2024-09-13T05:56:25.913 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-13T05:56:25.929 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T05:56:26.021 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/tchandra-2024-09-13_05:06:18-rgw-wip-tejas-testing-2024-09-09-1611-squid-distro-default-smithi/7903244 branch: wip-tejas-testing-2024-09-09-1611-squid description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{ubuntu_latest}} email: tchandra@redhat.com first_in_suite: false job_id: '7903244' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: tchandra-2024-09-13_05:06:18-rgw-wip-tejas-testing-2024-09-09-1611-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-tejas-testing-2024-09-09-1611-squid ceph: conf: client: debug rgw: 20 setgroup: ceph setuser: ceph mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled sha1: 7162ca8a22368558b9ec845c47e93c7afc45e8c3 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 7162ca8a22368558b9ec845c47e93c7afc45e8c3 rgw: ec-data-pool: true erasure_code_profile: crush-failure-domain: osd k: 3 m: 1 name: testprofile frontend: beast s3tests: slow_backend: true thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-tejas-testing-2024-09-09-1611-squid sha1: 7162ca8a22368558b9ec845c47e93c7afc45e8c3 owner: scheduled_tchandra@teuthology priority: 100 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - osd.0 - - mgr.x - client.0 - osd.1 - osd.2 - osd.3 seed: 9276 sha1: 7162ca8a22368558b9ec845c47e93c7afc45e8c3 sleep_before_teardown: 0 suite: rgw suite_branch: wip-tejas-testing-2024-09-09-1611-squid suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_7162ca8a22368558b9ec845c47e93c7afc45e8c3/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 7162ca8a22368558b9ec845c47e93c7afc45e8c3 targets: smithi120.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO79P+9X1hZdCsaAV6ToaJG9Q0lBjrnAiknFG59spMhgZvF9CYKDpI6UogwMiTO1vvswat/B/mYw3YTtL4JinYQ= smithi194.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJkDh+3szbWsGkQ1AIRtgMqDVSJl/meyrZw1rOMnLYSpzioY3Mm1hMaP57aI1r9zVs6uB0f/z9KEZOjS80udUR0= tasks: - install: null - ceph: conf: client: debug ms: 1 rgw gc obj min wait: 15 osd: debug ms: 1 debug objclass: 20 - rgw: client.0: null - radosgw-admin: null - radosgw-admin-rest: null teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-13_05:06:18 tube: smithi user: tchandra verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-13T05:56:26.021 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_7162ca8a22368558b9ec845c47e93c7afc45e8c3/qa; will attempt to use it 2024-09-13T05:56:26.022 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_7162ca8a22368558b9ec845c47e93c7afc45e8c3/qa/tasks 2024-09-13T05:56:26.022 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-13T05:56:26.024 INFO:teuthology.task.internal:Checking packages... 2024-09-13T05:56:26.045 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '7162ca8a22368558b9ec845c47e93c7afc45e8c3' 2024-09-13T05:56:26.045 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T05:56:26.045 INFO:teuthology.packaging:ref: None 2024-09-13T05:56:26.045 INFO:teuthology.packaging:tag: None 2024-09-13T05:56:26.045 INFO:teuthology.packaging:branch: wip-tejas-testing-2024-09-09-1611-squid 2024-09-13T05:56:26.045 INFO:teuthology.packaging:sha1: 7162ca8a22368558b9ec845c47e93c7afc45e8c3 2024-09-13T05:56:26.046 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-tejas-testing-2024-09-09-1611-squid 2024-09-13T05:56:26.199 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-304-g7162ca8a-1jammy 2024-09-13T05:56:26.200 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-13T05:56:26.207 INFO:teuthology.task.internal:no buildpackages task found 2024-09-13T05:56:26.207 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-13T05:56:26.215 INFO:teuthology.task.internal:Saving configuration 2024-09-13T05:56:26.229 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-13T05:56:26.235 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-13T05:56:26.268 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi120.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/tchandra-2024-09-13_05:06:18-rgw-wip-tejas-testing-2024-09-09-1611-squid-distro-default-smithi/7903244', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 05:49:55.231675', 'locked_by': 'scheduled_tchandra@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHmNp5i7m94pxoq4GwuSXdAOdL6RL8i4P7tsw4LZSUWx'} 2024-09-13T05:56:26.298 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi194.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/tchandra-2024-09-13_05:06:18-rgw-wip-tejas-testing-2024-09-09-1611-squid-distro-default-smithi/7903244', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 05:49:55.233128', 'locked_by': 'scheduled_tchandra@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAINkLMwrSSOdl5w+uFX4DwZNyM+FYm00wMwAgUo5/7L03'} 2024-09-13T05:56:26.298 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-13T05:56:26.304 INFO:teuthology.task.internal:roles: ubuntu@smithi120.front.sepia.ceph.com - ['mon.a', 'osd.0'] 2024-09-13T05:56:26.305 INFO:teuthology.task.internal:roles: ubuntu@smithi194.front.sepia.ceph.com - ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3'] 2024-09-13T05:56:26.305 INFO:teuthology.run_tasks:Running task console_log... 2024-09-13T05:56:26.383 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe3ab20bbe0>, signals=[15]) 2024-09-13T05:56:26.383 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-13T05:56:26.389 INFO:teuthology.task.internal:Opening connections... 2024-09-13T05:56:26.389 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi120.front.sepia.ceph.com 2024-09-13T05:56:26.391 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T05:56:26.494 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi194.front.sepia.ceph.com 2024-09-13T05:56:26.495 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T05:56:26.580 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-13T05:56:26.589 DEBUG:teuthology.orchestra.run.smithi120:> uname -m 2024-09-13T05:56:26.594 INFO:teuthology.orchestra.run.smithi120.stdout:x86_64 2024-09-13T05:56:26.594 DEBUG:teuthology.orchestra.run.smithi120:> cat /etc/os-release 2024-09-13T05:56:26.641 INFO:teuthology.orchestra.run.smithi120.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-13T05:56:26.641 INFO:teuthology.orchestra.run.smithi120.stdout:NAME="Ubuntu" 2024-09-13T05:56:26.641 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_ID="22.04" 2024-09-13T05:56:26.641 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-13T05:56:26.642 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_CODENAME=jammy 2024-09-13T05:56:26.642 INFO:teuthology.orchestra.run.smithi120.stdout:ID=ubuntu 2024-09-13T05:56:26.642 INFO:teuthology.orchestra.run.smithi120.stdout:ID_LIKE=debian 2024-09-13T05:56:26.642 INFO:teuthology.orchestra.run.smithi120.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-13T05:56:26.642 INFO:teuthology.orchestra.run.smithi120.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-13T05:56:26.642 INFO:teuthology.orchestra.run.smithi120.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-13T05:56:26.642 INFO:teuthology.orchestra.run.smithi120.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-13T05:56:26.642 INFO:teuthology.orchestra.run.smithi120.stdout:UBUNTU_CODENAME=jammy 2024-09-13T05:56:26.643 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server 2024-09-13T05:56:26.673 DEBUG:teuthology.orchestra.run.smithi194:> uname -m 2024-09-13T05:56:26.679 INFO:teuthology.orchestra.run.smithi194.stdout:x86_64 2024-09-13T05:56:26.679 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release 2024-09-13T05:56:26.727 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-13T05:56:26.727 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="Ubuntu" 2024-09-13T05:56:26.727 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="22.04" 2024-09-13T05:56:26.727 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-13T05:56:26.728 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_CODENAME=jammy 2024-09-13T05:56:26.728 INFO:teuthology.orchestra.run.smithi194.stdout:ID=ubuntu 2024-09-13T05:56:26.728 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE=debian 2024-09-13T05:56:26.728 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-13T05:56:26.728 INFO:teuthology.orchestra.run.smithi194.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-13T05:56:26.728 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-13T05:56:26.728 INFO:teuthology.orchestra.run.smithi194.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-13T05:56:26.728 INFO:teuthology.orchestra.run.smithi194.stdout:UBUNTU_CODENAME=jammy 2024-09-13T05:56:26.728 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server 2024-09-13T05:56:26.756 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-13T05:56:26.765 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-13T05:56:26.770 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-13T05:56:26.770 DEBUG:teuthology.orchestra.run.smithi120:> test '!' -e /home/ubuntu/cephtest 2024-09-13T05:56:26.773 DEBUG:teuthology.orchestra.run.smithi194:> test '!' -e /home/ubuntu/cephtest 2024-09-13T05:56:26.777 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-13T05:56:26.783 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-13T05:56:26.783 DEBUG:teuthology.orchestra.run.smithi120:> test -z $(ls -A /var/lib/ceph) 2024-09-13T05:56:26.819 DEBUG:teuthology.orchestra.run.smithi194:> test -z $(ls -A /var/lib/ceph) 2024-09-13T05:56:26.825 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-13T05:56:26.898 INFO:teuthology.run_tasks:Running task kernel... 2024-09-13T05:56:26.914 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-13T05:56:26.914 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mgr.x': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-13T05:56:26.915 DEBUG:teuthology.orchestra.run.smithi120:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T05:56:26.915 DEBUG:teuthology.orchestra.run.smithi194:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T05:56:26.919 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T05:56:26.920 DEBUG:teuthology.orchestra.run.smithi120:> uname -r 2024-09-13T05:56:26.920 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T05:56:26.921 DEBUG:teuthology.orchestra.run.smithi194:> uname -r 2024-09-13T05:56:26.966 INFO:teuthology.orchestra.run.smithi120.stdout:5.15.0-56-generic 2024-09-13T05:56:26.966 INFO:teuthology.task.kernel:Running kernel on smithi120: 5.15.0-56-generic 2024-09-13T05:56:26.966 DEBUG:teuthology.orchestra.run.smithi120:> sudo apt-get clean 2024-09-13T05:56:26.968 INFO:teuthology.orchestra.run.smithi194.stdout:5.15.0-56-generic 2024-09-13T05:56:26.968 INFO:teuthology.task.kernel:Running kernel on smithi194: 5.15.0-56-generic 2024-09-13T05:56:26.968 DEBUG:teuthology.orchestra.run.smithi194:> sudo apt-get clean 2024-09-13T05:56:27.090 DEBUG:teuthology.orchestra.run.smithi120:> sudo apt-get update 2024-09-13T05:56:27.118 DEBUG:teuthology.orchestra.run.smithi194:> sudo apt-get update 2024-09-13T05:56:27.219 INFO:teuthology.orchestra.run.smithi120.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T05:56:27.245 INFO:teuthology.orchestra.run.smithi120.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-13T05:56:27.283 INFO:teuthology.orchestra.run.smithi194.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T05:56:27.284 INFO:teuthology.orchestra.run.smithi194.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-13T05:56:27.284 INFO:teuthology.orchestra.run.smithi194.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-13T05:56:27.308 INFO:teuthology.orchestra.run.smithi120.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-13T05:56:27.334 INFO:teuthology.orchestra.run.smithi120.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-13T05:56:27.343 INFO:teuthology.orchestra.run.smithi194.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-13T05:56:27.467 INFO:teuthology.orchestra.run.smithi120.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [696 kB] 2024-09-13T05:56:27.520 INFO:teuthology.orchestra.run.smithi194.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-13T05:56:27.530 INFO:teuthology.orchestra.run.smithi120.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,022 kB] 2024-09-13T05:56:27.563 INFO:teuthology.orchestra.run.smithi120.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [352 kB] 2024-09-13T05:56:27.566 INFO:teuthology.orchestra.run.smithi120.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-13T05:56:27.567 INFO:teuthology.orchestra.run.smithi120.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-13T05:56:27.567 INFO:teuthology.orchestra.run.smithi120.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,437 kB] 2024-09-13T05:56:27.583 INFO:teuthology.orchestra.run.smithi120.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [419 kB] 2024-09-13T05:56:27.586 INFO:teuthology.orchestra.run.smithi120.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-13T05:56:27.586 INFO:teuthology.orchestra.run.smithi120.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-13T05:56:27.591 INFO:teuthology.orchestra.run.smithi120.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-13T05:56:27.596 INFO:teuthology.orchestra.run.smithi194.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [696 kB] 2024-09-13T05:56:27.598 INFO:teuthology.orchestra.run.smithi120.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-13T05:56:27.600 INFO:teuthology.orchestra.run.smithi120.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-13T05:56:27.601 INFO:teuthology.orchestra.run.smithi120.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-13T05:56:27.601 INFO:teuthology.orchestra.run.smithi120.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-13T05:56:27.601 INFO:teuthology.orchestra.run.smithi120.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-13T05:56:27.640 INFO:teuthology.orchestra.run.smithi120.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-13T05:56:27.641 INFO:teuthology.orchestra.run.smithi120.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-13T05:56:27.641 INFO:teuthology.orchestra.run.smithi120.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-13T05:56:27.642 INFO:teuthology.orchestra.run.smithi194.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-13T05:56:27.643 INFO:teuthology.orchestra.run.smithi120.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-13T05:56:27.643 INFO:teuthology.orchestra.run.smithi120.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-13T05:56:27.643 INFO:teuthology.orchestra.run.smithi120.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-13T05:56:27.643 INFO:teuthology.orchestra.run.smithi120.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-13T05:56:27.643 INFO:teuthology.orchestra.run.smithi120.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-13T05:56:27.643 INFO:teuthology.orchestra.run.smithi120.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-13T05:56:27.648 INFO:teuthology.orchestra.run.smithi194.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-13T05:56:27.652 INFO:teuthology.orchestra.run.smithi194.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-13T05:56:27.652 INFO:teuthology.orchestra.run.smithi194.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-13T05:56:27.657 INFO:teuthology.orchestra.run.smithi194.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,022 kB] 2024-09-13T05:56:27.675 INFO:teuthology.orchestra.run.smithi194.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-13T05:56:27.675 INFO:teuthology.orchestra.run.smithi194.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-13T05:56:27.679 INFO:teuthology.orchestra.run.smithi194.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-13T05:56:27.679 INFO:teuthology.orchestra.run.smithi194.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-13T05:56:27.684 INFO:teuthology.orchestra.run.smithi194.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-13T05:56:27.690 INFO:teuthology.orchestra.run.smithi194.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-13T05:56:27.692 INFO:teuthology.orchestra.run.smithi194.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-13T05:56:27.717 INFO:teuthology.orchestra.run.smithi194.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [352 kB] 2024-09-13T05:56:27.717 INFO:teuthology.orchestra.run.smithi194.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-13T05:56:27.717 INFO:teuthology.orchestra.run.smithi194.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-13T05:56:27.717 INFO:teuthology.orchestra.run.smithi194.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-13T05:56:27.717 INFO:teuthology.orchestra.run.smithi194.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-13T05:56:27.723 INFO:teuthology.orchestra.run.smithi194.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-13T05:56:27.724 INFO:teuthology.orchestra.run.smithi194.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-13T05:56:27.725 INFO:teuthology.orchestra.run.smithi194.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,437 kB] 2024-09-13T05:56:27.761 INFO:teuthology.orchestra.run.smithi194.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [419 kB] 2024-09-13T05:56:27.765 INFO:teuthology.orchestra.run.smithi194.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-13T05:56:27.765 INFO:teuthology.orchestra.run.smithi194.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-13T05:56:27.773 INFO:teuthology.orchestra.run.smithi194.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-13T05:56:27.791 INFO:teuthology.orchestra.run.smithi120.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-13T05:56:27.792 INFO:teuthology.orchestra.run.smithi194.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-13T05:56:27.794 INFO:teuthology.orchestra.run.smithi194.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-13T05:56:27.794 INFO:teuthology.orchestra.run.smithi194.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-13T05:56:27.795 INFO:teuthology.orchestra.run.smithi194.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-13T05:56:27.795 INFO:teuthology.orchestra.run.smithi194.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-13T05:56:27.795 INFO:teuthology.orchestra.run.smithi194.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-13T05:56:27.797 INFO:teuthology.orchestra.run.smithi194.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-13T05:56:27.798 INFO:teuthology.orchestra.run.smithi194.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-13T05:56:27.799 INFO:teuthology.orchestra.run.smithi194.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-13T05:56:27.815 INFO:teuthology.orchestra.run.smithi194.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-13T05:56:27.815 INFO:teuthology.orchestra.run.smithi194.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-13T05:56:27.815 INFO:teuthology.orchestra.run.smithi194.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-13T05:56:27.815 INFO:teuthology.orchestra.run.smithi194.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-13T05:56:27.816 INFO:teuthology.orchestra.run.smithi194.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-13T05:56:28.212 INFO:teuthology.orchestra.run.smithi120.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-13T05:56:28.231 INFO:teuthology.orchestra.run.smithi120.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-13T05:56:28.237 INFO:teuthology.orchestra.run.smithi120.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-13T05:56:28.237 INFO:teuthology.orchestra.run.smithi120.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-13T05:56:28.238 INFO:teuthology.orchestra.run.smithi120.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-13T05:56:28.336 INFO:teuthology.orchestra.run.smithi120.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-13T05:56:28.347 INFO:teuthology.orchestra.run.smithi120.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-13T05:56:28.347 INFO:teuthology.orchestra.run.smithi120.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-13T05:56:28.362 INFO:teuthology.orchestra.run.smithi120.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-13T05:56:28.392 INFO:teuthology.orchestra.run.smithi120.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-13T05:56:28.394 INFO:teuthology.orchestra.run.smithi120.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-13T05:56:28.398 INFO:teuthology.orchestra.run.smithi120.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-13T05:56:28.398 INFO:teuthology.orchestra.run.smithi120.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-13T05:56:28.398 INFO:teuthology.orchestra.run.smithi120.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-13T05:56:28.479 INFO:teuthology.orchestra.run.smithi120.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-13T05:56:33.877 INFO:teuthology.orchestra.run.smithi120.stdout:Fetched 16.0 MB in 2s (7,399 kB/s) 2024-09-13T05:56:33.972 INFO:teuthology.orchestra.run.smithi194.stdout:Fetched 16.0 MB in 2s (7,260 kB/s) 2024-09-13T05:56:35.321 INFO:teuthology.orchestra.run.smithi120.stdout:Reading package lists... 2024-09-13T05:56:35.323 INFO:teuthology.orchestra.run.smithi194.stdout:Reading package lists... 2024-09-13T05:56:35.339 DEBUG:teuthology.orchestra.run.smithi120:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-13T05:56:35.341 DEBUG:teuthology.orchestra.run.smithi194:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-13T05:56:35.403 INFO:teuthology.orchestra.run.smithi194.stdout:Reading package lists... 2024-09-13T05:56:35.403 INFO:teuthology.orchestra.run.smithi120.stdout:Reading package lists... 2024-09-13T05:56:35.614 INFO:teuthology.orchestra.run.smithi120.stdout:Building dependency tree... 2024-09-13T05:56:35.614 INFO:teuthology.orchestra.run.smithi120.stdout:Reading state information... 2024-09-13T05:56:35.614 INFO:teuthology.orchestra.run.smithi194.stdout:Building dependency tree... 2024-09-13T05:56:35.615 INFO:teuthology.orchestra.run.smithi194.stdout:Reading state information... 2024-09-13T05:56:35.792 INFO:teuthology.orchestra.run.smithi120.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T05:56:35.792 INFO:teuthology.orchestra.run.smithi120.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T05:56:35.792 INFO:teuthology.orchestra.run.smithi120.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T05:56:35.793 INFO:teuthology.orchestra.run.smithi120.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T05:56:35.793 INFO:teuthology.orchestra.run.smithi120.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-13T05:56:35.793 INFO:teuthology.orchestra.run.smithi120.stdout: python2.7-minimal 2024-09-13T05:56:35.793 INFO:teuthology.orchestra.run.smithi120.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T05:56:35.794 INFO:teuthology.orchestra.run.smithi194.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T05:56:35.794 INFO:teuthology.orchestra.run.smithi194.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T05:56:35.794 INFO:teuthology.orchestra.run.smithi194.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T05:56:35.794 INFO:teuthology.orchestra.run.smithi194.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T05:56:35.795 INFO:teuthology.orchestra.run.smithi194.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-13T05:56:35.795 INFO:teuthology.orchestra.run.smithi194.stdout: python2.7-minimal 2024-09-13T05:56:35.795 INFO:teuthology.orchestra.run.smithi194.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T05:56:35.795 INFO:teuthology.orchestra.run.smithi120.stdout:The following additional packages will be installed: 2024-09-13T05:56:35.795 INFO:teuthology.orchestra.run.smithi120.stdout: linux-generic linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-13T05:56:35.795 INFO:teuthology.orchestra.run.smithi120.stdout: linux-headers-generic linux-image-5.15.0-121-generic 2024-09-13T05:56:35.795 INFO:teuthology.orchestra.run.smithi120.stdout: linux-modules-5.15.0-121-generic linux-modules-extra-5.15.0-121-generic 2024-09-13T05:56:35.796 INFO:teuthology.orchestra.run.smithi194.stdout:The following additional packages will be installed: 2024-09-13T05:56:35.796 INFO:teuthology.orchestra.run.smithi194.stdout: linux-generic linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-13T05:56:35.796 INFO:teuthology.orchestra.run.smithi194.stdout: linux-headers-generic linux-image-5.15.0-121-generic 2024-09-13T05:56:35.796 INFO:teuthology.orchestra.run.smithi194.stdout: linux-modules-5.15.0-121-generic linux-modules-extra-5.15.0-121-generic 2024-09-13T05:56:35.797 INFO:teuthology.orchestra.run.smithi120.stdout:Suggested packages: 2024-09-13T05:56:35.797 INFO:teuthology.orchestra.run.smithi120.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-13T05:56:35.797 INFO:teuthology.orchestra.run.smithi120.stdout:Recommended packages: 2024-09-13T05:56:35.797 INFO:teuthology.orchestra.run.smithi120.stdout: thermald 2024-09-13T05:56:35.797 INFO:teuthology.orchestra.run.smithi194.stdout:Suggested packages: 2024-09-13T05:56:35.797 INFO:teuthology.orchestra.run.smithi194.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-13T05:56:35.798 INFO:teuthology.orchestra.run.smithi194.stdout:Recommended packages: 2024-09-13T05:56:35.798 INFO:teuthology.orchestra.run.smithi194.stdout: thermald 2024-09-13T05:56:35.841 INFO:teuthology.orchestra.run.smithi194.stdout:The following NEW packages will be installed: 2024-09-13T05:56:35.841 INFO:teuthology.orchestra.run.smithi194.stdout: linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-13T05:56:35.842 INFO:teuthology.orchestra.run.smithi194.stdout: linux-image-5.15.0-121-generic linux-modules-5.15.0-121-generic 2024-09-13T05:56:35.842 INFO:teuthology.orchestra.run.smithi120.stdout:The following NEW packages will be installed: 2024-09-13T05:56:35.842 INFO:teuthology.orchestra.run.smithi120.stdout: linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-13T05:56:35.842 INFO:teuthology.orchestra.run.smithi120.stdout: linux-image-5.15.0-121-generic linux-modules-5.15.0-121-generic 2024-09-13T05:56:35.843 INFO:teuthology.orchestra.run.smithi194.stdout: linux-modules-extra-5.15.0-121-generic 2024-09-13T05:56:35.843 INFO:teuthology.orchestra.run.smithi120.stdout: linux-modules-extra-5.15.0-121-generic 2024-09-13T05:56:35.843 INFO:teuthology.orchestra.run.smithi194.stdout:The following packages will be upgraded: 2024-09-13T05:56:35.844 INFO:teuthology.orchestra.run.smithi120.stdout:The following packages will be upgraded: 2024-09-13T05:56:35.844 INFO:teuthology.orchestra.run.smithi194.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-13T05:56:35.844 INFO:teuthology.orchestra.run.smithi120.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-13T05:56:35.895 INFO:teuthology.orchestra.run.smithi194.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-13T05:56:35.896 INFO:teuthology.orchestra.run.smithi194.stdout:Need to get 113 MB of archives. 2024-09-13T05:56:35.896 INFO:teuthology.orchestra.run.smithi194.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-13T05:56:35.896 INFO:teuthology.orchestra.run.smithi194.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-121-generic amd64 5.15.0-121.131 [22.7 MB] 2024-09-13T05:56:36.024 INFO:teuthology.orchestra.run.smithi120.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-13T05:56:36.024 INFO:teuthology.orchestra.run.smithi120.stdout:Need to get 113 MB of archives. 2024-09-13T05:56:36.024 INFO:teuthology.orchestra.run.smithi120.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-13T05:56:36.024 INFO:teuthology.orchestra.run.smithi120.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-121-generic amd64 5.15.0-121.131 [22.7 MB] 2024-09-13T05:56:36.318 INFO:teuthology.orchestra.run.smithi194.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-121-generic amd64 5.15.0-121.131 [11.5 MB] 2024-09-13T05:56:36.413 INFO:teuthology.orchestra.run.smithi194.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-121-generic amd64 5.15.0-121.131 [63.9 MB] 2024-09-13T05:56:37.195 INFO:teuthology.orchestra.run.smithi194.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.121.121 [1,694 B] 2024-09-13T05:56:37.196 INFO:teuthology.orchestra.run.smithi194.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.121.121 [2,464 B] 2024-09-13T05:56:37.208 INFO:teuthology.orchestra.run.smithi194.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121 all 5.15.0-121.131 [12.3 MB] 2024-09-13T05:56:37.328 INFO:teuthology.orchestra.run.smithi194.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121-generic amd64 5.15.0-121.131 [2,827 kB] 2024-09-13T05:56:37.409 INFO:teuthology.orchestra.run.smithi194.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.121.121 [2,316 B] 2024-09-13T05:56:37.607 INFO:teuthology.orchestra.run.smithi120.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-121-generic amd64 5.15.0-121.131 [11.5 MB] 2024-09-13T05:56:37.812 INFO:teuthology.orchestra.run.smithi194.stdout:Fetched 113 MB in 2s (72.7 MB/s) 2024-09-13T05:56:37.960 INFO:teuthology.orchestra.run.smithi120.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-121-generic amd64 5.15.0-121.131 [63.9 MB] 2024-09-13T05:56:38.004 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package linux-modules-5.15.0-121-generic. 2024-09-13T05:56:39.899 INFO:teuthology.orchestra.run.smithi194.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-13T05:56:39.903 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../0-linux-modules-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T05:56:40.018 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T05:56:40.197 INFO:teuthology.orchestra.run.smithi120.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.121.121 [1,694 B] 2024-09-13T05:56:40.197 INFO:teuthology.orchestra.run.smithi120.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.121.121 [2,464 B] 2024-09-13T05:56:40.198 INFO:teuthology.orchestra.run.smithi120.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121 all 5.15.0-121.131 [12.3 MB] 2024-09-13T05:56:40.541 INFO:teuthology.orchestra.run.smithi120.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121-generic amd64 5.15.0-121.131 [2,827 kB] 2024-09-13T05:56:40.620 INFO:teuthology.orchestra.run.smithi120.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.121.121 [2,316 B] 2024-09-13T05:56:41.057 INFO:teuthology.orchestra.run.smithi120.stdout:Fetched 113 MB in 5s (23.8 MB/s) 2024-09-13T05:56:41.187 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package linux-modules-5.15.0-121-generic. 2024-09-13T05:56:42.160 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package linux-image-5.15.0-121-generic. 2024-09-13T05:56:42.180 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../1-linux-image-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T05:56:42.259 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T05:56:42.763 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-121-generic. 2024-09-13T05:56:42.784 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T05:56:42.846 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T05:56:43.198 INFO:teuthology.orchestra.run.smithi120.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-13T05:56:43.202 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../0-linux-modules-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T05:56:43.267 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T05:56:45.742 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package linux-image-5.15.0-121-generic. 2024-09-13T05:56:45.763 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../1-linux-image-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T05:56:45.853 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T05:56:46.354 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-121-generic. 2024-09-13T05:56:46.374 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T05:56:46.412 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T05:56:49.869 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../3-linux-generic_5.15.0.121.121_amd64.deb ... 2024-09-13T05:56:49.987 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking linux-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-13T05:56:50.387 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.121.121_amd64.deb ... 2024-09-13T05:56:50.524 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking linux-image-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-13T05:56:50.794 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package linux-headers-5.15.0-121. 2024-09-13T05:56:50.805 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../5-linux-headers-5.15.0-121_5.15.0-121.131_all.deb ... 2024-09-13T05:56:50.835 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-13T05:56:52.864 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../3-linux-generic_5.15.0.121.121_amd64.deb ... 2024-09-13T05:56:53.007 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking linux-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-13T05:56:53.332 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.121.121_amd64.deb ... 2024-09-13T05:56:53.444 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking linux-image-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-13T05:56:53.723 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package linux-headers-5.15.0-121. 2024-09-13T05:56:53.736 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../5-linux-headers-5.15.0-121_5.15.0-121.131_all.deb ... 2024-09-13T05:56:53.772 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-13T05:56:56.942 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package linux-headers-5.15.0-121-generic. 2024-09-13T05:56:56.979 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../6-linux-headers-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T05:56:57.017 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T05:56:59.691 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package linux-headers-5.15.0-121-generic. 2024-09-13T05:56:59.728 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../6-linux-headers-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T05:56:59.766 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T05:56:59.785 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.121.121_amd64.deb ... 2024-09-13T05:56:59.935 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking linux-headers-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-13T05:57:00.285 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-13T05:57:00.389 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T05:57:00.507 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up linux-headers-generic (5.15.0.121.121) ... 2024-09-13T05:57:00.627 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T05:57:01.927 INFO:teuthology.orchestra.run.smithi194.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-13T05:57:01.927 INFO:teuthology.orchestra.run.smithi194.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-13T05:57:01.927 INFO:teuthology.orchestra.run.smithi194.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-121-generic 2024-09-13T05:57:01.927 INFO:teuthology.orchestra.run.smithi194.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-121-generic 2024-09-13T05:57:02.070 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T05:57:02.332 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.121.121_amd64.deb ... 2024-09-13T05:57:02.441 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking linux-headers-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-13T05:57:03.158 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-13T05:57:03.697 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T05:57:03.815 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up linux-headers-generic (5.15.0.121.121) ... 2024-09-13T05:57:03.943 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T05:57:03.996 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T05:57:05.277 INFO:teuthology.orchestra.run.smithi120.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-13T05:57:05.277 INFO:teuthology.orchestra.run.smithi120.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-13T05:57:05.278 INFO:teuthology.orchestra.run.smithi120.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-121-generic 2024-09-13T05:57:05.278 INFO:teuthology.orchestra.run.smithi120.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-121-generic 2024-09-13T05:57:05.440 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up linux-image-generic (5.15.0.121.121) ... 2024-09-13T05:57:05.464 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T05:57:05.565 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up linux-generic (5.15.0.121.121) ... 2024-09-13T05:57:05.691 INFO:teuthology.orchestra.run.smithi194.stdout:Processing triggers for linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T05:57:05.755 INFO:teuthology.orchestra.run.smithi194.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-13T05:57:05.755 INFO:teuthology.orchestra.run.smithi194.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-121-generic 2024-09-13T05:57:06.848 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T05:57:08.224 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up linux-image-generic (5.15.0.121.121) ... 2024-09-13T05:57:08.350 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up linux-generic (5.15.0.121.121) ... 2024-09-13T05:57:08.476 INFO:teuthology.orchestra.run.smithi120.stdout:Processing triggers for linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T05:57:08.532 INFO:teuthology.orchestra.run.smithi120.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-13T05:57:08.533 INFO:teuthology.orchestra.run.smithi120.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-121-generic 2024-09-13T05:57:19.764 INFO:teuthology.orchestra.run.smithi194.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-13T05:57:19.764 INFO:teuthology.orchestra.run.smithi194.stdout:Sourcing file `/etc/default/grub' 2024-09-13T05:57:19.785 INFO:teuthology.orchestra.run.smithi194.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T05:57:19.807 INFO:teuthology.orchestra.run.smithi194.stdout:Generating grub configuration file ... 2024-09-13T05:57:20.117 INFO:teuthology.orchestra.run.smithi194.stdout:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-13T05:57:20.135 INFO:teuthology.orchestra.run.smithi194.stdout:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-13T05:57:20.469 INFO:teuthology.orchestra.run.smithi194.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-13T05:57:20.475 INFO:teuthology.orchestra.run.smithi194.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-13T05:57:20.549 INFO:teuthology.orchestra.run.smithi194.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-13T05:57:20.553 INFO:teuthology.orchestra.run.smithi194.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-13T05:57:20.747 INFO:teuthology.orchestra.run.smithi194.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-13T05:57:20.747 INFO:teuthology.orchestra.run.smithi194.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-13T05:57:20.747 INFO:teuthology.orchestra.run.smithi194.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-13T05:57:20.790 INFO:teuthology.orchestra.run.smithi194.stdout:done 2024-09-13T05:57:21.283 DEBUG:teuthology.orchestra.run.smithi194:> dpkg -s linux-image-generic 2024-09-13T05:57:21.309 INFO:teuthology.orchestra.run.smithi194.stdout:Package: linux-image-generic 2024-09-13T05:57:21.309 INFO:teuthology.orchestra.run.smithi194.stdout:Status: install ok installed 2024-09-13T05:57:21.309 INFO:teuthology.orchestra.run.smithi194.stdout:Priority: optional 2024-09-13T05:57:21.310 INFO:teuthology.orchestra.run.smithi194.stdout:Section: kernel 2024-09-13T05:57:21.310 INFO:teuthology.orchestra.run.smithi194.stdout:Installed-Size: 21 2024-09-13T05:57:21.310 INFO:teuthology.orchestra.run.smithi194.stdout:Maintainer: Ubuntu Kernel Team 2024-09-13T05:57:21.310 INFO:teuthology.orchestra.run.smithi194.stdout:Architecture: amd64 2024-09-13T05:57:21.310 INFO:teuthology.orchestra.run.smithi194.stdout:Source: linux-meta 2024-09-13T05:57:21.310 INFO:teuthology.orchestra.run.smithi194.stdout:Version: 5.15.0.121.121 2024-09-13T05:57:21.310 INFO:teuthology.orchestra.run.smithi194.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-13T05:57:21.310 INFO:teuthology.orchestra.run.smithi194.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-13T05:57:21.310 INFO:teuthology.orchestra.run.smithi194.stdout:Recommends: thermald 2024-09-13T05:57:21.310 INFO:teuthology.orchestra.run.smithi194.stdout:Description: Generic Linux kernel image 2024-09-13T05:57:21.310 INFO:teuthology.orchestra.run.smithi194.stdout: This package will always depend on the latest generic kernel image 2024-09-13T05:57:21.310 INFO:teuthology.orchestra.run.smithi194.stdout: available. 2024-09-13T05:57:21.311 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-121-generic 2024-09-13T05:57:21.311 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T05:57:21.311 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T05:57:21.311 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-09-13T05:57:21.311 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi194.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T05:57:21.311 DEBUG:teuthology.orchestra.run.smithi194:> sudo apt-get clean 2024-09-13T05:57:21.501 DEBUG:teuthology.orchestra.run.smithi194:> sudo apt-get update 2024-09-13T05:57:21.645 INFO:teuthology.orchestra.run.smithi194.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-13T05:57:21.745 INFO:teuthology.orchestra.run.smithi194.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T05:57:21.826 INFO:teuthology.orchestra.run.smithi194.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-13T05:57:22.182 INFO:teuthology.orchestra.run.smithi194.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-13T05:57:22.371 INFO:teuthology.orchestra.run.smithi194.stdout:Fetched 128 kB in 1s (182 kB/s) 2024-09-13T05:57:23.053 INFO:teuthology.orchestra.run.smithi120.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-13T05:57:23.053 INFO:teuthology.orchestra.run.smithi120.stdout:Sourcing file `/etc/default/grub' 2024-09-13T05:57:23.069 INFO:teuthology.orchestra.run.smithi120.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T05:57:23.091 INFO:teuthology.orchestra.run.smithi120.stdout:Generating grub configuration file ... 2024-09-13T05:57:23.383 INFO:teuthology.orchestra.run.smithi120.stdout:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-13T05:57:23.394 INFO:teuthology.orchestra.run.smithi194.stdout:Reading package lists... 2024-09-13T05:57:23.403 INFO:teuthology.orchestra.run.smithi120.stdout:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-13T05:57:23.413 DEBUG:teuthology.orchestra.run.smithi194:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-13T05:57:23.468 INFO:teuthology.orchestra.run.smithi194.stdout:Reading package lists... 2024-09-13T05:57:23.665 INFO:teuthology.orchestra.run.smithi194.stdout:Building dependency tree... 2024-09-13T05:57:23.665 INFO:teuthology.orchestra.run.smithi194.stdout:Reading state information... 2024-09-13T05:57:23.710 INFO:teuthology.orchestra.run.smithi120.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-13T05:57:23.716 INFO:teuthology.orchestra.run.smithi120.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-13T05:57:23.780 INFO:teuthology.orchestra.run.smithi120.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-13T05:57:23.786 INFO:teuthology.orchestra.run.smithi120.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-13T05:57:23.833 INFO:teuthology.orchestra.run.smithi194.stdout:linux-image-generic is already the newest version (5.15.0.121.121). 2024-09-13T05:57:23.834 INFO:teuthology.orchestra.run.smithi194.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T05:57:23.834 INFO:teuthology.orchestra.run.smithi194.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T05:57:23.834 INFO:teuthology.orchestra.run.smithi194.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T05:57:23.834 INFO:teuthology.orchestra.run.smithi194.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T05:57:23.834 INFO:teuthology.orchestra.run.smithi194.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-13T05:57:23.834 INFO:teuthology.orchestra.run.smithi194.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-13T05:57:23.835 INFO:teuthology.orchestra.run.smithi194.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T05:57:23.875 INFO:teuthology.orchestra.run.smithi194.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-13T05:57:23.877 DEBUG:teuthology.orchestra.run.smithi194:> dpkg -s linux-image-generic 2024-09-13T05:57:23.929 INFO:teuthology.orchestra.run.smithi194.stdout:Package: linux-image-generic 2024-09-13T05:57:23.929 INFO:teuthology.orchestra.run.smithi194.stdout:Status: install ok installed 2024-09-13T05:57:23.930 INFO:teuthology.orchestra.run.smithi194.stdout:Priority: optional 2024-09-13T05:57:23.930 INFO:teuthology.orchestra.run.smithi194.stdout:Section: kernel 2024-09-13T05:57:23.930 INFO:teuthology.orchestra.run.smithi194.stdout:Installed-Size: 21 2024-09-13T05:57:23.930 INFO:teuthology.orchestra.run.smithi194.stdout:Maintainer: Ubuntu Kernel Team 2024-09-13T05:57:23.930 INFO:teuthology.orchestra.run.smithi194.stdout:Architecture: amd64 2024-09-13T05:57:23.930 INFO:teuthology.orchestra.run.smithi194.stdout:Source: linux-meta 2024-09-13T05:57:23.930 INFO:teuthology.orchestra.run.smithi194.stdout:Version: 5.15.0.121.121 2024-09-13T05:57:23.930 INFO:teuthology.orchestra.run.smithi194.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-13T05:57:23.930 INFO:teuthology.orchestra.run.smithi194.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-13T05:57:23.930 INFO:teuthology.orchestra.run.smithi194.stdout:Recommends: thermald 2024-09-13T05:57:23.930 INFO:teuthology.orchestra.run.smithi194.stdout:Description: Generic Linux kernel image 2024-09-13T05:57:23.930 INFO:teuthology.orchestra.run.smithi194.stdout: This package will always depend on the latest generic kernel image 2024-09-13T05:57:23.930 INFO:teuthology.orchestra.run.smithi194.stdout: available. 2024-09-13T05:57:23.931 DEBUG:teuthology.orchestra.run.smithi194:> mktemp 2024-09-13T05:57:23.961 INFO:teuthology.orchestra.run.smithi120.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-13T05:57:23.961 INFO:teuthology.orchestra.run.smithi120.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-13T05:57:23.961 INFO:teuthology.orchestra.run.smithi120.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-13T05:57:23.973 INFO:teuthology.orchestra.run.smithi194.stdout:/tmp/tmp.WQGktPSzCM 2024-09-13T05:57:23.974 DEBUG:teuthology.orchestra.run.smithi194:> sudo cp /boot/grub/grub.cfg /tmp/tmp.WQGktPSzCM 2024-09-13T05:57:24.005 INFO:teuthology.orchestra.run.smithi120.stdout:done 2024-09-13T05:57:24.026 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 0666 /tmp/tmp.WQGktPSzCM 2024-09-13T05:57:24.140 DEBUG:teuthology.orchestra.remote:smithi194:/tmp/tmp.WQGktPSzCM is 10KB 2024-09-13T05:57:24.153 DEBUG:teuthology.orchestra.run.smithi194:> rm -fr /tmp/tmp.WQGktPSzCM 2024-09-13T05:57:24.170 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-13T05:57:24.210 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T05:57:24.210 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-13T05:57:24.210 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-13T05:57:24.306 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-121-generic 2024-09-13T05:57:24.306 DEBUG:teuthology.orchestra.run.smithi194:> sudo update-grub 2024-09-13T05:57:24.501 DEBUG:teuthology.orchestra.run.smithi120:> dpkg -s linux-image-generic 2024-09-13T05:57:24.517 INFO:teuthology.orchestra.run.smithi120.stdout:Package: linux-image-generic 2024-09-13T05:57:24.517 INFO:teuthology.orchestra.run.smithi120.stdout:Status: install ok installed 2024-09-13T05:57:24.517 INFO:teuthology.orchestra.run.smithi120.stdout:Priority: optional 2024-09-13T05:57:24.517 INFO:teuthology.orchestra.run.smithi120.stdout:Section: kernel 2024-09-13T05:57:24.517 INFO:teuthology.orchestra.run.smithi120.stdout:Installed-Size: 21 2024-09-13T05:57:24.517 INFO:teuthology.orchestra.run.smithi120.stdout:Maintainer: Ubuntu Kernel Team 2024-09-13T05:57:24.517 INFO:teuthology.orchestra.run.smithi120.stdout:Architecture: amd64 2024-09-13T05:57:24.517 INFO:teuthology.orchestra.run.smithi120.stdout:Source: linux-meta 2024-09-13T05:57:24.517 INFO:teuthology.orchestra.run.smithi120.stdout:Version: 5.15.0.121.121 2024-09-13T05:57:24.517 INFO:teuthology.orchestra.run.smithi120.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-13T05:57:24.518 INFO:teuthology.orchestra.run.smithi120.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-13T05:57:24.518 INFO:teuthology.orchestra.run.smithi120.stdout:Recommends: thermald 2024-09-13T05:57:24.518 INFO:teuthology.orchestra.run.smithi120.stdout:Description: Generic Linux kernel image 2024-09-13T05:57:24.518 INFO:teuthology.orchestra.run.smithi120.stdout: This package will always depend on the latest generic kernel image 2024-09-13T05:57:24.518 INFO:teuthology.orchestra.run.smithi120.stdout: available. 2024-09-13T05:57:24.518 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-121-generic 2024-09-13T05:57:24.518 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T05:57:24.518 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T05:57:24.518 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-13T05:57:24.518 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi120.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T05:57:24.519 DEBUG:teuthology.orchestra.run.smithi120:> sudo apt-get clean 2024-09-13T05:57:24.684 DEBUG:teuthology.orchestra.run.smithi120:> sudo apt-get update 2024-09-13T05:57:24.936 INFO:teuthology.orchestra.run.smithi120.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T05:57:24.936 INFO:teuthology.orchestra.run.smithi120.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-13T05:57:25.002 INFO:teuthology.orchestra.run.smithi120.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-13T05:57:25.358 INFO:teuthology.orchestra.run.smithi120.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-13T05:57:25.546 INFO:teuthology.orchestra.run.smithi120.stdout:Fetched 257 kB in 1s (367 kB/s) 2024-09-13T05:57:25.638 INFO:teuthology.orchestra.run.smithi194.stderr:Sourcing file `/etc/default/grub' 2024-09-13T05:57:25.639 INFO:teuthology.orchestra.run.smithi194.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T05:57:25.643 INFO:teuthology.orchestra.run.smithi194.stderr:Generating grub configuration file ... 2024-09-13T05:57:25.832 INFO:teuthology.orchestra.run.smithi194.stderr:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-13T05:57:25.837 INFO:teuthology.orchestra.run.smithi194.stderr:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-13T05:57:26.099 INFO:teuthology.orchestra.run.smithi194.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-13T05:57:26.104 INFO:teuthology.orchestra.run.smithi194.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-13T05:57:26.143 INFO:teuthology.orchestra.run.smithi194.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-13T05:57:26.148 INFO:teuthology.orchestra.run.smithi194.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-13T05:57:26.291 INFO:teuthology.orchestra.run.smithi194.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-13T05:57:26.292 INFO:teuthology.orchestra.run.smithi194.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-13T05:57:26.292 INFO:teuthology.orchestra.run.smithi194.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-13T05:57:26.313 INFO:teuthology.orchestra.run.smithi194.stderr:done 2024-09-13T05:57:26.321 DEBUG:teuthology.orchestra.run.smithi194:> sudo shutdown -r now 2024-09-13T05:57:26.567 INFO:teuthology.orchestra.run.smithi120.stdout:Reading package lists... 2024-09-13T05:57:26.586 DEBUG:teuthology.orchestra.run.smithi120:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-13T05:57:26.639 INFO:teuthology.orchestra.run.smithi120.stdout:Reading package lists... 2024-09-13T05:57:26.825 INFO:teuthology.orchestra.run.smithi120.stdout:Building dependency tree... 2024-09-13T05:57:26.826 INFO:teuthology.orchestra.run.smithi120.stdout:Reading state information... 2024-09-13T05:57:26.997 INFO:teuthology.orchestra.run.smithi120.stdout:linux-image-generic is already the newest version (5.15.0.121.121). 2024-09-13T05:57:26.997 INFO:teuthology.orchestra.run.smithi120.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T05:57:26.997 INFO:teuthology.orchestra.run.smithi120.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T05:57:26.997 INFO:teuthology.orchestra.run.smithi120.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T05:57:26.997 INFO:teuthology.orchestra.run.smithi120.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T05:57:26.998 INFO:teuthology.orchestra.run.smithi120.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-13T05:57:26.998 INFO:teuthology.orchestra.run.smithi120.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-13T05:57:26.998 INFO:teuthology.orchestra.run.smithi120.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T05:57:27.040 INFO:teuthology.orchestra.run.smithi120.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-13T05:57:27.041 DEBUG:teuthology.orchestra.run.smithi120:> dpkg -s linux-image-generic 2024-09-13T05:57:27.103 INFO:teuthology.orchestra.run.smithi120.stdout:Package: linux-image-generic 2024-09-13T05:57:27.103 INFO:teuthology.orchestra.run.smithi120.stdout:Status: install ok installed 2024-09-13T05:57:27.103 INFO:teuthology.orchestra.run.smithi120.stdout:Priority: optional 2024-09-13T05:57:27.104 INFO:teuthology.orchestra.run.smithi120.stdout:Section: kernel 2024-09-13T05:57:27.104 INFO:teuthology.orchestra.run.smithi120.stdout:Installed-Size: 21 2024-09-13T05:57:27.104 INFO:teuthology.orchestra.run.smithi120.stdout:Maintainer: Ubuntu Kernel Team 2024-09-13T05:57:27.104 INFO:teuthology.orchestra.run.smithi120.stdout:Architecture: amd64 2024-09-13T05:57:27.104 INFO:teuthology.orchestra.run.smithi120.stdout:Source: linux-meta 2024-09-13T05:57:27.104 INFO:teuthology.orchestra.run.smithi120.stdout:Version: 5.15.0.121.121 2024-09-13T05:57:27.104 INFO:teuthology.orchestra.run.smithi120.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-13T05:57:27.104 INFO:teuthology.orchestra.run.smithi120.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-13T05:57:27.104 INFO:teuthology.orchestra.run.smithi120.stdout:Recommends: thermald 2024-09-13T05:57:27.104 INFO:teuthology.orchestra.run.smithi120.stdout:Description: Generic Linux kernel image 2024-09-13T05:57:27.104 INFO:teuthology.orchestra.run.smithi120.stdout: This package will always depend on the latest generic kernel image 2024-09-13T05:57:27.104 INFO:teuthology.orchestra.run.smithi120.stdout: available. 2024-09-13T05:57:27.105 DEBUG:teuthology.orchestra.run.smithi120:> mktemp 2024-09-13T05:57:27.149 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/tmp.jDgWgWYfv7 2024-09-13T05:57:27.149 DEBUG:teuthology.orchestra.run.smithi120:> sudo cp /boot/grub/grub.cfg /tmp/tmp.jDgWgWYfv7 2024-09-13T05:57:27.205 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 0666 /tmp/tmp.jDgWgWYfv7 2024-09-13T05:57:27.322 DEBUG:teuthology.orchestra.remote:smithi120:/tmp/tmp.jDgWgWYfv7 is 10KB 2024-09-13T05:57:27.334 DEBUG:teuthology.orchestra.run.smithi120:> rm -fr /tmp/tmp.jDgWgWYfv7 2024-09-13T05:57:27.339 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-13T05:57:27.393 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-13T05:57:27.393 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-13T05:57:27.393 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-13T05:57:27.470 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-121-generic 2024-09-13T05:57:27.470 DEBUG:teuthology.orchestra.run.smithi120:> sudo update-grub 2024-09-13T05:57:28.725 INFO:teuthology.orchestra.run.smithi120.stderr:Sourcing file `/etc/default/grub' 2024-09-13T05:57:28.727 INFO:teuthology.orchestra.run.smithi120.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T05:57:28.733 INFO:teuthology.orchestra.run.smithi120.stderr:Generating grub configuration file ... 2024-09-13T05:57:28.900 INFO:teuthology.orchestra.run.smithi120.stderr:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-13T05:57:28.906 INFO:teuthology.orchestra.run.smithi120.stderr:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-13T05:57:29.124 INFO:teuthology.orchestra.run.smithi120.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-13T05:57:29.129 INFO:teuthology.orchestra.run.smithi120.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-13T05:57:29.167 INFO:teuthology.orchestra.run.smithi120.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-13T05:57:29.171 INFO:teuthology.orchestra.run.smithi120.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-13T05:57:29.298 INFO:teuthology.orchestra.run.smithi120.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-13T05:57:29.298 INFO:teuthology.orchestra.run.smithi120.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-13T05:57:29.298 INFO:teuthology.orchestra.run.smithi120.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-13T05:57:29.308 INFO:teuthology.orchestra.run.smithi120.stderr:done 2024-09-13T05:57:29.309 DEBUG:teuthology.orchestra.run.smithi120:> sudo shutdown -r now 2024-09-13T05:57:56.350 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-09-13T05:57:56.351 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-09-13T05:57:56.352 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T05:57:59.313 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-13T05:57:59.313 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-09-13T05:57:59.314 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T05:58:14.849 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-09-13T05:58:17.665 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-09-13T05:58:23.856 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-09-13T05:58:23.857 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T05:58:26.668 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-09-13T05:58:26.669 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T05:58:26.941 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-09-13T05:58:29.757 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-09-13T05:58:38.949 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-09-13T05:58:38.950 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T05:58:41.761 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-09-13T05:58:41.761 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T05:58:57.345 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-09-13T05:59:00.161 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-09-13T05:59:12.357 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-09-13T05:59:12.359 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T05:59:12.699 DEBUG:teuthology.orchestra.run.smithi194:> true 2024-09-13T05:59:13.538 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-09-13T05:59:13.538 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.15.0-121-generic"... 2024-09-13T05:59:13.539 DEBUG:teuthology.orchestra.run.smithi194:> uname -r 2024-09-13T05:59:13.587 INFO:teuthology.orchestra.run.smithi194.stdout:5.15.0-121-generic 2024-09-13T05:59:13.587 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-121-generic vs 5.15.0-121-generic 2024-09-13T05:59:13.587 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T05:59:13.587 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-13T05:59:14.589 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-09-13T05:59:14.589 DEBUG:teuthology.orchestra.run.smithi194:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T05:59:14.669 INFO:teuthology.orchestra.run.smithi194.stdout:ttyS1 2024-09-13T05:59:14.709 DEBUG:teuthology.parallel:result is None 2024-09-13T05:59:15.162 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-09-13T05:59:15.163 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T05:59:15.464 DEBUG:teuthology.orchestra.run.smithi120:> true 2024-09-13T05:59:16.608 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-09-13T05:59:16.608 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-121-generic"... 2024-09-13T05:59:16.608 DEBUG:teuthology.orchestra.run.smithi120:> uname -r 2024-09-13T05:59:16.613 INFO:teuthology.orchestra.run.smithi120.stdout:5.15.0-121-generic 2024-09-13T05:59:16.614 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-121-generic vs 5.15.0-121-generic 2024-09-13T05:59:16.614 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T05:59:16.614 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-13T05:59:17.615 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-13T05:59:17.615 DEBUG:teuthology.orchestra.run.smithi120:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T05:59:17.764 INFO:teuthology.orchestra.run.smithi120.stdout:ttyS1 2024-09-13T05:59:17.809 DEBUG:teuthology.parallel:result is None 2024-09-13T05:59:17.810 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-13T05:59:17.818 INFO:teuthology.task.internal:Creating test directory... 2024-09-13T05:59:17.818 DEBUG:teuthology.orchestra.run.smithi120:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T05:59:17.821 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T05:59:17.828 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-13T05:59:17.835 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-13T05:59:17.846 INFO:teuthology.task.internal:Creating archive directory... 2024-09-13T05:59:17.846 DEBUG:teuthology.orchestra.run.smithi120:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T05:59:17.868 DEBUG:teuthology.orchestra.run.smithi194:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T05:59:17.956 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-13T05:59:17.965 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-13T05:59:17.965 DEBUG:teuthology.orchestra.run.smithi120:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T05:59:17.967 DEBUG:teuthology.orchestra.run.smithi194:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T05:59:17.987 INFO:teuthology.orchestra.run.smithi194.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T05:59:17.995 INFO:teuthology.orchestra.run.smithi194.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T05:59:18.000 INFO:teuthology.orchestra.run.smithi120.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T05:59:18.007 INFO:teuthology.orchestra.run.smithi120.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T05:59:18.008 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-13T05:59:18.016 INFO:teuthology.task.internal:Configuring sudo... 2024-09-13T05:59:18.016 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T05:59:18.053 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T05:59:18.067 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-13T05:59:18.107 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-13T05:59:18.107 DEBUG:teuthology.orchestra.run.smithi120:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T05:59:18.110 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T05:59:18.115 DEBUG:teuthology.orchestra.run.smithi120:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T05:59:18.160 DEBUG:teuthology.orchestra.run.smithi120:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T05:59:18.208 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-13T05:59:18.208 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T05:59:18.298 DEBUG:teuthology.orchestra.run.smithi194:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T05:59:18.304 DEBUG:teuthology.orchestra.run.smithi194:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T05:59:18.351 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T05:59:18.352 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T05:59:18.418 DEBUG:teuthology.orchestra.run.smithi120:> sudo service rsyslog restart 2024-09-13T05:59:18.421 DEBUG:teuthology.orchestra.run.smithi194:> sudo service rsyslog restart 2024-09-13T05:59:18.533 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-13T05:59:18.542 INFO:teuthology.task.internal:Starting timer... 2024-09-13T05:59:18.542 INFO:teuthology.run_tasks:Running task pcp... 2024-09-13T05:59:18.556 INFO:teuthology.run_tasks:Running task selinux... 2024-09-13T05:59:18.566 DEBUG:teuthology.task.selinux:Excluding smithi120: OS 'ubuntu' does not support SELinux 2024-09-13T05:59:18.567 DEBUG:teuthology.task.selinux:Excluding smithi194: OS 'ubuntu' does not support SELinux 2024-09-13T05:59:18.567 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-13T05:59:18.567 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-13T05:59:18.567 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-13T05:59:18.567 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-13T05:59:18.576 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-13T05:59:18.589 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-13T05:59:18.590 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi120.front.sepia.ceph.com,smithi194.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-13T06:06:53.453 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi120.front.sepia.ceph.com'), Remote(name='ubuntu@smithi194.front.sepia.ceph.com')] 2024-09-13T06:06:53.455 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-09-13T06:06:53.456 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T06:06:53.550 DEBUG:teuthology.orchestra.run.smithi120:> true 2024-09-13T06:06:53.625 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-09-13T06:06:53.625 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-09-13T06:06:53.625 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T06:06:53.713 DEBUG:teuthology.orchestra.run.smithi194:> true 2024-09-13T06:06:53.793 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-09-13T06:06:53.793 INFO:teuthology.run_tasks:Running task clock... 2024-09-13T06:06:53.804 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-13T06:06:53.805 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T06:06:53.805 DEBUG:teuthology.orchestra.run.smithi120:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T06:06:53.808 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T06:06:53.808 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T06:06:53.833 INFO:teuthology.orchestra.run.smithi120.stdout:13 Sep 06:06:53 ntpd[18461]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-13T06:06:53.833 INFO:teuthology.orchestra.run.smithi120.stdout:13 Sep 06:06:53 ntpd[18461]: Command line: ntpd -gq 2024-09-13T06:06:53.833 INFO:teuthology.orchestra.run.smithi120.stdout:13 Sep 06:06:53 ntpd[18461]: ---------------------------------------------------- 2024-09-13T06:06:53.833 INFO:teuthology.orchestra.run.smithi120.stdout:13 Sep 06:06:53 ntpd[18461]: ntp-4 is maintained by Network Time Foundation, 2024-09-13T06:06:53.833 INFO:teuthology.orchestra.run.smithi120.stdout:13 Sep 06:06:53 ntpd[18461]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-13T06:06:53.833 INFO:teuthology.orchestra.run.smithi120.stdout:13 Sep 06:06:53 ntpd[18461]: corporation. Support and training for ntp-4 are 2024-09-13T06:06:53.834 INFO:teuthology.orchestra.run.smithi120.stdout:13 Sep 06:06:53 ntpd[18461]: available at https://www.nwtime.org/support 2024-09-13T06:06:53.834 INFO:teuthology.orchestra.run.smithi120.stdout:13 Sep 06:06:53 ntpd[18461]: ---------------------------------------------------- 2024-09-13T06:06:53.834 INFO:teuthology.orchestra.run.smithi120.stdout:13 Sep 06:06:53 ntpd[18461]: proto: precision = 0.043 usec (-24) 2024-09-13T06:06:53.834 INFO:teuthology.orchestra.run.smithi120.stdout:13 Sep 06:06:53 ntpd[18461]: basedate set to 2022-02-04 2024-09-13T06:06:53.834 INFO:teuthology.orchestra.run.smithi120.stdout:13 Sep 06:06:53 ntpd[18461]: gps base set to 2022-02-06 (week 2196) 2024-09-13T06:06:53.834 INFO:teuthology.orchestra.run.smithi120.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T06:06:53.834 INFO:teuthology.orchestra.run.smithi120.stdout:13 Sep 06:06:53 ntpd[18461]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T06:06:53.835 INFO:teuthology.orchestra.run.smithi120.stdout:13 Sep 06:06:53 ntpd[18461]: restrict ::: KOD does nothing without LIMITED. 2024-09-13T06:06:53.835 INFO:teuthology.orchestra.run.smithi120.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-13T06:06:53.836 INFO:teuthology.orchestra.run.smithi120.stdout:13 Sep 06:06:53 ntpd[18461]: Listen and drop on 0 v6wildcard [::]:123 2024-09-13T06:06:53.836 INFO:teuthology.orchestra.run.smithi120.stdout:13 Sep 06:06:53 ntpd[18461]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-13T06:06:53.836 INFO:teuthology.orchestra.run.smithi120.stdout:13 Sep 06:06:53 ntpd[18461]: Listen normally on 2 lo 127.0.0.1:123 2024-09-13T06:06:53.836 INFO:teuthology.orchestra.run.smithi120.stdout:13 Sep 06:06:53 ntpd[18461]: Listen normally on 3 enp3s0f1 172.21.15.120:123 2024-09-13T06:06:53.836 INFO:teuthology.orchestra.run.smithi120.stdout:13 Sep 06:06:53 ntpd[18461]: Listen normally on 4 lo [::1]:123 2024-09-13T06:06:53.836 INFO:teuthology.orchestra.run.smithi120.stdout:13 Sep 06:06:53 ntpd[18461]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:478f%5]:123 2024-09-13T06:06:53.836 INFO:teuthology.orchestra.run.smithi120.stdout:13 Sep 06:06:53 ntpd[18461]: Listening on routing socket on fd #22 for interface updates 2024-09-13T06:06:53.863 INFO:teuthology.orchestra.run.smithi194.stdout:13 Sep 06:06:53 ntpd[18473]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-13T06:06:53.863 INFO:teuthology.orchestra.run.smithi194.stdout:13 Sep 06:06:53 ntpd[18473]: Command line: ntpd -gq 2024-09-13T06:06:53.863 INFO:teuthology.orchestra.run.smithi194.stdout:13 Sep 06:06:53 ntpd[18473]: ---------------------------------------------------- 2024-09-13T06:06:53.863 INFO:teuthology.orchestra.run.smithi194.stdout:13 Sep 06:06:53 ntpd[18473]: ntp-4 is maintained by Network Time Foundation, 2024-09-13T06:06:53.863 INFO:teuthology.orchestra.run.smithi194.stdout:13 Sep 06:06:53 ntpd[18473]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-13T06:06:53.864 INFO:teuthology.orchestra.run.smithi194.stdout:13 Sep 06:06:53 ntpd[18473]: corporation. Support and training for ntp-4 are 2024-09-13T06:06:53.864 INFO:teuthology.orchestra.run.smithi194.stdout:13 Sep 06:06:53 ntpd[18473]: available at https://www.nwtime.org/support 2024-09-13T06:06:53.864 INFO:teuthology.orchestra.run.smithi194.stdout:13 Sep 06:06:53 ntpd[18473]: ---------------------------------------------------- 2024-09-13T06:06:53.865 INFO:teuthology.orchestra.run.smithi194.stdout:13 Sep 06:06:53 ntpd[18473]: proto: precision = 0.086 usec (-23) 2024-09-13T06:06:53.865 INFO:teuthology.orchestra.run.smithi194.stdout:13 Sep 06:06:53 ntpd[18473]: basedate set to 2022-02-04 2024-09-13T06:06:53.865 INFO:teuthology.orchestra.run.smithi194.stdout:13 Sep 06:06:53 ntpd[18473]: gps base set to 2022-02-06 (week 2196) 2024-09-13T06:06:53.865 INFO:teuthology.orchestra.run.smithi194.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T06:06:53.865 INFO:teuthology.orchestra.run.smithi194.stdout:13 Sep 06:06:53 ntpd[18473]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T06:06:53.866 INFO:teuthology.orchestra.run.smithi194.stdout:13 Sep 06:06:53 ntpd[18473]: restrict ::: KOD does nothing without LIMITED. 2024-09-13T06:06:53.866 INFO:teuthology.orchestra.run.smithi194.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-13T06:06:53.867 INFO:teuthology.orchestra.run.smithi194.stdout:13 Sep 06:06:53 ntpd[18473]: Listen and drop on 0 v6wildcard [::]:123 2024-09-13T06:06:53.867 INFO:teuthology.orchestra.run.smithi194.stdout:13 Sep 06:06:53 ntpd[18473]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-13T06:06:53.867 INFO:teuthology.orchestra.run.smithi194.stdout:13 Sep 06:06:53 ntpd[18473]: Listen normally on 2 lo 127.0.0.1:123 2024-09-13T06:06:53.868 INFO:teuthology.orchestra.run.smithi194.stdout:13 Sep 06:06:53 ntpd[18473]: Listen normally on 3 enp3s0f1 172.21.15.194:123 2024-09-13T06:06:53.868 INFO:teuthology.orchestra.run.smithi194.stdout:13 Sep 06:06:53 ntpd[18473]: Listen normally on 4 lo [::1]:123 2024-09-13T06:06:53.868 INFO:teuthology.orchestra.run.smithi194.stdout:13 Sep 06:06:53 ntpd[18473]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7ea5%5]:123 2024-09-13T06:06:53.868 INFO:teuthology.orchestra.run.smithi194.stdout:13 Sep 06:06:53 ntpd[18473]: Listening on routing socket on fd #22 for interface updates 2024-09-13T06:06:54.833 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 06:06:54 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:06:54.834 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 06:06:54 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:06:54.834 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 06:06:54 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:06:54.834 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 06:06:54 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:06:54.834 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 06:06:54 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:06:54.834 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 06:06:54 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:06:54.834 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 06:06:54 ntpd[18461]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T06:06:54.834 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 06:06:54 ntpd[18461]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T06:06:54.863 INFO:teuthology.orchestra.run.smithi194.stderr:13 Sep 06:06:54 ntpd[18473]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:06:54.864 INFO:teuthology.orchestra.run.smithi194.stderr:13 Sep 06:06:54 ntpd[18473]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:06:54.864 INFO:teuthology.orchestra.run.smithi194.stderr:13 Sep 06:06:54 ntpd[18473]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:06:54.864 INFO:teuthology.orchestra.run.smithi194.stderr:13 Sep 06:06:54 ntpd[18473]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:06:54.864 INFO:teuthology.orchestra.run.smithi194.stderr:13 Sep 06:06:54 ntpd[18473]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:06:54.864 INFO:teuthology.orchestra.run.smithi194.stderr:13 Sep 06:06:54 ntpd[18473]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:06:54.864 INFO:teuthology.orchestra.run.smithi194.stderr:13 Sep 06:06:54 ntpd[18473]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T06:06:54.864 INFO:teuthology.orchestra.run.smithi194.stderr:13 Sep 06:06:54 ntpd[18473]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T06:06:54.864 INFO:teuthology.orchestra.run.smithi194.stderr:13 Sep 06:06:54 ntpd[18473]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:06:54.864 INFO:teuthology.orchestra.run.smithi194.stderr:13 Sep 06:06:54 ntpd[18473]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:06:54.864 INFO:teuthology.orchestra.run.smithi194.stderr:13 Sep 06:06:54 ntpd[18473]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T06:06:54.864 INFO:teuthology.orchestra.run.smithi194.stderr:13 Sep 06:06:54 ntpd[18473]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T06:06:55.833 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 06:06:55 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:06:55.833 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 06:06:55 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:06:55.834 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 06:06:55 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:06:55.834 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 06:06:55 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:06:55.834 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 06:06:55 ntpd[18461]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T06:06:55.834 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 06:06:55 ntpd[18461]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T06:06:55.863 INFO:teuthology.orchestra.run.smithi194.stderr:13 Sep 06:06:55 ntpd[18473]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:06:55.863 INFO:teuthology.orchestra.run.smithi194.stderr:13 Sep 06:06:55 ntpd[18473]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:06:56.834 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 06:06:56 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:06:56.834 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 06:06:56 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:06:56.834 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 06:06:56 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:06:56.834 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 06:06:56 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:06:56.834 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 06:06:56 ntpd[18461]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T06:06:56.834 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 06:06:56 ntpd[18461]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T06:06:56.864 INFO:teuthology.orchestra.run.smithi194.stderr:13 Sep 06:06:56 ntpd[18473]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:06:56.864 INFO:teuthology.orchestra.run.smithi194.stderr:13 Sep 06:06:56 ntpd[18473]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:06:56.864 INFO:teuthology.orchestra.run.smithi194.stderr:13 Sep 06:06:56 ntpd[18473]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:06:56.864 INFO:teuthology.orchestra.run.smithi194.stderr:13 Sep 06:06:56 ntpd[18473]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:06:56.864 INFO:teuthology.orchestra.run.smithi194.stderr:13 Sep 06:06:56 ntpd[18473]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:06:56.864 INFO:teuthology.orchestra.run.smithi194.stderr:13 Sep 06:06:56 ntpd[18473]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:06:56.864 INFO:teuthology.orchestra.run.smithi194.stderr:13 Sep 06:06:56 ntpd[18473]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T06:06:56.864 INFO:teuthology.orchestra.run.smithi194.stderr:13 Sep 06:06:56 ntpd[18473]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T06:06:56.864 INFO:teuthology.orchestra.run.smithi194.stderr:13 Sep 06:06:56 ntpd[18473]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:06:56.864 INFO:teuthology.orchestra.run.smithi194.stderr:13 Sep 06:06:56 ntpd[18473]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:06:56.864 INFO:teuthology.orchestra.run.smithi194.stderr:13 Sep 06:06:56 ntpd[18473]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T06:06:56.865 INFO:teuthology.orchestra.run.smithi194.stderr:13 Sep 06:06:56 ntpd[18473]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T06:06:57.834 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 06:06:57 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:06:57.834 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 06:06:57 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:06:57.834 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 06:06:57 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:06:57.834 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 06:06:57 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:06:57.834 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 06:06:57 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:06:57.835 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 06:06:57 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:06:57.835 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 06:06:57 ntpd[18461]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T06:06:57.835 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 06:06:57 ntpd[18461]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T06:06:57.835 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 06:06:57 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:06:57.835 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 06:06:57 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:06:57.835 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 06:06:57 ntpd[18461]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T06:06:57.835 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 06:06:57 ntpd[18461]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T06:06:58.833 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 06:06:58 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:06:58.833 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 06:06:58 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:06:58.834 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 06:06:58 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:06:58.834 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 06:06:58 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:06:58.834 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 06:06:58 ntpd[18461]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T06:06:58.834 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 06:06:58 ntpd[18461]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T06:06:58.864 INFO:teuthology.orchestra.run.smithi194.stderr:13 Sep 06:06:58 ntpd[18473]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:06:58.864 INFO:teuthology.orchestra.run.smithi194.stderr:13 Sep 06:06:58 ntpd[18473]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:06:58.864 INFO:teuthology.orchestra.run.smithi194.stderr:13 Sep 06:06:58 ntpd[18473]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:06:58.864 INFO:teuthology.orchestra.run.smithi194.stderr:13 Sep 06:06:58 ntpd[18473]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:06:58.864 INFO:teuthology.orchestra.run.smithi194.stderr:13 Sep 06:06:58 ntpd[18473]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:06:58.864 INFO:teuthology.orchestra.run.smithi194.stderr:13 Sep 06:06:58 ntpd[18473]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:06:58.864 INFO:teuthology.orchestra.run.smithi194.stderr:13 Sep 06:06:58 ntpd[18473]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:06:58.865 INFO:teuthology.orchestra.run.smithi194.stderr:13 Sep 06:06:58 ntpd[18473]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:06:58.865 INFO:teuthology.orchestra.run.smithi194.stderr:13 Sep 06:06:58 ntpd[18473]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T06:06:58.865 INFO:teuthology.orchestra.run.smithi194.stderr:13 Sep 06:06:58 ntpd[18473]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T06:06:58.865 INFO:teuthology.orchestra.run.smithi194.stderr:13 Sep 06:06:58 ntpd[18473]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:06:58.865 INFO:teuthology.orchestra.run.smithi194.stderr:13 Sep 06:06:58 ntpd[18473]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:06:58.865 INFO:teuthology.orchestra.run.smithi194.stderr:13 Sep 06:06:58 ntpd[18473]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T06:06:58.865 INFO:teuthology.orchestra.run.smithi194.stderr:13 Sep 06:06:58 ntpd[18473]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T06:06:58.865 INFO:teuthology.orchestra.run.smithi194.stderr:13 Sep 06:06:58 ntpd[18473]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:06:58.865 INFO:teuthology.orchestra.run.smithi194.stderr:13 Sep 06:06:58 ntpd[18473]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:06:58.865 INFO:teuthology.orchestra.run.smithi194.stderr:13 Sep 06:06:58 ntpd[18473]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T06:06:58.865 INFO:teuthology.orchestra.run.smithi194.stderr:13 Sep 06:06:58 ntpd[18473]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T06:06:59.834 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 06:06:59 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:06:59.835 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 06:06:59 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:06:59.835 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 06:06:59 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:06:59.835 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 06:06:59 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:06:59.835 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 06:06:59 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:06:59.835 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 06:06:59 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:06:59.835 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 06:06:59 ntpd[18461]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T06:06:59.835 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 06:06:59 ntpd[18461]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T06:06:59.835 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 06:06:59 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:06:59.835 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 06:06:59 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:06:59.835 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 06:06:59 ntpd[18461]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T06:06:59.835 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 06:06:59 ntpd[18461]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T06:07:00.833 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 06:07:00 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:07:00.833 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 06:07:00 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:07:00.833 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 06:07:00 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:07:00.834 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 06:07:00 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:07:00.834 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 06:07:00 ntpd[18461]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T06:07:00.834 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 06:07:00 ntpd[18461]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T06:07:00.834 INFO:teuthology.orchestra.run.smithi120.stdout:13 Sep 06:07:00 ntpd[18461]: ntpd: time slew -0.000013 s 2024-09-13T06:07:00.834 INFO:teuthology.orchestra.run.smithi120.stdout:ntpd: time slew -0.000013s 2024-09-13T06:07:00.834 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 06:07:00 ntpd[18461]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-13T06:07:00.835 INFO:teuthology.orchestra.run.smithi120.stderr:13 Sep 06:07:00 ntpd[18461]: can't open /var/log/ntpstats/loopstats.20240913: Permission denied 2024-09-13T06:07:00.864 INFO:teuthology.orchestra.run.smithi194.stderr:13 Sep 06:07:00 ntpd[18473]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:07:00.864 INFO:teuthology.orchestra.run.smithi194.stderr:13 Sep 06:07:00 ntpd[18473]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:07:00.864 INFO:teuthology.orchestra.run.smithi194.stderr:13 Sep 06:07:00 ntpd[18473]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:07:00.864 INFO:teuthology.orchestra.run.smithi194.stderr:13 Sep 06:07:00 ntpd[18473]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:07:00.864 INFO:teuthology.orchestra.run.smithi194.stderr:13 Sep 06:07:00 ntpd[18473]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:07:00.864 INFO:teuthology.orchestra.run.smithi194.stderr:13 Sep 06:07:00 ntpd[18473]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:07:00.864 INFO:teuthology.orchestra.run.smithi194.stderr:13 Sep 06:07:00 ntpd[18473]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:07:00.864 INFO:teuthology.orchestra.run.smithi194.stderr:13 Sep 06:07:00 ntpd[18473]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:07:00.864 INFO:teuthology.orchestra.run.smithi194.stderr:13 Sep 06:07:00 ntpd[18473]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T06:07:00.864 INFO:teuthology.orchestra.run.smithi194.stderr:13 Sep 06:07:00 ntpd[18473]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T06:07:00.865 INFO:teuthology.orchestra.run.smithi194.stdout:13 Sep 06:07:00 ntpd[18473]: ntpd: time slew -0.003014 s 2024-09-13T06:07:00.865 INFO:teuthology.orchestra.run.smithi194.stdout:ntpd: time slew -0.003014s 2024-09-13T06:07:00.865 INFO:teuthology.orchestra.run.smithi194.stderr:13 Sep 06:07:00 ntpd[18473]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-13T06:07:00.865 INFO:teuthology.orchestra.run.smithi194.stderr:13 Sep 06:07:00 ntpd[18473]: can't open /var/log/ntpstats/loopstats.20240913: Permission denied 2024-09-13T06:07:00.880 INFO:teuthology.orchestra.run.smithi120.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T06:07:00.880 INFO:teuthology.orchestra.run.smithi120.stdout:============================================================================== 2024-09-13T06:07:00.880 INFO:teuthology.orchestra.run.smithi120.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T06:07:00.880 INFO:teuthology.orchestra.run.smithi120.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T06:07:00.880 INFO:teuthology.orchestra.run.smithi120.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T06:07:00.881 INFO:teuthology.orchestra.run.smithi120.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T06:07:00.999 INFO:teuthology.orchestra.run.smithi194.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T06:07:00.999 INFO:teuthology.orchestra.run.smithi194.stdout:============================================================================== 2024-09-13T06:07:00.999 INFO:teuthology.orchestra.run.smithi194.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T06:07:00.999 INFO:teuthology.orchestra.run.smithi194.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T06:07:00.999 INFO:teuthology.orchestra.run.smithi194.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T06:07:00.999 INFO:teuthology.orchestra.run.smithi194.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T06:07:01.001 INFO:teuthology.run_tasks:Running task install... 2024-09-13T06:07:01.010 DEBUG:teuthology.task.install:project ceph 2024-09-13T06:07:01.010 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '7162ca8a22368558b9ec845c47e93c7afc45e8c3'}} 2024-09-13T06:07:01.010 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '7162ca8a22368558b9ec845c47e93c7afc45e8c3'} 2024-09-13T06:07:01.010 INFO:teuthology.task.install:Using flavor: default 2024-09-13T06:07:01.016 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-13T06:07:01.016 INFO:teuthology.task.install:extra packages: [] 2024-09-13T06:07:01.016 DEBUG:teuthology.orchestra.run.smithi120:> sudo apt-key list | grep Ceph 2024-09-13T06:07:01.017 DEBUG:teuthology.orchestra.run.smithi194:> sudo apt-key list | grep Ceph 2024-09-13T06:07:01.079 INFO:teuthology.orchestra.run.smithi120.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-13T06:07:01.109 INFO:teuthology.orchestra.run.smithi120.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-13T06:07:01.109 INFO:teuthology.orchestra.run.smithi120.stdout:uid [ unknown] Ceph.com (release key) 2024-09-13T06:07:01.109 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-13T06:07:01.110 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7162ca8a22368558b9ec845c47e93c7afc45e8c3 2024-09-13T06:07:01.123 INFO:teuthology.orchestra.run.smithi194.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-13T06:07:01.139 INFO:teuthology.orchestra.run.smithi194.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-13T06:07:01.139 INFO:teuthology.orchestra.run.smithi194.stdout:uid [ unknown] Ceph.com (release key) 2024-09-13T06:07:01.140 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-13T06:07:01.140 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7162ca8a22368558b9ec845c47e93c7afc45e8c3 2024-09-13T06:07:01.268 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default/ 2024-09-13T06:07:01.268 INFO:teuthology.task.install.deb:Package version is 19.1.1-304-g7162ca8a-1jammy 2024-09-13T06:07:01.289 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default/ 2024-09-13T06:07:01.289 INFO:teuthology.task.install.deb:Package version is 19.1.1-304-g7162ca8a-1jammy 2024-09-13T06:07:01.391 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-13T06:07:01.391 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-13T06:07:01.405 DEBUG:teuthology.orchestra.run.smithi120:> sudo apt-get update 2024-09-13T06:07:01.408 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T06:07:01.408 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-13T06:07:01.422 DEBUG:teuthology.orchestra.run.smithi194:> sudo apt-get update 2024-09-13T06:07:01.596 INFO:teuthology.orchestra.run.smithi194.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T06:07:01.596 INFO:teuthology.orchestra.run.smithi194.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-13T06:07:01.605 INFO:teuthology.orchestra.run.smithi194.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-13T06:07:01.622 INFO:teuthology.orchestra.run.smithi194.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-13T06:07:01.627 INFO:teuthology.orchestra.run.smithi120.stdout:Ign:1 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy InRelease 2024-09-13T06:07:01.648 INFO:teuthology.orchestra.run.smithi194.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy InRelease 2024-09-13T06:07:01.649 INFO:teuthology.orchestra.run.smithi120.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-13T06:07:01.670 INFO:teuthology.orchestra.run.smithi194.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-13T06:07:01.672 INFO:teuthology.orchestra.run.smithi120.stdout:Ign:3 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-13T06:07:01.691 INFO:teuthology.orchestra.run.smithi194.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-13T06:07:01.703 INFO:teuthology.orchestra.run.smithi120.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T06:07:01.703 INFO:teuthology.orchestra.run.smithi120.stdout:Hit:5 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-13T06:07:01.703 INFO:teuthology.orchestra.run.smithi120.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-13T06:07:01.713 INFO:teuthology.orchestra.run.smithi194.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-13T06:07:01.733 INFO:teuthology.orchestra.run.smithi120.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,419 B] 2024-09-13T06:07:01.741 INFO:teuthology.orchestra.run.smithi194.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,419 B] 2024-09-13T06:07:01.775 INFO:teuthology.orchestra.run.smithi120.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-13T06:07:01.856 INFO:teuthology.orchestra.run.smithi120.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-13T06:07:01.950 INFO:teuthology.orchestra.run.smithi194.stdout:Fetched 28.9 kB in 0s (84.9 kB/s) 2024-09-13T06:07:02.059 INFO:teuthology.orchestra.run.smithi120.stdout:Fetched 28.9 kB in 0s (61.3 kB/s) 2024-09-13T06:07:02.975 INFO:teuthology.orchestra.run.smithi194.stdout:Reading package lists... 2024-09-13T06:07:02.991 DEBUG:teuthology.orchestra.run.smithi194:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-304-g7162ca8a-1jammy cephadm=19.1.1-304-g7162ca8a-1jammy ceph-mds=19.1.1-304-g7162ca8a-1jammy ceph-mgr=19.1.1-304-g7162ca8a-1jammy ceph-common=19.1.1-304-g7162ca8a-1jammy ceph-fuse=19.1.1-304-g7162ca8a-1jammy ceph-test=19.1.1-304-g7162ca8a-1jammy ceph-volume=19.1.1-304-g7162ca8a-1jammy radosgw=19.1.1-304-g7162ca8a-1jammy python3-rados=19.1.1-304-g7162ca8a-1jammy python3-rgw=19.1.1-304-g7162ca8a-1jammy python3-cephfs=19.1.1-304-g7162ca8a-1jammy python3-rbd=19.1.1-304-g7162ca8a-1jammy libcephfs2=19.1.1-304-g7162ca8a-1jammy libcephfs-dev=19.1.1-304-g7162ca8a-1jammy librados2=19.1.1-304-g7162ca8a-1jammy librbd1=19.1.1-304-g7162ca8a-1jammy rbd-fuse=19.1.1-304-g7162ca8a-1jammy 2024-09-13T06:07:03.014 INFO:teuthology.orchestra.run.smithi120.stdout:Reading package lists... 2024-09-13T06:07:03.032 DEBUG:teuthology.orchestra.run.smithi120:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-304-g7162ca8a-1jammy cephadm=19.1.1-304-g7162ca8a-1jammy ceph-mds=19.1.1-304-g7162ca8a-1jammy ceph-mgr=19.1.1-304-g7162ca8a-1jammy ceph-common=19.1.1-304-g7162ca8a-1jammy ceph-fuse=19.1.1-304-g7162ca8a-1jammy ceph-test=19.1.1-304-g7162ca8a-1jammy ceph-volume=19.1.1-304-g7162ca8a-1jammy radosgw=19.1.1-304-g7162ca8a-1jammy python3-rados=19.1.1-304-g7162ca8a-1jammy python3-rgw=19.1.1-304-g7162ca8a-1jammy python3-cephfs=19.1.1-304-g7162ca8a-1jammy python3-rbd=19.1.1-304-g7162ca8a-1jammy libcephfs2=19.1.1-304-g7162ca8a-1jammy libcephfs-dev=19.1.1-304-g7162ca8a-1jammy librados2=19.1.1-304-g7162ca8a-1jammy librbd1=19.1.1-304-g7162ca8a-1jammy rbd-fuse=19.1.1-304-g7162ca8a-1jammy 2024-09-13T06:07:03.055 INFO:teuthology.orchestra.run.smithi194.stdout:Reading package lists... 2024-09-13T06:07:03.094 INFO:teuthology.orchestra.run.smithi120.stdout:Reading package lists... 2024-09-13T06:07:03.267 INFO:teuthology.orchestra.run.smithi194.stdout:Building dependency tree... 2024-09-13T06:07:03.268 INFO:teuthology.orchestra.run.smithi194.stdout:Reading state information... 2024-09-13T06:07:03.305 INFO:teuthology.orchestra.run.smithi120.stdout:Building dependency tree... 2024-09-13T06:07:03.305 INFO:teuthology.orchestra.run.smithi120.stdout:Reading state information... 2024-09-13T06:07:03.461 INFO:teuthology.orchestra.run.smithi194.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T06:07:03.461 INFO:teuthology.orchestra.run.smithi194.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T06:07:03.462 INFO:teuthology.orchestra.run.smithi194.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T06:07:03.462 INFO:teuthology.orchestra.run.smithi194.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T06:07:03.462 INFO:teuthology.orchestra.run.smithi194.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-13T06:07:03.462 INFO:teuthology.orchestra.run.smithi194.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-13T06:07:03.462 INFO:teuthology.orchestra.run.smithi194.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T06:07:03.463 INFO:teuthology.orchestra.run.smithi194.stdout:The following additional packages will be installed: 2024-09-13T06:07:03.463 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-13T06:07:03.463 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-13T06:07:03.463 INFO:teuthology.orchestra.run.smithi194.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-13T06:07:03.463 INFO:teuthology.orchestra.run.smithi194.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-13T06:07:03.464 INFO:teuthology.orchestra.run.smithi194.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-13T06:07:03.464 INFO:teuthology.orchestra.run.smithi194.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-13T06:07:03.465 INFO:teuthology.orchestra.run.smithi194.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-13T06:07:03.465 INFO:teuthology.orchestra.run.smithi194.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-13T06:07:03.465 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-13T06:07:03.465 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-13T06:07:03.465 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-13T06:07:03.465 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-13T06:07:03.465 INFO:teuthology.orchestra.run.smithi194.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-13T06:07:03.465 INFO:teuthology.orchestra.run.smithi194.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-13T06:07:03.465 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-13T06:07:03.465 INFO:teuthology.orchestra.run.smithi194.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-13T06:07:03.465 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-13T06:07:03.465 INFO:teuthology.orchestra.run.smithi194.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-13T06:07:03.465 INFO:teuthology.orchestra.run.smithi194.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-13T06:07:03.465 INFO:teuthology.orchestra.run.smithi194.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-13T06:07:03.466 INFO:teuthology.orchestra.run.smithi194.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-13T06:07:03.466 INFO:teuthology.orchestra.run.smithi194.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-13T06:07:03.466 INFO:teuthology.orchestra.run.smithi194.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-13T06:07:03.466 INFO:teuthology.orchestra.run.smithi194.stdout: xmlstarlet zip 2024-09-13T06:07:03.466 INFO:teuthology.orchestra.run.smithi194.stdout:Suggested packages: 2024-09-13T06:07:03.466 INFO:teuthology.orchestra.run.smithi194.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-13T06:07:03.466 INFO:teuthology.orchestra.run.smithi194.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-13T06:07:03.466 INFO:teuthology.orchestra.run.smithi194.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-13T06:07:03.466 INFO:teuthology.orchestra.run.smithi194.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-13T06:07:03.467 INFO:teuthology.orchestra.run.smithi194.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-13T06:07:03.467 INFO:teuthology.orchestra.run.smithi194.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-13T06:07:03.467 INFO:teuthology.orchestra.run.smithi194.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-13T06:07:03.467 INFO:teuthology.orchestra.run.smithi194.stdout:Recommended packages: 2024-09-13T06:07:03.467 INFO:teuthology.orchestra.run.smithi194.stdout: btrfs-tools 2024-09-13T06:07:03.496 INFO:teuthology.orchestra.run.smithi120.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T06:07:03.497 INFO:teuthology.orchestra.run.smithi120.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T06:07:03.497 INFO:teuthology.orchestra.run.smithi120.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T06:07:03.497 INFO:teuthology.orchestra.run.smithi120.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T06:07:03.497 INFO:teuthology.orchestra.run.smithi120.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-13T06:07:03.497 INFO:teuthology.orchestra.run.smithi120.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-13T06:07:03.498 INFO:teuthology.orchestra.run.smithi120.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T06:07:03.498 INFO:teuthology.orchestra.run.smithi120.stdout:The following additional packages will be installed: 2024-09-13T06:07:03.498 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-13T06:07:03.498 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-13T06:07:03.498 INFO:teuthology.orchestra.run.smithi120.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-13T06:07:03.499 INFO:teuthology.orchestra.run.smithi120.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-13T06:07:03.500 INFO:teuthology.orchestra.run.smithi120.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-13T06:07:03.500 INFO:teuthology.orchestra.run.smithi120.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-13T06:07:03.500 INFO:teuthology.orchestra.run.smithi120.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-13T06:07:03.500 INFO:teuthology.orchestra.run.smithi120.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-13T06:07:03.500 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-13T06:07:03.500 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-13T06:07:03.500 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-13T06:07:03.500 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-13T06:07:03.500 INFO:teuthology.orchestra.run.smithi120.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-13T06:07:03.500 INFO:teuthology.orchestra.run.smithi120.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-13T06:07:03.500 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-13T06:07:03.500 INFO:teuthology.orchestra.run.smithi120.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-13T06:07:03.501 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-13T06:07:03.501 INFO:teuthology.orchestra.run.smithi120.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-13T06:07:03.501 INFO:teuthology.orchestra.run.smithi120.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-13T06:07:03.501 INFO:teuthology.orchestra.run.smithi120.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-13T06:07:03.501 INFO:teuthology.orchestra.run.smithi120.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-13T06:07:03.501 INFO:teuthology.orchestra.run.smithi120.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-13T06:07:03.501 INFO:teuthology.orchestra.run.smithi120.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-13T06:07:03.501 INFO:teuthology.orchestra.run.smithi120.stdout: xmlstarlet zip 2024-09-13T06:07:03.501 INFO:teuthology.orchestra.run.smithi120.stdout:Suggested packages: 2024-09-13T06:07:03.502 INFO:teuthology.orchestra.run.smithi120.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-13T06:07:03.502 INFO:teuthology.orchestra.run.smithi120.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-13T06:07:03.502 INFO:teuthology.orchestra.run.smithi120.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-13T06:07:03.502 INFO:teuthology.orchestra.run.smithi120.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-13T06:07:03.502 INFO:teuthology.orchestra.run.smithi120.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-13T06:07:03.502 INFO:teuthology.orchestra.run.smithi120.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-13T06:07:03.502 INFO:teuthology.orchestra.run.smithi120.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-13T06:07:03.502 INFO:teuthology.orchestra.run.smithi120.stdout:Recommended packages: 2024-09-13T06:07:03.502 INFO:teuthology.orchestra.run.smithi120.stdout: btrfs-tools 2024-09-13T06:07:03.569 INFO:teuthology.orchestra.run.smithi194.stdout:The following NEW packages will be installed: 2024-09-13T06:07:03.569 INFO:teuthology.orchestra.run.smithi194.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-13T06:07:03.570 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-13T06:07:03.570 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-13T06:07:03.570 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-13T06:07:03.571 INFO:teuthology.orchestra.run.smithi194.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-13T06:07:03.571 INFO:teuthology.orchestra.run.smithi194.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-13T06:07:03.571 INFO:teuthology.orchestra.run.smithi194.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-13T06:07:03.571 INFO:teuthology.orchestra.run.smithi194.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-13T06:07:03.571 INFO:teuthology.orchestra.run.smithi194.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-13T06:07:03.571 INFO:teuthology.orchestra.run.smithi194.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-13T06:07:03.571 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-13T06:07:03.572 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-13T06:07:03.572 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-13T06:07:03.572 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-13T06:07:03.572 INFO:teuthology.orchestra.run.smithi194.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-13T06:07:03.572 INFO:teuthology.orchestra.run.smithi194.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-13T06:07:03.572 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-13T06:07:03.572 INFO:teuthology.orchestra.run.smithi194.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-13T06:07:03.572 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-13T06:07:03.572 INFO:teuthology.orchestra.run.smithi194.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-13T06:07:03.572 INFO:teuthology.orchestra.run.smithi194.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-13T06:07:03.572 INFO:teuthology.orchestra.run.smithi194.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-13T06:07:03.572 INFO:teuthology.orchestra.run.smithi194.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-13T06:07:03.572 INFO:teuthology.orchestra.run.smithi194.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-13T06:07:03.572 INFO:teuthology.orchestra.run.smithi194.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-13T06:07:03.573 INFO:teuthology.orchestra.run.smithi194.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-13T06:07:03.608 INFO:teuthology.orchestra.run.smithi120.stdout:The following NEW packages will be installed: 2024-09-13T06:07:03.608 INFO:teuthology.orchestra.run.smithi120.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-13T06:07:03.608 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-13T06:07:03.608 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-13T06:07:03.608 INFO:teuthology.orchestra.run.smithi120.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-13T06:07:03.608 INFO:teuthology.orchestra.run.smithi120.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-13T06:07:03.608 INFO:teuthology.orchestra.run.smithi120.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-13T06:07:03.609 INFO:teuthology.orchestra.run.smithi120.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-13T06:07:03.609 INFO:teuthology.orchestra.run.smithi120.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-13T06:07:03.609 INFO:teuthology.orchestra.run.smithi120.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-13T06:07:03.610 INFO:teuthology.orchestra.run.smithi120.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-13T06:07:03.610 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-13T06:07:03.610 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-13T06:07:03.610 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-13T06:07:03.610 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-13T06:07:03.610 INFO:teuthology.orchestra.run.smithi120.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-13T06:07:03.610 INFO:teuthology.orchestra.run.smithi120.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-13T06:07:03.610 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-13T06:07:03.610 INFO:teuthology.orchestra.run.smithi120.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-13T06:07:03.610 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-13T06:07:03.610 INFO:teuthology.orchestra.run.smithi120.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-13T06:07:03.610 INFO:teuthology.orchestra.run.smithi120.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-13T06:07:03.610 INFO:teuthology.orchestra.run.smithi120.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-13T06:07:03.610 INFO:teuthology.orchestra.run.smithi120.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-13T06:07:03.611 INFO:teuthology.orchestra.run.smithi120.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-13T06:07:03.611 INFO:teuthology.orchestra.run.smithi120.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-13T06:07:03.611 INFO:teuthology.orchestra.run.smithi120.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-13T06:07:03.714 INFO:teuthology.orchestra.run.smithi194.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-13T06:07:03.714 INFO:teuthology.orchestra.run.smithi194.stdout:Need to get 181 MB of archives. 2024-09-13T06:07:03.714 INFO:teuthology.orchestra.run.smithi194.stdout:After this operation, 829 MB of additional disk space will be used. 2024-09-13T06:07:03.715 INFO:teuthology.orchestra.run.smithi194.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-304-g7162ca8a-1jammy [3,590 kB] 2024-09-13T06:07:03.750 INFO:teuthology.orchestra.run.smithi120.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-13T06:07:03.751 INFO:teuthology.orchestra.run.smithi120.stdout:Need to get 181 MB of archives. 2024-09-13T06:07:03.751 INFO:teuthology.orchestra.run.smithi120.stdout:After this operation, 829 MB of additional disk space will be used. 2024-09-13T06:07:03.751 INFO:teuthology.orchestra.run.smithi120.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-304-g7162ca8a-1jammy [3,590 kB] 2024-09-13T06:07:03.759 INFO:teuthology.orchestra.run.smithi194.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-13T06:07:03.797 INFO:teuthology.orchestra.run.smithi120.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-13T06:07:03.900 INFO:teuthology.orchestra.run.smithi194.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-304-g7162ca8a-1jammy [3,243 kB] 2024-09-13T06:07:03.974 INFO:teuthology.orchestra.run.smithi194.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-304-g7162ca8a-1jammy [720 kB] 2024-09-13T06:07:03.985 INFO:teuthology.orchestra.run.smithi194.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-304-g7162ca8a-1jammy [356 kB] 2024-09-13T06:07:03.988 INFO:teuthology.orchestra.run.smithi120.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-304-g7162ca8a-1jammy [3,243 kB] 2024-09-13T06:07:03.990 INFO:teuthology.orchestra.run.smithi194.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-304-g7162ca8a-1jammy [32.8 kB] 2024-09-13T06:07:03.998 INFO:teuthology.orchestra.run.smithi194.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-304-g7162ca8a-1jammy [180 kB] 2024-09-13T06:07:04.022 INFO:teuthology.orchestra.run.smithi194.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-304-g7162ca8a-1jammy [67.6 kB] 2024-09-13T06:07:04.026 INFO:teuthology.orchestra.run.smithi194.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-304-g7162ca8a-1jammy [333 kB] 2024-09-13T06:07:04.031 INFO:teuthology.orchestra.run.smithi194.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-304-g7162ca8a-1jammy [6,873 kB] 2024-09-13T06:07:04.083 INFO:teuthology.orchestra.run.smithi120.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-304-g7162ca8a-1jammy [720 kB] 2024-09-13T06:07:04.097 INFO:teuthology.orchestra.run.smithi120.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-304-g7162ca8a-1jammy [356 kB] 2024-09-13T06:07:04.134 INFO:teuthology.orchestra.run.smithi120.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-304-g7162ca8a-1jammy [32.8 kB] 2024-09-13T06:07:04.135 INFO:teuthology.orchestra.run.smithi120.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-304-g7162ca8a-1jammy [180 kB] 2024-09-13T06:07:04.139 INFO:teuthology.orchestra.run.smithi120.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-304-g7162ca8a-1jammy [67.6 kB] 2024-09-13T06:07:04.141 INFO:teuthology.orchestra.run.smithi120.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-304-g7162ca8a-1jammy [333 kB] 2024-09-13T06:07:04.148 INFO:teuthology.orchestra.run.smithi120.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-304-g7162ca8a-1jammy [6,873 kB] 2024-09-13T06:07:04.178 INFO:teuthology.orchestra.run.smithi194.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-13T06:07:04.190 INFO:teuthology.orchestra.run.smithi194.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-13T06:07:04.215 INFO:teuthology.orchestra.run.smithi120.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-13T06:07:04.227 INFO:teuthology.orchestra.run.smithi120.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-13T06:07:04.255 INFO:teuthology.orchestra.run.smithi194.stdout:Get:13 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-304-g7162ca8a-1jammy [112 kB] 2024-09-13T06:07:04.257 INFO:teuthology.orchestra.run.smithi194.stdout:Get:14 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-304-g7162ca8a-1jammy [472 kB] 2024-09-13T06:07:04.267 INFO:teuthology.orchestra.run.smithi194.stdout:Get:15 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-304-g7162ca8a-1jammy [25.9 MB] 2024-09-13T06:07:04.271 INFO:teuthology.orchestra.run.smithi194.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-13T06:07:04.308 INFO:teuthology.orchestra.run.smithi120.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-13T06:07:04.429 INFO:teuthology.orchestra.run.smithi120.stdout:Get:14 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-304-g7162ca8a-1jammy [112 kB] 2024-09-13T06:07:04.430 INFO:teuthology.orchestra.run.smithi120.stdout:Get:15 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-304-g7162ca8a-1jammy [472 kB] 2024-09-13T06:07:04.437 INFO:teuthology.orchestra.run.smithi120.stdout:Get:16 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-304-g7162ca8a-1jammy [25.9 MB] 2024-09-13T06:07:04.500 INFO:teuthology.orchestra.run.smithi194.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-13T06:07:04.510 INFO:teuthology.orchestra.run.smithi194.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-13T06:07:04.537 INFO:teuthology.orchestra.run.smithi120.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-13T06:07:04.540 INFO:teuthology.orchestra.run.smithi194.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-13T06:07:04.547 INFO:teuthology.orchestra.run.smithi120.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-13T06:07:04.549 INFO:teuthology.orchestra.run.smithi194.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-13T06:07:04.550 INFO:teuthology.orchestra.run.smithi194.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-13T06:07:04.551 INFO:teuthology.orchestra.run.smithi194.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-13T06:07:04.569 INFO:teuthology.orchestra.run.smithi194.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-13T06:07:04.573 INFO:teuthology.orchestra.run.smithi194.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-13T06:07:04.577 INFO:teuthology.orchestra.run.smithi120.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-13T06:07:04.577 INFO:teuthology.orchestra.run.smithi194.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-13T06:07:04.582 INFO:teuthology.orchestra.run.smithi194.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-13T06:07:04.586 INFO:teuthology.orchestra.run.smithi120.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-13T06:07:04.586 INFO:teuthology.orchestra.run.smithi120.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-13T06:07:04.587 INFO:teuthology.orchestra.run.smithi120.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-13T06:07:04.606 INFO:teuthology.orchestra.run.smithi120.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-13T06:07:04.610 INFO:teuthology.orchestra.run.smithi120.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-13T06:07:04.614 INFO:teuthology.orchestra.run.smithi120.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-13T06:07:04.618 INFO:teuthology.orchestra.run.smithi120.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-13T06:07:04.662 INFO:teuthology.orchestra.run.smithi194.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-13T06:07:04.666 INFO:teuthology.orchestra.run.smithi194.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-13T06:07:04.671 INFO:teuthology.orchestra.run.smithi194.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-13T06:07:04.674 INFO:teuthology.orchestra.run.smithi194.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-13T06:07:04.675 INFO:teuthology.orchestra.run.smithi194.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-13T06:07:04.676 INFO:teuthology.orchestra.run.smithi194.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-13T06:07:04.678 INFO:teuthology.orchestra.run.smithi194.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-13T06:07:04.678 INFO:teuthology.orchestra.run.smithi194.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-13T06:07:04.679 INFO:teuthology.orchestra.run.smithi194.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-13T06:07:04.701 INFO:teuthology.orchestra.run.smithi120.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-13T06:07:04.702 INFO:teuthology.orchestra.run.smithi120.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-13T06:07:04.706 INFO:teuthology.orchestra.run.smithi120.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-13T06:07:04.710 INFO:teuthology.orchestra.run.smithi120.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-13T06:07:04.711 INFO:teuthology.orchestra.run.smithi120.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-13T06:07:04.711 INFO:teuthology.orchestra.run.smithi120.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-13T06:07:04.713 INFO:teuthology.orchestra.run.smithi120.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-13T06:07:04.714 INFO:teuthology.orchestra.run.smithi120.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-13T06:07:04.715 INFO:teuthology.orchestra.run.smithi120.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-13T06:07:04.745 INFO:teuthology.orchestra.run.smithi194.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-13T06:07:04.761 INFO:teuthology.orchestra.run.smithi194.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-13T06:07:04.762 INFO:teuthology.orchestra.run.smithi194.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-13T06:07:04.762 INFO:teuthology.orchestra.run.smithi194.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-13T06:07:04.768 INFO:teuthology.orchestra.run.smithi194.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-13T06:07:04.769 INFO:teuthology.orchestra.run.smithi194.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-13T06:07:04.781 INFO:teuthology.orchestra.run.smithi120.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-13T06:07:04.797 INFO:teuthology.orchestra.run.smithi120.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-13T06:07:04.798 INFO:teuthology.orchestra.run.smithi120.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-13T06:07:04.798 INFO:teuthology.orchestra.run.smithi120.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-13T06:07:04.804 INFO:teuthology.orchestra.run.smithi120.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-13T06:07:04.805 INFO:teuthology.orchestra.run.smithi120.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-13T06:07:04.826 INFO:teuthology.orchestra.run.smithi194.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-13T06:07:04.826 INFO:teuthology.orchestra.run.smithi194.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-13T06:07:04.829 INFO:teuthology.orchestra.run.smithi194.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-13T06:07:04.829 INFO:teuthology.orchestra.run.smithi194.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-13T06:07:04.863 INFO:teuthology.orchestra.run.smithi120.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-13T06:07:04.864 INFO:teuthology.orchestra.run.smithi120.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-13T06:07:04.865 INFO:teuthology.orchestra.run.smithi120.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-13T06:07:04.866 INFO:teuthology.orchestra.run.smithi120.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-13T06:07:04.907 INFO:teuthology.orchestra.run.smithi194.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-13T06:07:04.909 INFO:teuthology.orchestra.run.smithi194.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-13T06:07:04.911 INFO:teuthology.orchestra.run.smithi194.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-13T06:07:04.912 INFO:teuthology.orchestra.run.smithi194.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-13T06:07:04.923 INFO:teuthology.orchestra.run.smithi194.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-13T06:07:04.944 INFO:teuthology.orchestra.run.smithi120.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-13T06:07:04.946 INFO:teuthology.orchestra.run.smithi120.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-13T06:07:04.947 INFO:teuthology.orchestra.run.smithi120.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-13T06:07:04.948 INFO:teuthology.orchestra.run.smithi120.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-13T06:07:04.959 INFO:teuthology.orchestra.run.smithi120.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-13T06:07:04.988 INFO:teuthology.orchestra.run.smithi194.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-13T06:07:04.989 INFO:teuthology.orchestra.run.smithi194.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-13T06:07:04.990 INFO:teuthology.orchestra.run.smithi194.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-13T06:07:04.993 INFO:teuthology.orchestra.run.smithi194.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-13T06:07:04.997 INFO:teuthology.orchestra.run.smithi194.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-13T06:07:05.025 INFO:teuthology.orchestra.run.smithi120.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-13T06:07:05.026 INFO:teuthology.orchestra.run.smithi120.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-13T06:07:05.027 INFO:teuthology.orchestra.run.smithi120.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-13T06:07:05.029 INFO:teuthology.orchestra.run.smithi120.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-13T06:07:05.033 INFO:teuthology.orchestra.run.smithi120.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-13T06:07:05.069 INFO:teuthology.orchestra.run.smithi194.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-13T06:07:05.082 INFO:teuthology.orchestra.run.smithi194.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-13T06:07:05.084 INFO:teuthology.orchestra.run.smithi194.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-13T06:07:05.106 INFO:teuthology.orchestra.run.smithi120.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-13T06:07:05.109 INFO:teuthology.orchestra.run.smithi120.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-13T06:07:05.110 INFO:teuthology.orchestra.run.smithi120.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-13T06:07:05.115 INFO:teuthology.orchestra.run.smithi120.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-13T06:07:05.116 INFO:teuthology.orchestra.run.smithi120.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-13T06:07:05.126 INFO:teuthology.orchestra.run.smithi194.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-13T06:07:05.128 INFO:teuthology.orchestra.run.smithi194.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-13T06:07:05.128 INFO:teuthology.orchestra.run.smithi194.stdout:Get:61 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-304-g7162ca8a-1jammy [5,145 kB] 2024-09-13T06:07:05.150 INFO:teuthology.orchestra.run.smithi194.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-13T06:07:05.155 INFO:teuthology.orchestra.run.smithi194.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-13T06:07:05.187 INFO:teuthology.orchestra.run.smithi120.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-13T06:07:05.192 INFO:teuthology.orchestra.run.smithi120.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-13T06:07:05.208 INFO:teuthology.orchestra.run.smithi194.stdout:Get:64 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-304-g7162ca8a-1jammy [245 kB] 2024-09-13T06:07:05.215 INFO:teuthology.orchestra.run.smithi194.stdout:Get:65 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-304-g7162ca8a-1jammy [124 kB] 2024-09-13T06:07:05.225 INFO:teuthology.orchestra.run.smithi194.stdout:Get:66 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-304-g7162ca8a-1jammy [1,555 kB] 2024-09-13T06:07:05.272 INFO:teuthology.orchestra.run.smithi194.stdout:Get:67 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-304-g7162ca8a-1jammy [6,143 kB] 2024-09-13T06:07:05.319 INFO:teuthology.orchestra.run.smithi194.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-13T06:07:05.321 INFO:teuthology.orchestra.run.smithi194.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-13T06:07:05.324 INFO:teuthology.orchestra.run.smithi194.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-13T06:07:05.325 INFO:teuthology.orchestra.run.smithi194.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-13T06:07:05.327 INFO:teuthology.orchestra.run.smithi194.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-13T06:07:05.361 INFO:teuthology.orchestra.run.smithi194.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-13T06:07:05.388 INFO:teuthology.orchestra.run.smithi120.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-13T06:07:05.395 INFO:teuthology.orchestra.run.smithi194.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-13T06:07:05.396 INFO:teuthology.orchestra.run.smithi194.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-13T06:07:05.422 INFO:teuthology.orchestra.run.smithi194.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-13T06:07:05.423 INFO:teuthology.orchestra.run.smithi194.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-13T06:07:05.424 INFO:teuthology.orchestra.run.smithi194.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-13T06:07:05.437 INFO:teuthology.orchestra.run.smithi120.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-13T06:07:05.438 INFO:teuthology.orchestra.run.smithi194.stdout:Get:79 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-304-g7162ca8a-1jammy [22.8 MB] 2024-09-13T06:07:05.439 INFO:teuthology.orchestra.run.smithi120.stdout:Get:65 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-304-g7162ca8a-1jammy [5,145 kB] 2024-09-13T06:07:05.440 INFO:teuthology.orchestra.run.smithi120.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-13T06:07:05.441 INFO:teuthology.orchestra.run.smithi120.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-13T06:07:05.443 INFO:teuthology.orchestra.run.smithi120.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-13T06:07:05.485 INFO:teuthology.orchestra.run.smithi194.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-13T06:07:05.486 INFO:teuthology.orchestra.run.smithi194.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-13T06:07:05.488 INFO:teuthology.orchestra.run.smithi194.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-13T06:07:05.488 INFO:teuthology.orchestra.run.smithi120.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-13T06:07:05.489 INFO:teuthology.orchestra.run.smithi194.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-13T06:07:05.489 INFO:teuthology.orchestra.run.smithi194.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-13T06:07:05.492 INFO:teuthology.orchestra.run.smithi120.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-13T06:07:05.493 INFO:teuthology.orchestra.run.smithi120.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-13T06:07:05.495 INFO:teuthology.orchestra.run.smithi194.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-13T06:07:05.533 INFO:teuthology.orchestra.run.smithi120.stdout:Get:72 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-304-g7162ca8a-1jammy [245 kB] 2024-09-13T06:07:05.554 INFO:teuthology.orchestra.run.smithi120.stdout:Get:73 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-304-g7162ca8a-1jammy [124 kB] 2024-09-13T06:07:05.554 INFO:teuthology.orchestra.run.smithi120.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-13T06:07:05.554 INFO:teuthology.orchestra.run.smithi120.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-13T06:07:05.556 INFO:teuthology.orchestra.run.smithi120.stdout:Get:76 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-304-g7162ca8a-1jammy [1,555 kB] 2024-09-13T06:07:05.567 INFO:teuthology.orchestra.run.smithi194.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-13T06:07:05.570 INFO:teuthology.orchestra.run.smithi194.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-13T06:07:05.571 INFO:teuthology.orchestra.run.smithi194.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-13T06:07:05.578 INFO:teuthology.orchestra.run.smithi194.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-13T06:07:05.602 INFO:teuthology.orchestra.run.smithi120.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-13T06:07:05.603 INFO:teuthology.orchestra.run.smithi120.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-13T06:07:05.605 INFO:teuthology.orchestra.run.smithi120.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-13T06:07:05.606 INFO:teuthology.orchestra.run.smithi120.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-13T06:07:05.607 INFO:teuthology.orchestra.run.smithi120.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-13T06:07:05.608 INFO:teuthology.orchestra.run.smithi120.stdout:Get:82 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-304-g7162ca8a-1jammy [6,143 kB] 2024-09-13T06:07:05.608 INFO:teuthology.orchestra.run.smithi120.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-13T06:07:05.616 INFO:teuthology.orchestra.run.smithi120.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-13T06:07:05.648 INFO:teuthology.orchestra.run.smithi194.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-13T06:07:05.650 INFO:teuthology.orchestra.run.smithi194.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-13T06:07:05.651 INFO:teuthology.orchestra.run.smithi194.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-13T06:07:05.661 INFO:teuthology.orchestra.run.smithi194.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-13T06:07:05.662 INFO:teuthology.orchestra.run.smithi194.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-13T06:07:05.669 INFO:teuthology.orchestra.run.smithi194.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-13T06:07:05.684 INFO:teuthology.orchestra.run.smithi120.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-13T06:07:05.687 INFO:teuthology.orchestra.run.smithi120.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-13T06:07:05.689 INFO:teuthology.orchestra.run.smithi120.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-13T06:07:05.729 INFO:teuthology.orchestra.run.smithi194.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-13T06:07:05.731 INFO:teuthology.orchestra.run.smithi194.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-13T06:07:05.732 INFO:teuthology.orchestra.run.smithi194.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-13T06:07:05.736 INFO:teuthology.orchestra.run.smithi194.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-13T06:07:05.765 INFO:teuthology.orchestra.run.smithi120.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-13T06:07:05.771 INFO:teuthology.orchestra.run.smithi120.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-13T06:07:05.773 INFO:teuthology.orchestra.run.smithi120.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-13T06:07:05.775 INFO:teuthology.orchestra.run.smithi120.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-13T06:07:05.786 INFO:teuthology.orchestra.run.smithi120.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-13T06:07:05.787 INFO:teuthology.orchestra.run.smithi120.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-13T06:07:05.795 INFO:teuthology.orchestra.run.smithi120.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-13T06:07:05.810 INFO:teuthology.orchestra.run.smithi194.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-13T06:07:05.824 INFO:teuthology.orchestra.run.smithi120.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-304-g7162ca8a-1jammy [22.8 MB] 2024-09-13T06:07:05.830 INFO:teuthology.orchestra.run.smithi194.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-13T06:07:05.831 INFO:teuthology.orchestra.run.smithi194.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-13T06:07:05.832 INFO:teuthology.orchestra.run.smithi194.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-13T06:07:05.838 INFO:teuthology.orchestra.run.smithi194.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-13T06:07:05.839 INFO:teuthology.orchestra.run.smithi194.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-13T06:07:05.850 INFO:teuthology.orchestra.run.smithi120.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-13T06:07:05.852 INFO:teuthology.orchestra.run.smithi120.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-13T06:07:05.853 INFO:teuthology.orchestra.run.smithi120.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-13T06:07:05.927 INFO:teuthology.orchestra.run.smithi120.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-13T06:07:05.929 INFO:teuthology.orchestra.run.smithi120.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-13T06:07:05.946 INFO:teuthology.orchestra.run.smithi120.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-13T06:07:05.947 INFO:teuthology.orchestra.run.smithi120.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-13T06:07:05.948 INFO:teuthology.orchestra.run.smithi120.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-13T06:07:05.953 INFO:teuthology.orchestra.run.smithi120.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-13T06:07:05.954 INFO:teuthology.orchestra.run.smithi120.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-13T06:07:06.198 INFO:teuthology.orchestra.run.smithi194.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-304-g7162ca8a-1jammy [14.1 kB] 2024-09-13T06:07:06.199 INFO:teuthology.orchestra.run.smithi194.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-304-g7162ca8a-1jammy [877 kB] 2024-09-13T06:07:06.216 INFO:teuthology.orchestra.run.smithi194.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-304-g7162ca8a-1jammy [2,460 kB] 2024-09-13T06:07:06.257 INFO:teuthology.orchestra.run.smithi194.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-304-g7162ca8a-1jammy [794 kB] 2024-09-13T06:07:06.266 INFO:teuthology.orchestra.run.smithi194.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-304-g7162ca8a-1jammy [152 kB] 2024-09-13T06:07:06.274 INFO:teuthology.orchestra.run.smithi194.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-304-g7162ca8a-1jammy [2,284 kB] 2024-09-13T06:07:06.339 INFO:teuthology.orchestra.run.smithi194.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-304-g7162ca8a-1jammy [8,625 kB] 2024-09-13T06:07:06.610 INFO:teuthology.orchestra.run.smithi194.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-304-g7162ca8a-1jammy [14.2 kB] 2024-09-13T06:07:06.611 INFO:teuthology.orchestra.run.smithi194.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-304-g7162ca8a-1jammy [51.4 MB] 2024-09-13T06:07:06.711 INFO:teuthology.orchestra.run.smithi120.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-304-g7162ca8a-1jammy [14.1 kB] 2024-09-13T06:07:06.712 INFO:teuthology.orchestra.run.smithi120.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-304-g7162ca8a-1jammy [877 kB] 2024-09-13T06:07:06.728 INFO:teuthology.orchestra.run.smithi120.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-304-g7162ca8a-1jammy [2,460 kB] 2024-09-13T06:07:06.770 INFO:teuthology.orchestra.run.smithi120.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-304-g7162ca8a-1jammy [794 kB] 2024-09-13T06:07:06.780 INFO:teuthology.orchestra.run.smithi120.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-304-g7162ca8a-1jammy [152 kB] 2024-09-13T06:07:06.782 INFO:teuthology.orchestra.run.smithi120.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-304-g7162ca8a-1jammy [2,284 kB] 2024-09-13T06:07:06.873 INFO:teuthology.orchestra.run.smithi120.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-304-g7162ca8a-1jammy [8,625 kB] 2024-09-13T06:07:07.174 INFO:teuthology.orchestra.run.smithi120.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-304-g7162ca8a-1jammy [14.2 kB] 2024-09-13T06:07:07.175 INFO:teuthology.orchestra.run.smithi120.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-304-g7162ca8a-1jammy [51.4 MB] 2024-09-13T06:07:08.404 INFO:teuthology.orchestra.run.smithi194.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-304-g7162ca8a-1jammy [130 kB] 2024-09-13T06:07:08.406 INFO:teuthology.orchestra.run.smithi194.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-304-g7162ca8a-1jammy [39.0 kB] 2024-09-13T06:07:08.407 INFO:teuthology.orchestra.run.smithi194.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-304-g7162ca8a-1jammy [13.6 MB] 2024-09-13T06:07:08.760 INFO:teuthology.orchestra.run.smithi194.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-304-g7162ca8a-1jammy [91.5 kB] 2024-09-13T06:07:09.022 INFO:teuthology.orchestra.run.smithi120.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-304-g7162ca8a-1jammy [130 kB] 2024-09-13T06:07:09.025 INFO:teuthology.orchestra.run.smithi120.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-304-g7162ca8a-1jammy [39.0 kB] 2024-09-13T06:07:09.026 INFO:teuthology.orchestra.run.smithi120.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-304-g7162ca8a-1jammy [13.6 MB] 2024-09-13T06:07:09.214 INFO:teuthology.orchestra.run.smithi120.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-304-g7162ca8a-1jammy [91.5 kB] 2024-09-13T06:07:09.335 INFO:teuthology.orchestra.run.smithi194.stdout:Fetched 181 MB in 5s (34.9 MB/s) 2024-09-13T06:07:09.494 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-13T06:07:09.586 INFO:teuthology.orchestra.run.smithi194.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-13T06:07:09.591 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-13T06:07:09.676 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-13T06:07:09.779 INFO:teuthology.orchestra.run.smithi120.stdout:Fetched 181 MB in 6s (32.3 MB/s) 2024-09-13T06:07:09.931 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-13T06:07:09.962 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-13T06:07:09.988 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-13T06:07:10.020 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-13T06:07:10.032 INFO:teuthology.orchestra.run.smithi120.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-13T06:07:10.037 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-13T06:07:10.121 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-13T06:07:10.340 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-13T06:07:10.366 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-13T06:07:10.407 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-13T06:07:10.417 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-13T06:07:10.443 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-13T06:07:10.475 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-13T06:07:10.778 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-13T06:07:10.805 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-13T06:07:10.845 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-13T06:07:10.860 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-13T06:07:10.886 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T06:07:10.934 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T06:07:11.299 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-13T06:07:11.326 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T06:07:11.346 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-13T06:07:11.373 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T06:07:11.373 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T06:07:11.413 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T06:07:11.719 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-13T06:07:11.745 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T06:07:11.757 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-13T06:07:11.777 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T06:07:11.784 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T06:07:11.824 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T06:07:12.105 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-13T06:07:12.132 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T06:07:12.169 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-13T06:07:12.172 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T06:07:12.195 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-13T06:07:12.227 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-13T06:07:12.501 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-13T06:07:12.526 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-13T06:07:12.563 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package librados2. 2024-09-13T06:07:12.567 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-13T06:07:12.589 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../007-librados2_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:07:12.629 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking librados2 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:07:12.811 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package librados2. 2024-09-13T06:07:12.834 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../007-librados2_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:07:12.869 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking librados2 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:07:13.092 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package librbd1. 2024-09-13T06:07:13.107 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../008-librbd1_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:07:13.151 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking librbd1 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:07:13.323 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package librbd1. 2024-09-13T06:07:13.349 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../008-librbd1_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:07:13.389 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking librbd1 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:07:13.586 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libcephfs2. 2024-09-13T06:07:13.602 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../009-libcephfs2_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:07:13.636 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libcephfs2 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:07:13.817 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libcephfs2. 2024-09-13T06:07:13.844 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../009-libcephfs2_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:07:13.884 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libcephfs2 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:07:13.905 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-rados. 2024-09-13T06:07:13.920 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../010-python3-rados_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:07:13.964 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-rados (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:07:14.153 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-rados. 2024-09-13T06:07:14.168 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../010-python3-rados_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:07:14.237 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-rados (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:07:14.283 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-13T06:07:14.310 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.1.1-304-g7162ca8a-1jammy_all.deb ... 2024-09-13T06:07:14.350 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-ceph-argparse (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:07:14.565 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-13T06:07:14.591 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.1.1-304-g7162ca8a-1jammy_all.deb ... 2024-09-13T06:07:14.602 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-cephfs. 2024-09-13T06:07:14.617 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../012-python3-cephfs_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:07:14.656 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-ceph-argparse (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:07:14.660 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-cephfs (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:07:14.892 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-cephfs. 2024-09-13T06:07:14.907 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../012-python3-cephfs_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:07:14.929 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-13T06:07:14.951 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-cephfs (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:07:14.956 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../013-python3-ceph-common_19.1.1-304-g7162ca8a-1jammy_all.deb ... 2024-09-13T06:07:14.996 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-ceph-common (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:07:15.204 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-13T06:07:15.230 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../013-python3-ceph-common_19.1.1-304-g7162ca8a-1jammy_all.deb ... 2024-09-13T06:07:15.279 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-ceph-common (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:07:15.290 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-13T06:07:15.306 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-13T06:07:15.349 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-13T06:07:15.599 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-13T06:07:15.625 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-13T06:07:15.665 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-13T06:07:15.676 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-prettytable. 2024-09-13T06:07:15.703 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-13T06:07:15.743 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-13T06:07:16.004 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-rbd. 2024-09-13T06:07:16.030 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../016-python3-rbd_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:07:16.070 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-rbd (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:07:16.177 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-prettytable. 2024-09-13T06:07:16.203 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-13T06:07:16.243 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-13T06:07:16.440 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-13T06:07:16.466 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-13T06:07:16.496 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-rbd. 2024-09-13T06:07:16.506 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-13T06:07:16.522 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../016-python3-rbd_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:07:16.554 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-rbd (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:07:16.759 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-13T06:07:16.774 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-13T06:07:16.809 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-13T06:07:16.874 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-13T06:07:16.901 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-13T06:07:16.941 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-13T06:07:17.120 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-13T06:07:17.135 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-13T06:07:17.178 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-13T06:07:17.218 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-13T06:07:17.234 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-13T06:07:17.277 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-13T06:07:17.514 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package lua5.1. 2024-09-13T06:07:17.541 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-13T06:07:17.580 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-13T06:07:17.581 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-13T06:07:17.606 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-13T06:07:17.647 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-13T06:07:17.884 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package lua-any. 2024-09-13T06:07:17.899 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-13T06:07:17.934 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-13T06:07:17.967 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package lua5.1. 2024-09-13T06:07:17.993 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-13T06:07:18.033 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-13T06:07:18.144 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package zip. 2024-09-13T06:07:18.159 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-13T06:07:18.203 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking zip (3.0-12build2) ... 2024-09-13T06:07:18.353 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package lua-any. 2024-09-13T06:07:18.379 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-13T06:07:18.420 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-13T06:07:18.581 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package unzip. 2024-09-13T06:07:18.607 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-13T06:07:18.656 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-13T06:07:18.673 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package zip. 2024-09-13T06:07:18.688 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-13T06:07:18.731 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking zip (3.0-12build2) ... 2024-09-13T06:07:19.051 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package unzip. 2024-09-13T06:07:19.059 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package luarocks. 2024-09-13T06:07:19.078 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-13T06:07:19.085 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-13T06:07:19.118 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-13T06:07:19.126 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-13T06:07:19.447 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package luarocks. 2024-09-13T06:07:19.474 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-13T06:07:19.514 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-13T06:07:19.517 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package librgw2. 2024-09-13T06:07:19.543 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../025-librgw2_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:07:19.583 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking librgw2 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:07:19.872 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package librgw2. 2024-09-13T06:07:19.899 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../025-librgw2_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:07:19.939 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking librgw2 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:07:20.169 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-rgw. 2024-09-13T06:07:20.184 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../026-python3-rgw_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:07:20.219 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-rgw (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:07:20.466 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-rgw. 2024-09-13T06:07:20.482 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../026-python3-rgw_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:07:20.497 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-13T06:07:20.523 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-13T06:07:20.525 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-rgw (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:07:20.555 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-13T06:07:20.803 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-13T06:07:20.818 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-13T06:07:20.852 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-13T06:07:20.866 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libradosstriper1. 2024-09-13T06:07:20.892 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../028-libradosstriper1_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:07:20.941 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libradosstriper1 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:07:21.173 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libradosstriper1. 2024-09-13T06:07:21.199 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../028-libradosstriper1_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:07:21.239 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libradosstriper1 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:07:21.403 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-common. 2024-09-13T06:07:21.429 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../029-ceph-common_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:07:21.477 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-common (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:07:21.643 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-common. 2024-09-13T06:07:21.670 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../029-ceph-common_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:07:21.709 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-common (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:07:23.049 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-base. 2024-09-13T06:07:23.075 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../030-ceph-base_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:07:23.107 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-base. 2024-09-13T06:07:23.133 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-base (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:07:23.134 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../030-ceph-base_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:07:23.183 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-base (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:07:23.670 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-13T06:07:23.696 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-13T06:07:23.736 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-13T06:07:23.778 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-13T06:07:23.805 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-13T06:07:23.845 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-13T06:07:24.047 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-cheroot. 2024-09-13T06:07:24.073 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-13T06:07:24.106 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-cheroot. 2024-09-13T06:07:24.113 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-13T06:07:24.122 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-13T06:07:24.156 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-13T06:07:24.418 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-13T06:07:24.442 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-13T06:07:24.444 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-13T06:07:24.468 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-13T06:07:24.484 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-13T06:07:24.508 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-13T06:07:24.786 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-13T06:07:24.801 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-13T06:07:24.812 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-13T06:07:24.836 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-13T06:07:24.839 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-13T06:07:24.879 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-13T06:07:25.072 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-13T06:07:25.098 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-13T06:07:25.138 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-13T06:07:25.191 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-13T06:07:25.217 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-13T06:07:25.257 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-13T06:07:25.441 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-tempora. 2024-09-13T06:07:25.467 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-13T06:07:25.508 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-13T06:07:25.510 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-tempora. 2024-09-13T06:07:25.537 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-13T06:07:25.577 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-13T06:07:25.811 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-portend. 2024-09-13T06:07:25.837 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-13T06:07:25.877 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-13T06:07:25.880 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-portend. 2024-09-13T06:07:25.907 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-13T06:07:25.947 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-13T06:07:26.146 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-13T06:07:26.173 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-13T06:07:26.205 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-13T06:07:26.250 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-13T06:07:26.277 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-13T06:07:26.316 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-13T06:07:26.482 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-13T06:07:26.509 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-13T06:07:26.549 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-13T06:07:26.745 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-13T06:07:26.771 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-13T06:07:26.811 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-13T06:07:26.886 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-natsort. 2024-09-13T06:07:26.901 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-13T06:07:26.935 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-13T06:07:27.174 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-natsort. 2024-09-13T06:07:27.200 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-13T06:07:27.205 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-logutils. 2024-09-13T06:07:27.231 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-13T06:07:27.240 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-13T06:07:27.263 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-13T06:07:27.518 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-logutils. 2024-09-13T06:07:27.545 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-13T06:07:27.566 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-13T06:07:27.576 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-13T06:07:27.592 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-13T06:07:27.632 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-13T06:07:27.879 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-13T06:07:27.906 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-13T06:07:27.961 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-mako. 2024-09-13T06:07:27.971 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-13T06:07:27.987 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-13T06:07:28.027 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-13T06:07:28.283 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-mako. 2024-09-13T06:07:28.310 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-13T06:07:28.349 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-13T06:07:28.355 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-13T06:07:28.381 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-13T06:07:28.421 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-13T06:07:28.645 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-13T06:07:28.671 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-13T06:07:28.682 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-13T06:07:28.709 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-13T06:07:28.711 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-13T06:07:28.740 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-13T06:07:28.981 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-13T06:07:29.008 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-13T06:07:29.027 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-webob. 2024-09-13T06:07:29.049 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-13T06:07:29.053 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-13T06:07:29.093 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-13T06:07:29.351 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-webob. 2024-09-13T06:07:29.377 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-13T06:07:29.417 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-13T06:07:29.446 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-waitress. 2024-09-13T06:07:29.473 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-13T06:07:29.516 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-13T06:07:29.720 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-waitress. 2024-09-13T06:07:29.747 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-13T06:07:29.782 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-13T06:07:29.824 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-tempita. 2024-09-13T06:07:29.850 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-13T06:07:29.890 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-13T06:07:30.040 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-tempita. 2024-09-13T06:07:30.067 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-13T06:07:30.107 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-13T06:07:30.194 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-paste. 2024-09-13T06:07:30.220 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-13T06:07:30.260 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-13T06:07:30.410 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-paste. 2024-09-13T06:07:30.437 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-13T06:07:30.493 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-13T06:07:30.588 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-13T06:07:30.614 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-13T06:07:30.654 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-13T06:07:30.813 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-13T06:07:30.839 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-13T06:07:30.871 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-13T06:07:30.915 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-13T06:07:30.941 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-13T06:07:30.973 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-13T06:07:31.158 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-13T06:07:31.185 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-13T06:07:31.224 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-13T06:07:31.268 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-webtest. 2024-09-13T06:07:31.295 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-13T06:07:31.335 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-13T06:07:31.663 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-webtest. 2024-09-13T06:07:31.670 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-pecan. 2024-09-13T06:07:31.690 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-13T06:07:31.697 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-13T06:07:31.737 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-13T06:07:31.744 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-13T06:07:32.056 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-pecan. 2024-09-13T06:07:32.083 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-13T06:07:32.109 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-certifi. 2024-09-13T06:07:32.122 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-13T06:07:32.135 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-13T06:07:32.175 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-13T06:07:32.453 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-certifi. 2024-09-13T06:07:32.468 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-13T06:07:32.495 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-idna. 2024-09-13T06:07:32.502 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-13T06:07:32.521 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-13T06:07:32.561 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-13T06:07:32.806 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-idna. 2024-09-13T06:07:32.822 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-urllib3. 2024-09-13T06:07:32.825 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-13T06:07:32.849 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-13T06:07:32.864 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-13T06:07:32.880 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-13T06:07:33.150 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-requests. 2024-09-13T06:07:33.176 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-urllib3. 2024-09-13T06:07:33.176 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-13T06:07:33.202 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-13T06:07:33.217 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-13T06:07:33.242 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-13T06:07:33.520 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-13T06:07:33.529 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-requests. 2024-09-13T06:07:33.546 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-13T06:07:33.556 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-13T06:07:33.586 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-13T06:07:33.587 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-13T06:07:33.864 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-13T06:07:33.890 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.1.1-304-g7162ca8a-1jammy_all.deb ... 2024-09-13T06:07:33.899 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-13T06:07:33.922 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-mgr-modules-core (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:07:33.926 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-13T06:07:33.965 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-13T06:07:34.252 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-13T06:07:34.279 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.1.1-304-g7162ca8a-1jammy_all.deb ... 2024-09-13T06:07:34.302 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-13T06:07:34.318 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-mgr-modules-core (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:07:34.328 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:07:34.368 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:07:34.629 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-13T06:07:34.656 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-13T06:07:34.687 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-13T06:07:34.741 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-13T06:07:34.768 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:07:34.807 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:07:34.965 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-openssl. 2024-09-13T06:07:34.992 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-13T06:07:35.032 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-13T06:07:35.127 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-13T06:07:35.154 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-13T06:07:35.193 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-13T06:07:35.402 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-mgr. 2024-09-13T06:07:35.428 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../063-ceph-mgr_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:07:35.463 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-openssl. 2024-09-13T06:07:35.468 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-mgr (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:07:35.478 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-13T06:07:35.513 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-13T06:07:35.842 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-mgr. 2024-09-13T06:07:35.868 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../063-ceph-mgr_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:07:35.879 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-mon. 2024-09-13T06:07:35.906 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../064-ceph-mon_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:07:35.908 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-mgr (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:07:35.946 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-mon (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:07:36.303 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-mon. 2024-09-13T06:07:36.329 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../064-ceph-mon_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:07:36.370 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-mon (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:07:36.474 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-osd. 2024-09-13T06:07:36.501 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../065-ceph-osd_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:07:36.540 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-osd (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:07:38.025 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-osd. 2024-09-13T06:07:38.051 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../065-ceph-osd_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:07:38.091 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-osd (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:07:38.328 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph. 2024-09-13T06:07:38.354 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../066-ceph_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:07:38.394 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:07:38.713 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-fuse. 2024-09-13T06:07:38.740 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../067-ceph-fuse_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:07:38.780 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-fuse (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:07:39.100 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-mds. 2024-09-13T06:07:39.182 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../068-ceph-mds_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:07:39.182 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-mds (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:07:39.194 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph. 2024-09-13T06:07:39.210 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../066-ceph_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:07:39.244 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:07:39.514 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-fuse. 2024-09-13T06:07:39.541 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../067-ceph-fuse_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:07:39.577 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package cephadm. 2024-09-13T06:07:39.580 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-fuse (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:07:39.604 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../069-cephadm_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:07:39.644 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking cephadm (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:07:39.963 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-13T06:07:39.967 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-mds. 2024-09-13T06:07:39.990 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-13T06:07:39.994 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../068-ceph-mds_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:07:40.029 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-13T06:07:40.033 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-mds (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:07:40.357 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-13T06:07:40.372 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-13T06:07:40.412 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package cephadm. 2024-09-13T06:07:40.415 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-13T06:07:40.438 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../069-cephadm_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:07:40.478 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking cephadm (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:07:40.765 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-13T06:07:40.791 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-13T06:07:40.831 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-13T06:07:41.143 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-13T06:07:41.158 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-13T06:07:41.201 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-13T06:07:41.478 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-babel. 2024-09-13T06:07:41.505 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-13T06:07:41.545 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-13T06:07:41.864 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-jinja2. 2024-09-13T06:07:41.891 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-13T06:07:41.930 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-13T06:07:42.265 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-babel. 2024-09-13T06:07:42.277 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-13T06:07:42.292 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-13T06:07:42.302 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.1.1-304-g7162ca8a-1jammy_all.deb ... 2024-09-13T06:07:42.331 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-13T06:07:42.342 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-mgr-cephadm (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:07:42.651 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-jinja2. 2024-09-13T06:07:42.679 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-13T06:07:42.679 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-13T06:07:42.705 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-13T06:07:42.717 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-13T06:07:42.744 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-13T06:07:43.037 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-13T06:07:43.064 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.1.1-304-g7162ca8a-1jammy_all.deb ... 2024-09-13T06:07:43.089 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-routes. 2024-09-13T06:07:43.104 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-mgr-cephadm (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:07:43.116 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-13T06:07:43.155 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-13T06:07:43.433 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-13T06:07:43.460 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-13T06:07:43.499 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-13T06:07:43.542 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-13T06:07:43.569 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.1.1-304-g7162ca8a-1jammy_all.deb ... 2024-09-13T06:07:43.617 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-mgr-dashboard (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:07:43.810 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-routes. 2024-09-13T06:07:43.837 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-13T06:07:43.877 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-13T06:07:44.205 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-13T06:07:44.232 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.1.1-304-g7162ca8a-1jammy_all.deb ... 2024-09-13T06:07:44.272 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-mgr-dashboard (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:07:44.830 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-13T06:07:44.846 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-13T06:07:44.880 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-13T06:07:45.350 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-joblib. 2024-09-13T06:07:45.377 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-13T06:07:45.416 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-13T06:07:45.604 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-13T06:07:45.620 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-13T06:07:45.663 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-13T06:07:45.761 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-13T06:07:45.788 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-13T06:07:45.828 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-13T06:07:46.189 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-sklearn. 2024-09-13T06:07:46.200 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-joblib. 2024-09-13T06:07:46.215 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-13T06:07:46.227 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-13T06:07:46.263 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-13T06:07:46.266 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-13T06:07:46.637 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-13T06:07:46.664 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-13T06:07:46.703 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-13T06:07:46.963 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-13T06:07:46.991 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.1.1-304-g7162ca8a-1jammy_all.deb ... 2024-09-13T06:07:47.015 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-sklearn. 2024-09-13T06:07:47.042 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-13T06:07:47.081 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-13T06:07:47.157 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:07:48.016 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-13T06:07:48.044 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.1.1-304-g7162ca8a-1jammy_all.deb ... 2024-09-13T06:07:48.111 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-cachetools. 2024-09-13T06:07:48.138 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-13T06:07:48.177 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-13T06:07:48.185 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:07:48.480 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-13T06:07:48.507 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-13T06:07:48.651 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-13T06:07:49.058 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-13T06:07:49.085 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-13T06:07:49.124 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-13T06:07:49.197 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-cachetools. 2024-09-13T06:07:49.224 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-13T06:07:49.255 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-13T06:07:49.387 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-rsa. 2024-09-13T06:07:49.403 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-13T06:07:49.437 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-13T06:07:49.525 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-13T06:07:49.552 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-13T06:07:49.591 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-13T06:07:49.749 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-google-auth. 2024-09-13T06:07:49.776 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-13T06:07:49.815 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-13T06:07:49.878 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-13T06:07:49.905 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-13T06:07:49.936 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-13T06:07:50.144 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-13T06:07:50.171 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-13T06:07:50.198 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-rsa. 2024-09-13T06:07:50.210 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-13T06:07:50.225 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-13T06:07:50.265 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-13T06:07:50.521 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-websocket. 2024-09-13T06:07:50.548 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-13T06:07:50.586 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-google-auth. 2024-09-13T06:07:50.588 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-13T06:07:50.613 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-13T06:07:50.652 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-13T06:07:50.908 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-13T06:07:50.934 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-13T06:07:50.972 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-13T06:07:50.974 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-13T06:07:50.999 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-13T06:07:51.039 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-13T06:07:51.334 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-websocket. 2024-09-13T06:07:51.349 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-13T06:07:51.383 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-13T06:07:51.629 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-13T06:07:51.657 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.1.1-304-g7162ca8a-1jammy_all.deb ... 2024-09-13T06:07:51.662 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-13T06:07:51.689 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-13T06:07:51.695 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:07:51.728 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-13T06:07:52.015 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-13T06:07:52.043 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-13T06:07:52.081 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-13T06:07:52.359 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-13T06:07:52.375 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-13T06:07:52.417 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-13T06:07:52.460 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-13T06:07:52.476 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.1.1-304-g7162ca8a-1jammy_all.deb ... 2024-09-13T06:07:52.518 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:07:52.704 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package jq. 2024-09-13T06:07:52.731 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-13T06:07:52.770 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-13T06:07:52.829 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-13T06:07:52.857 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-13T06:07:52.896 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-13T06:07:53.006 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package socat. 2024-09-13T06:07:53.033 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-13T06:07:53.072 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-13T06:07:53.174 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-13T06:07:53.190 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-13T06:07:53.232 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-13T06:07:53.384 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package xmlstarlet. 2024-09-13T06:07:53.411 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-13T06:07:53.450 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-13T06:07:53.502 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package jq. 2024-09-13T06:07:53.518 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-13T06:07:53.560 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-13T06:07:53.813 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package socat. 2024-09-13T06:07:53.821 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-test. 2024-09-13T06:07:53.837 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../097-ceph-test_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:07:53.840 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-13T06:07:53.879 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-test (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:07:53.880 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-13T06:07:54.183 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package xmlstarlet. 2024-09-13T06:07:54.199 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-13T06:07:54.233 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-13T06:07:54.638 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-test. 2024-09-13T06:07:54.665 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../097-ceph-test_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:07:54.704 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-test (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:07:56.225 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package ceph-volume. 2024-09-13T06:07:56.252 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../098-ceph-volume_19.1.1-304-g7162ca8a-1jammy_all.deb ... 2024-09-13T06:07:56.291 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking ceph-volume (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:07:56.612 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-13T06:07:56.639 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../099-libcephfs-dev_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:07:56.678 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking libcephfs-dev (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:07:56.989 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-13T06:07:57.017 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-13T06:07:57.056 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-13T06:07:57.068 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-volume. 2024-09-13T06:07:57.095 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../098-ceph-volume_19.1.1-304-g7162ca8a-1jammy_all.deb ... 2024-09-13T06:07:57.126 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-volume (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:07:57.351 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-13T06:07:57.367 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-13T06:07:57.401 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-13T06:07:57.489 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-13T06:07:57.516 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../099-libcephfs-dev_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:07:57.563 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libcephfs-dev (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:07:57.764 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package nvme-cli. 2024-09-13T06:07:57.791 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-13T06:07:57.830 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-13T06:07:57.908 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-13T06:07:57.935 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-13T06:07:57.983 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-13T06:07:58.260 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package pkg-config. 2024-09-13T06:07:58.288 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-13T06:07:58.410 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-13T06:07:58.563 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-13T06:07:58.590 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-13T06:07:58.638 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-13T06:07:58.688 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-13T06:07:58.715 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-13T06:07:58.754 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-13T06:07:59.092 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package nvme-cli. 2024-09-13T06:07:59.120 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-13T06:07:59.159 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-13T06:07:59.174 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-13T06:07:59.201 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-13T06:07:59.240 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-13T06:07:59.526 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-pastescript. 2024-09-13T06:07:59.554 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-13T06:07:59.589 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package pkg-config. 2024-09-13T06:07:59.592 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-13T06:07:59.617 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-13T06:07:59.656 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-13T06:07:59.888 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-pluggy. 2024-09-13T06:07:59.915 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-13T06:07:59.946 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-13T06:07:59.976 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-13T06:08:00.003 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-13T06:08:00.050 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-13T06:08:00.232 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-psutil. 2024-09-13T06:08:00.259 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-13T06:08:00.298 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-13T06:08:00.496 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-13T06:08:00.524 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-13T06:08:00.562 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-13T06:08:00.635 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-py. 2024-09-13T06:08:00.662 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-13T06:08:00.701 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-13T06:08:00.840 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-pastescript. 2024-09-13T06:08:00.856 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-13T06:08:00.890 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-13T06:08:01.005 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-pygments. 2024-09-13T06:08:01.032 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-13T06:08:01.071 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-13T06:08:01.161 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-pluggy. 2024-09-13T06:08:01.188 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-13T06:08:01.236 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-13T06:08:01.542 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-13T06:08:01.569 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-13T06:08:01.580 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-psutil. 2024-09-13T06:08:01.608 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-13T06:08:01.608 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-13T06:08:01.655 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-13T06:08:01.894 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-toml. 2024-09-13T06:08:01.910 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-13T06:08:01.944 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-13T06:08:02.034 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-py. 2024-09-13T06:08:02.061 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-13T06:08:02.108 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-13T06:08:02.205 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-pytest. 2024-09-13T06:08:02.233 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-13T06:08:02.271 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-13T06:08:02.479 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-pygments. 2024-09-13T06:08:02.506 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-13T06:08:02.554 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-13T06:08:02.600 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package python3-simplejson. 2024-09-13T06:08:02.627 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-13T06:08:02.666 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-13T06:08:02.927 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-13T06:08:02.943 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-13T06:08:02.985 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-13T06:08:03.325 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-13T06:08:03.353 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-13T06:08:03.391 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-13T06:08:03.670 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-toml. 2024-09-13T06:08:03.698 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package radosgw. 2024-09-13T06:08:03.698 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-13T06:08:03.725 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../116-radosgw_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:08:03.736 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-13T06:08:03.755 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking radosgw (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:08:04.039 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-pytest. 2024-09-13T06:08:04.067 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-13T06:08:04.106 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-13T06:08:04.460 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-simplejson. 2024-09-13T06:08:04.488 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-13T06:08:04.550 INFO:teuthology.orchestra.run.smithi194.stdout:Selecting previously unselected package rbd-fuse. 2024-09-13T06:08:04.560 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-13T06:08:04.578 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing to unpack .../117-rbd-fuse_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:08:04.616 INFO:teuthology.orchestra.run.smithi194.stdout:Unpacking rbd-fuse (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:08:04.813 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-13T06:08:04.840 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-13T06:08:04.879 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-13T06:08:04.922 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-13T06:08:05.396 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-13T06:08:05.522 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-13T06:08:05.650 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package radosgw. 2024-09-13T06:08:05.679 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../116-radosgw_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:08:05.716 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking radosgw (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:08:05.793 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-13T06:08:06.106 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-13T06:08:06.520 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package rbd-fuse. 2024-09-13T06:08:06.548 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../117-rbd-fuse_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-13T06:08:06.578 INFO:teuthology.orchestra.run.smithi194.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-13T06:08:06.578 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking rbd-fuse (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:08:06.892 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-13T06:08:06.976 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up cephadm (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:08:07.142 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-13T06:08:07.244 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-13T06:08:07.508 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-13T06:08:07.704 INFO:teuthology.orchestra.run.smithi194.stdout:Adding system user cephadm....done 2024-09-13T06:08:07.845 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-13T06:08:07.995 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-13T06:08:08.286 INFO:teuthology.orchestra.run.smithi120.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-13T06:08:08.333 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-13T06:08:08.375 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up cephadm (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:08:08.584 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-13T06:08:08.685 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-13T06:08:08.896 INFO:teuthology.orchestra.run.smithi120.stdout:Adding system user cephadm....done 2024-09-13T06:08:08.928 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-13T06:08:09.044 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-13T06:08:09.179 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-13T06:08:09.305 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-13T06:08:09.320 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-13T06:08:09.563 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-13T06:08:09.606 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-13T06:08:09.664 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-13T06:08:09.916 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-13T06:08:09.967 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-13T06:08:10.167 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-13T06:08:10.201 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-13T06:08:10.302 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-13T06:08:10.478 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-13T06:08:10.603 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-13T06:08:10.746 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-13T06:08:10.956 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-13T06:08:11.072 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-13T06:08:11.223 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-13T06:08:11.331 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-13T06:08:11.491 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-13T06:08:11.574 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-ceph-argparse (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:08:11.735 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-13T06:08:11.841 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-13T06:08:11.951 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-13T06:08:11.986 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-13T06:08:12.052 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-13T06:08:12.178 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-13T06:08:12.238 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-13T06:08:12.454 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-13T06:08:12.488 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-ceph-argparse (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:08:12.842 INFO:teuthology.orchestra.run.smithi194.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-13T06:08:12.868 INFO:teuthology.orchestra.run.smithi194.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-13T06:08:12.873 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-13T06:08:12.932 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-13T06:08:12.999 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-13T06:08:13.058 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-13T06:08:13.108 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-13T06:08:13.218 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-13T06:08:13.408 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-13T06:08:13.469 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-13T06:08:13.534 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-13T06:08:13.802 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-13T06:08:13.855 INFO:teuthology.orchestra.run.smithi120.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-13T06:08:13.884 INFO:teuthology.orchestra.run.smithi120.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-13T06:08:13.939 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-13T06:08:14.040 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-13T06:08:14.078 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-13T06:08:14.388 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up zip (3.0-12build2) ... 2024-09-13T06:08:14.400 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-13T06:08:14.514 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-13T06:08:14.526 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-13T06:08:14.786 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-13T06:08:15.045 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-13T06:08:15.182 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-13T06:08:15.355 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up zip (3.0-12build2) ... 2024-09-13T06:08:15.464 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-13T06:08:15.608 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-13T06:08:15.859 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-13T06:08:15.960 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-13T06:08:16.099 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-13T06:08:16.253 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-13T06:08:16.343 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-13T06:08:16.469 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-13T06:08:16.595 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-13T06:08:16.629 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-13T06:08:16.880 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-13T06:08:16.887 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-13T06:08:17.240 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-13T06:08:17.280 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-13T06:08:17.523 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-13T06:08:17.524 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-13T06:08:17.859 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-13T06:08:17.900 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-13T06:08:18.093 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-13T06:08:18.185 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-13T06:08:18.219 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-ceph-common (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:08:18.520 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-13T06:08:18.528 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-13T06:08:18.822 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-13T06:08:18.963 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-13T06:08:19.089 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-ceph-common (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:08:19.382 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-13T06:08:19.699 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-13T06:08:19.968 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-13T06:08:20.228 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T06:08:20.363 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-13T06:08:20.622 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-13T06:08:20.739 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-13T06:08:20.881 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-13T06:08:20.891 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-13T06:08:21.116 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T06:08:21.192 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-13T06:08:21.275 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-13T06:08:21.443 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-13T06:08:21.552 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-13T06:08:21.678 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-13T06:08:21.702 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T06:08:21.804 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-13T06:08:21.828 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-13T06:08:22.097 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-13T06:08:22.121 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-13T06:08:22.357 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-13T06:08:22.372 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-13T06:08:22.608 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T06:08:22.623 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-13T06:08:22.734 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-13T06:08:22.883 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-13T06:08:23.061 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-13T06:08:23.125 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-13T06:08:23.320 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-13T06:08:23.384 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-13T06:08:23.511 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-13T06:08:23.596 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-13T06:08:23.795 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-13T06:08:23.872 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-13T06:08:23.896 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-13T06:08:24.140 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-13T06:08:24.180 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-13T06:08:24.408 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-13T06:08:24.482 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-13T06:08:24.543 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-13T06:08:24.741 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-13T06:08:24.827 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-13T06:08:24.866 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-13T06:08:24.953 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-13T06:08:24.992 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-13T06:08:25.081 INFO:teuthology.orchestra.run.smithi194.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-13T06:08:25.230 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-13T06:08:25.328 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-13T06:08:25.479 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-13T06:08:25.523 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-13T06:08:25.749 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-13T06:08:25.850 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-13T06:08:25.863 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-13T06:08:25.951 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-13T06:08:26.040 INFO:teuthology.orchestra.run.smithi120.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-13T06:08:26.106 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-13T06:08:26.232 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-13T06:08:26.278 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-13T06:08:26.404 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-13T06:08:26.483 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T06:08:26.609 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-13T06:08:26.789 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-13T06:08:26.918 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-13T06:08:27.032 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-13T06:08:27.133 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-13T06:08:27.219 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-13T06:08:27.385 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T06:08:27.504 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-13T06:08:27.510 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-13T06:08:27.630 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-13T06:08:27.862 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-13T06:08:27.914 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-13T06:08:28.155 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-13T06:08:28.190 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-13T06:08:28.406 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-13T06:08:28.524 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-13T06:08:28.534 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-13T06:08:28.792 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-13T06:08:28.928 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-13T06:08:29.051 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-13T06:08:29.204 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-13T06:08:29.405 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-13T06:08:29.549 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-13T06:08:29.674 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up librados2 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:08:29.774 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-13T06:08:29.800 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libsqlite3-mod-ceph (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:08:29.926 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-13T06:08:30.042 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-13T06:08:30.271 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libcephfs2 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:08:30.386 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-13T06:08:30.397 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libradosstriper1 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:08:30.513 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up librados2 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:08:30.523 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-13T06:08:30.639 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libsqlite3-mod-ceph (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:08:30.765 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-13T06:08:30.799 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up librbd1 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:08:30.925 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-mgr-modules-core (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:08:31.062 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libcephfs2 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:08:31.077 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-fuse (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:08:31.213 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libradosstriper1 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:08:31.298 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T06:08:31.298 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T06:08:31.339 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-13T06:08:31.615 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up librbd1 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:08:31.741 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-mgr-modules-core (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:08:31.753 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up libcephfs-dev (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:08:31.862 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-rados (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:08:31.867 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-fuse (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:08:31.963 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up librgw2 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:08:32.064 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-13T06:08:32.082 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T06:08:32.082 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T06:08:32.593 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libcephfs-dev (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:08:32.719 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-rados (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:08:32.845 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up librgw2 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:08:32.971 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-13T06:08:33.267 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-rbd (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:08:33.393 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up rbd-fuse (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:08:33.521 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-rgw (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:08:33.647 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up python3-cephfs (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:08:33.773 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-common (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:08:34.158 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-rbd (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:08:34.274 INFO:teuthology.orchestra.run.smithi194.stdout:Adding group ceph....done 2024-09-13T06:08:34.284 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up rbd-fuse (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:08:34.410 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-rgw (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:08:34.553 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-cephfs (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:08:34.626 INFO:teuthology.orchestra.run.smithi194.stdout:Adding system user ceph....done 2024-09-13T06:08:34.670 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-common (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:08:34.736 INFO:teuthology.orchestra.run.smithi194.stdout:Setting system user ceph properties....done 2024-09-13T06:08:34.755 INFO:teuthology.orchestra.run.smithi194.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-13T06:08:34.897 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-13T06:08:35.164 INFO:teuthology.orchestra.run.smithi120.stdout:Adding group ceph....done 2024-09-13T06:08:35.247 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-13T06:08:35.548 INFO:teuthology.orchestra.run.smithi120.stdout:Adding system user ceph....done 2024-09-13T06:08:35.724 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-test (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:08:35.725 INFO:teuthology.orchestra.run.smithi120.stdout:Setting system user ceph properties....done 2024-09-13T06:08:35.742 INFO:teuthology.orchestra.run.smithi120.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-13T06:08:35.850 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up radosgw (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:08:35.876 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-13T06:08:36.189 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-13T06:08:36.345 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T06:08:36.345 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T06:08:36.688 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-test (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:08:36.814 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up radosgw (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:08:36.835 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-base (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:08:37.206 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-13T06:08:37.296 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T06:08:37.296 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T06:08:37.671 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-mds (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:08:37.774 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-base (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:08:37.878 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T06:08:37.879 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T06:08:38.161 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-13T06:08:38.330 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-mgr (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:08:38.548 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T06:08:38.549 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T06:08:38.609 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-mds (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:08:38.829 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T06:08:38.829 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T06:08:39.032 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-osd (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:08:39.294 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-mgr (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:08:39.307 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T06:08:39.307 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T06:08:39.553 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T06:08:39.553 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T06:08:39.783 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-mgr-k8sevents (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:08:39.909 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:08:40.046 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-osd (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:08:40.060 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-mon (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:08:40.279 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T06:08:40.279 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T06:08:40.314 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T06:08:40.314 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T06:08:40.761 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-mgr-cephadm (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:08:40.814 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-mgr-k8sevents (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:08:40.940 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:08:40.946 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:08:41.072 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-mgr-dashboard (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:08:41.091 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-mon (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:08:41.223 INFO:teuthology.orchestra.run.smithi194.stdout:Setting up ceph-volume (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:08:41.322 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T06:08:41.322 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T06:08:41.594 INFO:teuthology.orchestra.run.smithi194.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-13T06:08:41.719 INFO:teuthology.orchestra.run.smithi194.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-13T06:08:41.800 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-mgr-cephadm (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:08:41.951 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:08:41.997 INFO:teuthology.orchestra.run.smithi194.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-13T06:08:42.086 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-mgr-dashboard (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:08:42.212 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-volume (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-13T06:08:42.557 INFO:teuthology.orchestra.run.smithi120.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-13T06:08:42.657 INFO:teuthology.orchestra.run.smithi120.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-13T06:08:42.793 INFO:teuthology.orchestra.run.smithi120.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-13T06:08:43.214 INFO:teuthology.orchestra.run.smithi194.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-13T06:08:43.843 INFO:teuthology.orchestra.run.smithi120.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-13T06:08:43.860 INFO:teuthology.orchestra.run.smithi194.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-13T06:08:43.868 DEBUG:teuthology.parallel:result is None 2024-09-13T06:08:44.465 INFO:teuthology.orchestra.run.smithi120.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-13T06:08:44.470 DEBUG:teuthology.parallel:result is None 2024-09-13T06:08:44.471 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7162ca8a22368558b9ec845c47e93c7afc45e8c3 2024-09-13T06:08:44.622 DEBUG:teuthology.orchestra.run.smithi120:> dpkg-query -W -f '${Version}' ceph 2024-09-13T06:08:44.641 INFO:teuthology.orchestra.run.smithi120.stdout:19.1.1-304-g7162ca8a-1jammy 2024-09-13T06:08:44.641 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-304-g7162ca8a-1jammy 2024-09-13T06:08:44.641 INFO:teuthology.task.install:The correct ceph version 19.1.1-304-g7162ca8a-1jammy is installed. 2024-09-13T06:08:44.643 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7162ca8a22368558b9ec845c47e93c7afc45e8c3 2024-09-13T06:08:44.791 DEBUG:teuthology.orchestra.run.smithi194:> dpkg-query -W -f '${Version}' ceph 2024-09-13T06:08:44.810 INFO:teuthology.orchestra.run.smithi194.stdout:19.1.1-304-g7162ca8a-1jammy 2024-09-13T06:08:44.811 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-304-g7162ca8a-1jammy 2024-09-13T06:08:44.811 INFO:teuthology.task.install:The correct ceph version 19.1.1-304-g7162ca8a-1jammy is installed. 2024-09-13T06:08:44.812 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-13T06:08:44.813 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-13T06:08:44.813 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T06:08:44.828 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T06:08:44.828 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T06:08:44.863 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-13T06:08:44.864 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-13T06:08:44.864 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T06:08:44.886 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T06:08:44.941 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T06:08:44.941 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T06:08:44.954 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T06:08:45.007 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-13T06:08:45.007 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-13T06:08:45.007 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T06:08:45.019 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T06:08:45.073 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T06:08:45.074 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T06:08:45.086 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T06:08:45.139 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-13T06:08:45.139 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-13T06:08:45.139 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T06:08:45.153 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T06:08:45.209 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T06:08:45.209 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T06:08:45.223 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T06:08:45.279 INFO:teuthology.run_tasks:Running task ceph... 2024-09-13T06:08:45.355 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-13T06:08:45.355 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 777 /var/log/ceph 2024-09-13T06:08:45.358 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 777 /var/log/ceph 2024-09-13T06:08:45.372 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-13T06:08:45.372 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-13T06:08:45.415 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-13T06:08:45.427 INFO:tasks.ceph:Creating extra log directories... 2024-09-13T06:08:45.427 DEBUG:teuthology.orchestra.run.smithi120:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-13T06:08:45.467 DEBUG:teuthology.orchestra.run.smithi194:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-13T06:08:45.491 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-13T06:08:45.491 INFO:tasks.ceph:config {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-13T06:08:45.491 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/tchandra-2024-09-13_05:06:18-rgw-wip-tejas-testing-2024-09-09-1611-squid-distro-default-smithi/7903244', 'branch': 'wip-tejas-testing-2024-09-09-1611-squid', 'description': 'rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{ubuntu_latest}}', 'email': 'tchandra@redhat.com', 'first_in_suite': False, 'job_id': '7903244', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'tchandra-2024-09-13_05:06:18-rgw-wip-tejas-testing-2024-09-09-1611-squid-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-tejas-testing-2024-09-09-1611-squid'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': '7162ca8a22368558b9ec845c47e93c7afc45e8c3'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '7162ca8a22368558b9ec845c47e93c7afc45e8c3'}}, 'rgw': {'ec-data-pool': True, 'erasure_code_profile': {'crush-failure-domain': 'osd', 'k': 3, 'm': 1, 'name': 'testprofile'}, 'frontend': 'beast'}, 's3tests': {'slow_backend': True}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-tejas-testing-2024-09-09-1611-squid', 'sha1': '7162ca8a22368558b9ec845c47e93c7afc45e8c3'}}, 'owner': 'scheduled_tchandra@teuthology', 'priority': 100, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'osd.0'], ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3']], 'seed': 9276, 'sha1': '7162ca8a22368558b9ec845c47e93c7afc45e8c3', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-tejas-testing-2024-09-09-1611-squid', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_7162ca8a22368558b9ec845c47e93c7afc45e8c3/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '7162ca8a22368558b9ec845c47e93c7afc45e8c3', 'targets': {'smithi120.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO79P+9X1hZdCsaAV6ToaJG9Q0lBjrnAiknFG59spMhgZvF9CYKDpI6UogwMiTO1vvswat/B/mYw3YTtL4JinYQ=', 'smithi194.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJkDh+3szbWsGkQ1AIRtgMqDVSJl/meyrZw1rOMnLYSpzioY3Mm1hMaP57aI1r9zVs6uB0f/z9KEZOjS80udUR0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': '7162ca8a22368558b9ec845c47e93c7afc45e8c3', 'cluster': 'ceph'}}, {'rgw': {'client.0': None}}, {'radosgw-admin': None}, {'radosgw-admin-rest': None}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-13_05:06:18', 'tube': 'smithi', 'user': 'tchandra', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-13T06:08:45.492 DEBUG:teuthology.orchestra.run.smithi120:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-13T06:08:45.522 DEBUG:teuthology.orchestra.run.smithi194:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-13T06:08:45.531 DEBUG:teuthology.orchestra.run.smithi120:> sudo install -d -m0777 -- /var/run/ceph 2024-09-13T06:08:45.570 DEBUG:teuthology.orchestra.run.smithi194:> sudo install -d -m0777 -- /var/run/ceph 2024-09-13T06:08:45.587 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-13T06:08:45.587 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T06:08:45.634 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T06:08:45.634 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_1 2024-09-13T06:08:45.686 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T06:08:45.686 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T06:08:45.686 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 5h/5d Inode: 876 Links: 1 2024-09-13T06:08:45.687 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T06:08:45.687 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2024-09-13 06:03:22.181807635 +0000 2024-09-13T06:08:45.687 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2024-09-13 06:03:21.929809887 +0000 2024-09-13T06:08:45.687 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2024-09-13 06:03:21.929809887 +0000 2024-09-13T06:08:45.687 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: - 2024-09-13T06:08:45.687 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T06:08:45.740 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2024-09-13T06:08:45.740 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2024-09-13T06:08:45.740 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.00034235 s, 1.5 MB/s 2024-09-13T06:08:45.741 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T06:08:45.791 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_2 2024-09-13T06:08:45.842 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T06:08:45.842 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T06:08:45.842 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 5h/5d Inode: 889 Links: 1 2024-09-13T06:08:45.842 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T06:08:45.842 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2024-09-13 06:03:22.665803314 +0000 2024-09-13T06:08:45.842 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2024-09-13 06:03:22.397805707 +0000 2024-09-13T06:08:45.842 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2024-09-13 06:03:22.397805707 +0000 2024-09-13T06:08:45.842 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: - 2024-09-13T06:08:45.843 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T06:08:45.896 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2024-09-13T06:08:45.896 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2024-09-13T06:08:45.896 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.00041612 s, 1.2 MB/s 2024-09-13T06:08:45.897 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T06:08:45.947 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_3 2024-09-13T06:08:45.994 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T06:08:45.994 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T06:08:45.994 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 5h/5d Inode: 903 Links: 1 2024-09-13T06:08:45.994 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T06:08:45.994 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2024-09-13 06:03:23.181798704 +0000 2024-09-13T06:08:45.994 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2024-09-13 06:03:22.889801313 +0000 2024-09-13T06:08:45.994 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2024-09-13 06:03:22.889801313 +0000 2024-09-13T06:08:45.994 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: - 2024-09-13T06:08:45.995 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T06:08:46.048 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2024-09-13T06:08:46.048 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2024-09-13T06:08:46.048 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.000349501 s, 1.5 MB/s 2024-09-13T06:08:46.049 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T06:08:46.099 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_4 2024-09-13T06:08:46.146 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T06:08:46.146 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T06:08:46.146 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 5h/5d Inode: 920 Links: 1 2024-09-13T06:08:46.146 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T06:08:46.146 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2024-09-13 06:03:23.725793844 +0000 2024-09-13T06:08:46.146 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2024-09-13 06:03:23.417796596 +0000 2024-09-13T06:08:46.146 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2024-09-13 06:03:23.417796596 +0000 2024-09-13T06:08:46.146 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: - 2024-09-13T06:08:46.146 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T06:08:46.200 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2024-09-13T06:08:46.200 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2024-09-13T06:08:46.200 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.000319294 s, 1.6 MB/s 2024-09-13T06:08:46.201 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T06:08:46.252 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-13T06:08:46.252 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T06:08:46.252 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T06:08:46.258 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T06:08:46.258 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_1 2024-09-13T06:08:46.304 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T06:08:46.305 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T06:08:46.305 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 5h/5d Inode: 878 Links: 1 2024-09-13T06:08:46.305 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T06:08:46.305 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2024-09-13 06:03:22.266299370 +0000 2024-09-13T06:08:46.305 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-09-13 06:03:21.978301942 +0000 2024-09-13T06:08:46.305 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-09-13 06:03:21.978301942 +0000 2024-09-13T06:08:46.305 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: - 2024-09-13T06:08:46.305 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T06:08:46.358 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2024-09-13T06:08:46.358 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2024-09-13T06:08:46.358 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000400846 s, 1.3 MB/s 2024-09-13T06:08:46.359 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T06:08:46.414 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_2 2024-09-13T06:08:46.464 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T06:08:46.464 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T06:08:46.464 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 5h/5d Inode: 898 Links: 1 2024-09-13T06:08:46.464 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T06:08:46.464 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2024-09-13 06:03:22.530297011 +0000 2024-09-13T06:08:46.464 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-09-13 06:03:22.526297046 +0000 2024-09-13T06:08:46.464 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-09-13 06:03:22.526297046 +0000 2024-09-13T06:08:46.465 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: - 2024-09-13T06:08:46.465 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T06:08:46.519 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2024-09-13T06:08:46.519 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2024-09-13T06:08:46.519 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000413295 s, 1.2 MB/s 2024-09-13T06:08:46.520 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T06:08:46.569 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_3 2024-09-13T06:08:46.616 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T06:08:46.616 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T06:08:46.616 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 5h/5d Inode: 917 Links: 1 2024-09-13T06:08:46.616 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T06:08:46.616 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2024-09-13 06:03:23.306290080 +0000 2024-09-13T06:08:46.616 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-09-13 06:03:23.054292331 +0000 2024-09-13T06:08:46.616 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-09-13 06:03:23.054292331 +0000 2024-09-13T06:08:46.617 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: - 2024-09-13T06:08:46.617 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T06:08:46.670 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2024-09-13T06:08:46.670 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2024-09-13T06:08:46.670 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000384023 s, 1.3 MB/s 2024-09-13T06:08:46.672 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T06:08:46.721 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_4 2024-09-13T06:08:46.772 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T06:08:46.772 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T06:08:46.772 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 5h/5d Inode: 933 Links: 1 2024-09-13T06:08:46.773 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T06:08:46.773 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2024-09-13 06:03:23.538288008 +0000 2024-09-13T06:08:46.773 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-09-13 06:03:23.534288044 +0000 2024-09-13T06:08:46.773 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-09-13 06:03:23.534288044 +0000 2024-09-13T06:08:46.773 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: - 2024-09-13T06:08:46.773 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T06:08:46.825 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2024-09-13T06:08:46.825 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2024-09-13T06:08:46.825 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000280841 s, 1.8 MB/s 2024-09-13T06:08:46.827 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T06:08:46.877 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-13T06:08:46.877 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi120.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi194.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-09-13T06:08:46.877 INFO:tasks.ceph:Generating config... 2024-09-13T06:08:46.879 INFO:tasks.ceph:[client] debug ms = 1 2024-09-13T06:08:46.879 INFO:tasks.ceph:[client] rgw gc obj min wait = 15 2024-09-13T06:08:46.879 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-13T06:08:46.879 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-13T06:08:46.879 INFO:tasks.ceph:[client] setuser = ceph 2024-09-13T06:08:46.879 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-13T06:08:46.879 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-13T06:08:46.879 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-13T06:08:46.879 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-13T06:08:46.879 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-13T06:08:46.879 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-13T06:08:46.879 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-13T06:08:46.879 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-13T06:08:46.880 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-13T06:08:46.880 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-13T06:08:46.880 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-13T06:08:46.880 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-13T06:08:46.880 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-13T06:08:46.880 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-13T06:08:46.880 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-13T06:08:46.880 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-13T06:08:46.880 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-13T06:08:46.880 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-13T06:08:46.880 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-13T06:08:46.880 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-13T06:08:46.880 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-13T06:08:46.880 INFO:tasks.ceph:Setting up mon.a... 2024-09-13T06:08:46.881 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-13T06:08:46.916 INFO:teuthology.orchestra.run.smithi120.stdout:creating /etc/ceph/ceph.keyring 2024-09-13T06:08:46.933 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-13T06:08:47.012 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T06:08:47.065 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.120')] 2024-09-13T06:08:47.065 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.120'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}} 2024-09-13T06:08:47.066 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-13T06:08:47.066 DEBUG:teuthology.orchestra.run.smithi120:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-13T06:08:47.114 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.120 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-13T06:08:47.192 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:08:47.192 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:08:47.192 INFO:teuthology.orchestra.run.smithi120.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-13T06:08:47.193 INFO:teuthology.orchestra.run.smithi120.stdout:monmaptool: generated fsid b924da04-5ce7-4b88-90c8-d1e25fda89f0 2024-09-13T06:08:47.193 INFO:teuthology.orchestra.run.smithi120.stdout:setting min_mon_release = quincy 2024-09-13T06:08:47.193 INFO:teuthology.orchestra.run.smithi120.stdout:epoch 0 2024-09-13T06:08:47.193 INFO:teuthology.orchestra.run.smithi120.stdout:fsid b924da04-5ce7-4b88-90c8-d1e25fda89f0 2024-09-13T06:08:47.193 INFO:teuthology.orchestra.run.smithi120.stdout:last_changed 2024-09-13T06:08:47.195875+0000 2024-09-13T06:08:47.193 INFO:teuthology.orchestra.run.smithi120.stdout:created 2024-09-13T06:08:47.195875+0000 2024-09-13T06:08:47.193 INFO:teuthology.orchestra.run.smithi120.stdout:min_mon_release 17 (quincy) 2024-09-13T06:08:47.193 INFO:teuthology.orchestra.run.smithi120.stdout:election_strategy: 1 2024-09-13T06:08:47.193 INFO:teuthology.orchestra.run.smithi120.stdout:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-13T06:08:47.194 INFO:teuthology.orchestra.run.smithi120.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-09-13T06:08:47.195 DEBUG:teuthology.orchestra.run.smithi120:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-13T06:08:47.245 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID b924da04-5ce7-4b88-90c8-d1e25fda89f0... 2024-09-13T06:08:47.245 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T06:08:47.291 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T06:08:47.319 INFO:teuthology.orchestra.run.smithi120.stdout:[global] 2024-09-13T06:08:47.319 INFO:teuthology.orchestra.run.smithi120.stdout: chdir = "" 2024-09-13T06:08:47.319 INFO:teuthology.orchestra.run.smithi120.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T06:08:47.319 INFO:teuthology.orchestra.run.smithi120.stdout: auth supported = cephx 2024-09-13T06:08:47.319 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T06:08:47.319 INFO:teuthology.orchestra.run.smithi120.stdout: filestore xattr use omap = true 2024-09-13T06:08:47.319 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T06:08:47.319 INFO:teuthology.orchestra.run.smithi120.stdout: mon clock drift allowed = 1.000 2024-09-13T06:08:47.319 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T06:08:47.319 INFO:teuthology.orchestra.run.smithi120.stdout: osd crush chooseleaf type = 0 2024-09-13T06:08:47.319 INFO:teuthology.orchestra.run.smithi120.stdout: auth debug = true 2024-09-13T06:08:47.320 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T06:08:47.320 INFO:teuthology.orchestra.run.smithi120.stdout: ms die on old message = true 2024-09-13T06:08:47.320 INFO:teuthology.orchestra.run.smithi120.stdout: ms die on bug = true 2024-09-13T06:08:47.320 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T06:08:47.320 INFO:teuthology.orchestra.run.smithi120.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T06:08:47.320 INFO:teuthology.orchestra.run.smithi120.stdout: mon pg warn max object skew = 0 2024-09-13T06:08:47.320 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T06:08:47.320 INFO:teuthology.orchestra.run.smithi120.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T06:08:47.320 INFO:teuthology.orchestra.run.smithi120.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T06:08:47.320 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T06:08:47.320 INFO:teuthology.orchestra.run.smithi120.stdout: osd pool default size = 2 2024-09-13T06:08:47.320 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T06:08:47.320 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd allow primary affinity = true 2024-09-13T06:08:47.320 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd allow pg remap = true 2024-09-13T06:08:47.321 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on legacy crush tunables = false 2024-09-13T06:08:47.321 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on crush straw calc version zero = false 2024-09-13T06:08:47.321 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on no sortbitwise = false 2024-09-13T06:08:47.321 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on osd down out interval zero = false 2024-09-13T06:08:47.321 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on too few osds = false 2024-09-13T06:08:47.321 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T06:08:47.321 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T06:08:47.321 INFO:teuthology.orchestra.run.smithi120.stdout: mon_allow_pool_size_one = true 2024-09-13T06:08:47.321 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T06:08:47.321 INFO:teuthology.orchestra.run.smithi120.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T06:08:47.321 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T06:08:47.321 INFO:teuthology.orchestra.run.smithi120.stdout: osd default data pool replay window = 5 2024-09-13T06:08:47.321 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T06:08:47.322 INFO:teuthology.orchestra.run.smithi120.stdout: mon allow pool delete = true 2024-09-13T06:08:47.322 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T06:08:47.322 INFO:teuthology.orchestra.run.smithi120.stdout: mon cluster log file level = debug 2024-09-13T06:08:47.322 INFO:teuthology.orchestra.run.smithi120.stdout: debug asserts on shutdown = true 2024-09-13T06:08:47.322 INFO:teuthology.orchestra.run.smithi120.stdout: mon health detail to clog = false 2024-09-13T06:08:47.322 INFO:teuthology.orchestra.run.smithi120.stdout: mon host = 172.21.15.120 2024-09-13T06:08:47.322 INFO:teuthology.orchestra.run.smithi120.stdout: fsid = b924da04-5ce7-4b88-90c8-d1e25fda89f0 2024-09-13T06:08:47.322 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T06:08:47.322 INFO:teuthology.orchestra.run.smithi120.stdout:[osd] 2024-09-13T06:08:47.322 INFO:teuthology.orchestra.run.smithi120.stdout: osd journal size = 100 2024-09-13T06:08:47.322 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T06:08:47.322 INFO:teuthology.orchestra.run.smithi120.stdout: osd scrub load threshold = 5.0 2024-09-13T06:08:47.322 INFO:teuthology.orchestra.run.smithi120.stdout: osd scrub max interval = 600 2024-09-13T06:08:47.323 INFO:teuthology.orchestra.run.smithi120.stdout: osd mclock profile = high_recovery_ops 2024-09-13T06:08:47.323 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T06:08:47.323 INFO:teuthology.orchestra.run.smithi120.stdout: osd recover clone overlap = true 2024-09-13T06:08:47.323 INFO:teuthology.orchestra.run.smithi120.stdout: osd recovery max chunk = 1048576 2024-09-13T06:08:47.323 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T06:08:47.323 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug shutdown = true 2024-09-13T06:08:47.323 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug op order = true 2024-09-13T06:08:47.323 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug verify stray on activate = true 2024-09-13T06:08:47.323 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug trim objects = true 2024-09-13T06:08:47.323 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T06:08:47.323 INFO:teuthology.orchestra.run.smithi120.stdout: osd open classes on start = true 2024-09-13T06:08:47.323 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug pg log writeout = true 2024-09-13T06:08:47.323 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T06:08:47.324 INFO:teuthology.orchestra.run.smithi120.stdout: osd deep scrub update digest min age = 30 2024-09-13T06:08:47.324 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T06:08:47.324 INFO:teuthology.orchestra.run.smithi120.stdout: osd map max advance = 10 2024-09-13T06:08:47.324 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T06:08:47.324 INFO:teuthology.orchestra.run.smithi120.stdout: journal zero on create = true 2024-09-13T06:08:47.324 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T06:08:47.324 INFO:teuthology.orchestra.run.smithi120.stdout: filestore ondisk finisher threads = 3 2024-09-13T06:08:47.324 INFO:teuthology.orchestra.run.smithi120.stdout: filestore apply finisher threads = 3 2024-09-13T06:08:47.324 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T06:08:47.324 INFO:teuthology.orchestra.run.smithi120.stdout: bdev debug aio = true 2024-09-13T06:08:47.324 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug misdirected ops = true 2024-09-13T06:08:47.324 INFO:teuthology.orchestra.run.smithi120.stdout: debug ms = 1 2024-09-13T06:08:47.324 INFO:teuthology.orchestra.run.smithi120.stdout: debug objclass = 20 2024-09-13T06:08:47.324 INFO:teuthology.orchestra.run.smithi120.stdout: bdev async discard = True 2024-09-13T06:08:47.325 INFO:teuthology.orchestra.run.smithi120.stdout: bdev enable discard = True 2024-09-13T06:08:47.325 INFO:teuthology.orchestra.run.smithi120.stdout: bluestore allocator = bitmap 2024-09-13T06:08:47.325 INFO:teuthology.orchestra.run.smithi120.stdout: bluestore block size = 96636764160 2024-09-13T06:08:47.325 INFO:teuthology.orchestra.run.smithi120.stdout: bluestore fsck on mount = True 2024-09-13T06:08:47.325 INFO:teuthology.orchestra.run.smithi120.stdout: debug bluefs = 1/20 2024-09-13T06:08:47.325 INFO:teuthology.orchestra.run.smithi120.stdout: debug bluestore = 1/20 2024-09-13T06:08:47.325 INFO:teuthology.orchestra.run.smithi120.stdout: debug osd = 20 2024-09-13T06:08:47.325 INFO:teuthology.orchestra.run.smithi120.stdout: debug rocksdb = 4/10 2024-09-13T06:08:47.325 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T06:08:47.325 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd full ratio = 0.9 2024-09-13T06:08:47.325 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd nearfull ratio = 0.8 2024-09-13T06:08:47.325 INFO:teuthology.orchestra.run.smithi120.stdout: osd failsafe full ratio = 0.95 2024-09-13T06:08:47.325 INFO:teuthology.orchestra.run.smithi120.stdout: osd objectstore = bluestore 2024-09-13T06:08:47.326 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T06:08:47.326 INFO:teuthology.orchestra.run.smithi120.stdout:[mgr] 2024-09-13T06:08:47.326 INFO:teuthology.orchestra.run.smithi120.stdout: debug ms = 1 2024-09-13T06:08:47.326 INFO:teuthology.orchestra.run.smithi120.stdout: debug mgr = 20 2024-09-13T06:08:47.326 INFO:teuthology.orchestra.run.smithi120.stdout: debug mon = 20 2024-09-13T06:08:47.326 INFO:teuthology.orchestra.run.smithi120.stdout: debug auth = 20 2024-09-13T06:08:47.326 INFO:teuthology.orchestra.run.smithi120.stdout: mon reweight min pgs per osd = 4 2024-09-13T06:08:47.326 INFO:teuthology.orchestra.run.smithi120.stdout: mon reweight min bytes per osd = 10 2024-09-13T06:08:47.326 INFO:teuthology.orchestra.run.smithi120.stdout: mgr/telemetry/nag = false 2024-09-13T06:08:47.326 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T06:08:47.326 INFO:teuthology.orchestra.run.smithi120.stdout:[mon] 2024-09-13T06:08:47.326 INFO:teuthology.orchestra.run.smithi120.stdout: debug ms = 1 2024-09-13T06:08:47.326 INFO:teuthology.orchestra.run.smithi120.stdout: debug mon = 20 2024-09-13T06:08:47.326 INFO:teuthology.orchestra.run.smithi120.stdout: debug paxos = 20 2024-09-13T06:08:47.327 INFO:teuthology.orchestra.run.smithi120.stdout: debug auth = 20 2024-09-13T06:08:47.327 INFO:teuthology.orchestra.run.smithi120.stdout: mon data avail warn = 5 2024-09-13T06:08:47.327 INFO:teuthology.orchestra.run.smithi120.stdout: mon mgr mkfs grace = 240 2024-09-13T06:08:47.327 INFO:teuthology.orchestra.run.smithi120.stdout: mon reweight min pgs per osd = 4 2024-09-13T06:08:47.327 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd reporter subtree level = osd 2024-09-13T06:08:47.327 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd prime pg temp = true 2024-09-13T06:08:47.327 INFO:teuthology.orchestra.run.smithi120.stdout: mon reweight min bytes per osd = 10 2024-09-13T06:08:47.327 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T06:08:47.327 INFO:teuthology.orchestra.run.smithi120.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T06:08:47.327 INFO:teuthology.orchestra.run.smithi120.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T06:08:47.327 INFO:teuthology.orchestra.run.smithi120.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T06:08:47.327 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T06:08:47.327 INFO:teuthology.orchestra.run.smithi120.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T06:08:47.327 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T06:08:47.328 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T06:08:47.328 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T06:08:47.328 INFO:teuthology.orchestra.run.smithi120.stdout: # 1m isn't quite enough 2024-09-13T06:08:47.328 INFO:teuthology.orchestra.run.smithi120.stdout: mon_down_mkfs_grace = 2m 2024-09-13T06:08:47.328 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T06:08:47.328 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_filestore_osds = false 2024-09-13T06:08:47.328 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T06:08:47.328 INFO:teuthology.orchestra.run.smithi120.stdout:[client] 2024-09-13T06:08:47.328 INFO:teuthology.orchestra.run.smithi120.stdout: rgw cache enabled = true 2024-09-13T06:08:47.328 INFO:teuthology.orchestra.run.smithi120.stdout: rgw enable ops log = true 2024-09-13T06:08:47.328 INFO:teuthology.orchestra.run.smithi120.stdout: rgw enable usage log = true 2024-09-13T06:08:47.328 INFO:teuthology.orchestra.run.smithi120.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T06:08:47.328 INFO:teuthology.orchestra.run.smithi120.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T06:08:47.329 INFO:teuthology.orchestra.run.smithi120.stdout: debug ms = 1 2024-09-13T06:08:47.329 INFO:teuthology.orchestra.run.smithi120.stdout: rgw gc obj min wait = 15 2024-09-13T06:08:47.329 INFO:teuthology.orchestra.run.smithi120.stdout: debug rgw = 20 2024-09-13T06:08:47.329 INFO:teuthology.orchestra.run.smithi120.stdout: setgroup = ceph 2024-09-13T06:08:47.329 INFO:teuthology.orchestra.run.smithi120.stdout: setuser = ceph 2024-09-13T06:08:47.329 INFO:teuthology.orchestra.run.smithi120.stdout:[mon.a] 2024-09-13T06:08:47.329 INFO:teuthology.orchestra.run.smithi194.stdout:[global] 2024-09-13T06:08:47.329 INFO:teuthology.orchestra.run.smithi194.stdout: chdir = "" 2024-09-13T06:08:47.330 INFO:teuthology.orchestra.run.smithi194.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T06:08:47.330 INFO:teuthology.orchestra.run.smithi194.stdout: auth supported = cephx 2024-09-13T06:08:47.330 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T06:08:47.330 INFO:teuthology.orchestra.run.smithi194.stdout: filestore xattr use omap = true 2024-09-13T06:08:47.330 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T06:08:47.330 INFO:teuthology.orchestra.run.smithi194.stdout: mon clock drift allowed = 1.000 2024-09-13T06:08:47.330 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T06:08:47.330 INFO:teuthology.orchestra.run.smithi194.stdout: osd crush chooseleaf type = 0 2024-09-13T06:08:47.330 INFO:teuthology.orchestra.run.smithi194.stdout: auth debug = true 2024-09-13T06:08:47.330 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T06:08:47.330 INFO:teuthology.orchestra.run.smithi194.stdout: ms die on old message = true 2024-09-13T06:08:47.330 INFO:teuthology.orchestra.run.smithi194.stdout: ms die on bug = true 2024-09-13T06:08:47.330 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T06:08:47.331 INFO:teuthology.orchestra.run.smithi194.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T06:08:47.331 INFO:teuthology.orchestra.run.smithi194.stdout: mon pg warn max object skew = 0 2024-09-13T06:08:47.331 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T06:08:47.331 INFO:teuthology.orchestra.run.smithi194.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T06:08:47.331 INFO:teuthology.orchestra.run.smithi194.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T06:08:47.331 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T06:08:47.331 INFO:teuthology.orchestra.run.smithi194.stdout: osd pool default size = 2 2024-09-13T06:08:47.331 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T06:08:47.331 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd allow primary affinity = true 2024-09-13T06:08:47.331 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd allow pg remap = true 2024-09-13T06:08:47.331 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on legacy crush tunables = false 2024-09-13T06:08:47.331 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on crush straw calc version zero = false 2024-09-13T06:08:47.331 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on no sortbitwise = false 2024-09-13T06:08:47.331 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on osd down out interval zero = false 2024-09-13T06:08:47.331 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on too few osds = false 2024-09-13T06:08:47.332 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T06:08:47.332 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T06:08:47.332 INFO:teuthology.orchestra.run.smithi194.stdout: mon_allow_pool_size_one = true 2024-09-13T06:08:47.332 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T06:08:47.332 INFO:teuthology.orchestra.run.smithi194.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T06:08:47.332 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T06:08:47.332 INFO:teuthology.orchestra.run.smithi194.stdout: osd default data pool replay window = 5 2024-09-13T06:08:47.332 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T06:08:47.332 INFO:teuthology.orchestra.run.smithi194.stdout: mon allow pool delete = true 2024-09-13T06:08:47.332 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T06:08:47.332 INFO:teuthology.orchestra.run.smithi194.stdout: mon cluster log file level = debug 2024-09-13T06:08:47.332 INFO:teuthology.orchestra.run.smithi194.stdout: debug asserts on shutdown = true 2024-09-13T06:08:47.332 INFO:teuthology.orchestra.run.smithi194.stdout: mon health detail to clog = false 2024-09-13T06:08:47.333 INFO:teuthology.orchestra.run.smithi194.stdout: mon host = 172.21.15.120 2024-09-13T06:08:47.333 INFO:teuthology.orchestra.run.smithi194.stdout: fsid = b924da04-5ce7-4b88-90c8-d1e25fda89f0 2024-09-13T06:08:47.333 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T06:08:47.333 INFO:teuthology.orchestra.run.smithi194.stdout:[osd] 2024-09-13T06:08:47.333 INFO:teuthology.orchestra.run.smithi194.stdout: osd journal size = 100 2024-09-13T06:08:47.333 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T06:08:47.333 INFO:teuthology.orchestra.run.smithi194.stdout: osd scrub load threshold = 5.0 2024-09-13T06:08:47.333 INFO:teuthology.orchestra.run.smithi194.stdout: osd scrub max interval = 600 2024-09-13T06:08:47.333 INFO:teuthology.orchestra.run.smithi194.stdout: osd mclock profile = high_recovery_ops 2024-09-13T06:08:47.333 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T06:08:47.333 INFO:teuthology.orchestra.run.smithi194.stdout: osd recover clone overlap = true 2024-09-13T06:08:47.333 INFO:teuthology.orchestra.run.smithi194.stdout: osd recovery max chunk = 1048576 2024-09-13T06:08:47.333 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T06:08:47.334 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug shutdown = true 2024-09-13T06:08:47.334 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug op order = true 2024-09-13T06:08:47.334 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug verify stray on activate = true 2024-09-13T06:08:47.334 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug trim objects = true 2024-09-13T06:08:47.334 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T06:08:47.334 INFO:teuthology.orchestra.run.smithi194.stdout: osd open classes on start = true 2024-09-13T06:08:47.334 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug pg log writeout = true 2024-09-13T06:08:47.334 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T06:08:47.334 INFO:teuthology.orchestra.run.smithi194.stdout: osd deep scrub update digest min age = 30 2024-09-13T06:08:47.334 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T06:08:47.334 INFO:teuthology.orchestra.run.smithi194.stdout: osd map max advance = 10 2024-09-13T06:08:47.334 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T06:08:47.334 INFO:teuthology.orchestra.run.smithi194.stdout: journal zero on create = true 2024-09-13T06:08:47.334 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T06:08:47.335 INFO:teuthology.orchestra.run.smithi194.stdout: filestore ondisk finisher threads = 3 2024-09-13T06:08:47.335 INFO:teuthology.orchestra.run.smithi194.stdout: filestore apply finisher threads = 3 2024-09-13T06:08:47.335 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T06:08:47.335 INFO:teuthology.orchestra.run.smithi194.stdout: bdev debug aio = true 2024-09-13T06:08:47.335 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug misdirected ops = true 2024-09-13T06:08:47.335 INFO:teuthology.orchestra.run.smithi194.stdout: debug ms = 1 2024-09-13T06:08:47.335 INFO:teuthology.orchestra.run.smithi194.stdout: debug objclass = 20 2024-09-13T06:08:47.335 INFO:teuthology.orchestra.run.smithi194.stdout: bdev async discard = True 2024-09-13T06:08:47.335 INFO:teuthology.orchestra.run.smithi194.stdout: bdev enable discard = True 2024-09-13T06:08:47.335 INFO:teuthology.orchestra.run.smithi194.stdout: bluestore allocator = bitmap 2024-09-13T06:08:47.335 INFO:teuthology.orchestra.run.smithi194.stdout: bluestore block size = 96636764160 2024-09-13T06:08:47.335 INFO:teuthology.orchestra.run.smithi194.stdout: bluestore fsck on mount = True 2024-09-13T06:08:47.335 INFO:teuthology.orchestra.run.smithi194.stdout: debug bluefs = 1/20 2024-09-13T06:08:47.335 INFO:teuthology.orchestra.run.smithi194.stdout: debug bluestore = 1/20 2024-09-13T06:08:47.335 INFO:teuthology.orchestra.run.smithi194.stdout: debug osd = 20 2024-09-13T06:08:47.336 INFO:teuthology.orchestra.run.smithi194.stdout: debug rocksdb = 4/10 2024-09-13T06:08:47.336 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T06:08:47.336 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd full ratio = 0.9 2024-09-13T06:08:47.336 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd nearfull ratio = 0.8 2024-09-13T06:08:47.336 INFO:teuthology.orchestra.run.smithi194.stdout: osd failsafe full ratio = 0.95 2024-09-13T06:08:47.336 INFO:teuthology.orchestra.run.smithi194.stdout: osd objectstore = bluestore 2024-09-13T06:08:47.336 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T06:08:47.336 INFO:teuthology.orchestra.run.smithi194.stdout:[mgr] 2024-09-13T06:08:47.336 INFO:teuthology.orchestra.run.smithi194.stdout: debug ms = 1 2024-09-13T06:08:47.336 INFO:teuthology.orchestra.run.smithi194.stdout: debug mgr = 20 2024-09-13T06:08:47.336 INFO:teuthology.orchestra.run.smithi194.stdout: debug mon = 20 2024-09-13T06:08:47.336 INFO:teuthology.orchestra.run.smithi194.stdout: debug auth = 20 2024-09-13T06:08:47.336 INFO:teuthology.orchestra.run.smithi194.stdout: mon reweight min pgs per osd = 4 2024-09-13T06:08:47.336 INFO:teuthology.orchestra.run.smithi194.stdout: mon reweight min bytes per osd = 10 2024-09-13T06:08:47.337 INFO:teuthology.orchestra.run.smithi194.stdout: mgr/telemetry/nag = false 2024-09-13T06:08:47.337 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T06:08:47.337 INFO:teuthology.orchestra.run.smithi194.stdout:[mon] 2024-09-13T06:08:47.337 INFO:teuthology.orchestra.run.smithi194.stdout: debug ms = 1 2024-09-13T06:08:47.337 INFO:teuthology.orchestra.run.smithi194.stdout: debug mon = 20 2024-09-13T06:08:47.337 INFO:teuthology.orchestra.run.smithi194.stdout: debug paxos = 20 2024-09-13T06:08:47.337 INFO:teuthology.orchestra.run.smithi194.stdout: debug auth = 20 2024-09-13T06:08:47.337 INFO:teuthology.orchestra.run.smithi194.stdout: mon data avail warn = 5 2024-09-13T06:08:47.337 INFO:teuthology.orchestra.run.smithi194.stdout: mon mgr mkfs grace = 240 2024-09-13T06:08:47.337 INFO:teuthology.orchestra.run.smithi194.stdout: mon reweight min pgs per osd = 4 2024-09-13T06:08:47.337 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd reporter subtree level = osd 2024-09-13T06:08:47.337 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd prime pg temp = true 2024-09-13T06:08:47.337 INFO:teuthology.orchestra.run.smithi194.stdout: mon reweight min bytes per osd = 10 2024-09-13T06:08:47.338 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T06:08:47.338 INFO:teuthology.orchestra.run.smithi194.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T06:08:47.338 INFO:teuthology.orchestra.run.smithi194.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T06:08:47.338 INFO:teuthology.orchestra.run.smithi194.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T06:08:47.338 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T06:08:47.338 INFO:teuthology.orchestra.run.smithi194.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T06:08:47.338 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T06:08:47.338 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T06:08:47.338 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T06:08:47.338 INFO:teuthology.orchestra.run.smithi194.stdout: # 1m isn't quite enough 2024-09-13T06:08:47.338 INFO:teuthology.orchestra.run.smithi194.stdout: mon_down_mkfs_grace = 2m 2024-09-13T06:08:47.338 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T06:08:47.338 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_filestore_osds = false 2024-09-13T06:08:47.338 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T06:08:47.338 INFO:teuthology.orchestra.run.smithi194.stdout:[client] 2024-09-13T06:08:47.339 INFO:teuthology.orchestra.run.smithi194.stdout: rgw cache enabled = true 2024-09-13T06:08:47.339 INFO:teuthology.orchestra.run.smithi194.stdout: rgw enable ops log = true 2024-09-13T06:08:47.339 INFO:teuthology.orchestra.run.smithi194.stdout: rgw enable usage log = true 2024-09-13T06:08:47.339 INFO:teuthology.orchestra.run.smithi194.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T06:08:47.339 INFO:teuthology.orchestra.run.smithi194.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T06:08:47.339 INFO:teuthology.orchestra.run.smithi194.stdout: debug ms = 1 2024-09-13T06:08:47.339 INFO:teuthology.orchestra.run.smithi194.stdout: rgw gc obj min wait = 15 2024-09-13T06:08:47.339 INFO:teuthology.orchestra.run.smithi194.stdout: debug rgw = 20 2024-09-13T06:08:47.339 INFO:teuthology.orchestra.run.smithi194.stdout: setgroup = ceph 2024-09-13T06:08:47.339 INFO:teuthology.orchestra.run.smithi194.stdout: setuser = ceph 2024-09-13T06:08:47.339 INFO:teuthology.orchestra.run.smithi194.stdout:[mon.a] 2024-09-13T06:08:47.340 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-13T06:08:47.341 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-13T06:08:47.428 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-13T06:08:47.429 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-13T06:08:47.429 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-13T06:08:47.434 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-13T06:08:47.434 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-13T06:08:47.481 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi120.front.sepia.ceph.com 2024-09-13T06:08:47.481 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-13T06:08:47.481 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-13T06:08:47.481 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T06:08:47.547 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-13T06:08:47.547 DEBUG:teuthology.orchestra.run.smithi120:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-13T06:08:47.594 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi194.front.sepia.ceph.com 2024-09-13T06:08:47.594 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T06:08:47.594 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-13T06:08:47.594 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T06:08:47.617 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T06:08:47.617 DEBUG:teuthology.orchestra.run.smithi194:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-13T06:08:47.663 INFO:tasks.ceph:Setting up mon nodes... 2024-09-13T06:08:47.664 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-13T06:08:47.664 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-13T06:08:47.748 INFO:teuthology.orchestra.run.smithi194.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-13T06:08:47.768 INFO:tasks.ceph:Setting up mds nodes... 2024-09-13T06:08:47.768 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-13T06:08:47.769 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-13T06:08:47.845 INFO:teuthology.orchestra.run.smithi194.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-13T06:08:47.857 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-13T06:08:47.857 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi120.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi194.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-09-13T06:08:47.858 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-13T06:08:47.871 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-13T06:08:47.871 INFO:tasks.ceph:role: osd.0 2024-09-13T06:08:47.871 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi120.front.sepia.ceph.com 2024-09-13T06:08:47.871 DEBUG:teuthology.orchestra.run.smithi120:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-13T06:08:47.934 INFO:teuthology.orchestra.run.smithi120.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T06:08:47.934 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T06:08:47.934 INFO:teuthology.orchestra.run.smithi120.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T06:08:47.934 INFO:teuthology.orchestra.run.smithi120.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-13T06:08:47.934 INFO:teuthology.orchestra.run.smithi120.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T06:08:47.934 INFO:teuthology.orchestra.run.smithi120.stdout: = sunit=0 swidth=0 blks 2024-09-13T06:08:47.934 INFO:teuthology.orchestra.run.smithi120.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T06:08:47.934 INFO:teuthology.orchestra.run.smithi120.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T06:08:47.934 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T06:08:47.934 INFO:teuthology.orchestra.run.smithi120.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T06:08:48.397 INFO:teuthology.orchestra.run.smithi120.stdout:Discarding blocks...Done. 2024-09-13T06:08:48.399 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi120.front.sepia.ceph.com -o noatime 2024-09-13T06:08:48.399 DEBUG:teuthology.orchestra.run.smithi120:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-13T06:08:48.491 DEBUG:teuthology.orchestra.run.smithi120:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-13T06:08:48.500 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T06:08:48.501 INFO:teuthology.orchestra.run.smithi120.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T06:08:48.501 DEBUG:teuthology.orchestra.run.smithi120:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T06:08:48.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:08:48.617+0000 7ff12f87c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-13T06:08:48.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:08:48.621+0000 7ff12f87c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-13T06:08:48.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:08:48.621+0000 7ff12f87c7c0 -1 bdev(0x560474eb1800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-13T06:08:48.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:08:48.621+0000 7ff12f87c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-13T06:08:51.770 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T06:08:51.784 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-13T06:08:51.798 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-13T06:08:51.798 INFO:tasks.ceph:role: osd.1 2024-09-13T06:08:51.799 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi194.front.sepia.ceph.com 2024-09-13T06:08:51.799 DEBUG:teuthology.orchestra.run.smithi194:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-13T06:08:51.864 INFO:teuthology.orchestra.run.smithi194.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T06:08:51.864 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T06:08:51.865 INFO:teuthology.orchestra.run.smithi194.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T06:08:51.865 INFO:teuthology.orchestra.run.smithi194.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-13T06:08:51.865 INFO:teuthology.orchestra.run.smithi194.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T06:08:51.865 INFO:teuthology.orchestra.run.smithi194.stdout: = sunit=0 swidth=0 blks 2024-09-13T06:08:51.865 INFO:teuthology.orchestra.run.smithi194.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T06:08:51.865 INFO:teuthology.orchestra.run.smithi194.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T06:08:51.865 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T06:08:51.865 INFO:teuthology.orchestra.run.smithi194.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T06:08:52.333 INFO:teuthology.orchestra.run.smithi194.stdout:Discarding blocks...Done. 2024-09-13T06:08:52.335 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi194.front.sepia.ceph.com -o noatime 2024-09-13T06:08:52.335 DEBUG:teuthology.orchestra.run.smithi194:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-09-13T06:08:52.431 DEBUG:teuthology.orchestra.run.smithi194:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-13T06:08:52.441 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T06:08:52.442 INFO:teuthology.orchestra.run.smithi194.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T06:08:52.442 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-13T06:08:52.493 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-13T06:08:52.493 INFO:tasks.ceph:role: osd.2 2024-09-13T06:08:52.493 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi194.front.sepia.ceph.com 2024-09-13T06:08:52.493 DEBUG:teuthology.orchestra.run.smithi194:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-13T06:08:52.556 INFO:teuthology.orchestra.run.smithi194.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T06:08:52.556 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T06:08:52.556 INFO:teuthology.orchestra.run.smithi194.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T06:08:52.556 INFO:teuthology.orchestra.run.smithi194.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-13T06:08:52.556 INFO:teuthology.orchestra.run.smithi194.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T06:08:52.556 INFO:teuthology.orchestra.run.smithi194.stdout: = sunit=0 swidth=0 blks 2024-09-13T06:08:52.556 INFO:teuthology.orchestra.run.smithi194.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T06:08:52.556 INFO:teuthology.orchestra.run.smithi194.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T06:08:52.556 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T06:08:52.556 INFO:teuthology.orchestra.run.smithi194.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T06:08:53.027 INFO:teuthology.orchestra.run.smithi194.stdout:Discarding blocks...Done. 2024-09-13T06:08:53.029 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi194.front.sepia.ceph.com -o noatime 2024-09-13T06:08:53.029 DEBUG:teuthology.orchestra.run.smithi194:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2024-09-13T06:08:53.187 DEBUG:teuthology.orchestra.run.smithi194:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-13T06:08:53.198 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T06:08:53.198 INFO:teuthology.orchestra.run.smithi194.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T06:08:53.199 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-13T06:08:53.256 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-13T06:08:53.256 INFO:tasks.ceph:role: osd.3 2024-09-13T06:08:53.256 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi194.front.sepia.ceph.com 2024-09-13T06:08:53.256 DEBUG:teuthology.orchestra.run.smithi194:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-13T06:08:53.319 INFO:teuthology.orchestra.run.smithi194.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T06:08:53.319 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T06:08:53.319 INFO:teuthology.orchestra.run.smithi194.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T06:08:53.319 INFO:teuthology.orchestra.run.smithi194.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-13T06:08:53.320 INFO:teuthology.orchestra.run.smithi194.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T06:08:53.320 INFO:teuthology.orchestra.run.smithi194.stdout: = sunit=0 swidth=0 blks 2024-09-13T06:08:53.320 INFO:teuthology.orchestra.run.smithi194.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T06:08:53.320 INFO:teuthology.orchestra.run.smithi194.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T06:08:53.320 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T06:08:53.320 INFO:teuthology.orchestra.run.smithi194.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T06:08:53.781 INFO:teuthology.orchestra.run.smithi194.stdout:Discarding blocks...Done. 2024-09-13T06:08:53.782 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi194.front.sepia.ceph.com -o noatime 2024-09-13T06:08:53.782 DEBUG:teuthology.orchestra.run.smithi194:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2024-09-13T06:08:53.910 DEBUG:teuthology.orchestra.run.smithi194:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-13T06:08:53.921 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T06:08:53.921 INFO:teuthology.orchestra.run.smithi194.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T06:08:53.922 DEBUG:teuthology.orchestra.run.smithi194:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T06:08:54.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:08:54.040+0000 7fe7c3b777c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-13T06:08:54.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:08:54.040+0000 7fe7c3b777c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-13T06:08:54.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:08:54.040+0000 7fe7c3b777c0 -1 bdev(0x55f3dda61800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-13T06:08:54.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:08:54.040+0000 7fe7c3b777c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-13T06:08:57.436 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T06:08:57.454 DEBUG:teuthology.orchestra.run.smithi194:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T06:08:57.532 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:08:57.532+0000 7effa5a467c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-13T06:08:57.533 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:08:57.532+0000 7effa5a467c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-13T06:08:57.533 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:08:57.532+0000 7effa5a467c0 -1 bdev(0x55847ae65800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-13T06:08:57.533 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:08:57.532+0000 7effa5a467c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-13T06:09:00.681 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T06:09:00.736 DEBUG:teuthology.orchestra.run.smithi194:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T06:09:00.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:00.816+0000 7f729d6a37c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-13T06:09:00.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:00.816+0000 7f729d6a37c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-13T06:09:00.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:00.816+0000 7f729d6a37c0 -1 bdev(0x55f1f5575800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-13T06:09:00.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:00.816+0000 7f729d6a37c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-13T06:09:03.979 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T06:09:04.035 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-13T06:09:04.036 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-13T06:09:04.036 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-13T06:09:04.050 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T06:09:04.050 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-13T06:09:04.090 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T06:09:04.090 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-13T06:09:04.142 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T06:09:04.142 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-13T06:09:04.194 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T06:09:04.194 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-13T06:09:04.247 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T06:09:04.247 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-13T06:09:04.295 INFO:tasks.ceph:Adding keys to all mons... 2024-09-13T06:09:04.296 DEBUG:teuthology.orchestra.run.smithi120:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-13T06:09:04.308 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.0] 2024-09-13T06:09:04.308 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQDw1uNm13UjJRAAYNq6r++u1p6XXMkO4GqqEA== 2024-09-13T06:09:04.308 INFO:teuthology.orchestra.run.smithi120.stdout:[mgr.x] 2024-09-13T06:09:04.308 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQDv1uNm+XW5LBAAwmSohxXMNH3E4gu8jrOQqg== 2024-09-13T06:09:04.308 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.1] 2024-09-13T06:09:04.308 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQD21uNm+8aCAhAA2o3S+X1iGCZmPwJuPCp31A== 2024-09-13T06:09:04.308 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.2] 2024-09-13T06:09:04.308 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQD51uNmUf3WHxAAoF9S5kKYv/R+veRYe7V/UA== 2024-09-13T06:09:04.308 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.3] 2024-09-13T06:09:04.308 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQD81uNmwbLTMBAAGCkzA9Ks1lCmZYKM57Uvww== 2024-09-13T06:09:04.309 INFO:teuthology.orchestra.run.smithi120.stdout:[client.0] 2024-09-13T06:09:04.309 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQDv1uNmHSpzMhAAF/G8kUQP+f7O+DOnqpdxTw== 2024-09-13T06:09:04.310 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T06:09:04.398 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T06:09:04.439 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T06:09:04.520 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T06:09:04.604 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T06:09:04.688 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T06:09:04.777 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-13T06:09:04.778 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-13T06:09:04.790 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T06:09:04.882 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-13T06:09:04.892 DEBUG:teuthology.orchestra.run.smithi120:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-13T06:09:04.936 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-13T06:09:04.937 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-13T06:09:04.937 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-13T06:09:04.982 INFO:tasks.ceph.mon.a:Started 2024-09-13T06:09:04.982 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-13T06:09:04.982 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-13T06:09:04.982 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-13T06:09:04.985 INFO:tasks.ceph.mgr.x:Started 2024-09-13T06:09:04.985 INFO:tasks.ceph:Setting crush tunables to default 2024-09-13T06:09:04.985 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph osd crush tunables default 2024-09-13T06:09:05.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:05.104+0000 7fa378be7640 1 Processor -- start 2024-09-13T06:09:05.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:05.104+0000 7fa378be7640 1 -- start start 2024-09-13T06:09:05.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:05.104+0000 7fa378be7640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fa374072a30 0x7fa374131780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:05.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:05.104+0000 7fa378be7640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa374072e80 con 0x7fa374071f40 2024-09-13T06:09:05.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:05.104+0000 7fa378be7640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fa374071860 con 0x7fa374072a30 2024-09-13T06:09:05.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:05.104+0000 7fa371d9b640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fa374072a30 0x7fa374131780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:05.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:05.104+0000 7fa371d9b640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fa374072a30 0x7fa374131780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58044/0 (socket says 172.21.15.120:58044) 2024-09-13T06:09:05.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:05.104+0000 7fa371d9b640 1 -- 172.21.15.120:0/313646980 learned_addr learned my addr 172.21.15.120:0/313646980 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-13T06:09:05.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:05.104+0000 7fa37259c640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fa374071f40 0x7fa374072320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:57788/0 (socket says 172.21.15.120:57788) 2024-09-13T06:09:05.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:05.104+0000 7fa371d9b640 1 -- 172.21.15.120:0/313646980 >> v2:172.21.15.120:3300/0 conn(0x7fa374072a30 msgr2=0x7fa374131780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T06:09:05.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:05.104+0000 7fa371d9b640 1 -- 172.21.15.120:0/313646980 >> v2:172.21.15.120:3300/0 conn(0x7fa374072a30 msgr2=0x7fa374131780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T06:09:05.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:05.104+0000 7fa371d9b640 1 --2- 172.21.15.120:0/313646980 >> v2:172.21.15.120:3300/0 conn(0x7fa374072a30 0x7fa374131780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T06:09:05.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:05.104+0000 7fa371d9b640 1 --2- 172.21.15.120:0/313646980 >> v2:172.21.15.120:3300/0 conn(0x7fa374072a30 0x7fa374131780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T06:09:05.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:05.108+0000 7fa37159a640 1 -- 172.21.15.120:0/313646980 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2411237813 0 0) 0x7fa374072e80 con 0x7fa374071f40 2024-09-13T06:09:05.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:05.108+0000 7fa37159a640 1 -- 172.21.15.120:0/313646980 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa35c003530 con 0x7fa374071f40 2024-09-13T06:09:05.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:05.108+0000 7fa37159a640 1 -- 172.21.15.120:0/313646980 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1132874102 0 0) 0x7fa35c003530 con 0x7fa374071f40 2024-09-13T06:09:05.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:05.108+0000 7fa37159a640 1 -- 172.21.15.120:0/313646980 >> v2:172.21.15.120:3300/0 conn(0x7fa374072a30 msgr2=0x7fa374131780 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T06:09:05.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:05.108+0000 7fa37159a640 1 --2- 172.21.15.120:0/313646980 >> v2:172.21.15.120:3300/0 conn(0x7fa374072a30 0x7fa374131780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:05.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:05.108+0000 7fa37159a640 1 -- 172.21.15.120:0/313646980 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa374071c30 con 0x7fa374071f40 2024-09-13T06:09:05.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:05.108+0000 7fa37159a640 1 -- 172.21.15.120:0/313646980 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 ==== 205+0+0 (unknown 338757812 0 0) 0x7fa3640015b0 con 0x7fa374071f40 2024-09-13T06:09:05.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:05.108+0000 7fa37159a640 1 -- 172.21.15.120:0/313646980 >> v1:172.21.15.120:6789/0 conn(0x7fa374071f40 legacy=0x7fa374072320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:05.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:05.108+0000 7fa37159a640 1 --2- 172.21.15.120:0/313646980 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa35c0039c0 0x7fa35c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:05.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:05.108+0000 7fa37159a640 1 -- 172.21.15.120:0/313646980 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fa374071860 con 0x7fa35c0039c0 2024-09-13T06:09:05.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:05.108+0000 7fa37259c640 1 --2- 172.21.15.120:0/313646980 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa35c0039c0 0x7fa35c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:05.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:05.108+0000 7fa37259c640 1 -- 172.21.15.120:0/313646980 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa35c003530 con 0x7fa35c0039c0 2024-09-13T06:09:05.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:05.128+0000 7fa37259c640 1 --2- 172.21.15.120:0/313646980 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa35c0039c0 0x7fa35c003dc0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fa364007f60 tx=0x7fa36401cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d3c250c5a59d368 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:05.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:05.128+0000 7fa37159a640 1 -- 172.21.15.120:0/313646980 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa364007c30 con 0x7fa35c0039c0 2024-09-13T06:09:05.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:05.128+0000 7fa37159a640 1 -- 172.21.15.120:0/313646980 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3640a9070 con 0x7fa35c0039c0 2024-09-13T06:09:05.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:05.128+0000 7fa37159a640 1 -- 172.21.15.120:0/313646980 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3640a5b10 con 0x7fa35c0039c0 2024-09-13T06:09:05.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:05.128+0000 7fa378be7640 1 -- 172.21.15.120:0/313646980 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa35c0039c0 msgr2=0x7fa35c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:05.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:05.128+0000 7fa378be7640 1 --2- 172.21.15.120:0/313646980 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa35c0039c0 0x7fa35c003dc0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fa364007f60 tx=0x7fa36401cc20 comp rx=0 tx=0).stop 2024-09-13T06:09:05.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:05.128+0000 7fa378be7640 1 -- 172.21.15.120:0/313646980 shutdown_connections 2024-09-13T06:09:05.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:05.128+0000 7fa378be7640 1 --2- 172.21.15.120:0/313646980 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa35c0039c0 0x7fa35c003dc0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:05.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:05.128+0000 7fa378be7640 1 --2- 172.21.15.120:0/313646980 >> v2:172.21.15.120:3300/0 conn(0x7fa374072a30 0x7fa374131780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:05.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:05.128+0000 7fa378be7640 1 -- 172.21.15.120:0/313646980 >> 172.21.15.120:0/313646980 conn(0x7fa37409ce10 msgr2=0x7fa37409d220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:05.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:05.128+0000 7fa378be7640 1 -- 172.21.15.120:0/313646980 shutdown_connections 2024-09-13T06:09:05.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:05.128+0000 7fa378be7640 1 -- 172.21.15.120:0/313646980 wait complete. 2024-09-13T06:09:05.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:05.128+0000 7fa378be7640 1 Processor -- start 2024-09-13T06:09:05.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:05.128+0000 7fa378be7640 1 -- start start 2024-09-13T06:09:05.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:05.132+0000 7fa378be7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa35c0039c0 0x7fa37412e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:05.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:05.132+0000 7fa378be7640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fa374134870 con 0x7fa35c0039c0 2024-09-13T06:09:05.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:05.132+0000 7fa37259c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa35c0039c0 0x7fa37412e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:05.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:05.132+0000 7fa37259c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa35c0039c0 0x7fa37412e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58056/0 (socket says 172.21.15.120:58056) 2024-09-13T06:09:05.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:05.132+0000 7fa37259c640 1 -- 172.21.15.120:0/3436773849 learned_addr learned my addr 172.21.15.120:0/3436773849 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-13T06:09:05.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:05.132+0000 7fa37259c640 1 -- 172.21.15.120:0/3436773849 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa374130160 con 0x7fa35c0039c0 2024-09-13T06:09:05.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:05.132+0000 7fa37259c640 1 --2- 172.21.15.120:0/3436773849 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa35c0039c0 0x7fa37412e710 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fa364019830 tx=0x7fa35c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:05.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:05.132+0000 7fa362ffd640 1 -- 172.21.15.120:0/3436773849 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3640a6dc0 con 0x7fa35c0039c0 2024-09-13T06:09:05.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:05.132+0000 7fa362ffd640 1 -- 172.21.15.120:0/3436773849 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3640b4070 con 0x7fa35c0039c0 2024-09-13T06:09:05.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:05.132+0000 7fa378be7640 1 -- 172.21.15.120:0/3436773849 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa374126e10 con 0x7fa35c0039c0 2024-09-13T06:09:05.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:05.132+0000 7fa362ffd640 1 -- 172.21.15.120:0/3436773849 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3640071a0 con 0x7fa35c0039c0 2024-09-13T06:09:05.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:05.132+0000 7fa378be7640 1 -- 172.21.15.120:0/3436773849 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa374131260 con 0x7fa35c0039c0 2024-09-13T06:09:05.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:05.132+0000 7fa362ffd640 1 -- 172.21.15.120:0/3436773849 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa3640b6070 con 0x7fa35c0039c0 2024-09-13T06:09:05.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:05.132+0000 7fa362ffd640 1 -- 172.21.15.120:0/3436773849 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa3640ae7b0 con 0x7fa35c0039c0 2024-09-13T06:09:05.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:05.132+0000 7fa378be7640 1 -- 172.21.15.120:0/3436773849 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3740008e0 con 0x7fa35c0039c0 2024-09-13T06:09:05.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:05.136+0000 7fa362ffd640 1 -- 172.21.15.120:0/3436773849 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fa3640d82d0 con 0x7fa35c0039c0 2024-09-13T06:09:05.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:05.200+0000 7fa378be7640 1 -- 172.21.15.120:0/3436773849 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fa374072a30 con 0x7fa35c0039c0 2024-09-13T06:09:05.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:05.204+0000 7fa362ffd640 1 -- 172.21.15.120:0/3436773849 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fa3640c6020 con 0x7fa35c0039c0 2024-09-13T06:09:05.201 INFO:teuthology.orchestra.run.smithi120.stderr:adjusted tunables profile to default 2024-09-13T06:09:05.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:05.204+0000 7fa378be7640 1 -- 172.21.15.120:0/3436773849 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa35c0039c0 msgr2=0x7fa37412e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:05.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:05.204+0000 7fa378be7640 1 --2- 172.21.15.120:0/3436773849 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa35c0039c0 0x7fa37412e710 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fa364019830 tx=0x7fa35c005840 comp rx=0 tx=0).stop 2024-09-13T06:09:05.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:05.204+0000 7fa378be7640 1 -- 172.21.15.120:0/3436773849 shutdown_connections 2024-09-13T06:09:05.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:05.204+0000 7fa378be7640 1 --2- 172.21.15.120:0/3436773849 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa35c0039c0 0x7fa37412e710 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:05.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:05.204+0000 7fa378be7640 1 -- 172.21.15.120:0/3436773849 >> 172.21.15.120:0/3436773849 conn(0x7fa37409ce10 msgr2=0x7fa374127020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:05.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:05.204+0000 7fa378be7640 1 -- 172.21.15.120:0/3436773849 shutdown_connections 2024-09-13T06:09:05.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:05.204+0000 7fa378be7640 1 -- 172.21.15.120:0/3436773849 wait complete. 2024-09-13T06:09:05.219 INFO:tasks.ceph:check_enable_crimson: False 2024-09-13T06:09:05.219 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-13T06:09:05.219 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-13T06:09:05.220 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-13T06:09:05.231 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T06:09:05.231 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-13T06:09:05.243 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T06:09:05.243 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-13T06:09:05.299 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T06:09:05.299 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-13T06:09:05.323 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-13T06:09:05.320+0000 7f37e2a22180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T06:09:05.334 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new 6d4134f4-6b9e-4fcd-bf7c-0938458a015f 0 2024-09-13T06:09:05.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.496+0000 7f342035c640 1 Processor -- start 2024-09-13T06:09:05.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.496+0000 7f342035c640 1 -- start start 2024-09-13T06:09:05.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.496+0000 7f342035c640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f3418110b60 0x7f341806c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:05.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.496+0000 7f342035c640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f341806d050 con 0x7f341806cb10 2024-09-13T06:09:05.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.496+0000 7f342035c640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f341806d220 con 0x7f3418110b60 2024-09-13T06:09:05.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.496+0000 7f341e0f8640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f3418110b60 0x7f341806c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:05.499 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.496+0000 7f341d8f7640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f341806cb10 0x7f341811c400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:36170/0 (socket says 172.21.15.194:36170) 2024-09-13T06:09:05.499 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.496+0000 7f341d8f7640 1 -- 172.21.15.194:0/166738233 learned_addr learned my addr 172.21.15.194:0/166738233 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-09-13T06:09:05.499 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.496+0000 7f341e0f8640 1 -- 172.21.15.194:0/166738233 >> v1:172.21.15.120:6789/0 conn(0x7f341806cb10 legacy=0x7f341811c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:05.499 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.496+0000 7f341e0f8640 1 -- 172.21.15.194:0/166738233 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f341811eb30 con 0x7f3418110b60 2024-09-13T06:09:05.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.500+0000 7f341e0f8640 1 --2- 172.21.15.194:0/166738233 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3418110b60 0x7f341806c4e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3408009740 tx=0x7f340801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13cb94aae5ecd063 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:05.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.500+0000 7f341d0f6640 1 -- 172.21.15.194:0/166738233 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34080b1070 con 0x7f3418110b60 2024-09-13T06:09:05.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.500+0000 7f341d0f6640 1 -- 172.21.15.194:0/166738233 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34080ac520 con 0x7f3418110b60 2024-09-13T06:09:05.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.500+0000 7f341d0f6640 1 -- 172.21.15.194:0/166738233 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34080ac820 con 0x7f3418110b60 2024-09-13T06:09:05.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.500+0000 7f342035c640 1 -- 172.21.15.194:0/166738233 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3418110b60 msgr2=0x7f341806c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:05.503 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.500+0000 7f342035c640 1 --2- 172.21.15.194:0/166738233 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3418110b60 0x7f341806c4e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3408009740 tx=0x7f340801c370 comp rx=0 tx=0).stop 2024-09-13T06:09:05.503 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.500+0000 7f342035c640 1 -- 172.21.15.194:0/166738233 shutdown_connections 2024-09-13T06:09:05.503 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.500+0000 7f342035c640 1 --2- 172.21.15.194:0/166738233 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3418110b60 0x7f341806c4e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:05.503 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.500+0000 7f342035c640 1 -- 172.21.15.194:0/166738233 >> 172.21.15.194:0/166738233 conn(0x7f341806fff0 msgr2=0x7f3418072410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:05.503 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.500+0000 7f342035c640 1 -- 172.21.15.194:0/166738233 shutdown_connections 2024-09-13T06:09:05.503 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.500+0000 7f342035c640 1 -- 172.21.15.194:0/166738233 wait complete. 2024-09-13T06:09:05.504 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.504+0000 7f342035c640 1 Processor -- start 2024-09-13T06:09:05.504 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.504+0000 7f342035c640 1 -- start start 2024-09-13T06:09:05.504 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.504+0000 7f342035c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f341806cb10 0x7f34181aeed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:05.504 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.504+0000 7f342035c640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f341811e700 con 0x7f341806cb10 2024-09-13T06:09:05.504 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.504+0000 7f341e0f8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f341806cb10 0x7f34181aeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:05.504 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.504+0000 7f341e0f8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f341806cb10 0x7f34181aeed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:32882/0 (socket says 172.21.15.194:32882) 2024-09-13T06:09:05.504 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.504+0000 7f341e0f8640 1 -- 172.21.15.194:0/3200113383 learned_addr learned my addr 172.21.15.194:0/3200113383 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:05.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.504+0000 7f341e0f8640 1 -- 172.21.15.194:0/3200113383 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34181af4a0 con 0x7f341806cb10 2024-09-13T06:09:05.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.504+0000 7f341e0f8640 1 --2- 172.21.15.194:0/3200113383 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f341806cb10 0x7f34181aeed0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f34080af040 tx=0x7f340801abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:05.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.504+0000 7f340effd640 1 -- 172.21.15.194:0/3200113383 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34080b1050 con 0x7f341806cb10 2024-09-13T06:09:05.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.504+0000 7f342035c640 1 -- 172.21.15.194:0/3200113383 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34181af6d0 con 0x7f341806cb10 2024-09-13T06:09:05.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.504+0000 7f340effd640 1 -- 172.21.15.194:0/3200113383 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34080b2040 con 0x7f341806cb10 2024-09-13T06:09:05.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.504+0000 7f340effd640 1 -- 172.21.15.194:0/3200113383 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34080aba40 con 0x7f341806cb10 2024-09-13T06:09:05.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.504+0000 7f342035c640 1 -- 172.21.15.194:0/3200113383 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34181a8f70 con 0x7f341806cb10 2024-09-13T06:09:05.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.504+0000 7f340effd640 1 -- 172.21.15.194:0/3200113383 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f34080bf030 con 0x7f341806cb10 2024-09-13T06:09:05.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.504+0000 7f340effd640 1 -- 172.21.15.194:0/3200113383 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f34080bd070 con 0x7f341806cb10 2024-09-13T06:09:05.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.504+0000 7f342035c640 1 -- 172.21.15.194:0/3200113383 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f341806c4e0 con 0x7f341806cb10 2024-09-13T06:09:05.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.512+0000 7f340effd640 1 -- 172.21.15.194:0/3200113383 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f34080c6060 con 0x7f341806cb10 2024-09-13T06:09:05.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.580+0000 7f342035c640 1 -- 172.21.15.194:0/3200113383 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6d4134f4-6b9e-4fcd-bf7c-0938458a015f", "id": 0} v 0) -- 0x7f3418110b60 con 0x7f341806cb10 2024-09-13T06:09:05.584 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.584+0000 7f340effd640 1 -- 172.21.15.194:0/3200113383 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6d4134f4-6b9e-4fcd-bf7c-0938458a015f", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f34080a9070 con 0x7f341806cb10 2024-09-13T06:09:05.584 INFO:teuthology.orchestra.run.smithi194.stdout:0 2024-09-13T06:09:05.585 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.584+0000 7f342035c640 1 -- 172.21.15.194:0/3200113383 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f341806cb10 msgr2=0x7f34181aeed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:05.585 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.584+0000 7f342035c640 1 --2- 172.21.15.194:0/3200113383 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f341806cb10 0x7f34181aeed0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f34080af040 tx=0x7f340801abb0 comp rx=0 tx=0).stop 2024-09-13T06:09:05.585 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.584+0000 7f342035c640 1 -- 172.21.15.194:0/3200113383 shutdown_connections 2024-09-13T06:09:05.585 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.584+0000 7f342035c640 1 --2- 172.21.15.194:0/3200113383 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f341806cb10 0x7f34181aeed0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:05.585 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.584+0000 7f342035c640 1 -- 172.21.15.194:0/3200113383 >> 172.21.15.194:0/3200113383 conn(0x7f341806fff0 msgr2=0x7f3418119b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:05.585 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.584+0000 7f342035c640 1 -- 172.21.15.194:0/3200113383 shutdown_connections 2024-09-13T06:09:05.585 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.584+0000 7f342035c640 1 -- 172.21.15.194:0/3200113383 wait complete. 2024-09-13T06:09:05.601 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new aca83f02-0827-44d8-b4b9-2480cce86270 1 2024-09-13T06:09:05.722 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.720+0000 7f946a91c640 1 Processor -- start 2024-09-13T06:09:05.722 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.720+0000 7f946a91c640 1 -- start start 2024-09-13T06:09:05.722 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.720+0000 7f946a91c640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f946410ed90 0x7f946410f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:05.722 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.720+0000 7f946a91c640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9464074240 con 0x7f946410f6b0 2024-09-13T06:09:05.722 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.720+0000 7f946a91c640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f946410fbf0 con 0x7f946410ed90 2024-09-13T06:09:05.722 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.720+0000 7f9463fff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f946410ed90 0x7f946410f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:05.722 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.720+0000 7f9463fff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f946410ed90 0x7f946410f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:32898/0 (socket says 172.21.15.194:32898) 2024-09-13T06:09:05.723 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.720+0000 7f9463fff640 1 -- 172.21.15.194:0/625842084 learned_addr learned my addr 172.21.15.194:0/625842084 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:05.723 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.720+0000 7f945bfff640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f946410f6b0 0x7f946411a110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:36174/0 (socket says 172.21.15.194:36174) 2024-09-13T06:09:05.723 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.720+0000 7f9463fff640 1 -- 172.21.15.194:0/625842084 >> v1:172.21.15.120:6789/0 conn(0x7f946410f6b0 legacy=0x7f946411a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:05.723 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.720+0000 7f9463fff640 1 -- 172.21.15.194:0/625842084 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f946411c840 con 0x7f946410ed90 2024-09-13T06:09:05.725 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.724+0000 7f9463fff640 1 --2- 172.21.15.194:0/625842084 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f946410ed90 0x7f946410f170 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f94540097f0 tx=0x7f945401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=715464aaf1ea56ec server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:05.725 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.724+0000 7f94637fe640 1 -- 172.21.15.194:0/625842084 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94540ab580 con 0x7f946410ed90 2024-09-13T06:09:05.725 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.724+0000 7f94637fe640 1 -- 172.21.15.194:0/625842084 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94540b0070 con 0x7f946410ed90 2024-09-13T06:09:05.726 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.724+0000 7f94637fe640 1 -- 172.21.15.194:0/625842084 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94540ab870 con 0x7f946410ed90 2024-09-13T06:09:05.727 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.724+0000 7f946a91c640 1 -- 172.21.15.194:0/625842084 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f946410ed90 msgr2=0x7f946410f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:05.727 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.724+0000 7f946a91c640 1 --2- 172.21.15.194:0/625842084 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f946410ed90 0x7f946410f170 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f94540097f0 tx=0x7f945401c430 comp rx=0 tx=0).stop 2024-09-13T06:09:05.727 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.724+0000 7f946a91c640 1 -- 172.21.15.194:0/625842084 shutdown_connections 2024-09-13T06:09:05.727 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.724+0000 7f946a91c640 1 --2- 172.21.15.194:0/625842084 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f946410ed90 0x7f946410f170 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:05.727 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.724+0000 7f946a91c640 1 -- 172.21.15.194:0/625842084 >> 172.21.15.194:0/625842084 conn(0x7f946406f840 msgr2=0x7f9464071c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:05.727 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.724+0000 7f946a91c640 1 -- 172.21.15.194:0/625842084 shutdown_connections 2024-09-13T06:09:05.727 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.724+0000 7f946a91c640 1 -- 172.21.15.194:0/625842084 wait complete. 2024-09-13T06:09:05.727 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.724+0000 7f946a91c640 1 Processor -- start 2024-09-13T06:09:05.727 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.724+0000 7f946a91c640 1 -- start start 2024-09-13T06:09:05.727 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.728+0000 7f946a91c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f946410ed90 0x7f946410ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:05.727 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.728+0000 7f946a91c640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f946411c4d0 con 0x7f946410ed90 2024-09-13T06:09:05.729 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.728+0000 7f9463fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f946410ed90 0x7f946410ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:05.729 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.728+0000 7f9463fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f946410ed90 0x7f946410ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:32904/0 (socket says 172.21.15.194:32904) 2024-09-13T06:09:05.729 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.728+0000 7f9463fff640 1 -- 172.21.15.194:0/2603550136 learned_addr learned my addr 172.21.15.194:0/2603550136 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:05.729 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.728+0000 7f9463fff640 1 -- 172.21.15.194:0/2603550136 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94641104b0 con 0x7f946410ed90 2024-09-13T06:09:05.729 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.728+0000 7f9463fff640 1 --2- 172.21.15.194:0/2603550136 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f946410ed90 0x7f946410ff70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f945401a060 tx=0x7f945401ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:05.729 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.728+0000 7f94617fa640 1 -- 172.21.15.194:0/2603550136 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94540aa7d0 con 0x7f946410ed90 2024-09-13T06:09:05.729 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.728+0000 7f94617fa640 1 -- 172.21.15.194:0/2603550136 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94540aa970 con 0x7f946410ed90 2024-09-13T06:09:05.729 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.728+0000 7f946a91c640 1 -- 172.21.15.194:0/2603550136 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94641106e0 con 0x7f946410ed90 2024-09-13T06:09:05.729 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.728+0000 7f94617fa640 1 -- 172.21.15.194:0/2603550136 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94540aac70 con 0x7f946410ed90 2024-09-13T06:09:05.730 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.728+0000 7f946a91c640 1 -- 172.21.15.194:0/2603550136 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9464110c20 con 0x7f946410ed90 2024-09-13T06:09:05.730 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.728+0000 7f94617fa640 1 -- 172.21.15.194:0/2603550136 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f94540c77d0 con 0x7f946410ed90 2024-09-13T06:09:05.730 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.728+0000 7f94617fa640 1 -- 172.21.15.194:0/2603550136 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f94540be990 con 0x7f946410ed90 2024-09-13T06:09:05.730 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.728+0000 7f946a91c640 1 -- 172.21.15.194:0/2603550136 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f946410f1f0 con 0x7f946410ed90 2024-09-13T06:09:05.735 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.736+0000 7f94617fa640 1 -- 172.21.15.194:0/2603550136 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f94540160b0 con 0x7f946410ed90 2024-09-13T06:09:05.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.804+0000 7f946a91c640 1 -- 172.21.15.194:0/2603550136 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd new", "uuid": "aca83f02-0827-44d8-b4b9-2480cce86270", "id": 1} v 0) -- 0x7f946410f6b0 con 0x7f946410ed90 2024-09-13T06:09:05.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.808+0000 7f94617fa640 1 -- 172.21.15.194:0/2603550136 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "aca83f02-0827-44d8-b4b9-2480cce86270", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f94540aae60 con 0x7f946410ed90 2024-09-13T06:09:05.810 INFO:teuthology.orchestra.run.smithi194.stdout:1 2024-09-13T06:09:05.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.812+0000 7f946a91c640 1 -- 172.21.15.194:0/2603550136 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f946410ed90 msgr2=0x7f946410ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:05.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.812+0000 7f946a91c640 1 --2- 172.21.15.194:0/2603550136 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f946410ed90 0x7f946410ff70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f945401a060 tx=0x7f945401ac70 comp rx=0 tx=0).stop 2024-09-13T06:09:05.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.812+0000 7f946a91c640 1 -- 172.21.15.194:0/2603550136 shutdown_connections 2024-09-13T06:09:05.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.812+0000 7f946a91c640 1 --2- 172.21.15.194:0/2603550136 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f946410ed90 0x7f946410ff70 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:05.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.812+0000 7f946a91c640 1 -- 172.21.15.194:0/2603550136 >> 172.21.15.194:0/2603550136 conn(0x7f946406f840 msgr2=0x7f946411a970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:05.812 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.812+0000 7f946a91c640 1 -- 172.21.15.194:0/2603550136 shutdown_connections 2024-09-13T06:09:05.812 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.812+0000 7f946a91c640 1 -- 172.21.15.194:0/2603550136 wait complete. 2024-09-13T06:09:05.828 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new 2e1a73a0-26b9-4247-acbb-15ccd2478adb 2 2024-09-13T06:09:05.831 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-13T06:09:05.832+0000 7f37e2a22180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T06:09:05.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.944+0000 7efdd6078640 1 Processor -- start 2024-09-13T06:09:05.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.944+0000 7efdd6078640 1 -- start start 2024-09-13T06:09:05.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.944+0000 7efdd6078640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7efdd0117900 0x7efdd0119cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:05.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.944+0000 7efdd6078640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdd011a350 con 0x7efdd0114c00 2024-09-13T06:09:05.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.944+0000 7efdd6078640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7efdd011b550 con 0x7efdd0117900 2024-09-13T06:09:05.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.944+0000 7efdceffd640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7efdd0117900 0x7efdd0119cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:05.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.948+0000 7efdcf7fe640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7efdd0114c00 0x7efdd0114fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:36182/0 (socket says 172.21.15.194:36182) 2024-09-13T06:09:05.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.948+0000 7efdceffd640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7efdd0117900 0x7efdd0119cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:32916/0 (socket says 172.21.15.194:32916) 2024-09-13T06:09:05.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.948+0000 7efdcf7fe640 1 -- 172.21.15.194:0/77689795 learned_addr learned my addr 172.21.15.194:0/77689795 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-09-13T06:09:05.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.948+0000 7efdceffd640 1 -- 172.21.15.194:0/77689795 >> v1:172.21.15.120:6789/0 conn(0x7efdd0114c00 legacy=0x7efdd0114fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:05.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.948+0000 7efdceffd640 1 -- 172.21.15.194:0/77689795 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdd011b700 con 0x7efdd0117900 2024-09-13T06:09:05.950 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.948+0000 7efdceffd640 1 --2- 172.21.15.194:0/77689795 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efdd0117900 0x7efdd0119cf0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7efdc4009740 tx=0x7efdc401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80ab2ca4c95564a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:05.950 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.948+0000 7efdce7fc640 1 -- 172.21.15.194:0/77689795 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdc40b1070 con 0x7efdd0117900 2024-09-13T06:09:05.950 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.948+0000 7efdce7fc640 1 -- 172.21.15.194:0/77689795 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdc40ac520 con 0x7efdd0117900 2024-09-13T06:09:05.950 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.948+0000 7efdce7fc640 1 -- 172.21.15.194:0/77689795 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdc40ac820 con 0x7efdd0117900 2024-09-13T06:09:05.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.948+0000 7efdd6078640 1 -- 172.21.15.194:0/77689795 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efdd0117900 msgr2=0x7efdd0119cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:05.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.948+0000 7efdd6078640 1 --2- 172.21.15.194:0/77689795 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efdd0117900 0x7efdd0119cf0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7efdc4009740 tx=0x7efdc401c370 comp rx=0 tx=0).stop 2024-09-13T06:09:05.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.948+0000 7efdd6078640 1 -- 172.21.15.194:0/77689795 shutdown_connections 2024-09-13T06:09:05.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.948+0000 7efdd6078640 1 --2- 172.21.15.194:0/77689795 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efdd0117900 0x7efdd0119cf0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:05.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.948+0000 7efdd6078640 1 -- 172.21.15.194:0/77689795 >> 172.21.15.194:0/77689795 conn(0x7efdd006fff0 msgr2=0x7efdd0072410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:05.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.948+0000 7efdd6078640 1 -- 172.21.15.194:0/77689795 shutdown_connections 2024-09-13T06:09:05.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.948+0000 7efdd6078640 1 -- 172.21.15.194:0/77689795 wait complete. 2024-09-13T06:09:05.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.952+0000 7efdd6078640 1 Processor -- start 2024-09-13T06:09:05.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.952+0000 7efdd6078640 1 -- start start 2024-09-13T06:09:05.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.952+0000 7efdd6078640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efdd0114c00 0x7efdd01acd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:05.953 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.952+0000 7efdd6078640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7efdd011b210 con 0x7efdd0114c00 2024-09-13T06:09:05.953 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.952+0000 7efdcf7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efdd0114c00 0x7efdd01acd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:05.953 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.952+0000 7efdcf7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efdd0114c00 0x7efdd01acd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:32930/0 (socket says 172.21.15.194:32930) 2024-09-13T06:09:05.953 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.952+0000 7efdcf7fe640 1 -- 172.21.15.194:0/3874521074 learned_addr learned my addr 172.21.15.194:0/3874521074 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:05.953 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.952+0000 7efdcf7fe640 1 -- 172.21.15.194:0/3874521074 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdd01ad300 con 0x7efdd0114c00 2024-09-13T06:09:05.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.952+0000 7efdcf7fe640 1 --2- 172.21.15.194:0/3874521074 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efdd0114c00 0x7efdd01acd30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7efdc000c480 tx=0x7efdc000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:05.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.952+0000 7efdb7fff640 1 -- 172.21.15.194:0/3874521074 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdc0017070 con 0x7efdd0114c00 2024-09-13T06:09:05.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.952+0000 7efdd6078640 1 -- 172.21.15.194:0/3874521074 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdd01ad590 con 0x7efdd0114c00 2024-09-13T06:09:05.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.952+0000 7efdb7fff640 1 -- 172.21.15.194:0/3874521074 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdc0005c20 con 0x7efdd0114c00 2024-09-13T06:09:05.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.952+0000 7efdb7fff640 1 -- 172.21.15.194:0/3874521074 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdc0007070 con 0x7efdd0114c00 2024-09-13T06:09:05.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.952+0000 7efdd6078640 1 -- 172.21.15.194:0/3874521074 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdd01a7020 con 0x7efdd0114c00 2024-09-13T06:09:05.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.952+0000 7efdb7fff640 1 -- 172.21.15.194:0/3874521074 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7efdc001a070 con 0x7efdd0114c00 2024-09-13T06:09:05.955 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.952+0000 7efdb7fff640 1 -- 172.21.15.194:0/3874521074 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7efdc001cc40 con 0x7efdd0114c00 2024-09-13T06:09:05.955 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.952+0000 7efdd6078640 1 -- 172.21.15.194:0/3874521074 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdd0114fe0 con 0x7efdd0114c00 2024-09-13T06:09:05.960 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:05.960+0000 7efdb7fff640 1 -- 172.21.15.194:0/3874521074 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7efdc001c440 con 0x7efdd0114c00 2024-09-13T06:09:06.025 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-13T06:09:06.024+0000 7f37e2a22180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T06:09:06.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:06.028+0000 7efdd6078640 1 -- 172.21.15.194:0/3874521074 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2e1a73a0-26b9-4247-acbb-15ccd2478adb", "id": 2} v 0) -- 0x7efdd01ad7c0 con 0x7efdd0114c00 2024-09-13T06:09:06.034 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:06.032+0000 7efdb7fff640 1 -- 172.21.15.194:0/3874521074 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2e1a73a0-26b9-4247-acbb-15ccd2478adb", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7efdc001c6e0 con 0x7efdd0114c00 2024-09-13T06:09:06.034 INFO:teuthology.orchestra.run.smithi194.stdout:2 2024-09-13T06:09:06.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:06.036+0000 7efdd6078640 1 -- 172.21.15.194:0/3874521074 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efdd0114c00 msgr2=0x7efdd01acd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:06.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:06.036+0000 7efdd6078640 1 --2- 172.21.15.194:0/3874521074 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efdd0114c00 0x7efdd01acd30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7efdc000c480 tx=0x7efdc000c940 comp rx=0 tx=0).stop 2024-09-13T06:09:06.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:06.036+0000 7efdd6078640 1 -- 172.21.15.194:0/3874521074 shutdown_connections 2024-09-13T06:09:06.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:06.036+0000 7efdd6078640 1 --2- 172.21.15.194:0/3874521074 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efdd0114c00 0x7efdd01acd30 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:06.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:06.036+0000 7efdd6078640 1 -- 172.21.15.194:0/3874521074 >> 172.21.15.194:0/3874521074 conn(0x7efdd006fff0 msgr2=0x7efdd006c720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:06.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:06.036+0000 7efdd6078640 1 -- 172.21.15.194:0/3874521074 shutdown_connections 2024-09-13T06:09:06.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:06.036+0000 7efdd6078640 1 -- 172.21.15.194:0/3874521074 wait complete. 2024-09-13T06:09:06.053 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new afca1e17-ff25-4f0e-9639-a9a06385b8c8 3 2024-09-13T06:09:06.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:06.216+0000 7fe43ae4e640 1 Processor -- start 2024-09-13T06:09:06.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:06.216+0000 7fe43ae4e640 1 -- start start 2024-09-13T06:09:06.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:06.216+0000 7fe43ae4e640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe43410fea0 0x7fe434110280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:06.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:06.216+0000 7fe43ae4e640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe434110c70 con 0x7fe4341107c0 2024-09-13T06:09:06.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:06.216+0000 7fe43ae4e640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fe43411b640 con 0x7fe43410fea0 2024-09-13T06:09:06.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:06.216+0000 7fe438bea640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe43410fea0 0x7fe434110280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:06.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:06.216+0000 7fe433fff640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fe4341107c0 0x7fe434118f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:36196/0 (socket says 172.21.15.194:36196) 2024-09-13T06:09:06.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:06.216+0000 7fe433fff640 1 -- 172.21.15.194:0/3036412168 learned_addr learned my addr 172.21.15.194:0/3036412168 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-09-13T06:09:06.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:06.216+0000 7fe438bea640 1 -- 172.21.15.194:0/3036412168 >> v1:172.21.15.120:6789/0 conn(0x7fe4341107c0 legacy=0x7fe434118f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:06.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:06.216+0000 7fe438bea640 1 -- 172.21.15.194:0/3036412168 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe43411b7c0 con 0x7fe43410fea0 2024-09-13T06:09:06.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:06.220+0000 7fe438bea640 1 --2- 172.21.15.194:0/3036412168 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe43410fea0 0x7fe434110280 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe428009740 tx=0x7fe42801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15e4dd33f159e524 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:06.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:06.220+0000 7fe4337fe640 1 -- 172.21.15.194:0/3036412168 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4280b0070 con 0x7fe43410fea0 2024-09-13T06:09:06.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:06.220+0000 7fe4337fe640 1 -- 172.21.15.194:0/3036412168 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4280ab530 con 0x7fe43410fea0 2024-09-13T06:09:06.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:06.220+0000 7fe4337fe640 1 -- 172.21.15.194:0/3036412168 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4280ab830 con 0x7fe43410fea0 2024-09-13T06:09:06.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:06.220+0000 7fe43ae4e640 1 -- 172.21.15.194:0/3036412168 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe43410fea0 msgr2=0x7fe434110280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:06.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:06.220+0000 7fe43ae4e640 1 --2- 172.21.15.194:0/3036412168 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe43410fea0 0x7fe434110280 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe428009740 tx=0x7fe42801c3d0 comp rx=0 tx=0).stop 2024-09-13T06:09:06.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:06.220+0000 7fe43ae4e640 1 -- 172.21.15.194:0/3036412168 shutdown_connections 2024-09-13T06:09:06.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:06.220+0000 7fe43ae4e640 1 --2- 172.21.15.194:0/3036412168 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe43410fea0 0x7fe434110280 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:06.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:06.220+0000 7fe43ae4e640 1 -- 172.21.15.194:0/3036412168 >> 172.21.15.194:0/3036412168 conn(0x7fe43406f840 msgr2=0x7fe434071c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:06.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:06.220+0000 7fe43ae4e640 1 -- 172.21.15.194:0/3036412168 shutdown_connections 2024-09-13T06:09:06.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:06.220+0000 7fe43ae4e640 1 -- 172.21.15.194:0/3036412168 wait complete. 2024-09-13T06:09:06.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:06.220+0000 7fe43ae4e640 1 Processor -- start 2024-09-13T06:09:06.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:06.220+0000 7fe43ae4e640 1 -- start start 2024-09-13T06:09:06.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:06.224+0000 7fe43ae4e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe43410fea0 0x7fe4341accd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:06.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:06.224+0000 7fe43ae4e640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fe43411b300 con 0x7fe43410fea0 2024-09-13T06:09:06.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:06.224+0000 7fe438bea640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe43410fea0 0x7fe4341accd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:06.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:06.224+0000 7fe438bea640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe43410fea0 0x7fe4341accd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:32938/0 (socket says 172.21.15.194:32938) 2024-09-13T06:09:06.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:06.224+0000 7fe438bea640 1 -- 172.21.15.194:0/2543650425 learned_addr learned my addr 172.21.15.194:0/2543650425 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:06.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:06.224+0000 7fe438bea640 1 -- 172.21.15.194:0/2543650425 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4341ad2a0 con 0x7fe43410fea0 2024-09-13T06:09:06.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:06.224+0000 7fe438bea640 1 --2- 172.21.15.194:0/2543650425 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe43410fea0 0x7fe4341accd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe428018fe0 tx=0x7fe428019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:06.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:06.224+0000 7fe4317fa640 1 -- 172.21.15.194:0/2543650425 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4280b9070 con 0x7fe43410fea0 2024-09-13T06:09:06.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:06.224+0000 7fe4317fa640 1 -- 172.21.15.194:0/2543650425 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4280b5880 con 0x7fe43410fea0 2024-09-13T06:09:06.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:06.224+0000 7fe43ae4e640 1 -- 172.21.15.194:0/2543650425 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4341ad530 con 0x7fe43410fea0 2024-09-13T06:09:06.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:06.224+0000 7fe4317fa640 1 -- 172.21.15.194:0/2543650425 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4280b0040 con 0x7fe43410fea0 2024-09-13T06:09:06.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:06.224+0000 7fe43ae4e640 1 -- 172.21.15.194:0/2543650425 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4341a6fc0 con 0x7fe43410fea0 2024-09-13T06:09:06.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:06.224+0000 7fe4317fa640 1 -- 172.21.15.194:0/2543650425 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe4280bc070 con 0x7fe43410fea0 2024-09-13T06:09:06.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:06.224+0000 7fe4317fa640 1 -- 172.21.15.194:0/2543650425 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7fe4280be860 con 0x7fe43410fea0 2024-09-13T06:09:06.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:06.224+0000 7fe43ae4e640 1 -- 172.21.15.194:0/2543650425 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe434110300 con 0x7fe43410fea0 2024-09-13T06:09:06.231 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:06.232+0000 7fe4317fa640 1 -- 172.21.15.194:0/2543650425 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fe428015ff0 con 0x7fe43410fea0 2024-09-13T06:09:06.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:06.300+0000 7fe43ae4e640 1 -- 172.21.15.194:0/2543650425 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd new", "uuid": "afca1e17-ff25-4f0e-9639-a9a06385b8c8", "id": 3} v 0) -- 0x7fe4341ad700 con 0x7fe43410fea0 2024-09-13T06:09:06.305 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:06.304+0000 7fe4317fa640 1 -- 172.21.15.194:0/2543650425 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "afca1e17-ff25-4f0e-9639-a9a06385b8c8", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7fe4280b5b60 con 0x7fe43410fea0 2024-09-13T06:09:06.306 INFO:teuthology.orchestra.run.smithi194.stdout:3 2024-09-13T06:09:06.307 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:06.304+0000 7fe43ae4e640 1 -- 172.21.15.194:0/2543650425 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe43410fea0 msgr2=0x7fe4341accd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:06.307 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:06.304+0000 7fe43ae4e640 1 --2- 172.21.15.194:0/2543650425 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe43410fea0 0x7fe4341accd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe428018fe0 tx=0x7fe428019170 comp rx=0 tx=0).stop 2024-09-13T06:09:06.307 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:06.304+0000 7fe43ae4e640 1 -- 172.21.15.194:0/2543650425 shutdown_connections 2024-09-13T06:09:06.307 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:06.304+0000 7fe43ae4e640 1 --2- 172.21.15.194:0/2543650425 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe43410fea0 0x7fe4341accd0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:06.307 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:06.308+0000 7fe43ae4e640 1 -- 172.21.15.194:0/2543650425 >> 172.21.15.194:0/2543650425 conn(0x7fe43406f840 msgr2=0x7fe4341197f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:06.307 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:06.308+0000 7fe43ae4e640 1 -- 172.21.15.194:0/2543650425 shutdown_connections 2024-09-13T06:09:06.307 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:06.308+0000 7fe43ae4e640 1 -- 172.21.15.194:0/2543650425 wait complete. 2024-09-13T06:09:06.322 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-13T06:09:06.322 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-13T06:09:06.325 INFO:tasks.ceph.osd.0:Started 2024-09-13T06:09:06.325 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-13T06:09:06.325 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-13T06:09:06.327 INFO:tasks.ceph.osd.1:Started 2024-09-13T06:09:06.327 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-13T06:09:06.327 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-13T06:09:06.329 INFO:tasks.ceph.osd.2:Started 2024-09-13T06:09:06.329 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-13T06:09:06.329 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-13T06:09:06.331 INFO:tasks.ceph.osd.3:Started 2024-09-13T06:09:06.331 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T06:09:06.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:06.452+0000 7f530cacc640 1 Processor -- start 2024-09-13T06:09:06.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:06.452+0000 7f530cacc640 1 -- start start 2024-09-13T06:09:06.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:06.452+0000 7f530cacc640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f530812e760 0x7f530812ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:06.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:06.452+0000 7f530cacc640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53080984f0 con 0x7f530812f1c0 2024-09-13T06:09:06.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:06.452+0000 7f530cacc640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f5308098dc0 con 0x7f530812e760 2024-09-13T06:09:06.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:06.452+0000 7f5305d9b640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f530812f1c0 0x7f530812b260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:57818/0 (socket says 172.21.15.120:57818) 2024-09-13T06:09:06.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:06.452+0000 7f530659c640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f530812e760 0x7f530812ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:06.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:06.452+0000 7f5305d9b640 1 -- 172.21.15.120:0/2122215658 learned_addr learned my addr 172.21.15.120:0/2122215658 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-13T06:09:06.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:06.456+0000 7f530659c640 1 -- 172.21.15.120:0/2122215658 >> v1:172.21.15.120:6789/0 conn(0x7f530812f1c0 legacy=0x7f530812b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:06.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:06.456+0000 7f530659c640 1 -- 172.21.15.120:0/2122215658 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f530812f5a0 con 0x7f530812e760 2024-09-13T06:09:06.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:06.456+0000 7f530659c640 1 --2- 172.21.15.120:0/2122215658 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f530812e760 0x7f530812ec80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f52f8009740 tx=0x7f52f801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48076227195da4c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:06.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:06.456+0000 7f530559a640 1 -- 172.21.15.120:0/2122215658 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52f80b0070 con 0x7f530812e760 2024-09-13T06:09:06.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:06.456+0000 7f530559a640 1 -- 172.21.15.120:0/2122215658 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52f80ab530 con 0x7f530812e760 2024-09-13T06:09:06.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:06.456+0000 7f530559a640 1 -- 172.21.15.120:0/2122215658 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52f80ab830 con 0x7f530812e760 2024-09-13T06:09:06.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:06.456+0000 7f530cacc640 1 -- 172.21.15.120:0/2122215658 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f530812e760 msgr2=0x7f530812ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:06.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:06.456+0000 7f530cacc640 1 --2- 172.21.15.120:0/2122215658 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f530812e760 0x7f530812ec80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f52f8009740 tx=0x7f52f801c400 comp rx=0 tx=0).stop 2024-09-13T06:09:06.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:06.456+0000 7f530cacc640 1 -- 172.21.15.120:0/2122215658 shutdown_connections 2024-09-13T06:09:06.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:06.456+0000 7f530cacc640 1 --2- 172.21.15.120:0/2122215658 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f530812e760 0x7f530812ec80 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:06.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:06.456+0000 7f530cacc640 1 -- 172.21.15.120:0/2122215658 >> 172.21.15.120:0/2122215658 conn(0x7f53080a10a0 msgr2=0x7f53080a14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:06.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:06.456+0000 7f530cacc640 1 -- 172.21.15.120:0/2122215658 shutdown_connections 2024-09-13T06:09:06.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:06.456+0000 7f530cacc640 1 -- 172.21.15.120:0/2122215658 wait complete. 2024-09-13T06:09:06.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:06.456+0000 7f530cacc640 1 Processor -- start 2024-09-13T06:09:06.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:06.456+0000 7f530cacc640 1 -- start start 2024-09-13T06:09:06.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:06.460+0000 7f530cacc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f530812e760 0x7f530809c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:06.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:06.460+0000 7f530cacc640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f5308136e30 con 0x7f530812e760 2024-09-13T06:09:06.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:06.460+0000 7f530659c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f530812e760 0x7f530809c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:06.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:06.460+0000 7f530659c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f530812e760 0x7f530809c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58070/0 (socket says 172.21.15.120:58070) 2024-09-13T06:09:06.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:06.460+0000 7f530659c640 1 -- 172.21.15.120:0/1237247502 learned_addr learned my addr 172.21.15.120:0/1237247502 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-13T06:09:06.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:06.460+0000 7f530659c640 1 -- 172.21.15.120:0/1237247502 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5308130510 con 0x7f530812e760 2024-09-13T06:09:06.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:06.460+0000 7f530659c640 1 --2- 172.21.15.120:0/1237247502 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f530812e760 0x7f530809c920 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f52f801a030 tx=0x7f52f801ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:06.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:06.460+0000 7f52f6ffd640 1 -- 172.21.15.120:0/1237247502 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52f80b0050 con 0x7f530812e760 2024-09-13T06:09:06.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:06.460+0000 7f52f6ffd640 1 -- 172.21.15.120:0/1237247502 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52f80b1040 con 0x7f530812e760 2024-09-13T06:09:06.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:06.460+0000 7f530cacc640 1 -- 172.21.15.120:0/1237247502 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5308130c10 con 0x7f530812e760 2024-09-13T06:09:06.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:06.460+0000 7f52f6ffd640 1 -- 172.21.15.120:0/1237247502 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52f80b5740 con 0x7f530812e760 2024-09-13T06:09:06.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:06.460+0000 7f530cacc640 1 -- 172.21.15.120:0/1237247502 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f530809ce60 con 0x7f530812e760 2024-09-13T06:09:06.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:06.460+0000 7f52f6ffd640 1 -- 172.21.15.120:0/1237247502 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f52f80be030 con 0x7f530812e760 2024-09-13T06:09:06.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:06.460+0000 7f52f6ffd640 1 -- 172.21.15.120:0/1237247502 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f52f80bc070 con 0x7f530812e760 2024-09-13T06:09:06.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:06.460+0000 7f530cacc640 1 -- 172.21.15.120:0/1237247502 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f530809e3a0 con 0x7f530812e760 2024-09-13T06:09:06.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:06.464+0000 7f52f6ffd640 1 -- 172.21.15.120:0/1237247502 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f52f80c5020 con 0x7f530812e760 2024-09-13T06:09:06.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:06.520+0000 7f530cacc640 1 -- 172.21.15.120:0/1237247502 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f530812ec80 con 0x7f530812e760 2024-09-13T06:09:06.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:06.520+0000 7f52f6ffd640 1 -- 172.21.15.120:0/1237247502 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7f52f8015ff0 con 0x7f530812e760 2024-09-13T06:09:06.520 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T06:09:06.520 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":6,"fsid":"b924da04-5ce7-4b88-90c8-d1e25fda89f0","created":"2024-09-13T06:09:05.102460+0000","modified":"2024-09-13T06:09:06.306194+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T06:09:06.306194+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"6d4134f4-6b9e-4fcd-bf7c-0938458a015f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"aca83f02-0827-44d8-b4b9-2480cce86270","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2e1a73a0-26b9-4247-acbb-15ccd2478adb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"afca1e17-ff25-4f0e-9639-a9a06385b8c8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T06:09:06.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:06.520+0000 7f530cacc640 1 -- 172.21.15.120:0/1237247502 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f530812e760 msgr2=0x7f530809c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:06.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:06.520+0000 7f530cacc640 1 --2- 172.21.15.120:0/1237247502 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f530812e760 0x7f530809c920 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f52f801a030 tx=0x7f52f801ac40 comp rx=0 tx=0).stop 2024-09-13T06:09:06.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:06.520+0000 7f530cacc640 1 -- 172.21.15.120:0/1237247502 shutdown_connections 2024-09-13T06:09:06.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:06.520+0000 7f530cacc640 1 --2- 172.21.15.120:0/1237247502 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f530812e760 0x7f530809c920 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:06.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:06.520+0000 7f530cacc640 1 -- 172.21.15.120:0/1237247502 >> 172.21.15.120:0/1237247502 conn(0x7f53080a10a0 msgr2=0x7f5308095280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:06.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:06.520+0000 7f530cacc640 1 -- 172.21.15.120:0/1237247502 shutdown_connections 2024-09-13T06:09:06.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:06.520+0000 7f530cacc640 1 -- 172.21.15.120:0/1237247502 wait complete. 2024-09-13T06:09:06.537 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-13T06:09:06.537 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-13T06:09:06.594 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-13T06:09:06.592+0000 7f37e2a22180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T06:09:06.647 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-13T06:09:06.648+0000 7f37e2a22180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T06:09:06.699 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-13T06:09:06.700+0000 7f37e2a22180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T06:09:06.776 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-13T06:09:06.776+0000 7f37e2a22180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T06:09:06.827 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-13T06:09:06.824+0000 7f37e2a22180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T06:09:06.902 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-13T06:09:06.900+0000 7f37e2a22180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T06:09:06.940 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T06:09:06.954 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-13T06:09:06.952+0000 7f37e2a22180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T06:09:07.060 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:07.060+0000 7f1313191640 1 Processor -- start 2024-09-13T06:09:07.060 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:07.060+0000 7f1313191640 1 -- start start 2024-09-13T06:09:07.061 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:07.060+0000 7f1313191640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f130c094240 0x7f130c094620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:07.061 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:07.060+0000 7f1313191640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f130c099590 con 0x7f130c094b60 2024-09-13T06:09:07.061 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:07.064+0000 7f1313191640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f130c098be0 con 0x7f130c094240 2024-09-13T06:09:07.062 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:07.064+0000 7f1310f2d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f130c094240 0x7f130c094620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:07.062 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:07.064+0000 7f130bfff640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f130c094b60 0x7f130c132ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:57826/0 (socket says 172.21.15.120:57826) 2024-09-13T06:09:07.062 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:07.064+0000 7f130bfff640 1 -- 172.21.15.120:0/2030328153 learned_addr learned my addr 172.21.15.120:0/2030328153 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-13T06:09:07.062 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:07.064+0000 7f1310f2d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f130c094240 0x7f130c094620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58086/0 (socket says 172.21.15.120:58086) 2024-09-13T06:09:07.062 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:07.064+0000 7f1310f2d640 1 -- 172.21.15.120:0/2030328153 >> v1:172.21.15.120:6789/0 conn(0x7f130c094b60 legacy=0x7f130c132ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:07.062 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:07.064+0000 7f130b7fe640 1 -- 172.21.15.120:0/2030328153 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 113670044 0 0) 0x7f130c099590 con 0x7f130c094b60 2024-09-13T06:09:07.062 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:07.064+0000 7f1310f2d640 1 -- 172.21.15.120:0/2030328153 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f130c096680 con 0x7f130c094240 2024-09-13T06:09:07.063 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:07.064+0000 7f1310f2d640 1 --2- 172.21.15.120:0/2030328153 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f130c094240 0x7f130c094620 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f12fc009dc0 tx=0x7f12fc01c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd31e2c537796cd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:07.064 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:07.064+0000 7f130b7fe640 1 -- 172.21.15.120:0/2030328153 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12fc0b2070 con 0x7f130c094240 2024-09-13T06:09:07.064 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:07.064+0000 7f130b7fe640 1 -- 172.21.15.120:0/2030328153 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12fc0a5740 con 0x7f130c094240 2024-09-13T06:09:07.064 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:07.064+0000 7f130b7fe640 1 -- 172.21.15.120:0/2030328153 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12fc0a5a40 con 0x7f130c094240 2024-09-13T06:09:07.064 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:07.064+0000 7f1313191640 1 -- 172.21.15.120:0/2030328153 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f130c094240 msgr2=0x7f130c094620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:07.065 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:07.064+0000 7f1313191640 1 --2- 172.21.15.120:0/2030328153 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f130c094240 0x7f130c094620 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f12fc009dc0 tx=0x7f12fc01c840 comp rx=0 tx=0).stop 2024-09-13T06:09:07.065 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:07.064+0000 7f1313191640 1 -- 172.21.15.120:0/2030328153 shutdown_connections 2024-09-13T06:09:07.065 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:07.064+0000 7f1313191640 1 --2- 172.21.15.120:0/2030328153 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f130c094240 0x7f130c094620 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:07.065 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:07.064+0000 7f1313191640 1 -- 172.21.15.120:0/2030328153 >> 172.21.15.120:0/2030328153 conn(0x7f130c099c40 msgr2=0x7f130c09a050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:07.065 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:07.064+0000 7f1313191640 1 -- 172.21.15.120:0/2030328153 shutdown_connections 2024-09-13T06:09:07.065 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:07.064+0000 7f1313191640 1 -- 172.21.15.120:0/2030328153 wait complete. 2024-09-13T06:09:07.067 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:07.068+0000 7f1313191640 1 Processor -- start 2024-09-13T06:09:07.067 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:07.068+0000 7f1313191640 1 -- start start 2024-09-13T06:09:07.067 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:07.068+0000 7f1313191640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f130c094240 0x7f130c121e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:07.067 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:07.068+0000 7f1313191640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f130c1371c0 con 0x7f130c094240 2024-09-13T06:09:07.067 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:07.068+0000 7f1310f2d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f130c094240 0x7f130c121e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:07.067 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:07.068+0000 7f1310f2d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f130c094240 0x7f130c121e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58094/0 (socket says 172.21.15.120:58094) 2024-09-13T06:09:07.067 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:07.068+0000 7f1310f2d640 1 -- 172.21.15.120:0/4123113777 learned_addr learned my addr 172.21.15.120:0/4123113777 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-13T06:09:07.067 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:07.068+0000 7f1310f2d640 1 -- 172.21.15.120:0/4123113777 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f130c123a50 con 0x7f130c094240 2024-09-13T06:09:07.067 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:07.068+0000 7f1310f2d640 1 --2- 172.21.15.120:0/4123113777 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f130c094240 0x7f130c121e00 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f12fc0194b0 tx=0x7f12fc019640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:07.067 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:07.068+0000 7f13097fa640 1 -- 172.21.15.120:0/4123113777 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12fc0b2050 con 0x7f130c094240 2024-09-13T06:09:07.067 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:07.068+0000 7f13097fa640 1 -- 172.21.15.120:0/4123113777 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12fc0b3040 con 0x7f130c094240 2024-09-13T06:09:07.068 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:07.068+0000 7f1313191640 1 -- 172.21.15.120:0/4123113777 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f130c072940 con 0x7f130c094240 2024-09-13T06:09:07.068 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:07.068+0000 7f13097fa640 1 -- 172.21.15.120:0/4123113777 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12fc0ad8d0 con 0x7f130c094240 2024-09-13T06:09:07.068 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:07.068+0000 7f1313191640 1 -- 172.21.15.120:0/4123113777 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f130c1242b0 con 0x7f130c094240 2024-09-13T06:09:07.068 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:07.068+0000 7f13097fa640 1 -- 172.21.15.120:0/4123113777 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f12fc0c0020 con 0x7f130c094240 2024-09-13T06:09:07.068 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:07.068+0000 7f13097fa640 1 -- 172.21.15.120:0/4123113777 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f12fc0be020 con 0x7f130c094240 2024-09-13T06:09:07.068 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:07.068+0000 7f1313191640 1 -- 172.21.15.120:0/4123113777 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f130c094620 con 0x7f130c094240 2024-09-13T06:09:07.069 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:07.072+0000 7f13097fa640 1 -- 172.21.15.120:0/4123113777 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f12fc0c7020 con 0x7f130c094240 2024-09-13T06:09:07.103 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-13T06:09:07.104+0000 7f37e2a22180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T06:09:07.128 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:07.128+0000 7f1313191640 1 -- 172.21.15.120:0/4123113777 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f130c072b10 con 0x7f130c094240 2024-09-13T06:09:07.129 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:07.132+0000 7f13097fa640 1 -- 172.21.15.120:0/4123113777 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7f12fc016520 con 0x7f130c094240 2024-09-13T06:09:07.129 INFO:teuthology.misc.health.smithi120.stdout: 2024-09-13T06:09:07.129 INFO:teuthology.misc.health.smithi120.stdout:{"epoch":6,"fsid":"b924da04-5ce7-4b88-90c8-d1e25fda89f0","created":"2024-09-13T06:09:05.102460+0000","modified":"2024-09-13T06:09:06.306194+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T06:09:06.306194+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"6d4134f4-6b9e-4fcd-bf7c-0938458a015f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"aca83f02-0827-44d8-b4b9-2480cce86270","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2e1a73a0-26b9-4247-acbb-15ccd2478adb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"afca1e17-ff25-4f0e-9639-a9a06385b8c8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T06:09:07.130 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:07.132+0000 7f1313191640 1 -- 172.21.15.120:0/4123113777 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f130c094240 msgr2=0x7f130c121e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:07.130 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:07.132+0000 7f1313191640 1 --2- 172.21.15.120:0/4123113777 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f130c094240 0x7f130c121e00 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f12fc0194b0 tx=0x7f12fc019640 comp rx=0 tx=0).stop 2024-09-13T06:09:07.130 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:07.132+0000 7f1313191640 1 -- 172.21.15.120:0/4123113777 shutdown_connections 2024-09-13T06:09:07.130 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:07.132+0000 7f1313191640 1 --2- 172.21.15.120:0/4123113777 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f130c094240 0x7f130c121e00 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:07.130 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:07.132+0000 7f1313191640 1 -- 172.21.15.120:0/4123113777 >> 172.21.15.120:0/4123113777 conn(0x7f130c099c40 msgr2=0x7f130c09bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:07.130 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:07.132+0000 7f1313191640 1 -- 172.21.15.120:0/4123113777 shutdown_connections 2024-09-13T06:09:07.130 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:07.132+0000 7f1313191640 1 -- 172.21.15.120:0/4123113777 wait complete. 2024-09-13T06:09:07.146 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-13T06:09:07.165 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-13T06:09:07.164+0000 7f37e2a22180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T06:09:07.794 INFO:tasks.ceph.mgr.x.smithi194.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-13T06:09:07.795 INFO:tasks.ceph.mgr.x.smithi194.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-13T06:09:07.795 INFO:tasks.ceph.mgr.x.smithi194.stderr: from numpy import show_config as show_numpy_config 2024-09-13T06:09:07.863 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-13T06:09:07.864+0000 7f37e2a22180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T06:09:08.039 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-13T06:09:08.036+0000 7f37e2a22180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T06:09:08.119 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T06:09:08.120+0000 7fcc5b8347c0 -1 Falling back to public interface 2024-09-13T06:09:08.191 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-13T06:09:08.192+0000 7f37e2a22180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T06:09:08.196 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-09-13T06:09:08.196+0000 7f41b962c7c0 -1 Falling back to public interface 2024-09-13T06:09:08.203 INFO:tasks.ceph.osd.1.smithi194.stderr:2024-09-13T06:09:08.204+0000 7fc4266f67c0 -1 Falling back to public interface 2024-09-13T06:09:08.255 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-13T06:09:08.256+0000 7f37e2a22180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T06:09:08.387 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-13T06:09:08.388+0000 7f37e2a22180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T06:09:08.493 INFO:tasks.ceph.osd.3.smithi194.stderr:2024-09-13T06:09:08.492+0000 7f8737d4a7c0 -1 Falling back to public interface 2024-09-13T06:09:08.988 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-13T06:09:08.988+0000 7f37e2a22180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T06:09:09.061 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-13T06:09:09.060+0000 7f37e2a22180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T06:09:09.242 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-13T06:09:09.240+0000 7f37e2a22180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T06:09:09.315 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-13T06:09:09.312+0000 7f37e2a22180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T06:09:09.602 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-13T06:09:09.600+0000 7f37e2a22180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T06:09:09.663 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-13T06:09:09.664+0000 7f37e2a22180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T06:09:10.696 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-13T06:09:10.696+0000 7f3789558640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-13T06:09:12.519 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-09-13T06:09:12.520+0000 7f41b962c7c0 -1 osd.2 0 log_to_monitors true 2024-09-13T06:09:12.684 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T06:09:12.684+0000 7fcc5b8347c0 -1 osd.0 0 log_to_monitors true 2024-09-13T06:09:12.785 INFO:tasks.ceph.osd.1.smithi194.stderr:2024-09-13T06:09:12.784+0000 7fc4266f67c0 -1 osd.1 0 log_to_monitors true 2024-09-13T06:09:13.202 INFO:tasks.ceph.osd.3.smithi194.stderr:2024-09-13T06:09:13.200+0000 7f8737d4a7c0 -1 osd.3 0 log_to_monitors true 2024-09-13T06:09:13.549 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T06:09:13.673 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:13.672+0000 7f0b953cb640 1 Processor -- start 2024-09-13T06:09:13.673 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:13.672+0000 7f0b953cb640 1 -- start start 2024-09-13T06:09:13.674 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:13.676+0000 7f0b953cb640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f0b9012a6a0 0x7f0b9012aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:13.674 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:13.676+0000 7f0b953cb640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b90098be0 con 0x7f0b90096ff0 2024-09-13T06:09:13.674 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:13.676+0000 7f0b953cb640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f0b9012a2e0 con 0x7f0b9012a6a0 2024-09-13T06:09:13.674 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:13.676+0000 7f0b8effd640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f0b9012a6a0 0x7f0b9012aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:13.674 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:13.676+0000 7f0b8e7fc640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f0b90096ff0 0x7f0b90129260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:52894/0 (socket says 172.21.15.120:52894) 2024-09-13T06:09:13.674 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:13.676+0000 7f0b8e7fc640 1 -- 172.21.15.120:0/1353152436 learned_addr learned my addr 172.21.15.120:0/1353152436 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-13T06:09:13.674 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:13.676+0000 7f0b8effd640 1 --2- 172.21.15.120:0/1353152436 >> v2:172.21.15.120:3300/0 conn(0x7f0b9012a6a0 0x7f0b9012aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56916/0 (socket says 172.21.15.120:56916) 2024-09-13T06:09:13.674 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:13.676+0000 7f0b8effd640 1 -- 172.21.15.120:0/1353152436 >> v1:172.21.15.120:6789/0 conn(0x7f0b90096ff0 legacy=0x7f0b90129260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:13.674 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:13.676+0000 7f0b8effd640 1 -- 172.21.15.120:0/1353152436 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b90096560 con 0x7f0b9012a6a0 2024-09-13T06:09:13.676 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:13.676+0000 7f0b8effd640 1 --2- 172.21.15.120:0/1353152436 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b9012a6a0 0x7f0b9012aa80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0b84009740 tx=0x7f0b8401c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30b6733371b3284 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:13.676 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:13.676+0000 7f0b8dffb640 1 -- 172.21.15.120:0/1353152436 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b840b0070 con 0x7f0b9012a6a0 2024-09-13T06:09:13.676 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:13.676+0000 7f0b8dffb640 1 -- 172.21.15.120:0/1353152436 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b840ab530 con 0x7f0b9012a6a0 2024-09-13T06:09:13.676 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:13.676+0000 7f0b8dffb640 1 -- 172.21.15.120:0/1353152436 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b840a4e60 con 0x7f0b9012a6a0 2024-09-13T06:09:13.677 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:13.676+0000 7f0b953cb640 1 -- 172.21.15.120:0/1353152436 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b9012a6a0 msgr2=0x7f0b9012aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:13.677 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:13.676+0000 7f0b953cb640 1 --2- 172.21.15.120:0/1353152436 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b9012a6a0 0x7f0b9012aa80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0b84009740 tx=0x7f0b8401c3a0 comp rx=0 tx=0).stop 2024-09-13T06:09:13.677 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:13.676+0000 7f0b953cb640 1 -- 172.21.15.120:0/1353152436 shutdown_connections 2024-09-13T06:09:13.677 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:13.676+0000 7f0b953cb640 1 --2- 172.21.15.120:0/1353152436 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b9012a6a0 0x7f0b9012aa80 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:13.677 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:13.676+0000 7f0b953cb640 1 -- 172.21.15.120:0/1353152436 >> 172.21.15.120:0/1353152436 conn(0x7f0b90099c40 msgr2=0x7f0b9009a050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:13.677 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:13.676+0000 7f0b953cb640 1 -- 172.21.15.120:0/1353152436 shutdown_connections 2024-09-13T06:09:13.677 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:13.676+0000 7f0b953cb640 1 -- 172.21.15.120:0/1353152436 wait complete. 2024-09-13T06:09:13.679 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:13.680+0000 7f0b953cb640 1 Processor -- start 2024-09-13T06:09:13.679 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:13.680+0000 7f0b953cb640 1 -- start start 2024-09-13T06:09:13.679 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:13.680+0000 7f0b953cb640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b90096ff0 0x7f0b90127d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:13.679 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:13.680+0000 7f0b953cb640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f0b90133b20 con 0x7f0b90096ff0 2024-09-13T06:09:13.679 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:13.680+0000 7f0b8effd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b90096ff0 0x7f0b90127d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:13.679 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:13.680+0000 7f0b8effd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b90096ff0 0x7f0b90127d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56928/0 (socket says 172.21.15.120:56928) 2024-09-13T06:09:13.679 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:13.680+0000 7f0b8effd640 1 -- 172.21.15.120:0/1871668224 learned_addr learned my addr 172.21.15.120:0/1871668224 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-13T06:09:13.679 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:13.680+0000 7f0b8effd640 1 -- 172.21.15.120:0/1871668224 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b9006fe60 con 0x7f0b90096ff0 2024-09-13T06:09:13.679 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:13.680+0000 7f0b8effd640 1 --2- 172.21.15.120:0/1871668224 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b90096ff0 0x7f0b90127d00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0b840ae040 tx=0x7f0b8401ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:13.679 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:13.680+0000 7f0b777fe640 1 -- 172.21.15.120:0/1871668224 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b840b0050 con 0x7f0b90096ff0 2024-09-13T06:09:13.679 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:13.680+0000 7f0b777fe640 1 -- 172.21.15.120:0/1871668224 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b840b1040 con 0x7f0b90096ff0 2024-09-13T06:09:13.680 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:13.680+0000 7f0b953cb640 1 -- 172.21.15.120:0/1871668224 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b90127790 con 0x7f0b90096ff0 2024-09-13T06:09:13.680 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:13.680+0000 7f0b777fe640 1 -- 172.21.15.120:0/1871668224 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b840b5610 con 0x7f0b90096ff0 2024-09-13T06:09:13.680 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:13.680+0000 7f0b953cb640 1 -- 172.21.15.120:0/1871668224 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b90128240 con 0x7f0b90096ff0 2024-09-13T06:09:13.680 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:13.680+0000 7f0b953cb640 1 -- 172.21.15.120:0/1871668224 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b90126b10 con 0x7f0b90096ff0 2024-09-13T06:09:13.681 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:13.680+0000 7f0b777fe640 1 -- 172.21.15.120:0/1871668224 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 4) ==== 43997+0+0 (secure 0 0 0) 0x7f0b840be030 con 0x7f0b90096ff0 2024-09-13T06:09:13.681 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:13.680+0000 7f0b777fe640 1 --2- 172.21.15.120:0/1871668224 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0b7c035d20 0x7f0b7c0381e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:13.681 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:13.680+0000 7f0b777fe640 1 -- 172.21.15.120:0/1871668224 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1297+0+0 (secure 0 0 0) 0x7f0b840bc070 con 0x7f0b90096ff0 2024-09-13T06:09:13.681 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:13.680+0000 7f0b8e7fc640 1 --2- 172.21.15.120:0/1871668224 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0b7c035d20 0x7f0b7c0381e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:13.681 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:13.684+0000 7f0b8e7fc640 1 --2- 172.21.15.120:0/1871668224 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0b7c035d20 0x7f0b7c0381e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0b800012f0 tx=0x7f0b80001640 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:13.684 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:13.688+0000 7f0b777fe640 1 -- 172.21.15.120:0/1871668224 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0b840c5020 con 0x7f0b90096ff0 2024-09-13T06:09:13.855 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:13.856+0000 7f0b953cb640 1 -- 172.21.15.120:0/1871668224 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0b90075770 con 0x7f0b90096ff0 2024-09-13T06:09:13.856 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:13.856+0000 7f0b777fe640 1 -- 172.21.15.120:0/1871668224 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) ==== 74+0+4153 (secure 0 0 0) 0x7f0b84015ff0 con 0x7f0b90096ff0 2024-09-13T06:09:13.856 INFO:teuthology.misc.health.smithi120.stdout: 2024-09-13T06:09:13.856 INFO:teuthology.misc.health.smithi120.stdout:{"epoch":8,"fsid":"b924da04-5ce7-4b88-90c8-d1e25fda89f0","created":"2024-09-13T06:09:05.102460+0000","modified":"2024-09-13T06:09:13.751182+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T06:09:06.306194+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"6d4134f4-6b9e-4fcd-bf7c-0938458a015f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"aca83f02-0827-44d8-b4b9-2480cce86270","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2e1a73a0-26b9-4247-acbb-15ccd2478adb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"afca1e17-ff25-4f0e-9639-a9a06385b8c8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T06:09:13.858 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:13.860+0000 7f0b953cb640 1 -- 172.21.15.120:0/1871668224 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0b7c035d20 msgr2=0x7f0b7c0381e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:13.858 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:13.860+0000 7f0b953cb640 1 --2- 172.21.15.120:0/1871668224 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0b7c035d20 0x7f0b7c0381e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0b800012f0 tx=0x7f0b80001640 comp rx=0 tx=0).stop 2024-09-13T06:09:13.858 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:13.860+0000 7f0b953cb640 1 -- 172.21.15.120:0/1871668224 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b90096ff0 msgr2=0x7f0b90127d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:13.858 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:13.860+0000 7f0b953cb640 1 --2- 172.21.15.120:0/1871668224 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b90096ff0 0x7f0b90127d00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0b840ae040 tx=0x7f0b8401ac40 comp rx=0 tx=0).stop 2024-09-13T06:09:13.858 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:13.860+0000 7f0b953cb640 1 -- 172.21.15.120:0/1871668224 shutdown_connections 2024-09-13T06:09:13.858 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:13.860+0000 7f0b953cb640 1 --2- 172.21.15.120:0/1871668224 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0b7c035d20 0x7f0b7c0381e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:13.859 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:13.860+0000 7f0b953cb640 1 --2- 172.21.15.120:0/1871668224 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b90096ff0 0x7f0b90127d00 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:13.859 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:13.860+0000 7f0b953cb640 1 -- 172.21.15.120:0/1871668224 >> 172.21.15.120:0/1871668224 conn(0x7f0b90099c40 msgr2=0x7f0b9009b810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:13.859 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:13.860+0000 7f0b953cb640 1 -- 172.21.15.120:0/1871668224 shutdown_connections 2024-09-13T06:09:13.859 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:13.860+0000 7f0b953cb640 1 -- 172.21.15.120:0/1871668224 wait complete. 2024-09-13T06:09:13.875 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-13T06:09:14.639 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T06:09:14.640+0000 7fcc56fba640 -1 osd.0 0 waiting for initial osdmap 2024-09-13T06:09:14.662 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-13T06:09:14.664+0000 7fcc4f601640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T06:09:14.748 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-09-13T06:09:14.748+0000 7f41b4db2640 -1 osd.2 0 waiting for initial osdmap 2024-09-13T06:09:14.785 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-09-13T06:09:14.784+0000 7f41ad3f9640 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T06:09:16.155 INFO:tasks.ceph.osd.1.smithi194.stderr:2024-09-13T06:09:16.156+0000 7fc422eb1640 -1 osd.1 0 waiting for initial osdmap 2024-09-13T06:09:16.175 INFO:tasks.ceph.osd.1.smithi194.stderr:2024-09-13T06:09:16.176+0000 7fc41a4c3640 -1 osd.1 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T06:09:16.176 INFO:tasks.ceph.osd.3.smithi194.stderr:2024-09-13T06:09:16.176+0000 7f87334d0640 -1 osd.3 0 waiting for initial osdmap 2024-09-13T06:09:16.219 INFO:tasks.ceph.osd.3.smithi194.stderr:2024-09-13T06:09:16.220+0000 7f872bb17640 -1 osd.3 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T06:09:20.280 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T06:09:20.399 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:20.400+0000 7fd48d529640 1 Processor -- start 2024-09-13T06:09:20.400 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:20.400+0000 7fd48d529640 1 -- start start 2024-09-13T06:09:20.400 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:20.400+0000 7fd48d529640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fd488097780 0x7fd488097b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:20.400 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:20.400+0000 7fd48d529640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd48809b440 con 0x7fd48812e500 2024-09-13T06:09:20.400 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:20.400+0000 7fd48d529640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fd48809af60 con 0x7fd488097780 2024-09-13T06:09:20.400 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:20.400+0000 7fd486ffd640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fd488097780 0x7fd488097b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:20.400 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:20.400+0000 7fd486ffd640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fd488097780 0x7fd488097b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56944/0 (socket says 172.21.15.120:56944) 2024-09-13T06:09:20.400 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:20.400+0000 7fd486ffd640 1 -- 172.21.15.120:0/4261188854 learned_addr learned my addr 172.21.15.120:0/4261188854 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-13T06:09:20.400 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:20.400+0000 7fd486ffd640 1 -- 172.21.15.120:0/4261188854 >> v1:172.21.15.120:6789/0 conn(0x7fd48812e500 legacy=0x7fd48812e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:20.400 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:20.400+0000 7fd4867fc640 1 -- 172.21.15.120:0/4261188854 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3356744319 0 0) 0x7fd48809b440 con 0x7fd48812e500 2024-09-13T06:09:20.400 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:20.400+0000 7fd486ffd640 1 -- 172.21.15.120:0/4261188854 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd488098650 con 0x7fd488097780 2024-09-13T06:09:20.402 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:20.404+0000 7fd486ffd640 1 --2- 172.21.15.120:0/4261188854 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd488097780 0x7fd488097b60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd4780097f0 tx=0x7fd47801c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb6e072e9b7e4019 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:20.402 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:20.404+0000 7fd4867fc640 1 -- 172.21.15.120:0/4261188854 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4780b0070 con 0x7fd488097780 2024-09-13T06:09:20.402 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:20.404+0000 7fd4867fc640 1 -- 172.21.15.120:0/4261188854 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4780ab530 con 0x7fd488097780 2024-09-13T06:09:20.402 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:20.404+0000 7fd4867fc640 1 -- 172.21.15.120:0/4261188854 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4780ab830 con 0x7fd488097780 2024-09-13T06:09:20.403 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:20.404+0000 7fd48d529640 1 -- 172.21.15.120:0/4261188854 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd488097780 msgr2=0x7fd488097b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:20.403 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:20.404+0000 7fd48d529640 1 --2- 172.21.15.120:0/4261188854 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd488097780 0x7fd488097b60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd4780097f0 tx=0x7fd47801c4c0 comp rx=0 tx=0).stop 2024-09-13T06:09:20.403 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:20.404+0000 7fd48d529640 1 -- 172.21.15.120:0/4261188854 shutdown_connections 2024-09-13T06:09:20.403 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:20.404+0000 7fd48d529640 1 --2- 172.21.15.120:0/4261188854 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd488097780 0x7fd488097b60 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:20.403 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:20.404+0000 7fd48d529640 1 -- 172.21.15.120:0/4261188854 >> 172.21.15.120:0/4261188854 conn(0x7fd4880a0fd0 msgr2=0x7fd4880a13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:20.403 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:20.404+0000 7fd48d529640 1 -- 172.21.15.120:0/4261188854 shutdown_connections 2024-09-13T06:09:20.403 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:20.404+0000 7fd48d529640 1 -- 172.21.15.120:0/4261188854 wait complete. 2024-09-13T06:09:20.405 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:20.404+0000 7fd48d529640 1 Processor -- start 2024-09-13T06:09:20.405 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:20.404+0000 7fd48d529640 1 -- start start 2024-09-13T06:09:20.405 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:20.404+0000 7fd48d529640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd488097780 0x7fd4881c64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:20.405 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:20.404+0000 7fd48d529640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fd4881371d0 con 0x7fd488097780 2024-09-13T06:09:20.405 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:20.404+0000 7fd486ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd488097780 0x7fd4881c64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:20.405 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:20.404+0000 7fd486ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd488097780 0x7fd4881c64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56956/0 (socket says 172.21.15.120:56956) 2024-09-13T06:09:20.405 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:20.404+0000 7fd486ffd640 1 -- 172.21.15.120:0/1441642608 learned_addr learned my addr 172.21.15.120:0/1441642608 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-13T06:09:20.405 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:20.404+0000 7fd486ffd640 1 -- 172.21.15.120:0/1441642608 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd488073ab0 con 0x7fd488097780 2024-09-13T06:09:20.405 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:20.404+0000 7fd486ffd640 1 --2- 172.21.15.120:0/1441642608 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd488097780 0x7fd4881c64e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd4780190d0 tx=0x7fd478019260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:20.405 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:20.404+0000 7fd47ffff640 1 -- 172.21.15.120:0/1441642608 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4780b0040 con 0x7fd488097780 2024-09-13T06:09:20.405 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:20.408+0000 7fd47ffff640 1 -- 172.21.15.120:0/1441642608 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4780abdb0 con 0x7fd488097780 2024-09-13T06:09:20.405 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:20.408+0000 7fd48d529640 1 -- 172.21.15.120:0/1441642608 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd48812acf0 con 0x7fd488097780 2024-09-13T06:09:20.406 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:20.408+0000 7fd47ffff640 1 -- 172.21.15.120:0/1441642608 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd478004150 con 0x7fd488097780 2024-09-13T06:09:20.406 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:20.408+0000 7fd48d529640 1 -- 172.21.15.120:0/1441642608 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd48812bbc0 con 0x7fd488097780 2024-09-13T06:09:20.406 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:20.408+0000 7fd48d529640 1 -- 172.21.15.120:0/1441642608 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd488097be0 con 0x7fd488097780 2024-09-13T06:09:20.407 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:20.408+0000 7fd47ffff640 1 -- 172.21.15.120:0/1441642608 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd4780b3070 con 0x7fd488097780 2024-09-13T06:09:20.407 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:20.408+0000 7fd47ffff640 1 --2- 172.21.15.120:0/1441642608 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fd468035db0 0x7fd468038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:20.407 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:20.408+0000 7fd47ffff640 1 -- 172.21.15.120:0/1441642608 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 3129+0+0 (secure 0 0 0) 0x7fd4780e2820 con 0x7fd488097780 2024-09-13T06:09:20.407 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:20.408+0000 7fd47e7fc640 1 --2- 172.21.15.120:0/1441642608 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fd468035db0 0x7fd468038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:20.407 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:20.408+0000 7fd47e7fc640 1 --2- 172.21.15.120:0/1441642608 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fd468035db0 0x7fd468038270 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd470000f70 tx=0x7fd470007930 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:20.411 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:20.412+0000 7fd47ffff640 1 -- 172.21.15.120:0/1441642608 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd4780c3030 con 0x7fd488097780 2024-09-13T06:09:20.575 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:20.576+0000 7fd48d529640 1 -- 172.21.15.120:0/1441642608 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd48806dc90 con 0x7fd488097780 2024-09-13T06:09:20.576 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:20.576+0000 7fd47ffff640 1 -- 172.21.15.120:0/1441642608 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+7990 (secure 0 0 0) 0x7fd488073ab0 con 0x7fd488097780 2024-09-13T06:09:20.577 INFO:teuthology.misc.health.smithi120.stdout: 2024-09-13T06:09:20.577 INFO:teuthology.misc.health.smithi120.stdout:{"epoch":14,"fsid":"b924da04-5ce7-4b88-90c8-d1e25fda89f0","created":"2024-09-13T06:09:05.102460+0000","modified":"2024-09-13T06:09:20.176207+0000","last_up_change":"2024-09-13T06:09:17.161802+0000","last_in_change":"2024-09-13T06:09:06.306194+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T06:09:17.772771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d4134f4-6b9e-4fcd-bf7c-0938458a015f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1923744619},{"type":"v1","addr":"172.21.15.120:6801","nonce":1923744619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1923744619},{"type":"v1","addr":"172.21.15.120:6803","nonce":1923744619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1923744619},{"type":"v1","addr":"172.21.15.120:6807","nonce":1923744619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1923744619},{"type":"v1","addr":"172.21.15.120:6805","nonce":1923744619}]},"public_addr":"172.21.15.120:6801/1923744619","cluster_addr":"172.21.15.120:6803/1923744619","heartbeat_back_addr":"172.21.15.120:6807/1923744619","heartbeat_front_addr":"172.21.15.120:6805/1923744619","state":["exists","up"]},{"osd":1,"uuid":"aca83f02-0827-44d8-b4b9-2480cce86270","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3135444559},{"type":"v1","addr":"172.21.15.194:6809","nonce":3135444559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3135444559},{"type":"v1","addr":"172.21.15.194:6811","nonce":3135444559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3135444559},{"type":"v1","addr":"172.21.15.194:6815","nonce":3135444559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3135444559},{"type":"v1","addr":"172.21.15.194:6813","nonce":3135444559}]},"public_addr":"172.21.15.194:6809/3135444559","cluster_addr":"172.21.15.194:6811/3135444559","heartbeat_back_addr":"172.21.15.194:6815/3135444559","heartbeat_front_addr":"172.21.15.194:6813/3135444559","state":["exists","up"]},{"osd":2,"uuid":"2e1a73a0-26b9-4247-acbb-15ccd2478adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":815615585},{"type":"v1","addr":"172.21.15.194:6801","nonce":815615585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":815615585},{"type":"v1","addr":"172.21.15.194:6803","nonce":815615585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":815615585},{"type":"v1","addr":"172.21.15.194:6807","nonce":815615585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":815615585},{"type":"v1","addr":"172.21.15.194:6805","nonce":815615585}]},"public_addr":"172.21.15.194:6801/815615585","cluster_addr":"172.21.15.194:6803/815615585","heartbeat_back_addr":"172.21.15.194:6807/815615585","heartbeat_front_addr":"172.21.15.194:6805/815615585","state":["exists","up"]},{"osd":3,"uuid":"afca1e17-ff25-4f0e-9639-a9a06385b8c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":96632515},{"type":"v1","addr":"172.21.15.194:6817","nonce":96632515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":96632515},{"type":"v1","addr":"172.21.15.194:6819","nonce":96632515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":96632515},{"type":"v1","addr":"172.21.15.194:6823","nonce":96632515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":96632515},{"type":"v1","addr":"172.21.15.194:6821","nonce":96632515}]},"public_addr":"172.21.15.194:6817/96632515","cluster_addr":"172.21.15.194:6819/96632515","heartbeat_back_addr":"172.21.15.194:6823/96632515","heartbeat_front_addr":"172.21.15.194:6821/96632515","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:09:13.701094+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:09:13.837131+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:09:13.550343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:09:14.173040+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T06:09:20.579 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:20.580+0000 7fd48d529640 1 -- 172.21.15.120:0/1441642608 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fd468035db0 msgr2=0x7fd468038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:20.579 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:20.580+0000 7fd48d529640 1 --2- 172.21.15.120:0/1441642608 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fd468035db0 0x7fd468038270 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd470000f70 tx=0x7fd470007930 comp rx=0 tx=0).stop 2024-09-13T06:09:20.579 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:20.580+0000 7fd48d529640 1 -- 172.21.15.120:0/1441642608 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd488097780 msgr2=0x7fd4881c64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:20.579 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:20.580+0000 7fd48d529640 1 --2- 172.21.15.120:0/1441642608 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd488097780 0x7fd4881c64e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd4780190d0 tx=0x7fd478019260 comp rx=0 tx=0).stop 2024-09-13T06:09:20.579 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:20.580+0000 7fd48d529640 1 -- 172.21.15.120:0/1441642608 shutdown_connections 2024-09-13T06:09:20.579 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:20.580+0000 7fd48d529640 1 --2- 172.21.15.120:0/1441642608 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fd468035db0 0x7fd468038270 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:20.579 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:20.580+0000 7fd48d529640 1 --2- 172.21.15.120:0/1441642608 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd488097780 0x7fd4881c64e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:20.579 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:20.580+0000 7fd48d529640 1 -- 172.21.15.120:0/1441642608 >> 172.21.15.120:0/1441642608 conn(0x7fd4880a0fd0 msgr2=0x7fd48809d360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:20.579 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:20.580+0000 7fd48d529640 1 -- 172.21.15.120:0/1441642608 shutdown_connections 2024-09-13T06:09:20.579 INFO:teuthology.misc.health.smithi120.stderr:2024-09-13T06:09:20.580+0000 7fd48d529640 1 -- 172.21.15.120:0/1441642608 wait complete. 2024-09-13T06:09:20.594 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-09-13T06:09:20.594 INFO:tasks.ceph:Creating RBD pool 2024-09-13T06:09:20.595 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-13T06:09:20.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:20.720+0000 7f401872c640 1 Processor -- start 2024-09-13T06:09:20.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:20.720+0000 7f401872c640 1 -- start start 2024-09-13T06:09:20.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:20.720+0000 7f401872c640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f40101283a0 0x7f4010128780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:20.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:20.720+0000 7f401872c640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4010127f00 con 0x7f40100702c0 2024-09-13T06:09:20.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:20.720+0000 7f401872c640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f4010073360 con 0x7f40101283a0 2024-09-13T06:09:20.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:20.720+0000 7f40164c8640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f40101283a0 0x7f4010128780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:20.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:20.720+0000 7f4015cc7640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f40100702c0 0x7f401012b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:52910/0 (socket says 172.21.15.120:52910) 2024-09-13T06:09:20.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:20.724+0000 7f4015cc7640 1 -- 172.21.15.120:0/1392170556 learned_addr learned my addr 172.21.15.120:0/1392170556 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-13T06:09:20.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:20.724+0000 7f40164c8640 1 -- 172.21.15.120:0/1392170556 >> v1:172.21.15.120:6789/0 conn(0x7f40100702c0 legacy=0x7f401012b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:20.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:20.724+0000 7f40164c8640 1 -- 172.21.15.120:0/1392170556 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40101281a0 con 0x7f40101283a0 2024-09-13T06:09:20.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:20.724+0000 7f40164c8640 1 --2- 172.21.15.120:0/1392170556 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40101283a0 0x7f4010128780 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f400c009740 tx=0x7f400c01c2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=300cb6afe5299376 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:20.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:20.724+0000 7f40154c6640 1 -- 172.21.15.120:0/1392170556 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f400c0b0070 con 0x7f40101283a0 2024-09-13T06:09:20.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:20.724+0000 7f40154c6640 1 -- 172.21.15.120:0/1392170556 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f400c0ab530 con 0x7f40101283a0 2024-09-13T06:09:20.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:20.724+0000 7f40154c6640 1 -- 172.21.15.120:0/1392170556 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f400c0ab830 con 0x7f40101283a0 2024-09-13T06:09:20.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:20.724+0000 7f401872c640 1 -- 172.21.15.120:0/1392170556 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40101283a0 msgr2=0x7f4010128780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:20.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:20.724+0000 7f401872c640 1 --2- 172.21.15.120:0/1392170556 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40101283a0 0x7f4010128780 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f400c009740 tx=0x7f400c01c2e0 comp rx=0 tx=0).stop 2024-09-13T06:09:20.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:20.724+0000 7f401872c640 1 -- 172.21.15.120:0/1392170556 shutdown_connections 2024-09-13T06:09:20.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:20.724+0000 7f401872c640 1 --2- 172.21.15.120:0/1392170556 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40101283a0 0x7f4010128780 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:20.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:20.724+0000 7f401872c640 1 -- 172.21.15.120:0/1392170556 >> 172.21.15.120:0/1392170556 conn(0x7f401009a8a0 msgr2=0x7f401009acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:20.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:20.724+0000 7f401872c640 1 -- 172.21.15.120:0/1392170556 shutdown_connections 2024-09-13T06:09:20.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:20.724+0000 7f401872c640 1 -- 172.21.15.120:0/1392170556 wait complete. 2024-09-13T06:09:20.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:20.728+0000 7f401872c640 1 Processor -- start 2024-09-13T06:09:20.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:20.728+0000 7f401872c640 1 -- start start 2024-09-13T06:09:20.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:20.728+0000 7f401872c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40100702c0 0x7f4010129280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:20.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:20.728+0000 7f401872c640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f40101339a0 con 0x7f40100702c0 2024-09-13T06:09:20.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:20.728+0000 7f40164c8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40100702c0 0x7f4010129280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:20.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:20.728+0000 7f40164c8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40100702c0 0x7f4010129280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56970/0 (socket says 172.21.15.120:56970) 2024-09-13T06:09:20.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:20.728+0000 7f40164c8640 1 -- 172.21.15.120:0/1715863606 learned_addr learned my addr 172.21.15.120:0/1715863606 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-13T06:09:20.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:20.728+0000 7f40164c8640 1 -- 172.21.15.120:0/1715863606 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4010125bf0 con 0x7f40100702c0 2024-09-13T06:09:20.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:20.728+0000 7f40164c8640 1 --2- 172.21.15.120:0/1715863606 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40100702c0 0x7f4010129280 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f400c0ae040 tx=0x7f400c019080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:20.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:20.728+0000 7f4006ffd640 1 -- 172.21.15.120:0/1715863606 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f400c0b8020 con 0x7f40100702c0 2024-09-13T06:09:20.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:20.728+0000 7f4006ffd640 1 -- 172.21.15.120:0/1715863606 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f400c0b4410 con 0x7f40100702c0 2024-09-13T06:09:20.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:20.728+0000 7f4006ffd640 1 -- 172.21.15.120:0/1715863606 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f400c0b0040 con 0x7f40100702c0 2024-09-13T06:09:20.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:20.728+0000 7f401872c640 1 -- 172.21.15.120:0/1715863606 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f401012e110 con 0x7f40100702c0 2024-09-13T06:09:20.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:20.728+0000 7f401872c640 1 -- 172.21.15.120:0/1715863606 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4010096a50 con 0x7f40100702c0 2024-09-13T06:09:20.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:20.728+0000 7f4006ffd640 1 -- 172.21.15.120:0/1715863606 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f400c0bb020 con 0x7f40100702c0 2024-09-13T06:09:20.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:20.728+0000 7f401872c640 1 -- 172.21.15.120:0/1715863606 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40100008e0 con 0x7f40100702c0 2024-09-13T06:09:20.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:20.728+0000 7f4006ffd640 1 --2- 172.21.15.120:0/1715863606 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3ff4035de0 0x7f3ff40382a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:20.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:20.728+0000 7f4006ffd640 1 -- 172.21.15.120:0/1715863606 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 3129+0+0 (secure 0 0 0) 0x7f400c0e2270 con 0x7f40100702c0 2024-09-13T06:09:20.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:20.728+0000 7f4015cc7640 1 --2- 172.21.15.120:0/1715863606 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3ff4035de0 0x7f3ff40382a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:20.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:20.732+0000 7f4015cc7640 1 --2- 172.21.15.120:0/1715863606 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3ff4035de0 0x7f3ff40382a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4000001610 tx=0x7f4000007ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:20.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:20.736+0000 7f4006ffd640 1 -- 172.21.15.120:0/1715863606 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f400c0c2030 con 0x7f40100702c0 2024-09-13T06:09:20.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:20.900+0000 7f401872c640 1 -- 172.21.15.120:0/1715863606 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7f4010074a40 con 0x7f40100702c0 2024-09-13T06:09:21.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:21.196+0000 7f4006ffd640 1 -- 172.21.15.120:0/1715863606 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v15) ==== 109+0+0 (secure 0 0 0) 0x7f4010125bf0 con 0x7f40100702c0 2024-09-13T06:09:21.195 INFO:teuthology.orchestra.run.smithi120.stderr:pool 'rbd' created 2024-09-13T06:09:21.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:21.200+0000 7f401872c640 1 -- 172.21.15.120:0/1715863606 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3ff4035de0 msgr2=0x7f3ff40382a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:21.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:21.200+0000 7f401872c640 1 --2- 172.21.15.120:0/1715863606 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3ff4035de0 0x7f3ff40382a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4000001610 tx=0x7f4000007ad0 comp rx=0 tx=0).stop 2024-09-13T06:09:21.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:21.200+0000 7f401872c640 1 -- 172.21.15.120:0/1715863606 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40100702c0 msgr2=0x7f4010129280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:21.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:21.200+0000 7f401872c640 1 --2- 172.21.15.120:0/1715863606 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40100702c0 0x7f4010129280 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f400c0ae040 tx=0x7f400c019080 comp rx=0 tx=0).stop 2024-09-13T06:09:21.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:21.200+0000 7f401872c640 1 -- 172.21.15.120:0/1715863606 shutdown_connections 2024-09-13T06:09:21.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:21.200+0000 7f401872c640 1 --2- 172.21.15.120:0/1715863606 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3ff4035de0 0x7f3ff40382a0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:21.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:21.200+0000 7f401872c640 1 --2- 172.21.15.120:0/1715863606 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40100702c0 0x7f4010129280 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:21.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:21.200+0000 7f401872c640 1 -- 172.21.15.120:0/1715863606 >> 172.21.15.120:0/1715863606 conn(0x7f401009a8a0 msgr2=0x7f401006d970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:21.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:21.200+0000 7f401872c640 1 -- 172.21.15.120:0/1715863606 shutdown_connections 2024-09-13T06:09:21.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:21.200+0000 7f401872c640 1 -- 172.21.15.120:0/1715863606 wait complete. 2024-09-13T06:09:21.221 DEBUG:teuthology.orchestra.run.smithi120:> rbd --cluster ceph pool init rbd 2024-09-13T06:09:21.278 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:09:21.278 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:09:21.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:21.280+0000 7f1bff892f80 1 Processor -- start 2024-09-13T06:09:21.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:21.280+0000 7f1bff892f80 1 -- start start 2024-09-13T06:09:21.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:21.280+0000 7f1bff892f80 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55d433905940 0x55d43399e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:21.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:21.280+0000 7f1bff892f80 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55d43378bea0 con 0x55d4338ec370 2024-09-13T06:09:21.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:21.280+0000 7f1bff892f80 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x55d433780e20 con 0x55d433905940 2024-09-13T06:09:21.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:21.280+0000 7f1bfe3a6640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x55d4338ec370 0x55d4338ec750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:52924/0 (socket says 172.21.15.120:52924) 2024-09-13T06:09:21.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:21.280+0000 7f1bfe3a6640 1 -- 172.21.15.120:0/4037302454 learned_addr learned my addr 172.21.15.120:0/4037302454 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-13T06:09:21.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:21.284+0000 7f1bfdba5640 1 --2- 172.21.15.120:0/4037302454 >> v2:172.21.15.120:3300/0 conn(0x55d433905940 0x55d43399e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:21.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:21.284+0000 7f1bfd3a4640 1 -- 172.21.15.120:0/4037302454 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2955175480 0 0) 0x55d43378bea0 con 0x55d4338ec370 2024-09-13T06:09:21.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:21.284+0000 7f1bfd3a4640 1 -- 172.21.15.120:0/4037302454 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1bec001e20 con 0x55d4338ec370 2024-09-13T06:09:21.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:21.284+0000 7f1bfdba5640 1 -- 172.21.15.120:0/4037302454 >> v1:172.21.15.120:6789/0 conn(0x55d4338ec370 legacy=0x55d4338ec750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:21.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:21.284+0000 7f1bfdba5640 1 -- 172.21.15.120:0/4037302454 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d433772180 con 0x55d433905940 2024-09-13T06:09:21.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:21.284+0000 7f1bfdba5640 1 --2- 172.21.15.120:0/4037302454 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d433905940 0x55d43399e540 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1be800a480 tx=0x7f1be801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85c3c45ed8157391 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:21.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:21.284+0000 7f1bfd3a4640 1 -- 172.21.15.120:0/4037302454 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1be80af070 con 0x55d433905940 2024-09-13T06:09:21.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:21.284+0000 7f1bfd3a4640 1 -- 172.21.15.120:0/4037302454 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1be80aa530 con 0x55d433905940 2024-09-13T06:09:21.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:21.284+0000 7f1bfd3a4640 1 -- 172.21.15.120:0/4037302454 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1be80aa830 con 0x55d433905940 2024-09-13T06:09:21.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:21.284+0000 7f1bff892f80 1 -- 172.21.15.120:0/4037302454 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d433905940 msgr2=0x55d43399e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:21.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:21.284+0000 7f1bff892f80 1 --2- 172.21.15.120:0/4037302454 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d433905940 0x55d43399e540 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1be800a480 tx=0x7f1be801b280 comp rx=0 tx=0).stop 2024-09-13T06:09:21.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:21.284+0000 7f1bff892f80 1 -- 172.21.15.120:0/4037302454 shutdown_connections 2024-09-13T06:09:21.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:21.284+0000 7f1bff892f80 1 --2- 172.21.15.120:0/4037302454 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d433905940 0x55d43399e540 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:21.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:21.284+0000 7f1bff892f80 1 -- 172.21.15.120:0/4037302454 >> 172.21.15.120:0/4037302454 conn(0x55d433908bf0 msgr2=0x55d433905030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:21.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:21.284+0000 7f1bff892f80 1 -- 172.21.15.120:0/4037302454 shutdown_connections 2024-09-13T06:09:21.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:21.284+0000 7f1bff892f80 1 -- 172.21.15.120:0/4037302454 wait complete. 2024-09-13T06:09:21.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:21.288+0000 7f1bff892f80 1 Processor -- start 2024-09-13T06:09:21.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:21.288+0000 7f1bff892f80 1 -- start start 2024-09-13T06:09:21.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:21.288+0000 7f1bff892f80 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d4338ec370 0x55d4339aafe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:21.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:21.288+0000 7f1bff892f80 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55d4337d7800 con 0x55d4338ec370 2024-09-13T06:09:21.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:21.288+0000 7f1bfe3a6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d4338ec370 0x55d4339aafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:21.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:21.288+0000 7f1bfe3a6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d4338ec370 0x55d4339aafe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56982/0 (socket says 172.21.15.120:56982) 2024-09-13T06:09:21.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:21.288+0000 7f1bfe3a6640 1 -- 172.21.15.120:0/615581240 learned_addr learned my addr 172.21.15.120:0/615581240 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-13T06:09:21.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:21.288+0000 7f1bfe3a6640 1 -- 172.21.15.120:0/615581240 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d43375c990 con 0x55d4338ec370 2024-09-13T06:09:21.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:21.288+0000 7f1bfe3a6640 1 --2- 172.21.15.120:0/615581240 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d4338ec370 0x55d4339aafe0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1bf000bdf0 tx=0x7f1bf0009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:21.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:21.288+0000 7f1bf67fc640 1 -- 172.21.15.120:0/615581240 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bf0012070 con 0x55d4338ec370 2024-09-13T06:09:21.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:21.288+0000 7f1bf67fc640 1 -- 172.21.15.120:0/615581240 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bf000e5b0 con 0x55d4338ec370 2024-09-13T06:09:21.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:21.288+0000 7f1bf67fc640 1 -- 172.21.15.120:0/615581240 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bf000e8b0 con 0x55d4338ec370 2024-09-13T06:09:21.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:21.288+0000 7f1bff892f80 1 -- 172.21.15.120:0/615581240 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d4339aabd0 con 0x55d4338ec370 2024-09-13T06:09:21.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:21.288+0000 7f1bff892f80 1 -- 172.21.15.120:0/615581240 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d433997e30 con 0x55d4338ec370 2024-09-13T06:09:21.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:21.288+0000 7f1bf67fc640 1 -- 172.21.15.120:0/615581240 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1bf0015070 con 0x55d4338ec370 2024-09-13T06:09:21.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:21.288+0000 7f1bf67fc640 1 --2- 172.21.15.120:0/615581240 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f1be00346a0 0x7f1be0036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:21.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:21.292+0000 7f1bf67fc640 1 -- 172.21.15.120:0/615581240 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3471+0+0 (secure 0 0 0) 0x7f1bf0005050 con 0x55d4338ec370 2024-09-13T06:09:21.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:21.292+0000 7f1bff892f80 1 -- 172.21.15.120:0/615581240 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) -- 0x55d4339899b0 con 0x55d4338ec370 2024-09-13T06:09:21.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:21.292+0000 7f1bfdba5640 1 --2- 172.21.15.120:0/615581240 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f1be00346a0 0x7f1be0036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:21.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:21.292+0000 7f1bfdba5640 1 --2- 172.21.15.120:0/615581240 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f1be00346a0 0x7f1be0036b60 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1be80ac000 tx=0x7f1be80a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:22.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:22.200+0000 7f1bf67fc640 1 -- 172.21.15.120:0/615581240 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v16) ==== 141+0+0 (secure 0 0 0) 0x55d4339aabd0 con 0x55d4338ec370 2024-09-13T06:09:22.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:22.200+0000 7f1bff892f80 1 -- 172.21.15.120:0/615581240 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1be80aa530 con 0x55d4338ec370 2024-09-13T06:09:22.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:22.208+0000 7f1bf67fc640 1 -- 172.21.15.120:0/615581240 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f1bf0016780 con 0x55d4338ec370 2024-09-13T06:09:22.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:22.208+0000 7f1bfcba3640 1 -- 172.21.15.120:0/615581240 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=16}) -- 0x7f1be4002af0 con 0x55d4338ec370 2024-09-13T06:09:22.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:22.208+0000 7f1bf67fc640 1 -- 172.21.15.120:0/615581240 <== mon.0 v2:172.21.15.120:3300/0 8 ==== osd_map(16..16 src has 1..16) ==== 650+0+0 (secure 0 0 0) 0x7f1bf0036e00 con 0x55d4338ec370 2024-09-13T06:09:22.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:22.208+0000 7f1bff892f80 1 --2- 172.21.15.120:0/615581240 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55d433905940 0x55d433986c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:22.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:22.208+0000 7f1bff892f80 1 -- 172.21.15.120:0/615581240 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16) -- 0x55d4339afc50 con 0x55d433905940 2024-09-13T06:09:22.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:22.208+0000 7f1bff608640 1 --2- 172.21.15.120:0/615581240 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55d433905940 0x55d433986c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:22.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:22.208+0000 7f1bff608640 1 --2- 172.21.15.120:0/615581240 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55d433905940 0x55d433986c80 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:22.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:22.224+0000 7f1bff608640 1 -- 172.21.15.120:0/615581240 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(1 rbd_trash [create] v16'1 uv1 ondisk = 0) ==== 153+0+0 (crc 0 0 0) 0x7f1bf800a4d0 con 0x55d433905940 2024-09-13T06:09:22.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:22.228+0000 7f1bff892f80 1 -- 172.21.15.120:0/615581240 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e16) -- 0x55d433a01500 con 0x55d433905940 2024-09-13T06:09:22.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:22.228+0000 7f1bff608640 1 -- 172.21.15.120:0/615581240 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1bf800a4d0 con 0x55d433905940 2024-09-13T06:09:22.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:22.228+0000 7f1bff892f80 1 -- 172.21.15.120:0/615581240 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e16) -- 0x55d433a00610 con 0x55d433905940 2024-09-13T06:09:22.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:22.228+0000 7f1bff608640 1 -- 172.21.15.120:0/615581240 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f1bf800a4d0 con 0x55d433905940 2024-09-13T06:09:22.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:22.228+0000 7f1bf7fff640 1 -- 172.21.15.120:0/615581240 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- pool_op(create unmanaged snap pool 2 tid 4 name v0) -- 0x7f1bd8001f10 con 0x55d4338ec370 2024-09-13T06:09:23.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:23.208+0000 7f1bf67fc640 1 -- 172.21.15.120:0/615581240 <== mon.0 v2:172.21.15.120:3300/0 9 ==== pool_op_reply(tid 4 (0) Success v17) ==== 55+0+0 (secure 0 0 0) 0x7f1bf000d7e0 con 0x55d4338ec370 2024-09-13T06:09:23.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:23.208+0000 7f1bf67fc640 1 -- 172.21.15.120:0/615581240 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=17}) -- 0x7f1be003a1a0 con 0x55d4338ec370 2024-09-13T06:09:23.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:23.208+0000 7f1bf67fc640 1 -- 172.21.15.120:0/615581240 <== mon.0 v2:172.21.15.120:3300/0 10 ==== osd_map(17..17 src has 1..17) ==== 626+0+0 (secure 0 0 0) 0x7f1bf0016bb0 con 0x55d4338ec370 2024-09-13T06:09:23.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:23.212+0000 7f1bfcba3640 1 -- 172.21.15.120:0/615581240 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17) -- 0x7f1be40056b0 con 0x55d433905940 2024-09-13T06:09:23.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:23.216+0000 7f1bff608640 1 -- 172.21.15.120:0/615581240 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(5 rbd_info [create,write 0~8] v17'1 uv1 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f1bf800a4d0 con 0x55d433905940 2024-09-13T06:09:23.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:23.216+0000 7f1bf7fff640 1 -- 172.21.15.120:0/615581240 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- pool_op(delete unmanaged snap pool 2 tid 6 name v17) -- 0x7f1bd8003360 con 0x55d4338ec370 2024-09-13T06:09:24.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.216+0000 7f1bf67fc640 1 -- 172.21.15.120:0/615581240 <== mon.0 v2:172.21.15.120:3300/0 11 ==== pool_op_reply(tid 6 (0) Success v18) ==== 43+0+0 (secure 0 0 0) 0x7f1bf0016db0 con 0x55d4338ec370 2024-09-13T06:09:24.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.216+0000 7f1bf67fc640 1 -- 172.21.15.120:0/615581240 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=18}) -- 0x7f1be003a420 con 0x55d4338ec370 2024-09-13T06:09:24.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.216+0000 7f1bf67fc640 1 -- 172.21.15.120:0/615581240 <== mon.0 v2:172.21.15.120:3300/0 12 ==== osd_map(18..18 src has 1..18) ==== 654+0+0 (secure 0 0 0) 0x7f1bf002f070 con 0x55d4338ec370 2024-09-13T06:09:24.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.216+0000 7f1bfcba3640 1 -- 172.21.15.120:0/615581240 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18) -- 0x7f1be4005a50 con 0x55d433905940 2024-09-13T06:09:24.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.224+0000 7f1bff608640 1 -- 172.21.15.120:0/615581240 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(7 rbd_info [write 0~19] v18'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bf800a4d0 con 0x55d433905940 2024-09-13T06:09:24.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.224+0000 7f1bff892f80 1 -- 172.21.15.120:0/615581240 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55d433905940 msgr2=0x55d433986c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:24.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.224+0000 7f1bff892f80 1 --2- 172.21.15.120:0/615581240 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55d433905940 0x55d433986c80 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:24.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.224+0000 7f1bff892f80 1 -- 172.21.15.120:0/615581240 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f1be00346a0 msgr2=0x7f1be0036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:24.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.224+0000 7f1bff892f80 1 --2- 172.21.15.120:0/615581240 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f1be00346a0 0x7f1be0036b60 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1be80ac000 tx=0x7f1be80a5000 comp rx=0 tx=0).stop 2024-09-13T06:09:24.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.224+0000 7f1bff892f80 1 -- 172.21.15.120:0/615581240 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d4338ec370 msgr2=0x55d4339aafe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:24.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.224+0000 7f1bff892f80 1 --2- 172.21.15.120:0/615581240 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d4338ec370 0x55d4339aafe0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1bf000bdf0 tx=0x7f1bf0009650 comp rx=0 tx=0).stop 2024-09-13T06:09:24.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.224+0000 7f1bff892f80 1 -- 172.21.15.120:0/615581240 shutdown_connections 2024-09-13T06:09:24.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.224+0000 7f1bff892f80 1 --2- 172.21.15.120:0/615581240 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55d433905940 0x55d433986c80 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:24.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.224+0000 7f1bff892f80 1 --2- 172.21.15.120:0/615581240 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f1be00346a0 0x7f1be0036b60 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:24.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.224+0000 7f1bff892f80 1 --2- 172.21.15.120:0/615581240 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d4338ec370 0x55d4339aafe0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:24.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.224+0000 7f1bff892f80 1 -- 172.21.15.120:0/615581240 >> 172.21.15.120:0/615581240 conn(0x55d433908bf0 msgr2=0x55d43399b450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:24.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.224+0000 7f1bff892f80 1 -- 172.21.15.120:0/615581240 shutdown_connections 2024-09-13T06:09:24.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.224+0000 7f1bff892f80 1 -- 172.21.15.120:0/615581240 wait complete. 2024-09-13T06:09:24.230 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-13T06:09:24.231 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-13T06:09:24.231 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-13T06:09:24.231 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-13T06:09:24.231 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-13T06:09:24.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.360+0000 7fed07830640 1 Processor -- start 2024-09-13T06:09:24.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.360+0000 7fed07830640 1 -- start start 2024-09-13T06:09:24.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.360+0000 7fed07830640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fed0006f190 0x7fed00072b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:24.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.360+0000 7fed07830640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed0006fa30 con 0x7fed00072760 2024-09-13T06:09:24.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.360+0000 7fed07830640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fed0006e800 con 0x7fed0006f190 2024-09-13T06:09:24.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.360+0000 7fed04dcb640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fed0006f190 0x7fed00072b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:24.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.360+0000 7fed055cc640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fed00072760 0x7fed0006d0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:38336/0 (socket says 172.21.15.120:38336) 2024-09-13T06:09:24.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.364+0000 7fed055cc640 1 -- 172.21.15.120:0/1317668708 learned_addr learned my addr 172.21.15.120:0/1317668708 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-13T06:09:24.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.364+0000 7fed04dcb640 1 -- 172.21.15.120:0/1317668708 >> v1:172.21.15.120:6789/0 conn(0x7fed00072760 legacy=0x7fed0006d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:24.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.364+0000 7fed04dcb640 1 -- 172.21.15.120:0/1317668708 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed0006fd40 con 0x7fed0006f190 2024-09-13T06:09:24.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.364+0000 7fed04dcb640 1 --2- 172.21.15.120:0/1317668708 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fed0006f190 0x7fed00072b40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fecfc009740 tx=0x7fecfc01c200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f2a25e1f392f121 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:24.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.364+0000 7fecf7fff640 1 -- 172.21.15.120:0/1317668708 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecfc0b0070 con 0x7fed0006f190 2024-09-13T06:09:24.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.364+0000 7fecf7fff640 1 -- 172.21.15.120:0/1317668708 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecfc0ab530 con 0x7fed0006f190 2024-09-13T06:09:24.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.364+0000 7fecf7fff640 1 -- 172.21.15.120:0/1317668708 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecfc0ab830 con 0x7fed0006f190 2024-09-13T06:09:24.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.364+0000 7fed07830640 1 -- 172.21.15.120:0/1317668708 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fed0006f190 msgr2=0x7fed00072b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:24.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.364+0000 7fed07830640 1 --2- 172.21.15.120:0/1317668708 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fed0006f190 0x7fed00072b40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fecfc009740 tx=0x7fecfc01c200 comp rx=0 tx=0).stop 2024-09-13T06:09:24.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.364+0000 7fed07830640 1 -- 172.21.15.120:0/1317668708 shutdown_connections 2024-09-13T06:09:24.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.364+0000 7fed07830640 1 --2- 172.21.15.120:0/1317668708 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fed0006f190 0x7fed00072b40 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:24.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.364+0000 7fed07830640 1 -- 172.21.15.120:0/1317668708 >> 172.21.15.120:0/1317668708 conn(0x7fed00099a50 msgr2=0x7fed000972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:24.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.364+0000 7fed07830640 1 -- 172.21.15.120:0/1317668708 shutdown_connections 2024-09-13T06:09:24.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.364+0000 7fed07830640 1 -- 172.21.15.120:0/1317668708 wait complete. 2024-09-13T06:09:24.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.368+0000 7fed07830640 1 Processor -- start 2024-09-13T06:09:24.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.368+0000 7fed07830640 1 -- start start 2024-09-13T06:09:24.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.368+0000 7fed07830640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fed0006f190 0x7fed00121e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:24.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.368+0000 7fed07830640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fed00137620 con 0x7fed0006f190 2024-09-13T06:09:24.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.368+0000 7fed055cc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fed0006f190 0x7fed00121e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:24.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.368+0000 7fed055cc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fed0006f190 0x7fed00121e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43406/0 (socket says 172.21.15.120:43406) 2024-09-13T06:09:24.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.368+0000 7fed055cc640 1 -- 172.21.15.120:0/832874029 learned_addr learned my addr 172.21.15.120:0/832874029 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-13T06:09:24.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.368+0000 7fed055cc640 1 -- 172.21.15.120:0/832874029 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed00125370 con 0x7fed0006f190 2024-09-13T06:09:24.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.368+0000 7fed055cc640 1 --2- 172.21.15.120:0/832874029 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fed0006f190 0x7fed00121e80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fecf000c700 tx=0x7fecf000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:24.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.368+0000 7fecf5ffb640 1 -- 172.21.15.120:0/832874029 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecf0017070 con 0x7fed0006f190 2024-09-13T06:09:24.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.368+0000 7fecf5ffb640 1 -- 172.21.15.120:0/832874029 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecf0005a10 con 0x7fed0006f190 2024-09-13T06:09:24.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.368+0000 7fecf5ffb640 1 -- 172.21.15.120:0/832874029 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecf0005d30 con 0x7fed0006f190 2024-09-13T06:09:24.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.368+0000 7fed07830640 1 -- 172.21.15.120:0/832874029 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed00132980 con 0x7fed0006f190 2024-09-13T06:09:24.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.368+0000 7fed07830640 1 -- 172.21.15.120:0/832874029 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed001223c0 con 0x7fed0006f190 2024-09-13T06:09:24.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.368+0000 7fecf5ffb640 1 -- 172.21.15.120:0/832874029 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fecf001a070 con 0x7fed0006f190 2024-09-13T06:09:24.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.368+0000 7fed07830640 1 -- 172.21.15.120:0/832874029 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed00073790 con 0x7fed0006f190 2024-09-13T06:09:24.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.368+0000 7fecf5ffb640 1 --2- 172.21.15.120:0/832874029 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fece4035db0 0x7fece4038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:24.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.368+0000 7fecf5ffb640 1 -- 172.21.15.120:0/832874029 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7fecf0047ba0 con 0x7fed0006f190 2024-09-13T06:09:24.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.368+0000 7fed04dcb640 1 --2- 172.21.15.120:0/832874029 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fece4035db0 0x7fece4038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:24.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.368+0000 7fed04dcb640 1 --2- 172.21.15.120:0/832874029 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fece4035db0 0x7fece4038270 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fecfc0ad000 tx=0x7fecfc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:24.372 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.372+0000 7fecf5ffb640 1 -- 172.21.15.120:0/832874029 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fecf000a980 con 0x7fed0006f190 2024-09-13T06:09:24.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.576+0000 7fed07830640 1 -- 172.21.15.120:0/832874029 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fed00123690 con 0x7fed0006f190 2024-09-13T06:09:24.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.580+0000 7fecf5ffb640 1 -- 172.21.15.120:0/832874029 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+84181 (secure 0 0 0) 0x7fecf00358f0 con 0x7fed0006f190 2024-09-13T06:09:24.580 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T06:09:24.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.584+0000 7fed07830640 1 -- 172.21.15.120:0/832874029 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fece4035db0 msgr2=0x7fece4038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:24.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.584+0000 7fed07830640 1 --2- 172.21.15.120:0/832874029 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fece4035db0 0x7fece4038270 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fecfc0ad000 tx=0x7fecfc008040 comp rx=0 tx=0).stop 2024-09-13T06:09:24.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.584+0000 7fed07830640 1 -- 172.21.15.120:0/832874029 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fed0006f190 msgr2=0x7fed00121e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:24.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.584+0000 7fed07830640 1 --2- 172.21.15.120:0/832874029 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fed0006f190 0x7fed00121e80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fecf000c700 tx=0x7fecf000cbc0 comp rx=0 tx=0).stop 2024-09-13T06:09:24.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.584+0000 7fed07830640 1 -- 172.21.15.120:0/832874029 shutdown_connections 2024-09-13T06:09:24.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.584+0000 7fed07830640 1 --2- 172.21.15.120:0/832874029 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fece4035db0 0x7fece4038270 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:24.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.584+0000 7fed07830640 1 --2- 172.21.15.120:0/832874029 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fed0006f190 0x7fed00121e80 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:24.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.584+0000 7fed07830640 1 -- 172.21.15.120:0/832874029 >> 172.21.15.120:0/832874029 conn(0x7fed00099a50 msgr2=0x7fed000703f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:24.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.584+0000 7fed07830640 1 -- 172.21.15.120:0/832874029 shutdown_connections 2024-09-13T06:09:24.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.584+0000 7fed07830640 1 -- 172.21.15.120:0/832874029 wait complete. 2024-09-13T06:09:24.598 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":3475680902},{"type":"v1","addr":"172.21.15.194:6825","nonce":3475680902}]},"active_addr":"172.21.15.194:6825/3475680902","active_change":"2024-09-13T06:09:09.688975+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.194:0","nonce":3120322896}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.194:0","nonce":1984807499}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.194:0","nonce":3148678535}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.194:0","nonce":4271683317}]}]} 2024-09-13T06:09:24.601 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-13T06:09:24.601 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-13T06:09:24.601 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T06:09:24.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.716+0000 7f3f27384640 1 Processor -- start 2024-09-13T06:09:24.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.716+0000 7f3f27384640 1 -- start start 2024-09-13T06:09:24.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.716+0000 7f3f27384640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f3f2006d0e0 0x7f3f2006d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:24.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.716+0000 7f3f27384640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f20071c10 con 0x7f3f2006da00 2024-09-13T06:09:24.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.716+0000 7f3f27384640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f3f20072230 con 0x7f3f2006d0e0 2024-09-13T06:09:24.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.716+0000 7f3f25120640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f3f2006d0e0 0x7f3f2006d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:24.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.716+0000 7f3f2491f640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f3f2006da00 0x7f3f2012ca10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:38350/0 (socket says 172.21.15.120:38350) 2024-09-13T06:09:24.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.716+0000 7f3f25120640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f3f2006d0e0 0x7f3f2006d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43420/0 (socket says 172.21.15.120:43420) 2024-09-13T06:09:24.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.716+0000 7f3f2491f640 1 -- 172.21.15.120:0/2132531528 learned_addr learned my addr 172.21.15.120:0/2132531528 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-13T06:09:24.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.716+0000 7f3f25120640 1 -- 172.21.15.120:0/2132531528 >> v1:172.21.15.120:6789/0 conn(0x7f3f2006da00 legacy=0x7f3f2012ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:24.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.716+0000 7f3f25120640 1 -- 172.21.15.120:0/2132531528 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f200709e0 con 0x7f3f2006d0e0 2024-09-13T06:09:24.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.716+0000 7f3f17fff640 1 -- 172.21.15.120:0/2132531528 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2722392497 0 0) 0x7f3f20071c10 con 0x7f3f2006da00 2024-09-13T06:09:24.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.720+0000 7f3f25120640 1 --2- 172.21.15.120:0/2132531528 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f2006d0e0 0x7f3f2006d4c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c009740 tx=0x7f3f1c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6e284532733715d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:24.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.720+0000 7f3f17fff640 1 -- 172.21.15.120:0/2132531528 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f1c0b0070 con 0x7f3f2006d0e0 2024-09-13T06:09:24.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.720+0000 7f3f17fff640 1 -- 172.21.15.120:0/2132531528 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f1c0ab530 con 0x7f3f2006d0e0 2024-09-13T06:09:24.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.720+0000 7f3f17fff640 1 -- 172.21.15.120:0/2132531528 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f1c0ab830 con 0x7f3f2006d0e0 2024-09-13T06:09:24.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.720+0000 7f3f27384640 1 -- 172.21.15.120:0/2132531528 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f2006d0e0 msgr2=0x7f3f2006d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:24.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.720+0000 7f3f27384640 1 --2- 172.21.15.120:0/2132531528 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f2006d0e0 0x7f3f2006d4c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c009740 tx=0x7f3f1c01c370 comp rx=0 tx=0).stop 2024-09-13T06:09:24.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.720+0000 7f3f27384640 1 -- 172.21.15.120:0/2132531528 shutdown_connections 2024-09-13T06:09:24.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.720+0000 7f3f27384640 1 --2- 172.21.15.120:0/2132531528 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f2006d0e0 0x7f3f2006d4c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:24.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.720+0000 7f3f27384640 1 -- 172.21.15.120:0/2132531528 >> 172.21.15.120:0/2132531528 conn(0x7f3f20099a50 msgr2=0x7f3f200972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:24.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.720+0000 7f3f27384640 1 -- 172.21.15.120:0/2132531528 shutdown_connections 2024-09-13T06:09:24.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.720+0000 7f3f27384640 1 -- 172.21.15.120:0/2132531528 wait complete. 2024-09-13T06:09:24.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.720+0000 7f3f27384640 1 Processor -- start 2024-09-13T06:09:24.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.720+0000 7f3f27384640 1 -- start start 2024-09-13T06:09:24.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.720+0000 7f3f27384640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f2006d0e0 0x7f3f201279b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:24.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.720+0000 7f3f27384640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f3f20134e80 con 0x7f3f2006d0e0 2024-09-13T06:09:24.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.724+0000 7f3f25120640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f2006d0e0 0x7f3f201279b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:24.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.724+0000 7f3f25120640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f2006d0e0 0x7f3f201279b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43432/0 (socket says 172.21.15.120:43432) 2024-09-13T06:09:24.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.724+0000 7f3f25120640 1 -- 172.21.15.120:0/2230570989 learned_addr learned my addr 172.21.15.120:0/2230570989 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-13T06:09:24.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.724+0000 7f3f25120640 1 -- 172.21.15.120:0/2230570989 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f20129e40 con 0x7f3f2006d0e0 2024-09-13T06:09:24.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.724+0000 7f3f25120640 1 --2- 172.21.15.120:0/2230570989 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f2006d0e0 0x7f3f201279b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c019fa0 tx=0x7f3f1c01abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:24.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.724+0000 7f3f15ffb640 1 -- 172.21.15.120:0/2230570989 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f1c0b0050 con 0x7f3f2006d0e0 2024-09-13T06:09:24.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.724+0000 7f3f15ffb640 1 -- 172.21.15.120:0/2230570989 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f1c0b1040 con 0x7f3f2006d0e0 2024-09-13T06:09:24.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.724+0000 7f3f27384640 1 -- 172.21.15.120:0/2230570989 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f20072710 con 0x7f3f2006d0e0 2024-09-13T06:09:24.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.724+0000 7f3f15ffb640 1 -- 172.21.15.120:0/2230570989 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f1c0b5740 con 0x7f3f2006d0e0 2024-09-13T06:09:24.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.724+0000 7f3f27384640 1 -- 172.21.15.120:0/2230570989 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f2012a4d0 con 0x7f3f2006d0e0 2024-09-13T06:09:24.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.724+0000 7f3f15ffb640 1 -- 172.21.15.120:0/2230570989 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3f1c0be030 con 0x7f3f2006d0e0 2024-09-13T06:09:24.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.724+0000 7f3f15ffb640 1 --2- 172.21.15.120:0/2230570989 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3f04035db0 0x7f3f04038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:24.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.724+0000 7f3f15ffb640 1 -- 172.21.15.120:0/2230570989 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f3f1c0bc070 con 0x7f3f2006d0e0 2024-09-13T06:09:24.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.724+0000 7f3f27384640 1 -- 172.21.15.120:0/2230570989 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f2006d4c0 con 0x7f3f2006d0e0 2024-09-13T06:09:24.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.724+0000 7f3f2491f640 1 --2- 172.21.15.120:0/2230570989 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3f04035db0 0x7f3f04038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:24.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.724+0000 7f3f2491f640 1 --2- 172.21.15.120:0/2230570989 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3f04035db0 0x7f3f04038270 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3f10007fd0 tx=0x7f3f10007980 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:24.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.728+0000 7f3f15ffb640 1 -- 172.21.15.120:0/2230570989 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3f1c0c5020 con 0x7f3f2006d0e0 2024-09-13T06:09:24.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.892+0000 7f3f27384640 1 -- 172.21.15.120:0/2230570989 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3f20073790 con 0x7f3f2006d0e0 2024-09-13T06:09:24.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.892+0000 7f3f15ffb640 1 -- 172.21.15.120:0/2230570989 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+9890 (secure 0 0 0) 0x7f3f1c015ff0 con 0x7f3f2006d0e0 2024-09-13T06:09:24.891 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T06:09:24.891 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":18,"fsid":"b924da04-5ce7-4b88-90c8-d1e25fda89f0","created":"2024-09-13T06:09:05.102460+0000","modified":"2024-09-13T06:09:24.209984+0000","last_up_change":"2024-09-13T06:09:17.161802+0000","last_in_change":"2024-09-13T06:09:06.306194+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T06:09:17.772771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-13T06:09:20.938823+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":18,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d4134f4-6b9e-4fcd-bf7c-0938458a015f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1923744619},{"type":"v1","addr":"172.21.15.120:6801","nonce":1923744619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1923744619},{"type":"v1","addr":"172.21.15.120:6803","nonce":1923744619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1923744619},{"type":"v1","addr":"172.21.15.120:6807","nonce":1923744619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1923744619},{"type":"v1","addr":"172.21.15.120:6805","nonce":1923744619}]},"public_addr":"172.21.15.120:6801/1923744619","cluster_addr":"172.21.15.120:6803/1923744619","heartbeat_back_addr":"172.21.15.120:6807/1923744619","heartbeat_front_addr":"172.21.15.120:6805/1923744619","state":["exists","up"]},{"osd":1,"uuid":"aca83f02-0827-44d8-b4b9-2480cce86270","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3135444559},{"type":"v1","addr":"172.21.15.194:6809","nonce":3135444559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3135444559},{"type":"v1","addr":"172.21.15.194:6811","nonce":3135444559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3135444559},{"type":"v1","addr":"172.21.15.194:6815","nonce":3135444559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3135444559},{"type":"v1","addr":"172.21.15.194:6813","nonce":3135444559}]},"public_addr":"172.21.15.194:6809/3135444559","cluster_addr":"172.21.15.194:6811/3135444559","heartbeat_back_addr":"172.21.15.194:6815/3135444559","heartbeat_front_addr":"172.21.15.194:6813/3135444559","state":["exists","up"]},{"osd":2,"uuid":"2e1a73a0-26b9-4247-acbb-15ccd2478adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":815615585},{"type":"v1","addr":"172.21.15.194:6801","nonce":815615585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":815615585},{"type":"v1","addr":"172.21.15.194:6803","nonce":815615585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":815615585},{"type":"v1","addr":"172.21.15.194:6807","nonce":815615585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":815615585},{"type":"v1","addr":"172.21.15.194:6805","nonce":815615585}]},"public_addr":"172.21.15.194:6801/815615585","cluster_addr":"172.21.15.194:6803/815615585","heartbeat_back_addr":"172.21.15.194:6807/815615585","heartbeat_front_addr":"172.21.15.194:6805/815615585","state":["exists","up"]},{"osd":3,"uuid":"afca1e17-ff25-4f0e-9639-a9a06385b8c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":96632515},{"type":"v1","addr":"172.21.15.194:6817","nonce":96632515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":96632515},{"type":"v1","addr":"172.21.15.194:6819","nonce":96632515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":96632515},{"type":"v1","addr":"172.21.15.194:6823","nonce":96632515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":96632515},{"type":"v1","addr":"172.21.15.194:6821","nonce":96632515}]},"public_addr":"172.21.15.194:6817/96632515","cluster_addr":"172.21.15.194:6819/96632515","heartbeat_back_addr":"172.21.15.194:6823/96632515","heartbeat_front_addr":"172.21.15.194:6821/96632515","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:09:13.701094+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:09:13.837131+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:09:13.550343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:09:14.173040+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T06:09:24.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.892+0000 7f3f27384640 1 -- 172.21.15.120:0/2230570989 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3f04035db0 msgr2=0x7f3f04038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:24.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.892+0000 7f3f27384640 1 --2- 172.21.15.120:0/2230570989 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3f04035db0 0x7f3f04038270 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3f10007fd0 tx=0x7f3f10007980 comp rx=0 tx=0).stop 2024-09-13T06:09:24.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.892+0000 7f3f27384640 1 -- 172.21.15.120:0/2230570989 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f2006d0e0 msgr2=0x7f3f201279b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:24.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.892+0000 7f3f27384640 1 --2- 172.21.15.120:0/2230570989 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f2006d0e0 0x7f3f201279b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c019fa0 tx=0x7f3f1c01abb0 comp rx=0 tx=0).stop 2024-09-13T06:09:24.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.896+0000 7f3f27384640 1 -- 172.21.15.120:0/2230570989 shutdown_connections 2024-09-13T06:09:24.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.896+0000 7f3f27384640 1 --2- 172.21.15.120:0/2230570989 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3f04035db0 0x7f3f04038270 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:24.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.896+0000 7f3f27384640 1 --2- 172.21.15.120:0/2230570989 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f2006d0e0 0x7f3f201279b0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:24.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.896+0000 7f3f27384640 1 -- 172.21.15.120:0/2230570989 >> 172.21.15.120:0/2230570989 conn(0x7f3f20099a50 msgr2=0x7f3f20131c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:24.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.896+0000 7f3f27384640 1 -- 172.21.15.120:0/2230570989 shutdown_connections 2024-09-13T06:09:24.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:24.896+0000 7f3f27384640 1 -- 172.21.15.120:0/2230570989 wait complete. 2024-09-13T06:09:24.908 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-13T06:09:24.909 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T06:09:25.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.028+0000 7f1874a37640 1 Processor -- start 2024-09-13T06:09:25.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.028+0000 7f1874a37640 1 -- start start 2024-09-13T06:09:25.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.032+0000 7f1874a37640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f187006dbd0 0x7f1870131e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:25.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.032+0000 7f1874a37640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1870071c10 con 0x7f187006d0e0 2024-09-13T06:09:25.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.032+0000 7f1874a37640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f1870072230 con 0x7f187006dbd0 2024-09-13T06:09:25.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.032+0000 7f186dd9b640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f187006dbd0 0x7f1870131e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:25.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.032+0000 7f186e59c640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f187006d0e0 0x7f187006d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:38362/0 (socket says 172.21.15.120:38362) 2024-09-13T06:09:25.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.032+0000 7f186e59c640 1 -- 172.21.15.120:0/452187190 learned_addr learned my addr 172.21.15.120:0/452187190 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-13T06:09:25.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.032+0000 7f186d59a640 1 -- 172.21.15.120:0/452187190 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3091644742 0 0) 0x7f1870071c10 con 0x7f187006d0e0 2024-09-13T06:09:25.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.032+0000 7f186d59a640 1 -- 172.21.15.120:0/452187190 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f185c003530 con 0x7f187006d0e0 2024-09-13T06:09:25.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.032+0000 7f186dd9b640 1 -- 172.21.15.120:0/452187190 >> v1:172.21.15.120:6789/0 conn(0x7f187006d0e0 legacy=0x7f187006d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:25.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.032+0000 7f186dd9b640 1 -- 172.21.15.120:0/452187190 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18700709e0 con 0x7f187006dbd0 2024-09-13T06:09:25.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.032+0000 7f186dd9b640 1 --2- 172.21.15.120:0/452187190 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f187006dbd0 0x7f1870131e60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1858009740 tx=0x7f185801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fea779dd4fd221f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:25.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.032+0000 7f186d59a640 1 -- 172.21.15.120:0/452187190 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18580b0070 con 0x7f187006dbd0 2024-09-13T06:09:25.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.032+0000 7f186d59a640 1 -- 172.21.15.120:0/452187190 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18580ab530 con 0x7f187006dbd0 2024-09-13T06:09:25.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.032+0000 7f186d59a640 1 -- 172.21.15.120:0/452187190 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18580ab810 con 0x7f187006dbd0 2024-09-13T06:09:25.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.032+0000 7f1874a37640 1 -- 172.21.15.120:0/452187190 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f187006dbd0 msgr2=0x7f1870131e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:25.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.032+0000 7f1874a37640 1 --2- 172.21.15.120:0/452187190 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f187006dbd0 0x7f1870131e60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1858009740 tx=0x7f185801c370 comp rx=0 tx=0).stop 2024-09-13T06:09:25.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.032+0000 7f1874a37640 1 -- 172.21.15.120:0/452187190 shutdown_connections 2024-09-13T06:09:25.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.032+0000 7f1874a37640 1 --2- 172.21.15.120:0/452187190 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f187006dbd0 0x7f1870131e60 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:25.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.032+0000 7f1874a37640 1 -- 172.21.15.120:0/452187190 >> 172.21.15.120:0/452187190 conn(0x7f1870099a50 msgr2=0x7f18700972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:25.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.032+0000 7f1874a37640 1 -- 172.21.15.120:0/452187190 shutdown_connections 2024-09-13T06:09:25.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.032+0000 7f1874a37640 1 -- 172.21.15.120:0/452187190 wait complete. 2024-09-13T06:09:25.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.036+0000 7f1874a37640 1 Processor -- start 2024-09-13T06:09:25.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.036+0000 7f1874a37640 1 -- start start 2024-09-13T06:09:25.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.036+0000 7f1874a37640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f187006d0e0 0x7f1870092130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:25.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.036+0000 7f1874a37640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f1870134d40 con 0x7f187006d0e0 2024-09-13T06:09:25.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.036+0000 7f186e59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f187006d0e0 0x7f1870092130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:25.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.036+0000 7f186e59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f187006d0e0 0x7f1870092130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43446/0 (socket says 172.21.15.120:43446) 2024-09-13T06:09:25.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.036+0000 7f186e59c640 1 -- 172.21.15.120:0/38575500 learned_addr learned my addr 172.21.15.120:0/38575500 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-13T06:09:25.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.036+0000 7f186e59c640 1 -- 172.21.15.120:0/38575500 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1870093a50 con 0x7f187006d0e0 2024-09-13T06:09:25.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.036+0000 7f186e59c640 1 --2- 172.21.15.120:0/38575500 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f187006d0e0 0x7f1870092130 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f186000c3d0 tx=0x7f186000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:25.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.036+0000 7f1866ffd640 1 -- 172.21.15.120:0/38575500 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1860017070 con 0x7f187006d0e0 2024-09-13T06:09:25.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.036+0000 7f1866ffd640 1 -- 172.21.15.120:0/38575500 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1860005ce0 con 0x7f187006d0e0 2024-09-13T06:09:25.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.036+0000 7f1874a37640 1 -- 172.21.15.120:0/38575500 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1870095730 con 0x7f187006d0e0 2024-09-13T06:09:25.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.036+0000 7f1866ffd640 1 -- 172.21.15.120:0/38575500 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18600070d0 con 0x7f187006d0e0 2024-09-13T06:09:25.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.036+0000 7f1874a37640 1 -- 172.21.15.120:0/38575500 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1870094b80 con 0x7f187006d0e0 2024-09-13T06:09:25.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.036+0000 7f1866ffd640 1 -- 172.21.15.120:0/38575500 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f186001a070 con 0x7f187006d0e0 2024-09-13T06:09:25.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.036+0000 7f1874a37640 1 -- 172.21.15.120:0/38575500 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1870096a80 con 0x7f187006d0e0 2024-09-13T06:09:25.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.036+0000 7f1866ffd640 1 --2- 172.21.15.120:0/38575500 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f1850035db0 0x7f1850038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:25.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.036+0000 7f1866ffd640 1 -- 172.21.15.120:0/38575500 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f1860047ae0 con 0x7f187006d0e0 2024-09-13T06:09:25.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.036+0000 7f186dd9b640 1 --2- 172.21.15.120:0/38575500 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f1850035db0 0x7f1850038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:25.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.040+0000 7f186dd9b640 1 --2- 172.21.15.120:0/38575500 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f1850035db0 0x7f1850038270 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f18580ad000 tx=0x7f18580a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:25.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.040+0000 7f1866ffd640 1 -- 172.21.15.120:0/38575500 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1860019e10 con 0x7f187006d0e0 2024-09-13T06:09:25.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.204+0000 7f1874a37640 1 -- 172.21.15.120:0/38575500 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f187006d4c0 con 0x7f187006d0e0 2024-09-13T06:09:25.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.204+0000 7f1866ffd640 1 -- 172.21.15.120:0/38575500 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+9890 (secure 0 0 0) 0x7f186001b8d0 con 0x7f187006d0e0 2024-09-13T06:09:25.204 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T06:09:25.204 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":18,"fsid":"b924da04-5ce7-4b88-90c8-d1e25fda89f0","created":"2024-09-13T06:09:05.102460+0000","modified":"2024-09-13T06:09:24.209984+0000","last_up_change":"2024-09-13T06:09:17.161802+0000","last_in_change":"2024-09-13T06:09:06.306194+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T06:09:17.772771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-13T06:09:20.938823+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":18,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d4134f4-6b9e-4fcd-bf7c-0938458a015f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1923744619},{"type":"v1","addr":"172.21.15.120:6801","nonce":1923744619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1923744619},{"type":"v1","addr":"172.21.15.120:6803","nonce":1923744619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1923744619},{"type":"v1","addr":"172.21.15.120:6807","nonce":1923744619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1923744619},{"type":"v1","addr":"172.21.15.120:6805","nonce":1923744619}]},"public_addr":"172.21.15.120:6801/1923744619","cluster_addr":"172.21.15.120:6803/1923744619","heartbeat_back_addr":"172.21.15.120:6807/1923744619","heartbeat_front_addr":"172.21.15.120:6805/1923744619","state":["exists","up"]},{"osd":1,"uuid":"aca83f02-0827-44d8-b4b9-2480cce86270","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3135444559},{"type":"v1","addr":"172.21.15.194:6809","nonce":3135444559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3135444559},{"type":"v1","addr":"172.21.15.194:6811","nonce":3135444559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3135444559},{"type":"v1","addr":"172.21.15.194:6815","nonce":3135444559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3135444559},{"type":"v1","addr":"172.21.15.194:6813","nonce":3135444559}]},"public_addr":"172.21.15.194:6809/3135444559","cluster_addr":"172.21.15.194:6811/3135444559","heartbeat_back_addr":"172.21.15.194:6815/3135444559","heartbeat_front_addr":"172.21.15.194:6813/3135444559","state":["exists","up"]},{"osd":2,"uuid":"2e1a73a0-26b9-4247-acbb-15ccd2478adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":815615585},{"type":"v1","addr":"172.21.15.194:6801","nonce":815615585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":815615585},{"type":"v1","addr":"172.21.15.194:6803","nonce":815615585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":815615585},{"type":"v1","addr":"172.21.15.194:6807","nonce":815615585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":815615585},{"type":"v1","addr":"172.21.15.194:6805","nonce":815615585}]},"public_addr":"172.21.15.194:6801/815615585","cluster_addr":"172.21.15.194:6803/815615585","heartbeat_back_addr":"172.21.15.194:6807/815615585","heartbeat_front_addr":"172.21.15.194:6805/815615585","state":["exists","up"]},{"osd":3,"uuid":"afca1e17-ff25-4f0e-9639-a9a06385b8c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":96632515},{"type":"v1","addr":"172.21.15.194:6817","nonce":96632515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":96632515},{"type":"v1","addr":"172.21.15.194:6819","nonce":96632515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":96632515},{"type":"v1","addr":"172.21.15.194:6823","nonce":96632515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":96632515},{"type":"v1","addr":"172.21.15.194:6821","nonce":96632515}]},"public_addr":"172.21.15.194:6817/96632515","cluster_addr":"172.21.15.194:6819/96632515","heartbeat_back_addr":"172.21.15.194:6823/96632515","heartbeat_front_addr":"172.21.15.194:6821/96632515","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:09:13.701094+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:09:13.837131+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:09:13.550343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:09:14.173040+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T06:09:25.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.208+0000 7f1874a37640 1 -- 172.21.15.120:0/38575500 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f1850035db0 msgr2=0x7f1850038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:25.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.208+0000 7f1874a37640 1 --2- 172.21.15.120:0/38575500 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f1850035db0 0x7f1850038270 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f18580ad000 tx=0x7f18580a6000 comp rx=0 tx=0).stop 2024-09-13T06:09:25.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.208+0000 7f1874a37640 1 -- 172.21.15.120:0/38575500 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f187006d0e0 msgr2=0x7f1870092130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:25.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.208+0000 7f1874a37640 1 --2- 172.21.15.120:0/38575500 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f187006d0e0 0x7f1870092130 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f186000c3d0 tx=0x7f186000c890 comp rx=0 tx=0).stop 2024-09-13T06:09:25.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.208+0000 7f1874a37640 1 -- 172.21.15.120:0/38575500 shutdown_connections 2024-09-13T06:09:25.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.208+0000 7f1874a37640 1 --2- 172.21.15.120:0/38575500 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f1850035db0 0x7f1850038270 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:25.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.208+0000 7f1874a37640 1 --2- 172.21.15.120:0/38575500 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f187006d0e0 0x7f1870092130 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:25.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.208+0000 7f1874a37640 1 -- 172.21.15.120:0/38575500 >> 172.21.15.120:0/38575500 conn(0x7f1870099a50 msgr2=0x7f187008afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:25.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.208+0000 7f1874a37640 1 -- 172.21.15.120:0/38575500 shutdown_connections 2024-09-13T06:09:25.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.208+0000 7f1874a37640 1 -- 172.21.15.120:0/38575500 wait complete. 2024-09-13T06:09:25.222 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-13T06:09:25.223 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-13T06:09:25.223 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-13T06:09:25.224 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-13T06:09:25.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.332+0000 7f548cea8640 1 Processor -- start 2024-09-13T06:09:25.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.332+0000 7f548cea8640 1 -- start start 2024-09-13T06:09:25.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.332+0000 7f548cea8640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f548812f390 0x7f5488133a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:25.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.332+0000 7f548cea8640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54880984f0 con 0x7f548812e760 2024-09-13T06:09:25.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.332+0000 7f548cea8640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f5488098dc0 con 0x7f548812f390 2024-09-13T06:09:25.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.332+0000 7f5485d9b640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f548812f390 0x7f5488133a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:25.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.332+0000 7f548659c640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f548812e760 0x7f548812ec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:38368/0 (socket says 172.21.15.120:38368) 2024-09-13T06:09:25.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.332+0000 7f548659c640 1 -- 172.21.15.120:0/3648030904 learned_addr learned my addr 172.21.15.120:0/3648030904 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-13T06:09:25.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.332+0000 7fde80693640 1 Processor -- start 2024-09-13T06:09:25.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.332+0000 7f5485d9b640 1 -- 172.21.15.120:0/3648030904 >> v1:172.21.15.120:6789/0 conn(0x7f548812e760 legacy=0x7f548812ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:25.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.332+0000 7fde80693640 1 -- start start 2024-09-13T06:09:25.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.332+0000 7f5485d9b640 1 -- 172.21.15.120:0/3648030904 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54880981a0 con 0x7f548812f390 2024-09-13T06:09:25.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.332+0000 7f548559a640 1 -- 172.21.15.120:0/3648030904 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3060730771 0 0) 0x7f54880984f0 con 0x7f548812e760 2024-09-13T06:09:25.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.332+0000 7fde80693640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fde78132f20 0x7fde78133300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:25.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.332+0000 7fde80693640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde7806e470 con 0x7fde78133840 2024-09-13T06:09:25.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.332+0000 7fde80693640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fde7806e160 con 0x7fde78132f20 2024-09-13T06:09:25.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.332+0000 7fde7dc2e640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fde78133840 0x7fde78097bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:38374/0 (socket says 172.21.15.120:38374) 2024-09-13T06:09:25.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.332+0000 7fde7e42f640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fde78132f20 0x7fde78133300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:25.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.332+0000 7fde7dc2e640 1 -- 172.21.15.120:0/3447870176 learned_addr learned my addr 172.21.15.120:0/3447870176 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-13T06:09:25.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.332+0000 7fde7e42f640 1 -- 172.21.15.120:0/3447870176 >> v1:172.21.15.120:6789/0 conn(0x7fde78133840 legacy=0x7fde78097bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:25.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.332+0000 7fc59edbc640 1 Processor -- start 2024-09-13T06:09:25.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.332+0000 7fde7d42d640 1 -- 172.21.15.120:0/3447870176 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2025429057 0 0) 0x7fde7806e470 con 0x7fde78133840 2024-09-13T06:09:25.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.332+0000 7fde7e42f640 1 -- 172.21.15.120:0/3447870176 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde7806da50 con 0x7fde78132f20 2024-09-13T06:09:25.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.332+0000 7fc59edbc640 1 -- start start 2024-09-13T06:09:25.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.332+0000 7f24ec793640 1 Processor -- start 2024-09-13T06:09:25.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.332+0000 7f24ec793640 1 -- start start 2024-09-13T06:09:25.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.332+0000 7fc59edbc640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fc598071860 0x7fc5981318d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:25.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.332+0000 7fc59edbc640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc59806c6b0 con 0x7fc598070d70 2024-09-13T06:09:25.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.332+0000 7fc59edbc640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fc59806c8d0 con 0x7fc598071860 2024-09-13T06:09:25.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.332+0000 7fc59cb58640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fc598070d70 0x7fc598071150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:38386/0 (socket says 172.21.15.120:38386) 2024-09-13T06:09:25.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.332+0000 7fc59cb58640 1 -- 172.21.15.120:0/1513312861 learned_addr learned my addr 172.21.15.120:0/1513312861 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-13T06:09:25.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.332+0000 7fc597fff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fc598071860 0x7fc5981318d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:25.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.332+0000 7f24ec793640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f24e40952d0 0x7f24e40956b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:25.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.332+0000 7f24ec793640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24e4098790 con 0x7f24e4095bf0 2024-09-13T06:09:25.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.332+0000 7fc5977fe640 1 -- 172.21.15.120:0/1513312861 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3274755623 0 0) 0x7fc59806c6b0 con 0x7fc598070d70 2024-09-13T06:09:25.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.332+0000 7fc597fff640 1 -- 172.21.15.120:0/1513312861 >> v1:172.21.15.120:6789/0 conn(0x7fc598070d70 legacy=0x7fc598071150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:25.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.332+0000 7fc597fff640 1 -- 172.21.15.120:0/1513312861 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc59806be20 con 0x7fc598071860 2024-09-13T06:09:25.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.332+0000 7f24ec793640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f24e4098db0 con 0x7f24e40952d0 2024-09-13T06:09:25.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.332+0000 7f24e9d2e640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f24e4095bf0 0x7f24e40964e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:38396/0 (socket says 172.21.15.120:38396) 2024-09-13T06:09:25.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.332+0000 7f24e9d2e640 1 -- 172.21.15.120:0/805498116 learned_addr learned my addr 172.21.15.120:0/805498116 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-13T06:09:25.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.332+0000 7f24ea52f640 1 --2- 172.21.15.120:0/805498116 >> v2:172.21.15.120:3300/0 conn(0x7f24e40952d0 0x7f24e40956b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:25.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.336+0000 7f24ea52f640 1 -- 172.21.15.120:0/805498116 >> v1:172.21.15.120:6789/0 conn(0x7f24e4095bf0 legacy=0x7f24e40964e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:25.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.336+0000 7f24ea52f640 1 -- 172.21.15.120:0/805498116 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24e4098aa0 con 0x7f24e40952d0 2024-09-13T06:09:25.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.336+0000 7f5485d9b640 1 --2- 172.21.15.120:0/3648030904 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f548812f390 0x7f5488133a80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f547c009740 tx=0x7f547c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20b6a9756d847fac server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:25.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.336+0000 7f548559a640 1 -- 172.21.15.120:0/3648030904 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f547c0b1070 con 0x7f548812f390 2024-09-13T06:09:25.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.336+0000 7f548559a640 1 -- 172.21.15.120:0/3648030904 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f547c0ac570 con 0x7f548812f390 2024-09-13T06:09:25.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.336+0000 7f548559a640 1 -- 172.21.15.120:0/3648030904 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f547c0ac870 con 0x7f548812f390 2024-09-13T06:09:25.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.336+0000 7fde7e42f640 1 --2- 172.21.15.120:0/3447870176 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fde78132f20 0x7fde78133300 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fde74009740 tx=0x7fde7401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=428431705f83e533 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:25.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.336+0000 7fc597fff640 1 --2- 172.21.15.120:0/1513312861 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc598071860 0x7fc5981318d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc584009740 tx=0x7fc58401c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7349cc76174c1d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:25.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.336+0000 7fde7d42d640 1 -- 172.21.15.120:0/3447870176 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde740b0070 con 0x7fde78132f20 2024-09-13T06:09:25.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.336+0000 7fde7d42d640 1 -- 172.21.15.120:0/3447870176 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde740ab530 con 0x7fde78132f20 2024-09-13T06:09:25.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.336+0000 7fde7d42d640 1 -- 172.21.15.120:0/3447870176 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde740ab830 con 0x7fde78132f20 2024-09-13T06:09:25.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.336+0000 7f548cea8640 1 -- 172.21.15.120:0/3648030904 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f548812f390 msgr2=0x7f5488133a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:25.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.336+0000 7f548cea8640 1 --2- 172.21.15.120:0/3648030904 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f548812f390 0x7f5488133a80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f547c009740 tx=0x7f547c01c400 comp rx=0 tx=0).stop 2024-09-13T06:09:25.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.336+0000 7fc5977fe640 1 -- 172.21.15.120:0/1513312861 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5840b1070 con 0x7fc598071860 2024-09-13T06:09:25.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.336+0000 7fc5977fe640 1 -- 172.21.15.120:0/1513312861 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5840ac520 con 0x7fc598071860 2024-09-13T06:09:25.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.336+0000 7fc5977fe640 1 -- 172.21.15.120:0/1513312861 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5840ac820 con 0x7fc598071860 2024-09-13T06:09:25.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.336+0000 7f548cea8640 1 -- 172.21.15.120:0/3648030904 shutdown_connections 2024-09-13T06:09:25.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.336+0000 7f548cea8640 1 --2- 172.21.15.120:0/3648030904 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f548812f390 0x7f5488133a80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:25.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.336+0000 7f548cea8640 1 -- 172.21.15.120:0/3648030904 >> 172.21.15.120:0/3648030904 conn(0x7f54880a10a0 msgr2=0x7f54880a14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:25.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.336+0000 7f24ea52f640 1 --2- 172.21.15.120:0/805498116 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24e40952d0 0x7f24e40956b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f24e0009740 tx=0x7f24e001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f44dee5c7f8408f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:25.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.336+0000 7f548cea8640 1 -- 172.21.15.120:0/3648030904 shutdown_connections 2024-09-13T06:09:25.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.336+0000 7f548cea8640 1 -- 172.21.15.120:0/3648030904 wait complete. 2024-09-13T06:09:25.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.336+0000 7f24e952d640 1 -- 172.21.15.120:0/805498116 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24e00b1070 con 0x7f24e40952d0 2024-09-13T06:09:25.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.336+0000 7f24e952d640 1 -- 172.21.15.120:0/805498116 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24e00ac520 con 0x7f24e40952d0 2024-09-13T06:09:25.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.336+0000 7f24e952d640 1 -- 172.21.15.120:0/805498116 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24e00ac820 con 0x7f24e40952d0 2024-09-13T06:09:25.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.336+0000 7fc59edbc640 1 -- 172.21.15.120:0/1513312861 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc598071860 msgr2=0x7fc5981318d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:25.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.336+0000 7fc59edbc640 1 --2- 172.21.15.120:0/1513312861 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc598071860 0x7fc5981318d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc584009740 tx=0x7fc58401c330 comp rx=0 tx=0).stop 2024-09-13T06:09:25.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.336+0000 7fde80693640 1 -- 172.21.15.120:0/3447870176 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fde78132f20 msgr2=0x7fde78133300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:25.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.336+0000 7fde80693640 1 --2- 172.21.15.120:0/3447870176 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fde78132f20 0x7fde78133300 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fde74009740 tx=0x7fde7401c370 comp rx=0 tx=0).stop 2024-09-13T06:09:25.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.336+0000 7fc59edbc640 1 -- 172.21.15.120:0/1513312861 shutdown_connections 2024-09-13T06:09:25.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.336+0000 7fc59edbc640 1 --2- 172.21.15.120:0/1513312861 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc598071860 0x7fc5981318d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:25.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.336+0000 7fc59edbc640 1 -- 172.21.15.120:0/1513312861 >> 172.21.15.120:0/1513312861 conn(0x7fc59809ac70 msgr2=0x7fc59806d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:25.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.336+0000 7fde80693640 1 -- 172.21.15.120:0/3447870176 shutdown_connections 2024-09-13T06:09:25.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.336+0000 7fde80693640 1 --2- 172.21.15.120:0/3447870176 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fde78132f20 0x7fde78133300 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:25.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.336+0000 7fde80693640 1 -- 172.21.15.120:0/3447870176 >> 172.21.15.120:0/3447870176 conn(0x7fde7809ef10 msgr2=0x7fde7809f320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:25.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.336+0000 7fde80693640 1 -- 172.21.15.120:0/3447870176 shutdown_connections 2024-09-13T06:09:25.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.336+0000 7fc59edbc640 1 -- 172.21.15.120:0/1513312861 shutdown_connections 2024-09-13T06:09:25.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.336+0000 7fde80693640 1 -- 172.21.15.120:0/3447870176 wait complete. 2024-09-13T06:09:25.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.336+0000 7fc59edbc640 1 -- 172.21.15.120:0/1513312861 wait complete. 2024-09-13T06:09:25.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.336+0000 7f548cea8640 1 Processor -- start 2024-09-13T06:09:25.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.336+0000 7f24ec793640 1 -- 172.21.15.120:0/805498116 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24e40952d0 msgr2=0x7f24e40956b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:25.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.336+0000 7f24ec793640 1 --2- 172.21.15.120:0/805498116 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24e40952d0 0x7f24e40956b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f24e0009740 tx=0x7f24e001c370 comp rx=0 tx=0).stop 2024-09-13T06:09:25.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.336+0000 7f548cea8640 1 -- start start 2024-09-13T06:09:25.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.336+0000 7f24ec793640 1 -- 172.21.15.120:0/805498116 shutdown_connections 2024-09-13T06:09:25.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.336+0000 7f24ec793640 1 --2- 172.21.15.120:0/805498116 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24e40952d0 0x7f24e40956b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:25.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.336+0000 7f24ec793640 1 -- 172.21.15.120:0/805498116 >> 172.21.15.120:0/805498116 conn(0x7f24e409cd50 msgr2=0x7f24e409d160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:25.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.336+0000 7f24ec793640 1 -- 172.21.15.120:0/805498116 shutdown_connections 2024-09-13T06:09:25.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.336+0000 7f24ec793640 1 -- 172.21.15.120:0/805498116 wait complete. 2024-09-13T06:09:25.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.340+0000 7fde80693640 1 Processor -- start 2024-09-13T06:09:25.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.340+0000 7fde80693640 1 -- start start 2024-09-13T06:09:25.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.340+0000 7f548cea8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f548812e760 0x7f548812fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:25.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.340+0000 7f548cea8640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f5488136b70 con 0x7f548812e760 2024-09-13T06:09:25.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.340+0000 7f548659c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f548812e760 0x7f548812fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:25.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.340+0000 7f548659c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f548812e760 0x7f548812fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43512/0 (socket says 172.21.15.120:43512) 2024-09-13T06:09:25.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.340+0000 7fc59edbc640 1 Processor -- start 2024-09-13T06:09:25.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.340+0000 7f548659c640 1 -- 172.21.15.120:0/1083777388 learned_addr learned my addr 172.21.15.120:0/1083777388 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-13T06:09:25.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.340+0000 7f24ec793640 1 Processor -- start 2024-09-13T06:09:25.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.340+0000 7fc59edbc640 1 -- start start 2024-09-13T06:09:25.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.340+0000 7fde80693640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fde78132f20 0x7fde78131850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:25.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.340+0000 7fde80693640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fde78098ea0 con 0x7fde78132f20 2024-09-13T06:09:25.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.340+0000 7f548659c640 1 -- 172.21.15.120:0/1083777388 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5488131540 con 0x7f548812e760 2024-09-13T06:09:25.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.340+0000 7fde7e42f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fde78132f20 0x7fde78131850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:25.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.340+0000 7fde7e42f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fde78132f20 0x7fde78131850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43524/0 (socket says 172.21.15.120:43524) 2024-09-13T06:09:25.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.340+0000 7fde7e42f640 1 -- 172.21.15.120:0/4201143635 learned_addr learned my addr 172.21.15.120:0/4201143635 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-13T06:09:25.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.340+0000 7f24ec793640 1 -- start start 2024-09-13T06:09:25.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.340+0000 7f24ec793640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24e4095bf0 0x7f24e412ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:25.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.340+0000 7f24ec793640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f24e4097790 con 0x7f24e4095bf0 2024-09-13T06:09:25.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.340+0000 7fc59edbc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc598070d70 0x7fc59812d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:25.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.340+0000 7fc59edbc640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fc5981349c0 con 0x7fc598070d70 2024-09-13T06:09:25.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.340+0000 7f548659c640 1 --2- 172.21.15.120:0/1083777388 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f548812e760 0x7f548812fd20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f547800c450 tx=0x7f547800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:25.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.340+0000 7f24ea52f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24e4095bf0 0x7f24e412ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:25.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.340+0000 7f24ea52f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24e4095bf0 0x7f24e412ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43540/0 (socket says 172.21.15.120:43540) 2024-09-13T06:09:25.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.340+0000 7f24ea52f640 1 -- 172.21.15.120:0/4057021256 learned_addr learned my addr 172.21.15.120:0/4057021256 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-13T06:09:25.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.340+0000 7fc59cb58640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc598070d70 0x7fc59812d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:25.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.340+0000 7fc59cb58640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc598070d70 0x7fc59812d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43548/0 (socket says 172.21.15.120:43548) 2024-09-13T06:09:25.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.340+0000 7fc59cb58640 1 -- 172.21.15.120:0/3449146483 learned_addr learned my addr 172.21.15.120:0/3449146483 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-13T06:09:25.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.340+0000 7f5476ffd640 1 -- 172.21.15.120:0/1083777388 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5478005c20 con 0x7f548812e760 2024-09-13T06:09:25.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.340+0000 7fde7e42f640 1 -- 172.21.15.120:0/4201143635 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde78137bd0 con 0x7fde78132f20 2024-09-13T06:09:25.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.340+0000 7f5476ffd640 1 -- 172.21.15.120:0/1083777388 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5478005dc0 con 0x7f548812e760 2024-09-13T06:09:25.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.340+0000 7f5476ffd640 1 -- 172.21.15.120:0/1083777388 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54780071a0 con 0x7f548812e760 2024-09-13T06:09:25.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.340+0000 7f548cea8640 1 -- 172.21.15.120:0/1083777388 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5488133220 con 0x7f548812e760 2024-09-13T06:09:25.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.340+0000 7f548cea8640 1 -- 172.21.15.120:0/1083777388 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5488130260 con 0x7f548812e760 2024-09-13T06:09:25.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.340+0000 7fde7e42f640 1 --2- 172.21.15.120:0/4201143635 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fde78132f20 0x7fde78131850 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fde740ae040 tx=0x7fde7401abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:25.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.340+0000 7fde6effd640 1 -- 172.21.15.120:0/4201143635 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde740b0050 con 0x7fde78132f20 2024-09-13T06:09:25.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.340+0000 7fde6effd640 1 -- 172.21.15.120:0/4201143635 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde740b1040 con 0x7fde78132f20 2024-09-13T06:09:25.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.340+0000 7fde80693640 1 -- 172.21.15.120:0/4201143635 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde78125190 con 0x7fde78132f20 2024-09-13T06:09:25.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.340+0000 7fde6effd640 1 -- 172.21.15.120:0/4201143635 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde740aab80 con 0x7fde78132f20 2024-09-13T06:09:25.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.340+0000 7fde80693640 1 -- 172.21.15.120:0/4201143635 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde78131d90 con 0x7fde78132f20 2024-09-13T06:09:25.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.340+0000 7fc59cb58640 1 -- 172.21.15.120:0/3449146483 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc59812f0e0 con 0x7fc598070d70 2024-09-13T06:09:25.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.340+0000 7f24ea52f640 1 -- 172.21.15.120:0/4057021256 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24e406d860 con 0x7f24e4095bf0 2024-09-13T06:09:25.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.340+0000 7f24ea52f640 1 --2- 172.21.15.120:0/4057021256 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24e4095bf0 0x7f24e412ea80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f24e001aa20 tx=0x7f24e001abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:25.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.340+0000 7f24daffd640 1 -- 172.21.15.120:0/4057021256 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24e00b1050 con 0x7f24e4095bf0 2024-09-13T06:09:25.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.340+0000 7f24daffd640 1 -- 172.21.15.120:0/4057021256 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24e00b2040 con 0x7f24e4095bf0 2024-09-13T06:09:25.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.340+0000 7f24ec793640 1 -- 172.21.15.120:0/4057021256 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24e4130600 con 0x7f24e4095bf0 2024-09-13T06:09:25.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.340+0000 7f24daffd640 1 -- 172.21.15.120:0/4057021256 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24e00b6870 con 0x7f24e4095bf0 2024-09-13T06:09:25.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.340+0000 7f548cea8640 1 -- 172.21.15.120:0/1083777388 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f548812ec80 con 0x7f548812e760 2024-09-13T06:09:25.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.340+0000 7f5476ffd640 1 -- 172.21.15.120:0/1083777388 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5478007400 con 0x7f548812e760 2024-09-13T06:09:25.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.340+0000 7f5476ffd640 1 --2- 172.21.15.120:0/1083777388 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f5468035e00 0x7f54680382c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:25.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.340+0000 7f5476ffd640 1 -- 172.21.15.120:0/1083777388 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f54780483e0 con 0x7f548812e760 2024-09-13T06:09:25.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.340+0000 7f5476ffd640 1 --2- 172.21.15.120:0/1083777388 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x7f546803b580 0x7f546803da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:25.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.340+0000 7f5476ffd640 1 -- 172.21.15.120:0/1083777388 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5478013e70 con 0x7f546803b580 2024-09-13T06:09:25.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.340+0000 7fde80693640 1 -- 172.21.15.120:0/4201143635 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fde7806e9a0 con 0x7fde78132f20 2024-09-13T06:09:25.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.340+0000 7f24ec793640 1 -- 172.21.15.120:0/4057021256 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24e4130ea0 con 0x7f24e4095bf0 2024-09-13T06:09:25.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.340+0000 7f5485d9b640 1 --2- 172.21.15.120:0/1083777388 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f5468035e00 0x7f54680382c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:25.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.340+0000 7fc59cb58640 1 --2- 172.21.15.120:0/3449146483 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc598070d70 0x7fc59812d650 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc58c0011f0 tx=0x7fc58c00c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:25.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.340+0000 7f5486d9d640 1 --2- 172.21.15.120:0/1083777388 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x7f546803b580 0x7f546803da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:25.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.340+0000 7f24ec793640 1 -- 172.21.15.120:0/4057021256 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f24e40956b0 con 0x7f24e4095bf0 2024-09-13T06:09:25.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.340+0000 7f24daffd640 1 -- 172.21.15.120:0/4057021256 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f24e00bf030 con 0x7f24e4095bf0 2024-09-13T06:09:25.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.344+0000 7f24daffd640 1 --2- 172.21.15.120:0/4057021256 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f24c8035d40 0x7f24c8038200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:25.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.344+0000 7f24daffd640 1 -- 172.21.15.120:0/4057021256 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f24e00bd070 con 0x7f24e4095bf0 2024-09-13T06:09:25.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.344+0000 7f24daffd640 1 --2- 172.21.15.120:0/4057021256 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f24c803b4c0 0x7f24c803d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:25.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.344+0000 7f24daffd640 1 -- 172.21.15.120:0/4057021256 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f24e00bee80 con 0x7f24c803b4c0 2024-09-13T06:09:25.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.344+0000 7fde6effd640 1 -- 172.21.15.120:0/4201143635 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fde740be030 con 0x7fde78132f20 2024-09-13T06:09:25.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.344+0000 7f5485d9b640 1 --2- 172.21.15.120:0/1083777388 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f5468035e00 0x7f54680382c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f547c0ae000 tx=0x7f547c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:25.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.344+0000 7f24e9d2e640 1 --2- 172.21.15.120:0/4057021256 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f24c8035d40 0x7f24c8038200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:25.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.344+0000 7f24ead30640 1 --2- 172.21.15.120:0/4057021256 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f24c803b4c0 0x7f24c803d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:25.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.344+0000 7fde6effd640 1 --2- 172.21.15.120:0/4201143635 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fde5c035e50 0x7fde5c038310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:25.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.344+0000 7fde6effd640 1 -- 172.21.15.120:0/4201143635 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7fde740bc070 con 0x7fde78132f20 2024-09-13T06:09:25.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.344+0000 7fde6effd640 1 --2- 172.21.15.120:0/4201143635 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fde5c03b650 0x7fde5c03dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:25.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.344+0000 7fde6effd640 1 -- 172.21.15.120:0/4201143635 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fde7400af30 con 0x7fde5c03b650 2024-09-13T06:09:25.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.344+0000 7fde6effd640 1 -- 172.21.15.120:0/4201143635 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fde740e38c0 con 0x7fde78132f20 2024-09-13T06:09:25.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.344+0000 7f5486d9d640 1 --2- 172.21.15.120:0/1083777388 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x7f546803b580 0x7f546803da00 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:25.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.344+0000 7f24daffd640 1 -- 172.21.15.120:0/4057021256 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f24e00e8050 con 0x7f24e4095bf0 2024-09-13T06:09:25.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.344+0000 7f5476ffd640 1 -- 172.21.15.120:0/1083777388 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f547804f050 con 0x7f548812e760 2024-09-13T06:09:25.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.344+0000 7fde7ec30640 1 --2- 172.21.15.120:0/4201143635 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fde5c03b650 0x7fde5c03dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:25.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.344+0000 7fde7dc2e640 1 --2- 172.21.15.120:0/4201143635 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fde5c035e50 0x7fde5c038310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:25.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.344+0000 7fc5957fa640 1 -- 172.21.15.120:0/3449146483 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc58c018070 con 0x7fc598070d70 2024-09-13T06:09:25.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.344+0000 7fde7ec30640 1 --2- 172.21.15.120:0/4201143635 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fde5c03b650 0x7fde5c03dad0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:25.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.344+0000 7fc59edbc640 1 -- 172.21.15.120:0/3449146483 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc598126e80 con 0x7fc598070d70 2024-09-13T06:09:25.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.344+0000 7fc59edbc640 1 -- 172.21.15.120:0/3449146483 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc59812db90 con 0x7fc598070d70 2024-09-13T06:09:25.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.344+0000 7fc5957fa640 1 -- 172.21.15.120:0/3449146483 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc58c007410 con 0x7fc598070d70 2024-09-13T06:09:25.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.344+0000 7fc5957fa640 1 -- 172.21.15.120:0/3449146483 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc58c0047f0 con 0x7fc598070d70 2024-09-13T06:09:25.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.344+0000 7f24e9d2e640 1 --2- 172.21.15.120:0/4057021256 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f24c8035d40 0x7f24c8038200 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f24d4001610 tx=0x7f24d4007ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:25.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.344+0000 7f24ead30640 1 --2- 172.21.15.120:0/4057021256 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f24c803b4c0 0x7f24c803d940 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:25.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.344+0000 7fde7dc2e640 1 --2- 172.21.15.120:0/4201143635 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fde5c035e50 0x7fde5c038310 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fde68007fd0 tx=0x7fde68007920 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:25.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.344+0000 7fc59edbc640 1 -- 172.21.15.120:0/3449146483 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc578000f90 con 0x7fc598070d70 2024-09-13T06:09:25.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.344+0000 7fde6effd640 1 -- 172.21.15.120:0/4201143635 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fde7400af30 con 0x7fde5c03b650 2024-09-13T06:09:25.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.344+0000 7fc5957fa640 1 -- 172.21.15.120:0/3449146483 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc58c01b070 con 0x7fc598070d70 2024-09-13T06:09:25.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.344+0000 7fc5957fa640 1 --2- 172.21.15.120:0/3449146483 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fc57c035db0 0x7fc57c038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:25.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.344+0000 7fc5957fa640 1 -- 172.21.15.120:0/3449146483 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7fc58c04c170 con 0x7fc598070d70 2024-09-13T06:09:25.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.344+0000 7fc5957fa640 1 --2- 172.21.15.120:0/3449146483 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x7fc57c03b530 0x7fc57c03d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:25.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.344+0000 7fc5957fa640 1 -- 172.21.15.120:0/3449146483 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc57c03e080 con 0x7fc57c03b530 2024-09-13T06:09:25.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.344+0000 7f5476ffd640 1 -- 172.21.15.120:0/1083777388 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5478013e70 con 0x7f546803b580 2024-09-13T06:09:25.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.344+0000 7fc5957fa640 1 -- 172.21.15.120:0/3449146483 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fc58c04d050 con 0x7fc598070d70 2024-09-13T06:09:25.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.344+0000 7fc597fff640 1 --2- 172.21.15.120:0/3449146483 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fc57c035db0 0x7fc57c038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:25.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.344+0000 7fc59d359640 1 --2- 172.21.15.120:0/3449146483 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x7fc57c03b530 0x7fc57c03d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:25.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.344+0000 7fc59d359640 1 --2- 172.21.15.120:0/3449146483 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x7fc57c03b530 0x7fc57c03d9b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:25.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.348+0000 7fc597fff640 1 --2- 172.21.15.120:0/3449146483 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fc57c035db0 0x7fc57c038270 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc5840ae000 tx=0x7fc5840a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:25.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.348+0000 7fc5957fa640 1 -- 172.21.15.120:0/3449146483 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc57c03e080 con 0x7fc57c03b530 2024-09-13T06:09:25.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.352+0000 7f24daffd640 1 -- 172.21.15.120:0/4057021256 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f24e00bee80 con 0x7f24c803b4c0 2024-09-13T06:09:25.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.356+0000 7fde80693640 1 -- 172.21.15.120:0/4201143635 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fde78133300 con 0x7fde5c03b650 2024-09-13T06:09:25.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.360+0000 7fde6effd640 1 -- 172.21.15.120:0/4201143635 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fde78133300 con 0x7fde5c03b650 2024-09-13T06:09:25.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.360+0000 7fde80693640 1 -- 172.21.15.120:0/4201143635 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fde5c03b650 msgr2=0x7fde5c03dad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:25.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.360+0000 7fde80693640 1 --2- 172.21.15.120:0/4201143635 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fde5c03b650 0x7fde5c03dad0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:25.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.360+0000 7fde80693640 1 -- 172.21.15.120:0/4201143635 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fde5c035e50 msgr2=0x7fde5c038310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:25.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.360+0000 7fde80693640 1 --2- 172.21.15.120:0/4201143635 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fde5c035e50 0x7fde5c038310 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fde68007fd0 tx=0x7fde68007920 comp rx=0 tx=0).stop 2024-09-13T06:09:25.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.360+0000 7fde80693640 1 -- 172.21.15.120:0/4201143635 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fde78132f20 msgr2=0x7fde78131850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:25.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.360+0000 7fde80693640 1 --2- 172.21.15.120:0/4201143635 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fde78132f20 0x7fde78131850 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fde740ae040 tx=0x7fde7401abb0 comp rx=0 tx=0).stop 2024-09-13T06:09:25.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.360+0000 7fde80693640 1 -- 172.21.15.120:0/4201143635 shutdown_connections 2024-09-13T06:09:25.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.360+0000 7fde80693640 1 --2- 172.21.15.120:0/4201143635 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fde5c03b650 0x7fde5c03dad0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:25.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.360+0000 7fde80693640 1 --2- 172.21.15.120:0/4201143635 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fde5c035e50 0x7fde5c038310 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:25.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.360+0000 7fde80693640 1 --2- 172.21.15.120:0/4201143635 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fde78132f20 0x7fde78131850 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:25.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.360+0000 7fde80693640 1 -- 172.21.15.120:0/4201143635 >> 172.21.15.120:0/4201143635 conn(0x7fde7809ef10 msgr2=0x7fde7809a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:25.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.360+0000 7fde80693640 1 -- 172.21.15.120:0/4201143635 shutdown_connections 2024-09-13T06:09:25.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.360+0000 7fde80693640 1 -- 172.21.15.120:0/4201143635 wait complete. 2024-09-13T06:09:25.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.360+0000 7fc59edbc640 1 -- 172.21.15.120:0/3449146483 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc578002c80 con 0x7fc57c03b530 2024-09-13T06:09:25.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.364+0000 7fc5957fa640 1 -- 172.21.15.120:0/3449146483 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc578002c80 con 0x7fc57c03b530 2024-09-13T06:09:25.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.364+0000 7fc59edbc640 1 -- 172.21.15.120:0/3449146483 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x7fc57c03b530 msgr2=0x7fc57c03d9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:25.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.364+0000 7fc59edbc640 1 --2- 172.21.15.120:0/3449146483 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x7fc57c03b530 0x7fc57c03d9b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:25.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.364+0000 7f548cea8640 1 -- 172.21.15.120:0/1083777388 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5488132fb0 con 0x7f546803b580 2024-09-13T06:09:25.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.364+0000 7f5476ffd640 1 -- 172.21.15.120:0/1083777388 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5488132fb0 con 0x7f546803b580 2024-09-13T06:09:25.371 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.364+0000 7f548cea8640 1 -- 172.21.15.120:0/1083777388 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x7f546803b580 msgr2=0x7f546803da00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:25.371 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.364+0000 7f548cea8640 1 --2- 172.21.15.120:0/1083777388 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x7f546803b580 0x7f546803da00 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:25.371 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.364+0000 7f548cea8640 1 -- 172.21.15.120:0/1083777388 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f5468035e00 msgr2=0x7f54680382c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:25.371 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.364+0000 7f548cea8640 1 --2- 172.21.15.120:0/1083777388 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f5468035e00 0x7f54680382c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f547c0ae000 tx=0x7f547c008040 comp rx=0 tx=0).stop 2024-09-13T06:09:25.371 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.364+0000 7f548cea8640 1 -- 172.21.15.120:0/1083777388 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f548812e760 msgr2=0x7f548812fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:25.372 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.364+0000 7f548cea8640 1 --2- 172.21.15.120:0/1083777388 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f548812e760 0x7f548812fd20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f547800c450 tx=0x7f547800c910 comp rx=0 tx=0).stop 2024-09-13T06:09:25.372 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.364+0000 7f548cea8640 1 -- 172.21.15.120:0/1083777388 shutdown_connections 2024-09-13T06:09:25.372 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.364+0000 7f548cea8640 1 --2- 172.21.15.120:0/1083777388 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x7f546803b580 0x7f546803da00 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:25.372 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.364+0000 7f548cea8640 1 --2- 172.21.15.120:0/1083777388 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f5468035e00 0x7f54680382c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:25.372 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.364+0000 7f548cea8640 1 --2- 172.21.15.120:0/1083777388 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f548812e760 0x7f548812fd20 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:25.372 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.364+0000 7f548cea8640 1 -- 172.21.15.120:0/1083777388 >> 172.21.15.120:0/1083777388 conn(0x7f54880a10a0 msgr2=0x7f5488128120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:25.372 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.364+0000 7f548cea8640 1 -- 172.21.15.120:0/1083777388 shutdown_connections 2024-09-13T06:09:25.372 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.364+0000 7f548cea8640 1 -- 172.21.15.120:0/1083777388 wait complete. 2024-09-13T06:09:25.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.368+0000 7fc59edbc640 1 -- 172.21.15.120:0/3449146483 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fc57c035db0 msgr2=0x7fc57c038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:25.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.368+0000 7fc59edbc640 1 --2- 172.21.15.120:0/3449146483 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fc57c035db0 0x7fc57c038270 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc5840ae000 tx=0x7fc5840a7000 comp rx=0 tx=0).stop 2024-09-13T06:09:25.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.368+0000 7fc59edbc640 1 -- 172.21.15.120:0/3449146483 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc598070d70 msgr2=0x7fc59812d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:25.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.368+0000 7fc59edbc640 1 --2- 172.21.15.120:0/3449146483 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc598070d70 0x7fc59812d650 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc58c0011f0 tx=0x7fc58c00c930 comp rx=0 tx=0).stop 2024-09-13T06:09:25.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.368+0000 7fc59edbc640 1 -- 172.21.15.120:0/3449146483 shutdown_connections 2024-09-13T06:09:25.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.368+0000 7fc59edbc640 1 --2- 172.21.15.120:0/3449146483 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x7fc57c03b530 0x7fc57c03d9b0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:25.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.368+0000 7fc59edbc640 1 --2- 172.21.15.120:0/3449146483 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fc57c035db0 0x7fc57c038270 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:25.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.368+0000 7fc59edbc640 1 --2- 172.21.15.120:0/3449146483 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc598070d70 0x7fc59812d650 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:25.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.368+0000 7fc59edbc640 1 -- 172.21.15.120:0/3449146483 >> 172.21.15.120:0/3449146483 conn(0x7fc59809ac70 msgr2=0x7fc59806d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:25.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.368+0000 7fc59edbc640 1 -- 172.21.15.120:0/3449146483 shutdown_connections 2024-09-13T06:09:25.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.368+0000 7fc59edbc640 1 -- 172.21.15.120:0/3449146483 wait complete. 2024-09-13T06:09:25.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.368+0000 7f24ec793640 1 -- 172.21.15.120:0/4057021256 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f24e409a5b0 con 0x7f24c803b4c0 2024-09-13T06:09:25.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.368+0000 7f24daffd640 1 -- 172.21.15.120:0/4057021256 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f24e409a5b0 con 0x7f24c803b4c0 2024-09-13T06:09:25.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.372+0000 7f24ec793640 1 -- 172.21.15.120:0/4057021256 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f24c803b4c0 msgr2=0x7f24c803d940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:25.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.372+0000 7f24ec793640 1 --2- 172.21.15.120:0/4057021256 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f24c803b4c0 0x7f24c803d940 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:25.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.372+0000 7f24ec793640 1 -- 172.21.15.120:0/4057021256 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f24c8035d40 msgr2=0x7f24c8038200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:25.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.372+0000 7f24ec793640 1 --2- 172.21.15.120:0/4057021256 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f24c8035d40 0x7f24c8038200 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f24d4001610 tx=0x7f24d4007ad0 comp rx=0 tx=0).stop 2024-09-13T06:09:25.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.372+0000 7f24ec793640 1 -- 172.21.15.120:0/4057021256 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24e4095bf0 msgr2=0x7f24e412ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:25.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.372+0000 7f24ec793640 1 --2- 172.21.15.120:0/4057021256 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24e4095bf0 0x7f24e412ea80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f24e001aa20 tx=0x7f24e001abb0 comp rx=0 tx=0).stop 2024-09-13T06:09:25.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.372+0000 7f24ec793640 1 -- 172.21.15.120:0/4057021256 shutdown_connections 2024-09-13T06:09:25.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.372+0000 7f24ec793640 1 --2- 172.21.15.120:0/4057021256 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f24c803b4c0 0x7f24c803d940 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:25.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.372+0000 7f24ec793640 1 --2- 172.21.15.120:0/4057021256 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f24c8035d40 0x7f24c8038200 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:25.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.372+0000 7f24ec793640 1 --2- 172.21.15.120:0/4057021256 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24e4095bf0 0x7f24e412ea80 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:25.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.372+0000 7f24ec793640 1 -- 172.21.15.120:0/4057021256 >> 172.21.15.120:0/4057021256 conn(0x7f24e409cd50 msgr2=0x7f24e4099c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:25.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.372+0000 7f24ec793640 1 -- 172.21.15.120:0/4057021256 shutdown_connections 2024-09-13T06:09:25.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.372+0000 7f24ec793640 1 -- 172.21.15.120:0/4057021256 wait complete. 2024-09-13T06:09:25.377 INFO:teuthology.orchestra.run.smithi120.stdout:38654705667 2024-09-13T06:09:25.377 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T06:09:25.384 INFO:teuthology.orchestra.run.smithi120.stdout:47244640262 2024-09-13T06:09:25.384 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T06:09:25.385 INFO:teuthology.orchestra.run.smithi120.stdout:47244640262 2024-09-13T06:09:25.386 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T06:09:25.389 INFO:teuthology.orchestra.run.smithi120.stdout:42949672966 2024-09-13T06:09:25.390 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T06:09:25.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.488+0000 7f728572c640 1 Processor -- start 2024-09-13T06:09:25.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.488+0000 7f728572c640 1 -- start start 2024-09-13T06:09:25.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.488+0000 7f728572c640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f7280097010 0x7f72801316e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:25.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.488+0000 7f728572c640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7280098420 con 0x7f7280096520 2024-09-13T06:09:25.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.488+0000 7f728572c640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f72800989e0 con 0x7f7280097010 2024-09-13T06:09:25.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.488+0000 7f727e7fc640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f7280097010 0x7f72801316e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:25.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.488+0000 7f727effd640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f7280096520 0x7f7280096900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:38402/0 (socket says 172.21.15.120:38402) 2024-09-13T06:09:25.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.488+0000 7f727effd640 1 -- 172.21.15.120:0/2829618562 learned_addr learned my addr 172.21.15.120:0/2829618562 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-13T06:09:25.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.488+0000 7f727e7fc640 1 -- 172.21.15.120:0/2829618562 >> v1:172.21.15.120:6789/0 conn(0x7f7280096520 legacy=0x7f7280096900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:25.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.488+0000 7f727e7fc640 1 -- 172.21.15.120:0/2829618562 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7280097a80 con 0x7f7280097010 2024-09-13T06:09:25.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.492+0000 7f727e7fc640 1 --2- 172.21.15.120:0/2829618562 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7280097010 0x7f72801316e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7274009740 tx=0x7f727401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c557aafde7da80b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:25.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.492+0000 7f727dffb640 1 -- 172.21.15.120:0/2829618562 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72740b0070 con 0x7f7280097010 2024-09-13T06:09:25.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.492+0000 7f727dffb640 1 -- 172.21.15.120:0/2829618562 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72740ab530 con 0x7f7280097010 2024-09-13T06:09:25.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.492+0000 7f727dffb640 1 -- 172.21.15.120:0/2829618562 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72740ab830 con 0x7f7280097010 2024-09-13T06:09:25.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.492+0000 7feb50c03640 1 Processor -- start 2024-09-13T06:09:25.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.492+0000 7feb50c03640 1 -- start start 2024-09-13T06:09:25.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.492+0000 7f728572c640 1 -- 172.21.15.120:0/2829618562 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7280097010 msgr2=0x7f72801316e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:25.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.492+0000 7f728572c640 1 --2- 172.21.15.120:0/2829618562 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7280097010 0x7f72801316e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7274009740 tx=0x7f727401c370 comp rx=0 tx=0).stop 2024-09-13T06:09:25.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.492+0000 7f728572c640 1 -- 172.21.15.120:0/2829618562 shutdown_connections 2024-09-13T06:09:25.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.492+0000 7f728572c640 1 --2- 172.21.15.120:0/2829618562 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7280097010 0x7f72801316e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:25.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.492+0000 7f728572c640 1 -- 172.21.15.120:0/2829618562 >> 172.21.15.120:0/2829618562 conn(0x7f728009f010 msgr2=0x7f728009f420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:25.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.492+0000 7f728572c640 1 -- 172.21.15.120:0/2829618562 shutdown_connections 2024-09-13T06:09:25.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.492+0000 7f728572c640 1 -- 172.21.15.120:0/2829618562 wait complete. 2024-09-13T06:09:25.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.492+0000 7feb50c03640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7feb4c12e760 0x7feb4c12ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:25.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.492+0000 7feb50c03640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb4c0984f0 con 0x7feb4c12f1c0 2024-09-13T06:09:25.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.492+0000 7feb50c03640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7feb4c098dc0 con 0x7feb4c12e760 2024-09-13T06:09:25.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.492+0000 7feb4a59c640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7feb4c12e760 0x7feb4c12ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:25.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.492+0000 7feb4a59c640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7feb4c12e760 0x7feb4c12ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43580/0 (socket says 172.21.15.120:43580) 2024-09-13T06:09:25.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.492+0000 7feb4a59c640 1 -- 172.21.15.120:0/3597036775 learned_addr learned my addr 172.21.15.120:0/3597036775 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-13T06:09:25.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.492+0000 7feb4a59c640 1 -- 172.21.15.120:0/3597036775 >> v1:172.21.15.120:6789/0 conn(0x7feb4c12f1c0 legacy=0x7feb4c12b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:25.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.492+0000 7feb49d9b640 1 -- 172.21.15.120:0/3597036775 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 198521754 0 0) 0x7feb4c0984f0 con 0x7feb4c12f1c0 2024-09-13T06:09:25.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.492+0000 7feb4a59c640 1 -- 172.21.15.120:0/3597036775 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb4c12f5a0 con 0x7feb4c12e760 2024-09-13T06:09:25.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.492+0000 7f728572c640 1 Processor -- start 2024-09-13T06:09:25.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.492+0000 7f728572c640 1 -- start start 2024-09-13T06:09:25.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.492+0000 7f728572c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7280096520 0x7f72801c6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:25.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.492+0000 7f728572c640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f7280134650 con 0x7f7280096520 2024-09-13T06:09:25.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.492+0000 7f727effd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7280096520 0x7f72801c6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:25.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.496+0000 7f727effd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7280096520 0x7f72801c6650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43586/0 (socket says 172.21.15.120:43586) 2024-09-13T06:09:25.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.496+0000 7f727effd640 1 -- 172.21.15.120:0/3640896763 learned_addr learned my addr 172.21.15.120:0/3640896763 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-13T06:09:25.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.496+0000 7f727effd640 1 -- 172.21.15.120:0/3640896763 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f728006ffd0 con 0x7f7280096520 2024-09-13T06:09:25.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.496+0000 7f727effd640 1 --2- 172.21.15.120:0/3640896763 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7280096520 0x7f72801c6650 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f727000c380 tx=0x7f727000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:25.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.496+0000 7f72677fe640 1 -- 172.21.15.120:0/3640896763 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7270017070 con 0x7f7280096520 2024-09-13T06:09:25.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.496+0000 7f72677fe640 1 -- 172.21.15.120:0/3640896763 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7270005c20 con 0x7f7280096520 2024-09-13T06:09:25.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.496+0000 7f72677fe640 1 -- 172.21.15.120:0/3640896763 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72700070d0 con 0x7f7280096520 2024-09-13T06:09:25.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.496+0000 7f728572c640 1 -- 172.21.15.120:0/3640896763 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7280071870 con 0x7f7280096520 2024-09-13T06:09:25.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.496+0000 7f728572c640 1 -- 172.21.15.120:0/3640896763 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72801c5fa0 con 0x7f7280096520 2024-09-13T06:09:25.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.496+0000 7feb4a59c640 1 --2- 172.21.15.120:0/3597036775 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb4c12e760 0x7feb4c12ec80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7feb3c0097f0 tx=0x7feb3c01c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dd14b6ad818403a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:25.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.496+0000 7feb49d9b640 1 -- 172.21.15.120:0/3597036775 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb3c0b0070 con 0x7feb4c12e760 2024-09-13T06:09:25.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.496+0000 7feb49d9b640 1 -- 172.21.15.120:0/3597036775 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb3c0ab530 con 0x7feb4c12e760 2024-09-13T06:09:25.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.496+0000 7feb49d9b640 1 -- 172.21.15.120:0/3597036775 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb3c0ab830 con 0x7feb4c12e760 2024-09-13T06:09:25.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.496+0000 7feb50c03640 1 -- 172.21.15.120:0/3597036775 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb4c12e760 msgr2=0x7feb4c12ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:25.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.496+0000 7feb50c03640 1 --2- 172.21.15.120:0/3597036775 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb4c12e760 0x7feb4c12ec80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7feb3c0097f0 tx=0x7feb3c01c4c0 comp rx=0 tx=0).stop 2024-09-13T06:09:25.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.496+0000 7feb50c03640 1 -- 172.21.15.120:0/3597036775 shutdown_connections 2024-09-13T06:09:25.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.496+0000 7feb50c03640 1 --2- 172.21.15.120:0/3597036775 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb4c12e760 0x7feb4c12ec80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:25.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.496+0000 7feb50c03640 1 -- 172.21.15.120:0/3597036775 >> 172.21.15.120:0/3597036775 conn(0x7feb4c0a10a0 msgr2=0x7feb4c0a14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:25.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.496+0000 7feb50c03640 1 -- 172.21.15.120:0/3597036775 shutdown_connections 2024-09-13T06:09:25.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.496+0000 7feb50c03640 1 -- 172.21.15.120:0/3597036775 wait complete. 2024-09-13T06:09:25.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.496+0000 7f72677fe640 1 -- 172.21.15.120:0/3640896763 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f727001a070 con 0x7f7280096520 2024-09-13T06:09:25.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.496+0000 7f728572c640 1 -- 172.21.15.120:0/3640896763 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72801c6230 con 0x7f7280096520 2024-09-13T06:09:25.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.496+0000 7f72677fe640 1 --2- 172.21.15.120:0/3640896763 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f726c035db0 0x7f726c038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:25.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.496+0000 7f72677fe640 1 -- 172.21.15.120:0/3640896763 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f7270047940 con 0x7f7280096520 2024-09-13T06:09:25.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.496+0000 7f727e7fc640 1 --2- 172.21.15.120:0/3640896763 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f726c035db0 0x7f726c038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:25.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.496+0000 7feb50c03640 1 Processor -- start 2024-09-13T06:09:25.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.496+0000 7feb50c03640 1 -- start start 2024-09-13T06:09:25.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.496+0000 7feb50c03640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb4c12e760 0x7feb4c130840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:25.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.496+0000 7feb50c03640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7feb4c136e30 con 0x7feb4c12e760 2024-09-13T06:09:25.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.496+0000 7feb4a59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb4c12e760 0x7feb4c130840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:25.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.496+0000 7feb4a59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb4c12e760 0x7feb4c130840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43594/0 (socket says 172.21.15.120:43594) 2024-09-13T06:09:25.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.496+0000 7feb4a59c640 1 -- 172.21.15.120:0/116913895 learned_addr learned my addr 172.21.15.120:0/116913895 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-13T06:09:25.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.500+0000 7f727e7fc640 1 --2- 172.21.15.120:0/3640896763 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f726c035db0 0x7f726c038270 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f72740ad000 tx=0x7f72740a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:25.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.500+0000 7feb4a59c640 1 -- 172.21.15.120:0/116913895 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb4c132510 con 0x7feb4c12e760 2024-09-13T06:09:25.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.500+0000 7feb4a59c640 1 --2- 172.21.15.120:0/116913895 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb4c12e760 0x7feb4c130840 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7feb3c0097f0 tx=0x7feb3c019260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:25.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.508+0000 7f72677fe640 1 -- 172.21.15.120:0/3640896763 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7270012400 con 0x7f7280096520 2024-09-13T06:09:25.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.508+0000 7feb42ffd640 1 -- 172.21.15.120:0/116913895 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb3c0b9020 con 0x7feb4c12e760 2024-09-13T06:09:25.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.508+0000 7feb42ffd640 1 -- 172.21.15.120:0/116913895 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb3c0b1040 con 0x7feb4c12e760 2024-09-13T06:09:25.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.508+0000 7feb50c03640 1 -- 172.21.15.120:0/116913895 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb4c128f50 con 0x7feb4c12e760 2024-09-13T06:09:25.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.508+0000 7feb42ffd640 1 -- 172.21.15.120:0/116913895 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb3c0b0050 con 0x7feb4c12e760 2024-09-13T06:09:25.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.508+0000 7feb50c03640 1 -- 172.21.15.120:0/116913895 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb4c097e80 con 0x7feb4c12e760 2024-09-13T06:09:25.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.508+0000 7feb50c03640 1 -- 172.21.15.120:0/116913895 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb4c12ec80 con 0x7feb4c12e760 2024-09-13T06:09:25.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.508+0000 7feb42ffd640 1 -- 172.21.15.120:0/116913895 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7feb3c0bc020 con 0x7feb4c12e760 2024-09-13T06:09:25.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.508+0000 7feb42ffd640 1 --2- 172.21.15.120:0/116913895 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7feb2c035e50 0x7feb2c038310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:25.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.508+0000 7feb42ffd640 1 -- 172.21.15.120:0/116913895 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7feb3c0e2460 con 0x7feb4c12e760 2024-09-13T06:09:25.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.508+0000 7feb43fff640 1 --2- 172.21.15.120:0/116913895 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7feb2c035e50 0x7feb2c038310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:25.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.508+0000 7feb43fff640 1 --2- 172.21.15.120:0/116913895 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7feb2c035e50 0x7feb2c038310 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7feb34007fd0 tx=0x7feb34007960 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:25.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.516+0000 7feb42ffd640 1 -- 172.21.15.120:0/116913895 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7feb3c0c3030 con 0x7feb4c12e760 2024-09-13T06:09:25.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.544+0000 7f1fe1d80640 1 Processor -- start 2024-09-13T06:09:25.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.544+0000 7f1fe1d80640 1 -- start start 2024-09-13T06:09:25.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.544+0000 7f1fe1d80640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1fdc128000 0x7f1fdc1283e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:25.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.544+0000 7f1fe1d80640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fdc097a60 con 0x7f1fdc128920 2024-09-13T06:09:25.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.544+0000 7f1fe1d80640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f1fdc072f50 con 0x7f1fdc128000 2024-09-13T06:09:25.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.544+0000 7f1fdaffd640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f1fdc128920 0x7f1fdc12b500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:38418/0 (socket says 172.21.15.120:38418) 2024-09-13T06:09:25.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.544+0000 7f1fdaffd640 1 -- 172.21.15.120:0/1557358005 learned_addr learned my addr 172.21.15.120:0/1557358005 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-13T06:09:25.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.544+0000 7f1fdb7fe640 1 --2- 172.21.15.120:0/1557358005 >> v2:172.21.15.120:3300/0 conn(0x7f1fdc128000 0x7f1fdc1283e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:25.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.544+0000 7f1fda7fc640 1 -- 172.21.15.120:0/1557358005 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1656714582 0 0) 0x7f1fdc097a60 con 0x7f1fdc128920 2024-09-13T06:09:25.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.544+0000 7f1fda7fc640 1 -- 172.21.15.120:0/1557358005 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1fc4003530 con 0x7f1fdc128920 2024-09-13T06:09:25.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.544+0000 7f1fdb7fe640 1 -- 172.21.15.120:0/1557358005 >> v1:172.21.15.120:6789/0 conn(0x7f1fdc128920 legacy=0x7f1fdc12b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:25.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.544+0000 7f1fdb7fe640 1 -- 172.21.15.120:0/1557358005 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fdc128d30 con 0x7f1fdc128000 2024-09-13T06:09:25.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.548+0000 7f1fdb7fe640 1 --2- 172.21.15.120:0/1557358005 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1fdc128000 0x7f1fdc1283e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc009740 tx=0x7f1fcc01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2a62c880cd631ef server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:25.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.548+0000 7f1fda7fc640 1 -- 172.21.15.120:0/1557358005 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fcc0b1070 con 0x7f1fdc128000 2024-09-13T06:09:25.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.548+0000 7f1fda7fc640 1 -- 172.21.15.120:0/1557358005 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fcc0ac520 con 0x7f1fdc128000 2024-09-13T06:09:25.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.548+0000 7f1fda7fc640 1 -- 172.21.15.120:0/1557358005 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fcc0ac820 con 0x7f1fdc128000 2024-09-13T06:09:25.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.548+0000 7f1fe1d80640 1 -- 172.21.15.120:0/1557358005 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1fdc128000 msgr2=0x7f1fdc1283e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:25.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.548+0000 7f1fe1d80640 1 --2- 172.21.15.120:0/1557358005 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1fdc128000 0x7f1fdc1283e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc009740 tx=0x7f1fcc01c370 comp rx=0 tx=0).stop 2024-09-13T06:09:25.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.548+0000 7f1fe1d80640 1 -- 172.21.15.120:0/1557358005 shutdown_connections 2024-09-13T06:09:25.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.548+0000 7f1fe1d80640 1 --2- 172.21.15.120:0/1557358005 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1fdc128000 0x7f1fdc1283e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:25.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.548+0000 7f1fe1d80640 1 -- 172.21.15.120:0/1557358005 >> 172.21.15.120:0/1557358005 conn(0x7f1fdc09a940 msgr2=0x7f1fdc09ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:25.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.548+0000 7f1fe1d80640 1 -- 172.21.15.120:0/1557358005 shutdown_connections 2024-09-13T06:09:25.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.548+0000 7f1fe1d80640 1 -- 172.21.15.120:0/1557358005 wait complete. 2024-09-13T06:09:25.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.548+0000 7f1fe1d80640 1 Processor -- start 2024-09-13T06:09:25.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.548+0000 7f1fe1d80640 1 -- start start 2024-09-13T06:09:25.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.552+0000 7f1fe1d80640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1fdc128000 0x7f1fdc132840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:25.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.552+0000 7f1fe1d80640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f1fdc132410 con 0x7f1fdc128000 2024-09-13T06:09:25.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.552+0000 7f1fdb7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1fdc128000 0x7f1fdc132840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:25.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.552+0000 7f1fdb7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1fdc128000 0x7f1fdc132840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43598/0 (socket says 172.21.15.120:43598) 2024-09-13T06:09:25.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.552+0000 7f1fdb7fe640 1 -- 172.21.15.120:0/1732931985 learned_addr learned my addr 172.21.15.120:0/1732931985 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-13T06:09:25.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.552+0000 7f1fdb7fe640 1 -- 172.21.15.120:0/1732931985 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fdc133ad0 con 0x7f1fdc128000 2024-09-13T06:09:25.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.552+0000 7f83343e3640 1 Processor -- start 2024-09-13T06:09:25.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.552+0000 7f1fdb7fe640 1 --2- 172.21.15.120:0/1732931985 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1fdc128000 0x7f1fdc132840 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc0af040 tx=0x7f1fcc019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:25.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.552+0000 7f1fc3fff640 1 -- 172.21.15.120:0/1732931985 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fcc0b9070 con 0x7f1fdc128000 2024-09-13T06:09:25.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.552+0000 7f1fc3fff640 1 -- 172.21.15.120:0/1732931985 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fcc0ab6c0 con 0x7f1fdc128000 2024-09-13T06:09:25.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.552+0000 7f1fc3fff640 1 -- 172.21.15.120:0/1732931985 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fcc0b1040 con 0x7f1fdc128000 2024-09-13T06:09:25.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.552+0000 7f1fe1d80640 1 -- 172.21.15.120:0/1732931985 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fdc130c90 con 0x7f1fdc128000 2024-09-13T06:09:25.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.552+0000 7f1fe1d80640 1 -- 172.21.15.120:0/1732931985 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fdc1342a0 con 0x7f1fdc128000 2024-09-13T06:09:25.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.552+0000 7f83343e3640 1 -- start start 2024-09-13T06:09:25.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.552+0000 7f1fe1d80640 1 -- 172.21.15.120:0/1732931985 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fdc1283e0 con 0x7f1fdc128000 2024-09-13T06:09:25.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.552+0000 7f83343e3640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f832c0953f0 0x7f832c0957d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:25.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.552+0000 7f833217f640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f832c0953f0 0x7f832c0957d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:25.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.552+0000 7f833197e640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f832c073d50 0x7f832c12f950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:38426/0 (socket says 172.21.15.120:38426) 2024-09-13T06:09:25.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.552+0000 7f833217f640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f832c0953f0 0x7f832c0957d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43606/0 (socket says 172.21.15.120:43606) 2024-09-13T06:09:25.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.552+0000 7f833197e640 1 -- 172.21.15.120:0/1568618567 learned_addr learned my addr 172.21.15.120:0/1568618567 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-13T06:09:25.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.552+0000 7f1fc3fff640 1 -- 172.21.15.120:0/1732931985 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1fcc0bc070 con 0x7f1fdc128000 2024-09-13T06:09:25.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.552+0000 7f83343e3640 1 -- 172.21.15.120:0/1568618567 --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f832c09c780 con 0x7f832c073d50 2024-09-13T06:09:25.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.552+0000 7f83343e3640 1 -- 172.21.15.120:0/1568618567 --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f832c097030 con 0x7f832c0953f0 2024-09-13T06:09:25.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.552+0000 7f1fc3fff640 1 --2- 172.21.15.120:0/1732931985 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f1fc8035db0 0x7f1fc8038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:25.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.552+0000 7f1fc3fff640 1 -- 172.21.15.120:0/1732931985 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f1fcc0e2490 con 0x7f1fdc128000 2024-09-13T06:09:25.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.552+0000 7f833217f640 1 -- 172.21.15.120:0/1568618567 >> v1:172.21.15.120:6789/0 conn(0x7f832c073d50 legacy=0x7f832c12f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:25.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.552+0000 7f833217f640 1 -- 172.21.15.120:0/1568618567 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f832c0966c0 con 0x7f832c0953f0 2024-09-13T06:09:25.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.556+0000 7f833217f640 1 --2- 172.21.15.120:0/1568618567 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f832c0953f0 0x7f832c0957d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8328009740 tx=0x7f832801e410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f98e62d87fc12e33 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:25.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.556+0000 7f833117d640 1 -- 172.21.15.120:0/1568618567 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83280b2070 con 0x7f832c0953f0 2024-09-13T06:09:25.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.556+0000 7f1fc3fff640 1 -- 172.21.15.120:0/1732931985 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1fcc0a9070 con 0x7f1fdc128000 2024-09-13T06:09:25.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.556+0000 7f833117d640 1 -- 172.21.15.120:0/1568618567 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83280ad530 con 0x7f832c0953f0 2024-09-13T06:09:25.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.556+0000 7f1fdaffd640 1 --2- 172.21.15.120:0/1732931985 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f1fc8035db0 0x7f1fc8038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:25.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.556+0000 7f833117d640 1 -- 172.21.15.120:0/1568618567 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83280ad830 con 0x7f832c0953f0 2024-09-13T06:09:25.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.560+0000 7f1fdaffd640 1 --2- 172.21.15.120:0/1732931985 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f1fc8035db0 0x7f1fc8038270 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1fd0007fd0 tx=0x7f1fd0007980 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:25.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.560+0000 7f83343e3640 1 -- 172.21.15.120:0/1568618567 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f832c0953f0 msgr2=0x7f832c0957d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:25.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.560+0000 7f83343e3640 1 --2- 172.21.15.120:0/1568618567 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f832c0953f0 0x7f832c0957d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8328009740 tx=0x7f832801e410 comp rx=0 tx=0).stop 2024-09-13T06:09:25.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.560+0000 7f83343e3640 1 -- 172.21.15.120:0/1568618567 shutdown_connections 2024-09-13T06:09:25.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.560+0000 7f83343e3640 1 --2- 172.21.15.120:0/1568618567 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f832c0953f0 0x7f832c0957d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:25.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.560+0000 7f83343e3640 1 -- 172.21.15.120:0/1568618567 >> 172.21.15.120:0/1568618567 conn(0x7f832c09b450 msgr2=0x7f832c09b860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:25.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.564+0000 7f83343e3640 1 -- 172.21.15.120:0/1568618567 shutdown_connections 2024-09-13T06:09:25.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.564+0000 7f83343e3640 1 -- 172.21.15.120:0/1568618567 wait complete. 2024-09-13T06:09:25.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.564+0000 7f83343e3640 1 Processor -- start 2024-09-13T06:09:25.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.564+0000 7f83343e3640 1 -- start start 2024-09-13T06:09:25.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.564+0000 7f83343e3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f832c073d50 0x7f832c1c3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:25.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.564+0000 7f83343e3640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f832c133410 con 0x7f832c073d50 2024-09-13T06:09:25.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.564+0000 7f833217f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f832c073d50 0x7f832c1c3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:25.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.564+0000 7f833217f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f832c073d50 0x7f832c1c3730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43622/0 (socket says 172.21.15.120:43622) 2024-09-13T06:09:25.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.564+0000 7f833217f640 1 -- 172.21.15.120:0/2545872756 learned_addr learned my addr 172.21.15.120:0/2545872756 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-13T06:09:25.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.564+0000 7f833217f640 1 -- 172.21.15.120:0/2545872756 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f832c091e90 con 0x7f832c073d50 2024-09-13T06:09:25.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.564+0000 7f833217f640 1 --2- 172.21.15.120:0/2545872756 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f832c073d50 0x7f832c1c3730 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f832801c040 tx=0x7f832801b1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:25.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.564+0000 7f8322ffd640 1 -- 172.21.15.120:0/2545872756 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83280b2070 con 0x7f832c073d50 2024-09-13T06:09:25.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.564+0000 7f83343e3640 1 -- 172.21.15.120:0/2545872756 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f832c122a80 con 0x7f832c073d50 2024-09-13T06:09:25.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.564+0000 7f8322ffd640 1 -- 172.21.15.120:0/2545872756 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83280ade40 con 0x7f832c073d50 2024-09-13T06:09:25.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.564+0000 7f8322ffd640 1 -- 172.21.15.120:0/2545872756 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83280ac9d0 con 0x7f832c073d50 2024-09-13T06:09:25.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.564+0000 7f83343e3640 1 -- 172.21.15.120:0/2545872756 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f832c1c3c70 con 0x7f832c073d50 2024-09-13T06:09:25.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.564+0000 7f83343e3640 1 -- 172.21.15.120:0/2545872756 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f832c092330 con 0x7f832c073d50 2024-09-13T06:09:25.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.564+0000 7f8322ffd640 1 -- 172.21.15.120:0/2545872756 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f83280acb70 con 0x7f832c073d50 2024-09-13T06:09:25.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.568+0000 7f8322ffd640 1 --2- 172.21.15.120:0/2545872756 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8310035d60 0x7f8310038220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:25.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.568+0000 7f8322ffd640 1 -- 172.21.15.120:0/2545872756 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f83280e2970 con 0x7f832c073d50 2024-09-13T06:09:25.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.568+0000 7f833197e640 1 --2- 172.21.15.120:0/2545872756 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8310035d60 0x7f8310038220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:25.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.568+0000 7f833197e640 1 --2- 172.21.15.120:0/2545872756 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8310035d60 0x7f8310038220 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f831c0017b0 tx=0x7f831c007a30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:25.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.576+0000 7f8322ffd640 1 -- 172.21.15.120:0/2545872756 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f83280e4e20 con 0x7f832c073d50 2024-09-13T06:09:25.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.676+0000 7f728572c640 1 -- 172.21.15.120:0/3640896763 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f7280096900 con 0x7f7280096520 2024-09-13T06:09:25.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.676+0000 7f72677fe640 1 -- 172.21.15.120:0/3640896763 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7270010c00 con 0x7f7280096520 2024-09-13T06:09:25.676 INFO:teuthology.orchestra.run.smithi120.stdout:38654705666 2024-09-13T06:09:25.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.680+0000 7f728572c640 1 -- 172.21.15.120:0/3640896763 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f726c035db0 msgr2=0x7f726c038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:25.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.680+0000 7f728572c640 1 --2- 172.21.15.120:0/3640896763 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f726c035db0 0x7f726c038270 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f72740ad000 tx=0x7f72740a6000 comp rx=0 tx=0).stop 2024-09-13T06:09:25.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.680+0000 7f728572c640 1 -- 172.21.15.120:0/3640896763 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7280096520 msgr2=0x7f72801c6650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:25.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.680+0000 7f728572c640 1 --2- 172.21.15.120:0/3640896763 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7280096520 0x7f72801c6650 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f727000c380 tx=0x7f727000c840 comp rx=0 tx=0).stop 2024-09-13T06:09:25.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.680+0000 7f728572c640 1 -- 172.21.15.120:0/3640896763 shutdown_connections 2024-09-13T06:09:25.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.680+0000 7f728572c640 1 --2- 172.21.15.120:0/3640896763 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f726c035db0 0x7f726c038270 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:25.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.680+0000 7f728572c640 1 --2- 172.21.15.120:0/3640896763 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7280096520 0x7f72801c6650 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:25.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.680+0000 7f728572c640 1 -- 172.21.15.120:0/3640896763 >> 172.21.15.120:0/3640896763 conn(0x7f728009f010 msgr2=0x7f7280123cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:25.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.680+0000 7f728572c640 1 -- 172.21.15.120:0/3640896763 shutdown_connections 2024-09-13T06:09:25.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.680+0000 7f728572c640 1 -- 172.21.15.120:0/3640896763 wait complete. 2024-09-13T06:09:25.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.684+0000 7feb50c03640 1 -- 172.21.15.120:0/116913895 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7feb4c132eb0 con 0x7feb4c12e760 2024-09-13T06:09:25.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.684+0000 7feb42ffd640 1 -- 172.21.15.120:0/116913895 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7feb3c0160b0 con 0x7feb4c12e760 2024-09-13T06:09:25.681 INFO:teuthology.orchestra.run.smithi120.stdout:47244640261 2024-09-13T06:09:25.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.684+0000 7feb50c03640 1 -- 172.21.15.120:0/116913895 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7feb2c035e50 msgr2=0x7feb2c038310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:25.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.684+0000 7feb50c03640 1 --2- 172.21.15.120:0/116913895 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7feb2c035e50 0x7feb2c038310 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7feb34007fd0 tx=0x7feb34007960 comp rx=0 tx=0).stop 2024-09-13T06:09:25.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.684+0000 7feb50c03640 1 -- 172.21.15.120:0/116913895 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb4c12e760 msgr2=0x7feb4c130840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:25.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.684+0000 7feb50c03640 1 --2- 172.21.15.120:0/116913895 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb4c12e760 0x7feb4c130840 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7feb3c0097f0 tx=0x7feb3c019260 comp rx=0 tx=0).stop 2024-09-13T06:09:25.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.684+0000 7feb50c03640 1 -- 172.21.15.120:0/116913895 shutdown_connections 2024-09-13T06:09:25.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.684+0000 7feb50c03640 1 --2- 172.21.15.120:0/116913895 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7feb2c035e50 0x7feb2c038310 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:25.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.684+0000 7feb50c03640 1 --2- 172.21.15.120:0/116913895 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feb4c12e760 0x7feb4c130840 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:25.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.684+0000 7feb50c03640 1 -- 172.21.15.120:0/116913895 >> 172.21.15.120:0/116913895 conn(0x7feb4c0a10a0 msgr2=0x7feb4c09b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:25.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.688+0000 7feb50c03640 1 -- 172.21.15.120:0/116913895 shutdown_connections 2024-09-13T06:09:25.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.688+0000 7feb50c03640 1 -- 172.21.15.120:0/116913895 wait complete. 2024-09-13T06:09:25.697 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705666 for osd.0 2024-09-13T06:09:25.701 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640262 got 47244640261 for osd.3 2024-09-13T06:09:25.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.720+0000 7f1fe1d80640 1 -- 172.21.15.120:0/1732931985 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f1fdc06ffe0 con 0x7f1fdc128000 2024-09-13T06:09:25.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.720+0000 7f1fc3fff640 1 -- 172.21.15.120:0/1732931985 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1fcc015ff0 con 0x7f1fdc128000 2024-09-13T06:09:25.718 INFO:teuthology.orchestra.run.smithi120.stdout:47244640261 2024-09-13T06:09:25.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.720+0000 7f1fe1d80640 1 -- 172.21.15.120:0/1732931985 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f1fc8035db0 msgr2=0x7f1fc8038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:25.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.720+0000 7f1fe1d80640 1 --2- 172.21.15.120:0/1732931985 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f1fc8035db0 0x7f1fc8038270 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1fd0007fd0 tx=0x7f1fd0007980 comp rx=0 tx=0).stop 2024-09-13T06:09:25.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.720+0000 7f1fe1d80640 1 -- 172.21.15.120:0/1732931985 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1fdc128000 msgr2=0x7f1fdc132840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:25.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.720+0000 7f1fe1d80640 1 --2- 172.21.15.120:0/1732931985 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1fdc128000 0x7f1fdc132840 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc0af040 tx=0x7f1fcc019110 comp rx=0 tx=0).stop 2024-09-13T06:09:25.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.720+0000 7f1fe1d80640 1 -- 172.21.15.120:0/1732931985 shutdown_connections 2024-09-13T06:09:25.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.720+0000 7f1fe1d80640 1 --2- 172.21.15.120:0/1732931985 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f1fc8035db0 0x7f1fc8038270 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:25.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.720+0000 7f1fe1d80640 1 --2- 172.21.15.120:0/1732931985 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1fdc128000 0x7f1fdc132840 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:25.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.720+0000 7f1fe1d80640 1 -- 172.21.15.120:0/1732931985 >> 172.21.15.120:0/1732931985 conn(0x7f1fdc09a940 msgr2=0x7f1fdc129300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:25.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.720+0000 7f1fe1d80640 1 -- 172.21.15.120:0/1732931985 shutdown_connections 2024-09-13T06:09:25.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.720+0000 7f1fe1d80640 1 -- 172.21.15.120:0/1732931985 wait complete. 2024-09-13T06:09:25.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.736+0000 7f83343e3640 1 -- 172.21.15.120:0/2545872756 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f832c0957d0 con 0x7f832c073d50 2024-09-13T06:09:25.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.736+0000 7f8322ffd640 1 -- 172.21.15.120:0/2545872756 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8328018120 con 0x7f832c073d50 2024-09-13T06:09:25.733 INFO:teuthology.orchestra.run.smithi120.stdout:42949672965 2024-09-13T06:09:25.734 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640262 got 47244640261 for osd.1 2024-09-13T06:09:25.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.736+0000 7f83343e3640 1 -- 172.21.15.120:0/2545872756 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8310035d60 msgr2=0x7f8310038220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:25.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.736+0000 7f83343e3640 1 --2- 172.21.15.120:0/2545872756 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8310035d60 0x7f8310038220 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f831c0017b0 tx=0x7f831c007a30 comp rx=0 tx=0).stop 2024-09-13T06:09:25.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.736+0000 7f83343e3640 1 -- 172.21.15.120:0/2545872756 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f832c073d50 msgr2=0x7f832c1c3730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:25.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.736+0000 7f83343e3640 1 --2- 172.21.15.120:0/2545872756 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f832c073d50 0x7f832c1c3730 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f832801c040 tx=0x7f832801b1b0 comp rx=0 tx=0).stop 2024-09-13T06:09:25.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.736+0000 7f83343e3640 1 -- 172.21.15.120:0/2545872756 shutdown_connections 2024-09-13T06:09:25.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.736+0000 7f83343e3640 1 --2- 172.21.15.120:0/2545872756 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8310035d60 0x7f8310038220 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:25.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.736+0000 7f83343e3640 1 --2- 172.21.15.120:0/2545872756 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f832c073d50 0x7f832c1c3730 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:25.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.736+0000 7f83343e3640 1 -- 172.21.15.120:0/2545872756 >> 172.21.15.120:0/2545872756 conn(0x7f832c09b450 msgr2=0x7f832c0987e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:25.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.736+0000 7f83343e3640 1 -- 172.21.15.120:0/2545872756 shutdown_connections 2024-09-13T06:09:25.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:25.736+0000 7f83343e3640 1 -- 172.21.15.120:0/2545872756 wait complete. 2024-09-13T06:09:25.749 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672965 for osd.2 2024-09-13T06:09:26.698 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T06:09:26.702 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T06:09:26.735 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T06:09:26.750 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T06:09:26.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.828+0000 7fbc43143640 1 Processor -- start 2024-09-13T06:09:26.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.828+0000 7fbc43143640 1 -- start start 2024-09-13T06:09:26.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.828+0000 7fbc43143640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fbc3c12b490 0x7fbc3c074ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:26.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.828+0000 7fbc43143640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc3c0924c0 con 0x7fbc3c12b870 2024-09-13T06:09:26.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.828+0000 7fbc43143640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fbc3c094bb0 con 0x7fbc3c12b490 2024-09-13T06:09:26.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.828+0000 7fbc40edf640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fbc3c12b490 0x7fbc3c074ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:26.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.828+0000 7fbc3bfff640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fbc3c12b870 0x7fbc3c12bce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:38432/0 (socket says 172.21.15.120:38432) 2024-09-13T06:09:26.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.828+0000 7fbc3bfff640 1 -- 172.21.15.120:0/3704511135 learned_addr learned my addr 172.21.15.120:0/3704511135 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-13T06:09:26.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.828+0000 7fbc40edf640 1 -- 172.21.15.120:0/3704511135 >> v1:172.21.15.120:6789/0 conn(0x7fbc3c12b870 legacy=0x7fbc3c12bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:26.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.828+0000 7fbc40edf640 1 -- 172.21.15.120:0/3704511135 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc3c093db0 con 0x7fbc3c12b490 2024-09-13T06:09:26.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.832+0000 7fbc40edf640 1 --2- 172.21.15.120:0/3704511135 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbc3c12b490 0x7fbc3c074ef0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbc30009740 tx=0x7fbc3001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc6d910948e73bd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:26.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.832+0000 7fbc3b7fe640 1 -- 172.21.15.120:0/3704511135 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc300b0070 con 0x7fbc3c12b490 2024-09-13T06:09:26.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.832+0000 7fbc3b7fe640 1 -- 172.21.15.120:0/3704511135 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc300ab530 con 0x7fbc3c12b490 2024-09-13T06:09:26.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.832+0000 7fbc3b7fe640 1 -- 172.21.15.120:0/3704511135 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc300ab830 con 0x7fbc3c12b490 2024-09-13T06:09:26.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.832+0000 7fbc43143640 1 -- 172.21.15.120:0/3704511135 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbc3c12b490 msgr2=0x7fbc3c074ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:26.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.832+0000 7fbc43143640 1 --2- 172.21.15.120:0/3704511135 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbc3c12b490 0x7fbc3c074ef0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbc30009740 tx=0x7fbc3001c370 comp rx=0 tx=0).stop 2024-09-13T06:09:26.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.832+0000 7fbc43143640 1 -- 172.21.15.120:0/3704511135 shutdown_connections 2024-09-13T06:09:26.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.832+0000 7fbc43143640 1 --2- 172.21.15.120:0/3704511135 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbc3c12b490 0x7fbc3c074ef0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:26.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.832+0000 7fbc43143640 1 -- 172.21.15.120:0/3704511135 >> 172.21.15.120:0/3704511135 conn(0x7fbc3c09d4c0 msgr2=0x7fbc3c09d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:26.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.832+0000 7fbc43143640 1 -- 172.21.15.120:0/3704511135 shutdown_connections 2024-09-13T06:09:26.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.832+0000 7fbc43143640 1 -- 172.21.15.120:0/3704511135 wait complete. 2024-09-13T06:09:26.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.836+0000 7fbc43143640 1 Processor -- start 2024-09-13T06:09:26.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.836+0000 7fbc43143640 1 -- start start 2024-09-13T06:09:26.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.836+0000 7fbc43143640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbc3c12b490 0x7fbc3c06d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:26.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.836+0000 7fbc43143640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fbc3c133570 con 0x7fbc3c12b490 2024-09-13T06:09:26.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.836+0000 7fbc40edf640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbc3c12b490 0x7fbc3c06d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:26.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.836+0000 7fbc40edf640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbc3c12b490 0x7fbc3c06d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43634/0 (socket says 172.21.15.120:43634) 2024-09-13T06:09:26.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.836+0000 7fbc40edf640 1 -- 172.21.15.120:0/339922453 learned_addr learned my addr 172.21.15.120:0/339922453 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-13T06:09:26.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.836+0000 7fbc40edf640 1 -- 172.21.15.120:0/339922453 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc3c070410 con 0x7fbc3c12b490 2024-09-13T06:09:26.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.836+0000 7fbc40edf640 1 --2- 172.21.15.120:0/339922453 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbc3c12b490 0x7fbc3c06d740 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbc30019fa0 tx=0x7fbc3001abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:26.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.836+0000 7fbc397fa640 1 -- 172.21.15.120:0/339922453 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc300b0050 con 0x7fbc3c12b490 2024-09-13T06:09:26.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.836+0000 7fbc397fa640 1 -- 172.21.15.120:0/339922453 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc300b1040 con 0x7fbc3c12b490 2024-09-13T06:09:26.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.836+0000 7fbc43143640 1 -- 172.21.15.120:0/339922453 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc3c06f860 con 0x7fbc3c12b490 2024-09-13T06:09:26.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.836+0000 7fbc397fa640 1 -- 172.21.15.120:0/339922453 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc300aab40 con 0x7fbc3c12b490 2024-09-13T06:09:26.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.836+0000 7fbc43143640 1 -- 172.21.15.120:0/339922453 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc3c12ef10 con 0x7fbc3c12b490 2024-09-13T06:09:26.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.836+0000 7fbc26ffd640 1 -- 172.21.15.120:0/339922453 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc14005090 con 0x7fbc3c12b490 2024-09-13T06:09:26.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.836+0000 7fbc397fa640 1 -- 172.21.15.120:0/339922453 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fbc300be030 con 0x7fbc3c12b490 2024-09-13T06:09:26.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.836+0000 7fbc397fa640 1 --2- 172.21.15.120:0/339922453 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fbc20035de0 0x7fbc200382a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:26.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.836+0000 7fbc397fa640 1 -- 172.21.15.120:0/339922453 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7fbc300bc070 con 0x7fbc3c12b490 2024-09-13T06:09:26.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.836+0000 7fbc3bfff640 1 --2- 172.21.15.120:0/339922453 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fbc20035de0 0x7fbc200382a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:26.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.840+0000 7fbc3bfff640 1 --2- 172.21.15.120:0/339922453 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fbc20035de0 0x7fbc200382a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbc28005890 tx=0x7fbc28007a90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:26.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.848+0000 7fbc397fa640 1 -- 172.21.15.120:0/339922453 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fbc300c5020 con 0x7fbc3c12b490 2024-09-13T06:09:26.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.864+0000 7f97bfa6f640 1 Processor -- start 2024-09-13T06:09:26.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.864+0000 7f97bfa6f640 1 -- start start 2024-09-13T06:09:26.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.864+0000 7f97bfa6f640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f97b806e180 0x7f97b8133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:26.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.864+0000 7f97bfa6f640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97b806fc40 con 0x7f97b812ed70 2024-09-13T06:09:26.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.864+0000 7f97bfa6f640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f97b806f930 con 0x7f97b806e180 2024-09-13T06:09:26.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.864+0000 7f97bd80b640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f97b812ed70 0x7f97b812f150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:38434/0 (socket says 172.21.15.120:38434) 2024-09-13T06:09:26.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.864+0000 7f97bd00a640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f97b806e180 0x7f97b8133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:26.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.864+0000 7f97bd80b640 1 -- 172.21.15.120:0/4293494385 learned_addr learned my addr 172.21.15.120:0/4293494385 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-13T06:09:26.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.864+0000 7f97bd00a640 1 -- 172.21.15.120:0/4293494385 >> v1:172.21.15.120:6789/0 conn(0x7f97b812ed70 legacy=0x7f97b812f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:26.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.864+0000 7f97bd00a640 1 -- 172.21.15.120:0/4293494385 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97b806ea20 con 0x7f97b806e180 2024-09-13T06:09:26.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.868+0000 7f42b1b98640 1 Processor -- start 2024-09-13T06:09:26.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.868+0000 7f42b1b98640 1 -- start start 2024-09-13T06:09:26.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.868+0000 7f42b1b98640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f42ac096290 0x7f42ac096670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:26.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.868+0000 7f42b1b98640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42ac098ca0 con 0x7f42ac096bb0 2024-09-13T06:09:26.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.868+0000 7f42b1b98640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f42ac09b6a0 con 0x7f42ac096290 2024-09-13T06:09:26.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.868+0000 7f42ab7fe640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f42ac096290 0x7f42ac096670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:26.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.868+0000 7f42aaffd640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f42ac096bb0 0x7f42ac132eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:38444/0 (socket says 172.21.15.120:38444) 2024-09-13T06:09:26.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.868+0000 7f42aaffd640 1 -- 172.21.15.120:0/2826640271 learned_addr learned my addr 172.21.15.120:0/2826640271 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-13T06:09:26.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.868+0000 7f42ab7fe640 1 -- 172.21.15.120:0/2826640271 >> v1:172.21.15.120:6789/0 conn(0x7f42ac096bb0 legacy=0x7f42ac132eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:26.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.868+0000 7f97bd00a640 1 --2- 172.21.15.120:0/4293494385 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f97b806e180 0x7f97b8133e50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f97a8009740 tx=0x7f97a801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fd4b8522dcff210 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:26.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.868+0000 7f97bc809640 1 -- 172.21.15.120:0/4293494385 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97a80b1070 con 0x7f97b806e180 2024-09-13T06:09:26.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.868+0000 7f97bc809640 1 -- 172.21.15.120:0/4293494385 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97a80ac570 con 0x7f97b806e180 2024-09-13T06:09:26.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.868+0000 7f97bc809640 1 -- 172.21.15.120:0/4293494385 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97a80ac870 con 0x7f97b806e180 2024-09-13T06:09:26.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.868+0000 7f42ab7fe640 1 -- 172.21.15.120:0/2826640271 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42ac098240 con 0x7f42ac096290 2024-09-13T06:09:26.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.868+0000 7f42ab7fe640 1 --2- 172.21.15.120:0/2826640271 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42ac096290 0x7f42ac096670 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f429c009740 tx=0x7f429c01c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e80a219a422344aa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:26.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.868+0000 7f42aa7fc640 1 -- 172.21.15.120:0/2826640271 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f429c0b0070 con 0x7f42ac096290 2024-09-13T06:09:26.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.868+0000 7f97bfa6f640 1 -- 172.21.15.120:0/4293494385 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f97b806e180 msgr2=0x7f97b8133e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:26.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.868+0000 7f97bfa6f640 1 --2- 172.21.15.120:0/4293494385 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f97b806e180 0x7f97b8133e50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f97a8009740 tx=0x7f97a801c400 comp rx=0 tx=0).stop 2024-09-13T06:09:26.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.868+0000 7f42aa7fc640 1 -- 172.21.15.120:0/2826640271 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f429c0ab530 con 0x7f42ac096290 2024-09-13T06:09:26.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.868+0000 7f42aa7fc640 1 -- 172.21.15.120:0/2826640271 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f429c0ab870 con 0x7f42ac096290 2024-09-13T06:09:26.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.868+0000 7f97bfa6f640 1 -- 172.21.15.120:0/4293494385 shutdown_connections 2024-09-13T06:09:26.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.868+0000 7f97bfa6f640 1 --2- 172.21.15.120:0/4293494385 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f97b806e180 0x7f97b8133e50 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:26.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.868+0000 7f97bfa6f640 1 -- 172.21.15.120:0/4293494385 >> 172.21.15.120:0/4293494385 conn(0x7f97b809cd30 msgr2=0x7f97b809d140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:26.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.868+0000 7f97bfa6f640 1 -- 172.21.15.120:0/4293494385 shutdown_connections 2024-09-13T06:09:26.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.868+0000 7f97bfa6f640 1 -- 172.21.15.120:0/4293494385 wait complete. 2024-09-13T06:09:26.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.872+0000 7f42b1b98640 1 -- 172.21.15.120:0/2826640271 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42ac096290 msgr2=0x7f42ac096670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:26.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.872+0000 7f42b1b98640 1 --2- 172.21.15.120:0/2826640271 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42ac096290 0x7f42ac096670 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f429c009740 tx=0x7f429c01c390 comp rx=0 tx=0).stop 2024-09-13T06:09:26.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.872+0000 7f42b1b98640 1 -- 172.21.15.120:0/2826640271 shutdown_connections 2024-09-13T06:09:26.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.872+0000 7f42b1b98640 1 --2- 172.21.15.120:0/2826640271 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42ac096290 0x7f42ac096670 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:26.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.872+0000 7f42b1b98640 1 -- 172.21.15.120:0/2826640271 >> 172.21.15.120:0/2826640271 conn(0x7f42ac09bbc0 msgr2=0x7f42ac09bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:26.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.872+0000 7f42b1b98640 1 -- 172.21.15.120:0/2826640271 shutdown_connections 2024-09-13T06:09:26.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.872+0000 7f42b1b98640 1 -- 172.21.15.120:0/2826640271 wait complete. 2024-09-13T06:09:26.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.872+0000 7f97bfa6f640 1 Processor -- start 2024-09-13T06:09:26.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.872+0000 7f97bfa6f640 1 -- start start 2024-09-13T06:09:26.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.872+0000 7f97bfa6f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f97b806e180 0x7f97b81c62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:26.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.872+0000 7f97bfa6f640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f97b8136f40 con 0x7f97b806e180 2024-09-13T06:09:26.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.872+0000 7f97bd80b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f97b806e180 0x7f97b81c62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:26.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.872+0000 7f97bd80b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f97b806e180 0x7f97b81c62e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43668/0 (socket says 172.21.15.120:43668) 2024-09-13T06:09:26.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.872+0000 7f97bd80b640 1 -- 172.21.15.120:0/3932587549 learned_addr learned my addr 172.21.15.120:0/3932587549 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-13T06:09:26.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.872+0000 7f97bd80b640 1 -- 172.21.15.120:0/3932587549 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97b812cbf0 con 0x7f97b806e180 2024-09-13T06:09:26.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.872+0000 7f42b1b98640 1 Processor -- start 2024-09-13T06:09:26.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.872+0000 7f42b1b98640 1 -- start start 2024-09-13T06:09:26.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.872+0000 7f97bd80b640 1 --2- 172.21.15.120:0/3932587549 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f97b806e180 0x7f97b81c62e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f97b400c480 tx=0x7f97b400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:26.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.872+0000 7f97ae7fc640 1 -- 172.21.15.120:0/3932587549 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97b4017070 con 0x7f97b806e180 2024-09-13T06:09:26.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.872+0000 7f97ae7fc640 1 -- 172.21.15.120:0/3932587549 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97b4005c20 con 0x7f97b806e180 2024-09-13T06:09:26.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.872+0000 7f97ae7fc640 1 -- 172.21.15.120:0/3932587549 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97b4007070 con 0x7f97b806e180 2024-09-13T06:09:26.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.872+0000 7f42b1b98640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42ac096290 0x7f42ac123de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:26.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.872+0000 7f42b1b98640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f42ac136f70 con 0x7f42ac096290 2024-09-13T06:09:26.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.872+0000 7f42ab7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42ac096290 0x7f42ac123de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:26.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.872+0000 7f42ab7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42ac096290 0x7f42ac123de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43672/0 (socket says 172.21.15.120:43672) 2024-09-13T06:09:26.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.872+0000 7f42ab7fe640 1 -- 172.21.15.120:0/3502861884 learned_addr learned my addr 172.21.15.120:0/3502861884 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-13T06:09:26.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.872+0000 7f97bfa6f640 1 -- 172.21.15.120:0/3932587549 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97b8098500 con 0x7f97b806e180 2024-09-13T06:09:26.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.872+0000 7f42ab7fe640 1 -- 172.21.15.120:0/3502861884 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42ac097b10 con 0x7f42ac096290 2024-09-13T06:09:26.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.872+0000 7f42ab7fe640 1 --2- 172.21.15.120:0/3502861884 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42ac096290 0x7f42ac123de0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f429c0ae040 tx=0x7f429c019130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:26.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.872+0000 7f4293fff640 1 -- 172.21.15.120:0/3502861884 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f429c0b8070 con 0x7f42ac096290 2024-09-13T06:09:26.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.872+0000 7f4293fff640 1 -- 172.21.15.120:0/3502861884 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f429c0b4540 con 0x7f42ac096290 2024-09-13T06:09:26.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.872+0000 7f42b1b98640 1 -- 172.21.15.120:0/3502861884 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42ac094ec0 con 0x7f42ac096290 2024-09-13T06:09:26.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.872+0000 7f97bfa6f640 1 -- 172.21.15.120:0/3932587549 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97b80937b0 con 0x7f97b806e180 2024-09-13T06:09:26.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.872+0000 7f4293fff640 1 -- 172.21.15.120:0/3502861884 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f429c0b0040 con 0x7f42ac096290 2024-09-13T06:09:26.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.872+0000 7f42b1b98640 1 -- 172.21.15.120:0/3502861884 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42ac126310 con 0x7f42ac096290 2024-09-13T06:09:26.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.872+0000 7f97bfa6f640 1 -- 172.21.15.120:0/3932587549 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97b8091f10 con 0x7f97b806e180 2024-09-13T06:09:26.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.872+0000 7f97ae7fc640 1 -- 172.21.15.120:0/3932587549 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f97b401a070 con 0x7f97b806e180 2024-09-13T06:09:26.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.876+0000 7f97ae7fc640 1 --2- 172.21.15.120:0/3932587549 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f979c035db0 0x7f979c038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:26.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.876+0000 7f97ae7fc640 1 -- 172.21.15.120:0/3932587549 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f97b4050350 con 0x7f97b806e180 2024-09-13T06:09:26.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.876+0000 7f97bd00a640 1 --2- 172.21.15.120:0/3932587549 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f979c035db0 0x7f979c038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:26.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.876+0000 7f42b1b98640 1 -- 172.21.15.120:0/3502861884 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f428c005090 con 0x7f42ac096290 2024-09-13T06:09:26.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.876+0000 7f97bd00a640 1 --2- 172.21.15.120:0/3932587549 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f979c035db0 0x7f979c038270 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f97a80ae000 tx=0x7f97a80a6070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:26.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.880+0000 7f4293fff640 1 -- 172.21.15.120:0/3502861884 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f429c0bb070 con 0x7f42ac096290 2024-09-13T06:09:26.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.880+0000 7f4293fff640 1 --2- 172.21.15.120:0/3502861884 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4298035e00 0x7f42980382c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:26.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.880+0000 7f4293fff640 1 -- 172.21.15.120:0/3502861884 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f429c0e2770 con 0x7f42ac096290 2024-09-13T06:09:26.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.880+0000 7f42aaffd640 1 --2- 172.21.15.120:0/3502861884 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4298035e00 0x7f42980382c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:26.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.880+0000 7f42aaffd640 1 --2- 172.21.15.120:0/3502861884 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4298035e00 0x7f42980382c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f42a0001610 tx=0x7f42a0007ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:26.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.884+0000 7f97ae7fc640 1 -- 172.21.15.120:0/3932587549 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f97b4046660 con 0x7f97b806e180 2024-09-13T06:09:26.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.892+0000 7f4293fff640 1 -- 172.21.15.120:0/3502861884 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f429c0a4e20 con 0x7f42ac096290 2024-09-13T06:09:26.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.908+0000 7f961d182640 1 Processor -- start 2024-09-13T06:09:26.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.908+0000 7f961d182640 1 -- start start 2024-09-13T06:09:26.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.908+0000 7f961d182640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f9618070870 0x7f9618131dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:26.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.908+0000 7f961d182640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f961809e860 con 0x7f961812cd50 2024-09-13T06:09:26.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.908+0000 7f961d182640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f961812d840 con 0x7f9618070870 2024-09-13T06:09:26.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.908+0000 7f961659c640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f9618070870 0x7f9618131dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:26.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.908+0000 7f961659c640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f9618070870 0x7f9618131dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43676/0 (socket says 172.21.15.120:43676) 2024-09-13T06:09:26.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.908+0000 7f961659c640 1 -- 172.21.15.120:0/3994507512 learned_addr learned my addr 172.21.15.120:0/3994507512 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-13T06:09:26.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.908+0000 7f9616d9d640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f961812cd50 0x7f961812d130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:38452/0 (socket says 172.21.15.120:38452) 2024-09-13T06:09:26.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.908+0000 7f961659c640 1 -- 172.21.15.120:0/3994507512 >> v1:172.21.15.120:6789/0 conn(0x7f961812cd50 legacy=0x7f961812d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:26.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.908+0000 7f9615d9b640 1 -- 172.21.15.120:0/3994507512 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1802711066 0 0) 0x7f961809e860 con 0x7f961812cd50 2024-09-13T06:09:26.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.908+0000 7f961659c640 1 -- 172.21.15.120:0/3994507512 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9618071c60 con 0x7f9618070870 2024-09-13T06:09:26.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.912+0000 7f961659c640 1 --2- 172.21.15.120:0/3994507512 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9618070870 0x7f9618131dc0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f960c0097f0 tx=0x7f960c01c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd253e655bb55cc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:26.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.912+0000 7f9615d9b640 1 -- 172.21.15.120:0/3994507512 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f960c0a6040 con 0x7f9618070870 2024-09-13T06:09:26.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.912+0000 7f9615d9b640 1 -- 172.21.15.120:0/3994507512 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f960c0af070 con 0x7f9618070870 2024-09-13T06:09:26.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.912+0000 7f9615d9b640 1 -- 172.21.15.120:0/3994507512 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f960c0aa6c0 con 0x7f9618070870 2024-09-13T06:09:26.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.912+0000 7f961d182640 1 -- 172.21.15.120:0/3994507512 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9618070870 msgr2=0x7f9618131dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:26.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.912+0000 7f961d182640 1 --2- 172.21.15.120:0/3994507512 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9618070870 0x7f9618131dc0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f960c0097f0 tx=0x7f960c01c4c0 comp rx=0 tx=0).stop 2024-09-13T06:09:26.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.912+0000 7f961d182640 1 -- 172.21.15.120:0/3994507512 shutdown_connections 2024-09-13T06:09:26.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.912+0000 7f961d182640 1 --2- 172.21.15.120:0/3994507512 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9618070870 0x7f9618131dc0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:26.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.912+0000 7f961d182640 1 -- 172.21.15.120:0/3994507512 >> 172.21.15.120:0/3994507512 conn(0x7f961809cd30 msgr2=0x7f961809d140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:26.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.912+0000 7f961d182640 1 -- 172.21.15.120:0/3994507512 shutdown_connections 2024-09-13T06:09:26.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.912+0000 7f961d182640 1 -- 172.21.15.120:0/3994507512 wait complete. 2024-09-13T06:09:26.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.912+0000 7f961d182640 1 Processor -- start 2024-09-13T06:09:26.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.912+0000 7f961d182640 1 -- start start 2024-09-13T06:09:26.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.912+0000 7f961d182640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9618070870 0x7f96180979b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:26.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.912+0000 7f961d182640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f9618134d30 con 0x7f9618070870 2024-09-13T06:09:26.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.916+0000 7f9616d9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9618070870 0x7f96180979b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:26.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.916+0000 7f9616d9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9618070870 0x7f96180979b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43684/0 (socket says 172.21.15.120:43684) 2024-09-13T06:09:26.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.916+0000 7f9616d9d640 1 -- 172.21.15.120:0/2847570409 learned_addr learned my addr 172.21.15.120:0/2847570409 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-13T06:09:26.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.916+0000 7f9616d9d640 1 -- 172.21.15.120:0/2847570409 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f961812b6f0 con 0x7f9618070870 2024-09-13T06:09:26.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.916+0000 7f9616d9d640 1 --2- 172.21.15.120:0/2847570409 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9618070870 0x7f96180979b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f960800c420 tx=0x7f960800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:26.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.916+0000 7f95ff7fe640 1 -- 172.21.15.120:0/2847570409 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9608018070 con 0x7f9618070870 2024-09-13T06:09:26.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.916+0000 7f95ff7fe640 1 -- 172.21.15.120:0/2847570409 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96080074d0 con 0x7f9618070870 2024-09-13T06:09:26.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.916+0000 7f95ff7fe640 1 -- 172.21.15.120:0/2847570409 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9608004960 con 0x7f9618070870 2024-09-13T06:09:26.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.916+0000 7f961d182640 1 -- 172.21.15.120:0/2847570409 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9618072cd0 con 0x7f9618070870 2024-09-13T06:09:26.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.916+0000 7f961d182640 1 -- 172.21.15.120:0/2847570409 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f961812c380 con 0x7f9618070870 2024-09-13T06:09:26.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.916+0000 7f961d182640 1 -- 172.21.15.120:0/2847570409 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f961812bec0 con 0x7f9618070870 2024-09-13T06:09:26.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.916+0000 7f95ff7fe640 1 -- 172.21.15.120:0/2847570409 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f960801b070 con 0x7f9618070870 2024-09-13T06:09:26.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.916+0000 7f95ff7fe640 1 --2- 172.21.15.120:0/2847570409 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f9604035cf0 0x7f96040381b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:26.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.916+0000 7f95ff7fe640 1 -- 172.21.15.120:0/2847570409 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f9608047a20 con 0x7f9618070870 2024-09-13T06:09:26.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.916+0000 7f961659c640 1 --2- 172.21.15.120:0/2847570409 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f9604035cf0 0x7f96040381b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:26.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.920+0000 7f961659c640 1 --2- 172.21.15.120:0/2847570409 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f9604035cf0 0x7f96040381b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f960c0ae000 tx=0x7f960c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:26.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:26.920+0000 7f95ff7fe640 1 -- 172.21.15.120:0/2847570409 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f960801ae10 con 0x7f9618070870 2024-09-13T06:09:27.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.016+0000 7fbc26ffd640 1 -- 172.21.15.120:0/339922453 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fbc14005380 con 0x7fbc3c12b490 2024-09-13T06:09:27.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.016+0000 7fbc397fa640 1 -- 172.21.15.120:0/339922453 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbc30015ff0 con 0x7fbc3c12b490 2024-09-13T06:09:27.016 INFO:teuthology.orchestra.run.smithi120.stdout:38654705667 2024-09-13T06:09:27.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.020+0000 7fbc26ffd640 1 -- 172.21.15.120:0/339922453 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fbc20035de0 msgr2=0x7fbc200382a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:27.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.020+0000 7fbc26ffd640 1 --2- 172.21.15.120:0/339922453 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fbc20035de0 0x7fbc200382a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbc28005890 tx=0x7fbc28007a90 comp rx=0 tx=0).stop 2024-09-13T06:09:27.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.020+0000 7fbc26ffd640 1 -- 172.21.15.120:0/339922453 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbc3c12b490 msgr2=0x7fbc3c06d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:27.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.020+0000 7fbc26ffd640 1 --2- 172.21.15.120:0/339922453 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbc3c12b490 0x7fbc3c06d740 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbc30019fa0 tx=0x7fbc3001abb0 comp rx=0 tx=0).stop 2024-09-13T06:09:27.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.020+0000 7fbc26ffd640 1 -- 172.21.15.120:0/339922453 shutdown_connections 2024-09-13T06:09:27.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.020+0000 7fbc26ffd640 1 --2- 172.21.15.120:0/339922453 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fbc20035de0 0x7fbc200382a0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:27.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.020+0000 7fbc26ffd640 1 --2- 172.21.15.120:0/339922453 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbc3c12b490 0x7fbc3c06d740 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:27.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.020+0000 7fbc26ffd640 1 -- 172.21.15.120:0/339922453 >> 172.21.15.120:0/339922453 conn(0x7fbc3c09d4c0 msgr2=0x7fbc3c091390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:27.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.020+0000 7fbc26ffd640 1 -- 172.21.15.120:0/339922453 shutdown_connections 2024-09-13T06:09:27.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.020+0000 7fbc26ffd640 1 -- 172.21.15.120:0/339922453 wait complete. 2024-09-13T06:09:27.038 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705667 for osd.0 2024-09-13T06:09:27.039 DEBUG:teuthology.parallel:result is None 2024-09-13T06:09:27.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.044+0000 7f97bfa6f640 1 -- 172.21.15.120:0/3932587549 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f97b806e600 con 0x7f97b806e180 2024-09-13T06:09:27.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.044+0000 7f97ae7fc640 1 -- 172.21.15.120:0/3932587549 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f97b4011c00 con 0x7f97b806e180 2024-09-13T06:09:27.042 INFO:teuthology.orchestra.run.smithi120.stdout:47244640262 2024-09-13T06:09:27.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.044+0000 7f97bfa6f640 1 -- 172.21.15.120:0/3932587549 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f979c035db0 msgr2=0x7f979c038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:27.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.044+0000 7f97bfa6f640 1 --2- 172.21.15.120:0/3932587549 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f979c035db0 0x7f979c038270 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f97a80ae000 tx=0x7f97a80a6070 comp rx=0 tx=0).stop 2024-09-13T06:09:27.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.044+0000 7f97bfa6f640 1 -- 172.21.15.120:0/3932587549 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f97b806e180 msgr2=0x7f97b81c62e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:27.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.044+0000 7f97bfa6f640 1 --2- 172.21.15.120:0/3932587549 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f97b806e180 0x7f97b81c62e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f97b400c480 tx=0x7f97b400c940 comp rx=0 tx=0).stop 2024-09-13T06:09:27.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.048+0000 7f97bfa6f640 1 -- 172.21.15.120:0/3932587549 shutdown_connections 2024-09-13T06:09:27.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.048+0000 7f97bfa6f640 1 --2- 172.21.15.120:0/3932587549 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f979c035db0 0x7f979c038270 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:27.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.048+0000 7f97bfa6f640 1 --2- 172.21.15.120:0/3932587549 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f97b806e180 0x7f97b81c62e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:27.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.048+0000 7f97bfa6f640 1 -- 172.21.15.120:0/3932587549 >> 172.21.15.120:0/3932587549 conn(0x7f97b809cd30 msgr2=0x7f97b8099c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:27.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.048+0000 7f97bfa6f640 1 -- 172.21.15.120:0/3932587549 shutdown_connections 2024-09-13T06:09:27.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.048+0000 7f97bfa6f640 1 -- 172.21.15.120:0/3932587549 wait complete. 2024-09-13T06:09:27.060 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640262 got 47244640262 for osd.1 2024-09-13T06:09:27.061 DEBUG:teuthology.parallel:result is None 2024-09-13T06:09:27.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.064+0000 7f42b1b98640 1 -- 172.21.15.120:0/3502861884 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f428c005380 con 0x7f42ac096290 2024-09-13T06:09:27.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.064+0000 7f4293fff640 1 -- 172.21.15.120:0/3502861884 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f429c016010 con 0x7f42ac096290 2024-09-13T06:09:27.063 INFO:teuthology.orchestra.run.smithi120.stdout:47244640262 2024-09-13T06:09:27.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.068+0000 7f42b1b98640 1 -- 172.21.15.120:0/3502861884 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4298035e00 msgr2=0x7f42980382c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:27.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.068+0000 7f42b1b98640 1 --2- 172.21.15.120:0/3502861884 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4298035e00 0x7f42980382c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f42a0001610 tx=0x7f42a0007ad0 comp rx=0 tx=0).stop 2024-09-13T06:09:27.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.068+0000 7f42b1b98640 1 -- 172.21.15.120:0/3502861884 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42ac096290 msgr2=0x7f42ac123de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:27.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.068+0000 7f42b1b98640 1 --2- 172.21.15.120:0/3502861884 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42ac096290 0x7f42ac123de0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f429c0ae040 tx=0x7f429c019130 comp rx=0 tx=0).stop 2024-09-13T06:09:27.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.068+0000 7f42b1b98640 1 -- 172.21.15.120:0/3502861884 shutdown_connections 2024-09-13T06:09:27.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.068+0000 7f42b1b98640 1 --2- 172.21.15.120:0/3502861884 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4298035e00 0x7f42980382c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:27.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.068+0000 7f42b1b98640 1 --2- 172.21.15.120:0/3502861884 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42ac096290 0x7f42ac123de0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:27.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.068+0000 7f42b1b98640 1 -- 172.21.15.120:0/3502861884 >> 172.21.15.120:0/3502861884 conn(0x7f42ac09bbc0 msgr2=0x7f42ac06d990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:27.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.068+0000 7f42b1b98640 1 -- 172.21.15.120:0/3502861884 shutdown_connections 2024-09-13T06:09:27.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.068+0000 7f42b1b98640 1 -- 172.21.15.120:0/3502861884 wait complete. 2024-09-13T06:09:27.085 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640262 got 47244640262 for osd.3 2024-09-13T06:09:27.085 DEBUG:teuthology.parallel:result is None 2024-09-13T06:09:27.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.092+0000 7f961d182640 1 -- 172.21.15.120:0/2847570409 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f9618070e10 con 0x7f9618070870 2024-09-13T06:09:27.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.092+0000 7f95ff7fe640 1 -- 172.21.15.120:0/2847570409 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9608011920 con 0x7f9618070870 2024-09-13T06:09:27.092 INFO:teuthology.orchestra.run.smithi120.stdout:42949672966 2024-09-13T06:09:27.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.096+0000 7f961d182640 1 -- 172.21.15.120:0/2847570409 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f9604035cf0 msgr2=0x7f96040381b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:27.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.096+0000 7f961d182640 1 --2- 172.21.15.120:0/2847570409 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f9604035cf0 0x7f96040381b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f960c0ae000 tx=0x7f960c008040 comp rx=0 tx=0).stop 2024-09-13T06:09:27.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.096+0000 7f961d182640 1 -- 172.21.15.120:0/2847570409 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9618070870 msgr2=0x7f96180979b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:27.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.096+0000 7f961d182640 1 --2- 172.21.15.120:0/2847570409 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9618070870 0x7f96180979b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f960800c420 tx=0x7f960800c8e0 comp rx=0 tx=0).stop 2024-09-13T06:09:27.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.096+0000 7f961d182640 1 -- 172.21.15.120:0/2847570409 shutdown_connections 2024-09-13T06:09:27.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.096+0000 7f961d182640 1 --2- 172.21.15.120:0/2847570409 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f9604035cf0 0x7f96040381b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:27.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.096+0000 7f961d182640 1 --2- 172.21.15.120:0/2847570409 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9618070870 0x7f96180979b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:27.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.096+0000 7f961d182640 1 -- 172.21.15.120:0/2847570409 >> 172.21.15.120:0/2847570409 conn(0x7f961809cd30 msgr2=0x7f96181308f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:27.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.096+0000 7f961d182640 1 -- 172.21.15.120:0/2847570409 shutdown_connections 2024-09-13T06:09:27.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.096+0000 7f961d182640 1 -- 172.21.15.120:0/2847570409 wait complete. 2024-09-13T06:09:27.108 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672966 for osd.2 2024-09-13T06:09:27.109 DEBUG:teuthology.parallel:result is None 2024-09-13T06:09:27.109 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-13T06:09:27.109 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T06:09:27.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.264+0000 7f6b6fb12640 1 Processor -- start 2024-09-13T06:09:27.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.264+0000 7f6b6fb12640 1 -- start start 2024-09-13T06:09:27.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.264+0000 7f6b6fb12640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f6b6806dbd0 0x7f6b68131e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:27.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.268+0000 7f6b6fb12640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b68071c10 con 0x7f6b6806d0e0 2024-09-13T06:09:27.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.268+0000 7f6b6fb12640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f6b68072230 con 0x7f6b6806dbd0 2024-09-13T06:09:27.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.268+0000 7f6b6d0ad640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f6b6806dbd0 0x7f6b68131e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:27.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.268+0000 7f6b6d8ae640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f6b6806d0e0 0x7f6b6806d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:38466/0 (socket says 172.21.15.120:38466) 2024-09-13T06:09:27.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.268+0000 7f6b6d8ae640 1 -- 172.21.15.120:0/1585335380 learned_addr learned my addr 172.21.15.120:0/1585335380 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-13T06:09:27.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.268+0000 7f6b6d0ad640 1 -- 172.21.15.120:0/1585335380 >> v1:172.21.15.120:6789/0 conn(0x7f6b6806d0e0 legacy=0x7f6b6806d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:27.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.268+0000 7f6b6d0ad640 1 -- 172.21.15.120:0/1585335380 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b680709e0 con 0x7f6b6806dbd0 2024-09-13T06:09:27.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.268+0000 7f6b6c8ac640 1 -- 172.21.15.120:0/1585335380 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1600693355 0 0) 0x7f6b68071c10 con 0x7f6b6806d0e0 2024-09-13T06:09:27.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.268+0000 7f6b6d0ad640 1 --2- 172.21.15.120:0/1585335380 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b6806dbd0 0x7f6b68131e60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6b60009d90 tx=0x7f6b6001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24ad43aec3b884dc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:27.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.268+0000 7f6b6c8ac640 1 -- 172.21.15.120:0/1585335380 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b600a6640 con 0x7f6b6806dbd0 2024-09-13T06:09:27.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.268+0000 7f6b6c8ac640 1 -- 172.21.15.120:0/1585335380 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b600a67e0 con 0x7f6b6806dbd0 2024-09-13T06:09:27.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.268+0000 7f6b6c8ac640 1 -- 172.21.15.120:0/1585335380 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b600a6ae0 con 0x7f6b6806dbd0 2024-09-13T06:09:27.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.268+0000 7f6b6fb12640 1 -- 172.21.15.120:0/1585335380 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b6806dbd0 msgr2=0x7f6b68131e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:27.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.268+0000 7f6b6fb12640 1 --2- 172.21.15.120:0/1585335380 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b6806dbd0 0x7f6b68131e60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6b60009d90 tx=0x7f6b6001c8c0 comp rx=0 tx=0).stop 2024-09-13T06:09:27.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.268+0000 7f6b6fb12640 1 -- 172.21.15.120:0/1585335380 shutdown_connections 2024-09-13T06:09:27.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.268+0000 7f6b6fb12640 1 --2- 172.21.15.120:0/1585335380 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b6806dbd0 0x7f6b68131e60 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:27.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.268+0000 7f6b6fb12640 1 -- 172.21.15.120:0/1585335380 >> 172.21.15.120:0/1585335380 conn(0x7f6b68099a50 msgr2=0x7f6b680972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:27.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.268+0000 7f6b6fb12640 1 -- 172.21.15.120:0/1585335380 shutdown_connections 2024-09-13T06:09:27.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.268+0000 7f6b6fb12640 1 -- 172.21.15.120:0/1585335380 wait complete. 2024-09-13T06:09:27.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.272+0000 7f6b6fb12640 1 Processor -- start 2024-09-13T06:09:27.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.272+0000 7f6b6fb12640 1 -- start start 2024-09-13T06:09:27.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.272+0000 7f6b6fb12640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b6806d0e0 0x7f6b6806e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:27.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.272+0000 7f6b6fb12640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f6b68134d40 con 0x7f6b6806d0e0 2024-09-13T06:09:27.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.272+0000 7f6b6d8ae640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b6806d0e0 0x7f6b6806e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:27.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.272+0000 7f6b6d8ae640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b6806d0e0 0x7f6b6806e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43698/0 (socket says 172.21.15.120:43698) 2024-09-13T06:09:27.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.272+0000 7f6b6d8ae640 1 -- 172.21.15.120:0/2176712891 learned_addr learned my addr 172.21.15.120:0/2176712891 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-13T06:09:27.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.272+0000 7f6b6d8ae640 1 -- 172.21.15.120:0/2176712891 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b6812ae70 con 0x7f6b6806d0e0 2024-09-13T06:09:27.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.272+0000 7f6b6d8ae640 1 --2- 172.21.15.120:0/2176712891 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b6806d0e0 0x7f6b6806e1f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6b6400c420 tx=0x7f6b6400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:27.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.272+0000 7f6b5a7fc640 1 -- 172.21.15.120:0/2176712891 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b64018070 con 0x7f6b6806d0e0 2024-09-13T06:09:27.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.272+0000 7f6b5a7fc640 1 -- 172.21.15.120:0/2176712891 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b640074d0 con 0x7f6b6806d0e0 2024-09-13T06:09:27.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.272+0000 7f6b6fb12640 1 -- 172.21.15.120:0/2176712891 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b6806fa10 con 0x7f6b6806d0e0 2024-09-13T06:09:27.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.272+0000 7f6b5a7fc640 1 -- 172.21.15.120:0/2176712891 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b64004960 con 0x7f6b6806d0e0 2024-09-13T06:09:27.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.272+0000 7f6b6fb12640 1 -- 172.21.15.120:0/2176712891 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b6806fed0 con 0x7f6b6806d0e0 2024-09-13T06:09:27.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.272+0000 7f6b5a7fc640 1 -- 172.21.15.120:0/2176712891 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6b6401b070 con 0x7f6b6806d0e0 2024-09-13T06:09:27.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.272+0000 7f6b6fb12640 1 -- 172.21.15.120:0/2176712891 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b6806d4c0 con 0x7f6b6806d0e0 2024-09-13T06:09:27.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.272+0000 7f6b5a7fc640 1 --2- 172.21.15.120:0/2176712891 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6b4c035db0 0x7f6b4c038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:27.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.272+0000 7f6b5a7fc640 1 -- 172.21.15.120:0/2176712891 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f6b64047a60 con 0x7f6b6806d0e0 2024-09-13T06:09:27.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.272+0000 7f6b6d0ad640 1 --2- 172.21.15.120:0/2176712891 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6b4c035db0 0x7f6b4c038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:27.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.272+0000 7f6b6d0ad640 1 --2- 172.21.15.120:0/2176712891 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6b4c035db0 0x7f6b4c038270 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6b600af000 tx=0x7f6b600a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:27.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.276+0000 7f6b5a7fc640 1 -- 172.21.15.120:0/2176712891 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6b6401ae10 con 0x7f6b6806d0e0 2024-09-13T06:09:27.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.424+0000 7f6b6fb12640 1 -- 172.21.15.120:0/2176712891 --> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6b68073790 con 0x7f6b4c035db0 2024-09-13T06:09:27.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.428+0000 7f6b5a7fc640 1 -- 172.21.15.120:0/2176712891 <== mgr.4100 v2:172.21.15.194:6824/3475680902 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+32241 (secure 0 0 0) 0x7f6b68073790 con 0x7f6b4c035db0 2024-09-13T06:09:27.425 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T06:09:27.426 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-09-13T06:09:27.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.428+0000 7f6b6fb12640 1 -- 172.21.15.120:0/2176712891 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6b4c035db0 msgr2=0x7f6b4c038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:27.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.428+0000 7f6b6fb12640 1 --2- 172.21.15.120:0/2176712891 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6b4c035db0 0x7f6b4c038270 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6b600af000 tx=0x7f6b600a7000 comp rx=0 tx=0).stop 2024-09-13T06:09:27.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.428+0000 7f6b6fb12640 1 -- 172.21.15.120:0/2176712891 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b6806d0e0 msgr2=0x7f6b6806e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:27.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.428+0000 7f6b6fb12640 1 --2- 172.21.15.120:0/2176712891 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b6806d0e0 0x7f6b6806e1f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6b6400c420 tx=0x7f6b6400c8e0 comp rx=0 tx=0).stop 2024-09-13T06:09:27.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.428+0000 7f6b6fb12640 1 -- 172.21.15.120:0/2176712891 shutdown_connections 2024-09-13T06:09:27.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.428+0000 7f6b6fb12640 1 --2- 172.21.15.120:0/2176712891 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6b4c035db0 0x7f6b4c038270 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:27.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.428+0000 7f6b6fb12640 1 --2- 172.21.15.120:0/2176712891 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b6806d0e0 0x7f6b6806e1f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:27.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.428+0000 7f6b6fb12640 1 -- 172.21.15.120:0/2176712891 >> 172.21.15.120:0/2176712891 conn(0x7f6b68099a50 msgr2=0x7f6b6809b100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:27.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.428+0000 7f6b6fb12640 1 -- 172.21.15.120:0/2176712891 shutdown_connections 2024-09-13T06:09:27.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.428+0000 7f6b6fb12640 1 -- 172.21.15.120:0/2176712891 wait complete. 2024-09-13T06:09:27.442 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-09-13T06:09:25.696731+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":10,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":114044,"kb_used_data":1760,"kb_used_omap":6,"kb_used_meta":112185,"kb_avail":377373316,"statfs":{"total":386547056640,"available":386430275584,"internally_reserved":0,"allocated":1802240,"data_stored":1373762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":114878230},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.488589"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T06:09:24.221889+0000","last_change":"2024-09-13T06:09:24.222245+0000","last_active":"2024-09-13T06:09:24.221889+0000","last_peered":"2024-09-13T06:09:24.221889+0000","last_clean":"2024-09-13T06:09:24.221889+0000","last_became_active":"2024-09-13T06:09:22.495259+0000","last_became_peered":"2024-09-13T06:09:22.495259+0000","last_unstale":"2024-09-13T06:09:24.221889+0000","last_undegraded":"2024-09-13T06:09:24.221889+0000","last_fullsized":"2024-09-13T06:09:24.221889+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_clean_scrub_stamp":"2024-09-13T06:09:21.188659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:50:33.808976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002230409,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T06:09:24.227867+0000","last_change":"2024-09-13T06:09:24.227867+0000","last_active":"2024-09-13T06:09:24.227867+0000","last_peered":"2024-09-13T06:09:24.227867+0000","last_clean":"2024-09-13T06:09:24.227867+0000","last_became_active":"2024-09-13T06:09:22.216905+0000","last_became_peered":"2024-09-13T06:09:22.216905+0000","last_unstale":"2024-09-13T06:09:24.227867+0000","last_undegraded":"2024-09-13T06:09:24.227867+0000","last_fullsized":"2024-09-13T06:09:24.227867+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_clean_scrub_stamp":"2024-09-13T06:09:21.188659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:24:00.674357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001005588,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T06:09:24.220889+0000","last_change":"2024-09-13T06:09:24.221355+0000","last_active":"2024-09-13T06:09:24.220889+0000","last_peered":"2024-09-13T06:09:24.220889+0000","last_clean":"2024-09-13T06:09:24.220889+0000","last_became_active":"2024-09-13T06:09:22.217809+0000","last_became_peered":"2024-09-13T06:09:22.217809+0000","last_unstale":"2024-09-13T06:09:24.220889+0000","last_undegraded":"2024-09-13T06:09:24.220889+0000","last_fullsized":"2024-09-13T06:09:24.220889+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_clean_scrub_stamp":"2024-09-13T06:09:21.188659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:16:27.098773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001447545,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T06:09:24.227949+0000","last_change":"2024-09-13T06:09:24.227949+0000","last_active":"2024-09-13T06:09:24.227949+0000","last_peered":"2024-09-13T06:09:24.227949+0000","last_clean":"2024-09-13T06:09:24.227949+0000","last_became_active":"2024-09-13T06:09:22.216659+0000","last_became_peered":"2024-09-13T06:09:22.216659+0000","last_unstale":"2024-09-13T06:09:24.227949+0000","last_undegraded":"2024-09-13T06:09:24.227949+0000","last_fullsized":"2024-09-13T06:09:24.227949+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_clean_scrub_stamp":"2024-09-13T06:09:21.188659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:49:43.834788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010625330000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"18'2","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T06:09:24.222172+0000","last_change":"2024-09-13T06:09:24.222172+0000","last_active":"2024-09-13T06:09:24.222172+0000","last_peered":"2024-09-13T06:09:24.222172+0000","last_clean":"2024-09-13T06:09:24.222172+0000","last_became_active":"2024-09-13T06:09:22.217581+0000","last_became_peered":"2024-09-13T06:09:22.217581+0000","last_unstale":"2024-09-13T06:09:24.222172+0000","last_undegraded":"2024-09-13T06:09:24.222172+0000","last_fullsized":"2024-09-13T06:09:24.222172+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_clean_scrub_stamp":"2024-09-13T06:09:21.188659+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:02:07.684980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022711580000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T06:09:24.564407+0000","last_change":"2024-09-13T06:09:24.565111+0000","last_active":"2024-09-13T06:09:24.564407+0000","last_peered":"2024-09-13T06:09:24.564407+0000","last_clean":"2024-09-13T06:09:24.564407+0000","last_became_active":"2024-09-13T06:09:22.214952+0000","last_became_peered":"2024-09-13T06:09:22.214952+0000","last_unstale":"2024-09-13T06:09:24.564407+0000","last_undegraded":"2024-09-13T06:09:24.564407+0000","last_fullsized":"2024-09-13T06:09:24.564407+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_clean_scrub_stamp":"2024-09-13T06:09:21.188659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:20:29.599784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097860299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T06:09:24.220333+0000","last_change":"2024-09-13T06:09:24.220722+0000","last_active":"2024-09-13T06:09:24.220333+0000","last_peered":"2024-09-13T06:09:24.220333+0000","last_clean":"2024-09-13T06:09:24.220333+0000","last_became_active":"2024-09-13T06:09:22.217643+0000","last_became_peered":"2024-09-13T06:09:22.217643+0000","last_unstale":"2024-09-13T06:09:24.220333+0000","last_undegraded":"2024-09-13T06:09:24.220333+0000","last_fullsized":"2024-09-13T06:09:24.220333+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_clean_scrub_stamp":"2024-09-13T06:09:21.188659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:44:20.577838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082521999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"16'1","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T06:09:24.220232+0000","last_change":"2024-09-13T06:09:24.220777+0000","last_active":"2024-09-13T06:09:24.220232+0000","last_peered":"2024-09-13T06:09:24.220232+0000","last_clean":"2024-09-13T06:09:24.220232+0000","last_became_active":"2024-09-13T06:09:22.217131+0000","last_became_peered":"2024-09-13T06:09:22.217131+0000","last_unstale":"2024-09-13T06:09:24.220232+0000","last_undegraded":"2024-09-13T06:09:24.220232+0000","last_fullsized":"2024-09-13T06:09:24.220232+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_clean_scrub_stamp":"2024-09-13T06:09:21.188659+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:58:05.578609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090967000000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"14'117","reported_seq":170,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T06:09:24.215064+0000","last_change":"2024-09-13T06:09:19.565573+0000","last_active":"2024-09-13T06:09:24.215064+0000","last_peered":"2024-09-13T06:09:24.215064+0000","last_clean":"2024-09-13T06:09:24.215064+0000","last_became_active":"2024-09-13T06:09:19.561434+0000","last_became_peered":"2024-09-13T06:09:19.561434+0000","last_unstale":"2024-09-13T06:09:24.215064+0000","last_undegraded":"2024-09-13T06:09:24.215064+0000","last_fullsized":"2024-09-13T06:09:24.215064+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:18.163598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:18.163598+0000","last_clean_scrub_stamp":"2024-09-13T06:09:18.163598+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:04:43.437453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640262,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":159744,"data_stored":50297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640262,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":749568,"data_stored":640646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672966,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31908,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339932,"statfs":{"total":96636764160,"available":96604090368,"internally_reserved":0,"allocated":733184,"data_stored":632522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705667,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":159744,"data_stored":50297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T06:09:27.443 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T06:09:27.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.556+0000 7f312c59d640 1 Processor -- start 2024-09-13T06:09:27.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.556+0000 7f312c59d640 1 -- start start 2024-09-13T06:09:27.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.560+0000 7f312c59d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f312412d000 0x7f3124131a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:27.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.560+0000 7f312c59d640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31240927a0 con 0x7f312412c510 2024-09-13T06:09:27.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.560+0000 7f312c59d640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f3124096e80 con 0x7f312412d000 2024-09-13T06:09:27.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.560+0000 7f312a339640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f312412c510 0x7f312412c8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:38476/0 (socket says 172.21.15.120:38476) 2024-09-13T06:09:27.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.560+0000 7f312a339640 1 -- 172.21.15.120:0/900999392 learned_addr learned my addr 172.21.15.120:0/900999392 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-13T06:09:27.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.560+0000 7f3129b38640 1 --2- 172.21.15.120:0/900999392 >> v2:172.21.15.120:3300/0 conn(0x7f312412d000 0x7f3124131a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:27.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.560+0000 7f3129b38640 1 -- 172.21.15.120:0/900999392 >> v1:172.21.15.120:6789/0 conn(0x7f312412c510 legacy=0x7f312412c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:27.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.560+0000 7f3129b38640 1 -- 172.21.15.120:0/900999392 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3124074ef0 con 0x7f312412d000 2024-09-13T06:09:27.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.560+0000 7f3129b38640 1 --2- 172.21.15.120:0/900999392 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f312412d000 0x7f3124131a40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3114009740 tx=0x7f311401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=599129662c26cd9a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:27.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.560+0000 7f3129337640 1 -- 172.21.15.120:0/900999392 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31140b0070 con 0x7f312412d000 2024-09-13T06:09:27.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.560+0000 7f3129337640 1 -- 172.21.15.120:0/900999392 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31140ab530 con 0x7f312412d000 2024-09-13T06:09:27.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.560+0000 7f3129337640 1 -- 172.21.15.120:0/900999392 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31140ab830 con 0x7f312412d000 2024-09-13T06:09:27.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.560+0000 7f312c59d640 1 -- 172.21.15.120:0/900999392 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f312412d000 msgr2=0x7f3124131a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:27.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.560+0000 7f312c59d640 1 --2- 172.21.15.120:0/900999392 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f312412d000 0x7f3124131a40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3114009740 tx=0x7f311401c370 comp rx=0 tx=0).stop 2024-09-13T06:09:27.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.560+0000 7f312c59d640 1 -- 172.21.15.120:0/900999392 shutdown_connections 2024-09-13T06:09:27.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.560+0000 7f312c59d640 1 --2- 172.21.15.120:0/900999392 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f312412d000 0x7f3124131a40 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:27.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.560+0000 7f312c59d640 1 -- 172.21.15.120:0/900999392 >> 172.21.15.120:0/900999392 conn(0x7f312409d4c0 msgr2=0x7f312409d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:27.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.560+0000 7f312c59d640 1 -- 172.21.15.120:0/900999392 shutdown_connections 2024-09-13T06:09:27.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.560+0000 7f312c59d640 1 -- 172.21.15.120:0/900999392 wait complete. 2024-09-13T06:09:27.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.564+0000 7f312c59d640 1 Processor -- start 2024-09-13T06:09:27.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.564+0000 7f312c59d640 1 -- start start 2024-09-13T06:09:27.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.564+0000 7f312c59d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f312412c510 0x7f3124071b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:27.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.564+0000 7f312c59d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f3124134b30 con 0x7f312412c510 2024-09-13T06:09:27.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.564+0000 7f312a339640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f312412c510 0x7f3124071b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:27.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.564+0000 7f312a339640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f312412c510 0x7f3124071b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43708/0 (socket says 172.21.15.120:43708) 2024-09-13T06:09:27.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.564+0000 7f312a339640 1 -- 172.21.15.120:0/764626826 learned_addr learned my addr 172.21.15.120:0/764626826 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-13T06:09:27.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.564+0000 7f312a339640 1 -- 172.21.15.120:0/764626826 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3124093d50 con 0x7f312412c510 2024-09-13T06:09:27.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.564+0000 7f312a339640 1 --2- 172.21.15.120:0/764626826 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f312412c510 0x7f3124071b50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f312000c480 tx=0x7f312000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:27.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.564+0000 7f311affd640 1 -- 172.21.15.120:0/764626826 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3120017070 con 0x7f312412c510 2024-09-13T06:09:27.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.564+0000 7f311affd640 1 -- 172.21.15.120:0/764626826 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3120005c20 con 0x7f312412c510 2024-09-13T06:09:27.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.564+0000 7f312c59d640 1 -- 172.21.15.120:0/764626826 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3124073680 con 0x7f312412c510 2024-09-13T06:09:27.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.564+0000 7f311affd640 1 -- 172.21.15.120:0/764626826 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3120007070 con 0x7f312412c510 2024-09-13T06:09:27.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.564+0000 7f312c59d640 1 -- 172.21.15.120:0/764626826 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3124072090 con 0x7f312412c510 2024-09-13T06:09:27.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.564+0000 7f311affd640 1 -- 172.21.15.120:0/764626826 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f312001a070 con 0x7f312412c510 2024-09-13T06:09:27.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.564+0000 7f312c59d640 1 -- 172.21.15.120:0/764626826 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f312412c8f0 con 0x7f312412c510 2024-09-13T06:09:27.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.564+0000 7f311affd640 1 --2- 172.21.15.120:0/764626826 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3108035db0 0x7f3108038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:27.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.564+0000 7f311affd640 1 -- 172.21.15.120:0/764626826 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f3120047a30 con 0x7f312412c510 2024-09-13T06:09:27.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.564+0000 7f3129b38640 1 --2- 172.21.15.120:0/764626826 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3108035db0 0x7f3108038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:27.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.564+0000 7f3129b38640 1 --2- 172.21.15.120:0/764626826 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3108035db0 0x7f3108038270 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f31140ad000 tx=0x7f3114008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:27.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.568+0000 7f311affd640 1 -- 172.21.15.120:0/764626826 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f312001a760 con 0x7f312412c510 2024-09-13T06:09:27.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.712+0000 7f312c59d640 1 -- 172.21.15.120:0/764626826 --> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3124096210 con 0x7f3108035db0 2024-09-13T06:09:27.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.716+0000 7f311affd640 1 -- 172.21.15.120:0/764626826 <== mgr.4100 v2:172.21.15.194:6824/3475680902 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+32217 (secure 0 0 0) 0x7f3124096210 con 0x7f3108035db0 2024-09-13T06:09:27.715 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T06:09:27.716 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-09-13T06:09:27.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.720+0000 7f312c59d640 1 -- 172.21.15.120:0/764626826 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3108035db0 msgr2=0x7f3108038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:27.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.720+0000 7f312c59d640 1 --2- 172.21.15.120:0/764626826 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3108035db0 0x7f3108038270 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f31140ad000 tx=0x7f3114008040 comp rx=0 tx=0).stop 2024-09-13T06:09:27.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.720+0000 7f312c59d640 1 -- 172.21.15.120:0/764626826 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f312412c510 msgr2=0x7f3124071b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:27.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.720+0000 7f312c59d640 1 --2- 172.21.15.120:0/764626826 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f312412c510 0x7f3124071b50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f312000c480 tx=0x7f312000c940 comp rx=0 tx=0).stop 2024-09-13T06:09:27.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.720+0000 7f312c59d640 1 -- 172.21.15.120:0/764626826 shutdown_connections 2024-09-13T06:09:27.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.720+0000 7f312c59d640 1 --2- 172.21.15.120:0/764626826 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3108035db0 0x7f3108038270 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:27.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.720+0000 7f312c59d640 1 --2- 172.21.15.120:0/764626826 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f312412c510 0x7f3124071b50 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:27.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.720+0000 7f312c59d640 1 -- 172.21.15.120:0/764626826 >> 172.21.15.120:0/764626826 conn(0x7f312409d4c0 msgr2=0x7f312412da20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:27.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.720+0000 7f312c59d640 1 -- 172.21.15.120:0/764626826 shutdown_connections 2024-09-13T06:09:27.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.720+0000 7f312c59d640 1 -- 172.21.15.120:0/764626826 wait complete. 2024-09-13T06:09:27.732 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-13T06:09:27.697430+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":114056,"kb_used_data":1776,"kb_used_omap":6,"kb_used_meta":112185,"kb_avail":377373304,"statfs":{"total":386547056640,"available":386430263296,"internally_reserved":0,"allocated":1818624,"data_stored":1381886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":114878230},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.489288"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T06:09:24.221889+0000","last_change":"2024-09-13T06:09:24.222245+0000","last_active":"2024-09-13T06:09:24.221889+0000","last_peered":"2024-09-13T06:09:24.221889+0000","last_clean":"2024-09-13T06:09:24.221889+0000","last_became_active":"2024-09-13T06:09:22.495259+0000","last_became_peered":"2024-09-13T06:09:22.495259+0000","last_unstale":"2024-09-13T06:09:24.221889+0000","last_undegraded":"2024-09-13T06:09:24.221889+0000","last_fullsized":"2024-09-13T06:09:24.221889+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_clean_scrub_stamp":"2024-09-13T06:09:21.188659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:50:33.808976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002230409,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T06:09:24.227867+0000","last_change":"2024-09-13T06:09:24.227867+0000","last_active":"2024-09-13T06:09:24.227867+0000","last_peered":"2024-09-13T06:09:24.227867+0000","last_clean":"2024-09-13T06:09:24.227867+0000","last_became_active":"2024-09-13T06:09:22.216905+0000","last_became_peered":"2024-09-13T06:09:22.216905+0000","last_unstale":"2024-09-13T06:09:24.227867+0000","last_undegraded":"2024-09-13T06:09:24.227867+0000","last_fullsized":"2024-09-13T06:09:24.227867+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_clean_scrub_stamp":"2024-09-13T06:09:21.188659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:24:00.674357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001005588,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T06:09:24.220889+0000","last_change":"2024-09-13T06:09:24.221355+0000","last_active":"2024-09-13T06:09:24.220889+0000","last_peered":"2024-09-13T06:09:24.220889+0000","last_clean":"2024-09-13T06:09:24.220889+0000","last_became_active":"2024-09-13T06:09:22.217809+0000","last_became_peered":"2024-09-13T06:09:22.217809+0000","last_unstale":"2024-09-13T06:09:24.220889+0000","last_undegraded":"2024-09-13T06:09:24.220889+0000","last_fullsized":"2024-09-13T06:09:24.220889+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_clean_scrub_stamp":"2024-09-13T06:09:21.188659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:16:27.098773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001447545,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T06:09:24.227949+0000","last_change":"2024-09-13T06:09:24.227949+0000","last_active":"2024-09-13T06:09:24.227949+0000","last_peered":"2024-09-13T06:09:24.227949+0000","last_clean":"2024-09-13T06:09:24.227949+0000","last_became_active":"2024-09-13T06:09:22.216659+0000","last_became_peered":"2024-09-13T06:09:22.216659+0000","last_unstale":"2024-09-13T06:09:24.227949+0000","last_undegraded":"2024-09-13T06:09:24.227949+0000","last_fullsized":"2024-09-13T06:09:24.227949+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_clean_scrub_stamp":"2024-09-13T06:09:21.188659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:49:43.834788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010625330000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"18'2","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T06:09:24.222172+0000","last_change":"2024-09-13T06:09:24.222172+0000","last_active":"2024-09-13T06:09:24.222172+0000","last_peered":"2024-09-13T06:09:24.222172+0000","last_clean":"2024-09-13T06:09:24.222172+0000","last_became_active":"2024-09-13T06:09:22.217581+0000","last_became_peered":"2024-09-13T06:09:22.217581+0000","last_unstale":"2024-09-13T06:09:24.222172+0000","last_undegraded":"2024-09-13T06:09:24.222172+0000","last_fullsized":"2024-09-13T06:09:24.222172+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_clean_scrub_stamp":"2024-09-13T06:09:21.188659+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:02:07.684980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022711580000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T06:09:24.564407+0000","last_change":"2024-09-13T06:09:24.565111+0000","last_active":"2024-09-13T06:09:24.564407+0000","last_peered":"2024-09-13T06:09:24.564407+0000","last_clean":"2024-09-13T06:09:24.564407+0000","last_became_active":"2024-09-13T06:09:22.214952+0000","last_became_peered":"2024-09-13T06:09:22.214952+0000","last_unstale":"2024-09-13T06:09:24.564407+0000","last_undegraded":"2024-09-13T06:09:24.564407+0000","last_fullsized":"2024-09-13T06:09:24.564407+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_clean_scrub_stamp":"2024-09-13T06:09:21.188659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:20:29.599784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097860299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T06:09:24.220333+0000","last_change":"2024-09-13T06:09:24.220722+0000","last_active":"2024-09-13T06:09:24.220333+0000","last_peered":"2024-09-13T06:09:24.220333+0000","last_clean":"2024-09-13T06:09:24.220333+0000","last_became_active":"2024-09-13T06:09:22.217643+0000","last_became_peered":"2024-09-13T06:09:22.217643+0000","last_unstale":"2024-09-13T06:09:24.220333+0000","last_undegraded":"2024-09-13T06:09:24.220333+0000","last_fullsized":"2024-09-13T06:09:24.220333+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_clean_scrub_stamp":"2024-09-13T06:09:21.188659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:44:20.577838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082521999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"16'1","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T06:09:24.220232+0000","last_change":"2024-09-13T06:09:24.220777+0000","last_active":"2024-09-13T06:09:24.220232+0000","last_peered":"2024-09-13T06:09:24.220232+0000","last_clean":"2024-09-13T06:09:24.220232+0000","last_became_active":"2024-09-13T06:09:22.217131+0000","last_became_peered":"2024-09-13T06:09:22.217131+0000","last_unstale":"2024-09-13T06:09:24.220232+0000","last_undegraded":"2024-09-13T06:09:24.220232+0000","last_fullsized":"2024-09-13T06:09:24.220232+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_clean_scrub_stamp":"2024-09-13T06:09:21.188659+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:58:05.578609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090967000000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"14'117","reported_seq":170,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T06:09:24.215064+0000","last_change":"2024-09-13T06:09:19.565573+0000","last_active":"2024-09-13T06:09:24.215064+0000","last_peered":"2024-09-13T06:09:24.215064+0000","last_clean":"2024-09-13T06:09:24.215064+0000","last_became_active":"2024-09-13T06:09:19.561434+0000","last_became_peered":"2024-09-13T06:09:19.561434+0000","last_unstale":"2024-09-13T06:09:24.215064+0000","last_undegraded":"2024-09-13T06:09:24.215064+0000","last_fullsized":"2024-09-13T06:09:24.215064+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:18.163598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:18.163598+0000","last_clean_scrub_stamp":"2024-09-13T06:09:18.163598+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:04:43.437453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640262,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":159744,"data_stored":50297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640262,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":749568,"data_stored":640646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672967,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31920,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339920,"statfs":{"total":96636764160,"available":96604078080,"internally_reserved":0,"allocated":749568,"data_stored":640646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705668,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":159744,"data_stored":50297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T06:09:27.733 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-13T06:09:27.733 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-13T06:09:27.733 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-13T06:09:27.733 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-13T06:09:27.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.840+0000 7fcf5b30e640 1 Processor -- start 2024-09-13T06:09:27.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.840+0000 7fcf5b30e640 1 -- start start 2024-09-13T06:09:27.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.840+0000 7fcf5b30e640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fcf5406ece0 0x7fcf54130e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:27.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.840+0000 7fcf5b30e640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf5406f750 con 0x7fcf5406e1f0 2024-09-13T06:09:27.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.840+0000 7fcf5b30e640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fcf54070c10 con 0x7fcf5406ece0 2024-09-13T06:09:27.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.840+0000 7fcf588a9640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fcf5406ece0 0x7fcf54130e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:27.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.840+0000 7fcf590aa640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fcf5406e1f0 0x7fcf5406e5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:38492/0 (socket says 172.21.15.120:38492) 2024-09-13T06:09:27.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.840+0000 7fcf590aa640 1 -- 172.21.15.120:0/1065170326 learned_addr learned my addr 172.21.15.120:0/1065170326 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-13T06:09:27.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.840+0000 7fcf588a9640 1 -- 172.21.15.120:0/1065170326 >> v1:172.21.15.120:6789/0 conn(0x7fcf5406e1f0 legacy=0x7fcf5406e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:27.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.840+0000 7fcf588a9640 1 -- 172.21.15.120:0/1065170326 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf540703f0 con 0x7fcf5406ece0 2024-09-13T06:09:27.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.844+0000 7fcf588a9640 1 --2- 172.21.15.120:0/1065170326 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcf5406ece0 0x7fcf54130e50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcf50009740 tx=0x7fcf5001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdfa113ae11e02b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:27.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.844+0000 7fcf4bfff640 1 -- 172.21.15.120:0/1065170326 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf500b0070 con 0x7fcf5406ece0 2024-09-13T06:09:27.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.844+0000 7fcf4bfff640 1 -- 172.21.15.120:0/1065170326 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf500ab530 con 0x7fcf5406ece0 2024-09-13T06:09:27.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.844+0000 7fcf4bfff640 1 -- 172.21.15.120:0/1065170326 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf500ab830 con 0x7fcf5406ece0 2024-09-13T06:09:27.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.844+0000 7fcf5b30e640 1 -- 172.21.15.120:0/1065170326 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcf5406ece0 msgr2=0x7fcf54130e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:27.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.844+0000 7fcf5b30e640 1 --2- 172.21.15.120:0/1065170326 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcf5406ece0 0x7fcf54130e50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcf50009740 tx=0x7fcf5001c370 comp rx=0 tx=0).stop 2024-09-13T06:09:27.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.844+0000 7fcf5b30e640 1 -- 172.21.15.120:0/1065170326 shutdown_connections 2024-09-13T06:09:27.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.844+0000 7fcf5b30e640 1 --2- 172.21.15.120:0/1065170326 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcf5406ece0 0x7fcf54130e50 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:27.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.844+0000 7fcf5b30e640 1 -- 172.21.15.120:0/1065170326 >> 172.21.15.120:0/1065170326 conn(0x7fcf54099a50 msgr2=0x7fcf540972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:27.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.844+0000 7fcf5b30e640 1 -- 172.21.15.120:0/1065170326 shutdown_connections 2024-09-13T06:09:27.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.844+0000 7fcf5b30e640 1 -- 172.21.15.120:0/1065170326 wait complete. 2024-09-13T06:09:27.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.844+0000 7fcf5b30e640 1 Processor -- start 2024-09-13T06:09:27.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.844+0000 7fcf5b30e640 1 -- start start 2024-09-13T06:09:27.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.848+0000 7fcf5b30e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcf5406e1f0 0x7fcf5412b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:27.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.848+0000 7fcf5b30e640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fcf54133d30 con 0x7fcf5406e1f0 2024-09-13T06:09:27.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.848+0000 7fcf590aa640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcf5406e1f0 0x7fcf5412b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:27.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.848+0000 7fcf590aa640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcf5406e1f0 0x7fcf5412b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43722/0 (socket says 172.21.15.120:43722) 2024-09-13T06:09:27.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.848+0000 7fcf590aa640 1 -- 172.21.15.120:0/1913204373 learned_addr learned my addr 172.21.15.120:0/1913204373 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-13T06:09:27.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.848+0000 7fcf590aa640 1 -- 172.21.15.120:0/1913204373 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf54129670 con 0x7fcf5406e1f0 2024-09-13T06:09:27.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.848+0000 7fcf590aa640 1 --2- 172.21.15.120:0/1913204373 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcf5406e1f0 0x7fcf5412b840 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fcf4400c480 tx=0x7fcf4400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:27.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.848+0000 7fcf49ffb640 1 -- 172.21.15.120:0/1913204373 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf44017070 con 0x7fcf5406e1f0 2024-09-13T06:09:27.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.848+0000 7fcf49ffb640 1 -- 172.21.15.120:0/1913204373 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf44005c20 con 0x7fcf5406e1f0 2024-09-13T06:09:27.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.848+0000 7fcf5b30e640 1 -- 172.21.15.120:0/1913204373 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf5412afb0 con 0x7fcf5406e1f0 2024-09-13T06:09:27.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.848+0000 7fcf49ffb640 1 -- 172.21.15.120:0/1913204373 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf44007070 con 0x7fcf5406e1f0 2024-09-13T06:09:27.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.848+0000 7fcf5b30e640 1 -- 172.21.15.120:0/1913204373 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf5412bd80 con 0x7fcf5406e1f0 2024-09-13T06:09:27.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.848+0000 7fcf49ffb640 1 -- 172.21.15.120:0/1913204373 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fcf4401a070 con 0x7fcf5406e1f0 2024-09-13T06:09:27.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.848+0000 7fcf5b30e640 1 -- 172.21.15.120:0/1913204373 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf5406e5d0 con 0x7fcf5406e1f0 2024-09-13T06:09:27.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.848+0000 7fcf49ffb640 1 --2- 172.21.15.120:0/1913204373 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fcf38035db0 0x7fcf38038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:27.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.848+0000 7fcf49ffb640 1 -- 172.21.15.120:0/1913204373 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7fcf440479d0 con 0x7fcf5406e1f0 2024-09-13T06:09:27.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.848+0000 7fcf588a9640 1 --2- 172.21.15.120:0/1913204373 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fcf38035db0 0x7fcf38038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:27.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.848+0000 7fcf588a9640 1 --2- 172.21.15.120:0/1913204373 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fcf38035db0 0x7fcf38038270 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fcf500ad000 tx=0x7fcf500a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:27.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:27.852+0000 7fcf49ffb640 1 -- 172.21.15.120:0/1913204373 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fcf44007210 con 0x7fcf5406e1f0 2024-09-13T06:09:28.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:28.036+0000 7fcf5b30e640 1 -- 172.21.15.120:0/1913204373 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fcf54073790 con 0x7fcf5406e1f0 2024-09-13T06:09:28.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:28.036+0000 7fcf49ffb640 1 -- 172.21.15.120:0/1913204373 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fcf4401b3b0 con 0x7fcf5406e1f0 2024-09-13T06:09:28.034 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T06:09:28.035 INFO:teuthology.orchestra.run.smithi120.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-13T06:09:28.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:28.036+0000 7fcf5b30e640 1 -- 172.21.15.120:0/1913204373 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fcf38035db0 msgr2=0x7fcf38038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:28.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:28.036+0000 7fcf5b30e640 1 --2- 172.21.15.120:0/1913204373 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fcf38035db0 0x7fcf38038270 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fcf500ad000 tx=0x7fcf500a6000 comp rx=0 tx=0).stop 2024-09-13T06:09:28.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:28.036+0000 7fcf5b30e640 1 -- 172.21.15.120:0/1913204373 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcf5406e1f0 msgr2=0x7fcf5412b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:28.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:28.036+0000 7fcf5b30e640 1 --2- 172.21.15.120:0/1913204373 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcf5406e1f0 0x7fcf5412b840 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fcf4400c480 tx=0x7fcf4400c940 comp rx=0 tx=0).stop 2024-09-13T06:09:28.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:28.036+0000 7fcf5b30e640 1 -- 172.21.15.120:0/1913204373 shutdown_connections 2024-09-13T06:09:28.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:28.036+0000 7fcf5b30e640 1 --2- 172.21.15.120:0/1913204373 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fcf38035db0 0x7fcf38038270 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:28.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:28.036+0000 7fcf5b30e640 1 --2- 172.21.15.120:0/1913204373 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcf5406e1f0 0x7fcf5412b840 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:28.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:28.036+0000 7fcf5b30e640 1 -- 172.21.15.120:0/1913204373 >> 172.21.15.120:0/1913204373 conn(0x7fcf54099a50 msgr2=0x7fcf5406d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:28.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:28.040+0000 7fcf5b30e640 1 -- 172.21.15.120:0/1913204373 shutdown_connections 2024-09-13T06:09:28.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:09:28.040+0000 7fcf5b30e640 1 -- 172.21.15.120:0/1913204373 wait complete. 2024-09-13T06:09:28.051 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-13T06:09:28.052 INFO:teuthology.run_tasks:Running task rgw... 2024-09-13T06:09:28.066 DEBUG:tasks.rgw:config is {'client.0': None} 2024-09-13T06:09:28.066 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-13T06:09:28.067 INFO:tasks.rgw:Creating data pools 2024-09-13T06:09:28.067 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-13T06:09:28.067 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph osd erasure-code-profile set client.0 crush-failure-domain=osd k=3 m=1 name=testprofile --cluster ceph 2024-09-13T06:09:28.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:28.199+0000 7fe3cc45e640 1 Processor -- start 2024-09-13T06:09:28.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:28.199+0000 7fe3cc45e640 1 -- start start 2024-09-13T06:09:28.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:28.199+0000 7fe3cc45e640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe3c41170c0 0x7fe3c41194b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:28.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:28.199+0000 7fe3cc45e640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3c4119ae0 con 0x7fe3c41144c0 2024-09-13T06:09:28.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:28.199+0000 7fe3cc45e640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fe3c40732b0 con 0x7fe3c41170c0 2024-09-13T06:09:28.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:28.199+0000 7fe3c99f9640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe3c41170c0 0x7fe3c41194b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:28.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:28.199+0000 7fe3c99f9640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe3c41170c0 0x7fe3c41194b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:60868/0 (socket says 172.21.15.194:60868) 2024-09-13T06:09:28.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:28.199+0000 7fe3ca1fa640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fe3c41144c0 0x7fe3c41148c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:35856/0 (socket says 172.21.15.194:35856) 2024-09-13T06:09:28.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:28.199+0000 7fe3c99f9640 1 -- 172.21.15.194:0/3665190571 learned_addr learned my addr 172.21.15.194:0/3665190571 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:28.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:28.199+0000 7fe3c99f9640 1 -- 172.21.15.194:0/3665190571 >> v1:172.21.15.120:6789/0 conn(0x7fe3c41144c0 legacy=0x7fe3c41148c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:28.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:28.199+0000 7fe3c99f9640 1 -- 172.21.15.194:0/3665190571 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3c4073460 con 0x7fe3c41170c0 2024-09-13T06:09:28.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:28.203+0000 7fe3c99f9640 1 --2- 172.21.15.194:0/3665190571 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe3c41170c0 0x7fe3c41194b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe3b40097f0 tx=0x7fe3b401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11a99ee2675628be server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:28.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:28.203+0000 7fe3c91f8640 1 -- 172.21.15.194:0/3665190571 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3b40ab580 con 0x7fe3c41170c0 2024-09-13T06:09:28.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:28.203+0000 7fe3c91f8640 1 -- 172.21.15.194:0/3665190571 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3b40b0070 con 0x7fe3c41170c0 2024-09-13T06:09:28.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:28.203+0000 7fe3c91f8640 1 -- 172.21.15.194:0/3665190571 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3b40ab870 con 0x7fe3c41170c0 2024-09-13T06:09:28.205 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:28.203+0000 7fe3cc45e640 1 -- 172.21.15.194:0/3665190571 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe3c41170c0 msgr2=0x7fe3c41194b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:28.205 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:28.203+0000 7fe3cc45e640 1 --2- 172.21.15.194:0/3665190571 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe3c41170c0 0x7fe3c41194b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe3b40097f0 tx=0x7fe3b401c430 comp rx=0 tx=0).stop 2024-09-13T06:09:28.206 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:28.203+0000 7fe3cc45e640 1 -- 172.21.15.194:0/3665190571 shutdown_connections 2024-09-13T06:09:28.206 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:28.203+0000 7fe3cc45e640 1 --2- 172.21.15.194:0/3665190571 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe3c41170c0 0x7fe3c41194b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:28.206 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:28.203+0000 7fe3cc45e640 1 -- 172.21.15.194:0/3665190571 >> 172.21.15.194:0/3665190571 conn(0x7fe3c406f370 msgr2=0x7fe3c4071790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:28.206 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:28.203+0000 7fe3cc45e640 1 -- 172.21.15.194:0/3665190571 shutdown_connections 2024-09-13T06:09:28.206 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:28.203+0000 7fe3cc45e640 1 -- 172.21.15.194:0/3665190571 wait complete. 2024-09-13T06:09:28.206 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:28.203+0000 7fe3cc45e640 1 Processor -- start 2024-09-13T06:09:28.206 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:28.203+0000 7fe3cc45e640 1 -- start start 2024-09-13T06:09:28.206 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:28.203+0000 7fe3cc45e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe3c41144c0 0x7fe3c41af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:28.206 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:28.203+0000 7fe3cc45e640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fe3c411a9e0 con 0x7fe3c41144c0 2024-09-13T06:09:28.206 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:28.203+0000 7fe3ca1fa640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe3c41144c0 0x7fe3c41af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:28.206 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:28.203+0000 7fe3ca1fa640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe3c41144c0 0x7fe3c41af3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:60880/0 (socket says 172.21.15.194:60880) 2024-09-13T06:09:28.206 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:28.203+0000 7fe3ca1fa640 1 -- 172.21.15.194:0/610382539 learned_addr learned my addr 172.21.15.194:0/610382539 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:28.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:28.203+0000 7fe3ca1fa640 1 -- 172.21.15.194:0/610382539 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3c41af970 con 0x7fe3c41144c0 2024-09-13T06:09:28.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:28.203+0000 7fe3ca1fa640 1 --2- 172.21.15.194:0/610382539 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe3c41144c0 0x7fe3c41af3a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe3c000c480 tx=0x7fe3c000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:28.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:28.203+0000 7fe3baffd640 1 -- 172.21.15.194:0/610382539 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3c0018070 con 0x7fe3c41144c0 2024-09-13T06:09:28.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:28.207+0000 7fe3baffd640 1 -- 172.21.15.194:0/610382539 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3c00073b0 con 0x7fe3c41144c0 2024-09-13T06:09:28.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:28.207+0000 7fe3cc45e640 1 -- 172.21.15.194:0/610382539 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3c41afc00 con 0x7fe3c41144c0 2024-09-13T06:09:28.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:28.207+0000 7fe3baffd640 1 -- 172.21.15.194:0/610382539 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3c0007690 con 0x7fe3c41144c0 2024-09-13T06:09:28.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:28.207+0000 7fe3cc45e640 1 -- 172.21.15.194:0/610382539 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3c41a9610 con 0x7fe3c41144c0 2024-09-13T06:09:28.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:28.207+0000 7fe3cc45e640 1 -- 172.21.15.194:0/610382539 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3c41148c0 con 0x7fe3c41144c0 2024-09-13T06:09:28.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:28.207+0000 7fe3baffd640 1 -- 172.21.15.194:0/610382539 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe3c001b070 con 0x7fe3c41144c0 2024-09-13T06:09:28.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:28.207+0000 7fe3baffd640 1 --2- 172.21.15.194:0/610382539 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fe3a8035d60 0x7fe3a8038220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:28.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:28.207+0000 7fe3baffd640 1 -- 172.21.15.194:0/610382539 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7fe3c0047b80 con 0x7fe3c41144c0 2024-09-13T06:09:28.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:28.207+0000 7fe3c99f9640 1 --2- 172.21.15.194:0/610382539 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fe3a8035d60 0x7fe3a8038220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:28.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:28.207+0000 7fe3c99f9640 1 --2- 172.21.15.194:0/610382539 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fe3a8035d60 0x7fe3a8038220 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe3b40af000 tx=0x7fe3b40a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:28.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:28.219+0000 7fe3baffd640 1 -- 172.21.15.194:0/610382539 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe3c0045b20 con 0x7fe3c41144c0 2024-09-13T06:09:28.385 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:28.383+0000 7fe3cc45e640 1 -- 172.21.15.194:0/610382539 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["crush-failure-domain=osd", "k=3", "m=1", "name=testprofile"]} v 0) -- 0x7fe3c41afe30 con 0x7fe3c41144c0 2024-09-13T06:09:29.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:29.227+0000 7fe3baffd640 1 -- 172.21.15.194:0/610382539 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["crush-failure-domain=osd", "k=3", "m=1", "name=testprofile"]}]=0 v19) ==== 171+0+0 (secure 0 0 0) 0x7fe3c0045ea0 con 0x7fe3c41144c0 2024-09-13T06:09:29.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:29.231+0000 7fe3cc45e640 1 -- 172.21.15.194:0/610382539 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fe3a8035d60 msgr2=0x7fe3a8038220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:29.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:29.231+0000 7fe3cc45e640 1 --2- 172.21.15.194:0/610382539 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fe3a8035d60 0x7fe3a8038220 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe3b40af000 tx=0x7fe3b40a7000 comp rx=0 tx=0).stop 2024-09-13T06:09:29.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:29.231+0000 7fe3cc45e640 1 -- 172.21.15.194:0/610382539 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe3c41144c0 msgr2=0x7fe3c41af3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:29.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:29.231+0000 7fe3cc45e640 1 --2- 172.21.15.194:0/610382539 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe3c41144c0 0x7fe3c41af3a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe3c000c480 tx=0x7fe3c000c940 comp rx=0 tx=0).stop 2024-09-13T06:09:29.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:29.231+0000 7fe3cc45e640 1 -- 172.21.15.194:0/610382539 shutdown_connections 2024-09-13T06:09:29.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:29.231+0000 7fe3cc45e640 1 --2- 172.21.15.194:0/610382539 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fe3a8035d60 0x7fe3a8038220 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:29.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:29.231+0000 7fe3cc45e640 1 --2- 172.21.15.194:0/610382539 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe3c41144c0 0x7fe3c41af3a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:29.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:29.231+0000 7fe3cc45e640 1 -- 172.21.15.194:0/610382539 >> 172.21.15.194:0/610382539 conn(0x7fe3c406f370 msgr2=0x7fe3c411ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:29.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:29.231+0000 7fe3cc45e640 1 -- 172.21.15.194:0/610382539 shutdown_connections 2024-09-13T06:09:29.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:29.231+0000 7fe3cc45e640 1 -- 172.21.15.194:0/610382539 wait complete. 2024-09-13T06:09:29.254 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-09-13T06:09:29.383 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:29.379+0000 7f494a0fe640 1 Processor -- start 2024-09-13T06:09:29.383 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:29.379+0000 7f494a0fe640 1 -- start start 2024-09-13T06:09:29.383 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:29.383+0000 7f494a0fe640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f4944111bd0 0x7f49440732b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:29.383 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:29.383+0000 7f494a0fe640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4944073d60 con 0x7f49440737f0 2024-09-13T06:09:29.383 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:29.383+0000 7f494a0fe640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f4944073f30 con 0x7f4944111bd0 2024-09-13T06:09:29.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:29.383+0000 7f49437fe640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f4944111bd0 0x7f49440732b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:29.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:29.383+0000 7f4942ffd640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f49440737f0 0x7f494411c500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:35868/0 (socket says 172.21.15.194:35868) 2024-09-13T06:09:29.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:29.383+0000 7f4942ffd640 1 -- 172.21.15.194:0/186871011 learned_addr learned my addr 172.21.15.194:0/186871011 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-09-13T06:09:29.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:29.383+0000 7f49437fe640 1 -- 172.21.15.194:0/186871011 >> v1:172.21.15.120:6789/0 conn(0x7f49440737f0 legacy=0x7f494411c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:29.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:29.383+0000 7f49437fe640 1 -- 172.21.15.194:0/186871011 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49440740e0 con 0x7f4944111bd0 2024-09-13T06:09:29.386 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:29.387+0000 7f49437fe640 1 --2- 172.21.15.194:0/186871011 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4944111bd0 0x7f49440732b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4934009740 tx=0x7f493401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbe7434ec84e01d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:29.387 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:29.387+0000 7f49427fc640 1 -- 172.21.15.194:0/186871011 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49340b1070 con 0x7f4944111bd0 2024-09-13T06:09:29.387 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:29.387+0000 7f49427fc640 1 -- 172.21.15.194:0/186871011 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49340ac520 con 0x7f4944111bd0 2024-09-13T06:09:29.387 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:29.387+0000 7f49427fc640 1 -- 172.21.15.194:0/186871011 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49340ac820 con 0x7f4944111bd0 2024-09-13T06:09:29.388 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:29.387+0000 7f494a0fe640 1 -- 172.21.15.194:0/186871011 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4944111bd0 msgr2=0x7f49440732b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:29.388 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:29.387+0000 7f494a0fe640 1 --2- 172.21.15.194:0/186871011 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4944111bd0 0x7f49440732b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4934009740 tx=0x7f493401c370 comp rx=0 tx=0).stop 2024-09-13T06:09:29.388 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:29.387+0000 7f494a0fe640 1 -- 172.21.15.194:0/186871011 shutdown_connections 2024-09-13T06:09:29.388 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:29.387+0000 7f494a0fe640 1 --2- 172.21.15.194:0/186871011 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4944111bd0 0x7f49440732b0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:29.388 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:29.387+0000 7f494a0fe640 1 -- 172.21.15.194:0/186871011 >> 172.21.15.194:0/186871011 conn(0x7f494406f370 msgr2=0x7f4944071790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:29.388 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:29.387+0000 7f494a0fe640 1 -- 172.21.15.194:0/186871011 shutdown_connections 2024-09-13T06:09:29.388 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:29.387+0000 7f494a0fe640 1 -- 172.21.15.194:0/186871011 wait complete. 2024-09-13T06:09:29.389 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:29.387+0000 7f494a0fe640 1 Processor -- start 2024-09-13T06:09:29.389 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:29.387+0000 7f494a0fe640 1 -- start start 2024-09-13T06:09:29.389 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:29.387+0000 7f494a0fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f49440737f0 0x7f49441af060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:29.389 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:29.387+0000 7f494a0fe640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f494411e8b0 con 0x7f49440737f0 2024-09-13T06:09:29.390 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:29.387+0000 7f49437fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f49440737f0 0x7f49441af060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:29.390 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:29.387+0000 7f49437fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f49440737f0 0x7f49441af060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:60904/0 (socket says 172.21.15.194:60904) 2024-09-13T06:09:29.390 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:29.387+0000 7f49437fe640 1 -- 172.21.15.194:0/3758358066 learned_addr learned my addr 172.21.15.194:0/3758358066 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:29.390 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:29.387+0000 7f49437fe640 1 -- 172.21.15.194:0/3758358066 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49441af630 con 0x7f49440737f0 2024-09-13T06:09:29.390 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:29.387+0000 7f49437fe640 1 --2- 172.21.15.194:0/3758358066 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f49440737f0 0x7f49441af060 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f49340af040 tx=0x7f493401abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:29.391 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:29.391+0000 7f492bfff640 1 -- 172.21.15.194:0/3758358066 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49340b1050 con 0x7f49440737f0 2024-09-13T06:09:29.391 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:29.391+0000 7f492bfff640 1 -- 172.21.15.194:0/3758358066 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49340b2040 con 0x7f49440737f0 2024-09-13T06:09:29.391 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:29.391+0000 7f492bfff640 1 -- 172.21.15.194:0/3758358066 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49340aba40 con 0x7f49440737f0 2024-09-13T06:09:29.391 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:29.391+0000 7f494a0fe640 1 -- 172.21.15.194:0/3758358066 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49441af860 con 0x7f49440737f0 2024-09-13T06:09:29.391 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:29.391+0000 7f494a0fe640 1 -- 172.21.15.194:0/3758358066 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49441a9100 con 0x7f49440737f0 2024-09-13T06:09:29.392 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:29.391+0000 7f494a0fe640 1 -- 172.21.15.194:0/3758358066 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49440732b0 con 0x7f49440737f0 2024-09-13T06:09:29.392 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:29.391+0000 7f492bfff640 1 -- 172.21.15.194:0/3758358066 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f49340bf030 con 0x7f49440737f0 2024-09-13T06:09:29.392 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:29.391+0000 7f492bfff640 1 --2- 172.21.15.194:0/3758358066 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4930035db0 0x7f4930038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:29.392 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:29.391+0000 7f492bfff640 1 -- 172.21.15.194:0/3758358066 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3825+0+0 (secure 0 0 0) 0x7f49340bd070 con 0x7f49440737f0 2024-09-13T06:09:29.392 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:29.391+0000 7f4942ffd640 1 --2- 172.21.15.194:0/3758358066 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4930035db0 0x7f4930038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:29.393 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:29.391+0000 7f4942ffd640 1 --2- 172.21.15.194:0/3758358066 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4930035db0 0x7f4930038270 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4938001610 tx=0x7f4938007ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:29.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:29.403+0000 7f492bfff640 1 -- 172.21.15.194:0/3758358066 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f49340c6060 con 0x7f49440737f0 2024-09-13T06:09:29.570 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:29.567+0000 7f494a0fe640 1 -- 172.21.15.194:0/3758358066 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"} v 0) -- 0x7f4944111bd0 con 0x7f49440737f0 2024-09-13T06:09:31.061 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:31.059+0000 7f492bfff640 1 -- 172.21.15.194:0/3758358066 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"}]=0 pool 'default.rgw.buckets.data' created v21) ==== 227+0+0 (secure 0 0 0) 0x7f49440740e0 con 0x7f49440737f0 2024-09-13T06:09:31.061 INFO:teuthology.orchestra.run.smithi194.stderr:pool 'default.rgw.buckets.data' created 2024-09-13T06:09:31.064 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:31.063+0000 7f494a0fe640 1 -- 172.21.15.194:0/3758358066 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4930035db0 msgr2=0x7f4930038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:31.064 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:31.063+0000 7f494a0fe640 1 --2- 172.21.15.194:0/3758358066 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4930035db0 0x7f4930038270 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4938001610 tx=0x7f4938007ad0 comp rx=0 tx=0).stop 2024-09-13T06:09:31.064 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:31.063+0000 7f494a0fe640 1 -- 172.21.15.194:0/3758358066 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f49440737f0 msgr2=0x7f49441af060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:31.064 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:31.063+0000 7f494a0fe640 1 --2- 172.21.15.194:0/3758358066 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f49440737f0 0x7f49441af060 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f49340af040 tx=0x7f493401abb0 comp rx=0 tx=0).stop 2024-09-13T06:09:31.064 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:31.063+0000 7f494a0fe640 1 -- 172.21.15.194:0/3758358066 shutdown_connections 2024-09-13T06:09:31.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:31.063+0000 7f494a0fe640 1 --2- 172.21.15.194:0/3758358066 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4930035db0 0x7f4930038270 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:31.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:31.063+0000 7f494a0fe640 1 --2- 172.21.15.194:0/3758358066 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f49440737f0 0x7f49441af060 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:31.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:31.063+0000 7f494a0fe640 1 -- 172.21.15.194:0/3758358066 >> 172.21.15.194:0/3758358066 conn(0x7f494406f370 msgr2=0x7f49440710c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:31.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:31.063+0000 7f494a0fe640 1 -- 172.21.15.194:0/3758358066 shutdown_connections 2024-09-13T06:09:31.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:31.063+0000 7f494a0fe640 1 -- 172.21.15.194:0/3758358066 wait complete. 2024-09-13T06:09:31.094 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-13T06:09:31.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:31.215+0000 7fcfb7fdf640 1 Processor -- start 2024-09-13T06:09:31.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:31.215+0000 7fcfb7fdf640 1 -- start start 2024-09-13T06:09:31.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:31.215+0000 7fcfb7fdf640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fcfb011ad80 0x7fcfb011d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:31.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:31.215+0000 7fcfb7fdf640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfb011d6b0 con 0x7fcfb0112010 2024-09-13T06:09:31.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:31.215+0000 7fcfb7fdf640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fcfb011e890 con 0x7fcfb011ad80 2024-09-13T06:09:31.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:31.215+0000 7fcfb557a640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fcfb011ad80 0x7fcfb011d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:31.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:31.215+0000 7fcfb557a640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fcfb011ad80 0x7fcfb011d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:60910/0 (socket says 172.21.15.194:60910) 2024-09-13T06:09:31.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:31.215+0000 7fcfb5d7b640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fcfb0112010 0x7fcfb01123f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:35874/0 (socket says 172.21.15.194:35874) 2024-09-13T06:09:31.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:31.215+0000 7fcfb557a640 1 -- 172.21.15.194:0/1770118885 learned_addr learned my addr 172.21.15.194:0/1770118885 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:31.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:31.215+0000 7fcfb557a640 1 -- 172.21.15.194:0/1770118885 >> v1:172.21.15.120:6789/0 conn(0x7fcfb0112010 legacy=0x7fcfb01123f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:31.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:31.215+0000 7fcfb557a640 1 -- 172.21.15.194:0/1770118885 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfb011ea10 con 0x7fcfb011ad80 2024-09-13T06:09:31.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:31.219+0000 7fcfb557a640 1 --2- 172.21.15.194:0/1770118885 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcfb011ad80 0x7fcfb011d170 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcfa00097f0 tx=0x7fcfa001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e88bee42d362a764 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:31.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:31.219+0000 7fcfb4d79640 1 -- 172.21.15.194:0/1770118885 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfa00ab580 con 0x7fcfb011ad80 2024-09-13T06:09:31.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:31.219+0000 7fcfb4d79640 1 -- 172.21.15.194:0/1770118885 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfa00b0070 con 0x7fcfb011ad80 2024-09-13T06:09:31.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:31.219+0000 7fcfb4d79640 1 -- 172.21.15.194:0/1770118885 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfa00ab870 con 0x7fcfb011ad80 2024-09-13T06:09:31.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:31.219+0000 7fcfb7fdf640 1 -- 172.21.15.194:0/1770118885 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcfb011ad80 msgr2=0x7fcfb011d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:31.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:31.219+0000 7fcfb7fdf640 1 --2- 172.21.15.194:0/1770118885 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcfb011ad80 0x7fcfb011d170 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcfa00097f0 tx=0x7fcfa001c430 comp rx=0 tx=0).stop 2024-09-13T06:09:31.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:31.219+0000 7fcfb7fdf640 1 -- 172.21.15.194:0/1770118885 shutdown_connections 2024-09-13T06:09:31.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:31.219+0000 7fcfb7fdf640 1 --2- 172.21.15.194:0/1770118885 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcfb011ad80 0x7fcfb011d170 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:31.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:31.219+0000 7fcfb7fdf640 1 -- 172.21.15.194:0/1770118885 >> 172.21.15.194:0/1770118885 conn(0x7fcfb006e5a0 msgr2=0x7fcfb006e9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:31.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:31.219+0000 7fcfb7fdf640 1 -- 172.21.15.194:0/1770118885 shutdown_connections 2024-09-13T06:09:31.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:31.219+0000 7fcfb7fdf640 1 -- 172.21.15.194:0/1770118885 wait complete. 2024-09-13T06:09:31.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:31.219+0000 7fcfb7fdf640 1 Processor -- start 2024-09-13T06:09:31.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:31.219+0000 7fcfb7fdf640 1 -- start start 2024-09-13T06:09:31.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:31.219+0000 7fcfb7fdf640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcfb0112010 0x7fcfb01aef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:31.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:31.219+0000 7fcfb7fdf640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb011e580 con 0x7fcfb0112010 2024-09-13T06:09:31.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:31.219+0000 7fcfb5d7b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcfb0112010 0x7fcfb01aef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:31.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:31.219+0000 7fcfb5d7b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcfb0112010 0x7fcfb01aef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:60924/0 (socket says 172.21.15.194:60924) 2024-09-13T06:09:31.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:31.219+0000 7fcfb5d7b640 1 -- 172.21.15.194:0/1918067673 learned_addr learned my addr 172.21.15.194:0/1918067673 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:31.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:31.219+0000 7fcfb5d7b640 1 -- 172.21.15.194:0/1918067673 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfb01af4f0 con 0x7fcfb0112010 2024-09-13T06:09:31.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:31.223+0000 7fcfb5d7b640 1 --2- 172.21.15.194:0/1918067673 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcfb0112010 0x7fcfb01aef20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fcfac00c480 tx=0x7fcfac00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:31.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:31.223+0000 7fcfa67fc640 1 -- 172.21.15.194:0/1918067673 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfac018070 con 0x7fcfb0112010 2024-09-13T06:09:31.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:31.223+0000 7fcfa67fc640 1 -- 172.21.15.194:0/1918067673 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfac0073b0 con 0x7fcfb0112010 2024-09-13T06:09:31.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:31.223+0000 7fcfa67fc640 1 -- 172.21.15.194:0/1918067673 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfac007690 con 0x7fcfb0112010 2024-09-13T06:09:31.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:31.223+0000 7fcfb7fdf640 1 -- 172.21.15.194:0/1918067673 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfb01af780 con 0x7fcfb0112010 2024-09-13T06:09:31.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:31.223+0000 7fcfb7fdf640 1 -- 172.21.15.194:0/1918067673 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfb01a9190 con 0x7fcfb0112010 2024-09-13T06:09:31.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:31.223+0000 7fcfb7fdf640 1 -- 172.21.15.194:0/1918067673 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfb0112470 con 0x7fcfb0112010 2024-09-13T06:09:31.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:31.223+0000 7fcfa67fc640 1 -- 172.21.15.194:0/1918067673 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fcfac01b070 con 0x7fcfb0112010 2024-09-13T06:09:31.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:31.223+0000 7fcfa67fc640 1 --2- 172.21.15.194:0/1918067673 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fcf94035db0 0x7fcf94038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:31.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:31.223+0000 7fcfa67fc640 1 -- 172.21.15.194:0/1918067673 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 4272+0+0 (secure 0 0 0) 0x7fcfac048130 con 0x7fcfb0112010 2024-09-13T06:09:31.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:31.223+0000 7fcfb557a640 1 --2- 172.21.15.194:0/1918067673 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fcf94035db0 0x7fcf94038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:31.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:31.223+0000 7fcfb557a640 1 --2- 172.21.15.194:0/1918067673 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fcf94035db0 0x7fcf94038270 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fcfa00af000 tx=0x7fcfa00a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:31.238 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:31.235+0000 7fcfa67fc640 1 -- 172.21.15.194:0/1918067673 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fcfac045e20 con 0x7fcfb0112010 2024-09-13T06:09:31.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:31.403+0000 7fcfb7fdf640 1 -- 172.21.15.194:0/1918067673 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"} v 0) -- 0x7fcfb01af9b0 con 0x7fcfb0112010 2024-09-13T06:09:32.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:32.067+0000 7fcfa67fc640 1 -- 172.21.15.194:0/1918067673 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.data' v22) ==== 185+0+0 (secure 0 0 0) 0x7fcfac0461a0 con 0x7fcfb0112010 2024-09-13T06:09:32.067 INFO:teuthology.orchestra.run.smithi194.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-13T06:09:32.070 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:32.067+0000 7fcfb7fdf640 1 -- 172.21.15.194:0/1918067673 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fcf94035db0 msgr2=0x7fcf94038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:32.070 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:32.067+0000 7fcfb7fdf640 1 --2- 172.21.15.194:0/1918067673 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fcf94035db0 0x7fcf94038270 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fcfa00af000 tx=0x7fcfa00a7000 comp rx=0 tx=0).stop 2024-09-13T06:09:32.070 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:32.067+0000 7fcfb7fdf640 1 -- 172.21.15.194:0/1918067673 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcfb0112010 msgr2=0x7fcfb01aef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:32.070 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:32.067+0000 7fcfb7fdf640 1 --2- 172.21.15.194:0/1918067673 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcfb0112010 0x7fcfb01aef20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fcfac00c480 tx=0x7fcfac00c940 comp rx=0 tx=0).stop 2024-09-13T06:09:32.070 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:32.067+0000 7fcfb7fdf640 1 -- 172.21.15.194:0/1918067673 shutdown_connections 2024-09-13T06:09:32.070 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:32.067+0000 7fcfb7fdf640 1 --2- 172.21.15.194:0/1918067673 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fcf94035db0 0x7fcf94038270 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:32.071 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:32.067+0000 7fcfb7fdf640 1 --2- 172.21.15.194:0/1918067673 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcfb0112010 0x7fcfb01aef20 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:32.071 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:32.067+0000 7fcfb7fdf640 1 -- 172.21.15.194:0/1918067673 >> 172.21.15.194:0/1918067673 conn(0x7fcfb006e5a0 msgr2=0x7fcfb010f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:32.071 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:32.067+0000 7fcfb7fdf640 1 -- 172.21.15.194:0/1918067673 shutdown_connections 2024-09-13T06:09:32.071 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:32.067+0000 7fcfb7fdf640 1 -- 172.21.15.194:0/1918067673 wait complete. 2024-09-13T06:09:32.126 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-13T06:09:32.252 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:32.251+0000 7f2e07046640 1 Processor -- start 2024-09-13T06:09:32.252 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:32.251+0000 7f2e07046640 1 -- start start 2024-09-13T06:09:32.252 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:32.251+0000 7f2e07046640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f2e00115b80 0x7f2e00115f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:32.252 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:32.251+0000 7f2e07046640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e00114590 con 0x7f2e00113960 2024-09-13T06:09:32.252 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:32.251+0000 7f2e07046640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f2e00122cf0 con 0x7f2e00115b80 2024-09-13T06:09:32.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:32.251+0000 7f2e04de2640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f2e00115b80 0x7f2e00115f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:32.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:32.251+0000 7f2dfffff640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f2e00113960 0x7f2e00113df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:35882/0 (socket says 172.21.15.194:35882) 2024-09-13T06:09:32.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:32.251+0000 7f2dfffff640 1 -- 172.21.15.194:0/1014016366 learned_addr learned my addr 172.21.15.194:0/1014016366 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-09-13T06:09:32.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:32.251+0000 7f2e04de2640 1 -- 172.21.15.194:0/1014016366 >> v1:172.21.15.120:6789/0 conn(0x7f2e00113960 legacy=0x7f2e00113df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:32.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:32.251+0000 7f2e04de2640 1 -- 172.21.15.194:0/1014016366 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e00122e70 con 0x7f2e00115b80 2024-09-13T06:09:32.256 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:32.255+0000 7f2e04de2640 1 --2- 172.21.15.194:0/1014016366 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2e00115b80 0x7f2e00115f60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2df4009740 tx=0x7f2df401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1a3e74ad8bf5226 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:32.256 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:32.255+0000 7f2dff7fe640 1 -- 172.21.15.194:0/1014016366 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2df40b1070 con 0x7f2e00115b80 2024-09-13T06:09:32.256 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:32.255+0000 7f2dff7fe640 1 -- 172.21.15.194:0/1014016366 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2df40ac520 con 0x7f2e00115b80 2024-09-13T06:09:32.256 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:32.255+0000 7f2dff7fe640 1 -- 172.21.15.194:0/1014016366 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2df40ac820 con 0x7f2e00115b80 2024-09-13T06:09:32.258 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:32.255+0000 7f2e07046640 1 -- 172.21.15.194:0/1014016366 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2e00115b80 msgr2=0x7f2e00115f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:32.258 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:32.255+0000 7f2e07046640 1 --2- 172.21.15.194:0/1014016366 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2e00115b80 0x7f2e00115f60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2df4009740 tx=0x7f2df401c370 comp rx=0 tx=0).stop 2024-09-13T06:09:32.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:32.255+0000 7f2e07046640 1 -- 172.21.15.194:0/1014016366 shutdown_connections 2024-09-13T06:09:32.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:32.255+0000 7f2e07046640 1 --2- 172.21.15.194:0/1014016366 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2e00115b80 0x7f2e00115f60 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:32.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:32.255+0000 7f2e07046640 1 -- 172.21.15.194:0/1014016366 >> 172.21.15.194:0/1014016366 conn(0x7f2e0006f390 msgr2=0x7f2e000717b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:32.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:32.255+0000 7f2e07046640 1 -- 172.21.15.194:0/1014016366 shutdown_connections 2024-09-13T06:09:32.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:32.255+0000 7f2e07046640 1 -- 172.21.15.194:0/1014016366 wait complete. 2024-09-13T06:09:32.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:32.255+0000 7f2e07046640 1 Processor -- start 2024-09-13T06:09:32.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:32.255+0000 7f2e07046640 1 -- start start 2024-09-13T06:09:32.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:32.255+0000 7f2e07046640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2e00113960 0x7f2e001b3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:32.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:32.255+0000 7f2e07046640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f2e00113310 con 0x7f2e00113960 2024-09-13T06:09:32.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:32.255+0000 7f2e04de2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2e00113960 0x7f2e001b3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:32.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:32.259+0000 7f2e04de2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2e00113960 0x7f2e001b3390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:60944/0 (socket says 172.21.15.194:60944) 2024-09-13T06:09:32.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:32.259+0000 7f2e04de2640 1 -- 172.21.15.194:0/3598432633 learned_addr learned my addr 172.21.15.194:0/3598432633 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:32.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:32.259+0000 7f2e04de2640 1 -- 172.21.15.194:0/3598432633 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e001b3960 con 0x7f2e00113960 2024-09-13T06:09:32.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:32.259+0000 7f2e04de2640 1 --2- 172.21.15.194:0/3598432633 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2e00113960 0x7f2e001b3390 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2df40af040 tx=0x7f2df401abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:32.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:32.259+0000 7f2dfd7fa640 1 -- 172.21.15.194:0/3598432633 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2df40b1050 con 0x7f2e00113960 2024-09-13T06:09:32.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:32.259+0000 7f2dfd7fa640 1 -- 172.21.15.194:0/3598432633 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2df40b2040 con 0x7f2e00113960 2024-09-13T06:09:32.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:32.259+0000 7f2e07046640 1 -- 172.21.15.194:0/3598432633 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e001b3b90 con 0x7f2e00113960 2024-09-13T06:09:32.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:32.259+0000 7f2dfd7fa640 1 -- 172.21.15.194:0/3598432633 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2df40aba40 con 0x7f2e00113960 2024-09-13T06:09:32.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:32.259+0000 7f2e07046640 1 -- 172.21.15.194:0/3598432633 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e001ad430 con 0x7f2e00113960 2024-09-13T06:09:32.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:32.259+0000 7f2e07046640 1 -- 172.21.15.194:0/3598432633 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e00115b80 con 0x7f2e00113960 2024-09-13T06:09:32.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:32.259+0000 7f2dfd7fa640 1 -- 172.21.15.194:0/3598432633 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f2df40bf030 con 0x7f2e00113960 2024-09-13T06:09:32.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:32.259+0000 7f2dfd7fa640 1 --2- 172.21.15.194:0/3598432633 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f2dec035d60 0x7f2dec038220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:32.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:32.259+0000 7f2dfd7fa640 1 -- 172.21.15.194:0/3598432633 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 4283+0+0 (secure 0 0 0) 0x7f2df40bd070 con 0x7f2e00113960 2024-09-13T06:09:32.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:32.259+0000 7f2dfffff640 1 --2- 172.21.15.194:0/3598432633 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f2dec035d60 0x7f2dec038220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:32.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:32.259+0000 7f2dfffff640 1 --2- 172.21.15.194:0/3598432633 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f2dec035d60 0x7f2dec038220 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2df0001610 tx=0x7f2df0007ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:32.274 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:32.271+0000 7f2dfd7fa640 1 -- 172.21.15.194:0/3598432633 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2df40c6060 con 0x7f2e00113960 2024-09-13T06:09:32.432 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:32.431+0000 7f2e07046640 1 -- 172.21.15.194:0/3598432633 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64} v 0) -- 0x7f2e00115da0 con 0x7f2e00113960 2024-09-13T06:09:33.070 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:33.067+0000 7f2dfd7fa640 1 -- 172.21.15.194:0/3598432633 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.index' created v23) ==== 169+0+0 (secure 0 0 0) 0x7f2df40a9070 con 0x7f2e00113960 2024-09-13T06:09:33.070 INFO:teuthology.orchestra.run.smithi194.stderr:pool 'default.rgw.buckets.index' created 2024-09-13T06:09:33.073 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:33.071+0000 7f2e07046640 1 -- 172.21.15.194:0/3598432633 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f2dec035d60 msgr2=0x7f2dec038220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:33.073 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:33.071+0000 7f2e07046640 1 --2- 172.21.15.194:0/3598432633 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f2dec035d60 0x7f2dec038220 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2df0001610 tx=0x7f2df0007ad0 comp rx=0 tx=0).stop 2024-09-13T06:09:33.073 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:33.071+0000 7f2e07046640 1 -- 172.21.15.194:0/3598432633 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2e00113960 msgr2=0x7f2e001b3390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:33.074 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:33.071+0000 7f2e07046640 1 --2- 172.21.15.194:0/3598432633 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2e00113960 0x7f2e001b3390 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2df40af040 tx=0x7f2df401abb0 comp rx=0 tx=0).stop 2024-09-13T06:09:33.074 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:33.071+0000 7f2e07046640 1 -- 172.21.15.194:0/3598432633 shutdown_connections 2024-09-13T06:09:33.074 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:33.071+0000 7f2e07046640 1 --2- 172.21.15.194:0/3598432633 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f2dec035d60 0x7f2dec038220 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:33.074 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:33.071+0000 7f2e07046640 1 --2- 172.21.15.194:0/3598432633 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2e00113960 0x7f2e001b3390 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:33.074 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:33.071+0000 7f2e07046640 1 -- 172.21.15.194:0/3598432633 >> 172.21.15.194:0/3598432633 conn(0x7f2e0006f390 msgr2=0x7f2e00110480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:33.074 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:33.071+0000 7f2e07046640 1 -- 172.21.15.194:0/3598432633 shutdown_connections 2024-09-13T06:09:33.074 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:33.071+0000 7f2e07046640 1 -- 172.21.15.194:0/3598432633 wait complete. 2024-09-13T06:09:33.100 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-13T06:09:33.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:33.219+0000 7f02aa9b0640 1 Processor -- start 2024-09-13T06:09:33.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:33.219+0000 7f02aa9b0640 1 -- start start 2024-09-13T06:09:33.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:33.223+0000 7f02aa9b0640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f02a410f880 0x7f02a411b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:33.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:33.223+0000 7f02aa9b0640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02a411b660 con 0x7f02a410ed90 2024-09-13T06:09:33.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:33.223+0000 7f02aa9b0640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f02a411c840 con 0x7f02a410f880 2024-09-13T06:09:33.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:33.223+0000 7f02a3fff640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f02a410ed90 0x7f02a410f170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:60718/0 (socket says 172.21.15.194:60718) 2024-09-13T06:09:33.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:33.223+0000 7f02a3fff640 1 -- 172.21.15.194:0/2260448554 learned_addr learned my addr 172.21.15.194:0/2260448554 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-09-13T06:09:33.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:33.223+0000 7f02a37fe640 1 --2- 172.21.15.194:0/2260448554 >> v2:172.21.15.120:3300/0 conn(0x7f02a410f880 0x7f02a411b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:33.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:33.223+0000 7f02a2ffd640 1 -- 172.21.15.194:0/2260448554 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 230700722 0 0) 0x7f02a411b660 con 0x7f02a410ed90 2024-09-13T06:09:33.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:33.223+0000 7f02a2ffd640 1 -- 172.21.15.194:0/2260448554 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f028c003530 con 0x7f02a410ed90 2024-09-13T06:09:33.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:33.223+0000 7f02a37fe640 1 -- 172.21.15.194:0/2260448554 >> v1:172.21.15.120:6789/0 conn(0x7f02a410ed90 legacy=0x7f02a410f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:33.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:33.223+0000 7f02a37fe640 1 -- 172.21.15.194:0/2260448554 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02a411c9c0 con 0x7f02a410f880 2024-09-13T06:09:33.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:33.223+0000 7f02a37fe640 1 --2- 172.21.15.194:0/2260448554 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f02a410f880 0x7f02a411b120 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0298009740 tx=0x7f029801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2f12a124240b7a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:33.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:33.227+0000 7f02a2ffd640 1 -- 172.21.15.194:0/2260448554 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02980b1070 con 0x7f02a410f880 2024-09-13T06:09:33.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:33.227+0000 7f02a2ffd640 1 -- 172.21.15.194:0/2260448554 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02980ac520 con 0x7f02a410f880 2024-09-13T06:09:33.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:33.227+0000 7f02a2ffd640 1 -- 172.21.15.194:0/2260448554 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02980ac800 con 0x7f02a410f880 2024-09-13T06:09:33.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:33.227+0000 7f02aa9b0640 1 -- 172.21.15.194:0/2260448554 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f02a410f880 msgr2=0x7f02a411b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:33.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:33.227+0000 7f02aa9b0640 1 --2- 172.21.15.194:0/2260448554 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f02a410f880 0x7f02a411b120 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0298009740 tx=0x7f029801c370 comp rx=0 tx=0).stop 2024-09-13T06:09:33.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:33.227+0000 7f02aa9b0640 1 -- 172.21.15.194:0/2260448554 shutdown_connections 2024-09-13T06:09:33.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:33.227+0000 7f02aa9b0640 1 --2- 172.21.15.194:0/2260448554 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f02a410f880 0x7f02a411b120 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:33.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:33.227+0000 7f02aa9b0640 1 -- 172.21.15.194:0/2260448554 >> 172.21.15.194:0/2260448554 conn(0x7f02a406f390 msgr2=0x7f02a40717b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:33.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:33.227+0000 7f02aa9b0640 1 -- 172.21.15.194:0/2260448554 shutdown_connections 2024-09-13T06:09:33.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:33.227+0000 7f02aa9b0640 1 -- 172.21.15.194:0/2260448554 wait complete. 2024-09-13T06:09:33.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:33.227+0000 7f02aa9b0640 1 Processor -- start 2024-09-13T06:09:33.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:33.227+0000 7f02aa9b0640 1 -- start start 2024-09-13T06:09:33.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:33.227+0000 7f02aa9b0640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f02a410ed90 0x7f02a410ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:33.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:33.227+0000 7f02aa9b0640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f02a411c490 con 0x7f02a410ed90 2024-09-13T06:09:33.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:33.227+0000 7f02a3fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f02a410ed90 0x7f02a410ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:33.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:33.227+0000 7f02a3fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f02a410ed90 0x7f02a410ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:52878/0 (socket says 172.21.15.194:52878) 2024-09-13T06:09:33.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:33.227+0000 7f02a3fff640 1 -- 172.21.15.194:0/798847725 learned_addr learned my addr 172.21.15.194:0/798847725 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:33.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:33.227+0000 7f02a3fff640 1 -- 172.21.15.194:0/798847725 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02a41104b0 con 0x7f02a410ed90 2024-09-13T06:09:33.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:33.227+0000 7f02a3fff640 1 --2- 172.21.15.194:0/798847725 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f02a410ed90 0x7f02a410ff70 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f029400c3d0 tx=0x7f029400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:33.231 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:33.227+0000 7f02a0ff9640 1 -- 172.21.15.194:0/798847725 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0294017070 con 0x7f02a410ed90 2024-09-13T06:09:33.231 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:33.227+0000 7f02aa9b0640 1 -- 172.21.15.194:0/798847725 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02a4110740 con 0x7f02a410ed90 2024-09-13T06:09:33.231 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:33.231+0000 7f02a0ff9640 1 -- 172.21.15.194:0/798847725 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0294005ce0 con 0x7f02a410ed90 2024-09-13T06:09:33.231 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:33.231+0000 7f02a0ff9640 1 -- 172.21.15.194:0/798847725 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02940070d0 con 0x7f02a410ed90 2024-09-13T06:09:33.231 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:33.231+0000 7f02aa9b0640 1 -- 172.21.15.194:0/798847725 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02a4110c00 con 0x7f02a410ed90 2024-09-13T06:09:33.232 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:33.231+0000 7f02aa9b0640 1 -- 172.21.15.194:0/798847725 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02a410f170 con 0x7f02a410ed90 2024-09-13T06:09:33.232 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:33.231+0000 7f02a0ff9640 1 -- 172.21.15.194:0/798847725 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f029401a070 con 0x7f02a410ed90 2024-09-13T06:09:33.232 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:33.231+0000 7f02a0ff9640 1 --2- 172.21.15.194:0/798847725 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0290035db0 0x7f0290038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:33.232 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:33.231+0000 7f02a0ff9640 1 -- 172.21.15.194:0/798847725 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 4647+0+0 (secure 0 0 0) 0x7f02940481f0 con 0x7f02a410ed90 2024-09-13T06:09:33.232 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:33.231+0000 7f02a37fe640 1 --2- 172.21.15.194:0/798847725 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0290035db0 0x7f0290038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:33.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:33.231+0000 7f02a37fe640 1 --2- 172.21.15.194:0/798847725 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0290035db0 0x7f0290038270 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f02980ae000 tx=0x7f02980a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:33.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:33.243+0000 7f02a0ff9640 1 -- 172.21.15.194:0/798847725 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0294045cc0 con 0x7f02a410ed90 2024-09-13T06:09:33.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:33.411+0000 7f02aa9b0640 1 -- 172.21.15.194:0/798847725 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"} v 0) -- 0x7f02a410f880 con 0x7f02a410ed90 2024-09-13T06:09:34.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:34.083+0000 7f02a0ff9640 1 -- 172.21.15.194:0/798847725 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.index' v24) ==== 187+0+0 (secure 0 0 0) 0x7f0294046040 con 0x7f02a410ed90 2024-09-13T06:09:34.083 INFO:teuthology.orchestra.run.smithi194.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-13T06:09:34.086 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:34.083+0000 7f02aa9b0640 1 -- 172.21.15.194:0/798847725 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0290035db0 msgr2=0x7f0290038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:34.086 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:34.083+0000 7f02aa9b0640 1 --2- 172.21.15.194:0/798847725 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0290035db0 0x7f0290038270 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f02980ae000 tx=0x7f02980a7000 comp rx=0 tx=0).stop 2024-09-13T06:09:34.086 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:34.083+0000 7f02aa9b0640 1 -- 172.21.15.194:0/798847725 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f02a410ed90 msgr2=0x7f02a410ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:34.086 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:34.083+0000 7f02aa9b0640 1 --2- 172.21.15.194:0/798847725 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f02a410ed90 0x7f02a410ff70 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f029400c3d0 tx=0x7f029400c890 comp rx=0 tx=0).stop 2024-09-13T06:09:34.087 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:34.083+0000 7f02aa9b0640 1 -- 172.21.15.194:0/798847725 shutdown_connections 2024-09-13T06:09:34.087 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:34.083+0000 7f02aa9b0640 1 --2- 172.21.15.194:0/798847725 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0290035db0 0x7f0290038270 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:34.087 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:34.083+0000 7f02aa9b0640 1 --2- 172.21.15.194:0/798847725 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f02a410ed90 0x7f02a410ff70 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:34.087 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:34.083+0000 7f02aa9b0640 1 -- 172.21.15.194:0/798847725 >> 172.21.15.194:0/798847725 conn(0x7f02a406f390 msgr2=0x7f02a411a670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:34.087 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:34.083+0000 7f02aa9b0640 1 -- 172.21.15.194:0/798847725 shutdown_connections 2024-09-13T06:09:34.087 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:34.083+0000 7f02aa9b0640 1 -- 172.21.15.194:0/798847725 wait complete. 2024-09-13T06:09:34.123 DEBUG:tasks.rgw:Pools created 2024-09-13T06:09:34.124 INFO:tasks.rgw:Starting rgw... 2024-09-13T06:09:34.124 INFO:tasks.rgw:rgw client.0 config is {} 2024-09-13T06:09:34.124 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-13T06:09:34.124 DEBUG:teuthology.orchestra.run.smithi194:> sudo echo -n http://smithi194.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-13T06:09:34.137 INFO:teuthology.orchestra.run.smithi194.stdout:http://smithi194.front.sepia.ceph.com:80 2024-09-13T06:09:34.137 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-13T06:09:34.188 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-13T06:09:34.188 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-13T06:09:34.232 INFO:tasks.rgw.client.0:Started 2024-09-13T06:09:34.232 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi194.front.sepia.ceph.com:80/ 2024-09-13T06:09:34.232 DEBUG:teuthology.orchestra.run.smithi194:> curl http://smithi194.front.sepia.ceph.com:80/ 2024-09-13T06:09:34.261 INFO:teuthology.orchestra.run.smithi194.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-13T06:09:34.261 INFO:teuthology.orchestra.run.smithi194.stderr: Dload Upload Total Spent Left Speed 2024-09-13T06:09:34.264 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-13T06:09:34.264 INFO:teuthology.orchestra.run.smithi194.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-13T06:09:34.264 INFO:teuthology.orchestra.run.smithi194.stderr:curl: (7) Failed to connect to smithi194.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-13T06:09:35.266 DEBUG:teuthology.orchestra.run.smithi194:> curl http://smithi194.front.sepia.ceph.com:80/ 2024-09-13T06:09:35.277 INFO:teuthology.orchestra.run.smithi194.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-13T06:09:35.277 INFO:teuthology.orchestra.run.smithi194.stderr: Dload Upload Total Spent Left Speed 2024-09-13T06:09:35.278 INFO:teuthology.orchestra.run.smithi194.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-13T06:09:35.278 INFO:teuthology.orchestra.run.smithi194.stderr:curl: (7) Failed to connect to smithi194.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-13T06:09:35.278 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-13T06:09:37.280 DEBUG:teuthology.orchestra.run.smithi194:> curl http://smithi194.front.sepia.ceph.com:80/ 2024-09-13T06:09:37.292 INFO:teuthology.orchestra.run.smithi194.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-13T06:09:37.292 INFO:teuthology.orchestra.run.smithi194.stderr: Dload Upload Total Spent Left Speed 2024-09-13T06:09:37.292 INFO:teuthology.orchestra.run.smithi194.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-13T06:09:37.292 INFO:teuthology.orchestra.run.smithi194.stderr:curl: (7) Failed to connect to smithi194.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-13T06:09:37.292 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-13T06:09:41.294 DEBUG:teuthology.orchestra.run.smithi194:> curl http://smithi194.front.sepia.ceph.com:80/ 2024-09-13T06:09:41.306 INFO:teuthology.orchestra.run.smithi194.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-13T06:09:41.306 INFO:teuthology.orchestra.run.smithi194.stderr: Dload Upload Total Spent Left Speed 2024-09-13T06:09:41.306 INFO:teuthology.orchestra.run.smithi194.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-13T06:09:41.306 INFO:teuthology.orchestra.run.smithi194.stderr:curl: (7) Failed to connect to smithi194.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-13T06:09:41.307 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-13T06:09:43.325 INFO:tasks.rgw.client.0.smithi194.stdout:2024-09-13T06:09:43.323+0000 7fe2aabdea40 -1 LDAP not started since no server URIs were provided in the configuration. 2024-09-13T06:09:49.308 DEBUG:teuthology.orchestra.run.smithi194:> curl http://smithi194.front.sepia.ceph.com:80/ 2024-09-13T06:09:49.320 INFO:teuthology.orchestra.run.smithi194.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-13T06:09:49.320 INFO:teuthology.orchestra.run.smithi194.stderr: Dload Upload Total Spent Left Speed 2024-09-13T06:09:49.323 INFO:teuthology.orchestra.run.smithi194.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 53428 0 --:--:-- --:--:-- --:--:-- 62333 2024-09-13T06:09:49.324 INFO:teuthology.orchestra.run.smithi194.stdout:anonymous 2024-09-13T06:09:49.324 INFO:teuthology.run_tasks:Running task radosgw-admin... 2024-09-13T06:09:51.274 DEBUG:tasks.radosgw_admin:config is: {'client.0': None} 2024-09-13T06:09:51.274 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-09-13T06:09:51.274 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-09-13T06:09:51.274 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-09-13T06:09:51.312 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:09:51.312 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:09:51.313 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.311+0000 7f08edb01980 1 Processor -- start 2024-09-13T06:09:51.313 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.311+0000 7f08edb01980 1 -- start start 2024-09-13T06:09:51.314 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.311+0000 7f08edb01980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55b5f686fab0 0x55b5f6871ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:51.314 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.311+0000 7f08edb01980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b5f66f9ae0 con 0x55b5f68723e0 2024-09-13T06:09:51.314 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.311+0000 7f08edb01980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x55b5f671de30 con 0x55b5f686fab0 2024-09-13T06:09:51.315 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.311+0000 7f08eb611640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55b5f686fab0 0x55b5f6871ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:51.315 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.311+0000 7f08eae10640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x55b5f68723e0 0x55b5f6878f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:51662/0 (socket says 172.21.15.194:51662) 2024-09-13T06:09:51.315 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.311+0000 7f08eb611640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55b5f686fab0 0x55b5f6871ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:54550/0 (socket says 172.21.15.194:54550) 2024-09-13T06:09:51.315 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.311+0000 7f08eae10640 1 -- 172.21.15.194:0/153705048 learned_addr learned my addr 172.21.15.194:0/153705048 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-09-13T06:09:51.315 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.315+0000 7f08eb611640 1 -- 172.21.15.194:0/153705048 >> v1:172.21.15.120:6789/0 conn(0x55b5f68723e0 legacy=0x55b5f6878f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:51.315 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.315+0000 7f08eb611640 1 -- 172.21.15.194:0/153705048 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5f68728b0 con 0x55b5f686fab0 2024-09-13T06:09:51.318 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.315+0000 7f08eb611640 1 --2- 172.21.15.194:0/153705048 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b5f686fab0 0x55b5f6871ea0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f08dc00a420 tx=0x7f08dc01afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8712a0a393c50eb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:51.318 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.315+0000 7f08ea60f640 1 -- 172.21.15.194:0/153705048 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08dc0af070 con 0x55b5f686fab0 2024-09-13T06:09:51.318 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.315+0000 7f08ea60f640 1 -- 172.21.15.194:0/153705048 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08dc0aa530 con 0x55b5f686fab0 2024-09-13T06:09:51.318 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.315+0000 7f08ea60f640 1 -- 172.21.15.194:0/153705048 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08dc0aa850 con 0x55b5f686fab0 2024-09-13T06:09:51.319 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.319+0000 7f08edb01980 1 -- 172.21.15.194:0/153705048 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b5f686fab0 msgr2=0x55b5f6871ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:51.319 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.319+0000 7f08edb01980 1 --2- 172.21.15.194:0/153705048 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b5f686fab0 0x55b5f6871ea0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f08dc00a420 tx=0x7f08dc01afd0 comp rx=0 tx=0).stop 2024-09-13T06:09:51.319 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.319+0000 7f08edb01980 1 -- 172.21.15.194:0/153705048 shutdown_connections 2024-09-13T06:09:51.319 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.319+0000 7f08edb01980 1 --2- 172.21.15.194:0/153705048 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b5f686fab0 0x55b5f6871ea0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:51.319 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.319+0000 7f08edb01980 1 -- 172.21.15.194:0/153705048 >> 172.21.15.194:0/153705048 conn(0x55b5f686b790 msgr2=0x55b5f686dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:51.319 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.319+0000 7f08edb01980 1 -- 172.21.15.194:0/153705048 shutdown_connections 2024-09-13T06:09:51.319 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.319+0000 7f08edb01980 1 -- 172.21.15.194:0/153705048 wait complete. 2024-09-13T06:09:51.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.335+0000 7f08edb01980 1 Processor -- start 2024-09-13T06:09:51.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.335+0000 7f08edb01980 1 -- start start 2024-09-13T06:09:51.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.335+0000 7f08edb01980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b5f686fab0 0x55b5f695ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:51.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.335+0000 7f08edb01980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55b5f671f200 con 0x55b5f686fab0 2024-09-13T06:09:51.336 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.335+0000 7f08eb611640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b5f686fab0 0x55b5f695ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:51.336 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.335+0000 7f08eb611640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b5f686fab0 0x55b5f695ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:54558/0 (socket says 172.21.15.194:54558) 2024-09-13T06:09:51.336 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.335+0000 7f08eb611640 1 -- 172.21.15.194:0/3208713934 learned_addr learned my addr 172.21.15.194:0/3208713934 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:51.336 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.335+0000 7f08eb611640 1 -- 172.21.15.194:0/3208713934 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5f695f1f0 con 0x55b5f686fab0 2024-09-13T06:09:51.337 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.335+0000 7f08eb611640 1 --2- 172.21.15.194:0/3208713934 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b5f686fab0 0x55b5f695ec20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f08dc00a420 tx=0x7f08dc0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70f2d612e9bf5698 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:51.337 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.335+0000 7f07d960a640 1 -- 172.21.15.194:0/3208713934 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08dc0af040 con 0x55b5f686fab0 2024-09-13T06:09:51.337 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.335+0000 7f07d960a640 1 -- 172.21.15.194:0/3208713934 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08dc0aab30 con 0x55b5f686fab0 2024-09-13T06:09:51.337 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.335+0000 7f07d960a640 1 -- 172.21.15.194:0/3208713934 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08dc0aae10 con 0x55b5f686fab0 2024-09-13T06:09:51.338 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.335+0000 7f08edb01980 1 -- 172.21.15.194:0/3208713934 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b5f686fab0 msgr2=0x55b5f695ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:51.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.335+0000 7f08edb01980 1 --2- 172.21.15.194:0/3208713934 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b5f686fab0 0x55b5f695ec20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f08dc00a420 tx=0x7f08dc0033b0 comp rx=0 tx=0).stop 2024-09-13T06:09:51.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.335+0000 7f08edb01980 1 -- 172.21.15.194:0/3208713934 shutdown_connections 2024-09-13T06:09:51.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.335+0000 7f08edb01980 1 --2- 172.21.15.194:0/3208713934 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b5f686fab0 0x55b5f695ec20 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:51.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.335+0000 7f08edb01980 1 -- 172.21.15.194:0/3208713934 >> 172.21.15.194:0/3208713934 conn(0x55b5f686b790 msgr2=0x55b5f695a850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:51.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.335+0000 7f08edb01980 1 -- 172.21.15.194:0/3208713934 shutdown_connections 2024-09-13T06:09:51.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.335+0000 7f08edb01980 1 -- 172.21.15.194:0/3208713934 wait complete. 2024-09-13T06:09:51.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.339+0000 7f08edb01980 1 Processor -- start 2024-09-13T06:09:51.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.339+0000 7f08edb01980 1 -- start start 2024-09-13T06:09:51.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.339+0000 7f08edb01980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b5f686fab0 0x55b5f6965f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:51.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.339+0000 7f08edb01980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55b5f687d1c0 con 0x55b5f686fab0 2024-09-13T06:09:51.340 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.339+0000 7f08eb611640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b5f686fab0 0x55b5f6965f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:51.341 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.339+0000 7f08eb611640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b5f686fab0 0x55b5f6965f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:54572/0 (socket says 172.21.15.194:54572) 2024-09-13T06:09:51.341 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.339+0000 7f08eb611640 1 -- 172.21.15.194:0/611681228 learned_addr learned my addr 172.21.15.194:0/611681228 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:51.341 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.339+0000 7f08eb611640 1 -- 172.21.15.194:0/611681228 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5f6966470 con 0x55b5f686fab0 2024-09-13T06:09:51.341 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.339+0000 7f08eb611640 1 --2- 172.21.15.194:0/611681228 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b5f686fab0 0x55b5f6965f30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f08dc01b870 tx=0x7f08dc017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:51.341 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.339+0000 7f07d7e07640 1 -- 172.21.15.194:0/611681228 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08dc0c5070 con 0x55b5f686fab0 2024-09-13T06:09:51.341 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.339+0000 7f08edb01980 1 -- 172.21.15.194:0/611681228 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b5f6966700 con 0x55b5f686fab0 2024-09-13T06:09:51.341 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.339+0000 7f07d7e07640 1 -- 172.21.15.194:0/611681228 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08dc0c1880 con 0x55b5f686fab0 2024-09-13T06:09:51.341 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.339+0000 7f07d7e07640 1 -- 172.21.15.194:0/611681228 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08dc0c1b60 con 0x55b5f686fab0 2024-09-13T06:09:51.341 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.339+0000 7f08edb01980 1 -- 172.21.15.194:0/611681228 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5f69693e0 con 0x55b5f686fab0 2024-09-13T06:09:51.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.339+0000 7f07d7e07640 1 -- 172.21.15.194:0/611681228 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f08dc0b5470 con 0x55b5f686fab0 2024-09-13T06:09:51.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.339+0000 7f07d7e07640 1 --2- 172.21.15.194:0/611681228 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f07d0034650 0x7f07d0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:51.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.339+0000 7f07d7e07640 1 -- 172.21.15.194:0/611681228 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f08dc0bb070 con 0x55b5f686fab0 2024-09-13T06:09:51.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.339+0000 7f08eae10640 1 --2- 172.21.15.194:0/611681228 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f07d0034650 0x7f07d0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:51.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.339+0000 7f08edb01980 1 --2- 172.21.15.194:0/611681228 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55b5f68723e0 0x55b5f696d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:51.343 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.339+0000 7f08edb01980 1 -- 172.21.15.194:0/611681228 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b5f696d570 con 0x55b5f68723e0 2024-09-13T06:09:51.343 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.343+0000 7f08ebe12640 1 --2- 172.21.15.194:0/611681228 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55b5f68723e0 0x55b5f696d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:51.344 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.343+0000 7f08eae10640 1 --2- 172.21.15.194:0/611681228 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f07d0034650 0x7f07d0036b10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f08d4000f70 tx=0x7f08d40012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:51.344 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.343+0000 7f08ebe12640 1 --2- 172.21.15.194:0/611681228 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55b5f68723e0 0x55b5f696d030 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:51.344 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.343+0000 7f08ebe12640 1 -- 172.21.15.194:0/611681228 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f08e40083f0 con 0x55b5f68723e0 2024-09-13T06:09:51.344 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.343+0000 7f08edb01980 1 -- 172.21.15.194:0/611681228 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b5f696a5e0 con 0x55b5f68723e0 2024-09-13T06:09:51.344 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.343+0000 7f08ebe12640 1 -- 172.21.15.194:0/611681228 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f08e40083f0 con 0x55b5f68723e0 2024-09-13T06:09:51.344 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.343+0000 7f08edb01980 1 --2- 172.21.15.194:0/611681228 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55b5f696f8b0 0x55b5f6971ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:51.344 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.343+0000 7f08edb01980 1 -- 172.21.15.194:0/611681228 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b5f6972370 con 0x55b5f696f8b0 2024-09-13T06:09:51.344 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.343+0000 7f08eb611640 1 --2- 172.21.15.194:0/611681228 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55b5f696f8b0 0x55b5f6971ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:51.344 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.343+0000 7f08eb611640 1 --2- 172.21.15.194:0/611681228 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55b5f696f8b0 0x55b5f6971ca0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:51.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.343+0000 7f08eb611640 1 -- 172.21.15.194:0/611681228 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f08dc0b2040 con 0x55b5f696f8b0 2024-09-13T06:09:51.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.343+0000 7f08edb01980 1 -- 172.21.15.194:0/611681228 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b5f696e720 con 0x55b5f68723e0 2024-09-13T06:09:51.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.343+0000 7f08ebe12640 1 -- 172.21.15.194:0/611681228 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f08e40083f0 con 0x55b5f68723e0 2024-09-13T06:09:51.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.343+0000 7f08edb01980 1 --2- 172.21.15.194:0/611681228 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55b5f69737d0 0x55b5f6975bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:51.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.343+0000 7f08edb01980 1 -- 172.21.15.194:0/611681228 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69762b0 con 0x55b5f69737d0 2024-09-13T06:09:51.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.343+0000 7f08eae10640 1 --2- 172.21.15.194:0/611681228 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55b5f69737d0 0x55b5f6975bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:51.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.343+0000 7f08eae10640 1 --2- 172.21.15.194:0/611681228 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55b5f69737d0 0x55b5f6975bc0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:51.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.343+0000 7f08eae10640 1 -- 172.21.15.194:0/611681228 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f08d400e620 con 0x55b5f69737d0 2024-09-13T06:09:51.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.343+0000 7f08edb01980 1 Processor -- start 2024-09-13T06:09:51.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.343+0000 7f08edb01980 1 -- start start 2024-09-13T06:09:51.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.347+0000 7f08edb01980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b5f6983d60 0x55b5f6984180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:51.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.347+0000 7f08edb01980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55b5f6778800 con 0x55b5f6983d60 2024-09-13T06:09:51.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.347+0000 7f08eb611640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b5f6983d60 0x55b5f6984180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:51.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.347+0000 7f08eb611640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b5f6983d60 0x55b5f6984180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:54574/0 (socket says 172.21.15.194:54574) 2024-09-13T06:09:51.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.347+0000 7f08eb611640 1 -- 172.21.15.194:0/1305644842 learned_addr learned my addr 172.21.15.194:0/1305644842 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:51.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.347+0000 7f08eb611640 1 -- 172.21.15.194:0/1305644842 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5f69846c0 con 0x55b5f6983d60 2024-09-13T06:09:51.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.347+0000 7f08eb611640 1 --2- 172.21.15.194:0/1305644842 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b5f6983d60 0x55b5f6984180 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f08dc0a98e0 tx=0x7f08dc0b5960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:51.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.347+0000 7f07d5602640 1 -- 172.21.15.194:0/1305644842 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08dc0c8730 con 0x55b5f6983d60 2024-09-13T06:09:51.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.347+0000 7f08edb01980 1 -- 172.21.15.194:0/1305644842 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b5f6984950 con 0x55b5f6983d60 2024-09-13T06:09:51.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.347+0000 7f07d5602640 1 -- 172.21.15.194:0/1305644842 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08dc0c88d0 con 0x55b5f6983d60 2024-09-13T06:09:51.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.347+0000 7f07d5602640 1 -- 172.21.15.194:0/1305644842 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08dc0bfa10 con 0x55b5f6983d60 2024-09-13T06:09:51.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.347+0000 7f08edb01980 1 -- 172.21.15.194:0/1305644842 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5f69875d0 con 0x55b5f6983d60 2024-09-13T06:09:51.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.347+0000 7f07d5602640 1 -- 172.21.15.194:0/1305644842 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f08dc0bfbb0 con 0x55b5f6983d60 2024-09-13T06:09:51.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.347+0000 7f07d5602640 1 --2- 172.21.15.194:0/1305644842 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f07c4034650 0x7f07c4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:51.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.347+0000 7f07d5602640 1 -- 172.21.15.194:0/1305644842 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f08dc0dd070 con 0x55b5f6983d60 2024-09-13T06:09:51.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.347+0000 7f08eae10640 1 --2- 172.21.15.194:0/1305644842 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f07c4034650 0x7f07c4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:51.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.347+0000 7f08edb01980 1 Processor -- start 2024-09-13T06:09:51.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.351+0000 7f08edb01980 1 -- start start 2024-09-13T06:09:51.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.351+0000 7f08edb01980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b5f6990660 0x55b5f6990a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:51.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.351+0000 7f08eae10640 1 --2- 172.21.15.194:0/1305644842 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f07c4034650 0x7f07c4036b10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f08d400bf60 tx=0x7f08d400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:51.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.351+0000 7f08edb01980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55b5f695f4b0 con 0x55b5f6990660 2024-09-13T06:09:51.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.351+0000 7f08eb611640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b5f6990660 0x55b5f6990a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:51.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.351+0000 7f08eb611640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b5f6990660 0x55b5f6990a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:54584/0 (socket says 172.21.15.194:54584) 2024-09-13T06:09:51.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.351+0000 7f08eb611640 1 -- 172.21.15.194:0/1697403241 learned_addr learned my addr 172.21.15.194:0/1697403241 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:51.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.351+0000 7f08eb611640 1 -- 172.21.15.194:0/1697403241 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5f6991010 con 0x55b5f6990660 2024-09-13T06:09:51.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.351+0000 7f08eb611640 1 --2- 172.21.15.194:0/1697403241 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b5f6990660 0x55b5f6990a40 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f08dc0e8000 tx=0x7f08dc0d3600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ae3b033a8fda365 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:51.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.351+0000 7f07ceffd640 1 -- 172.21.15.194:0/1697403241 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08dc0fa070 con 0x55b5f6990660 2024-09-13T06:09:51.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.351+0000 7f07ceffd640 1 -- 172.21.15.194:0/1697403241 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08dc0c76f0 con 0x55b5f6990660 2024-09-13T06:09:51.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.351+0000 7f07ceffd640 1 -- 172.21.15.194:0/1697403241 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08dc0c08a0 con 0x55b5f6990660 2024-09-13T06:09:51.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.351+0000 7f08edb01980 1 -- 172.21.15.194:0/1697403241 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b5f6990660 msgr2=0x55b5f6990a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:51.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.351+0000 7f08edb01980 1 --2- 172.21.15.194:0/1697403241 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b5f6990660 0x55b5f6990a40 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f08dc0e8000 tx=0x7f08dc0d3600 comp rx=0 tx=0).stop 2024-09-13T06:09:51.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.351+0000 7f08edb01980 1 -- 172.21.15.194:0/1697403241 shutdown_connections 2024-09-13T06:09:51.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.351+0000 7f08edb01980 1 --2- 172.21.15.194:0/1697403241 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b5f6990660 0x55b5f6990a40 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:51.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.351+0000 7f08edb01980 1 -- 172.21.15.194:0/1697403241 >> 172.21.15.194:0/1697403241 conn(0x55b5f698ca40 msgr2=0x55b5f698ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:51.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.351+0000 7f08edb01980 1 -- 172.21.15.194:0/1697403241 shutdown_connections 2024-09-13T06:09:51.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.351+0000 7f08edb01980 1 -- 172.21.15.194:0/1697403241 wait complete. 2024-09-13T06:09:51.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.351+0000 7f08edb01980 1 Processor -- start 2024-09-13T06:09:51.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.351+0000 7f08edb01980 1 -- start start 2024-09-13T06:09:51.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.351+0000 7f08edb01980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b5f6990660 0x55b5f6997880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:51.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.351+0000 7f08edb01980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55b5f69914b0 con 0x55b5f6990660 2024-09-13T06:09:51.355 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.351+0000 7f08eb611640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b5f6990660 0x55b5f6997880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:51.355 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.351+0000 7f08eb611640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b5f6990660 0x55b5f6997880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:54600/0 (socket says 172.21.15.194:54600) 2024-09-13T06:09:51.356 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.351+0000 7f08eb611640 1 -- 172.21.15.194:0/1119829784 learned_addr learned my addr 172.21.15.194:0/1119829784 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:51.356 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.351+0000 7f08eb611640 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5f6997dc0 con 0x55b5f6990660 2024-09-13T06:09:51.356 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.355+0000 7f08eb611640 1 --2- 172.21.15.194:0/1119829784 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b5f6990660 0x55b5f6997880 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f08dc0c8c50 tx=0x7f08dc0b8f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:51.356 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.355+0000 7f07cd7fa640 1 -- 172.21.15.194:0/1119829784 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08dc0fa040 con 0x55b5f6990660 2024-09-13T06:09:51.356 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.355+0000 7f08edb01980 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b5f6997dc0 con 0x55b5f6990660 2024-09-13T06:09:51.356 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.355+0000 7f07cd7fa640 1 -- 172.21.15.194:0/1119829784 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08dc0e0400 con 0x55b5f6990660 2024-09-13T06:09:51.356 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.355+0000 7f07cd7fa640 1 -- 172.21.15.194:0/1119829784 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08dc0c7300 con 0x55b5f6990660 2024-09-13T06:09:51.356 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.355+0000 7f08edb01980 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5f6998230 con 0x55b5f6990660 2024-09-13T06:09:51.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.355+0000 7f08edb01980 20 rados->read ofs=0 len=0 2024-09-13T06:09:51.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.355+0000 7f07cd7fa640 1 -- 172.21.15.194:0/1119829784 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f08dc10c020 con 0x55b5f6990660 2024-09-13T06:09:51.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.355+0000 7f07cd7fa640 1 --2- 172.21.15.194:0/1119829784 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f07b4034650 0x7f07b4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:51.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.355+0000 7f07cd7fa640 1 -- 172.21.15.194:0/1119829784 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f08dc10a020 con 0x55b5f6990660 2024-09-13T06:09:51.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.355+0000 7f08eae10640 1 --2- 172.21.15.194:0/1119829784 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f07b4034650 0x7f07b4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:51.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.355+0000 7f08edb01980 1 --2- 172.21.15.194:0/1119829784 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55b5f69a27a0 0x55b5f69a4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:51.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.355+0000 7f08edb01980 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69a53b0 con 0x55b5f69a27a0 2024-09-13T06:09:51.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.355+0000 7f08ebe12640 1 --2- 172.21.15.194:0/1119829784 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55b5f69a27a0 0x55b5f69a4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:51.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.355+0000 7f08eae10640 1 --2- 172.21.15.194:0/1119829784 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f07b4034650 0x7f07b4036b10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x55b5f696de60 tx=0x7f08d4010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:51.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.355+0000 7f08ebe12640 1 --2- 172.21.15.194:0/1119829784 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55b5f69a27a0 0x55b5f69a4c60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:51.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.355+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f08e40083f0 con 0x55b5f69a27a0 2024-09-13T06:09:51.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.355+0000 7f08edb01980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:51.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.355+0000 7f08edb01980 20 realm 2024-09-13T06:09:51.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.355+0000 7f08edb01980 20 rados->read ofs=0 len=0 2024-09-13T06:09:51.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.355+0000 7f08edb01980 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69a57c0 con 0x55b5f69a27a0 2024-09-13T06:09:51.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.355+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f08e40083f0 con 0x55b5f69a27a0 2024-09-13T06:09:51.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.355+0000 7f08edb01980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:51.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.355+0000 7f08edb01980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:09:51.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.355+0000 7f08edb01980 20 rados->read ofs=0 len=0 2024-09-13T06:09:51.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.355+0000 7f08edb01980 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69a6060 con 0x55b5f69a27a0 2024-09-13T06:09:51.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.355+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f08e40083f0 con 0x55b5f69a27a0 2024-09-13T06:09:51.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.355+0000 7f08edb01980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:51.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.355+0000 7f08edb01980 20 rados->read ofs=0 len=0 2024-09-13T06:09:51.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.355+0000 7f08edb01980 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69a6400 con 0x55b5f69a27a0 2024-09-13T06:09:51.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.359+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f08e40083f0 con 0x55b5f69a27a0 2024-09-13T06:09:51.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.359+0000 7f08edb01980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:51.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.359+0000 7f08edb01980 20 rados->read ofs=0 len=0 2024-09-13T06:09:51.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.359+0000 7f08edb01980 1 --2- 172.21.15.194:0/1119829784 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55b5f69a7160 0x55b5f69a9550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:51.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.359+0000 7f08edb01980 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69a9ad0 con 0x55b5f69a7160 2024-09-13T06:09:51.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.359+0000 7f08eb611640 1 --2- 172.21.15.194:0/1119829784 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55b5f69a7160 0x55b5f69a9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:51.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.359+0000 7f08eb611640 1 --2- 172.21.15.194:0/1119829784 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55b5f69a7160 0x55b5f69a9550 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:51.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.359+0000 7f08eb611640 1 -- 172.21.15.194:0/1119829784 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f08dc0fc070 con 0x55b5f69a7160 2024-09-13T06:09:51.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.359+0000 7f08edb01980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:09:51.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.359+0000 7f08edb01980 20 searching for the correct realm 2024-09-13T06:09:51.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.359+0000 7f08edb01980 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69ab330 con 0x55b5f69a7160 2024-09-13T06:09:51.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.359+0000 7f08eb611640 1 -- 172.21.15.194:0/1119829784 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08dc0fc070 con 0x55b5f69a7160 2024-09-13T06:09:51.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.359+0000 7f08eb611640 1 --2- 172.21.15.194:0/1119829784 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f08dc0e0020 0x7f08dc0ff880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:51.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.359+0000 7f08eb611640 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69ab330 con 0x7f08dc0e0020 2024-09-13T06:09:51.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.359+0000 7f08eae10640 1 --2- 172.21.15.194:0/1119829784 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f08dc0e0020 0x7f08dc0ff880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:51.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.359+0000 7f08eae10640 1 --2- 172.21.15.194:0/1119829784 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f08dc0e0020 0x7f08dc0ff880 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:51.366 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.359+0000 7f08eae10640 1 -- 172.21.15.194:0/1119829784 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f08d400e620 con 0x7f08dc0e0020 2024-09-13T06:09:51.366 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.359+0000 7f08eae10640 1 --2- 172.21.15.194:0/1119829784 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f08d4037040 0x7f08d4036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:51.366 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.359+0000 7f08eae10640 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69ab330 con 0x7f08d4037040 2024-09-13T06:09:51.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.359+0000 7f08ebe12640 1 --2- 172.21.15.194:0/1119829784 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f08d4037040 0x7f08d4036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:51.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.359+0000 7f08ebe12640 1 --2- 172.21.15.194:0/1119829784 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f08d4037040 0x7f08d4036410 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:51.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.363+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08e40083f0 con 0x7f08d4037040 2024-09-13T06:09:51.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.363+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69a6400 con 0x55b5f69a27a0 2024-09-13T06:09:51.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.363+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08e40083f0 con 0x55b5f69a27a0 2024-09-13T06:09:51.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.363+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69a6400 con 0x55b5f69a27a0 2024-09-13T06:09:51.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.363+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08e40083f0 con 0x55b5f69a27a0 2024-09-13T06:09:51.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.363+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69a6400 con 0x7f08d4037040 2024-09-13T06:09:51.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.363+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08e40083f0 con 0x7f08d4037040 2024-09-13T06:09:51.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.363+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69a6400 con 0x7f08d4037040 2024-09-13T06:09:51.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.363+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08e40083f0 con 0x7f08d4037040 2024-09-13T06:09:51.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.363+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69a6400 con 0x7f08dc0e0020 2024-09-13T06:09:51.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.363+0000 7f08eae10640 1 -- 172.21.15.194:0/1119829784 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08d400e620 con 0x7f08dc0e0020 2024-09-13T06:09:51.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.363+0000 7f08eae10640 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69a6400 con 0x55b5f69a7160 2024-09-13T06:09:51.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.363+0000 7f08eb611640 1 -- 172.21.15.194:0/1119829784 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08dc0fc070 con 0x55b5f69a7160 2024-09-13T06:09:51.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.363+0000 7f08eb611640 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69a6400 con 0x55b5f69a27a0 2024-09-13T06:09:51.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.363+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08e40083f0 con 0x55b5f69a27a0 2024-09-13T06:09:51.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.363+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69a6400 con 0x7f08d4037040 2024-09-13T06:09:51.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.363+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08e40083f0 con 0x7f08d4037040 2024-09-13T06:09:51.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.363+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69a6400 con 0x55b5f69a27a0 2024-09-13T06:09:51.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.367+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08e40083f0 con 0x55b5f69a27a0 2024-09-13T06:09:51.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.367+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69a6400 con 0x7f08dc0e0020 2024-09-13T06:09:51.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.367+0000 7f08eae10640 1 -- 172.21.15.194:0/1119829784 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f08d400e620 con 0x7f08dc0e0020 2024-09-13T06:09:51.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.367+0000 7f08eae10640 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69a6400 con 0x55b5f69a7160 2024-09-13T06:09:51.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.367+0000 7f08eb611640 1 -- 172.21.15.194:0/1119829784 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08dc0fc070 con 0x55b5f69a7160 2024-09-13T06:09:51.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.367+0000 7f08eb611640 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69a6400 con 0x55b5f69a7160 2024-09-13T06:09:51.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.367+0000 7f08eb611640 1 -- 172.21.15.194:0/1119829784 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08dc0fc070 con 0x55b5f69a7160 2024-09-13T06:09:51.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.367+0000 7f08eb611640 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69a6400 con 0x7f08d4037040 2024-09-13T06:09:51.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.367+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08e40083f0 con 0x7f08d4037040 2024-09-13T06:09:51.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.367+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69a6400 con 0x55b5f69a7160 2024-09-13T06:09:51.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.367+0000 7f08eb611640 1 -- 172.21.15.194:0/1119829784 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08dc0fc070 con 0x55b5f69a7160 2024-09-13T06:09:51.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.367+0000 7f08eb611640 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69a6400 con 0x55b5f69a7160 2024-09-13T06:09:51.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.367+0000 7f08eb611640 1 -- 172.21.15.194:0/1119829784 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08dc0fc070 con 0x55b5f69a7160 2024-09-13T06:09:51.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.367+0000 7f08eb611640 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69a6400 con 0x55b5f69a27a0 2024-09-13T06:09:51.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.367+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08e40083f0 con 0x55b5f69a27a0 2024-09-13T06:09:51.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.367+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69a6400 con 0x55b5f69a27a0 2024-09-13T06:09:51.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.367+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f08e40083f0 con 0x55b5f69a27a0 2024-09-13T06:09:51.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.367+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69a6400 con 0x7f08d4037040 2024-09-13T06:09:51.373 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.367+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08e40083f0 con 0x7f08d4037040 2024-09-13T06:09:51.373 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.367+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69a6400 con 0x55b5f69a7160 2024-09-13T06:09:51.373 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.367+0000 7f08eb611640 1 -- 172.21.15.194:0/1119829784 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08dc0fc070 con 0x55b5f69a7160 2024-09-13T06:09:51.373 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.367+0000 7f08eb611640 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69a6400 con 0x7f08dc0e0020 2024-09-13T06:09:51.373 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.371+0000 7f08eae10640 1 -- 172.21.15.194:0/1119829784 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08d400e620 con 0x7f08dc0e0020 2024-09-13T06:09:51.373 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.371+0000 7f08eae10640 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69a6400 con 0x55b5f69a27a0 2024-09-13T06:09:51.373 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.371+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08e40083f0 con 0x55b5f69a27a0 2024-09-13T06:09:51.373 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.371+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69a6400 con 0x7f08d4037040 2024-09-13T06:09:51.373 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.371+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08e40083f0 con 0x7f08d4037040 2024-09-13T06:09:51.373 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.371+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69a6400 con 0x55b5f69a7160 2024-09-13T06:09:51.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.371+0000 7f08eb611640 1 -- 172.21.15.194:0/1119829784 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=107b] v26'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f08dc0fc070 con 0x55b5f69a7160 2024-09-13T06:09:51.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.371+0000 7f08eb611640 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69a6400 con 0x7f08d4037040 2024-09-13T06:09:51.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.371+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08e40083f0 con 0x7f08d4037040 2024-09-13T06:09:51.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.371+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69a6400 con 0x7f08dc0e0020 2024-09-13T06:09:51.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.371+0000 7f08eae10640 1 -- 172.21.15.194:0/1119829784 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08d400e620 con 0x7f08dc0e0020 2024-09-13T06:09:51.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.371+0000 7f08eae10640 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69a6400 con 0x55b5f69a7160 2024-09-13T06:09:51.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.371+0000 7f08eb611640 1 -- 172.21.15.194:0/1119829784 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08dc0fc070 con 0x55b5f69a7160 2024-09-13T06:09:51.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.371+0000 7f08eb611640 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69a6400 con 0x7f08d4037040 2024-09-13T06:09:51.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.371+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08e40083f0 con 0x7f08d4037040 2024-09-13T06:09:51.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.371+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69a6400 con 0x55b5f69a27a0 2024-09-13T06:09:51.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.371+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f08e40083f0 con 0x55b5f69a27a0 2024-09-13T06:09:51.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.371+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69a6400 con 0x7f08dc0e0020 2024-09-13T06:09:51.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.375+0000 7f08eae10640 1 -- 172.21.15.194:0/1119829784 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08d400e620 con 0x7f08dc0e0020 2024-09-13T06:09:51.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.375+0000 7f08edb01980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:09:51.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.375+0000 7f08edb01980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:09:51.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.375+0000 7f08edb01980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:09:51.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.375+0000 7f08edb01980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:09:51.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.375+0000 7f08edb01980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:09:51.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.375+0000 7f08edb01980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:09:51.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.375+0000 7f08edb01980 20 rados->read ofs=0 len=0 2024-09-13T06:09:51.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.375+0000 7f08edb01980 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69aa450 con 0x55b5f69a27a0 2024-09-13T06:09:51.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.375+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f08e40083f0 con 0x55b5f69a27a0 2024-09-13T06:09:51.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.375+0000 7f08edb01980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:51.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.375+0000 7f08edb01980 20 rados->read ofs=0 len=0 2024-09-13T06:09:51.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.375+0000 7f08edb01980 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69aacf0 con 0x55b5f69a27a0 2024-09-13T06:09:51.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.375+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f08e40083f0 con 0x55b5f69a27a0 2024-09-13T06:09:51.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.375+0000 7f08edb01980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:51.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.375+0000 7f08edb01980 20 rados->read ofs=0 len=0 2024-09-13T06:09:51.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.375+0000 7f08edb01980 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69aa090 con 0x7f08dc0e0020 2024-09-13T06:09:51.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.375+0000 7f08eae10640 1 -- 172.21.15.194:0/1119829784 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f08d400e620 con 0x7f08dc0e0020 2024-09-13T06:09:51.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.375+0000 7f08edb01980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:09:51.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.375+0000 7f08edb01980 20 zone default found 2024-09-13T06:09:51.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.375+0000 7f08edb01980 4 Realm: () 2024-09-13T06:09:51.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.375+0000 7f08edb01980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:09:51.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.375+0000 7f08edb01980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:09:51.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.375+0000 7f08edb01980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:09:51.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.375+0000 7f08edb01980 20 zonegroup default 2024-09-13T06:09:51.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.375+0000 7f08edb01980 20 rados->read ofs=0 len=0 2024-09-13T06:09:51.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.375+0000 7f08edb01980 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69aacf0 con 0x7f08d4037040 2024-09-13T06:09:51.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.375+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f08e40083f0 con 0x7f08d4037040 2024-09-13T06:09:51.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.375+0000 7f08edb01980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:51.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.375+0000 7f08edb01980 20 rados->read ofs=0 len=0 2024-09-13T06:09:51.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.375+0000 7f08edb01980 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69ad1e0 con 0x55b5f69a7160 2024-09-13T06:09:51.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.375+0000 7f08eb611640 1 -- 172.21.15.194:0/1119829784 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f08dc0fc070 con 0x55b5f69a7160 2024-09-13T06:09:51.382 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.375+0000 7f08edb01980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:51.382 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.375+0000 7f08edb01980 20 rados->read ofs=0 len=0 2024-09-13T06:09:51.382 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.375+0000 7f08edb01980 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69ad580 con 0x55b5f69a7160 2024-09-13T06:09:51.382 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.375+0000 7f08eb611640 1 -- 172.21.15.194:0/1119829784 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f08dc0fc070 con 0x55b5f69a7160 2024-09-13T06:09:51.382 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.375+0000 7f08edb01980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:51.382 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.375+0000 7f08edb01980 20 started sync module instance, tier type = 2024-09-13T06:09:51.382 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.375+0000 7f08edb01980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:09:51.382 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.375+0000 7f08edb01980 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69ac680 con 0x7f08dc0e0020 2024-09-13T06:09:51.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.375+0000 7f08eae10640 1 -- 172.21.15.194:0/1119829784 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(44 notify.0 [create] v33'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08d400e620 con 0x7f08dc0e0020 2024-09-13T06:09:51.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.375+0000 7f08edb01980 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94240014778832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69ad990 con 0x7f08dc0e0020 2024-09-13T06:09:51.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.379+0000 7f08edb01980 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69ae1e0 con 0x55b5f69a27a0 2024-09-13T06:09:51.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.379+0000 7f08eae10640 1 -- 172.21.15.194:0/1119829784 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94240014778832] v33'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08d400e620 con 0x7f08dc0e0020 2024-09-13T06:09:51.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.379+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v33'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08e40083f0 con 0x55b5f69a27a0 2024-09-13T06:09:51.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.379+0000 7f08edb01980 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94240014785840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69ae600 con 0x55b5f69a27a0 2024-09-13T06:09:51.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.379+0000 7f08edb01980 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69aee90 con 0x55b5f69a7160 2024-09-13T06:09:51.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.383+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94240014785840] v33'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08e40083f0 con 0x55b5f69a27a0 2024-09-13T06:09:51.385 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.383+0000 7f08eb611640 1 -- 172.21.15.194:0/1119829784 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v33'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08dc0fc070 con 0x55b5f69a7160 2024-09-13T06:09:51.385 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.383+0000 7f08edb01980 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94240014786896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69aea20 con 0x55b5f69a7160 2024-09-13T06:09:51.385 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.383+0000 7f08edb01980 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69af8a0 con 0x7f08dc0e0020 2024-09-13T06:09:51.385 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.383+0000 7f08eae10640 1 -- 172.21.15.194:0/1119829784 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(50 notify.3 [create] v33'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08d400e620 con 0x7f08dc0e0020 2024-09-13T06:09:51.386 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.383+0000 7f08edb01980 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94240014791664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69b00f0 con 0x7f08dc0e0020 2024-09-13T06:09:51.386 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.383+0000 7f08edb01980 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69b0ab0 con 0x55b5f69a27a0 2024-09-13T06:09:51.386 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.383+0000 7f08eb611640 1 -- 172.21.15.194:0/1119829784 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94240014786896] v33'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08dc0fc070 con 0x55b5f69a7160 2024-09-13T06:09:51.387 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.387+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v33'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08e40083f0 con 0x55b5f69a27a0 2024-09-13T06:09:51.388 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.387+0000 7f08edb01980 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94240014787952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69b0ab0 con 0x55b5f69a27a0 2024-09-13T06:09:51.388 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.387+0000 7f08edb01980 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69b14c0 con 0x7f08d4037040 2024-09-13T06:09:51.388 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.387+0000 7f08eae10640 1 -- 172.21.15.194:0/1119829784 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94240014791664] v33'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08d400e620 con 0x7f08dc0e0020 2024-09-13T06:09:51.389 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.387+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94240014787952] v33'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08e40083f0 con 0x55b5f69a27a0 2024-09-13T06:09:51.389 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.387+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(54 notify.5 [create] v33'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08e40083f0 con 0x7f08d4037040 2024-09-13T06:09:51.390 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.387+0000 7f08edb01980 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94240014796288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69b0a20 con 0x7f08d4037040 2024-09-13T06:09:51.390 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.387+0000 7f08edb01980 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69b1970 con 0x7f08d4037040 2024-09-13T06:09:51.391 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.391+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94240014796288] v33'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08e40083f0 con 0x7f08d4037040 2024-09-13T06:09:51.392 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.391+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(56 notify.6 [create] v33'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08e40083f0 con 0x7f08d4037040 2024-09-13T06:09:51.392 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.391+0000 7f08edb01980 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94240014798864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69b18e0 con 0x7f08d4037040 2024-09-13T06:09:51.392 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.391+0000 7f08edb01980 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69b2170 con 0x7f08d4037040 2024-09-13T06:09:51.394 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.391+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94240014798864] v33'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08e40083f0 con 0x7f08d4037040 2024-09-13T06:09:51.395 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.395+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(58 notify.7 [create] v33'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08e40083f0 con 0x7f08d4037040 2024-09-13T06:09:51.395 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.395+0000 7f08edb01980 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94240014799920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69b2350 con 0x7f08d4037040 2024-09-13T06:09:51.395 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.395+0000 7f08edb01980 20 add_watcher() i=0 2024-09-13T06:09:51.396 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.395+0000 7f08edb01980 20 add_watcher() i=1 2024-09-13T06:09:51.396 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.395+0000 7f08edb01980 20 add_watcher() i=2 2024-09-13T06:09:51.396 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.395+0000 7f08edb01980 20 add_watcher() i=3 2024-09-13T06:09:51.396 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.395+0000 7f08edb01980 20 add_watcher() i=4 2024-09-13T06:09:51.396 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.395+0000 7f08edb01980 20 add_watcher() i=5 2024-09-13T06:09:51.396 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.395+0000 7f08edb01980 20 add_watcher() i=6 2024-09-13T06:09:51.398 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.395+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94240014799920] v33'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08e40083f0 con 0x7f08d4037040 2024-09-13T06:09:51.398 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.395+0000 7f08edb01980 20 add_watcher() i=7 2024-09-13T06:09:51.398 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.395+0000 7f08edb01980 2 all 8 watchers are set, enabling cache 2024-09-13T06:09:51.398 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.395+0000 7f08edb01980 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69b5720 con 0x55b5f69a27a0 2024-09-13T06:09:51.398 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.395+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f08e40083f0 con 0x55b5f69a27a0 2024-09-13T06:09:51.398 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.395+0000 7f08edb01980 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94240014803520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69b2b10 con 0x55b5f69a27a0 2024-09-13T06:09:51.403 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.399+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94240014803520] v33'24 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f08e40083f0 con 0x55b5f69a27a0 2024-09-13T06:09:51.403 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.399+0000 7f07a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:51.403 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.399+0000 7f08edb01980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:09:51.403 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.399+0000 7f08edb01980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:09:51.403 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.399+0000 7f08edb01980 5 note: GC not initialized 2024-09-13T06:09:51.403 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.399+0000 7f07a0fe1640 20 reqs_thread_entry: start 2024-09-13T06:09:51.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.399+0000 7f08edb01980 20 init_complete bucket index max shards: 11 2024-09-13T06:09:51.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.399+0000 7f08edb01980 20 Filter name: none 2024-09-13T06:09:51.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.399+0000 7f071a7fc640 20 reqs_thread_entry: start 2024-09-13T06:09:51.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.399+0000 7f08edb01980 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69d8350 con 0x55b5f69a7160 2024-09-13T06:09:51.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.399+0000 7f08eb611640 1 -- 172.21.15.194:0/1119829784 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(62 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08dc0fc070 con 0x55b5f69a7160 2024-09-13T06:09:51.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.399+0000 7f08eb611640 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69ad1e0 con 0x55b5f69a7160 2024-09-13T06:09:51.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.399+0000 7f08eb611640 1 -- 172.21.15.194:0/1119829784 <== osd.3 v2:172.21.15.194:6816/96632515 16 ==== osd_op_reply(63 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08dc0fc070 con 0x55b5f69a7160 2024-09-13T06:09:51.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.399+0000 7f08eb611640 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69ad1e0 con 0x55b5f69a27a0 2024-09-13T06:09:51.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.399+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(64 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08e40083f0 con 0x55b5f69a27a0 2024-09-13T06:09:51.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.399+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69aa450 con 0x55b5f69a27a0 2024-09-13T06:09:51.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.399+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(65 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08e40083f0 con 0x55b5f69a27a0 2024-09-13T06:09:51.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.399+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69aa450 con 0x7f08dc0e0020 2024-09-13T06:09:51.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.399+0000 7f08eae10640 1 -- 172.21.15.194:0/1119829784 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(66 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08d400e620 con 0x7f08dc0e0020 2024-09-13T06:09:51.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.399+0000 7f08eae10640 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69af8a0 con 0x55b5f69a7160 2024-09-13T06:09:51.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.399+0000 7f08eb611640 1 -- 172.21.15.194:0/1119829784 <== osd.3 v2:172.21.15.194:6816/96632515 17 ==== osd_op_reply(67 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08dc0fc070 con 0x55b5f69a7160 2024-09-13T06:09:51.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.399+0000 7f08eb611640 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69af8a0 con 0x55b5f69a27a0 2024-09-13T06:09:51.406 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.399+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(68 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08e40083f0 con 0x55b5f69a27a0 2024-09-13T06:09:51.406 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.399+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69af8a0 con 0x55b5f69a7160 2024-09-13T06:09:51.406 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.399+0000 7f08eb611640 1 -- 172.21.15.194:0/1119829784 <== osd.3 v2:172.21.15.194:6816/96632515 18 ==== osd_op_reply(69 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08dc0fc070 con 0x55b5f69a7160 2024-09-13T06:09:51.406 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.399+0000 7f08eb611640 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69af8a0 con 0x7f08dc0e0020 2024-09-13T06:09:51.406 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.399+0000 7f08eae10640 1 -- 172.21.15.194:0/1119829784 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(70 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08d400e620 con 0x7f08dc0e0020 2024-09-13T06:09:51.406 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.399+0000 7f08eae10640 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69af8a0 con 0x55b5f69a7160 2024-09-13T06:09:51.406 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.403+0000 7f08eb611640 1 -- 172.21.15.194:0/1119829784 <== osd.3 v2:172.21.15.194:6816/96632515 19 ==== osd_op_reply(71 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08dc0fc070 con 0x55b5f69a7160 2024-09-13T06:09:51.406 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.403+0000 7f08eb611640 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69af8a0 con 0x55b5f69a27a0 2024-09-13T06:09:51.406 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.403+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(72 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08e40083f0 con 0x55b5f69a27a0 2024-09-13T06:09:51.407 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.403+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69af8a0 con 0x7f08d4037040 2024-09-13T06:09:51.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.403+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(73 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08e40083f0 con 0x7f08d4037040 2024-09-13T06:09:51.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.403+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69af8a0 con 0x7f08d4037040 2024-09-13T06:09:51.412 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.403+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(74 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08e40083f0 con 0x7f08d4037040 2024-09-13T06:09:51.412 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.403+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69af8a0 con 0x55b5f69a7160 2024-09-13T06:09:51.412 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.403+0000 7f08eb611640 1 -- 172.21.15.194:0/1119829784 <== osd.3 v2:172.21.15.194:6816/96632515 20 ==== osd_op_reply(75 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08dc0fc070 con 0x55b5f69a7160 2024-09-13T06:09:51.412 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.403+0000 7f08eb611640 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69af8a0 con 0x7f08d4037040 2024-09-13T06:09:51.412 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.403+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(76 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08e40083f0 con 0x7f08d4037040 2024-09-13T06:09:51.412 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.403+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f08e4040040 con 0x7f08d4037040 2024-09-13T06:09:51.412 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.403+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 <== osd.0 v2:172.21.15.120:6800/1923744619 20 ==== osd_op_reply(77 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08e40083f0 con 0x7f08d4037040 2024-09-13T06:09:51.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.403+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f08e4040040 con 0x7f08d4037040 2024-09-13T06:09:51.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.407+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 <== osd.0 v2:172.21.15.120:6800/1923744619 21 ==== osd_op_reply(78 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08e40083f0 con 0x7f08d4037040 2024-09-13T06:09:51.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.407+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f08e4040040 con 0x55b5f69a7160 2024-09-13T06:09:51.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.407+0000 7f08eb611640 1 -- 172.21.15.194:0/1119829784 <== osd.3 v2:172.21.15.194:6816/96632515 21 ==== osd_op_reply(79 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08dc0fc070 con 0x55b5f69a7160 2024-09-13T06:09:51.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.407+0000 7f08eb611640 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f08e4040040 con 0x7f08dc0e0020 2024-09-13T06:09:51.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.407+0000 7f08eae10640 1 -- 172.21.15.194:0/1119829784 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(80 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08d400e620 con 0x7f08dc0e0020 2024-09-13T06:09:51.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.407+0000 7f08eae10640 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f08e4040040 con 0x55b5f69a27a0 2024-09-13T06:09:51.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.407+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 <== osd.1 v2:172.21.15.194:6808/3135444559 25 ==== osd_op_reply(81 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08e40083f0 con 0x55b5f69a27a0 2024-09-13T06:09:51.414 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.407+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f08e4040040 con 0x55b5f69a27a0 2024-09-13T06:09:51.414 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.407+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 <== osd.1 v2:172.21.15.194:6808/3135444559 26 ==== osd_op_reply(82 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08e40083f0 con 0x55b5f69a27a0 2024-09-13T06:09:51.414 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.407+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f08e4040040 con 0x55b5f69a7160 2024-09-13T06:09:51.414 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.407+0000 7f08eb611640 1 -- 172.21.15.194:0/1119829784 <== osd.3 v2:172.21.15.194:6816/96632515 22 ==== osd_op_reply(83 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08dc0fc070 con 0x55b5f69a7160 2024-09-13T06:09:51.414 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.407+0000 7f08eb611640 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f08e4040040 con 0x7f08dc0e0020 2024-09-13T06:09:51.414 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.407+0000 7f08eae10640 1 -- 172.21.15.194:0/1119829784 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== osd_op_reply(84 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08d400e620 con 0x7f08dc0e0020 2024-09-13T06:09:51.414 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.407+0000 7f08eae10640 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f08e4040040 con 0x7f08d4037040 2024-09-13T06:09:51.414 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.407+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 <== osd.0 v2:172.21.15.120:6800/1923744619 22 ==== osd_op_reply(85 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08e40083f0 con 0x7f08d4037040 2024-09-13T06:09:51.414 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.407+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f08e4040040 con 0x55b5f69a27a0 2024-09-13T06:09:51.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.407+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 <== osd.1 v2:172.21.15.194:6808/3135444559 27 ==== osd_op_reply(86 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08e40083f0 con 0x55b5f69a27a0 2024-09-13T06:09:51.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.407+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f08e4040040 con 0x7f08d4037040 2024-09-13T06:09:51.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.411+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 <== osd.0 v2:172.21.15.120:6800/1923744619 23 ==== osd_op_reply(87 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08e40083f0 con 0x7f08d4037040 2024-09-13T06:09:51.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.411+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f08e4040040 con 0x55b5f69a7160 2024-09-13T06:09:51.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.411+0000 7f08eb611640 1 -- 172.21.15.194:0/1119829784 <== osd.3 v2:172.21.15.194:6816/96632515 23 ==== osd_op_reply(88 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08dc0fc070 con 0x55b5f69a7160 2024-09-13T06:09:51.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.411+0000 7f08eb611640 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f08e4040040 con 0x7f08dc0e0020 2024-09-13T06:09:51.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.411+0000 7f08eae10640 1 -- 172.21.15.194:0/1119829784 <== osd.2 v2:172.21.15.194:6800/815615585 16 ==== osd_op_reply(89 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08d400e620 con 0x7f08dc0e0020 2024-09-13T06:09:51.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.411+0000 7f08eae10640 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f08e4040040 con 0x7f08d4037040 2024-09-13T06:09:51.417 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.411+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 <== osd.0 v2:172.21.15.120:6800/1923744619 24 ==== osd_op_reply(90 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08e40083f0 con 0x7f08d4037040 2024-09-13T06:09:51.418 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.411+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f08e4040040 con 0x55b5f69a27a0 2024-09-13T06:09:51.418 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.411+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 <== osd.1 v2:172.21.15.194:6808/3135444559 28 ==== osd_op_reply(91 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08e40083f0 con 0x55b5f69a27a0 2024-09-13T06:09:51.418 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.411+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f08e4040040 con 0x55b5f69a7160 2024-09-13T06:09:51.418 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.411+0000 7f08eb611640 1 -- 172.21.15.194:0/1119829784 <== osd.3 v2:172.21.15.194:6816/96632515 24 ==== osd_op_reply(92 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08dc0fc070 con 0x55b5f69a7160 2024-09-13T06:09:51.418 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.411+0000 7f08eb611640 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f08e4040040 con 0x7f08dc0e0020 2024-09-13T06:09:51.418 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.411+0000 7f08eae10640 1 -- 172.21.15.194:0/1119829784 <== osd.2 v2:172.21.15.194:6800/815615585 17 ==== osd_op_reply(93 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08d400e620 con 0x7f08dc0e0020 2024-09-13T06:09:51.418 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.415+0000 7f07a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:51.418 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.415+0000 7f08edb01980 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94240014803520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69ad1e0 con 0x55b5f69a27a0 2024-09-13T06:09:51.418 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.415+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 <== osd.1 v2:172.21.15.194:6808/3135444559 29 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94240014803520] v33'25 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f08e40083f0 con 0x55b5f69a27a0 2024-09-13T06:09:51.418 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.415+0000 7f08edb01980 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94240014778832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69af8a0 con 0x7f08dc0e0020 2024-09-13T06:09:51.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.415+0000 7f08eae10640 1 -- 172.21.15.194:0/1119829784 <== osd.2 v2:172.21.15.194:6800/815615585 18 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94240014778832] v33'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08d400e620 con 0x7f08dc0e0020 2024-09-13T06:09:51.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.415+0000 7f08edb01980 20 remove_watcher() i=0 2024-09-13T06:09:51.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.415+0000 7f08edb01980 2 removed watcher, disabling cache 2024-09-13T06:09:51.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.415+0000 7f08edb01980 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94240014785840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69aa450 con 0x55b5f69a27a0 2024-09-13T06:09:51.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.419+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 <== osd.1 v2:172.21.15.194:6808/3135444559 30 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94240014785840] v33'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08e40083f0 con 0x55b5f69a27a0 2024-09-13T06:09:51.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.419+0000 7f08edb01980 20 remove_watcher() i=1 2024-09-13T06:09:51.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.419+0000 7f08edb01980 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94240014786896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69af8a0 con 0x55b5f69a7160 2024-09-13T06:09:51.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.419+0000 7f08eb611640 1 -- 172.21.15.194:0/1119829784 <== osd.3 v2:172.21.15.194:6816/96632515 25 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94240014786896] v33'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08dc0fc070 con 0x55b5f69a7160 2024-09-13T06:09:51.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.419+0000 7f08edb01980 20 remove_watcher() i=2 2024-09-13T06:09:51.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.419+0000 7f08edb01980 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94240014791664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69aa450 con 0x7f08dc0e0020 2024-09-13T06:09:51.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.423+0000 7f08eae10640 1 -- 172.21.15.194:0/1119829784 <== osd.2 v2:172.21.15.194:6800/815615585 19 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94240014791664] v33'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08d400e620 con 0x7f08dc0e0020 2024-09-13T06:09:51.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.423+0000 7f08edb01980 20 remove_watcher() i=3 2024-09-13T06:09:51.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.423+0000 7f08edb01980 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94240014787952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69aa450 con 0x55b5f69a27a0 2024-09-13T06:09:51.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.423+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 <== osd.1 v2:172.21.15.194:6808/3135444559 31 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94240014787952] v33'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08e40083f0 con 0x55b5f69a27a0 2024-09-13T06:09:51.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.423+0000 7f08edb01980 20 remove_watcher() i=4 2024-09-13T06:09:51.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.423+0000 7f08edb01980 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94240014796288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69aa450 con 0x7f08d4037040 2024-09-13T06:09:51.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.427+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 <== osd.0 v2:172.21.15.120:6800/1923744619 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94240014796288] v33'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08e40083f0 con 0x7f08d4037040 2024-09-13T06:09:51.427 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.427+0000 7f08edb01980 20 remove_watcher() i=5 2024-09-13T06:09:51.427 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.427+0000 7f08edb01980 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94240014798864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69aa450 con 0x7f08d4037040 2024-09-13T06:09:51.428 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.427+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 <== osd.0 v2:172.21.15.120:6800/1923744619 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94240014798864] v33'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08e40083f0 con 0x7f08d4037040 2024-09-13T06:09:51.429 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.427+0000 7f08edb01980 20 remove_watcher() i=6 2024-09-13T06:09:51.429 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.427+0000 7f08edb01980 1 -- 172.21.15.194:0/1119829784 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94240014799920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b5f69aa450 con 0x7f08d4037040 2024-09-13T06:09:51.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.431+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 <== osd.0 v2:172.21.15.120:6800/1923744619 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94240014799920] v33'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08e40083f0 con 0x7f08d4037040 2024-09-13T06:09:51.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.431+0000 7f08edb01980 20 remove_watcher() i=7 2024-09-13T06:09:51.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.431+0000 7f08edb01980 1 -- 172.21.15.194:0/1119829784 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f08d4037040 msgr2=0x7f08d4036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:51.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.431+0000 7f08edb01980 1 --2- 172.21.15.194:0/1119829784 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f08d4037040 0x7f08d4036410 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:51.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.431+0000 7f08edb01980 1 -- 172.21.15.194:0/1119829784 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55b5f69a27a0 msgr2=0x55b5f69a4c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:51.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.431+0000 7f08edb01980 1 --2- 172.21.15.194:0/1119829784 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55b5f69a27a0 0x55b5f69a4c60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:51.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.431+0000 7f08edb01980 1 -- 172.21.15.194:0/1119829784 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f08dc0e0020 msgr2=0x7f08dc0ff880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:51.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.431+0000 7f08edb01980 1 --2- 172.21.15.194:0/1119829784 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f08dc0e0020 0x7f08dc0ff880 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:51.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.431+0000 7f08edb01980 1 -- 172.21.15.194:0/1119829784 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55b5f69a7160 msgr2=0x55b5f69a9550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:51.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.431+0000 7f08edb01980 1 --2- 172.21.15.194:0/1119829784 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55b5f69a7160 0x55b5f69a9550 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:51.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.431+0000 7f08edb01980 1 -- 172.21.15.194:0/1119829784 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f07b4034650 msgr2=0x7f07b4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:51.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.431+0000 7f08edb01980 1 --2- 172.21.15.194:0/1119829784 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f07b4034650 0x7f07b4036b10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x55b5f696de60 tx=0x7f08d4010000 comp rx=0 tx=0).stop 2024-09-13T06:09:51.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.431+0000 7f08edb01980 1 -- 172.21.15.194:0/1119829784 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b5f6990660 msgr2=0x55b5f6997880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:51.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.431+0000 7f08ebe12640 1 -- 172.21.15.194:0/1119829784 reap_dead start 2024-09-13T06:09:51.437 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.431+0000 7f08edb01980 1 --2- 172.21.15.194:0/1119829784 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b5f6990660 0x55b5f6997880 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f08dc0c8c50 tx=0x7f08dc0b8f10 comp rx=0 tx=0).stop 2024-09-13T06:09:51.437 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.431+0000 7f08edb01980 1 -- 172.21.15.194:0/1119829784 shutdown_connections 2024-09-13T06:09:51.437 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.431+0000 7f08edb01980 1 --2- 172.21.15.194:0/1119829784 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b5f6990660 0x55b5f6997880 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:51.437 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.431+0000 7f08edb01980 1 -- 172.21.15.194:0/1119829784 >> 172.21.15.194:0/1119829784 conn(0x55b5f698ca40 msgr2=0x55b5f698ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:51.437 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.431+0000 7f08edb01980 1 -- 172.21.15.194:0/1119829784 shutdown_connections 2024-09-13T06:09:51.437 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.431+0000 7f08edb01980 1 -- 172.21.15.194:0/1119829784 wait complete. 2024-09-13T06:09:51.437 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.431+0000 7f08edb01980 1 -- 172.21.15.194:0/1305644842 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f07c4034650 msgr2=0x7f07c4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:51.437 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.431+0000 7f08edb01980 1 --2- 172.21.15.194:0/1305644842 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f07c4034650 0x7f07c4036b10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f08d400bf60 tx=0x7f08d400f000 comp rx=0 tx=0).stop 2024-09-13T06:09:51.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.431+0000 7f08edb01980 1 -- 172.21.15.194:0/1305644842 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b5f6983d60 msgr2=0x55b5f6984180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:51.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.431+0000 7f08edb01980 1 --2- 172.21.15.194:0/1305644842 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b5f6983d60 0x55b5f6984180 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f08dc0a98e0 tx=0x7f08dc0b5960 comp rx=0 tx=0).stop 2024-09-13T06:09:51.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.431+0000 7f08edb01980 1 -- 172.21.15.194:0/1305644842 shutdown_connections 2024-09-13T06:09:51.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.431+0000 7f08edb01980 1 --2- 172.21.15.194:0/1305644842 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f07c4034650 0x7f07c4036b10 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:51.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.431+0000 7f08edb01980 1 --2- 172.21.15.194:0/1305644842 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b5f6983d60 0x55b5f6984180 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:51.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.431+0000 7f08edb01980 1 -- 172.21.15.194:0/1305644842 >> 172.21.15.194:0/1305644842 conn(0x55b5f6978eb0 msgr2=0x55b5f697b930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:51.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.431+0000 7f08edb01980 1 -- 172.21.15.194:0/1305644842 shutdown_connections 2024-09-13T06:09:51.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.431+0000 7f08edb01980 1 -- 172.21.15.194:0/1305644842 wait complete. 2024-09-13T06:09:51.439 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.431+0000 7f08edb01980 1 -- 172.21.15.194:0/611681228 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55b5f68723e0 msgr2=0x55b5f696d030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:51.439 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.431+0000 7f08edb01980 1 --2- 172.21.15.194:0/611681228 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55b5f68723e0 0x55b5f696d030 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:51.439 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.431+0000 7f08edb01980 1 -- 172.21.15.194:0/611681228 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55b5f69737d0 msgr2=0x55b5f6975bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:51.439 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.431+0000 7f08edb01980 1 --2- 172.21.15.194:0/611681228 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55b5f69737d0 0x55b5f6975bc0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:51.439 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.431+0000 7f08edb01980 1 -- 172.21.15.194:0/611681228 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55b5f696f8b0 msgr2=0x55b5f6971ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:51.439 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.431+0000 7f08edb01980 1 --2- 172.21.15.194:0/611681228 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55b5f696f8b0 0x55b5f6971ca0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:51.439 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.431+0000 7f08edb01980 1 -- 172.21.15.194:0/611681228 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f07d0034650 msgr2=0x7f07d0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:51.440 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.431+0000 7f08edb01980 1 --2- 172.21.15.194:0/611681228 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f07d0034650 0x7f07d0036b10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f08d4000f70 tx=0x7f08d40012c0 comp rx=0 tx=0).stop 2024-09-13T06:09:51.440 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.431+0000 7f08edb01980 1 -- 172.21.15.194:0/611681228 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b5f686fab0 msgr2=0x55b5f6965f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:51.440 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.431+0000 7f08edb01980 1 --2- 172.21.15.194:0/611681228 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b5f686fab0 0x55b5f6965f30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f08dc01b870 tx=0x7f08dc017d70 comp rx=0 tx=0).stop 2024-09-13T06:09:51.440 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.431+0000 7f08ebe12640 1 -- 172.21.15.194:0/611681228 reap_dead start 2024-09-13T06:09:51.440 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.431+0000 7f08edb01980 1 -- 172.21.15.194:0/611681228 shutdown_connections 2024-09-13T06:09:51.440 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.431+0000 7f08edb01980 1 -- 172.21.15.194:0/611681228 >> 172.21.15.194:0/611681228 conn(0x55b5f686b790 msgr2=0x55b5f69593d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:51.440 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.431+0000 7f08edb01980 1 -- 172.21.15.194:0/611681228 shutdown_connections 2024-09-13T06:09:51.441 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.431+0000 7f08edb01980 1 -- 172.21.15.194:0/611681228 wait complete. 2024-09-13T06:09:51.444 INFO:teuthology.orchestra.run.smithi194.stdout:[] 2024-09-13T06:09:51.444 DEBUG:tasks.util.rgw: json result: [] 2024-09-13T06:09:51.445 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud'] 2024-09-13T06:09:51.445 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud'] 2024-09-13T06:09:51.445 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud 2024-09-13T06:09:51.522 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:09:51.522 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:09:51.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.523+0000 7fad1f250980 1 Processor -- start 2024-09-13T06:09:51.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.523+0000 7fad1f250980 1 -- start start 2024-09-13T06:09:51.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.523+0000 7fad1f250980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55f53ebedc60 0x55f53ebf0050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:51.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.523+0000 7fad1f250980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f53ea6fae0 con 0x55f53ebe98e0 2024-09-13T06:09:51.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.523+0000 7fad1f250980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x55f53ea93e30 con 0x55f53ebedc60 2024-09-13T06:09:51.524 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.523+0000 7fad1c55f640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55f53ebedc60 0x55f53ebf0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:51.524 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.523+0000 7fad1cd60640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x55f53ebe98e0 0x55f53ebe9cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:51666/0 (socket says 172.21.15.194:51666) 2024-09-13T06:09:51.524 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.523+0000 7fad1cd60640 1 -- 172.21.15.194:0/1792245211 learned_addr learned my addr 172.21.15.194:0/1792245211 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-09-13T06:09:51.524 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.523+0000 7fad1c55f640 1 -- 172.21.15.194:0/1792245211 >> v1:172.21.15.120:6789/0 conn(0x55f53ebe98e0 legacy=0x55f53ebe9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:51.524 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.523+0000 7fad1c55f640 1 -- 172.21.15.194:0/1792245211 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f53ebf15a0 con 0x55f53ebedc60 2024-09-13T06:09:51.527 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.527+0000 7fad1c55f640 1 --2- 172.21.15.194:0/1792245211 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f53ebedc60 0x55f53ebf0050 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fad1000a480 tx=0x7fad1001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9c418eceb7336d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:51.527 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.527+0000 7fad1bd5e640 1 -- 172.21.15.194:0/1792245211 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad100b0070 con 0x55f53ebedc60 2024-09-13T06:09:51.528 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.527+0000 7fad1bd5e640 1 -- 172.21.15.194:0/1792245211 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad100ab540 con 0x55f53ebedc60 2024-09-13T06:09:51.528 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.527+0000 7fad1bd5e640 1 -- 172.21.15.194:0/1792245211 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad100ab840 con 0x55f53ebedc60 2024-09-13T06:09:51.528 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.527+0000 7fad1f250980 1 -- 172.21.15.194:0/1792245211 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f53ebedc60 msgr2=0x55f53ebf0050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:51.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.527+0000 7fad1f250980 1 --2- 172.21.15.194:0/1792245211 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f53ebedc60 0x55f53ebf0050 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fad1000a480 tx=0x7fad1001b280 comp rx=0 tx=0).stop 2024-09-13T06:09:51.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.527+0000 7fad1f250980 1 -- 172.21.15.194:0/1792245211 shutdown_connections 2024-09-13T06:09:51.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.527+0000 7fad1f250980 1 --2- 172.21.15.194:0/1792245211 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f53ebedc60 0x55f53ebf0050 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:51.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.527+0000 7fad1f250980 1 -- 172.21.15.194:0/1792245211 >> 172.21.15.194:0/1792245211 conn(0x55f53eb5d230 msgr2=0x55f53eb5d640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:51.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.527+0000 7fad1f250980 1 -- 172.21.15.194:0/1792245211 shutdown_connections 2024-09-13T06:09:51.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.527+0000 7fad1f250980 1 -- 172.21.15.194:0/1792245211 wait complete. 2024-09-13T06:09:51.544 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.543+0000 7fad1f250980 1 Processor -- start 2024-09-13T06:09:51.544 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.543+0000 7fad1f250980 1 -- start start 2024-09-13T06:09:51.544 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.543+0000 7fad1f250980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f53ebe98e0 0x55f53ecd4c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:51.544 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.543+0000 7fad1f250980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55f53ea95200 con 0x55f53ebe98e0 2024-09-13T06:09:51.545 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.543+0000 7fad1cd60640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f53ebe98e0 0x55f53ecd4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:51.546 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.543+0000 7fad1cd60640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f53ebe98e0 0x55f53ecd4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:54612/0 (socket says 172.21.15.194:54612) 2024-09-13T06:09:51.546 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.543+0000 7fad1cd60640 1 -- 172.21.15.194:0/3289270220 learned_addr learned my addr 172.21.15.194:0/3289270220 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:51.546 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.543+0000 7fad1cd60640 1 -- 172.21.15.194:0/3289270220 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f53ecd5210 con 0x55f53ebe98e0 2024-09-13T06:09:51.546 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.543+0000 7fad1cd60640 1 --2- 172.21.15.194:0/3289270220 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f53ebe98e0 0x55f53ecd4c40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fad0c0017b0 tx=0x7fad0c001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4c46f99a5e78baa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:51.546 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.543+0000 7fac0ae0d640 1 -- 172.21.15.194:0/3289270220 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad0c016070 con 0x55f53ebe98e0 2024-09-13T06:09:51.546 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.543+0000 7fac0ae0d640 1 -- 172.21.15.194:0/3289270220 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad0c004530 con 0x55f53ebe98e0 2024-09-13T06:09:51.546 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.543+0000 7fac0ae0d640 1 -- 172.21.15.194:0/3289270220 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad0c004870 con 0x55f53ebe98e0 2024-09-13T06:09:51.547 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.547+0000 7fad1f250980 1 -- 172.21.15.194:0/3289270220 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f53ebe98e0 msgr2=0x55f53ecd4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:51.548 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.547+0000 7fad1f250980 1 --2- 172.21.15.194:0/3289270220 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f53ebe98e0 0x55f53ecd4c40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fad0c0017b0 tx=0x7fad0c001c70 comp rx=0 tx=0).stop 2024-09-13T06:09:51.548 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.547+0000 7fad1f250980 1 -- 172.21.15.194:0/3289270220 shutdown_connections 2024-09-13T06:09:51.548 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.547+0000 7fad1f250980 1 --2- 172.21.15.194:0/3289270220 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f53ebe98e0 0x55f53ecd4c40 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:51.548 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.547+0000 7fad1f250980 1 -- 172.21.15.194:0/3289270220 >> 172.21.15.194:0/3289270220 conn(0x55f53eb5d230 msgr2=0x55f53ecd0870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:51.548 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.547+0000 7fad1f250980 1 -- 172.21.15.194:0/3289270220 shutdown_connections 2024-09-13T06:09:51.548 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.547+0000 7fad1f250980 1 -- 172.21.15.194:0/3289270220 wait complete. 2024-09-13T06:09:51.548 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.547+0000 7fad1f250980 1 Processor -- start 2024-09-13T06:09:51.548 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.547+0000 7fad1f250980 1 -- start start 2024-09-13T06:09:51.548 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.547+0000 7fad1f250980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f53ebe98e0 0x55f53ecdc060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:51.548 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.547+0000 7fad1f250980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55f53ebf10a0 con 0x55f53ebe98e0 2024-09-13T06:09:51.548 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.547+0000 7fad1cd60640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f53ebe98e0 0x55f53ecdc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:51.549 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.547+0000 7fad1cd60640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f53ebe98e0 0x55f53ecdc060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:54622/0 (socket says 172.21.15.194:54622) 2024-09-13T06:09:51.549 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.547+0000 7fad1cd60640 1 -- 172.21.15.194:0/2223822392 learned_addr learned my addr 172.21.15.194:0/2223822392 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:51.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.547+0000 7fad1cd60640 1 -- 172.21.15.194:0/2223822392 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f53ecdc5a0 con 0x55f53ebe98e0 2024-09-13T06:09:51.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.547+0000 7fad1cd60640 1 --2- 172.21.15.194:0/2223822392 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f53ebe98e0 0x55f53ecdc060 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fad0c014040 tx=0x7fad0c001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:51.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.547+0000 7fac0960a640 1 -- 172.21.15.194:0/2223822392 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad0c020070 con 0x55f53ebe98e0 2024-09-13T06:09:51.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.547+0000 7fac0960a640 1 -- 172.21.15.194:0/2223822392 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad0c011400 con 0x55f53ebe98e0 2024-09-13T06:09:51.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.547+0000 7fad1f250980 1 -- 172.21.15.194:0/2223822392 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f53ecdc830 con 0x55f53ebe98e0 2024-09-13T06:09:51.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.547+0000 7fac0960a640 1 -- 172.21.15.194:0/2223822392 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad0c016040 con 0x55f53ebe98e0 2024-09-13T06:09:51.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.547+0000 7fad1f250980 1 -- 172.21.15.194:0/2223822392 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f53ecdf510 con 0x55f53ebe98e0 2024-09-13T06:09:51.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.547+0000 7fac0960a640 1 -- 172.21.15.194:0/2223822392 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fad0c023070 con 0x55f53ebe98e0 2024-09-13T06:09:51.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.547+0000 7fac0960a640 1 --2- 172.21.15.194:0/2223822392 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fac04034650 0x7fac04036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:51.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.547+0000 7fac0960a640 1 -- 172.21.15.194:0/2223822392 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fad0c0490d0 con 0x55f53ebe98e0 2024-09-13T06:09:51.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.551+0000 7fad1c55f640 1 --2- 172.21.15.194:0/2223822392 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fac04034650 0x7fac04036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:51.552 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.551+0000 7fad1f250980 1 --2- 172.21.15.194:0/2223822392 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55f53ebedc60 0x55f53ece3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:51.552 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.551+0000 7fad1f250980 1 -- 172.21.15.194:0/2223822392 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f53ece36a0 con 0x55f53ebedc60 2024-09-13T06:09:51.552 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.551+0000 7fad1d561640 1 --2- 172.21.15.194:0/2223822392 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55f53ebedc60 0x55f53ece3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:51.552 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.551+0000 7fad1c55f640 1 --2- 172.21.15.194:0/2223822392 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fac04034650 0x7fac04036b10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fad100ad000 tx=0x7fad100a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:51.552 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.551+0000 7fad1d561640 1 --2- 172.21.15.194:0/2223822392 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55f53ebedc60 0x55f53ece3160 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:51.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.551+0000 7fad1d561640 1 -- 172.21.15.194:0/2223822392 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fad140083f0 con 0x55f53ebedc60 2024-09-13T06:09:51.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.551+0000 7fad1f250980 1 -- 172.21.15.194:0/2223822392 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f53ece0710 con 0x55f53ebedc60 2024-09-13T06:09:51.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.551+0000 7fad1d561640 1 -- 172.21.15.194:0/2223822392 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fad140083f0 con 0x55f53ebedc60 2024-09-13T06:09:51.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.551+0000 7fad1f250980 1 --2- 172.21.15.194:0/2223822392 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55f53ece59c0 0x55f53ece7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:51.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.551+0000 7fad1f250980 1 -- 172.21.15.194:0/2223822392 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f53ece8480 con 0x55f53ece59c0 2024-09-13T06:09:51.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.551+0000 7fad1cd60640 1 --2- 172.21.15.194:0/2223822392 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55f53ece59c0 0x55f53ece7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:51.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.551+0000 7fad1cd60640 1 --2- 172.21.15.194:0/2223822392 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55f53ece59c0 0x55f53ece7db0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:51.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.551+0000 7fad1cd60640 1 -- 172.21.15.194:0/2223822392 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fad0c02c070 con 0x55f53ece59c0 2024-09-13T06:09:51.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.551+0000 7fad1f250980 1 -- 172.21.15.194:0/2223822392 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f53ece4830 con 0x55f53ebedc60 2024-09-13T06:09:51.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.551+0000 7fad1d561640 1 -- 172.21.15.194:0/2223822392 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fad140083f0 con 0x55f53ebedc60 2024-09-13T06:09:51.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.551+0000 7fad1f250980 1 --2- 172.21.15.194:0/2223822392 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55f53ece98c0 0x55f53ecebcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:51.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.551+0000 7fad1f250980 1 -- 172.21.15.194:0/2223822392 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f53ecec420 con 0x55f53ece98c0 2024-09-13T06:09:51.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.551+0000 7fad1c55f640 1 --2- 172.21.15.194:0/2223822392 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55f53ece98c0 0x55f53ecebcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:51.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.551+0000 7fad1c55f640 1 --2- 172.21.15.194:0/2223822392 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55f53ece98c0 0x55f53ecebcb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:51.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.551+0000 7fad1c55f640 1 -- 172.21.15.194:0/2223822392 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fad100b3040 con 0x55f53ece98c0 2024-09-13T06:09:51.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.551+0000 7fad1f250980 1 Processor -- start 2024-09-13T06:09:51.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.555+0000 7fad1f250980 1 -- start start 2024-09-13T06:09:51.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.555+0000 7fad1f250980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f53ecf9e30 0x55f53ecfa250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:51.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.555+0000 7fad1f250980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55f53eaee800 con 0x55f53ecf9e30 2024-09-13T06:09:51.558 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.555+0000 7fad1cd60640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f53ecf9e30 0x55f53ecfa250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:51.558 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.555+0000 7fad1cd60640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f53ecf9e30 0x55f53ecfa250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:54636/0 (socket says 172.21.15.194:54636) 2024-09-13T06:09:51.558 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.555+0000 7fad1cd60640 1 -- 172.21.15.194:0/3650788649 learned_addr learned my addr 172.21.15.194:0/3650788649 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:51.558 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.555+0000 7fad1cd60640 1 -- 172.21.15.194:0/3650788649 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f53ecfa790 con 0x55f53ecf9e30 2024-09-13T06:09:51.558 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.555+0000 7fad1cd60640 1 --2- 172.21.15.194:0/3650788649 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f53ecf9e30 0x55f53ecfa250 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fad0c047520 tx=0x7fad0c024fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:51.558 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.555+0000 7fac027fc640 1 -- 172.21.15.194:0/3650788649 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad0c03f070 con 0x55f53ecf9e30 2024-09-13T06:09:51.558 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.555+0000 7fac027fc640 1 -- 172.21.15.194:0/3650788649 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad0c01bd50 con 0x55f53ecf9e30 2024-09-13T06:09:51.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.555+0000 7fad1f250980 1 -- 172.21.15.194:0/3650788649 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f53ecfaa20 con 0x55f53ecf9e30 2024-09-13T06:09:51.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.555+0000 7fac027fc640 1 -- 172.21.15.194:0/3650788649 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad0c026ac0 con 0x55f53ecf9e30 2024-09-13T06:09:51.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.555+0000 7fad1f250980 1 -- 172.21.15.194:0/3650788649 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f53ecfd6a0 con 0x55f53ecf9e30 2024-09-13T06:09:51.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.555+0000 7fac027fc640 1 -- 172.21.15.194:0/3650788649 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fad0c043040 con 0x55f53ecf9e30 2024-09-13T06:09:51.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.555+0000 7fac027fc640 1 --2- 172.21.15.194:0/3650788649 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fabf4034650 0x7fabf4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:51.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.555+0000 7fac027fc640 1 -- 172.21.15.194:0/3650788649 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fad0c04ad10 con 0x55f53ecf9e30 2024-09-13T06:09:51.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.555+0000 7fad1c55f640 1 --2- 172.21.15.194:0/3650788649 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fabf4034650 0x7fabf4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:51.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.555+0000 7fad1f250980 1 Processor -- start 2024-09-13T06:09:51.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.555+0000 7fad1f250980 1 -- start start 2024-09-13T06:09:51.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.555+0000 7fad1c55f640 1 --2- 172.21.15.194:0/3650788649 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fabf4034650 0x7fabf4036b10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fad1000a480 tx=0x7fad10005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:51.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.555+0000 7fad1f250980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f53ed06830 0x55f53ed06c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:51.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.555+0000 7fad1f250980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55f53ecd5590 con 0x55f53ed06830 2024-09-13T06:09:51.562 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.559+0000 7fad1cd60640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f53ed06830 0x55f53ed06c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:51.562 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.559+0000 7fad1cd60640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f53ed06830 0x55f53ed06c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:54652/0 (socket says 172.21.15.194:54652) 2024-09-13T06:09:51.562 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.559+0000 7fad1cd60640 1 -- 172.21.15.194:0/2323483957 learned_addr learned my addr 172.21.15.194:0/2323483957 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:51.562 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.559+0000 7fad1cd60640 1 -- 172.21.15.194:0/2323483957 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f53ed071e0 con 0x55f53ed06830 2024-09-13T06:09:51.562 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.559+0000 7fad1cd60640 1 --2- 172.21.15.194:0/2323483957 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f53ed06830 0x55f53ed06c10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fad0c02f6e0 tx=0x7fad0c02fb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1be441945d8a50b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:51.562 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.559+0000 7fabf3fff640 1 -- 172.21.15.194:0/2323483957 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad0c026e40 con 0x55f53ed06830 2024-09-13T06:09:51.562 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.559+0000 7fabf3fff640 1 -- 172.21.15.194:0/2323483957 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad0c040b50 con 0x55f53ed06830 2024-09-13T06:09:51.562 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.559+0000 7fabf3fff640 1 -- 172.21.15.194:0/2323483957 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad0c02fc70 con 0x55f53ed06830 2024-09-13T06:09:51.562 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.559+0000 7fad1f250980 1 -- 172.21.15.194:0/2323483957 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f53ed06830 msgr2=0x55f53ed06c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:51.562 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.559+0000 7fad1f250980 1 --2- 172.21.15.194:0/2323483957 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f53ed06830 0x55f53ed06c10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fad0c02f6e0 tx=0x7fad0c02fb40 comp rx=0 tx=0).stop 2024-09-13T06:09:51.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.559+0000 7fad1f250980 1 -- 172.21.15.194:0/2323483957 shutdown_connections 2024-09-13T06:09:51.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.559+0000 7fad1f250980 1 --2- 172.21.15.194:0/2323483957 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f53ed06830 0x55f53ed06c10 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:51.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.559+0000 7fad1f250980 1 -- 172.21.15.194:0/2323483957 >> 172.21.15.194:0/2323483957 conn(0x55f53ed02b60 msgr2=0x55f53ed00c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:51.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.559+0000 7fad1f250980 1 -- 172.21.15.194:0/2323483957 shutdown_connections 2024-09-13T06:09:51.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.559+0000 7fad1f250980 1 -- 172.21.15.194:0/2323483957 wait complete. 2024-09-13T06:09:51.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.559+0000 7fad1f250980 1 Processor -- start 2024-09-13T06:09:51.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.559+0000 7fad1f250980 1 -- start start 2024-09-13T06:09:51.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.559+0000 7fad1f250980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f53ed06830 0x55f53ed0d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:51.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.559+0000 7fad1f250980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55f53ed07570 con 0x55f53ed06830 2024-09-13T06:09:51.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.559+0000 7fad1cd60640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f53ed06830 0x55f53ed0d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:51.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.559+0000 7fad1cd60640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f53ed06830 0x55f53ed0d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:54664/0 (socket says 172.21.15.194:54664) 2024-09-13T06:09:51.564 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.559+0000 7fad1cd60640 1 -- 172.21.15.194:0/1357890827 learned_addr learned my addr 172.21.15.194:0/1357890827 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:51.564 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.559+0000 7fad1cd60640 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f53ed0de20 con 0x55f53ed06830 2024-09-13T06:09:51.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.559+0000 7fad1cd60640 1 --2- 172.21.15.194:0/1357890827 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f53ed06830 0x55f53ed0d8e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fad0c01bfb0 tx=0x7fad0c033f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:51.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.563+0000 7fabf27fc640 1 -- 172.21.15.194:0/1357890827 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad0c06b020 con 0x55f53ed06830 2024-09-13T06:09:51.569 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.563+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f53ed0de20 con 0x55f53ed06830 2024-09-13T06:09:51.569 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.563+0000 7fabf27fc640 1 -- 172.21.15.194:0/1357890827 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad0c026e40 con 0x55f53ed06830 2024-09-13T06:09:51.569 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.563+0000 7fabf27fc640 1 -- 172.21.15.194:0/1357890827 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad0c025790 con 0x55f53ed06830 2024-09-13T06:09:51.569 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.563+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f53ed0de20 con 0x55f53ed06830 2024-09-13T06:09:51.569 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.563+0000 7fabf27fc640 1 -- 172.21.15.194:0/1357890827 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fad0c06e020 con 0x55f53ed06830 2024-09-13T06:09:51.569 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.563+0000 7fabf27fc640 1 --2- 172.21.15.194:0/1357890827 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fabe8034650 0x7fabe8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:51.569 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.563+0000 7fabf27fc640 1 -- 172.21.15.194:0/1357890827 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fad0c063070 con 0x55f53ed06830 2024-09-13T06:09:51.569 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.563+0000 7fad1c55f640 1 --2- 172.21.15.194:0/1357890827 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fabe8034650 0x7fabe8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:51.569 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.563+0000 7fad1f250980 20 rados->read ofs=0 len=0 2024-09-13T06:09:51.569 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.563+0000 7fad1f250980 1 --2- 172.21.15.194:0/1357890827 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55f53ed18930 0x55f53ed1adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:51.569 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.563+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed1b540 con 0x55f53ed18930 2024-09-13T06:09:51.569 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.563+0000 7fad1d561640 1 --2- 172.21.15.194:0/1357890827 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55f53ed18930 0x55f53ed1adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:51.570 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.563+0000 7fad1c55f640 1 --2- 172.21.15.194:0/1357890827 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fabe8034650 0x7fabe8036b10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fad100ae040 tx=0x7fad100b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:51.570 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.563+0000 7fad1d561640 1 --2- 172.21.15.194:0/1357890827 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55f53ed18930 0x55f53ed1adf0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:51.570 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.563+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fad140083f0 con 0x55f53ed18930 2024-09-13T06:09:51.570 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.563+0000 7fad1f250980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:51.570 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.563+0000 7fad1f250980 20 realm 2024-09-13T06:09:51.570 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.563+0000 7fad1f250980 20 rados->read ofs=0 len=0 2024-09-13T06:09:51.570 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.563+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed1b950 con 0x55f53ed18930 2024-09-13T06:09:51.570 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.563+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fad140083f0 con 0x55f53ed18930 2024-09-13T06:09:51.570 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.563+0000 7fad1f250980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:51.570 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.563+0000 7fad1f250980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:09:51.570 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.563+0000 7fad1f250980 20 rados->read ofs=0 len=0 2024-09-13T06:09:51.570 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.563+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed1c220 con 0x55f53ed18930 2024-09-13T06:09:51.570 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.563+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fad140083f0 con 0x55f53ed18930 2024-09-13T06:09:51.571 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.563+0000 7fad1f250980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:51.571 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.563+0000 7fad1f250980 20 rados->read ofs=0 len=0 2024-09-13T06:09:51.571 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.563+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed1c5c0 con 0x55f53ed18930 2024-09-13T06:09:51.571 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.563+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fad140083f0 con 0x55f53ed18930 2024-09-13T06:09:51.571 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.563+0000 7fad1f250980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:51.571 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.563+0000 7fad1f250980 20 rados->read ofs=0 len=0 2024-09-13T06:09:51.571 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.563+0000 7fad1f250980 1 --2- 172.21.15.194:0/1357890827 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55f53ed1d320 0x55f53ed1f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:51.571 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.563+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed1fcd0 con 0x55f53ed1d320 2024-09-13T06:09:51.571 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.563+0000 7fad1cd60640 1 --2- 172.21.15.194:0/1357890827 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55f53ed1d320 0x55f53ed1f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:51.571 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.567+0000 7fad1cd60640 1 --2- 172.21.15.194:0/1357890827 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55f53ed1d320 0x55f53ed1f710 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:51.571 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.567+0000 7fad1cd60640 1 -- 172.21.15.194:0/1357890827 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fad0c038070 con 0x55f53ed1d320 2024-09-13T06:09:51.571 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.567+0000 7fad1f250980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:09:51.572 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.567+0000 7fad1f250980 20 searching for the correct realm 2024-09-13T06:09:51.572 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.567+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed215a0 con 0x55f53ed1d320 2024-09-13T06:09:51.572 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.567+0000 7fad1cd60640 1 -- 172.21.15.194:0/1357890827 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad0c038070 con 0x55f53ed1d320 2024-09-13T06:09:51.572 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.567+0000 7fad1cd60640 1 --2- 172.21.15.194:0/1357890827 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fad0c070020 0x7fad0c048a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:51.572 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.567+0000 7fad1cd60640 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed215a0 con 0x7fad0c070020 2024-09-13T06:09:51.572 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.567+0000 7fad1c55f640 1 --2- 172.21.15.194:0/1357890827 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fad0c070020 0x7fad0c048a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:51.572 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.567+0000 7fad1c55f640 1 --2- 172.21.15.194:0/1357890827 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fad0c070020 0x7fad0c048a10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:51.572 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.567+0000 7fad1c55f640 1 -- 172.21.15.194:0/1357890827 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fad100c9030 con 0x7fad0c070020 2024-09-13T06:09:51.572 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.567+0000 7fad1c55f640 1 --2- 172.21.15.194:0/1357890827 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fad100dc040 0x7fad100dd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:51.572 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.567+0000 7fad1c55f640 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed215a0 con 0x7fad100dc040 2024-09-13T06:09:51.572 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.567+0000 7fad1d561640 1 --2- 172.21.15.194:0/1357890827 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fad100dc040 0x7fad100dd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:51.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.567+0000 7fad1d561640 1 --2- 172.21.15.194:0/1357890827 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fad100dc040 0x7fad100dd430 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:51.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.567+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad140083f0 con 0x7fad100dc040 2024-09-13T06:09:51.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.567+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed1c5c0 con 0x55f53ed18930 2024-09-13T06:09:51.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.567+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad140083f0 con 0x55f53ed18930 2024-09-13T06:09:51.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.567+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed1c5c0 con 0x55f53ed18930 2024-09-13T06:09:51.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.571+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad140083f0 con 0x55f53ed18930 2024-09-13T06:09:51.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.571+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed1c5c0 con 0x7fad100dc040 2024-09-13T06:09:51.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.571+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad140083f0 con 0x7fad100dc040 2024-09-13T06:09:51.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.571+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed1c5c0 con 0x7fad100dc040 2024-09-13T06:09:51.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.571+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad140083f0 con 0x7fad100dc040 2024-09-13T06:09:51.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.571+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed1c5c0 con 0x7fad0c070020 2024-09-13T06:09:51.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.571+0000 7fad1c55f640 1 -- 172.21.15.194:0/1357890827 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad100c9030 con 0x7fad0c070020 2024-09-13T06:09:51.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.571+0000 7fad1c55f640 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed1c5c0 con 0x55f53ed1d320 2024-09-13T06:09:51.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.571+0000 7fad1cd60640 1 -- 172.21.15.194:0/1357890827 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad0c038070 con 0x55f53ed1d320 2024-09-13T06:09:51.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.571+0000 7fad1cd60640 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed1c5c0 con 0x55f53ed18930 2024-09-13T06:09:51.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.571+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad140083f0 con 0x55f53ed18930 2024-09-13T06:09:51.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.571+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed1c5c0 con 0x7fad100dc040 2024-09-13T06:09:51.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.571+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad140083f0 con 0x7fad100dc040 2024-09-13T06:09:51.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.571+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed1c5c0 con 0x55f53ed18930 2024-09-13T06:09:51.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.571+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad140083f0 con 0x55f53ed18930 2024-09-13T06:09:51.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.571+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed1c5c0 con 0x7fad0c070020 2024-09-13T06:09:51.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.571+0000 7fad1c55f640 1 -- 172.21.15.194:0/1357890827 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fad100c9030 con 0x7fad0c070020 2024-09-13T06:09:51.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.571+0000 7fad1c55f640 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed1c5c0 con 0x55f53ed1d320 2024-09-13T06:09:51.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.571+0000 7fad1cd60640 1 -- 172.21.15.194:0/1357890827 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad0c038070 con 0x55f53ed1d320 2024-09-13T06:09:51.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.571+0000 7fad1cd60640 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed1c5c0 con 0x55f53ed1d320 2024-09-13T06:09:51.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.575+0000 7fad1cd60640 1 -- 172.21.15.194:0/1357890827 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad0c038070 con 0x55f53ed1d320 2024-09-13T06:09:51.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.575+0000 7fad1cd60640 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed1c5c0 con 0x7fad100dc040 2024-09-13T06:09:51.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.575+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad140083f0 con 0x7fad100dc040 2024-09-13T06:09:51.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.575+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed1c5c0 con 0x55f53ed1d320 2024-09-13T06:09:51.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.575+0000 7fad1cd60640 1 -- 172.21.15.194:0/1357890827 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad0c038070 con 0x55f53ed1d320 2024-09-13T06:09:51.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.575+0000 7fad1cd60640 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed1c5c0 con 0x55f53ed1d320 2024-09-13T06:09:51.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.575+0000 7fad1cd60640 1 -- 172.21.15.194:0/1357890827 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad0c038070 con 0x55f53ed1d320 2024-09-13T06:09:51.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.575+0000 7fad1cd60640 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed1c5c0 con 0x55f53ed18930 2024-09-13T06:09:51.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.575+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad140083f0 con 0x55f53ed18930 2024-09-13T06:09:51.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.575+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed1c5c0 con 0x55f53ed18930 2024-09-13T06:09:51.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.575+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fad140083f0 con 0x55f53ed18930 2024-09-13T06:09:51.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.575+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed1c5c0 con 0x7fad100dc040 2024-09-13T06:09:51.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.575+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad140083f0 con 0x7fad100dc040 2024-09-13T06:09:51.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.575+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed1c5c0 con 0x55f53ed1d320 2024-09-13T06:09:51.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.575+0000 7fad1cd60640 1 -- 172.21.15.194:0/1357890827 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad0c038070 con 0x55f53ed1d320 2024-09-13T06:09:51.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.575+0000 7fad1cd60640 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed1c5c0 con 0x7fad0c070020 2024-09-13T06:09:51.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.575+0000 7fad1c55f640 1 -- 172.21.15.194:0/1357890827 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad100c9030 con 0x7fad0c070020 2024-09-13T06:09:51.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.575+0000 7fad1c55f640 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed1c5c0 con 0x55f53ed18930 2024-09-13T06:09:51.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.575+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad140083f0 con 0x55f53ed18930 2024-09-13T06:09:51.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.575+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed1c5c0 con 0x7fad100dc040 2024-09-13T06:09:51.586 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.575+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad140083f0 con 0x7fad100dc040 2024-09-13T06:09:51.586 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.575+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed1c5c0 con 0x55f53ed1d320 2024-09-13T06:09:51.586 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.579+0000 7fad1cd60640 1 -- 172.21.15.194:0/1357890827 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=107b] v26'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fad0c038070 con 0x55f53ed1d320 2024-09-13T06:09:51.586 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.579+0000 7fad1cd60640 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed1c5c0 con 0x7fad100dc040 2024-09-13T06:09:51.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.579+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad140083f0 con 0x7fad100dc040 2024-09-13T06:09:51.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.579+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed1c5c0 con 0x7fad0c070020 2024-09-13T06:09:51.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.579+0000 7fad1c55f640 1 -- 172.21.15.194:0/1357890827 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad100c9030 con 0x7fad0c070020 2024-09-13T06:09:51.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.579+0000 7fad1c55f640 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed1c5c0 con 0x55f53ed1d320 2024-09-13T06:09:51.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.579+0000 7fad1cd60640 1 -- 172.21.15.194:0/1357890827 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad0c038070 con 0x55f53ed1d320 2024-09-13T06:09:51.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.579+0000 7fad1cd60640 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed1c5c0 con 0x7fad100dc040 2024-09-13T06:09:51.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.579+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad140083f0 con 0x7fad100dc040 2024-09-13T06:09:51.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.579+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed1c5c0 con 0x55f53ed18930 2024-09-13T06:09:51.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.579+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fad140083f0 con 0x55f53ed18930 2024-09-13T06:09:51.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.579+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed1c5c0 con 0x7fad0c070020 2024-09-13T06:09:51.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.579+0000 7fad1c55f640 1 -- 172.21.15.194:0/1357890827 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad100c9030 con 0x7fad0c070020 2024-09-13T06:09:51.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.579+0000 7fad1f250980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:09:51.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.579+0000 7fad1f250980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:09:51.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.579+0000 7fad1f250980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:09:51.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.579+0000 7fad1f250980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:09:51.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.579+0000 7fad1f250980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:09:51.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.579+0000 7fad1f250980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:09:51.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.579+0000 7fad1f250980 20 rados->read ofs=0 len=0 2024-09-13T06:09:51.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.579+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed206c0 con 0x55f53ed18930 2024-09-13T06:09:51.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.579+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fad140083f0 con 0x55f53ed18930 2024-09-13T06:09:51.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.579+0000 7fad1f250980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:51.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.579+0000 7fad1f250980 20 rados->read ofs=0 len=0 2024-09-13T06:09:51.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.579+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed20300 con 0x55f53ed18930 2024-09-13T06:09:51.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.579+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fad140083f0 con 0x55f53ed18930 2024-09-13T06:09:51.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.579+0000 7fad1f250980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:51.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.579+0000 7fad1f250980 20 rados->read ofs=0 len=0 2024-09-13T06:09:51.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.579+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed20fe0 con 0x7fad0c070020 2024-09-13T06:09:51.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.579+0000 7fad1c55f640 1 -- 172.21.15.194:0/1357890827 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fad100c9030 con 0x7fad0c070020 2024-09-13T06:09:51.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.579+0000 7fad1f250980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:09:51.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.579+0000 7fad1f250980 20 zone default found 2024-09-13T06:09:51.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.579+0000 7fad1f250980 4 Realm: () 2024-09-13T06:09:51.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.579+0000 7fad1f250980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:09:51.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.579+0000 7fad1f250980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:09:51.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.579+0000 7fad1f250980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:09:51.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.579+0000 7fad1f250980 20 zonegroup default 2024-09-13T06:09:51.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.579+0000 7fad1f250980 20 rados->read ofs=0 len=0 2024-09-13T06:09:51.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.579+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed219d0 con 0x7fad100dc040 2024-09-13T06:09:51.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.583+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fad140083f0 con 0x7fad100dc040 2024-09-13T06:09:51.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.583+0000 7fad1f250980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:51.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.583+0000 7fad1f250980 20 rados->read ofs=0 len=0 2024-09-13T06:09:51.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.583+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed233b0 con 0x55f53ed1d320 2024-09-13T06:09:51.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.583+0000 7fad1cd60640 1 -- 172.21.15.194:0/1357890827 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fad0c038070 con 0x55f53ed1d320 2024-09-13T06:09:51.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.583+0000 7fad1f250980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:51.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.583+0000 7fad1f250980 20 rados->read ofs=0 len=0 2024-09-13T06:09:51.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.583+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed238b0 con 0x55f53ed1d320 2024-09-13T06:09:51.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.583+0000 7fad1cd60640 1 -- 172.21.15.194:0/1357890827 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fad0c038070 con 0x55f53ed1d320 2024-09-13T06:09:51.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.583+0000 7fad1f250980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:51.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.583+0000 7fad1f250980 20 started sync module instance, tier type = 2024-09-13T06:09:51.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.583+0000 7fad1f250980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:09:51.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.583+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed22850 con 0x7fad0c070020 2024-09-13T06:09:51.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.583+0000 7fad1c55f640 1 -- 172.21.15.194:0/1357890827 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(44 notify.0 [create] v33'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad100c9030 con 0x7fad0c070020 2024-09-13T06:09:51.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.583+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94511809309760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed224b0 con 0x7fad0c070020 2024-09-13T06:09:51.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.583+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed247e0 con 0x55f53ed18930 2024-09-13T06:09:51.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.583+0000 7fad1c55f640 1 -- 172.21.15.194:0/1357890827 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94511809309760] v33'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad100c9030 con 0x7fad0c070020 2024-09-13T06:09:51.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.587+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v33'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad140083f0 con 0x55f53ed18930 2024-09-13T06:09:51.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.587+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94511809315632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed24c00 con 0x55f53ed18930 2024-09-13T06:09:51.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.587+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed25450 con 0x55f53ed1d320 2024-09-13T06:09:51.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.587+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94511809315632] v33'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad140083f0 con 0x55f53ed18930 2024-09-13T06:09:51.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.587+0000 7fad1cd60640 1 -- 172.21.15.194:0/1357890827 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v33'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad0c038070 con 0x55f53ed1d320 2024-09-13T06:09:51.594 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.587+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94511809316960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed25840 con 0x55f53ed1d320 2024-09-13T06:09:51.594 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.587+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed26200 con 0x7fad0c070020 2024-09-13T06:09:51.594 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.591+0000 7fad1c55f640 1 -- 172.21.15.194:0/1357890827 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(50 notify.3 [create] v33'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad100c9030 con 0x7fad0c070020 2024-09-13T06:09:51.594 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.591+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94511809324448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed26e70 con 0x7fad0c070020 2024-09-13T06:09:51.594 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.591+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed27830 con 0x55f53ed18930 2024-09-13T06:09:51.594 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.591+0000 7fad1cd60640 1 -- 172.21.15.194:0/1357890827 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94511809316960] v33'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad0c038070 con 0x55f53ed1d320 2024-09-13T06:09:51.594 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.591+0000 7fad1c55f640 1 -- 172.21.15.194:0/1357890827 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94511809324448] v33'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad100c9030 con 0x7fad0c070020 2024-09-13T06:09:51.594 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.591+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v33'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad140083f0 con 0x55f53ed18930 2024-09-13T06:09:51.594 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.591+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94511809328000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed26e70 con 0x55f53ed18930 2024-09-13T06:09:51.594 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.591+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed277a0 con 0x7fad100dc040 2024-09-13T06:09:51.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.595+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94511809328000] v33'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad140083f0 con 0x55f53ed18930 2024-09-13T06:09:51.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.595+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(54 notify.5 [create] v33'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad140083f0 con 0x7fad100dc040 2024-09-13T06:09:51.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.595+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94511809325504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed26de0 con 0x7fad100dc040 2024-09-13T06:09:51.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.595+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed28660 con 0x7fad100dc040 2024-09-13T06:09:51.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.595+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(56 notify.6 [create] v33'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad140083f0 con 0x7fad100dc040 2024-09-13T06:09:51.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.595+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94511809331632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed28a80 con 0x7fad100dc040 2024-09-13T06:09:51.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.595+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed29550 con 0x7fad100dc040 2024-09-13T06:09:51.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.595+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94511809325504] v33'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad140083f0 con 0x7fad100dc040 2024-09-13T06:09:51.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.599+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(58 notify.7 [create] v33'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad140083f0 con 0x7fad100dc040 2024-09-13T06:09:51.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.599+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94511809335360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed29510 con 0x7fad100dc040 2024-09-13T06:09:51.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.599+0000 7fad1f250980 20 add_watcher() i=0 2024-09-13T06:09:51.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.599+0000 7fad1f250980 20 add_watcher() i=1 2024-09-13T06:09:51.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.599+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94511809331632] v33'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad140083f0 con 0x7fad100dc040 2024-09-13T06:09:51.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.599+0000 7fad1f250980 20 add_watcher() i=2 2024-09-13T06:09:51.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.599+0000 7fad1f250980 20 add_watcher() i=3 2024-09-13T06:09:51.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.599+0000 7fad1f250980 20 add_watcher() i=4 2024-09-13T06:09:51.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.599+0000 7fad1f250980 20 add_watcher() i=5 2024-09-13T06:09:51.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.599+0000 7fad1f250980 20 add_watcher() i=6 2024-09-13T06:09:51.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.599+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94511809335360] v33'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad140083f0 con 0x7fad100dc040 2024-09-13T06:09:51.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.599+0000 7fad1f250980 20 add_watcher() i=7 2024-09-13T06:09:51.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.599+0000 7fad1f250980 2 all 8 watchers are set, enabling cache 2024-09-13T06:09:51.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.599+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed28630 con 0x55f53ed18930 2024-09-13T06:09:51.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.599+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fad140083f0 con 0x55f53ed18930 2024-09-13T06:09:51.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.599+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94511809332784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed29940 con 0x55f53ed18930 2024-09-13T06:09:51.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.603+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94511809332784] v33'26 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fad140083f0 con 0x55f53ed18930 2024-09-13T06:09:51.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.603+0000 7fabd2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:51.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.603+0000 7fad1f250980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:09:51.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.603+0000 7fad1f250980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:09:51.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.603+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed34d70 con 0x55f53ed18930 2024-09-13T06:09:51.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.603+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fad140083f0 con 0x55f53ed18930 2024-09-13T06:09:51.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.603+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed353c0 con 0x7fad100dc040 2024-09-13T06:09:51.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.607+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'10 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fad140083f0 con 0x7fad100dc040 2024-09-13T06:09:51.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.607+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed35820 con 0x55f53ed1d320 2024-09-13T06:09:51.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.607+0000 7fad1cd60640 1 -- 172.21.15.194:0/1357890827 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'10 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fad0c038070 con 0x55f53ed1d320 2024-09-13T06:09:51.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.607+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed35bc0 con 0x55f53ed18930 2024-09-13T06:09:51.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.611+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'27 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fad140083f0 con 0x55f53ed18930 2024-09-13T06:09:51.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.611+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed36070 con 0x7fad0c070020 2024-09-13T06:09:51.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.611+0000 7fad1c55f640 1 -- 172.21.15.194:0/1357890827 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'20 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fad100c9030 con 0x7fad0c070020 2024-09-13T06:09:51.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.611+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed365e0 con 0x55f53ed1d320 2024-09-13T06:09:51.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.611+0000 7fad1cd60640 1 -- 172.21.15.194:0/1357890827 <== osd.3 v2:172.21.15.194:6816/96632515 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'13 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fad0c038070 con 0x55f53ed1d320 2024-09-13T06:09:51.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.611+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed365e0 con 0x55f53ed18930 2024-09-13T06:09:51.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.615+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'12 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fad140083f0 con 0x55f53ed18930 2024-09-13T06:09:51.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.615+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed365e0 con 0x7fad100dc040 2024-09-13T06:09:51.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.615+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'13 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fad140083f0 con 0x7fad100dc040 2024-09-13T06:09:51.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.615+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed36670 con 0x7fad0c070020 2024-09-13T06:09:51.620 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.619+0000 7fad1c55f640 1 -- 172.21.15.194:0/1357890827 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fad100c9030 con 0x7fad0c070020 2024-09-13T06:09:51.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.619+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed36be0 con 0x55f53ed1d320 2024-09-13T06:09:51.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.619+0000 7fad1cd60640 1 -- 172.21.15.194:0/1357890827 <== osd.3 v2:172.21.15.194:6816/96632515 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fad0c038070 con 0x55f53ed1d320 2024-09-13T06:09:51.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.619+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed36be0 con 0x7fad0c070020 2024-09-13T06:09:51.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.623+0000 7fad1c55f640 1 -- 172.21.15.194:0/1357890827 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fad100c9030 con 0x7fad0c070020 2024-09-13T06:09:51.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.623+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed37150 con 0x7fad100dc040 2024-09-13T06:09:51.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.623+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fad140083f0 con 0x7fad100dc040 2024-09-13T06:09:51.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.623+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed37150 con 0x7fad0c070020 2024-09-13T06:09:51.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.627+0000 7fad1c55f640 1 -- 172.21.15.194:0/1357890827 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fad100c9030 con 0x7fad0c070020 2024-09-13T06:09:51.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.627+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed37310 con 0x7fad100dc040 2024-09-13T06:09:51.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.627+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 <== osd.0 v2:172.21.15.120:6800/1923744619 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'19 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fad140083f0 con 0x7fad100dc040 2024-09-13T06:09:51.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.627+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed37310 con 0x55f53ed18930 2024-09-13T06:09:51.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.627+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'28 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fad140083f0 con 0x55f53ed18930 2024-09-13T06:09:51.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.627+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed37310 con 0x55f53ed1d320 2024-09-13T06:09:51.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.631+0000 7fad1cd60640 1 -- 172.21.15.194:0/1357890827 <== osd.3 v2:172.21.15.194:6816/96632515 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fad0c038070 con 0x55f53ed1d320 2024-09-13T06:09:51.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.631+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed37310 con 0x7fad0c070020 2024-09-13T06:09:51.634 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.635+0000 7fad1c55f640 1 -- 172.21.15.194:0/1357890827 <== osd.2 v2:172.21.15.194:6800/815615585 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'22 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fad100c9030 con 0x7fad0c070020 2024-09-13T06:09:51.634 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.635+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed37310 con 0x55f53ed1d320 2024-09-13T06:09:51.637 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.635+0000 7fad1cd60640 1 -- 172.21.15.194:0/1357890827 <== osd.3 v2:172.21.15.194:6816/96632515 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'10 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fad0c038070 con 0x55f53ed1d320 2024-09-13T06:09:51.637 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.635+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed37310 con 0x55f53ed18930 2024-09-13T06:09:51.639 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.639+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 <== osd.1 v2:172.21.15.194:6808/3135444559 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fad140083f0 con 0x55f53ed18930 2024-09-13T06:09:51.639 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.639+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed37310 con 0x55f53ed18930 2024-09-13T06:09:51.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.639+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 <== osd.1 v2:172.21.15.194:6808/3135444559 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'29 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fad140083f0 con 0x55f53ed18930 2024-09-13T06:09:51.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.639+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed37310 con 0x55f53ed1d320 2024-09-13T06:09:51.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.643+0000 7fad1cd60640 1 -- 172.21.15.194:0/1357890827 <== osd.3 v2:172.21.15.194:6816/96632515 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'15 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fad0c038070 con 0x55f53ed1d320 2024-09-13T06:09:51.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.643+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed37310 con 0x7fad0c070020 2024-09-13T06:09:51.646 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.643+0000 7fad1c55f640 1 -- 172.21.15.194:0/1357890827 <== osd.2 v2:172.21.15.194:6800/815615585 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fad100c9030 con 0x7fad0c070020 2024-09-13T06:09:51.646 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.643+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed37310 con 0x55f53ed1d320 2024-09-13T06:09:51.647 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.647+0000 7fad1cd60640 1 -- 172.21.15.194:0/1357890827 <== osd.3 v2:172.21.15.194:6816/96632515 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fad0c038070 con 0x55f53ed1d320 2024-09-13T06:09:51.647 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.647+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed37310 con 0x55f53ed1d320 2024-09-13T06:09:51.649 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.647+0000 7fad1cd60640 1 -- 172.21.15.194:0/1357890827 <== osd.3 v2:172.21.15.194:6816/96632515 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fad0c038070 con 0x55f53ed1d320 2024-09-13T06:09:51.649 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.647+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed37310 con 0x55f53ed1d320 2024-09-13T06:09:51.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.651+0000 7fad1cd60640 1 -- 172.21.15.194:0/1357890827 <== osd.3 v2:172.21.15.194:6816/96632515 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'6 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fad0c038070 con 0x55f53ed1d320 2024-09-13T06:09:51.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.651+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed37310 con 0x55f53ed1d320 2024-09-13T06:09:51.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.651+0000 7fad1cd60640 1 -- 172.21.15.194:0/1357890827 <== osd.3 v2:172.21.15.194:6816/96632515 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'14 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fad0c038070 con 0x55f53ed1d320 2024-09-13T06:09:51.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.651+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed37310 con 0x7fad100dc040 2024-09-13T06:09:51.655 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.655+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 <== osd.0 v2:172.21.15.120:6800/1923744619 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fad140083f0 con 0x7fad100dc040 2024-09-13T06:09:51.655 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.655+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed37310 con 0x55f53ed1d320 2024-09-13T06:09:51.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.655+0000 7fad1cd60640 1 -- 172.21.15.194:0/1357890827 <== osd.3 v2:172.21.15.194:6816/96632515 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'10 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fad0c038070 con 0x55f53ed1d320 2024-09-13T06:09:51.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.655+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed37310 con 0x7fad100dc040 2024-09-13T06:09:51.660 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.659+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 <== osd.0 v2:172.21.15.120:6800/1923744619 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'14 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fad140083f0 con 0x7fad100dc040 2024-09-13T06:09:51.660 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.659+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed37310 con 0x55f53ed1d320 2024-09-13T06:09:51.663 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.663+0000 7fad1cd60640 1 -- 172.21.15.194:0/1357890827 <== osd.3 v2:172.21.15.194:6816/96632515 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'16 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fad0c038070 con 0x55f53ed1d320 2024-09-13T06:09:51.663 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.663+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed37310 con 0x7fad100dc040 2024-09-13T06:09:51.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.663+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 <== osd.0 v2:172.21.15.120:6800/1923744619 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'20 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fad140083f0 con 0x7fad100dc040 2024-09-13T06:09:51.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.663+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed37310 con 0x7fad0c070020 2024-09-13T06:09:51.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.667+0000 7fad1c55f640 1 -- 172.21.15.194:0/1357890827 <== osd.2 v2:172.21.15.194:6800/815615585 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fad100c9030 con 0x7fad0c070020 2024-09-13T06:09:51.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.667+0000 7fabd1fe3640 20 reqs_thread_entry: start 2024-09-13T06:09:51.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.667+0000 7fad1f250980 20 init_complete bucket index max shards: 11 2024-09-13T06:09:51.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.667+0000 7fad1f250980 20 Filter name: none 2024-09-13T06:09:51.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.667+0000 7fab437fe640 20 reqs_thread_entry: start 2024-09-13T06:09:51.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.667+0000 7fad1f250980 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-13T06:09:51.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.667+0000 7fad1f250980 20 rados->read ofs=0 len=0 2024-09-13T06:09:51.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.667+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed330f0 con 0x7fad0c070020 2024-09-13T06:09:51.670 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.667+0000 7fad1c55f640 1 -- 172.21.15.194:0/1357890827 <== osd.2 v2:172.21.15.194:6800/815615585 19 ==== osd_op_reply(94 bud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fad100c9030 con 0x7fad0c070020 2024-09-13T06:09:51.670 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.667+0000 7fad1f250980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:51.670 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.667+0000 7fad1f250980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x0 2024-09-13T06:09:51.670 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.667+0000 7fad1f250980 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-13T06:09:51.670 INFO:teuthology.orchestra.run.smithi194.stderr:could not remove user: unable to remove user, user does not exist 2024-09-13T06:09:51.671 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.671+0000 7fabd2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:51.671 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.671+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94511809332784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed32ad0 con 0x55f53ed18930 2024-09-13T06:09:51.672 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.671+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 <== osd.1 v2:172.21.15.194:6808/3135444559 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94511809332784] v33'30 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fad140083f0 con 0x55f53ed18930 2024-09-13T06:09:51.672 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.671+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94511809309760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed28630 con 0x7fad0c070020 2024-09-13T06:09:51.674 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.671+0000 7fad1c55f640 1 -- 172.21.15.194:0/1357890827 <== osd.2 v2:172.21.15.194:6800/815615585 20 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94511809309760] v33'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad100c9030 con 0x7fad0c070020 2024-09-13T06:09:51.674 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.671+0000 7fad1f250980 20 remove_watcher() i=0 2024-09-13T06:09:51.674 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.671+0000 7fad1f250980 2 removed watcher, disabling cache 2024-09-13T06:09:51.674 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.671+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94511809315632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed28630 con 0x55f53ed18930 2024-09-13T06:09:51.676 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.675+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 <== osd.1 v2:172.21.15.194:6808/3135444559 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94511809315632] v33'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad140083f0 con 0x55f53ed18930 2024-09-13T06:09:51.676 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.675+0000 7fad1f250980 20 remove_watcher() i=1 2024-09-13T06:09:51.676 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.675+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94511809316960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed24330 con 0x55f53ed1d320 2024-09-13T06:09:51.678 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.675+0000 7fad1cd60640 1 -- 172.21.15.194:0/1357890827 <== osd.3 v2:172.21.15.194:6816/96632515 27 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94511809316960] v33'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad0c038070 con 0x55f53ed1d320 2024-09-13T06:09:51.678 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.675+0000 7fad1f250980 20 remove_watcher() i=2 2024-09-13T06:09:51.678 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.675+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94511809324448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed24860 con 0x7fad0c070020 2024-09-13T06:09:51.679 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.679+0000 7fad1c55f640 1 -- 172.21.15.194:0/1357890827 <== osd.2 v2:172.21.15.194:6800/815615585 21 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94511809324448] v33'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad100c9030 con 0x7fad0c070020 2024-09-13T06:09:51.679 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.679+0000 7fad1f250980 20 remove_watcher() i=3 2024-09-13T06:09:51.679 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.679+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94511809328000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed24330 con 0x55f53ed18930 2024-09-13T06:09:51.681 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.679+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 <== osd.1 v2:172.21.15.194:6808/3135444559 29 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94511809328000] v33'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad140083f0 con 0x55f53ed18930 2024-09-13T06:09:51.682 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.679+0000 7fad1f250980 20 remove_watcher() i=4 2024-09-13T06:09:51.682 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.679+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94511809325504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed265a0 con 0x7fad100dc040 2024-09-13T06:09:51.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.683+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 <== osd.0 v2:172.21.15.120:6800/1923744619 24 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94511809325504] v33'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad140083f0 con 0x7fad100dc040 2024-09-13T06:09:51.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.683+0000 7fad1f250980 20 remove_watcher() i=5 2024-09-13T06:09:51.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.683+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94511809331632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed24860 con 0x7fad100dc040 2024-09-13T06:09:51.686 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.683+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 <== osd.0 v2:172.21.15.120:6800/1923744619 25 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94511809331632] v33'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad140083f0 con 0x7fad100dc040 2024-09-13T06:09:51.686 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.683+0000 7fad1f250980 20 remove_watcher() i=6 2024-09-13T06:09:51.686 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.683+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94511809335360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f53ed27380 con 0x7fad100dc040 2024-09-13T06:09:51.688 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.687+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 <== osd.0 v2:172.21.15.120:6800/1923744619 26 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94511809335360] v33'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad140083f0 con 0x7fad100dc040 2024-09-13T06:09:51.688 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.687+0000 7fad1f250980 20 remove_watcher() i=7 2024-09-13T06:09:51.691 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.687+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fad100dc040 msgr2=0x7fad100dd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:51.691 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.687+0000 7fad1f250980 1 --2- 172.21.15.194:0/1357890827 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fad100dc040 0x7fad100dd430 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:51.691 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.687+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55f53ed18930 msgr2=0x55f53ed1adf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:51.691 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.687+0000 7fad1f250980 1 --2- 172.21.15.194:0/1357890827 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55f53ed18930 0x55f53ed1adf0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:51.692 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.687+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fad0c070020 msgr2=0x7fad0c048a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:51.692 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.687+0000 7fad1f250980 1 --2- 172.21.15.194:0/1357890827 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fad0c070020 0x7fad0c048a10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:51.692 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.687+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55f53ed1d320 msgr2=0x55f53ed1f710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:51.692 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.687+0000 7fad1f250980 1 --2- 172.21.15.194:0/1357890827 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55f53ed1d320 0x55f53ed1f710 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:51.692 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.687+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fabe8034650 msgr2=0x7fabe8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:51.692 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.687+0000 7fad1f250980 1 --2- 172.21.15.194:0/1357890827 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fabe8034650 0x7fabe8036b10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fad100ae040 tx=0x7fad100b9040 comp rx=0 tx=0).stop 2024-09-13T06:09:51.692 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.687+0000 7fad1d561640 1 -- 172.21.15.194:0/1357890827 reap_dead start 2024-09-13T06:09:51.692 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.687+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f53ed06830 msgr2=0x55f53ed0d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:51.692 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.687+0000 7fad1f250980 1 --2- 172.21.15.194:0/1357890827 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f53ed06830 0x55f53ed0d8e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fad0c01bfb0 tx=0x7fad0c033f70 comp rx=0 tx=0).stop 2024-09-13T06:09:51.692 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.687+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 shutdown_connections 2024-09-13T06:09:51.692 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.687+0000 7fad1f250980 1 --2- 172.21.15.194:0/1357890827 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f53ed06830 0x55f53ed0d8e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:51.692 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.687+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 >> 172.21.15.194:0/1357890827 conn(0x55f53ed02b60 msgr2=0x55f53ed00c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:51.692 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.687+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 shutdown_connections 2024-09-13T06:09:51.693 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.687+0000 7fad1f250980 1 -- 172.21.15.194:0/1357890827 wait complete. 2024-09-13T06:09:51.693 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.687+0000 7fad1f250980 1 -- 172.21.15.194:0/3650788649 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fabf4034650 msgr2=0x7fabf4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:51.693 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.687+0000 7fad1f250980 1 --2- 172.21.15.194:0/3650788649 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fabf4034650 0x7fabf4036b10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fad1000a480 tx=0x7fad10005a10 comp rx=0 tx=0).stop 2024-09-13T06:09:51.693 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.687+0000 7fad1f250980 1 -- 172.21.15.194:0/3650788649 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f53ecf9e30 msgr2=0x55f53ecfa250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:51.693 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.687+0000 7fad1f250980 1 --2- 172.21.15.194:0/3650788649 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f53ecf9e30 0x55f53ecfa250 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fad0c047520 tx=0x7fad0c024fa0 comp rx=0 tx=0).stop 2024-09-13T06:09:51.693 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.687+0000 7fad1f250980 1 -- 172.21.15.194:0/3650788649 shutdown_connections 2024-09-13T06:09:51.693 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.687+0000 7fad1f250980 1 --2- 172.21.15.194:0/3650788649 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fabf4034650 0x7fabf4036b10 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:51.693 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.687+0000 7fad1f250980 1 --2- 172.21.15.194:0/3650788649 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f53ecf9e30 0x55f53ecfa250 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:51.693 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.687+0000 7fad1f250980 1 -- 172.21.15.194:0/3650788649 >> 172.21.15.194:0/3650788649 conn(0x55f53eceef80 msgr2=0x55f53ecf1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:51.693 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.687+0000 7fad1f250980 1 -- 172.21.15.194:0/3650788649 shutdown_connections 2024-09-13T06:09:51.693 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.687+0000 7fad1f250980 1 -- 172.21.15.194:0/3650788649 wait complete. 2024-09-13T06:09:51.693 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.691+0000 7fad1f250980 1 -- 172.21.15.194:0/2223822392 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55f53ebedc60 msgr2=0x55f53ece3160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:51.694 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.691+0000 7fad1f250980 1 --2- 172.21.15.194:0/2223822392 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55f53ebedc60 0x55f53ece3160 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:51.694 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.691+0000 7fad1f250980 1 -- 172.21.15.194:0/2223822392 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55f53ece98c0 msgr2=0x55f53ecebcb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:51.694 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.691+0000 7fad1f250980 1 --2- 172.21.15.194:0/2223822392 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55f53ece98c0 0x55f53ecebcb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:51.694 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.691+0000 7fad1f250980 1 -- 172.21.15.194:0/2223822392 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55f53ece59c0 msgr2=0x55f53ece7db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:51.694 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.691+0000 7fad1f250980 1 --2- 172.21.15.194:0/2223822392 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55f53ece59c0 0x55f53ece7db0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:51.694 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.691+0000 7fad1f250980 1 -- 172.21.15.194:0/2223822392 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fac04034650 msgr2=0x7fac04036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:51.694 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.691+0000 7fad1f250980 1 --2- 172.21.15.194:0/2223822392 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fac04034650 0x7fac04036b10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fad100ad000 tx=0x7fad100a5040 comp rx=0 tx=0).stop 2024-09-13T06:09:51.694 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.691+0000 7fad1f250980 1 -- 172.21.15.194:0/2223822392 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f53ebe98e0 msgr2=0x55f53ecdc060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:51.694 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.691+0000 7fad1f250980 1 --2- 172.21.15.194:0/2223822392 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f53ebe98e0 0x55f53ecdc060 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fad0c014040 tx=0x7fad0c001260 comp rx=0 tx=0).stop 2024-09-13T06:09:51.694 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.691+0000 7fad1d561640 1 -- 172.21.15.194:0/2223822392 reap_dead start 2024-09-13T06:09:51.694 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.691+0000 7fad1f250980 1 -- 172.21.15.194:0/2223822392 shutdown_connections 2024-09-13T06:09:51.694 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.691+0000 7fad1f250980 1 -- 172.21.15.194:0/2223822392 >> 172.21.15.194:0/2223822392 conn(0x55f53eb5d230 msgr2=0x55f53eccf3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:51.694 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.691+0000 7fad1f250980 1 -- 172.21.15.194:0/2223822392 shutdown_connections 2024-09-13T06:09:51.695 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.691+0000 7fad1f250980 1 -- 172.21.15.194:0/2223822392 wait complete. 2024-09-13T06:09:51.703 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-13T06:09:51.703 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bar'] 2024-09-13T06:09:51.703 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bar'] 2024-09-13T06:09:51.704 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bar 2024-09-13T06:09:51.784 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:09:51.785 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:09:51.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.783+0000 7f6c9b8d8980 1 Processor -- start 2024-09-13T06:09:51.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.783+0000 7f6c9b8d8980 1 -- start start 2024-09-13T06:09:51.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.783+0000 7f6c9b8d8980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55d07a4f5c60 0x55d07a4f8050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:51.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.783+0000 7f6c9b8d8980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d07a377ae0 con 0x55d07a4f18e0 2024-09-13T06:09:51.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.783+0000 7f6c9b8d8980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x55d07a39be30 con 0x55d07a4f5c60 2024-09-13T06:09:51.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.787+0000 7f6c98be7640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55d07a4f5c60 0x55d07a4f8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:51.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.787+0000 7f6c98be7640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55d07a4f5c60 0x55d07a4f8050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:54678/0 (socket says 172.21.15.194:54678) 2024-09-13T06:09:51.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.787+0000 7f6c993e8640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x55d07a4f18e0 0x55d07a4f1cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:51680/0 (socket says 172.21.15.194:51680) 2024-09-13T06:09:51.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.787+0000 7f6c98be7640 1 -- 172.21.15.194:0/1008491268 learned_addr learned my addr 172.21.15.194:0/1008491268 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:51.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.787+0000 7f6c98be7640 1 -- 172.21.15.194:0/1008491268 >> v1:172.21.15.120:6789/0 conn(0x55d07a4f18e0 legacy=0x55d07a4f1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:51.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.787+0000 7f6c98be7640 1 -- 172.21.15.194:0/1008491268 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d07a4f95a0 con 0x55d07a4f5c60 2024-09-13T06:09:51.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.787+0000 7f6c98be7640 1 --2- 172.21.15.194:0/1008491268 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d07a4f5c60 0x55d07a4f8050 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6c8400a5c0 tx=0x7f6c8401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b14a2bf033ef466b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:51.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.787+0000 7f6c93fff640 1 -- 172.21.15.194:0/1008491268 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c840a6070 con 0x55d07a4f5c60 2024-09-13T06:09:51.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.787+0000 7f6c93fff640 1 -- 172.21.15.194:0/1008491268 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c840af070 con 0x55d07a4f5c60 2024-09-13T06:09:51.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.787+0000 7f6c93fff640 1 -- 172.21.15.194:0/1008491268 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c840aa5c0 con 0x55d07a4f5c60 2024-09-13T06:09:51.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.791+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/1008491268 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d07a4f5c60 msgr2=0x55d07a4f8050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:51.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.791+0000 7f6c9b8d8980 1 --2- 172.21.15.194:0/1008491268 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d07a4f5c60 0x55d07a4f8050 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6c8400a5c0 tx=0x7f6c8401b340 comp rx=0 tx=0).stop 2024-09-13T06:09:51.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.791+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/1008491268 shutdown_connections 2024-09-13T06:09:51.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.791+0000 7f6c9b8d8980 1 --2- 172.21.15.194:0/1008491268 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d07a4f5c60 0x55d07a4f8050 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:51.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.791+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/1008491268 >> 172.21.15.194:0/1008491268 conn(0x55d07a465230 msgr2=0x55d07a465640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:51.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.791+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/1008491268 shutdown_connections 2024-09-13T06:09:51.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.791+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/1008491268 wait complete. 2024-09-13T06:09:51.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.807+0000 7f6c9b8d8980 1 Processor -- start 2024-09-13T06:09:51.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.807+0000 7f6c9b8d8980 1 -- start start 2024-09-13T06:09:51.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.807+0000 7f6c9b8d8980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d07a4f18e0 0x55d07a5dc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:51.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.807+0000 7f6c9b8d8980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55d07a39d200 con 0x55d07a4f18e0 2024-09-13T06:09:51.808 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.807+0000 7f6c993e8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d07a4f18e0 0x55d07a5dc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:51.808 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.807+0000 7f6c993e8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d07a4f18e0 0x55d07a5dc9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:54680/0 (socket says 172.21.15.194:54680) 2024-09-13T06:09:51.808 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.807+0000 7f6c993e8640 1 -- 172.21.15.194:0/4100712566 learned_addr learned my addr 172.21.15.194:0/4100712566 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:51.808 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.807+0000 7f6c993e8640 1 -- 172.21.15.194:0/4100712566 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d07a5dcf80 con 0x55d07a4f18e0 2024-09-13T06:09:51.808 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.807+0000 7f6c993e8640 1 --2- 172.21.15.194:0/4100712566 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d07a4f18e0 0x55d07a5dc9b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c00b240 tx=0x7f6c8c00b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aee06f97e5fdca82 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:51.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.807+0000 7f6b87606640 1 -- 172.21.15.194:0/4100712566 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c8c00e700 con 0x55d07a4f18e0 2024-09-13T06:09:51.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.807+0000 7f6b87606640 1 -- 172.21.15.194:0/4100712566 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c8c00e8a0 con 0x55d07a4f18e0 2024-09-13T06:09:51.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.807+0000 7f6b87606640 1 -- 172.21.15.194:0/4100712566 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c8c00eb80 con 0x55d07a4f18e0 2024-09-13T06:09:51.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.807+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/4100712566 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d07a4f18e0 msgr2=0x55d07a5dc9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:51.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.807+0000 7f6c9b8d8980 1 --2- 172.21.15.194:0/4100712566 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d07a4f18e0 0x55d07a5dc9b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c00b240 tx=0x7f6c8c00b700 comp rx=0 tx=0).stop 2024-09-13T06:09:51.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.807+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/4100712566 shutdown_connections 2024-09-13T06:09:51.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.807+0000 7f6c9b8d8980 1 --2- 172.21.15.194:0/4100712566 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d07a4f18e0 0x55d07a5dc9b0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:51.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.807+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/4100712566 >> 172.21.15.194:0/4100712566 conn(0x55d07a465230 msgr2=0x55d07a5d85e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:51.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.807+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/4100712566 shutdown_connections 2024-09-13T06:09:51.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.807+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/4100712566 wait complete. 2024-09-13T06:09:51.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.807+0000 7f6c9b8d8980 1 Processor -- start 2024-09-13T06:09:51.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.807+0000 7f6c9b8d8980 1 -- start start 2024-09-13T06:09:51.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.807+0000 7f6c9b8d8980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d07a4f18e0 0x55d07a5e3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:51.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.807+0000 7f6c9b8d8980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55d07a4f90a0 con 0x55d07a4f18e0 2024-09-13T06:09:51.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.811+0000 7f6c993e8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d07a4f18e0 0x55d07a5e3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:51.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.811+0000 7f6c993e8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d07a4f18e0 0x55d07a5e3d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:54688/0 (socket says 172.21.15.194:54688) 2024-09-13T06:09:51.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.811+0000 7f6c993e8640 1 -- 172.21.15.194:0/2995386423 learned_addr learned my addr 172.21.15.194:0/2995386423 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:51.813 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.811+0000 7f6c993e8640 1 -- 172.21.15.194:0/2995386423 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d07a5e4250 con 0x55d07a4f18e0 2024-09-13T06:09:51.813 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.811+0000 7f6c993e8640 1 --2- 172.21.15.194:0/2995386423 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d07a4f18e0 0x55d07a5e3d10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c00b740 tx=0x7f6c8c000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:51.813 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.811+0000 7f6b85e03640 1 -- 172.21.15.194:0/2995386423 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c8c00f9a0 con 0x55d07a4f18e0 2024-09-13T06:09:51.813 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.811+0000 7f6b85e03640 1 -- 172.21.15.194:0/2995386423 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c8c00fb40 con 0x55d07a4f18e0 2024-09-13T06:09:51.813 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.811+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/2995386423 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d07a5e44e0 con 0x55d07a4f18e0 2024-09-13T06:09:51.813 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.811+0000 7f6b85e03640 1 -- 172.21.15.194:0/2995386423 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c8c00fe60 con 0x55d07a4f18e0 2024-09-13T06:09:51.813 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.811+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/2995386423 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d07a5e71c0 con 0x55d07a4f18e0 2024-09-13T06:09:51.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.811+0000 7f6b85e03640 1 -- 172.21.15.194:0/2995386423 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6c8c017070 con 0x55d07a4f18e0 2024-09-13T06:09:51.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.811+0000 7f6b85e03640 1 --2- 172.21.15.194:0/2995386423 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6b800346a0 0x7f6b80036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:51.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.811+0000 7f6b85e03640 1 -- 172.21.15.194:0/2995386423 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f6c8c015020 con 0x55d07a4f18e0 2024-09-13T06:09:51.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.811+0000 7f6c98be7640 1 --2- 172.21.15.194:0/2995386423 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6b800346a0 0x7f6b80036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:51.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.811+0000 7f6c9b8d8980 1 --2- 172.21.15.194:0/2995386423 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55d07a4f5c60 0x55d07a5ead00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:51.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.811+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/2995386423 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d07a5eb340 con 0x55d07a4f5c60 2024-09-13T06:09:51.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.811+0000 7f6c99be9640 1 --2- 172.21.15.194:0/2995386423 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55d07a4f5c60 0x55d07a5ead00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:51.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.811+0000 7f6c98be7640 1 --2- 172.21.15.194:0/2995386423 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6b800346a0 0x7f6b80036b60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6c840ae000 tx=0x7f6c840a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:51.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.815+0000 7f6c99be9640 1 --2- 172.21.15.194:0/2995386423 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55d07a4f5c60 0x55d07a5ead00 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:51.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.815+0000 7f6c99be9640 1 -- 172.21.15.194:0/2995386423 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c9400a4d0 con 0x55d07a4f5c60 2024-09-13T06:09:51.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.815+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/2995386423 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d07a5e83a0 con 0x55d07a4f5c60 2024-09-13T06:09:51.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.815+0000 7f6c99be9640 1 -- 172.21.15.194:0/2995386423 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6c9400a4d0 con 0x55d07a4f5c60 2024-09-13T06:09:51.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.815+0000 7f6c9b8d8980 1 --2- 172.21.15.194:0/2995386423 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55d07a5ed670 0x55d07a5efa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:51.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.815+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/2995386423 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d07a5f0100 con 0x55d07a5ed670 2024-09-13T06:09:51.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.815+0000 7f6c993e8640 1 --2- 172.21.15.194:0/2995386423 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55d07a5ed670 0x55d07a5efa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:51.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.815+0000 7f6c993e8640 1 --2- 172.21.15.194:0/2995386423 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55d07a5ed670 0x55d07a5efa60 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:51.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.815+0000 7f6c993e8640 1 -- 172.21.15.194:0/2995386423 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6c8c02e070 con 0x55d07a5ed670 2024-09-13T06:09:51.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.815+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/2995386423 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d07a5ec510 con 0x55d07a4f5c60 2024-09-13T06:09:51.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.815+0000 7f6c99be9640 1 -- 172.21.15.194:0/2995386423 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6c9400a4d0 con 0x55d07a4f5c60 2024-09-13T06:09:51.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.815+0000 7f6c9b8d8980 1 --2- 172.21.15.194:0/2995386423 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55d07a5f1560 0x55d07a5f3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:51.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.815+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/2995386423 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d07a5f40c0 con 0x55d07a5f1560 2024-09-13T06:09:51.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.815+0000 7f6c98be7640 1 --2- 172.21.15.194:0/2995386423 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55d07a5f1560 0x55d07a5f3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:51.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.815+0000 7f6c98be7640 1 --2- 172.21.15.194:0/2995386423 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55d07a5f1560 0x55d07a5f3950 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:51.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.815+0000 7f6c98be7640 1 -- 172.21.15.194:0/2995386423 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6c840aab90 con 0x55d07a5f1560 2024-09-13T06:09:51.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.815+0000 7f6c9b8d8980 1 Processor -- start 2024-09-13T06:09:51.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.815+0000 7f6c9b8d8980 1 -- start start 2024-09-13T06:09:51.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.815+0000 7f6c9b8d8980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d07a601b30 0x55d07a601f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:51.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.815+0000 7f6c9b8d8980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55d07a3f6800 con 0x55d07a601b30 2024-09-13T06:09:51.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.815+0000 7f6c993e8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d07a601b30 0x55d07a601f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:51.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.815+0000 7f6c993e8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d07a601b30 0x55d07a601f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:54704/0 (socket says 172.21.15.194:54704) 2024-09-13T06:09:51.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.815+0000 7f6c993e8640 1 -- 172.21.15.194:0/2490775943 learned_addr learned my addr 172.21.15.194:0/2490775943 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:51.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.819+0000 7f6c993e8640 1 -- 172.21.15.194:0/2490775943 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d07a602490 con 0x55d07a601b30 2024-09-13T06:09:51.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.819+0000 7f6c993e8640 1 --2- 172.21.15.194:0/2490775943 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d07a601b30 0x55d07a601f50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c04a010 tx=0x7f6c8c01a850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:51.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.819+0000 7f6b7effd640 1 -- 172.21.15.194:0/2490775943 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c8c040020 con 0x55d07a601b30 2024-09-13T06:09:51.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.819+0000 7f6b7effd640 1 -- 172.21.15.194:0/2490775943 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c8c017e40 con 0x55d07a601b30 2024-09-13T06:09:51.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.819+0000 7f6b7effd640 1 -- 172.21.15.194:0/2490775943 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c8c01b500 con 0x55d07a601b30 2024-09-13T06:09:51.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.819+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/2490775943 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d07a602720 con 0x55d07a601b30 2024-09-13T06:09:51.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.819+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/2490775943 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d07a602720 con 0x55d07a601b30 2024-09-13T06:09:51.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.819+0000 7f6b7effd640 1 -- 172.21.15.194:0/2490775943 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6c8c01b6a0 con 0x55d07a601b30 2024-09-13T06:09:51.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.819+0000 7f6b7effd640 1 --2- 172.21.15.194:0/2490775943 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6b70034650 0x7f6b70036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:51.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.819+0000 7f6b7effd640 1 -- 172.21.15.194:0/2490775943 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f6c8c045050 con 0x55d07a601b30 2024-09-13T06:09:51.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.819+0000 7f6c98be7640 1 --2- 172.21.15.194:0/2490775943 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6b70034650 0x7f6b70036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:51.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.819+0000 7f6c9b8d8980 1 Processor -- start 2024-09-13T06:09:51.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.819+0000 7f6c9b8d8980 1 -- start start 2024-09-13T06:09:51.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.819+0000 7f6c98be7640 1 --2- 172.21.15.194:0/2490775943 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6b70034650 0x7f6b70036b10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x55d07a5f04a0 tx=0x7f6c8401b340 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:51.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.819+0000 7f6c9b8d8980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d07a60e2e0 0x55d07a60e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:51.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.819+0000 7f6c9b8d8980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55d07a5dd300 con 0x55d07a60e2e0 2024-09-13T06:09:51.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.819+0000 7f6c993e8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d07a60e2e0 0x55d07a60e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:51.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.819+0000 7f6c993e8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d07a60e2e0 0x55d07a60e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:54710/0 (socket says 172.21.15.194:54710) 2024-09-13T06:09:51.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.819+0000 7f6c993e8640 1 -- 172.21.15.194:0/891081315 learned_addr learned my addr 172.21.15.194:0/891081315 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:51.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.823+0000 7f6c993e8640 1 -- 172.21.15.194:0/891081315 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d07a60ecb0 con 0x55d07a60e2e0 2024-09-13T06:09:51.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.823+0000 7f6c993e8640 1 --2- 172.21.15.194:0/891081315 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d07a60e2e0 0x55d07a60e6e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c019920 tx=0x7f6c8c03cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d1314300ad9bb88 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:51.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.823+0000 7f6b7cff9640 1 -- 172.21.15.194:0/891081315 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c8c03c410 con 0x55d07a60e2e0 2024-09-13T06:09:51.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.823+0000 7f6b7cff9640 1 -- 172.21.15.194:0/891081315 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c8c047710 con 0x55d07a60e2e0 2024-09-13T06:09:51.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.823+0000 7f6b7cff9640 1 -- 172.21.15.194:0/891081315 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c8c04aca0 con 0x55d07a60e2e0 2024-09-13T06:09:51.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.823+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/891081315 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d07a60e2e0 msgr2=0x55d07a60e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:51.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.823+0000 7f6c9b8d8980 1 --2- 172.21.15.194:0/891081315 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d07a60e2e0 0x55d07a60e6e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c019920 tx=0x7f6c8c03cf90 comp rx=0 tx=0).stop 2024-09-13T06:09:51.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.823+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/891081315 shutdown_connections 2024-09-13T06:09:51.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.823+0000 7f6c9b8d8980 1 --2- 172.21.15.194:0/891081315 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d07a60e2e0 0x55d07a60e6e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:51.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.823+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/891081315 >> 172.21.15.194:0/891081315 conn(0x55d07a60a6c0 msgr2=0x55d07a6087c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:51.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.823+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/891081315 shutdown_connections 2024-09-13T06:09:51.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.823+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/891081315 wait complete. 2024-09-13T06:09:51.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.823+0000 7f6c9b8d8980 1 Processor -- start 2024-09-13T06:09:51.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.823+0000 7f6c9b8d8980 1 -- start start 2024-09-13T06:09:51.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.823+0000 7f6c9b8d8980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d07a60e2e0 0x55d07a615490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:51.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.823+0000 7f6c9b8d8980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55d07a60f130 con 0x55d07a60e2e0 2024-09-13T06:09:51.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.823+0000 7f6c993e8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d07a60e2e0 0x55d07a615490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:51.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.823+0000 7f6c993e8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d07a60e2e0 0x55d07a615490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:54714/0 (socket says 172.21.15.194:54714) 2024-09-13T06:09:51.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.823+0000 7f6c993e8640 1 -- 172.21.15.194:0/788005332 learned_addr learned my addr 172.21.15.194:0/788005332 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:51.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.823+0000 7f6c993e8640 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d07a6159d0 con 0x55d07a60e2e0 2024-09-13T06:09:51.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.823+0000 7f6c993e8640 1 --2- 172.21.15.194:0/788005332 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d07a60e2e0 0x55d07a615490 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c019fd0 tx=0x7f6c8c003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:51.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.823+0000 7f6b6effd640 1 -- 172.21.15.194:0/788005332 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c8c06f070 con 0x55d07a60e2e0 2024-09-13T06:09:51.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.823+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d07a6159d0 con 0x55d07a60e2e0 2024-09-13T06:09:51.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.823+0000 7f6b6effd640 1 -- 172.21.15.194:0/788005332 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c8c04ae30 con 0x55d07a60e2e0 2024-09-13T06:09:51.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.823+0000 7f6b6effd640 1 -- 172.21.15.194:0/788005332 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c8c03c8f0 con 0x55d07a60e2e0 2024-09-13T06:09:51.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.823+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d07a6159d0 con 0x55d07a60e2e0 2024-09-13T06:09:51.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.827+0000 7f6b6effd640 1 -- 172.21.15.194:0/788005332 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6c8c072070 con 0x55d07a60e2e0 2024-09-13T06:09:51.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.827+0000 7f6b6effd640 1 --2- 172.21.15.194:0/788005332 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6b64034600 0x7f6b64036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:51.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.827+0000 7f6b6effd640 1 -- 172.21.15.194:0/788005332 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f6c8c067070 con 0x55d07a60e2e0 2024-09-13T06:09:51.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.827+0000 7f6c98be7640 1 --2- 172.21.15.194:0/788005332 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6b64034600 0x7f6b64036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:51.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.827+0000 7f6c9b8d8980 20 rados->read ofs=0 len=0 2024-09-13T06:09:51.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.827+0000 7f6c9b8d8980 1 --2- 172.21.15.194:0/788005332 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55d07a6205a0 0x55d07a622a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:51.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.827+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d07a6231b0 con 0x55d07a6205a0 2024-09-13T06:09:51.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.827+0000 7f6c99be9640 1 --2- 172.21.15.194:0/788005332 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55d07a6205a0 0x55d07a622a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:51.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.827+0000 7f6c98be7640 1 --2- 172.21.15.194:0/788005332 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6b64034600 0x7f6b64036ac0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6c84018f70 tx=0x7f6c840c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:51.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.827+0000 7f6c99be9640 1 --2- 172.21.15.194:0/788005332 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55d07a6205a0 0x55d07a622a60 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:51.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.827+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c9400a4d0 con 0x55d07a6205a0 2024-09-13T06:09:51.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.827+0000 7f6c9b8d8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:51.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.827+0000 7f6c9b8d8980 20 realm 2024-09-13T06:09:51.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.827+0000 7f6c9b8d8980 20 rados->read ofs=0 len=0 2024-09-13T06:09:51.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.827+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d07a6235c0 con 0x55d07a6205a0 2024-09-13T06:09:51.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.827+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c9400a4d0 con 0x55d07a6205a0 2024-09-13T06:09:51.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.827+0000 7f6c9b8d8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:51.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.827+0000 7f6c9b8d8980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:09:51.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.827+0000 7f6c9b8d8980 20 rados->read ofs=0 len=0 2024-09-13T06:09:51.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.827+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d07a623e90 con 0x55d07a6205a0 2024-09-13T06:09:51.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.827+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c9400a4d0 con 0x55d07a6205a0 2024-09-13T06:09:51.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.827+0000 7f6c9b8d8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:51.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.827+0000 7f6c9b8d8980 20 rados->read ofs=0 len=0 2024-09-13T06:09:51.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.827+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d07a624230 con 0x55d07a6205a0 2024-09-13T06:09:51.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.827+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6c9400a4d0 con 0x55d07a6205a0 2024-09-13T06:09:51.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.827+0000 7f6c9b8d8980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:51.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.827+0000 7f6c9b8d8980 20 rados->read ofs=0 len=0 2024-09-13T06:09:51.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.827+0000 7f6c9b8d8980 1 --2- 172.21.15.194:0/788005332 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55d07a624f90 0x55d07a627380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:51.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.827+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d07a627950 con 0x55d07a624f90 2024-09-13T06:09:51.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.827+0000 7f6c993e8640 1 --2- 172.21.15.194:0/788005332 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55d07a624f90 0x55d07a627380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:51.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.827+0000 7f6c993e8640 1 --2- 172.21.15.194:0/788005332 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55d07a624f90 0x55d07a627380 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:51.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.831+0000 7f6c993e8640 1 -- 172.21.15.194:0/788005332 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6c8c071030 con 0x55d07a624f90 2024-09-13T06:09:51.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.831+0000 7f6c9b8d8980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:09:51.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.831+0000 7f6c9b8d8980 20 searching for the correct realm 2024-09-13T06:09:51.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.831+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d07a629220 con 0x55d07a624f90 2024-09-13T06:09:51.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.831+0000 7f6c993e8640 1 -- 172.21.15.194:0/788005332 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c8c071030 con 0x55d07a624f90 2024-09-13T06:09:51.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.831+0000 7f6c993e8640 1 --2- 172.21.15.194:0/788005332 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f6c8c074060 0x7f6c8c03e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:51.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.831+0000 7f6c993e8640 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d07a629220 con 0x7f6c8c074060 2024-09-13T06:09:51.835 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.831+0000 7f6c98be7640 1 --2- 172.21.15.194:0/788005332 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f6c8c074060 0x7f6c8c03e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:51.835 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.831+0000 7f6c98be7640 1 --2- 172.21.15.194:0/788005332 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f6c8c074060 0x7f6c8c03e740 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:51.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.831+0000 7f6c98be7640 1 -- 172.21.15.194:0/788005332 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6c840aab90 con 0x7f6c8c074060 2024-09-13T06:09:51.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.831+0000 7f6c98be7640 1 --2- 172.21.15.194:0/788005332 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f6c840e0040 0x7f6c840e0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:51.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.831+0000 7f6c98be7640 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d07a629220 con 0x7f6c840e0040 2024-09-13T06:09:51.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.831+0000 7f6c99be9640 1 --2- 172.21.15.194:0/788005332 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f6c840e0040 0x7f6c840e0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:51.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.831+0000 7f6c99be9640 1 --2- 172.21.15.194:0/788005332 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f6c840e0040 0x7f6c840e0930 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:51.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.831+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c9400a4d0 con 0x7f6c840e0040 2024-09-13T06:09:51.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.831+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d07a624230 con 0x55d07a6205a0 2024-09-13T06:09:51.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.831+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c9400a4d0 con 0x55d07a6205a0 2024-09-13T06:09:51.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.831+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d07a624230 con 0x55d07a6205a0 2024-09-13T06:09:51.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.831+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c9400a4d0 con 0x55d07a6205a0 2024-09-13T06:09:51.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.831+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d07a624230 con 0x7f6c840e0040 2024-09-13T06:09:51.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.835+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c9400a4d0 con 0x7f6c840e0040 2024-09-13T06:09:51.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.835+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d07a624230 con 0x7f6c840e0040 2024-09-13T06:09:51.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.835+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c9400a4d0 con 0x7f6c840e0040 2024-09-13T06:09:51.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.835+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d07a624230 con 0x7f6c8c074060 2024-09-13T06:09:51.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.835+0000 7f6c98be7640 1 -- 172.21.15.194:0/788005332 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c840aab90 con 0x7f6c8c074060 2024-09-13T06:09:51.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.835+0000 7f6c98be7640 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d07a624230 con 0x55d07a624f90 2024-09-13T06:09:51.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.835+0000 7f6c993e8640 1 -- 172.21.15.194:0/788005332 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c8c071030 con 0x55d07a624f90 2024-09-13T06:09:51.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.835+0000 7f6c993e8640 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d07a624230 con 0x55d07a6205a0 2024-09-13T06:09:51.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.835+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c9400a4d0 con 0x55d07a6205a0 2024-09-13T06:09:51.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.835+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d07a624230 con 0x7f6c840e0040 2024-09-13T06:09:51.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.835+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c9400a4d0 con 0x7f6c840e0040 2024-09-13T06:09:51.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.835+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d07a624230 con 0x55d07a6205a0 2024-09-13T06:09:51.840 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.835+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c9400a4d0 con 0x55d07a6205a0 2024-09-13T06:09:51.840 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.835+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d07a624230 con 0x7f6c8c074060 2024-09-13T06:09:51.840 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.835+0000 7f6c98be7640 1 -- 172.21.15.194:0/788005332 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6c840aab90 con 0x7f6c8c074060 2024-09-13T06:09:51.840 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.835+0000 7f6c98be7640 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d07a624230 con 0x55d07a624f90 2024-09-13T06:09:51.840 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.835+0000 7f6c993e8640 1 -- 172.21.15.194:0/788005332 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c8c071030 con 0x55d07a624f90 2024-09-13T06:09:51.840 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.835+0000 7f6c993e8640 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d07a624230 con 0x55d07a624f90 2024-09-13T06:09:51.840 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.835+0000 7f6c993e8640 1 -- 172.21.15.194:0/788005332 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c8c071030 con 0x55d07a624f90 2024-09-13T06:09:51.840 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.835+0000 7f6c993e8640 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d07a624230 con 0x7f6c840e0040 2024-09-13T06:09:51.843 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.839+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c9400a4d0 con 0x7f6c840e0040 2024-09-13T06:09:51.843 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.839+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d07a624230 con 0x55d07a624f90 2024-09-13T06:09:51.843 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.839+0000 7f6c993e8640 1 -- 172.21.15.194:0/788005332 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c8c071030 con 0x55d07a624f90 2024-09-13T06:09:51.843 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.839+0000 7f6c993e8640 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d07a624230 con 0x55d07a624f90 2024-09-13T06:09:51.843 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.839+0000 7f6c993e8640 1 -- 172.21.15.194:0/788005332 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c8c071030 con 0x55d07a624f90 2024-09-13T06:09:51.843 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.839+0000 7f6c993e8640 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d07a624230 con 0x55d07a6205a0 2024-09-13T06:09:51.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.839+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c9400a4d0 con 0x55d07a6205a0 2024-09-13T06:09:51.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.839+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d07a624230 con 0x55d07a6205a0 2024-09-13T06:09:51.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.839+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6c9400a4d0 con 0x55d07a6205a0 2024-09-13T06:09:51.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.839+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d07a624230 con 0x7f6c840e0040 2024-09-13T06:09:51.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.839+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c9400a4d0 con 0x7f6c840e0040 2024-09-13T06:09:51.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.839+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d07a624230 con 0x55d07a624f90 2024-09-13T06:09:51.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.839+0000 7f6c993e8640 1 -- 172.21.15.194:0/788005332 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c8c071030 con 0x55d07a624f90 2024-09-13T06:09:51.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.839+0000 7f6c993e8640 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d07a624230 con 0x7f6c8c074060 2024-09-13T06:09:51.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.839+0000 7f6c98be7640 1 -- 172.21.15.194:0/788005332 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c840aab90 con 0x7f6c8c074060 2024-09-13T06:09:51.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.839+0000 7f6c98be7640 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d07a624230 con 0x55d07a6205a0 2024-09-13T06:09:51.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.839+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c9400a4d0 con 0x55d07a6205a0 2024-09-13T06:09:51.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.839+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d07a624230 con 0x7f6c840e0040 2024-09-13T06:09:51.845 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.839+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c9400a4d0 con 0x7f6c840e0040 2024-09-13T06:09:51.845 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.839+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d07a624230 con 0x55d07a624f90 2024-09-13T06:09:51.845 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.839+0000 7f6c993e8640 1 -- 172.21.15.194:0/788005332 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=107b] v26'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6c8c071030 con 0x55d07a624f90 2024-09-13T06:09:51.845 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.839+0000 7f6c993e8640 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d07a624230 con 0x7f6c840e0040 2024-09-13T06:09:51.845 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.843+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c9400a4d0 con 0x7f6c840e0040 2024-09-13T06:09:51.845 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.843+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d07a624230 con 0x7f6c8c074060 2024-09-13T06:09:51.845 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.843+0000 7f6c98be7640 1 -- 172.21.15.194:0/788005332 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c840aab90 con 0x7f6c8c074060 2024-09-13T06:09:51.845 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.843+0000 7f6c98be7640 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d07a624230 con 0x55d07a624f90 2024-09-13T06:09:51.849 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.843+0000 7f6c993e8640 1 -- 172.21.15.194:0/788005332 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c8c071030 con 0x55d07a624f90 2024-09-13T06:09:51.849 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.843+0000 7f6c993e8640 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d07a624230 con 0x7f6c840e0040 2024-09-13T06:09:51.849 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.843+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c9400a4d0 con 0x7f6c840e0040 2024-09-13T06:09:51.849 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.843+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d07a624230 con 0x55d07a6205a0 2024-09-13T06:09:51.849 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.843+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6c9400a4d0 con 0x55d07a6205a0 2024-09-13T06:09:51.849 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.843+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d07a624230 con 0x7f6c8c074060 2024-09-13T06:09:51.849 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.843+0000 7f6c98be7640 1 -- 172.21.15.194:0/788005332 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c840aab90 con 0x7f6c8c074060 2024-09-13T06:09:51.850 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.843+0000 7f6c9b8d8980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:09:51.850 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.843+0000 7f6c9b8d8980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:09:51.850 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.843+0000 7f6c9b8d8980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:09:51.850 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.843+0000 7f6c9b8d8980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:09:51.850 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.843+0000 7f6c9b8d8980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:09:51.850 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.843+0000 7f6c9b8d8980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:09:51.850 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.843+0000 7f6c9b8d8980 20 rados->read ofs=0 len=0 2024-09-13T06:09:51.850 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.843+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d07a628340 con 0x55d07a6205a0 2024-09-13T06:09:51.850 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.843+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c9400a4d0 con 0x55d07a6205a0 2024-09-13T06:09:51.850 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.843+0000 7f6c9b8d8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:51.850 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.843+0000 7f6c9b8d8980 20 rados->read ofs=0 len=0 2024-09-13T06:09:51.850 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.843+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d07a628be0 con 0x55d07a6205a0 2024-09-13T06:09:51.850 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.843+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6c9400a4d0 con 0x55d07a6205a0 2024-09-13T06:09:51.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.843+0000 7f6c9b8d8980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:51.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.843+0000 7f6c9b8d8980 20 rados->read ofs=0 len=0 2024-09-13T06:09:51.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.843+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d07a628730 con 0x7f6c8c074060 2024-09-13T06:09:51.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.843+0000 7f6c98be7640 1 -- 172.21.15.194:0/788005332 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6c840aab90 con 0x7f6c8c074060 2024-09-13T06:09:51.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.843+0000 7f6c9b8d8980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:09:51.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.843+0000 7f6c9b8d8980 20 zone default found 2024-09-13T06:09:51.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.843+0000 7f6c9b8d8980 4 Realm: () 2024-09-13T06:09:51.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.843+0000 7f6c9b8d8980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:09:51.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.843+0000 7f6c9b8d8980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:09:51.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.843+0000 7f6c9b8d8980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:09:51.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.843+0000 7f6c9b8d8980 20 zonegroup default 2024-09-13T06:09:51.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.843+0000 7f6c9b8d8980 20 rados->read ofs=0 len=0 2024-09-13T06:09:51.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.843+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d07a629650 con 0x7f6c840e0040 2024-09-13T06:09:51.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.847+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6c9400a4d0 con 0x7f6c840e0040 2024-09-13T06:09:51.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.847+0000 7f6c9b8d8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:51.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.847+0000 7f6c9b8d8980 20 rados->read ofs=0 len=0 2024-09-13T06:09:51.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.847+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d07a62b030 con 0x55d07a624f90 2024-09-13T06:09:51.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.847+0000 7f6c993e8640 1 -- 172.21.15.194:0/788005332 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6c8c071030 con 0x55d07a624f90 2024-09-13T06:09:51.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.847+0000 7f6c9b8d8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:51.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.847+0000 7f6c9b8d8980 20 rados->read ofs=0 len=0 2024-09-13T06:09:51.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.847+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d07a62b480 con 0x55d07a624f90 2024-09-13T06:09:51.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.847+0000 7f6c993e8640 1 -- 172.21.15.194:0/788005332 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6c8c071030 con 0x55d07a624f90 2024-09-13T06:09:51.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.847+0000 7f6c9b8d8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:51.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.847+0000 7f6c9b8d8980 20 started sync module instance, tier type = 2024-09-13T06:09:51.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.847+0000 7f6c9b8d8980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:09:51.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.847+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d07a62a4d0 con 0x7f6c8c074060 2024-09-13T06:09:51.853 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.847+0000 7f6c98be7640 1 -- 172.21.15.194:0/788005332 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(44 notify.0 [create] v33'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c840aab90 con 0x7f6c8c074060 2024-09-13T06:09:51.853 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.847+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94353894844528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d07a62ac90 con 0x7f6c8c074060 2024-09-13T06:09:51.853 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.847+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d07a62c3b0 con 0x55d07a6205a0 2024-09-13T06:09:51.853 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.847+0000 7f6c98be7640 1 -- 172.21.15.194:0/788005332 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94353894844528] v33'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c840aab90 con 0x7f6c8c074060 2024-09-13T06:09:51.854 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.851+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v33'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c9400a4d0 con 0x55d07a6205a0 2024-09-13T06:09:51.854 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.851+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94353894850304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d07a62c320 con 0x55d07a6205a0 2024-09-13T06:09:51.854 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.851+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d07a62d140 con 0x55d07a624f90 2024-09-13T06:09:51.854 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.851+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94353894850304] v33'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c9400a4d0 con 0x55d07a6205a0 2024-09-13T06:09:51.854 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.851+0000 7f6c993e8640 1 -- 172.21.15.194:0/788005332 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v33'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c8c071030 con 0x55d07a624f90 2024-09-13T06:09:51.854 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.851+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94353894852512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d07a62d530 con 0x55d07a624f90 2024-09-13T06:09:51.855 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.851+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d07a62def0 con 0x7f6c8c074060 2024-09-13T06:09:51.855 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.855+0000 7f6c98be7640 1 -- 172.21.15.194:0/788005332 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(50 notify.3 [create] v33'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c840aab90 con 0x7f6c8c074060 2024-09-13T06:09:51.855 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.855+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94353894857280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d07a62e790 con 0x7f6c8c074060 2024-09-13T06:09:51.855 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.855+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d07a62f1e0 con 0x55d07a6205a0 2024-09-13T06:09:51.856 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.855+0000 7f6c993e8640 1 -- 172.21.15.194:0/788005332 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94353894852512] v33'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c8c071030 con 0x55d07a624f90 2024-09-13T06:09:51.856 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.855+0000 7f6c98be7640 1 -- 172.21.15.194:0/788005332 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94353894857280] v33'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c840aab90 con 0x7f6c8c074060 2024-09-13T06:09:51.857 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.855+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v33'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c9400a4d0 con 0x55d07a6205a0 2024-09-13T06:09:51.857 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.855+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94353894862032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d07a62e2e0 con 0x55d07a6205a0 2024-09-13T06:09:51.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.855+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d07a62fa80 con 0x7f6c840e0040 2024-09-13T06:09:51.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.859+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94353894862032] v33'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c9400a4d0 con 0x55d07a6205a0 2024-09-13T06:09:51.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.859+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(54 notify.5 [create] v33'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c9400a4d0 con 0x7f6c840e0040 2024-09-13T06:09:51.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.859+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94353894853568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d07a62e2e0 con 0x7f6c840e0040 2024-09-13T06:09:51.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.859+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d07a62ff90 con 0x7f6c840e0040 2024-09-13T06:09:51.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.859+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(56 notify.6 [create] v33'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c9400a4d0 con 0x7f6c840e0040 2024-09-13T06:09:51.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.859+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94353894865520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d07a630440 con 0x7f6c840e0040 2024-09-13T06:09:51.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.859+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d07a630eb0 con 0x7f6c840e0040 2024-09-13T06:09:51.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.863+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94353894853568] v33'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c9400a4d0 con 0x7f6c840e0040 2024-09-13T06:09:51.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.863+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(58 notify.7 [create] v33'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c9400a4d0 con 0x7f6c840e0040 2024-09-13T06:09:51.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.863+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94353894869376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d07a630e70 con 0x7f6c840e0040 2024-09-13T06:09:51.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.863+0000 7f6c9b8d8980 20 add_watcher() i=0 2024-09-13T06:09:51.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.863+0000 7f6c9b8d8980 20 add_watcher() i=1 2024-09-13T06:09:51.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.863+0000 7f6c9b8d8980 20 add_watcher() i=2 2024-09-13T06:09:51.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.863+0000 7f6c9b8d8980 20 add_watcher() i=3 2024-09-13T06:09:51.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.863+0000 7f6c9b8d8980 20 add_watcher() i=4 2024-09-13T06:09:51.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.863+0000 7f6c9b8d8980 20 add_watcher() i=5 2024-09-13T06:09:51.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.863+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94353894865520] v33'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c9400a4d0 con 0x7f6c840e0040 2024-09-13T06:09:51.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.863+0000 7f6c9b8d8980 20 add_watcher() i=6 2024-09-13T06:09:51.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.867+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94353894869376] v33'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c9400a4d0 con 0x7f6c840e0040 2024-09-13T06:09:51.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.867+0000 7f6c9b8d8980 20 add_watcher() i=7 2024-09-13T06:09:51.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.867+0000 7f6c9b8d8980 2 all 8 watchers are set, enabling cache 2024-09-13T06:09:51.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.867+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d07a62ff90 con 0x55d07a6205a0 2024-09-13T06:09:51.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.867+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6c9400a4d0 con 0x55d07a6205a0 2024-09-13T06:09:51.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.867+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94353894866832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d07a631300 con 0x55d07a6205a0 2024-09-13T06:09:51.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.867+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94353894866832] v33'31 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6c9400a4d0 con 0x55d07a6205a0 2024-09-13T06:09:51.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.867+0000 7f6b4f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:51.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.867+0000 7f6c9b8d8980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:09:51.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.867+0000 7f6c9b8d8980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:09:51.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.867+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d07a63c740 con 0x55d07a6205a0 2024-09-13T06:09:51.871 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.871+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6c9400a4d0 con 0x55d07a6205a0 2024-09-13T06:09:51.871 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.871+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d07a63cd90 con 0x7f6c840e0040 2024-09-13T06:09:51.873 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.871+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'11 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6c9400a4d0 con 0x7f6c840e0040 2024-09-13T06:09:51.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.871+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d07a63d1f0 con 0x55d07a624f90 2024-09-13T06:09:51.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.875+0000 7f6c993e8640 1 -- 172.21.15.194:0/788005332 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'11 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6c8c071030 con 0x55d07a624f90 2024-09-13T06:09:51.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.875+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d07a63d130 con 0x55d07a6205a0 2024-09-13T06:09:51.876 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.875+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'32 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6c9400a4d0 con 0x55d07a6205a0 2024-09-13T06:09:51.876 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.875+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d07a63d6e0 con 0x7f6c8c074060 2024-09-13T06:09:51.878 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.875+0000 7f6c98be7640 1 -- 172.21.15.194:0/788005332 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'23 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6c840aab90 con 0x7f6c8c074060 2024-09-13T06:09:51.878 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.875+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d07a63db90 con 0x55d07a624f90 2024-09-13T06:09:51.879 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.879+0000 7f6c993e8640 1 -- 172.21.15.194:0/788005332 <== osd.3 v2:172.21.15.194:6816/96632515 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'15 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6c8c071030 con 0x55d07a624f90 2024-09-13T06:09:51.879 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.879+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d07a63db90 con 0x55d07a6205a0 2024-09-13T06:09:51.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.879+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'13 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6c9400a4d0 con 0x55d07a6205a0 2024-09-13T06:09:51.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.879+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d07a63db90 con 0x7f6c840e0040 2024-09-13T06:09:51.884 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.883+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'15 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6c9400a4d0 con 0x7f6c840e0040 2024-09-13T06:09:51.884 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.883+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d07a63db90 con 0x7f6c8c074060 2024-09-13T06:09:51.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.883+0000 7f6c98be7640 1 -- 172.21.15.194:0/788005332 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6c840aab90 con 0x7f6c8c074060 2024-09-13T06:09:51.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.883+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d07a63e100 con 0x55d07a624f90 2024-09-13T06:09:51.888 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.887+0000 7f6c993e8640 1 -- 172.21.15.194:0/788005332 <== osd.3 v2:172.21.15.194:6816/96632515 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6c8c071030 con 0x55d07a624f90 2024-09-13T06:09:51.888 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.887+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d07a63e100 con 0x7f6c8c074060 2024-09-13T06:09:51.889 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.887+0000 7f6c98be7640 1 -- 172.21.15.194:0/788005332 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c840aab90 con 0x7f6c8c074060 2024-09-13T06:09:51.889 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.887+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d07a63e670 con 0x7f6c840e0040 2024-09-13T06:09:51.891 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.891+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c9400a4d0 con 0x7f6c840e0040 2024-09-13T06:09:51.892 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.891+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d07a63eb20 con 0x7f6c8c074060 2024-09-13T06:09:51.893 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.891+0000 7f6c98be7640 1 -- 172.21.15.194:0/788005332 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c840aab90 con 0x7f6c8c074060 2024-09-13T06:09:51.893 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.891+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d07a63e950 con 0x7f6c840e0040 2024-09-13T06:09:51.895 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.895+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 <== osd.0 v2:172.21.15.120:6800/1923744619 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'21 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c9400a4d0 con 0x7f6c840e0040 2024-09-13T06:09:51.895 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.895+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d07a63e950 con 0x55d07a6205a0 2024-09-13T06:09:51.897 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.895+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'33 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c9400a4d0 con 0x55d07a6205a0 2024-09-13T06:09:51.897 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.895+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d07a63e950 con 0x55d07a624f90 2024-09-13T06:09:51.899 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.899+0000 7f6c993e8640 1 -- 172.21.15.194:0/788005332 <== osd.3 v2:172.21.15.194:6816/96632515 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c8c071030 con 0x55d07a624f90 2024-09-13T06:09:51.899 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.899+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d07a63e950 con 0x7f6c8c074060 2024-09-13T06:09:51.900 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.899+0000 7f6c98be7640 1 -- 172.21.15.194:0/788005332 <== osd.2 v2:172.21.15.194:6800/815615585 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'25 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c840aab90 con 0x7f6c8c074060 2024-09-13T06:09:51.901 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.899+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d07a63e810 con 0x55d07a624f90 2024-09-13T06:09:51.902 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.899+0000 7f6c993e8640 1 -- 172.21.15.194:0/788005332 <== osd.3 v2:172.21.15.194:6816/96632515 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'11 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c8c071030 con 0x55d07a624f90 2024-09-13T06:09:51.902 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.899+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d07a63e810 con 0x55d07a6205a0 2024-09-13T06:09:51.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.903+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 <== osd.1 v2:172.21.15.194:6808/3135444559 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c9400a4d0 con 0x55d07a6205a0 2024-09-13T06:09:51.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.903+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d07a63e810 con 0x55d07a6205a0 2024-09-13T06:09:51.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.903+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 <== osd.1 v2:172.21.15.194:6808/3135444559 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'34 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c9400a4d0 con 0x55d07a6205a0 2024-09-13T06:09:51.906 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.903+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d07a63e810 con 0x55d07a624f90 2024-09-13T06:09:51.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.907+0000 7f6c993e8640 1 -- 172.21.15.194:0/788005332 <== osd.3 v2:172.21.15.194:6816/96632515 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'18 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c8c071030 con 0x55d07a624f90 2024-09-13T06:09:51.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.907+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d07a63e810 con 0x7f6c8c074060 2024-09-13T06:09:51.909 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.907+0000 7f6c98be7640 1 -- 172.21.15.194:0/788005332 <== osd.2 v2:172.21.15.194:6800/815615585 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c840aab90 con 0x7f6c8c074060 2024-09-13T06:09:51.909 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.907+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d07a63e8c0 con 0x55d07a624f90 2024-09-13T06:09:51.911 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.911+0000 7f6c993e8640 1 -- 172.21.15.194:0/788005332 <== osd.3 v2:172.21.15.194:6816/96632515 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c8c071030 con 0x55d07a624f90 2024-09-13T06:09:51.911 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.911+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d07a63e8c0 con 0x55d07a624f90 2024-09-13T06:09:51.912 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.911+0000 7f6c993e8640 1 -- 172.21.15.194:0/788005332 <== osd.3 v2:172.21.15.194:6816/96632515 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c8c071030 con 0x55d07a624f90 2024-09-13T06:09:51.912 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.911+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d07a63e8c0 con 0x55d07a624f90 2024-09-13T06:09:51.913 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.911+0000 7f6c993e8640 1 -- 172.21.15.194:0/788005332 <== osd.3 v2:172.21.15.194:6816/96632515 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'7 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c8c071030 con 0x55d07a624f90 2024-09-13T06:09:51.913 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.911+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d07a63e8c0 con 0x55d07a624f90 2024-09-13T06:09:51.915 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.915+0000 7f6c993e8640 1 -- 172.21.15.194:0/788005332 <== osd.3 v2:172.21.15.194:6816/96632515 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'16 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c8c071030 con 0x55d07a624f90 2024-09-13T06:09:51.915 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.915+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d07a63e8c0 con 0x7f6c840e0040 2024-09-13T06:09:51.917 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.915+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 <== osd.0 v2:172.21.15.120:6800/1923744619 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c9400a4d0 con 0x7f6c840e0040 2024-09-13T06:09:51.917 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.915+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d07a63edc0 con 0x55d07a624f90 2024-09-13T06:09:51.919 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.919+0000 7f6c993e8640 1 -- 172.21.15.194:0/788005332 <== osd.3 v2:172.21.15.194:6816/96632515 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'11 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c8c071030 con 0x55d07a624f90 2024-09-13T06:09:51.919 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.919+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d07a63edc0 con 0x7f6c840e0040 2024-09-13T06:09:51.921 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.919+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 <== osd.0 v2:172.21.15.120:6800/1923744619 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'16 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c9400a4d0 con 0x7f6c840e0040 2024-09-13T06:09:51.921 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.919+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d07a63edc0 con 0x55d07a624f90 2024-09-13T06:09:51.923 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.923+0000 7f6c993e8640 1 -- 172.21.15.194:0/788005332 <== osd.3 v2:172.21.15.194:6816/96632515 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'19 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c8c071030 con 0x55d07a624f90 2024-09-13T06:09:51.923 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.923+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d07a63edc0 con 0x7f6c840e0040 2024-09-13T06:09:51.925 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.923+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 <== osd.0 v2:172.21.15.120:6800/1923744619 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'22 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c9400a4d0 con 0x7f6c840e0040 2024-09-13T06:09:51.925 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.923+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d07a63edc0 con 0x7f6c8c074060 2024-09-13T06:09:51.928 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.927+0000 7f6c98be7640 1 -- 172.21.15.194:0/788005332 <== osd.2 v2:172.21.15.194:6800/815615585 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c840aab90 con 0x7f6c8c074060 2024-09-13T06:09:51.929 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.927+0000 7f6b4e7e4640 20 reqs_thread_entry: start 2024-09-13T06:09:51.929 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.927+0000 7f6c9b8d8980 20 init_complete bucket index max shards: 11 2024-09-13T06:09:51.929 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.927+0000 7f6c9b8d8980 20 Filter name: none 2024-09-13T06:09:51.929 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.927+0000 7f6abffff640 20 reqs_thread_entry: start 2024-09-13T06:09:51.929 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.927+0000 7f6c9b8d8980 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-13T06:09:51.930 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.927+0000 7f6c9b8d8980 20 rados->read ofs=0 len=0 2024-09-13T06:09:51.930 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.927+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:94 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d07a659df0 con 0x7f6c840e0040 2024-09-13T06:09:51.930 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.927+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 <== osd.0 v2:172.21.15.120:6800/1923744619 24 ==== osd_op_reply(94 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f6c9400a4d0 con 0x7f6c840e0040 2024-09-13T06:09:51.930 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.927+0000 7f6c9b8d8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:51.930 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.927+0000 7f6c9b8d8980 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-09-13T06:09:51.931 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.927+0000 7f6c9b8d8980 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-13T06:09:51.931 INFO:teuthology.orchestra.run.smithi194.stderr:could not remove user: unable to remove user, user does not exist 2024-09-13T06:09:51.931 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.931+0000 7f6b4f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:51.931 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.931+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94353894866832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d07a61da60 con 0x55d07a6205a0 2024-09-13T06:09:51.932 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.931+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 <== osd.1 v2:172.21.15.194:6808/3135444559 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94353894866832] v33'35 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6c9400a4d0 con 0x55d07a6205a0 2024-09-13T06:09:51.932 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.931+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94353894844528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d07a62ff90 con 0x7f6c8c074060 2024-09-13T06:09:51.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.935+0000 7f6c98be7640 1 -- 172.21.15.194:0/788005332 <== osd.2 v2:172.21.15.194:6800/815615585 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94353894844528] v33'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c840aab90 con 0x7f6c8c074060 2024-09-13T06:09:51.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.935+0000 7f6c9b8d8980 20 remove_watcher() i=0 2024-09-13T06:09:51.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.935+0000 7f6c9b8d8980 2 removed watcher, disabling cache 2024-09-13T06:09:51.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.935+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94353894850304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d07a63a830 con 0x55d07a6205a0 2024-09-13T06:09:51.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.935+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 <== osd.1 v2:172.21.15.194:6808/3135444559 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94353894850304] v33'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c9400a4d0 con 0x55d07a6205a0 2024-09-13T06:09:51.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.935+0000 7f6c9b8d8980 20 remove_watcher() i=1 2024-09-13T06:09:51.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.935+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94353894852512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d07a62bf00 con 0x55d07a624f90 2024-09-13T06:09:51.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.939+0000 7f6c993e8640 1 -- 172.21.15.194:0/788005332 <== osd.3 v2:172.21.15.194:6816/96632515 27 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94353894852512] v33'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c8c071030 con 0x55d07a624f90 2024-09-13T06:09:51.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.939+0000 7f6c9b8d8980 20 remove_watcher() i=2 2024-09-13T06:09:51.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.939+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94353894857280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d07a62c7a0 con 0x7f6c8c074060 2024-09-13T06:09:51.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.939+0000 7f6c98be7640 1 -- 172.21.15.194:0/788005332 <== osd.2 v2:172.21.15.194:6800/815615585 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94353894857280] v33'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c840aab90 con 0x7f6c8c074060 2024-09-13T06:09:51.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.939+0000 7f6c9b8d8980 20 remove_watcher() i=3 2024-09-13T06:09:51.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.939+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94353894862032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d07a62bf00 con 0x55d07a6205a0 2024-09-13T06:09:51.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.943+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 <== osd.1 v2:172.21.15.194:6808/3135444559 29 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94353894862032] v33'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c9400a4d0 con 0x55d07a6205a0 2024-09-13T06:09:51.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.943+0000 7f6c9b8d8980 20 remove_watcher() i=4 2024-09-13T06:09:51.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.943+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94353894853568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d07a62c7a0 con 0x7f6c840e0040 2024-09-13T06:09:51.945 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.943+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 <== osd.0 v2:172.21.15.120:6800/1923744619 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94353894853568] v33'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c9400a4d0 con 0x7f6c840e0040 2024-09-13T06:09:51.945 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.943+0000 7f6c9b8d8980 20 remove_watcher() i=5 2024-09-13T06:09:51.945 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.943+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94353894865520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d07a62ecd0 con 0x7f6c840e0040 2024-09-13T06:09:51.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.947+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 <== osd.0 v2:172.21.15.120:6800/1923744619 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94353894865520] v33'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c9400a4d0 con 0x7f6c840e0040 2024-09-13T06:09:51.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.947+0000 7f6c9b8d8980 20 remove_watcher() i=6 2024-09-13T06:09:51.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.947+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94353894869376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d07a62bf00 con 0x7f6c840e0040 2024-09-13T06:09:51.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.947+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 <== osd.0 v2:172.21.15.120:6800/1923744619 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94353894869376] v33'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c9400a4d0 con 0x7f6c840e0040 2024-09-13T06:09:51.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.947+0000 7f6c9b8d8980 20 remove_watcher() i=7 2024-09-13T06:09:51.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.947+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f6c840e0040 msgr2=0x7f6c840e0930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:51.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.947+0000 7f6c9b8d8980 1 --2- 172.21.15.194:0/788005332 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f6c840e0040 0x7f6c840e0930 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:51.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.947+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55d07a6205a0 msgr2=0x55d07a622a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:51.953 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.947+0000 7f6c9b8d8980 1 --2- 172.21.15.194:0/788005332 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55d07a6205a0 0x55d07a622a60 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:51.953 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.947+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f6c8c074060 msgr2=0x7f6c8c03e740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:51.953 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.947+0000 7f6c9b8d8980 1 --2- 172.21.15.194:0/788005332 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f6c8c074060 0x7f6c8c03e740 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:51.953 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.947+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55d07a624f90 msgr2=0x55d07a627380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:51.953 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.947+0000 7f6c9b8d8980 1 --2- 172.21.15.194:0/788005332 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55d07a624f90 0x55d07a627380 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:51.953 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.951+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6b64034600 msgr2=0x7f6b64036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:51.953 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.951+0000 7f6c9b8d8980 1 --2- 172.21.15.194:0/788005332 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6b64034600 0x7f6b64036ac0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6c84018f70 tx=0x7f6c840c1040 comp rx=0 tx=0).stop 2024-09-13T06:09:51.953 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.951+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d07a60e2e0 msgr2=0x55d07a615490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:51.953 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.951+0000 7f6c9b8d8980 1 --2- 172.21.15.194:0/788005332 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d07a60e2e0 0x55d07a615490 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c019fd0 tx=0x7f6c8c003f60 comp rx=0 tx=0).stop 2024-09-13T06:09:51.953 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.951+0000 7f6c99be9640 1 -- 172.21.15.194:0/788005332 reap_dead start 2024-09-13T06:09:51.953 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.951+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 shutdown_connections 2024-09-13T06:09:51.953 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.951+0000 7f6c9b8d8980 1 --2- 172.21.15.194:0/788005332 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d07a60e2e0 0x55d07a615490 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:51.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.951+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 >> 172.21.15.194:0/788005332 conn(0x55d07a60a6c0 msgr2=0x55d07a608790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:51.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.951+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 shutdown_connections 2024-09-13T06:09:51.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.951+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/788005332 wait complete. 2024-09-13T06:09:51.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.951+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/2490775943 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6b70034650 msgr2=0x7f6b70036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:51.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.951+0000 7f6c9b8d8980 1 --2- 172.21.15.194:0/2490775943 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6b70034650 0x7f6b70036b10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x55d07a5f04a0 tx=0x7f6c8401b340 comp rx=0 tx=0).stop 2024-09-13T06:09:51.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.951+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/2490775943 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d07a601b30 msgr2=0x55d07a601f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:51.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.951+0000 7f6c9b8d8980 1 --2- 172.21.15.194:0/2490775943 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d07a601b30 0x55d07a601f50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c04a010 tx=0x7f6c8c01a850 comp rx=0 tx=0).stop 2024-09-13T06:09:51.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.951+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/2490775943 shutdown_connections 2024-09-13T06:09:51.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.951+0000 7f6c9b8d8980 1 --2- 172.21.15.194:0/2490775943 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6b70034650 0x7f6b70036b10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:51.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.951+0000 7f6c9b8d8980 1 --2- 172.21.15.194:0/2490775943 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d07a601b30 0x55d07a601f50 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:51.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.951+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/2490775943 >> 172.21.15.194:0/2490775943 conn(0x55d07a5f6c80 msgr2=0x55d07a5f9700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:51.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.951+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/2490775943 shutdown_connections 2024-09-13T06:09:51.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.951+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/2490775943 wait complete. 2024-09-13T06:09:51.955 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.951+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/2995386423 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55d07a4f5c60 msgr2=0x55d07a5ead00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:51.955 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.951+0000 7f6c9b8d8980 1 --2- 172.21.15.194:0/2995386423 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55d07a4f5c60 0x55d07a5ead00 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:51.955 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.951+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/2995386423 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55d07a5f1560 msgr2=0x55d07a5f3950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:51.955 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.951+0000 7f6c9b8d8980 1 --2- 172.21.15.194:0/2995386423 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55d07a5f1560 0x55d07a5f3950 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:51.955 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.951+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/2995386423 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55d07a5ed670 msgr2=0x55d07a5efa60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:51.955 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.951+0000 7f6c9b8d8980 1 --2- 172.21.15.194:0/2995386423 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55d07a5ed670 0x55d07a5efa60 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:51.955 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.951+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/2995386423 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6b800346a0 msgr2=0x7f6b80036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:51.955 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.951+0000 7f6c9b8d8980 1 --2- 172.21.15.194:0/2995386423 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6b800346a0 0x7f6b80036b60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6c840ae000 tx=0x7f6c840a6000 comp rx=0 tx=0).stop 2024-09-13T06:09:51.955 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.951+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/2995386423 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d07a4f18e0 msgr2=0x55d07a5e3d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:51.955 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.951+0000 7f6c9b8d8980 1 --2- 172.21.15.194:0/2995386423 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d07a4f18e0 0x55d07a5e3d10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c00b740 tx=0x7f6c8c000ee0 comp rx=0 tx=0).stop 2024-09-13T06:09:51.955 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.951+0000 7f6c99be9640 1 -- 172.21.15.194:0/2995386423 reap_dead start 2024-09-13T06:09:51.955 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.951+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/2995386423 shutdown_connections 2024-09-13T06:09:51.956 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.951+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/2995386423 >> 172.21.15.194:0/2995386423 conn(0x55d07a465230 msgr2=0x55d07a5d7160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:51.956 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.951+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/2995386423 shutdown_connections 2024-09-13T06:09:51.956 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:51.951+0000 7f6c9b8d8980 1 -- 172.21.15.194:0/2995386423 wait complete. 2024-09-13T06:09:51.963 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-13T06:09:51.964 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-13T06:09:51.964 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-13T06:09:51.964 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-13T06:09:52.040 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:09:52.041 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:09:52.041 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.039+0000 7f21e145c980 1 Processor -- start 2024-09-13T06:09:52.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.039+0000 7f21e145c980 1 -- start start 2024-09-13T06:09:52.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.039+0000 7f21e145c980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x557d6be62570 0x557d6be62950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.039+0000 7f21e145c980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557d6bcebae0 con 0x557d6be62ec0 2024-09-13T06:09:52.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.039+0000 7f21e145c980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x557d6bd0fe30 con 0x557d6be62570 2024-09-13T06:09:52.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.039+0000 7f21def6c640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x557d6be62570 0x557d6be62950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.039+0000 7f21def6c640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x557d6be62570 0x557d6be62950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:54728/0 (socket says 172.21.15.194:54728) 2024-09-13T06:09:52.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.039+0000 7f21def6c640 1 -- 172.21.15.194:0/2022076608 learned_addr learned my addr 172.21.15.194:0/2022076608 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:52.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.039+0000 7f21de76b640 1 --1- 172.21.15.194:0/2022076608 >> v1:172.21.15.120:6789/0 conn(0x557d6be62ec0 0x557d6be678f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:51686/0 (socket says 172.21.15.194:51686) 2024-09-13T06:09:52.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.043+0000 7f21def6c640 1 -- 172.21.15.194:0/2022076608 >> v1:172.21.15.120:6789/0 conn(0x557d6be62ec0 legacy=0x557d6be678f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:52.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.043+0000 7f21ddf6a640 1 -- 172.21.15.194:0/2022076608 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 34575820 0 0) 0x557d6bcebae0 con 0x557d6be62ec0 2024-09-13T06:09:52.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.043+0000 7f21def6c640 1 -- 172.21.15.194:0/2022076608 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d6be6a140 con 0x557d6be62570 2024-09-13T06:09:52.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.043+0000 7f21def6c640 1 --2- 172.21.15.194:0/2022076608 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557d6be62570 0x557d6be62950 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f21d0005f80 tx=0x7f21d001d570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98ad9747f699faf7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.043+0000 7f21ddf6a640 1 -- 172.21.15.194:0/2022076608 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21d00a75a0 con 0x557d6be62570 2024-09-13T06:09:52.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.043+0000 7f21ddf6a640 1 -- 172.21.15.194:0/2022076608 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21d00a7740 con 0x557d6be62570 2024-09-13T06:09:52.047 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.043+0000 7f21ddf6a640 1 -- 172.21.15.194:0/2022076608 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21d00a7a40 con 0x557d6be62570 2024-09-13T06:09:52.047 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.047+0000 7f21e145c980 1 -- 172.21.15.194:0/2022076608 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557d6be62570 msgr2=0x557d6be62950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:52.047 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.047+0000 7f21e145c980 1 --2- 172.21.15.194:0/2022076608 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557d6be62570 0x557d6be62950 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f21d0005f80 tx=0x7f21d001d570 comp rx=0 tx=0).stop 2024-09-13T06:09:52.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.047+0000 7f21e145c980 1 -- 172.21.15.194:0/2022076608 shutdown_connections 2024-09-13T06:09:52.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.047+0000 7f21e145c980 1 --2- 172.21.15.194:0/2022076608 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557d6be62570 0x557d6be62950 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:52.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.047+0000 7f21e145c980 1 -- 172.21.15.194:0/2022076608 >> 172.21.15.194:0/2022076608 conn(0x557d6be5e090 msgr2=0x557d6be604b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:52.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.047+0000 7f21e145c980 1 -- 172.21.15.194:0/2022076608 shutdown_connections 2024-09-13T06:09:52.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.047+0000 7f21e145c980 1 -- 172.21.15.194:0/2022076608 wait complete. 2024-09-13T06:09:52.063 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.063+0000 7f21e145c980 1 Processor -- start 2024-09-13T06:09:52.063 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.063+0000 7f21e145c980 1 -- start start 2024-09-13T06:09:52.063 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.063+0000 7f21e145c980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557d6be62570 0x557d6bf4c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.064 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.063+0000 7f21e145c980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x557d6bd11200 con 0x557d6be62570 2024-09-13T06:09:52.064 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.063+0000 7f21def6c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557d6be62570 0x557d6bf4c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.064 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.063+0000 7f21def6c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557d6be62570 0x557d6bf4c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:54736/0 (socket says 172.21.15.194:54736) 2024-09-13T06:09:52.064 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.063+0000 7f21def6c640 1 -- 172.21.15.194:0/3439501400 learned_addr learned my addr 172.21.15.194:0/3439501400 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:52.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.063+0000 7f21def6c640 1 -- 172.21.15.194:0/3439501400 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d6bf4cc30 con 0x557d6be62570 2024-09-13T06:09:52.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.063+0000 7f21def6c640 1 --2- 172.21.15.194:0/3439501400 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557d6be62570 0x557d6bf4c660 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f21d0005f80 tx=0x7f21d0003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1bd18872438ef87 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.063+0000 7f20cce09640 1 -- 172.21.15.194:0/3439501400 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21d00a7aa0 con 0x557d6be62570 2024-09-13T06:09:52.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.063+0000 7f20cce09640 1 -- 172.21.15.194:0/3439501400 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21d00a7c40 con 0x557d6be62570 2024-09-13T06:09:52.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.063+0000 7f20cce09640 1 -- 172.21.15.194:0/3439501400 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21d00a8450 con 0x557d6be62570 2024-09-13T06:09:52.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.063+0000 7f21e145c980 1 -- 172.21.15.194:0/3439501400 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557d6be62570 msgr2=0x557d6bf4c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:52.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.063+0000 7f21e145c980 1 --2- 172.21.15.194:0/3439501400 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557d6be62570 0x557d6bf4c660 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f21d0005f80 tx=0x7f21d0003030 comp rx=0 tx=0).stop 2024-09-13T06:09:52.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.063+0000 7f21e145c980 1 -- 172.21.15.194:0/3439501400 shutdown_connections 2024-09-13T06:09:52.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.063+0000 7f21e145c980 1 --2- 172.21.15.194:0/3439501400 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557d6be62570 0x557d6bf4c660 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:52.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.063+0000 7f21e145c980 1 -- 172.21.15.194:0/3439501400 >> 172.21.15.194:0/3439501400 conn(0x557d6be5e090 msgr2=0x557d6bf48290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:52.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.063+0000 7f21e145c980 1 -- 172.21.15.194:0/3439501400 shutdown_connections 2024-09-13T06:09:52.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.063+0000 7f21e145c980 1 -- 172.21.15.194:0/3439501400 wait complete. 2024-09-13T06:09:52.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.067+0000 7f21e145c980 1 Processor -- start 2024-09-13T06:09:52.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.067+0000 7f21e145c980 1 -- start start 2024-09-13T06:09:52.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.067+0000 7f21e145c980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557d6be62570 0x557d6bf53830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.067+0000 7f21e145c980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x557d6be69b80 con 0x557d6be62570 2024-09-13T06:09:52.068 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.067+0000 7f21def6c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557d6be62570 0x557d6bf53830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.069 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.067+0000 7f21def6c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557d6be62570 0x557d6bf53830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:54744/0 (socket says 172.21.15.194:54744) 2024-09-13T06:09:52.069 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.067+0000 7f21def6c640 1 -- 172.21.15.194:0/532641668 learned_addr learned my addr 172.21.15.194:0/532641668 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:52.069 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.067+0000 7f21def6c640 1 -- 172.21.15.194:0/532641668 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d6bf53d70 con 0x557d6be62570 2024-09-13T06:09:52.069 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.067+0000 7f21def6c640 1 --2- 172.21.15.194:0/532641668 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557d6be62570 0x557d6bf53830 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f21d00030b0 tx=0x7f21d001a310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.069 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.067+0000 7f20cb606640 1 -- 172.21.15.194:0/532641668 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21d00cb020 con 0x557d6be62570 2024-09-13T06:09:52.069 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.067+0000 7f20cb606640 1 -- 172.21.15.194:0/532641668 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21d00c7480 con 0x557d6be62570 2024-09-13T06:09:52.069 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.067+0000 7f21e145c980 1 -- 172.21.15.194:0/532641668 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557d6bf54000 con 0x557d6be62570 2024-09-13T06:09:52.069 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.067+0000 7f20cb606640 1 -- 172.21.15.194:0/532641668 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21d00a7aa0 con 0x557d6be62570 2024-09-13T06:09:52.069 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.067+0000 7f21e145c980 1 -- 172.21.15.194:0/532641668 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d6bf56ce0 con 0x557d6be62570 2024-09-13T06:09:52.070 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.067+0000 7f20cb606640 1 -- 172.21.15.194:0/532641668 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f21d00ce020 con 0x557d6be62570 2024-09-13T06:09:52.070 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.067+0000 7f20cb606640 1 --2- 172.21.15.194:0/532641668 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f20c4034650 0x7f20c4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.070 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.067+0000 7f20cb606640 1 -- 172.21.15.194:0/532641668 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f21d00c1070 con 0x557d6be62570 2024-09-13T06:09:52.071 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.067+0000 7f21de76b640 1 --2- 172.21.15.194:0/532641668 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f20c4034650 0x7f20c4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.071 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.067+0000 7f21e145c980 1 --2- 172.21.15.194:0/532641668 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x557d6be62ec0 0x557d6bf5a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.071 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.067+0000 7f21e145c980 1 -- 172.21.15.194:0/532641668 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557d6bf5ade0 con 0x557d6be62ec0 2024-09-13T06:09:52.071 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.067+0000 7f21df76d640 1 --2- 172.21.15.194:0/532641668 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x557d6be62ec0 0x557d6bf5a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.071 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.071+0000 7f21de76b640 1 --2- 172.21.15.194:0/532641668 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f20c4034650 0x7f20c4036b10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f21d4000c10 tx=0x7f21d40013c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.071 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.071+0000 7f21df76d640 1 --2- 172.21.15.194:0/532641668 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x557d6be62ec0 0x557d6bf5a7c0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.072 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.071+0000 7f21df76d640 1 -- 172.21.15.194:0/532641668 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f21d800a4d0 con 0x557d6be62ec0 2024-09-13T06:09:52.073 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.071+0000 7f21e145c980 1 -- 172.21.15.194:0/532641668 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557d6bf57ec0 con 0x557d6be62ec0 2024-09-13T06:09:52.073 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.071+0000 7f21df76d640 1 -- 172.21.15.194:0/532641668 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f21d800a4d0 con 0x557d6be62ec0 2024-09-13T06:09:52.073 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.071+0000 7f21e145c980 1 --2- 172.21.15.194:0/532641668 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x557d6bf5d110 0x557d6bf5f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.073 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.071+0000 7f21e145c980 1 -- 172.21.15.194:0/532641668 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557d6bf5fba0 con 0x557d6bf5d110 2024-09-13T06:09:52.073 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.071+0000 7f21def6c640 1 --2- 172.21.15.194:0/532641668 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x557d6bf5d110 0x557d6bf5f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.073 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.071+0000 7f21def6c640 1 --2- 172.21.15.194:0/532641668 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x557d6bf5d110 0x557d6bf5f500 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.073 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.071+0000 7f21def6c640 1 -- 172.21.15.194:0/532641668 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f21d00bc960 con 0x557d6bf5d110 2024-09-13T06:09:52.073 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.071+0000 7f21e145c980 1 -- 172.21.15.194:0/532641668 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557d6bf5bfb0 con 0x557d6be62ec0 2024-09-13T06:09:52.073 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.071+0000 7f21df76d640 1 -- 172.21.15.194:0/532641668 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f21d800a4d0 con 0x557d6be62ec0 2024-09-13T06:09:52.073 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.071+0000 7f21e145c980 1 --2- 172.21.15.194:0/532641668 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x557d6bf61000 0x557d6bf633f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.073 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.071+0000 7f21e145c980 1 -- 172.21.15.194:0/532641668 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557d6bf63af0 con 0x557d6bf61000 2024-09-13T06:09:52.074 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.071+0000 7f21de76b640 1 --2- 172.21.15.194:0/532641668 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x557d6bf61000 0x557d6bf633f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.075 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.071+0000 7f21de76b640 1 --2- 172.21.15.194:0/532641668 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x557d6bf61000 0x557d6bf633f0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.075 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.071+0000 7f21de76b640 1 -- 172.21.15.194:0/532641668 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f21d400f680 con 0x557d6bf61000 2024-09-13T06:09:52.075 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.071+0000 7f21e145c980 1 Processor -- start 2024-09-13T06:09:52.075 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.071+0000 7f21e145c980 1 -- start start 2024-09-13T06:09:52.075 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.071+0000 7f21e145c980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557d6bf759d0 0x557d6bf75df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.075 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.071+0000 7f21e145c980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x557d6bd6a800 con 0x557d6bf759d0 2024-09-13T06:09:52.075 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.075+0000 7f21def6c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557d6bf759d0 0x557d6bf75df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.075 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.075+0000 7f21def6c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557d6bf759d0 0x557d6bf75df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:54750/0 (socket says 172.21.15.194:54750) 2024-09-13T06:09:52.075 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.075+0000 7f21def6c640 1 -- 172.21.15.194:0/702514135 learned_addr learned my addr 172.21.15.194:0/702514135 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:52.075 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.075+0000 7f21def6c640 1 -- 172.21.15.194:0/702514135 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d6bf76330 con 0x557d6bf759d0 2024-09-13T06:09:52.076 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.075+0000 7f21def6c640 1 --2- 172.21.15.194:0/702514135 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557d6bf759d0 0x557d6bf75df0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f21d00e6430 tx=0x7f21d000d1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.076 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.075+0000 7f20c8e01640 1 -- 172.21.15.194:0/702514135 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21d00cfe30 con 0x557d6bf759d0 2024-09-13T06:09:52.076 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.075+0000 7f20c8e01640 1 -- 172.21.15.194:0/702514135 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21d00c5780 con 0x557d6bf759d0 2024-09-13T06:09:52.076 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.075+0000 7f20c8e01640 1 -- 172.21.15.194:0/702514135 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21d00c5a60 con 0x557d6bf759d0 2024-09-13T06:09:52.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.075+0000 7f21e145c980 1 -- 172.21.15.194:0/702514135 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557d6bf765c0 con 0x557d6bf759d0 2024-09-13T06:09:52.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.075+0000 7f21e145c980 1 -- 172.21.15.194:0/702514135 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d6bf765c0 con 0x557d6bf759d0 2024-09-13T06:09:52.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.075+0000 7f20c8e01640 1 -- 172.21.15.194:0/702514135 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f21d00cf3b0 con 0x557d6bf759d0 2024-09-13T06:09:52.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.075+0000 7f20c8e01640 1 --2- 172.21.15.194:0/702514135 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f20b8034840 0x7f20b8036d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.075+0000 7f20c8e01640 1 -- 172.21.15.194:0/702514135 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f21d00de0b0 con 0x557d6bf759d0 2024-09-13T06:09:52.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.075+0000 7f21de76b640 1 --2- 172.21.15.194:0/702514135 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f20b8034840 0x7f20b8036d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.075+0000 7f21e145c980 1 Processor -- start 2024-09-13T06:09:52.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.075+0000 7f21e145c980 1 -- start start 2024-09-13T06:09:52.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.075+0000 7f21de76b640 1 --2- 172.21.15.194:0/702514135 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f20b8034840 0x7f20b8036d00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x557d6bf5b6c0 tx=0x7f21d4006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.075+0000 7f21e145c980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557d6bf82100 0x557d6bf82500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.075+0000 7f21e145c980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x557d6bf4cef0 con 0x557d6bf82100 2024-09-13T06:09:52.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.079+0000 7f21def6c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557d6bf82100 0x557d6bf82500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.079+0000 7f21def6c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557d6bf82100 0x557d6bf82500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:54756/0 (socket says 172.21.15.194:54756) 2024-09-13T06:09:52.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.079+0000 7f21def6c640 1 -- 172.21.15.194:0/3195903163 learned_addr learned my addr 172.21.15.194:0/3195903163 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:52.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.079+0000 7f21def6c640 1 -- 172.21.15.194:0/3195903163 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d6bf82ad0 con 0x557d6bf82100 2024-09-13T06:09:52.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.079+0000 7f21def6c640 1 --2- 172.21.15.194:0/3195903163 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557d6bf82100 0x557d6bf82500 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f21d00e52f0 tx=0x7f21d00c1580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39b7a558a8b3153b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.079+0000 7f20c27fc640 1 -- 172.21.15.194:0/3195903163 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21d00dc430 con 0x557d6bf82100 2024-09-13T06:09:52.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.079+0000 7f20c27fc640 1 -- 172.21.15.194:0/3195903163 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21d00bfe80 con 0x557d6bf82100 2024-09-13T06:09:52.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.079+0000 7f20c27fc640 1 -- 172.21.15.194:0/3195903163 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21d00e6510 con 0x557d6bf82100 2024-09-13T06:09:52.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.079+0000 7f21e145c980 1 -- 172.21.15.194:0/3195903163 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557d6bf82100 msgr2=0x557d6bf82500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:52.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.079+0000 7f21e145c980 1 --2- 172.21.15.194:0/3195903163 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557d6bf82100 0x557d6bf82500 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f21d00e52f0 tx=0x7f21d00c1580 comp rx=0 tx=0).stop 2024-09-13T06:09:52.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.079+0000 7f21e145c980 1 -- 172.21.15.194:0/3195903163 shutdown_connections 2024-09-13T06:09:52.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.079+0000 7f21e145c980 1 --2- 172.21.15.194:0/3195903163 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557d6bf82100 0x557d6bf82500 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:52.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.079+0000 7f21e145c980 1 -- 172.21.15.194:0/3195903163 >> 172.21.15.194:0/3195903163 conn(0x557d6bf7e4e0 msgr2=0x557d6bf7c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:52.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.079+0000 7f21e145c980 1 -- 172.21.15.194:0/3195903163 shutdown_connections 2024-09-13T06:09:52.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.079+0000 7f21e145c980 1 -- 172.21.15.194:0/3195903163 wait complete. 2024-09-13T06:09:52.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.079+0000 7f21e145c980 1 Processor -- start 2024-09-13T06:09:52.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.079+0000 7f21e145c980 1 -- start start 2024-09-13T06:09:52.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.079+0000 7f21e145c980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557d6bf82100 0x557d6bf892d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.079+0000 7f21e145c980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x557d6bf82ef0 con 0x557d6bf82100 2024-09-13T06:09:52.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.079+0000 7f21def6c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557d6bf82100 0x557d6bf892d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.079+0000 7f21def6c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557d6bf82100 0x557d6bf892d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:54764/0 (socket says 172.21.15.194:54764) 2024-09-13T06:09:52.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.079+0000 7f21def6c640 1 -- 172.21.15.194:0/3969969185 learned_addr learned my addr 172.21.15.194:0/3969969185 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:52.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.079+0000 7f21def6c640 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d6bf89810 con 0x557d6bf82100 2024-09-13T06:09:52.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.079+0000 7f21def6c640 1 --2- 172.21.15.194:0/3969969185 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557d6bf82100 0x557d6bf892d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f21d001de10 tx=0x7f21d00c1d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.083+0000 7f20c0ff9640 1 -- 172.21.15.194:0/3969969185 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21d00c28a0 con 0x557d6bf82100 2024-09-13T06:09:52.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.083+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557d6bf89810 con 0x557d6bf82100 2024-09-13T06:09:52.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.083+0000 7f20c0ff9640 1 -- 172.21.15.194:0/3969969185 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21d00cf6a0 con 0x557d6bf82100 2024-09-13T06:09:52.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.083+0000 7f20c0ff9640 1 -- 172.21.15.194:0/3969969185 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21d00cf980 con 0x557d6bf82100 2024-09-13T06:09:52.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.083+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d6bf89c80 con 0x557d6bf82100 2024-09-13T06:09:52.088 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.083+0000 7f20c0ff9640 1 -- 172.21.15.194:0/3969969185 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f21d00c16a0 con 0x557d6bf82100 2024-09-13T06:09:52.088 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.083+0000 7f20c0ff9640 1 --2- 172.21.15.194:0/3969969185 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f20a8034650 0x7f20a8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.088 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.083+0000 7f20c0ff9640 1 -- 172.21.15.194:0/3969969185 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f21d010b070 con 0x557d6bf82100 2024-09-13T06:09:52.088 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.083+0000 7f21de76b640 1 --2- 172.21.15.194:0/3969969185 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f20a8034650 0x7f20a8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.088 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.083+0000 7f21e145c980 20 rados->read ofs=0 len=0 2024-09-13T06:09:52.088 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.083+0000 7f21e145c980 1 --2- 172.21.15.194:0/3969969185 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x557d6bf942c0 0x557d6bf96780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.088 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.083+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557d6bf96ed0 con 0x557d6bf942c0 2024-09-13T06:09:52.088 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.083+0000 7f21df76d640 1 --2- 172.21.15.194:0/3969969185 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x557d6bf942c0 0x557d6bf96780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.088 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.083+0000 7f21de76b640 1 --2- 172.21.15.194:0/3969969185 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f20a8034650 0x7f20a8036b10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x557d6bf63ef0 tx=0x7f21d4023040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.088 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.083+0000 7f21df76d640 1 --2- 172.21.15.194:0/3969969185 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x557d6bf942c0 0x557d6bf96780 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.088 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.083+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f21d800a4d0 con 0x557d6bf942c0 2024-09-13T06:09:52.089 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.083+0000 7f21e145c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:52.089 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.083+0000 7f21e145c980 20 realm 2024-09-13T06:09:52.089 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.083+0000 7f21e145c980 20 rados->read ofs=0 len=0 2024-09-13T06:09:52.089 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.083+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557d6bf972e0 con 0x557d6bf942c0 2024-09-13T06:09:52.089 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.083+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f21d800a4d0 con 0x557d6bf942c0 2024-09-13T06:09:52.089 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.083+0000 7f21e145c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:52.089 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.083+0000 7f21e145c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:09:52.089 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.083+0000 7f21e145c980 20 rados->read ofs=0 len=0 2024-09-13T06:09:52.089 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.083+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557d6bf97bb0 con 0x557d6bf942c0 2024-09-13T06:09:52.089 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.083+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f21d800a4d0 con 0x557d6bf942c0 2024-09-13T06:09:52.089 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.083+0000 7f21e145c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:52.089 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.083+0000 7f21e145c980 20 rados->read ofs=0 len=0 2024-09-13T06:09:52.089 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.083+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557d6bf97f50 con 0x557d6bf942c0 2024-09-13T06:09:52.090 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.083+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f21d800a4d0 con 0x557d6bf942c0 2024-09-13T06:09:52.090 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.083+0000 7f21e145c980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:52.090 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.083+0000 7f21e145c980 20 rados->read ofs=0 len=0 2024-09-13T06:09:52.090 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.083+0000 7f21e145c980 1 --2- 172.21.15.194:0/3969969185 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x557d6bf98cb0 0x557d6bf9b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.090 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.083+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557d6bf9b6b0 con 0x557d6bf98cb0 2024-09-13T06:09:52.090 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.087+0000 7f21def6c640 1 --2- 172.21.15.194:0/3969969185 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x557d6bf98cb0 0x557d6bf9b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.090 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.087+0000 7f21def6c640 1 --2- 172.21.15.194:0/3969969185 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x557d6bf98cb0 0x557d6bf9b0a0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.090 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.087+0000 7f21def6c640 1 -- 172.21.15.194:0/3969969185 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f21d0115020 con 0x557d6bf98cb0 2024-09-13T06:09:52.090 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.087+0000 7f21e145c980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:09:52.090 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.087+0000 7f21e145c980 20 searching for the correct realm 2024-09-13T06:09:52.090 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.087+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557d6bf9cf80 con 0x557d6bf98cb0 2024-09-13T06:09:52.090 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.087+0000 7f21def6c640 1 -- 172.21.15.194:0/3969969185 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d0115020 con 0x557d6bf98cb0 2024-09-13T06:09:52.090 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.087+0000 7f21def6c640 1 --2- 172.21.15.194:0/3969969185 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f21d00f9070 0x7f21d00066d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.091 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.087+0000 7f21def6c640 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557d6bf9cf80 con 0x7f21d00f9070 2024-09-13T06:09:52.091 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.087+0000 7f21de76b640 1 --2- 172.21.15.194:0/3969969185 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f21d00f9070 0x7f21d00066d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.091 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.087+0000 7f21de76b640 1 --2- 172.21.15.194:0/3969969185 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f21d00f9070 0x7f21d00066d0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.093 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.087+0000 7f21de76b640 1 -- 172.21.15.194:0/3969969185 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f21d4037040 con 0x7f21d00f9070 2024-09-13T06:09:52.093 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.087+0000 7f21de76b640 1 --2- 172.21.15.194:0/3969969185 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f21d401f940 0x7f21d403a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.094 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.087+0000 7f21de76b640 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557d6bf9cf80 con 0x7f21d401f940 2024-09-13T06:09:52.094 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.087+0000 7f21df76d640 1 --2- 172.21.15.194:0/3969969185 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f21d401f940 0x7f21d403a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.094 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.087+0000 7f21df76d640 1 --2- 172.21.15.194:0/3969969185 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f21d401f940 0x7f21d403a3c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.094 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.087+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d800a4d0 con 0x7f21d401f940 2024-09-13T06:09:52.094 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.087+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557d6bf97f50 con 0x557d6bf942c0 2024-09-13T06:09:52.094 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.087+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d800a4d0 con 0x557d6bf942c0 2024-09-13T06:09:52.094 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.087+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557d6bf97f50 con 0x557d6bf942c0 2024-09-13T06:09:52.094 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.091+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d800a4d0 con 0x557d6bf942c0 2024-09-13T06:09:52.094 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.091+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557d6bf97f50 con 0x7f21d401f940 2024-09-13T06:09:52.094 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.091+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d800a4d0 con 0x7f21d401f940 2024-09-13T06:09:52.094 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.091+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557d6bf97f50 con 0x7f21d401f940 2024-09-13T06:09:52.094 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.091+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d800a4d0 con 0x7f21d401f940 2024-09-13T06:09:52.094 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.091+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557d6bf97f50 con 0x7f21d00f9070 2024-09-13T06:09:52.095 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.091+0000 7f21de76b640 1 -- 172.21.15.194:0/3969969185 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d4037040 con 0x7f21d00f9070 2024-09-13T06:09:52.095 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.091+0000 7f21de76b640 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557d6bf97f50 con 0x557d6bf98cb0 2024-09-13T06:09:52.095 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.091+0000 7f21def6c640 1 -- 172.21.15.194:0/3969969185 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d0115020 con 0x557d6bf98cb0 2024-09-13T06:09:52.095 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.091+0000 7f21def6c640 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557d6bf97f50 con 0x557d6bf942c0 2024-09-13T06:09:52.095 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.091+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d800a4d0 con 0x557d6bf942c0 2024-09-13T06:09:52.095 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.091+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557d6bf97f50 con 0x7f21d401f940 2024-09-13T06:09:52.095 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.091+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d800a4d0 con 0x7f21d401f940 2024-09-13T06:09:52.095 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.091+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557d6bf97f50 con 0x557d6bf942c0 2024-09-13T06:09:52.095 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.091+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d800a4d0 con 0x557d6bf942c0 2024-09-13T06:09:52.095 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.091+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557d6bf97f50 con 0x7f21d00f9070 2024-09-13T06:09:52.098 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.091+0000 7f21de76b640 1 -- 172.21.15.194:0/3969969185 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f21d4037040 con 0x7f21d00f9070 2024-09-13T06:09:52.098 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.091+0000 7f21de76b640 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557d6bf97f50 con 0x557d6bf98cb0 2024-09-13T06:09:52.098 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.095+0000 7f21def6c640 1 -- 172.21.15.194:0/3969969185 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d0115020 con 0x557d6bf98cb0 2024-09-13T06:09:52.098 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.095+0000 7f21def6c640 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557d6bf97f50 con 0x557d6bf98cb0 2024-09-13T06:09:52.098 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.095+0000 7f21def6c640 1 -- 172.21.15.194:0/3969969185 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d0115020 con 0x557d6bf98cb0 2024-09-13T06:09:52.098 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.095+0000 7f21def6c640 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557d6bf97f50 con 0x7f21d401f940 2024-09-13T06:09:52.098 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.095+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d800a4d0 con 0x7f21d401f940 2024-09-13T06:09:52.098 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.095+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557d6bf97f50 con 0x557d6bf98cb0 2024-09-13T06:09:52.098 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.095+0000 7f21def6c640 1 -- 172.21.15.194:0/3969969185 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d0115020 con 0x557d6bf98cb0 2024-09-13T06:09:52.098 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.095+0000 7f21def6c640 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557d6bf97f50 con 0x557d6bf98cb0 2024-09-13T06:09:52.098 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.095+0000 7f21def6c640 1 -- 172.21.15.194:0/3969969185 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d0115020 con 0x557d6bf98cb0 2024-09-13T06:09:52.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.095+0000 7f21def6c640 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557d6bf97f50 con 0x557d6bf942c0 2024-09-13T06:09:52.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.095+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d800a4d0 con 0x557d6bf942c0 2024-09-13T06:09:52.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.095+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557d6bf97f50 con 0x557d6bf942c0 2024-09-13T06:09:52.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.095+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f21d800a4d0 con 0x557d6bf942c0 2024-09-13T06:09:52.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.095+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557d6bf97f50 con 0x7f21d401f940 2024-09-13T06:09:52.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.095+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d800a4d0 con 0x7f21d401f940 2024-09-13T06:09:52.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.095+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557d6bf97f50 con 0x557d6bf98cb0 2024-09-13T06:09:52.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.095+0000 7f21def6c640 1 -- 172.21.15.194:0/3969969185 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d0115020 con 0x557d6bf98cb0 2024-09-13T06:09:52.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.095+0000 7f21def6c640 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557d6bf97f50 con 0x7f21d00f9070 2024-09-13T06:09:52.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.095+0000 7f21de76b640 1 -- 172.21.15.194:0/3969969185 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d4037040 con 0x7f21d00f9070 2024-09-13T06:09:52.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.095+0000 7f21de76b640 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557d6bf97f50 con 0x557d6bf942c0 2024-09-13T06:09:52.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.095+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d800a4d0 con 0x557d6bf942c0 2024-09-13T06:09:52.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.095+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557d6bf97f50 con 0x7f21d401f940 2024-09-13T06:09:52.104 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.099+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d800a4d0 con 0x7f21d401f940 2024-09-13T06:09:52.104 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.099+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557d6bf97f50 con 0x557d6bf98cb0 2024-09-13T06:09:52.104 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.099+0000 7f21def6c640 1 -- 172.21.15.194:0/3969969185 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=107b] v26'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f21d0115020 con 0x557d6bf98cb0 2024-09-13T06:09:52.104 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.099+0000 7f21def6c640 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557d6bf97f50 con 0x7f21d401f940 2024-09-13T06:09:52.104 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.099+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d800a4d0 con 0x7f21d401f940 2024-09-13T06:09:52.104 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.099+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557d6bf97f50 con 0x7f21d00f9070 2024-09-13T06:09:52.104 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.099+0000 7f21de76b640 1 -- 172.21.15.194:0/3969969185 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d4037040 con 0x7f21d00f9070 2024-09-13T06:09:52.105 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.099+0000 7f21de76b640 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557d6bf97f50 con 0x557d6bf98cb0 2024-09-13T06:09:52.105 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.099+0000 7f21def6c640 1 -- 172.21.15.194:0/3969969185 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d0130040 con 0x557d6bf98cb0 2024-09-13T06:09:52.105 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.099+0000 7f21def6c640 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557d6bf97f50 con 0x7f21d401f940 2024-09-13T06:09:52.105 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.099+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d800a4d0 con 0x7f21d401f940 2024-09-13T06:09:52.105 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.099+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557d6bf97f50 con 0x557d6bf942c0 2024-09-13T06:09:52.105 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.099+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f21d800a4d0 con 0x557d6bf942c0 2024-09-13T06:09:52.105 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.099+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557d6bf97f50 con 0x7f21d00f9070 2024-09-13T06:09:52.105 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.099+0000 7f21de76b640 1 -- 172.21.15.194:0/3969969185 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d4037040 con 0x7f21d00f9070 2024-09-13T06:09:52.106 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.099+0000 7f21e145c980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:09:52.106 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.099+0000 7f21e145c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:09:52.106 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.099+0000 7f21e145c980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:09:52.106 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.099+0000 7f21e145c980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:09:52.106 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.099+0000 7f21e145c980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:09:52.106 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.099+0000 7f21e145c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:09:52.106 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.099+0000 7f21e145c980 20 rados->read ofs=0 len=0 2024-09-13T06:09:52.106 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.099+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557d6bf9c0a0 con 0x557d6bf942c0 2024-09-13T06:09:52.106 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.099+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f21d800a4d0 con 0x557d6bf942c0 2024-09-13T06:09:52.106 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.099+0000 7f21e145c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:52.106 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.099+0000 7f21e145c980 20 rados->read ofs=0 len=0 2024-09-13T06:09:52.106 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.099+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557d6bf9bce0 con 0x557d6bf942c0 2024-09-13T06:09:52.106 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.099+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f21d800a4d0 con 0x557d6bf942c0 2024-09-13T06:09:52.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.099+0000 7f21e145c980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:52.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.099+0000 7f21e145c980 20 rados->read ofs=0 len=0 2024-09-13T06:09:52.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.099+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557d6bf9c9c0 con 0x7f21d00f9070 2024-09-13T06:09:52.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.103+0000 7f21de76b640 1 -- 172.21.15.194:0/3969969185 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f21d4037040 con 0x7f21d00f9070 2024-09-13T06:09:52.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.103+0000 7f21e145c980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:09:52.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.103+0000 7f21e145c980 20 zone default found 2024-09-13T06:09:52.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.103+0000 7f21e145c980 4 Realm: () 2024-09-13T06:09:52.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.103+0000 7f21e145c980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:09:52.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.103+0000 7f21e145c980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:09:52.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.103+0000 7f21e145c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:09:52.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.103+0000 7f21e145c980 20 zonegroup default 2024-09-13T06:09:52.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.103+0000 7f21e145c980 20 rados->read ofs=0 len=0 2024-09-13T06:09:52.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.103+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557d6bf9d3b0 con 0x7f21d401f940 2024-09-13T06:09:52.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.103+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f21d800a4d0 con 0x7f21d401f940 2024-09-13T06:09:52.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.103+0000 7f21e145c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:52.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.103+0000 7f21e145c980 20 rados->read ofs=0 len=0 2024-09-13T06:09:52.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.103+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557d6bf9ed90 con 0x557d6bf98cb0 2024-09-13T06:09:52.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.103+0000 7f21def6c640 1 -- 172.21.15.194:0/3969969185 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f21d0130040 con 0x557d6bf98cb0 2024-09-13T06:09:52.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.103+0000 7f21e145c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:52.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.103+0000 7f21e145c980 20 rados->read ofs=0 len=0 2024-09-13T06:09:52.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.103+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557d6bf9f260 con 0x557d6bf98cb0 2024-09-13T06:09:52.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.103+0000 7f21def6c640 1 -- 172.21.15.194:0/3969969185 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f21d0130040 con 0x557d6bf98cb0 2024-09-13T06:09:52.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.103+0000 7f21e145c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:52.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.103+0000 7f21e145c980 20 started sync module instance, tier type = 2024-09-13T06:09:52.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.103+0000 7f21e145c980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:09:52.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.103+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d6bf9e230 con 0x7f21d00f9070 2024-09-13T06:09:52.109 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.103+0000 7f21de76b640 1 -- 172.21.15.194:0/3969969185 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(44 notify.0 [create] v33'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21d4037040 con 0x7f21d00f9070 2024-09-13T06:09:52.110 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.103+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93997170812448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d6bf9de90 con 0x7f21d00f9070 2024-09-13T06:09:52.110 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.103+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d6bfa0190 con 0x557d6bf942c0 2024-09-13T06:09:52.110 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.107+0000 7f21de76b640 1 -- 172.21.15.194:0/3969969185 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93997170812448] v33'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21d4037040 con 0x7f21d00f9070 2024-09-13T06:09:52.110 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.107+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v33'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21d800a4d0 con 0x557d6bf942c0 2024-09-13T06:09:52.110 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.107+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93997170818272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d6bfa05b0 con 0x557d6bf942c0 2024-09-13T06:09:52.110 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.107+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d6bfa0f70 con 0x557d6bf98cb0 2024-09-13T06:09:52.110 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.107+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93997170818272] v33'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21d800a4d0 con 0x557d6bf942c0 2024-09-13T06:09:52.111 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.111+0000 7f21def6c640 1 -- 172.21.15.194:0/3969969185 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v33'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21d0130040 con 0x557d6bf98cb0 2024-09-13T06:09:52.111 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.111+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93997170819600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d6bfa0f70 con 0x557d6bf98cb0 2024-09-13T06:09:52.111 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.111+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d6bfa1930 con 0x7f21d00f9070 2024-09-13T06:09:52.112 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.111+0000 7f21de76b640 1 -- 172.21.15.194:0/3969969185 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(50 notify.3 [create] v33'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21d4037040 con 0x7f21d00f9070 2024-09-13T06:09:52.112 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.111+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93997170824320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d6bfa2180 con 0x7f21d00f9070 2024-09-13T06:09:52.112 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.111+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d6bfa2b40 con 0x557d6bf942c0 2024-09-13T06:09:52.112 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.111+0000 7f21def6c640 1 -- 172.21.15.194:0/3969969185 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93997170819600] v33'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21d0130040 con 0x557d6bf98cb0 2024-09-13T06:09:52.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.111+0000 7f21de76b640 1 -- 172.21.15.194:0/3969969185 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93997170824320] v33'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21d4037040 con 0x7f21d00f9070 2024-09-13T06:09:52.114 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.111+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v33'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21d800a4d0 con 0x557d6bf942c0 2024-09-13T06:09:52.114 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.111+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93997170821824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d6bfa2b40 con 0x557d6bf942c0 2024-09-13T06:09:52.114 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.111+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d6bfa33e0 con 0x7f21d401f940 2024-09-13T06:09:52.116 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.115+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93997170821824] v33'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21d800a4d0 con 0x557d6bf942c0 2024-09-13T06:09:52.116 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.115+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(54 notify.5 [create] v33'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21d800a4d0 con 0x7f21d401f940 2024-09-13T06:09:52.116 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.115+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93997170829216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d6bfa3190 con 0x7f21d401f940 2024-09-13T06:09:52.117 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.115+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d6bfa3c50 con 0x7f21d401f940 2024-09-13T06:09:52.118 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.119+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(56 notify.6 [create] v33'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21d800a4d0 con 0x7f21d401f940 2024-09-13T06:09:52.118 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.119+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93997170833184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d6bfa40c0 con 0x7f21d401f940 2024-09-13T06:09:52.119 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.119+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d6bfa4bc0 con 0x7f21d401f940 2024-09-13T06:09:52.119 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.119+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93997170829216] v33'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21d800a4d0 con 0x7f21d401f940 2024-09-13T06:09:52.120 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.119+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(58 notify.7 [create] v33'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21d800a4d0 con 0x7f21d401f940 2024-09-13T06:09:52.121 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.119+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93997170837168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d6bfa4b80 con 0x7f21d401f940 2024-09-13T06:09:52.121 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.119+0000 7f21e145c980 20 add_watcher() i=0 2024-09-13T06:09:52.121 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.119+0000 7f21e145c980 20 add_watcher() i=1 2024-09-13T06:09:52.121 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.119+0000 7f21e145c980 20 add_watcher() i=2 2024-09-13T06:09:52.121 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.119+0000 7f21e145c980 20 add_watcher() i=3 2024-09-13T06:09:52.121 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.119+0000 7f21e145c980 20 add_watcher() i=4 2024-09-13T06:09:52.121 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.119+0000 7f21e145c980 20 add_watcher() i=5 2024-09-13T06:09:52.122 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.119+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93997170833184] v33'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21d800a4d0 con 0x7f21d401f940 2024-09-13T06:09:52.122 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.119+0000 7f21e145c980 20 add_watcher() i=6 2024-09-13T06:09:52.122 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.123+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93997170837168] v33'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21d800a4d0 con 0x7f21d401f940 2024-09-13T06:09:52.122 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.123+0000 7f21e145c980 20 add_watcher() i=7 2024-09-13T06:09:52.122 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.123+0000 7f21e145c980 2 all 8 watchers are set, enabling cache 2024-09-13T06:09:52.123 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.123+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557d6bfa3c10 con 0x557d6bf942c0 2024-09-13T06:09:52.123 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.123+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f21d800a4d0 con 0x557d6bf942c0 2024-09-13T06:09:52.123 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.123+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93997170834448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d6bfa4fb0 con 0x557d6bf942c0 2024-09-13T06:09:52.124 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.123+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93997170834448] v33'36 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f21d800a4d0 con 0x557d6bf942c0 2024-09-13T06:09:52.124 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.123+0000 7f20957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:52.124 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.123+0000 7f21e145c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:09:52.125 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.123+0000 7f21e145c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:09:52.125 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.123+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d6bfb03f0 con 0x557d6bf942c0 2024-09-13T06:09:52.126 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.127+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f21d800a4d0 con 0x557d6bf942c0 2024-09-13T06:09:52.126 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.127+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d6bfb0a00 con 0x7f21d401f940 2024-09-13T06:09:52.129 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.127+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'12 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f21d800a4d0 con 0x7f21d401f940 2024-09-13T06:09:52.129 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.127+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d6bfb0f70 con 0x557d6bf98cb0 2024-09-13T06:09:52.130 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.127+0000 7f21def6c640 1 -- 172.21.15.194:0/3969969185 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f21d0130040 con 0x557d6bf98cb0 2024-09-13T06:09:52.130 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.127+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d6bfb0f70 con 0x557d6bf942c0 2024-09-13T06:09:52.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.131+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'37 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f21d800a4d0 con 0x557d6bf942c0 2024-09-13T06:09:52.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.131+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d6bfb0f70 con 0x7f21d00f9070 2024-09-13T06:09:52.132 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.131+0000 7f21de76b640 1 -- 172.21.15.194:0/3969969185 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'26 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f21d4037040 con 0x7f21d00f9070 2024-09-13T06:09:52.132 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.131+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d6bfb1640 con 0x557d6bf98cb0 2024-09-13T06:09:52.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.131+0000 7f21def6c640 1 -- 172.21.15.194:0/3969969185 <== osd.3 v2:172.21.15.194:6816/96632515 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'17 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f21d0130040 con 0x557d6bf98cb0 2024-09-13T06:09:52.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.131+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d6bfb1640 con 0x557d6bf942c0 2024-09-13T06:09:52.135 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.135+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f21d800a4d0 con 0x557d6bf942c0 2024-09-13T06:09:52.136 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.135+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d6bfb01a0 con 0x7f21d401f940 2024-09-13T06:09:52.138 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.135+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'17 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f21d800a4d0 con 0x7f21d401f940 2024-09-13T06:09:52.138 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.135+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d6bfb1c10 con 0x7f21d00f9070 2024-09-13T06:09:52.140 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.139+0000 7f21de76b640 1 -- 172.21.15.194:0/3969969185 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f21d4037040 con 0x7f21d00f9070 2024-09-13T06:09:52.140 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.139+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d6bfb20c0 con 0x557d6bf98cb0 2024-09-13T06:09:52.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.139+0000 7f21def6c640 1 -- 172.21.15.194:0/3969969185 <== osd.3 v2:172.21.15.194:6816/96632515 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f21d0130040 con 0x557d6bf98cb0 2024-09-13T06:09:52.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.139+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d6bfb20c0 con 0x7f21d00f9070 2024-09-13T06:09:52.143 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.143+0000 7f21de76b640 1 -- 172.21.15.194:0/3969969185 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'27 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21d4037040 con 0x7f21d00f9070 2024-09-13T06:09:52.143 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.143+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d6bfb2150 con 0x7f21d401f940 2024-09-13T06:09:52.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.143+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21d800a4d0 con 0x7f21d401f940 2024-09-13T06:09:52.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.143+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d6bfb21e0 con 0x7f21d00f9070 2024-09-13T06:09:52.146 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.143+0000 7f21de76b640 1 -- 172.21.15.194:0/3969969185 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21d4037040 con 0x7f21d00f9070 2024-09-13T06:09:52.146 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.143+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d6bfb2270 con 0x7f21d401f940 2024-09-13T06:09:52.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.147+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 <== osd.0 v2:172.21.15.120:6800/1923744619 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'23 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21d800a4d0 con 0x7f21d401f940 2024-09-13T06:09:52.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.147+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d6bfb2270 con 0x557d6bf942c0 2024-09-13T06:09:52.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.147+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'38 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21d800a4d0 con 0x557d6bf942c0 2024-09-13T06:09:52.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.147+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d6bfb2270 con 0x557d6bf98cb0 2024-09-13T06:09:52.152 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.151+0000 7f21def6c640 1 -- 172.21.15.194:0/3969969185 <== osd.3 v2:172.21.15.194:6816/96632515 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21d0130040 con 0x557d6bf98cb0 2024-09-13T06:09:52.152 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.151+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d6bfb2300 con 0x7f21d00f9070 2024-09-13T06:09:52.153 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.151+0000 7f21de76b640 1 -- 172.21.15.194:0/3969969185 <== osd.2 v2:172.21.15.194:6800/815615585 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'28 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21d4037040 con 0x7f21d00f9070 2024-09-13T06:09:52.153 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.151+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d6bfb2390 con 0x557d6bf98cb0 2024-09-13T06:09:52.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.151+0000 7f21def6c640 1 -- 172.21.15.194:0/3969969185 <== osd.3 v2:172.21.15.194:6816/96632515 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'12 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21d0130040 con 0x557d6bf98cb0 2024-09-13T06:09:52.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.151+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d6bfb2390 con 0x557d6bf942c0 2024-09-13T06:09:52.156 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.155+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 <== osd.1 v2:172.21.15.194:6808/3135444559 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21d800a4d0 con 0x557d6bf942c0 2024-09-13T06:09:52.156 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.155+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d6bfb2390 con 0x557d6bf942c0 2024-09-13T06:09:52.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.155+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 <== osd.1 v2:172.21.15.194:6808/3135444559 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'39 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21d800a4d0 con 0x557d6bf942c0 2024-09-13T06:09:52.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.155+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d6bfb23c0 con 0x557d6bf98cb0 2024-09-13T06:09:52.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.159+0000 7f21def6c640 1 -- 172.21.15.194:0/3969969185 <== osd.3 v2:172.21.15.194:6816/96632515 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'21 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21d0130040 con 0x557d6bf98cb0 2024-09-13T06:09:52.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.159+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d6bfb23c0 con 0x7f21d00f9070 2024-09-13T06:09:52.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.159+0000 7f21de76b640 1 -- 172.21.15.194:0/3969969185 <== osd.2 v2:172.21.15.194:6800/815615585 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'22 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21d4037040 con 0x7f21d00f9070 2024-09-13T06:09:52.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.159+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d6bfb2390 con 0x557d6bf98cb0 2024-09-13T06:09:52.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.159+0000 7f21def6c640 1 -- 172.21.15.194:0/3969969185 <== osd.3 v2:172.21.15.194:6816/96632515 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21d0130040 con 0x557d6bf98cb0 2024-09-13T06:09:52.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.159+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d6bfb2390 con 0x557d6bf98cb0 2024-09-13T06:09:52.163 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.163+0000 7f21def6c640 1 -- 172.21.15.194:0/3969969185 <== osd.3 v2:172.21.15.194:6816/96632515 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21d0130040 con 0x557d6bf98cb0 2024-09-13T06:09:52.163 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.163+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d6bfb2390 con 0x557d6bf98cb0 2024-09-13T06:09:52.164 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.163+0000 7f21def6c640 1 -- 172.21.15.194:0/3969969185 <== osd.3 v2:172.21.15.194:6816/96632515 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'8 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21d0130040 con 0x557d6bf98cb0 2024-09-13T06:09:52.164 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.163+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d6bfb2390 con 0x557d6bf98cb0 2024-09-13T06:09:52.165 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.163+0000 7f21def6c640 1 -- 172.21.15.194:0/3969969185 <== osd.3 v2:172.21.15.194:6816/96632515 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'18 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21d0130040 con 0x557d6bf98cb0 2024-09-13T06:09:52.165 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.163+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d6bfb2390 con 0x7f21d401f940 2024-09-13T06:09:52.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.167+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 <== osd.0 v2:172.21.15.120:6800/1923744619 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21d800a4d0 con 0x7f21d401f940 2024-09-13T06:09:52.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.167+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d6bfb2390 con 0x557d6bf98cb0 2024-09-13T06:09:52.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.167+0000 7f21def6c640 1 -- 172.21.15.194:0/3969969185 <== osd.3 v2:172.21.15.194:6816/96632515 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21d0130040 con 0x557d6bf98cb0 2024-09-13T06:09:52.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.167+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d6bfb2390 con 0x7f21d401f940 2024-09-13T06:09:52.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.171+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 <== osd.0 v2:172.21.15.120:6800/1923744619 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'18 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21d800a4d0 con 0x7f21d401f940 2024-09-13T06:09:52.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.171+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d6bfb2390 con 0x557d6bf98cb0 2024-09-13T06:09:52.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.171+0000 7f21def6c640 1 -- 172.21.15.194:0/3969969185 <== osd.3 v2:172.21.15.194:6816/96632515 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'22 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21d0130040 con 0x557d6bf98cb0 2024-09-13T06:09:52.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.171+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d6bfb2390 con 0x7f21d401f940 2024-09-13T06:09:52.176 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.175+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 <== osd.0 v2:172.21.15.120:6800/1923744619 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'24 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21d800a4d0 con 0x7f21d401f940 2024-09-13T06:09:52.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.175+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d6bfb2390 con 0x7f21d00f9070 2024-09-13T06:09:52.179 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.179+0000 7f21de76b640 1 -- 172.21.15.194:0/3969969185 <== osd.2 v2:172.21.15.194:6800/815615585 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21d4037040 con 0x7f21d00f9070 2024-09-13T06:09:52.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.179+0000 7f200ffff640 20 reqs_thread_entry: start 2024-09-13T06:09:52.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.179+0000 7f21e145c980 20 init_complete bucket index max shards: 11 2024-09-13T06:09:52.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.179+0000 7f21e145c980 20 Filter name: none 2024-09-13T06:09:52.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.179+0000 7f200dffb640 20 reqs_thread_entry: start 2024-09-13T06:09:52.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.179+0000 7f21e145c980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T06:09:52.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.179+0000 7f21e145c980 20 rados->read ofs=0 len=0 2024-09-13T06:09:52.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.179+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557d6bfae890 con 0x7f21d401f940 2024-09-13T06:09:52.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.179+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 <== osd.0 v2:172.21.15.120:6800/1923744619 24 ==== osd_op_reply(94 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f21d800a4d0 con 0x7f21d401f940 2024-09-13T06:09:52.182 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.179+0000 7f21e145c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:52.182 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.179+0000 7f21e145c980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-13T06:09:52.182 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.179+0000 7f21e145c980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T06:09:52.182 INFO:teuthology.orchestra.run.smithi194.stderr:could not remove user: unable to remove user, user does not exist 2024-09-13T06:09:52.183 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.183+0000 7f20957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:52.183 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.183+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93997170834448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d6bfac730 con 0x557d6bf942c0 2024-09-13T06:09:52.185 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.183+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 <== osd.1 v2:172.21.15.194:6808/3135444559 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 93997170834448] v33'40 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f21d800a4d0 con 0x557d6bf942c0 2024-09-13T06:09:52.185 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.183+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93997170812448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d6bfa3c10 con 0x7f21d00f9070 2024-09-13T06:09:52.185 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.183+0000 7f21de76b640 1 -- 172.21.15.194:0/3969969185 <== osd.2 v2:172.21.15.194:6800/815615585 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 93997170812448] v33'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21d4037040 con 0x7f21d00f9070 2024-09-13T06:09:52.186 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.183+0000 7f21e145c980 20 remove_watcher() i=0 2024-09-13T06:09:52.186 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.183+0000 7f21e145c980 2 removed watcher, disabling cache 2024-09-13T06:09:52.186 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.183+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93997170818272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d6bf9e620 con 0x557d6bf942c0 2024-09-13T06:09:52.188 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.187+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 <== osd.1 v2:172.21.15.194:6808/3135444559 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 93997170818272] v33'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21d800a4d0 con 0x557d6bf942c0 2024-09-13T06:09:52.188 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.187+0000 7f21e145c980 20 remove_watcher() i=1 2024-09-13T06:09:52.188 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.187+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93997170819600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d6bf9e620 con 0x557d6bf98cb0 2024-09-13T06:09:52.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.187+0000 7f21def6c640 1 -- 172.21.15.194:0/3969969185 <== osd.3 v2:172.21.15.194:6816/96632515 27 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 93997170819600] v33'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21d0130040 con 0x557d6bf98cb0 2024-09-13T06:09:52.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.187+0000 7f21e145c980 20 remove_watcher() i=2 2024-09-13T06:09:52.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.187+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93997170824320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d6bfa0210 con 0x7f21d00f9070 2024-09-13T06:09:52.191 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.191+0000 7f21de76b640 1 -- 172.21.15.194:0/3969969185 <== osd.2 v2:172.21.15.194:6800/815615585 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 93997170824320] v33'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21d4037040 con 0x7f21d00f9070 2024-09-13T06:09:52.191 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.191+0000 7f21e145c980 20 remove_watcher() i=3 2024-09-13T06:09:52.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.191+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93997170821824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d6bf9e620 con 0x557d6bf942c0 2024-09-13T06:09:52.194 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.191+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 <== osd.1 v2:172.21.15.194:6808/3135444559 29 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 93997170821824] v33'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21d800a4d0 con 0x557d6bf942c0 2024-09-13T06:09:52.194 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.191+0000 7f21e145c980 20 remove_watcher() i=4 2024-09-13T06:09:52.194 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.191+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93997170829216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d6bfa1480 con 0x7f21d401f940 2024-09-13T06:09:52.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.195+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 <== osd.0 v2:172.21.15.120:6800/1923744619 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 93997170829216] v33'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21d800a4d0 con 0x7f21d401f940 2024-09-13T06:09:52.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.195+0000 7f21e145c980 20 remove_watcher() i=5 2024-09-13T06:09:52.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.195+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93997170833184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d6bfa0210 con 0x7f21d401f940 2024-09-13T06:09:52.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.195+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 <== osd.0 v2:172.21.15.120:6800/1923744619 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 93997170833184] v33'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21d800a4d0 con 0x7f21d401f940 2024-09-13T06:09:52.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.199+0000 7f21e145c980 20 remove_watcher() i=6 2024-09-13T06:09:52.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.199+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93997170837168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557d6bfa0ac0 con 0x7f21d401f940 2024-09-13T06:09:52.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.199+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 <== osd.0 v2:172.21.15.120:6800/1923744619 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 93997170837168] v33'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21d800a4d0 con 0x7f21d401f940 2024-09-13T06:09:52.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.199+0000 7f21e145c980 20 remove_watcher() i=7 2024-09-13T06:09:52.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.199+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f21d401f940 msgr2=0x7f21d403a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:52.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.199+0000 7f21e145c980 1 --2- 172.21.15.194:0/3969969185 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f21d401f940 0x7f21d403a3c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:52.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.199+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x557d6bf942c0 msgr2=0x557d6bf96780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:52.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.199+0000 7f21e145c980 1 --2- 172.21.15.194:0/3969969185 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x557d6bf942c0 0x557d6bf96780 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:52.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.199+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f21d00f9070 msgr2=0x7f21d00066d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:52.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.199+0000 7f21e145c980 1 --2- 172.21.15.194:0/3969969185 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f21d00f9070 0x7f21d00066d0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:52.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.199+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x557d6bf98cb0 msgr2=0x557d6bf9b0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:52.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.199+0000 7f21e145c980 1 --2- 172.21.15.194:0/3969969185 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x557d6bf98cb0 0x557d6bf9b0a0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:52.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.199+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f20a8034650 msgr2=0x7f20a8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:52.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.199+0000 7f21e145c980 1 --2- 172.21.15.194:0/3969969185 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f20a8034650 0x7f20a8036b10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x557d6bf63ef0 tx=0x7f21d4023040 comp rx=0 tx=0).stop 2024-09-13T06:09:52.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.199+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557d6bf82100 msgr2=0x557d6bf892d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:52.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.199+0000 7f21e145c980 1 --2- 172.21.15.194:0/3969969185 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557d6bf82100 0x557d6bf892d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f21d001de10 tx=0x7f21d00c1d20 comp rx=0 tx=0).stop 2024-09-13T06:09:52.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.199+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 reap_dead start 2024-09-13T06:09:52.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.199+0000 7f21df76d640 1 -- 172.21.15.194:0/3969969185 reap_dead start 2024-09-13T06:09:52.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.199+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 shutdown_connections 2024-09-13T06:09:52.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.199+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 >> 172.21.15.194:0/3969969185 conn(0x557d6bf7e4e0 msgr2=0x557d6bf7c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:52.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.199+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 shutdown_connections 2024-09-13T06:09:52.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.199+0000 7f21e145c980 1 -- 172.21.15.194:0/3969969185 wait complete. 2024-09-13T06:09:52.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.199+0000 7f21e145c980 1 -- 172.21.15.194:0/702514135 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f20b8034840 msgr2=0x7f20b8036d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:52.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.199+0000 7f21e145c980 1 --2- 172.21.15.194:0/702514135 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f20b8034840 0x7f20b8036d00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x557d6bf5b6c0 tx=0x7f21d4006000 comp rx=0 tx=0).stop 2024-09-13T06:09:52.205 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.199+0000 7f21e145c980 1 -- 172.21.15.194:0/702514135 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557d6bf759d0 msgr2=0x557d6bf75df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:52.205 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.199+0000 7f21e145c980 1 --2- 172.21.15.194:0/702514135 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557d6bf759d0 0x557d6bf75df0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f21d00e6430 tx=0x7f21d000d1e0 comp rx=0 tx=0).stop 2024-09-13T06:09:52.205 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.199+0000 7f21e145c980 1 -- 172.21.15.194:0/702514135 shutdown_connections 2024-09-13T06:09:52.205 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.199+0000 7f21e145c980 1 --2- 172.21.15.194:0/702514135 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f20b8034840 0x7f20b8036d00 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:52.205 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.199+0000 7f21e145c980 1 --2- 172.21.15.194:0/702514135 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557d6bf759d0 0x557d6bf75df0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:52.205 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.199+0000 7f21e145c980 1 -- 172.21.15.194:0/702514135 >> 172.21.15.194:0/702514135 conn(0x557d6bf66710 msgr2=0x557d6bf69190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:52.205 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.199+0000 7f21e145c980 1 -- 172.21.15.194:0/702514135 shutdown_connections 2024-09-13T06:09:52.205 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.199+0000 7f21e145c980 1 -- 172.21.15.194:0/702514135 wait complete. 2024-09-13T06:09:52.205 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.203+0000 7f21e145c980 1 -- 172.21.15.194:0/532641668 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x557d6be62ec0 msgr2=0x557d6bf5a7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:52.205 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.203+0000 7f21e145c980 1 --2- 172.21.15.194:0/532641668 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x557d6be62ec0 0x557d6bf5a7c0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:52.205 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.203+0000 7f21e145c980 1 -- 172.21.15.194:0/532641668 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x557d6bf61000 msgr2=0x557d6bf633f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:52.206 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.203+0000 7f21e145c980 1 --2- 172.21.15.194:0/532641668 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x557d6bf61000 0x557d6bf633f0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:52.206 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.203+0000 7f21e145c980 1 -- 172.21.15.194:0/532641668 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x557d6bf5d110 msgr2=0x557d6bf5f500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:52.206 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.203+0000 7f21e145c980 1 --2- 172.21.15.194:0/532641668 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x557d6bf5d110 0x557d6bf5f500 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:52.206 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.203+0000 7f21e145c980 1 -- 172.21.15.194:0/532641668 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f20c4034650 msgr2=0x7f20c4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:52.206 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.203+0000 7f21e145c980 1 --2- 172.21.15.194:0/532641668 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f20c4034650 0x7f20c4036b10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f21d4000c10 tx=0x7f21d40013c0 comp rx=0 tx=0).stop 2024-09-13T06:09:52.206 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.203+0000 7f21e145c980 1 -- 172.21.15.194:0/532641668 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557d6be62570 msgr2=0x557d6bf53830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:52.206 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.203+0000 7f21e145c980 1 --2- 172.21.15.194:0/532641668 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557d6be62570 0x557d6bf53830 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f21d00030b0 tx=0x7f21d001a310 comp rx=0 tx=0).stop 2024-09-13T06:09:52.206 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.203+0000 7f21df76d640 1 -- 172.21.15.194:0/532641668 reap_dead start 2024-09-13T06:09:52.206 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.203+0000 7f21e145c980 1 -- 172.21.15.194:0/532641668 shutdown_connections 2024-09-13T06:09:52.206 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.203+0000 7f21e145c980 1 -- 172.21.15.194:0/532641668 >> 172.21.15.194:0/532641668 conn(0x557d6be5e090 msgr2=0x557d6bf46e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:52.206 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.203+0000 7f21e145c980 1 -- 172.21.15.194:0/532641668 shutdown_connections 2024-09-13T06:09:52.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.203+0000 7f21e145c980 1 -- 172.21.15.194:0/532641668 wait complete. 2024-09-13T06:09:52.214 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-13T06:09:52.215 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-13T06:09:52.215 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-13T06:09:52.215 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-13T06:09:52.295 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:09:52.295 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:09:52.296 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.295+0000 7f063217e980 1 Processor -- start 2024-09-13T06:09:52.296 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.295+0000 7f063217e980 1 -- start start 2024-09-13T06:09:52.296 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.295+0000 7f063217e980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55c66f0cbac0 0x55c66f0cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.296 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.295+0000 7f063217e980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c66ef55ae0 con 0x55c66f0cc3e0 2024-09-13T06:09:52.296 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.295+0000 7f063217e980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x55c66ef79e30 con 0x55c66f0cbac0 2024-09-13T06:09:52.297 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.295+0000 7f062fc8e640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55c66f0cbac0 0x55c66f0cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.297 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.295+0000 7f062fc8e640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55c66f0cbac0 0x55c66f0cbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:43816/0 (socket says 172.21.15.194:43816) 2024-09-13T06:09:52.297 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.295+0000 7f062fc8e640 1 -- 172.21.15.194:0/957376190 learned_addr learned my addr 172.21.15.194:0/957376190 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:52.297 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.295+0000 7f062f48d640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x55c66f0cc3e0 0x55c66f0d2b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:50870/0 (socket says 172.21.15.194:50870) 2024-09-13T06:09:52.297 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.295+0000 7f062fc8e640 1 -- 172.21.15.194:0/957376190 >> v1:172.21.15.120:6789/0 conn(0x55c66f0cc3e0 legacy=0x55c66f0d2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:52.297 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.295+0000 7f062fc8e640 1 -- 172.21.15.194:0/957376190 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c66f0d52c0 con 0x55c66f0cbac0 2024-09-13T06:09:52.300 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.299+0000 7f062fc8e640 1 --2- 172.21.15.194:0/957376190 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c66f0cbac0 0x55c66f0cbea0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f062000a4e0 tx=0x7f062001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76ed6e6560219c13 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.300 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.299+0000 7f062ec8c640 1 -- 172.21.15.194:0/957376190 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06200aa540 con 0x55c66f0cbac0 2024-09-13T06:09:52.300 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.299+0000 7f062ec8c640 1 -- 172.21.15.194:0/957376190 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06200aa6e0 con 0x55c66f0cbac0 2024-09-13T06:09:52.300 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.299+0000 7f062ec8c640 1 -- 172.21.15.194:0/957376190 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06200aaa40 con 0x55c66f0cbac0 2024-09-13T06:09:52.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.299+0000 7f063217e980 1 -- 172.21.15.194:0/957376190 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c66f0cbac0 msgr2=0x55c66f0cbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:52.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.299+0000 7f063217e980 1 --2- 172.21.15.194:0/957376190 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c66f0cbac0 0x55c66f0cbea0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f062000a4e0 tx=0x7f062001b090 comp rx=0 tx=0).stop 2024-09-13T06:09:52.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.299+0000 7f063217e980 1 -- 172.21.15.194:0/957376190 shutdown_connections 2024-09-13T06:09:52.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.299+0000 7f063217e980 1 --2- 172.21.15.194:0/957376190 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c66f0cbac0 0x55c66f0cbea0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:52.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.299+0000 7f063217e980 1 -- 172.21.15.194:0/957376190 >> 172.21.15.194:0/957376190 conn(0x55c66f0c77a0 msgr2=0x55c66f0c9bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:52.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.299+0000 7f063217e980 1 -- 172.21.15.194:0/957376190 shutdown_connections 2024-09-13T06:09:52.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.299+0000 7f063217e980 1 -- 172.21.15.194:0/957376190 wait complete. 2024-09-13T06:09:52.317 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.315+0000 7f063217e980 1 Processor -- start 2024-09-13T06:09:52.317 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.315+0000 7f063217e980 1 -- start start 2024-09-13T06:09:52.317 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.315+0000 7f063217e980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c66f0cbac0 0x55c66f1b8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.317 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.315+0000 7f063217e980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55c66ef7b200 con 0x55c66f0cbac0 2024-09-13T06:09:52.318 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.315+0000 7f062fc8e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c66f0cbac0 0x55c66f1b8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.318 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.315+0000 7f062fc8e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c66f0cbac0 0x55c66f1b8a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:43832/0 (socket says 172.21.15.194:43832) 2024-09-13T06:09:52.318 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.315+0000 7f062fc8e640 1 -- 172.21.15.194:0/3712519776 learned_addr learned my addr 172.21.15.194:0/3712519776 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:52.318 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.315+0000 7f062fc8e640 1 -- 172.21.15.194:0/3712519776 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c66f1b9010 con 0x55c66f0cbac0 2024-09-13T06:09:52.318 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.315+0000 7f062fc8e640 1 --2- 172.21.15.194:0/3712519776 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c66f0cbac0 0x55c66f1b8a40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0620017ca0 tx=0x7f06200033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9fd1fc92a71c6a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.319 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.319+0000 7f051de0b640 1 -- 172.21.15.194:0/3712519776 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06200b9030 con 0x55c66f0cbac0 2024-09-13T06:09:52.319 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.319+0000 7f051de0b640 1 -- 172.21.15.194:0/3712519776 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06200aaac0 con 0x55c66f0cbac0 2024-09-13T06:09:52.319 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.319+0000 7f051de0b640 1 -- 172.21.15.194:0/3712519776 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06200aada0 con 0x55c66f0cbac0 2024-09-13T06:09:52.320 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.319+0000 7f063217e980 1 -- 172.21.15.194:0/3712519776 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c66f0cbac0 msgr2=0x55c66f1b8a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:52.320 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.319+0000 7f063217e980 1 --2- 172.21.15.194:0/3712519776 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c66f0cbac0 0x55c66f1b8a40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0620017ca0 tx=0x7f06200033b0 comp rx=0 tx=0).stop 2024-09-13T06:09:52.320 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.319+0000 7f063217e980 1 -- 172.21.15.194:0/3712519776 shutdown_connections 2024-09-13T06:09:52.320 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.319+0000 7f063217e980 1 --2- 172.21.15.194:0/3712519776 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c66f0cbac0 0x55c66f1b8a40 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:52.321 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.319+0000 7f063217e980 1 -- 172.21.15.194:0/3712519776 >> 172.21.15.194:0/3712519776 conn(0x55c66f0c77a0 msgr2=0x55c66f1b4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:52.321 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.319+0000 7f063217e980 1 -- 172.21.15.194:0/3712519776 shutdown_connections 2024-09-13T06:09:52.321 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.319+0000 7f063217e980 1 -- 172.21.15.194:0/3712519776 wait complete. 2024-09-13T06:09:52.321 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.319+0000 7f063217e980 1 Processor -- start 2024-09-13T06:09:52.321 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.319+0000 7f063217e980 1 -- start start 2024-09-13T06:09:52.321 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.319+0000 7f063217e980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c66f0cbac0 0x55c66f1bfc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.321 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.319+0000 7f063217e980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55c66f0d4dc0 con 0x55c66f0cbac0 2024-09-13T06:09:52.321 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.319+0000 7f062fc8e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c66f0cbac0 0x55c66f1bfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.321 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.319+0000 7f062fc8e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c66f0cbac0 0x55c66f1bfc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:43846/0 (socket says 172.21.15.194:43846) 2024-09-13T06:09:52.321 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.319+0000 7f062fc8e640 1 -- 172.21.15.194:0/1646038373 learned_addr learned my addr 172.21.15.194:0/1646038373 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:52.322 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.319+0000 7f062fc8e640 1 -- 172.21.15.194:0/1646038373 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c66f1c01d0 con 0x55c66f0cbac0 2024-09-13T06:09:52.322 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.319+0000 7f062fc8e640 1 --2- 172.21.15.194:0/1646038373 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c66f0cbac0 0x55c66f1bfc90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0620005cc0 tx=0x7f0620017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.322 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.319+0000 7f0517fff640 1 -- 172.21.15.194:0/1646038373 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06200b9030 con 0x55c66f0cbac0 2024-09-13T06:09:52.322 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.319+0000 7f063217e980 1 -- 172.21.15.194:0/1646038373 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c66f1c0460 con 0x55c66f0cbac0 2024-09-13T06:09:52.322 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.319+0000 7f0517fff640 1 -- 172.21.15.194:0/1646038373 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06200c3070 con 0x55c66f0cbac0 2024-09-13T06:09:52.322 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.319+0000 7f0517fff640 1 -- 172.21.15.194:0/1646038373 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06200bf750 con 0x55c66f0cbac0 2024-09-13T06:09:52.323 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.319+0000 7f063217e980 1 -- 172.21.15.194:0/1646038373 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c66f1c3140 con 0x55c66f0cbac0 2024-09-13T06:09:52.324 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.323+0000 7f0517fff640 1 -- 172.21.15.194:0/1646038373 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f06200c5030 con 0x55c66f0cbac0 2024-09-13T06:09:52.324 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.323+0000 7f0517fff640 1 --2- 172.21.15.194:0/1646038373 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0518034650 0x7f0518036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.324 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.323+0000 7f0517fff640 1 -- 172.21.15.194:0/1646038373 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f06200ba070 con 0x55c66f0cbac0 2024-09-13T06:09:52.324 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.323+0000 7f062f48d640 1 --2- 172.21.15.194:0/1646038373 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0518034650 0x7f0518036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.324 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.323+0000 7f063217e980 1 --2- 172.21.15.194:0/1646038373 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55c66f0cc3e0 0x55c66f1c6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.324 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.323+0000 7f063217e980 1 -- 172.21.15.194:0/1646038373 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c66f1c72d0 con 0x55c66f0cc3e0 2024-09-13T06:09:52.324 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.323+0000 7f063048f640 1 --2- 172.21.15.194:0/1646038373 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55c66f0cc3e0 0x55c66f1c6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.324 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.323+0000 7f062f48d640 1 --2- 172.21.15.194:0/1646038373 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0518034650 0x7f0518036b10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0618000f70 tx=0x7f0618001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.324 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.323+0000 7f063048f640 1 --2- 172.21.15.194:0/1646038373 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55c66f0cc3e0 0x55c66f1c6d90 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.326 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.323+0000 7f063048f640 1 -- 172.21.15.194:0/1646038373 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f06280083f0 con 0x55c66f0cc3e0 2024-09-13T06:09:52.326 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.323+0000 7f063217e980 1 -- 172.21.15.194:0/1646038373 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c66f1c4360 con 0x55c66f0cc3e0 2024-09-13T06:09:52.326 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.323+0000 7f063048f640 1 -- 172.21.15.194:0/1646038373 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f06280083f0 con 0x55c66f0cc3e0 2024-09-13T06:09:52.326 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.323+0000 7f063217e980 1 --2- 172.21.15.194:0/1646038373 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55c66f1c9610 0x55c66f1cba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.326 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.323+0000 7f063217e980 1 -- 172.21.15.194:0/1646038373 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c66f1cc0f0 con 0x55c66f1c9610 2024-09-13T06:09:52.326 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.323+0000 7f062fc8e640 1 --2- 172.21.15.194:0/1646038373 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55c66f1c9610 0x55c66f1cba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.326 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.323+0000 7f062fc8e640 1 --2- 172.21.15.194:0/1646038373 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55c66f1c9610 0x55c66f1cba00 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.327 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.323+0000 7f062fc8e640 1 -- 172.21.15.194:0/1646038373 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f06200ce070 con 0x55c66f1c9610 2024-09-13T06:09:52.327 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.323+0000 7f063217e980 1 -- 172.21.15.194:0/1646038373 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c66f1c84b0 con 0x55c66f0cc3e0 2024-09-13T06:09:52.327 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.323+0000 7f063048f640 1 -- 172.21.15.194:0/1646038373 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f06280083f0 con 0x55c66f0cc3e0 2024-09-13T06:09:52.327 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.323+0000 7f063217e980 1 --2- 172.21.15.194:0/1646038373 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55c66f1cd550 0x55c66f1cf940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.327 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.323+0000 7f063217e980 1 -- 172.21.15.194:0/1646038373 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c66f1d0080 con 0x55c66f1cd550 2024-09-13T06:09:52.327 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.323+0000 7f062f48d640 1 --2- 172.21.15.194:0/1646038373 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55c66f1cd550 0x55c66f1cf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.328 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.327+0000 7f062f48d640 1 --2- 172.21.15.194:0/1646038373 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55c66f1cd550 0x55c66f1cf940 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.328 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.327+0000 7f062f48d640 1 -- 172.21.15.194:0/1646038373 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f061800f6a0 con 0x55c66f1cd550 2024-09-13T06:09:52.328 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.327+0000 7f063217e980 1 Processor -- start 2024-09-13T06:09:52.328 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.327+0000 7f063217e980 1 -- start start 2024-09-13T06:09:52.328 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.327+0000 7f063217e980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c66f1ddb50 0x55c66f1ddf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.328 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.327+0000 7f063217e980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55c66efd4800 con 0x55c66f1ddb50 2024-09-13T06:09:52.328 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.327+0000 7f062fc8e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c66f1ddb50 0x55c66f1ddf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.329 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.327+0000 7f062fc8e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c66f1ddb50 0x55c66f1ddf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:43850/0 (socket says 172.21.15.194:43850) 2024-09-13T06:09:52.329 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.327+0000 7f062fc8e640 1 -- 172.21.15.194:0/4140909175 learned_addr learned my addr 172.21.15.194:0/4140909175 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:52.330 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.327+0000 7f062fc8e640 1 -- 172.21.15.194:0/4140909175 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c66f1de4b0 con 0x55c66f1ddb50 2024-09-13T06:09:52.330 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.327+0000 7f062fc8e640 1 --2- 172.21.15.194:0/4140909175 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c66f1ddb50 0x55c66f1ddf70 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f06200bdde0 tx=0x7f06200c6e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.330 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.327+0000 7f05157fa640 1 -- 172.21.15.194:0/4140909175 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06200e38f0 con 0x55c66f1ddb50 2024-09-13T06:09:52.330 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.327+0000 7f063217e980 1 -- 172.21.15.194:0/4140909175 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c66f1de740 con 0x55c66f1ddb50 2024-09-13T06:09:52.330 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.327+0000 7f05157fa640 1 -- 172.21.15.194:0/4140909175 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06200e3a90 con 0x55c66f1ddb50 2024-09-13T06:09:52.330 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.327+0000 7f063217e980 1 -- 172.21.15.194:0/4140909175 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c66f1e13c0 con 0x55c66f1ddb50 2024-09-13T06:09:52.330 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.327+0000 7f05157fa640 1 -- 172.21.15.194:0/4140909175 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06200ed060 con 0x55c66f1ddb50 2024-09-13T06:09:52.331 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.331+0000 7f05157fa640 1 -- 172.21.15.194:0/4140909175 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f06200b3040 con 0x55c66f1ddb50 2024-09-13T06:09:52.332 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.331+0000 7f05157fa640 1 --2- 172.21.15.194:0/4140909175 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0508034650 0x7f0508036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.332 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.331+0000 7f05157fa640 1 -- 172.21.15.194:0/4140909175 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f06200ac6a0 con 0x55c66f1ddb50 2024-09-13T06:09:52.332 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.331+0000 7f062f48d640 1 --2- 172.21.15.194:0/4140909175 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0508034650 0x7f0508036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.332 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.331+0000 7f063217e980 1 Processor -- start 2024-09-13T06:09:52.332 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.331+0000 7f063217e980 1 -- start start 2024-09-13T06:09:52.332 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.331+0000 7f062f48d640 1 --2- 172.21.15.194:0/4140909175 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0508034650 0x7f0508036b10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x55c66f1c7790 tx=0x7f061800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.332 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.331+0000 7f063217e980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c66f1ea570 0x55c66f1ea970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.332 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.331+0000 7f063217e980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55c66f1b92d0 con 0x55c66f1ea570 2024-09-13T06:09:52.332 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.331+0000 7f062fc8e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c66f1ea570 0x55c66f1ea970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.332 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.331+0000 7f062fc8e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c66f1ea570 0x55c66f1ea970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:43854/0 (socket says 172.21.15.194:43854) 2024-09-13T06:09:52.332 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.331+0000 7f062fc8e640 1 -- 172.21.15.194:0/2768064259 learned_addr learned my addr 172.21.15.194:0/2768064259 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:52.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.331+0000 7f062fc8e640 1 -- 172.21.15.194:0/2768064259 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c66f1eaf40 con 0x55c66f1ea570 2024-09-13T06:09:52.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.331+0000 7f062fc8e640 1 --2- 172.21.15.194:0/2768064259 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c66f1ea570 0x55c66f1ea970 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f06200d1fd0 tx=0x7f0620009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de171cc7066b9ad2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.331+0000 7f050effd640 1 -- 172.21.15.194:0/2768064259 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06200e0cd0 con 0x55c66f1ea570 2024-09-13T06:09:52.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.331+0000 7f050effd640 1 -- 172.21.15.194:0/2768064259 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06200d1450 con 0x55c66f1ea570 2024-09-13T06:09:52.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.331+0000 7f050effd640 1 -- 172.21.15.194:0/2768064259 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06200e03e0 con 0x55c66f1ea570 2024-09-13T06:09:52.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.331+0000 7f063217e980 1 -- 172.21.15.194:0/2768064259 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c66f1ea570 msgr2=0x55c66f1ea970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:52.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.331+0000 7f063217e980 1 --2- 172.21.15.194:0/2768064259 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c66f1ea570 0x55c66f1ea970 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f06200d1fd0 tx=0x7f0620009f90 comp rx=0 tx=0).stop 2024-09-13T06:09:52.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.331+0000 7f063217e980 1 -- 172.21.15.194:0/2768064259 shutdown_connections 2024-09-13T06:09:52.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.331+0000 7f063217e980 1 --2- 172.21.15.194:0/2768064259 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c66f1ea570 0x55c66f1ea970 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:52.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.331+0000 7f063217e980 1 -- 172.21.15.194:0/2768064259 >> 172.21.15.194:0/2768064259 conn(0x55c66f1e68f0 msgr2=0x55c66f1e49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:52.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.331+0000 7f063217e980 1 -- 172.21.15.194:0/2768064259 shutdown_connections 2024-09-13T06:09:52.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.331+0000 7f063217e980 1 -- 172.21.15.194:0/2768064259 wait complete. 2024-09-13T06:09:52.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.331+0000 7f063217e980 1 Processor -- start 2024-09-13T06:09:52.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.331+0000 7f063217e980 1 -- start start 2024-09-13T06:09:52.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.331+0000 7f063217e980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c66f1ea570 0x55c66f1f16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.331+0000 7f063217e980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55c66f1eb300 con 0x55c66f1ea570 2024-09-13T06:09:52.336 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.335+0000 7f062fc8e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c66f1ea570 0x55c66f1f16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.336 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.335+0000 7f062fc8e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c66f1ea570 0x55c66f1f16d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:43860/0 (socket says 172.21.15.194:43860) 2024-09-13T06:09:52.336 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.335+0000 7f062fc8e640 1 -- 172.21.15.194:0/2123890646 learned_addr learned my addr 172.21.15.194:0/2123890646 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:52.337 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.335+0000 7f062fc8e640 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c66f1f1c10 con 0x55c66f1ea570 2024-09-13T06:09:52.338 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.335+0000 7f062fc8e640 1 --2- 172.21.15.194:0/2123890646 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c66f1ea570 0x55c66f1f16d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f06200b4c10 tx=0x7f06200ac310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.338 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.335+0000 7f050d7fa640 1 -- 172.21.15.194:0/2123890646 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06200a63f0 con 0x55c66f1ea570 2024-09-13T06:09:52.338 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.335+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c66f1f1c10 con 0x55c66f1ea570 2024-09-13T06:09:52.338 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.335+0000 7f050d7fa640 1 -- 172.21.15.194:0/2123890646 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06200c7ab0 con 0x55c66f1ea570 2024-09-13T06:09:52.338 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.335+0000 7f050d7fa640 1 -- 172.21.15.194:0/2123890646 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06200c7dd0 con 0x55c66f1ea570 2024-09-13T06:09:52.338 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.335+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c66f1f1c10 con 0x55c66f1ea570 2024-09-13T06:09:52.338 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.335+0000 7f050d7fa640 1 -- 172.21.15.194:0/2123890646 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f062010e020 con 0x55c66f1ea570 2024-09-13T06:09:52.338 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.335+0000 7f050d7fa640 1 --2- 172.21.15.194:0/2123890646 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f04f8034750 0x7f04f8036c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.338 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.335+0000 7f050d7fa640 1 -- 172.21.15.194:0/2123890646 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f062010c020 con 0x55c66f1ea570 2024-09-13T06:09:52.338 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.335+0000 7f063217e980 20 rados->read ofs=0 len=0 2024-09-13T06:09:52.338 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.335+0000 7f062f48d640 1 --2- 172.21.15.194:0/2123890646 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f04f8034750 0x7f04f8036c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.338 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.335+0000 7f063217e980 1 --2- 172.21.15.194:0/2123890646 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55c66f1fc7d0 0x55c66f1fec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.335+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c66f1ff3e0 con 0x55c66f1fc7d0 2024-09-13T06:09:52.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.335+0000 7f063048f640 1 --2- 172.21.15.194:0/2123890646 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55c66f1fc7d0 0x55c66f1fec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.335+0000 7f062f48d640 1 --2- 172.21.15.194:0/2123890646 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f04f8034750 0x7f04f8036c10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f061800ffd0 tx=0x7f0618010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.335+0000 7f063048f640 1 --2- 172.21.15.194:0/2123890646 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55c66f1fc7d0 0x55c66f1fec90 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.341 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.335+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f06280083f0 con 0x55c66f1fc7d0 2024-09-13T06:09:52.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.335+0000 7f063217e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:52.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.335+0000 7f063217e980 20 realm 2024-09-13T06:09:52.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.335+0000 7f063217e980 20 rados->read ofs=0 len=0 2024-09-13T06:09:52.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.335+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c66f1ff7f0 con 0x55c66f1fc7d0 2024-09-13T06:09:52.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.339+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f06280083f0 con 0x55c66f1fc7d0 2024-09-13T06:09:52.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.339+0000 7f063217e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:52.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.339+0000 7f063217e980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:09:52.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.339+0000 7f063217e980 20 rados->read ofs=0 len=0 2024-09-13T06:09:52.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.339+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c66f200090 con 0x55c66f1fc7d0 2024-09-13T06:09:52.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.339+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f06280083f0 con 0x55c66f1fc7d0 2024-09-13T06:09:52.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.339+0000 7f063217e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:52.343 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.339+0000 7f063217e980 20 rados->read ofs=0 len=0 2024-09-13T06:09:52.343 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.339+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c66f200430 con 0x55c66f1fc7d0 2024-09-13T06:09:52.343 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.339+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f06280083f0 con 0x55c66f1fc7d0 2024-09-13T06:09:52.343 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.339+0000 7f063217e980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:52.343 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.339+0000 7f063217e980 20 rados->read ofs=0 len=0 2024-09-13T06:09:52.343 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.339+0000 7f063217e980 1 --2- 172.21.15.194:0/2123890646 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55c66f201190 0x55c66f203580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.343 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.339+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c66f203bd0 con 0x55c66f201190 2024-09-13T06:09:52.343 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.339+0000 7f062fc8e640 1 --2- 172.21.15.194:0/2123890646 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55c66f201190 0x55c66f203580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.343 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.339+0000 7f062fc8e640 1 --2- 172.21.15.194:0/2123890646 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55c66f201190 0x55c66f203580 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.343 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.339+0000 7f062fc8e640 1 -- 172.21.15.194:0/2123890646 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f06200ef070 con 0x55c66f201190 2024-09-13T06:09:52.343 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.339+0000 7f063217e980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:09:52.343 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.339+0000 7f063217e980 20 searching for the correct realm 2024-09-13T06:09:52.343 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.339+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c66f205430 con 0x55c66f201190 2024-09-13T06:09:52.344 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.339+0000 7f062fc8e640 1 -- 172.21.15.194:0/2123890646 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06200ef070 con 0x55c66f201190 2024-09-13T06:09:52.344 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.339+0000 7f062fc8e640 1 --2- 172.21.15.194:0/2123890646 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f0620009850 0x7f06200af8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.344 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.339+0000 7f062fc8e640 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c66f205430 con 0x7f0620009850 2024-09-13T06:09:52.344 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.339+0000 7f062f48d640 1 --2- 172.21.15.194:0/2123890646 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f0620009850 0x7f06200af8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.344 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.339+0000 7f062f48d640 1 --2- 172.21.15.194:0/2123890646 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f0620009850 0x7f06200af8f0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.344 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.339+0000 7f062f48d640 1 -- 172.21.15.194:0/2123890646 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0618037040 con 0x7f0620009850 2024-09-13T06:09:52.344 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.339+0000 7f062f48d640 1 --2- 172.21.15.194:0/2123890646 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f061801fbe0 0x7f061803a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.344 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.339+0000 7f062f48d640 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c66f205430 con 0x7f061801fbe0 2024-09-13T06:09:52.344 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.339+0000 7f063048f640 1 --2- 172.21.15.194:0/2123890646 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f061801fbe0 0x7f061803a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.339+0000 7f063048f640 1 --2- 172.21.15.194:0/2123890646 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f061801fbe0 0x7f061803a3c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.343+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06280083f0 con 0x7f061801fbe0 2024-09-13T06:09:52.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.343+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c66f200430 con 0x55c66f1fc7d0 2024-09-13T06:09:52.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.343+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06280083f0 con 0x55c66f1fc7d0 2024-09-13T06:09:52.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.343+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c66f200430 con 0x55c66f1fc7d0 2024-09-13T06:09:52.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.343+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06280083f0 con 0x55c66f1fc7d0 2024-09-13T06:09:52.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.343+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c66f200430 con 0x7f061801fbe0 2024-09-13T06:09:52.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.343+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06280083f0 con 0x7f061801fbe0 2024-09-13T06:09:52.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.343+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c66f200430 con 0x7f061801fbe0 2024-09-13T06:09:52.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.343+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06280083f0 con 0x7f061801fbe0 2024-09-13T06:09:52.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.343+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c66f200430 con 0x7f0620009850 2024-09-13T06:09:52.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.343+0000 7f062f48d640 1 -- 172.21.15.194:0/2123890646 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0618037040 con 0x7f0620009850 2024-09-13T06:09:52.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.343+0000 7f062f48d640 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c66f200430 con 0x55c66f201190 2024-09-13T06:09:52.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.343+0000 7f062fc8e640 1 -- 172.21.15.194:0/2123890646 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06200ef070 con 0x55c66f201190 2024-09-13T06:09:52.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.343+0000 7f062fc8e640 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c66f200430 con 0x55c66f1fc7d0 2024-09-13T06:09:52.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.343+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06280083f0 con 0x55c66f1fc7d0 2024-09-13T06:09:52.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.343+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c66f200430 con 0x7f061801fbe0 2024-09-13T06:09:52.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.343+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06280083f0 con 0x7f061801fbe0 2024-09-13T06:09:52.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.343+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c66f200430 con 0x55c66f1fc7d0 2024-09-13T06:09:52.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.347+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06280083f0 con 0x55c66f1fc7d0 2024-09-13T06:09:52.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.347+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c66f200430 con 0x7f0620009850 2024-09-13T06:09:52.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.347+0000 7f062f48d640 1 -- 172.21.15.194:0/2123890646 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0618037040 con 0x7f0620009850 2024-09-13T06:09:52.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.347+0000 7f062f48d640 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c66f200430 con 0x55c66f201190 2024-09-13T06:09:52.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.347+0000 7f062fc8e640 1 -- 172.21.15.194:0/2123890646 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06200ef070 con 0x55c66f201190 2024-09-13T06:09:52.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.347+0000 7f062fc8e640 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c66f200430 con 0x55c66f201190 2024-09-13T06:09:52.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.347+0000 7f062fc8e640 1 -- 172.21.15.194:0/2123890646 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06200ef070 con 0x55c66f201190 2024-09-13T06:09:52.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.347+0000 7f062fc8e640 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c66f200430 con 0x7f061801fbe0 2024-09-13T06:09:52.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.347+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06280083f0 con 0x7f061801fbe0 2024-09-13T06:09:52.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.347+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c66f200430 con 0x55c66f201190 2024-09-13T06:09:52.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.347+0000 7f062fc8e640 1 -- 172.21.15.194:0/2123890646 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06200ef070 con 0x55c66f201190 2024-09-13T06:09:52.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.347+0000 7f062fc8e640 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c66f200430 con 0x55c66f201190 2024-09-13T06:09:52.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.347+0000 7f062fc8e640 1 -- 172.21.15.194:0/2123890646 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06200ef070 con 0x55c66f201190 2024-09-13T06:09:52.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.347+0000 7f062fc8e640 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c66f200430 con 0x55c66f1fc7d0 2024-09-13T06:09:52.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.347+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06280083f0 con 0x55c66f1fc7d0 2024-09-13T06:09:52.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.347+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c66f200430 con 0x55c66f1fc7d0 2024-09-13T06:09:52.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.347+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f06280083f0 con 0x55c66f1fc7d0 2024-09-13T06:09:52.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.347+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c66f200430 con 0x7f061801fbe0 2024-09-13T06:09:52.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.347+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06280083f0 con 0x7f061801fbe0 2024-09-13T06:09:52.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.347+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c66f200430 con 0x55c66f201190 2024-09-13T06:09:52.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.347+0000 7f062fc8e640 1 -- 172.21.15.194:0/2123890646 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06200ef070 con 0x55c66f201190 2024-09-13T06:09:52.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.347+0000 7f062fc8e640 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c66f200430 con 0x7f0620009850 2024-09-13T06:09:52.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.351+0000 7f062f48d640 1 -- 172.21.15.194:0/2123890646 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0618037040 con 0x7f0620009850 2024-09-13T06:09:52.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.351+0000 7f062f48d640 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c66f200430 con 0x55c66f1fc7d0 2024-09-13T06:09:52.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.351+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06280083f0 con 0x55c66f1fc7d0 2024-09-13T06:09:52.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.351+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c66f200430 con 0x7f061801fbe0 2024-09-13T06:09:52.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.351+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06280083f0 con 0x7f061801fbe0 2024-09-13T06:09:52.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.351+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c66f200430 con 0x55c66f201190 2024-09-13T06:09:52.357 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.351+0000 7f062fc8e640 1 -- 172.21.15.194:0/2123890646 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=107b] v26'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f06200ef070 con 0x55c66f201190 2024-09-13T06:09:52.357 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.351+0000 7f062fc8e640 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c66f200430 con 0x7f061801fbe0 2024-09-13T06:09:52.357 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.351+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06280083f0 con 0x7f061801fbe0 2024-09-13T06:09:52.357 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.351+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c66f200430 con 0x7f0620009850 2024-09-13T06:09:52.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.351+0000 7f062f48d640 1 -- 172.21.15.194:0/2123890646 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0618037040 con 0x7f0620009850 2024-09-13T06:09:52.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.351+0000 7f062f48d640 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c66f200430 con 0x55c66f201190 2024-09-13T06:09:52.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.351+0000 7f062fc8e640 1 -- 172.21.15.194:0/2123890646 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06200ef070 con 0x55c66f201190 2024-09-13T06:09:52.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.351+0000 7f062fc8e640 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c66f200430 con 0x7f061801fbe0 2024-09-13T06:09:52.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.351+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06280083f0 con 0x7f061801fbe0 2024-09-13T06:09:52.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.351+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c66f200430 con 0x55c66f1fc7d0 2024-09-13T06:09:52.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.351+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f06280083f0 con 0x55c66f1fc7d0 2024-09-13T06:09:52.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.351+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55c66f200430 con 0x7f0620009850 2024-09-13T06:09:52.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.355+0000 7f062f48d640 1 -- 172.21.15.194:0/2123890646 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0618037040 con 0x7f0620009850 2024-09-13T06:09:52.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.355+0000 7f063217e980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:09:52.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.355+0000 7f063217e980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:09:52.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.355+0000 7f063217e980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:09:52.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.355+0000 7f063217e980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:09:52.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.355+0000 7f063217e980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:09:52.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.355+0000 7f063217e980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:09:52.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.355+0000 7f063217e980 20 rados->read ofs=0 len=0 2024-09-13T06:09:52.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.355+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c66f204550 con 0x55c66f1fc7d0 2024-09-13T06:09:52.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.355+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f06280083f0 con 0x55c66f1fc7d0 2024-09-13T06:09:52.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.355+0000 7f063217e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:52.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.355+0000 7f063217e980 20 rados->read ofs=0 len=0 2024-09-13T06:09:52.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.355+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c66f204da0 con 0x55c66f1fc7d0 2024-09-13T06:09:52.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.355+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f06280083f0 con 0x55c66f1fc7d0 2024-09-13T06:09:52.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.355+0000 7f063217e980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:52.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.355+0000 7f063217e980 20 rados->read ofs=0 len=0 2024-09-13T06:09:52.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.355+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c66f2041b0 con 0x7f0620009850 2024-09-13T06:09:52.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.355+0000 7f062f48d640 1 -- 172.21.15.194:0/2123890646 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0618037040 con 0x7f0620009850 2024-09-13T06:09:52.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.355+0000 7f063217e980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:09:52.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.355+0000 7f063217e980 20 zone default found 2024-09-13T06:09:52.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.355+0000 7f063217e980 4 Realm: () 2024-09-13T06:09:52.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.355+0000 7f063217e980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:09:52.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.355+0000 7f063217e980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:09:52.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.355+0000 7f063217e980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:09:52.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.355+0000 7f063217e980 20 zonegroup default 2024-09-13T06:09:52.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.355+0000 7f063217e980 20 rados->read ofs=0 len=0 2024-09-13T06:09:52.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.355+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c66f205860 con 0x7f061801fbe0 2024-09-13T06:09:52.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.355+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f06280083f0 con 0x7f061801fbe0 2024-09-13T06:09:52.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.355+0000 7f063217e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:52.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.355+0000 7f063217e980 20 rados->read ofs=0 len=0 2024-09-13T06:09:52.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.355+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c66f204a60 con 0x55c66f201190 2024-09-13T06:09:52.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.355+0000 7f062fc8e640 1 -- 172.21.15.194:0/2123890646 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f06200ef070 con 0x55c66f201190 2024-09-13T06:09:52.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.355+0000 7f063217e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:52.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.355+0000 7f063217e980 20 rados->read ofs=0 len=0 2024-09-13T06:09:52.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.355+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c66f2077b0 con 0x55c66f201190 2024-09-13T06:09:52.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.355+0000 7f062fc8e640 1 -- 172.21.15.194:0/2123890646 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f06200ef070 con 0x55c66f201190 2024-09-13T06:09:52.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.355+0000 7f063217e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:52.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.355+0000 7f063217e980 20 started sync module instance, tier type = 2024-09-13T06:09:52.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.355+0000 7f063217e980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:09:52.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.355+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c66f206b80 con 0x7f0620009850 2024-09-13T06:09:52.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.355+0000 7f062f48d640 1 -- 172.21.15.194:0/2123890646 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(44 notify.0 [create] v33'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0618037040 con 0x7f0620009850 2024-09-13T06:09:52.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.359+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94310756282224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c66f2067e0 con 0x7f0620009850 2024-09-13T06:09:52.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.359+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c66f2086e0 con 0x55c66f1fc7d0 2024-09-13T06:09:52.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.359+0000 7f062f48d640 1 -- 172.21.15.194:0/2123890646 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94310756282224] v33'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0618037040 con 0x7f0620009850 2024-09-13T06:09:52.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.359+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v33'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06280083f0 con 0x55c66f1fc7d0 2024-09-13T06:09:52.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.359+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94310756287024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c66f208b00 con 0x55c66f1fc7d0 2024-09-13T06:09:52.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.359+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c66f2093b0 con 0x55c66f201190 2024-09-13T06:09:52.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.363+0000 7f062fc8e640 1 -- 172.21.15.194:0/2123890646 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v33'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06200ef070 con 0x55c66f201190 2024-09-13T06:09:52.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.363+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94310756289584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c66f209c50 con 0x55c66f201190 2024-09-13T06:09:52.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.363+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c66f20a650 con 0x7f0620009850 2024-09-13T06:09:52.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.363+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94310756287024] v33'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06280083f0 con 0x55c66f1fc7d0 2024-09-13T06:09:52.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.363+0000 7f062f48d640 1 -- 172.21.15.194:0/2123890646 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(50 notify.3 [create] v33'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0618037040 con 0x7f0620009850 2024-09-13T06:09:52.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.363+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94310756288080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c66f20aa70 con 0x7f0620009850 2024-09-13T06:09:52.365 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.363+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c66f20b430 con 0x55c66f1fc7d0 2024-09-13T06:09:52.365 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.363+0000 7f062f48d640 1 -- 172.21.15.194:0/2123890646 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94310756288080] v33'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0618037040 con 0x7f0620009850 2024-09-13T06:09:52.366 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.367+0000 7f062fc8e640 1 -- 172.21.15.194:0/2123890646 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94310756289584] v33'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06200ef070 con 0x55c66f201190 2024-09-13T06:09:52.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.367+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v33'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06280083f0 con 0x55c66f1fc7d0 2024-09-13T06:09:52.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.367+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94310756295008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c66f2098b0 con 0x55c66f1fc7d0 2024-09-13T06:09:52.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.367+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c66f20bb70 con 0x7f061801fbe0 2024-09-13T06:09:52.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.367+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94310756295008] v33'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06280083f0 con 0x55c66f1fc7d0 2024-09-13T06:09:52.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.367+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(54 notify.5 [create] v33'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06280083f0 con 0x7f061801fbe0 2024-09-13T06:09:52.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.367+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94310756300320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c66f20bb30 con 0x7f061801fbe0 2024-09-13T06:09:52.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.367+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c66f20c580 con 0x7f061801fbe0 2024-09-13T06:09:52.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.371+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94310756300320] v33'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06280083f0 con 0x7f061801fbe0 2024-09-13T06:09:52.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.371+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(56 notify.6 [create] v33'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06280083f0 con 0x7f061801fbe0 2024-09-13T06:09:52.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.371+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94310756298624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c66f20c580 con 0x7f061801fbe0 2024-09-13T06:09:52.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.371+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c66f20cf40 con 0x7f061801fbe0 2024-09-13T06:09:52.373 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.371+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(58 notify.7 [create] v33'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06280083f0 con 0x7f061801fbe0 2024-09-13T06:09:52.373 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.371+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94310756305552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c66f20d360 con 0x7f061801fbe0 2024-09-13T06:09:52.373 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.371+0000 7f063217e980 20 add_watcher() i=0 2024-09-13T06:09:52.373 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.371+0000 7f063217e980 20 add_watcher() i=1 2024-09-13T06:09:52.374 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.371+0000 7f063217e980 20 add_watcher() i=2 2024-09-13T06:09:52.374 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.371+0000 7f063217e980 20 add_watcher() i=3 2024-09-13T06:09:52.374 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.371+0000 7f063217e980 20 add_watcher() i=4 2024-09-13T06:09:52.374 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.371+0000 7f063217e980 20 add_watcher() i=5 2024-09-13T06:09:52.374 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.371+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94310756298624] v33'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06280083f0 con 0x7f061801fbe0 2024-09-13T06:09:52.374 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.371+0000 7f063217e980 20 add_watcher() i=6 2024-09-13T06:09:52.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.375+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94310756305552] v33'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06280083f0 con 0x7f061801fbe0 2024-09-13T06:09:52.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.375+0000 7f063217e980 20 add_watcher() i=7 2024-09-13T06:09:52.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.375+0000 7f063217e980 2 all 8 watchers are set, enabling cache 2024-09-13T06:09:52.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.375+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c66f20c100 con 0x55c66f1fc7d0 2024-09-13T06:09:52.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.375+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f06280083f0 con 0x55c66f1fc7d0 2024-09-13T06:09:52.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.375+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94310756303056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c66f20d830 con 0x55c66f1fc7d0 2024-09-13T06:09:52.377 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.375+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94310756303056] v33'41 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f06280083f0 con 0x55c66f1fc7d0 2024-09-13T06:09:52.377 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.375+0000 7f04e5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:52.377 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.375+0000 7f063217e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:09:52.377 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.375+0000 7f063217e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:09:52.377 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.375+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c66f218bc0 con 0x55c66f1fc7d0 2024-09-13T06:09:52.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.379+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f06280083f0 con 0x55c66f1fc7d0 2024-09-13T06:09:52.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.379+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c66f219210 con 0x7f061801fbe0 2024-09-13T06:09:52.382 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.379+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'13 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f06280083f0 con 0x7f061801fbe0 2024-09-13T06:09:52.382 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.379+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c66f219670 con 0x55c66f201190 2024-09-13T06:09:52.383 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.383+0000 7f062fc8e640 1 -- 172.21.15.194:0/2123890646 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f06200ef070 con 0x55c66f201190 2024-09-13T06:09:52.383 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.383+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c66f219660 con 0x55c66f1fc7d0 2024-09-13T06:09:52.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.383+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'42 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f06280083f0 con 0x55c66f1fc7d0 2024-09-13T06:09:52.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.383+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c66f219bd0 con 0x7f0620009850 2024-09-13T06:09:52.385 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.383+0000 7f062f48d640 1 -- 172.21.15.194:0/2123890646 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'29 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0618037040 con 0x7f0620009850 2024-09-13T06:09:52.385 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.383+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c66f219ff0 con 0x55c66f201190 2024-09-13T06:09:52.386 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.387+0000 7f062fc8e640 1 -- 172.21.15.194:0/2123890646 <== osd.3 v2:172.21.15.194:6816/96632515 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'19 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f06200ef070 con 0x55c66f201190 2024-09-13T06:09:52.386 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.387+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c66f219ff0 con 0x55c66f1fc7d0 2024-09-13T06:09:52.388 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.387+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f06280083f0 con 0x55c66f1fc7d0 2024-09-13T06:09:52.389 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.387+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c66f21a100 con 0x7f061801fbe0 2024-09-13T06:09:52.391 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.391+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'19 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f06280083f0 con 0x7f061801fbe0 2024-09-13T06:09:52.391 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.391+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c66f21a190 con 0x7f0620009850 2024-09-13T06:09:52.393 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.391+0000 7f062f48d640 1 -- 172.21.15.194:0/2123890646 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0618037040 con 0x7f0620009850 2024-09-13T06:09:52.393 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.391+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c66f21a770 con 0x55c66f201190 2024-09-13T06:09:52.394 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.391+0000 7f062fc8e640 1 -- 172.21.15.194:0/2123890646 <== osd.3 v2:172.21.15.194:6816/96632515 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f06200ef070 con 0x55c66f201190 2024-09-13T06:09:52.394 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.391+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c66f21a770 con 0x7f0620009850 2024-09-13T06:09:52.395 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.395+0000 7f062f48d640 1 -- 172.21.15.194:0/2123890646 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'30 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0618037040 con 0x7f0620009850 2024-09-13T06:09:52.395 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.395+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c66f21ac20 con 0x7f061801fbe0 2024-09-13T06:09:52.397 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.395+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f06280083f0 con 0x7f061801fbe0 2024-09-13T06:09:52.397 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.395+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c66f21ac20 con 0x7f0620009850 2024-09-13T06:09:52.398 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.399+0000 7f062f48d640 1 -- 172.21.15.194:0/2123890646 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0618037040 con 0x7f0620009850 2024-09-13T06:09:52.399 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.399+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c66f21ac20 con 0x7f061801fbe0 2024-09-13T06:09:52.401 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.399+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 <== osd.0 v2:172.21.15.120:6800/1923744619 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'25 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f06280083f0 con 0x7f061801fbe0 2024-09-13T06:09:52.402 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.399+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c66f21ac20 con 0x55c66f1fc7d0 2024-09-13T06:09:52.403 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.403+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'43 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f06280083f0 con 0x55c66f1fc7d0 2024-09-13T06:09:52.403 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.403+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c66f21ac20 con 0x55c66f201190 2024-09-13T06:09:52.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.403+0000 7f062fc8e640 1 -- 172.21.15.194:0/2123890646 <== osd.3 v2:172.21.15.194:6816/96632515 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'23 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f06200ef070 con 0x55c66f201190 2024-09-13T06:09:52.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.403+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c66f21ac20 con 0x7f0620009850 2024-09-13T06:09:52.406 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.403+0000 7f062f48d640 1 -- 172.21.15.194:0/2123890646 <== osd.2 v2:172.21.15.194:6800/815615585 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'31 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0618037040 con 0x7f0620009850 2024-09-13T06:09:52.406 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.403+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c66f21acb0 con 0x55c66f201190 2024-09-13T06:09:52.407 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.407+0000 7f062fc8e640 1 -- 172.21.15.194:0/2123890646 <== osd.3 v2:172.21.15.194:6816/96632515 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'13 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f06200ef070 con 0x55c66f201190 2024-09-13T06:09:52.407 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.407+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c66f21acb0 con 0x55c66f1fc7d0 2024-09-13T06:09:52.410 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.407+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 <== osd.1 v2:172.21.15.194:6808/3135444559 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f06280083f0 con 0x55c66f1fc7d0 2024-09-13T06:09:52.410 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.407+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c66f21acb0 con 0x55c66f1fc7d0 2024-09-13T06:09:52.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.411+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 <== osd.1 v2:172.21.15.194:6808/3135444559 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'44 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f06280083f0 con 0x55c66f1fc7d0 2024-09-13T06:09:52.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.411+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c66f21ac20 con 0x55c66f201190 2024-09-13T06:09:52.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.411+0000 7f062fc8e640 1 -- 172.21.15.194:0/2123890646 <== osd.3 v2:172.21.15.194:6816/96632515 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'24 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f06200ef070 con 0x55c66f201190 2024-09-13T06:09:52.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.411+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c66f21ac20 con 0x7f0620009850 2024-09-13T06:09:52.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.411+0000 7f062f48d640 1 -- 172.21.15.194:0/2123890646 <== osd.2 v2:172.21.15.194:6800/815615585 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'23 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0618037040 con 0x7f0620009850 2024-09-13T06:09:52.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.415+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c66f21ad00 con 0x55c66f201190 2024-09-13T06:09:52.417 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.415+0000 7f062fc8e640 1 -- 172.21.15.194:0/2123890646 <== osd.3 v2:172.21.15.194:6816/96632515 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f06200ef070 con 0x55c66f201190 2024-09-13T06:09:52.417 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.415+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c66f21ad00 con 0x55c66f201190 2024-09-13T06:09:52.417 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.415+0000 7f062fc8e640 1 -- 172.21.15.194:0/2123890646 <== osd.3 v2:172.21.15.194:6816/96632515 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f06200ef070 con 0x55c66f201190 2024-09-13T06:09:52.417 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.415+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c66f21ad00 con 0x55c66f201190 2024-09-13T06:09:52.418 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.419+0000 7f062fc8e640 1 -- 172.21.15.194:0/2123890646 <== osd.3 v2:172.21.15.194:6816/96632515 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'9 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f06200ef070 con 0x55c66f201190 2024-09-13T06:09:52.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.419+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c66f21ad00 con 0x55c66f201190 2024-09-13T06:09:52.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.419+0000 7f062fc8e640 1 -- 172.21.15.194:0/2123890646 <== osd.3 v2:172.21.15.194:6816/96632515 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'20 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f06200ef070 con 0x55c66f201190 2024-09-13T06:09:52.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.419+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c66f21ad00 con 0x7f061801fbe0 2024-09-13T06:09:52.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.419+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 <== osd.0 v2:172.21.15.120:6800/1923744619 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f06280083f0 con 0x7f061801fbe0 2024-09-13T06:09:52.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.419+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c66f21ad00 con 0x55c66f201190 2024-09-13T06:09:52.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.423+0000 7f062fc8e640 1 -- 172.21.15.194:0/2123890646 <== osd.3 v2:172.21.15.194:6816/96632515 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f06200ef070 con 0x55c66f201190 2024-09-13T06:09:52.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.423+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c66f21ad00 con 0x7f061801fbe0 2024-09-13T06:09:52.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.423+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 <== osd.0 v2:172.21.15.120:6800/1923744619 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'20 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f06280083f0 con 0x7f061801fbe0 2024-09-13T06:09:52.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.423+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c66f21ad00 con 0x55c66f201190 2024-09-13T06:09:52.428 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.427+0000 7f062fc8e640 1 -- 172.21.15.194:0/2123890646 <== osd.3 v2:172.21.15.194:6816/96632515 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'25 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f06200ef070 con 0x55c66f201190 2024-09-13T06:09:52.428 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.427+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c66f21ad00 con 0x7f061801fbe0 2024-09-13T06:09:52.430 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.431+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 <== osd.0 v2:172.21.15.120:6800/1923744619 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'26 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f06280083f0 con 0x7f061801fbe0 2024-09-13T06:09:52.431 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.431+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c66f21ad00 con 0x7f0620009850 2024-09-13T06:09:52.432 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.431+0000 7f062f48d640 1 -- 172.21.15.194:0/2123890646 <== osd.2 v2:172.21.15.194:6800/815615585 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0618037040 con 0x7f0620009850 2024-09-13T06:09:52.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.431+0000 7f04e4fe1640 20 reqs_thread_entry: start 2024-09-13T06:09:52.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.431+0000 7f063217e980 20 init_complete bucket index max shards: 11 2024-09-13T06:09:52.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.431+0000 7f063217e980 20 Filter name: none 2024-09-13T06:09:52.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.431+0000 7f045e7fc640 20 reqs_thread_entry: start 2024-09-13T06:09:52.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.431+0000 7f063217e980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T06:09:52.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.431+0000 7f063217e980 20 rados->read ofs=0 len=0 2024-09-13T06:09:52.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.431+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55c66f2362d0 con 0x55c66f1fc7d0 2024-09-13T06:09:52.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.431+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 <== osd.1 v2:172.21.15.194:6808/3135444559 27 ==== osd_op_reply(94 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f06280083f0 con 0x55c66f1fc7d0 2024-09-13T06:09:52.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.431+0000 7f063217e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:52.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.431+0000 7f063217e980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-09-13T06:09:52.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.431+0000 7f063217e980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:09:52.435 INFO:teuthology.orchestra.run.smithi194.stderr:could not remove user: unable to remove user, user does not exist 2024-09-13T06:09:52.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.435+0000 7f04e5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:52.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.435+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94310756303056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c66f215a20 con 0x55c66f1fc7d0 2024-09-13T06:09:52.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.435+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 <== osd.1 v2:172.21.15.194:6808/3135444559 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94310756303056] v33'45 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f06280083f0 con 0x55c66f1fc7d0 2024-09-13T06:09:52.437 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.435+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94310756282224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c66f20c0d0 con 0x7f0620009850 2024-09-13T06:09:52.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.435+0000 7f062f48d640 1 -- 172.21.15.194:0/2123890646 <== osd.2 v2:172.21.15.194:6800/815615585 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94310756282224] v33'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0618037040 con 0x7f0620009850 2024-09-13T06:09:52.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.435+0000 7f063217e980 20 remove_watcher() i=0 2024-09-13T06:09:52.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.435+0000 7f063217e980 2 removed watcher, disabling cache 2024-09-13T06:09:52.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.435+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94310756287024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c66f20c0d0 con 0x55c66f1fc7d0 2024-09-13T06:09:52.440 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.439+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 <== osd.1 v2:172.21.15.194:6808/3135444559 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94310756287024] v33'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06280083f0 con 0x55c66f1fc7d0 2024-09-13T06:09:52.440 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.439+0000 7f063217e980 20 remove_watcher() i=1 2024-09-13T06:09:52.440 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.439+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94310756289584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c66f208230 con 0x55c66f201190 2024-09-13T06:09:52.442 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.443+0000 7f062fc8e640 1 -- 172.21.15.194:0/2123890646 <== osd.3 v2:172.21.15.194:6816/96632515 27 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94310756289584] v33'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06200ef070 con 0x55c66f201190 2024-09-13T06:09:52.442 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.443+0000 7f063217e980 20 remove_watcher() i=2 2024-09-13T06:09:52.443 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.443+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94310756288080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c66f20c0d0 con 0x7f0620009850 2024-09-13T06:09:52.444 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.443+0000 7f062f48d640 1 -- 172.21.15.194:0/2123890646 <== osd.2 v2:172.21.15.194:6800/815615585 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94310756288080] v33'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0618037040 con 0x7f0620009850 2024-09-13T06:09:52.444 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.443+0000 7f063217e980 20 remove_watcher() i=3 2024-09-13T06:09:52.444 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.443+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94310756295008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c66f20c0d0 con 0x55c66f1fc7d0 2024-09-13T06:09:52.446 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.443+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 <== osd.1 v2:172.21.15.194:6808/3135444559 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94310756295008] v33'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06280083f0 con 0x55c66f1fc7d0 2024-09-13T06:09:52.446 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.443+0000 7f063217e980 20 remove_watcher() i=4 2024-09-13T06:09:52.446 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.443+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94310756300320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c66f20a160 con 0x7f061801fbe0 2024-09-13T06:09:52.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.447+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 <== osd.0 v2:172.21.15.120:6800/1923744619 24 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94310756300320] v33'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06280083f0 con 0x7f061801fbe0 2024-09-13T06:09:52.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.447+0000 7f063217e980 20 remove_watcher() i=5 2024-09-13T06:09:52.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.447+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94310756298624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c66f20c0d0 con 0x7f061801fbe0 2024-09-13T06:09:52.451 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.451+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 <== osd.0 v2:172.21.15.120:6800/1923744619 25 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94310756298624] v33'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06280083f0 con 0x7f061801fbe0 2024-09-13T06:09:52.451 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.451+0000 7f063217e980 20 remove_watcher() i=6 2024-09-13T06:09:52.451 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.451+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94310756305552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55c66f20a160 con 0x7f061801fbe0 2024-09-13T06:09:52.455 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.451+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 <== osd.0 v2:172.21.15.120:6800/1923744619 26 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94310756305552] v33'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06280083f0 con 0x7f061801fbe0 2024-09-13T06:09:52.455 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.451+0000 7f063217e980 20 remove_watcher() i=7 2024-09-13T06:09:52.455 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.451+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f061801fbe0 msgr2=0x7f061803a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:52.456 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.451+0000 7f063217e980 1 --2- 172.21.15.194:0/2123890646 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f061801fbe0 0x7f061803a3c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:52.456 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.451+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55c66f1fc7d0 msgr2=0x55c66f1fec90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:52.456 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.451+0000 7f063217e980 1 --2- 172.21.15.194:0/2123890646 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55c66f1fc7d0 0x55c66f1fec90 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:52.456 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.451+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f0620009850 msgr2=0x7f06200af8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:52.456 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.451+0000 7f063217e980 1 --2- 172.21.15.194:0/2123890646 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f0620009850 0x7f06200af8f0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:52.456 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.451+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55c66f201190 msgr2=0x55c66f203580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:52.456 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.451+0000 7f063217e980 1 --2- 172.21.15.194:0/2123890646 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55c66f201190 0x55c66f203580 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:52.456 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.451+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f04f8034750 msgr2=0x7f04f8036c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:52.456 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.451+0000 7f063217e980 1 --2- 172.21.15.194:0/2123890646 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f04f8034750 0x7f04f8036c10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f061800ffd0 tx=0x7f0618010000 comp rx=0 tx=0).stop 2024-09-13T06:09:52.456 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.451+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c66f1ea570 msgr2=0x55c66f1f16d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:52.456 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.451+0000 7f063048f640 1 -- 172.21.15.194:0/2123890646 reap_dead start 2024-09-13T06:09:52.456 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.451+0000 7f063217e980 1 --2- 172.21.15.194:0/2123890646 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c66f1ea570 0x55c66f1f16d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f06200b4c10 tx=0x7f06200ac310 comp rx=0 tx=0).stop 2024-09-13T06:09:52.457 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.451+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 shutdown_connections 2024-09-13T06:09:52.457 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.451+0000 7f063217e980 1 --2- 172.21.15.194:0/2123890646 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c66f1ea570 0x55c66f1f16d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:52.457 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.451+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 >> 172.21.15.194:0/2123890646 conn(0x55c66f1e68f0 msgr2=0x55c66f1e49c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:52.457 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.451+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 shutdown_connections 2024-09-13T06:09:52.457 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.451+0000 7f063217e980 1 -- 172.21.15.194:0/2123890646 wait complete. 2024-09-13T06:09:52.457 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.451+0000 7f063217e980 1 -- 172.21.15.194:0/4140909175 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0508034650 msgr2=0x7f0508036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:52.457 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.451+0000 7f063217e980 1 --2- 172.21.15.194:0/4140909175 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0508034650 0x7f0508036b10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x55c66f1c7790 tx=0x7f061800f000 comp rx=0 tx=0).stop 2024-09-13T06:09:52.457 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.451+0000 7f063217e980 1 -- 172.21.15.194:0/4140909175 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c66f1ddb50 msgr2=0x55c66f1ddf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:52.457 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.451+0000 7f063217e980 1 --2- 172.21.15.194:0/4140909175 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c66f1ddb50 0x55c66f1ddf70 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f06200bdde0 tx=0x7f06200c6e70 comp rx=0 tx=0).stop 2024-09-13T06:09:52.457 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.451+0000 7f063217e980 1 -- 172.21.15.194:0/4140909175 shutdown_connections 2024-09-13T06:09:52.457 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.451+0000 7f063217e980 1 --2- 172.21.15.194:0/4140909175 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0508034650 0x7f0508036b10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:52.457 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.451+0000 7f063217e980 1 --2- 172.21.15.194:0/4140909175 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c66f1ddb50 0x55c66f1ddf70 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:52.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.451+0000 7f063217e980 1 -- 172.21.15.194:0/4140909175 >> 172.21.15.194:0/4140909175 conn(0x55c66f1d2ca0 msgr2=0x55c66f1d5720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:52.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.455+0000 7f063217e980 1 -- 172.21.15.194:0/4140909175 shutdown_connections 2024-09-13T06:09:52.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.455+0000 7f063217e980 1 -- 172.21.15.194:0/4140909175 wait complete. 2024-09-13T06:09:52.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.455+0000 7f063217e980 1 -- 172.21.15.194:0/1646038373 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55c66f0cc3e0 msgr2=0x55c66f1c6d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:52.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.455+0000 7f063217e980 1 --2- 172.21.15.194:0/1646038373 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55c66f0cc3e0 0x55c66f1c6d90 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:52.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.455+0000 7f063217e980 1 -- 172.21.15.194:0/1646038373 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55c66f1cd550 msgr2=0x55c66f1cf940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:52.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.455+0000 7f063217e980 1 --2- 172.21.15.194:0/1646038373 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55c66f1cd550 0x55c66f1cf940 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:52.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.455+0000 7f063217e980 1 -- 172.21.15.194:0/1646038373 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55c66f1c9610 msgr2=0x55c66f1cba00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:52.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.455+0000 7f063217e980 1 --2- 172.21.15.194:0/1646038373 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55c66f1c9610 0x55c66f1cba00 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:52.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.455+0000 7f063217e980 1 -- 172.21.15.194:0/1646038373 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0518034650 msgr2=0x7f0518036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:52.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.455+0000 7f063217e980 1 --2- 172.21.15.194:0/1646038373 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0518034650 0x7f0518036b10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0618000f70 tx=0x7f0618001380 comp rx=0 tx=0).stop 2024-09-13T06:09:52.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.455+0000 7f063217e980 1 -- 172.21.15.194:0/1646038373 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c66f0cbac0 msgr2=0x55c66f1bfc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:52.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.455+0000 7f063217e980 1 --2- 172.21.15.194:0/1646038373 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c66f0cbac0 0x55c66f1bfc90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0620005cc0 tx=0x7f0620017e30 comp rx=0 tx=0).stop 2024-09-13T06:09:52.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.455+0000 7f063048f640 1 -- 172.21.15.194:0/1646038373 reap_dead start 2024-09-13T06:09:52.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.455+0000 7f063217e980 1 -- 172.21.15.194:0/1646038373 shutdown_connections 2024-09-13T06:09:52.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.455+0000 7f063217e980 1 -- 172.21.15.194:0/1646038373 >> 172.21.15.194:0/1646038373 conn(0x55c66f0c77a0 msgr2=0x55c66f1b31f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:52.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.455+0000 7f063217e980 1 -- 172.21.15.194:0/1646038373 shutdown_connections 2024-09-13T06:09:52.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.455+0000 7f063217e980 1 -- 172.21.15.194:0/1646038373 wait complete. 2024-09-13T06:09:52.466 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-13T06:09:52.466 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-13T06:09:52.466 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-13T06:09:52.467 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-09-13T06:09:52.553 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:09:52.554 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:09:52.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.551+0000 7f6e386ae980 1 Processor -- start 2024-09-13T06:09:52.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.551+0000 7f6e386ae980 1 -- start start 2024-09-13T06:09:52.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.551+0000 7f6e386ae980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x558b369a23c0 0x558b36a30320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.551+0000 7f6e386ae980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558b368b5ae0 con 0x558b36a30860 2024-09-13T06:09:52.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.551+0000 7f6e386ae980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x558b368d9e30 con 0x558b369a23c0 2024-09-13T06:09:52.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.555+0000 7f6e361be640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x558b369a23c0 0x558b36a30320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.555+0000 7f6e359bd640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x558b36a30860 0x558b36a32c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:50886/0 (socket says 172.21.15.194:50886) 2024-09-13T06:09:52.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.555+0000 7f6e359bd640 1 -- 172.21.15.194:0/3881583478 learned_addr learned my addr 172.21.15.194:0/3881583478 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-09-13T06:09:52.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.555+0000 7f6e361be640 1 -- 172.21.15.194:0/3881583478 >> v1:172.21.15.120:6789/0 conn(0x558b36a30860 legacy=0x558b36a32c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:52.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.555+0000 7f6e361be640 1 -- 172.21.15.194:0/3881583478 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b36a35380 con 0x558b369a23c0 2024-09-13T06:09:52.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.555+0000 7f6e361be640 1 --2- 172.21.15.194:0/3881583478 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558b369a23c0 0x558b36a30320 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6e3000a480 tx=0x7f6e3001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=560dd533741a5a41 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.555+0000 7f6e351bc640 1 -- 172.21.15.194:0/3881583478 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e300b0070 con 0x558b369a23c0 2024-09-13T06:09:52.560 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.555+0000 7f6e351bc640 1 -- 172.21.15.194:0/3881583478 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e300ab540 con 0x558b369a23c0 2024-09-13T06:09:52.560 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.555+0000 7f6e351bc640 1 -- 172.21.15.194:0/3881583478 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e300ab840 con 0x558b369a23c0 2024-09-13T06:09:52.560 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.559+0000 7f6e386ae980 1 -- 172.21.15.194:0/3881583478 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558b369a23c0 msgr2=0x558b36a30320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:52.560 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.559+0000 7f6e386ae980 1 --2- 172.21.15.194:0/3881583478 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558b369a23c0 0x558b36a30320 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6e3000a480 tx=0x7f6e3001b280 comp rx=0 tx=0).stop 2024-09-13T06:09:52.560 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.559+0000 7f6e386ae980 1 -- 172.21.15.194:0/3881583478 shutdown_connections 2024-09-13T06:09:52.560 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.559+0000 7f6e386ae980 1 --2- 172.21.15.194:0/3881583478 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558b369a23c0 0x558b36a30320 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:52.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.559+0000 7f6e386ae980 1 -- 172.21.15.194:0/3881583478 >> 172.21.15.194:0/3881583478 conn(0x558b36a28050 msgr2=0x558b36a2a470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:52.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.559+0000 7f6e386ae980 1 -- 172.21.15.194:0/3881583478 shutdown_connections 2024-09-13T06:09:52.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.559+0000 7f6e386ae980 1 -- 172.21.15.194:0/3881583478 wait complete. 2024-09-13T06:09:52.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.575+0000 7f6e386ae980 1 Processor -- start 2024-09-13T06:09:52.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.575+0000 7f6e386ae980 1 -- start start 2024-09-13T06:09:52.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.575+0000 7f6e386ae980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558b369a23c0 0x558b36a2da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.575+0000 7f6e386ae980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x558b368db200 con 0x558b369a23c0 2024-09-13T06:09:52.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.575+0000 7f6e361be640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558b369a23c0 0x558b36a2da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.575+0000 7f6e361be640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558b369a23c0 0x558b36a2da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:43878/0 (socket says 172.21.15.194:43878) 2024-09-13T06:09:52.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.575+0000 7f6e361be640 1 -- 172.21.15.194:0/974622153 learned_addr learned my addr 172.21.15.194:0/974622153 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:52.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.575+0000 7f6e361be640 1 -- 172.21.15.194:0/974622153 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b36a2e050 con 0x558b369a23c0 2024-09-13T06:09:52.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.575+0000 7f6e361be640 1 --2- 172.21.15.194:0/974622153 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558b369a23c0 0x558b36a2da80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6e300ae040 tx=0x7f6e30003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e76c32ab433dcbe server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.575+0000 7f6d24608640 1 -- 172.21.15.194:0/974622153 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e300b0040 con 0x558b369a23c0 2024-09-13T06:09:52.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.575+0000 7f6d24608640 1 -- 172.21.15.194:0/974622153 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e300ab9d0 con 0x558b369a23c0 2024-09-13T06:09:52.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.575+0000 7f6d24608640 1 -- 172.21.15.194:0/974622153 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e300abcf0 con 0x558b369a23c0 2024-09-13T06:09:52.594 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.575+0000 7f6e386ae980 1 -- 172.21.15.194:0/974622153 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558b369a23c0 msgr2=0x558b36a2da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:52.594 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.575+0000 7f6e386ae980 1 --2- 172.21.15.194:0/974622153 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558b369a23c0 0x558b36a2da80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6e300ae040 tx=0x7f6e30003030 comp rx=0 tx=0).stop 2024-09-13T06:09:52.594 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.575+0000 7f6e386ae980 1 -- 172.21.15.194:0/974622153 shutdown_connections 2024-09-13T06:09:52.594 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.575+0000 7f6e386ae980 1 --2- 172.21.15.194:0/974622153 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558b369a23c0 0x558b36a2da80 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:52.594 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.575+0000 7f6e386ae980 1 -- 172.21.15.194:0/974622153 >> 172.21.15.194:0/974622153 conn(0x558b36a28050 msgr2=0x558b36b14720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:52.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.575+0000 7f6e386ae980 1 -- 172.21.15.194:0/974622153 shutdown_connections 2024-09-13T06:09:52.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.575+0000 7f6e386ae980 1 -- 172.21.15.194:0/974622153 wait complete. 2024-09-13T06:09:52.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.575+0000 7f6e386ae980 1 Processor -- start 2024-09-13T06:09:52.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.575+0000 7f6e386ae980 1 -- start start 2024-09-13T06:09:52.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.575+0000 7f6e386ae980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558b369a23c0 0x558b36b21f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.575+0000 7f6e386ae980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x558b36a34df0 con 0x558b369a23c0 2024-09-13T06:09:52.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.575+0000 7f6e361be640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558b369a23c0 0x558b36b21f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.575+0000 7f6e361be640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558b369a23c0 0x558b36b21f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:43888/0 (socket says 172.21.15.194:43888) 2024-09-13T06:09:52.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.575+0000 7f6e361be640 1 -- 172.21.15.194:0/815890779 learned_addr learned my addr 172.21.15.194:0/815890779 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:52.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.579+0000 7f6e361be640 1 -- 172.21.15.194:0/815890779 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b36b224b0 con 0x558b369a23c0 2024-09-13T06:09:52.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.579+0000 7f6e361be640 1 --2- 172.21.15.194:0/815890779 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558b369a23c0 0x558b36b21f70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6e30019930 tx=0x7f6e30018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.579+0000 7f6d22e05640 1 -- 172.21.15.194:0/815890779 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e300b0070 con 0x558b369a23c0 2024-09-13T06:09:52.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.579+0000 7f6e386ae980 1 -- 172.21.15.194:0/815890779 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558b36b22740 con 0x558b369a23c0 2024-09-13T06:09:52.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.579+0000 7f6d22e05640 1 -- 172.21.15.194:0/815890779 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e300b68b0 con 0x558b369a23c0 2024-09-13T06:09:52.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.579+0000 7f6d22e05640 1 -- 172.21.15.194:0/815890779 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e300b6b90 con 0x558b369a23c0 2024-09-13T06:09:52.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.579+0000 7f6e386ae980 1 -- 172.21.15.194:0/815890779 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b36b25420 con 0x558b369a23c0 2024-09-13T06:09:52.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.579+0000 7f6e386ae980 1 Processor -- start 2024-09-13T06:09:52.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.579+0000 7f6e386ae980 1 -- start start 2024-09-13T06:09:52.598 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.579+0000 7f6e386ae980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558b36b2ecb0 0x558b36b2f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.598 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.579+0000 7f6e386ae980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x558b36934800 con 0x558b36b2ecb0 2024-09-13T06:09:52.598 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.579+0000 7f6d22e05640 1 -- 172.21.15.194:0/815890779 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6e300bf3f0 con 0x558b369a23c0 2024-09-13T06:09:52.598 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.579+0000 7f6e369bf640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558b36b2ecb0 0x558b36b2f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.598 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.579+0000 7f6e369bf640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558b36b2ecb0 0x558b36b2f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:43890/0 (socket says 172.21.15.194:43890) 2024-09-13T06:09:52.598 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.579+0000 7f6e369bf640 1 -- 172.21.15.194:0/3024987820 learned_addr learned my addr 172.21.15.194:0/3024987820 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:52.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.579+0000 7f6d22e05640 1 --2- 172.21.15.194:0/815890779 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6d1c034650 0x7f6d1c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.579+0000 7f6d22e05640 1 -- 172.21.15.194:0/815890779 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f6e300bc070 con 0x558b369a23c0 2024-09-13T06:09:52.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.579+0000 7f6e361be640 1 --2- 172.21.15.194:0/815890779 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6d1c034650 0x7f6d1c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.579+0000 7f6e369bf640 1 -- 172.21.15.194:0/3024987820 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b36b2f5f0 con 0x558b36b2ecb0 2024-09-13T06:09:52.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.579+0000 7f6e369bf640 1 --2- 172.21.15.194:0/3024987820 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558b36b2ecb0 0x558b36b2f0b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6e2800a440 tx=0x7f6e2800a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9027f9542063346 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.579+0000 7f6e361be640 1 --2- 172.21.15.194:0/815890779 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6d1c034650 0x7f6d1c036b10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6e300b5760 tx=0x7f6e30006390 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.579+0000 7f6d20e01640 1 -- 172.21.15.194:0/3024987820 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e28008850 con 0x558b36b2ecb0 2024-09-13T06:09:52.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.579+0000 7f6d20e01640 1 -- 172.21.15.194:0/3024987820 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e28008a10 con 0x558b36b2ecb0 2024-09-13T06:09:52.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.579+0000 7f6d20e01640 1 -- 172.21.15.194:0/3024987820 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e28008d30 con 0x558b36b2ecb0 2024-09-13T06:09:52.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.583+0000 7f6e386ae980 1 -- 172.21.15.194:0/3024987820 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558b36b2ecb0 msgr2=0x558b36b2f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:52.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.583+0000 7f6e386ae980 1 --2- 172.21.15.194:0/3024987820 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558b36b2ecb0 0x558b36b2f0b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6e2800a440 tx=0x7f6e2800a900 comp rx=0 tx=0).stop 2024-09-13T06:09:52.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.583+0000 7f6e386ae980 1 -- 172.21.15.194:0/3024987820 shutdown_connections 2024-09-13T06:09:52.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.583+0000 7f6e386ae980 1 --2- 172.21.15.194:0/3024987820 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558b36b2ecb0 0x558b36b2f0b0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:52.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.583+0000 7f6e386ae980 1 -- 172.21.15.194:0/3024987820 >> 172.21.15.194:0/3024987820 conn(0x558b36a30860 msgr2=0x558b36b2a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:52.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.583+0000 7f6e386ae980 1 -- 172.21.15.194:0/3024987820 shutdown_connections 2024-09-13T06:09:52.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.583+0000 7f6e386ae980 1 -- 172.21.15.194:0/3024987820 wait complete. 2024-09-13T06:09:52.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.583+0000 7f6e386ae980 1 Processor -- start 2024-09-13T06:09:52.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.583+0000 7f6e386ae980 1 -- start start 2024-09-13T06:09:52.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.583+0000 7f6e386ae980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558b36b2ecb0 0x558b36b36040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.583+0000 7f6e386ae980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x558b36b2ffd0 con 0x558b36b2ecb0 2024-09-13T06:09:52.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.583+0000 7f6e369bf640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558b36b2ecb0 0x558b36b36040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.583+0000 7f6e369bf640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558b36b2ecb0 0x558b36b36040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:43894/0 (socket says 172.21.15.194:43894) 2024-09-13T06:09:52.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.583+0000 7f6e369bf640 1 -- 172.21.15.194:0/1693670253 learned_addr learned my addr 172.21.15.194:0/1693670253 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:52.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.583+0000 7f6e369bf640 1 -- 172.21.15.194:0/1693670253 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b36b36580 con 0x558b36b2ecb0 2024-09-13T06:09:52.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.583+0000 7f6e369bf640 1 --2- 172.21.15.194:0/1693670253 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558b36b2ecb0 0x558b36b36040 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x558b36b2fa60 tx=0x7f6e28003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.583+0000 7f6d1affd640 1 -- 172.21.15.194:0/1693670253 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e28013a70 con 0x558b36b2ecb0 2024-09-13T06:09:52.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.583+0000 7f6e386ae980 1 -- 172.21.15.194:0/1693670253 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558b36b36810 con 0x558b36b2ecb0 2024-09-13T06:09:52.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.583+0000 7f6e386ae980 1 -- 172.21.15.194:0/1693670253 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b36b394f0 con 0x558b36b2ecb0 2024-09-13T06:09:52.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.583+0000 7f6d1affd640 1 -- 172.21.15.194:0/1693670253 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e28023070 con 0x558b36b2ecb0 2024-09-13T06:09:52.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.583+0000 7f6d1affd640 1 -- 172.21.15.194:0/1693670253 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e28013c10 con 0x558b36b2ecb0 2024-09-13T06:09:52.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.583+0000 7f6d1affd640 1 -- 172.21.15.194:0/1693670253 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6e28028460 con 0x558b36b2ecb0 2024-09-13T06:09:52.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.583+0000 7f6e386ae980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:09:52.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.583+0000 7f6e386ae980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:09:52.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.587+0000 7f6d1affd640 1 --2- 172.21.15.194:0/1693670253 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6d10034650 0x7f6d10036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.587+0000 7f6d1affd640 1 -- 172.21.15.194:0/1693670253 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f6e28049e80 con 0x558b36b2ecb0 2024-09-13T06:09:52.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.587+0000 7f6e386ae980 1 Processor -- start 2024-09-13T06:09:52.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.587+0000 7f6e369bf640 1 --2- 172.21.15.194:0/1693670253 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6d10034650 0x7f6d10036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.587+0000 7f6e386ae980 1 -- start start 2024-09-13T06:09:52.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.587+0000 7f6e386ae980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558b36b4f900 0x558b36b4fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.587+0000 7f6e386ae980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x558b36a2c1b0 con 0x558b36b4f900 2024-09-13T06:09:52.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.587+0000 7f6e369bf640 1 --2- 172.21.15.194:0/1693670253 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6d10034650 0x7f6d10036b10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6e28028770 tx=0x7f6e28005660 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.587+0000 7f6e361be640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558b36b4f900 0x558b36b4fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.587+0000 7f6e361be640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558b36b4f900 0x558b36b4fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:43910/0 (socket says 172.21.15.194:43910) 2024-09-13T06:09:52.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.587+0000 7f6e361be640 1 -- 172.21.15.194:0/1404787647 learned_addr learned my addr 172.21.15.194:0/1404787647 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:52.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.587+0000 7f6e361be640 1 -- 172.21.15.194:0/1404787647 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b36b502f0 con 0x558b36b4f900 2024-09-13T06:09:52.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.587+0000 7f6e361be640 1 --2- 172.21.15.194:0/1404787647 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558b36b4f900 0x558b36b4fd20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6e300e2c60 tx=0x7f6e300e2bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.587+0000 7f6cfafe5640 1 -- 172.21.15.194:0/1404787647 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e300e9070 con 0x558b36b4f900 2024-09-13T06:09:52.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.587+0000 7f6e386ae980 1 -- 172.21.15.194:0/1404787647 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558b36b52ef0 con 0x558b36b4f900 2024-09-13T06:09:52.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.587+0000 7f6cfafe5640 1 -- 172.21.15.194:0/1404787647 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e300e49d0 con 0x558b36b4f900 2024-09-13T06:09:52.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.587+0000 7f6cfafe5640 1 -- 172.21.15.194:0/1404787647 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e300e4cd0 con 0x558b36b4f900 2024-09-13T06:09:52.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.587+0000 7f6e386ae980 1 -- 172.21.15.194:0/1404787647 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b36b532a0 con 0x558b36b4f900 2024-09-13T06:09:52.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.587+0000 7f6cfafe5640 1 -- 172.21.15.194:0/1404787647 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6e300ec070 con 0x558b36b4f900 2024-09-13T06:09:52.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.587+0000 7f6cfafe5640 1 --2- 172.21.15.194:0/1404787647 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6c78034650 0x7f6c78036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.587+0000 7f6cfafe5640 1 -- 172.21.15.194:0/1404787647 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f6e300a8070 con 0x558b36b4f900 2024-09-13T06:09:52.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.587+0000 7f6e359bd640 1 --2- 172.21.15.194:0/1404787647 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6c78034650 0x7f6c78036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.591+0000 7f6cf8fe1640 20 reqs_thread_entry: start 2024-09-13T06:09:52.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.591+0000 7f6e386ae980 1 --2- 172.21.15.194:0/815890779 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x558b36b554c0 0x558b36b578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.591+0000 7f6e359bd640 1 --2- 172.21.15.194:0/1404787647 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6c78034650 0x7f6c78036b10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6e200012f0 tx=0x7f6e20006680 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.591+0000 7f6e386ae980 1 -- 172.21.15.194:0/815890779 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558b36b57f80 con 0x558b36b554c0 2024-09-13T06:09:52.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.591+0000 7f6e369bf640 1 --2- 172.21.15.194:0/815890779 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x558b36b554c0 0x558b36b578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.591+0000 7f6e369bf640 1 --2- 172.21.15.194:0/815890779 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x558b36b554c0 0x558b36b578b0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.591+0000 7f6e369bf640 1 -- 172.21.15.194:0/815890779 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6e2803a040 con 0x558b36b554c0 2024-09-13T06:09:52.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.591+0000 7f6e386ae980 1 --2- 172.21.15.194:0/815890779 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x558b36b59d50 0x558b36b5c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.591+0000 7f6e386ae980 1 -- 172.21.15.194:0/815890779 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:2 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558b36b5c7a0 con 0x558b36b59d50 2024-09-13T06:09:52.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.591+0000 7f6e361be640 1 --2- 172.21.15.194:0/815890779 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x558b36b59d50 0x558b36b5c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.591+0000 7f6e361be640 1 --2- 172.21.15.194:0/815890779 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x558b36b59d50 0x558b36b5c140 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.591+0000 7f6e361be640 1 -- 172.21.15.194:0/815890779 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(2 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6e300eb030 con 0x558b36b59d50 2024-09-13T06:09:52.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.591+0000 7f6e386ae980 1 -- 172.21.15.194:0/815890779 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558b36b61510 con 0x558b36b59d50 2024-09-13T06:09:52.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.595+0000 7f6e361be640 1 -- 172.21.15.194:0/815890779 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [stat,call,call,writefull 0~993] v33'2 uv2 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7f6e300eb030 con 0x558b36b59d50 2024-09-13T06:09:52.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.595+0000 7f6e386ae980 1 -- 172.21.15.194:0/1693670253 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6d10034650 msgr2=0x7f6d10036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:52.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.595+0000 7f6e386ae980 1 --2- 172.21.15.194:0/1693670253 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6d10034650 0x7f6d10036b10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6e28028770 tx=0x7f6e28005660 comp rx=0 tx=0).stop 2024-09-13T06:09:52.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.595+0000 7f6e386ae980 1 -- 172.21.15.194:0/1693670253 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558b36b2ecb0 msgr2=0x558b36b36040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:52.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.595+0000 7f6e386ae980 1 --2- 172.21.15.194:0/1693670253 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558b36b2ecb0 0x558b36b36040 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x558b36b2fa60 tx=0x7f6e28003000 comp rx=0 tx=0).stop 2024-09-13T06:09:52.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.595+0000 7f6e386ae980 1 -- 172.21.15.194:0/1693670253 shutdown_connections 2024-09-13T06:09:52.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.595+0000 7f6e386ae980 1 --2- 172.21.15.194:0/1693670253 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6d10034650 0x7f6d10036b10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:52.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.595+0000 7f6e386ae980 1 --2- 172.21.15.194:0/1693670253 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558b36b2ecb0 0x558b36b36040 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:52.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.595+0000 7f6e386ae980 1 -- 172.21.15.194:0/1693670253 >> 172.21.15.194:0/1693670253 conn(0x558b36a30860 msgr2=0x558b36b2a130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:52.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.595+0000 7f6e386ae980 1 -- 172.21.15.194:0/1693670253 shutdown_connections 2024-09-13T06:09:52.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.595+0000 7f6e386ae980 1 -- 172.21.15.194:0/1693670253 wait complete. 2024-09-13T06:09:52.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.595+0000 7f6e386ae980 1 -- 172.21.15.194:0/1404787647 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6c78034650 msgr2=0x7f6c78036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:52.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.595+0000 7f6e386ae980 1 --2- 172.21.15.194:0/1404787647 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6c78034650 0x7f6c78036b10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6e200012f0 tx=0x7f6e20006680 comp rx=0 tx=0).stop 2024-09-13T06:09:52.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.595+0000 7f6e386ae980 1 -- 172.21.15.194:0/1404787647 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558b36b4f900 msgr2=0x558b36b4fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:52.620 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.595+0000 7f6e386ae980 1 --2- 172.21.15.194:0/1404787647 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558b36b4f900 0x558b36b4fd20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6e300e2c60 tx=0x7f6e300e2bc0 comp rx=0 tx=0).stop 2024-09-13T06:09:52.620 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.595+0000 7f6e386ae980 1 -- 172.21.15.194:0/1404787647 shutdown_connections 2024-09-13T06:09:52.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.595+0000 7f6e386ae980 1 --2- 172.21.15.194:0/1404787647 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6c78034650 0x7f6c78036b10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:52.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.595+0000 7f6e386ae980 1 --2- 172.21.15.194:0/1404787647 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558b36b4f900 0x558b36b4fd20 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:52.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.595+0000 7f6e386ae980 1 -- 172.21.15.194:0/1404787647 >> 172.21.15.194:0/1404787647 conn(0x558b36b44930 msgr2=0x558b36b47220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:52.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.595+0000 7f6e386ae980 1 -- 172.21.15.194:0/1404787647 shutdown_connections 2024-09-13T06:09:52.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.595+0000 7f6e386ae980 1 -- 172.21.15.194:0/1404787647 wait complete. 2024-09-13T06:09:52.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.595+0000 7f6e386ae980 1 -- 172.21.15.194:0/815890779 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x558b36b554c0 msgr2=0x558b36b578b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:52.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.595+0000 7f6e386ae980 1 --2- 172.21.15.194:0/815890779 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x558b36b554c0 0x558b36b578b0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:52.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.595+0000 7f6e386ae980 1 -- 172.21.15.194:0/815890779 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x558b36b59d50 msgr2=0x558b36b5c140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:52.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.595+0000 7f6e386ae980 1 --2- 172.21.15.194:0/815890779 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x558b36b59d50 0x558b36b5c140 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:52.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.595+0000 7f6e386ae980 1 -- 172.21.15.194:0/815890779 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6d1c034650 msgr2=0x7f6d1c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:52.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.595+0000 7f6e386ae980 1 --2- 172.21.15.194:0/815890779 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6d1c034650 0x7f6d1c036b10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6e300b5760 tx=0x7f6e30006390 comp rx=0 tx=0).stop 2024-09-13T06:09:52.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.595+0000 7f6e386ae980 1 -- 172.21.15.194:0/815890779 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558b369a23c0 msgr2=0x558b36b21f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:52.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.595+0000 7f6e386ae980 1 --2- 172.21.15.194:0/815890779 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558b369a23c0 0x558b36b21f70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6e30019930 tx=0x7f6e30018020 comp rx=0 tx=0).stop 2024-09-13T06:09:52.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.595+0000 7f6e386ae980 1 -- 172.21.15.194:0/815890779 shutdown_connections 2024-09-13T06:09:52.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.595+0000 7f6e386ae980 1 --2- 172.21.15.194:0/815890779 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x558b36b59d50 0x558b36b5c140 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:52.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.595+0000 7f6e386ae980 1 --2- 172.21.15.194:0/815890779 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x558b36b554c0 0x558b36b578b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:52.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.595+0000 7f6e386ae980 1 --2- 172.21.15.194:0/815890779 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6d1c034650 0x7f6d1c036b10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:52.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.595+0000 7f6e386ae980 1 --2- 172.21.15.194:0/815890779 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558b369a23c0 0x558b36b21f70 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:52.624 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.595+0000 7f6e386ae980 1 -- 172.21.15.194:0/815890779 >> 172.21.15.194:0/815890779 conn(0x558b36a28050 msgr2=0x558b36b14360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:52.624 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.595+0000 7f6e386ae980 1 -- 172.21.15.194:0/815890779 shutdown_connections 2024-09-13T06:09:52.624 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.595+0000 7f6e386ae980 1 -- 172.21.15.194:0/815890779 wait complete. 2024-09-13T06:09:52.625 INFO:teuthology.orchestra.run.smithi194.stdout:{"id":"52d5ffc2-b91b-4558-98ea-6defdf5151d8","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-13T06:09:52.626 DEBUG:tasks.util.rgw: json result: {'id': '52d5ffc2-b91b-4558-98ea-6defdf5151d8', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-13T06:09:52.628 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-09-13T06:09:52.629 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-09-13T06:09:52.629 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-09-13T06:09:52.703 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:09:52.704 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:09:52.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.703+0000 7ffbed5c0980 1 Processor -- start 2024-09-13T06:09:52.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.703+0000 7ffbed5c0980 1 -- start start 2024-09-13T06:09:52.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.703+0000 7ffbed5c0980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55f33c95d2c0 0x55f33c9ed750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.703+0000 7ffbed5c0980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f33c870ae0 con 0x55f33c9edc90 2024-09-13T06:09:52.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.703+0000 7ffbed5c0980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x55f33c894e30 con 0x55f33c95d2c0 2024-09-13T06:09:52.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.703+0000 7ffbeb0d0640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55f33c95d2c0 0x55f33c9ed750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.703+0000 7ffbea8cf640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x55f33c9edc90 0x55f33c9f0080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:50896/0 (socket says 172.21.15.194:50896) 2024-09-13T06:09:52.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.703+0000 7ffbeb0d0640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55f33c95d2c0 0x55f33c9ed750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:43926/0 (socket says 172.21.15.194:43926) 2024-09-13T06:09:52.708 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.703+0000 7ffbea8cf640 1 -- 172.21.15.194:0/2980908003 learned_addr learned my addr 172.21.15.194:0/2980908003 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-09-13T06:09:52.708 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.703+0000 7ffbeb0d0640 1 -- 172.21.15.194:0/2980908003 >> v1:172.21.15.120:6789/0 conn(0x55f33c9edc90 legacy=0x55f33c9f0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:52.708 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.703+0000 7ffbeb0d0640 1 -- 172.21.15.194:0/2980908003 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f33c95d6a0 con 0x55f33c95d2c0 2024-09-13T06:09:52.710 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.707+0000 7ffbeb0d0640 1 --2- 172.21.15.194:0/2980908003 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f33c95d2c0 0x55f33c9ed750 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc00a480 tx=0x7ffbdc01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30ff4c254dc3e8e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.710 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.707+0000 7ffbea0ce640 1 -- 172.21.15.194:0/2980908003 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbdc0b0070 con 0x55f33c95d2c0 2024-09-13T06:09:52.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.707+0000 7ffbea0ce640 1 -- 172.21.15.194:0/2980908003 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbdc0ab540 con 0x55f33c95d2c0 2024-09-13T06:09:52.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.707+0000 7ffbea0ce640 1 -- 172.21.15.194:0/2980908003 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbdc0ab840 con 0x55f33c95d2c0 2024-09-13T06:09:52.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.707+0000 7ffbed5c0980 1 -- 172.21.15.194:0/2980908003 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f33c95d2c0 msgr2=0x55f33c9ed750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:52.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.707+0000 7ffbed5c0980 1 --2- 172.21.15.194:0/2980908003 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f33c95d2c0 0x55f33c9ed750 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc00a480 tx=0x7ffbdc01b280 comp rx=0 tx=0).stop 2024-09-13T06:09:52.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.707+0000 7ffbed5c0980 1 -- 172.21.15.194:0/2980908003 shutdown_connections 2024-09-13T06:09:52.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.707+0000 7ffbed5c0980 1 --2- 172.21.15.194:0/2980908003 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f33c95d2c0 0x55f33c9ed750 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:52.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.707+0000 7ffbed5c0980 1 -- 172.21.15.194:0/2980908003 >> 172.21.15.194:0/2980908003 conn(0x55f33c9e3080 msgr2=0x55f33c9e54a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:52.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.707+0000 7ffbed5c0980 1 -- 172.21.15.194:0/2980908003 shutdown_connections 2024-09-13T06:09:52.712 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.707+0000 7ffbed5c0980 1 -- 172.21.15.194:0/2980908003 wait complete. 2024-09-13T06:09:52.730 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.723+0000 7ffbed5c0980 1 Processor -- start 2024-09-13T06:09:52.731 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.723+0000 7ffbed5c0980 1 -- start start 2024-09-13T06:09:52.731 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.723+0000 7ffbed5c0980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f33c95d2c0 0x55f33cad5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.731 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.723+0000 7ffbed5c0980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55f33c896200 con 0x55f33c95d2c0 2024-09-13T06:09:52.731 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.723+0000 7ffbeb0d0640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f33c95d2c0 0x55f33cad5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.731 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.723+0000 7ffbeb0d0640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f33c95d2c0 0x55f33cad5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:43934/0 (socket says 172.21.15.194:43934) 2024-09-13T06:09:52.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.723+0000 7ffbeb0d0640 1 -- 172.21.15.194:0/2138304227 learned_addr learned my addr 172.21.15.194:0/2138304227 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:52.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.723+0000 7ffbeb0d0640 1 -- 172.21.15.194:0/2138304227 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f33cad6200 con 0x55f33c95d2c0 2024-09-13T06:09:52.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.723+0000 7ffbeb0d0640 1 --2- 172.21.15.194:0/2138304227 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f33c95d2c0 0x55f33cad5c30 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc017e90 tx=0x7ffbdc003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37edbf71d3b1699f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.727+0000 7ffad960a640 1 -- 172.21.15.194:0/2138304227 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbdc0b0040 con 0x55f33c95d2c0 2024-09-13T06:09:52.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.727+0000 7ffad960a640 1 -- 172.21.15.194:0/2138304227 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbdc0ab9d0 con 0x55f33c95d2c0 2024-09-13T06:09:52.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.727+0000 7ffad960a640 1 -- 172.21.15.194:0/2138304227 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbdc0abcf0 con 0x55f33c95d2c0 2024-09-13T06:09:52.733 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.727+0000 7ffbed5c0980 1 -- 172.21.15.194:0/2138304227 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f33c95d2c0 msgr2=0x55f33cad5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:52.733 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.727+0000 7ffbed5c0980 1 --2- 172.21.15.194:0/2138304227 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f33c95d2c0 0x55f33cad5c30 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc017e90 tx=0x7ffbdc003030 comp rx=0 tx=0).stop 2024-09-13T06:09:52.733 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.727+0000 7ffbed5c0980 1 -- 172.21.15.194:0/2138304227 shutdown_connections 2024-09-13T06:09:52.733 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.727+0000 7ffbed5c0980 1 --2- 172.21.15.194:0/2138304227 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f33c95d2c0 0x55f33cad5c30 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:52.733 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.727+0000 7ffbed5c0980 1 -- 172.21.15.194:0/2138304227 >> 172.21.15.194:0/2138304227 conn(0x55f33c9e3080 msgr2=0x55f33cad1860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:52.733 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.727+0000 7ffbed5c0980 1 -- 172.21.15.194:0/2138304227 shutdown_connections 2024-09-13T06:09:52.734 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.727+0000 7ffbed5c0980 1 -- 172.21.15.194:0/2138304227 wait complete. 2024-09-13T06:09:52.734 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.727+0000 7ffbed5c0980 1 Processor -- start 2024-09-13T06:09:52.734 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.727+0000 7ffbed5c0980 1 -- start start 2024-09-13T06:09:52.734 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.727+0000 7ffbed5c0980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f33c95d2c0 0x55f33cadce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.734 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.727+0000 7ffbed5c0980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55f33c9f4200 con 0x55f33c95d2c0 2024-09-13T06:09:52.734 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.727+0000 7ffbeb0d0640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f33c95d2c0 0x55f33cadce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.735 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.727+0000 7ffbeb0d0640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f33c95d2c0 0x55f33cadce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:43946/0 (socket says 172.21.15.194:43946) 2024-09-13T06:09:52.735 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.727+0000 7ffbeb0d0640 1 -- 172.21.15.194:0/77703105 learned_addr learned my addr 172.21.15.194:0/77703105 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:52.735 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.727+0000 7ffbeb0d0640 1 -- 172.21.15.194:0/77703105 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f33cadd340 con 0x55f33c95d2c0 2024-09-13T06:09:52.735 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.727+0000 7ffbeb0d0640 1 --2- 172.21.15.194:0/77703105 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f33c95d2c0 0x55f33cadce00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc0ab510 tx=0x7ffbdc018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.735 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.727+0000 7ffad7e07640 1 -- 172.21.15.194:0/77703105 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbdc0b0070 con 0x55f33c95d2c0 2024-09-13T06:09:52.735 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.727+0000 7ffbed5c0980 1 -- 172.21.15.194:0/77703105 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f33cadd5d0 con 0x55f33c95d2c0 2024-09-13T06:09:52.736 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.727+0000 7ffad7e07640 1 -- 172.21.15.194:0/77703105 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbdc0b6d20 con 0x55f33c95d2c0 2024-09-13T06:09:52.736 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.727+0000 7ffad7e07640 1 -- 172.21.15.194:0/77703105 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbdc0c8440 con 0x55f33c95d2c0 2024-09-13T06:09:52.736 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.727+0000 7ffbed5c0980 1 -- 172.21.15.194:0/77703105 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f33cae02b0 con 0x55f33c95d2c0 2024-09-13T06:09:52.752 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.731+0000 7ffad7e07640 1 -- 172.21.15.194:0/77703105 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ffbdc0c85e0 con 0x55f33c95d2c0 2024-09-13T06:09:52.752 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.731+0000 7ffad7e07640 1 --2- 172.21.15.194:0/77703105 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ffad0034650 0x7ffad0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.752 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.731+0000 7ffad7e07640 1 -- 172.21.15.194:0/77703105 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7ffbdc0a8070 con 0x55f33c95d2c0 2024-09-13T06:09:52.752 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.731+0000 7ffbea8cf640 1 --2- 172.21.15.194:0/77703105 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ffad0034650 0x7ffad0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.752 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.731+0000 7ffbed5c0980 1 --2- 172.21.15.194:0/77703105 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55f33c9edc90 0x55f33cae3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.752 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.731+0000 7ffbed5c0980 1 -- 172.21.15.194:0/77703105 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f33cae4360 con 0x55f33c9edc90 2024-09-13T06:09:52.752 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.731+0000 7ffbeb8d1640 1 --2- 172.21.15.194:0/77703105 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55f33c9edc90 0x55f33cae3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.752 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.731+0000 7ffbea8cf640 1 --2- 172.21.15.194:0/77703105 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ffad0034650 0x7ffad0036b10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ffbe0001da0 tx=0x7ffbe0001300 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.752 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.731+0000 7ffbeb8d1640 1 --2- 172.21.15.194:0/77703105 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55f33c9edc90 0x55f33cae3d90 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.753 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.731+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/77703105 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffbe400a4d0 con 0x55f33c9edc90 2024-09-13T06:09:52.753 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.731+0000 7ffbed5c0980 1 -- 172.21.15.194:0/77703105 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f33cae4c90 con 0x55f33c9edc90 2024-09-13T06:09:52.753 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.731+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/77703105 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ffbe400a4d0 con 0x55f33c9edc90 2024-09-13T06:09:52.753 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.731+0000 7ffbed5c0980 1 --2- 172.21.15.194:0/77703105 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55f33cae65e0 0x55f33cae8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.753 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.731+0000 7ffbed5c0980 1 -- 172.21.15.194:0/77703105 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f33cae9200 con 0x55f33cae65e0 2024-09-13T06:09:52.753 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.731+0000 7ffbeb0d0640 1 --2- 172.21.15.194:0/77703105 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55f33cae65e0 0x55f33cae8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.753 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.731+0000 7ffbeb0d0640 1 --2- 172.21.15.194:0/77703105 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55f33cae65e0 0x55f33cae8a70 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.753 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.731+0000 7ffbeb0d0640 1 -- 172.21.15.194:0/77703105 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ffbdc0b3040 con 0x55f33cae65e0 2024-09-13T06:09:52.753 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.731+0000 7ffbed5c0980 1 -- 172.21.15.194:0/77703105 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f33cae54e0 con 0x55f33c9edc90 2024-09-13T06:09:52.753 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.731+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/77703105 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ffbe400a4d0 con 0x55f33c9edc90 2024-09-13T06:09:52.754 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.731+0000 7ffbed5c0980 1 --2- 172.21.15.194:0/77703105 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55f33caea660 0x55f33caeca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.754 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.731+0000 7ffbed5c0980 1 -- 172.21.15.194:0/77703105 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f33caed190 con 0x55f33caea660 2024-09-13T06:09:52.754 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.731+0000 7ffbea8cf640 1 --2- 172.21.15.194:0/77703105 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55f33caea660 0x55f33caeca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.754 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.735+0000 7ffbea8cf640 1 --2- 172.21.15.194:0/77703105 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55f33caea660 0x55f33caeca50 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.754 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.735+0000 7ffbea8cf640 1 -- 172.21.15.194:0/77703105 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ffbe000e6c0 con 0x55f33caea660 2024-09-13T06:09:52.754 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.735+0000 7ffbed5c0980 1 Processor -- start 2024-09-13T06:09:52.754 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.735+0000 7ffbed5c0980 1 -- start start 2024-09-13T06:09:52.754 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.735+0000 7ffbed5c0980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f33cafac40 0x55f33cafb060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.754 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.735+0000 7ffbed5c0980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55f33c8ef800 con 0x55f33cafac40 2024-09-13T06:09:52.754 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.735+0000 7ffbeb0d0640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f33cafac40 0x55f33cafb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.755 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.735+0000 7ffbeb0d0640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f33cafac40 0x55f33cafb060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:43962/0 (socket says 172.21.15.194:43962) 2024-09-13T06:09:52.755 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.735+0000 7ffbeb0d0640 1 -- 172.21.15.194:0/4055805474 learned_addr learned my addr 172.21.15.194:0/4055805474 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:52.755 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.735+0000 7ffbeb0d0640 1 -- 172.21.15.194:0/4055805474 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f33cafb5a0 con 0x55f33cafac40 2024-09-13T06:09:52.755 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.735+0000 7ffbeb0d0640 1 --2- 172.21.15.194:0/4055805474 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f33cafac40 0x55f33cafb060 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc0bffd0 tx=0x7ffbdc0be460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.755 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.735+0000 7ffad5602640 1 -- 172.21.15.194:0/4055805474 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbdc0c0cb0 con 0x55f33cafac40 2024-09-13T06:09:52.755 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.735+0000 7ffbed5c0980 1 -- 172.21.15.194:0/4055805474 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f33cafb830 con 0x55f33cafac40 2024-09-13T06:09:52.755 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.735+0000 7ffad5602640 1 -- 172.21.15.194:0/4055805474 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbdc0c8ab0 con 0x55f33cafac40 2024-09-13T06:09:52.755 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.735+0000 7ffbed5c0980 1 -- 172.21.15.194:0/4055805474 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f33cafe4b0 con 0x55f33cafac40 2024-09-13T06:09:52.756 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.735+0000 7ffad5602640 1 -- 172.21.15.194:0/4055805474 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbdc0c8c60 con 0x55f33cafac40 2024-09-13T06:09:52.756 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.735+0000 7ffad5602640 1 -- 172.21.15.194:0/4055805474 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ffbdc0dd040 con 0x55f33cafac40 2024-09-13T06:09:52.756 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.735+0000 7ffad5602640 1 --2- 172.21.15.194:0/4055805474 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ffac4034650 0x7ffac4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.756 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.739+0000 7ffad5602640 1 -- 172.21.15.194:0/4055805474 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7ffbdc0029c0 con 0x55f33cafac40 2024-09-13T06:09:52.756 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.739+0000 7ffbea8cf640 1 --2- 172.21.15.194:0/4055805474 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ffac4034650 0x7ffac4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.756 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.739+0000 7ffbed5c0980 1 Processor -- start 2024-09-13T06:09:52.756 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.739+0000 7ffbed5c0980 1 -- start start 2024-09-13T06:09:52.756 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.739+0000 7ffbea8cf640 1 --2- 172.21.15.194:0/4055805474 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ffac4034650 0x7ffac4036b10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x55f33cae1630 tx=0x7ffbe000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.756 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.739+0000 7ffbed5c0980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f33cb07560 0x55f33cb07960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.756 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.739+0000 7ffbed5c0980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55f33cad64c0 con 0x55f33cb07560 2024-09-13T06:09:52.757 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.739+0000 7ffbeb0d0640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f33cb07560 0x55f33cb07960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.757 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.739+0000 7ffbeb0d0640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f33cb07560 0x55f33cb07960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:43974/0 (socket says 172.21.15.194:43974) 2024-09-13T06:09:52.757 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.739+0000 7ffbeb0d0640 1 -- 172.21.15.194:0/1450267643 learned_addr learned my addr 172.21.15.194:0/1450267643 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:52.757 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.739+0000 7ffbeb0d0640 1 -- 172.21.15.194:0/1450267643 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f33cb07f30 con 0x55f33cb07560 2024-09-13T06:09:52.757 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.739+0000 7ffbeb0d0640 1 --2- 172.21.15.194:0/1450267643 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f33cb07560 0x55f33cb07960 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc0be6b0 tx=0x7ffbdc002da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c990648e27351a4a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.757 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.739+0000 7ffaceffd640 1 -- 172.21.15.194:0/1450267643 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbdc103070 con 0x55f33cb07560 2024-09-13T06:09:52.757 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.739+0000 7ffaceffd640 1 -- 172.21.15.194:0/1450267643 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbdc0aaa50 con 0x55f33cb07560 2024-09-13T06:09:52.758 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.739+0000 7ffaceffd640 1 -- 172.21.15.194:0/1450267643 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbdc0fa040 con 0x55f33cb07560 2024-09-13T06:09:52.758 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.739+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1450267643 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f33cb07560 msgr2=0x55f33cb07960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:52.758 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.739+0000 7ffbed5c0980 1 --2- 172.21.15.194:0/1450267643 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f33cb07560 0x55f33cb07960 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc0be6b0 tx=0x7ffbdc002da0 comp rx=0 tx=0).stop 2024-09-13T06:09:52.758 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.739+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1450267643 shutdown_connections 2024-09-13T06:09:52.758 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.739+0000 7ffbed5c0980 1 --2- 172.21.15.194:0/1450267643 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f33cb07560 0x55f33cb07960 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:52.758 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.739+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1450267643 >> 172.21.15.194:0/1450267643 conn(0x55f33cb03990 msgr2=0x55f33cb01a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:52.758 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.739+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1450267643 shutdown_connections 2024-09-13T06:09:52.758 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.739+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1450267643 wait complete. 2024-09-13T06:09:52.758 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.739+0000 7ffbed5c0980 1 Processor -- start 2024-09-13T06:09:52.758 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.739+0000 7ffbed5c0980 1 -- start start 2024-09-13T06:09:52.758 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.739+0000 7ffbed5c0980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f33cb07560 0x55f33cb0e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.758 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.739+0000 7ffbed5c0980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55f33cb07f30 con 0x55f33cb07560 2024-09-13T06:09:52.758 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.739+0000 7ffbeb0d0640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f33cb07560 0x55f33cb0e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.759 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.739+0000 7ffbeb0d0640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f33cb07560 0x55f33cb0e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:43990/0 (socket says 172.21.15.194:43990) 2024-09-13T06:09:52.759 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.739+0000 7ffbeb0d0640 1 -- 172.21.15.194:0/1596426436 learned_addr learned my addr 172.21.15.194:0/1596426436 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:52.759 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.743+0000 7ffbeb0d0640 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f33cb0eb30 con 0x55f33cb07560 2024-09-13T06:09:52.759 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.743+0000 7ffbeb0d0640 1 --2- 172.21.15.194:0/1596426436 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f33cb07560 0x55f33cb0e5f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc0f3fd0 tx=0x7ffbdc002660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.759 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.743+0000 7ffacd7fa640 1 -- 172.21.15.194:0/1596426436 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbdc10c020 con 0x55f33cb07560 2024-09-13T06:09:52.759 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.743+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f33cb0eb30 con 0x55f33cb07560 2024-09-13T06:09:52.759 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.743+0000 7ffacd7fa640 1 -- 172.21.15.194:0/1596426436 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbdc104040 con 0x55f33cb07560 2024-09-13T06:09:52.759 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.743+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f33cb0eb30 con 0x55f33cb07560 2024-09-13T06:09:52.759 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.743+0000 7ffacd7fa640 1 -- 172.21.15.194:0/1596426436 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbdc103070 con 0x55f33cb07560 2024-09-13T06:09:52.759 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.743+0000 7ffacd7fa640 1 -- 172.21.15.194:0/1596426436 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ffbdc10f020 con 0x55f33cb07560 2024-09-13T06:09:52.759 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.743+0000 7ffbed5c0980 20 rados->read ofs=0 len=0 2024-09-13T06:09:52.759 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.743+0000 7ffacd7fa640 1 --2- 172.21.15.194:0/1596426436 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ffab4034650 0x7ffab4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.759 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.743+0000 7ffacd7fa640 1 -- 172.21.15.194:0/1596426436 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7ffbdc112c60 con 0x55f33cb07560 2024-09-13T06:09:52.760 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.743+0000 7ffbea8cf640 1 --2- 172.21.15.194:0/1596426436 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ffab4034650 0x7ffab4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.760 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.743+0000 7ffbed5c0980 1 --2- 172.21.15.194:0/1596426436 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55f33cb195f0 0x55f33cb1bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.760 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.743+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb1c200 con 0x55f33cb195f0 2024-09-13T06:09:52.760 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.743+0000 7ffbeb8d1640 1 --2- 172.21.15.194:0/1596426436 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55f33cb195f0 0x55f33cb1bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.760 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.743+0000 7ffbea8cf640 1 --2- 172.21.15.194:0/1596426436 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ffab4034650 0x7ffab4036b10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x55f33caed570 tx=0x7ffbe0010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.760 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.743+0000 7ffbeb8d1640 1 --2- 172.21.15.194:0/1596426436 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55f33cb195f0 0x55f33cb1bab0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.760 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.743+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffbe400a4d0 con 0x55f33cb195f0 2024-09-13T06:09:52.760 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.743+0000 7ffbed5c0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:52.760 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.743+0000 7ffbed5c0980 20 realm 2024-09-13T06:09:52.760 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.743+0000 7ffbed5c0980 20 rados->read ofs=0 len=0 2024-09-13T06:09:52.760 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.743+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb1c610 con 0x55f33cb195f0 2024-09-13T06:09:52.761 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.743+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffbe400a4d0 con 0x55f33cb195f0 2024-09-13T06:09:52.761 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.743+0000 7ffbed5c0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:52.761 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.743+0000 7ffbed5c0980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:09:52.761 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.743+0000 7ffbed5c0980 20 rados->read ofs=0 len=0 2024-09-13T06:09:52.761 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.743+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb1ceb0 con 0x55f33cb195f0 2024-09-13T06:09:52.761 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.743+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffbe400a4d0 con 0x55f33cb195f0 2024-09-13T06:09:52.761 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.743+0000 7ffbed5c0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:52.761 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.743+0000 7ffbed5c0980 20 rados->read ofs=0 len=0 2024-09-13T06:09:52.761 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.743+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb1d250 con 0x55f33cb195f0 2024-09-13T06:09:52.761 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.747+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ffbe400a4d0 con 0x55f33cb195f0 2024-09-13T06:09:52.761 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.747+0000 7ffbed5c0980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:52.761 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.747+0000 7ffbed5c0980 20 rados->read ofs=0 len=0 2024-09-13T06:09:52.761 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.747+0000 7ffbed5c0980 1 --2- 172.21.15.194:0/1596426436 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55f33cb1dfb0 0x55f33cb203a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.747+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb20920 con 0x55f33cb1dfb0 2024-09-13T06:09:52.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.747+0000 7ffbeb0d0640 1 --2- 172.21.15.194:0/1596426436 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55f33cb1dfb0 0x55f33cb203a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.747+0000 7ffbeb0d0640 1 --2- 172.21.15.194:0/1596426436 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55f33cb1dfb0 0x55f33cb203a0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.747+0000 7ffbeb0d0640 1 -- 172.21.15.194:0/1596426436 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ffbdc106070 con 0x55f33cb1dfb0 2024-09-13T06:09:52.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.747+0000 7ffbed5c0980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:09:52.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.747+0000 7ffbed5c0980 20 searching for the correct realm 2024-09-13T06:09:52.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.747+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb221c0 con 0x55f33cb1dfb0 2024-09-13T06:09:52.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.747+0000 7ffbeb0d0640 1 -- 172.21.15.194:0/1596426436 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbdc106070 con 0x55f33cb1dfb0 2024-09-13T06:09:52.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.747+0000 7ffbeb0d0640 1 --2- 172.21.15.194:0/1596426436 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7ffbdc111020 0x7ffbdc0f3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.747+0000 7ffbeb0d0640 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb221c0 con 0x7ffbdc111020 2024-09-13T06:09:52.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.747+0000 7ffbea8cf640 1 --2- 172.21.15.194:0/1596426436 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7ffbdc111020 0x7ffbdc0f3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.747+0000 7ffbea8cf640 1 --2- 172.21.15.194:0/1596426436 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7ffbdc111020 0x7ffbdc0f3170 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.747+0000 7ffbea8cf640 1 -- 172.21.15.194:0/1596426436 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ffbe000e6c0 con 0x7ffbdc111020 2024-09-13T06:09:52.763 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.747+0000 7ffbea8cf640 1 --2- 172.21.15.194:0/1596426436 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7ffbe0037040 0x7ffbe0036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.763 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.747+0000 7ffbea8cf640 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb221c0 con 0x7ffbe0037040 2024-09-13T06:09:52.763 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.747+0000 7ffbeb8d1640 1 --2- 172.21.15.194:0/1596426436 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7ffbe0037040 0x7ffbe0036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.763 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.747+0000 7ffbeb8d1640 1 --2- 172.21.15.194:0/1596426436 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7ffbe0037040 0x7ffbe0036410 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.763 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.751+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbe400a4d0 con 0x7ffbe0037040 2024-09-13T06:09:52.763 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.751+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb1d250 con 0x55f33cb195f0 2024-09-13T06:09:52.763 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.751+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbe400a4d0 con 0x55f33cb195f0 2024-09-13T06:09:52.763 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.751+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb1d250 con 0x55f33cb195f0 2024-09-13T06:09:52.763 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.751+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbe400a4d0 con 0x55f33cb195f0 2024-09-13T06:09:52.763 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.751+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb1d250 con 0x7ffbe0037040 2024-09-13T06:09:52.763 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.751+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbe400a4d0 con 0x7ffbe0037040 2024-09-13T06:09:52.763 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.751+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb1d250 con 0x7ffbe0037040 2024-09-13T06:09:52.776 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.751+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbe400a4d0 con 0x7ffbe0037040 2024-09-13T06:09:52.776 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.751+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb1d250 con 0x7ffbdc111020 2024-09-13T06:09:52.776 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.751+0000 7ffbea8cf640 1 -- 172.21.15.194:0/1596426436 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbe000e6c0 con 0x7ffbdc111020 2024-09-13T06:09:52.777 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.751+0000 7ffbea8cf640 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb1d250 con 0x55f33cb1dfb0 2024-09-13T06:09:52.777 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.751+0000 7ffbeb0d0640 1 -- 172.21.15.194:0/1596426436 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbdc106070 con 0x55f33cb1dfb0 2024-09-13T06:09:52.777 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.751+0000 7ffbeb0d0640 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb1d250 con 0x55f33cb195f0 2024-09-13T06:09:52.777 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.751+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbe400a4d0 con 0x55f33cb195f0 2024-09-13T06:09:52.777 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.751+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb1d250 con 0x7ffbe0037040 2024-09-13T06:09:52.777 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.751+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbe400a4d0 con 0x7ffbe0037040 2024-09-13T06:09:52.777 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.751+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb1d250 con 0x55f33cb195f0 2024-09-13T06:09:52.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.751+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbe400a4d0 con 0x55f33cb195f0 2024-09-13T06:09:52.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.751+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb1d250 con 0x7ffbdc111020 2024-09-13T06:09:52.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.755+0000 7ffbea8cf640 1 -- 172.21.15.194:0/1596426436 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ffbe000e6c0 con 0x7ffbdc111020 2024-09-13T06:09:52.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.755+0000 7ffbea8cf640 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb1d250 con 0x55f33cb1dfb0 2024-09-13T06:09:52.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.755+0000 7ffbeb0d0640 1 -- 172.21.15.194:0/1596426436 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbdc106070 con 0x55f33cb1dfb0 2024-09-13T06:09:52.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.755+0000 7ffbeb0d0640 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb1d250 con 0x55f33cb1dfb0 2024-09-13T06:09:52.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.755+0000 7ffbeb0d0640 1 -- 172.21.15.194:0/1596426436 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbdc106070 con 0x55f33cb1dfb0 2024-09-13T06:09:52.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.755+0000 7ffbeb0d0640 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb1d250 con 0x7ffbe0037040 2024-09-13T06:09:52.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.755+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbe400a4d0 con 0x7ffbe0037040 2024-09-13T06:09:52.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.755+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb1d250 con 0x55f33cb1dfb0 2024-09-13T06:09:52.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.755+0000 7ffbeb0d0640 1 -- 172.21.15.194:0/1596426436 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbdc106070 con 0x55f33cb1dfb0 2024-09-13T06:09:52.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.755+0000 7ffbeb0d0640 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb1d250 con 0x55f33cb1dfb0 2024-09-13T06:09:52.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.755+0000 7ffbeb0d0640 1 -- 172.21.15.194:0/1596426436 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbdc106070 con 0x55f33cb1dfb0 2024-09-13T06:09:52.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.755+0000 7ffbeb0d0640 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb1d250 con 0x55f33cb195f0 2024-09-13T06:09:52.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.755+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbe400a4d0 con 0x55f33cb195f0 2024-09-13T06:09:52.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.755+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb1d250 con 0x55f33cb195f0 2024-09-13T06:09:52.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.755+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ffbe400a4d0 con 0x55f33cb195f0 2024-09-13T06:09:52.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.755+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb1d250 con 0x7ffbe0037040 2024-09-13T06:09:52.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.755+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbe400a4d0 con 0x7ffbe0037040 2024-09-13T06:09:52.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.755+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb1d250 con 0x55f33cb1dfb0 2024-09-13T06:09:52.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.755+0000 7ffbeb0d0640 1 -- 172.21.15.194:0/1596426436 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbdc106070 con 0x55f33cb1dfb0 2024-09-13T06:09:52.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.755+0000 7ffbeb0d0640 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb1d250 con 0x7ffbdc111020 2024-09-13T06:09:52.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.755+0000 7ffbea8cf640 1 -- 172.21.15.194:0/1596426436 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbe000e6c0 con 0x7ffbdc111020 2024-09-13T06:09:52.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.755+0000 7ffbea8cf640 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb1d250 con 0x55f33cb195f0 2024-09-13T06:09:52.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.759+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbe400a4d0 con 0x55f33cb195f0 2024-09-13T06:09:52.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.759+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb1d250 con 0x7ffbe0037040 2024-09-13T06:09:52.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.759+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbe400a4d0 con 0x7ffbe0037040 2024-09-13T06:09:52.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.759+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb1d250 con 0x55f33cb1dfb0 2024-09-13T06:09:52.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.759+0000 7ffbeb0d0640 1 -- 172.21.15.194:0/1596426436 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ffbdc106070 con 0x55f33cb1dfb0 2024-09-13T06:09:52.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.759+0000 7ffbeb0d0640 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb1d250 con 0x7ffbe0037040 2024-09-13T06:09:52.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.759+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbe400a4d0 con 0x7ffbe0037040 2024-09-13T06:09:52.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.759+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb1d250 con 0x7ffbdc111020 2024-09-13T06:09:52.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.759+0000 7ffbea8cf640 1 -- 172.21.15.194:0/1596426436 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbe000e6c0 con 0x7ffbdc111020 2024-09-13T06:09:52.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.759+0000 7ffbea8cf640 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb1d250 con 0x55f33cb1dfb0 2024-09-13T06:09:52.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.759+0000 7ffbeb0d0640 1 -- 172.21.15.194:0/1596426436 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbdc106070 con 0x55f33cb1dfb0 2024-09-13T06:09:52.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.759+0000 7ffbeb0d0640 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb1d250 con 0x7ffbe0037040 2024-09-13T06:09:52.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.759+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbe400a4d0 con 0x7ffbe0037040 2024-09-13T06:09:52.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.759+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb1d250 con 0x55f33cb195f0 2024-09-13T06:09:52.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.759+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ffbe400a4d0 con 0x55f33cb195f0 2024-09-13T06:09:52.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.759+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb1d250 con 0x7ffbdc111020 2024-09-13T06:09:52.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.759+0000 7ffbea8cf640 1 -- 172.21.15.194:0/1596426436 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbe000e6c0 con 0x7ffbdc111020 2024-09-13T06:09:52.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.759+0000 7ffbed5c0980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:09:52.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.759+0000 7ffbed5c0980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:09:52.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.759+0000 7ffbed5c0980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:09:52.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.759+0000 7ffbed5c0980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:09:52.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.759+0000 7ffbed5c0980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:09:52.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.759+0000 7ffbed5c0980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:09:52.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.759+0000 7ffbed5c0980 20 rados->read ofs=0 len=0 2024-09-13T06:09:52.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.759+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb21170 con 0x55f33cb195f0 2024-09-13T06:09:52.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.759+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffbe400a4d0 con 0x55f33cb195f0 2024-09-13T06:09:52.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.759+0000 7ffbed5c0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:52.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.763+0000 7ffbed5c0980 20 rados->read ofs=0 len=0 2024-09-13T06:09:52.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.763+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb21560 con 0x55f33cb195f0 2024-09-13T06:09:52.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.763+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ffbe400a4d0 con 0x55f33cb195f0 2024-09-13T06:09:52.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.763+0000 7ffbed5c0980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:52.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.763+0000 7ffbed5c0980 20 rados->read ofs=0 len=0 2024-09-13T06:09:52.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.763+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb21560 con 0x7ffbdc111020 2024-09-13T06:09:52.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.763+0000 7ffbea8cf640 1 -- 172.21.15.194:0/1596426436 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ffbe000e6c0 con 0x7ffbdc111020 2024-09-13T06:09:52.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.763+0000 7ffbed5c0980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:09:52.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.763+0000 7ffbed5c0980 20 zone default found 2024-09-13T06:09:52.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.763+0000 7ffbed5c0980 4 Realm: () 2024-09-13T06:09:52.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.763+0000 7ffbed5c0980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:09:52.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.763+0000 7ffbed5c0980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:09:52.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.763+0000 7ffbed5c0980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:09:52.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.763+0000 7ffbed5c0980 20 zonegroup default 2024-09-13T06:09:52.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.763+0000 7ffbed5c0980 20 rados->read ofs=0 len=0 2024-09-13T06:09:52.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.763+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb22690 con 0x7ffbe0037040 2024-09-13T06:09:52.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.763+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ffbe400a4d0 con 0x7ffbe0037040 2024-09-13T06:09:52.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.763+0000 7ffbed5c0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:52.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.763+0000 7ffbed5c0980 20 rados->read ofs=0 len=0 2024-09-13T06:09:52.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.763+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb24070 con 0x55f33cb1dfb0 2024-09-13T06:09:52.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.763+0000 7ffbeb0d0640 1 -- 172.21.15.194:0/1596426436 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ffbdc106070 con 0x55f33cb1dfb0 2024-09-13T06:09:52.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.763+0000 7ffbed5c0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:52.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.763+0000 7ffbed5c0980 20 rados->read ofs=0 len=0 2024-09-13T06:09:52.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.763+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb24410 con 0x55f33cb1dfb0 2024-09-13T06:09:52.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.763+0000 7ffbeb0d0640 1 -- 172.21.15.194:0/1596426436 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ffbdc106070 con 0x55f33cb1dfb0 2024-09-13T06:09:52.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.763+0000 7ffbed5c0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:52.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.763+0000 7ffbed5c0980 20 started sync module instance, tier type = 2024-09-13T06:09:52.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.763+0000 7ffbed5c0980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:09:52.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.763+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb23510 con 0x7ffbdc111020 2024-09-13T06:09:52.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.763+0000 7ffbea8cf640 1 -- 172.21.15.194:0/1596426436 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(44 notify.0 [create] v33'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbe000e6c0 con 0x7ffbdc111020 2024-09-13T06:09:52.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.763+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94503183726848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb24cb0 con 0x7ffbdc111020 2024-09-13T06:09:52.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.763+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb25500 con 0x55f33cb195f0 2024-09-13T06:09:52.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.767+0000 7ffbea8cf640 1 -- 172.21.15.194:0/1596426436 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94503183726848] v33'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbe000e6c0 con 0x7ffbdc111020 2024-09-13T06:09:52.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.767+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v33'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbe400a4d0 con 0x55f33cb195f0 2024-09-13T06:09:52.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.767+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94503183730688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb25500 con 0x55f33cb195f0 2024-09-13T06:09:52.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.767+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb25fd0 con 0x55f33cb1dfb0 2024-09-13T06:09:52.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.767+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94503183730688] v33'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbe400a4d0 con 0x55f33cb195f0 2024-09-13T06:09:52.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.767+0000 7ffbeb0d0640 1 -- 172.21.15.194:0/1596426436 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v33'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbdc106070 con 0x55f33cb1dfb0 2024-09-13T06:09:52.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.767+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94503183732816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb25470 con 0x55f33cb1dfb0 2024-09-13T06:09:52.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.767+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb26d80 con 0x7ffbdc111020 2024-09-13T06:09:52.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.771+0000 7ffbea8cf640 1 -- 172.21.15.194:0/1596426436 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(50 notify.3 [create] v33'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbe000e6c0 con 0x7ffbdc111020 2024-09-13T06:09:52.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.771+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94503183741296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb27a40 con 0x7ffbdc111020 2024-09-13T06:09:52.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.771+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb28400 con 0x55f33cb195f0 2024-09-13T06:09:52.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.771+0000 7ffbeb0d0640 1 -- 172.21.15.194:0/1596426436 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94503183732816] v33'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbdc106070 con 0x55f33cb1dfb0 2024-09-13T06:09:52.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.771+0000 7ffbea8cf640 1 -- 172.21.15.194:0/1596426436 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94503183741296] v33'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbe000e6c0 con 0x7ffbdc111020 2024-09-13T06:09:52.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.771+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v33'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbe400a4d0 con 0x55f33cb195f0 2024-09-13T06:09:52.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.771+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94503183744848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb27a40 con 0x55f33cb195f0 2024-09-13T06:09:52.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.771+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb28370 con 0x7ffbe0037040 2024-09-13T06:09:52.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.775+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94503183744848] v33'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbe400a4d0 con 0x55f33cb195f0 2024-09-13T06:09:52.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.775+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(54 notify.5 [create] v33'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbe400a4d0 con 0x7ffbe0037040 2024-09-13T06:09:52.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.775+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94503183742624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb28820 con 0x7ffbe0037040 2024-09-13T06:09:52.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.775+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb291e0 con 0x7ffbe0037040 2024-09-13T06:09:52.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.775+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94503183742624] v33'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbe400a4d0 con 0x7ffbe0037040 2024-09-13T06:09:52.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.775+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(56 notify.6 [create] v33'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbe400a4d0 con 0x7ffbe0037040 2024-09-13T06:09:52.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.775+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94503183746176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb291e0 con 0x7ffbe0037040 2024-09-13T06:09:52.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.775+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb29a70 con 0x7ffbe0037040 2024-09-13T06:09:52.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.779+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94503183746176] v33'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbe400a4d0 con 0x7ffbe0037040 2024-09-13T06:09:52.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.779+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(58 notify.7 [create] v33'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbe400a4d0 con 0x7ffbe0037040 2024-09-13T06:09:52.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.779+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94503183748400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb29c50 con 0x7ffbe0037040 2024-09-13T06:09:52.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.779+0000 7ffbed5c0980 20 add_watcher() i=0 2024-09-13T06:09:52.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.779+0000 7ffbed5c0980 20 add_watcher() i=1 2024-09-13T06:09:52.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.779+0000 7ffbed5c0980 20 add_watcher() i=2 2024-09-13T06:09:52.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.779+0000 7ffbed5c0980 20 add_watcher() i=3 2024-09-13T06:09:52.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.779+0000 7ffbed5c0980 20 add_watcher() i=4 2024-09-13T06:09:52.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.779+0000 7ffbed5c0980 20 add_watcher() i=5 2024-09-13T06:09:52.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.779+0000 7ffbed5c0980 20 add_watcher() i=6 2024-09-13T06:09:52.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.779+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94503183748400] v33'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbe400a4d0 con 0x7ffbe0037040 2024-09-13T06:09:52.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.779+0000 7ffbed5c0980 20 add_watcher() i=7 2024-09-13T06:09:52.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.779+0000 7ffbed5c0980 2 all 8 watchers are set, enabling cache 2024-09-13T06:09:52.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.779+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb2d020 con 0x55f33cb195f0 2024-09-13T06:09:52.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.779+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ffbe400a4d0 con 0x55f33cb195f0 2024-09-13T06:09:52.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.779+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94503183752000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb2a410 con 0x55f33cb195f0 2024-09-13T06:09:52.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.783+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94503183752000] v33'46 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ffbe400a4d0 con 0x55f33cb195f0 2024-09-13T06:09:52.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.783+0000 7ffaa1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:52.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.783+0000 7ffbed5c0980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:09:52.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.783+0000 7ffbed5c0980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:09:52.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.783+0000 7ffbed5c0980 5 note: GC not initialized 2024-09-13T06:09:52.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.783+0000 7ffaa0fe1640 20 reqs_thread_entry: start 2024-09-13T06:09:52.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.783+0000 7ffbed5c0980 20 init_complete bucket index max shards: 11 2024-09-13T06:09:52.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.783+0000 7ffbed5c0980 20 Filter name: none 2024-09-13T06:09:52.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.783+0000 7ffa1a7fc640 20 reqs_thread_entry: start 2024-09-13T06:09:52.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.783+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb50b80 con 0x55f33cb195f0 2024-09-13T06:09:52.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.783+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ffbe400a4d0 con 0x55f33cb195f0 2024-09-13T06:09:52.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.783+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb50b80 con 0x7ffbdc111020 2024-09-13T06:09:52.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.783+0000 7ffbea8cf640 1 -- 172.21.15.194:0/1596426436 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ffbe000e6c0 con 0x7ffbdc111020 2024-09-13T06:09:52.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.783+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb50b80 con 0x55f33cb195f0 2024-09-13T06:09:52.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.783+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ffbe400a4d0 con 0x55f33cb195f0 2024-09-13T06:09:52.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.783+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb50b40 con 0x55f33cb1dfb0 2024-09-13T06:09:52.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.783+0000 7ffbeb0d0640 1 -- 172.21.15.194:0/1596426436 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ffbdc106070 con 0x55f33cb1dfb0 2024-09-13T06:09:52.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.783+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb51090 con 0x55f33cb1dfb0 2024-09-13T06:09:52.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.783+0000 7ffbeb0d0640 1 -- 172.21.15.194:0/1596426436 <== osd.3 v2:172.21.15.194:6816/96632515 16 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ffbdc106070 con 0x55f33cb1dfb0 2024-09-13T06:09:52.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.783+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb51090 con 0x55f33cb1dfb0 2024-09-13T06:09:52.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.783+0000 7ffbeb0d0640 1 -- 172.21.15.194:0/1596426436 <== osd.3 v2:172.21.15.194:6816/96632515 17 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ffbdc106070 con 0x55f33cb1dfb0 2024-09-13T06:09:52.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.783+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb51090 con 0x55f33cb195f0 2024-09-13T06:09:52.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.783+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ffbe400a4d0 con 0x55f33cb195f0 2024-09-13T06:09:52.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.783+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb51090 con 0x55f33cb195f0 2024-09-13T06:09:52.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.787+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ffbe400a4d0 con 0x55f33cb195f0 2024-09-13T06:09:52.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.787+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb51040 con 0x55f33cb1dfb0 2024-09-13T06:09:52.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.787+0000 7ffbeb0d0640 1 -- 172.21.15.194:0/1596426436 <== osd.3 v2:172.21.15.194:6816/96632515 18 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ffbdc106070 con 0x55f33cb1dfb0 2024-09-13T06:09:52.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.787+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb51040 con 0x55f33cb1dfb0 2024-09-13T06:09:52.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.787+0000 7ffbeb0d0640 1 -- 172.21.15.194:0/1596426436 <== osd.3 v2:172.21.15.194:6816/96632515 19 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ffbdc106070 con 0x55f33cb1dfb0 2024-09-13T06:09:52.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.787+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb51040 con 0x7ffbe0037040 2024-09-13T06:09:52.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.787+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(72 usage.10 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ffbe400a4d0 con 0x7ffbe0037040 2024-09-13T06:09:52.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.787+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb51020 con 0x55f33cb195f0 2024-09-13T06:09:52.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.787+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 <== osd.1 v2:172.21.15.194:6808/3135444559 25 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ffbe400a4d0 con 0x55f33cb195f0 2024-09-13T06:09:52.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.787+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb51020 con 0x7ffbdc111020 2024-09-13T06:09:52.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.787+0000 7ffbea8cf640 1 -- 172.21.15.194:0/1596426436 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ffbe000e6c0 con 0x7ffbdc111020 2024-09-13T06:09:52.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.787+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb51020 con 0x55f33cb1dfb0 2024-09-13T06:09:52.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.787+0000 7ffbeb0d0640 1 -- 172.21.15.194:0/1596426436 <== osd.3 v2:172.21.15.194:6816/96632515 20 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ffbdc106070 con 0x55f33cb1dfb0 2024-09-13T06:09:52.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.787+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb51000 con 0x7ffbe0037040 2024-09-13T06:09:52.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.787+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ffbe400a4d0 con 0x7ffbe0037040 2024-09-13T06:09:52.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.787+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb51000 con 0x7ffbe0037040 2024-09-13T06:09:52.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.787+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ffbe400a4d0 con 0x7ffbe0037040 2024-09-13T06:09:52.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.787+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb51000 con 0x55f33cb1dfb0 2024-09-13T06:09:52.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.787+0000 7ffbeb0d0640 1 -- 172.21.15.194:0/1596426436 <== osd.3 v2:172.21.15.194:6816/96632515 21 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ffbdc106070 con 0x55f33cb1dfb0 2024-09-13T06:09:52.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.787+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb51000 con 0x7ffbe0037040 2024-09-13T06:09:52.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.791+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 <== osd.0 v2:172.21.15.120:6800/1923744619 20 ==== osd_op_reply(79 usage.17 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ffbe400a4d0 con 0x7ffbe0037040 2024-09-13T06:09:52.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.791+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb51000 con 0x55f33cb195f0 2024-09-13T06:09:52.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.791+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 <== osd.1 v2:172.21.15.194:6808/3135444559 26 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ffbe400a4d0 con 0x55f33cb195f0 2024-09-13T06:09:52.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.791+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb51000 con 0x55f33cb1dfb0 2024-09-13T06:09:52.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.791+0000 7ffbeb0d0640 1 -- 172.21.15.194:0/1596426436 <== osd.3 v2:172.21.15.194:6816/96632515 22 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ffbdc106070 con 0x55f33cb1dfb0 2024-09-13T06:09:52.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.791+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb51000 con 0x7ffbe0037040 2024-09-13T06:09:52.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.791+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 <== osd.0 v2:172.21.15.120:6800/1923744619 21 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ffbe400a4d0 con 0x7ffbe0037040 2024-09-13T06:09:52.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.791+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb51000 con 0x7ffbdc111020 2024-09-13T06:09:52.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.791+0000 7ffbea8cf640 1 -- 172.21.15.194:0/1596426436 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ffbe000e6c0 con 0x7ffbdc111020 2024-09-13T06:09:52.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.791+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb50fb0 con 0x7ffbe0037040 2024-09-13T06:09:52.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.791+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 <== osd.0 v2:172.21.15.120:6800/1923744619 22 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ffbe400a4d0 con 0x7ffbe0037040 2024-09-13T06:09:52.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.791+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb50fb0 con 0x55f33cb195f0 2024-09-13T06:09:52.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.791+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 <== osd.1 v2:172.21.15.194:6808/3135444559 27 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ffbe400a4d0 con 0x55f33cb195f0 2024-09-13T06:09:52.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.791+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb50fb0 con 0x55f33cb195f0 2024-09-13T06:09:52.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.791+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 <== osd.1 v2:172.21.15.194:6808/3135444559 28 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ffbe400a4d0 con 0x55f33cb195f0 2024-09-13T06:09:52.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.791+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb50fb0 con 0x55f33cb1dfb0 2024-09-13T06:09:52.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.791+0000 7ffbeb0d0640 1 -- 172.21.15.194:0/1596426436 <== osd.3 v2:172.21.15.194:6816/96632515 23 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ffbdc106070 con 0x55f33cb1dfb0 2024-09-13T06:09:52.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.791+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb50fb0 con 0x55f33cb195f0 2024-09-13T06:09:52.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.791+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 <== osd.1 v2:172.21.15.194:6808/3135444559 29 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ffbe400a4d0 con 0x55f33cb195f0 2024-09-13T06:09:52.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.791+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb50fb0 con 0x55f33cb195f0 2024-09-13T06:09:52.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.795+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 <== osd.1 v2:172.21.15.194:6808/3135444559 30 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ffbe400a4d0 con 0x55f33cb195f0 2024-09-13T06:09:52.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.795+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb50fb0 con 0x55f33cb1dfb0 2024-09-13T06:09:52.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.795+0000 7ffbeb0d0640 1 -- 172.21.15.194:0/1596426436 <== osd.3 v2:172.21.15.194:6816/96632515 24 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ffbdc106070 con 0x55f33cb1dfb0 2024-09-13T06:09:52.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.795+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb50fb0 con 0x55f33cb1dfb0 2024-09-13T06:09:52.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.795+0000 7ffbeb0d0640 1 -- 172.21.15.194:0/1596426436 <== osd.3 v2:172.21.15.194:6816/96632515 25 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ffbdc106070 con 0x55f33cb1dfb0 2024-09-13T06:09:52.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.795+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb50fb0 con 0x55f33cb1dfb0 2024-09-13T06:09:52.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.795+0000 7ffbeb0d0640 1 -- 172.21.15.194:0/1596426436 <== osd.3 v2:172.21.15.194:6816/96632515 26 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ffbdc106070 con 0x55f33cb1dfb0 2024-09-13T06:09:52.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.795+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb50fb0 con 0x7ffbe0037040 2024-09-13T06:09:52.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.795+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 <== osd.0 v2:172.21.15.120:6800/1923744619 23 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ffbe400a4d0 con 0x7ffbe0037040 2024-09-13T06:09:52.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.795+0000 7ffaa1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:52.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.795+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94503183752000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb50fb0 con 0x55f33cb195f0 2024-09-13T06:09:52.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.799+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 <== osd.1 v2:172.21.15.194:6808/3135444559 31 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94503183752000] v33'47 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ffbe400a4d0 con 0x55f33cb195f0 2024-09-13T06:09:52.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.799+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94503183726848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb50fb0 con 0x7ffbdc111020 2024-09-13T06:09:52.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.799+0000 7ffbea8cf640 1 -- 172.21.15.194:0/1596426436 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94503183726848] v33'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbe000e6c0 con 0x7ffbdc111020 2024-09-13T06:09:52.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.799+0000 7ffbed5c0980 20 remove_watcher() i=0 2024-09-13T06:09:52.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.799+0000 7ffbed5c0980 2 removed watcher, disabling cache 2024-09-13T06:09:52.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.799+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94503183730688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb50fb0 con 0x55f33cb195f0 2024-09-13T06:09:52.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.799+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 <== osd.1 v2:172.21.15.194:6808/3135444559 32 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94503183730688] v33'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbe400a4d0 con 0x55f33cb195f0 2024-09-13T06:09:52.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.799+0000 7ffbed5c0980 20 remove_watcher() i=1 2024-09-13T06:09:52.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.799+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94503183732816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb50fb0 con 0x55f33cb1dfb0 2024-09-13T06:09:52.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.803+0000 7ffbeb0d0640 1 -- 172.21.15.194:0/1596426436 <== osd.3 v2:172.21.15.194:6816/96632515 27 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94503183732816] v33'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbdc106070 con 0x55f33cb1dfb0 2024-09-13T06:09:52.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.803+0000 7ffbed5c0980 20 remove_watcher() i=2 2024-09-13T06:09:52.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.803+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94503183741296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb50fb0 con 0x7ffbdc111020 2024-09-13T06:09:52.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.803+0000 7ffbea8cf640 1 -- 172.21.15.194:0/1596426436 <== osd.2 v2:172.21.15.194:6800/815615585 16 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94503183741296] v33'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbe000e6c0 con 0x7ffbdc111020 2024-09-13T06:09:52.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.803+0000 7ffbed5c0980 20 remove_watcher() i=3 2024-09-13T06:09:52.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.803+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94503183744848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb50fb0 con 0x55f33cb195f0 2024-09-13T06:09:52.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.807+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 <== osd.1 v2:172.21.15.194:6808/3135444559 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94503183744848] v33'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbe400a4d0 con 0x55f33cb195f0 2024-09-13T06:09:52.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.807+0000 7ffbed5c0980 20 remove_watcher() i=4 2024-09-13T06:09:52.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.807+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94503183742624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb50fb0 con 0x7ffbe0037040 2024-09-13T06:09:52.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.807+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 <== osd.0 v2:172.21.15.120:6800/1923744619 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94503183742624] v33'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbe400a4d0 con 0x7ffbe0037040 2024-09-13T06:09:52.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.807+0000 7ffbed5c0980 20 remove_watcher() i=5 2024-09-13T06:09:52.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.807+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94503183746176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb50fb0 con 0x7ffbe0037040 2024-09-13T06:09:52.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.811+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 <== osd.0 v2:172.21.15.120:6800/1923744619 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94503183746176] v33'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbe400a4d0 con 0x7ffbe0037040 2024-09-13T06:09:52.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.811+0000 7ffbed5c0980 20 remove_watcher() i=6 2024-09-13T06:09:52.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.811+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94503183748400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f33cb50fb0 con 0x7ffbe0037040 2024-09-13T06:09:52.814 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.811+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 <== osd.0 v2:172.21.15.120:6800/1923744619 26 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94503183748400] v33'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbe400a4d0 con 0x7ffbe0037040 2024-09-13T06:09:52.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.811+0000 7ffbed5c0980 20 remove_watcher() i=7 2024-09-13T06:09:52.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.811+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7ffbe0037040 msgr2=0x7ffbe0036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:52.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.811+0000 7ffbed5c0980 1 --2- 172.21.15.194:0/1596426436 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7ffbe0037040 0x7ffbe0036410 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:52.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.811+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55f33cb195f0 msgr2=0x55f33cb1bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:52.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.811+0000 7ffbed5c0980 1 --2- 172.21.15.194:0/1596426436 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55f33cb195f0 0x55f33cb1bab0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:52.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.811+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7ffbdc111020 msgr2=0x7ffbdc0f3170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:52.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.811+0000 7ffbed5c0980 1 --2- 172.21.15.194:0/1596426436 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7ffbdc111020 0x7ffbdc0f3170 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:52.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.811+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55f33cb1dfb0 msgr2=0x55f33cb203a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:52.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.811+0000 7ffbed5c0980 1 --2- 172.21.15.194:0/1596426436 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55f33cb1dfb0 0x55f33cb203a0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:52.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.811+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ffab4034650 msgr2=0x7ffab4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:52.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.811+0000 7ffbed5c0980 1 --2- 172.21.15.194:0/1596426436 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ffab4034650 0x7ffab4036b10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x55f33caed570 tx=0x7ffbe0010000 comp rx=0 tx=0).stop 2024-09-13T06:09:52.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.811+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/1596426436 reap_dead start 2024-09-13T06:09:52.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.811+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f33cb07560 msgr2=0x55f33cb0e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:52.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.811+0000 7ffbed5c0980 1 --2- 172.21.15.194:0/1596426436 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f33cb07560 0x55f33cb0e5f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc0f3fd0 tx=0x7ffbdc002660 comp rx=0 tx=0).stop 2024-09-13T06:09:52.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.811+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 shutdown_connections 2024-09-13T06:09:52.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.811+0000 7ffbed5c0980 1 --2- 172.21.15.194:0/1596426436 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f33cb07560 0x55f33cb0e5f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:52.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.811+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 >> 172.21.15.194:0/1596426436 conn(0x55f33cb03990 msgr2=0x55f33cb01a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:52.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.811+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 shutdown_connections 2024-09-13T06:09:52.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.811+0000 7ffbed5c0980 1 -- 172.21.15.194:0/1596426436 wait complete. 2024-09-13T06:09:52.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.811+0000 7ffbed5c0980 1 -- 172.21.15.194:0/4055805474 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ffac4034650 msgr2=0x7ffac4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:52.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.811+0000 7ffbed5c0980 1 --2- 172.21.15.194:0/4055805474 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ffac4034650 0x7ffac4036b10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x55f33cae1630 tx=0x7ffbe000f000 comp rx=0 tx=0).stop 2024-09-13T06:09:52.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.811+0000 7ffbed5c0980 1 -- 172.21.15.194:0/4055805474 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f33cafac40 msgr2=0x55f33cafb060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:52.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.811+0000 7ffbed5c0980 1 --2- 172.21.15.194:0/4055805474 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f33cafac40 0x55f33cafb060 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc0bffd0 tx=0x7ffbdc0be460 comp rx=0 tx=0).stop 2024-09-13T06:09:52.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.811+0000 7ffbed5c0980 1 -- 172.21.15.194:0/4055805474 shutdown_connections 2024-09-13T06:09:52.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.811+0000 7ffbed5c0980 1 --2- 172.21.15.194:0/4055805474 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ffac4034650 0x7ffac4036b10 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:52.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.811+0000 7ffbed5c0980 1 --2- 172.21.15.194:0/4055805474 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f33cafac40 0x55f33cafb060 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:52.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.811+0000 7ffbed5c0980 1 -- 172.21.15.194:0/4055805474 >> 172.21.15.194:0/4055805474 conn(0x55f33caefd90 msgr2=0x55f33caf2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:52.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.811+0000 7ffbed5c0980 1 -- 172.21.15.194:0/4055805474 shutdown_connections 2024-09-13T06:09:52.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.811+0000 7ffbed5c0980 1 -- 172.21.15.194:0/4055805474 wait complete. 2024-09-13T06:09:52.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.811+0000 7ffbed5c0980 1 -- 172.21.15.194:0/77703105 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55f33c9edc90 msgr2=0x55f33cae3d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:52.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.811+0000 7ffbed5c0980 1 --2- 172.21.15.194:0/77703105 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55f33c9edc90 0x55f33cae3d90 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:52.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.811+0000 7ffbed5c0980 1 -- 172.21.15.194:0/77703105 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55f33caea660 msgr2=0x55f33caeca50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:52.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.811+0000 7ffbed5c0980 1 --2- 172.21.15.194:0/77703105 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55f33caea660 0x55f33caeca50 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:52.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.811+0000 7ffbed5c0980 1 -- 172.21.15.194:0/77703105 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55f33cae65e0 msgr2=0x55f33cae8a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:52.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.811+0000 7ffbed5c0980 1 --2- 172.21.15.194:0/77703105 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55f33cae65e0 0x55f33cae8a70 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:52.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.811+0000 7ffbed5c0980 1 -- 172.21.15.194:0/77703105 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ffad0034650 msgr2=0x7ffad0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:52.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.811+0000 7ffbed5c0980 1 --2- 172.21.15.194:0/77703105 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ffad0034650 0x7ffad0036b10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ffbe0001da0 tx=0x7ffbe0001300 comp rx=0 tx=0).stop 2024-09-13T06:09:52.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.811+0000 7ffbed5c0980 1 -- 172.21.15.194:0/77703105 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f33c95d2c0 msgr2=0x55f33cadce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:52.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.811+0000 7ffbed5c0980 1 --2- 172.21.15.194:0/77703105 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f33c95d2c0 0x55f33cadce00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc0ab510 tx=0x7ffbdc018020 comp rx=0 tx=0).stop 2024-09-13T06:09:52.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.811+0000 7ffbeb8d1640 1 -- 172.21.15.194:0/77703105 reap_dead start 2024-09-13T06:09:52.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.811+0000 7ffbed5c0980 1 -- 172.21.15.194:0/77703105 shutdown_connections 2024-09-13T06:09:52.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.811+0000 7ffbed5c0980 1 -- 172.21.15.194:0/77703105 >> 172.21.15.194:0/77703105 conn(0x55f33c9e3080 msgr2=0x55f33cad03e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:52.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.815+0000 7ffbed5c0980 1 -- 172.21.15.194:0/77703105 shutdown_connections 2024-09-13T06:09:52.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.815+0000 7ffbed5c0980 1 -- 172.21.15.194:0/77703105 wait complete. 2024-09-13T06:09:52.826 INFO:teuthology.orchestra.run.smithi194.stdout:{"entries":[],"summary":[]} 2024-09-13T06:09:52.826 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-09-13T06:09:52.826 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T06:09:52.826 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T06:09:52.827 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T06:09:52.902 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:09:52.902 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:09:52.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.903+0000 7f419fe91980 1 Processor -- start 2024-09-13T06:09:52.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.903+0000 7f419fe91980 1 -- start start 2024-09-13T06:09:52.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.903+0000 7f419fe91980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x560f3003aac0 0x560f300cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.903+0000 7f419fe91980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560f2ff4eae0 con 0x560f300cbcb0 2024-09-13T06:09:52.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.903+0000 7f419fe91980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x560f2ff72e30 con 0x560f3003aac0 2024-09-13T06:09:52.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.903+0000 7f419d9a1640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x560f3003aac0 0x560f300cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.903+0000 7f419d9a1640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x560f3003aac0 0x560f300cb770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44002/0 (socket says 172.21.15.194:44002) 2024-09-13T06:09:52.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.903+0000 7f419d1a0640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x560f300cbcb0 0x560f300ce0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:50912/0 (socket says 172.21.15.194:50912) 2024-09-13T06:09:52.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.903+0000 7f419d9a1640 1 -- 172.21.15.194:0/2525422684 learned_addr learned my addr 172.21.15.194:0/2525422684 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:52.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.903+0000 7f419d9a1640 1 -- 172.21.15.194:0/2525422684 >> v1:172.21.15.120:6789/0 conn(0x560f300cbcb0 legacy=0x560f300ce0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:52.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.903+0000 7f419d9a1640 1 -- 172.21.15.194:0/2525422684 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f3003aea0 con 0x560f3003aac0 2024-09-13T06:09:52.907 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.907+0000 7f419d9a1640 1 --2- 172.21.15.194:0/2525422684 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f3003aac0 0x560f300cb770 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f419000a5c0 tx=0x7f419001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6439917b6e17ad9a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.907 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.907+0000 7f419c99f640 1 -- 172.21.15.194:0/2525422684 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41900a6070 con 0x560f3003aac0 2024-09-13T06:09:52.907 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.907+0000 7f419c99f640 1 -- 172.21.15.194:0/2525422684 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41900af070 con 0x560f3003aac0 2024-09-13T06:09:52.907 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.907+0000 7f419c99f640 1 -- 172.21.15.194:0/2525422684 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41900aa5c0 con 0x560f3003aac0 2024-09-13T06:09:52.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.907+0000 7f419fe91980 1 -- 172.21.15.194:0/2525422684 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f3003aac0 msgr2=0x560f300cb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:52.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.907+0000 7f419fe91980 1 --2- 172.21.15.194:0/2525422684 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f3003aac0 0x560f300cb770 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f419000a5c0 tx=0x7f419001b340 comp rx=0 tx=0).stop 2024-09-13T06:09:52.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.907+0000 7f419fe91980 1 -- 172.21.15.194:0/2525422684 shutdown_connections 2024-09-13T06:09:52.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.907+0000 7f419fe91980 1 --2- 172.21.15.194:0/2525422684 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f3003aac0 0x560f300cb770 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:52.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.907+0000 7f419fe91980 1 -- 172.21.15.194:0/2525422684 >> 172.21.15.194:0/2525422684 conn(0x560f300c1060 msgr2=0x560f300c3480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:52.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.907+0000 7f419fe91980 1 -- 172.21.15.194:0/2525422684 shutdown_connections 2024-09-13T06:09:52.909 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.907+0000 7f419fe91980 1 -- 172.21.15.194:0/2525422684 wait complete. 2024-09-13T06:09:52.924 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.923+0000 7f419fe91980 1 Processor -- start 2024-09-13T06:09:52.924 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.923+0000 7f419fe91980 1 -- start start 2024-09-13T06:09:52.924 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.923+0000 7f419fe91980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f3003aac0 0x560f301b3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.924 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.923+0000 7f419fe91980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x560f2ff74200 con 0x560f3003aac0 2024-09-13T06:09:52.924 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.923+0000 7f419d9a1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f3003aac0 0x560f301b3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.924 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.923+0000 7f419d9a1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f3003aac0 0x560f301b3c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44010/0 (socket says 172.21.15.194:44010) 2024-09-13T06:09:52.924 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.923+0000 7f419d9a1640 1 -- 172.21.15.194:0/620265556 learned_addr learned my addr 172.21.15.194:0/620265556 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:52.925 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.923+0000 7f419d9a1640 1 -- 172.21.15.194:0/620265556 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f301b41f0 con 0x560f3003aac0 2024-09-13T06:09:52.925 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.923+0000 7f419d9a1640 1 --2- 172.21.15.194:0/620265556 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f3003aac0 0x560f301b3c20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f41900ac040 tx=0x7f4190003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbc17eda69dbdc27 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.925 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.923+0000 7f408be07640 1 -- 172.21.15.194:0/620265556 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41900aa970 con 0x560f3003aac0 2024-09-13T06:09:52.925 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.923+0000 7f408be07640 1 -- 172.21.15.194:0/620265556 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41900aab30 con 0x560f3003aac0 2024-09-13T06:09:52.925 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.923+0000 7f408be07640 1 -- 172.21.15.194:0/620265556 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41900aae50 con 0x560f3003aac0 2024-09-13T06:09:52.927 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.923+0000 7f419fe91980 1 -- 172.21.15.194:0/620265556 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f3003aac0 msgr2=0x560f301b3c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:52.927 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.923+0000 7f419fe91980 1 --2- 172.21.15.194:0/620265556 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f3003aac0 0x560f301b3c20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f41900ac040 tx=0x7f4190003030 comp rx=0 tx=0).stop 2024-09-13T06:09:52.927 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.923+0000 7f419fe91980 1 -- 172.21.15.194:0/620265556 shutdown_connections 2024-09-13T06:09:52.927 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.923+0000 7f419fe91980 1 --2- 172.21.15.194:0/620265556 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f3003aac0 0x560f301b3c20 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:52.927 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.923+0000 7f419fe91980 1 -- 172.21.15.194:0/620265556 >> 172.21.15.194:0/620265556 conn(0x560f300c1060 msgr2=0x560f301af850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:52.927 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.923+0000 7f419fe91980 1 -- 172.21.15.194:0/620265556 shutdown_connections 2024-09-13T06:09:52.927 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.923+0000 7f419fe91980 1 -- 172.21.15.194:0/620265556 wait complete. 2024-09-13T06:09:52.927 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.927+0000 7f419fe91980 1 Processor -- start 2024-09-13T06:09:52.927 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.927+0000 7f419fe91980 1 -- start start 2024-09-13T06:09:52.927 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.927+0000 7f419fe91980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f3003aac0 0x560f301baeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.927 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.927+0000 7f419fe91980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x560f300d2250 con 0x560f3003aac0 2024-09-13T06:09:52.929 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.927+0000 7f419d9a1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f3003aac0 0x560f301baeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.929 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.927+0000 7f419d9a1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f3003aac0 0x560f301baeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44026/0 (socket says 172.21.15.194:44026) 2024-09-13T06:09:52.929 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.927+0000 7f419d9a1640 1 -- 172.21.15.194:0/3670880448 learned_addr learned my addr 172.21.15.194:0/3670880448 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:52.929 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.927+0000 7f419d9a1640 1 -- 172.21.15.194:0/3670880448 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f301bb3f0 con 0x560f3003aac0 2024-09-13T06:09:52.929 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.927+0000 7f419d9a1640 1 --2- 172.21.15.194:0/3670880448 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f3003aac0 0x560f301baeb0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4190096f40 tx=0x7f41900180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.929 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.927+0000 7f408a604640 1 -- 172.21.15.194:0/3670880448 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41900cb030 con 0x560f3003aac0 2024-09-13T06:09:52.929 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.927+0000 7f408a604640 1 -- 172.21.15.194:0/3670880448 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41900bd680 con 0x560f3003aac0 2024-09-13T06:09:52.929 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.927+0000 7f408a604640 1 -- 172.21.15.194:0/3670880448 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41900bd9a0 con 0x560f3003aac0 2024-09-13T06:09:52.929 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.927+0000 7f419fe91980 1 -- 172.21.15.194:0/3670880448 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560f301bb680 con 0x560f3003aac0 2024-09-13T06:09:52.929 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.927+0000 7f419fe91980 1 -- 172.21.15.194:0/3670880448 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f301be360 con 0x560f3003aac0 2024-09-13T06:09:52.931 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.927+0000 7f408a604640 1 -- 172.21.15.194:0/3670880448 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f41900ce070 con 0x560f3003aac0 2024-09-13T06:09:52.931 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.927+0000 7f408a604640 1 --2- 172.21.15.194:0/3670880448 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f40840346a0 0x7f4084036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.931 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.927+0000 7f408a604640 1 -- 172.21.15.194:0/3670880448 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f41900cc070 con 0x560f3003aac0 2024-09-13T06:09:52.931 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.927+0000 7f419d1a0640 1 --2- 172.21.15.194:0/3670880448 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f40840346a0 0x7f4084036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.931 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.927+0000 7f419fe91980 1 --2- 172.21.15.194:0/3670880448 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x560f300cbcb0 0x560f301c1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.931 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.927+0000 7f419fe91980 1 -- 172.21.15.194:0/3670880448 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f301c24c0 con 0x560f300cbcb0 2024-09-13T06:09:52.931 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.927+0000 7f419e1a2640 1 --2- 172.21.15.194:0/3670880448 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x560f300cbcb0 0x560f301c1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.931 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.931+0000 7f419d1a0640 1 --2- 172.21.15.194:0/3670880448 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f40840346a0 0x7f4084036b60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4194001e50 tx=0x7f41940013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.931 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.931+0000 7f419e1a2640 1 --2- 172.21.15.194:0/3670880448 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x560f300cbcb0 0x560f301c1ea0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.931 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.931+0000 7f419e1a2640 1 -- 172.21.15.194:0/3670880448 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f419800a4d0 con 0x560f300cbcb0 2024-09-13T06:09:52.931 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.931+0000 7f419fe91980 1 -- 172.21.15.194:0/3670880448 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f301c2d80 con 0x560f300cbcb0 2024-09-13T06:09:52.933 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.931+0000 7f419e1a2640 1 -- 172.21.15.194:0/3670880448 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f419800a4d0 con 0x560f300cbcb0 2024-09-13T06:09:52.933 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.931+0000 7f419fe91980 1 --2- 172.21.15.194:0/3670880448 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x560f301c4690 0x560f301c6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.933 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.931+0000 7f419fe91980 1 -- 172.21.15.194:0/3670880448 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f301c72c0 con 0x560f301c4690 2024-09-13T06:09:52.933 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.931+0000 7f419d9a1640 1 --2- 172.21.15.194:0/3670880448 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x560f301c4690 0x560f301c6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.934 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.931+0000 7f419d9a1640 1 --2- 172.21.15.194:0/3670880448 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x560f301c4690 0x560f301c6b30 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.934 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.931+0000 7f419d9a1640 1 -- 172.21.15.194:0/3670880448 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f41900b3cf0 con 0x560f301c4690 2024-09-13T06:09:52.934 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.931+0000 7f419fe91980 1 -- 172.21.15.194:0/3670880448 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f301c35d0 con 0x560f300cbcb0 2024-09-13T06:09:52.934 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.931+0000 7f419e1a2640 1 -- 172.21.15.194:0/3670880448 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f419800a4d0 con 0x560f300cbcb0 2024-09-13T06:09:52.934 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.931+0000 7f419fe91980 1 --2- 172.21.15.194:0/3670880448 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x560f301c8720 0x560f301cab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.934 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.931+0000 7f419fe91980 1 -- 172.21.15.194:0/3670880448 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f301cb280 con 0x560f301c8720 2024-09-13T06:09:52.934 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.931+0000 7f419d1a0640 1 --2- 172.21.15.194:0/3670880448 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x560f301c8720 0x560f301cab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.934 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.931+0000 7f419d1a0640 1 --2- 172.21.15.194:0/3670880448 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x560f301c8720 0x560f301cab10 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.934 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.931+0000 7f419d1a0640 1 -- 172.21.15.194:0/3670880448 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f419400f700 con 0x560f301c8720 2024-09-13T06:09:52.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.931+0000 7f419fe91980 1 Processor -- start 2024-09-13T06:09:52.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.931+0000 7f419fe91980 1 -- start start 2024-09-13T06:09:52.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.931+0000 7f419fe91980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f301d8d30 0x560f301d9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.931+0000 7f419fe91980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x560f2ffcd800 con 0x560f301d8d30 2024-09-13T06:09:52.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.935+0000 7f419d9a1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f301d8d30 0x560f301d9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.935+0000 7f419d9a1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f301d8d30 0x560f301d9150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44038/0 (socket says 172.21.15.194:44038) 2024-09-13T06:09:52.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.935+0000 7f419d9a1640 1 -- 172.21.15.194:0/2971412895 learned_addr learned my addr 172.21.15.194:0/2971412895 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:52.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.935+0000 7f419d9a1640 1 -- 172.21.15.194:0/2971412895 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f301d9690 con 0x560f301d8d30 2024-09-13T06:09:52.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.935+0000 7f419d9a1640 1 --2- 172.21.15.194:0/2971412895 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f301d8d30 0x560f301d9150 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f41900c7d00 tx=0x7f41900df340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.935+0000 7f40837fe640 1 -- 172.21.15.194:0/2971412895 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41900c0ce0 con 0x560f301d8d30 2024-09-13T06:09:52.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.935+0000 7f40837fe640 1 -- 172.21.15.194:0/2971412895 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41900c0e80 con 0x560f301d8d30 2024-09-13T06:09:52.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.935+0000 7f419fe91980 1 -- 172.21.15.194:0/2971412895 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560f301d9920 con 0x560f301d8d30 2024-09-13T06:09:52.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.935+0000 7f40837fe640 1 -- 172.21.15.194:0/2971412895 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41900c5850 con 0x560f301d8d30 2024-09-13T06:09:52.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.935+0000 7f419fe91980 1 -- 172.21.15.194:0/2971412895 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f301d9920 con 0x560f301d8d30 2024-09-13T06:09:52.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.935+0000 7f40837fe640 1 -- 172.21.15.194:0/2971412895 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f41900c73f0 con 0x560f301d8d30 2024-09-13T06:09:52.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.935+0000 7f40837fe640 1 --2- 172.21.15.194:0/2971412895 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f40780346a0 0x7f4078036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.935+0000 7f40837fe640 1 -- 172.21.15.194:0/2971412895 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f41900efc90 con 0x560f301d8d30 2024-09-13T06:09:52.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.935+0000 7f419d1a0640 1 --2- 172.21.15.194:0/2971412895 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f40780346a0 0x7f4078036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.935+0000 7f419fe91980 1 Processor -- start 2024-09-13T06:09:52.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.935+0000 7f419fe91980 1 -- start start 2024-09-13T06:09:52.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.935+0000 7f419fe91980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f301e54e0 0x560f301e58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.935+0000 7f419fe91980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x560f301b44b0 con 0x560f301e54e0 2024-09-13T06:09:52.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.935+0000 7f419d1a0640 1 --2- 172.21.15.194:0/2971412895 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f40780346a0 0x7f4078036b60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x560f301c3970 tx=0x7f419400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.935+0000 7f419d9a1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f301e54e0 0x560f301e58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.935+0000 7f419d9a1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f301e54e0 0x560f301e58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44042/0 (socket says 172.21.15.194:44042) 2024-09-13T06:09:52.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.935+0000 7f419d9a1640 1 -- 172.21.15.194:0/740663285 learned_addr learned my addr 172.21.15.194:0/740663285 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:52.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.939+0000 7f419d9a1640 1 -- 172.21.15.194:0/740663285 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f301e5e90 con 0x560f301e54e0 2024-09-13T06:09:52.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.939+0000 7f419d9a1640 1 --2- 172.21.15.194:0/740663285 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f301e54e0 0x560f301e58c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f41900d3af0 tx=0x7f41900c59f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be130b18b031d063 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.939+0000 7f40817fa640 1 -- 172.21.15.194:0/740663285 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41900cfe70 con 0x560f301e54e0 2024-09-13T06:09:52.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.939+0000 7f40817fa640 1 -- 172.21.15.194:0/740663285 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41900d3dc0 con 0x560f301e54e0 2024-09-13T06:09:52.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.939+0000 7f40817fa640 1 -- 172.21.15.194:0/740663285 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41900c0800 con 0x560f301e54e0 2024-09-13T06:09:52.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.939+0000 7f419fe91980 1 -- 172.21.15.194:0/740663285 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f301e54e0 msgr2=0x560f301e58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:52.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.939+0000 7f419fe91980 1 --2- 172.21.15.194:0/740663285 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f301e54e0 0x560f301e58c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f41900d3af0 tx=0x7f41900c59f0 comp rx=0 tx=0).stop 2024-09-13T06:09:52.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.939+0000 7f419fe91980 1 -- 172.21.15.194:0/740663285 shutdown_connections 2024-09-13T06:09:52.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.939+0000 7f419fe91980 1 --2- 172.21.15.194:0/740663285 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f301e54e0 0x560f301e58c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:52.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.939+0000 7f419fe91980 1 -- 172.21.15.194:0/740663285 >> 172.21.15.194:0/740663285 conn(0x560f301e18c0 msgr2=0x560f301df9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:52.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.939+0000 7f419fe91980 1 -- 172.21.15.194:0/740663285 shutdown_connections 2024-09-13T06:09:52.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.939+0000 7f419fe91980 1 -- 172.21.15.194:0/740663285 wait complete. 2024-09-13T06:09:52.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.939+0000 7f419fe91980 1 Processor -- start 2024-09-13T06:09:52.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.939+0000 7f419fe91980 1 -- start start 2024-09-13T06:09:52.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.939+0000 7f419fe91980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f301e54e0 0x560f301ec560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.939+0000 7f419fe91980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x560f301e5e90 con 0x560f301e54e0 2024-09-13T06:09:52.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.939+0000 7f419d9a1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f301e54e0 0x560f301ec560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.939+0000 7f419d9a1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f301e54e0 0x560f301ec560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44058/0 (socket says 172.21.15.194:44058) 2024-09-13T06:09:52.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.939+0000 7f419d9a1640 1 -- 172.21.15.194:0/3316581270 learned_addr learned my addr 172.21.15.194:0/3316581270 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:52.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.939+0000 7f419d9a1640 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f301ecaa0 con 0x560f301e54e0 2024-09-13T06:09:52.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.939+0000 7f419d9a1640 1 --2- 172.21.15.194:0/3316581270 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f301e54e0 0x560f301ec560 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f41900bdfd0 tx=0x7f41900fd000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.939+0000 7f406f7fe640 1 -- 172.21.15.194:0/3316581270 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41900cfe70 con 0x560f301e54e0 2024-09-13T06:09:52.944 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.939+0000 7f419fe91980 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560f301ecaa0 con 0x560f301e54e0 2024-09-13T06:09:52.944 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.939+0000 7f406f7fe640 1 -- 172.21.15.194:0/3316581270 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41900f2170 con 0x560f301e54e0 2024-09-13T06:09:52.944 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.939+0000 7f406f7fe640 1 -- 172.21.15.194:0/3316581270 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41900c0120 con 0x560f301e54e0 2024-09-13T06:09:52.944 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.939+0000 7f419fe91980 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f301ecf10 con 0x560f301e54e0 2024-09-13T06:09:52.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.943+0000 7f419fe91980 20 rados->read ofs=0 len=0 2024-09-13T06:09:52.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.943+0000 7f406f7fe640 1 -- 172.21.15.194:0/3316581270 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4190112060 con 0x560f301e54e0 2024-09-13T06:09:52.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.943+0000 7f406f7fe640 1 --2- 172.21.15.194:0/3316581270 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4068034650 0x7f4068036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.943+0000 7f406f7fe640 1 -- 172.21.15.194:0/3316581270 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f41900fe030 con 0x560f301e54e0 2024-09-13T06:09:52.949 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.943+0000 7f419d1a0640 1 --2- 172.21.15.194:0/3316581270 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4068034650 0x7f4068036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.949 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.943+0000 7f419fe91980 1 --2- 172.21.15.194:0/3316581270 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x560f301f7490 0x560f301f9950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.949 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.943+0000 7f419fe91980 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f301fa0a0 con 0x560f301f7490 2024-09-13T06:09:52.949 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.943+0000 7f419e1a2640 1 --2- 172.21.15.194:0/3316581270 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x560f301f7490 0x560f301f9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.949 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.943+0000 7f419d1a0640 1 --2- 172.21.15.194:0/3316581270 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4068034650 0x7f4068036b10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x560f301cb660 tx=0x7f4194010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.949 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.943+0000 7f419e1a2640 1 --2- 172.21.15.194:0/3316581270 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x560f301f7490 0x560f301f9950 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.949 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.943+0000 7f419e1a2640 1 -- 172.21.15.194:0/3316581270 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f419800a4d0 con 0x560f301f7490 2024-09-13T06:09:52.949 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.943+0000 7f419fe91980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:52.949 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.943+0000 7f419fe91980 20 realm 2024-09-13T06:09:52.949 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.943+0000 7f419fe91980 20 rados->read ofs=0 len=0 2024-09-13T06:09:52.949 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.943+0000 7f419fe91980 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f301fa4b0 con 0x560f301f7490 2024-09-13T06:09:52.949 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.943+0000 7f419e1a2640 1 -- 172.21.15.194:0/3316581270 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f419800a4d0 con 0x560f301f7490 2024-09-13T06:09:52.949 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.943+0000 7f419fe91980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:52.950 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.943+0000 7f419fe91980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:09:52.950 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.943+0000 7f419fe91980 20 rados->read ofs=0 len=0 2024-09-13T06:09:52.950 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.943+0000 7f419fe91980 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f301fad50 con 0x560f301f7490 2024-09-13T06:09:52.950 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.943+0000 7f419e1a2640 1 -- 172.21.15.194:0/3316581270 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f419800a4d0 con 0x560f301f7490 2024-09-13T06:09:52.950 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.943+0000 7f419fe91980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:52.950 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.943+0000 7f419fe91980 20 rados->read ofs=0 len=0 2024-09-13T06:09:52.950 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.943+0000 7f419fe91980 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f301fb0f0 con 0x560f301f7490 2024-09-13T06:09:52.950 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.943+0000 7f419e1a2640 1 -- 172.21.15.194:0/3316581270 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f419800a4d0 con 0x560f301f7490 2024-09-13T06:09:52.950 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.943+0000 7f419fe91980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:52.950 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.943+0000 7f419fe91980 20 rados->read ofs=0 len=0 2024-09-13T06:09:52.950 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.943+0000 7f419fe91980 1 --2- 172.21.15.194:0/3316581270 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x560f301fbe50 0x560f301fe240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.950 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.943+0000 7f419fe91980 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f301fe7c0 con 0x560f301fbe50 2024-09-13T06:09:52.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.943+0000 7f419d9a1640 1 --2- 172.21.15.194:0/3316581270 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x560f301fbe50 0x560f301fe240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.943+0000 7f419d9a1640 1 --2- 172.21.15.194:0/3316581270 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x560f301fbe50 0x560f301fe240 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.943+0000 7f419d9a1640 1 -- 172.21.15.194:0/3316581270 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f41900f5070 con 0x560f301fbe50 2024-09-13T06:09:52.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.943+0000 7f419fe91980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:09:52.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.943+0000 7f419fe91980 20 searching for the correct realm 2024-09-13T06:09:52.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.947+0000 7f419fe91980 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f30200020 con 0x560f301fbe50 2024-09-13T06:09:52.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.947+0000 7f419d9a1640 1 -- 172.21.15.194:0/3316581270 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41900f5070 con 0x560f301fbe50 2024-09-13T06:09:52.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.947+0000 7f419d9a1640 1 --2- 172.21.15.194:0/3316581270 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f4190114070 0x7f41900df8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.947+0000 7f419d9a1640 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f30200020 con 0x7f4190114070 2024-09-13T06:09:52.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.947+0000 7f419d1a0640 1 --2- 172.21.15.194:0/3316581270 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f4190114070 0x7f41900df8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.947+0000 7f419d1a0640 1 --2- 172.21.15.194:0/3316581270 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f4190114070 0x7f41900df8b0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.947+0000 7f419d1a0640 1 -- 172.21.15.194:0/3316581270 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4194037040 con 0x7f4190114070 2024-09-13T06:09:52.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.947+0000 7f419d1a0640 1 --2- 172.21.15.194:0/3316581270 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f419401fc60 0x7f419403a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:52.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.947+0000 7f419d1a0640 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f30200020 con 0x7f419401fc60 2024-09-13T06:09:52.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.947+0000 7f419e1a2640 1 --2- 172.21.15.194:0/3316581270 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f419401fc60 0x7f419403a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:52.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.947+0000 7f419e1a2640 1 --2- 172.21.15.194:0/3316581270 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f419401fc60 0x7f419403a3c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:52.956 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.947+0000 7f419e1a2640 1 -- 172.21.15.194:0/3316581270 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f419800a4d0 con 0x7f419401fc60 2024-09-13T06:09:52.956 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.947+0000 7f419e1a2640 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f301fb0f0 con 0x560f301f7490 2024-09-13T06:09:52.956 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.947+0000 7f419e1a2640 1 -- 172.21.15.194:0/3316581270 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f419800a4d0 con 0x560f301f7490 2024-09-13T06:09:52.956 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.947+0000 7f419e1a2640 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f301fb0f0 con 0x560f301f7490 2024-09-13T06:09:52.956 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.947+0000 7f419e1a2640 1 -- 172.21.15.194:0/3316581270 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f419800a4d0 con 0x560f301f7490 2024-09-13T06:09:52.956 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.947+0000 7f419e1a2640 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f301fb0f0 con 0x7f419401fc60 2024-09-13T06:09:52.956 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.951+0000 7f419e1a2640 1 -- 172.21.15.194:0/3316581270 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f419800a4d0 con 0x7f419401fc60 2024-09-13T06:09:52.956 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.951+0000 7f419e1a2640 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f301fb0f0 con 0x7f419401fc60 2024-09-13T06:09:52.956 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.951+0000 7f419e1a2640 1 -- 172.21.15.194:0/3316581270 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f419800a4d0 con 0x7f419401fc60 2024-09-13T06:09:52.956 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.951+0000 7f419e1a2640 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f301fb0f0 con 0x7f4190114070 2024-09-13T06:09:52.957 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.951+0000 7f419d1a0640 1 -- 172.21.15.194:0/3316581270 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4194037040 con 0x7f4190114070 2024-09-13T06:09:52.957 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.951+0000 7f419d1a0640 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f301fb0f0 con 0x560f301fbe50 2024-09-13T06:09:52.957 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.951+0000 7f419d9a1640 1 -- 172.21.15.194:0/3316581270 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41900f5070 con 0x560f301fbe50 2024-09-13T06:09:52.957 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.951+0000 7f419d9a1640 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f301fb0f0 con 0x560f301f7490 2024-09-13T06:09:52.957 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.951+0000 7f419e1a2640 1 -- 172.21.15.194:0/3316581270 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f419800a4d0 con 0x560f301f7490 2024-09-13T06:09:52.957 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.951+0000 7f419e1a2640 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f301fb0f0 con 0x7f419401fc60 2024-09-13T06:09:52.957 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.951+0000 7f419e1a2640 1 -- 172.21.15.194:0/3316581270 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f419800a4d0 con 0x7f419401fc60 2024-09-13T06:09:52.957 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.951+0000 7f419e1a2640 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f301fb0f0 con 0x560f301f7490 2024-09-13T06:09:52.957 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.951+0000 7f419e1a2640 1 -- 172.21.15.194:0/3316581270 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f419800a4d0 con 0x560f301f7490 2024-09-13T06:09:52.957 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.951+0000 7f419e1a2640 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f301fb0f0 con 0x7f4190114070 2024-09-13T06:09:52.957 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.951+0000 7f419d1a0640 1 -- 172.21.15.194:0/3316581270 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4194037040 con 0x7f4190114070 2024-09-13T06:09:52.957 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.951+0000 7f419d1a0640 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f301fb0f0 con 0x560f301fbe50 2024-09-13T06:09:52.958 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.951+0000 7f419d9a1640 1 -- 172.21.15.194:0/3316581270 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41900f5070 con 0x560f301fbe50 2024-09-13T06:09:52.958 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.951+0000 7f419d9a1640 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f301fb0f0 con 0x560f301fbe50 2024-09-13T06:09:52.958 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.951+0000 7f419d9a1640 1 -- 172.21.15.194:0/3316581270 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41900f5070 con 0x560f301fbe50 2024-09-13T06:09:52.958 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.951+0000 7f419d9a1640 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f301fb0f0 con 0x7f419401fc60 2024-09-13T06:09:52.958 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.955+0000 7f419e1a2640 1 -- 172.21.15.194:0/3316581270 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f419800a4d0 con 0x7f419401fc60 2024-09-13T06:09:52.958 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.955+0000 7f419e1a2640 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f301fb0f0 con 0x560f301fbe50 2024-09-13T06:09:52.958 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.955+0000 7f419d9a1640 1 -- 172.21.15.194:0/3316581270 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41900f5070 con 0x560f301fbe50 2024-09-13T06:09:52.958 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.955+0000 7f419d9a1640 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f301fb0f0 con 0x560f301fbe50 2024-09-13T06:09:52.958 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.955+0000 7f419d9a1640 1 -- 172.21.15.194:0/3316581270 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41900f5070 con 0x560f301fbe50 2024-09-13T06:09:52.958 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.955+0000 7f419d9a1640 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f301fb0f0 con 0x560f301f7490 2024-09-13T06:09:52.958 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.955+0000 7f419e1a2640 1 -- 172.21.15.194:0/3316581270 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f419800a4d0 con 0x560f301f7490 2024-09-13T06:09:52.958 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.955+0000 7f419e1a2640 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f301fb0f0 con 0x560f301f7490 2024-09-13T06:09:52.959 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.955+0000 7f419e1a2640 1 -- 172.21.15.194:0/3316581270 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f419800a4d0 con 0x560f301f7490 2024-09-13T06:09:52.959 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.955+0000 7f419e1a2640 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f301fb0f0 con 0x7f419401fc60 2024-09-13T06:09:52.959 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.955+0000 7f419e1a2640 1 -- 172.21.15.194:0/3316581270 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f419800a4d0 con 0x7f419401fc60 2024-09-13T06:09:52.959 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.955+0000 7f419e1a2640 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f301fb0f0 con 0x560f301fbe50 2024-09-13T06:09:52.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.955+0000 7f419d9a1640 1 -- 172.21.15.194:0/3316581270 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41900f5070 con 0x560f301fbe50 2024-09-13T06:09:52.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.955+0000 7f419d9a1640 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f301fb0f0 con 0x7f4190114070 2024-09-13T06:09:52.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.955+0000 7f419d1a0640 1 -- 172.21.15.194:0/3316581270 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4194037040 con 0x7f4190114070 2024-09-13T06:09:52.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.955+0000 7f419d1a0640 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f301fb0f0 con 0x560f301f7490 2024-09-13T06:09:52.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.955+0000 7f419e1a2640 1 -- 172.21.15.194:0/3316581270 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f419800a4d0 con 0x560f301f7490 2024-09-13T06:09:52.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.955+0000 7f419e1a2640 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f301fb0f0 con 0x7f419401fc60 2024-09-13T06:09:52.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.955+0000 7f419e1a2640 1 -- 172.21.15.194:0/3316581270 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f419800a4d0 con 0x7f419401fc60 2024-09-13T06:09:52.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.955+0000 7f419e1a2640 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f301fb0f0 con 0x560f301fbe50 2024-09-13T06:09:52.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.955+0000 7f419d9a1640 1 -- 172.21.15.194:0/3316581270 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f41900f5070 con 0x560f301fbe50 2024-09-13T06:09:52.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.955+0000 7f419d9a1640 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f301fb0f0 con 0x7f419401fc60 2024-09-13T06:09:52.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.959+0000 7f419e1a2640 1 -- 172.21.15.194:0/3316581270 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f419800a4d0 con 0x7f419401fc60 2024-09-13T06:09:52.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.959+0000 7f419e1a2640 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f301fb0f0 con 0x7f4190114070 2024-09-13T06:09:52.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.959+0000 7f419d1a0640 1 -- 172.21.15.194:0/3316581270 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4194037040 con 0x7f4190114070 2024-09-13T06:09:52.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.959+0000 7f419d1a0640 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f301fb0f0 con 0x560f301fbe50 2024-09-13T06:09:52.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.959+0000 7f419d9a1640 1 -- 172.21.15.194:0/3316581270 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41900f5070 con 0x560f301fbe50 2024-09-13T06:09:52.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.959+0000 7f419d9a1640 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f301fb0f0 con 0x7f419401fc60 2024-09-13T06:09:52.965 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.959+0000 7f419e1a2640 1 -- 172.21.15.194:0/3316581270 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f419800a4d0 con 0x7f419401fc60 2024-09-13T06:09:52.965 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.959+0000 7f419e1a2640 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f301fb0f0 con 0x560f301f7490 2024-09-13T06:09:52.965 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.959+0000 7f419e1a2640 1 -- 172.21.15.194:0/3316581270 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f419800a4d0 con 0x560f301f7490 2024-09-13T06:09:52.965 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.959+0000 7f419e1a2640 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560f301fb0f0 con 0x7f4190114070 2024-09-13T06:09:52.965 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.959+0000 7f419d1a0640 1 -- 172.21.15.194:0/3316581270 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4194037040 con 0x7f4190114070 2024-09-13T06:09:52.965 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.959+0000 7f419fe91980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:09:52.965 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.959+0000 7f419fe91980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:09:52.965 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.959+0000 7f419fe91980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:09:52.965 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.959+0000 7f419fe91980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:09:52.965 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.959+0000 7f419fe91980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:09:52.965 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.959+0000 7f419fe91980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:09:52.965 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.959+0000 7f419fe91980 20 rados->read ofs=0 len=0 2024-09-13T06:09:52.965 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.959+0000 7f419fe91980 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f301ff140 con 0x560f301f7490 2024-09-13T06:09:52.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.959+0000 7f419e1a2640 1 -- 172.21.15.194:0/3316581270 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f419800a4d0 con 0x560f301f7490 2024-09-13T06:09:52.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.959+0000 7f419fe91980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:52.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.959+0000 7f419fe91980 20 rados->read ofs=0 len=0 2024-09-13T06:09:52.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.959+0000 7f419fe91980 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f301ff9e0 con 0x560f301f7490 2024-09-13T06:09:52.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.959+0000 7f419e1a2640 1 -- 172.21.15.194:0/3316581270 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f419800a4d0 con 0x560f301f7490 2024-09-13T06:09:52.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.959+0000 7f419fe91980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:52.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.959+0000 7f419fe91980 20 rados->read ofs=0 len=0 2024-09-13T06:09:52.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.959+0000 7f419fe91980 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f301fed80 con 0x7f4190114070 2024-09-13T06:09:52.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.959+0000 7f419d1a0640 1 -- 172.21.15.194:0/3316581270 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4194037040 con 0x7f4190114070 2024-09-13T06:09:52.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.959+0000 7f419fe91980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:09:52.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.959+0000 7f419fe91980 20 zone default found 2024-09-13T06:09:52.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.959+0000 7f419fe91980 4 Realm: () 2024-09-13T06:09:52.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.959+0000 7f419fe91980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:09:52.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.959+0000 7f419fe91980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:09:52.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.959+0000 7f419fe91980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:09:52.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.959+0000 7f419fe91980 20 zonegroup default 2024-09-13T06:09:52.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.959+0000 7f419fe91980 20 rados->read ofs=0 len=0 2024-09-13T06:09:52.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.959+0000 7f419fe91980 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f301ff9e0 con 0x7f419401fc60 2024-09-13T06:09:52.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.959+0000 7f419e1a2640 1 -- 172.21.15.194:0/3316581270 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f419800a4d0 con 0x7f419401fc60 2024-09-13T06:09:52.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.959+0000 7f419fe91980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:52.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.959+0000 7f419fe91980 20 rados->read ofs=0 len=0 2024-09-13T06:09:52.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.959+0000 7f419fe91980 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f30201ed0 con 0x560f301fbe50 2024-09-13T06:09:52.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.963+0000 7f419d9a1640 1 -- 172.21.15.194:0/3316581270 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f41900f5070 con 0x560f301fbe50 2024-09-13T06:09:52.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.963+0000 7f419fe91980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:52.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.963+0000 7f419fe91980 20 rados->read ofs=0 len=0 2024-09-13T06:09:52.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.963+0000 7f419fe91980 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f30202270 con 0x560f301fbe50 2024-09-13T06:09:52.968 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.963+0000 7f419d9a1640 1 -- 172.21.15.194:0/3316581270 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f41900f5070 con 0x560f301fbe50 2024-09-13T06:09:52.968 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.963+0000 7f419fe91980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:52.968 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.963+0000 7f419fe91980 20 started sync module instance, tier type = 2024-09-13T06:09:52.968 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.963+0000 7f419fe91980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:09:52.968 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.963+0000 7f419fe91980 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f30201370 con 0x7f4190114070 2024-09-13T06:09:52.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.963+0000 7f419d1a0640 1 -- 172.21.15.194:0/3316581270 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(44 notify.0 [create] v33'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4194037040 con 0x7f4190114070 2024-09-13T06:09:52.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.963+0000 7f419fe91980 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94623231907728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f30202ac0 con 0x7f4190114070 2024-09-13T06:09:52.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.963+0000 7f419fe91980 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f30203310 con 0x560f301f7490 2024-09-13T06:09:52.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.963+0000 7f419d1a0640 1 -- 172.21.15.194:0/3316581270 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94623231907728] v33'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4194037040 con 0x7f4190114070 2024-09-13T06:09:52.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.967+0000 7f419e1a2640 1 -- 172.21.15.194:0/3316581270 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v33'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f419800a4d0 con 0x560f301f7490 2024-09-13T06:09:52.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.967+0000 7f419fe91980 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94623231911440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f30203310 con 0x560f301f7490 2024-09-13T06:09:52.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.967+0000 7f419fe91980 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f30203db0 con 0x560f301fbe50 2024-09-13T06:09:52.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.967+0000 7f419e1a2640 1 -- 172.21.15.194:0/3316581270 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94623231911440] v33'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f419800a4d0 con 0x560f301f7490 2024-09-13T06:09:52.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.967+0000 7f419d9a1640 1 -- 172.21.15.194:0/3316581270 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v33'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41900f5070 con 0x560f301fbe50 2024-09-13T06:09:52.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.967+0000 7f419fe91980 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94623231913568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f30203280 con 0x560f301fbe50 2024-09-13T06:09:52.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.967+0000 7f419fe91980 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f30204b20 con 0x7f4190114070 2024-09-13T06:09:52.971 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.967+0000 7f419d1a0640 1 -- 172.21.15.194:0/3316581270 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(50 notify.3 [create] v33'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4194037040 con 0x7f4190114070 2024-09-13T06:09:52.971 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.967+0000 7f419fe91980 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94623231921936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f302057e0 con 0x7f4190114070 2024-09-13T06:09:52.971 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.967+0000 7f419fe91980 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f302061a0 con 0x560f301f7490 2024-09-13T06:09:52.971 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.971+0000 7f419d9a1640 1 -- 172.21.15.194:0/3316581270 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94623231913568] v33'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41900f5070 con 0x560f301fbe50 2024-09-13T06:09:52.972 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.971+0000 7f419d1a0640 1 -- 172.21.15.194:0/3316581270 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94623231921936] v33'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4194037040 con 0x7f4190114070 2024-09-13T06:09:52.972 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.971+0000 7f419e1a2640 1 -- 172.21.15.194:0/3316581270 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v33'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f419800a4d0 con 0x560f301f7490 2024-09-13T06:09:52.972 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.971+0000 7f419fe91980 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94623231918496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f302061a0 con 0x560f301f7490 2024-09-13T06:09:52.972 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.971+0000 7f419fe91980 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f30206a40 con 0x7f419401fc60 2024-09-13T06:09:52.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.971+0000 7f419e1a2640 1 -- 172.21.15.194:0/3316581270 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(54 notify.5 [create] v33'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f419800a4d0 con 0x7f419401fc60 2024-09-13T06:09:52.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.971+0000 7f419fe91980 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94623231926960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f30206d40 con 0x7f419401fc60 2024-09-13T06:09:52.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.971+0000 7f419fe91980 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f30207860 con 0x7f419401fc60 2024-09-13T06:09:52.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.971+0000 7f419e1a2640 1 -- 172.21.15.194:0/3316581270 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94623231918496] v33'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f419800a4d0 con 0x560f301f7490 2024-09-13T06:09:52.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.975+0000 7f419e1a2640 1 -- 172.21.15.194:0/3316581270 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94623231926960] v33'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f419800a4d0 con 0x7f419401fc60 2024-09-13T06:09:52.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.975+0000 7f419e1a2640 1 -- 172.21.15.194:0/3316581270 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(56 notify.6 [create] v33'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f419800a4d0 con 0x7f419401fc60 2024-09-13T06:09:52.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.975+0000 7f419fe91980 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94623231931184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f30207820 con 0x7f419401fc60 2024-09-13T06:09:52.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.975+0000 7f419fe91980 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f30208100 con 0x7f419401fc60 2024-09-13T06:09:52.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.983+0000 7f419e1a2640 1 -- 172.21.15.194:0/3316581270 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94623231931184] v33'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f419800a4d0 con 0x7f419401fc60 2024-09-13T06:09:52.985 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.983+0000 7f419e1a2640 1 -- 172.21.15.194:0/3316581270 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(58 notify.7 [create] v33'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f419800a4d0 con 0x7f419401fc60 2024-09-13T06:09:52.985 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.983+0000 7f419fe91980 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94623231925488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f30207820 con 0x7f419401fc60 2024-09-13T06:09:52.985 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.983+0000 7f419fe91980 20 add_watcher() i=0 2024-09-13T06:09:52.985 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.983+0000 7f419fe91980 20 add_watcher() i=1 2024-09-13T06:09:52.985 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.983+0000 7f419fe91980 20 add_watcher() i=2 2024-09-13T06:09:52.985 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.983+0000 7f419fe91980 20 add_watcher() i=3 2024-09-13T06:09:52.985 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.983+0000 7f419fe91980 20 add_watcher() i=4 2024-09-13T06:09:52.985 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.983+0000 7f419fe91980 20 add_watcher() i=5 2024-09-13T06:09:52.985 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.983+0000 7f419fe91980 20 add_watcher() i=6 2024-09-13T06:09:52.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.987+0000 7f419e1a2640 1 -- 172.21.15.194:0/3316581270 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94623231925488] v33'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f419800a4d0 con 0x7f419401fc60 2024-09-13T06:09:52.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.987+0000 7f419fe91980 20 add_watcher() i=7 2024-09-13T06:09:52.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.987+0000 7f419fe91980 2 all 8 watchers are set, enabling cache 2024-09-13T06:09:52.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.987+0000 7f419fe91980 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f3020b0e0 con 0x560f301f7490 2024-09-13T06:09:52.988 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.987+0000 7f419e1a2640 1 -- 172.21.15.194:0/3316581270 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f419800a4d0 con 0x560f301f7490 2024-09-13T06:09:52.988 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.987+0000 7f419fe91980 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94623231933440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f302085a0 con 0x560f301f7490 2024-09-13T06:09:52.989 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.987+0000 7f419e1a2640 1 -- 172.21.15.194:0/3316581270 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94623231933440] v33'48 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f419800a4d0 con 0x560f301f7490 2024-09-13T06:09:52.989 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.987+0000 7f404f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:52.990 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.987+0000 7f419fe91980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:09:52.990 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.987+0000 7f419fe91980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:09:52.990 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.987+0000 7f419fe91980 5 note: GC not initialized 2024-09-13T06:09:52.990 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.987+0000 7f404e7fc640 20 reqs_thread_entry: start 2024-09-13T06:09:52.990 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.987+0000 7f419fe91980 20 init_complete bucket index max shards: 11 2024-09-13T06:09:52.990 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.987+0000 7f419fe91980 20 Filter name: none 2024-09-13T06:09:52.990 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.987+0000 7f3fbffff640 20 reqs_thread_entry: start 2024-09-13T06:09:52.990 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.987+0000 7f419fe91980 20 rados->read ofs=0 len=0 2024-09-13T06:09:52.990 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.987+0000 7f419fe91980 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560f3022e2b0 con 0x560f301f7490 2024-09-13T06:09:52.990 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.987+0000 7f419e1a2640 1 -- 172.21.15.194:0/3316581270 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f419800a4d0 con 0x560f301f7490 2024-09-13T06:09:52.990 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.987+0000 7f419fe91980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:52.990 INFO:teuthology.orchestra.run.smithi194.stderr:could not fetch user info: no user info saved 2024-09-13T06:09:52.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.991+0000 7f404f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:52.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.991+0000 7f419fe91980 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94623231933440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f3022e270 con 0x560f301f7490 2024-09-13T06:09:52.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.991+0000 7f419e1a2640 1 -- 172.21.15.194:0/3316581270 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94623231933440] v33'49 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f419800a4d0 con 0x560f301f7490 2024-09-13T06:09:52.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.991+0000 7f419fe91980 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94623231907728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f3022e270 con 0x7f4190114070 2024-09-13T06:09:52.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.991+0000 7f419d1a0640 1 -- 172.21.15.194:0/3316581270 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94623231907728] v33'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4194037040 con 0x7f4190114070 2024-09-13T06:09:52.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.991+0000 7f419fe91980 20 remove_watcher() i=0 2024-09-13T06:09:52.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.991+0000 7f419fe91980 2 removed watcher, disabling cache 2024-09-13T06:09:52.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.991+0000 7f419fe91980 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94623231911440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f3022e270 con 0x560f301f7490 2024-09-13T06:09:52.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.995+0000 7f419e1a2640 1 -- 172.21.15.194:0/3316581270 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94623231911440] v33'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f419800a4d0 con 0x560f301f7490 2024-09-13T06:09:52.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.995+0000 7f419fe91980 20 remove_watcher() i=1 2024-09-13T06:09:52.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.995+0000 7f419fe91980 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94623231913568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f3022e270 con 0x560f301fbe50 2024-09-13T06:09:52.997 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.995+0000 7f419d9a1640 1 -- 172.21.15.194:0/3316581270 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94623231913568] v33'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41900f5070 con 0x560f301fbe50 2024-09-13T06:09:52.997 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.995+0000 7f419fe91980 20 remove_watcher() i=2 2024-09-13T06:09:52.997 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.995+0000 7f419fe91980 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94623231921936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f3022c140 con 0x7f4190114070 2024-09-13T06:09:52.998 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.999+0000 7f419d1a0640 1 -- 172.21.15.194:0/3316581270 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94623231921936] v33'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4194037040 con 0x7f4190114070 2024-09-13T06:09:52.999 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.999+0000 7f419fe91980 20 remove_watcher() i=3 2024-09-13T06:09:52.999 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.999+0000 7f419fe91980 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94623231918496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f30202e60 con 0x560f301f7490 2024-09-13T06:09:53.000 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.999+0000 7f419e1a2640 1 -- 172.21.15.194:0/3316581270 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94623231918496] v33'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f419800a4d0 con 0x560f301f7490 2024-09-13T06:09:53.001 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.999+0000 7f419fe91980 20 remove_watcher() i=4 2024-09-13T06:09:53.001 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:52.999+0000 7f419fe91980 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94623231926960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f30204f10 con 0x7f419401fc60 2024-09-13T06:09:53.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.003+0000 7f419e1a2640 1 -- 172.21.15.194:0/3316581270 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94623231926960] v33'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f419800a4d0 con 0x7f419401fc60 2024-09-13T06:09:53.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.003+0000 7f419fe91980 20 remove_watcher() i=5 2024-09-13T06:09:53.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.003+0000 7f419fe91980 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94623231931184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f3022c140 con 0x7f419401fc60 2024-09-13T06:09:53.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.003+0000 7f419e1a2640 1 -- 172.21.15.194:0/3316581270 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94623231931184] v33'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f419800a4d0 con 0x7f419401fc60 2024-09-13T06:09:53.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.003+0000 7f419fe91980 20 remove_watcher() i=6 2024-09-13T06:09:53.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.003+0000 7f419fe91980 1 -- 172.21.15.194:0/3316581270 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94623231925488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560f302041a0 con 0x7f419401fc60 2024-09-13T06:09:53.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.003+0000 7f419e1a2640 1 -- 172.21.15.194:0/3316581270 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94623231925488] v33'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f419800a4d0 con 0x7f419401fc60 2024-09-13T06:09:53.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.003+0000 7f419fe91980 20 remove_watcher() i=7 2024-09-13T06:09:53.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.007+0000 7f419fe91980 1 -- 172.21.15.194:0/3316581270 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f419401fc60 msgr2=0x7f419403a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.007+0000 7f419fe91980 1 --2- 172.21.15.194:0/3316581270 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f419401fc60 0x7f419403a3c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.007+0000 7f419fe91980 1 -- 172.21.15.194:0/3316581270 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x560f301f7490 msgr2=0x560f301f9950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.007+0000 7f419fe91980 1 --2- 172.21.15.194:0/3316581270 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x560f301f7490 0x560f301f9950 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.007+0000 7f419fe91980 1 -- 172.21.15.194:0/3316581270 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f4190114070 msgr2=0x7f41900df8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.007+0000 7f419fe91980 1 --2- 172.21.15.194:0/3316581270 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f4190114070 0x7f41900df8b0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.007+0000 7f419fe91980 1 -- 172.21.15.194:0/3316581270 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x560f301fbe50 msgr2=0x560f301fe240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.007+0000 7f419fe91980 1 --2- 172.21.15.194:0/3316581270 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x560f301fbe50 0x560f301fe240 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.007+0000 7f419fe91980 1 -- 172.21.15.194:0/3316581270 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4068034650 msgr2=0x7f4068036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.007+0000 7f419fe91980 1 --2- 172.21.15.194:0/3316581270 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4068034650 0x7f4068036b10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x560f301cb660 tx=0x7f4194010000 comp rx=0 tx=0).stop 2024-09-13T06:09:53.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.007+0000 7f419fe91980 1 -- 172.21.15.194:0/3316581270 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f301e54e0 msgr2=0x560f301ec560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.007+0000 7f419e1a2640 1 -- 172.21.15.194:0/3316581270 reap_dead start 2024-09-13T06:09:53.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.007+0000 7f419fe91980 1 --2- 172.21.15.194:0/3316581270 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f301e54e0 0x560f301ec560 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f41900bdfd0 tx=0x7f41900fd000 comp rx=0 tx=0).stop 2024-09-13T06:09:53.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.007+0000 7f419fe91980 1 -- 172.21.15.194:0/3316581270 shutdown_connections 2024-09-13T06:09:53.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.007+0000 7f419fe91980 1 --2- 172.21.15.194:0/3316581270 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f301e54e0 0x560f301ec560 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.007+0000 7f419fe91980 1 -- 172.21.15.194:0/3316581270 >> 172.21.15.194:0/3316581270 conn(0x560f301e18c0 msgr2=0x560f301df990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:53.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.007+0000 7f419fe91980 1 -- 172.21.15.194:0/3316581270 shutdown_connections 2024-09-13T06:09:53.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.007+0000 7f419fe91980 1 -- 172.21.15.194:0/3316581270 wait complete. 2024-09-13T06:09:53.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.007+0000 7f419fe91980 1 -- 172.21.15.194:0/2971412895 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f40780346a0 msgr2=0x7f4078036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.007+0000 7f419fe91980 1 --2- 172.21.15.194:0/2971412895 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f40780346a0 0x7f4078036b60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x560f301c3970 tx=0x7f419400f000 comp rx=0 tx=0).stop 2024-09-13T06:09:53.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.007+0000 7f419fe91980 1 -- 172.21.15.194:0/2971412895 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f301d8d30 msgr2=0x560f301d9150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.007+0000 7f419fe91980 1 --2- 172.21.15.194:0/2971412895 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f301d8d30 0x560f301d9150 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f41900c7d00 tx=0x7f41900df340 comp rx=0 tx=0).stop 2024-09-13T06:09:53.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.007+0000 7f419fe91980 1 -- 172.21.15.194:0/2971412895 shutdown_connections 2024-09-13T06:09:53.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.007+0000 7f419fe91980 1 --2- 172.21.15.194:0/2971412895 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f40780346a0 0x7f4078036b60 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.007+0000 7f419fe91980 1 --2- 172.21.15.194:0/2971412895 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f301d8d30 0x560f301d9150 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.007+0000 7f419fe91980 1 -- 172.21.15.194:0/2971412895 >> 172.21.15.194:0/2971412895 conn(0x560f301cde80 msgr2=0x560f301d0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:53.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.007+0000 7f419fe91980 1 -- 172.21.15.194:0/2971412895 shutdown_connections 2024-09-13T06:09:53.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.007+0000 7f419fe91980 1 -- 172.21.15.194:0/2971412895 wait complete. 2024-09-13T06:09:53.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.007+0000 7f419fe91980 1 -- 172.21.15.194:0/3670880448 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x560f300cbcb0 msgr2=0x560f301c1ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.007+0000 7f419fe91980 1 --2- 172.21.15.194:0/3670880448 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x560f300cbcb0 0x560f301c1ea0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.007+0000 7f419fe91980 1 -- 172.21.15.194:0/3670880448 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x560f301c8720 msgr2=0x560f301cab10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.007+0000 7f419fe91980 1 --2- 172.21.15.194:0/3670880448 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x560f301c8720 0x560f301cab10 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.007+0000 7f419fe91980 1 -- 172.21.15.194:0/3670880448 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x560f301c4690 msgr2=0x560f301c6b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.007+0000 7f419fe91980 1 --2- 172.21.15.194:0/3670880448 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x560f301c4690 0x560f301c6b30 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.007+0000 7f419fe91980 1 -- 172.21.15.194:0/3670880448 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f40840346a0 msgr2=0x7f4084036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.007+0000 7f419fe91980 1 --2- 172.21.15.194:0/3670880448 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f40840346a0 0x7f4084036b60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4194001e50 tx=0x7f41940013b0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.007+0000 7f419fe91980 1 -- 172.21.15.194:0/3670880448 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f3003aac0 msgr2=0x560f301baeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.007+0000 7f419fe91980 1 --2- 172.21.15.194:0/3670880448 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560f3003aac0 0x560f301baeb0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4190096f40 tx=0x7f41900180e0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.007+0000 7f419e1a2640 1 -- 172.21.15.194:0/3670880448 reap_dead start 2024-09-13T06:09:53.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.007+0000 7f419fe91980 1 -- 172.21.15.194:0/3670880448 shutdown_connections 2024-09-13T06:09:53.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.007+0000 7f419fe91980 1 -- 172.21.15.194:0/3670880448 >> 172.21.15.194:0/3670880448 conn(0x560f300c1060 msgr2=0x560f301ae3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:53.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.007+0000 7f419fe91980 1 -- 172.21.15.194:0/3670880448 shutdown_connections 2024-09-13T06:09:53.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.007+0000 7f419fe91980 1 -- 172.21.15.194:0/3670880448 wait complete. 2024-09-13T06:09:53.018 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-13T06:09:53.019 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-09-13T06:09:53.019 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-09-13T06:09:53.019 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid foo --display-name Foo --email foo@foo.com --access-key 9te6NH5mcdcq0Tc5i8i1 --secret Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu --max-buckets 4 2024-09-13T06:09:53.106 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:09:53.107 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:09:53.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.107+0000 7f98c857e980 1 Processor -- start 2024-09-13T06:09:53.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.107+0000 7f98c857e980 1 -- start start 2024-09-13T06:09:53.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.107+0000 7f98c857e980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55acfe632890 0x55acfe634c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.107+0000 7f98c857e980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55acfe4b7ae0 con 0x55acfe62e510 2024-09-13T06:09:53.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.107+0000 7f98c857e980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x55acfe4dbe30 con 0x55acfe632890 2024-09-13T06:09:53.109 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.107+0000 7f98c588d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55acfe632890 0x55acfe634c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.109 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.107+0000 7f98c588d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55acfe632890 0x55acfe634c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44070/0 (socket says 172.21.15.194:44070) 2024-09-13T06:09:53.109 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.107+0000 7f98c608e640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x55acfe62e510 0x55acfe62e8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:50918/0 (socket says 172.21.15.194:50918) 2024-09-13T06:09:53.109 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.107+0000 7f98c588d640 1 -- 172.21.15.194:0/3644200497 learned_addr learned my addr 172.21.15.194:0/3644200497 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:53.109 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.107+0000 7f98c588d640 1 -- 172.21.15.194:0/3644200497 >> v1:172.21.15.120:6789/0 conn(0x55acfe62e510 legacy=0x55acfe62e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.109 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.107+0000 7f98c588d640 1 -- 172.21.15.194:0/3644200497 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acfe6361d0 con 0x55acfe632890 2024-09-13T06:09:53.109 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.107+0000 7f98c508c640 1 -- 172.21.15.194:0/3644200497 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1884214702 0 0) 0x55acfe4b7ae0 con 0x55acfe62e510 2024-09-13T06:09:53.111 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.111+0000 7f98c588d640 1 --2- 172.21.15.194:0/3644200497 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55acfe632890 0x55acfe634c80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f98bc00a5c0 tx=0x7f98bc01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa49c313982972a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.112 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.111+0000 7f98c508c640 1 -- 172.21.15.194:0/3644200497 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98bc0a6070 con 0x55acfe632890 2024-09-13T06:09:53.112 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.111+0000 7f98c508c640 1 -- 172.21.15.194:0/3644200497 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98bc0af070 con 0x55acfe632890 2024-09-13T06:09:53.112 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.111+0000 7f98c508c640 1 -- 172.21.15.194:0/3644200497 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98bc0aa5c0 con 0x55acfe632890 2024-09-13T06:09:53.112 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.111+0000 7f98c857e980 1 -- 172.21.15.194:0/3644200497 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55acfe632890 msgr2=0x55acfe634c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.111+0000 7f98c857e980 1 --2- 172.21.15.194:0/3644200497 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55acfe632890 0x55acfe634c80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f98bc00a5c0 tx=0x7f98bc01b340 comp rx=0 tx=0).stop 2024-09-13T06:09:53.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.111+0000 7f98c857e980 1 -- 172.21.15.194:0/3644200497 shutdown_connections 2024-09-13T06:09:53.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.111+0000 7f98c857e980 1 --2- 172.21.15.194:0/3644200497 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55acfe632890 0x55acfe634c80 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.111+0000 7f98c857e980 1 -- 172.21.15.194:0/3644200497 >> 172.21.15.194:0/3644200497 conn(0x55acfe62a030 msgr2=0x55acfe62c450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:53.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.111+0000 7f98c857e980 1 -- 172.21.15.194:0/3644200497 shutdown_connections 2024-09-13T06:09:53.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.111+0000 7f98c857e980 1 -- 172.21.15.194:0/3644200497 wait complete. 2024-09-13T06:09:53.128 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.127+0000 7f98c857e980 1 Processor -- start 2024-09-13T06:09:53.128 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.127+0000 7f98c857e980 1 -- start start 2024-09-13T06:09:53.128 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.127+0000 7f98c857e980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55acfe62e510 0x55acfe5a3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.128 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.127+0000 7f98c857e980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55acfe4dd200 con 0x55acfe62e510 2024-09-13T06:09:53.129 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.127+0000 7f98c608e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55acfe62e510 0x55acfe5a3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.129 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.127+0000 7f98c608e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55acfe62e510 0x55acfe5a3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44082/0 (socket says 172.21.15.194:44082) 2024-09-13T06:09:53.129 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.127+0000 7f98c608e640 1 -- 172.21.15.194:0/3509294603 learned_addr learned my addr 172.21.15.194:0/3509294603 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:53.129 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.127+0000 7f98c608e640 1 -- 172.21.15.194:0/3509294603 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acfe5a4170 con 0x55acfe62e510 2024-09-13T06:09:53.129 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.127+0000 7f98c608e640 1 --2- 172.21.15.194:0/3509294603 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55acfe62e510 0x55acfe5a3ba0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f98b800b250 tx=0x7f98b800b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de1f15821d01b54 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.127+0000 7f97b4608640 1 -- 172.21.15.194:0/3509294603 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98b800d640 con 0x55acfe62e510 2024-09-13T06:09:53.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.127+0000 7f97b4608640 1 -- 172.21.15.194:0/3509294603 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98b8008070 con 0x55acfe62e510 2024-09-13T06:09:53.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.127+0000 7f97b4608640 1 -- 172.21.15.194:0/3509294603 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98b800d990 con 0x55acfe62e510 2024-09-13T06:09:53.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.127+0000 7f98c857e980 1 -- 172.21.15.194:0/3509294603 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55acfe62e510 msgr2=0x55acfe5a3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.127+0000 7f98c857e980 1 --2- 172.21.15.194:0/3509294603 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55acfe62e510 0x55acfe5a3ba0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f98b800b250 tx=0x7f98b800b710 comp rx=0 tx=0).stop 2024-09-13T06:09:53.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.127+0000 7f98c857e980 1 -- 172.21.15.194:0/3509294603 shutdown_connections 2024-09-13T06:09:53.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.127+0000 7f98c857e980 1 --2- 172.21.15.194:0/3509294603 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55acfe62e510 0x55acfe5a3ba0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.127+0000 7f98c857e980 1 -- 172.21.15.194:0/3509294603 >> 172.21.15.194:0/3509294603 conn(0x55acfe62a030 msgr2=0x55acfe715380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:53.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.131+0000 7f98c857e980 1 -- 172.21.15.194:0/3509294603 shutdown_connections 2024-09-13T06:09:53.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.131+0000 7f98c857e980 1 -- 172.21.15.194:0/3509294603 wait complete. 2024-09-13T06:09:53.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.131+0000 7f98c857e980 1 Processor -- start 2024-09-13T06:09:53.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.131+0000 7f98c857e980 1 -- start start 2024-09-13T06:09:53.132 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.131+0000 7f98c857e980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55acfe62e510 0x55acfe723e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.132 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.131+0000 7f98c857e980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55acfe635cd0 con 0x55acfe62e510 2024-09-13T06:09:53.133 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.131+0000 7f98c608e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55acfe62e510 0x55acfe723e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.133 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.131+0000 7f98c608e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55acfe62e510 0x55acfe723e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44096/0 (socket says 172.21.15.194:44096) 2024-09-13T06:09:53.133 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.131+0000 7f98c608e640 1 -- 172.21.15.194:0/1906684091 learned_addr learned my addr 172.21.15.194:0/1906684091 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:53.133 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.131+0000 7f98c608e640 1 -- 172.21.15.194:0/1906684091 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acfe724340 con 0x55acfe62e510 2024-09-13T06:09:53.133 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.131+0000 7f98c608e640 1 --2- 172.21.15.194:0/1906684091 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55acfe62e510 0x55acfe723e00 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x55acfe719840 tx=0x7f98b8000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.131+0000 7f97b2e05640 1 -- 172.21.15.194:0/1906684091 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98b801a690 con 0x55acfe62e510 2024-09-13T06:09:53.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.131+0000 7f98c857e980 1 -- 172.21.15.194:0/1906684091 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55acfe7245d0 con 0x55acfe62e510 2024-09-13T06:09:53.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.131+0000 7f97b2e05640 1 -- 172.21.15.194:0/1906684091 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98b801a830 con 0x55acfe62e510 2024-09-13T06:09:53.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.131+0000 7f97b2e05640 1 -- 172.21.15.194:0/1906684091 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98b801ab50 con 0x55acfe62e510 2024-09-13T06:09:53.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.131+0000 7f98c857e980 1 -- 172.21.15.194:0/1906684091 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55acfe7272b0 con 0x55acfe62e510 2024-09-13T06:09:53.136 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.131+0000 7f97b2e05640 1 -- 172.21.15.194:0/1906684091 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f98b8017070 con 0x55acfe62e510 2024-09-13T06:09:53.136 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.131+0000 7f97b2e05640 1 --2- 172.21.15.194:0/1906684091 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f97ac034650 0x7f97ac036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.136 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.131+0000 7f97b2e05640 1 -- 172.21.15.194:0/1906684091 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f98b8015020 con 0x55acfe62e510 2024-09-13T06:09:53.137 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.131+0000 7f98c588d640 1 --2- 172.21.15.194:0/1906684091 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f97ac034650 0x7f97ac036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.137 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.131+0000 7f98c857e980 1 --2- 172.21.15.194:0/1906684091 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55acfe632890 0x55acfe72af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.137 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.131+0000 7f98c857e980 1 -- 172.21.15.194:0/1906684091 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55acfe72b480 con 0x55acfe632890 2024-09-13T06:09:53.137 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.135+0000 7f98c688f640 1 --2- 172.21.15.194:0/1906684091 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55acfe632890 0x55acfe72af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.137 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.135+0000 7f98c588d640 1 --2- 172.21.15.194:0/1906684091 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f97ac034650 0x7f97ac036b10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f98bc0ae000 tx=0x7f98bc0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.137 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.135+0000 7f98c688f640 1 --2- 172.21.15.194:0/1906684091 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55acfe632890 0x55acfe72af00 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.137 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.135+0000 7f98c688f640 1 -- 172.21.15.194:0/1906684091 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f98c000a4d0 con 0x55acfe632890 2024-09-13T06:09:53.137 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.135+0000 7f98c857e980 1 -- 172.21.15.194:0/1906684091 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55acfe7284d0 con 0x55acfe632890 2024-09-13T06:09:53.137 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.135+0000 7f98c688f640 1 -- 172.21.15.194:0/1906684091 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f98c000a4d0 con 0x55acfe632890 2024-09-13T06:09:53.137 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.135+0000 7f98c857e980 1 --2- 172.21.15.194:0/1906684091 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55acfe72d7b0 0x55acfe72fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.137 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.135+0000 7f98c857e980 1 -- 172.21.15.194:0/1906684091 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55acfe730290 con 0x55acfe72d7b0 2024-09-13T06:09:53.137 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.135+0000 7f98c608e640 1 --2- 172.21.15.194:0/1906684091 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55acfe72d7b0 0x55acfe72fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.137 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.135+0000 7f98c608e640 1 --2- 172.21.15.194:0/1906684091 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55acfe72d7b0 0x55acfe72fba0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.138 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.135+0000 7f98c608e640 1 -- 172.21.15.194:0/1906684091 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f98b802e070 con 0x55acfe72d7b0 2024-09-13T06:09:53.138 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.135+0000 7f98c857e980 1 -- 172.21.15.194:0/1906684091 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55acfe72c650 con 0x55acfe632890 2024-09-13T06:09:53.138 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.135+0000 7f98c688f640 1 -- 172.21.15.194:0/1906684091 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f98c000a4d0 con 0x55acfe632890 2024-09-13T06:09:53.138 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.135+0000 7f98c857e980 1 --2- 172.21.15.194:0/1906684091 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55acfe7316f0 0x55acfe733ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.138 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.135+0000 7f98c857e980 1 -- 172.21.15.194:0/1906684091 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55acfe734220 con 0x55acfe7316f0 2024-09-13T06:09:53.138 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.135+0000 7f98c588d640 1 --2- 172.21.15.194:0/1906684091 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55acfe7316f0 0x55acfe733ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.139 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.135+0000 7f98c588d640 1 --2- 172.21.15.194:0/1906684091 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55acfe7316f0 0x55acfe733ae0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.140 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.135+0000 7f98c588d640 1 -- 172.21.15.194:0/1906684091 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f98bc0aa9e0 con 0x55acfe7316f0 2024-09-13T06:09:53.140 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.135+0000 7f98c857e980 1 Processor -- start 2024-09-13T06:09:53.140 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.135+0000 7f98c857e980 1 -- start start 2024-09-13T06:09:53.140 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.135+0000 7f98c857e980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55acfe741cf0 0x55acfe742110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.140 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.135+0000 7f98c857e980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55acfe536800 con 0x55acfe741cf0 2024-09-13T06:09:53.140 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.139+0000 7f98c608e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55acfe741cf0 0x55acfe742110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.140 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.139+0000 7f98c608e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55acfe741cf0 0x55acfe742110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44112/0 (socket says 172.21.15.194:44112) 2024-09-13T06:09:53.140 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.139+0000 7f98c608e640 1 -- 172.21.15.194:0/699488136 learned_addr learned my addr 172.21.15.194:0/699488136 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:53.140 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.139+0000 7f98c608e640 1 -- 172.21.15.194:0/699488136 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acfe742650 con 0x55acfe741cf0 2024-09-13T06:09:53.140 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.139+0000 7f98c608e640 1 --2- 172.21.15.194:0/699488136 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55acfe741cf0 0x55acfe742110 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f98b804a010 tx=0x7f98b801af00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.140 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.139+0000 7f97abfff640 1 -- 172.21.15.194:0/699488136 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98b8012200 con 0x55acfe741cf0 2024-09-13T06:09:53.140 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.139+0000 7f97abfff640 1 -- 172.21.15.194:0/699488136 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98b80123a0 con 0x55acfe741cf0 2024-09-13T06:09:53.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.139+0000 7f98c857e980 1 -- 172.21.15.194:0/699488136 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55acfe7428e0 con 0x55acfe741cf0 2024-09-13T06:09:53.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.139+0000 7f97abfff640 1 -- 172.21.15.194:0/699488136 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98b8042360 con 0x55acfe741cf0 2024-09-13T06:09:53.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.139+0000 7f98c857e980 1 -- 172.21.15.194:0/699488136 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55acfe745560 con 0x55acfe741cf0 2024-09-13T06:09:53.143 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.139+0000 7f97abfff640 1 -- 172.21.15.194:0/699488136 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f98b8042500 con 0x55acfe741cf0 2024-09-13T06:09:53.143 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.139+0000 7f97abfff640 1 --2- 172.21.15.194:0/699488136 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f97a00346a0 0x7f97a0036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.143 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.139+0000 7f97abfff640 1 -- 172.21.15.194:0/699488136 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f98b803d070 con 0x55acfe741cf0 2024-09-13T06:09:53.143 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.139+0000 7f98c588d640 1 --2- 172.21.15.194:0/699488136 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f97a00346a0 0x7f97a0036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.143 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.139+0000 7f98c857e980 1 Processor -- start 2024-09-13T06:09:53.143 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.139+0000 7f98c857e980 1 -- start start 2024-09-13T06:09:53.143 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.139+0000 7f98c857e980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55acfe74e680 0x55acfe74ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.143 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.139+0000 7f98c857e980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55acfe5a44f0 con 0x55acfe74e680 2024-09-13T06:09:53.143 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.139+0000 7f98c588d640 1 --2- 172.21.15.194:0/699488136 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f97a00346a0 0x7f97a0036b60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x55acfe72b930 tx=0x7f98bc005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.143 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.139+0000 7f98c608e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55acfe74e680 0x55acfe74ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.143 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.139+0000 7f98c608e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55acfe74e680 0x55acfe74ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44120/0 (socket says 172.21.15.194:44120) 2024-09-13T06:09:53.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.139+0000 7f98c608e640 1 -- 172.21.15.194:0/2340622002 learned_addr learned my addr 172.21.15.194:0/2340622002 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:53.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.139+0000 7f98c608e640 1 -- 172.21.15.194:0/2340622002 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acfe74f050 con 0x55acfe74e680 2024-09-13T06:09:53.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.143+0000 7f98c608e640 1 --2- 172.21.15.194:0/2340622002 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55acfe74e680 0x55acfe74ea80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f98b801c020 tx=0x7f98b8012910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fa9da3e71c869e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.143+0000 7f97a9ffb640 1 -- 172.21.15.194:0/2340622002 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98b800e790 con 0x55acfe74e680 2024-09-13T06:09:53.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.143+0000 7f97a9ffb640 1 -- 172.21.15.194:0/2340622002 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98b80427f0 con 0x55acfe74e680 2024-09-13T06:09:53.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.143+0000 7f97a9ffb640 1 -- 172.21.15.194:0/2340622002 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98b804a0b0 con 0x55acfe74e680 2024-09-13T06:09:53.146 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.143+0000 7f98c857e980 1 -- 172.21.15.194:0/2340622002 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55acfe74e680 msgr2=0x55acfe74ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.146 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.143+0000 7f98c857e980 1 --2- 172.21.15.194:0/2340622002 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55acfe74e680 0x55acfe74ea80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f98b801c020 tx=0x7f98b8012910 comp rx=0 tx=0).stop 2024-09-13T06:09:53.146 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.143+0000 7f98c857e980 1 -- 172.21.15.194:0/2340622002 shutdown_connections 2024-09-13T06:09:53.146 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.143+0000 7f98c857e980 1 --2- 172.21.15.194:0/2340622002 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55acfe74e680 0x55acfe74ea80 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.146 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.143+0000 7f98c857e980 1 -- 172.21.15.194:0/2340622002 >> 172.21.15.194:0/2340622002 conn(0x55acfe74aa60 msgr2=0x55acfe748b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:53.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.143+0000 7f98c857e980 1 -- 172.21.15.194:0/2340622002 shutdown_connections 2024-09-13T06:09:53.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.143+0000 7f98c857e980 1 -- 172.21.15.194:0/2340622002 wait complete. 2024-09-13T06:09:53.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.143+0000 7f98c857e980 1 Processor -- start 2024-09-13T06:09:53.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.143+0000 7f98c857e980 1 -- start start 2024-09-13T06:09:53.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.143+0000 7f98c857e980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55acfe74e680 0x55acfe7557f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.143+0000 7f98c857e980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55acfe74f4d0 con 0x55acfe74e680 2024-09-13T06:09:53.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.143+0000 7f98c608e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55acfe74e680 0x55acfe7557f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.143+0000 7f98c608e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55acfe74e680 0x55acfe7557f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44130/0 (socket says 172.21.15.194:44130) 2024-09-13T06:09:53.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.143+0000 7f98c608e640 1 -- 172.21.15.194:0/4233208263 learned_addr learned my addr 172.21.15.194:0/4233208263 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:53.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.143+0000 7f98c608e640 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acfe755d30 con 0x55acfe74e680 2024-09-13T06:09:53.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.143+0000 7f98c608e640 1 --2- 172.21.15.194:0/4233208263 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55acfe74e680 0x55acfe7557f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f98b801c020 tx=0x7f98b8016e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.143+0000 7f9797fff640 1 -- 172.21.15.194:0/4233208263 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98b806e070 con 0x55acfe74e680 2024-09-13T06:09:53.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.143+0000 7f98c857e980 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55acfe755d30 con 0x55acfe74e680 2024-09-13T06:09:53.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.143+0000 7f98c857e980 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55acfe755d30 con 0x55acfe74e680 2024-09-13T06:09:53.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.143+0000 7f9797fff640 1 -- 172.21.15.194:0/4233208263 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98b804a6a0 con 0x55acfe74e680 2024-09-13T06:09:53.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.143+0000 7f9797fff640 1 -- 172.21.15.194:0/4233208263 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98b804abf0 con 0x55acfe74e680 2024-09-13T06:09:53.151 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.147+0000 7f9797fff640 1 -- 172.21.15.194:0/4233208263 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f98b8071070 con 0x55acfe74e680 2024-09-13T06:09:53.151 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.147+0000 7f9797fff640 1 --2- 172.21.15.194:0/4233208263 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f9790034650 0x7f9790036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.152 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.147+0000 7f9797fff640 1 -- 172.21.15.194:0/4233208263 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f98b8066070 con 0x55acfe74e680 2024-09-13T06:09:53.152 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.147+0000 7f98c588d640 1 --2- 172.21.15.194:0/4233208263 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f9790034650 0x7f9790036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.152 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.147+0000 7f98c857e980 20 rados->read ofs=0 len=0 2024-09-13T06:09:53.152 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.147+0000 7f98c857e980 1 --2- 172.21.15.194:0/4233208263 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55acfe760880 0x55acfe762d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.152 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.147+0000 7f98c857e980 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55acfe763490 con 0x55acfe760880 2024-09-13T06:09:53.152 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.147+0000 7f98c688f640 1 --2- 172.21.15.194:0/4233208263 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55acfe760880 0x55acfe762d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.152 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.147+0000 7f98c588d640 1 --2- 172.21.15.194:0/4233208263 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f9790034650 0x7f9790036b10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f98bc0c8fd0 tx=0x7f98bc0c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.152 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.147+0000 7f98c688f640 1 --2- 172.21.15.194:0/4233208263 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55acfe760880 0x55acfe762d40 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.152 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.147+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f98c000a4d0 con 0x55acfe760880 2024-09-13T06:09:53.152 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.147+0000 7f98c857e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:53.152 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.147+0000 7f98c857e980 20 realm 2024-09-13T06:09:53.152 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.147+0000 7f98c857e980 20 rados->read ofs=0 len=0 2024-09-13T06:09:53.152 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.147+0000 7f98c857e980 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55acfe7638a0 con 0x55acfe760880 2024-09-13T06:09:53.153 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.147+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f98c000a4d0 con 0x55acfe760880 2024-09-13T06:09:53.153 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.147+0000 7f98c857e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:53.153 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.147+0000 7f98c857e980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:09:53.153 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.147+0000 7f98c857e980 20 rados->read ofs=0 len=0 2024-09-13T06:09:53.153 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.147+0000 7f98c857e980 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55acfe764170 con 0x55acfe760880 2024-09-13T06:09:53.153 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.147+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f98c000a4d0 con 0x55acfe760880 2024-09-13T06:09:53.153 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.147+0000 7f98c857e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:53.153 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.147+0000 7f98c857e980 20 rados->read ofs=0 len=0 2024-09-13T06:09:53.153 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.147+0000 7f98c857e980 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55acfe764510 con 0x55acfe760880 2024-09-13T06:09:53.153 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.147+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f98c000a4d0 con 0x55acfe760880 2024-09-13T06:09:53.153 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.147+0000 7f98c857e980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:53.153 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.147+0000 7f98c857e980 20 rados->read ofs=0 len=0 2024-09-13T06:09:53.153 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.147+0000 7f98c857e980 1 --2- 172.21.15.194:0/4233208263 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55acfe765270 0x55acfe767660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.147+0000 7f98c857e980 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55acfe767c70 con 0x55acfe765270 2024-09-13T06:09:53.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.147+0000 7f98c608e640 1 --2- 172.21.15.194:0/4233208263 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55acfe765270 0x55acfe767660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.147+0000 7f98c608e640 1 --2- 172.21.15.194:0/4233208263 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55acfe765270 0x55acfe767660 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.147+0000 7f98c608e640 1 -- 172.21.15.194:0/4233208263 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f98b8070030 con 0x55acfe765270 2024-09-13T06:09:53.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.147+0000 7f98c857e980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:09:53.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.147+0000 7f98c857e980 20 searching for the correct realm 2024-09-13T06:09:53.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.147+0000 7f98c857e980 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55acfe769540 con 0x55acfe765270 2024-09-13T06:09:53.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.151+0000 7f98c608e640 1 -- 172.21.15.194:0/4233208263 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b8070030 con 0x55acfe765270 2024-09-13T06:09:53.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.151+0000 7f98c608e640 1 --2- 172.21.15.194:0/4233208263 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f98b8073c20 0x7f98b8016650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.151+0000 7f98c608e640 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55acfe769540 con 0x7f98b8073c20 2024-09-13T06:09:53.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.151+0000 7f98c588d640 1 --2- 172.21.15.194:0/4233208263 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f98b8073c20 0x7f98b8016650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.151+0000 7f98c588d640 1 --2- 172.21.15.194:0/4233208263 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f98b8073c20 0x7f98b8016650 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.151+0000 7f98c588d640 1 -- 172.21.15.194:0/4233208263 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f98bc0df040 con 0x7f98b8073c20 2024-09-13T06:09:53.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.151+0000 7f98c588d640 1 --2- 172.21.15.194:0/4233208263 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f98bc0e2040 0x7f98bc0e2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.151+0000 7f98c588d640 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55acfe769540 con 0x7f98bc0e2040 2024-09-13T06:09:53.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.151+0000 7f98c688f640 1 --2- 172.21.15.194:0/4233208263 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f98bc0e2040 0x7f98bc0e2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.151+0000 7f98c688f640 1 --2- 172.21.15.194:0/4233208263 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f98bc0e2040 0x7f98bc0e2930 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.151+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c000a4d0 con 0x7f98bc0e2040 2024-09-13T06:09:53.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.151+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55acfe764510 con 0x55acfe760880 2024-09-13T06:09:53.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.151+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c000a4d0 con 0x55acfe760880 2024-09-13T06:09:53.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.151+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55acfe764510 con 0x55acfe760880 2024-09-13T06:09:53.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.151+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c000a4d0 con 0x55acfe760880 2024-09-13T06:09:53.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.151+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55acfe764510 con 0x7f98bc0e2040 2024-09-13T06:09:53.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.155+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c000a4d0 con 0x7f98bc0e2040 2024-09-13T06:09:53.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.155+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55acfe764510 con 0x7f98bc0e2040 2024-09-13T06:09:53.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.155+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c000a4d0 con 0x7f98bc0e2040 2024-09-13T06:09:53.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.155+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55acfe764510 con 0x7f98b8073c20 2024-09-13T06:09:53.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.155+0000 7f98c588d640 1 -- 172.21.15.194:0/4233208263 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98bc0df040 con 0x7f98b8073c20 2024-09-13T06:09:53.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.155+0000 7f98c588d640 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55acfe764510 con 0x55acfe765270 2024-09-13T06:09:53.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.155+0000 7f98c608e640 1 -- 172.21.15.194:0/4233208263 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b8070030 con 0x55acfe765270 2024-09-13T06:09:53.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.155+0000 7f98c608e640 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55acfe764510 con 0x55acfe760880 2024-09-13T06:09:53.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.155+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c000a4d0 con 0x55acfe760880 2024-09-13T06:09:53.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.155+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55acfe764510 con 0x7f98bc0e2040 2024-09-13T06:09:53.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.155+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c000a4d0 con 0x7f98bc0e2040 2024-09-13T06:09:53.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.155+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55acfe764510 con 0x55acfe760880 2024-09-13T06:09:53.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.155+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c000a4d0 con 0x55acfe760880 2024-09-13T06:09:53.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.155+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55acfe764510 con 0x7f98b8073c20 2024-09-13T06:09:53.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.155+0000 7f98c588d640 1 -- 172.21.15.194:0/4233208263 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f98bc0df040 con 0x7f98b8073c20 2024-09-13T06:09:53.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.155+0000 7f98c588d640 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55acfe764510 con 0x55acfe765270 2024-09-13T06:09:53.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.155+0000 7f98c608e640 1 -- 172.21.15.194:0/4233208263 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b8070030 con 0x55acfe765270 2024-09-13T06:09:53.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.155+0000 7f98c608e640 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55acfe764510 con 0x55acfe765270 2024-09-13T06:09:53.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.155+0000 7f98c608e640 1 -- 172.21.15.194:0/4233208263 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b8070030 con 0x55acfe765270 2024-09-13T06:09:53.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.155+0000 7f98c608e640 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55acfe764510 con 0x7f98bc0e2040 2024-09-13T06:09:53.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.155+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c000a4d0 con 0x7f98bc0e2040 2024-09-13T06:09:53.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.155+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55acfe764510 con 0x55acfe765270 2024-09-13T06:09:53.163 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.159+0000 7f98c608e640 1 -- 172.21.15.194:0/4233208263 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b8070030 con 0x55acfe765270 2024-09-13T06:09:53.163 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.159+0000 7f98c608e640 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55acfe764510 con 0x55acfe765270 2024-09-13T06:09:53.163 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.159+0000 7f98c608e640 1 -- 172.21.15.194:0/4233208263 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b8070030 con 0x55acfe765270 2024-09-13T06:09:53.163 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.159+0000 7f98c608e640 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55acfe764510 con 0x55acfe760880 2024-09-13T06:09:53.163 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.159+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c000a4d0 con 0x55acfe760880 2024-09-13T06:09:53.163 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.159+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55acfe764510 con 0x55acfe760880 2024-09-13T06:09:53.163 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.159+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f98c000a4d0 con 0x55acfe760880 2024-09-13T06:09:53.163 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.159+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55acfe764510 con 0x7f98bc0e2040 2024-09-13T06:09:53.163 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.159+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c000a4d0 con 0x7f98bc0e2040 2024-09-13T06:09:53.163 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.159+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55acfe764510 con 0x55acfe765270 2024-09-13T06:09:53.164 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.159+0000 7f98c608e640 1 -- 172.21.15.194:0/4233208263 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b8070030 con 0x55acfe765270 2024-09-13T06:09:53.164 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.159+0000 7f98c608e640 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55acfe764510 con 0x7f98b8073c20 2024-09-13T06:09:53.164 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.159+0000 7f98c588d640 1 -- 172.21.15.194:0/4233208263 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98bc0df040 con 0x7f98b8073c20 2024-09-13T06:09:53.164 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.159+0000 7f98c588d640 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55acfe764510 con 0x55acfe760880 2024-09-13T06:09:53.164 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.159+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c000a4d0 con 0x55acfe760880 2024-09-13T06:09:53.164 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.159+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55acfe764510 con 0x7f98bc0e2040 2024-09-13T06:09:53.164 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.159+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c000a4d0 con 0x7f98bc0e2040 2024-09-13T06:09:53.164 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.159+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55acfe764510 con 0x55acfe765270 2024-09-13T06:09:53.164 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.159+0000 7f98c608e640 1 -- 172.21.15.194:0/4233208263 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f98b8070030 con 0x55acfe765270 2024-09-13T06:09:53.164 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.159+0000 7f98c608e640 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55acfe764510 con 0x7f98bc0e2040 2024-09-13T06:09:53.164 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.163+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c000a4d0 con 0x7f98bc0e2040 2024-09-13T06:09:53.164 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.163+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55acfe764510 con 0x7f98b8073c20 2024-09-13T06:09:53.165 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.163+0000 7f98c588d640 1 -- 172.21.15.194:0/4233208263 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98bc0df040 con 0x7f98b8073c20 2024-09-13T06:09:53.165 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.163+0000 7f98c588d640 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55acfe764510 con 0x55acfe765270 2024-09-13T06:09:53.165 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.163+0000 7f98c608e640 1 -- 172.21.15.194:0/4233208263 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b8070030 con 0x55acfe765270 2024-09-13T06:09:53.165 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.163+0000 7f98c608e640 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55acfe764510 con 0x7f98bc0e2040 2024-09-13T06:09:53.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.163+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c000a4d0 con 0x7f98bc0e2040 2024-09-13T06:09:53.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.163+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55acfe764510 con 0x55acfe760880 2024-09-13T06:09:53.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.163+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f98c000a4d0 con 0x55acfe760880 2024-09-13T06:09:53.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.163+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55acfe764510 con 0x7f98b8073c20 2024-09-13T06:09:53.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.163+0000 7f98c588d640 1 -- 172.21.15.194:0/4233208263 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98bc0df040 con 0x7f98b8073c20 2024-09-13T06:09:53.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.163+0000 7f98c857e980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:09:53.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.163+0000 7f98c857e980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:09:53.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.163+0000 7f98c857e980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:09:53.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.163+0000 7f98c857e980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:09:53.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.163+0000 7f98c857e980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:09:53.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.163+0000 7f98c857e980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:09:53.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.163+0000 7f98c857e980 20 rados->read ofs=0 len=0 2024-09-13T06:09:53.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.163+0000 7f98c857e980 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55acfe768630 con 0x55acfe760880 2024-09-13T06:09:53.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.163+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f98c000a4d0 con 0x55acfe760880 2024-09-13T06:09:53.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.163+0000 7f98c857e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:53.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.163+0000 7f98c857e980 20 rados->read ofs=0 len=0 2024-09-13T06:09:53.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.163+0000 7f98c857e980 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55acfe768240 con 0x55acfe760880 2024-09-13T06:09:53.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.163+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f98c000a4d0 con 0x55acfe760880 2024-09-13T06:09:53.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.163+0000 7f98c857e980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:53.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.163+0000 7f98c857e980 20 rados->read ofs=0 len=0 2024-09-13T06:09:53.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.163+0000 7f98c857e980 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55acfe768f20 con 0x7f98b8073c20 2024-09-13T06:09:53.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.163+0000 7f98c588d640 1 -- 172.21.15.194:0/4233208263 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f98bc0df040 con 0x7f98b8073c20 2024-09-13T06:09:53.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.163+0000 7f98c857e980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:09:53.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.163+0000 7f98c857e980 20 zone default found 2024-09-13T06:09:53.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.163+0000 7f98c857e980 4 Realm: () 2024-09-13T06:09:53.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.163+0000 7f98c857e980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:09:53.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.163+0000 7f98c857e980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:09:53.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.163+0000 7f98c857e980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:09:53.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.163+0000 7f98c857e980 20 zonegroup default 2024-09-13T06:09:53.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.163+0000 7f98c857e980 20 rados->read ofs=0 len=0 2024-09-13T06:09:53.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.163+0000 7f98c857e980 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55acfe769970 con 0x7f98bc0e2040 2024-09-13T06:09:53.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.163+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f98c000a4d0 con 0x7f98bc0e2040 2024-09-13T06:09:53.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.163+0000 7f98c857e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:53.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.163+0000 7f98c857e980 20 rados->read ofs=0 len=0 2024-09-13T06:09:53.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.163+0000 7f98c857e980 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55acfe76b350 con 0x55acfe765270 2024-09-13T06:09:53.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.167+0000 7f98c608e640 1 -- 172.21.15.194:0/4233208263 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f98b8070030 con 0x55acfe765270 2024-09-13T06:09:53.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.167+0000 7f98c857e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:53.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.167+0000 7f98c857e980 20 rados->read ofs=0 len=0 2024-09-13T06:09:53.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.167+0000 7f98c857e980 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55acfe76b6f0 con 0x55acfe765270 2024-09-13T06:09:53.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.167+0000 7f98c608e640 1 -- 172.21.15.194:0/4233208263 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f98b8070030 con 0x55acfe765270 2024-09-13T06:09:53.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.167+0000 7f98c857e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:53.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.167+0000 7f98c857e980 20 started sync module instance, tier type = 2024-09-13T06:09:53.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.167+0000 7f98c857e980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:09:53.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.167+0000 7f98c857e980 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55acfe76a7f0 con 0x7f98b8073c20 2024-09-13T06:09:53.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.167+0000 7f98c588d640 1 -- 172.21.15.194:0/4233208263 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(44 notify.0 [create] v33'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98bc0df040 con 0x7f98b8073c20 2024-09-13T06:09:53.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.167+0000 7f98c857e980 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94201491925984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55acfe76a450 con 0x7f98b8073c20 2024-09-13T06:09:53.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.167+0000 7f98c857e980 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55acfe76c650 con 0x55acfe760880 2024-09-13T06:09:53.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.167+0000 7f98c588d640 1 -- 172.21.15.194:0/4233208263 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94201491925984] v33'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98bc0df040 con 0x7f98b8073c20 2024-09-13T06:09:53.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.167+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v33'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c000a4d0 con 0x55acfe760880 2024-09-13T06:09:53.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.167+0000 7f98c857e980 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94201491931552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55acfe76ca70 con 0x55acfe760880 2024-09-13T06:09:53.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.171+0000 7f98c857e980 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55acfe76d430 con 0x55acfe765270 2024-09-13T06:09:53.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.171+0000 7f98c608e640 1 -- 172.21.15.194:0/4233208263 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v33'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98b8070030 con 0x55acfe765270 2024-09-13T06:09:53.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.171+0000 7f98c857e980 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94201491935104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55acfe76dc80 con 0x55acfe765270 2024-09-13T06:09:53.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.171+0000 7f98c857e980 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55acfe76e640 con 0x7f98b8073c20 2024-09-13T06:09:53.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.171+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94201491931552] v33'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c000a4d0 con 0x55acfe760880 2024-09-13T06:09:53.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.171+0000 7f98c588d640 1 -- 172.21.15.194:0/4233208263 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(50 notify.3 [create] v33'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98bc0df040 con 0x7f98b8073c20 2024-09-13T06:09:53.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.171+0000 7f98c857e980 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94201491939728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55acfe76ea30 con 0x7f98b8073c20 2024-09-13T06:09:53.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.171+0000 7f98c857e980 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55acfe76f3f0 con 0x55acfe760880 2024-09-13T06:09:53.175 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.171+0000 7f98c608e640 1 -- 172.21.15.194:0/4233208263 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94201491935104] v33'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98b8070030 con 0x55acfe765270 2024-09-13T06:09:53.175 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.175+0000 7f98c588d640 1 -- 172.21.15.194:0/4233208263 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94201491939728] v33'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98bc0df040 con 0x7f98b8073c20 2024-09-13T06:09:53.175 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.175+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v33'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c000a4d0 con 0x55acfe760880 2024-09-13T06:09:53.175 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.175+0000 7f98c857e980 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94201491937232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55acfe76c6d0 con 0x55acfe760880 2024-09-13T06:09:53.175 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.175+0000 7f98c857e980 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55acfe76f3f0 con 0x7f98bc0e2040 2024-09-13T06:09:53.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.175+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94201491937232] v33'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c000a4d0 con 0x55acfe760880 2024-09-13T06:09:53.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.175+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(54 notify.5 [create] v33'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c000a4d0 con 0x7f98bc0e2040 2024-09-13T06:09:53.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.175+0000 7f98c857e980 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94201491945936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55acfe76f3f0 con 0x7f98bc0e2040 2024-09-13T06:09:53.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.175+0000 7f98c857e980 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55acfe770590 con 0x7f98bc0e2040 2024-09-13T06:09:53.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.179+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94201491945936] v33'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c000a4d0 con 0x7f98bc0e2040 2024-09-13T06:09:53.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.179+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(56 notify.6 [create] v33'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c000a4d0 con 0x7f98bc0e2040 2024-09-13T06:09:53.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.179+0000 7f98c857e980 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94201491943504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55acfe770590 con 0x7f98bc0e2040 2024-09-13T06:09:53.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.179+0000 7f98c857e980 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55acfe770f50 con 0x7f98bc0e2040 2024-09-13T06:09:53.183 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.183+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(58 notify.7 [create] v33'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c000a4d0 con 0x7f98bc0e2040 2024-09-13T06:09:53.183 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.183+0000 7f98c857e980 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94201491950240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55acfe771370 con 0x7f98bc0e2040 2024-09-13T06:09:53.183 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.183+0000 7f98c857e980 20 add_watcher() i=0 2024-09-13T06:09:53.183 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.183+0000 7f98c857e980 20 add_watcher() i=1 2024-09-13T06:09:53.183 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.183+0000 7f98c857e980 20 add_watcher() i=2 2024-09-13T06:09:53.183 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.183+0000 7f98c857e980 20 add_watcher() i=3 2024-09-13T06:09:53.183 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.183+0000 7f98c857e980 20 add_watcher() i=4 2024-09-13T06:09:53.183 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.183+0000 7f98c857e980 20 add_watcher() i=5 2024-09-13T06:09:53.184 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.183+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94201491943504] v33'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c000a4d0 con 0x7f98bc0e2040 2024-09-13T06:09:53.184 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.183+0000 7f98c857e980 20 add_watcher() i=6 2024-09-13T06:09:53.185 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.183+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94201491950240] v33'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c000a4d0 con 0x7f98bc0e2040 2024-09-13T06:09:53.185 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.183+0000 7f98c857e980 20 add_watcher() i=7 2024-09-13T06:09:53.185 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.183+0000 7f98c857e980 2 all 8 watchers are set, enabling cache 2024-09-13T06:09:53.185 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.183+0000 7f98c857e980 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55acfe7700e0 con 0x55acfe760880 2024-09-13T06:09:53.185 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.183+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f98c000a4d0 con 0x55acfe760880 2024-09-13T06:09:53.185 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.183+0000 7f98c857e980 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94201491947744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55acfe771830 con 0x55acfe760880 2024-09-13T06:09:53.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.187+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94201491947744] v33'50 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f98c000a4d0 con 0x55acfe760880 2024-09-13T06:09:53.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.187+0000 7f977cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:53.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.187+0000 7f98c857e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:09:53.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.187+0000 7f98c857e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:09:53.188 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.187+0000 7f98c857e980 5 note: GC not initialized 2024-09-13T06:09:53.188 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.187+0000 7f96f77fe640 20 reqs_thread_entry: start 2024-09-13T06:09:53.188 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.187+0000 7f98c857e980 20 init_complete bucket index max shards: 11 2024-09-13T06:09:53.188 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.187+0000 7f98c857e980 20 Filter name: none 2024-09-13T06:09:53.188 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.187+0000 7f96f57fa640 20 reqs_thread_entry: start 2024-09-13T06:09:53.188 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.187+0000 7f98c857e980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T06:09:53.188 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.187+0000 7f98c857e980 20 rados->read ofs=0 len=0 2024-09-13T06:09:53.188 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.187+0000 7f98c857e980 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55acfe797a30 con 0x55acfe760880 2024-09-13T06:09:53.189 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.187+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f98c000a4d0 con 0x55acfe760880 2024-09-13T06:09:53.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.187+0000 7f98c857e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:53.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.187+0000 7f98c857e980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-09-13T06:09:53.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.187+0000 7f98c857e980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:09:53.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.187+0000 7f98c857e980 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-09-13T06:09:53.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.187+0000 7f98c857e980 20 rados->read ofs=0 len=0 2024-09-13T06:09:53.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.187+0000 7f98c857e980 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55acfe7961d0 con 0x55acfe760880 2024-09-13T06:09:53.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.187+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(63 foo@foo.com [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7f98c000a4d0 con 0x55acfe760880 2024-09-13T06:09:53.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.187+0000 7f98c857e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:53.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.187+0000 7f98c857e980 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x0 2024-09-13T06:09:53.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.187+0000 7f98c857e980 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-13T06:09:53.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.187+0000 7f98c857e980 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : miss 2024-09-13T06:09:53.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.187+0000 7f98c857e980 20 rados->read ofs=0 len=0 2024-09-13T06:09:53.191 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.187+0000 7f98c857e980 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:64 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55acfe7961d0 con 0x7f98bc0e2040 2024-09-13T06:09:53.191 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.187+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(64 9te6NH5mcdcq0Tc5i8i1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f98c000a4d0 con 0x7f98bc0e2040 2024-09-13T06:09:53.191 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.187+0000 7f98c857e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:53.191 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.187+0000 7f98c857e980 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x0 2024-09-13T06:09:53.191 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.187+0000 7f98c857e980 10 adding default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-13T06:09:53.191 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.187+0000 7f98c857e980 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-09-13T06:09:53.191 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.187+0000 7f98c857e980 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-09-13T06:09:53.191 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.187+0000 7f98c857e980 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:65 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55acfe796c20 con 0x55acfe760880 2024-09-13T06:09:53.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.187+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(65 foo [delete,create,call,writefull 0~391] v33'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f98c000a4d0 con 0x55acfe760880 2024-09-13T06:09:53.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.187+0000 7f98c857e980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T06:09:53.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.187+0000 7f98c857e980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:09:53.193 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.187+0000 7f98c857e980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T06:09:53.193 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.187+0000 7f98c857e980 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify cookie 94201492104768 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55acfe79b540 con 0x55acfe760880 2024-09-13T06:09:53.193 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.191+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== watch-notify(notify (1) cookie 94201491937232 notify 141733920768 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55acfe796fc0 con 0x55acfe760880 2024-09-13T06:09:53.193 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.191+0000 7f97a9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920768 cookie 94201491937232 notifier 4290 bl.length()=567 2024-09-13T06:09:53.193 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.191+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 <== osd.1 v2:172.21.15.194:6808/3135444559 25 ==== osd_op_reply(66 notify.4 [notify cookie 94201492104768 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f98c000a4d0 con 0x55acfe760880 2024-09-13T06:09:53.193 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.191+0000 7f97a9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T06:09:53.193 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.191+0000 7f97a9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:09:53.193 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.191+0000 7f97a9ffb640 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f978c003eb0 con 0x55acfe760880 2024-09-13T06:09:53.193 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.191+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 <== osd.1 v2:172.21.15.194:6808/3135444559 26 ==== osd_op_reply(67 notify.4 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c000a4d0 con 0x55acfe760880 2024-09-13T06:09:53.193 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.191+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 <== osd.1 v2:172.21.15.194:6808/3135444559 27 ==== watch-notify(notify_complete (2) cookie 94201492104768 notify 141733920768 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55acfe797670 con 0x55acfe760880 2024-09-13T06:09:53.193 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.191+0000 7f98c857e980 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:68 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55acfe7965f0 con 0x55acfe760880 2024-09-13T06:09:53.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.191+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 <== osd.1 v2:172.21.15.194:6808/3135444559 28 ==== osd_op_reply(68 foo@foo.com [delete,create,writefull 0~7] v33'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f98c000a4d0 con 0x55acfe760880 2024-09-13T06:09:53.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.191+0000 7f98c857e980 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-09-13T06:09:53.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.191+0000 7f98c857e980 10 moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-13T06:09:53.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.191+0000 7f98c857e980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-09-13T06:09:53.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.191+0000 7f98c857e980 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [notify cookie 94201492104688 in=181b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55acfe79b970 con 0x7f98b8073c20 2024-09-13T06:09:53.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.191+0000 7f98c588d640 1 -- 172.21.15.194:0/4233208263 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== watch-notify(notify (1) cookie 94201491939728 notify 141733920768 ret 0) ==== 211+0+0 (crc 0 0 0) 0x55acfe6361d0 con 0x7f98b8073c20 2024-09-13T06:09:53.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.191+0000 7f97a9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920768 cookie 94201491939728 notifier 4290 bl.length()=169 2024-09-13T06:09:53.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.191+0000 7f97a9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-09-13T06:09:53.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.191+0000 7f97a9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-13T06:09:53.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.191+0000 7f97a9ffb640 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f978c003eb0 con 0x7f98b8073c20 2024-09-13T06:09:53.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.191+0000 7f98c588d640 1 -- 172.21.15.194:0/4233208263 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(69 notify.3 [notify cookie 94201492104688 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f98bc0df040 con 0x7f98b8073c20 2024-09-13T06:09:53.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.191+0000 7f98c588d640 1 -- 172.21.15.194:0/4233208263 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(70 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98bc0df040 con 0x7f98b8073c20 2024-09-13T06:09:53.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.191+0000 7f98c588d640 1 -- 172.21.15.194:0/4233208263 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== watch-notify(notify_complete (2) cookie 94201492104688 notify 141733920768 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f98bc0c6b60 con 0x7f98b8073c20 2024-09-13T06:09:53.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.191+0000 7f98c857e980 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:71 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55acfe7965f0 con 0x7f98bc0e2040 2024-09-13T06:09:53.197 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.195+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(71 9te6NH5mcdcq0Tc5i8i1 [delete,create,writefull 0~7] v33'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f98c000a4d0 con 0x7f98bc0e2040 2024-09-13T06:09:53.197 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.195+0000 7f98c857e980 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-09-13T06:09:53.197 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.195+0000 7f98c857e980 10 moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-13T06:09:53.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.195+0000 7f98c857e980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-09-13T06:09:53.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.195+0000 7f98c857e980 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:72 7.e 7:7759931f:::notify.3:head [notify cookie 94201492104688 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55acfe79b970 con 0x7f98b8073c20 2024-09-13T06:09:53.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.195+0000 7f98c588d640 1 -- 172.21.15.194:0/4233208263 <== osd.2 v2:172.21.15.194:6800/815615585 16 ==== watch-notify(notify (1) cookie 94201491939728 notify 141733920769 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7f98bc0c6b60 con 0x7f98b8073c20 2024-09-13T06:09:53.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.195+0000 7f97a97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920769 cookie 94201491939728 notifier 4290 bl.length()=177 2024-09-13T06:09:53.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.195+0000 7f97a97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-09-13T06:09:53.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.195+0000 7f97a97fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-13T06:09:53.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.195+0000 7f98c588d640 1 -- 172.21.15.194:0/4233208263 <== osd.2 v2:172.21.15.194:6800/815615585 17 ==== osd_op_reply(72 notify.3 [notify cookie 94201492104688 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f98bc0df040 con 0x7f98b8073c20 2024-09-13T06:09:53.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.195+0000 7f97a97fa640 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f96fc003410 con 0x7f98b8073c20 2024-09-13T06:09:53.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.195+0000 7f98c588d640 1 -- 172.21.15.194:0/4233208263 <== osd.2 v2:172.21.15.194:6800/815615585 18 ==== watch-notify(notify_complete (2) cookie 94201492104688 notify 141733920769 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f98bc0ed430 con 0x7f98b8073c20 2024-09-13T06:09:53.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.195+0000 7f98c588d640 1 -- 172.21.15.194:0/4233208263 <== osd.2 v2:172.21.15.194:6800/815615585 19 ==== osd_op_reply(73 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98bc0df040 con 0x7f98b8073c20 2024-09-13T06:09:53.199 INFO:teuthology.orchestra.run.smithi194.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T06:09:53.191222Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:09:53.191207Z","tags":[],"group_ids":[]} 2024-09-13T06:09:53.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.199+0000 7f977cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:53.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.199+0000 7f98c857e980 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:74 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94201491947744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55acfe7957d0 con 0x55acfe760880 2024-09-13T06:09:53.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.199+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 <== osd.1 v2:172.21.15.194:6808/3135444559 29 ==== osd_op_reply(74 data_loggenerations_metadata [watch unwatch cookie 94201491947744] v33'51 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f98c000a4d0 con 0x55acfe760880 2024-09-13T06:09:53.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.199+0000 7f98c857e980 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:75 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94201491925984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55acfe7957d0 con 0x7f98b8073c20 2024-09-13T06:09:53.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.199+0000 7f98c588d640 1 -- 172.21.15.194:0/4233208263 <== osd.2 v2:172.21.15.194:6800/815615585 20 ==== osd_op_reply(75 notify.0 [watch unwatch cookie 94201491925984] v33'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98bc0df040 con 0x7f98b8073c20 2024-09-13T06:09:53.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.199+0000 7f98c857e980 20 remove_watcher() i=0 2024-09-13T06:09:53.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.199+0000 7f98c857e980 2 removed watcher, disabling cache 2024-09-13T06:09:53.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.199+0000 7f98c857e980 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:76 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94201491931552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55acfe7957d0 con 0x55acfe760880 2024-09-13T06:09:53.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.203+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 <== osd.1 v2:172.21.15.194:6808/3135444559 30 ==== osd_op_reply(76 notify.1 [watch unwatch cookie 94201491931552] v33'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c000a4d0 con 0x55acfe760880 2024-09-13T06:09:53.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.203+0000 7f98c857e980 20 remove_watcher() i=1 2024-09-13T06:09:53.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.203+0000 7f98c857e980 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:77 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94201491935104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55acfe76c1a0 con 0x55acfe765270 2024-09-13T06:09:53.205 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.203+0000 7f98c608e640 1 -- 172.21.15.194:0/4233208263 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(77 notify.2 [watch unwatch cookie 94201491935104] v33'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98b8070030 con 0x55acfe765270 2024-09-13T06:09:53.205 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.203+0000 7f98c857e980 20 remove_watcher() i=2 2024-09-13T06:09:53.205 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.203+0000 7f98c857e980 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:78 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94201491939728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55acfe7957d0 con 0x7f98b8073c20 2024-09-13T06:09:53.206 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.207+0000 7f98c588d640 1 -- 172.21.15.194:0/4233208263 <== osd.2 v2:172.21.15.194:6800/815615585 21 ==== osd_op_reply(78 notify.3 [watch unwatch cookie 94201491939728] v33'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98bc0df040 con 0x7f98b8073c20 2024-09-13T06:09:53.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.207+0000 7f98c857e980 20 remove_watcher() i=3 2024-09-13T06:09:53.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.207+0000 7f98c857e980 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:79 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94201491937232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55acfe76cf80 con 0x55acfe760880 2024-09-13T06:09:53.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.207+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 <== osd.1 v2:172.21.15.194:6808/3135444559 31 ==== osd_op_reply(79 notify.4 [watch unwatch cookie 94201491937232] v33'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c000a4d0 con 0x55acfe760880 2024-09-13T06:09:53.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.207+0000 7f98c857e980 20 remove_watcher() i=4 2024-09-13T06:09:53.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.207+0000 7f98c857e980 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:80 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94201491945936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55acfe76c1a0 con 0x7f98bc0e2040 2024-09-13T06:09:53.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.211+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(80 notify.5 [watch unwatch cookie 94201491945936] v33'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c000a4d0 con 0x7f98bc0e2040 2024-09-13T06:09:53.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.211+0000 7f98c857e980 20 remove_watcher() i=5 2024-09-13T06:09:53.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.211+0000 7f98c857e980 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:81 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94201491943504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55acfe7957d0 con 0x7f98bc0e2040 2024-09-13T06:09:53.213 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.211+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 <== osd.0 v2:172.21.15.120:6800/1923744619 20 ==== osd_op_reply(81 notify.6 [watch unwatch cookie 94201491943504] v33'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c000a4d0 con 0x7f98bc0e2040 2024-09-13T06:09:53.213 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.211+0000 7f98c857e980 20 remove_watcher() i=6 2024-09-13T06:09:53.213 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.211+0000 7f98c857e980 1 -- 172.21.15.194:0/4233208263 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:82 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94201491950240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55acfe76d7d0 con 0x7f98bc0e2040 2024-09-13T06:09:53.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.215+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 <== osd.0 v2:172.21.15.120:6800/1923744619 21 ==== osd_op_reply(82 notify.7 [watch unwatch cookie 94201491950240] v33'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c000a4d0 con 0x7f98bc0e2040 2024-09-13T06:09:53.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.215+0000 7f98c857e980 20 remove_watcher() i=7 2024-09-13T06:09:53.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.215+0000 7f98c857e980 1 -- 172.21.15.194:0/4233208263 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f98bc0e2040 msgr2=0x7f98bc0e2930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.215+0000 7f98c857e980 1 --2- 172.21.15.194:0/4233208263 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f98bc0e2040 0x7f98bc0e2930 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.215+0000 7f98c857e980 1 -- 172.21.15.194:0/4233208263 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55acfe760880 msgr2=0x55acfe762d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.215+0000 7f98c857e980 1 --2- 172.21.15.194:0/4233208263 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55acfe760880 0x55acfe762d40 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.215+0000 7f98c857e980 1 -- 172.21.15.194:0/4233208263 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f98b8073c20 msgr2=0x7f98b8016650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.215+0000 7f98c857e980 1 --2- 172.21.15.194:0/4233208263 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f98b8073c20 0x7f98b8016650 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.215+0000 7f98c857e980 1 -- 172.21.15.194:0/4233208263 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55acfe765270 msgr2=0x55acfe767660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.215+0000 7f98c857e980 1 --2- 172.21.15.194:0/4233208263 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55acfe765270 0x55acfe767660 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.215+0000 7f98c857e980 1 -- 172.21.15.194:0/4233208263 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f9790034650 msgr2=0x7f9790036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.215+0000 7f98c857e980 1 --2- 172.21.15.194:0/4233208263 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f9790034650 0x7f9790036b10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f98bc0c8fd0 tx=0x7f98bc0c1040 comp rx=0 tx=0).stop 2024-09-13T06:09:53.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.215+0000 7f98c688f640 1 -- 172.21.15.194:0/4233208263 reap_dead start 2024-09-13T06:09:53.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.215+0000 7f98c857e980 1 -- 172.21.15.194:0/4233208263 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55acfe74e680 msgr2=0x55acfe7557f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.215+0000 7f98c857e980 1 --2- 172.21.15.194:0/4233208263 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55acfe74e680 0x55acfe7557f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f98b801c020 tx=0x7f98b8016e70 comp rx=0 tx=0).stop 2024-09-13T06:09:53.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.215+0000 7f98c857e980 1 -- 172.21.15.194:0/4233208263 shutdown_connections 2024-09-13T06:09:53.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.215+0000 7f98c857e980 1 --2- 172.21.15.194:0/4233208263 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55acfe74e680 0x55acfe7557f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.215+0000 7f98c857e980 1 -- 172.21.15.194:0/4233208263 >> 172.21.15.194:0/4233208263 conn(0x55acfe74aa60 msgr2=0x55acfe748b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:53.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.215+0000 7f98c857e980 1 -- 172.21.15.194:0/4233208263 shutdown_connections 2024-09-13T06:09:53.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.215+0000 7f98c857e980 1 -- 172.21.15.194:0/4233208263 wait complete. 2024-09-13T06:09:53.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.215+0000 7f98c857e980 1 -- 172.21.15.194:0/699488136 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f97a00346a0 msgr2=0x7f97a0036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.215+0000 7f98c857e980 1 --2- 172.21.15.194:0/699488136 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f97a00346a0 0x7f97a0036b60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x55acfe72b930 tx=0x7f98bc005ad0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.215+0000 7f98c857e980 1 -- 172.21.15.194:0/699488136 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55acfe741cf0 msgr2=0x55acfe742110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.215+0000 7f98c857e980 1 --2- 172.21.15.194:0/699488136 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55acfe741cf0 0x55acfe742110 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f98b804a010 tx=0x7f98b801af00 comp rx=0 tx=0).stop 2024-09-13T06:09:53.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.215+0000 7f98c857e980 1 -- 172.21.15.194:0/699488136 shutdown_connections 2024-09-13T06:09:53.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.215+0000 7f98c857e980 1 --2- 172.21.15.194:0/699488136 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f97a00346a0 0x7f97a0036b60 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.215+0000 7f98c857e980 1 --2- 172.21.15.194:0/699488136 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55acfe741cf0 0x55acfe742110 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.215+0000 7f98c857e980 1 -- 172.21.15.194:0/699488136 >> 172.21.15.194:0/699488136 conn(0x55acfe736e40 msgr2=0x55acfe7398c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:53.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.215+0000 7f98c857e980 1 -- 172.21.15.194:0/699488136 shutdown_connections 2024-09-13T06:09:53.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.215+0000 7f98c857e980 1 -- 172.21.15.194:0/699488136 wait complete. 2024-09-13T06:09:53.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.215+0000 7f98c857e980 1 -- 172.21.15.194:0/1906684091 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55acfe632890 msgr2=0x55acfe72af00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.215+0000 7f98c857e980 1 --2- 172.21.15.194:0/1906684091 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55acfe632890 0x55acfe72af00 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.215+0000 7f98c857e980 1 -- 172.21.15.194:0/1906684091 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55acfe7316f0 msgr2=0x55acfe733ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.215+0000 7f98c857e980 1 --2- 172.21.15.194:0/1906684091 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55acfe7316f0 0x55acfe733ae0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.215+0000 7f98c857e980 1 -- 172.21.15.194:0/1906684091 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55acfe72d7b0 msgr2=0x55acfe72fba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.215+0000 7f98c857e980 1 --2- 172.21.15.194:0/1906684091 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55acfe72d7b0 0x55acfe72fba0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.215+0000 7f98c857e980 1 -- 172.21.15.194:0/1906684091 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f97ac034650 msgr2=0x7f97ac036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.215+0000 7f98c857e980 1 --2- 172.21.15.194:0/1906684091 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f97ac034650 0x7f97ac036b10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f98bc0ae000 tx=0x7f98bc0a6000 comp rx=0 tx=0).stop 2024-09-13T06:09:53.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.215+0000 7f98c857e980 1 -- 172.21.15.194:0/1906684091 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55acfe62e510 msgr2=0x55acfe723e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.215+0000 7f98c857e980 1 --2- 172.21.15.194:0/1906684091 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55acfe62e510 0x55acfe723e00 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x55acfe719840 tx=0x7f98b8000ee0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.215+0000 7f98c688f640 1 -- 172.21.15.194:0/1906684091 reap_dead start 2024-09-13T06:09:53.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.215+0000 7f98c857e980 1 -- 172.21.15.194:0/1906684091 shutdown_connections 2024-09-13T06:09:53.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.215+0000 7f98c857e980 1 -- 172.21.15.194:0/1906684091 >> 172.21.15.194:0/1906684091 conn(0x55acfe62a030 msgr2=0x55acfe713f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:53.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.215+0000 7f98c857e980 1 -- 172.21.15.194:0/1906684091 shutdown_connections 2024-09-13T06:09:53.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.215+0000 7f98c857e980 1 -- 172.21.15.194:0/1906684091 wait complete. 2024-09-13T06:09:53.228 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T06:09:53.191222Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:09:53.191207Z', 'tags': [], 'group_ids': []} 2024-09-13T06:09:53.228 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-09-13T06:09:53.228 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-09-13T06:09:53.228 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --email foo@foo.com 2024-09-13T06:09:53.263 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:09:53.263 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:09:53.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.263+0000 7f01f52d2980 1 Processor -- start 2024-09-13T06:09:53.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.263+0000 7f01f52d2980 1 -- start start 2024-09-13T06:09:53.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.263+0000 7f01f52d2980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x5653dc916230 0x5653dc9a6740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.263+0000 7f01f52d2980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5653dc829ae0 con 0x5653dc9a6c80 2024-09-13T06:09:53.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.263+0000 7f01f52d2980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x5653dc84de30 con 0x5653dc916230 2024-09-13T06:09:53.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.263+0000 7f01f2de2640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x5653dc916230 0x5653dc9a6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.263+0000 7f01f2de2640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x5653dc916230 0x5653dc9a6740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44138/0 (socket says 172.21.15.194:44138) 2024-09-13T06:09:53.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.263+0000 7f01f2de2640 1 -- 172.21.15.194:0/4250148945 learned_addr learned my addr 172.21.15.194:0/4250148945 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:53.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.263+0000 7f01f25e1640 1 --1- 172.21.15.194:0/4250148945 >> v1:172.21.15.120:6789/0 conn(0x5653dc9a6c80 0x5653dc9a9070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:50924/0 (socket says 172.21.15.194:50924) 2024-09-13T06:09:53.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.263+0000 7f01f2de2640 1 -- 172.21.15.194:0/4250148945 >> v1:172.21.15.120:6789/0 conn(0x5653dc9a6c80 legacy=0x5653dc9a9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.263+0000 7f01f2de2640 1 -- 172.21.15.194:0/4250148945 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653dc916610 con 0x5653dc916230 2024-09-13T06:09:53.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.267+0000 7f01f2de2640 1 --2- 172.21.15.194:0/4250148945 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653dc916230 0x5653dc9a6740 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f01e400a5c0 tx=0x7f01e401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f390871b5cf28a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.267+0000 7f01f1de0640 1 -- 172.21.15.194:0/4250148945 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01e40a6070 con 0x5653dc916230 2024-09-13T06:09:53.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.267+0000 7f01f1de0640 1 -- 172.21.15.194:0/4250148945 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01e40af070 con 0x5653dc916230 2024-09-13T06:09:53.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.267+0000 7f01f1de0640 1 -- 172.21.15.194:0/4250148945 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01e40aa5c0 con 0x5653dc916230 2024-09-13T06:09:53.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.267+0000 7f01f52d2980 1 -- 172.21.15.194:0/4250148945 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653dc916230 msgr2=0x5653dc9a6740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.267+0000 7f01f52d2980 1 --2- 172.21.15.194:0/4250148945 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653dc916230 0x5653dc9a6740 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f01e400a5c0 tx=0x7f01e401b340 comp rx=0 tx=0).stop 2024-09-13T06:09:53.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.267+0000 7f01f52d2980 1 -- 172.21.15.194:0/4250148945 shutdown_connections 2024-09-13T06:09:53.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.267+0000 7f01f52d2980 1 --2- 172.21.15.194:0/4250148945 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653dc916230 0x5653dc9a6740 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.267+0000 7f01f52d2980 1 -- 172.21.15.194:0/4250148945 >> 172.21.15.194:0/4250148945 conn(0x5653dc99c030 msgr2=0x5653dc99e450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:53.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.267+0000 7f01f52d2980 1 -- 172.21.15.194:0/4250148945 shutdown_connections 2024-09-13T06:09:53.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.267+0000 7f01f52d2980 1 -- 172.21.15.194:0/4250148945 wait complete. 2024-09-13T06:09:53.283 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.283+0000 7f01f52d2980 1 Processor -- start 2024-09-13T06:09:53.283 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.283+0000 7f01f52d2980 1 -- start start 2024-09-13T06:09:53.283 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.283+0000 7f01f52d2980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653dc9a6c80 0x5653dca8ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.283 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.283+0000 7f01f52d2980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5653dc84f200 con 0x5653dc9a6c80 2024-09-13T06:09:53.284 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.283+0000 7f01f2de2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653dc9a6c80 0x5653dca8ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.284 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.283+0000 7f01f2de2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653dc9a6c80 0x5653dca8ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44150/0 (socket says 172.21.15.194:44150) 2024-09-13T06:09:53.284 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.283+0000 7f01f2de2640 1 -- 172.21.15.194:0/1351896203 learned_addr learned my addr 172.21.15.194:0/1351896203 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:53.284 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.283+0000 7f01f2de2640 1 -- 172.21.15.194:0/1351896203 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653dca8f340 con 0x5653dc9a6c80 2024-09-13T06:09:53.284 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.283+0000 7f01f2de2640 1 --2- 172.21.15.194:0/1351896203 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653dc9a6c80 0x5653dca8ed70 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f01e40199f0 tx=0x7f01e4003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5681183e90ba5ce5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.285 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.283+0000 7f00e0e09640 1 -- 172.21.15.194:0/1351896203 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01e40aa840 con 0x5653dc9a6c80 2024-09-13T06:09:53.285 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.283+0000 7f00e0e09640 1 -- 172.21.15.194:0/1351896203 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01e40aa9e0 con 0x5653dc9a6c80 2024-09-13T06:09:53.285 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.283+0000 7f00e0e09640 1 -- 172.21.15.194:0/1351896203 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01e40aacc0 con 0x5653dc9a6c80 2024-09-13T06:09:53.286 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.283+0000 7f01f52d2980 1 -- 172.21.15.194:0/1351896203 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653dc9a6c80 msgr2=0x5653dca8ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.286 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.283+0000 7f01f52d2980 1 --2- 172.21.15.194:0/1351896203 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653dc9a6c80 0x5653dca8ed70 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f01e40199f0 tx=0x7f01e4003030 comp rx=0 tx=0).stop 2024-09-13T06:09:53.286 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.283+0000 7f01f52d2980 1 -- 172.21.15.194:0/1351896203 shutdown_connections 2024-09-13T06:09:53.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.283+0000 7f01f52d2980 1 --2- 172.21.15.194:0/1351896203 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653dc9a6c80 0x5653dca8ed70 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.283+0000 7f01f52d2980 1 -- 172.21.15.194:0/1351896203 >> 172.21.15.194:0/1351896203 conn(0x5653dc99c030 msgr2=0x5653dca8a900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:53.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.283+0000 7f01f52d2980 1 -- 172.21.15.194:0/1351896203 shutdown_connections 2024-09-13T06:09:53.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.283+0000 7f01f52d2980 1 -- 172.21.15.194:0/1351896203 wait complete. 2024-09-13T06:09:53.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.283+0000 7f01f52d2980 1 Processor -- start 2024-09-13T06:09:53.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.283+0000 7f01f52d2980 1 -- start start 2024-09-13T06:09:53.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.283+0000 7f01f52d2980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653dc9a6c80 0x5653dca96050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.283+0000 7f01f52d2980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5653dc9ad1c0 con 0x5653dc9a6c80 2024-09-13T06:09:53.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.287+0000 7f01f2de2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653dc9a6c80 0x5653dca96050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.287+0000 7f01f2de2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653dc9a6c80 0x5653dca96050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44160/0 (socket says 172.21.15.194:44160) 2024-09-13T06:09:53.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.287+0000 7f01f2de2640 1 -- 172.21.15.194:0/1043685269 learned_addr learned my addr 172.21.15.194:0/1043685269 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:53.289 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.287+0000 7f01f2de2640 1 -- 172.21.15.194:0/1043685269 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653dca96590 con 0x5653dc9a6c80 2024-09-13T06:09:53.289 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.287+0000 7f01f2de2640 1 --2- 172.21.15.194:0/1043685269 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653dc9a6c80 0x5653dca96050 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f01e4005410 tx=0x7f01e40180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.289 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.287+0000 7f00df606640 1 -- 172.21.15.194:0/1043685269 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01e40abec0 con 0x5653dc9a6c80 2024-09-13T06:09:53.290 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.287+0000 7f00df606640 1 -- 172.21.15.194:0/1043685269 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01e4000e50 con 0x5653dc9a6c80 2024-09-13T06:09:53.290 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.287+0000 7f01f52d2980 1 -- 172.21.15.194:0/1043685269 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5653dca96820 con 0x5653dc9a6c80 2024-09-13T06:09:53.290 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.287+0000 7f00df606640 1 -- 172.21.15.194:0/1043685269 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01e40bda30 con 0x5653dc9a6c80 2024-09-13T06:09:53.290 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.287+0000 7f01f52d2980 1 -- 172.21.15.194:0/1043685269 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653dca99500 con 0x5653dc9a6c80 2024-09-13T06:09:53.290 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.287+0000 7f00df606640 1 -- 172.21.15.194:0/1043685269 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f01e40ce030 con 0x5653dc9a6c80 2024-09-13T06:09:53.290 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.287+0000 7f00df606640 1 --2- 172.21.15.194:0/1043685269 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f00d8034840 0x7f00d8036d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.290 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.287+0000 7f00df606640 1 -- 172.21.15.194:0/1043685269 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f01e40cc020 con 0x5653dc9a6c80 2024-09-13T06:09:53.290 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.287+0000 7f01f25e1640 1 --2- 172.21.15.194:0/1043685269 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f00d8034840 0x7f00d8036d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.290 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.287+0000 7f01f52d2980 1 --2- 172.21.15.194:0/1043685269 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5653dca9afd0 0x5653dca9d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.290 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.287+0000 7f01f52d2980 1 -- 172.21.15.194:0/1043685269 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5653dca9da90 con 0x5653dca9afd0 2024-09-13T06:09:53.290 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.287+0000 7f01f35e3640 1 --2- 172.21.15.194:0/1043685269 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5653dca9afd0 0x5653dca9d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.290 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.287+0000 7f01f25e1640 1 --2- 172.21.15.194:0/1043685269 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f00d8034840 0x7f00d8036d00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f01e8000f70 tx=0x7f01e8001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.291 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.287+0000 7f01f35e3640 1 --2- 172.21.15.194:0/1043685269 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5653dca9afd0 0x5653dca9d420 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.292 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.287+0000 7f01f35e3640 1 -- 172.21.15.194:0/1043685269 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f01ec00a4d0 con 0x5653dca9afd0 2024-09-13T06:09:53.292 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.287+0000 7f01f52d2980 1 -- 172.21.15.194:0/1043685269 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5653dca9a720 con 0x5653dca9afd0 2024-09-13T06:09:53.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.291+0000 7f01f35e3640 1 -- 172.21.15.194:0/1043685269 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f01ec00a4d0 con 0x5653dca9afd0 2024-09-13T06:09:53.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.291+0000 7f01f52d2980 1 --2- 172.21.15.194:0/1043685269 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5653dca9fdc0 0x5653dcaa21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.291+0000 7f01f52d2980 1 -- 172.21.15.194:0/1043685269 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5653dcaa28a0 con 0x5653dca9fdc0 2024-09-13T06:09:53.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.291+0000 7f01f2de2640 1 --2- 172.21.15.194:0/1043685269 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5653dca9fdc0 0x5653dcaa21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.291+0000 7f01f2de2640 1 --2- 172.21.15.194:0/1043685269 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5653dca9fdc0 0x5653dcaa21b0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.291+0000 7f01f2de2640 1 -- 172.21.15.194:0/1043685269 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f01e40c69f0 con 0x5653dca9fdc0 2024-09-13T06:09:53.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.291+0000 7f01f52d2980 1 -- 172.21.15.194:0/1043685269 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5653dca9ec60 con 0x5653dca9afd0 2024-09-13T06:09:53.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.291+0000 7f01f35e3640 1 -- 172.21.15.194:0/1043685269 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f01ec00a4d0 con 0x5653dca9afd0 2024-09-13T06:09:53.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.291+0000 7f01f52d2980 1 --2- 172.21.15.194:0/1043685269 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5653dcaa3d00 0x5653dcaa60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.291+0000 7f01f52d2980 1 -- 172.21.15.194:0/1043685269 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5653dcaa6830 con 0x5653dcaa3d00 2024-09-13T06:09:53.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.291+0000 7f01f25e1640 1 --2- 172.21.15.194:0/1043685269 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5653dcaa3d00 0x5653dcaa60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.291+0000 7f01f25e1640 1 --2- 172.21.15.194:0/1043685269 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5653dcaa3d00 0x5653dcaa60f0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.294 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.291+0000 7f01f25e1640 1 -- 172.21.15.194:0/1043685269 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f01e800f6a0 con 0x5653dcaa3d00 2024-09-13T06:09:53.295 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.291+0000 7f01f52d2980 1 Processor -- start 2024-09-13T06:09:53.295 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.291+0000 7f01f52d2980 1 -- start start 2024-09-13T06:09:53.295 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.291+0000 7f01f52d2980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653dcab4300 0x5653dcab4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.295 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.291+0000 7f01f52d2980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5653dc8a8800 con 0x5653dcab4300 2024-09-13T06:09:53.295 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.291+0000 7f01f2de2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653dcab4300 0x5653dcab4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.295 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.291+0000 7f01f2de2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653dcab4300 0x5653dcab4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44162/0 (socket says 172.21.15.194:44162) 2024-09-13T06:09:53.295 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.291+0000 7f01f2de2640 1 -- 172.21.15.194:0/3047972928 learned_addr learned my addr 172.21.15.194:0/3047972928 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:53.296 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.291+0000 7f01f2de2640 1 -- 172.21.15.194:0/3047972928 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653dcab4c60 con 0x5653dcab4300 2024-09-13T06:09:53.296 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.295+0000 7f01f2de2640 1 --2- 172.21.15.194:0/3047972928 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653dcab4300 0x5653dcab4720 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f01e40e3710 tx=0x7f01e40c5d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.296 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.295+0000 7f00dce01640 1 -- 172.21.15.194:0/3047972928 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01e40e31c0 con 0x5653dcab4300 2024-09-13T06:09:53.296 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.295+0000 7f00dce01640 1 -- 172.21.15.194:0/3047972928 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01e40e3360 con 0x5653dcab4300 2024-09-13T06:09:53.296 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.295+0000 7f00dce01640 1 -- 172.21.15.194:0/3047972928 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01e40c5760 con 0x5653dcab4300 2024-09-13T06:09:53.296 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.295+0000 7f01f52d2980 1 -- 172.21.15.194:0/3047972928 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5653dcab4ef0 con 0x5653dcab4300 2024-09-13T06:09:53.296 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.295+0000 7f01f52d2980 1 -- 172.21.15.194:0/3047972928 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653dcab7b70 con 0x5653dcab4300 2024-09-13T06:09:53.298 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.295+0000 7f00dce01640 1 -- 172.21.15.194:0/3047972928 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f01e40c5900 con 0x5653dcab4300 2024-09-13T06:09:53.298 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.295+0000 7f00dce01640 1 --2- 172.21.15.194:0/3047972928 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f00cc034650 0x7f00cc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.298 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.295+0000 7f00dce01640 1 -- 172.21.15.194:0/3047972928 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f01e40efc50 con 0x5653dcab4300 2024-09-13T06:09:53.298 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.295+0000 7f01f25e1640 1 --2- 172.21.15.194:0/3047972928 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f00cc034650 0x7f00cc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.298 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.295+0000 7f01f52d2980 1 Processor -- start 2024-09-13T06:09:53.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.295+0000 7f01f52d2980 1 -- start start 2024-09-13T06:09:53.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.295+0000 7f01f25e1640 1 --2- 172.21.15.194:0/3047972928 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f00cc034650 0x7f00cc036b10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x5653dca9df40 tx=0x7f01e800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.295+0000 7f01f52d2980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653dcac0d00 0x5653dcac10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.295+0000 7f01f52d2980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5653dca8f600 con 0x5653dcac0d00 2024-09-13T06:09:53.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.295+0000 7f01f2de2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653dcac0d00 0x5653dcac10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.295+0000 7f01f2de2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653dcac0d00 0x5653dcac10e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44164/0 (socket says 172.21.15.194:44164) 2024-09-13T06:09:53.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.295+0000 7f01f2de2640 1 -- 172.21.15.194:0/4228607869 learned_addr learned my addr 172.21.15.194:0/4228607869 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:53.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.295+0000 7f01f2de2640 1 -- 172.21.15.194:0/4228607869 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653dcac16b0 con 0x5653dcac0d00 2024-09-13T06:09:53.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.295+0000 7f01f2de2640 1 --2- 172.21.15.194:0/4228607869 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653dcac0d00 0x5653dcac10e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f01e40c7890 tx=0x7f01e40c7690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdea30b25ca0cece server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.295+0000 7f00d67fc640 1 -- 172.21.15.194:0/4228607869 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01e40f3030 con 0x5653dcac0d00 2024-09-13T06:09:53.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.295+0000 7f00d67fc640 1 -- 172.21.15.194:0/4228607869 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01e40b35b0 con 0x5653dcac0d00 2024-09-13T06:09:53.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.299+0000 7f00d67fc640 1 -- 172.21.15.194:0/4228607869 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01e40cfc00 con 0x5653dcac0d00 2024-09-13T06:09:53.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.299+0000 7f01f52d2980 1 -- 172.21.15.194:0/4228607869 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653dcac0d00 msgr2=0x5653dcac10e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.299+0000 7f01f52d2980 1 --2- 172.21.15.194:0/4228607869 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653dcac0d00 0x5653dcac10e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f01e40c7890 tx=0x7f01e40c7690 comp rx=0 tx=0).stop 2024-09-13T06:09:53.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.299+0000 7f01f52d2980 1 -- 172.21.15.194:0/4228607869 shutdown_connections 2024-09-13T06:09:53.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.299+0000 7f01f52d2980 1 --2- 172.21.15.194:0/4228607869 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653dcac0d00 0x5653dcac10e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.299+0000 7f01f52d2980 1 -- 172.21.15.194:0/4228607869 >> 172.21.15.194:0/4228607869 conn(0x5653dcabd030 msgr2=0x5653dcabb130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:53.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.299+0000 7f01f52d2980 1 -- 172.21.15.194:0/4228607869 shutdown_connections 2024-09-13T06:09:53.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.299+0000 7f01f52d2980 1 -- 172.21.15.194:0/4228607869 wait complete. 2024-09-13T06:09:53.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.299+0000 7f01f52d2980 1 Processor -- start 2024-09-13T06:09:53.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.299+0000 7f01f52d2980 1 -- start start 2024-09-13T06:09:53.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.299+0000 7f01f52d2980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653dcac0d00 0x5653dcac7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.299+0000 7f01f52d2980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5653dcac1a40 con 0x5653dcac0d00 2024-09-13T06:09:53.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.299+0000 7f01f2de2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653dcac0d00 0x5653dcac7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.299+0000 7f01f2de2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653dcac0d00 0x5653dcac7e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44168/0 (socket says 172.21.15.194:44168) 2024-09-13T06:09:53.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.299+0000 7f01f2de2640 1 -- 172.21.15.194:0/4253175794 learned_addr learned my addr 172.21.15.194:0/4253175794 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:53.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.299+0000 7f01f2de2640 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653dcac83b0 con 0x5653dcac0d00 2024-09-13T06:09:53.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.299+0000 7f01f2de2640 1 --2- 172.21.15.194:0/4253175794 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653dcac0d00 0x5653dcac7e70 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f01e40afff0 tx=0x7f01e40aff40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.303 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.299+0000 7f00d4ff9640 1 -- 172.21.15.194:0/4253175794 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01e40c9e60 con 0x5653dcac0d00 2024-09-13T06:09:53.303 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.299+0000 7f01f52d2980 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5653dcac83b0 con 0x5653dcac0d00 2024-09-13T06:09:53.303 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.299+0000 7f00d4ff9640 1 -- 172.21.15.194:0/4253175794 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01e40a44a0 con 0x5653dcac0d00 2024-09-13T06:09:53.303 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.299+0000 7f01f52d2980 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653dcac8820 con 0x5653dcac0d00 2024-09-13T06:09:53.303 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.299+0000 7f00d4ff9640 1 -- 172.21.15.194:0/4253175794 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01e40a4650 con 0x5653dcac0d00 2024-09-13T06:09:53.307 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.303+0000 7f00d4ff9640 1 -- 172.21.15.194:0/4253175794 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f01e40db3a0 con 0x5653dcac0d00 2024-09-13T06:09:53.307 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.303+0000 7f00d4ff9640 1 --2- 172.21.15.194:0/4253175794 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f00bc0345b0 0x7f00bc036a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.307 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.303+0000 7f00d4ff9640 1 -- 172.21.15.194:0/4253175794 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f01e40fe030 con 0x5653dcac0d00 2024-09-13T06:09:53.307 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.303+0000 7f01f25e1640 1 --2- 172.21.15.194:0/4253175794 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f00bc0345b0 0x7f00bc036a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.308 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.303+0000 7f01f52d2980 20 rados->read ofs=0 len=0 2024-09-13T06:09:53.308 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.303+0000 7f01f52d2980 1 --2- 172.21.15.194:0/4253175794 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5653dcad2d80 0x5653dcad5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.308 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.303+0000 7f01f52d2980 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5653dcad5990 con 0x5653dcad2d80 2024-09-13T06:09:53.308 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.303+0000 7f01f35e3640 1 --2- 172.21.15.194:0/4253175794 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5653dcad2d80 0x5653dcad5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.308 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.303+0000 7f01f25e1640 1 --2- 172.21.15.194:0/4253175794 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f00bc0345b0 0x7f00bc036a70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f01e800c010 tx=0x7f01e8010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.308 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.303+0000 7f01f35e3640 1 --2- 172.21.15.194:0/4253175794 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5653dcad2d80 0x5653dcad5240 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.308 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.303+0000 7f01f35e3640 1 -- 172.21.15.194:0/4253175794 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f01ec00a4d0 con 0x5653dcad2d80 2024-09-13T06:09:53.308 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.303+0000 7f01f52d2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:53.308 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.303+0000 7f01f52d2980 20 realm 2024-09-13T06:09:53.308 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.303+0000 7f01f52d2980 20 rados->read ofs=0 len=0 2024-09-13T06:09:53.308 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.303+0000 7f01f52d2980 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5653dcad5da0 con 0x5653dcad2d80 2024-09-13T06:09:53.309 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.303+0000 7f01f35e3640 1 -- 172.21.15.194:0/4253175794 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f01ec00a4d0 con 0x5653dcad2d80 2024-09-13T06:09:53.309 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.303+0000 7f01f52d2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:53.309 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.303+0000 7f01f52d2980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:09:53.309 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.303+0000 7f01f52d2980 20 rados->read ofs=0 len=0 2024-09-13T06:09:53.309 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.303+0000 7f01f52d2980 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5653dcad6640 con 0x5653dcad2d80 2024-09-13T06:09:53.309 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.303+0000 7f01f35e3640 1 -- 172.21.15.194:0/4253175794 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f01ec00a4d0 con 0x5653dcad2d80 2024-09-13T06:09:53.309 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.303+0000 7f01f52d2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:53.309 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.303+0000 7f01f52d2980 20 rados->read ofs=0 len=0 2024-09-13T06:09:53.309 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.303+0000 7f01f52d2980 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5653dcad69e0 con 0x5653dcad2d80 2024-09-13T06:09:53.309 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.303+0000 7f01f35e3640 1 -- 172.21.15.194:0/4253175794 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f01ec00a4d0 con 0x5653dcad2d80 2024-09-13T06:09:53.309 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.303+0000 7f01f52d2980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:53.309 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.303+0000 7f01f52d2980 20 rados->read ofs=0 len=0 2024-09-13T06:09:53.310 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.303+0000 7f01f52d2980 1 --2- 172.21.15.194:0/4253175794 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5653dcad7740 0x5653dcad9b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.310 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.303+0000 7f01f52d2980 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5653dcada1d0 con 0x5653dcad7740 2024-09-13T06:09:53.310 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.303+0000 7f01f2de2640 1 --2- 172.21.15.194:0/4253175794 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5653dcad7740 0x5653dcad9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.310 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.303+0000 7f01f2de2640 1 --2- 172.21.15.194:0/4253175794 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5653dcad7740 0x5653dcad9b30 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.310 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.303+0000 7f01f2de2640 1 -- 172.21.15.194:0/4253175794 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f01e40c69f0 con 0x5653dcad7740 2024-09-13T06:09:53.310 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.303+0000 7f01f52d2980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:09:53.310 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.303+0000 7f01f52d2980 20 searching for the correct realm 2024-09-13T06:09:53.310 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.303+0000 7f01f52d2980 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5653dcadba30 con 0x5653dcad7740 2024-09-13T06:09:53.310 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.303+0000 7f01f2de2640 1 -- 172.21.15.194:0/4253175794 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01e40c69f0 con 0x5653dcad7740 2024-09-13T06:09:53.310 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.303+0000 7f01f2de2640 1 --2- 172.21.15.194:0/4253175794 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f01e40e6040 0x7f01e40db8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.310 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.303+0000 7f01f2de2640 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5653dcadba30 con 0x7f01e40e6040 2024-09-13T06:09:53.310 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.303+0000 7f01f25e1640 1 --2- 172.21.15.194:0/4253175794 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f01e40e6040 0x7f01e40db8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.311 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.307+0000 7f01f25e1640 1 --2- 172.21.15.194:0/4253175794 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f01e40e6040 0x7f01e40db8f0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.311 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.307+0000 7f01f25e1640 1 -- 172.21.15.194:0/4253175794 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f01e8037040 con 0x7f01e40e6040 2024-09-13T06:09:53.311 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.307+0000 7f01f25e1640 1 --2- 172.21.15.194:0/4253175794 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f01e801fbe0 0x7f01e803a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.311 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.307+0000 7f01f25e1640 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5653dcadba30 con 0x7f01e801fbe0 2024-09-13T06:09:53.311 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.307+0000 7f01f35e3640 1 --2- 172.21.15.194:0/4253175794 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f01e801fbe0 0x7f01e803a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.315 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.307+0000 7f01f35e3640 1 --2- 172.21.15.194:0/4253175794 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f01e801fbe0 0x7f01e803a3c0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.315 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.307+0000 7f01f35e3640 1 -- 172.21.15.194:0/4253175794 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01ec00a4d0 con 0x7f01e801fbe0 2024-09-13T06:09:53.315 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.307+0000 7f01f35e3640 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5653dcad69e0 con 0x5653dcad2d80 2024-09-13T06:09:53.315 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.307+0000 7f01f35e3640 1 -- 172.21.15.194:0/4253175794 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01ec00a4d0 con 0x5653dcad2d80 2024-09-13T06:09:53.315 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.307+0000 7f01f35e3640 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5653dcad69e0 con 0x5653dcad2d80 2024-09-13T06:09:53.315 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.307+0000 7f01f35e3640 1 -- 172.21.15.194:0/4253175794 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01ec00a4d0 con 0x5653dcad2d80 2024-09-13T06:09:53.315 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.307+0000 7f01f35e3640 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5653dcad69e0 con 0x7f01e801fbe0 2024-09-13T06:09:53.315 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.307+0000 7f01f35e3640 1 -- 172.21.15.194:0/4253175794 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01ec00a4d0 con 0x7f01e801fbe0 2024-09-13T06:09:53.315 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.307+0000 7f01f35e3640 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5653dcad69e0 con 0x7f01e801fbe0 2024-09-13T06:09:53.315 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.311+0000 7f01f35e3640 1 -- 172.21.15.194:0/4253175794 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01ec00a4d0 con 0x7f01e801fbe0 2024-09-13T06:09:53.316 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.311+0000 7f01f35e3640 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5653dcad69e0 con 0x7f01e40e6040 2024-09-13T06:09:53.316 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.311+0000 7f01f25e1640 1 -- 172.21.15.194:0/4253175794 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01e8037040 con 0x7f01e40e6040 2024-09-13T06:09:53.316 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.311+0000 7f01f25e1640 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5653dcad69e0 con 0x5653dcad7740 2024-09-13T06:09:53.316 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.311+0000 7f01f2de2640 1 -- 172.21.15.194:0/4253175794 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01e40c69f0 con 0x5653dcad7740 2024-09-13T06:09:53.316 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.311+0000 7f01f2de2640 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5653dcad69e0 con 0x5653dcad2d80 2024-09-13T06:09:53.316 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.311+0000 7f01f35e3640 1 -- 172.21.15.194:0/4253175794 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01ec00a4d0 con 0x5653dcad2d80 2024-09-13T06:09:53.316 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.311+0000 7f01f35e3640 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5653dcad69e0 con 0x7f01e801fbe0 2024-09-13T06:09:53.316 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.311+0000 7f01f35e3640 1 -- 172.21.15.194:0/4253175794 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01ec00a4d0 con 0x7f01e801fbe0 2024-09-13T06:09:53.316 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.311+0000 7f01f35e3640 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5653dcad69e0 con 0x5653dcad2d80 2024-09-13T06:09:53.316 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.311+0000 7f01f35e3640 1 -- 172.21.15.194:0/4253175794 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01ec00a4d0 con 0x5653dcad2d80 2024-09-13T06:09:53.316 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.311+0000 7f01f35e3640 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5653dcad69e0 con 0x7f01e40e6040 2024-09-13T06:09:53.316 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.311+0000 7f01f25e1640 1 -- 172.21.15.194:0/4253175794 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f01e8037040 con 0x7f01e40e6040 2024-09-13T06:09:53.316 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.311+0000 7f01f25e1640 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5653dcad69e0 con 0x5653dcad7740 2024-09-13T06:09:53.316 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.311+0000 7f01f2de2640 1 -- 172.21.15.194:0/4253175794 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01e40c69f0 con 0x5653dcad7740 2024-09-13T06:09:53.317 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.311+0000 7f01f2de2640 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5653dcad69e0 con 0x5653dcad7740 2024-09-13T06:09:53.317 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.311+0000 7f01f2de2640 1 -- 172.21.15.194:0/4253175794 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01e40c69f0 con 0x5653dcad7740 2024-09-13T06:09:53.317 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.311+0000 7f01f2de2640 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5653dcad69e0 con 0x7f01e801fbe0 2024-09-13T06:09:53.317 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.311+0000 7f01f35e3640 1 -- 172.21.15.194:0/4253175794 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01ec00a4d0 con 0x7f01e801fbe0 2024-09-13T06:09:53.317 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.311+0000 7f01f35e3640 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5653dcad69e0 con 0x5653dcad7740 2024-09-13T06:09:53.317 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.311+0000 7f01f2de2640 1 -- 172.21.15.194:0/4253175794 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01e40c69f0 con 0x5653dcad7740 2024-09-13T06:09:53.317 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.311+0000 7f01f2de2640 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5653dcad69e0 con 0x5653dcad7740 2024-09-13T06:09:53.317 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.311+0000 7f01f2de2640 1 -- 172.21.15.194:0/4253175794 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01e40c69f0 con 0x5653dcad7740 2024-09-13T06:09:53.317 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.311+0000 7f01f2de2640 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5653dcad69e0 con 0x5653dcad2d80 2024-09-13T06:09:53.317 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.315+0000 7f01f35e3640 1 -- 172.21.15.194:0/4253175794 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01ec00a4d0 con 0x5653dcad2d80 2024-09-13T06:09:53.317 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.315+0000 7f01f35e3640 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5653dcad69e0 con 0x5653dcad2d80 2024-09-13T06:09:53.317 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.315+0000 7f01f35e3640 1 -- 172.21.15.194:0/4253175794 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f01ec00a4d0 con 0x5653dcad2d80 2024-09-13T06:09:53.317 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.315+0000 7f01f35e3640 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5653dcad69e0 con 0x7f01e801fbe0 2024-09-13T06:09:53.322 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.315+0000 7f01f35e3640 1 -- 172.21.15.194:0/4253175794 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01ec00a4d0 con 0x7f01e801fbe0 2024-09-13T06:09:53.323 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.315+0000 7f01f35e3640 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5653dcad69e0 con 0x5653dcad7740 2024-09-13T06:09:53.323 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.315+0000 7f01f2de2640 1 -- 172.21.15.194:0/4253175794 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01e40c69f0 con 0x5653dcad7740 2024-09-13T06:09:53.323 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.315+0000 7f01f2de2640 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5653dcad69e0 con 0x7f01e40e6040 2024-09-13T06:09:53.323 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.315+0000 7f01f25e1640 1 -- 172.21.15.194:0/4253175794 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01e8037040 con 0x7f01e40e6040 2024-09-13T06:09:53.323 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.315+0000 7f01f25e1640 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5653dcad69e0 con 0x5653dcad2d80 2024-09-13T06:09:53.323 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.315+0000 7f01f35e3640 1 -- 172.21.15.194:0/4253175794 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01ec00a4d0 con 0x5653dcad2d80 2024-09-13T06:09:53.323 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.315+0000 7f01f35e3640 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5653dcad69e0 con 0x7f01e801fbe0 2024-09-13T06:09:53.323 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.315+0000 7f01f35e3640 1 -- 172.21.15.194:0/4253175794 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01ec00a4d0 con 0x7f01e801fbe0 2024-09-13T06:09:53.323 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.315+0000 7f01f35e3640 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5653dcad69e0 con 0x5653dcad7740 2024-09-13T06:09:53.323 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.315+0000 7f01f2de2640 1 -- 172.21.15.194:0/4253175794 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f01e40c69f0 con 0x5653dcad7740 2024-09-13T06:09:53.323 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.315+0000 7f01f2de2640 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5653dcad69e0 con 0x7f01e801fbe0 2024-09-13T06:09:53.323 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.315+0000 7f01f35e3640 1 -- 172.21.15.194:0/4253175794 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01ec00a4d0 con 0x7f01e801fbe0 2024-09-13T06:09:53.324 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.315+0000 7f01f35e3640 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5653dcad69e0 con 0x7f01e40e6040 2024-09-13T06:09:53.324 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.315+0000 7f01f25e1640 1 -- 172.21.15.194:0/4253175794 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01e8037040 con 0x7f01e40e6040 2024-09-13T06:09:53.324 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.315+0000 7f01f25e1640 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5653dcad69e0 con 0x5653dcad7740 2024-09-13T06:09:53.324 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.319+0000 7f01f2de2640 1 -- 172.21.15.194:0/4253175794 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01e40c69f0 con 0x5653dcad7740 2024-09-13T06:09:53.324 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.319+0000 7f01f2de2640 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5653dcad69e0 con 0x7f01e801fbe0 2024-09-13T06:09:53.324 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.319+0000 7f01f35e3640 1 -- 172.21.15.194:0/4253175794 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01ec00a4d0 con 0x7f01e801fbe0 2024-09-13T06:09:53.324 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.319+0000 7f01f35e3640 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5653dcad69e0 con 0x5653dcad2d80 2024-09-13T06:09:53.324 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.319+0000 7f01f35e3640 1 -- 172.21.15.194:0/4253175794 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f01ec00a4d0 con 0x5653dcad2d80 2024-09-13T06:09:53.324 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.319+0000 7f01f35e3640 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5653dcad69e0 con 0x7f01e40e6040 2024-09-13T06:09:53.324 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.319+0000 7f01f25e1640 1 -- 172.21.15.194:0/4253175794 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01e8037040 con 0x7f01e40e6040 2024-09-13T06:09:53.324 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.319+0000 7f01f52d2980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:09:53.324 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.319+0000 7f01f52d2980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:09:53.324 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.319+0000 7f01f52d2980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:09:53.325 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.319+0000 7f01f52d2980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:09:53.325 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.319+0000 7f01f52d2980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:09:53.325 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.319+0000 7f01f52d2980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:09:53.325 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.319+0000 7f01f52d2980 20 rados->read ofs=0 len=0 2024-09-13T06:09:53.325 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.319+0000 7f01f52d2980 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5653dcadab50 con 0x5653dcad2d80 2024-09-13T06:09:53.325 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.319+0000 7f01f35e3640 1 -- 172.21.15.194:0/4253175794 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f01ec00a4d0 con 0x5653dcad2d80 2024-09-13T06:09:53.325 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.319+0000 7f01f52d2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:53.325 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.319+0000 7f01f52d2980 20 rados->read ofs=0 len=0 2024-09-13T06:09:53.325 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.319+0000 7f01f52d2980 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5653dcadb3a0 con 0x5653dcad2d80 2024-09-13T06:09:53.325 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.319+0000 7f01f35e3640 1 -- 172.21.15.194:0/4253175794 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f01ec00a4d0 con 0x5653dcad2d80 2024-09-13T06:09:53.325 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.319+0000 7f01f52d2980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:53.325 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.319+0000 7f01f52d2980 20 rados->read ofs=0 len=0 2024-09-13T06:09:53.325 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.319+0000 7f01f52d2980 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5653dcada7b0 con 0x7f01e40e6040 2024-09-13T06:09:53.326 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.319+0000 7f01f25e1640 1 -- 172.21.15.194:0/4253175794 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f01e8037040 con 0x7f01e40e6040 2024-09-13T06:09:53.326 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.319+0000 7f01f52d2980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:09:53.326 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.319+0000 7f01f52d2980 20 zone default found 2024-09-13T06:09:53.326 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.319+0000 7f01f52d2980 4 Realm: () 2024-09-13T06:09:53.326 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.319+0000 7f01f52d2980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:09:53.326 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.319+0000 7f01f52d2980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:09:53.326 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.319+0000 7f01f52d2980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:09:53.326 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.319+0000 7f01f52d2980 20 zonegroup default 2024-09-13T06:09:53.326 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.319+0000 7f01f52d2980 20 rados->read ofs=0 len=0 2024-09-13T06:09:53.326 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.319+0000 7f01f52d2980 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5653dcadbe60 con 0x7f01e801fbe0 2024-09-13T06:09:53.326 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.319+0000 7f01f35e3640 1 -- 172.21.15.194:0/4253175794 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f01ec00a4d0 con 0x7f01e801fbe0 2024-09-13T06:09:53.326 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.319+0000 7f01f52d2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:53.326 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.319+0000 7f01f52d2980 20 rados->read ofs=0 len=0 2024-09-13T06:09:53.326 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.319+0000 7f01f52d2980 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5653dcadd8d0 con 0x5653dcad7740 2024-09-13T06:09:53.327 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.319+0000 7f01f2de2640 1 -- 172.21.15.194:0/4253175794 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f01e40c69f0 con 0x5653dcad7740 2024-09-13T06:09:53.327 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.319+0000 7f01f52d2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:53.327 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.319+0000 7f01f52d2980 20 rados->read ofs=0 len=0 2024-09-13T06:09:53.327 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.319+0000 7f01f52d2980 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5653dcadddc0 con 0x5653dcad7740 2024-09-13T06:09:53.327 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.319+0000 7f01f2de2640 1 -- 172.21.15.194:0/4253175794 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f01e40c69f0 con 0x5653dcad7740 2024-09-13T06:09:53.327 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.319+0000 7f01f52d2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:53.327 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.319+0000 7f01f52d2980 20 started sync module instance, tier type = 2024-09-13T06:09:53.327 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.319+0000 7f01f52d2980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:09:53.327 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.319+0000 7f01f52d2980 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5653dcadcce0 con 0x7f01e40e6040 2024-09-13T06:09:53.329 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.323+0000 7f01f25e1640 1 -- 172.21.15.194:0/4253175794 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(44 notify.0 [create] v33'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01e8037040 con 0x7f01e40e6040 2024-09-13T06:09:53.329 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.323+0000 7f01f52d2980 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94918184653056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5653dcadc940 con 0x7f01e40e6040 2024-09-13T06:09:53.329 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.323+0000 7f01f52d2980 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5653dcadecf0 con 0x5653dcad2d80 2024-09-13T06:09:53.329 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.323+0000 7f01f35e3640 1 -- 172.21.15.194:0/4253175794 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v33'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01ec00a4d0 con 0x5653dcad2d80 2024-09-13T06:09:53.329 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.323+0000 7f01f25e1640 1 -- 172.21.15.194:0/4253175794 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94918184653056] v33'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01e8037040 con 0x7f01e40e6040 2024-09-13T06:09:53.329 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.323+0000 7f01f52d2980 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94918184659280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5653dcadf3c0 con 0x5653dcad2d80 2024-09-13T06:09:53.329 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.323+0000 7f01f52d2980 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5653dcade260 con 0x5653dcad7740 2024-09-13T06:09:53.329 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.327+0000 7f01f35e3640 1 -- 172.21.15.194:0/4253175794 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94918184659280] v33'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01ec00a4d0 con 0x5653dcad2d80 2024-09-13T06:09:53.329 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.327+0000 7f01f2de2640 1 -- 172.21.15.194:0/4253175794 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v33'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01e40c69f0 con 0x5653dcad7740 2024-09-13T06:09:53.329 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.327+0000 7f01f52d2980 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94918184660496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5653dcadfe60 con 0x5653dcad7740 2024-09-13T06:09:53.330 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.327+0000 7f01f52d2980 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5653dcae06b0 con 0x7f01e40e6040 2024-09-13T06:09:53.330 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.327+0000 7f01f25e1640 1 -- 172.21.15.194:0/4253175794 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(50 notify.3 [create] v33'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01e8037040 con 0x7f01e40e6040 2024-09-13T06:09:53.330 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.327+0000 7f01f52d2980 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94918184667808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5653dcae1370 con 0x7f01e40e6040 2024-09-13T06:09:53.330 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.327+0000 7f01f52d2980 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5653dcae1d30 con 0x5653dcad2d80 2024-09-13T06:09:53.330 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.331+0000 7f01f2de2640 1 -- 172.21.15.194:0/4253175794 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94918184660496] v33'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01e40c69f0 con 0x5653dcad7740 2024-09-13T06:09:53.331 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.331+0000 7f01f25e1640 1 -- 172.21.15.194:0/4253175794 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94918184667808] v33'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01e8037040 con 0x7f01e40e6040 2024-09-13T06:09:53.332 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.331+0000 7f01f35e3640 1 -- 172.21.15.194:0/4253175794 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v33'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01ec00a4d0 con 0x5653dcad2d80 2024-09-13T06:09:53.332 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.331+0000 7f01f52d2980 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94918184663472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5653dcae0fd0 con 0x5653dcad2d80 2024-09-13T06:09:53.332 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.331+0000 7f01f52d2980 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5653dcae1d30 con 0x7f01e801fbe0 2024-09-13T06:09:53.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.331+0000 7f01f35e3640 1 -- 172.21.15.194:0/4253175794 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(54 notify.5 [create] v33'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01ec00a4d0 con 0x7f01e801fbe0 2024-09-13T06:09:53.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.331+0000 7f01f52d2980 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94918184674112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5653dcae1d30 con 0x7f01e801fbe0 2024-09-13T06:09:53.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.331+0000 7f01f52d2980 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5653dcae3390 con 0x7f01e801fbe0 2024-09-13T06:09:53.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.335+0000 7f01f35e3640 1 -- 172.21.15.194:0/4253175794 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94918184663472] v33'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01ec00a4d0 con 0x5653dcad2d80 2024-09-13T06:09:53.336 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.335+0000 7f01f35e3640 1 -- 172.21.15.194:0/4253175794 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94918184674112] v33'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01ec00a4d0 con 0x7f01e801fbe0 2024-09-13T06:09:53.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.339+0000 7f01f35e3640 1 -- 172.21.15.194:0/4253175794 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(56 notify.6 [create] v33'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01ec00a4d0 con 0x7f01e801fbe0 2024-09-13T06:09:53.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.339+0000 7f01f52d2980 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94918184677088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5653dcae1d30 con 0x7f01e801fbe0 2024-09-13T06:09:53.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.339+0000 7f01f52d2980 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5653dcae3300 con 0x7f01e801fbe0 2024-09-13T06:09:53.341 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.339+0000 7f01f35e3640 1 -- 172.21.15.194:0/4253175794 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(58 notify.7 [create] v33'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01ec00a4d0 con 0x7f01e801fbe0 2024-09-13T06:09:53.341 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.339+0000 7f01f52d2980 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94918184678144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5653dcae3c30 con 0x7f01e801fbe0 2024-09-13T06:09:53.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.339+0000 7f01f52d2980 20 add_watcher() i=0 2024-09-13T06:09:53.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.339+0000 7f01f52d2980 20 add_watcher() i=1 2024-09-13T06:09:53.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.339+0000 7f01f52d2980 20 add_watcher() i=2 2024-09-13T06:09:53.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.339+0000 7f01f52d2980 20 add_watcher() i=3 2024-09-13T06:09:53.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.339+0000 7f01f52d2980 20 add_watcher() i=4 2024-09-13T06:09:53.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.339+0000 7f01f52d2980 20 add_watcher() i=5 2024-09-13T06:09:53.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.339+0000 7f01f35e3640 1 -- 172.21.15.194:0/4253175794 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94918184677088] v33'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01ec00a4d0 con 0x7f01e801fbe0 2024-09-13T06:09:53.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.339+0000 7f01f52d2980 20 add_watcher() i=6 2024-09-13T06:09:53.343 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.343+0000 7f01f35e3640 1 -- 172.21.15.194:0/4253175794 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94918184678144] v33'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01ec00a4d0 con 0x7f01e801fbe0 2024-09-13T06:09:53.343 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.343+0000 7f01f52d2980 20 add_watcher() i=7 2024-09-13T06:09:53.343 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.343+0000 7f01f52d2980 2 all 8 watchers are set, enabling cache 2024-09-13T06:09:53.343 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.343+0000 7f01f52d2980 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5653dcae3c30 con 0x5653dcad2d80 2024-09-13T06:09:53.344 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.343+0000 7f01f35e3640 1 -- 172.21.15.194:0/4253175794 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f01ec00a4d0 con 0x5653dcad2d80 2024-09-13T06:09:53.344 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.343+0000 7f01f52d2980 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94918184679296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5653dcae3ba0 con 0x5653dcad2d80 2024-09-13T06:09:53.345 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.343+0000 7f01f35e3640 1 -- 172.21.15.194:0/4253175794 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94918184679296] v33'52 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f01ec00a4d0 con 0x5653dcad2d80 2024-09-13T06:09:53.345 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.343+0000 7f00a97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:53.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.343+0000 7f01f52d2980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:09:53.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.343+0000 7f01f52d2980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:09:53.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.343+0000 7f01f52d2980 5 note: GC not initialized 2024-09-13T06:09:53.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.343+0000 7f0023fff640 20 reqs_thread_entry: start 2024-09-13T06:09:53.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.343+0000 7f01f52d2980 20 init_complete bucket index max shards: 11 2024-09-13T06:09:53.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.343+0000 7f01f52d2980 20 Filter name: none 2024-09-13T06:09:53.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.343+0000 7f0021ffb640 20 reqs_thread_entry: start 2024-09-13T06:09:53.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.343+0000 7f01f52d2980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T06:09:53.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.343+0000 7f01f52d2980 20 rados->read ofs=0 len=0 2024-09-13T06:09:53.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.343+0000 7f01f52d2980 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5653dcb0a310 con 0x7f01e801fbe0 2024-09-13T06:09:53.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.343+0000 7f01f35e3640 1 -- 172.21.15.194:0/4253175794 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f01ec00a4d0 con 0x7f01e801fbe0 2024-09-13T06:09:53.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.343+0000 7f01f52d2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:53.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.343+0000 7f01f52d2980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-13T06:09:53.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.343+0000 7f01f52d2980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T06:09:53.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.343+0000 7f01f52d2980 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-09-13T06:09:53.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.343+0000 7f01f52d2980 20 rados->read ofs=0 len=0 2024-09-13T06:09:53.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.343+0000 7f01f52d2980 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5653dcb08ab0 con 0x5653dcad2d80 2024-09-13T06:09:53.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.347+0000 7f01f35e3640 1 -- 172.21.15.194:0/4253175794 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(63 foo@foo.com [stat out=16b,read 0~7 out=7b] v0'0 uv1 ondisk = 0) ==== 197+0+23 (crc 0 0 0) 0x7f01ec00a4d0 con 0x5653dcad2d80 2024-09-13T06:09:53.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.347+0000 7f01f52d2980 20 rados_obj.operate() r=0 bl.length=7 2024-09-13T06:09:53.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.347+0000 7f01f52d2980 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x5 2024-09-13T06:09:53.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.347+0000 7f01f52d2980 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-13T06:09:53.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.347+0000 7f01f52d2980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T06:09:53.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.347+0000 7f01f52d2980 20 rados->read ofs=0 len=0 2024-09-13T06:09:53.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.347+0000 7f01f52d2980 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5653dcb08ea0 con 0x5653dcad2d80 2024-09-13T06:09:53.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.347+0000 7f01f35e3640 1 -- 172.21.15.194:0/4253175794 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(64 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f01ec00a4d0 con 0x5653dcad2d80 2024-09-13T06:09:53.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.347+0000 7f01f52d2980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T06:09:53.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.347+0000 7f01f52d2980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T06:09:53.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.347+0000 7f01f52d2980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:09:53.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.347+0000 7f01f52d2980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:09:53.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.347+0000 7f01f52d2980 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+foo 2024-09-13T06:09:53.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.347+0000 7f01f52d2980 20 get_user_info_from_index found 0 xattrs 2024-09-13T06:09:53.349 INFO:teuthology.orchestra.run.smithi194.stderr:could not create user: unable to parse parameters, email: foo@foo.com is the email address of an existing user 2024-09-13T06:09:53.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.347+0000 7f00a97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:53.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.347+0000 7f01f52d2980 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94918184679296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5653dcae95a0 con 0x5653dcad2d80 2024-09-13T06:09:53.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.347+0000 7f01f35e3640 1 -- 172.21.15.194:0/4253175794 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94918184679296] v33'53 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f01ec00a4d0 con 0x5653dcad2d80 2024-09-13T06:09:53.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.347+0000 7f01f52d2980 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94918184653056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5653dcb08140 con 0x7f01e40e6040 2024-09-13T06:09:53.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.351+0000 7f01f25e1640 1 -- 172.21.15.194:0/4253175794 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94918184653056] v33'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01e8037040 con 0x7f01e40e6040 2024-09-13T06:09:53.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.351+0000 7f01f52d2980 20 remove_watcher() i=0 2024-09-13T06:09:53.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.351+0000 7f01f52d2980 2 removed watcher, disabling cache 2024-09-13T06:09:53.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.351+0000 7f01f52d2980 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94918184659280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5653dcadd100 con 0x5653dcad2d80 2024-09-13T06:09:53.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.351+0000 7f01f35e3640 1 -- 172.21.15.194:0/4253175794 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94918184659280] v33'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01ec00a4d0 con 0x5653dcad2d80 2024-09-13T06:09:53.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.351+0000 7f01f52d2980 20 remove_watcher() i=1 2024-09-13T06:09:53.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.351+0000 7f01f52d2980 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94918184660496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5653dcade950 con 0x5653dcad7740 2024-09-13T06:09:53.355 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.355+0000 7f01f2de2640 1 -- 172.21.15.194:0/4253175794 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94918184660496] v33'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01e40c69f0 con 0x5653dcad7740 2024-09-13T06:09:53.355 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.355+0000 7f01f52d2980 20 remove_watcher() i=2 2024-09-13T06:09:53.355 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.355+0000 7f01f52d2980 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94918184667808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5653dcadd100 con 0x7f01e40e6040 2024-09-13T06:09:53.357 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.355+0000 7f01f25e1640 1 -- 172.21.15.194:0/4253175794 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94918184667808] v33'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01e8037040 con 0x7f01e40e6040 2024-09-13T06:09:53.357 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.355+0000 7f01f52d2980 20 remove_watcher() i=3 2024-09-13T06:09:53.357 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.355+0000 7f01f52d2980 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94918184663472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5653dcae0aa0 con 0x5653dcad2d80 2024-09-13T06:09:53.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.359+0000 7f01f35e3640 1 -- 172.21.15.194:0/4253175794 <== osd.1 v2:172.21.15.194:6808/3135444559 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94918184663472] v33'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01ec00a4d0 con 0x5653dcad2d80 2024-09-13T06:09:53.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.359+0000 7f01f52d2980 20 remove_watcher() i=4 2024-09-13T06:09:53.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.359+0000 7f01f52d2980 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94918184674112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5653dcadd100 con 0x7f01e801fbe0 2024-09-13T06:09:53.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.359+0000 7f01f35e3640 1 -- 172.21.15.194:0/4253175794 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94918184674112] v33'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01ec00a4d0 con 0x7f01e801fbe0 2024-09-13T06:09:53.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.359+0000 7f01f52d2980 20 remove_watcher() i=5 2024-09-13T06:09:53.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.359+0000 7f01f52d2980 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94918184677088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5653dcae0aa0 con 0x7f01e801fbe0 2024-09-13T06:09:53.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.363+0000 7f01f35e3640 1 -- 172.21.15.194:0/4253175794 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94918184677088] v33'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01ec00a4d0 con 0x7f01e801fbe0 2024-09-13T06:09:53.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.363+0000 7f01f52d2980 20 remove_watcher() i=6 2024-09-13T06:09:53.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.363+0000 7f01f52d2980 1 -- 172.21.15.194:0/4253175794 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94918184678144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5653dcadd100 con 0x7f01e801fbe0 2024-09-13T06:09:53.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.363+0000 7f01f35e3640 1 -- 172.21.15.194:0/4253175794 <== osd.0 v2:172.21.15.120:6800/1923744619 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94918184678144] v33'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01ec00a4d0 con 0x7f01e801fbe0 2024-09-13T06:09:53.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.363+0000 7f01f52d2980 20 remove_watcher() i=7 2024-09-13T06:09:53.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.363+0000 7f01f52d2980 1 -- 172.21.15.194:0/4253175794 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f01e801fbe0 msgr2=0x7f01e803a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.363+0000 7f01f52d2980 1 --2- 172.21.15.194:0/4253175794 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f01e801fbe0 0x7f01e803a3c0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.363+0000 7f01f52d2980 1 -- 172.21.15.194:0/4253175794 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5653dcad2d80 msgr2=0x5653dcad5240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.363+0000 7f01f52d2980 1 --2- 172.21.15.194:0/4253175794 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5653dcad2d80 0x5653dcad5240 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.363+0000 7f01f52d2980 1 -- 172.21.15.194:0/4253175794 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f01e40e6040 msgr2=0x7f01e40db8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.363+0000 7f01f52d2980 1 --2- 172.21.15.194:0/4253175794 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f01e40e6040 0x7f01e40db8f0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.363+0000 7f01f52d2980 1 -- 172.21.15.194:0/4253175794 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5653dcad7740 msgr2=0x5653dcad9b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.363+0000 7f01f52d2980 1 --2- 172.21.15.194:0/4253175794 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5653dcad7740 0x5653dcad9b30 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.363+0000 7f01f52d2980 1 -- 172.21.15.194:0/4253175794 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f00bc0345b0 msgr2=0x7f00bc036a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.363+0000 7f01f52d2980 1 --2- 172.21.15.194:0/4253175794 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f00bc0345b0 0x7f00bc036a70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f01e800c010 tx=0x7f01e8010000 comp rx=0 tx=0).stop 2024-09-13T06:09:53.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.363+0000 7f01f35e3640 1 -- 172.21.15.194:0/4253175794 reap_dead start 2024-09-13T06:09:53.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.363+0000 7f01f52d2980 1 -- 172.21.15.194:0/4253175794 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653dcac0d00 msgr2=0x5653dcac7e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.363+0000 7f01f52d2980 1 --2- 172.21.15.194:0/4253175794 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653dcac0d00 0x5653dcac7e70 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f01e40afff0 tx=0x7f01e40aff40 comp rx=0 tx=0).stop 2024-09-13T06:09:53.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.363+0000 7f01f52d2980 1 -- 172.21.15.194:0/4253175794 shutdown_connections 2024-09-13T06:09:53.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.363+0000 7f01f52d2980 1 --2- 172.21.15.194:0/4253175794 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653dcac0d00 0x5653dcac7e70 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.363+0000 7f01f52d2980 1 -- 172.21.15.194:0/4253175794 >> 172.21.15.194:0/4253175794 conn(0x5653dcabd030 msgr2=0x5653dcabb100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:53.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.363+0000 7f01f52d2980 1 -- 172.21.15.194:0/4253175794 shutdown_connections 2024-09-13T06:09:53.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.363+0000 7f01f52d2980 1 -- 172.21.15.194:0/4253175794 wait complete. 2024-09-13T06:09:53.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.363+0000 7f01f52d2980 1 -- 172.21.15.194:0/3047972928 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f00cc034650 msgr2=0x7f00cc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.363+0000 7f01f52d2980 1 --2- 172.21.15.194:0/3047972928 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f00cc034650 0x7f00cc036b10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x5653dca9df40 tx=0x7f01e800f000 comp rx=0 tx=0).stop 2024-09-13T06:09:53.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.363+0000 7f01f52d2980 1 -- 172.21.15.194:0/3047972928 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653dcab4300 msgr2=0x5653dcab4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.363+0000 7f01f52d2980 1 --2- 172.21.15.194:0/3047972928 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653dcab4300 0x5653dcab4720 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f01e40e3710 tx=0x7f01e40c5d40 comp rx=0 tx=0).stop 2024-09-13T06:09:53.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.363+0000 7f01f52d2980 1 -- 172.21.15.194:0/3047972928 shutdown_connections 2024-09-13T06:09:53.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.363+0000 7f01f52d2980 1 --2- 172.21.15.194:0/3047972928 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f00cc034650 0x7f00cc036b10 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.363+0000 7f01f52d2980 1 --2- 172.21.15.194:0/3047972928 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653dcab4300 0x5653dcab4720 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.363+0000 7f01f52d2980 1 -- 172.21.15.194:0/3047972928 >> 172.21.15.194:0/3047972928 conn(0x5653dcaa9450 msgr2=0x5653dcaabed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:53.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.363+0000 7f01f52d2980 1 -- 172.21.15.194:0/3047972928 shutdown_connections 2024-09-13T06:09:53.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.363+0000 7f01f52d2980 1 -- 172.21.15.194:0/3047972928 wait complete. 2024-09-13T06:09:53.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.367+0000 7f01f52d2980 1 -- 172.21.15.194:0/1043685269 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5653dca9afd0 msgr2=0x5653dca9d420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.367+0000 7f01f52d2980 1 --2- 172.21.15.194:0/1043685269 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5653dca9afd0 0x5653dca9d420 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.367+0000 7f01f52d2980 1 -- 172.21.15.194:0/1043685269 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5653dcaa3d00 msgr2=0x5653dcaa60f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.367+0000 7f01f52d2980 1 --2- 172.21.15.194:0/1043685269 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5653dcaa3d00 0x5653dcaa60f0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.367+0000 7f01f52d2980 1 -- 172.21.15.194:0/1043685269 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5653dca9fdc0 msgr2=0x5653dcaa21b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.367+0000 7f01f52d2980 1 --2- 172.21.15.194:0/1043685269 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5653dca9fdc0 0x5653dcaa21b0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.367+0000 7f01f52d2980 1 -- 172.21.15.194:0/1043685269 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f00d8034840 msgr2=0x7f00d8036d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.367+0000 7f01f52d2980 1 --2- 172.21.15.194:0/1043685269 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f00d8034840 0x7f00d8036d00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f01e8000f70 tx=0x7f01e8001380 comp rx=0 tx=0).stop 2024-09-13T06:09:53.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.367+0000 7f01f52d2980 1 -- 172.21.15.194:0/1043685269 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653dc9a6c80 msgr2=0x5653dca96050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.367+0000 7f01f52d2980 1 --2- 172.21.15.194:0/1043685269 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653dc9a6c80 0x5653dca96050 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f01e4005410 tx=0x7f01e40180e0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.367+0000 7f01f35e3640 1 -- 172.21.15.194:0/1043685269 reap_dead start 2024-09-13T06:09:53.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.367+0000 7f01f52d2980 1 -- 172.21.15.194:0/1043685269 shutdown_connections 2024-09-13T06:09:53.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.367+0000 7f01f52d2980 1 -- 172.21.15.194:0/1043685269 >> 172.21.15.194:0/1043685269 conn(0x5653dc99c030 msgr2=0x5653dca89480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:53.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.367+0000 7f01f52d2980 1 -- 172.21.15.194:0/1043685269 shutdown_connections 2024-09-13T06:09:53.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.367+0000 7f01f52d2980 1 -- 172.21.15.194:0/1043685269 wait complete. 2024-09-13T06:09:53.377 DEBUG:teuthology.orchestra.run:got remote process result: 240 2024-09-13T06:09:53.378 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T06:09:53.378 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T06:09:53.378 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T06:09:53.451 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:09:53.451 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:09:53.452 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.451+0000 7f7bad3c2980 1 Processor -- start 2024-09-13T06:09:53.452 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.451+0000 7f7bad3c2980 1 -- start start 2024-09-13T06:09:53.452 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.451+0000 7f7bad3c2980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x5612d22eb690 0x5612d22eba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.452 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.451+0000 7f7bad3c2980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5612d2173ae0 con 0x5612d22ebfe0 2024-09-13T06:09:53.452 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.451+0000 7f7bad3c2980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x5612d2197e30 con 0x5612d22eb690 2024-09-13T06:09:53.453 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.451+0000 7f7baaed2640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x5612d22eb690 0x5612d22eba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.453 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.451+0000 7f7baaed2640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x5612d22eb690 0x5612d22eba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44176/0 (socket says 172.21.15.194:44176) 2024-09-13T06:09:53.453 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.451+0000 7f7baaed2640 1 -- 172.21.15.194:0/3654054830 learned_addr learned my addr 172.21.15.194:0/3654054830 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:53.453 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.451+0000 7f7baaed2640 1 -- 172.21.15.194:0/3654054830 >> v1:172.21.15.120:6789/0 conn(0x5612d22ebfe0 legacy=0x5612d22f0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.453 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.451+0000 7f7baaed2640 1 -- 172.21.15.194:0/3654054830 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612d22f3260 con 0x5612d22eb690 2024-09-13T06:09:53.456 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.455+0000 7f7baaed2640 1 --2- 172.21.15.194:0/3654054830 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5612d22eb690 0x5612d22eba70 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c00a4e0 tx=0x7f7b9c01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a80745224a7d1b5f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.456 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.455+0000 7f7ba9ed0640 1 -- 172.21.15.194:0/3654054830 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b9c0aa540 con 0x5612d22eb690 2024-09-13T06:09:53.456 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.455+0000 7f7ba9ed0640 1 -- 172.21.15.194:0/3654054830 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b9c0aa6e0 con 0x5612d22eb690 2024-09-13T06:09:53.456 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.455+0000 7f7ba9ed0640 1 -- 172.21.15.194:0/3654054830 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b9c0aaa40 con 0x5612d22eb690 2024-09-13T06:09:53.457 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.455+0000 7f7bad3c2980 1 -- 172.21.15.194:0/3654054830 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5612d22eb690 msgr2=0x5612d22eba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.457 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.455+0000 7f7bad3c2980 1 --2- 172.21.15.194:0/3654054830 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5612d22eb690 0x5612d22eba70 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c00a4e0 tx=0x7f7b9c01b090 comp rx=0 tx=0).stop 2024-09-13T06:09:53.457 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.455+0000 7f7bad3c2980 1 -- 172.21.15.194:0/3654054830 shutdown_connections 2024-09-13T06:09:53.457 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.455+0000 7f7bad3c2980 1 --2- 172.21.15.194:0/3654054830 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5612d22eb690 0x5612d22eba70 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.457 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.455+0000 7f7bad3c2980 1 -- 172.21.15.194:0/3654054830 >> 172.21.15.194:0/3654054830 conn(0x5612d22e71b0 msgr2=0x5612d22e95d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:53.457 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.455+0000 7f7bad3c2980 1 -- 172.21.15.194:0/3654054830 shutdown_connections 2024-09-13T06:09:53.457 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.455+0000 7f7bad3c2980 1 -- 172.21.15.194:0/3654054830 wait complete. 2024-09-13T06:09:53.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.471+0000 7f7bad3c2980 1 Processor -- start 2024-09-13T06:09:53.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.471+0000 7f7bad3c2980 1 -- start start 2024-09-13T06:09:53.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.471+0000 7f7bad3c2980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5612d22ebfe0 0x5612d23d6b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.471+0000 7f7bad3c2980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5612d2199200 con 0x5612d22ebfe0 2024-09-13T06:09:53.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.471+0000 7f7baaed2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5612d22ebfe0 0x5612d23d6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.471+0000 7f7baaed2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5612d22ebfe0 0x5612d23d6b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44178/0 (socket says 172.21.15.194:44178) 2024-09-13T06:09:53.474 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.471+0000 7f7baaed2640 1 -- 172.21.15.194:0/4215307468 learned_addr learned my addr 172.21.15.194:0/4215307468 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:53.474 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.471+0000 7f7baaed2640 1 -- 172.21.15.194:0/4215307468 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612d23d7100 con 0x5612d22ebfe0 2024-09-13T06:09:53.474 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.471+0000 7f7baaed2640 1 --2- 172.21.15.194:0/4215307468 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5612d22ebfe0 0x5612d23d6b30 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c019740 tx=0x7f7b9c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49b47e47aacc695e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.474 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.471+0000 7f7a98e09640 1 -- 172.21.15.194:0/4215307468 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b9c0b9070 con 0x5612d22ebfe0 2024-09-13T06:09:53.474 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.471+0000 7f7a98e09640 1 -- 172.21.15.194:0/4215307468 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b9c0aa990 con 0x5612d22ebfe0 2024-09-13T06:09:53.474 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.471+0000 7f7a98e09640 1 -- 172.21.15.194:0/4215307468 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b9c0aac70 con 0x5612d22ebfe0 2024-09-13T06:09:53.476 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.475+0000 7f7bad3c2980 1 -- 172.21.15.194:0/4215307468 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5612d22ebfe0 msgr2=0x5612d23d6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.476 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.475+0000 7f7bad3c2980 1 --2- 172.21.15.194:0/4215307468 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5612d22ebfe0 0x5612d23d6b30 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c019740 tx=0x7f7b9c0033b0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.476 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.475+0000 7f7bad3c2980 1 -- 172.21.15.194:0/4215307468 shutdown_connections 2024-09-13T06:09:53.476 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.475+0000 7f7bad3c2980 1 --2- 172.21.15.194:0/4215307468 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5612d22ebfe0 0x5612d23d6b30 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.476 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.475+0000 7f7bad3c2980 1 -- 172.21.15.194:0/4215307468 >> 172.21.15.194:0/4215307468 conn(0x5612d22e71b0 msgr2=0x5612d23d26c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:53.476 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.475+0000 7f7bad3c2980 1 -- 172.21.15.194:0/4215307468 shutdown_connections 2024-09-13T06:09:53.476 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.475+0000 7f7bad3c2980 1 -- 172.21.15.194:0/4215307468 wait complete. 2024-09-13T06:09:53.476 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.475+0000 7f7bad3c2980 1 Processor -- start 2024-09-13T06:09:53.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.475+0000 7f7bad3c2980 1 -- start start 2024-09-13T06:09:53.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.475+0000 7f7bad3c2980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5612d23ddf10 0x5612d23de330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.475+0000 7f7bad3c2980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5612d22f2ca0 con 0x5612d23ddf10 2024-09-13T06:09:53.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.475+0000 7f7baaed2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5612d23ddf10 0x5612d23de330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.475+0000 7f7baaed2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5612d23ddf10 0x5612d23de330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44190/0 (socket says 172.21.15.194:44190) 2024-09-13T06:09:53.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.475+0000 7f7baaed2640 1 -- 172.21.15.194:0/376217420 learned_addr learned my addr 172.21.15.194:0/376217420 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:53.479 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.475+0000 7f7baaed2640 1 -- 172.21.15.194:0/376217420 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612d23de870 con 0x5612d23ddf10 2024-09-13T06:09:53.479 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.475+0000 7f7baaed2640 1 --2- 172.21.15.194:0/376217420 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5612d23ddf10 0x5612d23de330 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c019740 tx=0x7f7b9c017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.479 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.475+0000 7f7a97606640 1 -- 172.21.15.194:0/376217420 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b9c0b9050 con 0x5612d23ddf10 2024-09-13T06:09:53.479 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.475+0000 7f7a97606640 1 -- 172.21.15.194:0/376217420 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b9c0b6830 con 0x5612d23ddf10 2024-09-13T06:09:53.479 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.475+0000 7f7bad3c2980 1 -- 172.21.15.194:0/376217420 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5612d23deb00 con 0x5612d23ddf10 2024-09-13T06:09:53.479 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.475+0000 7f7a97606640 1 -- 172.21.15.194:0/376217420 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b9c0b6b30 con 0x5612d23ddf10 2024-09-13T06:09:53.479 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.475+0000 7f7bad3c2980 1 -- 172.21.15.194:0/376217420 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612d23e1660 con 0x5612d23ddf10 2024-09-13T06:09:53.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.475+0000 7f7a97606640 1 -- 172.21.15.194:0/376217420 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7b9c0b6d10 con 0x5612d23ddf10 2024-09-13T06:09:53.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.479+0000 7f7a97606640 1 --2- 172.21.15.194:0/376217420 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7a900346a0 0x7f7a90036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.479+0000 7f7a97606640 1 -- 172.21.15.194:0/376217420 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f7b9c0c3070 con 0x5612d23ddf10 2024-09-13T06:09:53.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.479+0000 7f7baa6d1640 1 --2- 172.21.15.194:0/376217420 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7a900346a0 0x7f7a90036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.479+0000 7f7bad3c2980 1 --2- 172.21.15.194:0/376217420 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5612d23e33b0 0x5612d23e57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.479+0000 7f7bad3c2980 1 -- 172.21.15.194:0/376217420 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5612d23e5d20 con 0x5612d23e33b0 2024-09-13T06:09:53.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.479+0000 7f7bab6d3640 1 --2- 172.21.15.194:0/376217420 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5612d23e33b0 0x5612d23e57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.479+0000 7f7baa6d1640 1 --2- 172.21.15.194:0/376217420 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7a900346a0 0x7f7a90036b60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7b94000f70 tx=0x7f7b94001420 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.479+0000 7f7bab6d3640 1 --2- 172.21.15.194:0/376217420 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5612d23e33b0 0x5612d23e57a0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.482 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.479+0000 7f7bab6d3640 1 -- 172.21.15.194:0/376217420 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7ba40083f0 con 0x5612d23e33b0 2024-09-13T06:09:53.482 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.479+0000 7f7bad3c2980 1 -- 172.21.15.194:0/376217420 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5612d23e65e0 con 0x5612d23e33b0 2024-09-13T06:09:53.482 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.479+0000 7f7bab6d3640 1 -- 172.21.15.194:0/376217420 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7ba40083f0 con 0x5612d23e33b0 2024-09-13T06:09:53.483 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.479+0000 7f7bad3c2980 1 --2- 172.21.15.194:0/376217420 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5612d23e7ef0 0x5612d23ea3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.483 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.479+0000 7f7bad3c2980 1 -- 172.21.15.194:0/376217420 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5612d23eab40 con 0x5612d23e7ef0 2024-09-13T06:09:53.483 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.479+0000 7f7baaed2640 1 --2- 172.21.15.194:0/376217420 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5612d23e7ef0 0x5612d23ea3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.483 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.479+0000 7f7baaed2640 1 --2- 172.21.15.194:0/376217420 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5612d23e7ef0 0x5612d23ea3b0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.483 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.479+0000 7f7baaed2640 1 -- 172.21.15.194:0/376217420 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7b9c0ce340 con 0x5612d23e7ef0 2024-09-13T06:09:53.483 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.479+0000 7f7bad3c2980 1 -- 172.21.15.194:0/376217420 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5612d23e6e30 con 0x5612d23e33b0 2024-09-13T06:09:53.483 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.479+0000 7f7bab6d3640 1 -- 172.21.15.194:0/376217420 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7ba40083f0 con 0x5612d23e33b0 2024-09-13T06:09:53.483 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.479+0000 7f7bad3c2980 1 --2- 172.21.15.194:0/376217420 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5612d23ebfa0 0x5612d23ee390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.483 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.479+0000 7f7bad3c2980 1 -- 172.21.15.194:0/376217420 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5612d23eea80 con 0x5612d23ebfa0 2024-09-13T06:09:53.483 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.479+0000 7f7baa6d1640 1 --2- 172.21.15.194:0/376217420 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5612d23ebfa0 0x5612d23ee390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.483 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.479+0000 7f7baa6d1640 1 --2- 172.21.15.194:0/376217420 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5612d23ebfa0 0x5612d23ee390 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.484 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.479+0000 7f7baa6d1640 1 -- 172.21.15.194:0/376217420 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7b9400d040 con 0x5612d23ebfa0 2024-09-13T06:09:53.484 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.483+0000 7f7bad3c2980 1 Processor -- start 2024-09-13T06:09:53.484 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.483+0000 7f7bad3c2980 1 -- start start 2024-09-13T06:09:53.484 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.483+0000 7f7bad3c2980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5612d2262590 0x5612d2260c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.484 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.483+0000 7f7bad3c2980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5612d21f2800 con 0x5612d2262590 2024-09-13T06:09:53.485 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.483+0000 7f7baaed2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5612d2262590 0x5612d2260c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.485 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.483+0000 7f7baaed2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5612d2262590 0x5612d2260c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44204/0 (socket says 172.21.15.194:44204) 2024-09-13T06:09:53.485 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.483+0000 7f7baaed2640 1 -- 172.21.15.194:0/3422572884 learned_addr learned my addr 172.21.15.194:0/3422572884 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:53.485 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.483+0000 7f7baaed2640 1 -- 172.21.15.194:0/3422572884 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612d22629b0 con 0x5612d2262590 2024-09-13T06:09:53.485 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.483+0000 7f7baaed2640 1 --2- 172.21.15.194:0/3422572884 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5612d2262590 0x5612d2260c10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c0ce8d0 tx=0x7f7b9c0dce10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.486 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.483+0000 7f7a94e01640 1 -- 172.21.15.194:0/3422572884 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b9c0cec80 con 0x5612d2262590 2024-09-13T06:09:53.486 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.483+0000 7f7a94e01640 1 -- 172.21.15.194:0/3422572884 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b9c0cee20 con 0x5612d2262590 2024-09-13T06:09:53.486 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.483+0000 7f7a94e01640 1 -- 172.21.15.194:0/3422572884 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b9c0e4c20 con 0x5612d2262590 2024-09-13T06:09:53.486 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.483+0000 7f7bad3c2980 1 -- 172.21.15.194:0/3422572884 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5612d22611b0 con 0x5612d2262590 2024-09-13T06:09:53.486 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.483+0000 7f7bad3c2980 1 -- 172.21.15.194:0/3422572884 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612d2261680 con 0x5612d2262590 2024-09-13T06:09:53.487 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.483+0000 7f7a94e01640 1 -- 172.21.15.194:0/3422572884 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7b9c0b3040 con 0x5612d2262590 2024-09-13T06:09:53.487 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.483+0000 7f7a94e01640 1 --2- 172.21.15.194:0/3422572884 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7a84034650 0x7f7a84036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.487 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.483+0000 7f7a94e01640 1 -- 172.21.15.194:0/3422572884 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f7b9c0d8050 con 0x5612d2262590 2024-09-13T06:09:53.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.483+0000 7f7baa6d1640 1 --2- 172.21.15.194:0/3422572884 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7a84034650 0x7f7a84036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.487+0000 7f7bad3c2980 1 Processor -- start 2024-09-13T06:09:53.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.487+0000 7f7bad3c2980 1 -- start start 2024-09-13T06:09:53.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.487+0000 7f7bad3c2980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5612d240b0a0 0x5612d240b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.487+0000 7f7bad3c2980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5612d23d73c0 con 0x5612d240b0a0 2024-09-13T06:09:53.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.487+0000 7f7baa6d1640 1 --2- 172.21.15.194:0/3422572884 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7a84034650 0x7f7a84036b10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x5612d23e29d0 tx=0x7f7b94006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.487+0000 7f7baaed2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5612d240b0a0 0x5612d240b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.487+0000 7f7baaed2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5612d240b0a0 0x5612d240b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44216/0 (socket says 172.21.15.194:44216) 2024-09-13T06:09:53.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.487+0000 7f7baaed2640 1 -- 172.21.15.194:0/3186840228 learned_addr learned my addr 172.21.15.194:0/3186840228 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:53.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.487+0000 7f7baaed2640 1 -- 172.21.15.194:0/3186840228 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612d240ba50 con 0x5612d240b0a0 2024-09-13T06:09:53.491 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.487+0000 7f7baaed2640 1 --2- 172.21.15.194:0/3186840228 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5612d240b0a0 0x5612d240b480 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c0ce630 tx=0x7f7b9c0a9960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28eeb03b792e10fc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.491 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.487+0000 7f7a8e7fc640 1 -- 172.21.15.194:0/3186840228 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b9c0d3e10 con 0x5612d240b0a0 2024-09-13T06:09:53.491 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.487+0000 7f7a8e7fc640 1 -- 172.21.15.194:0/3186840228 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b9c0fb070 con 0x5612d240b0a0 2024-09-13T06:09:53.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.487+0000 7f7a8e7fc640 1 -- 172.21.15.194:0/3186840228 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b9c0c8170 con 0x5612d240b0a0 2024-09-13T06:09:53.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.487+0000 7f7bad3c2980 1 -- 172.21.15.194:0/3186840228 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5612d240b0a0 msgr2=0x5612d240b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.487+0000 7f7bad3c2980 1 --2- 172.21.15.194:0/3186840228 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5612d240b0a0 0x5612d240b480 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c0ce630 tx=0x7f7b9c0a9960 comp rx=0 tx=0).stop 2024-09-13T06:09:53.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.487+0000 7f7bad3c2980 1 -- 172.21.15.194:0/3186840228 shutdown_connections 2024-09-13T06:09:53.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.487+0000 7f7bad3c2980 1 --2- 172.21.15.194:0/3186840228 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5612d240b0a0 0x5612d240b480 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.487+0000 7f7bad3c2980 1 -- 172.21.15.194:0/3186840228 >> 172.21.15.194:0/3186840228 conn(0x5612d2407480 msgr2=0x5612d2405580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:53.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.487+0000 7f7bad3c2980 1 -- 172.21.15.194:0/3186840228 shutdown_connections 2024-09-13T06:09:53.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.487+0000 7f7bad3c2980 1 -- 172.21.15.194:0/3186840228 wait complete. 2024-09-13T06:09:53.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.487+0000 7f7bad3c2980 1 Processor -- start 2024-09-13T06:09:53.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.487+0000 7f7bad3c2980 1 -- start start 2024-09-13T06:09:53.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.487+0000 7f7bad3c2980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5612d240b0a0 0x5612d2412260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.487+0000 7f7bad3c2980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5612d240bef0 con 0x5612d240b0a0 2024-09-13T06:09:53.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.487+0000 7f7baaed2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5612d240b0a0 0x5612d2412260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.487+0000 7f7baaed2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5612d240b0a0 0x5612d2412260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44232/0 (socket says 172.21.15.194:44232) 2024-09-13T06:09:53.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.487+0000 7f7baaed2640 1 -- 172.21.15.194:0/1763624578 learned_addr learned my addr 172.21.15.194:0/1763624578 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:53.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.487+0000 7f7baaed2640 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612d24127a0 con 0x5612d240b0a0 2024-09-13T06:09:53.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.491+0000 7f7baaed2640 1 --2- 172.21.15.194:0/1763624578 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5612d240b0a0 0x5612d2412260 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c0ce630 tx=0x7f7b9c0c8370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.491+0000 7f7a8cff9640 1 -- 172.21.15.194:0/1763624578 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b9c10e070 con 0x5612d240b0a0 2024-09-13T06:09:53.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.491+0000 7f7a8cff9640 1 -- 172.21.15.194:0/1763624578 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b9c0c7650 con 0x5612d240b0a0 2024-09-13T06:09:53.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.491+0000 7f7a8cff9640 1 -- 172.21.15.194:0/1763624578 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b9c0c7970 con 0x5612d240b0a0 2024-09-13T06:09:53.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.491+0000 7f7bad3c2980 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5612d24127a0 con 0x5612d240b0a0 2024-09-13T06:09:53.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.491+0000 7f7bad3c2980 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612d24127a0 con 0x5612d240b0a0 2024-09-13T06:09:53.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.491+0000 7f7a8cff9640 1 -- 172.21.15.194:0/1763624578 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7b9c111070 con 0x5612d240b0a0 2024-09-13T06:09:53.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.491+0000 7f7bad3c2980 20 rados->read ofs=0 len=0 2024-09-13T06:09:53.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.491+0000 7f7a8cff9640 1 --2- 172.21.15.194:0/1763624578 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7a740346a0 0x7f7a74036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.491+0000 7f7a8cff9640 1 -- 172.21.15.194:0/1763624578 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f7b9c114ca0 con 0x5612d240b0a0 2024-09-13T06:09:53.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.491+0000 7f7baa6d1640 1 --2- 172.21.15.194:0/1763624578 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7a740346a0 0x7f7a74036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.491+0000 7f7bad3c2980 1 --2- 172.21.15.194:0/1763624578 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5612d241d030 0x5612d241f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.491+0000 7f7bad3c2980 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5612d241fc40 con 0x5612d241d030 2024-09-13T06:09:53.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.491+0000 7f7bab6d3640 1 --2- 172.21.15.194:0/1763624578 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5612d241d030 0x5612d241f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.491+0000 7f7baa6d1640 1 --2- 172.21.15.194:0/1763624578 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7a740346a0 0x7f7a74036b60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7b94010fd0 tx=0x7f7b94011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.491+0000 7f7bab6d3640 1 --2- 172.21.15.194:0/1763624578 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5612d241d030 0x5612d241f4f0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.491+0000 7f7bab6d3640 1 -- 172.21.15.194:0/1763624578 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7ba40083f0 con 0x5612d241d030 2024-09-13T06:09:53.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.491+0000 7f7bad3c2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:53.499 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.491+0000 7f7bad3c2980 20 realm 2024-09-13T06:09:53.499 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.491+0000 7f7bad3c2980 20 rados->read ofs=0 len=0 2024-09-13T06:09:53.499 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.491+0000 7f7bad3c2980 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5612d24200a0 con 0x5612d241d030 2024-09-13T06:09:53.499 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.491+0000 7f7bab6d3640 1 -- 172.21.15.194:0/1763624578 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7ba40083f0 con 0x5612d241d030 2024-09-13T06:09:53.499 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.491+0000 7f7bad3c2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:53.499 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.491+0000 7f7bad3c2980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:09:53.499 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.491+0000 7f7bad3c2980 20 rados->read ofs=0 len=0 2024-09-13T06:09:53.499 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.491+0000 7f7bad3c2980 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5612d2420940 con 0x5612d241d030 2024-09-13T06:09:53.499 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.491+0000 7f7bab6d3640 1 -- 172.21.15.194:0/1763624578 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7ba40083f0 con 0x5612d241d030 2024-09-13T06:09:53.499 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.491+0000 7f7bad3c2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:53.499 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.491+0000 7f7bad3c2980 20 rados->read ofs=0 len=0 2024-09-13T06:09:53.499 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.491+0000 7f7bad3c2980 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5612d2420ce0 con 0x5612d241d030 2024-09-13T06:09:53.499 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.495+0000 7f7bab6d3640 1 -- 172.21.15.194:0/1763624578 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7ba40083f0 con 0x5612d241d030 2024-09-13T06:09:53.500 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.495+0000 7f7bad3c2980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:53.500 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.495+0000 7f7bad3c2980 20 rados->read ofs=0 len=0 2024-09-13T06:09:53.500 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.495+0000 7f7bad3c2980 1 --2- 172.21.15.194:0/1763624578 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5612d2421a40 0x5612d2423e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.500 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.495+0000 7f7bad3c2980 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5612d2424370 con 0x5612d2421a40 2024-09-13T06:09:53.500 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.495+0000 7f7baaed2640 1 --2- 172.21.15.194:0/1763624578 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5612d2421a40 0x5612d2423e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.500 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.495+0000 7f7baaed2640 1 --2- 172.21.15.194:0/1763624578 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5612d2421a40 0x5612d2423e30 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.500 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.495+0000 7f7baaed2640 1 -- 172.21.15.194:0/1763624578 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7b9c110030 con 0x5612d2421a40 2024-09-13T06:09:53.500 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.495+0000 7f7bad3c2980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:09:53.500 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.495+0000 7f7bad3c2980 20 searching for the correct realm 2024-09-13T06:09:53.500 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.495+0000 7f7bad3c2980 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5612d2425c10 con 0x5612d2421a40 2024-09-13T06:09:53.500 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.495+0000 7f7baaed2640 1 -- 172.21.15.194:0/1763624578 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b9c110030 con 0x5612d2421a40 2024-09-13T06:09:53.500 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.495+0000 7f7baaed2640 1 --2- 172.21.15.194:0/1763624578 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f7b9c113060 0x7f7b9c0b9900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.500 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.495+0000 7f7baaed2640 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5612d2425c10 con 0x7f7b9c113060 2024-09-13T06:09:53.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.495+0000 7f7baa6d1640 1 --2- 172.21.15.194:0/1763624578 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f7b9c113060 0x7f7b9c0b9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.495+0000 7f7baa6d1640 1 --2- 172.21.15.194:0/1763624578 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f7b9c113060 0x7f7b9c0b9900 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.495+0000 7f7baa6d1640 1 -- 172.21.15.194:0/1763624578 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7b94036040 con 0x7f7b9c113060 2024-09-13T06:09:53.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.495+0000 7f7baa6d1640 1 --2- 172.21.15.194:0/1763624578 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f7b9400f3d0 0x7f7b9400f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.495+0000 7f7baa6d1640 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5612d2425c10 con 0x7f7b9400f3d0 2024-09-13T06:09:53.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.495+0000 7f7bab6d3640 1 --2- 172.21.15.194:0/1763624578 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f7b9400f3d0 0x7f7b9400f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.495+0000 7f7bab6d3640 1 --2- 172.21.15.194:0/1763624578 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f7b9400f3d0 0x7f7b9400f7f0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.495+0000 7f7bab6d3640 1 -- 172.21.15.194:0/1763624578 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ba40083f0 con 0x7f7b9400f3d0 2024-09-13T06:09:53.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.495+0000 7f7bab6d3640 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5612d2420ce0 con 0x5612d241d030 2024-09-13T06:09:53.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.499+0000 7f7bab6d3640 1 -- 172.21.15.194:0/1763624578 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ba40083f0 con 0x5612d241d030 2024-09-13T06:09:53.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.499+0000 7f7bab6d3640 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5612d2420ce0 con 0x5612d241d030 2024-09-13T06:09:53.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.499+0000 7f7bab6d3640 1 -- 172.21.15.194:0/1763624578 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ba40083f0 con 0x5612d241d030 2024-09-13T06:09:53.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.499+0000 7f7bab6d3640 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5612d2420ce0 con 0x7f7b9400f3d0 2024-09-13T06:09:53.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.499+0000 7f7bab6d3640 1 -- 172.21.15.194:0/1763624578 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ba40083f0 con 0x7f7b9400f3d0 2024-09-13T06:09:53.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.499+0000 7f7bab6d3640 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5612d2420ce0 con 0x7f7b9400f3d0 2024-09-13T06:09:53.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.499+0000 7f7bab6d3640 1 -- 172.21.15.194:0/1763624578 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ba40083f0 con 0x7f7b9400f3d0 2024-09-13T06:09:53.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.499+0000 7f7bab6d3640 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5612d2420ce0 con 0x7f7b9c113060 2024-09-13T06:09:53.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.499+0000 7f7baa6d1640 1 -- 172.21.15.194:0/1763624578 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b94036040 con 0x7f7b9c113060 2024-09-13T06:09:53.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.499+0000 7f7baa6d1640 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5612d2420ce0 con 0x5612d2421a40 2024-09-13T06:09:53.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.499+0000 7f7baaed2640 1 -- 172.21.15.194:0/1763624578 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b9c110030 con 0x5612d2421a40 2024-09-13T06:09:53.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.499+0000 7f7baaed2640 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5612d2420ce0 con 0x5612d241d030 2024-09-13T06:09:53.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.499+0000 7f7bab6d3640 1 -- 172.21.15.194:0/1763624578 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ba40083f0 con 0x5612d241d030 2024-09-13T06:09:53.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.499+0000 7f7bab6d3640 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5612d2420ce0 con 0x7f7b9400f3d0 2024-09-13T06:09:53.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.499+0000 7f7bab6d3640 1 -- 172.21.15.194:0/1763624578 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ba40083f0 con 0x7f7b9400f3d0 2024-09-13T06:09:53.507 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.499+0000 7f7bab6d3640 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5612d2420ce0 con 0x5612d241d030 2024-09-13T06:09:53.507 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.499+0000 7f7bab6d3640 1 -- 172.21.15.194:0/1763624578 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ba40083f0 con 0x5612d241d030 2024-09-13T06:09:53.507 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.499+0000 7f7bab6d3640 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5612d2420ce0 con 0x7f7b9c113060 2024-09-13T06:09:53.507 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.503+0000 7f7baa6d1640 1 -- 172.21.15.194:0/1763624578 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7b94036040 con 0x7f7b9c113060 2024-09-13T06:09:53.507 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.503+0000 7f7baa6d1640 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5612d2420ce0 con 0x5612d2421a40 2024-09-13T06:09:53.507 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.503+0000 7f7baaed2640 1 -- 172.21.15.194:0/1763624578 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b9c110030 con 0x5612d2421a40 2024-09-13T06:09:53.507 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.503+0000 7f7baaed2640 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5612d2420ce0 con 0x5612d2421a40 2024-09-13T06:09:53.507 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.503+0000 7f7baaed2640 1 -- 172.21.15.194:0/1763624578 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b9c110030 con 0x5612d2421a40 2024-09-13T06:09:53.507 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.503+0000 7f7baaed2640 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5612d2420ce0 con 0x7f7b9400f3d0 2024-09-13T06:09:53.507 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.503+0000 7f7bab6d3640 1 -- 172.21.15.194:0/1763624578 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ba40083f0 con 0x7f7b9400f3d0 2024-09-13T06:09:53.507 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.503+0000 7f7bab6d3640 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5612d2420ce0 con 0x5612d2421a40 2024-09-13T06:09:53.507 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.503+0000 7f7baaed2640 1 -- 172.21.15.194:0/1763624578 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b9c110030 con 0x5612d2421a40 2024-09-13T06:09:53.507 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.503+0000 7f7baaed2640 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5612d2420ce0 con 0x5612d2421a40 2024-09-13T06:09:53.508 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.503+0000 7f7baaed2640 1 -- 172.21.15.194:0/1763624578 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b9c110030 con 0x5612d2421a40 2024-09-13T06:09:53.508 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.503+0000 7f7baaed2640 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5612d2420ce0 con 0x5612d241d030 2024-09-13T06:09:53.508 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.503+0000 7f7bab6d3640 1 -- 172.21.15.194:0/1763624578 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ba40083f0 con 0x5612d241d030 2024-09-13T06:09:53.508 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.503+0000 7f7bab6d3640 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5612d2420ce0 con 0x5612d241d030 2024-09-13T06:09:53.508 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.503+0000 7f7bab6d3640 1 -- 172.21.15.194:0/1763624578 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7ba40083f0 con 0x5612d241d030 2024-09-13T06:09:53.508 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.503+0000 7f7bab6d3640 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5612d2420ce0 con 0x7f7b9400f3d0 2024-09-13T06:09:53.508 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.503+0000 7f7bab6d3640 1 -- 172.21.15.194:0/1763624578 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ba40083f0 con 0x7f7b9400f3d0 2024-09-13T06:09:53.508 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.503+0000 7f7bab6d3640 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5612d2420ce0 con 0x5612d2421a40 2024-09-13T06:09:53.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.503+0000 7f7baaed2640 1 -- 172.21.15.194:0/1763624578 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b9c110030 con 0x5612d2421a40 2024-09-13T06:09:53.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.503+0000 7f7baaed2640 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5612d2420ce0 con 0x7f7b9c113060 2024-09-13T06:09:53.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.503+0000 7f7baa6d1640 1 -- 172.21.15.194:0/1763624578 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b94036040 con 0x7f7b9c113060 2024-09-13T06:09:53.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.503+0000 7f7baa6d1640 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5612d2420ce0 con 0x5612d241d030 2024-09-13T06:09:53.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.507+0000 7f7bab6d3640 1 -- 172.21.15.194:0/1763624578 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ba40083f0 con 0x5612d241d030 2024-09-13T06:09:53.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.507+0000 7f7bab6d3640 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5612d2420ce0 con 0x7f7b9400f3d0 2024-09-13T06:09:53.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.507+0000 7f7bab6d3640 1 -- 172.21.15.194:0/1763624578 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ba40083f0 con 0x7f7b9400f3d0 2024-09-13T06:09:53.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.507+0000 7f7bab6d3640 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5612d2420ce0 con 0x5612d2421a40 2024-09-13T06:09:53.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.507+0000 7f7baaed2640 1 -- 172.21.15.194:0/1763624578 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7b9c110030 con 0x5612d2421a40 2024-09-13T06:09:53.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.507+0000 7f7baaed2640 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5612d2420ce0 con 0x7f7b9400f3d0 2024-09-13T06:09:53.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.507+0000 7f7bab6d3640 1 -- 172.21.15.194:0/1763624578 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ba40083f0 con 0x7f7b9400f3d0 2024-09-13T06:09:53.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.507+0000 7f7bab6d3640 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5612d2420ce0 con 0x7f7b9c113060 2024-09-13T06:09:53.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.507+0000 7f7baa6d1640 1 -- 172.21.15.194:0/1763624578 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b94036040 con 0x7f7b9c113060 2024-09-13T06:09:53.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.507+0000 7f7baa6d1640 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5612d2420ce0 con 0x5612d2421a40 2024-09-13T06:09:53.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.507+0000 7f7baaed2640 1 -- 172.21.15.194:0/1763624578 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b9c110030 con 0x5612d2421a40 2024-09-13T06:09:53.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.507+0000 7f7baaed2640 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5612d2420ce0 con 0x7f7b9400f3d0 2024-09-13T06:09:53.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.507+0000 7f7bab6d3640 1 -- 172.21.15.194:0/1763624578 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ba40083f0 con 0x7f7b9400f3d0 2024-09-13T06:09:53.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.507+0000 7f7bab6d3640 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5612d2420ce0 con 0x5612d241d030 2024-09-13T06:09:53.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.507+0000 7f7bab6d3640 1 -- 172.21.15.194:0/1763624578 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7ba40083f0 con 0x5612d241d030 2024-09-13T06:09:53.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.507+0000 7f7bab6d3640 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5612d2420ce0 con 0x7f7b9c113060 2024-09-13T06:09:53.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.507+0000 7f7baa6d1640 1 -- 172.21.15.194:0/1763624578 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b94036040 con 0x7f7b9c113060 2024-09-13T06:09:53.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.507+0000 7f7bad3c2980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:09:53.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.507+0000 7f7bad3c2980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:09:53.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.507+0000 7f7bad3c2980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:09:53.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.507+0000 7f7bad3c2980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:09:53.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.507+0000 7f7bad3c2980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:09:53.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.507+0000 7f7bad3c2980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:09:53.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.507+0000 7f7bad3c2980 20 rados->read ofs=0 len=0 2024-09-13T06:09:53.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.507+0000 7f7bad3c2980 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5612d2424bc0 con 0x5612d241d030 2024-09-13T06:09:53.516 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.511+0000 7f7bab6d3640 1 -- 172.21.15.194:0/1763624578 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7ba40083f0 con 0x5612d241d030 2024-09-13T06:09:53.516 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.511+0000 7f7bad3c2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:53.516 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.511+0000 7f7bad3c2980 20 rados->read ofs=0 len=0 2024-09-13T06:09:53.516 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.511+0000 7f7bad3c2980 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5612d2424fb0 con 0x5612d241d030 2024-09-13T06:09:53.516 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.511+0000 7f7bab6d3640 1 -- 172.21.15.194:0/1763624578 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7ba40083f0 con 0x5612d241d030 2024-09-13T06:09:53.516 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.511+0000 7f7bad3c2980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:53.516 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.511+0000 7f7bad3c2980 20 rados->read ofs=0 len=0 2024-09-13T06:09:53.516 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.511+0000 7f7bad3c2980 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5612d2424fb0 con 0x7f7b9c113060 2024-09-13T06:09:53.516 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.511+0000 7f7baa6d1640 1 -- 172.21.15.194:0/1763624578 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7b94036040 con 0x7f7b9c113060 2024-09-13T06:09:53.516 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.511+0000 7f7bad3c2980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:09:53.516 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.511+0000 7f7bad3c2980 20 zone default found 2024-09-13T06:09:53.516 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.511+0000 7f7bad3c2980 4 Realm: () 2024-09-13T06:09:53.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.511+0000 7f7bad3c2980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:09:53.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.511+0000 7f7bad3c2980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:09:53.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.511+0000 7f7bad3c2980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:09:53.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.511+0000 7f7bad3c2980 20 zonegroup default 2024-09-13T06:09:53.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.511+0000 7f7bad3c2980 20 rados->read ofs=0 len=0 2024-09-13T06:09:53.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.511+0000 7f7bad3c2980 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5612d24260e0 con 0x7f7b9400f3d0 2024-09-13T06:09:53.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.511+0000 7f7bab6d3640 1 -- 172.21.15.194:0/1763624578 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7ba40083f0 con 0x7f7b9400f3d0 2024-09-13T06:09:53.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.511+0000 7f7bad3c2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:53.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.511+0000 7f7bad3c2980 20 rados->read ofs=0 len=0 2024-09-13T06:09:53.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.511+0000 7f7bad3c2980 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5612d2427ac0 con 0x5612d2421a40 2024-09-13T06:09:53.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.511+0000 7f7baaed2640 1 -- 172.21.15.194:0/1763624578 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7b9c110030 con 0x5612d2421a40 2024-09-13T06:09:53.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.511+0000 7f7bad3c2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:53.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.511+0000 7f7bad3c2980 20 rados->read ofs=0 len=0 2024-09-13T06:09:53.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.511+0000 7f7bad3c2980 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5612d2427e60 con 0x5612d2421a40 2024-09-13T06:09:53.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.511+0000 7f7baaed2640 1 -- 172.21.15.194:0/1763624578 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7b9c110030 con 0x5612d2421a40 2024-09-13T06:09:53.518 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.511+0000 7f7bad3c2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:53.518 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.511+0000 7f7bad3c2980 20 started sync module instance, tier type = 2024-09-13T06:09:53.518 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.511+0000 7f7bad3c2980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:09:53.518 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.511+0000 7f7bad3c2980 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5612d2426f60 con 0x7f7b9c113060 2024-09-13T06:09:53.519 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.511+0000 7f7baa6d1640 1 -- 172.21.15.194:0/1763624578 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(44 notify.0 [create] v33'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b94036040 con 0x7f7b9c113060 2024-09-13T06:09:53.519 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.511+0000 7f7bad3c2980 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94638836970368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5612d2426bc0 con 0x7f7b9c113060 2024-09-13T06:09:53.519 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.511+0000 7f7bad3c2980 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5612d2428d40 con 0x5612d241d030 2024-09-13T06:09:53.519 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.515+0000 7f7bab6d3640 1 -- 172.21.15.194:0/1763624578 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v33'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ba40083f0 con 0x5612d241d030 2024-09-13T06:09:53.519 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.515+0000 7f7bad3c2980 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94638836976032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5612d2429450 con 0x5612d241d030 2024-09-13T06:09:53.519 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.515+0000 7f7bad3c2980 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5612d2429f70 con 0x5612d2421a40 2024-09-13T06:09:53.519 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.515+0000 7f7baa6d1640 1 -- 172.21.15.194:0/1763624578 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94638836970368] v33'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b94036040 con 0x7f7b9c113060 2024-09-13T06:09:53.519 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.519+0000 7f7baaed2640 1 -- 172.21.15.194:0/1763624578 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v33'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b9c110030 con 0x5612d2421a40 2024-09-13T06:09:53.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.519+0000 7f7bad3c2980 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94638836980288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5612d242a360 con 0x5612d2421a40 2024-09-13T06:09:53.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.519+0000 7f7bab6d3640 1 -- 172.21.15.194:0/1763624578 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94638836976032] v33'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ba40083f0 con 0x5612d241d030 2024-09-13T06:09:53.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.519+0000 7f7bad3c2980 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5612d2428ee0 con 0x7f7b9c113060 2024-09-13T06:09:53.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.519+0000 7f7baa6d1640 1 -- 172.21.15.194:0/1763624578 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(50 notify.3 [create] v33'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b94036040 con 0x7f7b9c113060 2024-09-13T06:09:53.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.519+0000 7f7bad3c2980 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94638836983920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5612d242b140 con 0x7f7b9c113060 2024-09-13T06:09:53.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.519+0000 7f7bad3c2980 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5612d242bb00 con 0x5612d241d030 2024-09-13T06:09:53.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.519+0000 7f7baaed2640 1 -- 172.21.15.194:0/1763624578 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94638836980288] v33'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b9c110030 con 0x5612d2421a40 2024-09-13T06:09:53.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.523+0000 7f7bab6d3640 1 -- 172.21.15.194:0/1763624578 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v33'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ba40083f0 con 0x5612d241d030 2024-09-13T06:09:53.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.523+0000 7f7bad3c2980 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94638836974192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5612d242bb00 con 0x5612d241d030 2024-09-13T06:09:53.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.523+0000 7f7bad3c2980 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5612d242c3d0 con 0x7f7b9400f3d0 2024-09-13T06:09:53.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.523+0000 7f7baa6d1640 1 -- 172.21.15.194:0/1763624578 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94638836983920] v33'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b94036040 con 0x7f7b9c113060 2024-09-13T06:09:53.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.523+0000 7f7bab6d3640 1 -- 172.21.15.194:0/1763624578 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(54 notify.5 [create] v33'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ba40083f0 con 0x7f7b9400f3d0 2024-09-13T06:09:53.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.523+0000 7f7bad3c2980 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94638836984976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5612d242c4e0 con 0x7f7b9400f3d0 2024-09-13T06:09:53.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.523+0000 7f7bad3c2980 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5612d242cd30 con 0x7f7b9400f3d0 2024-09-13T06:09:53.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.523+0000 7f7bab6d3640 1 -- 172.21.15.194:0/1763624578 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94638836974192] v33'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ba40083f0 con 0x5612d241d030 2024-09-13T06:09:53.527 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.527+0000 7f7bab6d3640 1 -- 172.21.15.194:0/1763624578 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94638836984976] v33'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ba40083f0 con 0x7f7b9400f3d0 2024-09-13T06:09:53.527 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.527+0000 7f7bab6d3640 1 -- 172.21.15.194:0/1763624578 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(56 notify.6 [create] v33'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ba40083f0 con 0x7f7b9400f3d0 2024-09-13T06:09:53.527 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.527+0000 7f7bad3c2980 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94638836987472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5612d242c990 con 0x7f7b9400f3d0 2024-09-13T06:09:53.527 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.527+0000 7f7bad3c2980 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5612d242d1e0 con 0x7f7b9400f3d0 2024-09-13T06:09:53.530 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.527+0000 7f7bab6d3640 1 -- 172.21.15.194:0/1763624578 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(58 notify.7 [create] v33'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ba40083f0 con 0x7f7b9400f3d0 2024-09-13T06:09:53.530 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.527+0000 7f7bad3c2980 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94638836992672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5612d242d570 con 0x7f7b9400f3d0 2024-09-13T06:09:53.530 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.527+0000 7f7bad3c2980 20 add_watcher() i=0 2024-09-13T06:09:53.530 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.527+0000 7f7bad3c2980 20 add_watcher() i=1 2024-09-13T06:09:53.531 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.527+0000 7f7bad3c2980 20 add_watcher() i=2 2024-09-13T06:09:53.531 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.527+0000 7f7bad3c2980 20 add_watcher() i=3 2024-09-13T06:09:53.531 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.527+0000 7f7bad3c2980 20 add_watcher() i=4 2024-09-13T06:09:53.531 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.527+0000 7f7bad3c2980 20 add_watcher() i=5 2024-09-13T06:09:53.531 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.527+0000 7f7bab6d3640 1 -- 172.21.15.194:0/1763624578 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94638836987472] v33'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ba40083f0 con 0x7f7b9400f3d0 2024-09-13T06:09:53.531 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.527+0000 7f7bad3c2980 20 add_watcher() i=6 2024-09-13T06:09:53.532 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.531+0000 7f7bab6d3640 1 -- 172.21.15.194:0/1763624578 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94638836992672] v33'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ba40083f0 con 0x7f7b9400f3d0 2024-09-13T06:09:53.532 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.531+0000 7f7bad3c2980 20 add_watcher() i=7 2024-09-13T06:09:53.532 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.531+0000 7f7bad3c2980 2 all 8 watchers are set, enabling cache 2024-09-13T06:09:53.532 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.531+0000 7f7bad3c2980 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5612d242c530 con 0x5612d241d030 2024-09-13T06:09:53.532 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.531+0000 7f7bab6d3640 1 -- 172.21.15.194:0/1763624578 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7ba40083f0 con 0x5612d241d030 2024-09-13T06:09:53.533 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.531+0000 7f7bad3c2980 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94638836991232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5612d242da80 con 0x5612d241d030 2024-09-13T06:09:53.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.531+0000 7f7bab6d3640 1 -- 172.21.15.194:0/1763624578 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94638836991232] v33'54 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7ba40083f0 con 0x5612d241d030 2024-09-13T06:09:53.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.531+0000 7f7a617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:53.535 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.531+0000 7f7bad3c2980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:09:53.535 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.531+0000 7f7bad3c2980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:09:53.535 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.531+0000 7f7bad3c2980 5 note: GC not initialized 2024-09-13T06:09:53.535 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.531+0000 7f79dbfff640 20 reqs_thread_entry: start 2024-09-13T06:09:53.535 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.535+0000 7f7bad3c2980 20 init_complete bucket index max shards: 11 2024-09-13T06:09:53.535 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.535+0000 7f7bad3c2980 20 Filter name: none 2024-09-13T06:09:53.535 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.535+0000 7f79d9ffb640 20 reqs_thread_entry: start 2024-09-13T06:09:53.535 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.535+0000 7f7bad3c2980 20 rados->read ofs=0 len=0 2024-09-13T06:09:53.535 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.535+0000 7f7bad3c2980 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5612d24536e0 con 0x5612d241d030 2024-09-13T06:09:53.536 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.535+0000 7f7bab6d3640 1 -- 172.21.15.194:0/1763624578 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f7ba40083f0 con 0x5612d241d030 2024-09-13T06:09:53.536 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.535+0000 7f7bad3c2980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T06:09:53.536 INFO:teuthology.orchestra.run.smithi194.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T06:09:53.191222Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:09:53.191207Z","tags":[],"group_ids":[]} 2024-09-13T06:09:53.536 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.535+0000 7f7a617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:53.536 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.535+0000 7f7bad3c2980 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94638836991232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5612d2452630 con 0x5612d241d030 2024-09-13T06:09:53.537 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.535+0000 7f7bab6d3640 1 -- 172.21.15.194:0/1763624578 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94638836991232] v33'55 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7ba40083f0 con 0x5612d241d030 2024-09-13T06:09:53.537 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.535+0000 7f7bad3c2980 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94638836970368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5612d242c500 con 0x7f7b9c113060 2024-09-13T06:09:53.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.539+0000 7f7baa6d1640 1 -- 172.21.15.194:0/1763624578 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94638836970368] v33'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b94036040 con 0x7f7b9c113060 2024-09-13T06:09:53.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.539+0000 7f7bad3c2980 20 remove_watcher() i=0 2024-09-13T06:09:53.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.539+0000 7f7bad3c2980 2 removed watcher, disabling cache 2024-09-13T06:09:53.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.539+0000 7f7bad3c2980 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94638836976032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5612d2427380 con 0x5612d241d030 2024-09-13T06:09:53.541 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.539+0000 7f7bab6d3640 1 -- 172.21.15.194:0/1763624578 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94638836976032] v33'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ba40083f0 con 0x5612d241d030 2024-09-13T06:09:53.541 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.539+0000 7f7bad3c2980 20 remove_watcher() i=1 2024-09-13T06:09:53.541 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.539+0000 7f7bad3c2980 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94638836980288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5612d24289a0 con 0x5612d2421a40 2024-09-13T06:09:53.543 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.543+0000 7f7baaed2640 1 -- 172.21.15.194:0/1763624578 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94638836980288] v33'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b9c110030 con 0x5612d2421a40 2024-09-13T06:09:53.543 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.543+0000 7f7bad3c2980 20 remove_watcher() i=2 2024-09-13T06:09:53.543 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.543+0000 7f7bad3c2980 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94638836983920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5612d2429a40 con 0x7f7b9c113060 2024-09-13T06:09:53.544 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.543+0000 7f7baa6d1640 1 -- 172.21.15.194:0/1763624578 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94638836983920] v33'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b94036040 con 0x7f7b9c113060 2024-09-13T06:09:53.544 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.543+0000 7f7bad3c2980 20 remove_watcher() i=3 2024-09-13T06:09:53.544 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.543+0000 7f7bad3c2980 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94638836974192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5612d2429a40 con 0x5612d241d030 2024-09-13T06:09:53.546 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.543+0000 7f7bab6d3640 1 -- 172.21.15.194:0/1763624578 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94638836974192] v33'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ba40083f0 con 0x5612d241d030 2024-09-13T06:09:53.546 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.543+0000 7f7bad3c2980 20 remove_watcher() i=4 2024-09-13T06:09:53.546 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.543+0000 7f7bad3c2980 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94638836984976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5612d2428270 con 0x7f7b9400f3d0 2024-09-13T06:09:53.548 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.547+0000 7f7bab6d3640 1 -- 172.21.15.194:0/1763624578 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94638836984976] v33'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ba40083f0 con 0x7f7b9400f3d0 2024-09-13T06:09:53.548 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.547+0000 7f7bad3c2980 20 remove_watcher() i=5 2024-09-13T06:09:53.549 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.547+0000 7f7bad3c2980 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94638836987472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5612d2429a40 con 0x7f7b9400f3d0 2024-09-13T06:09:53.550 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.547+0000 7f7bab6d3640 1 -- 172.21.15.194:0/1763624578 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94638836987472] v33'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ba40083f0 con 0x7f7b9400f3d0 2024-09-13T06:09:53.550 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.547+0000 7f7bad3c2980 20 remove_watcher() i=6 2024-09-13T06:09:53.550 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.551+0000 7f7bad3c2980 1 -- 172.21.15.194:0/1763624578 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94638836992672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5612d2429a40 con 0x7f7b9400f3d0 2024-09-13T06:09:53.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.551+0000 7f7bab6d3640 1 -- 172.21.15.194:0/1763624578 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94638836992672] v33'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ba40083f0 con 0x7f7b9400f3d0 2024-09-13T06:09:53.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.551+0000 7f7bad3c2980 20 remove_watcher() i=7 2024-09-13T06:09:53.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.551+0000 7f7bad3c2980 1 -- 172.21.15.194:0/1763624578 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f7b9400f3d0 msgr2=0x7f7b9400f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.551+0000 7f7bad3c2980 1 --2- 172.21.15.194:0/1763624578 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f7b9400f3d0 0x7f7b9400f7f0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.551+0000 7f7bad3c2980 1 -- 172.21.15.194:0/1763624578 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5612d241d030 msgr2=0x5612d241f4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.551+0000 7f7bad3c2980 1 --2- 172.21.15.194:0/1763624578 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5612d241d030 0x5612d241f4f0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.551+0000 7f7bad3c2980 1 -- 172.21.15.194:0/1763624578 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f7b9c113060 msgr2=0x7f7b9c0b9900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.551+0000 7f7bad3c2980 1 --2- 172.21.15.194:0/1763624578 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f7b9c113060 0x7f7b9c0b9900 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.551+0000 7f7bad3c2980 1 -- 172.21.15.194:0/1763624578 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5612d2421a40 msgr2=0x5612d2423e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.551+0000 7f7bad3c2980 1 --2- 172.21.15.194:0/1763624578 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5612d2421a40 0x5612d2423e30 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.551+0000 7f7bad3c2980 1 -- 172.21.15.194:0/1763624578 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7a740346a0 msgr2=0x7f7a74036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.551+0000 7f7bad3c2980 1 --2- 172.21.15.194:0/1763624578 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7a740346a0 0x7f7a74036b60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7b94010fd0 tx=0x7f7b94011000 comp rx=0 tx=0).stop 2024-09-13T06:09:53.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.551+0000 7f7bad3c2980 1 -- 172.21.15.194:0/1763624578 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5612d240b0a0 msgr2=0x5612d2412260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.551+0000 7f7bad3c2980 1 --2- 172.21.15.194:0/1763624578 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5612d240b0a0 0x5612d2412260 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c0ce630 tx=0x7f7b9c0c8370 comp rx=0 tx=0).stop 2024-09-13T06:09:53.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.551+0000 7f7bab6d3640 1 -- 172.21.15.194:0/1763624578 reap_dead start 2024-09-13T06:09:53.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.551+0000 7f7bad3c2980 1 -- 172.21.15.194:0/1763624578 shutdown_connections 2024-09-13T06:09:53.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.551+0000 7f7bad3c2980 1 -- 172.21.15.194:0/1763624578 >> 172.21.15.194:0/1763624578 conn(0x5612d2407480 msgr2=0x5612d2405550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:53.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.551+0000 7f7bad3c2980 1 -- 172.21.15.194:0/1763624578 shutdown_connections 2024-09-13T06:09:53.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.551+0000 7f7bad3c2980 1 -- 172.21.15.194:0/1763624578 wait complete. 2024-09-13T06:09:53.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.551+0000 7f7bad3c2980 1 -- 172.21.15.194:0/3422572884 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7a84034650 msgr2=0x7f7a84036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.551+0000 7f7bad3c2980 1 --2- 172.21.15.194:0/3422572884 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7a84034650 0x7f7a84036b10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x5612d23e29d0 tx=0x7f7b94006000 comp rx=0 tx=0).stop 2024-09-13T06:09:53.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.551+0000 7f7bad3c2980 1 -- 172.21.15.194:0/3422572884 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5612d2262590 msgr2=0x5612d2260c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.551+0000 7f7bad3c2980 1 --2- 172.21.15.194:0/3422572884 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5612d2262590 0x5612d2260c10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c0ce8d0 tx=0x7f7b9c0dce10 comp rx=0 tx=0).stop 2024-09-13T06:09:53.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.551+0000 7f7bad3c2980 1 -- 172.21.15.194:0/3422572884 shutdown_connections 2024-09-13T06:09:53.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.551+0000 7f7bad3c2980 1 --2- 172.21.15.194:0/3422572884 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7a84034650 0x7f7a84036b10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.551+0000 7f7bad3c2980 1 --2- 172.21.15.194:0/3422572884 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5612d2262590 0x5612d2260c10 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.551+0000 7f7bad3c2980 1 -- 172.21.15.194:0/3422572884 >> 172.21.15.194:0/3422572884 conn(0x5612d23f16a0 msgr2=0x5612d23f4120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:53.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.551+0000 7f7bad3c2980 1 -- 172.21.15.194:0/3422572884 shutdown_connections 2024-09-13T06:09:53.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.551+0000 7f7bad3c2980 1 -- 172.21.15.194:0/3422572884 wait complete. 2024-09-13T06:09:53.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.551+0000 7f7bad3c2980 1 -- 172.21.15.194:0/376217420 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5612d23e33b0 msgr2=0x5612d23e57a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.551+0000 7f7bad3c2980 1 --2- 172.21.15.194:0/376217420 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5612d23e33b0 0x5612d23e57a0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.551+0000 7f7bad3c2980 1 -- 172.21.15.194:0/376217420 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5612d23ebfa0 msgr2=0x5612d23ee390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.551+0000 7f7bad3c2980 1 --2- 172.21.15.194:0/376217420 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5612d23ebfa0 0x5612d23ee390 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.551+0000 7f7bad3c2980 1 -- 172.21.15.194:0/376217420 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5612d23e7ef0 msgr2=0x5612d23ea3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.551+0000 7f7bad3c2980 1 --2- 172.21.15.194:0/376217420 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5612d23e7ef0 0x5612d23ea3b0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.551+0000 7f7bad3c2980 1 -- 172.21.15.194:0/376217420 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7a900346a0 msgr2=0x7f7a90036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.551+0000 7f7bad3c2980 1 --2- 172.21.15.194:0/376217420 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7a900346a0 0x7f7a90036b60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7b94000f70 tx=0x7f7b94001420 comp rx=0 tx=0).stop 2024-09-13T06:09:53.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.551+0000 7f7bad3c2980 1 -- 172.21.15.194:0/376217420 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5612d23ddf10 msgr2=0x5612d23de330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.558 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.551+0000 7f7bad3c2980 1 --2- 172.21.15.194:0/376217420 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5612d23ddf10 0x5612d23de330 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c019740 tx=0x7f7b9c017e30 comp rx=0 tx=0).stop 2024-09-13T06:09:53.558 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.551+0000 7f7bab6d3640 1 -- 172.21.15.194:0/376217420 reap_dead start 2024-09-13T06:09:53.558 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.551+0000 7f7bad3c2980 1 -- 172.21.15.194:0/376217420 shutdown_connections 2024-09-13T06:09:53.558 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.555+0000 7f7bad3c2980 1 -- 172.21.15.194:0/376217420 >> 172.21.15.194:0/376217420 conn(0x5612d22e71b0 msgr2=0x5612d23d1240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:53.558 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.555+0000 7f7bad3c2980 1 -- 172.21.15.194:0/376217420 shutdown_connections 2024-09-13T06:09:53.558 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.555+0000 7f7bad3c2980 1 -- 172.21.15.194:0/376217420 wait complete. 2024-09-13T06:09:53.565 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T06:09:53.191222Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:09:53.191207Z', 'tags': [], 'group_ids': []} 2024-09-13T06:09:53.566 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-09-13T06:09:53.566 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-09-13T06:09:53.566 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-09-13T06:09:53.643 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:09:53.643 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:09:53.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.643+0000 7f337d196980 1 Processor -- start 2024-09-13T06:09:53.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.643+0000 7f337d196980 1 -- start start 2024-09-13T06:09:53.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.643+0000 7f337d196980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55ded967c540 0x55ded967c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.643+0000 7f337d196980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ded9505ae0 con 0x55ded967ce90 2024-09-13T06:09:53.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.643+0000 7f337d196980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x55ded9529e30 con 0x55ded967c540 2024-09-13T06:09:53.645 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.643+0000 7f337aca6640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55ded967c540 0x55ded967c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.645 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.643+0000 7f337a4a5640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x55ded967ce90 0x55ded9681910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:50934/0 (socket says 172.21.15.194:50934) 2024-09-13T06:09:53.645 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.643+0000 7f337aca6640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55ded967c540 0x55ded967c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44238/0 (socket says 172.21.15.194:44238) 2024-09-13T06:09:53.645 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.643+0000 7f337a4a5640 1 -- 172.21.15.194:0/2453280047 learned_addr learned my addr 172.21.15.194:0/2453280047 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-09-13T06:09:53.645 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.643+0000 7f337aca6640 1 -- 172.21.15.194:0/2453280047 >> v1:172.21.15.120:6789/0 conn(0x55ded967ce90 legacy=0x55ded9681910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.646 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.643+0000 7f337aca6640 1 -- 172.21.15.194:0/2453280047 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ded9684160 con 0x55ded967c540 2024-09-13T06:09:53.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.647+0000 7f337aca6640 1 --2- 172.21.15.194:0/2453280047 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ded967c540 0x55ded967c920 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f336c00a420 tx=0x7f336c01afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cdddb19df4002c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.647+0000 7f3379ca4640 1 -- 172.21.15.194:0/2453280047 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f336c0af070 con 0x55ded967c540 2024-09-13T06:09:53.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.647+0000 7f3379ca4640 1 -- 172.21.15.194:0/2453280047 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f336c0aa530 con 0x55ded967c540 2024-09-13T06:09:53.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.647+0000 7f3379ca4640 1 -- 172.21.15.194:0/2453280047 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f336c0aa850 con 0x55ded967c540 2024-09-13T06:09:53.649 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.647+0000 7f337d196980 1 -- 172.21.15.194:0/2453280047 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ded967c540 msgr2=0x55ded967c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.649 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.647+0000 7f337d196980 1 --2- 172.21.15.194:0/2453280047 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ded967c540 0x55ded967c920 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f336c00a420 tx=0x7f336c01afd0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.649 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.647+0000 7f337d196980 1 -- 172.21.15.194:0/2453280047 shutdown_connections 2024-09-13T06:09:53.649 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.647+0000 7f337d196980 1 --2- 172.21.15.194:0/2453280047 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ded967c540 0x55ded967c920 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.649 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.647+0000 7f337d196980 1 -- 172.21.15.194:0/2453280047 >> 172.21.15.194:0/2453280047 conn(0x55ded9678060 msgr2=0x55ded967a480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:53.649 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.647+0000 7f337d196980 1 -- 172.21.15.194:0/2453280047 shutdown_connections 2024-09-13T06:09:53.649 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.647+0000 7f337d196980 1 -- 172.21.15.194:0/2453280047 wait complete. 2024-09-13T06:09:53.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.663+0000 7f337d196980 1 Processor -- start 2024-09-13T06:09:53.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.663+0000 7f337d196980 1 -- start start 2024-09-13T06:09:53.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.663+0000 7f337d196980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ded967c540 0x55ded9768a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.663+0000 7f337d196980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55ded952b200 con 0x55ded967c540 2024-09-13T06:09:53.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.663+0000 7f337aca6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ded967c540 0x55ded9768a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.663+0000 7f337aca6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ded967c540 0x55ded9768a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44252/0 (socket says 172.21.15.194:44252) 2024-09-13T06:09:53.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.663+0000 7f337aca6640 1 -- 172.21.15.194:0/126366541 learned_addr learned my addr 172.21.15.194:0/126366541 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:53.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.663+0000 7f337aca6640 1 -- 172.21.15.194:0/126366541 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ded9768fd0 con 0x55ded967c540 2024-09-13T06:09:53.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.663+0000 7f337aca6640 1 --2- 172.21.15.194:0/126366541 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ded967c540 0x55ded9768a00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f336c00a420 tx=0x7f336c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d8d15e81d02b8b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.667+0000 7f3268e09640 1 -- 172.21.15.194:0/126366541 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f336c0af050 con 0x55ded967c540 2024-09-13T06:09:53.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.667+0000 7f3268e09640 1 -- 172.21.15.194:0/126366541 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f336c0b0040 con 0x55ded967c540 2024-09-13T06:09:53.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.667+0000 7f3268e09640 1 -- 172.21.15.194:0/126366541 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f336c0aac60 con 0x55ded967c540 2024-09-13T06:09:53.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.667+0000 7f337d196980 1 -- 172.21.15.194:0/126366541 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ded967c540 msgr2=0x55ded9768a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.667+0000 7f337d196980 1 --2- 172.21.15.194:0/126366541 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ded967c540 0x55ded9768a00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f336c00a420 tx=0x7f336c0033b0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.667+0000 7f337d196980 1 -- 172.21.15.194:0/126366541 shutdown_connections 2024-09-13T06:09:53.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.667+0000 7f337d196980 1 --2- 172.21.15.194:0/126366541 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ded967c540 0x55ded9768a00 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.667+0000 7f337d196980 1 -- 172.21.15.194:0/126366541 >> 172.21.15.194:0/126366541 conn(0x55ded9678060 msgr2=0x55ded95f1620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:53.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.667+0000 7f337d196980 1 -- 172.21.15.194:0/126366541 shutdown_connections 2024-09-13T06:09:53.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.667+0000 7f337d196980 1 -- 172.21.15.194:0/126366541 wait complete. 2024-09-13T06:09:53.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.667+0000 7f337d196980 1 Processor -- start 2024-09-13T06:09:53.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.667+0000 7f337d196980 1 -- start start 2024-09-13T06:09:53.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.667+0000 7f337d196980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ded967c540 0x55ded976fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.667+0000 7f337d196980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55ded9683ba0 con 0x55ded967c540 2024-09-13T06:09:53.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.667+0000 7f337aca6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ded967c540 0x55ded976fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.667+0000 7f337aca6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ded967c540 0x55ded976fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44266/0 (socket says 172.21.15.194:44266) 2024-09-13T06:09:53.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.667+0000 7f337aca6640 1 -- 172.21.15.194:0/2992185486 learned_addr learned my addr 172.21.15.194:0/2992185486 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:53.670 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.667+0000 7f337aca6640 1 -- 172.21.15.194:0/2992185486 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ded97701b0 con 0x55ded967c540 2024-09-13T06:09:53.670 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.667+0000 7f337aca6640 1 --2- 172.21.15.194:0/2992185486 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ded967c540 0x55ded976fc70 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f336c01b870 tx=0x7f336c019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.671 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.667+0000 7f3267606640 1 -- 172.21.15.194:0/2992185486 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f336c0c5020 con 0x55ded967c540 2024-09-13T06:09:53.671 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.667+0000 7f3267606640 1 -- 172.21.15.194:0/2992185486 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f336c0b6cb0 con 0x55ded967c540 2024-09-13T06:09:53.671 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.667+0000 7f337d196980 1 -- 172.21.15.194:0/2992185486 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ded9770440 con 0x55ded967c540 2024-09-13T06:09:53.671 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.667+0000 7f3267606640 1 -- 172.21.15.194:0/2992185486 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f336c0c1480 con 0x55ded967c540 2024-09-13T06:09:53.671 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.667+0000 7f337d196980 1 -- 172.21.15.194:0/2992185486 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ded9773120 con 0x55ded967c540 2024-09-13T06:09:53.672 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.671+0000 7f3267606640 1 -- 172.21.15.194:0/2992185486 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f336c0c8070 con 0x55ded967c540 2024-09-13T06:09:53.672 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.671+0000 7f3267606640 1 --2- 172.21.15.194:0/2992185486 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3260034650 0x7f3260036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.672 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.671+0000 7f3267606640 1 -- 172.21.15.194:0/2992185486 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f336c0bb070 con 0x55ded967c540 2024-09-13T06:09:53.672 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.671+0000 7f337a4a5640 1 --2- 172.21.15.194:0/2992185486 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3260034650 0x7f3260036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.671+0000 7f337d196980 1 --2- 172.21.15.194:0/2992185486 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ded967ce90 0x55ded9776d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.671+0000 7f337d196980 1 -- 172.21.15.194:0/2992185486 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ded97772f0 con 0x55ded967ce90 2024-09-13T06:09:53.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.671+0000 7f337b4a7640 1 --2- 172.21.15.194:0/2992185486 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ded967ce90 0x55ded9776d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.671+0000 7f337a4a5640 1 --2- 172.21.15.194:0/2992185486 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3260034650 0x7f3260036b10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3364001da0 tx=0x7f3364001300 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.671+0000 7f337b4a7640 1 --2- 172.21.15.194:0/2992185486 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ded967ce90 0x55ded9776d70 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.674 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.671+0000 7f337b4a7640 1 -- 172.21.15.194:0/2992185486 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f33740083f0 con 0x55ded967ce90 2024-09-13T06:09:53.675 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.671+0000 7f337d196980 1 -- 172.21.15.194:0/2992185486 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ded9777bb0 con 0x55ded967ce90 2024-09-13T06:09:53.675 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.671+0000 7f337b4a7640 1 -- 172.21.15.194:0/2992185486 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f33740083f0 con 0x55ded967ce90 2024-09-13T06:09:53.675 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.671+0000 7f337d196980 1 --2- 172.21.15.194:0/2992185486 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ded97794c0 0x55ded977b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.675 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.671+0000 7f337d196980 1 -- 172.21.15.194:0/2992185486 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ded977c0f0 con 0x55ded97794c0 2024-09-13T06:09:53.675 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.671+0000 7f337aca6640 1 --2- 172.21.15.194:0/2992185486 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ded97794c0 0x55ded977b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.675 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.671+0000 7f337aca6640 1 --2- 172.21.15.194:0/2992185486 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ded97794c0 0x55ded977b960 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.675 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.671+0000 7f337aca6640 1 -- 172.21.15.194:0/2992185486 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f336c0c7030 con 0x55ded97794c0 2024-09-13T06:09:53.675 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.671+0000 7f337d196980 1 -- 172.21.15.194:0/2992185486 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ded9778400 con 0x55ded967ce90 2024-09-13T06:09:53.675 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.675+0000 7f337b4a7640 1 -- 172.21.15.194:0/2992185486 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f33740083f0 con 0x55ded967ce90 2024-09-13T06:09:53.675 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.675+0000 7f337d196980 1 --2- 172.21.15.194:0/2992185486 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55ded977d550 0x55ded977f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.675 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.675+0000 7f337d196980 1 -- 172.21.15.194:0/2992185486 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ded97800b0 con 0x55ded977d550 2024-09-13T06:09:53.675 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.675+0000 7f337a4a5640 1 --2- 172.21.15.194:0/2992185486 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55ded977d550 0x55ded977f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.677 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.675+0000 7f337a4a5640 1 --2- 172.21.15.194:0/2992185486 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55ded977d550 0x55ded977f940 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.677 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.675+0000 7f337a4a5640 1 -- 172.21.15.194:0/2992185486 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f336400e6c0 con 0x55ded977d550 2024-09-13T06:09:53.677 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.675+0000 7f337d196980 1 Processor -- start 2024-09-13T06:09:53.677 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.675+0000 7f337d196980 1 -- start start 2024-09-13T06:09:53.677 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.675+0000 7f337d196980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ded978db60 0x55ded978df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.677 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.675+0000 7f337d196980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55ded9584800 con 0x55ded978db60 2024-09-13T06:09:53.677 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.675+0000 7f337aca6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ded978db60 0x55ded978df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.677 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.675+0000 7f337aca6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ded978db60 0x55ded978df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44282/0 (socket says 172.21.15.194:44282) 2024-09-13T06:09:53.677 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.675+0000 7f337aca6640 1 -- 172.21.15.194:0/9460790 learned_addr learned my addr 172.21.15.194:0/9460790 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:53.678 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.675+0000 7f337aca6640 1 -- 172.21.15.194:0/9460790 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ded978e4c0 con 0x55ded978db60 2024-09-13T06:09:53.678 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.675+0000 7f337aca6640 1 --2- 172.21.15.194:0/9460790 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ded978db60 0x55ded978df80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f336c0b8010 tx=0x7f336c0b8360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.680 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.675+0000 7f3264e01640 1 -- 172.21.15.194:0/9460790 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f336c0050a0 con 0x55ded978db60 2024-09-13T06:09:53.680 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.675+0000 7f3264e01640 1 -- 172.21.15.194:0/9460790 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f336c0d9070 con 0x55ded978db60 2024-09-13T06:09:53.680 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.675+0000 7f337d196980 1 -- 172.21.15.194:0/9460790 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ded978e750 con 0x55ded978db60 2024-09-13T06:09:53.680 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.675+0000 7f3264e01640 1 -- 172.21.15.194:0/9460790 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f336c005370 con 0x55ded978db60 2024-09-13T06:09:53.680 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.675+0000 7f337d196980 1 -- 172.21.15.194:0/9460790 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ded97913d0 con 0x55ded978db60 2024-09-13T06:09:53.680 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.679+0000 7f3264e01640 1 -- 172.21.15.194:0/9460790 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f336c0c8970 con 0x55ded978db60 2024-09-13T06:09:53.680 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.679+0000 7f3264e01640 1 --2- 172.21.15.194:0/9460790 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3254034650 0x7f3254036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.681 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.679+0000 7f3264e01640 1 -- 172.21.15.194:0/9460790 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f336c0070a0 con 0x55ded978db60 2024-09-13T06:09:53.681 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.679+0000 7f337a4a5640 1 --2- 172.21.15.194:0/9460790 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3254034650 0x7f3254036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.681 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.679+0000 7f337d196980 1 Processor -- start 2024-09-13T06:09:53.681 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.679+0000 7f337d196980 1 -- start start 2024-09-13T06:09:53.681 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.679+0000 7f337d196980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ded979a470 0x55ded979a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.681 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.679+0000 7f337d196980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55ded9769290 con 0x55ded979a470 2024-09-13T06:09:53.681 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.679+0000 7f337a4a5640 1 --2- 172.21.15.194:0/9460790 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3254034650 0x7f3254036b10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x55ded97787a0 tx=0x7f336400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.681 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.679+0000 7f337aca6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ded979a470 0x55ded979a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.681 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.679+0000 7f337aca6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ded979a470 0x55ded979a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44290/0 (socket says 172.21.15.194:44290) 2024-09-13T06:09:53.681 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.679+0000 7f337aca6640 1 -- 172.21.15.194:0/3206827365 learned_addr learned my addr 172.21.15.194:0/3206827365 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:53.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.679+0000 7f337aca6640 1 -- 172.21.15.194:0/3206827365 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ded979ae40 con 0x55ded979a470 2024-09-13T06:09:53.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.679+0000 7f337aca6640 1 --2- 172.21.15.194:0/3206827365 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ded979a470 0x55ded979a870 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f336c004f50 tx=0x7f336c0e12e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edac2aaecd9fa984 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.679+0000 7f325e7fc640 1 -- 172.21.15.194:0/3206827365 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f336c0e9030 con 0x55ded979a470 2024-09-13T06:09:53.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.679+0000 7f325e7fc640 1 -- 172.21.15.194:0/3206827365 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f336c004740 con 0x55ded979a470 2024-09-13T06:09:53.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.679+0000 7f325e7fc640 1 -- 172.21.15.194:0/3206827365 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f336c0c1750 con 0x55ded979a470 2024-09-13T06:09:53.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.679+0000 7f337d196980 1 -- 172.21.15.194:0/3206827365 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ded979a470 msgr2=0x55ded979a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.679+0000 7f337d196980 1 --2- 172.21.15.194:0/3206827365 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ded979a470 0x55ded979a870 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f336c004f50 tx=0x7f336c0e12e0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.679+0000 7f337d196980 1 -- 172.21.15.194:0/3206827365 shutdown_connections 2024-09-13T06:09:53.685 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.679+0000 7f337d196980 1 --2- 172.21.15.194:0/3206827365 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ded979a470 0x55ded979a870 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.685 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.679+0000 7f337d196980 1 -- 172.21.15.194:0/3206827365 >> 172.21.15.194:0/3206827365 conn(0x55ded9796850 msgr2=0x55ded9794950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:53.685 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.679+0000 7f337d196980 1 -- 172.21.15.194:0/3206827365 shutdown_connections 2024-09-13T06:09:53.685 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.679+0000 7f337d196980 1 -- 172.21.15.194:0/3206827365 wait complete. 2024-09-13T06:09:53.685 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.679+0000 7f337d196980 1 Processor -- start 2024-09-13T06:09:53.685 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.679+0000 7f337d196980 1 -- start start 2024-09-13T06:09:53.685 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.679+0000 7f337d196980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ded979a470 0x55ded9764b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.685 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.679+0000 7f337d196980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55ded979b2c0 con 0x55ded979a470 2024-09-13T06:09:53.685 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.683+0000 7f337aca6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ded979a470 0x55ded9764b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.685 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.683+0000 7f337aca6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ded979a470 0x55ded9764b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44292/0 (socket says 172.21.15.194:44292) 2024-09-13T06:09:53.685 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.683+0000 7f337aca6640 1 -- 172.21.15.194:0/2191710200 learned_addr learned my addr 172.21.15.194:0/2191710200 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:53.685 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.683+0000 7f337aca6640 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ded9763220 con 0x55ded979a470 2024-09-13T06:09:53.686 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.683+0000 7f337aca6640 1 --2- 172.21.15.194:0/2191710200 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ded979a470 0x55ded9764b00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f336c004f50 tx=0x7f336c0acf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.686 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.683+0000 7f325cff9640 1 -- 172.21.15.194:0/2191710200 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f336c0e9040 con 0x55ded979a470 2024-09-13T06:09:53.686 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.683+0000 7f325cff9640 1 -- 172.21.15.194:0/2191710200 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f336c0ab340 con 0x55ded979a470 2024-09-13T06:09:53.686 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.683+0000 7f337d196980 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ded9763220 con 0x55ded979a470 2024-09-13T06:09:53.686 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.683+0000 7f325cff9640 1 -- 172.21.15.194:0/2191710200 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f336c0e4800 con 0x55ded979a470 2024-09-13T06:09:53.686 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.683+0000 7f337d196980 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ded9763220 con 0x55ded979a470 2024-09-13T06:09:53.690 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.683+0000 7f325cff9640 1 -- 172.21.15.194:0/2191710200 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f336c0e49a0 con 0x55ded979a470 2024-09-13T06:09:53.691 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.683+0000 7f325cff9640 1 --2- 172.21.15.194:0/2191710200 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f32440346a0 0x7f3244036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.691 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.683+0000 7f325cff9640 1 -- 172.21.15.194:0/2191710200 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f336c100070 con 0x55ded979a470 2024-09-13T06:09:53.691 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.683+0000 7f337a4a5640 1 --2- 172.21.15.194:0/2191710200 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f32440346a0 0x7f3244036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.691 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.683+0000 7f337d196980 20 rados->read ofs=0 len=0 2024-09-13T06:09:53.691 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.683+0000 7f337d196980 1 --2- 172.21.15.194:0/2191710200 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ded97ae8b0 0x55ded97b0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.691 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.683+0000 7f337d196980 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ded97b14c0 con 0x55ded97ae8b0 2024-09-13T06:09:53.691 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.683+0000 7f337b4a7640 1 --2- 172.21.15.194:0/2191710200 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ded97ae8b0 0x55ded97b0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.691 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.683+0000 7f337a4a5640 1 --2- 172.21.15.194:0/2191710200 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f32440346a0 0x7f3244036b60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x55ded9780490 tx=0x7f3364010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.691 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.683+0000 7f337b4a7640 1 --2- 172.21.15.194:0/2191710200 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ded97ae8b0 0x55ded97b0d70 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.691 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.687+0000 7f337b4a7640 1 -- 172.21.15.194:0/2191710200 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f33740083f0 con 0x55ded97ae8b0 2024-09-13T06:09:53.691 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.687+0000 7f337d196980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:53.691 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.687+0000 7f337d196980 20 realm 2024-09-13T06:09:53.692 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.687+0000 7f337d196980 20 rados->read ofs=0 len=0 2024-09-13T06:09:53.692 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.687+0000 7f337d196980 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ded97b18d0 con 0x55ded97ae8b0 2024-09-13T06:09:53.692 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.687+0000 7f337b4a7640 1 -- 172.21.15.194:0/2191710200 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f33740083f0 con 0x55ded97ae8b0 2024-09-13T06:09:53.692 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.687+0000 7f337d196980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:53.692 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.687+0000 7f337d196980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:09:53.692 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.687+0000 7f337d196980 20 rados->read ofs=0 len=0 2024-09-13T06:09:53.692 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.687+0000 7f337d196980 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ded97b21a0 con 0x55ded97ae8b0 2024-09-13T06:09:53.692 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.687+0000 7f337b4a7640 1 -- 172.21.15.194:0/2191710200 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f33740083f0 con 0x55ded97ae8b0 2024-09-13T06:09:53.692 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.687+0000 7f337d196980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:53.692 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.687+0000 7f337d196980 20 rados->read ofs=0 len=0 2024-09-13T06:09:53.692 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.687+0000 7f337d196980 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ded97b2540 con 0x55ded97ae8b0 2024-09-13T06:09:53.692 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.687+0000 7f337b4a7640 1 -- 172.21.15.194:0/2191710200 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f33740083f0 con 0x55ded97ae8b0 2024-09-13T06:09:53.693 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.687+0000 7f337d196980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:53.693 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.687+0000 7f337d196980 20 rados->read ofs=0 len=0 2024-09-13T06:09:53.693 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.687+0000 7f337d196980 1 --2- 172.21.15.194:0/2191710200 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ded97b32a0 0x55ded97b5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.693 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.687+0000 7f337d196980 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ded97b5ca0 con 0x55ded97b32a0 2024-09-13T06:09:53.693 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.687+0000 7f337aca6640 1 --2- 172.21.15.194:0/2191710200 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ded97b32a0 0x55ded97b5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.693 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.687+0000 7f337aca6640 1 --2- 172.21.15.194:0/2191710200 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ded97b32a0 0x55ded97b5690 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.693 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.687+0000 7f337aca6640 1 -- 172.21.15.194:0/2191710200 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f336c109020 con 0x55ded97b32a0 2024-09-13T06:09:53.693 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.687+0000 7f337d196980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:09:53.693 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.687+0000 7f337d196980 20 searching for the correct realm 2024-09-13T06:09:53.693 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.687+0000 7f337d196980 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ded97b7570 con 0x55ded97b32a0 2024-09-13T06:09:53.693 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.687+0000 7f337aca6640 1 -- 172.21.15.194:0/2191710200 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f336c109020 con 0x55ded97b32a0 2024-09-13T06:09:53.693 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.687+0000 7f337aca6640 1 --2- 172.21.15.194:0/2191710200 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f336c103030 0x7f336c0db770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.693 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.687+0000 7f337aca6640 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ded97b7570 con 0x7f336c103030 2024-09-13T06:09:53.694 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.687+0000 7f337a4a5640 1 --2- 172.21.15.194:0/2191710200 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f336c103030 0x7f336c0db770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.694 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.687+0000 7f337a4a5640 1 --2- 172.21.15.194:0/2191710200 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f336c103030 0x7f336c0db770 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.694 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.687+0000 7f337a4a5640 1 -- 172.21.15.194:0/2191710200 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f336400e6c0 con 0x7f336c103030 2024-09-13T06:09:53.694 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.687+0000 7f337a4a5640 1 --2- 172.21.15.194:0/2191710200 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f3364037040 0x7f3364036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.694 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.687+0000 7f337a4a5640 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ded97b7570 con 0x7f3364037040 2024-09-13T06:09:53.694 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.687+0000 7f337b4a7640 1 --2- 172.21.15.194:0/2191710200 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f3364037040 0x7f3364036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.694 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.691+0000 7f337b4a7640 1 --2- 172.21.15.194:0/2191710200 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f3364037040 0x7f3364036410 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.698 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.691+0000 7f337b4a7640 1 -- 172.21.15.194:0/2191710200 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33740083f0 con 0x7f3364037040 2024-09-13T06:09:53.698 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.691+0000 7f337b4a7640 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ded97b2540 con 0x55ded97ae8b0 2024-09-13T06:09:53.698 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.691+0000 7f337b4a7640 1 -- 172.21.15.194:0/2191710200 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33740083f0 con 0x55ded97ae8b0 2024-09-13T06:09:53.698 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.691+0000 7f337b4a7640 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ded97b2540 con 0x55ded97ae8b0 2024-09-13T06:09:53.698 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.691+0000 7f337b4a7640 1 -- 172.21.15.194:0/2191710200 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33740083f0 con 0x55ded97ae8b0 2024-09-13T06:09:53.698 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.691+0000 7f337b4a7640 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ded97b2540 con 0x7f3364037040 2024-09-13T06:09:53.698 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.691+0000 7f337b4a7640 1 -- 172.21.15.194:0/2191710200 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33740083f0 con 0x7f3364037040 2024-09-13T06:09:53.698 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.691+0000 7f337b4a7640 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ded97b2540 con 0x7f3364037040 2024-09-13T06:09:53.699 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.691+0000 7f337b4a7640 1 -- 172.21.15.194:0/2191710200 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33740083f0 con 0x7f3364037040 2024-09-13T06:09:53.699 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.691+0000 7f337b4a7640 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ded97b2540 con 0x7f336c103030 2024-09-13T06:09:53.699 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.691+0000 7f337a4a5640 1 -- 172.21.15.194:0/2191710200 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f336400e6c0 con 0x7f336c103030 2024-09-13T06:09:53.699 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.691+0000 7f337a4a5640 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ded97b2540 con 0x55ded97b32a0 2024-09-13T06:09:53.699 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.691+0000 7f337aca6640 1 -- 172.21.15.194:0/2191710200 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f336c109020 con 0x55ded97b32a0 2024-09-13T06:09:53.699 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.691+0000 7f337aca6640 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ded97b2540 con 0x55ded97ae8b0 2024-09-13T06:09:53.699 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.691+0000 7f337b4a7640 1 -- 172.21.15.194:0/2191710200 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33740083f0 con 0x55ded97ae8b0 2024-09-13T06:09:53.699 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.691+0000 7f337b4a7640 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ded97b2540 con 0x7f3364037040 2024-09-13T06:09:53.699 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.695+0000 7f337b4a7640 1 -- 172.21.15.194:0/2191710200 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33740083f0 con 0x7f3364037040 2024-09-13T06:09:53.699 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.695+0000 7f337b4a7640 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ded97b2540 con 0x55ded97ae8b0 2024-09-13T06:09:53.699 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.695+0000 7f337b4a7640 1 -- 172.21.15.194:0/2191710200 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33740083f0 con 0x55ded97ae8b0 2024-09-13T06:09:53.699 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.695+0000 7f337b4a7640 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ded97b2540 con 0x7f336c103030 2024-09-13T06:09:53.699 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.695+0000 7f337a4a5640 1 -- 172.21.15.194:0/2191710200 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f336400e6c0 con 0x7f336c103030 2024-09-13T06:09:53.700 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.695+0000 7f337a4a5640 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ded97b2540 con 0x55ded97b32a0 2024-09-13T06:09:53.700 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.695+0000 7f337aca6640 1 -- 172.21.15.194:0/2191710200 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f336c109020 con 0x55ded97b32a0 2024-09-13T06:09:53.700 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.695+0000 7f337aca6640 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ded97b2540 con 0x55ded97b32a0 2024-09-13T06:09:53.700 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.695+0000 7f337aca6640 1 -- 172.21.15.194:0/2191710200 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f336c109020 con 0x55ded97b32a0 2024-09-13T06:09:53.700 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.695+0000 7f337aca6640 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ded97b2540 con 0x7f3364037040 2024-09-13T06:09:53.700 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.695+0000 7f337b4a7640 1 -- 172.21.15.194:0/2191710200 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33740083f0 con 0x7f3364037040 2024-09-13T06:09:53.700 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.695+0000 7f337b4a7640 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ded97b2540 con 0x55ded97b32a0 2024-09-13T06:09:53.700 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.695+0000 7f337aca6640 1 -- 172.21.15.194:0/2191710200 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f336c109020 con 0x55ded97b32a0 2024-09-13T06:09:53.700 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.695+0000 7f337aca6640 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ded97b2540 con 0x55ded97b32a0 2024-09-13T06:09:53.700 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.695+0000 7f337aca6640 1 -- 172.21.15.194:0/2191710200 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f336c109020 con 0x55ded97b32a0 2024-09-13T06:09:53.700 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.695+0000 7f337aca6640 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ded97b2540 con 0x55ded97ae8b0 2024-09-13T06:09:53.701 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.695+0000 7f337b4a7640 1 -- 172.21.15.194:0/2191710200 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33740083f0 con 0x55ded97ae8b0 2024-09-13T06:09:53.701 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.695+0000 7f337b4a7640 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ded97b2540 con 0x55ded97ae8b0 2024-09-13T06:09:53.701 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.695+0000 7f337b4a7640 1 -- 172.21.15.194:0/2191710200 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f33740083f0 con 0x55ded97ae8b0 2024-09-13T06:09:53.701 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.695+0000 7f337b4a7640 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ded97b2540 con 0x7f3364037040 2024-09-13T06:09:53.701 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.695+0000 7f337b4a7640 1 -- 172.21.15.194:0/2191710200 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33740083f0 con 0x7f3364037040 2024-09-13T06:09:53.701 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.695+0000 7f337b4a7640 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ded97b2540 con 0x55ded97b32a0 2024-09-13T06:09:53.705 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.699+0000 7f337aca6640 1 -- 172.21.15.194:0/2191710200 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f336c109020 con 0x55ded97b32a0 2024-09-13T06:09:53.705 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.699+0000 7f337aca6640 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ded97b2540 con 0x7f336c103030 2024-09-13T06:09:53.705 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.699+0000 7f337a4a5640 1 -- 172.21.15.194:0/2191710200 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f336400e6c0 con 0x7f336c103030 2024-09-13T06:09:53.705 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.699+0000 7f337a4a5640 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ded97b2540 con 0x55ded97ae8b0 2024-09-13T06:09:53.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.699+0000 7f337b4a7640 1 -- 172.21.15.194:0/2191710200 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33740083f0 con 0x55ded97ae8b0 2024-09-13T06:09:53.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.699+0000 7f337b4a7640 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ded97b2540 con 0x7f3364037040 2024-09-13T06:09:53.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.699+0000 7f337b4a7640 1 -- 172.21.15.194:0/2191710200 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33740083f0 con 0x7f3364037040 2024-09-13T06:09:53.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.699+0000 7f337b4a7640 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ded97b2540 con 0x55ded97b32a0 2024-09-13T06:09:53.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.699+0000 7f337aca6640 1 -- 172.21.15.194:0/2191710200 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f336c109020 con 0x55ded97b32a0 2024-09-13T06:09:53.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.699+0000 7f337aca6640 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ded97b2540 con 0x7f3364037040 2024-09-13T06:09:53.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.699+0000 7f337b4a7640 1 -- 172.21.15.194:0/2191710200 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33740083f0 con 0x7f3364037040 2024-09-13T06:09:53.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.699+0000 7f337b4a7640 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ded97b2540 con 0x7f336c103030 2024-09-13T06:09:53.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.699+0000 7f337a4a5640 1 -- 172.21.15.194:0/2191710200 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f336400e6c0 con 0x7f336c103030 2024-09-13T06:09:53.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.699+0000 7f337a4a5640 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ded97b2540 con 0x55ded97b32a0 2024-09-13T06:09:53.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.699+0000 7f337aca6640 1 -- 172.21.15.194:0/2191710200 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f336c109020 con 0x55ded97b32a0 2024-09-13T06:09:53.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.699+0000 7f337aca6640 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ded97b2540 con 0x7f3364037040 2024-09-13T06:09:53.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.699+0000 7f337b4a7640 1 -- 172.21.15.194:0/2191710200 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33740083f0 con 0x7f3364037040 2024-09-13T06:09:53.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.699+0000 7f337b4a7640 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ded97b2540 con 0x55ded97ae8b0 2024-09-13T06:09:53.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.699+0000 7f337b4a7640 1 -- 172.21.15.194:0/2191710200 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f33740083f0 con 0x55ded97ae8b0 2024-09-13T06:09:53.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.699+0000 7f337b4a7640 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ded97b2540 con 0x7f336c103030 2024-09-13T06:09:53.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.703+0000 7f337a4a5640 1 -- 172.21.15.194:0/2191710200 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f336400e6c0 con 0x7f336c103030 2024-09-13T06:09:53.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.703+0000 7f337d196980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:09:53.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.703+0000 7f337d196980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:09:53.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.703+0000 7f337d196980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:09:53.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.703+0000 7f337d196980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:09:53.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.703+0000 7f337d196980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:09:53.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.703+0000 7f337d196980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:09:53.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.703+0000 7f337d196980 20 rados->read ofs=0 len=0 2024-09-13T06:09:53.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.703+0000 7f337d196980 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ded97b6690 con 0x55ded97ae8b0 2024-09-13T06:09:53.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.703+0000 7f337b4a7640 1 -- 172.21.15.194:0/2191710200 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f33740083f0 con 0x55ded97ae8b0 2024-09-13T06:09:53.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.703+0000 7f337d196980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:53.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.703+0000 7f337d196980 20 rados->read ofs=0 len=0 2024-09-13T06:09:53.708 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.703+0000 7f337d196980 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ded97b62d0 con 0x55ded97ae8b0 2024-09-13T06:09:53.708 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.703+0000 7f337b4a7640 1 -- 172.21.15.194:0/2191710200 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f33740083f0 con 0x55ded97ae8b0 2024-09-13T06:09:53.708 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.703+0000 7f337d196980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:53.708 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.703+0000 7f337d196980 20 rados->read ofs=0 len=0 2024-09-13T06:09:53.708 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.703+0000 7f337d196980 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ded97b6fb0 con 0x7f336c103030 2024-09-13T06:09:53.708 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.703+0000 7f337a4a5640 1 -- 172.21.15.194:0/2191710200 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f336400e6c0 con 0x7f336c103030 2024-09-13T06:09:53.708 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.703+0000 7f337d196980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:09:53.708 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.703+0000 7f337d196980 20 zone default found 2024-09-13T06:09:53.708 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.703+0000 7f337d196980 4 Realm: () 2024-09-13T06:09:53.708 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.703+0000 7f337d196980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:09:53.708 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.703+0000 7f337d196980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:09:53.708 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.703+0000 7f337d196980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:09:53.708 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.703+0000 7f337d196980 20 zonegroup default 2024-09-13T06:09:53.708 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.703+0000 7f337d196980 20 rados->read ofs=0 len=0 2024-09-13T06:09:53.709 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.703+0000 7f337d196980 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ded97b79a0 con 0x7f3364037040 2024-09-13T06:09:53.709 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.703+0000 7f337b4a7640 1 -- 172.21.15.194:0/2191710200 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f33740083f0 con 0x7f3364037040 2024-09-13T06:09:53.709 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.703+0000 7f337d196980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:53.709 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.703+0000 7f337d196980 20 rados->read ofs=0 len=0 2024-09-13T06:09:53.709 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.703+0000 7f337d196980 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ded97b9380 con 0x55ded97b32a0 2024-09-13T06:09:53.709 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.703+0000 7f337aca6640 1 -- 172.21.15.194:0/2191710200 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f336c109020 con 0x55ded97b32a0 2024-09-13T06:09:53.709 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.703+0000 7f337d196980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:53.709 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.703+0000 7f337d196980 20 rados->read ofs=0 len=0 2024-09-13T06:09:53.709 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.703+0000 7f337d196980 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ded97b98d0 con 0x55ded97b32a0 2024-09-13T06:09:53.709 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.703+0000 7f337aca6640 1 -- 172.21.15.194:0/2191710200 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f336c109020 con 0x55ded97b32a0 2024-09-13T06:09:53.709 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.703+0000 7f337d196980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:53.709 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.703+0000 7f337d196980 20 started sync module instance, tier type = 2024-09-13T06:09:53.709 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.703+0000 7f337d196980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:09:53.710 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.703+0000 7f337d196980 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ded97b8820 con 0x7f336c103030 2024-09-13T06:09:53.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.707+0000 7f337a4a5640 1 -- 172.21.15.194:0/2191710200 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(44 notify.0 [create] v33'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f336400e6c0 con 0x7f336c103030 2024-09-13T06:09:53.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.707+0000 7f337d196980 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94415619853328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ded97b8480 con 0x7f336c103030 2024-09-13T06:09:53.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.707+0000 7f337d196980 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ded97ba710 con 0x55ded97ae8b0 2024-09-13T06:09:53.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.707+0000 7f337a4a5640 1 -- 172.21.15.194:0/2191710200 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94415619853328] v33'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f336400e6c0 con 0x7f336c103030 2024-09-13T06:09:53.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.707+0000 7f337b4a7640 1 -- 172.21.15.194:0/2191710200 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v33'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33740083f0 con 0x55ded97ae8b0 2024-09-13T06:09:53.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.707+0000 7f337d196980 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94415619857712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ded97bab00 con 0x55ded97ae8b0 2024-09-13T06:09:53.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.707+0000 7f337d196980 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ded97bb4c0 con 0x55ded97b32a0 2024-09-13T06:09:53.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.711+0000 7f337aca6640 1 -- 172.21.15.194:0/2191710200 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v33'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f336c109020 con 0x55ded97b32a0 2024-09-13T06:09:53.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.711+0000 7f337d196980 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94415619862544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ded97bbd10 con 0x55ded97b32a0 2024-09-13T06:09:53.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.711+0000 7f337d196980 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ded97bc730 con 0x7f336c103030 2024-09-13T06:09:53.712 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.711+0000 7f337b4a7640 1 -- 172.21.15.194:0/2191710200 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94415619857712] v33'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33740083f0 con 0x55ded97ae8b0 2024-09-13T06:09:53.712 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.711+0000 7f337a4a5640 1 -- 172.21.15.194:0/2191710200 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(50 notify.3 [create] v33'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f336400e6c0 con 0x7f336c103030 2024-09-13T06:09:53.712 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.711+0000 7f337d196980 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94415619858768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ded97bcfd0 con 0x7f336c103030 2024-09-13T06:09:53.712 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.711+0000 7f337d196980 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ded97bd820 con 0x55ded97ae8b0 2024-09-13T06:09:53.713 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.711+0000 7f337aca6640 1 -- 172.21.15.194:0/2191710200 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94415619862544] v33'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f336c109020 con 0x55ded97b32a0 2024-09-13T06:09:53.713 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.711+0000 7f337a4a5640 1 -- 172.21.15.194:0/2191710200 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94415619858768] v33'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f336400e6c0 con 0x7f336c103030 2024-09-13T06:09:53.714 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.711+0000 7f337b4a7640 1 -- 172.21.15.194:0/2191710200 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v33'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33740083f0 con 0x55ded97ae8b0 2024-09-13T06:09:53.714 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.711+0000 7f337d196980 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94415619869472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ded97bd3f0 con 0x55ded97ae8b0 2024-09-13T06:09:53.714 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.711+0000 7f337d196980 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ded97be0c0 con 0x7f3364037040 2024-09-13T06:09:53.716 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.715+0000 7f337b4a7640 1 -- 172.21.15.194:0/2191710200 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94415619869472] v33'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33740083f0 con 0x55ded97ae8b0 2024-09-13T06:09:53.716 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.715+0000 7f337b4a7640 1 -- 172.21.15.194:0/2191710200 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(54 notify.5 [create] v33'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33740083f0 con 0x7f3364037040 2024-09-13T06:09:53.716 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.715+0000 7f337d196980 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94415619870528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ded97bd360 con 0x7f3364037040 2024-09-13T06:09:53.717 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.715+0000 7f337d196980 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ded97be5c0 con 0x7f3364037040 2024-09-13T06:09:53.718 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.715+0000 7f337b4a7640 1 -- 172.21.15.194:0/2191710200 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94415619870528] v33'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33740083f0 con 0x7f3364037040 2024-09-13T06:09:53.718 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.719+0000 7f337b4a7640 1 -- 172.21.15.194:0/2191710200 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(56 notify.6 [create] v33'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33740083f0 con 0x7f3364037040 2024-09-13T06:09:53.718 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.719+0000 7f337d196980 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94415619873456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ded97be580 con 0x7f3364037040 2024-09-13T06:09:53.719 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.719+0000 7f337d196980 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ded97befa0 con 0x7f3364037040 2024-09-13T06:09:53.721 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.719+0000 7f337b4a7640 1 -- 172.21.15.194:0/2191710200 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(58 notify.7 [create] v33'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33740083f0 con 0x7f3364037040 2024-09-13T06:09:53.721 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.719+0000 7f337d196980 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94415619877520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ded97bf410 con 0x7f3364037040 2024-09-13T06:09:53.721 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.719+0000 7f337d196980 20 add_watcher() i=0 2024-09-13T06:09:53.721 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.719+0000 7f337d196980 20 add_watcher() i=1 2024-09-13T06:09:53.721 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.719+0000 7f337d196980 20 add_watcher() i=2 2024-09-13T06:09:53.721 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.719+0000 7f337d196980 20 add_watcher() i=3 2024-09-13T06:09:53.721 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.719+0000 7f337d196980 20 add_watcher() i=4 2024-09-13T06:09:53.721 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.719+0000 7f337d196980 20 add_watcher() i=5 2024-09-13T06:09:53.721 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.719+0000 7f337b4a7640 1 -- 172.21.15.194:0/2191710200 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94415619873456] v33'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33740083f0 con 0x7f3364037040 2024-09-13T06:09:53.721 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.719+0000 7f337d196980 20 add_watcher() i=6 2024-09-13T06:09:53.722 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.723+0000 7f337b4a7640 1 -- 172.21.15.194:0/2191710200 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94415619877520] v33'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33740083f0 con 0x7f3364037040 2024-09-13T06:09:53.722 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.723+0000 7f337d196980 20 add_watcher() i=7 2024-09-13T06:09:53.723 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.723+0000 7f337d196980 2 all 8 watchers are set, enabling cache 2024-09-13T06:09:53.723 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.723+0000 7f337d196980 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ded97bf410 con 0x55ded97ae8b0 2024-09-13T06:09:53.723 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.723+0000 7f337b4a7640 1 -- 172.21.15.194:0/2191710200 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f33740083f0 con 0x55ded97ae8b0 2024-09-13T06:09:53.723 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.723+0000 7f337d196980 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94415619878752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ded97bf380 con 0x55ded97ae8b0 2024-09-13T06:09:53.725 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.723+0000 7f337b4a7640 1 -- 172.21.15.194:0/2191710200 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94415619878752] v33'56 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f33740083f0 con 0x55ded97ae8b0 2024-09-13T06:09:53.725 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.723+0000 7f32317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:53.725 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.723+0000 7f337d196980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:09:53.725 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.723+0000 7f337d196980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:09:53.725 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.723+0000 7f337d196980 5 note: GC not initialized 2024-09-13T06:09:53.725 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.723+0000 7f31abfff640 20 reqs_thread_entry: start 2024-09-13T06:09:53.726 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.723+0000 7f337d196980 20 init_complete bucket index max shards: 11 2024-09-13T06:09:53.726 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.723+0000 7f337d196980 20 Filter name: none 2024-09-13T06:09:53.726 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.723+0000 7f31a9ffb640 20 reqs_thread_entry: start 2024-09-13T06:09:53.726 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.723+0000 7f337d196980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T06:09:53.726 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.723+0000 7f337d196980 20 rados->read ofs=0 len=0 2024-09-13T06:09:53.726 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.723+0000 7f337d196980 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ded97e5ac0 con 0x55ded97ae8b0 2024-09-13T06:09:53.727 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.723+0000 7f337b4a7640 1 -- 172.21.15.194:0/2191710200 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f33740083f0 con 0x55ded97ae8b0 2024-09-13T06:09:53.727 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.723+0000 7f337d196980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T06:09:53.727 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.723+0000 7f337d196980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T06:09:53.727 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.723+0000 7f337d196980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:09:53.727 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.723+0000 7f337d196980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:09:53.727 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.723+0000 7f337d196980 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ded97e55a0 con 0x7f336c103030 2024-09-13T06:09:53.728 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.723+0000 7f337a4a5640 1 -- 172.21.15.194:0/2191710200 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f336400e6c0 con 0x7f336c103030 2024-09-13T06:09:53.728 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.723+0000 7f337d196980 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ded97ebd30 con 0x55ded97ae8b0 2024-09-13T06:09:53.729 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.727+0000 7f337b4a7640 1 -- 172.21.15.194:0/2191710200 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v33'2 uv2 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f33740083f0 con 0x55ded97ae8b0 2024-09-13T06:09:53.729 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.727+0000 7f337d196980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T06:09:53.729 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.727+0000 7f337d196980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:09:53.729 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.727+0000 7f337d196980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T06:09:53.729 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.727+0000 7f337d196980 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94415620061632 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ded97e8a50 con 0x55ded97ae8b0 2024-09-13T06:09:53.729 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.727+0000 7f337b4a7640 1 -- 172.21.15.194:0/2191710200 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== watch-notify(notify (1) cookie 94415619869472 notify 141733920769 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f337403b040 con 0x55ded97ae8b0 2024-09-13T06:09:53.729 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.727+0000 7f325e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920769 cookie 94415619869472 notifier 4311 bl.length()=567 2024-09-13T06:09:53.729 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.727+0000 7f325e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T06:09:53.730 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.727+0000 7f325e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:09:53.730 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.727+0000 7f325e7fc640 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f3240003eb0 con 0x55ded97ae8b0 2024-09-13T06:09:53.730 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.727+0000 7f337b4a7640 1 -- 172.21.15.194:0/2191710200 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(65 notify.4 [notify cookie 94415620061632 out=8b] v0'0 uv33 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f33740083f0 con 0x55ded97ae8b0 2024-09-13T06:09:53.730 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.727+0000 7f337b4a7640 1 -- 172.21.15.194:0/2191710200 <== osd.1 v2:172.21.15.194:6808/3135444559 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33740083f0 con 0x55ded97ae8b0 2024-09-13T06:09:53.730 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.727+0000 7f337b4a7640 1 -- 172.21.15.194:0/2191710200 <== osd.1 v2:172.21.15.194:6808/3135444559 26 ==== watch-notify(notify_complete (2) cookie 94415620061632 notify 141733920769 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f3374010040 con 0x55ded97ae8b0 2024-09-13T06:09:53.730 INFO:teuthology.orchestra.run.smithi194.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T06:09:53.191222Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:09:53.191207Z","tags":[],"group_ids":[]} 2024-09-13T06:09:53.731 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.727+0000 7f32317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:53.731 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.727+0000 7f337d196980 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94415619878752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ded97e38f0 con 0x55ded97ae8b0 2024-09-13T06:09:53.731 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.731+0000 7f337b4a7640 1 -- 172.21.15.194:0/2191710200 <== osd.1 v2:172.21.15.194:6808/3135444559 27 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94415619878752] v33'57 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f33740083f0 con 0x55ded97ae8b0 2024-09-13T06:09:53.731 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.731+0000 7f337d196980 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94415619853328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ded97e38f0 con 0x7f336c103030 2024-09-13T06:09:53.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.731+0000 7f337a4a5640 1 -- 172.21.15.194:0/2191710200 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94415619853328] v33'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f336400e6c0 con 0x7f336c103030 2024-09-13T06:09:53.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.731+0000 7f337d196980 20 remove_watcher() i=0 2024-09-13T06:09:53.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.731+0000 7f337d196980 2 removed watcher, disabling cache 2024-09-13T06:09:53.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.731+0000 7f337d196980 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94415619857712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ded97b8c10 con 0x55ded97ae8b0 2024-09-13T06:09:53.734 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.731+0000 7f337b4a7640 1 -- 172.21.15.194:0/2191710200 <== osd.1 v2:172.21.15.194:6808/3135444559 28 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94415619857712] v33'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33740083f0 con 0x55ded97ae8b0 2024-09-13T06:09:53.734 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.731+0000 7f337d196980 20 remove_watcher() i=1 2024-09-13T06:09:53.734 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.731+0000 7f337d196980 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94415619862544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ded97e38f0 con 0x55ded97b32a0 2024-09-13T06:09:53.736 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.735+0000 7f337aca6640 1 -- 172.21.15.194:0/2191710200 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94415619862544] v33'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f336c109020 con 0x55ded97b32a0 2024-09-13T06:09:53.736 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.735+0000 7f337d196980 20 remove_watcher() i=2 2024-09-13T06:09:53.736 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.735+0000 7f337d196980 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94415619858768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ded97b9d30 con 0x7f336c103030 2024-09-13T06:09:53.737 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.735+0000 7f337a4a5640 1 -- 172.21.15.194:0/2191710200 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94415619858768] v33'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f336400e6c0 con 0x7f336c103030 2024-09-13T06:09:53.738 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.735+0000 7f337d196980 20 remove_watcher() i=3 2024-09-13T06:09:53.738 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.735+0000 7f337d196980 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94415619869472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ded97b8c10 con 0x55ded97ae8b0 2024-09-13T06:09:53.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.739+0000 7f337b4a7640 1 -- 172.21.15.194:0/2191710200 <== osd.1 v2:172.21.15.194:6808/3135444559 29 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94415619869472] v33'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33740083f0 con 0x55ded97ae8b0 2024-09-13T06:09:53.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.739+0000 7f337d196980 20 remove_watcher() i=4 2024-09-13T06:09:53.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.739+0000 7f337d196980 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94415619870528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ded97e38f0 con 0x7f3364037040 2024-09-13T06:09:53.741 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.739+0000 7f337b4a7640 1 -- 172.21.15.194:0/2191710200 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94415619870528] v33'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33740083f0 con 0x7f3364037040 2024-09-13T06:09:53.741 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.739+0000 7f337d196980 20 remove_watcher() i=5 2024-09-13T06:09:53.741 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.739+0000 7f337d196980 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94415619873456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ded97b8c10 con 0x7f3364037040 2024-09-13T06:09:53.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.743+0000 7f337b4a7640 1 -- 172.21.15.194:0/2191710200 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94415619873456] v33'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33740083f0 con 0x7f3364037040 2024-09-13T06:09:53.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.743+0000 7f337d196980 20 remove_watcher() i=6 2024-09-13T06:09:53.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.743+0000 7f337d196980 1 -- 172.21.15.194:0/2191710200 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94415619877520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ded97e38f0 con 0x7f3364037040 2024-09-13T06:09:53.748 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.743+0000 7f337b4a7640 1 -- 172.21.15.194:0/2191710200 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94415619877520] v33'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33740083f0 con 0x7f3364037040 2024-09-13T06:09:53.748 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.743+0000 7f337d196980 20 remove_watcher() i=7 2024-09-13T06:09:53.748 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.743+0000 7f337d196980 1 -- 172.21.15.194:0/2191710200 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f3364037040 msgr2=0x7f3364036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.748 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.743+0000 7f337d196980 1 --2- 172.21.15.194:0/2191710200 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f3364037040 0x7f3364036410 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.748 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.743+0000 7f337d196980 1 -- 172.21.15.194:0/2191710200 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ded97ae8b0 msgr2=0x55ded97b0d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.748 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.743+0000 7f337d196980 1 --2- 172.21.15.194:0/2191710200 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ded97ae8b0 0x55ded97b0d70 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.748 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.743+0000 7f337d196980 1 -- 172.21.15.194:0/2191710200 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f336c103030 msgr2=0x7f336c0db770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.748 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.743+0000 7f337d196980 1 --2- 172.21.15.194:0/2191710200 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f336c103030 0x7f336c0db770 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.749 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.743+0000 7f337d196980 1 -- 172.21.15.194:0/2191710200 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ded97b32a0 msgr2=0x55ded97b5690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.749 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.743+0000 7f337d196980 1 --2- 172.21.15.194:0/2191710200 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ded97b32a0 0x55ded97b5690 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.749 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.743+0000 7f337d196980 1 -- 172.21.15.194:0/2191710200 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f32440346a0 msgr2=0x7f3244036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.749 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.743+0000 7f337d196980 1 --2- 172.21.15.194:0/2191710200 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f32440346a0 0x7f3244036b60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x55ded9780490 tx=0x7f3364010000 comp rx=0 tx=0).stop 2024-09-13T06:09:53.749 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.743+0000 7f337d196980 1 -- 172.21.15.194:0/2191710200 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ded979a470 msgr2=0x55ded9764b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.749 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.743+0000 7f337d196980 1 --2- 172.21.15.194:0/2191710200 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ded979a470 0x55ded9764b00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f336c004f50 tx=0x7f336c0acf50 comp rx=0 tx=0).stop 2024-09-13T06:09:53.749 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.743+0000 7f337b4a7640 1 -- 172.21.15.194:0/2191710200 reap_dead start 2024-09-13T06:09:53.749 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.743+0000 7f337d196980 1 -- 172.21.15.194:0/2191710200 shutdown_connections 2024-09-13T06:09:53.749 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.743+0000 7f337d196980 1 -- 172.21.15.194:0/2191710200 >> 172.21.15.194:0/2191710200 conn(0x55ded9796850 msgr2=0x55ded9794920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:53.749 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.743+0000 7f337d196980 1 -- 172.21.15.194:0/2191710200 shutdown_connections 2024-09-13T06:09:53.749 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.743+0000 7f337d196980 1 -- 172.21.15.194:0/2191710200 wait complete. 2024-09-13T06:09:53.749 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.743+0000 7f337d196980 1 -- 172.21.15.194:0/9460790 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3254034650 msgr2=0x7f3254036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.750 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.743+0000 7f337d196980 1 --2- 172.21.15.194:0/9460790 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3254034650 0x7f3254036b10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x55ded97787a0 tx=0x7f336400f000 comp rx=0 tx=0).stop 2024-09-13T06:09:53.750 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.747+0000 7f337d196980 1 -- 172.21.15.194:0/9460790 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ded978db60 msgr2=0x55ded978df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.750 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.747+0000 7f337d196980 1 --2- 172.21.15.194:0/9460790 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ded978db60 0x55ded978df80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f336c0b8010 tx=0x7f336c0b8360 comp rx=0 tx=0).stop 2024-09-13T06:09:53.750 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.747+0000 7f337d196980 1 -- 172.21.15.194:0/9460790 shutdown_connections 2024-09-13T06:09:53.750 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.747+0000 7f337d196980 1 --2- 172.21.15.194:0/9460790 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3254034650 0x7f3254036b10 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.750 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.747+0000 7f337d196980 1 --2- 172.21.15.194:0/9460790 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ded978db60 0x55ded978df80 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.750 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.747+0000 7f337d196980 1 -- 172.21.15.194:0/9460790 >> 172.21.15.194:0/9460790 conn(0x55ded9782cb0 msgr2=0x55ded9785730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:53.750 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.747+0000 7f337d196980 1 -- 172.21.15.194:0/9460790 shutdown_connections 2024-09-13T06:09:53.750 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.747+0000 7f337d196980 1 -- 172.21.15.194:0/9460790 wait complete. 2024-09-13T06:09:53.750 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.747+0000 7f337d196980 1 -- 172.21.15.194:0/2992185486 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ded967ce90 msgr2=0x55ded9776d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.750 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.747+0000 7f337d196980 1 --2- 172.21.15.194:0/2992185486 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ded967ce90 0x55ded9776d70 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.747+0000 7f337d196980 1 -- 172.21.15.194:0/2992185486 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55ded977d550 msgr2=0x55ded977f940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.747+0000 7f337d196980 1 --2- 172.21.15.194:0/2992185486 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55ded977d550 0x55ded977f940 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.747+0000 7f337d196980 1 -- 172.21.15.194:0/2992185486 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ded97794c0 msgr2=0x55ded977b960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.747+0000 7f337d196980 1 --2- 172.21.15.194:0/2992185486 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ded97794c0 0x55ded977b960 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.747+0000 7f337d196980 1 -- 172.21.15.194:0/2992185486 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3260034650 msgr2=0x7f3260036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.747+0000 7f337d196980 1 --2- 172.21.15.194:0/2992185486 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3260034650 0x7f3260036b10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3364001da0 tx=0x7f3364001300 comp rx=0 tx=0).stop 2024-09-13T06:09:53.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.747+0000 7f337d196980 1 -- 172.21.15.194:0/2992185486 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ded967c540 msgr2=0x55ded976fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.747+0000 7f337d196980 1 --2- 172.21.15.194:0/2992185486 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ded967c540 0x55ded976fc70 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f336c01b870 tx=0x7f336c019810 comp rx=0 tx=0).stop 2024-09-13T06:09:53.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.747+0000 7f337b4a7640 1 -- 172.21.15.194:0/2992185486 reap_dead start 2024-09-13T06:09:53.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.747+0000 7f337d196980 1 -- 172.21.15.194:0/2992185486 shutdown_connections 2024-09-13T06:09:53.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.747+0000 7f337d196980 1 -- 172.21.15.194:0/2992185486 >> 172.21.15.194:0/2992185486 conn(0x55ded9678060 msgr2=0x55ded97620c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:53.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.747+0000 7f337d196980 1 -- 172.21.15.194:0/2992185486 shutdown_connections 2024-09-13T06:09:53.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.747+0000 7f337d196980 1 -- 172.21.15.194:0/2992185486 wait complete. 2024-09-13T06:09:53.758 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T06:09:53.191222Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:09:53.191207Z', 'tags': [], 'group_ids': []} 2024-09-13T06:09:53.758 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T06:09:53.759 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T06:09:53.759 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T06:09:53.835 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:09:53.835 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:09:53.836 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.835+0000 7f31c902e980 1 Processor -- start 2024-09-13T06:09:53.836 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.835+0000 7f31c902e980 1 -- start start 2024-09-13T06:09:53.836 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.835+0000 7f31c902e980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55ff381caa10 0x55ff381cce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.836 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.835+0000 7f31c902e980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ff3804eae0 con 0x55ff381c6690 2024-09-13T06:09:53.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.835+0000 7f31c902e980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x55ff38072e30 con 0x55ff381caa10 2024-09-13T06:09:53.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.835+0000 7f31c633d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55ff381caa10 0x55ff381cce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.835+0000 7f31c633d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55ff381caa10 0x55ff381cce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44300/0 (socket says 172.21.15.194:44300) 2024-09-13T06:09:53.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.835+0000 7f31c633d640 1 -- 172.21.15.194:0/3850958561 learned_addr learned my addr 172.21.15.194:0/3850958561 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:53.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.835+0000 7f31c6b3e640 1 --1- 172.21.15.194:0/3850958561 >> v1:172.21.15.120:6789/0 conn(0x55ff381c6690 0x55ff381c6a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:50938/0 (socket says 172.21.15.194:50938) 2024-09-13T06:09:53.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.835+0000 7f31c633d640 1 -- 172.21.15.194:0/3850958561 >> v1:172.21.15.120:6789/0 conn(0x55ff381c6690 legacy=0x55ff381c6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.835+0000 7f31c633d640 1 -- 172.21.15.194:0/3850958561 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff381ce350 con 0x55ff381caa10 2024-09-13T06:09:53.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.839+0000 7f31c633d640 1 --2- 172.21.15.194:0/3850958561 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff381caa10 0x55ff381cce00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f31b000a5c0 tx=0x7f31b001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9c10d20fb8980dc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.840 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.839+0000 7f31c5b3c640 1 -- 172.21.15.194:0/3850958561 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31b00a6070 con 0x55ff381caa10 2024-09-13T06:09:53.840 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.839+0000 7f31c5b3c640 1 -- 172.21.15.194:0/3850958561 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31b00af070 con 0x55ff381caa10 2024-09-13T06:09:53.840 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.839+0000 7f31c5b3c640 1 -- 172.21.15.194:0/3850958561 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31b00aa5c0 con 0x55ff381caa10 2024-09-13T06:09:53.841 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.839+0000 7f31c902e980 1 -- 172.21.15.194:0/3850958561 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff381caa10 msgr2=0x55ff381cce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.841 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.839+0000 7f31c902e980 1 --2- 172.21.15.194:0/3850958561 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff381caa10 0x55ff381cce00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f31b000a5c0 tx=0x7f31b001b340 comp rx=0 tx=0).stop 2024-09-13T06:09:53.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.839+0000 7f31c902e980 1 -- 172.21.15.194:0/3850958561 shutdown_connections 2024-09-13T06:09:53.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.839+0000 7f31c902e980 1 --2- 172.21.15.194:0/3850958561 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff381caa10 0x55ff381cce00 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.845 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.839+0000 7f31c902e980 1 -- 172.21.15.194:0/3850958561 >> 172.21.15.194:0/3850958561 conn(0x55ff381c21b0 msgr2=0x55ff381c45d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:53.845 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.839+0000 7f31c902e980 1 -- 172.21.15.194:0/3850958561 shutdown_connections 2024-09-13T06:09:53.845 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.839+0000 7f31c902e980 1 -- 172.21.15.194:0/3850958561 wait complete. 2024-09-13T06:09:53.856 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.855+0000 7f31c902e980 1 Processor -- start 2024-09-13T06:09:53.857 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.855+0000 7f31c902e980 1 -- start start 2024-09-13T06:09:53.857 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.855+0000 7f31c902e980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff381c6690 0x55ff382b1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.857 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.855+0000 7f31c902e980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55ff38074200 con 0x55ff381c6690 2024-09-13T06:09:53.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.855+0000 7f31c6b3e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff381c6690 0x55ff382b1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.855+0000 7f31c6b3e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff381c6690 0x55ff382b1a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44310/0 (socket says 172.21.15.194:44310) 2024-09-13T06:09:53.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.855+0000 7f31c6b3e640 1 -- 172.21.15.194:0/4149943384 learned_addr learned my addr 172.21.15.194:0/4149943384 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:53.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.855+0000 7f31c6b3e640 1 -- 172.21.15.194:0/4149943384 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff382b2050 con 0x55ff381c6690 2024-09-13T06:09:53.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.855+0000 7f31c6b3e640 1 --2- 172.21.15.194:0/4149943384 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff381c6690 0x55ff382b1a80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f31b80015f0 tx=0x7f31b8001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16a91cea96aeb42e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.855+0000 7f30b4e09640 1 -- 172.21.15.194:0/4149943384 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31b8013420 con 0x55ff381c6690 2024-09-13T06:09:53.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.855+0000 7f30b4e09640 1 -- 172.21.15.194:0/4149943384 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31b80135e0 con 0x55ff381c6690 2024-09-13T06:09:53.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.855+0000 7f30b4e09640 1 -- 172.21.15.194:0/4149943384 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31b8013940 con 0x55ff381c6690 2024-09-13T06:09:53.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.859+0000 7f31c902e980 1 -- 172.21.15.194:0/4149943384 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff381c6690 msgr2=0x55ff382b1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.859+0000 7f31c902e980 1 --2- 172.21.15.194:0/4149943384 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff381c6690 0x55ff382b1a80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f31b80015f0 tx=0x7f31b8001ab0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.859+0000 7f31c902e980 1 -- 172.21.15.194:0/4149943384 shutdown_connections 2024-09-13T06:09:53.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.859+0000 7f31c902e980 1 --2- 172.21.15.194:0/4149943384 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff381c6690 0x55ff382b1a80 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.859+0000 7f31c902e980 1 -- 172.21.15.194:0/4149943384 >> 172.21.15.194:0/4149943384 conn(0x55ff381c21b0 msgr2=0x55ff382ad6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:53.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.859+0000 7f31c902e980 1 -- 172.21.15.194:0/4149943384 shutdown_connections 2024-09-13T06:09:53.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.859+0000 7f31c902e980 1 -- 172.21.15.194:0/4149943384 wait complete. 2024-09-13T06:09:53.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.859+0000 7f31c902e980 1 Processor -- start 2024-09-13T06:09:53.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.859+0000 7f31c902e980 1 -- start start 2024-09-13T06:09:53.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.859+0000 7f31c902e980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff381caa10 0x55ff382b9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.861 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.859+0000 7f31c902e980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55ff381cde50 con 0x55ff381caa10 2024-09-13T06:09:53.861 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.859+0000 7f31c6b3e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff381caa10 0x55ff382b9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.861 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.859+0000 7f31c6b3e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff381caa10 0x55ff382b9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44326/0 (socket says 172.21.15.194:44326) 2024-09-13T06:09:53.861 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.859+0000 7f31c6b3e640 1 -- 172.21.15.194:0/3631829999 learned_addr learned my addr 172.21.15.194:0/3631829999 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:53.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.859+0000 7f31c6b3e640 1 -- 172.21.15.194:0/3631829999 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff382b9580 con 0x55ff381caa10 2024-09-13T06:09:53.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.859+0000 7f31c6b3e640 1 --2- 172.21.15.194:0/3631829999 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff381caa10 0x55ff382b9040 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f31b8006640 tx=0x7f31b8000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.859+0000 7f30b3606640 1 -- 172.21.15.194:0/3631829999 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31b8022020 con 0x55ff381caa10 2024-09-13T06:09:53.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.859+0000 7f30b3606640 1 -- 172.21.15.194:0/3631829999 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31b8006320 con 0x55ff381caa10 2024-09-13T06:09:53.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.859+0000 7f31c902e980 1 -- 172.21.15.194:0/3631829999 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ff382b9810 con 0x55ff381caa10 2024-09-13T06:09:53.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.859+0000 7f30b3606640 1 -- 172.21.15.194:0/3631829999 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31b8004aa0 con 0x55ff381caa10 2024-09-13T06:09:53.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.859+0000 7f31c902e980 1 -- 172.21.15.194:0/3631829999 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff382bc4f0 con 0x55ff381caa10 2024-09-13T06:09:53.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.859+0000 7f30b3606640 1 -- 172.21.15.194:0/3631829999 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f31b8025020 con 0x55ff381caa10 2024-09-13T06:09:53.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.863+0000 7f30b3606640 1 --2- 172.21.15.194:0/3631829999 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f30ac034650 0x7f30ac036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.863+0000 7f30b3606640 1 -- 172.21.15.194:0/3631829999 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f31b8018030 con 0x55ff381caa10 2024-09-13T06:09:53.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.863+0000 7f31c633d640 1 --2- 172.21.15.194:0/3631829999 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f30ac034650 0x7f30ac036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.863+0000 7f31c902e980 1 --2- 172.21.15.194:0/3631829999 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ff382bdfc0 0x55ff382c03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.863+0000 7f31c902e980 1 -- 172.21.15.194:0/3631829999 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ff382c0980 con 0x55ff382bdfc0 2024-09-13T06:09:53.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.863+0000 7f31c733f640 1 --2- 172.21.15.194:0/3631829999 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ff382bdfc0 0x55ff382c03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.863+0000 7f31c633d640 1 --2- 172.21.15.194:0/3631829999 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f30ac034650 0x7f30ac036b10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f31b00ae000 tx=0x7f31b00a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.863+0000 7f31c733f640 1 --2- 172.21.15.194:0/3631829999 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ff382bdfc0 0x55ff382c03b0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.863+0000 7f31c733f640 1 -- 172.21.15.194:0/3631829999 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f31c00083f0 con 0x55ff382bdfc0 2024-09-13T06:09:53.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.863+0000 7f31c902e980 1 -- 172.21.15.194:0/3631829999 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ff382bd710 con 0x55ff382bdfc0 2024-09-13T06:09:53.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.863+0000 7f31c733f640 1 -- 172.21.15.194:0/3631829999 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f31c00083f0 con 0x55ff382bdfc0 2024-09-13T06:09:53.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.863+0000 7f31c902e980 1 --2- 172.21.15.194:0/3631829999 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ff382c2cd0 0x55ff382c50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.863+0000 7f31c902e980 1 -- 172.21.15.194:0/3631829999 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ff382c5790 con 0x55ff382c2cd0 2024-09-13T06:09:53.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.863+0000 7f31c6b3e640 1 --2- 172.21.15.194:0/3631829999 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ff382c2cd0 0x55ff382c50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.863+0000 7f31c6b3e640 1 --2- 172.21.15.194:0/3631829999 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ff382c2cd0 0x55ff382c50c0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.863+0000 7f31c6b3e640 1 -- 172.21.15.194:0/3631829999 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f31b801b070 con 0x55ff382c2cd0 2024-09-13T06:09:53.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.863+0000 7f31c902e980 1 -- 172.21.15.194:0/3631829999 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ff382c1b70 con 0x55ff382bdfc0 2024-09-13T06:09:53.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.863+0000 7f31c733f640 1 -- 172.21.15.194:0/3631829999 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f31c00083f0 con 0x55ff382bdfc0 2024-09-13T06:09:53.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.863+0000 7f31c902e980 1 --2- 172.21.15.194:0/3631829999 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55ff382c6bd0 0x55ff382c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.863+0000 7f31c902e980 1 -- 172.21.15.194:0/3631829999 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ff382c9700 con 0x55ff382c6bd0 2024-09-13T06:09:53.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.863+0000 7f31c633d640 1 --2- 172.21.15.194:0/3631829999 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55ff382c6bd0 0x55ff382c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.863+0000 7f31c633d640 1 --2- 172.21.15.194:0/3631829999 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55ff382c6bd0 0x55ff382c8fc0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.863+0000 7f31c633d640 1 -- 172.21.15.194:0/3631829999 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f31b00aaa80 con 0x55ff382c6bd0 2024-09-13T06:09:53.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.867+0000 7f31c902e980 1 Processor -- start 2024-09-13T06:09:53.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.867+0000 7f31c902e980 1 -- start start 2024-09-13T06:09:53.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.867+0000 7f31c902e980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff382d7190 0x55ff382d75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.867+0000 7f31c902e980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55ff380cd800 con 0x55ff382d7190 2024-09-13T06:09:53.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.867+0000 7f31c6b3e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff382d7190 0x55ff382d75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.867+0000 7f31c6b3e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff382d7190 0x55ff382d75b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44336/0 (socket says 172.21.15.194:44336) 2024-09-13T06:09:53.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.867+0000 7f31c6b3e640 1 -- 172.21.15.194:0/541889213 learned_addr learned my addr 172.21.15.194:0/541889213 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:53.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.867+0000 7f31c6b3e640 1 -- 172.21.15.194:0/541889213 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff382d7af0 con 0x55ff382d7190 2024-09-13T06:09:53.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.867+0000 7f31c6b3e640 1 --2- 172.21.15.194:0/541889213 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff382d7190 0x55ff382d75b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f31b8006a00 tx=0x7f31b8010ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.867+0000 7f30b0e01640 1 -- 172.21.15.194:0/541889213 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31b8041170 con 0x55ff382d7190 2024-09-13T06:09:53.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.867+0000 7f30b0e01640 1 -- 172.21.15.194:0/541889213 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31b8041310 con 0x55ff382d7190 2024-09-13T06:09:53.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.867+0000 7f31c902e980 1 -- 172.21.15.194:0/541889213 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ff382d7d80 con 0x55ff382d7190 2024-09-13T06:09:53.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.867+0000 7f30b0e01640 1 -- 172.21.15.194:0/541889213 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31b80415f0 con 0x55ff382d7190 2024-09-13T06:09:53.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.867+0000 7f31c902e980 1 -- 172.21.15.194:0/541889213 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff382daa00 con 0x55ff382d7190 2024-09-13T06:09:53.871 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.867+0000 7f30b0e01640 1 -- 172.21.15.194:0/541889213 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f31b8010070 con 0x55ff382d7190 2024-09-13T06:09:53.871 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.867+0000 7f30b0e01640 1 --2- 172.21.15.194:0/541889213 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f30a00346a0 0x7f30a0036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.871 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.867+0000 7f30b0e01640 1 -- 172.21.15.194:0/541889213 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f31b8039040 con 0x55ff382d7190 2024-09-13T06:09:53.871 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.867+0000 7f31c633d640 1 --2- 172.21.15.194:0/541889213 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f30a00346a0 0x7f30a0036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.871 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.867+0000 7f31c902e980 1 Processor -- start 2024-09-13T06:09:53.871 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.867+0000 7f31c902e980 1 -- start start 2024-09-13T06:09:53.872 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.871+0000 7f31c633d640 1 --2- 172.21.15.194:0/541889213 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f30a00346a0 0x7f30a0036b60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f31b0018f70 tx=0x7f31b0005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.872 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.871+0000 7f31c902e980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff382e3a40 0x55ff382e3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.872 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.871+0000 7f31c902e980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55ff382b23d0 con 0x55ff382e3a40 2024-09-13T06:09:53.872 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.871+0000 7f31c6b3e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff382e3a40 0x55ff382e3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.872 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.871+0000 7f31c6b3e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff382e3a40 0x55ff382e3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44350/0 (socket says 172.21.15.194:44350) 2024-09-13T06:09:53.872 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.871+0000 7f31c6b3e640 1 -- 172.21.15.194:0/3494541454 learned_addr learned my addr 172.21.15.194:0/3494541454 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:53.872 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.871+0000 7f31c6b3e640 1 -- 172.21.15.194:0/3494541454 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff382e43f0 con 0x55ff382e3a40 2024-09-13T06:09:53.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.871+0000 7f31c6b3e640 1 --2- 172.21.15.194:0/3494541454 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff382e3a40 0x55ff382e3e20 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f31b8006790 tx=0x7f31b804c1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c86df6e23543b7c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.871+0000 7f30aa7fc640 1 -- 172.21.15.194:0/3494541454 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31b801d9b0 con 0x55ff382e3a40 2024-09-13T06:09:53.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.871+0000 7f30aa7fc640 1 -- 172.21.15.194:0/3494541454 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31b801d580 con 0x55ff382e3a40 2024-09-13T06:09:53.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.871+0000 7f30aa7fc640 1 -- 172.21.15.194:0/3494541454 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31b801db50 con 0x55ff382e3a40 2024-09-13T06:09:53.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.871+0000 7f31c902e980 1 -- 172.21.15.194:0/3494541454 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff382e3a40 msgr2=0x55ff382e3e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.871+0000 7f31c902e980 1 --2- 172.21.15.194:0/3494541454 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff382e3a40 0x55ff382e3e20 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f31b8006790 tx=0x7f31b804c1e0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.871+0000 7f31c902e980 1 -- 172.21.15.194:0/3494541454 shutdown_connections 2024-09-13T06:09:53.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.871+0000 7f31c902e980 1 --2- 172.21.15.194:0/3494541454 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff382e3a40 0x55ff382e3e20 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.871+0000 7f31c902e980 1 -- 172.21.15.194:0/3494541454 >> 172.21.15.194:0/3494541454 conn(0x55ff382dfe20 msgr2=0x55ff382ddf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:53.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.871+0000 7f31c902e980 1 -- 172.21.15.194:0/3494541454 shutdown_connections 2024-09-13T06:09:53.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.871+0000 7f31c902e980 1 -- 172.21.15.194:0/3494541454 wait complete. 2024-09-13T06:09:53.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.871+0000 7f31c902e980 1 Processor -- start 2024-09-13T06:09:53.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.871+0000 7f31c902e980 1 -- start start 2024-09-13T06:09:53.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.871+0000 7f31c902e980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff382e3a40 0x55ff382ecd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.871+0000 7f31c902e980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55ff382e4890 con 0x55ff382e3a40 2024-09-13T06:09:53.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.871+0000 7f31c6b3e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff382e3a40 0x55ff382ecd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.871+0000 7f31c6b3e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff382e3a40 0x55ff382ecd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44362/0 (socket says 172.21.15.194:44362) 2024-09-13T06:09:53.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.871+0000 7f31c6b3e640 1 -- 172.21.15.194:0/4165023178 learned_addr learned my addr 172.21.15.194:0/4165023178 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:53.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.871+0000 7f31c6b3e640 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff382ed2c0 con 0x55ff382e3a40 2024-09-13T06:09:53.876 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.875+0000 7f31c6b3e640 1 --2- 172.21.15.194:0/4165023178 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff382e3a40 0x55ff382ecd80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f31b8006790 tx=0x7f31b8038ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.879 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.875+0000 7f30a8ff9640 1 -- 172.21.15.194:0/4165023178 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31b806e020 con 0x55ff382e3a40 2024-09-13T06:09:53.879 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.875+0000 7f30a8ff9640 1 -- 172.21.15.194:0/4165023178 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31b8027610 con 0x55ff382e3a40 2024-09-13T06:09:53.879 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.875+0000 7f31c902e980 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ff382ed2c0 con 0x55ff382e3a40 2024-09-13T06:09:53.879 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.875+0000 7f30a8ff9640 1 -- 172.21.15.194:0/4165023178 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31b80278f0 con 0x55ff382e3a40 2024-09-13T06:09:53.879 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.875+0000 7f31c902e980 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff382ed2c0 con 0x55ff382e3a40 2024-09-13T06:09:53.879 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.875+0000 7f30a8ff9640 1 -- 172.21.15.194:0/4165023178 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f31b8071020 con 0x55ff382e3a40 2024-09-13T06:09:53.879 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.875+0000 7f31c902e980 20 rados->read ofs=0 len=0 2024-09-13T06:09:53.879 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.875+0000 7f30a8ff9640 1 --2- 172.21.15.194:0/4165023178 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f30900346a0 0x7f3090036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.879 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.875+0000 7f30a8ff9640 1 -- 172.21.15.194:0/4165023178 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f31b8064030 con 0x55ff382e3a40 2024-09-13T06:09:53.880 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.875+0000 7f31c633d640 1 --2- 172.21.15.194:0/4165023178 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f30900346a0 0x7f3090036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.880 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.875+0000 7f31c902e980 1 --2- 172.21.15.194:0/4165023178 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ff382f7d60 0x55ff382fa220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.880 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.875+0000 7f31c902e980 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ff382fa970 con 0x55ff382f7d60 2024-09-13T06:09:53.880 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.875+0000 7f31c733f640 1 --2- 172.21.15.194:0/4165023178 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ff382f7d60 0x55ff382fa220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.880 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.875+0000 7f31c633d640 1 --2- 172.21.15.194:0/4165023178 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f30900346a0 0x7f3090036b60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f31b0000c10 tx=0x7f31b00c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.880 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.875+0000 7f31c733f640 1 --2- 172.21.15.194:0/4165023178 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ff382f7d60 0x55ff382fa220 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.880 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.875+0000 7f31c733f640 1 -- 172.21.15.194:0/4165023178 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f31c00083f0 con 0x55ff382f7d60 2024-09-13T06:09:53.880 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.875+0000 7f31c902e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:53.881 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.875+0000 7f31c902e980 20 realm 2024-09-13T06:09:53.881 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.875+0000 7f31c902e980 20 rados->read ofs=0 len=0 2024-09-13T06:09:53.881 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.875+0000 7f31c902e980 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ff382fad80 con 0x55ff382f7d60 2024-09-13T06:09:53.881 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.875+0000 7f31c733f640 1 -- 172.21.15.194:0/4165023178 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f31c00083f0 con 0x55ff382f7d60 2024-09-13T06:09:53.881 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.875+0000 7f31c902e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:53.881 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.875+0000 7f31c902e980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:09:53.881 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.875+0000 7f31c902e980 20 rados->read ofs=0 len=0 2024-09-13T06:09:53.881 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.875+0000 7f31c902e980 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ff382fb620 con 0x55ff382f7d60 2024-09-13T06:09:53.881 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.875+0000 7f31c733f640 1 -- 172.21.15.194:0/4165023178 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f31c00083f0 con 0x55ff382f7d60 2024-09-13T06:09:53.881 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.875+0000 7f31c902e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:53.881 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.875+0000 7f31c902e980 20 rados->read ofs=0 len=0 2024-09-13T06:09:53.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.875+0000 7f31c902e980 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ff382fb9c0 con 0x55ff382f7d60 2024-09-13T06:09:53.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.875+0000 7f31c733f640 1 -- 172.21.15.194:0/4165023178 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f31c00083f0 con 0x55ff382f7d60 2024-09-13T06:09:53.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.875+0000 7f31c902e980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:53.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.875+0000 7f31c902e980 20 rados->read ofs=0 len=0 2024-09-13T06:09:53.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.875+0000 7f31c902e980 1 --2- 172.21.15.194:0/4165023178 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ff382fc720 0x55ff382feb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.875+0000 7f31c902e980 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ff382ff090 con 0x55ff382fc720 2024-09-13T06:09:53.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.879+0000 7f31c6b3e640 1 --2- 172.21.15.194:0/4165023178 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ff382fc720 0x55ff382feb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.879+0000 7f31c6b3e640 1 --2- 172.21.15.194:0/4165023178 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ff382fc720 0x55ff382feb10 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.879+0000 7f31c6b3e640 1 -- 172.21.15.194:0/4165023178 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f31b8067070 con 0x55ff382fc720 2024-09-13T06:09:53.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.879+0000 7f31c902e980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:09:53.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.879+0000 7f31c902e980 20 searching for the correct realm 2024-09-13T06:09:53.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.879+0000 7f31c902e980 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ff38300930 con 0x55ff382fc720 2024-09-13T06:09:53.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.879+0000 7f31c6b3e640 1 -- 172.21.15.194:0/4165023178 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31b8067070 con 0x55ff382fc720 2024-09-13T06:09:53.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.879+0000 7f31c6b3e640 1 --2- 172.21.15.194:0/4165023178 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f31b8073020 0x7f31b8052610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.879+0000 7f31c6b3e640 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ff38300930 con 0x7f31b8073020 2024-09-13T06:09:53.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.879+0000 7f31c633d640 1 --2- 172.21.15.194:0/4165023178 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f31b8073020 0x7f31b8052610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.887 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.879+0000 7f31c633d640 1 --2- 172.21.15.194:0/4165023178 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f31b8073020 0x7f31b8052610 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.887 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.879+0000 7f31c633d640 1 -- 172.21.15.194:0/4165023178 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f31b00aaa80 con 0x7f31b8073020 2024-09-13T06:09:53.887 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.879+0000 7f31c633d640 1 --2- 172.21.15.194:0/4165023178 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f31b00e0040 0x7f31b00e0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:53.887 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.879+0000 7f31c633d640 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ff38300930 con 0x7f31b00e0040 2024-09-13T06:09:53.887 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.879+0000 7f31c733f640 1 --2- 172.21.15.194:0/4165023178 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f31b00e0040 0x7f31b00e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:53.887 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.879+0000 7f31c733f640 1 --2- 172.21.15.194:0/4165023178 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f31b00e0040 0x7f31b00e0420 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:53.887 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.879+0000 7f31c733f640 1 -- 172.21.15.194:0/4165023178 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31c00083f0 con 0x7f31b00e0040 2024-09-13T06:09:53.887 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.879+0000 7f31c733f640 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ff382fb9c0 con 0x55ff382f7d60 2024-09-13T06:09:53.887 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.879+0000 7f31c733f640 1 -- 172.21.15.194:0/4165023178 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31c00083f0 con 0x55ff382f7d60 2024-09-13T06:09:53.887 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.879+0000 7f31c733f640 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ff382fb9c0 con 0x55ff382f7d60 2024-09-13T06:09:53.887 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.883+0000 7f31c733f640 1 -- 172.21.15.194:0/4165023178 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31c00083f0 con 0x55ff382f7d60 2024-09-13T06:09:53.887 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.883+0000 7f31c733f640 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ff382fb9c0 con 0x7f31b00e0040 2024-09-13T06:09:53.887 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.883+0000 7f31c733f640 1 -- 172.21.15.194:0/4165023178 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31c00083f0 con 0x7f31b00e0040 2024-09-13T06:09:53.887 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.883+0000 7f31c733f640 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ff382fb9c0 con 0x7f31b00e0040 2024-09-13T06:09:53.888 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.883+0000 7f31c733f640 1 -- 172.21.15.194:0/4165023178 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31c00083f0 con 0x7f31b00e0040 2024-09-13T06:09:53.888 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.883+0000 7f31c733f640 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ff382fb9c0 con 0x7f31b8073020 2024-09-13T06:09:53.888 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.883+0000 7f31c633d640 1 -- 172.21.15.194:0/4165023178 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31b00aaa80 con 0x7f31b8073020 2024-09-13T06:09:53.888 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.883+0000 7f31c633d640 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ff382fb9c0 con 0x55ff382fc720 2024-09-13T06:09:53.888 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.883+0000 7f31c6b3e640 1 -- 172.21.15.194:0/4165023178 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31b8067070 con 0x55ff382fc720 2024-09-13T06:09:53.888 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.883+0000 7f31c6b3e640 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ff382fb9c0 con 0x55ff382f7d60 2024-09-13T06:09:53.888 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.883+0000 7f31c733f640 1 -- 172.21.15.194:0/4165023178 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31c00083f0 con 0x55ff382f7d60 2024-09-13T06:09:53.888 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.883+0000 7f31c733f640 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ff382fb9c0 con 0x7f31b00e0040 2024-09-13T06:09:53.888 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.883+0000 7f31c733f640 1 -- 172.21.15.194:0/4165023178 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31c00083f0 con 0x7f31b00e0040 2024-09-13T06:09:53.888 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.883+0000 7f31c733f640 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ff382fb9c0 con 0x55ff382f7d60 2024-09-13T06:09:53.888 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.883+0000 7f31c733f640 1 -- 172.21.15.194:0/4165023178 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31c00083f0 con 0x55ff382f7d60 2024-09-13T06:09:53.888 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.883+0000 7f31c733f640 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ff382fb9c0 con 0x7f31b8073020 2024-09-13T06:09:53.889 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.883+0000 7f31c633d640 1 -- 172.21.15.194:0/4165023178 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f31b00aaa80 con 0x7f31b8073020 2024-09-13T06:09:53.889 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.883+0000 7f31c633d640 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ff382fb9c0 con 0x55ff382fc720 2024-09-13T06:09:53.889 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.883+0000 7f31c6b3e640 1 -- 172.21.15.194:0/4165023178 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31b8067070 con 0x55ff382fc720 2024-09-13T06:09:53.889 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.883+0000 7f31c6b3e640 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ff382fb9c0 con 0x55ff382fc720 2024-09-13T06:09:53.889 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.887+0000 7f31c6b3e640 1 -- 172.21.15.194:0/4165023178 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31b8067070 con 0x55ff382fc720 2024-09-13T06:09:53.889 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.887+0000 7f31c6b3e640 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f31b808a040 con 0x7f31b00e0040 2024-09-13T06:09:53.892 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.887+0000 7f31c733f640 1 -- 172.21.15.194:0/4165023178 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31c00083f0 con 0x7f31b00e0040 2024-09-13T06:09:53.892 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.887+0000 7f31c733f640 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f31b808a040 con 0x55ff382fc720 2024-09-13T06:09:53.893 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.887+0000 7f31c6b3e640 1 -- 172.21.15.194:0/4165023178 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31b8067070 con 0x55ff382fc720 2024-09-13T06:09:53.893 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.887+0000 7f31c6b3e640 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f31b808a040 con 0x55ff382fc720 2024-09-13T06:09:53.893 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.887+0000 7f31c6b3e640 1 -- 172.21.15.194:0/4165023178 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31b8067070 con 0x55ff382fc720 2024-09-13T06:09:53.893 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.887+0000 7f31c6b3e640 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f31b808a040 con 0x55ff382f7d60 2024-09-13T06:09:53.893 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.887+0000 7f31c733f640 1 -- 172.21.15.194:0/4165023178 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31c00083f0 con 0x55ff382f7d60 2024-09-13T06:09:53.893 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.887+0000 7f31c733f640 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f31b808a040 con 0x55ff382f7d60 2024-09-13T06:09:53.893 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.887+0000 7f31c733f640 1 -- 172.21.15.194:0/4165023178 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f31c00083f0 con 0x55ff382f7d60 2024-09-13T06:09:53.893 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.887+0000 7f31c733f640 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f31b808a040 con 0x7f31b00e0040 2024-09-13T06:09:53.893 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.887+0000 7f31c733f640 1 -- 172.21.15.194:0/4165023178 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31c00083f0 con 0x7f31b00e0040 2024-09-13T06:09:53.893 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.887+0000 7f31c733f640 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f31b808a040 con 0x55ff382fc720 2024-09-13T06:09:53.893 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.887+0000 7f31c6b3e640 1 -- 172.21.15.194:0/4165023178 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31b8067070 con 0x55ff382fc720 2024-09-13T06:09:53.893 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.887+0000 7f31c6b3e640 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f31b808a040 con 0x7f31b8073020 2024-09-13T06:09:53.894 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.887+0000 7f31c633d640 1 -- 172.21.15.194:0/4165023178 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31b00aaa80 con 0x7f31b8073020 2024-09-13T06:09:53.894 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.887+0000 7f31c633d640 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f31b808a040 con 0x55ff382f7d60 2024-09-13T06:09:53.894 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.887+0000 7f31c733f640 1 -- 172.21.15.194:0/4165023178 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31c00083f0 con 0x55ff382f7d60 2024-09-13T06:09:53.894 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.887+0000 7f31c733f640 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f31b808a040 con 0x7f31b00e0040 2024-09-13T06:09:53.894 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.891+0000 7f31c733f640 1 -- 172.21.15.194:0/4165023178 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31c00083f0 con 0x7f31b00e0040 2024-09-13T06:09:53.894 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.891+0000 7f31c733f640 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f31b808a040 con 0x55ff382fc720 2024-09-13T06:09:53.894 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.891+0000 7f31c6b3e640 1 -- 172.21.15.194:0/4165023178 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f31b8067070 con 0x55ff382fc720 2024-09-13T06:09:53.894 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.891+0000 7f31c6b3e640 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f31b808a040 con 0x7f31b00e0040 2024-09-13T06:09:53.894 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.891+0000 7f31c733f640 1 -- 172.21.15.194:0/4165023178 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31c00083f0 con 0x7f31b00e0040 2024-09-13T06:09:53.894 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.891+0000 7f31c733f640 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f31b808a040 con 0x7f31b8073020 2024-09-13T06:09:53.894 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.891+0000 7f31c633d640 1 -- 172.21.15.194:0/4165023178 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31b00aaa80 con 0x7f31b8073020 2024-09-13T06:09:53.894 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.891+0000 7f31c633d640 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f31b808a040 con 0x55ff382fc720 2024-09-13T06:09:53.894 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.891+0000 7f31c6b3e640 1 -- 172.21.15.194:0/4165023178 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31b8067070 con 0x55ff382fc720 2024-09-13T06:09:53.895 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.891+0000 7f31c6b3e640 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f31b808a040 con 0x7f31b00e0040 2024-09-13T06:09:53.895 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.891+0000 7f31c733f640 1 -- 172.21.15.194:0/4165023178 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31c00083f0 con 0x7f31b00e0040 2024-09-13T06:09:53.895 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.891+0000 7f31c733f640 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f31b808a040 con 0x55ff382f7d60 2024-09-13T06:09:53.898 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.891+0000 7f31c733f640 1 -- 172.21.15.194:0/4165023178 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f31c00083f0 con 0x55ff382f7d60 2024-09-13T06:09:53.898 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.891+0000 7f31c733f640 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f31b808a040 con 0x7f31b8073020 2024-09-13T06:09:53.898 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.891+0000 7f31c633d640 1 -- 172.21.15.194:0/4165023178 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31b00aaa80 con 0x7f31b8073020 2024-09-13T06:09:53.898 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.891+0000 7f31c902e980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:09:53.898 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.891+0000 7f31c902e980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:09:53.898 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.891+0000 7f31c902e980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:09:53.899 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.891+0000 7f31c902e980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:09:53.899 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.891+0000 7f31c902e980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:09:53.899 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.891+0000 7f31c902e980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:09:53.899 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.891+0000 7f31c902e980 20 rados->read ofs=0 len=0 2024-09-13T06:09:53.899 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.891+0000 7f31c902e980 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ff382ff8e0 con 0x55ff382f7d60 2024-09-13T06:09:53.899 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.891+0000 7f31c733f640 1 -- 172.21.15.194:0/4165023178 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f31c00083f0 con 0x55ff382f7d60 2024-09-13T06:09:53.899 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.891+0000 7f31c902e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:53.899 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.891+0000 7f31c902e980 20 rados->read ofs=0 len=0 2024-09-13T06:09:53.899 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.891+0000 7f31c902e980 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ff382ffcd0 con 0x55ff382f7d60 2024-09-13T06:09:53.899 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.891+0000 7f31c733f640 1 -- 172.21.15.194:0/4165023178 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f31c00083f0 con 0x55ff382f7d60 2024-09-13T06:09:53.899 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.891+0000 7f31c902e980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:53.900 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.891+0000 7f31c902e980 20 rados->read ofs=0 len=0 2024-09-13T06:09:53.900 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.891+0000 7f31c902e980 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ff382ffcd0 con 0x7f31b8073020 2024-09-13T06:09:53.900 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.891+0000 7f31c633d640 1 -- 172.21.15.194:0/4165023178 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f31b00aaa80 con 0x7f31b8073020 2024-09-13T06:09:53.900 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.891+0000 7f31c902e980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:09:53.900 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.891+0000 7f31c902e980 20 zone default found 2024-09-13T06:09:53.900 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.891+0000 7f31c902e980 4 Realm: () 2024-09-13T06:09:53.900 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.891+0000 7f31c902e980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:09:53.900 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.891+0000 7f31c902e980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:09:53.900 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.891+0000 7f31c902e980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:09:53.900 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.891+0000 7f31c902e980 20 zonegroup default 2024-09-13T06:09:53.900 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.891+0000 7f31c902e980 20 rados->read ofs=0 len=0 2024-09-13T06:09:53.900 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.891+0000 7f31c902e980 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ff38300e00 con 0x7f31b00e0040 2024-09-13T06:09:53.900 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.895+0000 7f31c733f640 1 -- 172.21.15.194:0/4165023178 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f31c00083f0 con 0x7f31b00e0040 2024-09-13T06:09:53.901 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.895+0000 7f31c902e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:53.901 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.895+0000 7f31c902e980 20 rados->read ofs=0 len=0 2024-09-13T06:09:53.901 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.895+0000 7f31c902e980 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ff383027e0 con 0x55ff382fc720 2024-09-13T06:09:53.901 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.895+0000 7f31c6b3e640 1 -- 172.21.15.194:0/4165023178 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f31b8067070 con 0x55ff382fc720 2024-09-13T06:09:53.901 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.895+0000 7f31c902e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:53.901 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.895+0000 7f31c902e980 20 rados->read ofs=0 len=0 2024-09-13T06:09:53.901 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.895+0000 7f31c902e980 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ff38302b80 con 0x55ff382fc720 2024-09-13T06:09:53.901 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.895+0000 7f31c6b3e640 1 -- 172.21.15.194:0/4165023178 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f31b8067070 con 0x55ff382fc720 2024-09-13T06:09:53.901 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.895+0000 7f31c902e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:53.901 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.895+0000 7f31c902e980 20 started sync module instance, tier type = 2024-09-13T06:09:53.901 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.895+0000 7f31c902e980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:09:53.901 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.895+0000 7f31c902e980 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ff38301c80 con 0x7f31b8073020 2024-09-13T06:09:53.901 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.895+0000 7f31c633d640 1 -- 172.21.15.194:0/4165023178 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(44 notify.0 [create] v33'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31b00aaa80 con 0x7f31b8073020 2024-09-13T06:09:53.902 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.895+0000 7f31c902e980 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94554647699616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ff383033d0 con 0x7f31b8073020 2024-09-13T06:09:53.902 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.895+0000 7f31c902e980 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ff38303c20 con 0x55ff382f7d60 2024-09-13T06:09:53.902 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.899+0000 7f31c633d640 1 -- 172.21.15.194:0/4165023178 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94554647699616] v33'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31b00aaa80 con 0x7f31b8073020 2024-09-13T06:09:53.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.899+0000 7f31c733f640 1 -- 172.21.15.194:0/4165023178 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v33'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31c00083f0 con 0x55ff382f7d60 2024-09-13T06:09:53.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.899+0000 7f31c902e980 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94554647703328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ff38303c20 con 0x55ff382f7d60 2024-09-13T06:09:53.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.899+0000 7f31c902e980 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ff38304620 con 0x55ff382fc720 2024-09-13T06:09:53.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.899+0000 7f31c733f640 1 -- 172.21.15.194:0/4165023178 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94554647703328] v33'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31c00083f0 con 0x55ff382f7d60 2024-09-13T06:09:53.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.899+0000 7f31c6b3e640 1 -- 172.21.15.194:0/4165023178 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v33'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31b8067070 con 0x55ff382fc720 2024-09-13T06:09:53.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.899+0000 7f31c902e980 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94554647705456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ff38303b90 con 0x55ff382fc720 2024-09-13T06:09:53.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.899+0000 7f31c902e980 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ff383053a0 con 0x7f31b8073020 2024-09-13T06:09:53.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.903+0000 7f31c633d640 1 -- 172.21.15.194:0/4165023178 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(50 notify.3 [create] v33'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31b00aaa80 con 0x7f31b8073020 2024-09-13T06:09:53.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.903+0000 7f31c902e980 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94554647711472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ff38305c40 con 0x7f31b8073020 2024-09-13T06:09:53.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.903+0000 7f31c902e980 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ff38306640 con 0x55ff382f7d60 2024-09-13T06:09:53.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.903+0000 7f31c6b3e640 1 -- 172.21.15.194:0/4165023178 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94554647705456] v33'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31b8067070 con 0x55ff382fc720 2024-09-13T06:09:53.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.903+0000 7f31c633d640 1 -- 172.21.15.194:0/4165023178 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94554647711472] v33'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31b00aaa80 con 0x7f31b8073020 2024-09-13T06:09:53.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.903+0000 7f31c733f640 1 -- 172.21.15.194:0/4165023178 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v33'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31c00083f0 con 0x55ff382f7d60 2024-09-13T06:09:53.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.903+0000 7f31c902e980 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94554647710272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ff38305790 con 0x55ff382f7d60 2024-09-13T06:09:53.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.903+0000 7f31c902e980 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ff38306f10 con 0x7f31b00e0040 2024-09-13T06:09:53.906 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.907+0000 7f31c733f640 1 -- 172.21.15.194:0/4165023178 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(54 notify.5 [create] v33'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31c00083f0 con 0x7f31b00e0040 2024-09-13T06:09:53.906 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.907+0000 7f31c902e980 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94554647718016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ff38307150 con 0x7f31b00e0040 2024-09-13T06:09:53.906 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.907+0000 7f31c902e980 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ff383079a0 con 0x7f31b00e0040 2024-09-13T06:09:53.907 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.907+0000 7f31c733f640 1 -- 172.21.15.194:0/4165023178 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94554647710272] v33'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31c00083f0 con 0x55ff382f7d60 2024-09-13T06:09:53.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.907+0000 7f31c733f640 1 -- 172.21.15.194:0/4165023178 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94554647718016] v33'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31c00083f0 con 0x7f31b00e0040 2024-09-13T06:09:53.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.907+0000 7f31c733f640 1 -- 172.21.15.194:0/4165023178 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(56 notify.6 [create] v33'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31c00083f0 con 0x7f31b00e0040 2024-09-13T06:09:53.909 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.907+0000 7f31c902e980 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94554647719072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ff38307570 con 0x7f31b00e0040 2024-09-13T06:09:53.909 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.907+0000 7f31c902e980 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ff38307e00 con 0x7f31b00e0040 2024-09-13T06:09:53.911 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.911+0000 7f31c733f640 1 -- 172.21.15.194:0/4165023178 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94554647719072] v33'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31c00083f0 con 0x7f31b00e0040 2024-09-13T06:09:53.911 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.911+0000 7f31c733f640 1 -- 172.21.15.194:0/4165023178 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(58 notify.7 [create] v33'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31c00083f0 con 0x7f31b00e0040 2024-09-13T06:09:53.911 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.911+0000 7f31c902e980 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94554647720608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ff38307cd0 con 0x7f31b00e0040 2024-09-13T06:09:53.911 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.911+0000 7f31c902e980 20 add_watcher() i=0 2024-09-13T06:09:53.911 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.911+0000 7f31c902e980 20 add_watcher() i=1 2024-09-13T06:09:53.911 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.911+0000 7f31c902e980 20 add_watcher() i=2 2024-09-13T06:09:53.911 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.911+0000 7f31c902e980 20 add_watcher() i=3 2024-09-13T06:09:53.911 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.911+0000 7f31c902e980 20 add_watcher() i=4 2024-09-13T06:09:53.912 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.911+0000 7f31c902e980 20 add_watcher() i=5 2024-09-13T06:09:53.912 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.911+0000 7f31c902e980 20 add_watcher() i=6 2024-09-13T06:09:53.912 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.911+0000 7f31c733f640 1 -- 172.21.15.194:0/4165023178 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94554647720608] v33'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31c00083f0 con 0x7f31b00e0040 2024-09-13T06:09:53.913 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.911+0000 7f31c902e980 20 add_watcher() i=7 2024-09-13T06:09:53.913 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.911+0000 7f31c902e980 2 all 8 watchers are set, enabling cache 2024-09-13T06:09:53.913 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.911+0000 7f31c902e980 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ff3830b210 con 0x55ff382f7d60 2024-09-13T06:09:53.913 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.911+0000 7f31c733f640 1 -- 172.21.15.194:0/4165023178 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f31c00083f0 con 0x55ff382f7d60 2024-09-13T06:09:53.913 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.911+0000 7f31c902e980 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94554647721824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ff383086d0 con 0x55ff382f7d60 2024-09-13T06:09:53.915 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.915+0000 7f31c733f640 1 -- 172.21.15.194:0/4165023178 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94554647721824] v33'58 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f31c00083f0 con 0x55ff382f7d60 2024-09-13T06:09:53.915 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.915+0000 7f307d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:53.915 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.915+0000 7f31c902e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:09:53.915 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.915+0000 7f31c902e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:09:53.915 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.915+0000 7f31c902e980 5 note: GC not initialized 2024-09-13T06:09:53.915 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.915+0000 7f2ff7fff640 20 reqs_thread_entry: start 2024-09-13T06:09:53.915 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.915+0000 7f31c902e980 20 init_complete bucket index max shards: 11 2024-09-13T06:09:53.916 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.915+0000 7f31c902e980 20 Filter name: none 2024-09-13T06:09:53.916 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.915+0000 7f2ff5ffb640 20 reqs_thread_entry: start 2024-09-13T06:09:53.916 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.915+0000 7f31c902e980 20 rados->read ofs=0 len=0 2024-09-13T06:09:53.916 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.915+0000 7f31c902e980 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ff3832e3d0 con 0x55ff382f7d60 2024-09-13T06:09:53.916 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.915+0000 7f31c733f640 1 -- 172.21.15.194:0/4165023178 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f31c00083f0 con 0x55ff382f7d60 2024-09-13T06:09:53.916 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.915+0000 7f31c902e980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T06:09:53.917 INFO:teuthology.orchestra.run.smithi194.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T06:09:53.191222Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:09:53.191207Z","tags":[],"group_ids":[]} 2024-09-13T06:09:53.917 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.915+0000 7f307d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:53.917 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.915+0000 7f31c902e980 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94554647721824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ff3832d320 con 0x55ff382f7d60 2024-09-13T06:09:53.918 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.915+0000 7f31c733f640 1 -- 172.21.15.194:0/4165023178 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94554647721824] v33'59 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f31c00083f0 con 0x55ff382f7d60 2024-09-13T06:09:53.918 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.915+0000 7f31c902e980 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94554647699616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ff38307720 con 0x7f31b8073020 2024-09-13T06:09:53.919 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.919+0000 7f31c633d640 1 -- 172.21.15.194:0/4165023178 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94554647699616] v33'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31b00aaa80 con 0x7f31b8073020 2024-09-13T06:09:53.919 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.919+0000 7f31c902e980 20 remove_watcher() i=0 2024-09-13T06:09:53.920 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.919+0000 7f31c902e980 2 removed watcher, disabling cache 2024-09-13T06:09:53.920 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.919+0000 7f31c902e980 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94554647703328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ff383020a0 con 0x55ff382f7d60 2024-09-13T06:09:53.921 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.919+0000 7f31c733f640 1 -- 172.21.15.194:0/4165023178 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94554647703328] v33'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31c00083f0 con 0x55ff382f7d60 2024-09-13T06:09:53.921 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.919+0000 7f31c902e980 20 remove_watcher() i=1 2024-09-13T06:09:53.922 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.919+0000 7f31c902e980 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94554647705456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ff383020a0 con 0x55ff382fc720 2024-09-13T06:09:53.923 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.923+0000 7f31c6b3e640 1 -- 172.21.15.194:0/4165023178 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94554647705456] v33'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31b8067070 con 0x55ff382fc720 2024-09-13T06:09:53.924 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.923+0000 7f31c902e980 20 remove_watcher() i=2 2024-09-13T06:09:53.924 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.923+0000 7f31c902e980 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94554647711472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ff38303770 con 0x7f31b8073020 2024-09-13T06:09:53.925 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.923+0000 7f31c633d640 1 -- 172.21.15.194:0/4165023178 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94554647711472] v33'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31b00aaa80 con 0x7f31b8073020 2024-09-13T06:09:53.925 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.923+0000 7f31c902e980 20 remove_watcher() i=3 2024-09-13T06:09:53.925 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.923+0000 7f31c902e980 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94554647710272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ff383020a0 con 0x55ff382f7d60 2024-09-13T06:09:53.927 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.927+0000 7f31c733f640 1 -- 172.21.15.194:0/4165023178 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94554647710272] v33'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31c00083f0 con 0x55ff382f7d60 2024-09-13T06:09:53.927 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.927+0000 7f31c902e980 20 remove_watcher() i=4 2024-09-13T06:09:53.927 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.927+0000 7f31c902e980 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94554647718016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ff38303770 con 0x7f31b00e0040 2024-09-13T06:09:53.928 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.927+0000 7f31c733f640 1 -- 172.21.15.194:0/4165023178 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94554647718016] v33'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31c00083f0 con 0x7f31b00e0040 2024-09-13T06:09:53.929 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.927+0000 7f31c902e980 20 remove_watcher() i=5 2024-09-13T06:09:53.929 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.927+0000 7f31c902e980 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94554647719072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ff38304a40 con 0x7f31b00e0040 2024-09-13T06:09:53.931 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.931+0000 7f31c733f640 1 -- 172.21.15.194:0/4165023178 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94554647719072] v33'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31c00083f0 con 0x7f31b00e0040 2024-09-13T06:09:53.931 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.931+0000 7f31c902e980 20 remove_watcher() i=6 2024-09-13T06:09:53.931 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.931+0000 7f31c902e980 1 -- 172.21.15.194:0/4165023178 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94554647720608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ff383020a0 con 0x7f31b00e0040 2024-09-13T06:09:53.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.931+0000 7f31c733f640 1 -- 172.21.15.194:0/4165023178 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94554647720608] v33'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31c00083f0 con 0x7f31b00e0040 2024-09-13T06:09:53.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.931+0000 7f31c902e980 20 remove_watcher() i=7 2024-09-13T06:09:53.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.931+0000 7f31c902e980 1 -- 172.21.15.194:0/4165023178 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f31b00e0040 msgr2=0x7f31b00e0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.931+0000 7f31c902e980 1 --2- 172.21.15.194:0/4165023178 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f31b00e0040 0x7f31b00e0420 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.931+0000 7f31c902e980 1 -- 172.21.15.194:0/4165023178 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ff382f7d60 msgr2=0x55ff382fa220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.931+0000 7f31c902e980 1 --2- 172.21.15.194:0/4165023178 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ff382f7d60 0x55ff382fa220 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.931+0000 7f31c902e980 1 -- 172.21.15.194:0/4165023178 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f31b8073020 msgr2=0x7f31b8052610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.931+0000 7f31c902e980 1 --2- 172.21.15.194:0/4165023178 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f31b8073020 0x7f31b8052610 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.931+0000 7f31c902e980 1 -- 172.21.15.194:0/4165023178 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ff382fc720 msgr2=0x55ff382feb10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.931+0000 7f31c902e980 1 --2- 172.21.15.194:0/4165023178 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ff382fc720 0x55ff382feb10 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.931+0000 7f31c902e980 1 -- 172.21.15.194:0/4165023178 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f30900346a0 msgr2=0x7f3090036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.931+0000 7f31c902e980 1 --2- 172.21.15.194:0/4165023178 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f30900346a0 0x7f3090036b60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f31b0000c10 tx=0x7f31b00c1040 comp rx=0 tx=0).stop 2024-09-13T06:09:53.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.931+0000 7f31c902e980 1 -- 172.21.15.194:0/4165023178 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff382e3a40 msgr2=0x55ff382ecd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.931+0000 7f31c733f640 1 -- 172.21.15.194:0/4165023178 reap_dead start 2024-09-13T06:09:53.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.931+0000 7f31c902e980 1 --2- 172.21.15.194:0/4165023178 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff382e3a40 0x55ff382ecd80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f31b8006790 tx=0x7f31b8038ed0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.931+0000 7f31c902e980 1 -- 172.21.15.194:0/4165023178 shutdown_connections 2024-09-13T06:09:53.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.931+0000 7f31c902e980 1 --2- 172.21.15.194:0/4165023178 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff382e3a40 0x55ff382ecd80 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.931+0000 7f31c902e980 1 -- 172.21.15.194:0/4165023178 >> 172.21.15.194:0/4165023178 conn(0x55ff382dfe20 msgr2=0x55ff382ddef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:53.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.931+0000 7f31c902e980 1 -- 172.21.15.194:0/4165023178 shutdown_connections 2024-09-13T06:09:53.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.931+0000 7f31c902e980 1 -- 172.21.15.194:0/4165023178 wait complete. 2024-09-13T06:09:53.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.931+0000 7f31c902e980 1 -- 172.21.15.194:0/541889213 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f30a00346a0 msgr2=0x7f30a0036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.931+0000 7f31c902e980 1 --2- 172.21.15.194:0/541889213 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f30a00346a0 0x7f30a0036b60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f31b0018f70 tx=0x7f31b0005ad0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.931+0000 7f31c902e980 1 -- 172.21.15.194:0/541889213 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff382d7190 msgr2=0x55ff382d75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.931+0000 7f31c902e980 1 --2- 172.21.15.194:0/541889213 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff382d7190 0x55ff382d75b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f31b8006a00 tx=0x7f31b8010ab0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.931+0000 7f31c902e980 1 -- 172.21.15.194:0/541889213 shutdown_connections 2024-09-13T06:09:53.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.931+0000 7f31c902e980 1 --2- 172.21.15.194:0/541889213 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f30a00346a0 0x7f30a0036b60 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.931+0000 7f31c902e980 1 --2- 172.21.15.194:0/541889213 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff382d7190 0x55ff382d75b0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.931+0000 7f31c902e980 1 -- 172.21.15.194:0/541889213 >> 172.21.15.194:0/541889213 conn(0x55ff382cc2e0 msgr2=0x55ff382ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:53.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.931+0000 7f31c902e980 1 -- 172.21.15.194:0/541889213 shutdown_connections 2024-09-13T06:09:53.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.931+0000 7f31c902e980 1 -- 172.21.15.194:0/541889213 wait complete. 2024-09-13T06:09:53.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.935+0000 7f31c902e980 1 -- 172.21.15.194:0/3631829999 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ff382bdfc0 msgr2=0x55ff382c03b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.935+0000 7f31c902e980 1 --2- 172.21.15.194:0/3631829999 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ff382bdfc0 0x55ff382c03b0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.935+0000 7f31c902e980 1 -- 172.21.15.194:0/3631829999 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55ff382c6bd0 msgr2=0x55ff382c8fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.935+0000 7f31c902e980 1 --2- 172.21.15.194:0/3631829999 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55ff382c6bd0 0x55ff382c8fc0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.935+0000 7f31c902e980 1 -- 172.21.15.194:0/3631829999 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ff382c2cd0 msgr2=0x55ff382c50c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.935+0000 7f31c902e980 1 --2- 172.21.15.194:0/3631829999 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ff382c2cd0 0x55ff382c50c0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:53.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.935+0000 7f31c902e980 1 -- 172.21.15.194:0/3631829999 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f30ac034650 msgr2=0x7f30ac036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.935+0000 7f31c902e980 1 --2- 172.21.15.194:0/3631829999 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f30ac034650 0x7f30ac036b10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f31b00ae000 tx=0x7f31b00a6000 comp rx=0 tx=0).stop 2024-09-13T06:09:53.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.935+0000 7f31c902e980 1 -- 172.21.15.194:0/3631829999 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff381caa10 msgr2=0x55ff382b9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:53.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.935+0000 7f31c902e980 1 --2- 172.21.15.194:0/3631829999 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff381caa10 0x55ff382b9040 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f31b8006640 tx=0x7f31b8000f50 comp rx=0 tx=0).stop 2024-09-13T06:09:53.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.935+0000 7f31c733f640 1 -- 172.21.15.194:0/3631829999 reap_dead start 2024-09-13T06:09:53.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.935+0000 7f31c902e980 1 -- 172.21.15.194:0/3631829999 shutdown_connections 2024-09-13T06:09:53.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.935+0000 7f31c902e980 1 -- 172.21.15.194:0/3631829999 >> 172.21.15.194:0/3631829999 conn(0x55ff381c21b0 msgr2=0x55ff382ac230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:53.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.935+0000 7f31c902e980 1 -- 172.21.15.194:0/3631829999 shutdown_connections 2024-09-13T06:09:53.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:53.935+0000 7f31c902e980 1 -- 172.21.15.194:0/3631829999 wait complete. 2024-09-13T06:09:53.945 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T06:09:53.191222Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:09:53.191207Z', 'tags': [], 'group_ids': []} 2024-09-13T06:09:53.946 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-09-13T06:09:53.946 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-09-13T06:09:53.946 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-09-13T06:09:54.017 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:09:54.017 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:09:54.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.015+0000 7fdec9916980 1 Processor -- start 2024-09-13T06:09:54.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.015+0000 7fdec9916980 1 -- start start 2024-09-13T06:09:54.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.015+0000 7fdec9916980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x563ce2cf6650 0x563ce2cf6a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.019+0000 7fdec9916980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563ce2b7eae0 con 0x563ce2cf6fa0 2024-09-13T06:09:54.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.019+0000 7fdec9916980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x563ce2ba2e30 con 0x563ce2cf6650 2024-09-13T06:09:54.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.019+0000 7fdec7426640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x563ce2cf6650 0x563ce2cf6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.019+0000 7fdec7426640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x563ce2cf6650 0x563ce2cf6a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44374/0 (socket says 172.21.15.194:44374) 2024-09-13T06:09:54.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.019+0000 7fdec6c25640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x563ce2cf6fa0 0x563ce2cfb9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:50946/0 (socket says 172.21.15.194:50946) 2024-09-13T06:09:54.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.019+0000 7fdec7426640 1 -- 172.21.15.194:0/3430067308 learned_addr learned my addr 172.21.15.194:0/3430067308 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:54.020 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.019+0000 7fdec7426640 1 -- 172.21.15.194:0/3430067308 >> v1:172.21.15.120:6789/0 conn(0x563ce2cf6fa0 legacy=0x563ce2cfb9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.020 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.019+0000 7fdec7426640 1 -- 172.21.15.194:0/3430067308 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ce2cfe220 con 0x563ce2cf6650 2024-09-13T06:09:54.021 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.019+0000 7fdec7426640 1 --2- 172.21.15.194:0/3430067308 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563ce2cf6650 0x563ce2cf6a30 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fdeb800a4e0 tx=0x7fdeb801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12c76e077af3f995 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.019+0000 7fdec6424640 1 -- 172.21.15.194:0/3430067308 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdeb80aa540 con 0x563ce2cf6650 2024-09-13T06:09:54.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.019+0000 7fdec6424640 1 -- 172.21.15.194:0/3430067308 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdeb80aa6e0 con 0x563ce2cf6650 2024-09-13T06:09:54.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.019+0000 7fdec6424640 1 -- 172.21.15.194:0/3430067308 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdeb80aaa40 con 0x563ce2cf6650 2024-09-13T06:09:54.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.023+0000 7fdec9916980 1 -- 172.21.15.194:0/3430067308 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563ce2cf6650 msgr2=0x563ce2cf6a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.023+0000 7fdec9916980 1 --2- 172.21.15.194:0/3430067308 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563ce2cf6650 0x563ce2cf6a30 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fdeb800a4e0 tx=0x7fdeb801b090 comp rx=0 tx=0).stop 2024-09-13T06:09:54.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.023+0000 7fdec9916980 1 -- 172.21.15.194:0/3430067308 shutdown_connections 2024-09-13T06:09:54.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.023+0000 7fdec9916980 1 --2- 172.21.15.194:0/3430067308 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563ce2cf6650 0x563ce2cf6a30 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.023+0000 7fdec9916980 1 -- 172.21.15.194:0/3430067308 >> 172.21.15.194:0/3430067308 conn(0x563ce2cf2170 msgr2=0x563ce2cf4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:54.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.023+0000 7fdec9916980 1 -- 172.21.15.194:0/3430067308 shutdown_connections 2024-09-13T06:09:54.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.023+0000 7fdec9916980 1 -- 172.21.15.194:0/3430067308 wait complete. 2024-09-13T06:09:54.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.039+0000 7fdec9916980 1 Processor -- start 2024-09-13T06:09:54.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.039+0000 7fdec9916980 1 -- start start 2024-09-13T06:09:54.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.039+0000 7fdec9916980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563ce2cf6650 0x563ce2c6cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.039+0000 7fdec9916980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x563ce2ba4200 con 0x563ce2cf6650 2024-09-13T06:09:54.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.039+0000 7fdec7426640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563ce2cf6650 0x563ce2c6cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.039+0000 7fdec7426640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563ce2cf6650 0x563ce2c6cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44382/0 (socket says 172.21.15.194:44382) 2024-09-13T06:09:54.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.039+0000 7fdec7426640 1 -- 172.21.15.194:0/788443677 learned_addr learned my addr 172.21.15.194:0/788443677 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:54.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.039+0000 7fdec7426640 1 -- 172.21.15.194:0/788443677 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ce2c6d120 con 0x563ce2cf6650 2024-09-13T06:09:54.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.039+0000 7fdec7426640 1 --2- 172.21.15.194:0/788443677 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563ce2cf6650 0x563ce2c6cb50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fdeb8017ca0 tx=0x7fdeb80033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77cd67c03d794247 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.041 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.039+0000 7fddb560a640 1 -- 172.21.15.194:0/788443677 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdeb80b9030 con 0x563ce2cf6650 2024-09-13T06:09:54.041 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.039+0000 7fddb560a640 1 -- 172.21.15.194:0/788443677 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdeb80aaac0 con 0x563ce2cf6650 2024-09-13T06:09:54.041 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.039+0000 7fddb560a640 1 -- 172.21.15.194:0/788443677 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdeb80aada0 con 0x563ce2cf6650 2024-09-13T06:09:54.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.039+0000 7fdec9916980 1 -- 172.21.15.194:0/788443677 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563ce2cf6650 msgr2=0x563ce2c6cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.039+0000 7fdec9916980 1 --2- 172.21.15.194:0/788443677 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563ce2cf6650 0x563ce2c6cb50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fdeb8017ca0 tx=0x7fdeb80033b0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.039+0000 7fdec9916980 1 -- 172.21.15.194:0/788443677 shutdown_connections 2024-09-13T06:09:54.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.039+0000 7fdec9916980 1 --2- 172.21.15.194:0/788443677 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563ce2cf6650 0x563ce2c6cb50 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.039+0000 7fdec9916980 1 -- 172.21.15.194:0/788443677 >> 172.21.15.194:0/788443677 conn(0x563ce2cf2170 msgr2=0x563ce2ddd670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:54.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.039+0000 7fdec9916980 1 -- 172.21.15.194:0/788443677 shutdown_connections 2024-09-13T06:09:54.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.039+0000 7fdec9916980 1 -- 172.21.15.194:0/788443677 wait complete. 2024-09-13T06:09:54.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.039+0000 7fdec9916980 1 Processor -- start 2024-09-13T06:09:54.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.039+0000 7fdec9916980 1 -- start start 2024-09-13T06:09:54.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.039+0000 7fdec9916980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563ce2cf6650 0x563ce2deae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.039+0000 7fdec9916980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x563ce2cfdc60 con 0x563ce2cf6650 2024-09-13T06:09:54.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.039+0000 7fdec7426640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563ce2cf6650 0x563ce2deae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.039+0000 7fdec7426640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563ce2cf6650 0x563ce2deae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44386/0 (socket says 172.21.15.194:44386) 2024-09-13T06:09:54.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.039+0000 7fdec7426640 1 -- 172.21.15.194:0/125820595 learned_addr learned my addr 172.21.15.194:0/125820595 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:54.044 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.043+0000 7fdec7426640 1 -- 172.21.15.194:0/125820595 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ce2deb3b0 con 0x563ce2cf6650 2024-09-13T06:09:54.044 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.043+0000 7fdec7426640 1 --2- 172.21.15.194:0/125820595 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563ce2cf6650 0x563ce2deae70 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fdeb8005cc0 tx=0x7fdeb8017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.044 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.043+0000 7fddb3e07640 1 -- 172.21.15.194:0/125820595 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdeb80b9030 con 0x563ce2cf6650 2024-09-13T06:09:54.044 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.043+0000 7fddb3e07640 1 -- 172.21.15.194:0/125820595 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdeb80c3070 con 0x563ce2cf6650 2024-09-13T06:09:54.044 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.043+0000 7fdec9916980 1 -- 172.21.15.194:0/125820595 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563ce2deb640 con 0x563ce2cf6650 2024-09-13T06:09:54.044 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.043+0000 7fddb3e07640 1 -- 172.21.15.194:0/125820595 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdeb80bf750 con 0x563ce2cf6650 2024-09-13T06:09:54.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.043+0000 7fdec9916980 1 -- 172.21.15.194:0/125820595 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ce2dee320 con 0x563ce2cf6650 2024-09-13T06:09:54.052 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.043+0000 7fddb3e07640 1 -- 172.21.15.194:0/125820595 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fdeb80c5030 con 0x563ce2cf6650 2024-09-13T06:09:54.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.043+0000 7fddb3e07640 1 --2- 172.21.15.194:0/125820595 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fddac034650 0x7fddac036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.043+0000 7fddb3e07640 1 -- 172.21.15.194:0/125820595 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fdeb80ba070 con 0x563ce2cf6650 2024-09-13T06:09:54.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.043+0000 7fdec6c25640 1 --2- 172.21.15.194:0/125820595 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fddac034650 0x7fddac036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.043+0000 7fdec9916980 1 --2- 172.21.15.194:0/125820595 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x563ce2cf6fa0 0x563ce2df1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.043+0000 7fdec9916980 1 -- 172.21.15.194:0/125820595 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563ce2df2420 con 0x563ce2cf6fa0 2024-09-13T06:09:54.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.043+0000 7fdec7c27640 1 --2- 172.21.15.194:0/125820595 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x563ce2cf6fa0 0x563ce2df1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.043+0000 7fdec6c25640 1 --2- 172.21.15.194:0/125820595 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fddac034650 0x7fddac036b10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdeb0000f70 tx=0x7fdeb0001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.043+0000 7fdec7c27640 1 --2- 172.21.15.194:0/125820595 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x563ce2cf6fa0 0x563ce2df1e00 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.043+0000 7fdec7c27640 1 -- 172.21.15.194:0/125820595 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdec00083f0 con 0x563ce2cf6fa0 2024-09-13T06:09:54.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.043+0000 7fdec9916980 1 -- 172.21.15.194:0/125820595 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563ce2def540 con 0x563ce2cf6fa0 2024-09-13T06:09:54.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.047+0000 7fdec7c27640 1 -- 172.21.15.194:0/125820595 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdec00083f0 con 0x563ce2cf6fa0 2024-09-13T06:09:54.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.047+0000 7fdec9916980 1 --2- 172.21.15.194:0/125820595 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x563ce2df47c0 0x563ce2df6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.047+0000 7fdec9916980 1 -- 172.21.15.194:0/125820595 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563ce2df7280 con 0x563ce2df47c0 2024-09-13T06:09:54.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.047+0000 7fdec7426640 1 --2- 172.21.15.194:0/125820595 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x563ce2df47c0 0x563ce2df6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.047+0000 7fdec7426640 1 --2- 172.21.15.194:0/125820595 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x563ce2df47c0 0x563ce2df6bb0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.047+0000 7fdec7426640 1 -- 172.21.15.194:0/125820595 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdeb80ce070 con 0x563ce2df47c0 2024-09-13T06:09:54.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.047+0000 7fdec9916980 1 -- 172.21.15.194:0/125820595 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563ce2df3660 con 0x563ce2cf6fa0 2024-09-13T06:09:54.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.047+0000 7fdec7c27640 1 -- 172.21.15.194:0/125820595 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdec00083f0 con 0x563ce2cf6fa0 2024-09-13T06:09:54.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.047+0000 7fdec9916980 1 --2- 172.21.15.194:0/125820595 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x563ce2df86c0 0x563ce2dfaab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.047+0000 7fdec9916980 1 -- 172.21.15.194:0/125820595 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563ce2dfb240 con 0x563ce2df86c0 2024-09-13T06:09:54.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.047+0000 7fdec6c25640 1 --2- 172.21.15.194:0/125820595 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x563ce2df86c0 0x563ce2dfaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.047+0000 7fdec6c25640 1 --2- 172.21.15.194:0/125820595 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x563ce2df86c0 0x563ce2dfaab0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.047+0000 7fdec6c25640 1 -- 172.21.15.194:0/125820595 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdeb000f6a0 con 0x563ce2df86c0 2024-09-13T06:09:54.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.047+0000 7fdec9916980 1 Processor -- start 2024-09-13T06:09:54.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.047+0000 7fdec9916980 1 -- start start 2024-09-13T06:09:54.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.047+0000 7fdec9916980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563ce2e08cd0 0x563ce2e090f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.047+0000 7fdec9916980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x563ce2bfd800 con 0x563ce2e08cd0 2024-09-13T06:09:54.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.047+0000 7fdec7426640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563ce2e08cd0 0x563ce2e090f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.047+0000 7fdec7426640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563ce2e08cd0 0x563ce2e090f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44402/0 (socket says 172.21.15.194:44402) 2024-09-13T06:09:54.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.047+0000 7fdec7426640 1 -- 172.21.15.194:0/2433543790 learned_addr learned my addr 172.21.15.194:0/2433543790 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:54.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.047+0000 7fdec7426640 1 -- 172.21.15.194:0/2433543790 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ce2e09630 con 0x563ce2e08cd0 2024-09-13T06:09:54.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.051+0000 7fdec7426640 1 --2- 172.21.15.194:0/2433543790 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563ce2e08cd0 0x563ce2e090f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fdeb80bdad0 tx=0x7fdeb80a9f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.051+0000 7fddb1602640 1 -- 172.21.15.194:0/2433543790 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdeb80c63c0 con 0x563ce2e08cd0 2024-09-13T06:09:54.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.051+0000 7fddb1602640 1 -- 172.21.15.194:0/2433543790 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdeb80c6560 con 0x563ce2e08cd0 2024-09-13T06:09:54.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.051+0000 7fdec9916980 1 -- 172.21.15.194:0/2433543790 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563ce2e09860 con 0x563ce2e08cd0 2024-09-13T06:09:54.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.051+0000 7fddb1602640 1 -- 172.21.15.194:0/2433543790 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdeb80b4a20 con 0x563ce2e08cd0 2024-09-13T06:09:54.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.051+0000 7fdec9916980 1 -- 172.21.15.194:0/2433543790 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ce2e0c4e0 con 0x563ce2e08cd0 2024-09-13T06:09:54.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.051+0000 7fddb1602640 1 -- 172.21.15.194:0/2433543790 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fdeb80b3040 con 0x563ce2e08cd0 2024-09-13T06:09:54.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.051+0000 7fddb1602640 1 --2- 172.21.15.194:0/2433543790 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fdda0034650 0x7fdda0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.051+0000 7fddb1602640 1 -- 172.21.15.194:0/2433543790 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fdeb80d7070 con 0x563ce2e08cd0 2024-09-13T06:09:54.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.051+0000 7fdec6c25640 1 --2- 172.21.15.194:0/2433543790 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fdda0034650 0x7fdda0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.051+0000 7fdec9916980 1 Processor -- start 2024-09-13T06:09:54.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.051+0000 7fdec9916980 1 -- start start 2024-09-13T06:09:54.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.051+0000 7fdec6c25640 1 --2- 172.21.15.194:0/2433543790 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fdda0034650 0x7fdda0036b10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x563ce2dfb640 tx=0x7fdeb000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.051+0000 7fdec9916980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563ce2e15640 0x563ce2e15a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.051+0000 7fdec9916980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x563ce2c6b280 con 0x563ce2e15640 2024-09-13T06:09:54.063 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.051+0000 7fdec7426640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563ce2e15640 0x563ce2e15a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.063 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.051+0000 7fdec7426640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563ce2e15640 0x563ce2e15a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44412/0 (socket says 172.21.15.194:44412) 2024-09-13T06:09:54.063 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.051+0000 7fdec7426640 1 -- 172.21.15.194:0/4214692341 learned_addr learned my addr 172.21.15.194:0/4214692341 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:54.063 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.051+0000 7fdec7426640 1 -- 172.21.15.194:0/4214692341 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ce2e15ff0 con 0x563ce2e15640 2024-09-13T06:09:54.063 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.051+0000 7fdec7426640 1 --2- 172.21.15.194:0/4214692341 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563ce2e15640 0x563ce2e15a20 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fdeb80b7010 tx=0x7fdeb80d1510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1181b97ff16c729c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.063 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.051+0000 7fddaaffd640 1 -- 172.21.15.194:0/4214692341 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdeb80c91b0 con 0x563ce2e15640 2024-09-13T06:09:54.063 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.051+0000 7fddaaffd640 1 -- 172.21.15.194:0/4214692341 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdeb80dcb50 con 0x563ce2e15640 2024-09-13T06:09:54.064 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.051+0000 7fddaaffd640 1 -- 172.21.15.194:0/4214692341 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdeb80bf9c0 con 0x563ce2e15640 2024-09-13T06:09:54.064 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.055+0000 7fdec9916980 1 -- 172.21.15.194:0/4214692341 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563ce2e15640 msgr2=0x563ce2e15a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.064 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.055+0000 7fdec9916980 1 --2- 172.21.15.194:0/4214692341 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563ce2e15640 0x563ce2e15a20 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fdeb80b7010 tx=0x7fdeb80d1510 comp rx=0 tx=0).stop 2024-09-13T06:09:54.064 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.055+0000 7fdec9916980 1 -- 172.21.15.194:0/4214692341 shutdown_connections 2024-09-13T06:09:54.064 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.055+0000 7fdec9916980 1 --2- 172.21.15.194:0/4214692341 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563ce2e15640 0x563ce2e15a20 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.064 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.055+0000 7fdec9916980 1 -- 172.21.15.194:0/4214692341 >> 172.21.15.194:0/4214692341 conn(0x563ce2e11970 msgr2=0x563ce2e0fa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:54.064 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.055+0000 7fdec9916980 1 -- 172.21.15.194:0/4214692341 shutdown_connections 2024-09-13T06:09:54.064 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.055+0000 7fdec9916980 1 -- 172.21.15.194:0/4214692341 wait complete. 2024-09-13T06:09:54.064 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.055+0000 7fdec9916980 1 Processor -- start 2024-09-13T06:09:54.064 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.055+0000 7fdec9916980 1 -- start start 2024-09-13T06:09:54.064 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.055+0000 7fdec9916980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563ce2e15640 0x563ce2e1c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.064 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.055+0000 7fdec9916980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x563ce2e15ff0 con 0x563ce2e15640 2024-09-13T06:09:54.064 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.055+0000 7fdec7426640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563ce2e15640 0x563ce2e1c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.064 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.055+0000 7fdec7426640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563ce2e15640 0x563ce2e1c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44422/0 (socket says 172.21.15.194:44422) 2024-09-13T06:09:54.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.055+0000 7fdec7426640 1 -- 172.21.15.194:0/2067136216 learned_addr learned my addr 172.21.15.194:0/2067136216 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:54.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.055+0000 7fdec7426640 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ce2e1cbb0 con 0x563ce2e15640 2024-09-13T06:09:54.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.055+0000 7fdec7426640 1 --2- 172.21.15.194:0/2067136216 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563ce2e15640 0x563ce2e1c670 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fdeb80b7010 tx=0x7fdeb80c90e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.055+0000 7fdda97fa640 1 -- 172.21.15.194:0/2067136216 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdeb80c7790 con 0x563ce2e15640 2024-09-13T06:09:54.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.055+0000 7fdec9916980 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563ce2e1cbb0 con 0x563ce2e15640 2024-09-13T06:09:54.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.055+0000 7fdda97fa640 1 -- 172.21.15.194:0/2067136216 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdeb80c7930 con 0x563ce2e15640 2024-09-13T06:09:54.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.055+0000 7fdda97fa640 1 -- 172.21.15.194:0/2067136216 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdeb80dc070 con 0x563ce2e15640 2024-09-13T06:09:54.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.055+0000 7fdec9916980 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ce2e1cbb0 con 0x563ce2e15640 2024-09-13T06:09:54.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.055+0000 7fdda97fa640 1 -- 172.21.15.194:0/2067136216 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fdeb810d020 con 0x563ce2e15640 2024-09-13T06:09:54.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.055+0000 7fdda97fa640 1 --2- 172.21.15.194:0/2067136216 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fdd90034650 0x7fdd90036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.055+0000 7fdda97fa640 1 -- 172.21.15.194:0/2067136216 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fdeb810b020 con 0x563ce2e15640 2024-09-13T06:09:54.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.059+0000 7fdec6c25640 1 --2- 172.21.15.194:0/2067136216 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fdd90034650 0x7fdd90036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.059+0000 7fdec9916980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.059+0000 7fdec9916980 1 --2- 172.21.15.194:0/2067136216 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x563ce2e27510 0x563ce2e299d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.059+0000 7fdec9916980 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e2a120 con 0x563ce2e27510 2024-09-13T06:09:54.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.059+0000 7fdec7c27640 1 --2- 172.21.15.194:0/2067136216 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x563ce2e27510 0x563ce2e299d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.059+0000 7fdec6c25640 1 --2- 172.21.15.194:0/2067136216 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fdd90034650 0x7fdd90036b10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdeb000c010 tx=0x7fdeb0010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.059+0000 7fdec7c27640 1 --2- 172.21.15.194:0/2067136216 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x563ce2e27510 0x563ce2e299d0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.059+0000 7fdec7c27640 1 -- 172.21.15.194:0/2067136216 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdec00083f0 con 0x563ce2e27510 2024-09-13T06:09:54.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.059+0000 7fdec9916980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:54.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.059+0000 7fdec9916980 20 realm 2024-09-13T06:09:54.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.059+0000 7fdec9916980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.059+0000 7fdec9916980 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e2a530 con 0x563ce2e27510 2024-09-13T06:09:54.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.059+0000 7fdec7c27640 1 -- 172.21.15.194:0/2067136216 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdec00083f0 con 0x563ce2e27510 2024-09-13T06:09:54.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.059+0000 7fdec9916980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:54.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.059+0000 7fdec9916980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:09:54.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.059+0000 7fdec9916980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.059+0000 7fdec9916980 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e2ae00 con 0x563ce2e27510 2024-09-13T06:09:54.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.059+0000 7fdec7c27640 1 -- 172.21.15.194:0/2067136216 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdec00083f0 con 0x563ce2e27510 2024-09-13T06:09:54.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.059+0000 7fdec9916980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:54.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.059+0000 7fdec9916980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.059+0000 7fdec9916980 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e2b1a0 con 0x563ce2e27510 2024-09-13T06:09:54.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.059+0000 7fdec7c27640 1 -- 172.21.15.194:0/2067136216 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdec00083f0 con 0x563ce2e27510 2024-09-13T06:09:54.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.059+0000 7fdec9916980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:54.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.059+0000 7fdec9916980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.059+0000 7fdec9916980 1 --2- 172.21.15.194:0/2067136216 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x563ce2e2bf00 0x563ce2e2e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.059+0000 7fdec9916980 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e2e900 con 0x563ce2e2bf00 2024-09-13T06:09:54.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.059+0000 7fdec7426640 1 --2- 172.21.15.194:0/2067136216 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x563ce2e2bf00 0x563ce2e2e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.059+0000 7fdec7426640 1 --2- 172.21.15.194:0/2067136216 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x563ce2e2bf00 0x563ce2e2e2f0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.059+0000 7fdec7426640 1 -- 172.21.15.194:0/2067136216 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fdeb80ce070 con 0x563ce2e2bf00 2024-09-13T06:09:54.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.059+0000 7fdec9916980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:09:54.068 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.059+0000 7fdec9916980 20 searching for the correct realm 2024-09-13T06:09:54.068 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.059+0000 7fdec9916980 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e301d0 con 0x563ce2e2bf00 2024-09-13T06:09:54.068 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.059+0000 7fdec7426640 1 -- 172.21.15.194:0/2067136216 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdeb80ce070 con 0x563ce2e2bf00 2024-09-13T06:09:54.068 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.059+0000 7fdec7426640 1 --2- 172.21.15.194:0/2067136216 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fdeb80da020 0x7fdeb80dc210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.068 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.059+0000 7fdec7426640 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e301d0 con 0x7fdeb80da020 2024-09-13T06:09:54.068 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.059+0000 7fdec6c25640 1 --2- 172.21.15.194:0/2067136216 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fdeb80da020 0x7fdeb80dc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.068 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.059+0000 7fdec6c25640 1 --2- 172.21.15.194:0/2067136216 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fdeb80da020 0x7fdeb80dc210 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.068 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.063+0000 7fdec6c25640 1 -- 172.21.15.194:0/2067136216 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fdeb0037040 con 0x7fdeb80da020 2024-09-13T06:09:54.068 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.063+0000 7fdec6c25640 1 --2- 172.21.15.194:0/2067136216 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fdeb001fbe0 0x7fdeb003a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.068 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.063+0000 7fdec6c25640 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e301d0 con 0x7fdeb001fbe0 2024-09-13T06:09:54.068 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.063+0000 7fdec7c27640 1 --2- 172.21.15.194:0/2067136216 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fdeb001fbe0 0x7fdeb003a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.068 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.063+0000 7fdec7c27640 1 --2- 172.21.15.194:0/2067136216 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fdeb001fbe0 0x7fdeb003a3c0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.073 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.063+0000 7fdec7c27640 1 -- 172.21.15.194:0/2067136216 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdec00083f0 con 0x7fdeb001fbe0 2024-09-13T06:09:54.073 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.063+0000 7fdec7c27640 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e2b1a0 con 0x563ce2e27510 2024-09-13T06:09:54.074 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.063+0000 7fdec7c27640 1 -- 172.21.15.194:0/2067136216 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdec00083f0 con 0x563ce2e27510 2024-09-13T06:09:54.074 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.063+0000 7fdec7c27640 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e2b1a0 con 0x563ce2e27510 2024-09-13T06:09:54.074 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.063+0000 7fdec7c27640 1 -- 172.21.15.194:0/2067136216 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdec00083f0 con 0x563ce2e27510 2024-09-13T06:09:54.074 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.063+0000 7fdec7c27640 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e2b1a0 con 0x7fdeb001fbe0 2024-09-13T06:09:54.074 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.063+0000 7fdec7c27640 1 -- 172.21.15.194:0/2067136216 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdec00083f0 con 0x7fdeb001fbe0 2024-09-13T06:09:54.074 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.063+0000 7fdec7c27640 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e2b1a0 con 0x7fdeb001fbe0 2024-09-13T06:09:54.074 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.063+0000 7fdec7c27640 1 -- 172.21.15.194:0/2067136216 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdec00083f0 con 0x7fdeb001fbe0 2024-09-13T06:09:54.074 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.063+0000 7fdec7c27640 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e2b1a0 con 0x7fdeb80da020 2024-09-13T06:09:54.074 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.067+0000 7fdec6c25640 1 -- 172.21.15.194:0/2067136216 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdeb0037040 con 0x7fdeb80da020 2024-09-13T06:09:54.074 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.067+0000 7fdec6c25640 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e2b1a0 con 0x563ce2e2bf00 2024-09-13T06:09:54.074 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.067+0000 7fdec7426640 1 -- 172.21.15.194:0/2067136216 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdeb80ce070 con 0x563ce2e2bf00 2024-09-13T06:09:54.074 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.067+0000 7fdec7426640 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e2b1a0 con 0x563ce2e27510 2024-09-13T06:09:54.075 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.067+0000 7fdec7c27640 1 -- 172.21.15.194:0/2067136216 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdec00083f0 con 0x563ce2e27510 2024-09-13T06:09:54.075 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.067+0000 7fdec7c27640 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e2b1a0 con 0x7fdeb001fbe0 2024-09-13T06:09:54.075 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.067+0000 7fdec7c27640 1 -- 172.21.15.194:0/2067136216 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdec00083f0 con 0x7fdeb001fbe0 2024-09-13T06:09:54.075 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.067+0000 7fdec7c27640 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e2b1a0 con 0x563ce2e27510 2024-09-13T06:09:54.075 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.067+0000 7fdec7c27640 1 -- 172.21.15.194:0/2067136216 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdec00083f0 con 0x563ce2e27510 2024-09-13T06:09:54.075 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.067+0000 7fdec7c27640 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e2b1a0 con 0x7fdeb80da020 2024-09-13T06:09:54.075 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.067+0000 7fdec6c25640 1 -- 172.21.15.194:0/2067136216 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fdeb0037040 con 0x7fdeb80da020 2024-09-13T06:09:54.075 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.067+0000 7fdec6c25640 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e2b1a0 con 0x563ce2e2bf00 2024-09-13T06:09:54.075 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.067+0000 7fdec7426640 1 -- 172.21.15.194:0/2067136216 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdeb80ce070 con 0x563ce2e2bf00 2024-09-13T06:09:54.075 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.067+0000 7fdec7426640 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e2b1a0 con 0x563ce2e2bf00 2024-09-13T06:09:54.075 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.067+0000 7fdec7426640 1 -- 172.21.15.194:0/2067136216 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdeb80ce070 con 0x563ce2e2bf00 2024-09-13T06:09:54.075 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.067+0000 7fdec7426640 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e2b1a0 con 0x7fdeb001fbe0 2024-09-13T06:09:54.075 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.067+0000 7fdec7c27640 1 -- 172.21.15.194:0/2067136216 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdec00083f0 con 0x7fdeb001fbe0 2024-09-13T06:09:54.076 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.067+0000 7fdec7c27640 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e2b1a0 con 0x563ce2e2bf00 2024-09-13T06:09:54.076 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.067+0000 7fdec7426640 1 -- 172.21.15.194:0/2067136216 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdeb80ce070 con 0x563ce2e2bf00 2024-09-13T06:09:54.076 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.067+0000 7fdec7426640 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e2b1a0 con 0x563ce2e2bf00 2024-09-13T06:09:54.076 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.067+0000 7fdec7426640 1 -- 172.21.15.194:0/2067136216 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdeb80ce070 con 0x563ce2e2bf00 2024-09-13T06:09:54.076 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.067+0000 7fdec7426640 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e2b1a0 con 0x563ce2e27510 2024-09-13T06:09:54.076 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.071+0000 7fdec7c27640 1 -- 172.21.15.194:0/2067136216 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdec00083f0 con 0x563ce2e27510 2024-09-13T06:09:54.076 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.071+0000 7fdec7c27640 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e2b1a0 con 0x563ce2e27510 2024-09-13T06:09:54.076 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.071+0000 7fdec7c27640 1 -- 172.21.15.194:0/2067136216 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fdec00083f0 con 0x563ce2e27510 2024-09-13T06:09:54.076 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.071+0000 7fdec7c27640 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e2b1a0 con 0x7fdeb001fbe0 2024-09-13T06:09:54.076 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.071+0000 7fdec7c27640 1 -- 172.21.15.194:0/2067136216 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdec00083f0 con 0x7fdeb001fbe0 2024-09-13T06:09:54.076 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.071+0000 7fdec7c27640 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e2b1a0 con 0x563ce2e2bf00 2024-09-13T06:09:54.076 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.071+0000 7fdec7426640 1 -- 172.21.15.194:0/2067136216 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdeb80ce070 con 0x563ce2e2bf00 2024-09-13T06:09:54.076 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.071+0000 7fdec7426640 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e2b1a0 con 0x7fdeb80da020 2024-09-13T06:09:54.076 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.071+0000 7fdec6c25640 1 -- 172.21.15.194:0/2067136216 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdeb0037040 con 0x7fdeb80da020 2024-09-13T06:09:54.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.071+0000 7fdec6c25640 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e2b1a0 con 0x563ce2e27510 2024-09-13T06:09:54.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.071+0000 7fdec7c27640 1 -- 172.21.15.194:0/2067136216 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdec00083f0 con 0x563ce2e27510 2024-09-13T06:09:54.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.071+0000 7fdec7c27640 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e2b1a0 con 0x7fdeb001fbe0 2024-09-13T06:09:54.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.071+0000 7fdec7c27640 1 -- 172.21.15.194:0/2067136216 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdec00083f0 con 0x7fdeb001fbe0 2024-09-13T06:09:54.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.071+0000 7fdec7c27640 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e2b1a0 con 0x563ce2e2bf00 2024-09-13T06:09:54.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.071+0000 7fdec7426640 1 -- 172.21.15.194:0/2067136216 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fdeb80ce070 con 0x563ce2e2bf00 2024-09-13T06:09:54.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.071+0000 7fdec7426640 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e2b1a0 con 0x7fdeb001fbe0 2024-09-13T06:09:54.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.071+0000 7fdec7c27640 1 -- 172.21.15.194:0/2067136216 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdec00083f0 con 0x7fdeb001fbe0 2024-09-13T06:09:54.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.071+0000 7fdec7c27640 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e2b1a0 con 0x7fdeb80da020 2024-09-13T06:09:54.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.075+0000 7fdec6c25640 1 -- 172.21.15.194:0/2067136216 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdeb0037040 con 0x7fdeb80da020 2024-09-13T06:09:54.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.075+0000 7fdec6c25640 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e2b1a0 con 0x563ce2e2bf00 2024-09-13T06:09:54.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.075+0000 7fdec7426640 1 -- 172.21.15.194:0/2067136216 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdeb80ce070 con 0x563ce2e2bf00 2024-09-13T06:09:54.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.075+0000 7fdec7426640 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e2b1a0 con 0x7fdeb001fbe0 2024-09-13T06:09:54.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.075+0000 7fdec7c27640 1 -- 172.21.15.194:0/2067136216 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdec00083f0 con 0x7fdeb001fbe0 2024-09-13T06:09:54.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.075+0000 7fdec7c27640 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e2b1a0 con 0x563ce2e27510 2024-09-13T06:09:54.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.075+0000 7fdec7c27640 1 -- 172.21.15.194:0/2067136216 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fdec00083f0 con 0x563ce2e27510 2024-09-13T06:09:54.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.075+0000 7fdec7c27640 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e2b1a0 con 0x7fdeb80da020 2024-09-13T06:09:54.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.075+0000 7fdec6c25640 1 -- 172.21.15.194:0/2067136216 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdeb0037040 con 0x7fdeb80da020 2024-09-13T06:09:54.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.075+0000 7fdec9916980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:09:54.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.075+0000 7fdec9916980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:09:54.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.075+0000 7fdec9916980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:09:54.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.075+0000 7fdec9916980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:09:54.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.075+0000 7fdec9916980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:09:54.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.075+0000 7fdec9916980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:09:54.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.075+0000 7fdec9916980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.075+0000 7fdec9916980 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e2f250 con 0x563ce2e27510 2024-09-13T06:09:54.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.075+0000 7fdec7c27640 1 -- 172.21.15.194:0/2067136216 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdec00083f0 con 0x563ce2e27510 2024-09-13T06:09:54.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.075+0000 7fdec9916980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:54.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.075+0000 7fdec9916980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.075+0000 7fdec9916980 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e2faf0 con 0x563ce2e27510 2024-09-13T06:09:54.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.075+0000 7fdec7c27640 1 -- 172.21.15.194:0/2067136216 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdec00083f0 con 0x563ce2e27510 2024-09-13T06:09:54.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.075+0000 7fdec9916980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:54.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.075+0000 7fdec9916980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.075+0000 7fdec9916980 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e2f640 con 0x7fdeb80da020 2024-09-13T06:09:54.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.075+0000 7fdec6c25640 1 -- 172.21.15.194:0/2067136216 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fdeb0037040 con 0x7fdeb80da020 2024-09-13T06:09:54.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.075+0000 7fdec9916980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:09:54.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.075+0000 7fdec9916980 20 zone default found 2024-09-13T06:09:54.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.075+0000 7fdec9916980 4 Realm: () 2024-09-13T06:09:54.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.075+0000 7fdec9916980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:09:54.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.075+0000 7fdec9916980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:09:54.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.075+0000 7fdec9916980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:09:54.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.075+0000 7fdec9916980 20 zonegroup default 2024-09-13T06:09:54.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.075+0000 7fdec9916980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.075+0000 7fdec9916980 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e2fb20 con 0x7fdeb001fbe0 2024-09-13T06:09:54.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.075+0000 7fdec7c27640 1 -- 172.21.15.194:0/2067136216 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdec00083f0 con 0x7fdeb001fbe0 2024-09-13T06:09:54.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.075+0000 7fdec9916980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:54.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.075+0000 7fdec9916980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.075+0000 7fdec9916980 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e32080 con 0x563ce2e2bf00 2024-09-13T06:09:54.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.075+0000 7fdec7426640 1 -- 172.21.15.194:0/2067136216 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdeb80ce070 con 0x563ce2e2bf00 2024-09-13T06:09:54.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.075+0000 7fdec9916980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:54.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.075+0000 7fdec9916980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.075+0000 7fdec9916980 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e32470 con 0x563ce2e2bf00 2024-09-13T06:09:54.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.079+0000 7fdec7426640 1 -- 172.21.15.194:0/2067136216 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdeb80ce070 con 0x563ce2e2bf00 2024-09-13T06:09:54.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.079+0000 7fdec9916980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:54.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.079+0000 7fdec9916980 20 started sync module instance, tier type = 2024-09-13T06:09:54.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.079+0000 7fdec9916980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:09:54.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.079+0000 7fdec9916980 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e31520 con 0x7fdeb80da020 2024-09-13T06:09:54.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.079+0000 7fdec6c25640 1 -- 172.21.15.194:0/2067136216 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(44 notify.0 [create] v33'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdeb0037040 con 0x7fdeb80da020 2024-09-13T06:09:54.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.079+0000 7fdec9916980 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94819504560400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e31180 con 0x7fdeb80da020 2024-09-13T06:09:54.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.079+0000 7fdec9916980 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e333a0 con 0x563ce2e27510 2024-09-13T06:09:54.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.079+0000 7fdec6c25640 1 -- 172.21.15.194:0/2067136216 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94819504560400] v33'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdeb0037040 con 0x7fdeb80da020 2024-09-13T06:09:54.087 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.079+0000 7fdec7c27640 1 -- 172.21.15.194:0/2067136216 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v33'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdec00083f0 con 0x563ce2e27510 2024-09-13T06:09:54.087 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.079+0000 7fdec9916980 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94819504566000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e337c0 con 0x563ce2e27510 2024-09-13T06:09:54.087 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.079+0000 7fdec9916980 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e34090 con 0x563ce2e2bf00 2024-09-13T06:09:54.087 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.083+0000 7fdec7426640 1 -- 172.21.15.194:0/2067136216 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v33'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdeb80ce070 con 0x563ce2e2bf00 2024-09-13T06:09:54.087 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.083+0000 7fdec9916980 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94819504568560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e34930 con 0x563ce2e2bf00 2024-09-13T06:09:54.088 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.083+0000 7fdec9916980 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e35350 con 0x7fdeb80da020 2024-09-13T06:09:54.088 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.083+0000 7fdec7c27640 1 -- 172.21.15.194:0/2067136216 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94819504566000] v33'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdec00083f0 con 0x563ce2e27510 2024-09-13T06:09:54.088 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.083+0000 7fdec6c25640 1 -- 172.21.15.194:0/2067136216 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(50 notify.3 [create] v33'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdeb0037040 con 0x7fdeb80da020 2024-09-13T06:09:54.088 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.083+0000 7fdec9916980 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94819504567056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e35bf0 con 0x7fdeb80da020 2024-09-13T06:09:54.088 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.083+0000 7fdec9916980 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e36440 con 0x563ce2e27510 2024-09-13T06:09:54.088 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.083+0000 7fdec7426640 1 -- 172.21.15.194:0/2067136216 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94819504568560] v33'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdeb80ce070 con 0x563ce2e2bf00 2024-09-13T06:09:54.088 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.087+0000 7fdec6c25640 1 -- 172.21.15.194:0/2067136216 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94819504567056] v33'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdeb0037040 con 0x7fdeb80da020 2024-09-13T06:09:54.088 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.087+0000 7fdec7c27640 1 -- 172.21.15.194:0/2067136216 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v33'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdec00083f0 con 0x563ce2e27510 2024-09-13T06:09:54.088 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.087+0000 7fdec9916980 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94819504571520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e36440 con 0x563ce2e27510 2024-09-13T06:09:54.088 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.087+0000 7fdec9916980 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e36ce0 con 0x7fdeb001fbe0 2024-09-13T06:09:54.089 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.087+0000 7fdec7c27640 1 -- 172.21.15.194:0/2067136216 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94819504571520] v33'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdec00083f0 con 0x563ce2e27510 2024-09-13T06:09:54.089 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.087+0000 7fdec7c27640 1 -- 172.21.15.194:0/2067136216 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(54 notify.5 [create] v33'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdec00083f0 con 0x7fdeb001fbe0 2024-09-13T06:09:54.089 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.087+0000 7fdec9916980 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94819504578720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e36a90 con 0x7fdeb001fbe0 2024-09-13T06:09:54.089 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.087+0000 7fdec9916980 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e37580 con 0x7fdeb001fbe0 2024-09-13T06:09:54.091 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.091+0000 7fdec7c27640 1 -- 172.21.15.194:0/2067136216 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94819504578720] v33'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdec00083f0 con 0x7fdeb001fbe0 2024-09-13T06:09:54.091 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.091+0000 7fdec7c27640 1 -- 172.21.15.194:0/2067136216 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(56 notify.6 [create] v33'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdec00083f0 con 0x7fdeb001fbe0 2024-09-13T06:09:54.091 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.091+0000 7fdec9916980 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94819504582736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e37540 con 0x7fdeb001fbe0 2024-09-13T06:09:54.092 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.091+0000 7fdec9916980 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e37f40 con 0x7fdeb001fbe0 2024-09-13T06:09:54.093 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.091+0000 7fdec7c27640 1 -- 172.21.15.194:0/2067136216 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94819504582736] v33'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdec00083f0 con 0x7fdeb001fbe0 2024-09-13T06:09:54.093 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.091+0000 7fdec7c27640 1 -- 172.21.15.194:0/2067136216 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(58 notify.7 [create] v33'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdec00083f0 con 0x7fdeb001fbe0 2024-09-13T06:09:54.094 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.091+0000 7fdec9916980 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94819504579840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e37f00 con 0x7fdeb001fbe0 2024-09-13T06:09:54.094 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.091+0000 7fdec9916980 20 add_watcher() i=0 2024-09-13T06:09:54.094 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.091+0000 7fdec9916980 20 add_watcher() i=1 2024-09-13T06:09:54.094 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.091+0000 7fdec9916980 20 add_watcher() i=2 2024-09-13T06:09:54.094 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.091+0000 7fdec9916980 20 add_watcher() i=3 2024-09-13T06:09:54.094 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.091+0000 7fdec9916980 20 add_watcher() i=4 2024-09-13T06:09:54.094 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.091+0000 7fdec9916980 20 add_watcher() i=5 2024-09-13T06:09:54.094 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.091+0000 7fdec9916980 20 add_watcher() i=6 2024-09-13T06:09:54.096 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.095+0000 7fdec7c27640 1 -- 172.21.15.194:0/2067136216 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94819504579840] v33'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdec00083f0 con 0x7fdeb001fbe0 2024-09-13T06:09:54.096 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.095+0000 7fdec9916980 20 add_watcher() i=7 2024-09-13T06:09:54.096 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.095+0000 7fdec9916980 2 all 8 watchers are set, enabling cache 2024-09-13T06:09:54.096 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.095+0000 7fdec9916980 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e3b360 con 0x563ce2e27510 2024-09-13T06:09:54.096 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.095+0000 7fdec7c27640 1 -- 172.21.15.194:0/2067136216 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdec00083f0 con 0x563ce2e27510 2024-09-13T06:09:54.096 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.095+0000 7fdec9916980 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94819504585760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e388b0 con 0x563ce2e27510 2024-09-13T06:09:54.098 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.095+0000 7fdec7c27640 1 -- 172.21.15.194:0/2067136216 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94819504585760] v33'60 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdec00083f0 con 0x563ce2e27510 2024-09-13T06:09:54.098 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.095+0000 7fdd7dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:54.098 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.095+0000 7fdec9916980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:09:54.098 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.095+0000 7fdec9916980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:09:54.098 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.095+0000 7fdec9916980 5 note: GC not initialized 2024-09-13T06:09:54.098 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.095+0000 7fdd7cfe1640 20 reqs_thread_entry: start 2024-09-13T06:09:54.098 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.095+0000 7fdec9916980 20 init_complete bucket index max shards: 11 2024-09-13T06:09:54.098 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.095+0000 7fdec9916980 20 Filter name: none 2024-09-13T06:09:54.098 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.095+0000 7fdcf67fc640 20 reqs_thread_entry: start 2024-09-13T06:09:54.098 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.095+0000 7fdec9916980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T06:09:54.098 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.095+0000 7fdec9916980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.095+0000 7fdec9916980 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e5e9d0 con 0x563ce2e27510 2024-09-13T06:09:54.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.099+0000 7fdec7c27640 1 -- 172.21.15.194:0/2067136216 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fdec00083f0 con 0x563ce2e27510 2024-09-13T06:09:54.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.099+0000 7fdec9916980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T06:09:54.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.099+0000 7fdec9916980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T06:09:54.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.099+0000 7fdec9916980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:09:54.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.099+0000 7fdec9916980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:09:54.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.099+0000 7fdec9916980 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e5e4f0 con 0x7fdeb80da020 2024-09-13T06:09:54.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.099+0000 7fdec6c25640 1 -- 172.21.15.194:0/2067136216 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7fdeb0037040 con 0x7fdeb80da020 2024-09-13T06:09:54.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.099+0000 7fdec9916980 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e64c70 con 0x563ce2e27510 2024-09-13T06:09:54.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.099+0000 7fdec7c27640 1 -- 172.21.15.194:0/2067136216 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v33'3 uv3 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fdec00083f0 con 0x563ce2e27510 2024-09-13T06:09:54.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.099+0000 7fdec9916980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T06:09:54.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.099+0000 7fdec9916980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:09:54.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.099+0000 7fdec9916980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T06:09:54.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.099+0000 7fdec9916980 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94819504769280 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e61990 con 0x563ce2e27510 2024-09-13T06:09:54.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.099+0000 7fdec7c27640 1 -- 172.21.15.194:0/2067136216 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== watch-notify(notify (1) cookie 94819504571520 notify 141733920770 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7fdec003b040 con 0x563ce2e27510 2024-09-13T06:09:54.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.099+0000 7fddaaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920770 cookie 94819504571520 notifier 4325 bl.length()=567 2024-09-13T06:09:54.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.099+0000 7fdec7c27640 1 -- 172.21.15.194:0/2067136216 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(65 notify.4 [notify cookie 94819504769280 out=8b] v0'0 uv39 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdec00083f0 con 0x563ce2e27510 2024-09-13T06:09:54.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.099+0000 7fddaaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T06:09:54.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.099+0000 7fddaaffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:09:54.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.099+0000 7fddaaffd640 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fdd8c003eb0 con 0x563ce2e27510 2024-09-13T06:09:54.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.099+0000 7fdec7c27640 1 -- 172.21.15.194:0/2067136216 <== osd.1 v2:172.21.15.194:6808/3135444559 25 ==== watch-notify(notify_complete (2) cookie 94819504769280 notify 141733920770 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fdec0010040 con 0x563ce2e27510 2024-09-13T06:09:54.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.099+0000 7fdec7c27640 1 -- 172.21.15.194:0/2067136216 <== osd.1 v2:172.21.15.194:6808/3135444559 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdec00083f0 con 0x563ce2e27510 2024-09-13T06:09:54.102 INFO:teuthology.orchestra.run.smithi194.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T06:09:53.191222Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:09:53.191207Z","tags":[],"group_ids":[]} 2024-09-13T06:09:54.103 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.099+0000 7fdd7dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:54.103 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.099+0000 7fdec9916980 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94819504585760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e5c800 con 0x563ce2e27510 2024-09-13T06:09:54.103 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.103+0000 7fdec7c27640 1 -- 172.21.15.194:0/2067136216 <== osd.1 v2:172.21.15.194:6808/3135444559 27 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94819504585760] v33'61 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdec00083f0 con 0x563ce2e27510 2024-09-13T06:09:54.103 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.103+0000 7fdec9916980 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94819504560400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e5c800 con 0x7fdeb80da020 2024-09-13T06:09:54.104 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.103+0000 7fdec6c25640 1 -- 172.21.15.194:0/2067136216 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94819504560400] v33'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdeb0037040 con 0x7fdeb80da020 2024-09-13T06:09:54.105 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.103+0000 7fdec9916980 20 remove_watcher() i=0 2024-09-13T06:09:54.105 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.103+0000 7fdec9916980 2 removed watcher, disabling cache 2024-09-13T06:09:54.105 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.103+0000 7fdec9916980 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94819504566000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e5c800 con 0x563ce2e27510 2024-09-13T06:09:54.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.107+0000 7fdec7c27640 1 -- 172.21.15.194:0/2067136216 <== osd.1 v2:172.21.15.194:6808/3135444559 28 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94819504566000] v33'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdec00083f0 con 0x563ce2e27510 2024-09-13T06:09:54.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.107+0000 7fdec9916980 20 remove_watcher() i=1 2024-09-13T06:09:54.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.107+0000 7fdec9916980 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94819504568560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e5c800 con 0x563ce2e2bf00 2024-09-13T06:09:54.109 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.107+0000 7fdec7426640 1 -- 172.21.15.194:0/2067136216 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94819504568560] v33'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdeb80ce070 con 0x563ce2e2bf00 2024-09-13T06:09:54.109 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.107+0000 7fdec9916980 20 remove_watcher() i=2 2024-09-13T06:09:54.109 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.107+0000 7fdec9916980 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94819504567056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e5c800 con 0x7fdeb80da020 2024-09-13T06:09:54.110 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.107+0000 7fdec6c25640 1 -- 172.21.15.194:0/2067136216 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94819504567056] v33'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdeb0037040 con 0x7fdeb80da020 2024-09-13T06:09:54.110 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.107+0000 7fdec9916980 20 remove_watcher() i=3 2024-09-13T06:09:54.110 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.107+0000 7fdec9916980 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94819504571520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e5c800 con 0x563ce2e27510 2024-09-13T06:09:54.112 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.111+0000 7fdec7c27640 1 -- 172.21.15.194:0/2067136216 <== osd.1 v2:172.21.15.194:6808/3135444559 29 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94819504571520] v33'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdec00083f0 con 0x563ce2e27510 2024-09-13T06:09:54.112 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.111+0000 7fdec9916980 20 remove_watcher() i=4 2024-09-13T06:09:54.112 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.111+0000 7fdec9916980 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94819504578720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e5c800 con 0x7fdeb001fbe0 2024-09-13T06:09:54.114 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.111+0000 7fdec7c27640 1 -- 172.21.15.194:0/2067136216 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94819504578720] v33'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdec00083f0 con 0x7fdeb001fbe0 2024-09-13T06:09:54.114 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.111+0000 7fdec9916980 20 remove_watcher() i=5 2024-09-13T06:09:54.114 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.111+0000 7fdec9916980 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94819504582736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e360a0 con 0x7fdeb001fbe0 2024-09-13T06:09:54.116 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.115+0000 7fdec7c27640 1 -- 172.21.15.194:0/2067136216 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94819504582736] v33'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdec00083f0 con 0x7fdeb001fbe0 2024-09-13T06:09:54.117 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.115+0000 7fdec9916980 20 remove_watcher() i=6 2024-09-13T06:09:54.117 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.115+0000 7fdec9916980 1 -- 172.21.15.194:0/2067136216 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94819504579840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563ce2e5c800 con 0x7fdeb001fbe0 2024-09-13T06:09:54.121 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.119+0000 7fdec7c27640 1 -- 172.21.15.194:0/2067136216 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94819504579840] v33'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdec00083f0 con 0x7fdeb001fbe0 2024-09-13T06:09:54.121 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.119+0000 7fdec9916980 20 remove_watcher() i=7 2024-09-13T06:09:54.121 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.119+0000 7fdec9916980 1 -- 172.21.15.194:0/2067136216 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fdeb001fbe0 msgr2=0x7fdeb003a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.121 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.119+0000 7fdec9916980 1 --2- 172.21.15.194:0/2067136216 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fdeb001fbe0 0x7fdeb003a3c0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.121 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.119+0000 7fdec9916980 1 -- 172.21.15.194:0/2067136216 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x563ce2e27510 msgr2=0x563ce2e299d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.122 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.119+0000 7fdec9916980 1 --2- 172.21.15.194:0/2067136216 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x563ce2e27510 0x563ce2e299d0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.122 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.119+0000 7fdec9916980 1 -- 172.21.15.194:0/2067136216 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fdeb80da020 msgr2=0x7fdeb80dc210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.122 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.119+0000 7fdec9916980 1 --2- 172.21.15.194:0/2067136216 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fdeb80da020 0x7fdeb80dc210 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.122 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.119+0000 7fdec9916980 1 -- 172.21.15.194:0/2067136216 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x563ce2e2bf00 msgr2=0x563ce2e2e2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.122 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.119+0000 7fdec9916980 1 --2- 172.21.15.194:0/2067136216 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x563ce2e2bf00 0x563ce2e2e2f0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.122 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.119+0000 7fdec9916980 1 -- 172.21.15.194:0/2067136216 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fdd90034650 msgr2=0x7fdd90036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.122 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.119+0000 7fdec9916980 1 --2- 172.21.15.194:0/2067136216 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fdd90034650 0x7fdd90036b10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdeb000c010 tx=0x7fdeb0010000 comp rx=0 tx=0).stop 2024-09-13T06:09:54.122 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.119+0000 7fdec7c27640 1 -- 172.21.15.194:0/2067136216 reap_dead start 2024-09-13T06:09:54.122 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.119+0000 7fdec9916980 1 -- 172.21.15.194:0/2067136216 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563ce2e15640 msgr2=0x563ce2e1c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.122 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.119+0000 7fdec9916980 1 --2- 172.21.15.194:0/2067136216 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563ce2e15640 0x563ce2e1c670 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fdeb80b7010 tx=0x7fdeb80c90e0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.122 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.119+0000 7fdec9916980 1 -- 172.21.15.194:0/2067136216 shutdown_connections 2024-09-13T06:09:54.122 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.119+0000 7fdec9916980 1 --2- 172.21.15.194:0/2067136216 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563ce2e15640 0x563ce2e1c670 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.122 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.119+0000 7fdec9916980 1 -- 172.21.15.194:0/2067136216 >> 172.21.15.194:0/2067136216 conn(0x563ce2e11970 msgr2=0x563ce2e0fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:54.123 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.119+0000 7fdec9916980 1 -- 172.21.15.194:0/2067136216 shutdown_connections 2024-09-13T06:09:54.123 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.119+0000 7fdec9916980 1 -- 172.21.15.194:0/2067136216 wait complete. 2024-09-13T06:09:54.123 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.119+0000 7fdec9916980 1 -- 172.21.15.194:0/2433543790 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fdda0034650 msgr2=0x7fdda0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.123 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.119+0000 7fdec9916980 1 --2- 172.21.15.194:0/2433543790 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fdda0034650 0x7fdda0036b10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x563ce2dfb640 tx=0x7fdeb000f000 comp rx=0 tx=0).stop 2024-09-13T06:09:54.123 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.119+0000 7fdec9916980 1 -- 172.21.15.194:0/2433543790 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563ce2e08cd0 msgr2=0x563ce2e090f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.123 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.119+0000 7fdec9916980 1 --2- 172.21.15.194:0/2433543790 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563ce2e08cd0 0x563ce2e090f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fdeb80bdad0 tx=0x7fdeb80a9f70 comp rx=0 tx=0).stop 2024-09-13T06:09:54.123 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.119+0000 7fdec9916980 1 -- 172.21.15.194:0/2433543790 shutdown_connections 2024-09-13T06:09:54.123 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.119+0000 7fdec9916980 1 --2- 172.21.15.194:0/2433543790 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fdda0034650 0x7fdda0036b10 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.123 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.119+0000 7fdec9916980 1 --2- 172.21.15.194:0/2433543790 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563ce2e08cd0 0x563ce2e090f0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.123 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.119+0000 7fdec9916980 1 -- 172.21.15.194:0/2433543790 >> 172.21.15.194:0/2433543790 conn(0x563ce2dfde20 msgr2=0x563ce2e008a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:54.123 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.119+0000 7fdec9916980 1 -- 172.21.15.194:0/2433543790 shutdown_connections 2024-09-13T06:09:54.123 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.119+0000 7fdec9916980 1 -- 172.21.15.194:0/2433543790 wait complete. 2024-09-13T06:09:54.123 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.119+0000 7fdec9916980 1 -- 172.21.15.194:0/125820595 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x563ce2cf6fa0 msgr2=0x563ce2df1e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.124 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.119+0000 7fdec9916980 1 --2- 172.21.15.194:0/125820595 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x563ce2cf6fa0 0x563ce2df1e00 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.124 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.119+0000 7fdec9916980 1 -- 172.21.15.194:0/125820595 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x563ce2df86c0 msgr2=0x563ce2dfaab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.124 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.119+0000 7fdec9916980 1 --2- 172.21.15.194:0/125820595 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x563ce2df86c0 0x563ce2dfaab0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.124 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.119+0000 7fdec9916980 1 -- 172.21.15.194:0/125820595 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x563ce2df47c0 msgr2=0x563ce2df6bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.124 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.119+0000 7fdec9916980 1 --2- 172.21.15.194:0/125820595 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x563ce2df47c0 0x563ce2df6bb0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.124 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.119+0000 7fdec9916980 1 -- 172.21.15.194:0/125820595 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fddac034650 msgr2=0x7fddac036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.124 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.119+0000 7fdec9916980 1 --2- 172.21.15.194:0/125820595 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fddac034650 0x7fddac036b10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdeb0000f70 tx=0x7fdeb0001380 comp rx=0 tx=0).stop 2024-09-13T06:09:54.124 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.119+0000 7fdec9916980 1 -- 172.21.15.194:0/125820595 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563ce2cf6650 msgr2=0x563ce2deae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.124 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.119+0000 7fdec9916980 1 --2- 172.21.15.194:0/125820595 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563ce2cf6650 0x563ce2deae70 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fdeb8005cc0 tx=0x7fdeb8017e30 comp rx=0 tx=0).stop 2024-09-13T06:09:54.124 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.119+0000 7fdec7c27640 1 -- 172.21.15.194:0/125820595 reap_dead start 2024-09-13T06:09:54.124 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.119+0000 7fdec9916980 1 -- 172.21.15.194:0/125820595 shutdown_connections 2024-09-13T06:09:54.124 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.119+0000 7fdec9916980 1 -- 172.21.15.194:0/125820595 >> 172.21.15.194:0/125820595 conn(0x563ce2cf2170 msgr2=0x563ce2c6b7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:54.124 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.119+0000 7fdec9916980 1 -- 172.21.15.194:0/125820595 shutdown_connections 2024-09-13T06:09:54.125 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.119+0000 7fdec9916980 1 -- 172.21.15.194:0/125820595 wait complete. 2024-09-13T06:09:54.132 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T06:09:53.191222Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:09:53.191207Z', 'tags': [], 'group_ids': []} 2024-09-13T06:09:54.132 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T06:09:54.132 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T06:09:54.132 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T06:09:54.204 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:09:54.204 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:09:54.205 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.203+0000 7f89f6c77980 1 Processor -- start 2024-09-13T06:09:54.205 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.203+0000 7f89f6c77980 1 -- start start 2024-09-13T06:09:54.205 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.203+0000 7f89f6c77980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55ee1fd4da90 0x55ee1fd4fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.205 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.203+0000 7f89f6c77980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ee1fbd1ae0 con 0x55ee1fcbdac0 2024-09-13T06:09:54.205 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.203+0000 7f89f6c77980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x55ee1fbf5e30 con 0x55ee1fd4da90 2024-09-13T06:09:54.206 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.203+0000 7f89f3f86640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55ee1fd4da90 0x55ee1fd4fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.206 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.203+0000 7f89f3f86640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55ee1fd4da90 0x55ee1fd4fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44430/0 (socket says 172.21.15.194:44430) 2024-09-13T06:09:54.206 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.203+0000 7f89f3f86640 1 -- 172.21.15.194:0/4074531283 learned_addr learned my addr 172.21.15.194:0/4074531283 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:54.206 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.203+0000 7f89f3f86640 1 -- 172.21.15.194:0/4074531283 >> v1:172.21.15.120:6789/0 conn(0x55ee1fcbdac0 legacy=0x55ee1fd4c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.206 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.203+0000 7f89f3f86640 1 -- 172.21.15.194:0/4074531283 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee1fd513d0 con 0x55ee1fd4da90 2024-09-13T06:09:54.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.207+0000 7f89f3f86640 1 --2- 172.21.15.194:0/4074531283 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee1fd4da90 0x55ee1fd4fe80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f89dc00a5c0 tx=0x7f89dc01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec51685cf7f3866c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.207+0000 7f89f3785640 1 -- 172.21.15.194:0/4074531283 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89dc0a6070 con 0x55ee1fd4da90 2024-09-13T06:09:54.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.207+0000 7f89f3785640 1 -- 172.21.15.194:0/4074531283 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89dc0af070 con 0x55ee1fd4da90 2024-09-13T06:09:54.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.207+0000 7f89f3785640 1 -- 172.21.15.194:0/4074531283 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89dc0aa5c0 con 0x55ee1fd4da90 2024-09-13T06:09:54.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.207+0000 7f89f6c77980 1 -- 172.21.15.194:0/4074531283 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee1fd4da90 msgr2=0x55ee1fd4fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.207+0000 7f89f6c77980 1 --2- 172.21.15.194:0/4074531283 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee1fd4da90 0x55ee1fd4fe80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f89dc00a5c0 tx=0x7f89dc01b340 comp rx=0 tx=0).stop 2024-09-13T06:09:54.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.207+0000 7f89f6c77980 1 -- 172.21.15.194:0/4074531283 shutdown_connections 2024-09-13T06:09:54.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.207+0000 7f89f6c77980 1 --2- 172.21.15.194:0/4074531283 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee1fd4da90 0x55ee1fd4fe80 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.207+0000 7f89f6c77980 1 -- 172.21.15.194:0/4074531283 >> 172.21.15.194:0/4074531283 conn(0x55ee1fd44060 msgr2=0x55ee1fd46480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:54.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.207+0000 7f89f6c77980 1 -- 172.21.15.194:0/4074531283 shutdown_connections 2024-09-13T06:09:54.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.207+0000 7f89f6c77980 1 -- 172.21.15.194:0/4074531283 wait complete. 2024-09-13T06:09:54.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.223+0000 7f89f6c77980 1 Processor -- start 2024-09-13T06:09:54.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.223+0000 7f89f6c77980 1 -- start start 2024-09-13T06:09:54.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.223+0000 7f89f6c77980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee1fcbdac0 0x55ee1fe34a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.223+0000 7f89f6c77980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55ee1fbf7200 con 0x55ee1fcbdac0 2024-09-13T06:09:54.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.227+0000 7f89f4787640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee1fcbdac0 0x55ee1fe34a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.227+0000 7f89f4787640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee1fcbdac0 0x55ee1fe34a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44436/0 (socket says 172.21.15.194:44436) 2024-09-13T06:09:54.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.227+0000 7f89f4787640 1 -- 172.21.15.194:0/1866368715 learned_addr learned my addr 172.21.15.194:0/1866368715 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:54.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.227+0000 7f89f4787640 1 -- 172.21.15.194:0/1866368715 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee1fe35030 con 0x55ee1fcbdac0 2024-09-13T06:09:54.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.227+0000 7f89f4787640 1 --2- 172.21.15.194:0/1866368715 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee1fcbdac0 0x55ee1fe34a60 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f89e400b1f0 tx=0x7f89e400b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3cac8947d456229 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.227+0000 7f88e260c640 1 -- 172.21.15.194:0/1866368715 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89e400a040 con 0x55ee1fcbdac0 2024-09-13T06:09:54.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.227+0000 7f88e260c640 1 -- 172.21.15.194:0/1866368715 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89e400f750 con 0x55ee1fcbdac0 2024-09-13T06:09:54.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.227+0000 7f88e260c640 1 -- 172.21.15.194:0/1866368715 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89e400fa70 con 0x55ee1fcbdac0 2024-09-13T06:09:54.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.227+0000 7f89f6c77980 1 -- 172.21.15.194:0/1866368715 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee1fcbdac0 msgr2=0x55ee1fe34a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.227+0000 7f89f6c77980 1 --2- 172.21.15.194:0/1866368715 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee1fcbdac0 0x55ee1fe34a60 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f89e400b1f0 tx=0x7f89e400b6b0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.227+0000 7f89f6c77980 1 -- 172.21.15.194:0/1866368715 shutdown_connections 2024-09-13T06:09:54.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.227+0000 7f89f6c77980 1 --2- 172.21.15.194:0/1866368715 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee1fcbdac0 0x55ee1fe34a60 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.227+0000 7f89f6c77980 1 -- 172.21.15.194:0/1866368715 >> 172.21.15.194:0/1866368715 conn(0x55ee1fd44060 msgr2=0x55ee1fe30690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:54.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.227+0000 7f89f6c77980 1 -- 172.21.15.194:0/1866368715 shutdown_connections 2024-09-13T06:09:54.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.227+0000 7f89f6c77980 1 -- 172.21.15.194:0/1866368715 wait complete. 2024-09-13T06:09:54.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.227+0000 7f89f6c77980 1 Processor -- start 2024-09-13T06:09:54.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.227+0000 7f89f6c77980 1 -- start start 2024-09-13T06:09:54.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.227+0000 7f89f6c77980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee1fcbdac0 0x55ee1fe3be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.227+0000 7f89f6c77980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55ee1fd50e10 con 0x55ee1fcbdac0 2024-09-13T06:09:54.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.227+0000 7f89f4787640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee1fcbdac0 0x55ee1fe3be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.227+0000 7f89f4787640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee1fcbdac0 0x55ee1fe3be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44450/0 (socket says 172.21.15.194:44450) 2024-09-13T06:09:54.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.227+0000 7f89f4787640 1 -- 172.21.15.194:0/2025222878 learned_addr learned my addr 172.21.15.194:0/2025222878 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:54.231 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.227+0000 7f89f4787640 1 -- 172.21.15.194:0/2025222878 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee1fe3c350 con 0x55ee1fcbdac0 2024-09-13T06:09:54.231 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.227+0000 7f89f4787640 1 --2- 172.21.15.194:0/2025222878 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee1fcbdac0 0x55ee1fe3be10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f89e400b6f0 tx=0x7f89e4000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.231 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.227+0000 7f88e0e09640 1 -- 172.21.15.194:0/2025222878 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89e4001300 con 0x55ee1fcbdac0 2024-09-13T06:09:54.231 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.231+0000 7f89f6c77980 1 -- 172.21.15.194:0/2025222878 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ee1fe3c5e0 con 0x55ee1fcbdac0 2024-09-13T06:09:54.231 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.231+0000 7f88e0e09640 1 -- 172.21.15.194:0/2025222878 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89e401c9c0 con 0x55ee1fcbdac0 2024-09-13T06:09:54.231 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.231+0000 7f88e0e09640 1 -- 172.21.15.194:0/2025222878 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89e401cca0 con 0x55ee1fcbdac0 2024-09-13T06:09:54.231 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.231+0000 7f89f6c77980 1 -- 172.21.15.194:0/2025222878 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee1fe3f2c0 con 0x55ee1fcbdac0 2024-09-13T06:09:54.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.231+0000 7f88e0e09640 1 -- 172.21.15.194:0/2025222878 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f89e4017050 con 0x55ee1fcbdac0 2024-09-13T06:09:54.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.231+0000 7f88e0e09640 1 --2- 172.21.15.194:0/2025222878 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f88dc0346f0 0x7f88dc036bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.231+0000 7f88e0e09640 1 -- 172.21.15.194:0/2025222878 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f89e4015020 con 0x55ee1fcbdac0 2024-09-13T06:09:54.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.231+0000 7f89f3f86640 1 --2- 172.21.15.194:0/2025222878 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f88dc0346f0 0x7f88dc036bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.231+0000 7f89f6c77980 1 --2- 172.21.15.194:0/2025222878 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ee1fd4da90 0x55ee1fe42f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.231+0000 7f89f6c77980 1 -- 172.21.15.194:0/2025222878 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe43490 con 0x55ee1fd4da90 2024-09-13T06:09:54.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.231+0000 7f89f4f88640 1 --2- 172.21.15.194:0/2025222878 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ee1fd4da90 0x55ee1fe42f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.231+0000 7f89f3f86640 1 --2- 172.21.15.194:0/2025222878 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f88dc0346f0 0x7f88dc036bb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f89dc0ae000 tx=0x7f89dc0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.231+0000 7f89f4f88640 1 --2- 172.21.15.194:0/2025222878 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ee1fd4da90 0x55ee1fe42f10 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.231+0000 7f89f4f88640 1 -- 172.21.15.194:0/2025222878 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f89ec00a4d0 con 0x55ee1fd4da90 2024-09-13T06:09:54.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.231+0000 7f89f6c77980 1 -- 172.21.15.194:0/2025222878 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe404e0 con 0x55ee1fd4da90 2024-09-13T06:09:54.236 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.231+0000 7f89f4f88640 1 -- 172.21.15.194:0/2025222878 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f89ec00a4d0 con 0x55ee1fd4da90 2024-09-13T06:09:54.236 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.231+0000 7f89f6c77980 1 --2- 172.21.15.194:0/2025222878 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ee1fe457c0 0x55ee1fe47bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.236 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.231+0000 7f89f6c77980 1 -- 172.21.15.194:0/2025222878 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe48280 con 0x55ee1fe457c0 2024-09-13T06:09:54.237 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.231+0000 7f89f4787640 1 --2- 172.21.15.194:0/2025222878 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ee1fe457c0 0x55ee1fe47bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.237 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.231+0000 7f89f4787640 1 --2- 172.21.15.194:0/2025222878 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ee1fe457c0 0x55ee1fe47bb0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.237 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.231+0000 7f89f4787640 1 -- 172.21.15.194:0/2025222878 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f89e402e070 con 0x55ee1fe457c0 2024-09-13T06:09:54.237 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.235+0000 7f89f6c77980 1 -- 172.21.15.194:0/2025222878 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe44630 con 0x55ee1fd4da90 2024-09-13T06:09:54.237 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.235+0000 7f89f4f88640 1 -- 172.21.15.194:0/2025222878 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f89ec00a4d0 con 0x55ee1fd4da90 2024-09-13T06:09:54.237 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.235+0000 7f89f6c77980 1 --2- 172.21.15.194:0/2025222878 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55ee1fe496e0 0x55ee1fe4bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.237 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.235+0000 7f89f6c77980 1 -- 172.21.15.194:0/2025222878 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe4c1c0 con 0x55ee1fe496e0 2024-09-13T06:09:54.237 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.235+0000 7f89f3f86640 1 --2- 172.21.15.194:0/2025222878 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55ee1fe496e0 0x55ee1fe4bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.237 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.235+0000 7f89f3f86640 1 --2- 172.21.15.194:0/2025222878 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55ee1fe496e0 0x55ee1fe4bad0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.237 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.235+0000 7f89f3f86640 1 -- 172.21.15.194:0/2025222878 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f89dc0aaad0 con 0x55ee1fe496e0 2024-09-13T06:09:54.237 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.235+0000 7f89f6c77980 1 Processor -- start 2024-09-13T06:09:54.237 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.235+0000 7f89f6c77980 1 -- start start 2024-09-13T06:09:54.237 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.235+0000 7f89f6c77980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee1fe59c70 0x55ee1fe5a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.238 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.235+0000 7f89f6c77980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55ee1fc50800 con 0x55ee1fe59c70 2024-09-13T06:09:54.238 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.235+0000 7f89f4787640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee1fe59c70 0x55ee1fe5a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.238 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.235+0000 7f89f4787640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee1fe59c70 0x55ee1fe5a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44462/0 (socket says 172.21.15.194:44462) 2024-09-13T06:09:54.238 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.235+0000 7f89f4787640 1 -- 172.21.15.194:0/3633304496 learned_addr learned my addr 172.21.15.194:0/3633304496 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:54.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.235+0000 7f89f4787640 1 -- 172.21.15.194:0/3633304496 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee1fe5a5d0 con 0x55ee1fe59c70 2024-09-13T06:09:54.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.235+0000 7f89f4787640 1 --2- 172.21.15.194:0/3633304496 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee1fe59c70 0x55ee1fe5a090 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f89e401dfd0 tx=0x7f89e401b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.235+0000 7f88d9ffb640 1 -- 172.21.15.194:0/3633304496 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89e4048870 con 0x55ee1fe59c70 2024-09-13T06:09:54.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.235+0000 7f88d9ffb640 1 -- 172.21.15.194:0/3633304496 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89e4048a10 con 0x55ee1fe59c70 2024-09-13T06:09:54.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.235+0000 7f88d9ffb640 1 -- 172.21.15.194:0/3633304496 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89e4048d30 con 0x55ee1fe59c70 2024-09-13T06:09:54.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.235+0000 7f89f6c77980 1 -- 172.21.15.194:0/3633304496 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ee1fe5a860 con 0x55ee1fe59c70 2024-09-13T06:09:54.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.235+0000 7f89f6c77980 1 -- 172.21.15.194:0/3633304496 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee1fe5d4e0 con 0x55ee1fe59c70 2024-09-13T06:09:54.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.239+0000 7f88d9ffb640 1 -- 172.21.15.194:0/3633304496 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f89e4019600 con 0x55ee1fe59c70 2024-09-13T06:09:54.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.239+0000 7f88d9ffb640 1 --2- 172.21.15.194:0/3633304496 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f88cc0346a0 0x7f88cc036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.239+0000 7f88d9ffb640 1 -- 172.21.15.194:0/3633304496 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f89e40419c0 con 0x55ee1fe59c70 2024-09-13T06:09:54.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.239+0000 7f89f3f86640 1 --2- 172.21.15.194:0/3633304496 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f88cc0346a0 0x7f88cc036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.239+0000 7f89f6c77980 1 Processor -- start 2024-09-13T06:09:54.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.239+0000 7f89f6c77980 1 -- start start 2024-09-13T06:09:54.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.239+0000 7f89f3f86640 1 --2- 172.21.15.194:0/3633304496 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f88cc0346a0 0x7f88cc036b60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x55ee1fe43d70 tx=0x7f89dc005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.239+0000 7f89f6c77980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee1fd49570 0x55ee1fd49970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.239+0000 7f89f6c77980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55ee1fe353b0 con 0x55ee1fd49570 2024-09-13T06:09:54.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.239+0000 7f89f4787640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee1fd49570 0x55ee1fd49970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.239+0000 7f89f4787640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee1fd49570 0x55ee1fd49970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44464/0 (socket says 172.21.15.194:44464) 2024-09-13T06:09:54.242 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.239+0000 7f89f4787640 1 -- 172.21.15.194:0/3041928800 learned_addr learned my addr 172.21.15.194:0/3041928800 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:54.242 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.239+0000 7f89f4787640 1 -- 172.21.15.194:0/3041928800 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee1fd49f40 con 0x55ee1fd49570 2024-09-13T06:09:54.244 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.239+0000 7f89f4787640 1 --2- 172.21.15.194:0/3041928800 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee1fd49570 0x55ee1fd49970 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f89e40473e0 tx=0x7f89e40423f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=710ab2afa689316d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.244 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.239+0000 7f88cb7fe640 1 -- 172.21.15.194:0/3041928800 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89e401ba90 con 0x55ee1fd49570 2024-09-13T06:09:54.244 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.239+0000 7f88cb7fe640 1 -- 172.21.15.194:0/3041928800 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89e4027b40 con 0x55ee1fd49570 2024-09-13T06:09:54.244 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.239+0000 7f88cb7fe640 1 -- 172.21.15.194:0/3041928800 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89e401bc30 con 0x55ee1fd49570 2024-09-13T06:09:54.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.239+0000 7f89f6c77980 1 -- 172.21.15.194:0/3041928800 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee1fd49570 msgr2=0x55ee1fd49970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.239+0000 7f89f6c77980 1 --2- 172.21.15.194:0/3041928800 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee1fd49570 0x55ee1fd49970 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f89e40473e0 tx=0x7f89e40423f0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.239+0000 7f89f6c77980 1 -- 172.21.15.194:0/3041928800 shutdown_connections 2024-09-13T06:09:54.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.239+0000 7f89f6c77980 1 --2- 172.21.15.194:0/3041928800 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee1fd49570 0x55ee1fd49970 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.239+0000 7f89f6c77980 1 -- 172.21.15.194:0/3041928800 >> 172.21.15.194:0/3041928800 conn(0x55ee1fe62980 msgr2=0x55ee1fe60a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:54.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.239+0000 7f89f6c77980 1 -- 172.21.15.194:0/3041928800 shutdown_connections 2024-09-13T06:09:54.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.239+0000 7f89f6c77980 1 -- 172.21.15.194:0/3041928800 wait complete. 2024-09-13T06:09:54.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.239+0000 7f89f6c77980 1 Processor -- start 2024-09-13T06:09:54.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.239+0000 7f89f6c77980 1 -- start start 2024-09-13T06:09:54.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.239+0000 7f89f6c77980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee1fd49570 0x55ee1fe6f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.239+0000 7f89f6c77980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55ee1fd4a170 con 0x55ee1fd49570 2024-09-13T06:09:54.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.243+0000 7f89f4787640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee1fd49570 0x55ee1fe6f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.243+0000 7f89f4787640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee1fd49570 0x55ee1fe6f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44478/0 (socket says 172.21.15.194:44478) 2024-09-13T06:09:54.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.243+0000 7f89f4787640 1 -- 172.21.15.194:0/992776484 learned_addr learned my addr 172.21.15.194:0/992776484 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:54.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.243+0000 7f89f4787640 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee1fe6fd40 con 0x55ee1fd49570 2024-09-13T06:09:54.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.243+0000 7f89f4787640 1 --2- 172.21.15.194:0/992776484 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee1fd49570 0x55ee1fe6f800 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f89e4000fc0 tx=0x7f89e4046ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.243+0000 7f88c9ffb640 1 -- 172.21.15.194:0/992776484 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89e4019b00 con 0x55ee1fd49570 2024-09-13T06:09:54.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.243+0000 7f89f6c77980 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ee1fe6fd40 con 0x55ee1fd49570 2024-09-13T06:09:54.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.243+0000 7f88c9ffb640 1 -- 172.21.15.194:0/992776484 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89e4064030 con 0x55ee1fd49570 2024-09-13T06:09:54.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.243+0000 7f88c9ffb640 1 -- 172.21.15.194:0/992776484 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89e4027430 con 0x55ee1fd49570 2024-09-13T06:09:54.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.243+0000 7f89f6c77980 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee1fe6fd40 con 0x55ee1fd49570 2024-09-13T06:09:54.258 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.243+0000 7f89f6c77980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.258 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.243+0000 7f88c9ffb640 1 -- 172.21.15.194:0/992776484 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f89e40276a0 con 0x55ee1fd49570 2024-09-13T06:09:54.258 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.243+0000 7f88c9ffb640 1 --2- 172.21.15.194:0/992776484 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f88bc034650 0x7f88bc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.258 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.243+0000 7f88c9ffb640 1 -- 172.21.15.194:0/992776484 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f89e4056070 con 0x55ee1fd49570 2024-09-13T06:09:54.258 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.243+0000 7f89f3f86640 1 --2- 172.21.15.194:0/992776484 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f88bc034650 0x7f88bc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.258 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.243+0000 7f89f6c77980 1 --2- 172.21.15.194:0/992776484 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ee1fe7a6a0 0x55ee1fe7cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.258 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.243+0000 7f89f6c77980 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe7d280 con 0x55ee1fe7a6a0 2024-09-13T06:09:54.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.243+0000 7f89f4f88640 1 --2- 172.21.15.194:0/992776484 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ee1fe7a6a0 0x55ee1fe7cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.243+0000 7f89f3f86640 1 --2- 172.21.15.194:0/992776484 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f88bc034650 0x7f88bc036b10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f89dc000c10 tx=0x7f89dc0c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.243+0000 7f89f4f88640 1 --2- 172.21.15.194:0/992776484 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ee1fe7a6a0 0x55ee1fe7cb30 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.243+0000 7f89f4f88640 1 -- 172.21.15.194:0/992776484 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f89ec00a4d0 con 0x55ee1fe7a6a0 2024-09-13T06:09:54.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.243+0000 7f89f6c77980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:54.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.243+0000 7f89f6c77980 20 realm 2024-09-13T06:09:54.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.247+0000 7f89f6c77980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.247+0000 7f89f6c77980 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe7d690 con 0x55ee1fe7a6a0 2024-09-13T06:09:54.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.247+0000 7f89f4f88640 1 -- 172.21.15.194:0/992776484 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f89ec00a4d0 con 0x55ee1fe7a6a0 2024-09-13T06:09:54.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.247+0000 7f89f6c77980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:54.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.247+0000 7f89f6c77980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:09:54.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.247+0000 7f89f6c77980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.247+0000 7f89f6c77980 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe7df30 con 0x55ee1fe7a6a0 2024-09-13T06:09:54.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.247+0000 7f89f4f88640 1 -- 172.21.15.194:0/992776484 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f89ec00a4d0 con 0x55ee1fe7a6a0 2024-09-13T06:09:54.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.247+0000 7f89f6c77980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:54.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.247+0000 7f89f6c77980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.247+0000 7f89f6c77980 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe7e2d0 con 0x55ee1fe7a6a0 2024-09-13T06:09:54.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.247+0000 7f89f4f88640 1 -- 172.21.15.194:0/992776484 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f89ec00a4d0 con 0x55ee1fe7a6a0 2024-09-13T06:09:54.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.247+0000 7f89f6c77980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:54.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.247+0000 7f89f6c77980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.247+0000 7f89f6c77980 1 --2- 172.21.15.194:0/992776484 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ee1fe7f030 0x55ee1fe81420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.247+0000 7f89f6c77980 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe819a0 con 0x55ee1fe7f030 2024-09-13T06:09:54.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.247+0000 7f89f4787640 1 --2- 172.21.15.194:0/992776484 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ee1fe7f030 0x55ee1fe81420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.247+0000 7f89f4787640 1 --2- 172.21.15.194:0/992776484 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ee1fe7f030 0x55ee1fe81420 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.247+0000 7f89f4787640 1 -- 172.21.15.194:0/992776484 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f89e402e070 con 0x55ee1fe7f030 2024-09-13T06:09:54.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.247+0000 7f89f6c77980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:09:54.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.247+0000 7f89f6c77980 20 searching for the correct realm 2024-09-13T06:09:54.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.247+0000 7f89f6c77980 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe83200 con 0x55ee1fe7f030 2024-09-13T06:09:54.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.247+0000 7f89f4787640 1 -- 172.21.15.194:0/992776484 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89e402e070 con 0x55ee1fe7f030 2024-09-13T06:09:54.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.247+0000 7f89f4787640 1 --2- 172.21.15.194:0/992776484 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f89e404b480 0x7f89e40598d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.247+0000 7f89f4787640 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe83200 con 0x7f89e404b480 2024-09-13T06:09:54.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.247+0000 7f89f3f86640 1 --2- 172.21.15.194:0/992776484 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f89e404b480 0x7f89e40598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.247+0000 7f89f3f86640 1 --2- 172.21.15.194:0/992776484 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f89e404b480 0x7f89e40598d0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.247+0000 7f89f3f86640 1 -- 172.21.15.194:0/992776484 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f89dc0aaad0 con 0x7f89e404b480 2024-09-13T06:09:54.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.247+0000 7f89f3f86640 1 --2- 172.21.15.194:0/992776484 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f89dc0e0040 0x7f89dc0e0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.247+0000 7f89f3f86640 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe83200 con 0x7f89dc0e0040 2024-09-13T06:09:54.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.247+0000 7f89f4f88640 1 --2- 172.21.15.194:0/992776484 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f89dc0e0040 0x7f89dc0e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.247+0000 7f89f4f88640 1 --2- 172.21.15.194:0/992776484 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f89dc0e0040 0x7f89dc0e0420 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.251+0000 7f89f4f88640 1 -- 172.21.15.194:0/992776484 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89ec00a4d0 con 0x7f89dc0e0040 2024-09-13T06:09:54.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.251+0000 7f89f4f88640 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe7e2d0 con 0x55ee1fe7a6a0 2024-09-13T06:09:54.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.251+0000 7f89f4f88640 1 -- 172.21.15.194:0/992776484 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89ec00a4d0 con 0x55ee1fe7a6a0 2024-09-13T06:09:54.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.251+0000 7f89f4f88640 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe7e2d0 con 0x55ee1fe7a6a0 2024-09-13T06:09:54.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.251+0000 7f89f4f88640 1 -- 172.21.15.194:0/992776484 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89ec00a4d0 con 0x55ee1fe7a6a0 2024-09-13T06:09:54.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.251+0000 7f89f4f88640 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe7e2d0 con 0x7f89dc0e0040 2024-09-13T06:09:54.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.251+0000 7f89f4f88640 1 -- 172.21.15.194:0/992776484 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89ec00a4d0 con 0x7f89dc0e0040 2024-09-13T06:09:54.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.251+0000 7f89f4f88640 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe7e2d0 con 0x7f89dc0e0040 2024-09-13T06:09:54.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.251+0000 7f89f4f88640 1 -- 172.21.15.194:0/992776484 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89ec00a4d0 con 0x7f89dc0e0040 2024-09-13T06:09:54.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.251+0000 7f89f4f88640 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe7e2d0 con 0x7f89e404b480 2024-09-13T06:09:54.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.251+0000 7f89f3f86640 1 -- 172.21.15.194:0/992776484 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89dc0aaad0 con 0x7f89e404b480 2024-09-13T06:09:54.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.251+0000 7f89f3f86640 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe7e2d0 con 0x55ee1fe7f030 2024-09-13T06:09:54.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.251+0000 7f89f4787640 1 -- 172.21.15.194:0/992776484 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89e402e070 con 0x55ee1fe7f030 2024-09-13T06:09:54.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.251+0000 7f89f4787640 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe7e2d0 con 0x55ee1fe7a6a0 2024-09-13T06:09:54.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.251+0000 7f89f4f88640 1 -- 172.21.15.194:0/992776484 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89ec00a4d0 con 0x55ee1fe7a6a0 2024-09-13T06:09:54.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.251+0000 7f89f4f88640 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe7e2d0 con 0x7f89dc0e0040 2024-09-13T06:09:54.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.251+0000 7f89f4f88640 1 -- 172.21.15.194:0/992776484 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89ec00a4d0 con 0x7f89dc0e0040 2024-09-13T06:09:54.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.251+0000 7f89f4f88640 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe7e2d0 con 0x55ee1fe7a6a0 2024-09-13T06:09:54.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.251+0000 7f89f4f88640 1 -- 172.21.15.194:0/992776484 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89ec00a4d0 con 0x55ee1fe7a6a0 2024-09-13T06:09:54.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.251+0000 7f89f4f88640 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe7e2d0 con 0x7f89e404b480 2024-09-13T06:09:54.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.251+0000 7f89f3f86640 1 -- 172.21.15.194:0/992776484 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f89dc0aaad0 con 0x7f89e404b480 2024-09-13T06:09:54.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.251+0000 7f89f3f86640 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe7e2d0 con 0x55ee1fe7f030 2024-09-13T06:09:54.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.255+0000 7f89f4787640 1 -- 172.21.15.194:0/992776484 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89e402e070 con 0x55ee1fe7f030 2024-09-13T06:09:54.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.255+0000 7f89f4787640 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe7e2d0 con 0x55ee1fe7f030 2024-09-13T06:09:54.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.255+0000 7f89f4787640 1 -- 172.21.15.194:0/992776484 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89e402e070 con 0x55ee1fe7f030 2024-09-13T06:09:54.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.255+0000 7f89f4787640 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe7e2d0 con 0x7f89dc0e0040 2024-09-13T06:09:54.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.255+0000 7f89f4f88640 1 -- 172.21.15.194:0/992776484 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89ec00a4d0 con 0x7f89dc0e0040 2024-09-13T06:09:54.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.255+0000 7f89f4f88640 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe7e2d0 con 0x55ee1fe7f030 2024-09-13T06:09:54.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.255+0000 7f89f4787640 1 -- 172.21.15.194:0/992776484 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89e402e070 con 0x55ee1fe7f030 2024-09-13T06:09:54.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.255+0000 7f89f4787640 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe7e2d0 con 0x55ee1fe7f030 2024-09-13T06:09:54.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.255+0000 7f89f4787640 1 -- 172.21.15.194:0/992776484 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89e402e070 con 0x55ee1fe7f030 2024-09-13T06:09:54.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.255+0000 7f89f4787640 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe7e2d0 con 0x55ee1fe7a6a0 2024-09-13T06:09:54.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.255+0000 7f89f4f88640 1 -- 172.21.15.194:0/992776484 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89ec00a4d0 con 0x55ee1fe7a6a0 2024-09-13T06:09:54.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.255+0000 7f89f4f88640 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe7e2d0 con 0x55ee1fe7a6a0 2024-09-13T06:09:54.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.255+0000 7f89f4f88640 1 -- 172.21.15.194:0/992776484 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f89ec00a4d0 con 0x55ee1fe7a6a0 2024-09-13T06:09:54.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.255+0000 7f89f4f88640 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe7e2d0 con 0x7f89dc0e0040 2024-09-13T06:09:54.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.255+0000 7f89f4f88640 1 -- 172.21.15.194:0/992776484 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89ec00a4d0 con 0x7f89dc0e0040 2024-09-13T06:09:54.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.255+0000 7f89f4f88640 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe7e2d0 con 0x55ee1fe7f030 2024-09-13T06:09:54.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.255+0000 7f89f4787640 1 -- 172.21.15.194:0/992776484 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89e402e070 con 0x55ee1fe7f030 2024-09-13T06:09:54.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.255+0000 7f89f4787640 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe7e2d0 con 0x7f89e404b480 2024-09-13T06:09:54.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.255+0000 7f89f3f86640 1 -- 172.21.15.194:0/992776484 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89dc0aaad0 con 0x7f89e404b480 2024-09-13T06:09:54.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.255+0000 7f89f3f86640 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe7e2d0 con 0x55ee1fe7a6a0 2024-09-13T06:09:54.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.255+0000 7f89f4f88640 1 -- 172.21.15.194:0/992776484 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89ec00a4d0 con 0x55ee1fe7a6a0 2024-09-13T06:09:54.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.255+0000 7f89f4f88640 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe7e2d0 con 0x7f89dc0e0040 2024-09-13T06:09:54.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.259+0000 7f89f4f88640 1 -- 172.21.15.194:0/992776484 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89ec00a4d0 con 0x7f89dc0e0040 2024-09-13T06:09:54.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.259+0000 7f89f4f88640 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe7e2d0 con 0x55ee1fe7f030 2024-09-13T06:09:54.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.259+0000 7f89f4787640 1 -- 172.21.15.194:0/992776484 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f89e402e070 con 0x55ee1fe7f030 2024-09-13T06:09:54.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.259+0000 7f89f4787640 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe7e2d0 con 0x7f89dc0e0040 2024-09-13T06:09:54.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.259+0000 7f89f4f88640 1 -- 172.21.15.194:0/992776484 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89ec00a4d0 con 0x7f89dc0e0040 2024-09-13T06:09:54.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.259+0000 7f89f4f88640 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe7e2d0 con 0x7f89e404b480 2024-09-13T06:09:54.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.259+0000 7f89f3f86640 1 -- 172.21.15.194:0/992776484 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89dc0aaad0 con 0x7f89e404b480 2024-09-13T06:09:54.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.259+0000 7f89f3f86640 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe7e2d0 con 0x55ee1fe7f030 2024-09-13T06:09:54.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.259+0000 7f89f4787640 1 -- 172.21.15.194:0/992776484 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89e402e070 con 0x55ee1fe7f030 2024-09-13T06:09:54.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.259+0000 7f89f4787640 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe7e2d0 con 0x7f89dc0e0040 2024-09-13T06:09:54.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.259+0000 7f89f4f88640 1 -- 172.21.15.194:0/992776484 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89ec00a4d0 con 0x7f89dc0e0040 2024-09-13T06:09:54.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.259+0000 7f89f4f88640 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe7e2d0 con 0x55ee1fe7a6a0 2024-09-13T06:09:54.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.259+0000 7f89f4f88640 1 -- 172.21.15.194:0/992776484 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f89ec00a4d0 con 0x55ee1fe7a6a0 2024-09-13T06:09:54.272 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.259+0000 7f89f4f88640 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe7e2d0 con 0x7f89e404b480 2024-09-13T06:09:54.272 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.259+0000 7f89f3f86640 1 -- 172.21.15.194:0/992776484 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89dc0aaad0 con 0x7f89e404b480 2024-09-13T06:09:54.272 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.259+0000 7f89f6c77980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:09:54.272 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.259+0000 7f89f6c77980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:09:54.272 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.259+0000 7f89f6c77980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:09:54.272 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.259+0000 7f89f6c77980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:09:54.272 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.259+0000 7f89f6c77980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:09:54.272 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.259+0000 7f89f6c77980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:09:54.272 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.259+0000 7f89f6c77980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.272 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.259+0000 7f89f6c77980 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe822f0 con 0x55ee1fe7a6a0 2024-09-13T06:09:54.272 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.259+0000 7f89f4f88640 1 -- 172.21.15.194:0/992776484 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f89ec00a4d0 con 0x55ee1fe7a6a0 2024-09-13T06:09:54.273 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.259+0000 7f89f6c77980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:54.273 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.259+0000 7f89f6c77980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.273 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.259+0000 7f89f6c77980 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe82b90 con 0x55ee1fe7a6a0 2024-09-13T06:09:54.273 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.263+0000 7f89f4f88640 1 -- 172.21.15.194:0/992776484 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f89ec00a4d0 con 0x55ee1fe7a6a0 2024-09-13T06:09:54.273 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.263+0000 7f89f6c77980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:54.273 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.263+0000 7f89f6c77980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.273 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.263+0000 7f89f6c77980 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe81f30 con 0x7f89e404b480 2024-09-13T06:09:54.273 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.263+0000 7f89f3f86640 1 -- 172.21.15.194:0/992776484 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f89dc0aaad0 con 0x7f89e404b480 2024-09-13T06:09:54.273 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.263+0000 7f89f6c77980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:09:54.273 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.263+0000 7f89f6c77980 20 zone default found 2024-09-13T06:09:54.273 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.263+0000 7f89f6c77980 4 Realm: () 2024-09-13T06:09:54.273 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.263+0000 7f89f6c77980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:09:54.274 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.263+0000 7f89f6c77980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:09:54.274 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.263+0000 7f89f6c77980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:09:54.274 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.263+0000 7f89f6c77980 20 zonegroup default 2024-09-13T06:09:54.274 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.263+0000 7f89f6c77980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.274 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.263+0000 7f89f6c77980 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe82b90 con 0x7f89dc0e0040 2024-09-13T06:09:54.274 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.263+0000 7f89f4f88640 1 -- 172.21.15.194:0/992776484 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f89ec00a4d0 con 0x7f89dc0e0040 2024-09-13T06:09:54.274 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.263+0000 7f89f6c77980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:54.274 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.263+0000 7f89f6c77980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.274 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.263+0000 7f89f6c77980 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe850b0 con 0x55ee1fe7f030 2024-09-13T06:09:54.274 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.263+0000 7f89f4787640 1 -- 172.21.15.194:0/992776484 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f89e402e070 con 0x55ee1fe7f030 2024-09-13T06:09:54.274 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.263+0000 7f89f6c77980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:54.274 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.263+0000 7f89f6c77980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.274 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.263+0000 7f89f6c77980 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe85450 con 0x55ee1fe7f030 2024-09-13T06:09:54.275 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.263+0000 7f89f4787640 1 -- 172.21.15.194:0/992776484 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f89e402e070 con 0x55ee1fe7f030 2024-09-13T06:09:54.275 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.263+0000 7f89f6c77980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:54.275 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.263+0000 7f89f6c77980 20 started sync module instance, tier type = 2024-09-13T06:09:54.275 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.263+0000 7f89f6c77980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:09:54.275 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.263+0000 7f89f6c77980 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe84550 con 0x7f89e404b480 2024-09-13T06:09:54.275 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.263+0000 7f89f3f86640 1 -- 172.21.15.194:0/992776484 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(44 notify.0 [create] v33'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89dc0aaad0 con 0x7f89e404b480 2024-09-13T06:09:54.275 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.263+0000 7f89f6c77980 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94481225894128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe84d10 con 0x7f89e404b480 2024-09-13T06:09:54.275 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.263+0000 7f89f6c77980 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe862c0 con 0x55ee1fe7a6a0 2024-09-13T06:09:54.275 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.267+0000 7f89f3f86640 1 -- 172.21.15.194:0/992776484 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94481225894128] v33'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89dc0aaad0 con 0x7f89e404b480 2024-09-13T06:09:54.275 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.267+0000 7f89f4f88640 1 -- 172.21.15.194:0/992776484 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v33'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89ec00a4d0 con 0x55ee1fe7a6a0 2024-09-13T06:09:54.275 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.267+0000 7f89f6c77980 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94481225899536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe866e0 con 0x55ee1fe7a6a0 2024-09-13T06:09:54.276 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.267+0000 7f89f6c77980 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe86fb0 con 0x55ee1fe7f030 2024-09-13T06:09:54.276 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.267+0000 7f89f4f88640 1 -- 172.21.15.194:0/992776484 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94481225899536] v33'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89ec00a4d0 con 0x55ee1fe7a6a0 2024-09-13T06:09:54.276 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.267+0000 7f89f4787640 1 -- 172.21.15.194:0/992776484 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v33'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89e402e070 con 0x55ee1fe7f030 2024-09-13T06:09:54.276 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.267+0000 7f89f6c77980 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94481225900592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe86b00 con 0x55ee1fe7f030 2024-09-13T06:09:54.276 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.267+0000 7f89f6c77980 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe879c0 con 0x7f89e404b480 2024-09-13T06:09:54.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.271+0000 7f89f3f86640 1 -- 172.21.15.194:0/992776484 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(50 notify.3 [create] v33'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89dc0aaad0 con 0x7f89e404b480 2024-09-13T06:09:54.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.271+0000 7f89f6c77980 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94481225905424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe88260 con 0x7f89e404b480 2024-09-13T06:09:54.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.271+0000 7f89f6c77980 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe88c80 con 0x55ee1fe7a6a0 2024-09-13T06:09:54.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.271+0000 7f89f4787640 1 -- 172.21.15.194:0/992776484 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94481225900592] v33'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89e402e070 con 0x55ee1fe7f030 2024-09-13T06:09:54.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.271+0000 7f89f3f86640 1 -- 172.21.15.194:0/992776484 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94481225905424] v33'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89dc0aaad0 con 0x7f89e404b480 2024-09-13T06:09:54.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.271+0000 7f89f4f88640 1 -- 172.21.15.194:0/992776484 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v33'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89ec00a4d0 con 0x55ee1fe7a6a0 2024-09-13T06:09:54.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.271+0000 7f89f6c77980 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94481225910128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe87db0 con 0x55ee1fe7a6a0 2024-09-13T06:09:54.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.271+0000 7f89f6c77980 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe89520 con 0x7f89dc0e0040 2024-09-13T06:09:54.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.275+0000 7f89f4f88640 1 -- 172.21.15.194:0/992776484 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94481225910128] v33'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89ec00a4d0 con 0x55ee1fe7a6a0 2024-09-13T06:09:54.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.275+0000 7f89f4f88640 1 -- 172.21.15.194:0/992776484 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(54 notify.5 [create] v33'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89ec00a4d0 con 0x7f89dc0e0040 2024-09-13T06:09:54.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.275+0000 7f89f6c77980 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94481225901648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe87db0 con 0x7f89dc0e0040 2024-09-13T06:09:54.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.275+0000 7f89f6c77980 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe899f0 con 0x7f89dc0e0040 2024-09-13T06:09:54.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.275+0000 7f89f4f88640 1 -- 172.21.15.194:0/992776484 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(56 notify.6 [create] v33'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89ec00a4d0 con 0x7f89dc0e0040 2024-09-13T06:09:54.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.275+0000 7f89f6c77980 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94481225913568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe89e60 con 0x7f89dc0e0040 2024-09-13T06:09:54.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.275+0000 7f89f6c77980 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe8a930 con 0x7f89dc0e0040 2024-09-13T06:09:54.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.275+0000 7f89f4f88640 1 -- 172.21.15.194:0/992776484 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94481225901648] v33'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89ec00a4d0 con 0x7f89dc0e0040 2024-09-13T06:09:54.280 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.279+0000 7f89f4f88640 1 -- 172.21.15.194:0/992776484 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94481225913568] v33'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89ec00a4d0 con 0x7f89dc0e0040 2024-09-13T06:09:54.280 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.279+0000 7f89f4f88640 1 -- 172.21.15.194:0/992776484 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(58 notify.7 [create] v33'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89ec00a4d0 con 0x7f89dc0e0040 2024-09-13T06:09:54.280 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.279+0000 7f89f6c77980 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94481225917472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe899f0 con 0x7f89dc0e0040 2024-09-13T06:09:54.280 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.279+0000 7f89f6c77980 20 add_watcher() i=0 2024-09-13T06:09:54.281 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.279+0000 7f89f6c77980 20 add_watcher() i=1 2024-09-13T06:09:54.281 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.279+0000 7f89f6c77980 20 add_watcher() i=2 2024-09-13T06:09:54.281 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.279+0000 7f89f6c77980 20 add_watcher() i=3 2024-09-13T06:09:54.281 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.279+0000 7f89f6c77980 20 add_watcher() i=4 2024-09-13T06:09:54.281 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.279+0000 7f89f6c77980 20 add_watcher() i=5 2024-09-13T06:09:54.281 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.279+0000 7f89f6c77980 20 add_watcher() i=6 2024-09-13T06:09:54.282 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.279+0000 7f89f4f88640 1 -- 172.21.15.194:0/992776484 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94481225917472] v33'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89ec00a4d0 con 0x7f89dc0e0040 2024-09-13T06:09:54.282 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.279+0000 7f89f6c77980 20 add_watcher() i=7 2024-09-13T06:09:54.282 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.279+0000 7f89f6c77980 2 all 8 watchers are set, enabling cache 2024-09-13T06:09:54.282 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.279+0000 7f89f6c77980 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe8da30 con 0x55ee1fe7a6a0 2024-09-13T06:09:54.283 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.283+0000 7f89f4f88640 1 -- 172.21.15.194:0/992776484 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f89ec00a4d0 con 0x55ee1fe7a6a0 2024-09-13T06:09:54.283 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.283+0000 7f89f6c77980 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94481225911920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe8aeb0 con 0x55ee1fe7a6a0 2024-09-13T06:09:54.284 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.283+0000 7f89f4f88640 1 -- 172.21.15.194:0/992776484 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94481225911920] v33'62 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f89ec00a4d0 con 0x55ee1fe7a6a0 2024-09-13T06:09:54.284 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.283+0000 7f88aa7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:54.284 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.283+0000 7f89f6c77980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:09:54.284 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.283+0000 7f89f6c77980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:09:54.284 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.283+0000 7f89f6c77980 5 note: GC not initialized 2024-09-13T06:09:54.285 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.283+0000 7f88a97e2640 20 reqs_thread_entry: start 2024-09-13T06:09:54.285 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.283+0000 7f89f6c77980 20 init_complete bucket index max shards: 11 2024-09-13T06:09:54.285 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.283+0000 7f89f6c77980 20 Filter name: none 2024-09-13T06:09:54.285 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.283+0000 7f881affd640 20 reqs_thread_entry: start 2024-09-13T06:09:54.285 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.283+0000 7f89f6c77980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.285 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.283+0000 7f89f6c77980 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ee1feb0960 con 0x55ee1fe7a6a0 2024-09-13T06:09:54.285 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.283+0000 7f89f4f88640 1 -- 172.21.15.194:0/992776484 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f89ec00a4d0 con 0x55ee1fe7a6a0 2024-09-13T06:09:54.286 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.283+0000 7f89f6c77980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T06:09:54.286 INFO:teuthology.orchestra.run.smithi194.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T06:09:53.191222Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:09:53.191207Z","tags":[],"group_ids":[]} 2024-09-13T06:09:54.286 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.283+0000 7f88aa7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:54.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.283+0000 7f89f6c77980 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94481225911920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ee1feaf8b0 con 0x55ee1fe7a6a0 2024-09-13T06:09:54.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.287+0000 7f89f4f88640 1 -- 172.21.15.194:0/992776484 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94481225911920] v33'63 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f89ec00a4d0 con 0x55ee1fe7a6a0 2024-09-13T06:09:54.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.287+0000 7f89f6c77980 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94481225894128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe88e70 con 0x7f89e404b480 2024-09-13T06:09:54.288 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.287+0000 7f89f3f86640 1 -- 172.21.15.194:0/992776484 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94481225894128] v33'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89dc0aaad0 con 0x7f89e404b480 2024-09-13T06:09:54.288 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.287+0000 7f89f6c77980 20 remove_watcher() i=0 2024-09-13T06:09:54.288 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.287+0000 7f89f6c77980 2 removed watcher, disabling cache 2024-09-13T06:09:54.288 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.287+0000 7f89f6c77980 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94481225899536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe88e70 con 0x55ee1fe7a6a0 2024-09-13T06:09:54.290 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.287+0000 7f89f4f88640 1 -- 172.21.15.194:0/992776484 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94481225899536] v33'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89ec00a4d0 con 0x55ee1fe7a6a0 2024-09-13T06:09:54.290 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.287+0000 7f89f6c77980 20 remove_watcher() i=1 2024-09-13T06:09:54.290 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.287+0000 7f89f6c77980 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94481225900592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe85e10 con 0x55ee1fe7f030 2024-09-13T06:09:54.292 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.291+0000 7f89f4787640 1 -- 172.21.15.194:0/992776484 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94481225900592] v33'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89e402e070 con 0x55ee1fe7f030 2024-09-13T06:09:54.292 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.291+0000 7f89f6c77980 20 remove_watcher() i=2 2024-09-13T06:09:54.292 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.291+0000 7f89f6c77980 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94481225905424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe88e70 con 0x7f89e404b480 2024-09-13T06:09:54.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.291+0000 7f89f3f86640 1 -- 172.21.15.194:0/992776484 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94481225905424] v33'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89dc0aaad0 con 0x7f89e404b480 2024-09-13T06:09:54.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.291+0000 7f89f6c77980 20 remove_watcher() i=3 2024-09-13T06:09:54.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.291+0000 7f89f6c77980 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94481225910128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe87510 con 0x55ee1fe7a6a0 2024-09-13T06:09:54.294 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.295+0000 7f89f4f88640 1 -- 172.21.15.194:0/992776484 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94481225910128] v33'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89ec00a4d0 con 0x55ee1fe7a6a0 2024-09-13T06:09:54.295 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.295+0000 7f89f6c77980 20 remove_watcher() i=4 2024-09-13T06:09:54.295 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.295+0000 7f89f6c77980 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94481225901648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe88e70 con 0x7f89dc0e0040 2024-09-13T06:09:54.296 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.295+0000 7f89f4f88640 1 -- 172.21.15.194:0/992776484 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94481225901648] v33'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89ec00a4d0 con 0x7f89dc0e0040 2024-09-13T06:09:54.296 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.295+0000 7f89f6c77980 20 remove_watcher() i=5 2024-09-13T06:09:54.297 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.295+0000 7f89f6c77980 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94481225913568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe87510 con 0x7f89dc0e0040 2024-09-13T06:09:54.298 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.299+0000 7f89f4f88640 1 -- 172.21.15.194:0/992776484 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94481225913568] v33'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89ec00a4d0 con 0x7f89dc0e0040 2024-09-13T06:09:54.298 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.299+0000 7f89f6c77980 20 remove_watcher() i=6 2024-09-13T06:09:54.298 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.299+0000 7f89f6c77980 1 -- 172.21.15.194:0/992776484 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94481225917472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ee1fe87510 con 0x7f89dc0e0040 2024-09-13T06:09:54.303 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.299+0000 7f89f4f88640 1 -- 172.21.15.194:0/992776484 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94481225917472] v33'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89ec00a4d0 con 0x7f89dc0e0040 2024-09-13T06:09:54.303 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.299+0000 7f89f6c77980 20 remove_watcher() i=7 2024-09-13T06:09:54.303 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.299+0000 7f89f6c77980 1 -- 172.21.15.194:0/992776484 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f89dc0e0040 msgr2=0x7f89dc0e0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.303 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.299+0000 7f89f6c77980 1 --2- 172.21.15.194:0/992776484 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f89dc0e0040 0x7f89dc0e0420 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.303 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.299+0000 7f89f6c77980 1 -- 172.21.15.194:0/992776484 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ee1fe7a6a0 msgr2=0x55ee1fe7cb30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.303 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.299+0000 7f89f6c77980 1 --2- 172.21.15.194:0/992776484 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ee1fe7a6a0 0x55ee1fe7cb30 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.303 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.299+0000 7f89f6c77980 1 -- 172.21.15.194:0/992776484 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f89e404b480 msgr2=0x7f89e40598d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.303 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.299+0000 7f89f6c77980 1 --2- 172.21.15.194:0/992776484 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f89e404b480 0x7f89e40598d0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.303 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.299+0000 7f89f6c77980 1 -- 172.21.15.194:0/992776484 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ee1fe7f030 msgr2=0x55ee1fe81420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.303 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.299+0000 7f89f6c77980 1 --2- 172.21.15.194:0/992776484 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ee1fe7f030 0x55ee1fe81420 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.304 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.299+0000 7f89f6c77980 1 -- 172.21.15.194:0/992776484 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f88bc034650 msgr2=0x7f88bc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.304 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.299+0000 7f89f6c77980 1 --2- 172.21.15.194:0/992776484 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f88bc034650 0x7f88bc036b10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f89dc000c10 tx=0x7f89dc0c1040 comp rx=0 tx=0).stop 2024-09-13T06:09:54.304 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.299+0000 7f89f4f88640 1 -- 172.21.15.194:0/992776484 reap_dead start 2024-09-13T06:09:54.304 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.299+0000 7f89f6c77980 1 -- 172.21.15.194:0/992776484 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee1fd49570 msgr2=0x55ee1fe6f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.304 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.299+0000 7f89f6c77980 1 --2- 172.21.15.194:0/992776484 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee1fd49570 0x55ee1fe6f800 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f89e4000fc0 tx=0x7f89e4046ed0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.304 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.299+0000 7f89f6c77980 1 -- 172.21.15.194:0/992776484 shutdown_connections 2024-09-13T06:09:54.304 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.299+0000 7f89f6c77980 1 --2- 172.21.15.194:0/992776484 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee1fd49570 0x55ee1fe6f800 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.304 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.299+0000 7f89f6c77980 1 -- 172.21.15.194:0/992776484 >> 172.21.15.194:0/992776484 conn(0x55ee1fe62980 msgr2=0x55ee1fe60a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:54.304 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.299+0000 7f89f6c77980 1 -- 172.21.15.194:0/992776484 shutdown_connections 2024-09-13T06:09:54.304 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.299+0000 7f89f6c77980 1 -- 172.21.15.194:0/992776484 wait complete. 2024-09-13T06:09:54.304 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.299+0000 7f89f6c77980 1 -- 172.21.15.194:0/3633304496 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f88cc0346a0 msgr2=0x7f88cc036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.304 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.299+0000 7f89f6c77980 1 --2- 172.21.15.194:0/3633304496 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f88cc0346a0 0x7f88cc036b60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x55ee1fe43d70 tx=0x7f89dc005ad0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.304 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.299+0000 7f89f6c77980 1 -- 172.21.15.194:0/3633304496 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee1fe59c70 msgr2=0x55ee1fe5a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.305 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.299+0000 7f89f6c77980 1 --2- 172.21.15.194:0/3633304496 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee1fe59c70 0x55ee1fe5a090 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f89e401dfd0 tx=0x7f89e401b7a0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.305 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.299+0000 7f89f6c77980 1 -- 172.21.15.194:0/3633304496 shutdown_connections 2024-09-13T06:09:54.305 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.299+0000 7f89f6c77980 1 --2- 172.21.15.194:0/3633304496 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f88cc0346a0 0x7f88cc036b60 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.305 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.299+0000 7f89f6c77980 1 --2- 172.21.15.194:0/3633304496 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee1fe59c70 0x55ee1fe5a090 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.305 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.299+0000 7f89f6c77980 1 -- 172.21.15.194:0/3633304496 >> 172.21.15.194:0/3633304496 conn(0x55ee1fe4edc0 msgr2=0x55ee1fe51840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:54.305 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.299+0000 7f89f6c77980 1 -- 172.21.15.194:0/3633304496 shutdown_connections 2024-09-13T06:09:54.305 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.299+0000 7f89f6c77980 1 -- 172.21.15.194:0/3633304496 wait complete. 2024-09-13T06:09:54.305 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.299+0000 7f89f6c77980 1 -- 172.21.15.194:0/2025222878 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ee1fd4da90 msgr2=0x55ee1fe42f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.305 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.299+0000 7f89f6c77980 1 --2- 172.21.15.194:0/2025222878 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ee1fd4da90 0x55ee1fe42f10 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.305 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.299+0000 7f89f6c77980 1 -- 172.21.15.194:0/2025222878 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55ee1fe496e0 msgr2=0x55ee1fe4bad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.305 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.299+0000 7f89f6c77980 1 --2- 172.21.15.194:0/2025222878 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55ee1fe496e0 0x55ee1fe4bad0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.305 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.299+0000 7f89f6c77980 1 -- 172.21.15.194:0/2025222878 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ee1fe457c0 msgr2=0x55ee1fe47bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.305 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.299+0000 7f89f6c77980 1 --2- 172.21.15.194:0/2025222878 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ee1fe457c0 0x55ee1fe47bb0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.306 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.299+0000 7f89f6c77980 1 -- 172.21.15.194:0/2025222878 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f88dc0346f0 msgr2=0x7f88dc036bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.306 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.299+0000 7f89f6c77980 1 --2- 172.21.15.194:0/2025222878 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f88dc0346f0 0x7f88dc036bb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f89dc0ae000 tx=0x7f89dc0a6000 comp rx=0 tx=0).stop 2024-09-13T06:09:54.306 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.299+0000 7f89f6c77980 1 -- 172.21.15.194:0/2025222878 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee1fcbdac0 msgr2=0x55ee1fe3be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.306 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.299+0000 7f89f6c77980 1 --2- 172.21.15.194:0/2025222878 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee1fcbdac0 0x55ee1fe3be10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f89e400b6f0 tx=0x7f89e4000ee0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.306 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.299+0000 7f89f4f88640 1 -- 172.21.15.194:0/2025222878 reap_dead start 2024-09-13T06:09:54.306 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.299+0000 7f89f6c77980 1 -- 172.21.15.194:0/2025222878 shutdown_connections 2024-09-13T06:09:54.306 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.299+0000 7f89f6c77980 1 -- 172.21.15.194:0/2025222878 >> 172.21.15.194:0/2025222878 conn(0x55ee1fd44060 msgr2=0x55ee1fe2f210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:54.306 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.299+0000 7f89f6c77980 1 -- 172.21.15.194:0/2025222878 shutdown_connections 2024-09-13T06:09:54.306 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.299+0000 7f89f6c77980 1 -- 172.21.15.194:0/2025222878 wait complete. 2024-09-13T06:09:54.311 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T06:09:53.191222Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:09:53.191207Z', 'tags': [], 'group_ids': []} 2024-09-13T06:09:54.311 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-09-13T06:09:54.311 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-09-13T06:09:54.312 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key create --uid foo --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh 2024-09-13T06:09:54.389 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:09:54.389 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:09:54.390 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.387+0000 7ff330c57980 1 Processor -- start 2024-09-13T06:09:54.390 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.387+0000 7ff330c57980 1 -- start start 2024-09-13T06:09:54.390 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.391+0000 7ff330c57980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x56453dac45f0 0x56453dac49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.390 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.391+0000 7ff330c57980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56453d94cae0 con 0x56453dac4f40 2024-09-13T06:09:54.390 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.391+0000 7ff330c57980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x56453d970e30 con 0x56453dac45f0 2024-09-13T06:09:54.391 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.391+0000 7ff32e767640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x56453dac45f0 0x56453dac49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.391 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.391+0000 7ff32e767640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x56453dac45f0 0x56453dac49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44482/0 (socket says 172.21.15.194:44482) 2024-09-13T06:09:54.391 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.391+0000 7ff32e767640 1 -- 172.21.15.194:0/3012834297 learned_addr learned my addr 172.21.15.194:0/3012834297 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:54.392 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.391+0000 7ff32df66640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x56453dac4f40 0x56453dac9970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:50972/0 (socket says 172.21.15.194:50972) 2024-09-13T06:09:54.392 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.391+0000 7ff32e767640 1 -- 172.21.15.194:0/3012834297 >> v1:172.21.15.120:6789/0 conn(0x56453dac4f40 legacy=0x56453dac9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.392 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.391+0000 7ff32e767640 1 -- 172.21.15.194:0/3012834297 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56453dacc1c0 con 0x56453dac45f0 2024-09-13T06:09:54.393 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.391+0000 7ff32e767640 1 --2- 172.21.15.194:0/3012834297 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56453dac45f0 0x56453dac49d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff32000a5c0 tx=0x7ff32001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=763e0b61edc431dc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.394 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.391+0000 7ff32d765640 1 -- 172.21.15.194:0/3012834297 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3200a6070 con 0x56453dac45f0 2024-09-13T06:09:54.394 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.391+0000 7ff32d765640 1 -- 172.21.15.194:0/3012834297 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3200af070 con 0x56453dac45f0 2024-09-13T06:09:54.394 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.391+0000 7ff32d765640 1 -- 172.21.15.194:0/3012834297 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3200aa5c0 con 0x56453dac45f0 2024-09-13T06:09:54.395 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.391+0000 7ff330c57980 1 -- 172.21.15.194:0/3012834297 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56453dac45f0 msgr2=0x56453dac49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.395 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.391+0000 7ff330c57980 1 --2- 172.21.15.194:0/3012834297 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56453dac45f0 0x56453dac49d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff32000a5c0 tx=0x7ff32001b340 comp rx=0 tx=0).stop 2024-09-13T06:09:54.395 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.395+0000 7ff330c57980 1 -- 172.21.15.194:0/3012834297 shutdown_connections 2024-09-13T06:09:54.395 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.395+0000 7ff330c57980 1 --2- 172.21.15.194:0/3012834297 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56453dac45f0 0x56453dac49d0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.395 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.395+0000 7ff330c57980 1 -- 172.21.15.194:0/3012834297 >> 172.21.15.194:0/3012834297 conn(0x56453dac0110 msgr2=0x56453dac2530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:54.395 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.395+0000 7ff330c57980 1 -- 172.21.15.194:0/3012834297 shutdown_connections 2024-09-13T06:09:54.395 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.395+0000 7ff330c57980 1 -- 172.21.15.194:0/3012834297 wait complete. 2024-09-13T06:09:54.408 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.407+0000 7ff330c57980 1 Processor -- start 2024-09-13T06:09:54.408 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.407+0000 7ff330c57980 1 -- start start 2024-09-13T06:09:54.408 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.407+0000 7ff330c57980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56453dac45f0 0x56453da3aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.408 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.407+0000 7ff330c57980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x56453d972200 con 0x56453dac45f0 2024-09-13T06:09:54.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.407+0000 7ff32e767640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56453dac45f0 0x56453da3aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.407+0000 7ff32e767640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56453dac45f0 0x56453da3aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44488/0 (socket says 172.21.15.194:44488) 2024-09-13T06:09:54.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.407+0000 7ff32e767640 1 -- 172.21.15.194:0/940845807 learned_addr learned my addr 172.21.15.194:0/940845807 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:54.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.407+0000 7ff32e767640 1 -- 172.21.15.194:0/940845807 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56453da3b0c0 con 0x56453dac45f0 2024-09-13T06:09:54.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.407+0000 7ff32e767640 1 --2- 172.21.15.194:0/940845807 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56453dac45f0 0x56453da3aaf0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff3200199f0 tx=0x7ff320003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4219a1a63921f67 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.407+0000 7ff21c608640 1 -- 172.21.15.194:0/940845807 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3200aaa00 con 0x56453dac45f0 2024-09-13T06:09:54.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.407+0000 7ff21c608640 1 -- 172.21.15.194:0/940845807 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3200aaba0 con 0x56453dac45f0 2024-09-13T06:09:54.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.407+0000 7ff21c608640 1 -- 172.21.15.194:0/940845807 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3200bd3f0 con 0x56453dac45f0 2024-09-13T06:09:54.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.407+0000 7ff330c57980 1 -- 172.21.15.194:0/940845807 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56453dac45f0 msgr2=0x56453da3aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.407+0000 7ff330c57980 1 --2- 172.21.15.194:0/940845807 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56453dac45f0 0x56453da3aaf0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff3200199f0 tx=0x7ff320003030 comp rx=0 tx=0).stop 2024-09-13T06:09:54.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.407+0000 7ff330c57980 1 -- 172.21.15.194:0/940845807 shutdown_connections 2024-09-13T06:09:54.412 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.407+0000 7ff330c57980 1 --2- 172.21.15.194:0/940845807 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56453dac45f0 0x56453da3aaf0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.412 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.407+0000 7ff330c57980 1 -- 172.21.15.194:0/940845807 >> 172.21.15.194:0/940845807 conn(0x56453dac0110 msgr2=0x56453dbab6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:54.412 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.407+0000 7ff330c57980 1 -- 172.21.15.194:0/940845807 shutdown_connections 2024-09-13T06:09:54.412 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.407+0000 7ff330c57980 1 -- 172.21.15.194:0/940845807 wait complete. 2024-09-13T06:09:54.412 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.411+0000 7ff330c57980 1 Processor -- start 2024-09-13T06:09:54.412 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.411+0000 7ff330c57980 1 -- start start 2024-09-13T06:09:54.412 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.411+0000 7ff330c57980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56453dac45f0 0x56453dbb8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.412 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.411+0000 7ff330c57980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x56453dacbc00 con 0x56453dac45f0 2024-09-13T06:09:54.412 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.411+0000 7ff32e767640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56453dac45f0 0x56453dbb8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.412 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.411+0000 7ff32e767640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56453dac45f0 0x56453dbb8f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44496/0 (socket says 172.21.15.194:44496) 2024-09-13T06:09:54.412 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.411+0000 7ff32e767640 1 -- 172.21.15.194:0/1193155963 learned_addr learned my addr 172.21.15.194:0/1193155963 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:54.412 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.411+0000 7ff32e767640 1 -- 172.21.15.194:0/1193155963 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56453dbb94a0 con 0x56453dac45f0 2024-09-13T06:09:54.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.411+0000 7ff32e767640 1 --2- 172.21.15.194:0/1193155963 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56453dac45f0 0x56453dbb8f60 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff3200199f0 tx=0x7ff3200180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.411+0000 7ff21ae05640 1 -- 172.21.15.194:0/1193155963 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3200bd7c0 con 0x56453dac45f0 2024-09-13T06:09:54.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.411+0000 7ff21ae05640 1 -- 172.21.15.194:0/1193155963 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3200bd960 con 0x56453dac45f0 2024-09-13T06:09:54.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.411+0000 7ff330c57980 1 -- 172.21.15.194:0/1193155963 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56453dbb9730 con 0x56453dac45f0 2024-09-13T06:09:54.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.411+0000 7ff21ae05640 1 -- 172.21.15.194:0/1193155963 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3200bdc40 con 0x56453dac45f0 2024-09-13T06:09:54.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.411+0000 7ff330c57980 1 -- 172.21.15.194:0/1193155963 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56453dbbc410 con 0x56453dac45f0 2024-09-13T06:09:54.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.411+0000 7ff21ae05640 1 -- 172.21.15.194:0/1193155963 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff3200ce020 con 0x56453dac45f0 2024-09-13T06:09:54.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.411+0000 7ff21ae05640 1 --2- 172.21.15.194:0/1193155963 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff214034650 0x7ff214036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.411+0000 7ff21ae05640 1 -- 172.21.15.194:0/1193155963 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7ff3200cc020 con 0x56453dac45f0 2024-09-13T06:09:54.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.411+0000 7ff32df66640 1 --2- 172.21.15.194:0/1193155963 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff214034650 0x7ff214036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.411+0000 7ff330c57980 1 --2- 172.21.15.194:0/1193155963 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x56453dac4f40 0x56453dbbff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.411+0000 7ff330c57980 1 -- 172.21.15.194:0/1193155963 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56453dbc0590 con 0x56453dac4f40 2024-09-13T06:09:54.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.411+0000 7ff32ef68640 1 --2- 172.21.15.194:0/1193155963 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x56453dac4f40 0x56453dbbff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.411+0000 7ff32df66640 1 --2- 172.21.15.194:0/1193155963 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff214034650 0x7ff214036b10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff324000f70 tx=0x7ff324001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.411+0000 7ff32ef68640 1 --2- 172.21.15.194:0/1193155963 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x56453dac4f40 0x56453dbbff50 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.415+0000 7ff32ef68640 1 -- 172.21.15.194:0/1193155963 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff32800a4d0 con 0x56453dac4f40 2024-09-13T06:09:54.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.415+0000 7ff330c57980 1 -- 172.21.15.194:0/1193155963 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56453dbbd610 con 0x56453dac4f40 2024-09-13T06:09:54.417 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.415+0000 7ff32ef68640 1 -- 172.21.15.194:0/1193155963 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff32800a4d0 con 0x56453dac4f40 2024-09-13T06:09:54.417 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.415+0000 7ff330c57980 1 --2- 172.21.15.194:0/1193155963 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x56453dbc28c0 0x56453dbc4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.417 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.415+0000 7ff330c57980 1 -- 172.21.15.194:0/1193155963 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56453dbc5380 con 0x56453dbc28c0 2024-09-13T06:09:54.417 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.415+0000 7ff32e767640 1 --2- 172.21.15.194:0/1193155963 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x56453dbc28c0 0x56453dbc4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.417 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.415+0000 7ff32e767640 1 --2- 172.21.15.194:0/1193155963 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x56453dbc28c0 0x56453dbc4cb0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.415+0000 7ff32e767640 1 -- 172.21.15.194:0/1193155963 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff3200e5050 con 0x56453dbc28c0 2024-09-13T06:09:54.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.415+0000 7ff330c57980 1 -- 172.21.15.194:0/1193155963 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56453dbc1760 con 0x56453dac4f40 2024-09-13T06:09:54.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.415+0000 7ff32ef68640 1 -- 172.21.15.194:0/1193155963 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff32800a4d0 con 0x56453dac4f40 2024-09-13T06:09:54.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.415+0000 7ff330c57980 1 --2- 172.21.15.194:0/1193155963 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x56453dbc67c0 0x56453dbc8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.415+0000 7ff330c57980 1 -- 172.21.15.194:0/1193155963 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56453dbc9340 con 0x56453dbc67c0 2024-09-13T06:09:54.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.415+0000 7ff32df66640 1 --2- 172.21.15.194:0/1193155963 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x56453dbc67c0 0x56453dbc8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.415+0000 7ff32df66640 1 --2- 172.21.15.194:0/1193155963 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x56453dbc67c0 0x56453dbc8bb0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.415+0000 7ff32df66640 1 -- 172.21.15.194:0/1193155963 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff32400f6a0 con 0x56453dbc67c0 2024-09-13T06:09:54.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.415+0000 7ff330c57980 1 Processor -- start 2024-09-13T06:09:54.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.415+0000 7ff330c57980 1 -- start start 2024-09-13T06:09:54.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.415+0000 7ff330c57980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56453dbd6dd0 0x56453dbd71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.415+0000 7ff330c57980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x56453d9cb800 con 0x56453dbd6dd0 2024-09-13T06:09:54.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.415+0000 7ff32e767640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56453dbd6dd0 0x56453dbd71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.415+0000 7ff32e767640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56453dbd6dd0 0x56453dbd71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44502/0 (socket says 172.21.15.194:44502) 2024-09-13T06:09:54.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.415+0000 7ff32e767640 1 -- 172.21.15.194:0/634553342 learned_addr learned my addr 172.21.15.194:0/634553342 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:54.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.419+0000 7ff32e767640 1 -- 172.21.15.194:0/634553342 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56453dbd7730 con 0x56453dbd6dd0 2024-09-13T06:09:54.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.419+0000 7ff32e767640 1 --2- 172.21.15.194:0/634553342 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56453dbd6dd0 0x56453dbd71f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff3200cf900 tx=0x7ff3200e3ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.419+0000 7ff213fff640 1 -- 172.21.15.194:0/634553342 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3200cfe20 con 0x56453dbd6dd0 2024-09-13T06:09:54.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.419+0000 7ff330c57980 1 -- 172.21.15.194:0/634553342 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56453dbd79c0 con 0x56453dbd6dd0 2024-09-13T06:09:54.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.419+0000 7ff213fff640 1 -- 172.21.15.194:0/634553342 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3200e32d0 con 0x56453dbd6dd0 2024-09-13T06:09:54.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.419+0000 7ff213fff640 1 -- 172.21.15.194:0/634553342 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3200e35b0 con 0x56453dbd6dd0 2024-09-13T06:09:54.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.419+0000 7ff330c57980 1 -- 172.21.15.194:0/634553342 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56453dbda640 con 0x56453dbd6dd0 2024-09-13T06:09:54.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.419+0000 7ff213fff640 1 -- 172.21.15.194:0/634553342 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff3200c6480 con 0x56453dbd6dd0 2024-09-13T06:09:54.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.419+0000 7ff213fff640 1 --2- 172.21.15.194:0/634553342 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff208034650 0x7ff208036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.419+0000 7ff213fff640 1 -- 172.21.15.194:0/634553342 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7ff3200eec50 con 0x56453dbd6dd0 2024-09-13T06:09:54.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.419+0000 7ff32df66640 1 --2- 172.21.15.194:0/634553342 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff208034650 0x7ff208036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.419+0000 7ff330c57980 1 Processor -- start 2024-09-13T06:09:54.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.419+0000 7ff330c57980 1 -- start start 2024-09-13T06:09:54.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.419+0000 7ff32df66640 1 --2- 172.21.15.194:0/634553342 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff208034650 0x7ff208036b10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x56453dbc9740 tx=0x7ff32400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.419+0000 7ff330c57980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56453dbe3780 0x56453dbe3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.419+0000 7ff330c57980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x56453da39220 con 0x56453dbe3780 2024-09-13T06:09:54.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.419+0000 7ff32e767640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56453dbe3780 0x56453dbe3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.419+0000 7ff32e767640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56453dbe3780 0x56453dbe3b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44506/0 (socket says 172.21.15.194:44506) 2024-09-13T06:09:54.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.419+0000 7ff32e767640 1 -- 172.21.15.194:0/3503398838 learned_addr learned my addr 172.21.15.194:0/3503398838 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:54.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.419+0000 7ff32e767640 1 -- 172.21.15.194:0/3503398838 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56453dbe4150 con 0x56453dbe3780 2024-09-13T06:09:54.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.419+0000 7ff32e767640 1 --2- 172.21.15.194:0/3503398838 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56453dbe3780 0x56453dbe3b80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff3200c9fc0 tx=0x7ff3200db7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=407a1a811edcf506 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.419+0000 7ff211ffb640 1 -- 172.21.15.194:0/3503398838 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3200f2040 con 0x56453dbe3780 2024-09-13T06:09:54.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.419+0000 7ff211ffb640 1 -- 172.21.15.194:0/3503398838 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3200c9df0 con 0x56453dbe3780 2024-09-13T06:09:54.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.419+0000 7ff211ffb640 1 -- 172.21.15.194:0/3503398838 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3200bc4d0 con 0x56453dbe3780 2024-09-13T06:09:54.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.423+0000 7ff330c57980 1 -- 172.21.15.194:0/3503398838 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56453dbe3780 msgr2=0x56453dbe3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.423+0000 7ff330c57980 1 --2- 172.21.15.194:0/3503398838 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56453dbe3780 0x56453dbe3b80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff3200c9fc0 tx=0x7ff3200db7a0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.423+0000 7ff330c57980 1 -- 172.21.15.194:0/3503398838 shutdown_connections 2024-09-13T06:09:54.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.423+0000 7ff330c57980 1 --2- 172.21.15.194:0/3503398838 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56453dbe3780 0x56453dbe3b80 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.423+0000 7ff330c57980 1 -- 172.21.15.194:0/3503398838 >> 172.21.15.194:0/3503398838 conn(0x56453dbdfb00 msgr2=0x56453dbddc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:54.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.423+0000 7ff330c57980 1 -- 172.21.15.194:0/3503398838 shutdown_connections 2024-09-13T06:09:54.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.423+0000 7ff330c57980 1 -- 172.21.15.194:0/3503398838 wait complete. 2024-09-13T06:09:54.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.423+0000 7ff330c57980 1 Processor -- start 2024-09-13T06:09:54.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.423+0000 7ff330c57980 1 -- start start 2024-09-13T06:09:54.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.423+0000 7ff330c57980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56453dbe3780 0x56453dbea880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.423+0000 7ff330c57980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x56453dbe4510 con 0x56453dbe3780 2024-09-13T06:09:54.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.423+0000 7ff32e767640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56453dbe3780 0x56453dbea880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.423+0000 7ff32e767640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56453dbe3780 0x56453dbea880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44516/0 (socket says 172.21.15.194:44516) 2024-09-13T06:09:54.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.423+0000 7ff32e767640 1 -- 172.21.15.194:0/1599645780 learned_addr learned my addr 172.21.15.194:0/1599645780 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:54.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.423+0000 7ff32e767640 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56453dbeadc0 con 0x56453dbe3780 2024-09-13T06:09:54.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.423+0000 7ff32e767640 1 --2- 172.21.15.194:0/1599645780 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56453dbe3780 0x56453dbea880 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff3200b3be0 tx=0x7ff3200a9fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.432 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.423+0000 7ff1fffff640 1 -- 172.21.15.194:0/1599645780 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff320110070 con 0x56453dbe3780 2024-09-13T06:09:54.432 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.423+0000 7ff330c57980 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56453dbeadc0 con 0x56453dbe3780 2024-09-13T06:09:54.432 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.423+0000 7ff1fffff640 1 -- 172.21.15.194:0/1599645780 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3200bc3a0 con 0x56453dbe3780 2024-09-13T06:09:54.432 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.423+0000 7ff1fffff640 1 -- 172.21.15.194:0/1599645780 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3200f2040 con 0x56453dbe3780 2024-09-13T06:09:54.432 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.423+0000 7ff330c57980 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56453dbeb230 con 0x56453dbe3780 2024-09-13T06:09:54.432 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.423+0000 7ff1fffff640 1 -- 172.21.15.194:0/1599645780 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff320113070 con 0x56453dbe3780 2024-09-13T06:09:54.432 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.423+0000 7ff1fffff640 1 --2- 172.21.15.194:0/1599645780 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff1f8034650 0x7ff1f8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.432 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.423+0000 7ff1fffff640 1 -- 172.21.15.194:0/1599645780 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7ff32010ccd0 con 0x56453dbe3780 2024-09-13T06:09:54.432 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.423+0000 7ff330c57980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.433 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.423+0000 7ff32df66640 1 --2- 172.21.15.194:0/1599645780 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff1f8034650 0x7ff1f8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.433 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.423+0000 7ff330c57980 1 --2- 172.21.15.194:0/1599645780 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x56453dbf58a0 0x56453dbf7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.433 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.423+0000 7ff330c57980 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56453dbf84b0 con 0x56453dbf58a0 2024-09-13T06:09:54.433 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.427+0000 7ff32ef68640 1 --2- 172.21.15.194:0/1599645780 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x56453dbf58a0 0x56453dbf7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.433 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.427+0000 7ff32ef68640 1 --2- 172.21.15.194:0/1599645780 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x56453dbf58a0 0x56453dbf7d60 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.433 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.427+0000 7ff32df66640 1 --2- 172.21.15.194:0/1599645780 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff1f8034650 0x7ff1f8036b10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff32400c010 tx=0x7ff324010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.433 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.427+0000 7ff32ef68640 1 -- 172.21.15.194:0/1599645780 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff32800a4d0 con 0x56453dbf58a0 2024-09-13T06:09:54.433 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.427+0000 7ff330c57980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:54.433 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.427+0000 7ff330c57980 20 realm 2024-09-13T06:09:54.433 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.427+0000 7ff330c57980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.433 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.427+0000 7ff330c57980 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56453dbf88c0 con 0x56453dbf58a0 2024-09-13T06:09:54.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.427+0000 7ff32ef68640 1 -- 172.21.15.194:0/1599645780 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff32800a4d0 con 0x56453dbf58a0 2024-09-13T06:09:54.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.427+0000 7ff330c57980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:54.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.427+0000 7ff330c57980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:09:54.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.427+0000 7ff330c57980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.427+0000 7ff330c57980 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56453dbf9160 con 0x56453dbf58a0 2024-09-13T06:09:54.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.427+0000 7ff32ef68640 1 -- 172.21.15.194:0/1599645780 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff32800a4d0 con 0x56453dbf58a0 2024-09-13T06:09:54.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.427+0000 7ff330c57980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:54.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.427+0000 7ff330c57980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.427+0000 7ff330c57980 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56453dbf9500 con 0x56453dbf58a0 2024-09-13T06:09:54.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.427+0000 7ff32ef68640 1 -- 172.21.15.194:0/1599645780 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff32800a4d0 con 0x56453dbf58a0 2024-09-13T06:09:54.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.427+0000 7ff330c57980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:54.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.427+0000 7ff330c57980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.427+0000 7ff330c57980 1 --2- 172.21.15.194:0/1599645780 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x56453dbfa260 0x56453dbfc650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.427+0000 7ff330c57980 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56453dbfcca0 con 0x56453dbfa260 2024-09-13T06:09:54.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.427+0000 7ff32e767640 1 --2- 172.21.15.194:0/1599645780 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x56453dbfa260 0x56453dbfc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.427+0000 7ff32e767640 1 --2- 172.21.15.194:0/1599645780 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x56453dbfa260 0x56453dbfc650 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.427+0000 7ff32e767640 1 -- 172.21.15.194:0/1599645780 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff320112030 con 0x56453dbfa260 2024-09-13T06:09:54.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.427+0000 7ff330c57980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:09:54.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.427+0000 7ff330c57980 20 searching for the correct realm 2024-09-13T06:09:54.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.427+0000 7ff330c57980 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56453dbfe500 con 0x56453dbfa260 2024-09-13T06:09:54.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.427+0000 7ff32e767640 1 -- 172.21.15.194:0/1599645780 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff320112030 con 0x56453dbfa260 2024-09-13T06:09:54.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.427+0000 7ff32e767640 1 --2- 172.21.15.194:0/1599645780 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7ff320115060 0x7ff3200c95b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.427+0000 7ff32e767640 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56453dbfe500 con 0x7ff320115060 2024-09-13T06:09:54.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.427+0000 7ff32df66640 1 --2- 172.21.15.194:0/1599645780 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7ff320115060 0x7ff3200c95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.427+0000 7ff32df66640 1 --2- 172.21.15.194:0/1599645780 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7ff320115060 0x7ff3200c95b0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.427+0000 7ff32df66640 1 -- 172.21.15.194:0/1599645780 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff324037040 con 0x7ff320115060 2024-09-13T06:09:54.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.427+0000 7ff32df66640 1 --2- 172.21.15.194:0/1599645780 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7ff32401fbe0 0x7ff32403a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.427+0000 7ff32df66640 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56453dbfe500 con 0x7ff32401fbe0 2024-09-13T06:09:54.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.427+0000 7ff32ef68640 1 --2- 172.21.15.194:0/1599645780 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7ff32401fbe0 0x7ff32403a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.431+0000 7ff32ef68640 1 --2- 172.21.15.194:0/1599645780 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7ff32401fbe0 0x7ff32403a3c0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.431+0000 7ff32ef68640 1 -- 172.21.15.194:0/1599645780 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff32800a4d0 con 0x7ff32401fbe0 2024-09-13T06:09:54.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.431+0000 7ff32ef68640 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56453dbf9500 con 0x56453dbf58a0 2024-09-13T06:09:54.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.431+0000 7ff32ef68640 1 -- 172.21.15.194:0/1599645780 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff32800a4d0 con 0x56453dbf58a0 2024-09-13T06:09:54.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.431+0000 7ff32ef68640 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56453dbf9500 con 0x56453dbf58a0 2024-09-13T06:09:54.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.431+0000 7ff32ef68640 1 -- 172.21.15.194:0/1599645780 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff32800a4d0 con 0x56453dbf58a0 2024-09-13T06:09:54.437 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.431+0000 7ff32ef68640 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56453dbf9500 con 0x7ff32401fbe0 2024-09-13T06:09:54.437 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.431+0000 7ff32ef68640 1 -- 172.21.15.194:0/1599645780 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff32800a4d0 con 0x7ff32401fbe0 2024-09-13T06:09:54.437 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.431+0000 7ff32ef68640 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56453dbf9500 con 0x7ff32401fbe0 2024-09-13T06:09:54.444 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.431+0000 7ff32ef68640 1 -- 172.21.15.194:0/1599645780 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff32800a4d0 con 0x7ff32401fbe0 2024-09-13T06:09:54.444 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.431+0000 7ff32ef68640 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56453dbf9500 con 0x7ff320115060 2024-09-13T06:09:54.444 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.431+0000 7ff32df66640 1 -- 172.21.15.194:0/1599645780 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff324037040 con 0x7ff320115060 2024-09-13T06:09:54.445 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.431+0000 7ff32df66640 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56453dbf9500 con 0x56453dbfa260 2024-09-13T06:09:54.445 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.431+0000 7ff32e767640 1 -- 172.21.15.194:0/1599645780 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff320112030 con 0x56453dbfa260 2024-09-13T06:09:54.445 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.431+0000 7ff32e767640 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56453dbf9500 con 0x56453dbf58a0 2024-09-13T06:09:54.445 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.431+0000 7ff32ef68640 1 -- 172.21.15.194:0/1599645780 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff32800a4d0 con 0x56453dbf58a0 2024-09-13T06:09:54.445 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.431+0000 7ff32ef68640 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56453dbf9500 con 0x7ff32401fbe0 2024-09-13T06:09:54.445 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.431+0000 7ff32ef68640 1 -- 172.21.15.194:0/1599645780 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff32800a4d0 con 0x7ff32401fbe0 2024-09-13T06:09:54.445 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.431+0000 7ff32ef68640 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56453dbf9500 con 0x56453dbf58a0 2024-09-13T06:09:54.445 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.431+0000 7ff32ef68640 1 -- 172.21.15.194:0/1599645780 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff32800a4d0 con 0x56453dbf58a0 2024-09-13T06:09:54.445 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.431+0000 7ff32ef68640 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56453dbf9500 con 0x7ff320115060 2024-09-13T06:09:54.445 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.435+0000 7ff32df66640 1 -- 172.21.15.194:0/1599645780 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff324037040 con 0x7ff320115060 2024-09-13T06:09:54.445 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.435+0000 7ff32df66640 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56453dbf9500 con 0x56453dbfa260 2024-09-13T06:09:54.445 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.435+0000 7ff32e767640 1 -- 172.21.15.194:0/1599645780 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff320112030 con 0x56453dbfa260 2024-09-13T06:09:54.446 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.435+0000 7ff32e767640 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56453dbf9500 con 0x56453dbfa260 2024-09-13T06:09:54.446 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.435+0000 7ff32e767640 1 -- 172.21.15.194:0/1599645780 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff320112030 con 0x56453dbfa260 2024-09-13T06:09:54.446 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.435+0000 7ff32e767640 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56453dbf9500 con 0x7ff32401fbe0 2024-09-13T06:09:54.446 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.435+0000 7ff32ef68640 1 -- 172.21.15.194:0/1599645780 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff32800a4d0 con 0x7ff32401fbe0 2024-09-13T06:09:54.446 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.435+0000 7ff32ef68640 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56453dbf9500 con 0x56453dbfa260 2024-09-13T06:09:54.446 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.435+0000 7ff32e767640 1 -- 172.21.15.194:0/1599645780 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff320112030 con 0x56453dbfa260 2024-09-13T06:09:54.446 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.435+0000 7ff32e767640 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56453dbf9500 con 0x56453dbfa260 2024-09-13T06:09:54.446 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.435+0000 7ff32e767640 1 -- 172.21.15.194:0/1599645780 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff320112030 con 0x56453dbfa260 2024-09-13T06:09:54.446 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.435+0000 7ff32e767640 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56453dbf9500 con 0x56453dbf58a0 2024-09-13T06:09:54.446 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.435+0000 7ff32ef68640 1 -- 172.21.15.194:0/1599645780 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff32800a4d0 con 0x56453dbf58a0 2024-09-13T06:09:54.446 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.435+0000 7ff32ef68640 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56453dbf9500 con 0x56453dbf58a0 2024-09-13T06:09:54.446 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.435+0000 7ff32ef68640 1 -- 172.21.15.194:0/1599645780 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff32800a4d0 con 0x56453dbf58a0 2024-09-13T06:09:54.446 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.435+0000 7ff32ef68640 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56453dbf9500 con 0x7ff32401fbe0 2024-09-13T06:09:54.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.435+0000 7ff32ef68640 1 -- 172.21.15.194:0/1599645780 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff32800a4d0 con 0x7ff32401fbe0 2024-09-13T06:09:54.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.435+0000 7ff32ef68640 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56453dbf9500 con 0x56453dbfa260 2024-09-13T06:09:54.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.435+0000 7ff32e767640 1 -- 172.21.15.194:0/1599645780 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff320112030 con 0x56453dbfa260 2024-09-13T06:09:54.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.435+0000 7ff32e767640 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56453dbf9500 con 0x7ff320115060 2024-09-13T06:09:54.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.435+0000 7ff32df66640 1 -- 172.21.15.194:0/1599645780 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff324037040 con 0x7ff320115060 2024-09-13T06:09:54.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.435+0000 7ff32df66640 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56453dbf9500 con 0x56453dbf58a0 2024-09-13T06:09:54.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.435+0000 7ff32ef68640 1 -- 172.21.15.194:0/1599645780 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff32800a4d0 con 0x56453dbf58a0 2024-09-13T06:09:54.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.435+0000 7ff32ef68640 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56453dbf9500 con 0x7ff32401fbe0 2024-09-13T06:09:54.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.439+0000 7ff32ef68640 1 -- 172.21.15.194:0/1599645780 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff32800a4d0 con 0x7ff32401fbe0 2024-09-13T06:09:54.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.439+0000 7ff32ef68640 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56453dbf9500 con 0x56453dbfa260 2024-09-13T06:09:54.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.439+0000 7ff32e767640 1 -- 172.21.15.194:0/1599645780 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff320112030 con 0x56453dbfa260 2024-09-13T06:09:54.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.439+0000 7ff32e767640 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56453dbf9500 con 0x7ff32401fbe0 2024-09-13T06:09:54.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.439+0000 7ff32ef68640 1 -- 172.21.15.194:0/1599645780 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff32800a4d0 con 0x7ff32401fbe0 2024-09-13T06:09:54.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.439+0000 7ff32ef68640 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56453dbf9500 con 0x7ff320115060 2024-09-13T06:09:54.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.439+0000 7ff32df66640 1 -- 172.21.15.194:0/1599645780 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff324037040 con 0x7ff320115060 2024-09-13T06:09:54.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.439+0000 7ff32df66640 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56453dbf9500 con 0x56453dbfa260 2024-09-13T06:09:54.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.439+0000 7ff32e767640 1 -- 172.21.15.194:0/1599645780 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff320112030 con 0x56453dbfa260 2024-09-13T06:09:54.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.439+0000 7ff32e767640 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56453dbf9500 con 0x7ff32401fbe0 2024-09-13T06:09:54.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.439+0000 7ff32ef68640 1 -- 172.21.15.194:0/1599645780 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff32800a4d0 con 0x7ff32401fbe0 2024-09-13T06:09:54.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.439+0000 7ff32ef68640 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56453dbf9500 con 0x56453dbf58a0 2024-09-13T06:09:54.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.439+0000 7ff32ef68640 1 -- 172.21.15.194:0/1599645780 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff32800a4d0 con 0x56453dbf58a0 2024-09-13T06:09:54.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.439+0000 7ff32ef68640 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56453dbf9500 con 0x7ff320115060 2024-09-13T06:09:54.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.439+0000 7ff32df66640 1 -- 172.21.15.194:0/1599645780 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff324037040 con 0x7ff320115060 2024-09-13T06:09:54.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.439+0000 7ff330c57980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:09:54.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.439+0000 7ff330c57980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:09:54.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.439+0000 7ff330c57980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:09:54.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.439+0000 7ff330c57980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:09:54.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.439+0000 7ff330c57980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:09:54.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.439+0000 7ff330c57980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:09:54.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.439+0000 7ff330c57980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.439+0000 7ff330c57980 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56453dbfd620 con 0x56453dbf58a0 2024-09-13T06:09:54.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.439+0000 7ff32ef68640 1 -- 172.21.15.194:0/1599645780 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff32800a4d0 con 0x56453dbf58a0 2024-09-13T06:09:54.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.439+0000 7ff330c57980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:54.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.439+0000 7ff330c57980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.439+0000 7ff330c57980 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56453dbfde70 con 0x56453dbf58a0 2024-09-13T06:09:54.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.439+0000 7ff32ef68640 1 -- 172.21.15.194:0/1599645780 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff32800a4d0 con 0x56453dbf58a0 2024-09-13T06:09:54.450 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.439+0000 7ff330c57980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:54.450 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.439+0000 7ff330c57980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.450 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.439+0000 7ff330c57980 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56453dbfd280 con 0x7ff320115060 2024-09-13T06:09:54.450 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.443+0000 7ff32df66640 1 -- 172.21.15.194:0/1599645780 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff324037040 con 0x7ff320115060 2024-09-13T06:09:54.450 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.443+0000 7ff330c57980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:09:54.450 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.443+0000 7ff330c57980 20 zone default found 2024-09-13T06:09:54.450 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.443+0000 7ff330c57980 4 Realm: () 2024-09-13T06:09:54.450 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.443+0000 7ff330c57980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:09:54.450 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.443+0000 7ff330c57980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:09:54.450 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.443+0000 7ff330c57980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:09:54.451 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.443+0000 7ff330c57980 20 zonegroup default 2024-09-13T06:09:54.451 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.443+0000 7ff330c57980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.451 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.443+0000 7ff330c57980 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56453dbfe930 con 0x7ff32401fbe0 2024-09-13T06:09:54.451 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.443+0000 7ff32ef68640 1 -- 172.21.15.194:0/1599645780 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff32800a4d0 con 0x7ff32401fbe0 2024-09-13T06:09:54.451 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.443+0000 7ff330c57980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:54.451 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.443+0000 7ff330c57980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.451 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.443+0000 7ff330c57980 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56453dbfdb30 con 0x56453dbfa260 2024-09-13T06:09:54.451 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.443+0000 7ff32e767640 1 -- 172.21.15.194:0/1599645780 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff320112030 con 0x56453dbfa260 2024-09-13T06:09:54.451 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.443+0000 7ff330c57980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:54.451 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.443+0000 7ff330c57980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.451 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.443+0000 7ff330c57980 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56453dc008c0 con 0x56453dbfa260 2024-09-13T06:09:54.451 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.443+0000 7ff32e767640 1 -- 172.21.15.194:0/1599645780 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff320112030 con 0x56453dbfa260 2024-09-13T06:09:54.451 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.443+0000 7ff330c57980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:54.452 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.443+0000 7ff330c57980 20 started sync module instance, tier type = 2024-09-13T06:09:54.452 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.443+0000 7ff330c57980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:09:54.452 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.443+0000 7ff330c57980 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56453dbffc50 con 0x7ff320115060 2024-09-13T06:09:54.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.443+0000 7ff32df66640 1 -- 172.21.15.194:0/1599645780 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(44 notify.0 [create] v33'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff324037040 con 0x7ff320115060 2024-09-13T06:09:54.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.443+0000 7ff330c57980 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94855388725312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56453dc011d0 con 0x7ff320115060 2024-09-13T06:09:54.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.443+0000 7ff330c57980 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56453dc01a20 con 0x56453dbf58a0 2024-09-13T06:09:54.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.443+0000 7ff32df66640 1 -- 172.21.15.194:0/1599645780 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94855388725312] v33'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff324037040 con 0x7ff320115060 2024-09-13T06:09:54.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.447+0000 7ff32ef68640 1 -- 172.21.15.194:0/1599645780 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v33'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff32800a4d0 con 0x56453dbf58a0 2024-09-13T06:09:54.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.447+0000 7ff330c57980 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94855388728608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56453dc01a20 con 0x56453dbf58a0 2024-09-13T06:09:54.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.447+0000 7ff330c57980 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56453dc024a0 con 0x56453dbfa260 2024-09-13T06:09:54.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.447+0000 7ff32ef68640 1 -- 172.21.15.194:0/1599645780 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94855388728608] v33'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff32800a4d0 con 0x56453dbf58a0 2024-09-13T06:09:54.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.447+0000 7ff32e767640 1 -- 172.21.15.194:0/1599645780 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v33'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff320112030 con 0x56453dbfa260 2024-09-13T06:09:54.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.447+0000 7ff330c57980 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94855388730736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56453dc01990 con 0x56453dbfa260 2024-09-13T06:09:54.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.447+0000 7ff330c57980 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56453dc031f0 con 0x7ff320115060 2024-09-13T06:09:54.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.451+0000 7ff32df66640 1 -- 172.21.15.194:0/1599645780 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(50 notify.3 [create] v33'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff324037040 con 0x7ff320115060 2024-09-13T06:09:54.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.451+0000 7ff330c57980 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94855388736832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56453dc03a90 con 0x7ff320115060 2024-09-13T06:09:54.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.451+0000 7ff330c57980 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56453dc044b0 con 0x56453dbf58a0 2024-09-13T06:09:54.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.451+0000 7ff32e767640 1 -- 172.21.15.194:0/1599645780 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94855388730736] v33'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff320112030 con 0x56453dbfa260 2024-09-13T06:09:54.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.451+0000 7ff32df66640 1 -- 172.21.15.194:0/1599645780 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94855388736832] v33'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff324037040 con 0x7ff320115060 2024-09-13T06:09:54.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.451+0000 7ff32ef68640 1 -- 172.21.15.194:0/1599645780 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v33'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff32800a4d0 con 0x56453dbf58a0 2024-09-13T06:09:54.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.451+0000 7ff330c57980 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94855388739040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56453dc02890 con 0x56453dbf58a0 2024-09-13T06:09:54.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.451+0000 7ff330c57980 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56453dc04d50 con 0x7ff32401fbe0 2024-09-13T06:09:54.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.451+0000 7ff32ef68640 1 -- 172.21.15.194:0/1599645780 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94855388739040] v33'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff32800a4d0 con 0x56453dbf58a0 2024-09-13T06:09:54.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.455+0000 7ff32ef68640 1 -- 172.21.15.194:0/1599645780 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(54 notify.5 [create] v33'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff32800a4d0 con 0x7ff32401fbe0 2024-09-13T06:09:54.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.455+0000 7ff330c57980 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94855388741536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56453dc04cb0 con 0x7ff32401fbe0 2024-09-13T06:09:54.460 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.455+0000 7ff330c57980 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56453dc05670 con 0x7ff32401fbe0 2024-09-13T06:09:54.460 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.455+0000 7ff32ef68640 1 -- 172.21.15.194:0/1599645780 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94855388741536] v33'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff32800a4d0 con 0x7ff32401fbe0 2024-09-13T06:09:54.460 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.455+0000 7ff32ef68640 1 -- 172.21.15.194:0/1599645780 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(56 notify.6 [create] v33'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff32800a4d0 con 0x7ff32401fbe0 2024-09-13T06:09:54.460 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.455+0000 7ff330c57980 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94855388743952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56453dc05670 con 0x7ff32401fbe0 2024-09-13T06:09:54.460 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.455+0000 7ff330c57980 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56453dc06030 con 0x7ff32401fbe0 2024-09-13T06:09:54.461 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.459+0000 7ff32ef68640 1 -- 172.21.15.194:0/1599645780 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94855388743952] v33'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff32800a4d0 con 0x7ff32401fbe0 2024-09-13T06:09:54.461 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.459+0000 7ff32ef68640 1 -- 172.21.15.194:0/1599645780 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(58 notify.7 [create] v33'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff32800a4d0 con 0x7ff32401fbe0 2024-09-13T06:09:54.461 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.459+0000 7ff330c57980 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94855388746448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56453dc06030 con 0x7ff32401fbe0 2024-09-13T06:09:54.461 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.459+0000 7ff330c57980 20 add_watcher() i=0 2024-09-13T06:09:54.462 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.459+0000 7ff330c57980 20 add_watcher() i=1 2024-09-13T06:09:54.462 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.459+0000 7ff330c57980 20 add_watcher() i=2 2024-09-13T06:09:54.462 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.459+0000 7ff330c57980 20 add_watcher() i=3 2024-09-13T06:09:54.462 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.459+0000 7ff330c57980 20 add_watcher() i=4 2024-09-13T06:09:54.462 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.459+0000 7ff330c57980 20 add_watcher() i=5 2024-09-13T06:09:54.462 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.459+0000 7ff330c57980 20 add_watcher() i=6 2024-09-13T06:09:54.462 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.459+0000 7ff32ef68640 1 -- 172.21.15.194:0/1599645780 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94855388746448] v33'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff32800a4d0 con 0x7ff32401fbe0 2024-09-13T06:09:54.462 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.459+0000 7ff330c57980 20 add_watcher() i=7 2024-09-13T06:09:54.462 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.459+0000 7ff330c57980 2 all 8 watchers are set, enabling cache 2024-09-13T06:09:54.462 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.459+0000 7ff330c57980 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56453dc09330 con 0x56453dbf58a0 2024-09-13T06:09:54.462 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.459+0000 7ff32ef68640 1 -- 172.21.15.194:0/1599645780 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff32800a4d0 con 0x56453dbf58a0 2024-09-13T06:09:54.462 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.459+0000 7ff330c57980 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94855388749040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56453dc065c0 con 0x56453dbf58a0 2024-09-13T06:09:54.466 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.459+0000 7ff32ef68640 1 -- 172.21.15.194:0/1599645780 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94855388749040] v33'64 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff32800a4d0 con 0x56453dbf58a0 2024-09-13T06:09:54.466 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.463+0000 7ff1e4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:54.466 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.463+0000 7ff330c57980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:09:54.466 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.463+0000 7ff330c57980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:09:54.466 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.463+0000 7ff330c57980 5 note: GC not initialized 2024-09-13T06:09:54.466 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.463+0000 7ff15f7fe640 20 reqs_thread_entry: start 2024-09-13T06:09:54.466 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.463+0000 7ff330c57980 20 init_complete bucket index max shards: 11 2024-09-13T06:09:54.466 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.463+0000 7ff330c57980 20 Filter name: none 2024-09-13T06:09:54.466 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.463+0000 7ff15d7fa640 20 reqs_thread_entry: start 2024-09-13T06:09:54.467 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.463+0000 7ff330c57980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T06:09:54.467 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.463+0000 7ff330c57980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.467 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.463+0000 7ff330c57980 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56453dc2cac0 con 0x56453dbf58a0 2024-09-13T06:09:54.467 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.463+0000 7ff32ef68640 1 -- 172.21.15.194:0/1599645780 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7ff32800a4d0 con 0x56453dbf58a0 2024-09-13T06:09:54.467 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.463+0000 7ff330c57980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T06:09:54.467 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.463+0000 7ff330c57980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T06:09:54.467 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.463+0000 7ff330c57980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:09:54.467 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.463+0000 7ff330c57980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:09:54.467 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.463+0000 7ff330c57980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-13T06:09:54.467 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.463+0000 7ff330c57980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.467 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.463+0000 7ff330c57980 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56453dc2d530 con 0x7ff32401fbe0 2024-09-13T06:09:54.467 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.463+0000 7ff32ef68640 1 -- 172.21.15.194:0/1599645780 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7ff32800a4d0 con 0x7ff32401fbe0 2024-09-13T06:09:54.468 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.463+0000 7ff330c57980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:54.468 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.463+0000 7ff330c57980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-13T06:09:54.468 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.463+0000 7ff330c57980 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T06:09:54.468 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.463+0000 7ff330c57980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-13T06:09:54.468 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.463+0000 7ff330c57980 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~502 in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56453dc32ed0 con 0x56453dbf58a0 2024-09-13T06:09:54.468 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.463+0000 7ff32ef68640 1 -- 172.21.15.194:0/1599645780 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~502] v33'4 uv4 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7ff32800a4d0 con 0x56453dbf58a0 2024-09-13T06:09:54.468 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.463+0000 7ff330c57980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T06:09:54.468 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.463+0000 7ff330c57980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:09:54.468 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.463+0000 7ff330c57980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T06:09:54.468 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.463+0000 7ff330c57980 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94855388932416 in=690b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56453dc2e600 con 0x56453dbf58a0 2024-09-13T06:09:54.468 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.463+0000 7ff32ef68640 1 -- 172.21.15.194:0/1599645780 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== watch-notify(notify (1) cookie 94855388739040 notify 141733920771 ret 0) ==== 720+0+0 (crc 0 0 0) 0x7ff32802d040 con 0x56453dbf58a0 2024-09-13T06:09:54.468 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.463+0000 7ff211ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920771 cookie 94855388739040 notifier 4339 bl.length()=678 2024-09-13T06:09:54.469 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.463+0000 7ff211ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T06:09:54.469 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.463+0000 7ff211ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:09:54.469 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.463+0000 7ff32ef68640 1 -- 172.21.15.194:0/1599645780 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(65 notify.4 [notify cookie 94855388932416 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff32800a4d0 con 0x56453dbf58a0 2024-09-13T06:09:54.469 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.463+0000 7ff211ffb640 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7ff1f4003eb0 con 0x56453dbf58a0 2024-09-13T06:09:54.469 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.463+0000 7ff32ef68640 1 -- 172.21.15.194:0/1599645780 <== osd.1 v2:172.21.15.194:6808/3135444559 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff32800a4d0 con 0x56453dbf58a0 2024-09-13T06:09:54.469 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.463+0000 7ff32ef68640 1 -- 172.21.15.194:0/1599645780 <== osd.1 v2:172.21.15.194:6808/3135444559 26 ==== watch-notify(notify_complete (2) cookie 94855388932416 notify 141733920771 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7ff32801e040 con 0x56453dbf58a0 2024-09-13T06:09:54.469 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.463+0000 7ff330c57980 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56453dc32940 con 0x7ff32401fbe0 2024-09-13T06:09:54.470 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.467+0000 7ff32ef68640 1 -- 172.21.15.194:0/1599645780 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v33'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7ff32800a4d0 con 0x7ff32401fbe0 2024-09-13T06:09:54.470 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.467+0000 7ff330c57980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-13T06:09:54.470 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.467+0000 7ff330c57980 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T06:09:54.470 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.467+0000 7ff330c57980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-13T06:09:54.471 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.467+0000 7ff330c57980 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94855388916272 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56453dc32940 con 0x56453dbfa260 2024-09-13T06:09:54.471 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.467+0000 7ff32e767640 1 -- 172.21.15.194:0/1599645780 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== watch-notify(notify (1) cookie 94855388730736 notify 141733920768 ret 0) ==== 219+0+0 (crc 0 0 0) 0x56453dbd79c0 con 0x56453dbfa260 2024-09-13T06:09:54.471 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.467+0000 7ff2117fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920768 cookie 94855388730736 notifier 4339 bl.length()=177 2024-09-13T06:09:54.471 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.467+0000 7ff32e767640 1 -- 172.21.15.194:0/1599645780 <== osd.3 v2:172.21.15.194:6816/96632515 16 ==== osd_op_reply(68 notify.2 [notify cookie 94855388916272 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff320112030 con 0x56453dbfa260 2024-09-13T06:09:54.471 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.467+0000 7ff2117fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-13T06:09:54.471 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.467+0000 7ff2117fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T06:09:54.471 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.467+0000 7ff2117fa640 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7ff164003410 con 0x56453dbfa260 2024-09-13T06:09:54.471 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.467+0000 7ff32e767640 1 -- 172.21.15.194:0/1599645780 <== osd.3 v2:172.21.15.194:6816/96632515 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff320112030 con 0x56453dbfa260 2024-09-13T06:09:54.471 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.467+0000 7ff32e767640 1 -- 172.21.15.194:0/1599645780 <== osd.3 v2:172.21.15.194:6816/96632515 18 ==== watch-notify(notify_complete (2) cookie 94855388916272 notify 141733920768 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56453dbd7730 con 0x56453dbfa260 2024-09-13T06:09:54.472 INFO:teuthology.orchestra.run.smithi194.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T06:09:53.191222Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-13T06:09:54.466646Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:09:53.191207Z","tags":[],"group_ids":[]} 2024-09-13T06:09:54.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.467+0000 7ff1e4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:54.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.467+0000 7ff330c57980 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94855388749040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56453dc32940 con 0x56453dbf58a0 2024-09-13T06:09:54.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.471+0000 7ff32ef68640 1 -- 172.21.15.194:0/1599645780 <== osd.1 v2:172.21.15.194:6808/3135444559 27 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94855388749040] v33'65 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff32800a4d0 con 0x56453dbf58a0 2024-09-13T06:09:54.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.471+0000 7ff330c57980 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94855388725312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56453dc32940 con 0x7ff320115060 2024-09-13T06:09:54.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.471+0000 7ff32df66640 1 -- 172.21.15.194:0/1599645780 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94855388725312] v33'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff324037040 con 0x7ff320115060 2024-09-13T06:09:54.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.471+0000 7ff330c57980 20 remove_watcher() i=0 2024-09-13T06:09:54.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.471+0000 7ff330c57980 2 removed watcher, disabling cache 2024-09-13T06:09:54.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.471+0000 7ff330c57980 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94855388728608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56453dc32940 con 0x56453dbf58a0 2024-09-13T06:09:54.474 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.471+0000 7ff32ef68640 1 -- 172.21.15.194:0/1599645780 <== osd.1 v2:172.21.15.194:6808/3135444559 28 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94855388728608] v33'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff32800a4d0 con 0x56453dbf58a0 2024-09-13T06:09:54.474 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.471+0000 7ff330c57980 20 remove_watcher() i=1 2024-09-13T06:09:54.474 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.471+0000 7ff330c57980 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94855388730736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56453dc32940 con 0x56453dbfa260 2024-09-13T06:09:54.476 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.475+0000 7ff32e767640 1 -- 172.21.15.194:0/1599645780 <== osd.3 v2:172.21.15.194:6816/96632515 19 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94855388730736] v33'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff320112030 con 0x56453dbfa260 2024-09-13T06:09:54.476 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.475+0000 7ff330c57980 20 remove_watcher() i=2 2024-09-13T06:09:54.476 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.475+0000 7ff330c57980 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94855388736832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56453dc32940 con 0x7ff320115060 2024-09-13T06:09:54.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.475+0000 7ff32df66640 1 -- 172.21.15.194:0/1599645780 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94855388736832] v33'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff324037040 con 0x7ff320115060 2024-09-13T06:09:54.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.475+0000 7ff330c57980 20 remove_watcher() i=3 2024-09-13T06:09:54.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.475+0000 7ff330c57980 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94855388739040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56453dc32940 con 0x56453dbf58a0 2024-09-13T06:09:54.479 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.479+0000 7ff32ef68640 1 -- 172.21.15.194:0/1599645780 <== osd.1 v2:172.21.15.194:6808/3135444559 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94855388739040] v33'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff32800a4d0 con 0x56453dbf58a0 2024-09-13T06:09:54.479 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.479+0000 7ff330c57980 20 remove_watcher() i=4 2024-09-13T06:09:54.479 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.479+0000 7ff330c57980 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94855388741536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56453dc32940 con 0x7ff32401fbe0 2024-09-13T06:09:54.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.479+0000 7ff32ef68640 1 -- 172.21.15.194:0/1599645780 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94855388741536] v33'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff32800a4d0 con 0x7ff32401fbe0 2024-09-13T06:09:54.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.479+0000 7ff330c57980 20 remove_watcher() i=5 2024-09-13T06:09:54.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.479+0000 7ff330c57980 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94855388743952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56453dc32940 con 0x7ff32401fbe0 2024-09-13T06:09:54.483 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.483+0000 7ff32ef68640 1 -- 172.21.15.194:0/1599645780 <== osd.0 v2:172.21.15.120:6800/1923744619 20 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94855388743952] v33'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff32800a4d0 con 0x7ff32401fbe0 2024-09-13T06:09:54.483 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.483+0000 7ff330c57980 20 remove_watcher() i=6 2024-09-13T06:09:54.483 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.483+0000 7ff330c57980 1 -- 172.21.15.194:0/1599645780 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94855388746448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56453dc32940 con 0x7ff32401fbe0 2024-09-13T06:09:54.487 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.483+0000 7ff32ef68640 1 -- 172.21.15.194:0/1599645780 <== osd.0 v2:172.21.15.120:6800/1923744619 21 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94855388746448] v33'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff32800a4d0 con 0x7ff32401fbe0 2024-09-13T06:09:54.487 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.483+0000 7ff330c57980 20 remove_watcher() i=7 2024-09-13T06:09:54.487 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.483+0000 7ff330c57980 1 -- 172.21.15.194:0/1599645780 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7ff32401fbe0 msgr2=0x7ff32403a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.483+0000 7ff330c57980 1 --2- 172.21.15.194:0/1599645780 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7ff32401fbe0 0x7ff32403a3c0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.483+0000 7ff330c57980 1 -- 172.21.15.194:0/1599645780 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x56453dbf58a0 msgr2=0x56453dbf7d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.483+0000 7ff330c57980 1 --2- 172.21.15.194:0/1599645780 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x56453dbf58a0 0x56453dbf7d60 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.483+0000 7ff330c57980 1 -- 172.21.15.194:0/1599645780 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7ff320115060 msgr2=0x7ff3200c95b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.483+0000 7ff330c57980 1 --2- 172.21.15.194:0/1599645780 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7ff320115060 0x7ff3200c95b0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.483+0000 7ff330c57980 1 -- 172.21.15.194:0/1599645780 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x56453dbfa260 msgr2=0x56453dbfc650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.483+0000 7ff330c57980 1 --2- 172.21.15.194:0/1599645780 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x56453dbfa260 0x56453dbfc650 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.483+0000 7ff330c57980 1 -- 172.21.15.194:0/1599645780 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff1f8034650 msgr2=0x7ff1f8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.483+0000 7ff330c57980 1 --2- 172.21.15.194:0/1599645780 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff1f8034650 0x7ff1f8036b10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff32400c010 tx=0x7ff324010000 comp rx=0 tx=0).stop 2024-09-13T06:09:54.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.483+0000 7ff330c57980 1 -- 172.21.15.194:0/1599645780 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56453dbe3780 msgr2=0x56453dbea880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.483+0000 7ff330c57980 1 --2- 172.21.15.194:0/1599645780 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56453dbe3780 0x56453dbea880 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff3200b3be0 tx=0x7ff3200a9fa0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.483+0000 7ff32ef68640 1 -- 172.21.15.194:0/1599645780 reap_dead start 2024-09-13T06:09:54.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.483+0000 7ff330c57980 1 -- 172.21.15.194:0/1599645780 shutdown_connections 2024-09-13T06:09:54.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.483+0000 7ff330c57980 1 --2- 172.21.15.194:0/1599645780 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56453dbe3780 0x56453dbea880 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.483+0000 7ff330c57980 1 -- 172.21.15.194:0/1599645780 >> 172.21.15.194:0/1599645780 conn(0x56453dbdfb00 msgr2=0x56453dbddbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:54.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.483+0000 7ff330c57980 1 -- 172.21.15.194:0/1599645780 shutdown_connections 2024-09-13T06:09:54.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.483+0000 7ff330c57980 1 -- 172.21.15.194:0/1599645780 wait complete. 2024-09-13T06:09:54.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.483+0000 7ff330c57980 1 -- 172.21.15.194:0/634553342 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff208034650 msgr2=0x7ff208036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.483+0000 7ff330c57980 1 --2- 172.21.15.194:0/634553342 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff208034650 0x7ff208036b10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x56453dbc9740 tx=0x7ff32400f000 comp rx=0 tx=0).stop 2024-09-13T06:09:54.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.483+0000 7ff330c57980 1 -- 172.21.15.194:0/634553342 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56453dbd6dd0 msgr2=0x56453dbd71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.483+0000 7ff330c57980 1 --2- 172.21.15.194:0/634553342 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56453dbd6dd0 0x56453dbd71f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff3200cf900 tx=0x7ff3200e3ce0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.483+0000 7ff330c57980 1 -- 172.21.15.194:0/634553342 shutdown_connections 2024-09-13T06:09:54.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.483+0000 7ff330c57980 1 --2- 172.21.15.194:0/634553342 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff208034650 0x7ff208036b10 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.483+0000 7ff330c57980 1 --2- 172.21.15.194:0/634553342 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56453dbd6dd0 0x56453dbd71f0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.483+0000 7ff330c57980 1 -- 172.21.15.194:0/634553342 >> 172.21.15.194:0/634553342 conn(0x56453dbcbf20 msgr2=0x56453dbce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:54.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.483+0000 7ff330c57980 1 -- 172.21.15.194:0/634553342 shutdown_connections 2024-09-13T06:09:54.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.483+0000 7ff330c57980 1 -- 172.21.15.194:0/634553342 wait complete. 2024-09-13T06:09:54.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.483+0000 7ff330c57980 1 -- 172.21.15.194:0/1193155963 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x56453dac4f40 msgr2=0x56453dbbff50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.483+0000 7ff330c57980 1 --2- 172.21.15.194:0/1193155963 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x56453dac4f40 0x56453dbbff50 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.483+0000 7ff330c57980 1 -- 172.21.15.194:0/1193155963 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x56453dbc67c0 msgr2=0x56453dbc8bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.483+0000 7ff330c57980 1 --2- 172.21.15.194:0/1193155963 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x56453dbc67c0 0x56453dbc8bb0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.483+0000 7ff330c57980 1 -- 172.21.15.194:0/1193155963 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x56453dbc28c0 msgr2=0x56453dbc4cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.483+0000 7ff330c57980 1 --2- 172.21.15.194:0/1193155963 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x56453dbc28c0 0x56453dbc4cb0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.487+0000 7ff330c57980 1 -- 172.21.15.194:0/1193155963 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff214034650 msgr2=0x7ff214036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.487+0000 7ff330c57980 1 --2- 172.21.15.194:0/1193155963 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff214034650 0x7ff214036b10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff324000f70 tx=0x7ff324001380 comp rx=0 tx=0).stop 2024-09-13T06:09:54.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.487+0000 7ff330c57980 1 -- 172.21.15.194:0/1193155963 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56453dac45f0 msgr2=0x56453dbb8f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.487+0000 7ff330c57980 1 --2- 172.21.15.194:0/1193155963 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56453dac45f0 0x56453dbb8f60 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff3200199f0 tx=0x7ff3200180e0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.491 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.487+0000 7ff32ef68640 1 -- 172.21.15.194:0/1193155963 reap_dead start 2024-09-13T06:09:54.491 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.487+0000 7ff330c57980 1 -- 172.21.15.194:0/1193155963 shutdown_connections 2024-09-13T06:09:54.491 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.487+0000 7ff330c57980 1 -- 172.21.15.194:0/1193155963 >> 172.21.15.194:0/1193155963 conn(0x56453dac0110 msgr2=0x56453dbab310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:54.491 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.487+0000 7ff330c57980 1 -- 172.21.15.194:0/1193155963 shutdown_connections 2024-09-13T06:09:54.491 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.487+0000 7ff330c57980 1 -- 172.21.15.194:0/1193155963 wait complete. 2024-09-13T06:09:54.495 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T06:09:53.191222Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-13T06:09:54.466646Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:09:53.191207Z', 'tags': [], 'group_ids': []} 2024-09-13T06:09:54.495 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T06:09:54.495 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T06:09:54.496 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T06:09:54.571 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:09:54.571 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:09:54.572 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.571+0000 7f56d4aa9980 1 Processor -- start 2024-09-13T06:09:54.572 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.571+0000 7f56d4aa9980 1 -- start start 2024-09-13T06:09:54.572 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.571+0000 7f56d4aa9980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x557eb3864ac0 0x557eb38f3370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.571+0000 7f56d4aa9980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557eb3778ae0 con 0x557eb38f38b0 2024-09-13T06:09:54.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.571+0000 7f56d4aa9980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x557eb379ce30 con 0x557eb3864ac0 2024-09-13T06:09:54.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.571+0000 7f56d25b9640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x557eb3864ac0 0x557eb38f3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.571+0000 7f56d25b9640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x557eb3864ac0 0x557eb38f3370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44520/0 (socket says 172.21.15.194:44520) 2024-09-13T06:09:54.574 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.571+0000 7f56d25b9640 1 -- 172.21.15.194:0/1293752553 learned_addr learned my addr 172.21.15.194:0/1293752553 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:54.574 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.571+0000 7f56d25b9640 1 -- 172.21.15.194:0/1293752553 >> v1:172.21.15.120:6789/0 conn(0x557eb38f38b0 legacy=0x557eb38f5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.574 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.571+0000 7f56d25b9640 1 -- 172.21.15.194:0/1293752553 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557eb38f83d0 con 0x557eb3864ac0 2024-09-13T06:09:54.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.575+0000 7f56d25b9640 1 --2- 172.21.15.194:0/1293752553 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557eb3864ac0 0x557eb38f3370 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f56c400a4e0 tx=0x7f56c401b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=139e395aa316396f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.575+0000 7f56d15b7640 1 -- 172.21.15.194:0/1293752553 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56c40aa540 con 0x557eb3864ac0 2024-09-13T06:09:54.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.575+0000 7f56d15b7640 1 -- 172.21.15.194:0/1293752553 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56c40aa6e0 con 0x557eb3864ac0 2024-09-13T06:09:54.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.575+0000 7f56d15b7640 1 -- 172.21.15.194:0/1293752553 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56c40aaa40 con 0x557eb3864ac0 2024-09-13T06:09:54.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.575+0000 7f56d4aa9980 1 -- 172.21.15.194:0/1293752553 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557eb3864ac0 msgr2=0x557eb38f3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.575+0000 7f56d4aa9980 1 --2- 172.21.15.194:0/1293752553 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557eb3864ac0 0x557eb38f3370 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f56c400a4e0 tx=0x7f56c401b090 comp rx=0 tx=0).stop 2024-09-13T06:09:54.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.575+0000 7f56d4aa9980 1 -- 172.21.15.194:0/1293752553 shutdown_connections 2024-09-13T06:09:54.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.575+0000 7f56d4aa9980 1 --2- 172.21.15.194:0/1293752553 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557eb3864ac0 0x557eb38f3370 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.575+0000 7f56d4aa9980 1 -- 172.21.15.194:0/1293752553 >> 172.21.15.194:0/1293752553 conn(0x557eb38eb060 msgr2=0x557eb38ed480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:54.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.575+0000 7f56d4aa9980 1 -- 172.21.15.194:0/1293752553 shutdown_connections 2024-09-13T06:09:54.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.575+0000 7f56d4aa9980 1 -- 172.21.15.194:0/1293752553 wait complete. 2024-09-13T06:09:54.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.587+0000 7f56d4aa9980 1 Processor -- start 2024-09-13T06:09:54.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.587+0000 7f56d4aa9980 1 -- start start 2024-09-13T06:09:54.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.587+0000 7f56d4aa9980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557eb3864ac0 0x557eb38f0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.587+0000 7f56d4aa9980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x557eb379e200 con 0x557eb3864ac0 2024-09-13T06:09:54.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.587+0000 7f56d25b9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557eb3864ac0 0x557eb38f0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.587+0000 7f56d25b9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557eb3864ac0 0x557eb38f0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44530/0 (socket says 172.21.15.194:44530) 2024-09-13T06:09:54.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.587+0000 7f56d25b9640 1 -- 172.21.15.194:0/2445986371 learned_addr learned my addr 172.21.15.194:0/2445986371 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:54.592 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.591+0000 7f56d25b9640 1 -- 172.21.15.194:0/2445986371 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557eb38f10a0 con 0x557eb3864ac0 2024-09-13T06:09:54.592 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.591+0000 7f56d25b9640 1 --2- 172.21.15.194:0/2445986371 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557eb3864ac0 0x557eb38f0ad0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f56c4017ca0 tx=0x7f56c40033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74b9846aac648642 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.592 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.591+0000 7f55c0608640 1 -- 172.21.15.194:0/2445986371 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56c40b9030 con 0x557eb3864ac0 2024-09-13T06:09:54.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.591+0000 7f55c0608640 1 -- 172.21.15.194:0/2445986371 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56c40aaac0 con 0x557eb3864ac0 2024-09-13T06:09:54.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.591+0000 7f55c0608640 1 -- 172.21.15.194:0/2445986371 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56c40aada0 con 0x557eb3864ac0 2024-09-13T06:09:54.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.591+0000 7f56d4aa9980 1 -- 172.21.15.194:0/2445986371 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557eb3864ac0 msgr2=0x557eb38f0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.591+0000 7f56d4aa9980 1 --2- 172.21.15.194:0/2445986371 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557eb3864ac0 0x557eb38f0ad0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f56c4017ca0 tx=0x7f56c40033b0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.591+0000 7f56d4aa9980 1 -- 172.21.15.194:0/2445986371 shutdown_connections 2024-09-13T06:09:54.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.591+0000 7f56d4aa9980 1 --2- 172.21.15.194:0/2445986371 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557eb3864ac0 0x557eb38f0ad0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.591+0000 7f56d4aa9980 1 -- 172.21.15.194:0/2445986371 >> 172.21.15.194:0/2445986371 conn(0x557eb38eb060 msgr2=0x557eb39d7630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:54.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.591+0000 7f56d4aa9980 1 -- 172.21.15.194:0/2445986371 shutdown_connections 2024-09-13T06:09:54.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.591+0000 7f56d4aa9980 1 -- 172.21.15.194:0/2445986371 wait complete. 2024-09-13T06:09:54.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.591+0000 7f56d4aa9980 1 Processor -- start 2024-09-13T06:09:54.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.591+0000 7f56d4aa9980 1 -- start start 2024-09-13T06:09:54.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.591+0000 7f56d4aa9980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557eb3864ac0 0x557eb39e4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.591+0000 7f56d4aa9980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x557eb38f7e10 con 0x557eb3864ac0 2024-09-13T06:09:54.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.591+0000 7f56d25b9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557eb3864ac0 0x557eb39e4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.591+0000 7f56d25b9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557eb3864ac0 0x557eb39e4e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44542/0 (socket says 172.21.15.194:44542) 2024-09-13T06:09:54.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.591+0000 7f56d25b9640 1 -- 172.21.15.194:0/4030507291 learned_addr learned my addr 172.21.15.194:0/4030507291 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:54.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.591+0000 7f56d25b9640 1 -- 172.21.15.194:0/4030507291 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557eb39e5390 con 0x557eb3864ac0 2024-09-13T06:09:54.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.591+0000 7f56d25b9640 1 --2- 172.21.15.194:0/4030507291 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557eb3864ac0 0x557eb39e4e50 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f56c4005cc0 tx=0x7f56c4017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.591+0000 7f55bee05640 1 -- 172.21.15.194:0/4030507291 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56c40b9030 con 0x557eb3864ac0 2024-09-13T06:09:54.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.591+0000 7f56d4aa9980 1 -- 172.21.15.194:0/4030507291 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557eb39e5620 con 0x557eb3864ac0 2024-09-13T06:09:54.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.591+0000 7f56d4aa9980 1 -- 172.21.15.194:0/4030507291 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557eb39e8300 con 0x557eb3864ac0 2024-09-13T06:09:54.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.591+0000 7f55bee05640 1 -- 172.21.15.194:0/4030507291 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56c40c3070 con 0x557eb3864ac0 2024-09-13T06:09:54.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.591+0000 7f55bee05640 1 -- 172.21.15.194:0/4030507291 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56c40cc060 con 0x557eb3864ac0 2024-09-13T06:09:54.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.595+0000 7f55bee05640 1 -- 172.21.15.194:0/4030507291 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f56c40c5030 con 0x557eb3864ac0 2024-09-13T06:09:54.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.595+0000 7f55bee05640 1 --2- 172.21.15.194:0/4030507291 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f55b80346f0 0x7f55b8036bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.595+0000 7f55bee05640 1 -- 172.21.15.194:0/4030507291 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f56c40ba070 con 0x557eb3864ac0 2024-09-13T06:09:54.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.595+0000 7f56d1db8640 1 --2- 172.21.15.194:0/4030507291 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f55b80346f0 0x7f55b8036bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.595+0000 7f56d4aa9980 1 --2- 172.21.15.194:0/4030507291 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x557eb38f38b0 0x557eb39ebde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.595+0000 7f56d4aa9980 1 -- 172.21.15.194:0/4030507291 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557eb39ec3b0 con 0x557eb38f38b0 2024-09-13T06:09:54.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.595+0000 7f56d2dba640 1 --2- 172.21.15.194:0/4030507291 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x557eb38f38b0 0x557eb39ebde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.595+0000 7f56d1db8640 1 --2- 172.21.15.194:0/4030507291 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f55b80346f0 0x7f55b8036bb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f56bc000f70 tx=0x7f56bc001420 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.595+0000 7f56d2dba640 1 --2- 172.21.15.194:0/4030507291 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x557eb38f38b0 0x557eb39ebde0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.598 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.595+0000 7f56d2dba640 1 -- 172.21.15.194:0/4030507291 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f56cc0083f0 con 0x557eb38f38b0 2024-09-13T06:09:54.598 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.595+0000 7f56d4aa9980 1 -- 172.21.15.194:0/4030507291 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557eb39ecc90 con 0x557eb38f38b0 2024-09-13T06:09:54.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.595+0000 7f56d2dba640 1 -- 172.21.15.194:0/4030507291 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f56cc0083f0 con 0x557eb38f38b0 2024-09-13T06:09:54.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.595+0000 7f56d4aa9980 1 --2- 172.21.15.194:0/4030507291 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x557eb39ee5a0 0x557eb39f0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.595+0000 7f56d4aa9980 1 -- 172.21.15.194:0/4030507291 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557eb39f11d0 con 0x557eb39ee5a0 2024-09-13T06:09:54.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.595+0000 7f56d25b9640 1 --2- 172.21.15.194:0/4030507291 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x557eb39ee5a0 0x557eb39f0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.595+0000 7f56d25b9640 1 --2- 172.21.15.194:0/4030507291 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x557eb39ee5a0 0x557eb39f0a40 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.595+0000 7f56d25b9640 1 -- 172.21.15.194:0/4030507291 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f56c40bf930 con 0x557eb39ee5a0 2024-09-13T06:09:54.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.595+0000 7f56d4aa9980 1 -- 172.21.15.194:0/4030507291 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557eb39ed4e0 con 0x557eb38f38b0 2024-09-13T06:09:54.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.595+0000 7f56d2dba640 1 -- 172.21.15.194:0/4030507291 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f56cc0083f0 con 0x557eb38f38b0 2024-09-13T06:09:54.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.595+0000 7f56d4aa9980 1 --2- 172.21.15.194:0/4030507291 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x557eb39f2630 0x557eb39f4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.595+0000 7f56d4aa9980 1 -- 172.21.15.194:0/4030507291 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557eb39f5160 con 0x557eb39f2630 2024-09-13T06:09:54.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.595+0000 7f56d1db8640 1 --2- 172.21.15.194:0/4030507291 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x557eb39f2630 0x557eb39f4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.595+0000 7f56d1db8640 1 --2- 172.21.15.194:0/4030507291 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x557eb39f2630 0x557eb39f4a20 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.599+0000 7f56d1db8640 1 -- 172.21.15.194:0/4030507291 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f56bc00d040 con 0x557eb39f2630 2024-09-13T06:09:54.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.599+0000 7f56d4aa9980 1 Processor -- start 2024-09-13T06:09:54.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.599+0000 7f56d4aa9980 1 -- start start 2024-09-13T06:09:54.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.599+0000 7f56d4aa9980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557eb3a02c10 0x557eb3a03030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.599+0000 7f56d4aa9980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x557eb37f7800 con 0x557eb3a02c10 2024-09-13T06:09:54.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.599+0000 7f56d25b9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557eb3a02c10 0x557eb3a03030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.599+0000 7f56d25b9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557eb3a02c10 0x557eb3a03030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44552/0 (socket says 172.21.15.194:44552) 2024-09-13T06:09:54.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.599+0000 7f56d25b9640 1 -- 172.21.15.194:0/4158061544 learned_addr learned my addr 172.21.15.194:0/4158061544 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:54.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.599+0000 7f56d25b9640 1 -- 172.21.15.194:0/4158061544 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557eb3a03570 con 0x557eb3a02c10 2024-09-13T06:09:54.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.599+0000 7f56d25b9640 1 --2- 172.21.15.194:0/4158061544 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557eb3a02c10 0x557eb3a03030 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f56c40d0b50 tx=0x7f56c40d0c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.599+0000 7f55b7fff640 1 -- 172.21.15.194:0/4158061544 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56c40c6750 con 0x557eb3a02c10 2024-09-13T06:09:54.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.599+0000 7f56d4aa9980 1 -- 172.21.15.194:0/4158061544 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557eb3a03800 con 0x557eb3a02c10 2024-09-13T06:09:54.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.599+0000 7f55b7fff640 1 -- 172.21.15.194:0/4158061544 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56c40c68f0 con 0x557eb3a02c10 2024-09-13T06:09:54.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.599+0000 7f55b7fff640 1 -- 172.21.15.194:0/4158061544 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56c40b4a40 con 0x557eb3a02c10 2024-09-13T06:09:54.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.599+0000 7f56d4aa9980 1 -- 172.21.15.194:0/4158061544 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557eb3a06480 con 0x557eb3a02c10 2024-09-13T06:09:54.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.599+0000 7f55b7fff640 1 -- 172.21.15.194:0/4158061544 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f56c40b3040 con 0x557eb3a02c10 2024-09-13T06:09:54.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.599+0000 7f55b7fff640 1 --2- 172.21.15.194:0/4158061544 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f55ac034650 0x7f55ac036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.599+0000 7f55b7fff640 1 -- 172.21.15.194:0/4158061544 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f56c40c8020 con 0x557eb3a02c10 2024-09-13T06:09:54.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.599+0000 7f56d1db8640 1 --2- 172.21.15.194:0/4158061544 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f55ac034650 0x7f55ac036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.599+0000 7f56d4aa9980 1 Processor -- start 2024-09-13T06:09:54.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.599+0000 7f56d4aa9980 1 -- start start 2024-09-13T06:09:54.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.603+0000 7f56d4aa9980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557eb3a0f570 0x557eb3a0f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.603+0000 7f56d1db8640 1 --2- 172.21.15.194:0/4158061544 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f55ac034650 0x7f55ac036b10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x557eb39f1570 tx=0x7f56bc006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.603+0000 7f56d4aa9980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x557eb38ef200 con 0x557eb3a0f570 2024-09-13T06:09:54.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.603+0000 7f56d25b9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557eb3a0f570 0x557eb3a0f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.603+0000 7f56d25b9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557eb3a0f570 0x557eb3a0f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44554/0 (socket says 172.21.15.194:44554) 2024-09-13T06:09:54.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.603+0000 7f56d25b9640 1 -- 172.21.15.194:0/846283297 learned_addr learned my addr 172.21.15.194:0/846283297 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:54.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.603+0000 7f56d25b9640 1 -- 172.21.15.194:0/846283297 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557eb3a0ff20 con 0x557eb3a0f570 2024-09-13T06:09:54.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.603+0000 7f56d25b9640 1 --2- 172.21.15.194:0/846283297 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557eb3a0f570 0x557eb3a0f950 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f56c40071c0 tx=0x7f56c40bda80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0464126e7ab1cd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.603+0000 7f55b5ffb640 1 -- 172.21.15.194:0/846283297 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56c40f3020 con 0x557eb3a0f570 2024-09-13T06:09:54.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.603+0000 7f55b5ffb640 1 -- 172.21.15.194:0/846283297 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56c40deb80 con 0x557eb3a0f570 2024-09-13T06:09:54.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.603+0000 7f55b5ffb640 1 -- 172.21.15.194:0/846283297 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56c40b44d0 con 0x557eb3a0f570 2024-09-13T06:09:54.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.603+0000 7f56d4aa9980 1 -- 172.21.15.194:0/846283297 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557eb3a0f570 msgr2=0x557eb3a0f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.603+0000 7f56d4aa9980 1 --2- 172.21.15.194:0/846283297 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557eb3a0f570 0x557eb3a0f950 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f56c40071c0 tx=0x7f56c40bda80 comp rx=0 tx=0).stop 2024-09-13T06:09:54.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.603+0000 7f56d4aa9980 1 -- 172.21.15.194:0/846283297 shutdown_connections 2024-09-13T06:09:54.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.603+0000 7f56d4aa9980 1 --2- 172.21.15.194:0/846283297 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557eb3a0f570 0x557eb3a0f950 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.603+0000 7f56d4aa9980 1 -- 172.21.15.194:0/846283297 >> 172.21.15.194:0/846283297 conn(0x557eb3a0b950 msgr2=0x557eb3a09a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:54.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.603+0000 7f56d4aa9980 1 -- 172.21.15.194:0/846283297 shutdown_connections 2024-09-13T06:09:54.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.603+0000 7f56d4aa9980 1 -- 172.21.15.194:0/846283297 wait complete. 2024-09-13T06:09:54.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.603+0000 7f56d4aa9980 1 Processor -- start 2024-09-13T06:09:54.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.603+0000 7f56d4aa9980 1 -- start start 2024-09-13T06:09:54.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.603+0000 7f56d4aa9980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557eb3a0f570 0x557eb3a16730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.603+0000 7f56d4aa9980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x557eb3a103c0 con 0x557eb3a0f570 2024-09-13T06:09:54.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.603+0000 7f56d25b9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557eb3a0f570 0x557eb3a16730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.603+0000 7f56d25b9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557eb3a0f570 0x557eb3a16730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44560/0 (socket says 172.21.15.194:44560) 2024-09-13T06:09:54.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.603+0000 7f56d25b9640 1 -- 172.21.15.194:0/3692566970 learned_addr learned my addr 172.21.15.194:0/3692566970 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:54.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.603+0000 7f56d25b9640 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557eb3a16c70 con 0x557eb3a0f570 2024-09-13T06:09:54.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.603+0000 7f56d25b9640 1 --2- 172.21.15.194:0/3692566970 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557eb3a0f570 0x557eb3a16730 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f56c40e2690 tx=0x7f56c40acf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.603+0000 7f55a3fff640 1 -- 172.21.15.194:0/3692566970 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56c4108070 con 0x557eb3a0f570 2024-09-13T06:09:54.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.603+0000 7f56d4aa9980 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557eb3a16c70 con 0x557eb3a0f570 2024-09-13T06:09:54.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.603+0000 7f55a3fff640 1 -- 172.21.15.194:0/3692566970 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56c40bd5a0 con 0x557eb3a0f570 2024-09-13T06:09:54.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.603+0000 7f55a3fff640 1 -- 172.21.15.194:0/3692566970 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56c40de710 con 0x557eb3a0f570 2024-09-13T06:09:54.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.603+0000 7f56d4aa9980 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557eb3a170e0 con 0x557eb3a0f570 2024-09-13T06:09:54.614 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.607+0000 7f56d4aa9980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.614 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.607+0000 7f55a3fff640 1 -- 172.21.15.194:0/3692566970 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f56c410b070 con 0x557eb3a0f570 2024-09-13T06:09:54.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.607+0000 7f55a3fff640 1 --2- 172.21.15.194:0/3692566970 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f559c034650 0x7f559c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.607+0000 7f55a3fff640 1 -- 172.21.15.194:0/3692566970 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f56c40ff030 con 0x557eb3a0f570 2024-09-13T06:09:54.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.607+0000 7f56d1db8640 1 --2- 172.21.15.194:0/3692566970 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f559c034650 0x7f559c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.607+0000 7f56d4aa9980 1 --2- 172.21.15.194:0/3692566970 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x557eb3a21740 0x557eb3a23c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.607+0000 7f56d4aa9980 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a24350 con 0x557eb3a21740 2024-09-13T06:09:54.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.607+0000 7f56d2dba640 1 --2- 172.21.15.194:0/3692566970 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x557eb3a21740 0x557eb3a23c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.607+0000 7f56d1db8640 1 --2- 172.21.15.194:0/3692566970 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f559c034650 0x7f559c036b10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f56bc010fd0 tx=0x7f56bc011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.607+0000 7f56d2dba640 1 --2- 172.21.15.194:0/3692566970 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x557eb3a21740 0x557eb3a23c00 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.607+0000 7f56d2dba640 1 -- 172.21.15.194:0/3692566970 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f56cc0083f0 con 0x557eb3a21740 2024-09-13T06:09:54.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.607+0000 7f56d4aa9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:54.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.607+0000 7f56d4aa9980 20 realm 2024-09-13T06:09:54.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.607+0000 7f56d4aa9980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.607+0000 7f56d4aa9980 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a24760 con 0x557eb3a21740 2024-09-13T06:09:54.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.607+0000 7f56d2dba640 1 -- 172.21.15.194:0/3692566970 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f56cc0083f0 con 0x557eb3a21740 2024-09-13T06:09:54.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.607+0000 7f56d4aa9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:54.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.607+0000 7f56d4aa9980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:09:54.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.607+0000 7f56d4aa9980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.607+0000 7f56d4aa9980 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a25000 con 0x557eb3a21740 2024-09-13T06:09:54.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.607+0000 7f56d2dba640 1 -- 172.21.15.194:0/3692566970 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f56cc0083f0 con 0x557eb3a21740 2024-09-13T06:09:54.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.607+0000 7f56d4aa9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:54.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.607+0000 7f56d4aa9980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.607+0000 7f56d4aa9980 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a253a0 con 0x557eb3a21740 2024-09-13T06:09:54.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.607+0000 7f56d2dba640 1 -- 172.21.15.194:0/3692566970 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f56cc0083f0 con 0x557eb3a21740 2024-09-13T06:09:54.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.607+0000 7f56d4aa9980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:54.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.607+0000 7f56d4aa9980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.607+0000 7f56d4aa9980 1 --2- 172.21.15.194:0/3692566970 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x557eb3a26100 0x557eb3a284f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.607+0000 7f56d4aa9980 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a28a70 con 0x557eb3a26100 2024-09-13T06:09:54.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.607+0000 7f56d25b9640 1 --2- 172.21.15.194:0/3692566970 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x557eb3a26100 0x557eb3a284f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.607+0000 7f56d25b9640 1 --2- 172.21.15.194:0/3692566970 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x557eb3a26100 0x557eb3a284f0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.607+0000 7f56d25b9640 1 -- 172.21.15.194:0/3692566970 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f56c410a030 con 0x557eb3a26100 2024-09-13T06:09:54.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.607+0000 7f56d4aa9980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:09:54.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.607+0000 7f56d4aa9980 20 searching for the correct realm 2024-09-13T06:09:54.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.607+0000 7f56d4aa9980 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a2a310 con 0x557eb3a26100 2024-09-13T06:09:54.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.607+0000 7f56d25b9640 1 -- 172.21.15.194:0/3692566970 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56c410a030 con 0x557eb3a26100 2024-09-13T06:09:54.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.611+0000 7f56d25b9640 1 --2- 172.21.15.194:0/3692566970 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f56c410d060 0x7f56c40e55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.611+0000 7f56d25b9640 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a2a310 con 0x7f56c410d060 2024-09-13T06:09:54.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.611+0000 7f56d1db8640 1 --2- 172.21.15.194:0/3692566970 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f56c410d060 0x7f56c40e55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.611+0000 7f56d1db8640 1 --2- 172.21.15.194:0/3692566970 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f56c410d060 0x7f56c40e55f0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.611+0000 7f56d1db8640 1 -- 172.21.15.194:0/3692566970 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f56bc036040 con 0x7f56c410d060 2024-09-13T06:09:54.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.611+0000 7f56d1db8640 1 --2- 172.21.15.194:0/3692566970 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f56bc00f3d0 0x7f56bc00f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.611+0000 7f56d1db8640 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a2a310 con 0x7f56bc00f3d0 2024-09-13T06:09:54.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.611+0000 7f56d2dba640 1 --2- 172.21.15.194:0/3692566970 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f56bc00f3d0 0x7f56bc00f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.611+0000 7f56d2dba640 1 --2- 172.21.15.194:0/3692566970 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f56bc00f3d0 0x7f56bc00f7f0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.611+0000 7f56d2dba640 1 -- 172.21.15.194:0/3692566970 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56cc0083f0 con 0x7f56bc00f3d0 2024-09-13T06:09:54.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.611+0000 7f56d2dba640 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a253a0 con 0x557eb3a21740 2024-09-13T06:09:54.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.611+0000 7f56d2dba640 1 -- 172.21.15.194:0/3692566970 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56cc0083f0 con 0x557eb3a21740 2024-09-13T06:09:54.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.611+0000 7f56d2dba640 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a253a0 con 0x557eb3a21740 2024-09-13T06:09:54.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.611+0000 7f56d2dba640 1 -- 172.21.15.194:0/3692566970 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56cc0083f0 con 0x557eb3a21740 2024-09-13T06:09:54.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.611+0000 7f56d2dba640 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a253a0 con 0x7f56bc00f3d0 2024-09-13T06:09:54.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.611+0000 7f56d2dba640 1 -- 172.21.15.194:0/3692566970 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56cc0083f0 con 0x7f56bc00f3d0 2024-09-13T06:09:54.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.611+0000 7f56d2dba640 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a253a0 con 0x7f56bc00f3d0 2024-09-13T06:09:54.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.611+0000 7f56d2dba640 1 -- 172.21.15.194:0/3692566970 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56cc0083f0 con 0x7f56bc00f3d0 2024-09-13T06:09:54.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.611+0000 7f56d2dba640 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a253a0 con 0x7f56c410d060 2024-09-13T06:09:54.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.615+0000 7f56d1db8640 1 -- 172.21.15.194:0/3692566970 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56bc036040 con 0x7f56c410d060 2024-09-13T06:09:54.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.615+0000 7f56d1db8640 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a253a0 con 0x557eb3a26100 2024-09-13T06:09:54.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.615+0000 7f56d25b9640 1 -- 172.21.15.194:0/3692566970 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56c410a030 con 0x557eb3a26100 2024-09-13T06:09:54.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.615+0000 7f56d25b9640 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a253a0 con 0x557eb3a21740 2024-09-13T06:09:54.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.615+0000 7f56d2dba640 1 -- 172.21.15.194:0/3692566970 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56cc0083f0 con 0x557eb3a21740 2024-09-13T06:09:54.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.615+0000 7f56d2dba640 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a253a0 con 0x7f56bc00f3d0 2024-09-13T06:09:54.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.615+0000 7f56d2dba640 1 -- 172.21.15.194:0/3692566970 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56cc0083f0 con 0x7f56bc00f3d0 2024-09-13T06:09:54.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.615+0000 7f56d2dba640 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a253a0 con 0x557eb3a21740 2024-09-13T06:09:54.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.615+0000 7f56d2dba640 1 -- 172.21.15.194:0/3692566970 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56cc0083f0 con 0x557eb3a21740 2024-09-13T06:09:54.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.615+0000 7f56d2dba640 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a253a0 con 0x7f56c410d060 2024-09-13T06:09:54.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.615+0000 7f56d1db8640 1 -- 172.21.15.194:0/3692566970 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f56bc036040 con 0x7f56c410d060 2024-09-13T06:09:54.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.615+0000 7f56d1db8640 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a253a0 con 0x557eb3a26100 2024-09-13T06:09:54.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.615+0000 7f56d25b9640 1 -- 172.21.15.194:0/3692566970 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56c410a030 con 0x557eb3a26100 2024-09-13T06:09:54.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.615+0000 7f56d25b9640 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a253a0 con 0x557eb3a26100 2024-09-13T06:09:54.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.615+0000 7f56d25b9640 1 -- 172.21.15.194:0/3692566970 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56c410a030 con 0x557eb3a26100 2024-09-13T06:09:54.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.615+0000 7f56d25b9640 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a253a0 con 0x7f56bc00f3d0 2024-09-13T06:09:54.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.615+0000 7f56d2dba640 1 -- 172.21.15.194:0/3692566970 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56cc0083f0 con 0x7f56bc00f3d0 2024-09-13T06:09:54.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.615+0000 7f56d2dba640 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a253a0 con 0x557eb3a26100 2024-09-13T06:09:54.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.615+0000 7f56d25b9640 1 -- 172.21.15.194:0/3692566970 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56c410a030 con 0x557eb3a26100 2024-09-13T06:09:54.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.615+0000 7f56d25b9640 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a253a0 con 0x557eb3a26100 2024-09-13T06:09:54.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.615+0000 7f56d25b9640 1 -- 172.21.15.194:0/3692566970 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56c410a030 con 0x557eb3a26100 2024-09-13T06:09:54.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.615+0000 7f56d25b9640 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a253a0 con 0x557eb3a21740 2024-09-13T06:09:54.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.615+0000 7f56d2dba640 1 -- 172.21.15.194:0/3692566970 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56cc0083f0 con 0x557eb3a21740 2024-09-13T06:09:54.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.615+0000 7f56d2dba640 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a253a0 con 0x557eb3a21740 2024-09-13T06:09:54.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.619+0000 7f56d2dba640 1 -- 172.21.15.194:0/3692566970 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f56cc0083f0 con 0x557eb3a21740 2024-09-13T06:09:54.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.619+0000 7f56d2dba640 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a253a0 con 0x7f56bc00f3d0 2024-09-13T06:09:54.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.619+0000 7f56d2dba640 1 -- 172.21.15.194:0/3692566970 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56cc0083f0 con 0x7f56bc00f3d0 2024-09-13T06:09:54.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.619+0000 7f56d2dba640 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a253a0 con 0x557eb3a26100 2024-09-13T06:09:54.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.619+0000 7f56d25b9640 1 -- 172.21.15.194:0/3692566970 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56c410a030 con 0x557eb3a26100 2024-09-13T06:09:54.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.619+0000 7f56d25b9640 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a253a0 con 0x7f56c410d060 2024-09-13T06:09:54.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.619+0000 7f56d1db8640 1 -- 172.21.15.194:0/3692566970 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56bc036040 con 0x7f56c410d060 2024-09-13T06:09:54.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.619+0000 7f56d1db8640 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a253a0 con 0x557eb3a21740 2024-09-13T06:09:54.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.619+0000 7f56d2dba640 1 -- 172.21.15.194:0/3692566970 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56cc0083f0 con 0x557eb3a21740 2024-09-13T06:09:54.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.619+0000 7f56d2dba640 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a253a0 con 0x7f56bc00f3d0 2024-09-13T06:09:54.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.619+0000 7f56d2dba640 1 -- 172.21.15.194:0/3692566970 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56cc0083f0 con 0x7f56bc00f3d0 2024-09-13T06:09:54.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.619+0000 7f56d2dba640 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a253a0 con 0x557eb3a26100 2024-09-13T06:09:54.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.619+0000 7f56d25b9640 1 -- 172.21.15.194:0/3692566970 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f56c410a030 con 0x557eb3a26100 2024-09-13T06:09:54.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.619+0000 7f56d25b9640 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a253a0 con 0x7f56bc00f3d0 2024-09-13T06:09:54.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.619+0000 7f56d2dba640 1 -- 172.21.15.194:0/3692566970 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56cc0083f0 con 0x7f56bc00f3d0 2024-09-13T06:09:54.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.619+0000 7f56d2dba640 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a253a0 con 0x7f56c410d060 2024-09-13T06:09:54.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.619+0000 7f56d1db8640 1 -- 172.21.15.194:0/3692566970 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56bc036040 con 0x7f56c410d060 2024-09-13T06:09:54.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.619+0000 7f56d1db8640 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a253a0 con 0x557eb3a26100 2024-09-13T06:09:54.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.619+0000 7f56d25b9640 1 -- 172.21.15.194:0/3692566970 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56c410a030 con 0x557eb3a26100 2024-09-13T06:09:54.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.619+0000 7f56d25b9640 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a253a0 con 0x7f56bc00f3d0 2024-09-13T06:09:54.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.623+0000 7f56d2dba640 1 -- 172.21.15.194:0/3692566970 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56cc0083f0 con 0x7f56bc00f3d0 2024-09-13T06:09:54.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.623+0000 7f56d2dba640 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a253a0 con 0x557eb3a21740 2024-09-13T06:09:54.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.623+0000 7f56d2dba640 1 -- 172.21.15.194:0/3692566970 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f56cc0083f0 con 0x557eb3a21740 2024-09-13T06:09:54.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.623+0000 7f56d2dba640 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a253a0 con 0x7f56c410d060 2024-09-13T06:09:54.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.623+0000 7f56d1db8640 1 -- 172.21.15.194:0/3692566970 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56bc036040 con 0x7f56c410d060 2024-09-13T06:09:54.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.623+0000 7f56d4aa9980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:09:54.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.623+0000 7f56d4aa9980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:09:54.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.623+0000 7f56d4aa9980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:09:54.631 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.623+0000 7f56d4aa9980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:09:54.631 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.623+0000 7f56d4aa9980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:09:54.631 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.623+0000 7f56d4aa9980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:09:54.631 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.623+0000 7f56d4aa9980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.631 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.623+0000 7f56d4aa9980 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a292c0 con 0x557eb3a21740 2024-09-13T06:09:54.631 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.623+0000 7f56d2dba640 1 -- 172.21.15.194:0/3692566970 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f56cc0083f0 con 0x557eb3a21740 2024-09-13T06:09:54.631 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.623+0000 7f56d4aa9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:54.631 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.623+0000 7f56d4aa9980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.631 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.623+0000 7f56d4aa9980 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a296b0 con 0x557eb3a21740 2024-09-13T06:09:54.631 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.623+0000 7f56d2dba640 1 -- 172.21.15.194:0/3692566970 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f56cc0083f0 con 0x557eb3a21740 2024-09-13T06:09:54.631 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.623+0000 7f56d4aa9980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:54.631 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.623+0000 7f56d4aa9980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.631 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.623+0000 7f56d4aa9980 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a296b0 con 0x7f56c410d060 2024-09-13T06:09:54.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.623+0000 7f56d1db8640 1 -- 172.21.15.194:0/3692566970 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f56bc036040 con 0x7f56c410d060 2024-09-13T06:09:54.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.623+0000 7f56d4aa9980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:09:54.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.623+0000 7f56d4aa9980 20 zone default found 2024-09-13T06:09:54.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.623+0000 7f56d4aa9980 4 Realm: () 2024-09-13T06:09:54.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.623+0000 7f56d4aa9980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:09:54.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.623+0000 7f56d4aa9980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:09:54.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.623+0000 7f56d4aa9980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:09:54.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.623+0000 7f56d4aa9980 20 zonegroup default 2024-09-13T06:09:54.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.623+0000 7f56d4aa9980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.623+0000 7f56d4aa9980 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a2a7e0 con 0x7f56bc00f3d0 2024-09-13T06:09:54.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.623+0000 7f56d2dba640 1 -- 172.21.15.194:0/3692566970 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f56cc0083f0 con 0x7f56bc00f3d0 2024-09-13T06:09:54.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.623+0000 7f56d4aa9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:54.633 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.623+0000 7f56d4aa9980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.633 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.623+0000 7f56d4aa9980 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a2c1c0 con 0x557eb3a26100 2024-09-13T06:09:54.633 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.623+0000 7f56d25b9640 1 -- 172.21.15.194:0/3692566970 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f56c410a030 con 0x557eb3a26100 2024-09-13T06:09:54.633 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.623+0000 7f56d4aa9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:54.633 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.623+0000 7f56d4aa9980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.633 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.623+0000 7f56d4aa9980 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a2c560 con 0x557eb3a26100 2024-09-13T06:09:54.633 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.623+0000 7f56d25b9640 1 -- 172.21.15.194:0/3692566970 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f56c410a030 con 0x557eb3a26100 2024-09-13T06:09:54.633 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.623+0000 7f56d4aa9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:54.633 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.623+0000 7f56d4aa9980 20 started sync module instance, tier type = 2024-09-13T06:09:54.633 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.623+0000 7f56d4aa9980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:09:54.633 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.623+0000 7f56d4aa9980 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a2b660 con 0x7f56c410d060 2024-09-13T06:09:54.633 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.627+0000 7f56d1db8640 1 -- 172.21.15.194:0/3692566970 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(44 notify.0 [create] v33'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56bc036040 con 0x7f56c410d060 2024-09-13T06:09:54.633 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.627+0000 7f56d4aa9980 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94002668026448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a2cdb0 con 0x7f56c410d060 2024-09-13T06:09:54.634 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.627+0000 7f56d4aa9980 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a2d600 con 0x557eb3a21740 2024-09-13T06:09:54.636 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.627+0000 7f56d1db8640 1 -- 172.21.15.194:0/3692566970 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94002668026448] v33'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56bc036040 con 0x7f56c410d060 2024-09-13T06:09:54.636 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.627+0000 7f56d2dba640 1 -- 172.21.15.194:0/3692566970 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v33'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56cc0083f0 con 0x557eb3a21740 2024-09-13T06:09:54.636 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.627+0000 7f56d4aa9980 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94002668030208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a2d600 con 0x557eb3a21740 2024-09-13T06:09:54.636 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.627+0000 7f56d4aa9980 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a2e0a0 con 0x557eb3a26100 2024-09-13T06:09:54.636 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.631+0000 7f56d25b9640 1 -- 172.21.15.194:0/3692566970 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v33'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56c410a030 con 0x557eb3a26100 2024-09-13T06:09:54.636 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.631+0000 7f56d4aa9980 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94002668034928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a2e940 con 0x557eb3a26100 2024-09-13T06:09:54.636 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.631+0000 7f56d4aa9980 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a2f360 con 0x7f56c410d060 2024-09-13T06:09:54.636 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.631+0000 7f56d2dba640 1 -- 172.21.15.194:0/3692566970 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94002668030208] v33'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56cc0083f0 con 0x557eb3a21740 2024-09-13T06:09:54.636 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.631+0000 7f56d1db8640 1 -- 172.21.15.194:0/3692566970 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(50 notify.3 [create] v33'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56bc036040 con 0x7f56c410d060 2024-09-13T06:09:54.636 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.631+0000 7f56d4aa9980 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94002668039760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a2f750 con 0x7f56c410d060 2024-09-13T06:09:54.637 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.631+0000 7f56d4aa9980 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a30110 con 0x557eb3a21740 2024-09-13T06:09:54.637 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.631+0000 7f56d25b9640 1 -- 172.21.15.194:0/3692566970 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94002668034928] v33'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56c410a030 con 0x557eb3a26100 2024-09-13T06:09:54.637 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.631+0000 7f56d2dba640 1 -- 172.21.15.194:0/3692566970 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v33'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56cc0083f0 con 0x557eb3a21740 2024-09-13T06:09:54.637 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.631+0000 7f56d4aa9980 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94002668037264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a30110 con 0x557eb3a21740 2024-09-13T06:09:54.637 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.631+0000 7f56d4aa9980 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a30ad0 con 0x7f56bc00f3d0 2024-09-13T06:09:54.637 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.631+0000 7f56d1db8640 1 -- 172.21.15.194:0/3692566970 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94002668039760] v33'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56bc036040 con 0x7f56c410d060 2024-09-13T06:09:54.637 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.635+0000 7f56d2dba640 1 -- 172.21.15.194:0/3692566970 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94002668037264] v33'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56cc0083f0 con 0x557eb3a21740 2024-09-13T06:09:54.637 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.635+0000 7f56d2dba640 1 -- 172.21.15.194:0/3692566970 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(54 notify.5 [create] v33'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56cc0083f0 con 0x7f56bc00f3d0 2024-09-13T06:09:54.637 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.635+0000 7f56d4aa9980 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94002668043360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a30080 con 0x7f56bc00f3d0 2024-09-13T06:09:54.638 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.635+0000 7f56d4aa9980 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a30f80 con 0x7f56bc00f3d0 2024-09-13T06:09:54.638 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.635+0000 7f56d2dba640 1 -- 172.21.15.194:0/3692566970 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(56 notify.6 [create] v33'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56cc0083f0 con 0x7f56bc00f3d0 2024-09-13T06:09:54.638 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.635+0000 7f56d2dba640 1 -- 172.21.15.194:0/3692566970 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94002668043360] v33'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56cc0083f0 con 0x7f56bc00f3d0 2024-09-13T06:09:54.638 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.635+0000 7f56d4aa9980 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94002668047056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a313a0 con 0x7f56bc00f3d0 2024-09-13T06:09:54.638 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.635+0000 7f56d4aa9980 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a30640 con 0x7f56bc00f3d0 2024-09-13T06:09:54.639 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.639+0000 7f56d2dba640 1 -- 172.21.15.194:0/3692566970 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94002668047056] v33'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56cc0083f0 con 0x7f56bc00f3d0 2024-09-13T06:09:54.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.639+0000 7f56d2dba640 1 -- 172.21.15.194:0/3692566970 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(58 notify.7 [create] v33'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56cc0083f0 con 0x7f56bc00f3d0 2024-09-13T06:09:54.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.639+0000 7f56d4aa9980 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94002668048112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a31310 con 0x7f56bc00f3d0 2024-09-13T06:09:54.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.639+0000 7f56d4aa9980 20 add_watcher() i=0 2024-09-13T06:09:54.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.639+0000 7f56d4aa9980 20 add_watcher() i=1 2024-09-13T06:09:54.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.639+0000 7f56d4aa9980 20 add_watcher() i=2 2024-09-13T06:09:54.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.639+0000 7f56d4aa9980 20 add_watcher() i=3 2024-09-13T06:09:54.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.639+0000 7f56d4aa9980 20 add_watcher() i=4 2024-09-13T06:09:54.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.639+0000 7f56d4aa9980 20 add_watcher() i=5 2024-09-13T06:09:54.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.639+0000 7f56d4aa9980 20 add_watcher() i=6 2024-09-13T06:09:54.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.639+0000 7f56d2dba640 1 -- 172.21.15.194:0/3692566970 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94002668048112] v33'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56cc0083f0 con 0x7f56bc00f3d0 2024-09-13T06:09:54.642 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.639+0000 7f56d4aa9980 20 add_watcher() i=7 2024-09-13T06:09:54.642 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.639+0000 7f56d4aa9980 2 all 8 watchers are set, enabling cache 2024-09-13T06:09:54.642 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.639+0000 7f56d4aa9980 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a34d90 con 0x557eb3a21740 2024-09-13T06:09:54.642 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.639+0000 7f56d2dba640 1 -- 172.21.15.194:0/3692566970 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f56cc0083f0 con 0x557eb3a21740 2024-09-13T06:09:54.642 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.639+0000 7f56d4aa9980 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94002668050608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a321f0 con 0x557eb3a21740 2024-09-13T06:09:54.643 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.643+0000 7f56d2dba640 1 -- 172.21.15.194:0/3692566970 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94002668050608] v33'66 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f56cc0083f0 con 0x557eb3a21740 2024-09-13T06:09:54.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.643+0000 7f5588fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:54.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.643+0000 7f56d4aa9980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:09:54.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.643+0000 7f56d4aa9980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:09:54.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.643+0000 7f56d4aa9980 5 note: GC not initialized 2024-09-13T06:09:54.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.643+0000 7f55037fe640 20 reqs_thread_entry: start 2024-09-13T06:09:54.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.643+0000 7f56d4aa9980 20 init_complete bucket index max shards: 11 2024-09-13T06:09:54.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.643+0000 7f56d4aa9980 20 Filter name: none 2024-09-13T06:09:54.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.643+0000 7f55017fa640 20 reqs_thread_entry: start 2024-09-13T06:09:54.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.643+0000 7f56d4aa9980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.643+0000 7f56d4aa9980 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a57df0 con 0x557eb3a21740 2024-09-13T06:09:54.645 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.643+0000 7f56d2dba640 1 -- 172.21.15.194:0/3692566970 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7f56cc0083f0 con 0x557eb3a21740 2024-09-13T06:09:54.645 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.643+0000 7f56d4aa9980 20 rados_obj.operate() r=0 bl.length=502 2024-09-13T06:09:54.645 INFO:teuthology.orchestra.run.smithi194.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T06:09:53.191222Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-13T06:09:54.466646Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:09:53.191207Z","tags":[],"group_ids":[]} 2024-09-13T06:09:54.646 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.643+0000 7f5588fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:54.646 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.643+0000 7f56d4aa9980 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94002668050608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a569a0 con 0x557eb3a21740 2024-09-13T06:09:54.646 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.643+0000 7f56d2dba640 1 -- 172.21.15.194:0/3692566970 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94002668050608] v33'67 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f56cc0083f0 con 0x557eb3a21740 2024-09-13T06:09:54.646 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.643+0000 7f56d4aa9980 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94002668026448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a55cf0 con 0x7f56c410d060 2024-09-13T06:09:54.647 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.647+0000 7f56d1db8640 1 -- 172.21.15.194:0/3692566970 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94002668026448] v33'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56bc036040 con 0x7f56c410d060 2024-09-13T06:09:54.647 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.647+0000 7f56d4aa9980 20 remove_watcher() i=0 2024-09-13T06:09:54.647 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.647+0000 7f56d4aa9980 2 removed watcher, disabling cache 2024-09-13T06:09:54.647 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.647+0000 7f56d4aa9980 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94002668030208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a55cf0 con 0x557eb3a21740 2024-09-13T06:09:54.649 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.647+0000 7f56d2dba640 1 -- 172.21.15.194:0/3692566970 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94002668030208] v33'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56cc0083f0 con 0x557eb3a21740 2024-09-13T06:09:54.649 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.647+0000 7f56d4aa9980 20 remove_watcher() i=1 2024-09-13T06:09:54.649 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.647+0000 7f56d4aa9980 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94002668034928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a55cf0 con 0x557eb3a26100 2024-09-13T06:09:54.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.651+0000 7f56d25b9640 1 -- 172.21.15.194:0/3692566970 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94002668034928] v33'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56c410a030 con 0x557eb3a26100 2024-09-13T06:09:54.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.651+0000 7f56d4aa9980 20 remove_watcher() i=2 2024-09-13T06:09:54.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.651+0000 7f56d4aa9980 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94002668039760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a55cf0 con 0x7f56c410d060 2024-09-13T06:09:54.652 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.651+0000 7f56d1db8640 1 -- 172.21.15.194:0/3692566970 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94002668039760] v33'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56bc036040 con 0x7f56c410d060 2024-09-13T06:09:54.652 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.651+0000 7f56d4aa9980 20 remove_watcher() i=3 2024-09-13T06:09:54.652 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.651+0000 7f56d4aa9980 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94002668037264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a55cf0 con 0x557eb3a21740 2024-09-13T06:09:54.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.651+0000 7f56d2dba640 1 -- 172.21.15.194:0/3692566970 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94002668037264] v33'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56cc0083f0 con 0x557eb3a21740 2024-09-13T06:09:54.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.651+0000 7f56d4aa9980 20 remove_watcher() i=4 2024-09-13T06:09:54.654 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.651+0000 7f56d4aa9980 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94002668043360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a55cf0 con 0x7f56bc00f3d0 2024-09-13T06:09:54.655 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.655+0000 7f56d2dba640 1 -- 172.21.15.194:0/3692566970 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94002668043360] v33'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56cc0083f0 con 0x7f56bc00f3d0 2024-09-13T06:09:54.655 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.655+0000 7f56d4aa9980 20 remove_watcher() i=5 2024-09-13T06:09:54.655 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.655+0000 7f56d4aa9980 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94002668047056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a55cf0 con 0x7f56bc00f3d0 2024-09-13T06:09:54.661 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.655+0000 7f56d2dba640 1 -- 172.21.15.194:0/3692566970 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94002668047056] v33'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56cc0083f0 con 0x7f56bc00f3d0 2024-09-13T06:09:54.662 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.655+0000 7f56d4aa9980 20 remove_watcher() i=6 2024-09-13T06:09:54.662 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.655+0000 7f56d4aa9980 1 -- 172.21.15.194:0/3692566970 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94002668048112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557eb3a55cf0 con 0x7f56bc00f3d0 2024-09-13T06:09:54.664 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.659+0000 7f56d2dba640 1 -- 172.21.15.194:0/3692566970 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94002668048112] v33'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56cc0083f0 con 0x7f56bc00f3d0 2024-09-13T06:09:54.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.659+0000 7f56d4aa9980 20 remove_watcher() i=7 2024-09-13T06:09:54.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.659+0000 7f56d4aa9980 1 -- 172.21.15.194:0/3692566970 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f56bc00f3d0 msgr2=0x7f56bc00f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.659+0000 7f56d4aa9980 1 --2- 172.21.15.194:0/3692566970 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f56bc00f3d0 0x7f56bc00f7f0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.659+0000 7f56d4aa9980 1 -- 172.21.15.194:0/3692566970 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x557eb3a21740 msgr2=0x557eb3a23c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.659+0000 7f56d4aa9980 1 --2- 172.21.15.194:0/3692566970 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x557eb3a21740 0x557eb3a23c00 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.659+0000 7f56d4aa9980 1 -- 172.21.15.194:0/3692566970 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f56c410d060 msgr2=0x7f56c40e55f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.659+0000 7f56d4aa9980 1 --2- 172.21.15.194:0/3692566970 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f56c410d060 0x7f56c40e55f0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.659+0000 7f56d4aa9980 1 -- 172.21.15.194:0/3692566970 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x557eb3a26100 msgr2=0x557eb3a284f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.659+0000 7f56d4aa9980 1 --2- 172.21.15.194:0/3692566970 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x557eb3a26100 0x557eb3a284f0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.659+0000 7f56d4aa9980 1 -- 172.21.15.194:0/3692566970 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f559c034650 msgr2=0x7f559c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.659+0000 7f56d4aa9980 1 --2- 172.21.15.194:0/3692566970 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f559c034650 0x7f559c036b10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f56bc010fd0 tx=0x7f56bc011000 comp rx=0 tx=0).stop 2024-09-13T06:09:54.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.659+0000 7f56d4aa9980 1 -- 172.21.15.194:0/3692566970 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557eb3a0f570 msgr2=0x557eb3a16730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.659+0000 7f56d2dba640 1 -- 172.21.15.194:0/3692566970 reap_dead start 2024-09-13T06:09:54.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.659+0000 7f56d4aa9980 1 --2- 172.21.15.194:0/3692566970 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557eb3a0f570 0x557eb3a16730 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f56c40e2690 tx=0x7f56c40acf00 comp rx=0 tx=0).stop 2024-09-13T06:09:54.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.659+0000 7f56d4aa9980 1 -- 172.21.15.194:0/3692566970 shutdown_connections 2024-09-13T06:09:54.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.659+0000 7f56d4aa9980 1 --2- 172.21.15.194:0/3692566970 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557eb3a0f570 0x557eb3a16730 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.659+0000 7f56d4aa9980 1 -- 172.21.15.194:0/3692566970 >> 172.21.15.194:0/3692566970 conn(0x557eb3a0b950 msgr2=0x557eb3a09a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:54.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.659+0000 7f56d4aa9980 1 -- 172.21.15.194:0/3692566970 shutdown_connections 2024-09-13T06:09:54.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.659+0000 7f56d4aa9980 1 -- 172.21.15.194:0/3692566970 wait complete. 2024-09-13T06:09:54.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.659+0000 7f56d4aa9980 1 -- 172.21.15.194:0/4158061544 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f55ac034650 msgr2=0x7f55ac036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.659+0000 7f56d4aa9980 1 --2- 172.21.15.194:0/4158061544 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f55ac034650 0x7f55ac036b10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x557eb39f1570 tx=0x7f56bc006000 comp rx=0 tx=0).stop 2024-09-13T06:09:54.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.659+0000 7f56d4aa9980 1 -- 172.21.15.194:0/4158061544 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557eb3a02c10 msgr2=0x557eb3a03030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.659+0000 7f56d4aa9980 1 --2- 172.21.15.194:0/4158061544 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557eb3a02c10 0x557eb3a03030 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f56c40d0b50 tx=0x7f56c40d0c80 comp rx=0 tx=0).stop 2024-09-13T06:09:54.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.659+0000 7f56d4aa9980 1 -- 172.21.15.194:0/4158061544 shutdown_connections 2024-09-13T06:09:54.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.659+0000 7f56d4aa9980 1 --2- 172.21.15.194:0/4158061544 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f55ac034650 0x7f55ac036b10 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.659+0000 7f56d4aa9980 1 --2- 172.21.15.194:0/4158061544 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557eb3a02c10 0x557eb3a03030 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.659+0000 7f56d4aa9980 1 -- 172.21.15.194:0/4158061544 >> 172.21.15.194:0/4158061544 conn(0x557eb39f7d60 msgr2=0x557eb39fa7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:54.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.659+0000 7f56d4aa9980 1 -- 172.21.15.194:0/4158061544 shutdown_connections 2024-09-13T06:09:54.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.659+0000 7f56d4aa9980 1 -- 172.21.15.194:0/4158061544 wait complete. 2024-09-13T06:09:54.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.659+0000 7f56d4aa9980 1 -- 172.21.15.194:0/4030507291 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x557eb38f38b0 msgr2=0x557eb39ebde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.659+0000 7f56d4aa9980 1 --2- 172.21.15.194:0/4030507291 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x557eb38f38b0 0x557eb39ebde0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.659+0000 7f56d4aa9980 1 -- 172.21.15.194:0/4030507291 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x557eb39f2630 msgr2=0x557eb39f4a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.659+0000 7f56d4aa9980 1 --2- 172.21.15.194:0/4030507291 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x557eb39f2630 0x557eb39f4a20 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.659+0000 7f56d4aa9980 1 -- 172.21.15.194:0/4030507291 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x557eb39ee5a0 msgr2=0x557eb39f0a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.659+0000 7f56d4aa9980 1 --2- 172.21.15.194:0/4030507291 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x557eb39ee5a0 0x557eb39f0a40 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.659+0000 7f56d4aa9980 1 -- 172.21.15.194:0/4030507291 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f55b80346f0 msgr2=0x7f55b8036bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.659+0000 7f56d4aa9980 1 --2- 172.21.15.194:0/4030507291 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f55b80346f0 0x7f55b8036bb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f56bc000f70 tx=0x7f56bc001420 comp rx=0 tx=0).stop 2024-09-13T06:09:54.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.659+0000 7f56d4aa9980 1 -- 172.21.15.194:0/4030507291 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557eb3864ac0 msgr2=0x557eb39e4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.659+0000 7f56d4aa9980 1 --2- 172.21.15.194:0/4030507291 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557eb3864ac0 0x557eb39e4e50 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f56c4005cc0 tx=0x7f56c4017e30 comp rx=0 tx=0).stop 2024-09-13T06:09:54.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.659+0000 7f56d2dba640 1 -- 172.21.15.194:0/4030507291 reap_dead start 2024-09-13T06:09:54.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.659+0000 7f56d4aa9980 1 -- 172.21.15.194:0/4030507291 shutdown_connections 2024-09-13T06:09:54.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.659+0000 7f56d4aa9980 1 -- 172.21.15.194:0/4030507291 >> 172.21.15.194:0/4030507291 conn(0x557eb38eb060 msgr2=0x557eb38ef720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:54.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.659+0000 7f56d4aa9980 1 -- 172.21.15.194:0/4030507291 shutdown_connections 2024-09-13T06:09:54.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.659+0000 7f56d4aa9980 1 -- 172.21.15.194:0/4030507291 wait complete. 2024-09-13T06:09:54.669 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T06:09:53.191222Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-13T06:09:54.466646Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:09:53.191207Z', 'tags': [], 'group_ids': []} 2024-09-13T06:09:54.670 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-09-13T06:09:54.670 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-09-13T06:09:54.670 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --uid foo --access-key p5YnriCv1nAtykxBrupQ 2024-09-13T06:09:54.743 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:09:54.744 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:09:54.745 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.743+0000 7f3d084c8980 1 Processor -- start 2024-09-13T06:09:54.745 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.743+0000 7f3d084c8980 1 -- start start 2024-09-13T06:09:54.745 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.743+0000 7f3d084c8980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55cccdbce2a0 0x55cccdc5e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.745 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.743+0000 7f3d084c8980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55cccdae1ae0 con 0x55cccdc5ecf0 2024-09-13T06:09:54.745 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.743+0000 7f3d084c8980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x55cccdb05e30 con 0x55cccdbce2a0 2024-09-13T06:09:54.745 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.743+0000 7f3d05fd8640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55cccdbce2a0 0x55cccdc5e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.746 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.743+0000 7f3d057d7640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x55cccdc5ecf0 0x55cccdc610e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:51000/0 (socket says 172.21.15.194:51000) 2024-09-13T06:09:54.746 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.743+0000 7f3d05fd8640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55cccdbce2a0 0x55cccdc5e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44568/0 (socket says 172.21.15.194:44568) 2024-09-13T06:09:54.746 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.743+0000 7f3d057d7640 1 -- 172.21.15.194:0/2212548992 learned_addr learned my addr 172.21.15.194:0/2212548992 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-09-13T06:09:54.746 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.743+0000 7f3d05fd8640 1 -- 172.21.15.194:0/2212548992 >> v1:172.21.15.120:6789/0 conn(0x55cccdc5ecf0 legacy=0x55cccdc610e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.746 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.743+0000 7f3d05fd8640 1 -- 172.21.15.194:0/2212548992 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cccdbce680 con 0x55cccdbce2a0 2024-09-13T06:09:54.748 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.747+0000 7f3d05fd8640 1 --2- 172.21.15.194:0/2212548992 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55cccdbce2a0 0x55cccdc5e7b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3cf800a480 tx=0x7f3cf801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c9f0e0b6a2ab34e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.748 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.747+0000 7f3d04fd6640 1 -- 172.21.15.194:0/2212548992 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3cf80b0070 con 0x55cccdbce2a0 2024-09-13T06:09:54.748 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.747+0000 7f3d04fd6640 1 -- 172.21.15.194:0/2212548992 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cf80ab540 con 0x55cccdbce2a0 2024-09-13T06:09:54.748 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.747+0000 7f3d04fd6640 1 -- 172.21.15.194:0/2212548992 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3cf80ab840 con 0x55cccdbce2a0 2024-09-13T06:09:54.749 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.747+0000 7f3d084c8980 1 -- 172.21.15.194:0/2212548992 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55cccdbce2a0 msgr2=0x55cccdc5e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.749 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.747+0000 7f3d084c8980 1 --2- 172.21.15.194:0/2212548992 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55cccdbce2a0 0x55cccdc5e7b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3cf800a480 tx=0x7f3cf801b280 comp rx=0 tx=0).stop 2024-09-13T06:09:54.749 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.747+0000 7f3d084c8980 1 -- 172.21.15.194:0/2212548992 shutdown_connections 2024-09-13T06:09:54.749 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.747+0000 7f3d084c8980 1 --2- 172.21.15.194:0/2212548992 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55cccdbce2a0 0x55cccdc5e7b0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.750 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.747+0000 7f3d084c8980 1 -- 172.21.15.194:0/2212548992 >> 172.21.15.194:0/2212548992 conn(0x55cccdc540a0 msgr2=0x55cccdc564c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:54.750 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.747+0000 7f3d084c8980 1 -- 172.21.15.194:0/2212548992 shutdown_connections 2024-09-13T06:09:54.750 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.747+0000 7f3d084c8980 1 -- 172.21.15.194:0/2212548992 wait complete. 2024-09-13T06:09:54.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.759+0000 7f3d084c8980 1 Processor -- start 2024-09-13T06:09:54.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.759+0000 7f3d084c8980 1 -- start start 2024-09-13T06:09:54.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.759+0000 7f3d084c8980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55cccdbce2a0 0x55cccdd46ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.759+0000 7f3d084c8980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55cccdb07200 con 0x55cccdbce2a0 2024-09-13T06:09:54.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.759+0000 7f3d05fd8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55cccdbce2a0 0x55cccdd46ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.759+0000 7f3d05fd8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55cccdbce2a0 0x55cccdd46ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44578/0 (socket says 172.21.15.194:44578) 2024-09-13T06:09:54.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.759+0000 7f3d05fd8640 1 -- 172.21.15.194:0/2993552447 learned_addr learned my addr 172.21.15.194:0/2993552447 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:54.763 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.763+0000 7f3d05fd8640 1 -- 172.21.15.194:0/2993552447 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cccdd472b0 con 0x55cccdbce2a0 2024-09-13T06:09:54.763 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.763+0000 7f3d05fd8640 1 --2- 172.21.15.194:0/2993552447 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55cccdbce2a0 0x55cccdd46ce0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3cf8018eb0 tx=0x7f3cf8003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dcaa8e4b1041c89 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.766 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.763+0000 7f3bf3e07640 1 -- 172.21.15.194:0/2993552447 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3cf80b0070 con 0x55cccdbce2a0 2024-09-13T06:09:54.766 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.767+0000 7f3bf3e07640 1 -- 172.21.15.194:0/2993552447 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cf80b1040 con 0x55cccdbce2a0 2024-09-13T06:09:54.766 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.767+0000 7f3bf3e07640 1 -- 172.21.15.194:0/2993552447 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3cf80ab6f0 con 0x55cccdbce2a0 2024-09-13T06:09:54.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.767+0000 7f3d084c8980 1 -- 172.21.15.194:0/2993552447 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55cccdbce2a0 msgr2=0x55cccdd46ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.767+0000 7f3d084c8980 1 --2- 172.21.15.194:0/2993552447 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55cccdbce2a0 0x55cccdd46ce0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3cf8018eb0 tx=0x7f3cf8003030 comp rx=0 tx=0).stop 2024-09-13T06:09:54.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.767+0000 7f3d084c8980 1 -- 172.21.15.194:0/2993552447 shutdown_connections 2024-09-13T06:09:54.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.767+0000 7f3d084c8980 1 --2- 172.21.15.194:0/2993552447 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55cccdbce2a0 0x55cccdd46ce0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.767+0000 7f3d084c8980 1 -- 172.21.15.194:0/2993552447 >> 172.21.15.194:0/2993552447 conn(0x55cccdc540a0 msgr2=0x55cccdd42910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:54.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.767+0000 7f3d084c8980 1 -- 172.21.15.194:0/2993552447 shutdown_connections 2024-09-13T06:09:54.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.767+0000 7f3d084c8980 1 -- 172.21.15.194:0/2993552447 wait complete. 2024-09-13T06:09:54.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.767+0000 7f3d084c8980 1 Processor -- start 2024-09-13T06:09:54.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.767+0000 7f3d084c8980 1 -- start start 2024-09-13T06:09:54.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.767+0000 7f3d084c8980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55cccdbce2a0 0x55cccdd4deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.767+0000 7f3d084c8980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55cccdc65230 con 0x55cccdbce2a0 2024-09-13T06:09:54.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.767+0000 7f3d05fd8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55cccdbce2a0 0x55cccdd4deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.767+0000 7f3d05fd8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55cccdbce2a0 0x55cccdd4deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44594/0 (socket says 172.21.15.194:44594) 2024-09-13T06:09:54.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.767+0000 7f3d05fd8640 1 -- 172.21.15.194:0/1089329246 learned_addr learned my addr 172.21.15.194:0/1089329246 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:54.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.767+0000 7f3d05fd8640 1 -- 172.21.15.194:0/1089329246 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cccdd4e3f0 con 0x55cccdbce2a0 2024-09-13T06:09:54.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.767+0000 7f3d05fd8640 1 --2- 172.21.15.194:0/1089329246 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55cccdbce2a0 0x55cccdd4deb0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3cf80b9040 tx=0x7f3cf8018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.767+0000 7f3bf2604640 1 -- 172.21.15.194:0/1089329246 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3cf80b75b0 con 0x55cccdbce2a0 2024-09-13T06:09:54.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.767+0000 7f3d084c8980 1 -- 172.21.15.194:0/1089329246 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cccdd4e680 con 0x55cccdbce2a0 2024-09-13T06:09:54.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.767+0000 7f3d084c8980 1 -- 172.21.15.194:0/1089329246 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cccdd51360 con 0x55cccdbce2a0 2024-09-13T06:09:54.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.767+0000 7f3bf2604640 1 -- 172.21.15.194:0/1089329246 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cf80b7750 con 0x55cccdbce2a0 2024-09-13T06:09:54.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.767+0000 7f3bf2604640 1 -- 172.21.15.194:0/1089329246 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3cf80cf060 con 0x55cccdbce2a0 2024-09-13T06:09:54.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.771+0000 7f3bf2604640 1 -- 172.21.15.194:0/1089329246 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3cf80b7a30 con 0x55cccdbce2a0 2024-09-13T06:09:54.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.771+0000 7f3bf2604640 1 --2- 172.21.15.194:0/1089329246 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3bec0346a0 0x7f3bec036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.771+0000 7f3bf2604640 1 -- 172.21.15.194:0/1089329246 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f3cf80bc070 con 0x55cccdbce2a0 2024-09-13T06:09:54.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.771+0000 7f3d057d7640 1 --2- 172.21.15.194:0/1089329246 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3bec0346a0 0x7f3bec036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.772 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.771+0000 7f3d084c8980 1 --2- 172.21.15.194:0/1089329246 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55cccdc5ecf0 0x55cccdd54e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.772 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.771+0000 7f3d084c8980 1 -- 172.21.15.194:0/1089329246 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd55410 con 0x55cccdc5ecf0 2024-09-13T06:09:54.772 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.771+0000 7f3d067d9640 1 --2- 172.21.15.194:0/1089329246 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55cccdc5ecf0 0x55cccdd54e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.774 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.771+0000 7f3d057d7640 1 --2- 172.21.15.194:0/1089329246 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3bec0346a0 0x7f3bec036b60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc000f70 tx=0x7f3cfc0012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.774 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.771+0000 7f3d067d9640 1 --2- 172.21.15.194:0/1089329246 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55cccdc5ecf0 0x55cccdd54e40 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.774 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.771+0000 7f3d067d9640 1 -- 172.21.15.194:0/1089329246 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3d0000a4d0 con 0x55cccdc5ecf0 2024-09-13T06:09:54.775 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.771+0000 7f3d084c8980 1 -- 172.21.15.194:0/1089329246 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd52580 con 0x55cccdc5ecf0 2024-09-13T06:09:54.775 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.771+0000 7f3d067d9640 1 -- 172.21.15.194:0/1089329246 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3d0000a4d0 con 0x55cccdc5ecf0 2024-09-13T06:09:54.775 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.771+0000 7f3d084c8980 1 --2- 172.21.15.194:0/1089329246 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55cccdd57760 0x55cccdd59b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.775 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.771+0000 7f3d084c8980 1 -- 172.21.15.194:0/1089329246 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd5a220 con 0x55cccdd57760 2024-09-13T06:09:54.775 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.771+0000 7f3d05fd8640 1 --2- 172.21.15.194:0/1089329246 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55cccdd57760 0x55cccdd59b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.775 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.771+0000 7f3d05fd8640 1 --2- 172.21.15.194:0/1089329246 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55cccdd57760 0x55cccdd59b50 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.775 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.771+0000 7f3d05fd8640 1 -- 172.21.15.194:0/1089329246 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3cf80cace0 con 0x55cccdd57760 2024-09-13T06:09:54.775 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.771+0000 7f3d084c8980 1 -- 172.21.15.194:0/1089329246 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd56600 con 0x55cccdc5ecf0 2024-09-13T06:09:54.775 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.771+0000 7f3d067d9640 1 -- 172.21.15.194:0/1089329246 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3d0000a4d0 con 0x55cccdc5ecf0 2024-09-13T06:09:54.775 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.771+0000 7f3d084c8980 1 --2- 172.21.15.194:0/1089329246 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55cccdd5b660 0x55cccdd5da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.775 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.771+0000 7f3d084c8980 1 -- 172.21.15.194:0/1089329246 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd5e1e0 con 0x55cccdd5b660 2024-09-13T06:09:54.775 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.771+0000 7f3d057d7640 1 --2- 172.21.15.194:0/1089329246 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55cccdd5b660 0x55cccdd5da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.776 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.771+0000 7f3d057d7640 1 --2- 172.21.15.194:0/1089329246 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55cccdd5b660 0x55cccdd5da50 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.776 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.771+0000 7f3d057d7640 1 -- 172.21.15.194:0/1089329246 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3cfc00e620 con 0x55cccdd5b660 2024-09-13T06:09:54.776 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.771+0000 7f3d084c8980 1 Processor -- start 2024-09-13T06:09:54.776 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.771+0000 7f3d084c8980 1 -- start start 2024-09-13T06:09:54.776 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.771+0000 7f3d084c8980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55cccdd6bc70 0x55cccdd6c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.776 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.771+0000 7f3d084c8980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55cccdb60800 con 0x55cccdd6bc70 2024-09-13T06:09:54.776 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.775+0000 7f3d05fd8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55cccdd6bc70 0x55cccdd6c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.776 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.775+0000 7f3d05fd8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55cccdd6bc70 0x55cccdd6c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44608/0 (socket says 172.21.15.194:44608) 2024-09-13T06:09:54.776 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.775+0000 7f3d05fd8640 1 -- 172.21.15.194:0/3459736510 learned_addr learned my addr 172.21.15.194:0/3459736510 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:54.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.775+0000 7f3d05fd8640 1 -- 172.21.15.194:0/3459736510 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cccdd6c5d0 con 0x55cccdd6bc70 2024-09-13T06:09:54.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.775+0000 7f3d05fd8640 1 --2- 172.21.15.194:0/3459736510 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55cccdd6bc70 0x55cccdd6c090 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3cf800a480 tx=0x7f3cf80a40a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.775+0000 7f3beb7fe640 1 -- 172.21.15.194:0/3459736510 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3cf80aab00 con 0x55cccdd6bc70 2024-09-13T06:09:54.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.775+0000 7f3d084c8980 1 -- 172.21.15.194:0/3459736510 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cccdd6c800 con 0x55cccdd6bc70 2024-09-13T06:09:54.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.775+0000 7f3d084c8980 1 -- 172.21.15.194:0/3459736510 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cccdd6c800 con 0x55cccdd6bc70 2024-09-13T06:09:54.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.775+0000 7f3beb7fe640 1 -- 172.21.15.194:0/3459736510 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cf80aaca0 con 0x55cccdd6bc70 2024-09-13T06:09:54.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.775+0000 7f3beb7fe640 1 -- 172.21.15.194:0/3459736510 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3cf80aa570 con 0x55cccdd6bc70 2024-09-13T06:09:54.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.775+0000 7f3beb7fe640 1 -- 172.21.15.194:0/3459736510 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3cf80aa710 con 0x55cccdd6bc70 2024-09-13T06:09:54.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.775+0000 7f3beb7fe640 1 --2- 172.21.15.194:0/3459736510 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3be0034650 0x7f3be0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.775+0000 7f3beb7fe640 1 -- 172.21.15.194:0/3459736510 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f3cf80a8070 con 0x55cccdd6bc70 2024-09-13T06:09:54.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.775+0000 7f3d057d7640 1 --2- 172.21.15.194:0/3459736510 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3be0034650 0x7f3be0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.775+0000 7f3d084c8980 1 Processor -- start 2024-09-13T06:09:54.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.775+0000 7f3d084c8980 1 -- start start 2024-09-13T06:09:54.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.775+0000 7f3d057d7640 1 --2- 172.21.15.194:0/3459736510 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3be0034650 0x7f3be0036b10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc00bf60 tx=0x7f3cfc00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.775+0000 7f3d084c8980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55cccdd78230 0x55cccdd78610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.775+0000 7f3d084c8980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55cccdd47570 con 0x55cccdd78230 2024-09-13T06:09:54.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.775+0000 7f3d05fd8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55cccdd78230 0x55cccdd78610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.775+0000 7f3d05fd8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55cccdd78230 0x55cccdd78610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44618/0 (socket says 172.21.15.194:44618) 2024-09-13T06:09:54.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.775+0000 7f3d05fd8640 1 -- 172.21.15.194:0/3028201809 learned_addr learned my addr 172.21.15.194:0/3028201809 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:54.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.775+0000 7f3d05fd8640 1 -- 172.21.15.194:0/3028201809 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cccdd78be0 con 0x55cccdd78230 2024-09-13T06:09:54.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.779+0000 7f3d05fd8640 1 --2- 172.21.15.194:0/3028201809 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55cccdd78230 0x55cccdd78610 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3cf80c1b10 tx=0x7f3cf80af2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f22e80a14d479dbd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.779+0000 7f3be97fa640 1 -- 172.21.15.194:0/3028201809 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3cf80095c0 con 0x55cccdd78230 2024-09-13T06:09:54.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.779+0000 7f3be97fa640 1 -- 172.21.15.194:0/3028201809 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cf80fd030 con 0x55cccdd78230 2024-09-13T06:09:54.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.779+0000 7f3be97fa640 1 -- 172.21.15.194:0/3028201809 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3cf80b3270 con 0x55cccdd78230 2024-09-13T06:09:54.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.779+0000 7f3d084c8980 1 -- 172.21.15.194:0/3028201809 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55cccdd78230 msgr2=0x55cccdd78610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.779+0000 7f3d084c8980 1 --2- 172.21.15.194:0/3028201809 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55cccdd78230 0x55cccdd78610 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3cf80c1b10 tx=0x7f3cf80af2a0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.779+0000 7f3d084c8980 1 -- 172.21.15.194:0/3028201809 shutdown_connections 2024-09-13T06:09:54.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.779+0000 7f3d084c8980 1 --2- 172.21.15.194:0/3028201809 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55cccdd78230 0x55cccdd78610 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.779+0000 7f3d084c8980 1 -- 172.21.15.194:0/3028201809 >> 172.21.15.194:0/3028201809 conn(0x55cccdd74610 msgr2=0x55cccdd72710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:54.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.779+0000 7f3d084c8980 1 -- 172.21.15.194:0/3028201809 shutdown_connections 2024-09-13T06:09:54.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.779+0000 7f3d084c8980 1 -- 172.21.15.194:0/3028201809 wait complete. 2024-09-13T06:09:54.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.779+0000 7f3d084c8980 1 Processor -- start 2024-09-13T06:09:54.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.779+0000 7f3d084c8980 1 -- start start 2024-09-13T06:09:54.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.779+0000 7f3d084c8980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55cccdd78230 0x55cccdd7f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.779+0000 7f3d084c8980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55cccdd79080 con 0x55cccdd78230 2024-09-13T06:09:54.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.779+0000 7f3d05fd8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55cccdd78230 0x55cccdd7f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.779+0000 7f3d05fd8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55cccdd78230 0x55cccdd7f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44624/0 (socket says 172.21.15.194:44624) 2024-09-13T06:09:54.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.779+0000 7f3d05fd8640 1 -- 172.21.15.194:0/2617242217 learned_addr learned my addr 172.21.15.194:0/2617242217 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:54.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.779+0000 7f3d05fd8640 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cccdd7f930 con 0x55cccdd78230 2024-09-13T06:09:54.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.779+0000 7f3d05fd8640 1 --2- 172.21.15.194:0/2617242217 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55cccdd78230 0x55cccdd7f3f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3cf80c1b10 tx=0x7f3cf80e2590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.779+0000 7f3bd77fe640 1 -- 172.21.15.194:0/2617242217 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3cf80af170 con 0x55cccdd78230 2024-09-13T06:09:54.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.779+0000 7f3d084c8980 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cccdd7f930 con 0x55cccdd78230 2024-09-13T06:09:54.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.779+0000 7f3d084c8980 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cccdd7f930 con 0x55cccdd78230 2024-09-13T06:09:54.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.779+0000 7f3bd77fe640 1 -- 172.21.15.194:0/2617242217 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cf80db5f0 con 0x55cccdd78230 2024-09-13T06:09:54.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.779+0000 7f3bd77fe640 1 -- 172.21.15.194:0/2617242217 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3cf80ca570 con 0x55cccdd78230 2024-09-13T06:09:54.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.783+0000 7f3bd77fe640 1 -- 172.21.15.194:0/2617242217 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3cf80073f0 con 0x55cccdd78230 2024-09-13T06:09:54.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.783+0000 7f3bd77fe640 1 --2- 172.21.15.194:0/2617242217 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3bd0034600 0x7f3bd0036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.783+0000 7f3d084c8980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.783+0000 7f3bd77fe640 1 -- 172.21.15.194:0/2617242217 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f3cf810a070 con 0x55cccdd78230 2024-09-13T06:09:54.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.783+0000 7f3d057d7640 1 --2- 172.21.15.194:0/2617242217 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3bd0034600 0x7f3bd0036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.783+0000 7f3d084c8980 1 --2- 172.21.15.194:0/2617242217 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55cccdd8a380 0x55cccdd8c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.783+0000 7f3d084c8980 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd8cf90 con 0x55cccdd8a380 2024-09-13T06:09:54.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.783+0000 7f3d067d9640 1 --2- 172.21.15.194:0/2617242217 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55cccdd8a380 0x55cccdd8c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.783+0000 7f3d057d7640 1 --2- 172.21.15.194:0/2617242217 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3bd0034600 0x7f3bd0036ac0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x55cccdd5e5e0 tx=0x7f3cfc010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.783+0000 7f3d067d9640 1 --2- 172.21.15.194:0/2617242217 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55cccdd8a380 0x55cccdd8c840 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.783+0000 7f3d067d9640 1 -- 172.21.15.194:0/2617242217 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3d0000a4d0 con 0x55cccdd8a380 2024-09-13T06:09:54.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.783+0000 7f3d084c8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:54.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.783+0000 7f3d084c8980 20 realm 2024-09-13T06:09:54.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.783+0000 7f3d084c8980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.783+0000 7f3d084c8980 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd8d3a0 con 0x55cccdd8a380 2024-09-13T06:09:54.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.783+0000 7f3d067d9640 1 -- 172.21.15.194:0/2617242217 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3d0000a4d0 con 0x55cccdd8a380 2024-09-13T06:09:54.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.783+0000 7f3d084c8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:54.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.783+0000 7f3d084c8980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:09:54.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.783+0000 7f3d084c8980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.783+0000 7f3d084c8980 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd8dc40 con 0x55cccdd8a380 2024-09-13T06:09:54.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.783+0000 7f3d067d9640 1 -- 172.21.15.194:0/2617242217 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3d0000a4d0 con 0x55cccdd8a380 2024-09-13T06:09:54.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.783+0000 7f3d084c8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:54.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.783+0000 7f3d084c8980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.783+0000 7f3d084c8980 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd8dfe0 con 0x55cccdd8a380 2024-09-13T06:09:54.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.783+0000 7f3d067d9640 1 -- 172.21.15.194:0/2617242217 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3d0000a4d0 con 0x55cccdd8a380 2024-09-13T06:09:54.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.783+0000 7f3d084c8980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:54.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.783+0000 7f3d084c8980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.783+0000 7f3d084c8980 1 --2- 172.21.15.194:0/2617242217 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55cccdd8ed40 0x55cccdd91130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.783+0000 7f3d084c8980 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd91780 con 0x55cccdd8ed40 2024-09-13T06:09:54.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.783+0000 7f3d05fd8640 1 --2- 172.21.15.194:0/2617242217 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55cccdd8ed40 0x55cccdd91130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.783+0000 7f3d05fd8640 1 --2- 172.21.15.194:0/2617242217 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55cccdd8ed40 0x55cccdd91130 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.783+0000 7f3d05fd8640 1 -- 172.21.15.194:0/2617242217 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3cf8113020 con 0x55cccdd8ed40 2024-09-13T06:09:54.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.783+0000 7f3d084c8980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:09:54.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.783+0000 7f3d084c8980 20 searching for the correct realm 2024-09-13T06:09:54.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.783+0000 7f3d084c8980 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd92fe0 con 0x55cccdd8ed40 2024-09-13T06:09:54.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.783+0000 7f3d05fd8640 1 -- 172.21.15.194:0/2617242217 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3cf8113020 con 0x55cccdd8ed40 2024-09-13T06:09:54.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.783+0000 7f3d05fd8640 1 --2- 172.21.15.194:0/2617242217 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f3cf810d030 0x7f3cf80af900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.783+0000 7f3d05fd8640 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd92fe0 con 0x7f3cf810d030 2024-09-13T06:09:54.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.783+0000 7f3d057d7640 1 --2- 172.21.15.194:0/2617242217 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f3cf810d030 0x7f3cf80af900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.783+0000 7f3d057d7640 1 --2- 172.21.15.194:0/2617242217 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f3cf810d030 0x7f3cf80af900 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.787+0000 7f3d057d7640 1 -- 172.21.15.194:0/2617242217 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3cfc00e620 con 0x7f3cf810d030 2024-09-13T06:09:54.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.787+0000 7f3d057d7640 1 --2- 172.21.15.194:0/2617242217 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f3cfc037040 0x7f3cfc036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.787+0000 7f3d057d7640 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd92fe0 con 0x7f3cfc037040 2024-09-13T06:09:54.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.787+0000 7f3d067d9640 1 --2- 172.21.15.194:0/2617242217 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f3cfc037040 0x7f3cfc036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.787+0000 7f3d067d9640 1 --2- 172.21.15.194:0/2617242217 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f3cfc037040 0x7f3cfc036410 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.787+0000 7f3d067d9640 1 -- 172.21.15.194:0/2617242217 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d0000a4d0 con 0x7f3cfc037040 2024-09-13T06:09:54.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.787+0000 7f3d067d9640 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd8dfe0 con 0x55cccdd8a380 2024-09-13T06:09:54.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.787+0000 7f3d067d9640 1 -- 172.21.15.194:0/2617242217 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d0000a4d0 con 0x55cccdd8a380 2024-09-13T06:09:54.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.787+0000 7f3d067d9640 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd8dfe0 con 0x55cccdd8a380 2024-09-13T06:09:54.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.787+0000 7f3d067d9640 1 -- 172.21.15.194:0/2617242217 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d0000a4d0 con 0x55cccdd8a380 2024-09-13T06:09:54.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.787+0000 7f3d067d9640 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd8dfe0 con 0x7f3cfc037040 2024-09-13T06:09:54.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.787+0000 7f3d067d9640 1 -- 172.21.15.194:0/2617242217 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d0000a4d0 con 0x7f3cfc037040 2024-09-13T06:09:54.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.787+0000 7f3d067d9640 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd8dfe0 con 0x7f3cfc037040 2024-09-13T06:09:54.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.787+0000 7f3d067d9640 1 -- 172.21.15.194:0/2617242217 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d0000a4d0 con 0x7f3cfc037040 2024-09-13T06:09:54.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.787+0000 7f3d067d9640 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd8dfe0 con 0x7f3cf810d030 2024-09-13T06:09:54.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.787+0000 7f3d057d7640 1 -- 172.21.15.194:0/2617242217 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3cfc00e620 con 0x7f3cf810d030 2024-09-13T06:09:54.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.787+0000 7f3d057d7640 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd8dfe0 con 0x55cccdd8ed40 2024-09-13T06:09:54.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.787+0000 7f3d05fd8640 1 -- 172.21.15.194:0/2617242217 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3cf8113020 con 0x55cccdd8ed40 2024-09-13T06:09:54.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.787+0000 7f3d05fd8640 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd8dfe0 con 0x55cccdd8a380 2024-09-13T06:09:54.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.787+0000 7f3d067d9640 1 -- 172.21.15.194:0/2617242217 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d0000a4d0 con 0x55cccdd8a380 2024-09-13T06:09:54.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.787+0000 7f3d067d9640 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd8dfe0 con 0x7f3cfc037040 2024-09-13T06:09:54.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.791+0000 7f3d067d9640 1 -- 172.21.15.194:0/2617242217 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d0000a4d0 con 0x7f3cfc037040 2024-09-13T06:09:54.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.791+0000 7f3d067d9640 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd8dfe0 con 0x55cccdd8a380 2024-09-13T06:09:54.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.791+0000 7f3d067d9640 1 -- 172.21.15.194:0/2617242217 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d0000a4d0 con 0x55cccdd8a380 2024-09-13T06:09:54.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.791+0000 7f3d067d9640 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd8dfe0 con 0x7f3cf810d030 2024-09-13T06:09:54.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.791+0000 7f3d057d7640 1 -- 172.21.15.194:0/2617242217 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3cfc00e620 con 0x7f3cf810d030 2024-09-13T06:09:54.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.791+0000 7f3d057d7640 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd8dfe0 con 0x55cccdd8ed40 2024-09-13T06:09:54.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.791+0000 7f3d05fd8640 1 -- 172.21.15.194:0/2617242217 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3cf8113020 con 0x55cccdd8ed40 2024-09-13T06:09:54.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.791+0000 7f3d05fd8640 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd8dfe0 con 0x55cccdd8ed40 2024-09-13T06:09:54.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.791+0000 7f3d05fd8640 1 -- 172.21.15.194:0/2617242217 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3cf8113020 con 0x55cccdd8ed40 2024-09-13T06:09:54.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.791+0000 7f3d05fd8640 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd8dfe0 con 0x7f3cfc037040 2024-09-13T06:09:54.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.791+0000 7f3d067d9640 1 -- 172.21.15.194:0/2617242217 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d0000a4d0 con 0x7f3cfc037040 2024-09-13T06:09:54.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.791+0000 7f3d067d9640 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd8dfe0 con 0x55cccdd8ed40 2024-09-13T06:09:54.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.791+0000 7f3d05fd8640 1 -- 172.21.15.194:0/2617242217 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3cf8113020 con 0x55cccdd8ed40 2024-09-13T06:09:54.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.791+0000 7f3d05fd8640 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd8dfe0 con 0x55cccdd8ed40 2024-09-13T06:09:54.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.791+0000 7f3d05fd8640 1 -- 172.21.15.194:0/2617242217 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3cf8113020 con 0x55cccdd8ed40 2024-09-13T06:09:54.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.791+0000 7f3d05fd8640 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd8dfe0 con 0x55cccdd8a380 2024-09-13T06:09:54.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.791+0000 7f3d067d9640 1 -- 172.21.15.194:0/2617242217 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d0000a4d0 con 0x55cccdd8a380 2024-09-13T06:09:54.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.791+0000 7f3d067d9640 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd8dfe0 con 0x55cccdd8a380 2024-09-13T06:09:54.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.791+0000 7f3d067d9640 1 -- 172.21.15.194:0/2617242217 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3d0000a4d0 con 0x55cccdd8a380 2024-09-13T06:09:54.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.791+0000 7f3d067d9640 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd8dfe0 con 0x7f3cfc037040 2024-09-13T06:09:54.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.791+0000 7f3d067d9640 1 -- 172.21.15.194:0/2617242217 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d0000a4d0 con 0x7f3cfc037040 2024-09-13T06:09:54.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.791+0000 7f3d067d9640 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd8dfe0 con 0x55cccdd8ed40 2024-09-13T06:09:54.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.795+0000 7f3d05fd8640 1 -- 172.21.15.194:0/2617242217 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3cf8113020 con 0x55cccdd8ed40 2024-09-13T06:09:54.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.795+0000 7f3d05fd8640 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd8dfe0 con 0x7f3cf810d030 2024-09-13T06:09:54.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.795+0000 7f3d057d7640 1 -- 172.21.15.194:0/2617242217 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3cfc00e620 con 0x7f3cf810d030 2024-09-13T06:09:54.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.795+0000 7f3d057d7640 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd8dfe0 con 0x55cccdd8a380 2024-09-13T06:09:54.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.795+0000 7f3d067d9640 1 -- 172.21.15.194:0/2617242217 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d0000a4d0 con 0x55cccdd8a380 2024-09-13T06:09:54.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.795+0000 7f3d067d9640 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd8dfe0 con 0x7f3cfc037040 2024-09-13T06:09:54.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.795+0000 7f3d067d9640 1 -- 172.21.15.194:0/2617242217 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d0000a4d0 con 0x7f3cfc037040 2024-09-13T06:09:54.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.795+0000 7f3d067d9640 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd8dfe0 con 0x55cccdd8ed40 2024-09-13T06:09:54.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.795+0000 7f3d05fd8640 1 -- 172.21.15.194:0/2617242217 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3cf8113020 con 0x55cccdd8ed40 2024-09-13T06:09:54.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.795+0000 7f3d05fd8640 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd8dfe0 con 0x7f3cfc037040 2024-09-13T06:09:54.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.795+0000 7f3d067d9640 1 -- 172.21.15.194:0/2617242217 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d0000a4d0 con 0x7f3cfc037040 2024-09-13T06:09:54.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.795+0000 7f3d067d9640 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd8dfe0 con 0x7f3cf810d030 2024-09-13T06:09:54.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.795+0000 7f3d057d7640 1 -- 172.21.15.194:0/2617242217 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3cfc00e620 con 0x7f3cf810d030 2024-09-13T06:09:54.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.795+0000 7f3d057d7640 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd8dfe0 con 0x55cccdd8ed40 2024-09-13T06:09:54.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.795+0000 7f3d05fd8640 1 -- 172.21.15.194:0/2617242217 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3cf8113020 con 0x55cccdd8ed40 2024-09-13T06:09:54.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.795+0000 7f3d05fd8640 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd8dfe0 con 0x7f3cfc037040 2024-09-13T06:09:54.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.795+0000 7f3d067d9640 1 -- 172.21.15.194:0/2617242217 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d0000a4d0 con 0x7f3cfc037040 2024-09-13T06:09:54.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.795+0000 7f3d067d9640 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd8dfe0 con 0x55cccdd8a380 2024-09-13T06:09:54.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.795+0000 7f3d067d9640 1 -- 172.21.15.194:0/2617242217 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3d0000a4d0 con 0x55cccdd8a380 2024-09-13T06:09:54.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.795+0000 7f3d067d9640 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd8dfe0 con 0x7f3cf810d030 2024-09-13T06:09:54.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.795+0000 7f3d057d7640 1 -- 172.21.15.194:0/2617242217 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3cfc00e620 con 0x7f3cf810d030 2024-09-13T06:09:54.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.795+0000 7f3d084c8980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:09:54.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.795+0000 7f3d084c8980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:09:54.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.795+0000 7f3d084c8980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:09:54.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.795+0000 7f3d084c8980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:09:54.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.795+0000 7f3d084c8980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:09:54.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.795+0000 7f3d084c8980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:09:54.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.795+0000 7f3d084c8980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.795+0000 7f3d084c8980 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd92100 con 0x55cccdd8a380 2024-09-13T06:09:54.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.795+0000 7f3d067d9640 1 -- 172.21.15.194:0/2617242217 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3d0000a4d0 con 0x55cccdd8a380 2024-09-13T06:09:54.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.795+0000 7f3d084c8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:54.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.795+0000 7f3d084c8980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.795+0000 7f3d084c8980 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd92950 con 0x55cccdd8a380 2024-09-13T06:09:54.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.795+0000 7f3d067d9640 1 -- 172.21.15.194:0/2617242217 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3d0000a4d0 con 0x55cccdd8a380 2024-09-13T06:09:54.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.799+0000 7f3d084c8980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:54.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.799+0000 7f3d084c8980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.799+0000 7f3d084c8980 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd924a0 con 0x7f3cf810d030 2024-09-13T06:09:54.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.799+0000 7f3d057d7640 1 -- 172.21.15.194:0/2617242217 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3cfc00e620 con 0x7f3cf810d030 2024-09-13T06:09:54.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.799+0000 7f3d084c8980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:09:54.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.799+0000 7f3d084c8980 20 zone default found 2024-09-13T06:09:54.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.799+0000 7f3d084c8980 4 Realm: () 2024-09-13T06:09:54.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.799+0000 7f3d084c8980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:09:54.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.799+0000 7f3d084c8980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:09:54.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.799+0000 7f3d084c8980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:09:54.808 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.799+0000 7f3d084c8980 20 zonegroup default 2024-09-13T06:09:54.808 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.799+0000 7f3d084c8980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.808 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.799+0000 7f3d084c8980 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd93410 con 0x7f3cfc037040 2024-09-13T06:09:54.808 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.799+0000 7f3d067d9640 1 -- 172.21.15.194:0/2617242217 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3d0000a4d0 con 0x7f3cfc037040 2024-09-13T06:09:54.808 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.799+0000 7f3d084c8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:54.808 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.799+0000 7f3d084c8980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.808 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.799+0000 7f3d084c8980 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd94e80 con 0x55cccdd8ed40 2024-09-13T06:09:54.808 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.799+0000 7f3d05fd8640 1 -- 172.21.15.194:0/2617242217 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3cf8113020 con 0x55cccdd8ed40 2024-09-13T06:09:54.808 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.799+0000 7f3d084c8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:54.808 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.799+0000 7f3d084c8980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.808 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.799+0000 7f3d084c8980 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd95390 con 0x55cccdd8ed40 2024-09-13T06:09:54.808 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.799+0000 7f3d05fd8640 1 -- 172.21.15.194:0/2617242217 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3cf8113020 con 0x55cccdd8ed40 2024-09-13T06:09:54.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.799+0000 7f3d084c8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:54.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.799+0000 7f3d084c8980 20 started sync module instance, tier type = 2024-09-13T06:09:54.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.799+0000 7f3d084c8980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:09:54.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.799+0000 7f3d084c8980 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd94290 con 0x7f3cf810d030 2024-09-13T06:09:54.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.799+0000 7f3d057d7640 1 -- 172.21.15.194:0/2617242217 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(44 notify.0 [create] v33'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3cfc00e620 con 0x7f3cf810d030 2024-09-13T06:09:54.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.799+0000 7f3d084c8980 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94338115257984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd93ef0 con 0x7f3cf810d030 2024-09-13T06:09:54.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.799+0000 7f3d084c8980 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd962c0 con 0x55cccdd8a380 2024-09-13T06:09:54.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.799+0000 7f3d057d7640 1 -- 172.21.15.194:0/2617242217 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94338115257984] v33'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3cfc00e620 con 0x7f3cf810d030 2024-09-13T06:09:54.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.803+0000 7f3d067d9640 1 -- 172.21.15.194:0/2617242217 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v33'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d0000a4d0 con 0x55cccdd8a380 2024-09-13T06:09:54.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.803+0000 7f3d084c8980 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94338115264016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd966e0 con 0x55cccdd8a380 2024-09-13T06:09:54.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.803+0000 7f3d084c8980 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd96f90 con 0x55cccdd8ed40 2024-09-13T06:09:54.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.803+0000 7f3d067d9640 1 -- 172.21.15.194:0/2617242217 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94338115264016] v33'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d0000a4d0 con 0x55cccdd8a380 2024-09-13T06:09:54.812 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.803+0000 7f3d05fd8640 1 -- 172.21.15.194:0/2617242217 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v33'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3cf8113020 con 0x55cccdd8ed40 2024-09-13T06:09:54.812 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.803+0000 7f3d084c8980 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94338115265344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd97380 con 0x55cccdd8ed40 2024-09-13T06:09:54.812 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.803+0000 7f3d084c8980 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd97d40 con 0x7f3cf810d030 2024-09-13T06:09:54.812 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.807+0000 7f3d057d7640 1 -- 172.21.15.194:0/2617242217 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(50 notify.3 [create] v33'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3cfc00e620 con 0x7f3cf810d030 2024-09-13T06:09:54.812 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.807+0000 7f3d084c8980 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94338115272928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd989b0 con 0x7f3cf810d030 2024-09-13T06:09:54.812 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.807+0000 7f3d084c8980 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd99370 con 0x55cccdd8a380 2024-09-13T06:09:54.812 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.807+0000 7f3d05fd8640 1 -- 172.21.15.194:0/2617242217 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94338115265344] v33'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3cf8113020 con 0x55cccdd8ed40 2024-09-13T06:09:54.812 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.807+0000 7f3d057d7640 1 -- 172.21.15.194:0/2617242217 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94338115272928] v33'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3cfc00e620 con 0x7f3cf810d030 2024-09-13T06:09:54.812 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.807+0000 7f3d067d9640 1 -- 172.21.15.194:0/2617242217 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v33'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d0000a4d0 con 0x55cccdd8a380 2024-09-13T06:09:54.812 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.807+0000 7f3d084c8980 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94338115276480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd989b0 con 0x55cccdd8a380 2024-09-13T06:09:54.812 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.807+0000 7f3d084c8980 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd992e0 con 0x7f3cfc037040 2024-09-13T06:09:54.812 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.807+0000 7f3d067d9640 1 -- 172.21.15.194:0/2617242217 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94338115276480] v33'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d0000a4d0 con 0x55cccdd8a380 2024-09-13T06:09:54.813 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.807+0000 7f3d067d9640 1 -- 172.21.15.194:0/2617242217 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(54 notify.5 [create] v33'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d0000a4d0 con 0x7f3cfc037040 2024-09-13T06:09:54.813 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.807+0000 7f3d084c8980 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94338115273984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd98920 con 0x7f3cfc037040 2024-09-13T06:09:54.813 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.807+0000 7f3d084c8980 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd9a1a0 con 0x7f3cfc037040 2024-09-13T06:09:54.813 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.811+0000 7f3d067d9640 1 -- 172.21.15.194:0/2617242217 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(56 notify.6 [create] v33'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d0000a4d0 con 0x7f3cfc037040 2024-09-13T06:09:54.813 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.811+0000 7f3d084c8980 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94338115280112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd9a5c0 con 0x7f3cfc037040 2024-09-13T06:09:54.814 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.811+0000 7f3d084c8980 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd9b0e0 con 0x7f3cfc037040 2024-09-13T06:09:54.814 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.811+0000 7f3d067d9640 1 -- 172.21.15.194:0/2617242217 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94338115273984] v33'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d0000a4d0 con 0x7f3cfc037040 2024-09-13T06:09:54.814 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.811+0000 7f3d067d9640 1 -- 172.21.15.194:0/2617242217 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94338115280112] v33'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d0000a4d0 con 0x7f3cfc037040 2024-09-13T06:09:54.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.815+0000 7f3d067d9640 1 -- 172.21.15.194:0/2617242217 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(58 notify.7 [create] v33'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d0000a4d0 con 0x7f3cfc037040 2024-09-13T06:09:54.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.815+0000 7f3d084c8980 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94338115283888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd9a110 con 0x7f3cfc037040 2024-09-13T06:09:54.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.815+0000 7f3d084c8980 20 add_watcher() i=0 2024-09-13T06:09:54.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.815+0000 7f3d084c8980 20 add_watcher() i=1 2024-09-13T06:09:54.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.815+0000 7f3d084c8980 20 add_watcher() i=2 2024-09-13T06:09:54.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.815+0000 7f3d084c8980 20 add_watcher() i=3 2024-09-13T06:09:54.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.815+0000 7f3d084c8980 20 add_watcher() i=4 2024-09-13T06:09:54.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.815+0000 7f3d084c8980 20 add_watcher() i=5 2024-09-13T06:09:54.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.815+0000 7f3d084c8980 20 add_watcher() i=6 2024-09-13T06:09:54.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.815+0000 7f3d067d9640 1 -- 172.21.15.194:0/2617242217 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94338115283888] v33'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d0000a4d0 con 0x7f3cfc037040 2024-09-13T06:09:54.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.815+0000 7f3d084c8980 20 add_watcher() i=7 2024-09-13T06:09:54.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.815+0000 7f3d084c8980 2 all 8 watchers are set, enabling cache 2024-09-13T06:09:54.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.815+0000 7f3d084c8980 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd9e1e0 con 0x55cccdd8a380 2024-09-13T06:09:54.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.815+0000 7f3d067d9640 1 -- 172.21.15.194:0/2617242217 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3d0000a4d0 con 0x55cccdd8a380 2024-09-13T06:09:54.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.815+0000 7f3d084c8980 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94338115278464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd9b660 con 0x55cccdd8a380 2024-09-13T06:09:54.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.815+0000 7f3d067d9640 1 -- 172.21.15.194:0/2617242217 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94338115278464] v33'68 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3d0000a4d0 con 0x55cccdd8a380 2024-09-13T06:09:54.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.815+0000 7f3bb77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:54.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.815+0000 7f3d084c8980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:09:54.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.815+0000 7f3d084c8980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:09:54.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.815+0000 7f3d084c8980 5 note: GC not initialized 2024-09-13T06:09:54.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.815+0000 7f3bb67fc640 20 reqs_thread_entry: start 2024-09-13T06:09:54.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.815+0000 7f3d084c8980 20 init_complete bucket index max shards: 11 2024-09-13T06:09:54.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.815+0000 7f3d084c8980 20 Filter name: none 2024-09-13T06:09:54.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.819+0000 7f3b27fff640 20 reqs_thread_entry: start 2024-09-13T06:09:54.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.819+0000 7f3d084c8980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T06:09:54.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.819+0000 7f3d084c8980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.819+0000 7f3d084c8980 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cccddc1640 con 0x55cccdd8a380 2024-09-13T06:09:54.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.819+0000 7f3d067d9640 1 -- 172.21.15.194:0/2617242217 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7f3d0000a4d0 con 0x55cccdd8a380 2024-09-13T06:09:54.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.819+0000 7f3d084c8980 20 rados_obj.operate() r=0 bl.length=502 2024-09-13T06:09:54.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.819+0000 7f3d084c8980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T06:09:54.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.819+0000 7f3d084c8980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:09:54.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.819+0000 7f3d084c8980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:09:54.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.819+0000 7f3d084c8980 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cccddc7cb0 con 0x55cccdd8a380 2024-09-13T06:09:54.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.819+0000 7f3d067d9640 1 -- 172.21.15.194:0/2617242217 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v33'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f3d0000a4d0 con 0x55cccdd8a380 2024-09-13T06:09:54.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.819+0000 7f3d084c8980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T06:09:54.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.819+0000 7f3d084c8980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:09:54.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.819+0000 7f3d084c8980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T06:09:54.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.819+0000 7f3d084c8980 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94338115467040 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cccddc3380 con 0x55cccdd8a380 2024-09-13T06:09:54.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.819+0000 7f3d067d9640 1 -- 172.21.15.194:0/2617242217 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== watch-notify(notify (1) cookie 94338115276480 notify 141733920772 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f3d0002d040 con 0x55cccdd8a380 2024-09-13T06:09:54.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.819+0000 7f3be97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920772 cookie 94338115276480 notifier 4353 bl.length()=567 2024-09-13T06:09:54.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.819+0000 7f3be97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T06:09:54.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.819+0000 7f3be97fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:09:54.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.819+0000 7f3d067d9640 1 -- 172.21.15.194:0/2617242217 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(64 notify.4 [notify cookie 94338115467040 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3d0000a4d0 con 0x55cccdd8a380 2024-09-13T06:09:54.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.819+0000 7f3be97fa640 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f3bc8003eb0 con 0x55cccdd8a380 2024-09-13T06:09:54.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.819+0000 7f3d067d9640 1 -- 172.21.15.194:0/2617242217 <== osd.1 v2:172.21.15.194:6808/3135444559 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d0000a4d0 con 0x55cccdd8a380 2024-09-13T06:09:54.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.819+0000 7f3d067d9640 1 -- 172.21.15.194:0/2617242217 <== osd.1 v2:172.21.15.194:6808/3135444559 26 ==== watch-notify(notify_complete (2) cookie 94338115467040 notify 141733920772 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f3d0001e040 con 0x55cccdd8a380 2024-09-13T06:09:54.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.819+0000 7f3d084c8980 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:66 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cccddc7720 con 0x7f3cfc037040 2024-09-13T06:09:54.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.823+0000 7f3d067d9640 1 -- 172.21.15.194:0/2617242217 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(66 p5YnriCv1nAtykxBrupQ [delete] v33'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f3d0000a4d0 con 0x7f3cfc037040 2024-09-13T06:09:54.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.823+0000 7f3d084c8980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-13T06:09:54.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.823+0000 7f3d084c8980 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify cookie 94338115467040 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55cccddc2ed0 con 0x55cccdd8ed40 2024-09-13T06:09:54.824 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.823+0000 7f3d05fd8640 1 -- 172.21.15.194:0/2617242217 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== watch-notify(notify (1) cookie 94338115265344 notify 141733920769 ret 0) ==== 212+0+0 (crc 0 0 0) 0x7f3cf80db040 con 0x55cccdd8ed40 2024-09-13T06:09:54.824 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.823+0000 7f3d05fd8640 1 -- 172.21.15.194:0/2617242217 <== osd.3 v2:172.21.15.194:6816/96632515 16 ==== osd_op_reply(67 notify.2 [notify cookie 94338115467040 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3cf8113020 con 0x55cccdd8ed40 2024-09-13T06:09:54.824 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.823+0000 7f3be8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920769 cookie 94338115265344 notifier 4353 bl.length()=170 2024-09-13T06:09:54.824 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.823+0000 7f3be8ff9640 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f3b300032d0 con 0x55cccdd8ed40 2024-09-13T06:09:54.824 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.823+0000 7f3d05fd8640 1 -- 172.21.15.194:0/2617242217 <== osd.3 v2:172.21.15.194:6816/96632515 17 ==== watch-notify(notify_complete (2) cookie 94338115467040 notify 141733920769 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f3cf80db420 con 0x55cccdd8ed40 2024-09-13T06:09:54.824 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.823+0000 7f3d05fd8640 1 -- 172.21.15.194:0/2617242217 <== osd.3 v2:172.21.15.194:6816/96632515 18 ==== osd_op_reply(68 notify.2 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3cf8113020 con 0x55cccdd8ed40 2024-09-13T06:09:54.824 INFO:teuthology.orchestra.run.smithi194.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T06:09:53.191222Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:09:53.191207Z","tags":[],"group_ids":[]} 2024-09-13T06:09:54.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.823+0000 7f3bb77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:54.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.823+0000 7f3d084c8980 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94338115278464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cccddbf420 con 0x55cccdd8a380 2024-09-13T06:09:54.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.823+0000 7f3d067d9640 1 -- 172.21.15.194:0/2617242217 <== osd.1 v2:172.21.15.194:6808/3135444559 27 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94338115278464] v33'69 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3d0000a4d0 con 0x55cccdd8a380 2024-09-13T06:09:54.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.823+0000 7f3d084c8980 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94338115257984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cccddbf420 con 0x7f3cf810d030 2024-09-13T06:09:54.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.823+0000 7f3d057d7640 1 -- 172.21.15.194:0/2617242217 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94338115257984] v33'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3cfc00e620 con 0x7f3cf810d030 2024-09-13T06:09:54.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.823+0000 7f3d084c8980 20 remove_watcher() i=0 2024-09-13T06:09:54.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.823+0000 7f3d084c8980 2 removed watcher, disabling cache 2024-09-13T06:09:54.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.823+0000 7f3d084c8980 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94338115264016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cccddbf420 con 0x55cccdd8a380 2024-09-13T06:09:54.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.827+0000 7f3d067d9640 1 -- 172.21.15.194:0/2617242217 <== osd.1 v2:172.21.15.194:6808/3135444559 28 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94338115264016] v33'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d0000a4d0 con 0x55cccdd8a380 2024-09-13T06:09:54.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.827+0000 7f3d084c8980 20 remove_watcher() i=1 2024-09-13T06:09:54.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.827+0000 7f3d084c8980 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94338115265344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd95e10 con 0x55cccdd8ed40 2024-09-13T06:09:54.829 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.827+0000 7f3d05fd8640 1 -- 172.21.15.194:0/2617242217 <== osd.3 v2:172.21.15.194:6816/96632515 19 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94338115265344] v33'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3cf8113020 con 0x55cccdd8ed40 2024-09-13T06:09:54.829 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.827+0000 7f3d084c8980 20 remove_watcher() i=2 2024-09-13T06:09:54.830 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.827+0000 7f3d084c8980 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94338115272928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cccddbf420 con 0x7f3cf810d030 2024-09-13T06:09:54.830 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.831+0000 7f3d057d7640 1 -- 172.21.15.194:0/2617242217 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94338115272928] v33'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3cfc00e620 con 0x7f3cf810d030 2024-09-13T06:09:54.830 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.831+0000 7f3d084c8980 20 remove_watcher() i=3 2024-09-13T06:09:54.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.831+0000 7f3d084c8980 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94338115276480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd96340 con 0x55cccdd8a380 2024-09-13T06:09:54.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.831+0000 7f3d067d9640 1 -- 172.21.15.194:0/2617242217 <== osd.1 v2:172.21.15.194:6808/3135444559 29 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94338115276480] v33'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d0000a4d0 con 0x55cccdd8a380 2024-09-13T06:09:54.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.831+0000 7f3d084c8980 20 remove_watcher() i=4 2024-09-13T06:09:54.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.831+0000 7f3d084c8980 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94338115273984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd95e10 con 0x7f3cfc037040 2024-09-13T06:09:54.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.835+0000 7f3d067d9640 1 -- 172.21.15.194:0/2617242217 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94338115273984] v33'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d0000a4d0 con 0x7f3cfc037040 2024-09-13T06:09:54.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.835+0000 7f3d084c8980 20 remove_watcher() i=5 2024-09-13T06:09:54.835 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.835+0000 7f3d084c8980 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94338115280112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cccddbf420 con 0x7f3cfc037040 2024-09-13T06:09:54.836 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.835+0000 7f3d067d9640 1 -- 172.21.15.194:0/2617242217 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94338115280112] v33'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d0000a4d0 con 0x7f3cfc037040 2024-09-13T06:09:54.836 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.835+0000 7f3d084c8980 20 remove_watcher() i=6 2024-09-13T06:09:54.836 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.835+0000 7f3d084c8980 1 -- 172.21.15.194:0/2617242217 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94338115283888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55cccdd98ec0 con 0x7f3cfc037040 2024-09-13T06:09:54.840 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.835+0000 7f3d067d9640 1 -- 172.21.15.194:0/2617242217 <== osd.0 v2:172.21.15.120:6800/1923744619 20 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94338115283888] v33'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d0000a4d0 con 0x7f3cfc037040 2024-09-13T06:09:54.841 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.835+0000 7f3d084c8980 20 remove_watcher() i=7 2024-09-13T06:09:54.841 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.839+0000 7f3d084c8980 1 -- 172.21.15.194:0/2617242217 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f3cfc037040 msgr2=0x7f3cfc036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.841 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.839+0000 7f3d084c8980 1 --2- 172.21.15.194:0/2617242217 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f3cfc037040 0x7f3cfc036410 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.841 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.839+0000 7f3d084c8980 1 -- 172.21.15.194:0/2617242217 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55cccdd8a380 msgr2=0x55cccdd8c840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.841 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.839+0000 7f3d084c8980 1 --2- 172.21.15.194:0/2617242217 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55cccdd8a380 0x55cccdd8c840 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.841 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.839+0000 7f3d084c8980 1 -- 172.21.15.194:0/2617242217 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f3cf810d030 msgr2=0x7f3cf80af900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.841 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.839+0000 7f3d084c8980 1 --2- 172.21.15.194:0/2617242217 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f3cf810d030 0x7f3cf80af900 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.841 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.839+0000 7f3d084c8980 1 -- 172.21.15.194:0/2617242217 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55cccdd8ed40 msgr2=0x55cccdd91130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.841 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.839+0000 7f3d084c8980 1 --2- 172.21.15.194:0/2617242217 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55cccdd8ed40 0x55cccdd91130 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.841 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.839+0000 7f3d084c8980 1 -- 172.21.15.194:0/2617242217 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3bd0034600 msgr2=0x7f3bd0036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.842 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.839+0000 7f3d084c8980 1 --2- 172.21.15.194:0/2617242217 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3bd0034600 0x7f3bd0036ac0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x55cccdd5e5e0 tx=0x7f3cfc010000 comp rx=0 tx=0).stop 2024-09-13T06:09:54.842 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.839+0000 7f3d067d9640 1 -- 172.21.15.194:0/2617242217 reap_dead start 2024-09-13T06:09:54.842 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.839+0000 7f3d084c8980 1 -- 172.21.15.194:0/2617242217 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55cccdd78230 msgr2=0x55cccdd7f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.842 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.839+0000 7f3d084c8980 1 --2- 172.21.15.194:0/2617242217 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55cccdd78230 0x55cccdd7f3f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3cf80c1b10 tx=0x7f3cf80e2590 comp rx=0 tx=0).stop 2024-09-13T06:09:54.842 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.839+0000 7f3d084c8980 1 -- 172.21.15.194:0/2617242217 shutdown_connections 2024-09-13T06:09:54.842 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.839+0000 7f3d084c8980 1 --2- 172.21.15.194:0/2617242217 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55cccdd78230 0x55cccdd7f3f0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.842 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.839+0000 7f3d084c8980 1 -- 172.21.15.194:0/2617242217 >> 172.21.15.194:0/2617242217 conn(0x55cccdd74610 msgr2=0x55cccdd726e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:54.842 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.839+0000 7f3d084c8980 1 -- 172.21.15.194:0/2617242217 shutdown_connections 2024-09-13T06:09:54.842 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.839+0000 7f3d084c8980 1 -- 172.21.15.194:0/2617242217 wait complete. 2024-09-13T06:09:54.842 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.839+0000 7f3d084c8980 1 -- 172.21.15.194:0/3459736510 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3be0034650 msgr2=0x7f3be0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.842 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.839+0000 7f3d084c8980 1 --2- 172.21.15.194:0/3459736510 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3be0034650 0x7f3be0036b10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc00bf60 tx=0x7f3cfc00f000 comp rx=0 tx=0).stop 2024-09-13T06:09:54.842 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.839+0000 7f3d084c8980 1 -- 172.21.15.194:0/3459736510 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55cccdd6bc70 msgr2=0x55cccdd6c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.843 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.839+0000 7f3d084c8980 1 --2- 172.21.15.194:0/3459736510 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55cccdd6bc70 0x55cccdd6c090 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3cf800a480 tx=0x7f3cf80a40a0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.843 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.839+0000 7f3d084c8980 1 -- 172.21.15.194:0/3459736510 shutdown_connections 2024-09-13T06:09:54.843 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.839+0000 7f3d084c8980 1 --2- 172.21.15.194:0/3459736510 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3be0034650 0x7f3be0036b10 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.843 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.839+0000 7f3d084c8980 1 --2- 172.21.15.194:0/3459736510 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55cccdd6bc70 0x55cccdd6c090 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.843 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.839+0000 7f3d084c8980 1 -- 172.21.15.194:0/3459736510 >> 172.21.15.194:0/3459736510 conn(0x55cccdd60dc0 msgr2=0x55cccdd63840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:54.843 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.839+0000 7f3d084c8980 1 -- 172.21.15.194:0/3459736510 shutdown_connections 2024-09-13T06:09:54.843 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.839+0000 7f3d084c8980 1 -- 172.21.15.194:0/3459736510 wait complete. 2024-09-13T06:09:54.843 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.839+0000 7f3d084c8980 1 -- 172.21.15.194:0/1089329246 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55cccdc5ecf0 msgr2=0x55cccdd54e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.843 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.839+0000 7f3d084c8980 1 --2- 172.21.15.194:0/1089329246 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55cccdc5ecf0 0x55cccdd54e40 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.843 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.839+0000 7f3d084c8980 1 -- 172.21.15.194:0/1089329246 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55cccdd5b660 msgr2=0x55cccdd5da50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.843 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.839+0000 7f3d084c8980 1 --2- 172.21.15.194:0/1089329246 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55cccdd5b660 0x55cccdd5da50 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.843 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.839+0000 7f3d084c8980 1 -- 172.21.15.194:0/1089329246 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55cccdd57760 msgr2=0x55cccdd59b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.843 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.839+0000 7f3d084c8980 1 --2- 172.21.15.194:0/1089329246 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55cccdd57760 0x55cccdd59b50 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.843 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.839+0000 7f3d084c8980 1 -- 172.21.15.194:0/1089329246 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3bec0346a0 msgr2=0x7f3bec036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.839+0000 7f3d084c8980 1 --2- 172.21.15.194:0/1089329246 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3bec0346a0 0x7f3bec036b60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc000f70 tx=0x7f3cfc0012c0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.839+0000 7f3d084c8980 1 -- 172.21.15.194:0/1089329246 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55cccdbce2a0 msgr2=0x55cccdd4deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.839+0000 7f3d084c8980 1 --2- 172.21.15.194:0/1089329246 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55cccdbce2a0 0x55cccdd4deb0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3cf80b9040 tx=0x7f3cf8018020 comp rx=0 tx=0).stop 2024-09-13T06:09:54.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.839+0000 7f3d067d9640 1 -- 172.21.15.194:0/1089329246 reap_dead start 2024-09-13T06:09:54.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.839+0000 7f3d084c8980 1 -- 172.21.15.194:0/1089329246 shutdown_connections 2024-09-13T06:09:54.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.839+0000 7f3d084c8980 1 -- 172.21.15.194:0/1089329246 >> 172.21.15.194:0/1089329246 conn(0x55cccdc540a0 msgr2=0x55cccdd41490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:54.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.839+0000 7f3d084c8980 1 -- 172.21.15.194:0/1089329246 shutdown_connections 2024-09-13T06:09:54.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.839+0000 7f3d084c8980 1 -- 172.21.15.194:0/1089329246 wait complete. 2024-09-13T06:09:54.849 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T06:09:53.191222Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:09:53.191207Z', 'tags': [], 'group_ids': []} 2024-09-13T06:09:54.849 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-09-13T06:09:54.849 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-09-13T06:09:54.849 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo1 --access full 2024-09-13T06:09:54.918 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:09:54.918 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:09:54.919 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.919+0000 7f24c0b36980 1 Processor -- start 2024-09-13T06:09:54.919 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.919+0000 7f24c0b36980 1 -- start start 2024-09-13T06:09:54.920 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.919+0000 7f24c0b36980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x5565bda616a0 0x5565bda61a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.920 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.919+0000 7f24c0b36980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5565bd8e9ae0 con 0x5565bda61ff0 2024-09-13T06:09:54.920 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.919+0000 7f24c0b36980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x5565bd90de30 con 0x5565bda616a0 2024-09-13T06:09:54.921 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.919+0000 7f24be646640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x5565bda616a0 0x5565bda61a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.921 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.919+0000 7f24be646640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x5565bda616a0 0x5565bda61a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44630/0 (socket says 172.21.15.194:44630) 2024-09-13T06:09:54.921 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.919+0000 7f24be646640 1 -- 172.21.15.194:0/2666594465 learned_addr learned my addr 172.21.15.194:0/2666594465 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:54.921 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.919+0000 7f24bde45640 1 --1- 172.21.15.194:0/2666594465 >> v1:172.21.15.120:6789/0 conn(0x5565bda61ff0 0x5565bda66a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:51008/0 (socket says 172.21.15.194:51008) 2024-09-13T06:09:54.921 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.919+0000 7f24be646640 1 -- 172.21.15.194:0/2666594465 >> v1:172.21.15.120:6789/0 conn(0x5565bda61ff0 legacy=0x5565bda66a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.921 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.919+0000 7f24be646640 1 -- 172.21.15.194:0/2666594465 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565bda69270 con 0x5565bda616a0 2024-09-13T06:09:54.923 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.923+0000 7f24be646640 1 --2- 172.21.15.194:0/2666594465 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5565bda616a0 0x5565bda61a80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f24b000a5c0 tx=0x7f24b001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83f42d9c17ee97b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.923 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.923+0000 7f24bd644640 1 -- 172.21.15.194:0/2666594465 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24b00a6070 con 0x5565bda616a0 2024-09-13T06:09:54.923 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.923+0000 7f24bd644640 1 -- 172.21.15.194:0/2666594465 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24b00af070 con 0x5565bda616a0 2024-09-13T06:09:54.923 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.923+0000 7f24bd644640 1 -- 172.21.15.194:0/2666594465 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24b00aa5c0 con 0x5565bda616a0 2024-09-13T06:09:54.924 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.923+0000 7f24c0b36980 1 -- 172.21.15.194:0/2666594465 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5565bda616a0 msgr2=0x5565bda61a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.924 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.923+0000 7f24c0b36980 1 --2- 172.21.15.194:0/2666594465 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5565bda616a0 0x5565bda61a80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f24b000a5c0 tx=0x7f24b001b340 comp rx=0 tx=0).stop 2024-09-13T06:09:54.924 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.923+0000 7f24c0b36980 1 -- 172.21.15.194:0/2666594465 shutdown_connections 2024-09-13T06:09:54.924 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.923+0000 7f24c0b36980 1 --2- 172.21.15.194:0/2666594465 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5565bda616a0 0x5565bda61a80 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.924 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.923+0000 7f24c0b36980 1 -- 172.21.15.194:0/2666594465 >> 172.21.15.194:0/2666594465 conn(0x5565bda5d1c0 msgr2=0x5565bda5f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:54.924 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.923+0000 7f24c0b36980 1 -- 172.21.15.194:0/2666594465 shutdown_connections 2024-09-13T06:09:54.924 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.923+0000 7f24c0b36980 1 -- 172.21.15.194:0/2666594465 wait complete. 2024-09-13T06:09:54.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.935+0000 7f24c0b36980 1 Processor -- start 2024-09-13T06:09:54.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.935+0000 7f24c0b36980 1 -- start start 2024-09-13T06:09:54.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.935+0000 7f24c0b36980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5565bda616a0 0x5565bdb4ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.935+0000 7f24c0b36980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5565bd90f200 con 0x5565bda616a0 2024-09-13T06:09:54.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.935+0000 7f24be646640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5565bda616a0 0x5565bdb4ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.935+0000 7f24be646640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5565bda616a0 0x5565bdb4ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44634/0 (socket says 172.21.15.194:44634) 2024-09-13T06:09:54.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.935+0000 7f24be646640 1 -- 172.21.15.194:0/3340920686 learned_addr learned my addr 172.21.15.194:0/3340920686 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:54.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.935+0000 7f24be646640 1 -- 172.21.15.194:0/3340920686 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565bdb4d020 con 0x5565bda616a0 2024-09-13T06:09:54.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.935+0000 7f24be646640 1 --2- 172.21.15.194:0/3340920686 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5565bda616a0 0x5565bdb4ca50 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f24b00199f0 tx=0x7f24b0003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb4425fa0124b58b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.939+0000 7f23ac608640 1 -- 172.21.15.194:0/3340920686 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24b00aaa00 con 0x5565bda616a0 2024-09-13T06:09:54.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.939+0000 7f23ac608640 1 -- 172.21.15.194:0/3340920686 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24b00aaba0 con 0x5565bda616a0 2024-09-13T06:09:54.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.939+0000 7f23ac608640 1 -- 172.21.15.194:0/3340920686 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24b00bd3f0 con 0x5565bda616a0 2024-09-13T06:09:54.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.939+0000 7f24c0b36980 1 -- 172.21.15.194:0/3340920686 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5565bda616a0 msgr2=0x5565bdb4ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.939+0000 7f24c0b36980 1 --2- 172.21.15.194:0/3340920686 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5565bda616a0 0x5565bdb4ca50 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f24b00199f0 tx=0x7f24b0003030 comp rx=0 tx=0).stop 2024-09-13T06:09:54.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.939+0000 7f24c0b36980 1 -- 172.21.15.194:0/3340920686 shutdown_connections 2024-09-13T06:09:54.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.939+0000 7f24c0b36980 1 --2- 172.21.15.194:0/3340920686 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5565bda616a0 0x5565bdb4ca50 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.939+0000 7f24c0b36980 1 -- 172.21.15.194:0/3340920686 >> 172.21.15.194:0/3340920686 conn(0x5565bda5d1c0 msgr2=0x5565bdb48680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:54.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.939+0000 7f24c0b36980 1 -- 172.21.15.194:0/3340920686 shutdown_connections 2024-09-13T06:09:54.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.939+0000 7f24c0b36980 1 -- 172.21.15.194:0/3340920686 wait complete. 2024-09-13T06:09:54.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.939+0000 7f24c0b36980 1 Processor -- start 2024-09-13T06:09:54.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.939+0000 7f24c0b36980 1 -- start start 2024-09-13T06:09:54.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.939+0000 7f24c0b36980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5565bda61ff0 0x5565bdb53e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.939+0000 7f24c0b36980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5565bda68cb0 con 0x5565bda61ff0 2024-09-13T06:09:54.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.939+0000 7f24be646640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5565bda61ff0 0x5565bdb53e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.939+0000 7f24be646640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5565bda61ff0 0x5565bdb53e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44644/0 (socket says 172.21.15.194:44644) 2024-09-13T06:09:54.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.939+0000 7f24be646640 1 -- 172.21.15.194:0/2231238965 learned_addr learned my addr 172.21.15.194:0/2231238965 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:54.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.939+0000 7f24be646640 1 -- 172.21.15.194:0/2231238965 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565bdb54390 con 0x5565bda61ff0 2024-09-13T06:09:54.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.939+0000 7f24be646640 1 --2- 172.21.15.194:0/2231238965 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5565bda61ff0 0x5565bdb53e50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f24b00199f0 tx=0x7f24b00180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.939+0000 7f23aae05640 1 -- 172.21.15.194:0/2231238965 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24b00c6690 con 0x5565bda61ff0 2024-09-13T06:09:54.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.939+0000 7f24c0b36980 1 -- 172.21.15.194:0/2231238965 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5565bdb54620 con 0x5565bda61ff0 2024-09-13T06:09:54.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.939+0000 7f23aae05640 1 -- 172.21.15.194:0/2231238965 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24b00c6830 con 0x5565bda61ff0 2024-09-13T06:09:54.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.939+0000 7f24c0b36980 1 -- 172.21.15.194:0/2231238965 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565bdb57300 con 0x5565bda61ff0 2024-09-13T06:09:54.944 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.939+0000 7f23aae05640 1 -- 172.21.15.194:0/2231238965 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24b00c6b10 con 0x5565bda61ff0 2024-09-13T06:09:54.944 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.943+0000 7f23aae05640 1 -- 172.21.15.194:0/2231238965 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f24b00ce030 con 0x5565bda61ff0 2024-09-13T06:09:54.944 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.943+0000 7f23aae05640 1 --2- 172.21.15.194:0/2231238965 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f23a4034650 0x7f23a4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.944 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.943+0000 7f23aae05640 1 -- 172.21.15.194:0/2231238965 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f24b00cc020 con 0x5565bda61ff0 2024-09-13T06:09:54.944 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.943+0000 7f24bde45640 1 --2- 172.21.15.194:0/2231238965 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f23a4034650 0x7f23a4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.944 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.943+0000 7f24c0b36980 1 --2- 172.21.15.194:0/2231238965 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5565bdb58dd0 0x5565bdb5b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.944 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.943+0000 7f24c0b36980 1 -- 172.21.15.194:0/2231238965 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5565bdb5b870 con 0x5565bdb58dd0 2024-09-13T06:09:54.944 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.943+0000 7f24bee47640 1 --2- 172.21.15.194:0/2231238965 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5565bdb58dd0 0x5565bdb5b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.944 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.943+0000 7f24bde45640 1 --2- 172.21.15.194:0/2231238965 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f23a4034650 0x7f23a4036b10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f24b4000f70 tx=0x7f24b4001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.944 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.943+0000 7f24bee47640 1 --2- 172.21.15.194:0/2231238965 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5565bdb58dd0 0x5565bdb5b200 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.943+0000 7f24bee47640 1 -- 172.21.15.194:0/2231238965 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f24b800a4d0 con 0x5565bdb58dd0 2024-09-13T06:09:54.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.943+0000 7f24c0b36980 1 -- 172.21.15.194:0/2231238965 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5565bdb58520 con 0x5565bdb58dd0 2024-09-13T06:09:54.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.943+0000 7f24bee47640 1 -- 172.21.15.194:0/2231238965 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f24b800a4d0 con 0x5565bdb58dd0 2024-09-13T06:09:54.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.943+0000 7f24c0b36980 1 --2- 172.21.15.194:0/2231238965 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5565bdb5dba0 0x5565bdb5ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.943+0000 7f24c0b36980 1 -- 172.21.15.194:0/2231238965 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5565bdb60660 con 0x5565bdb5dba0 2024-09-13T06:09:54.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.943+0000 7f24be646640 1 --2- 172.21.15.194:0/2231238965 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5565bdb5dba0 0x5565bdb5ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.943+0000 7f24be646640 1 --2- 172.21.15.194:0/2231238965 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5565bdb5dba0 0x5565bdb5ff90 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.943+0000 7f24be646640 1 -- 172.21.15.194:0/2231238965 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f24b00d0a70 con 0x5565bdb5dba0 2024-09-13T06:09:54.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.943+0000 7f24c0b36980 1 -- 172.21.15.194:0/2231238965 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5565bdb5ca40 con 0x5565bdb58dd0 2024-09-13T06:09:54.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.943+0000 7f24bee47640 1 -- 172.21.15.194:0/2231238965 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f24b800a4d0 con 0x5565bdb58dd0 2024-09-13T06:09:54.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.943+0000 7f24c0b36980 1 --2- 172.21.15.194:0/2231238965 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5565bdb61ac0 0x5565bdb63eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.943+0000 7f24c0b36980 1 -- 172.21.15.194:0/2231238965 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5565bdb645b0 con 0x5565bdb61ac0 2024-09-13T06:09:54.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.943+0000 7f24bde45640 1 --2- 172.21.15.194:0/2231238965 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5565bdb61ac0 0x5565bdb63eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.943+0000 7f24bde45640 1 --2- 172.21.15.194:0/2231238965 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5565bdb61ac0 0x5565bdb63eb0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.943+0000 7f24bde45640 1 -- 172.21.15.194:0/2231238965 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f24b400f6a0 con 0x5565bdb61ac0 2024-09-13T06:09:54.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.943+0000 7f24c0b36980 1 Processor -- start 2024-09-13T06:09:54.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.943+0000 7f24c0b36980 1 -- start start 2024-09-13T06:09:54.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.947+0000 7f24c0b36980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5565bdb72080 0x5565bdb724a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.947+0000 7f24c0b36980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5565bd968800 con 0x5565bdb72080 2024-09-13T06:09:54.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.947+0000 7f24be646640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5565bdb72080 0x5565bdb724a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.947+0000 7f24be646640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5565bdb72080 0x5565bdb724a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44650/0 (socket says 172.21.15.194:44650) 2024-09-13T06:09:54.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.947+0000 7f24be646640 1 -- 172.21.15.194:0/3669743830 learned_addr learned my addr 172.21.15.194:0/3669743830 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:54.950 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.947+0000 7f24be646640 1 -- 172.21.15.194:0/3669743830 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565bdb729e0 con 0x5565bdb72080 2024-09-13T06:09:54.950 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.947+0000 7f24be646640 1 --2- 172.21.15.194:0/3669743830 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5565bdb72080 0x5565bdb724a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f24b0000c10 tx=0x7f24b00c5a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.950 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.947+0000 7f23a3fff640 1 -- 172.21.15.194:0/3669743830 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24b00ec070 con 0x5565bdb72080 2024-09-13T06:09:54.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.947+0000 7f24c0b36980 1 -- 172.21.15.194:0/3669743830 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5565bdb72c70 con 0x5565bdb72080 2024-09-13T06:09:54.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.947+0000 7f23a3fff640 1 -- 172.21.15.194:0/3669743830 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24b00c73f0 con 0x5565bdb72080 2024-09-13T06:09:54.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.947+0000 7f24c0b36980 1 -- 172.21.15.194:0/3669743830 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565bdb758f0 con 0x5565bdb72080 2024-09-13T06:09:54.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.947+0000 7f23a3fff640 1 -- 172.21.15.194:0/3669743830 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24b00c75a0 con 0x5565bdb72080 2024-09-13T06:09:54.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.947+0000 7f23a3fff640 1 -- 172.21.15.194:0/3669743830 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f24b00ef070 con 0x5565bdb72080 2024-09-13T06:09:54.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.947+0000 7f23a3fff640 1 --2- 172.21.15.194:0/3669743830 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f2398034650 0x7f2398036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.947+0000 7f23a3fff640 1 -- 172.21.15.194:0/3669743830 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f24b00ac090 con 0x5565bdb72080 2024-09-13T06:09:54.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.947+0000 7f24bde45640 1 --2- 172.21.15.194:0/3669743830 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f2398034650 0x7f2398036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.947+0000 7f24c0b36980 1 Processor -- start 2024-09-13T06:09:54.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.947+0000 7f24c0b36980 1 -- start start 2024-09-13T06:09:54.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.947+0000 7f24c0b36980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5565bdb7ea10 0x5565bdb7edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.947+0000 7f24c0b36980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5565bdb4d2e0 con 0x5565bdb7ea10 2024-09-13T06:09:54.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.947+0000 7f24bde45640 1 --2- 172.21.15.194:0/3669743830 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f2398034650 0x7f2398036b10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x5565bdb5c150 tx=0x7f24b400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.951+0000 7f24be646640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5565bdb7ea10 0x5565bdb7edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.951+0000 7f24be646640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5565bdb7ea10 0x5565bdb7edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44666/0 (socket says 172.21.15.194:44666) 2024-09-13T06:09:54.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.951+0000 7f24be646640 1 -- 172.21.15.194:0/2137911595 learned_addr learned my addr 172.21.15.194:0/2137911595 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:54.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.951+0000 7f24be646640 1 -- 172.21.15.194:0/2137911595 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565bdb7f3c0 con 0x5565bdb7ea10 2024-09-13T06:09:54.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.951+0000 7f24be646640 1 --2- 172.21.15.194:0/2137911595 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5565bdb7ea10 0x5565bdb7edf0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f24b001bbe0 tx=0x7f24b00da7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1da803588c47e2cd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.951+0000 7f23a1ffb640 1 -- 172.21.15.194:0/2137911595 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24b0103020 con 0x5565bdb7ea10 2024-09-13T06:09:54.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.951+0000 7f23a1ffb640 1 -- 172.21.15.194:0/2137911595 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24b00b3990 con 0x5565bdb7ea10 2024-09-13T06:09:54.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.951+0000 7f23a1ffb640 1 -- 172.21.15.194:0/2137911595 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24b00e7400 con 0x5565bdb7ea10 2024-09-13T06:09:54.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.951+0000 7f24c0b36980 1 -- 172.21.15.194:0/2137911595 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5565bdb7ea10 msgr2=0x5565bdb7edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:54.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.951+0000 7f24c0b36980 1 --2- 172.21.15.194:0/2137911595 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5565bdb7ea10 0x5565bdb7edf0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f24b001bbe0 tx=0x7f24b00da7b0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.955 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.951+0000 7f24c0b36980 1 -- 172.21.15.194:0/2137911595 shutdown_connections 2024-09-13T06:09:54.955 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.951+0000 7f24c0b36980 1 --2- 172.21.15.194:0/2137911595 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5565bdb7ea10 0x5565bdb7edf0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:54.955 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.951+0000 7f24c0b36980 1 -- 172.21.15.194:0/2137911595 >> 172.21.15.194:0/2137911595 conn(0x5565bdb7adf0 msgr2=0x5565bdb78ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:54.955 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.951+0000 7f24c0b36980 1 -- 172.21.15.194:0/2137911595 shutdown_connections 2024-09-13T06:09:54.955 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.951+0000 7f24c0b36980 1 -- 172.21.15.194:0/2137911595 wait complete. 2024-09-13T06:09:54.955 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.951+0000 7f24c0b36980 1 Processor -- start 2024-09-13T06:09:54.955 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.951+0000 7f24c0b36980 1 -- start start 2024-09-13T06:09:54.955 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.951+0000 7f24c0b36980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5565bdb7ea10 0x5565bd9d8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.955 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.951+0000 7f24c0b36980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5565bdb7f860 con 0x5565bdb7ea10 2024-09-13T06:09:54.955 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.951+0000 7f24be646640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5565bdb7ea10 0x5565bd9d8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.955 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.951+0000 7f24be646640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5565bdb7ea10 0x5565bd9d8500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44680/0 (socket says 172.21.15.194:44680) 2024-09-13T06:09:54.955 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.951+0000 7f24be646640 1 -- 172.21.15.194:0/2786695946 learned_addr learned my addr 172.21.15.194:0/2786695946 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:54.955 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.951+0000 7f24be646640 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565bd9d8a40 con 0x5565bdb7ea10 2024-09-13T06:09:54.955 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.951+0000 7f24be646640 1 --2- 172.21.15.194:0/2786695946 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5565bdb7ea10 0x5565bd9d8500 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f24b001bbe0 tx=0x7f24b00bae80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.956 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.951+0000 7f238ffff640 1 -- 172.21.15.194:0/2786695946 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24b00a7290 con 0x5565bdb7ea10 2024-09-13T06:09:54.956 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.951+0000 7f24c0b36980 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5565bd9d8a40 con 0x5565bdb7ea10 2024-09-13T06:09:54.956 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.951+0000 7f24c0b36980 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565bd9d6ec0 con 0x5565bdb7ea10 2024-09-13T06:09:54.956 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.951+0000 7f238ffff640 1 -- 172.21.15.194:0/2786695946 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24b00a7920 con 0x5565bdb7ea10 2024-09-13T06:09:54.956 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.951+0000 7f238ffff640 1 -- 172.21.15.194:0/2786695946 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24b00da3f0 con 0x5565bdb7ea10 2024-09-13T06:09:54.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.955+0000 7f238ffff640 1 -- 172.21.15.194:0/2786695946 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f24b0106020 con 0x5565bdb7ea10 2024-09-13T06:09:54.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.955+0000 7f238ffff640 1 --2- 172.21.15.194:0/2786695946 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f2388034650 0x7f2388036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.955+0000 7f238ffff640 1 -- 172.21.15.194:0/2786695946 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f24b0114ce0 con 0x5565bdb7ea10 2024-09-13T06:09:54.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.955+0000 7f24c0b36980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.955+0000 7f24bde45640 1 --2- 172.21.15.194:0/2786695946 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f2388034650 0x7f2388036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.955+0000 7f24c0b36980 1 --2- 172.21.15.194:0/2786695946 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5565bdb92ef0 0x5565bdb953b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.955+0000 7f24c0b36980 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5565bdb95b00 con 0x5565bdb92ef0 2024-09-13T06:09:54.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.955+0000 7f24bee47640 1 --2- 172.21.15.194:0/2786695946 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5565bdb92ef0 0x5565bdb953b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.955+0000 7f24bde45640 1 --2- 172.21.15.194:0/2786695946 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f2388034650 0x7f2388036b10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f24b400c010 tx=0x7f24b4010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.955+0000 7f24bee47640 1 --2- 172.21.15.194:0/2786695946 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5565bdb92ef0 0x5565bdb953b0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.955+0000 7f24bee47640 1 -- 172.21.15.194:0/2786695946 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f24b800a4d0 con 0x5565bdb92ef0 2024-09-13T06:09:54.962 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.955+0000 7f24c0b36980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:54.962 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.955+0000 7f24c0b36980 20 realm 2024-09-13T06:09:54.962 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.955+0000 7f24c0b36980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.962 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.955+0000 7f24c0b36980 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5565bdb95f10 con 0x5565bdb92ef0 2024-09-13T06:09:54.962 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.955+0000 7f24bee47640 1 -- 172.21.15.194:0/2786695946 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f24b800a4d0 con 0x5565bdb92ef0 2024-09-13T06:09:54.962 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.955+0000 7f24c0b36980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:54.962 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.955+0000 7f24c0b36980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:09:54.962 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.955+0000 7f24c0b36980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.962 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.955+0000 7f24c0b36980 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5565bdb967b0 con 0x5565bdb92ef0 2024-09-13T06:09:54.962 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.955+0000 7f24bee47640 1 -- 172.21.15.194:0/2786695946 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f24b800a4d0 con 0x5565bdb92ef0 2024-09-13T06:09:54.962 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.955+0000 7f24c0b36980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:54.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.955+0000 7f24c0b36980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.955+0000 7f24c0b36980 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5565bdb96b50 con 0x5565bdb92ef0 2024-09-13T06:09:54.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.955+0000 7f24bee47640 1 -- 172.21.15.194:0/2786695946 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f24b800a4d0 con 0x5565bdb92ef0 2024-09-13T06:09:54.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.955+0000 7f24c0b36980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:54.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.955+0000 7f24c0b36980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.955+0000 7f24c0b36980 1 --2- 172.21.15.194:0/2786695946 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5565bdb978b0 0x5565bdb99ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.955+0000 7f24c0b36980 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5565bdb9a2f0 con 0x5565bdb978b0 2024-09-13T06:09:54.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.955+0000 7f24be646640 1 --2- 172.21.15.194:0/2786695946 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5565bdb978b0 0x5565bdb99ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.955+0000 7f24be646640 1 --2- 172.21.15.194:0/2786695946 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5565bdb978b0 0x5565bdb99ca0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.955+0000 7f24be646640 1 -- 172.21.15.194:0/2786695946 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f24b00ee030 con 0x5565bdb978b0 2024-09-13T06:09:54.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.955+0000 7f24c0b36980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:09:54.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.955+0000 7f24c0b36980 20 searching for the correct realm 2024-09-13T06:09:54.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.955+0000 7f24c0b36980 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5565bdb9bb50 con 0x5565bdb978b0 2024-09-13T06:09:54.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.955+0000 7f24be646640 1 -- 172.21.15.194:0/2786695946 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24b00ee030 con 0x5565bdb978b0 2024-09-13T06:09:54.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.955+0000 7f24be646640 1 --2- 172.21.15.194:0/2786695946 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f24b0108040 0x7f24b00ff9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.955+0000 7f24be646640 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5565bdb9bb50 con 0x7f24b0108040 2024-09-13T06:09:54.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.955+0000 7f24bde45640 1 --2- 172.21.15.194:0/2786695946 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f24b0108040 0x7f24b00ff9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.959+0000 7f24bde45640 1 --2- 172.21.15.194:0/2786695946 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f24b0108040 0x7f24b00ff9f0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.959+0000 7f24bde45640 1 -- 172.21.15.194:0/2786695946 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f24b4037040 con 0x7f24b0108040 2024-09-13T06:09:54.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.959+0000 7f24bde45640 1 --2- 172.21.15.194:0/2786695946 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f24b401fbe0 0x7f24b403a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:54.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.959+0000 7f24bde45640 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5565bdb9bb50 con 0x7f24b401fbe0 2024-09-13T06:09:54.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.959+0000 7f24bee47640 1 --2- 172.21.15.194:0/2786695946 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f24b401fbe0 0x7f24b403a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:54.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.959+0000 7f24bee47640 1 --2- 172.21.15.194:0/2786695946 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f24b401fbe0 0x7f24b403a3c0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:54.965 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.959+0000 7f24bee47640 1 -- 172.21.15.194:0/2786695946 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24b800a4d0 con 0x7f24b401fbe0 2024-09-13T06:09:54.965 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.959+0000 7f24bee47640 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5565bdb96b50 con 0x5565bdb92ef0 2024-09-13T06:09:54.965 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.959+0000 7f24bee47640 1 -- 172.21.15.194:0/2786695946 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24b800a4d0 con 0x5565bdb92ef0 2024-09-13T06:09:54.965 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.959+0000 7f24bee47640 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5565bdb96b50 con 0x5565bdb92ef0 2024-09-13T06:09:54.965 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.959+0000 7f24bee47640 1 -- 172.21.15.194:0/2786695946 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24b800a4d0 con 0x5565bdb92ef0 2024-09-13T06:09:54.965 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.959+0000 7f24bee47640 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5565bdb96b50 con 0x7f24b401fbe0 2024-09-13T06:09:54.973 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.959+0000 7f24bee47640 1 -- 172.21.15.194:0/2786695946 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24b800a4d0 con 0x7f24b401fbe0 2024-09-13T06:09:54.973 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.959+0000 7f24bee47640 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5565bdb96b50 con 0x7f24b401fbe0 2024-09-13T06:09:54.973 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.959+0000 7f24bee47640 1 -- 172.21.15.194:0/2786695946 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24b800a4d0 con 0x7f24b401fbe0 2024-09-13T06:09:54.973 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.959+0000 7f24bee47640 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5565bdb96b50 con 0x7f24b0108040 2024-09-13T06:09:54.973 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.959+0000 7f24bde45640 1 -- 172.21.15.194:0/2786695946 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24b4037040 con 0x7f24b0108040 2024-09-13T06:09:54.973 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.959+0000 7f24bde45640 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5565bdb96b50 con 0x5565bdb978b0 2024-09-13T06:09:54.973 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.963+0000 7f24be646640 1 -- 172.21.15.194:0/2786695946 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24b00ee030 con 0x5565bdb978b0 2024-09-13T06:09:54.973 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.963+0000 7f24be646640 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5565bdb96b50 con 0x5565bdb92ef0 2024-09-13T06:09:54.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.963+0000 7f24bee47640 1 -- 172.21.15.194:0/2786695946 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24b800a4d0 con 0x5565bdb92ef0 2024-09-13T06:09:54.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.963+0000 7f24bee47640 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5565bdb96b50 con 0x7f24b401fbe0 2024-09-13T06:09:54.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.963+0000 7f24bee47640 1 -- 172.21.15.194:0/2786695946 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24b800a4d0 con 0x7f24b401fbe0 2024-09-13T06:09:54.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.963+0000 7f24bee47640 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5565bdb96b50 con 0x5565bdb92ef0 2024-09-13T06:09:54.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.963+0000 7f24bee47640 1 -- 172.21.15.194:0/2786695946 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24b800a4d0 con 0x5565bdb92ef0 2024-09-13T06:09:54.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.963+0000 7f24bee47640 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5565bdb96b50 con 0x7f24b0108040 2024-09-13T06:09:54.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.963+0000 7f24bde45640 1 -- 172.21.15.194:0/2786695946 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f24b4037040 con 0x7f24b0108040 2024-09-13T06:09:54.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.963+0000 7f24bde45640 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5565bdb96b50 con 0x5565bdb978b0 2024-09-13T06:09:54.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.963+0000 7f24be646640 1 -- 172.21.15.194:0/2786695946 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24b00ee030 con 0x5565bdb978b0 2024-09-13T06:09:54.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.963+0000 7f24be646640 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5565bdb96b50 con 0x5565bdb978b0 2024-09-13T06:09:54.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.963+0000 7f24be646640 1 -- 172.21.15.194:0/2786695946 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24b00ee030 con 0x5565bdb978b0 2024-09-13T06:09:54.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.963+0000 7f24be646640 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5565bdb96b50 con 0x7f24b401fbe0 2024-09-13T06:09:54.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.963+0000 7f24bee47640 1 -- 172.21.15.194:0/2786695946 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24b800a4d0 con 0x7f24b401fbe0 2024-09-13T06:09:54.975 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.963+0000 7f24bee47640 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5565bdb96b50 con 0x5565bdb978b0 2024-09-13T06:09:54.975 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.963+0000 7f24be646640 1 -- 172.21.15.194:0/2786695946 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24b00ee030 con 0x5565bdb978b0 2024-09-13T06:09:54.975 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.963+0000 7f24be646640 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5565bdb96b50 con 0x5565bdb978b0 2024-09-13T06:09:54.975 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.963+0000 7f24be646640 1 -- 172.21.15.194:0/2786695946 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24b00ee030 con 0x5565bdb978b0 2024-09-13T06:09:54.975 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.963+0000 7f24be646640 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5565bdb96b50 con 0x5565bdb92ef0 2024-09-13T06:09:54.975 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.963+0000 7f24bee47640 1 -- 172.21.15.194:0/2786695946 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24b800a4d0 con 0x5565bdb92ef0 2024-09-13T06:09:54.975 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.963+0000 7f24bee47640 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5565bdb96b50 con 0x5565bdb92ef0 2024-09-13T06:09:54.975 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.963+0000 7f24bee47640 1 -- 172.21.15.194:0/2786695946 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f24b800a4d0 con 0x5565bdb92ef0 2024-09-13T06:09:54.975 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.963+0000 7f24bee47640 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5565bdb96b50 con 0x7f24b401fbe0 2024-09-13T06:09:54.975 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.967+0000 7f24bee47640 1 -- 172.21.15.194:0/2786695946 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24b800a4d0 con 0x7f24b401fbe0 2024-09-13T06:09:54.975 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.967+0000 7f24bee47640 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5565bdb96b50 con 0x5565bdb978b0 2024-09-13T06:09:54.975 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.967+0000 7f24be646640 1 -- 172.21.15.194:0/2786695946 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24b00ee030 con 0x5565bdb978b0 2024-09-13T06:09:54.975 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.967+0000 7f24be646640 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5565bdb96b50 con 0x7f24b0108040 2024-09-13T06:09:54.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.967+0000 7f24bde45640 1 -- 172.21.15.194:0/2786695946 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24b4037040 con 0x7f24b0108040 2024-09-13T06:09:54.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.967+0000 7f24bde45640 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5565bdb96b50 con 0x5565bdb92ef0 2024-09-13T06:09:54.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.967+0000 7f24bee47640 1 -- 172.21.15.194:0/2786695946 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24b800a4d0 con 0x5565bdb92ef0 2024-09-13T06:09:54.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.967+0000 7f24bee47640 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5565bdb96b50 con 0x7f24b401fbe0 2024-09-13T06:09:54.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.967+0000 7f24bee47640 1 -- 172.21.15.194:0/2786695946 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24b800a4d0 con 0x7f24b401fbe0 2024-09-13T06:09:54.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.967+0000 7f24bee47640 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5565bdb96b50 con 0x5565bdb978b0 2024-09-13T06:09:54.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.967+0000 7f24be646640 1 -- 172.21.15.194:0/2786695946 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f24b00ee030 con 0x5565bdb978b0 2024-09-13T06:09:54.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.967+0000 7f24be646640 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5565bdb96b50 con 0x7f24b401fbe0 2024-09-13T06:09:54.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.967+0000 7f24bee47640 1 -- 172.21.15.194:0/2786695946 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24b800a4d0 con 0x7f24b401fbe0 2024-09-13T06:09:54.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.967+0000 7f24bee47640 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5565bdb96b50 con 0x7f24b0108040 2024-09-13T06:09:54.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.967+0000 7f24bde45640 1 -- 172.21.15.194:0/2786695946 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24b4037040 con 0x7f24b0108040 2024-09-13T06:09:54.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.967+0000 7f24bde45640 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5565bdb96b50 con 0x5565bdb978b0 2024-09-13T06:09:54.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.967+0000 7f24be646640 1 -- 172.21.15.194:0/2786695946 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24b00ee030 con 0x5565bdb978b0 2024-09-13T06:09:54.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.967+0000 7f24be646640 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5565bdb96b50 con 0x7f24b401fbe0 2024-09-13T06:09:54.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.967+0000 7f24bee47640 1 -- 172.21.15.194:0/2786695946 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24b800a4d0 con 0x7f24b401fbe0 2024-09-13T06:09:54.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.967+0000 7f24bee47640 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5565bdb96b50 con 0x5565bdb92ef0 2024-09-13T06:09:54.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.967+0000 7f24bee47640 1 -- 172.21.15.194:0/2786695946 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f24b800a4d0 con 0x5565bdb92ef0 2024-09-13T06:09:54.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.967+0000 7f24bee47640 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5565bdb96b50 con 0x7f24b0108040 2024-09-13T06:09:54.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.971+0000 7f24bde45640 1 -- 172.21.15.194:0/2786695946 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24b4037040 con 0x7f24b0108040 2024-09-13T06:09:54.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.971+0000 7f24c0b36980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:09:54.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.971+0000 7f24c0b36980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:09:54.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.971+0000 7f24c0b36980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:09:54.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.971+0000 7f24c0b36980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:09:54.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.971+0000 7f24c0b36980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:09:54.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.971+0000 7f24c0b36980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:09:54.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.971+0000 7f24c0b36980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.971+0000 7f24c0b36980 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5565bdb9ac70 con 0x5565bdb92ef0 2024-09-13T06:09:54.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.971+0000 7f24bee47640 1 -- 172.21.15.194:0/2786695946 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f24b800a4d0 con 0x5565bdb92ef0 2024-09-13T06:09:54.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.971+0000 7f24c0b36980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:54.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.971+0000 7f24c0b36980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.971+0000 7f24c0b36980 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5565bdb9b4c0 con 0x5565bdb92ef0 2024-09-13T06:09:54.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.971+0000 7f24bee47640 1 -- 172.21.15.194:0/2786695946 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f24b800a4d0 con 0x5565bdb92ef0 2024-09-13T06:09:54.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.971+0000 7f24c0b36980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:54.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.971+0000 7f24c0b36980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.971+0000 7f24c0b36980 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5565bdb9a8d0 con 0x7f24b0108040 2024-09-13T06:09:54.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.971+0000 7f24bde45640 1 -- 172.21.15.194:0/2786695946 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f24b4037040 con 0x7f24b0108040 2024-09-13T06:09:54.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.971+0000 7f24c0b36980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:09:54.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.971+0000 7f24c0b36980 20 zone default found 2024-09-13T06:09:54.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.971+0000 7f24c0b36980 4 Realm: () 2024-09-13T06:09:54.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.971+0000 7f24c0b36980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:09:54.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.971+0000 7f24c0b36980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:09:54.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.971+0000 7f24c0b36980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:09:54.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.971+0000 7f24c0b36980 20 zonegroup default 2024-09-13T06:09:54.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.971+0000 7f24c0b36980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.971+0000 7f24c0b36980 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5565bdb9bf80 con 0x7f24b401fbe0 2024-09-13T06:09:54.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.971+0000 7f24bee47640 1 -- 172.21.15.194:0/2786695946 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f24b800a4d0 con 0x7f24b401fbe0 2024-09-13T06:09:54.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.971+0000 7f24c0b36980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:54.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.971+0000 7f24c0b36980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.971+0000 7f24c0b36980 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5565bdb9b180 con 0x5565bdb978b0 2024-09-13T06:09:54.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.971+0000 7f24be646640 1 -- 172.21.15.194:0/2786695946 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f24b00ee030 con 0x5565bdb978b0 2024-09-13T06:09:54.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.971+0000 7f24c0b36980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:54.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.971+0000 7f24c0b36980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.971+0000 7f24c0b36980 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5565bdb9df10 con 0x5565bdb978b0 2024-09-13T06:09:54.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.971+0000 7f24be646640 1 -- 172.21.15.194:0/2786695946 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f24b00ee030 con 0x5565bdb978b0 2024-09-13T06:09:54.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.971+0000 7f24c0b36980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:54.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.971+0000 7f24c0b36980 20 started sync module instance, tier type = 2024-09-13T06:09:54.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.971+0000 7f24c0b36980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:09:54.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.971+0000 7f24c0b36980 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5565bdb9d2a0 con 0x7f24b0108040 2024-09-13T06:09:54.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.971+0000 7f24bde45640 1 -- 172.21.15.194:0/2786695946 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(44 notify.0 [create] v33'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24b4037040 con 0x7f24b0108040 2024-09-13T06:09:54.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.971+0000 7f24c0b36980 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93895463130768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5565bdb9cf00 con 0x7f24b0108040 2024-09-13T06:09:54.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.971+0000 7f24c0b36980 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5565bdb9ee40 con 0x5565bdb92ef0 2024-09-13T06:09:54.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.975+0000 7f24bde45640 1 -- 172.21.15.194:0/2786695946 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93895463130768] v33'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24b4037040 con 0x7f24b0108040 2024-09-13T06:09:54.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.975+0000 7f24bee47640 1 -- 172.21.15.194:0/2786695946 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v33'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24b800a4d0 con 0x5565bdb92ef0 2024-09-13T06:09:54.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.975+0000 7f24c0b36980 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93895463135632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5565bdb9f260 con 0x5565bdb92ef0 2024-09-13T06:09:54.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.975+0000 7f24c0b36980 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5565bdb9faf0 con 0x5565bdb978b0 2024-09-13T06:09:54.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.975+0000 7f24be646640 1 -- 172.21.15.194:0/2786695946 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v33'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24b00ee030 con 0x5565bdb978b0 2024-09-13T06:09:54.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.975+0000 7f24c0b36980 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93895463138160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5565bdba0390 con 0x5565bdb978b0 2024-09-13T06:09:54.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.975+0000 7f24c0b36980 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5565bdba0d90 con 0x7f24b0108040 2024-09-13T06:09:54.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.979+0000 7f24bee47640 1 -- 172.21.15.194:0/2786695946 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93895463135632] v33'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24b800a4d0 con 0x5565bdb92ef0 2024-09-13T06:09:54.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.979+0000 7f24bde45640 1 -- 172.21.15.194:0/2786695946 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(50 notify.3 [create] v33'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24b4037040 con 0x7f24b0108040 2024-09-13T06:09:54.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.979+0000 7f24c0b36980 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93895463136688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5565bdba1660 con 0x7f24b0108040 2024-09-13T06:09:54.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.979+0000 7f24c0b36980 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5565bdba1eb0 con 0x5565bdb92ef0 2024-09-13T06:09:54.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.979+0000 7f24be646640 1 -- 172.21.15.194:0/2786695946 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93895463138160] v33'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24b00ee030 con 0x5565bdb978b0 2024-09-13T06:09:54.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.979+0000 7f24bde45640 1 -- 172.21.15.194:0/2786695946 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93895463136688] v33'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24b4037040 con 0x7f24b0108040 2024-09-13T06:09:54.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.979+0000 7f24bee47640 1 -- 172.21.15.194:0/2786695946 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v33'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24b800a4d0 con 0x5565bdb92ef0 2024-09-13T06:09:54.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.979+0000 7f24c0b36980 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93895463141088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5565bdba12c0 con 0x5565bdb92ef0 2024-09-13T06:09:54.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.979+0000 7f24c0b36980 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5565bdba1eb0 con 0x7f24b401fbe0 2024-09-13T06:09:54.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.983+0000 7f24bee47640 1 -- 172.21.15.194:0/2786695946 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93895463141088] v33'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24b800a4d0 con 0x5565bdb92ef0 2024-09-13T06:09:54.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.983+0000 7f24bee47640 1 -- 172.21.15.194:0/2786695946 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(54 notify.5 [create] v33'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24b800a4d0 con 0x7f24b401fbe0 2024-09-13T06:09:54.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.983+0000 7f24c0b36980 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93895463150736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5565bdba1eb0 con 0x7f24b401fbe0 2024-09-13T06:09:54.985 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.983+0000 7f24c0b36980 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5565bdba3030 con 0x7f24b401fbe0 2024-09-13T06:09:54.985 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.983+0000 7f24bee47640 1 -- 172.21.15.194:0/2786695946 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93895463150736] v33'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24b800a4d0 con 0x7f24b401fbe0 2024-09-13T06:09:54.985 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.983+0000 7f24bee47640 1 -- 172.21.15.194:0/2786695946 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(56 notify.6 [create] v33'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24b800a4d0 con 0x7f24b401fbe0 2024-09-13T06:09:54.986 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.983+0000 7f24c0b36980 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93895463148304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5565bdba3030 con 0x7f24b401fbe0 2024-09-13T06:09:54.986 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.983+0000 7f24c0b36980 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5565bdba39f0 con 0x7f24b401fbe0 2024-09-13T06:09:54.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.987+0000 7f24bee47640 1 -- 172.21.15.194:0/2786695946 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(58 notify.7 [create] v33'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24b800a4d0 con 0x7f24b401fbe0 2024-09-13T06:09:54.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.987+0000 7f24c0b36980 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93895463155008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5565bdba3e10 con 0x7f24b401fbe0 2024-09-13T06:09:54.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.987+0000 7f24c0b36980 20 add_watcher() i=0 2024-09-13T06:09:54.988 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.987+0000 7f24c0b36980 20 add_watcher() i=1 2024-09-13T06:09:54.988 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.987+0000 7f24c0b36980 20 add_watcher() i=2 2024-09-13T06:09:54.988 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.987+0000 7f24c0b36980 20 add_watcher() i=3 2024-09-13T06:09:54.988 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.987+0000 7f24c0b36980 20 add_watcher() i=4 2024-09-13T06:09:54.988 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.987+0000 7f24c0b36980 20 add_watcher() i=5 2024-09-13T06:09:54.988 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.987+0000 7f24bee47640 1 -- 172.21.15.194:0/2786695946 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93895463148304] v33'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24b800a4d0 con 0x7f24b401fbe0 2024-09-13T06:09:54.988 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.987+0000 7f24c0b36980 20 add_watcher() i=6 2024-09-13T06:09:54.989 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.987+0000 7f24bee47640 1 -- 172.21.15.194:0/2786695946 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93895463155008] v33'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24b800a4d0 con 0x7f24b401fbe0 2024-09-13T06:09:54.989 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.987+0000 7f24c0b36980 20 add_watcher() i=7 2024-09-13T06:09:54.989 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.987+0000 7f24c0b36980 2 all 8 watchers are set, enabling cache 2024-09-13T06:09:54.989 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.987+0000 7f24c0b36980 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5565bdba3e10 con 0x5565bdb92ef0 2024-09-13T06:09:54.989 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.987+0000 7f24bee47640 1 -- 172.21.15.194:0/2786695946 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f24b800a4d0 con 0x5565bdb92ef0 2024-09-13T06:09:54.990 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.987+0000 7f24c0b36980 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93895463156064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5565bdba3d80 con 0x5565bdb92ef0 2024-09-13T06:09:54.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.991+0000 7f24bee47640 1 -- 172.21.15.194:0/2786695946 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93895463156064] v33'70 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f24b800a4d0 con 0x5565bdb92ef0 2024-09-13T06:09:54.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.991+0000 7f2374fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:54.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.991+0000 7f24c0b36980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:09:54.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.991+0000 7f24c0b36980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:09:54.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.991+0000 7f24c0b36980 5 note: GC not initialized 2024-09-13T06:09:54.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.991+0000 7f22ef7fe640 20 reqs_thread_entry: start 2024-09-13T06:09:54.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.991+0000 7f24c0b36980 20 init_complete bucket index max shards: 11 2024-09-13T06:09:54.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.991+0000 7f24c0b36980 20 Filter name: none 2024-09-13T06:09:54.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.991+0000 7f22ed7fa640 20 reqs_thread_entry: start 2024-09-13T06:09:54.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.991+0000 7f24c0b36980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T06:09:54.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.991+0000 7f24c0b36980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.991+0000 7f24c0b36980 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5565bdbca4f0 con 0x5565bdb92ef0 2024-09-13T06:09:54.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.991+0000 7f24bee47640 1 -- 172.21.15.194:0/2786695946 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f24b800a4d0 con 0x5565bdb92ef0 2024-09-13T06:09:54.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.991+0000 7f24c0b36980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T06:09:54.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.991+0000 7f24c0b36980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T06:09:54.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.991+0000 7f24c0b36980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:09:54.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.991+0000 7f24c0b36980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:09:54.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.991+0000 7f24c0b36980 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : miss 2024-09-13T06:09:54.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.991+0000 7f24c0b36980 20 rados->read ofs=0 len=0 2024-09-13T06:09:54.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.991+0000 7f24c0b36980 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:63 8.8 8:17d68d04:users.swift::foo%3afoo1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5565bdbca040 con 0x5565bdb92ef0 2024-09-13T06:09:54.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.991+0000 7f24bee47640 1 -- 172.21.15.194:0/2786695946 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(63 foo:foo1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7f24b800a4d0 con 0x5565bdb92ef0 2024-09-13T06:09:54.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.991+0000 7f24c0b36980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:54.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.991+0000 7f24c0b36980 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x0 2024-09-13T06:09:54.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.991+0000 7f24c0b36980 10 adding default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-13T06:09:54.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.991+0000 7f24c0b36980 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : hit (negative entry) 2024-09-13T06:09:54.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.991+0000 7f24c0b36980 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5565bdbd0c30 con 0x5565bdb92ef0 2024-09-13T06:09:54.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.991+0000 7f24bee47640 1 -- 172.21.15.194:0/2786695946 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~556] v33'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f24b800a4d0 con 0x5565bdb92ef0 2024-09-13T06:09:54.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.991+0000 7f24c0b36980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T06:09:54.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.991+0000 7f24c0b36980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:09:54.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.991+0000 7f24c0b36980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T06:09:54.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.991+0000 7f24c0b36980 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 93895463339680 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5565bdbcf780 con 0x5565bdb92ef0 2024-09-13T06:09:54.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.991+0000 7f24bee47640 1 -- 172.21.15.194:0/2786695946 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== watch-notify(notify (1) cookie 93895463141088 notify 141733920773 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7f24b802d040 con 0x5565bdb92ef0 2024-09-13T06:09:54.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.991+0000 7f23a1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920773 cookie 93895463141088 notifier 4360 bl.length()=732 2024-09-13T06:09:54.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.991+0000 7f23a1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T06:09:54.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.991+0000 7f23a1ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:09:54.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.991+0000 7f24bee47640 1 -- 172.21.15.194:0/2786695946 <== osd.1 v2:172.21.15.194:6808/3135444559 25 ==== osd_op_reply(65 notify.4 [notify cookie 93895463339680 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f24b800a4d0 con 0x5565bdb92ef0 2024-09-13T06:09:54.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.991+0000 7f23a1ffb640 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f2384003eb0 con 0x5565bdb92ef0 2024-09-13T06:09:54.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.991+0000 7f24bee47640 1 -- 172.21.15.194:0/2786695946 <== osd.1 v2:172.21.15.194:6808/3135444559 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24b800a4d0 con 0x5565bdb92ef0 2024-09-13T06:09:54.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.991+0000 7f24bee47640 1 -- 172.21.15.194:0/2786695946 <== osd.1 v2:172.21.15.194:6808/3135444559 27 ==== watch-notify(notify_complete (2) cookie 93895463339680 notify 141733920773 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f24b801e040 con 0x5565bdb92ef0 2024-09-13T06:09:54.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.991+0000 7f24c0b36980 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:67 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5565bdbd06a0 con 0x5565bdb92ef0 2024-09-13T06:09:54.997 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.995+0000 7f24bee47640 1 -- 172.21.15.194:0/2786695946 <== osd.1 v2:172.21.15.194:6808/3135444559 28 ==== osd_op_reply(67 foo:foo1 [delete,create,writefull 0~7] v33'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7f24b800a4d0 con 0x5565bdb92ef0 2024-09-13T06:09:54.998 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.995+0000 7f24c0b36980 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-09-13T06:09:54.998 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.995+0000 7f24c0b36980 10 moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-13T06:09:54.998 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.995+0000 7f24c0b36980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-09-13T06:09:54.998 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.995+0000 7f24c0b36980 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 93895463339680 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5565bdbcf2d0 con 0x7f24b0108040 2024-09-13T06:09:54.998 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.995+0000 7f24bde45640 1 -- 172.21.15.194:0/2786695946 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== watch-notify(notify (1) cookie 93895463130768 notify 141733920770 ret 0) ==== 208+0+0 (crc 0 0 0) 0x7f24b4018040 con 0x7f24b0108040 2024-09-13T06:09:54.998 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.995+0000 7f23a1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920770 cookie 93895463130768 notifier 4360 bl.length()=166 2024-09-13T06:09:54.998 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.995+0000 7f23a1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-09-13T06:09:54.998 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.995+0000 7f23a1ffb640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-13T06:09:54.998 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.995+0000 7f23a1ffb640 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f2384003eb0 con 0x7f24b0108040 2024-09-13T06:09:54.998 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.995+0000 7f24bde45640 1 -- 172.21.15.194:0/2786695946 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(68 notify.0 [notify cookie 93895463339680 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f24b4037040 con 0x7f24b0108040 2024-09-13T06:09:54.998 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.995+0000 7f24bde45640 1 -- 172.21.15.194:0/2786695946 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24b4037040 con 0x7f24b0108040 2024-09-13T06:09:54.998 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.995+0000 7f24bde45640 1 -- 172.21.15.194:0/2786695946 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== watch-notify(notify_complete (2) cookie 93895463339680 notify 141733920770 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5565bd8e9ae0 con 0x7f24b0108040 2024-09-13T06:09:54.999 INFO:teuthology.orchestra.run.smithi194.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T06:09:53.191222Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"JLE4FOzkDQvBKBoY3fwEaim3zJMwS4ZtcxiA7HQh","active":true,"create_date":"2024-09-13T06:09:54.994715Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:09:53.191207Z","tags":[],"group_ids":[]} 2024-09-13T06:09:55.000 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.995+0000 7f2374fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:55.000 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.995+0000 7f24c0b36980 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93895463156064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5565bdbc8320 con 0x5565bdb92ef0 2024-09-13T06:09:55.000 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.995+0000 7f24bee47640 1 -- 172.21.15.194:0/2786695946 <== osd.1 v2:172.21.15.194:6808/3135444559 29 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93895463156064] v33'71 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f24b800a4d0 con 0x5565bdb92ef0 2024-09-13T06:09:55.000 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.995+0000 7f24c0b36980 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93895463130768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5565bdbc8320 con 0x7f24b0108040 2024-09-13T06:09:55.000 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.999+0000 7f24bde45640 1 -- 172.21.15.194:0/2786695946 <== osd.2 v2:172.21.15.194:6800/815615585 16 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93895463130768] v33'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24b4037040 con 0x7f24b0108040 2024-09-13T06:09:55.000 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.999+0000 7f24c0b36980 20 remove_watcher() i=0 2024-09-13T06:09:55.000 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.999+0000 7f24c0b36980 2 removed watcher, disabling cache 2024-09-13T06:09:55.000 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.999+0000 7f24c0b36980 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93895463135632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5565bdbc8320 con 0x5565bdb92ef0 2024-09-13T06:09:55.001 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.999+0000 7f24bee47640 1 -- 172.21.15.194:0/2786695946 <== osd.1 v2:172.21.15.194:6808/3135444559 30 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93895463135632] v33'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24b800a4d0 con 0x5565bdb92ef0 2024-09-13T06:09:55.001 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.999+0000 7f24c0b36980 20 remove_watcher() i=1 2024-09-13T06:09:55.001 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:54.999+0000 7f24c0b36980 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93895463138160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5565bdb9e990 con 0x5565bdb978b0 2024-09-13T06:09:55.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.003+0000 7f24be646640 1 -- 172.21.15.194:0/2786695946 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93895463138160] v33'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24b00ee030 con 0x5565bdb978b0 2024-09-13T06:09:55.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.003+0000 7f24c0b36980 20 remove_watcher() i=2 2024-09-13T06:09:55.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.003+0000 7f24c0b36980 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93895463136688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5565bdbc8320 con 0x7f24b0108040 2024-09-13T06:09:55.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.003+0000 7f24bde45640 1 -- 172.21.15.194:0/2786695946 <== osd.2 v2:172.21.15.194:6800/815615585 17 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93895463136688] v33'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24b4037040 con 0x7f24b0108040 2024-09-13T06:09:55.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.003+0000 7f24c0b36980 20 remove_watcher() i=3 2024-09-13T06:09:55.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.003+0000 7f24c0b36980 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93895463141088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5565bdbc8320 con 0x5565bdb92ef0 2024-09-13T06:09:55.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.003+0000 7f24bee47640 1 -- 172.21.15.194:0/2786695946 <== osd.1 v2:172.21.15.194:6808/3135444559 31 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93895463141088] v33'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24b800a4d0 con 0x5565bdb92ef0 2024-09-13T06:09:55.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.003+0000 7f24c0b36980 20 remove_watcher() i=4 2024-09-13T06:09:55.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.003+0000 7f24c0b36980 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93895463150736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5565bdb9fee0 con 0x7f24b401fbe0 2024-09-13T06:09:55.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.007+0000 7f24bee47640 1 -- 172.21.15.194:0/2786695946 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93895463150736] v33'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24b800a4d0 con 0x7f24b401fbe0 2024-09-13T06:09:55.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.007+0000 7f24c0b36980 20 remove_watcher() i=5 2024-09-13T06:09:55.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.007+0000 7f24c0b36980 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93895463148304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5565bdbc8320 con 0x7f24b401fbe0 2024-09-13T06:09:55.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.007+0000 7f24bee47640 1 -- 172.21.15.194:0/2786695946 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93895463148304] v33'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24b800a4d0 con 0x7f24b401fbe0 2024-09-13T06:09:55.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.007+0000 7f24c0b36980 20 remove_watcher() i=6 2024-09-13T06:09:55.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.007+0000 7f24c0b36980 1 -- 172.21.15.194:0/2786695946 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93895463155008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5565bdba1b10 con 0x7f24b401fbe0 2024-09-13T06:09:55.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.011+0000 7f24bee47640 1 -- 172.21.15.194:0/2786695946 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93895463155008] v33'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24b800a4d0 con 0x7f24b401fbe0 2024-09-13T06:09:55.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.011+0000 7f24c0b36980 20 remove_watcher() i=7 2024-09-13T06:09:55.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.011+0000 7f24c0b36980 1 -- 172.21.15.194:0/2786695946 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f24b401fbe0 msgr2=0x7f24b403a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.011+0000 7f24c0b36980 1 --2- 172.21.15.194:0/2786695946 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f24b401fbe0 0x7f24b403a3c0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.011+0000 7f24c0b36980 1 -- 172.21.15.194:0/2786695946 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5565bdb92ef0 msgr2=0x5565bdb953b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.011+0000 7f24c0b36980 1 --2- 172.21.15.194:0/2786695946 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5565bdb92ef0 0x5565bdb953b0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.011+0000 7f24c0b36980 1 -- 172.21.15.194:0/2786695946 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f24b0108040 msgr2=0x7f24b00ff9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.011+0000 7f24c0b36980 1 --2- 172.21.15.194:0/2786695946 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f24b0108040 0x7f24b00ff9f0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.011+0000 7f24c0b36980 1 -- 172.21.15.194:0/2786695946 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5565bdb978b0 msgr2=0x5565bdb99ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.011+0000 7f24c0b36980 1 --2- 172.21.15.194:0/2786695946 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5565bdb978b0 0x5565bdb99ca0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.011+0000 7f24c0b36980 1 -- 172.21.15.194:0/2786695946 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f2388034650 msgr2=0x7f2388036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.011+0000 7f24c0b36980 1 --2- 172.21.15.194:0/2786695946 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f2388034650 0x7f2388036b10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f24b400c010 tx=0x7f24b4010000 comp rx=0 tx=0).stop 2024-09-13T06:09:55.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.011+0000 7f24c0b36980 1 -- 172.21.15.194:0/2786695946 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5565bdb7ea10 msgr2=0x5565bd9d8500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.011+0000 7f24c0b36980 1 --2- 172.21.15.194:0/2786695946 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5565bdb7ea10 0x5565bd9d8500 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f24b001bbe0 tx=0x7f24b00bae80 comp rx=0 tx=0).stop 2024-09-13T06:09:55.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.011+0000 7f24bee47640 1 -- 172.21.15.194:0/2786695946 reap_dead start 2024-09-13T06:09:55.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.011+0000 7f24bee47640 1 -- 172.21.15.194:0/2786695946 reap_dead start 2024-09-13T06:09:55.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.011+0000 7f24c0b36980 1 -- 172.21.15.194:0/2786695946 shutdown_connections 2024-09-13T06:09:55.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.011+0000 7f24c0b36980 1 -- 172.21.15.194:0/2786695946 >> 172.21.15.194:0/2786695946 conn(0x5565bdb7adf0 msgr2=0x5565bdb78ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:55.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.011+0000 7f24c0b36980 1 -- 172.21.15.194:0/2786695946 shutdown_connections 2024-09-13T06:09:55.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.011+0000 7f24c0b36980 1 -- 172.21.15.194:0/2786695946 wait complete. 2024-09-13T06:09:55.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.011+0000 7f24c0b36980 1 -- 172.21.15.194:0/3669743830 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f2398034650 msgr2=0x7f2398036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.011+0000 7f24c0b36980 1 --2- 172.21.15.194:0/3669743830 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f2398034650 0x7f2398036b10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x5565bdb5c150 tx=0x7f24b400f000 comp rx=0 tx=0).stop 2024-09-13T06:09:55.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.011+0000 7f24c0b36980 1 -- 172.21.15.194:0/3669743830 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5565bdb72080 msgr2=0x5565bdb724a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.011+0000 7f24c0b36980 1 --2- 172.21.15.194:0/3669743830 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5565bdb72080 0x5565bdb724a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f24b0000c10 tx=0x7f24b00c5a50 comp rx=0 tx=0).stop 2024-09-13T06:09:55.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.011+0000 7f24c0b36980 1 -- 172.21.15.194:0/3669743830 shutdown_connections 2024-09-13T06:09:55.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.011+0000 7f24c0b36980 1 --2- 172.21.15.194:0/3669743830 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f2398034650 0x7f2398036b10 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.011+0000 7f24c0b36980 1 --2- 172.21.15.194:0/3669743830 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5565bdb72080 0x5565bdb724a0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.011+0000 7f24c0b36980 1 -- 172.21.15.194:0/3669743830 >> 172.21.15.194:0/3669743830 conn(0x5565bdb671d0 msgr2=0x5565bdb69c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:55.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.011+0000 7f24c0b36980 1 -- 172.21.15.194:0/3669743830 shutdown_connections 2024-09-13T06:09:55.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.011+0000 7f24c0b36980 1 -- 172.21.15.194:0/3669743830 wait complete. 2024-09-13T06:09:55.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.011+0000 7f24c0b36980 1 -- 172.21.15.194:0/2231238965 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5565bdb58dd0 msgr2=0x5565bdb5b200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.011+0000 7f24c0b36980 1 --2- 172.21.15.194:0/2231238965 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5565bdb58dd0 0x5565bdb5b200 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.011+0000 7f24c0b36980 1 -- 172.21.15.194:0/2231238965 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5565bdb61ac0 msgr2=0x5565bdb63eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.011+0000 7f24c0b36980 1 --2- 172.21.15.194:0/2231238965 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5565bdb61ac0 0x5565bdb63eb0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.011+0000 7f24c0b36980 1 -- 172.21.15.194:0/2231238965 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5565bdb5dba0 msgr2=0x5565bdb5ff90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.011+0000 7f24c0b36980 1 --2- 172.21.15.194:0/2231238965 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5565bdb5dba0 0x5565bdb5ff90 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.017 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.011+0000 7f24c0b36980 1 -- 172.21.15.194:0/2231238965 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f23a4034650 msgr2=0x7f23a4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.017 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.011+0000 7f24c0b36980 1 --2- 172.21.15.194:0/2231238965 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f23a4034650 0x7f23a4036b10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f24b4000f70 tx=0x7f24b4001380 comp rx=0 tx=0).stop 2024-09-13T06:09:55.017 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.011+0000 7f24c0b36980 1 -- 172.21.15.194:0/2231238965 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5565bda61ff0 msgr2=0x5565bdb53e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.017 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.011+0000 7f24c0b36980 1 --2- 172.21.15.194:0/2231238965 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5565bda61ff0 0x5565bdb53e50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f24b00199f0 tx=0x7f24b00180e0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.017 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.011+0000 7f24bee47640 1 -- 172.21.15.194:0/2231238965 reap_dead start 2024-09-13T06:09:55.017 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.011+0000 7f24c0b36980 1 -- 172.21.15.194:0/2231238965 shutdown_connections 2024-09-13T06:09:55.017 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.011+0000 7f24c0b36980 1 -- 172.21.15.194:0/2231238965 >> 172.21.15.194:0/2231238965 conn(0x5565bda5d1c0 msgr2=0x5565bdb47200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:55.017 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.011+0000 7f24c0b36980 1 -- 172.21.15.194:0/2231238965 shutdown_connections 2024-09-13T06:09:55.017 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.011+0000 7f24c0b36980 1 -- 172.21.15.194:0/2231238965 wait complete. 2024-09-13T06:09:55.022 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T06:09:53.191222Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'JLE4FOzkDQvBKBoY3fwEaim3zJMwS4ZtcxiA7HQh', 'active': True, 'create_date': '2024-09-13T06:09:54.994715Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:09:53.191207Z', 'tags': [], 'group_ids': []} 2024-09-13T06:09:55.023 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-09-13T06:09:55.023 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-09-13T06:09:55.023 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser modify --subuser foo:foo1 --secret gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL --key-type swift 2024-09-13T06:09:55.104 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:09:55.104 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:09:55.105 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.103+0000 7f381ffb3980 1 Processor -- start 2024-09-13T06:09:55.105 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.103+0000 7f381ffb3980 1 -- start start 2024-09-13T06:09:55.105 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.103+0000 7f381ffb3980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x5584092f35f0 0x5584092f39d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.105 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.103+0000 7f381ffb3980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55840917bae0 con 0x5584092f3f40 2024-09-13T06:09:55.105 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.103+0000 7f381ffb3980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x55840919fe30 con 0x5584092f35f0 2024-09-13T06:09:55.105 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.103+0000 7f381dac3640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x5584092f35f0 0x5584092f39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.106 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.103+0000 7f381dac3640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x5584092f35f0 0x5584092f39d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44684/0 (socket says 172.21.15.194:44684) 2024-09-13T06:09:55.106 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.103+0000 7f381dac3640 1 -- 172.21.15.194:0/3916651007 learned_addr learned my addr 172.21.15.194:0/3916651007 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:55.106 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.103+0000 7f381dac3640 1 -- 172.21.15.194:0/3916651007 >> v1:172.21.15.120:6789/0 conn(0x5584092f3f40 legacy=0x5584092f8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.106 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.103+0000 7f381dac3640 1 -- 172.21.15.194:0/3916651007 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584092fb1c0 con 0x5584092f35f0 2024-09-13T06:09:55.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.107+0000 7f381dac3640 1 --2- 172.21.15.194:0/3916651007 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5584092f35f0 0x5584092f39d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f381000a5c0 tx=0x7f381001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0bc275e1e8be1c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.107+0000 7f381cac1640 1 -- 172.21.15.194:0/3916651007 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38100a6070 con 0x5584092f35f0 2024-09-13T06:09:55.109 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.107+0000 7f381cac1640 1 -- 172.21.15.194:0/3916651007 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38100af070 con 0x5584092f35f0 2024-09-13T06:09:55.109 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.107+0000 7f381cac1640 1 -- 172.21.15.194:0/3916651007 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38100aa5c0 con 0x5584092f35f0 2024-09-13T06:09:55.109 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.107+0000 7f381ffb3980 1 -- 172.21.15.194:0/3916651007 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5584092f35f0 msgr2=0x5584092f39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.109 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.107+0000 7f381ffb3980 1 --2- 172.21.15.194:0/3916651007 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5584092f35f0 0x5584092f39d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f381000a5c0 tx=0x7f381001b340 comp rx=0 tx=0).stop 2024-09-13T06:09:55.110 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.107+0000 7f381ffb3980 1 -- 172.21.15.194:0/3916651007 shutdown_connections 2024-09-13T06:09:55.110 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.107+0000 7f381ffb3980 1 --2- 172.21.15.194:0/3916651007 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5584092f35f0 0x5584092f39d0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.110 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.107+0000 7f381ffb3980 1 -- 172.21.15.194:0/3916651007 >> 172.21.15.194:0/3916651007 conn(0x5584092ef110 msgr2=0x5584092f1530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:55.110 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.107+0000 7f381ffb3980 1 -- 172.21.15.194:0/3916651007 shutdown_connections 2024-09-13T06:09:55.110 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.107+0000 7f381ffb3980 1 -- 172.21.15.194:0/3916651007 wait complete. 2024-09-13T06:09:55.123 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.123+0000 7f381ffb3980 1 Processor -- start 2024-09-13T06:09:55.123 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.123+0000 7f381ffb3980 1 -- start start 2024-09-13T06:09:55.123 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.123+0000 7f381ffb3980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5584092f35f0 0x5584093dea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.123 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.123+0000 7f381ffb3980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5584091a1200 con 0x5584092f35f0 2024-09-13T06:09:55.124 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.123+0000 7f381dac3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5584092f35f0 0x5584093dea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.124 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.123+0000 7f381dac3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5584092f35f0 0x5584093dea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44696/0 (socket says 172.21.15.194:44696) 2024-09-13T06:09:55.124 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.123+0000 7f381dac3640 1 -- 172.21.15.194:0/3871742026 learned_addr learned my addr 172.21.15.194:0/3871742026 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:55.124 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.123+0000 7f381dac3640 1 -- 172.21.15.194:0/3871742026 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584093df040 con 0x5584092f35f0 2024-09-13T06:09:55.124 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.123+0000 7f381dac3640 1 --2- 172.21.15.194:0/3871742026 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5584092f35f0 0x5584093dea70 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f381000a5c0 tx=0x7f3810003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a8f698cd0786920 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.125 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.123+0000 7f370be07640 1 -- 172.21.15.194:0/3871742026 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38100aa9b0 con 0x5584092f35f0 2024-09-13T06:09:55.125 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.123+0000 7f370be07640 1 -- 172.21.15.194:0/3871742026 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38100aab50 con 0x5584092f35f0 2024-09-13T06:09:55.125 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.123+0000 7f370be07640 1 -- 172.21.15.194:0/3871742026 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38100aae50 con 0x5584092f35f0 2024-09-13T06:09:55.126 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.123+0000 7f381ffb3980 1 -- 172.21.15.194:0/3871742026 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5584092f35f0 msgr2=0x5584093dea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.126 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.123+0000 7f381ffb3980 1 --2- 172.21.15.194:0/3871742026 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5584092f35f0 0x5584093dea70 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f381000a5c0 tx=0x7f3810003030 comp rx=0 tx=0).stop 2024-09-13T06:09:55.126 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.123+0000 7f381ffb3980 1 -- 172.21.15.194:0/3871742026 shutdown_connections 2024-09-13T06:09:55.126 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.123+0000 7f381ffb3980 1 --2- 172.21.15.194:0/3871742026 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5584092f35f0 0x5584093dea70 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.126 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.123+0000 7f381ffb3980 1 -- 172.21.15.194:0/3871742026 >> 172.21.15.194:0/3871742026 conn(0x5584092ef110 msgr2=0x5584093da6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:55.126 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.123+0000 7f381ffb3980 1 -- 172.21.15.194:0/3871742026 shutdown_connections 2024-09-13T06:09:55.126 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.123+0000 7f381ffb3980 1 -- 172.21.15.194:0/3871742026 wait complete. 2024-09-13T06:09:55.126 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.123+0000 7f381ffb3980 1 Processor -- start 2024-09-13T06:09:55.126 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.123+0000 7f381ffb3980 1 -- start start 2024-09-13T06:09:55.126 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.123+0000 7f381ffb3980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5584092f35f0 0x5584093e5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.127 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.123+0000 7f381ffb3980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5584092fac00 con 0x5584092f35f0 2024-09-13T06:09:55.127 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.127+0000 7f381dac3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5584092f35f0 0x5584093e5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.128 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.127+0000 7f381dac3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5584092f35f0 0x5584093e5d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44712/0 (socket says 172.21.15.194:44712) 2024-09-13T06:09:55.128 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.127+0000 7f381dac3640 1 -- 172.21.15.194:0/2076483842 learned_addr learned my addr 172.21.15.194:0/2076483842 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:55.128 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.127+0000 7f381dac3640 1 -- 172.21.15.194:0/2076483842 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584093e62c0 con 0x5584092f35f0 2024-09-13T06:09:55.128 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.127+0000 7f381dac3640 1 --2- 172.21.15.194:0/2076483842 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5584092f35f0 0x5584093e5d80 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f381000a5c0 tx=0x7f38100180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.128 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.127+0000 7f370a604640 1 -- 172.21.15.194:0/2076483842 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38100cb020 con 0x5584092f35f0 2024-09-13T06:09:55.128 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.127+0000 7f381ffb3980 1 -- 172.21.15.194:0/2076483842 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5584093e6550 con 0x5584092f35f0 2024-09-13T06:09:55.128 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.127+0000 7f370a604640 1 -- 172.21.15.194:0/2076483842 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38100c6710 con 0x5584092f35f0 2024-09-13T06:09:55.128 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.127+0000 7f381ffb3980 1 -- 172.21.15.194:0/2076483842 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584093e9230 con 0x5584092f35f0 2024-09-13T06:09:55.128 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.127+0000 7f370a604640 1 -- 172.21.15.194:0/2076483842 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38100c69f0 con 0x5584092f35f0 2024-09-13T06:09:55.130 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.127+0000 7f370a604640 1 -- 172.21.15.194:0/2076483842 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f38100ce020 con 0x5584092f35f0 2024-09-13T06:09:55.130 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.127+0000 7f370a604640 1 --2- 172.21.15.194:0/2076483842 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3704034650 0x7f3704036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.130 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.127+0000 7f370a604640 1 -- 172.21.15.194:0/2076483842 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f38100e5120 con 0x5584092f35f0 2024-09-13T06:09:55.130 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.127+0000 7f381d2c2640 1 --2- 172.21.15.194:0/2076483842 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3704034650 0x7f3704036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.130 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.127+0000 7f381ffb3980 1 --2- 172.21.15.194:0/2076483842 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5584092f3f40 0x5584093ecd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.130 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.127+0000 7f381ffb3980 1 -- 172.21.15.194:0/2076483842 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5584093ed3a0 con 0x5584092f3f40 2024-09-13T06:09:55.130 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.127+0000 7f381e2c4640 1 --2- 172.21.15.194:0/2076483842 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5584092f3f40 0x5584093ecd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.127+0000 7f381d2c2640 1 --2- 172.21.15.194:0/2076483842 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3704034650 0x7f3704036b10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3808001e20 tx=0x7f38080013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.127+0000 7f381e2c4640 1 --2- 172.21.15.194:0/2076483842 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5584092f3f40 0x5584093ecd30 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.127+0000 7f381e2c4640 1 -- 172.21.15.194:0/2076483842 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f381800a4d0 con 0x5584092f3f40 2024-09-13T06:09:55.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.127+0000 7f381ffb3980 1 -- 172.21.15.194:0/2076483842 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5584093edc60 con 0x5584092f3f40 2024-09-13T06:09:55.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.127+0000 7f381e2c4640 1 -- 172.21.15.194:0/2076483842 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f381800a4d0 con 0x5584092f3f40 2024-09-13T06:09:55.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.127+0000 7f381ffb3980 1 --2- 172.21.15.194:0/2076483842 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5584093ef570 0x5584093f1a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.127+0000 7f381ffb3980 1 -- 172.21.15.194:0/2076483842 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5584093f21c0 con 0x5584093ef570 2024-09-13T06:09:55.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.131+0000 7f381dac3640 1 --2- 172.21.15.194:0/2076483842 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5584093ef570 0x5584093f1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.133 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.131+0000 7f381dac3640 1 --2- 172.21.15.194:0/2076483842 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5584093ef570 0x5584093f1a30 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.133 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.131+0000 7f381dac3640 1 -- 172.21.15.194:0/2076483842 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f38100bd910 con 0x5584093ef570 2024-09-13T06:09:55.133 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.131+0000 7f381ffb3980 1 -- 172.21.15.194:0/2076483842 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5584093ee4b0 con 0x5584092f3f40 2024-09-13T06:09:55.133 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.131+0000 7f381e2c4640 1 -- 172.21.15.194:0/2076483842 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f381800a4d0 con 0x5584092f3f40 2024-09-13T06:09:55.133 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.131+0000 7f381ffb3980 1 --2- 172.21.15.194:0/2076483842 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5584093f3620 0x5584093f5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.133 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.131+0000 7f381ffb3980 1 -- 172.21.15.194:0/2076483842 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5584093f6100 con 0x5584093f3620 2024-09-13T06:09:55.133 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.131+0000 7f381d2c2640 1 --2- 172.21.15.194:0/2076483842 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5584093f3620 0x5584093f5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.133 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.131+0000 7f381d2c2640 1 --2- 172.21.15.194:0/2076483842 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5584093f3620 0x5584093f5a10 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.131+0000 7f381d2c2640 1 -- 172.21.15.194:0/2076483842 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f380800d040 con 0x5584093f3620 2024-09-13T06:09:55.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.131+0000 7f381ffb3980 1 Processor -- start 2024-09-13T06:09:55.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.131+0000 7f381ffb3980 1 -- start start 2024-09-13T06:09:55.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.131+0000 7f381ffb3980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558409269cf0 0x558409268370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.131+0000 7f381ffb3980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5584091fa800 con 0x558409269cf0 2024-09-13T06:09:55.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.131+0000 7f381dac3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558409269cf0 0x558409268370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.131+0000 7f381dac3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558409269cf0 0x558409268370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44718/0 (socket says 172.21.15.194:44718) 2024-09-13T06:09:55.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.131+0000 7f381dac3640 1 -- 172.21.15.194:0/2004801703 learned_addr learned my addr 172.21.15.194:0/2004801703 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:55.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.131+0000 7f381dac3640 1 -- 172.21.15.194:0/2004801703 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55840926a110 con 0x558409269cf0 2024-09-13T06:09:55.136 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.131+0000 7f381dac3640 1 --2- 172.21.15.194:0/2004801703 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558409269cf0 0x558409268370 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f38100c5fd0 tx=0x7f38100bd690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.136 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.131+0000 7f37037fe640 1 -- 172.21.15.194:0/2004801703 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38100c6cc0 con 0x558409269cf0 2024-09-13T06:09:55.137 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.131+0000 7f381ffb3980 1 -- 172.21.15.194:0/2004801703 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558409268910 con 0x558409269cf0 2024-09-13T06:09:55.137 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.131+0000 7f381ffb3980 1 -- 172.21.15.194:0/2004801703 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558409268de0 con 0x558409269cf0 2024-09-13T06:09:55.137 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.131+0000 7f37037fe640 1 -- 172.21.15.194:0/2004801703 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38100e3130 con 0x558409269cf0 2024-09-13T06:09:55.137 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.131+0000 7f37037fe640 1 -- 172.21.15.194:0/2004801703 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38100f2060 con 0x558409269cf0 2024-09-13T06:09:55.137 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.135+0000 7f37037fe640 1 -- 172.21.15.194:0/2004801703 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f38100c5720 con 0x558409269cf0 2024-09-13T06:09:55.137 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.135+0000 7f37037fe640 1 --2- 172.21.15.194:0/2004801703 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f36f8034650 0x7f36f8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.137 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.135+0000 7f37037fe640 1 -- 172.21.15.194:0/2004801703 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f38100e20c0 con 0x558409269cf0 2024-09-13T06:09:55.137 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.135+0000 7f381d2c2640 1 --2- 172.21.15.194:0/2004801703 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f36f8034650 0x7f36f8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.137 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.135+0000 7f381ffb3980 1 Processor -- start 2024-09-13T06:09:55.137 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.135+0000 7f381ffb3980 1 -- start start 2024-09-13T06:09:55.137 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.135+0000 7f381ffb3980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558409412740 0x558409412b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.137 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.135+0000 7f381ffb3980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5584093df300 con 0x558409412740 2024-09-13T06:09:55.138 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.135+0000 7f381d2c2640 1 --2- 172.21.15.194:0/2004801703 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f36f8034650 0x7f36f8036b10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x5584093ea490 tx=0x7f3808006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.138 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.135+0000 7f381dac3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558409412740 0x558409412b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.138 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.135+0000 7f381dac3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558409412740 0x558409412b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44734/0 (socket says 172.21.15.194:44734) 2024-09-13T06:09:55.138 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.135+0000 7f381dac3640 1 -- 172.21.15.194:0/2478178529 learned_addr learned my addr 172.21.15.194:0/2478178529 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:55.138 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.135+0000 7f381dac3640 1 -- 172.21.15.194:0/2478178529 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584094130f0 con 0x558409412740 2024-09-13T06:09:55.138 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.135+0000 7f381dac3640 1 --2- 172.21.15.194:0/2478178529 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558409412740 0x558409412b20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f38100ab3e0 tx=0x7f38100b3520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=298e1d1abbf9a715 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.135+0000 7f37017fa640 1 -- 172.21.15.194:0/2478178529 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38100c5a10 con 0x558409412740 2024-09-13T06:09:55.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.135+0000 7f37017fa640 1 -- 172.21.15.194:0/2478178529 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38100d2e20 con 0x558409412740 2024-09-13T06:09:55.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.135+0000 7f37017fa640 1 -- 172.21.15.194:0/2478178529 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38100bccb0 con 0x558409412740 2024-09-13T06:09:55.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.135+0000 7f381ffb3980 1 -- 172.21.15.194:0/2478178529 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558409412740 msgr2=0x558409412b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.135+0000 7f381ffb3980 1 --2- 172.21.15.194:0/2478178529 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558409412740 0x558409412b20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f38100ab3e0 tx=0x7f38100b3520 comp rx=0 tx=0).stop 2024-09-13T06:09:55.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.135+0000 7f381ffb3980 1 -- 172.21.15.194:0/2478178529 shutdown_connections 2024-09-13T06:09:55.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.135+0000 7f381ffb3980 1 --2- 172.21.15.194:0/2478178529 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558409412740 0x558409412b20 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.135+0000 7f381ffb3980 1 -- 172.21.15.194:0/2478178529 >> 172.21.15.194:0/2478178529 conn(0x55840940eb20 msgr2=0x55840940cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:55.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.135+0000 7f381ffb3980 1 -- 172.21.15.194:0/2478178529 shutdown_connections 2024-09-13T06:09:55.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.135+0000 7f381ffb3980 1 -- 172.21.15.194:0/2478178529 wait complete. 2024-09-13T06:09:55.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.135+0000 7f381ffb3980 1 Processor -- start 2024-09-13T06:09:55.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.135+0000 7f381ffb3980 1 -- start start 2024-09-13T06:09:55.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.135+0000 7f381ffb3980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558409412740 0x558409419960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.135+0000 7f381ffb3980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x558409413590 con 0x558409412740 2024-09-13T06:09:55.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.139+0000 7f381dac3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558409412740 0x558409419960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.139+0000 7f381dac3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558409412740 0x558409419960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44746/0 (socket says 172.21.15.194:44746) 2024-09-13T06:09:55.146 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.139+0000 7f381dac3640 1 -- 172.21.15.194:0/3377178399 learned_addr learned my addr 172.21.15.194:0/3377178399 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:55.146 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.139+0000 7f381dac3640 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558409419ea0 con 0x558409412740 2024-09-13T06:09:55.146 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.139+0000 7f381dac3640 1 --2- 172.21.15.194:0/3377178399 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558409412740 0x558409419960 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f38100ddf00 tx=0x7f38100bcf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.146 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.139+0000 7f36ef7fe640 1 -- 172.21.15.194:0/3377178399 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3810110070 con 0x558409412740 2024-09-13T06:09:55.146 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.139+0000 7f381ffb3980 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558409419ea0 con 0x558409412740 2024-09-13T06:09:55.146 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.139+0000 7f381ffb3980 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55840941a370 con 0x558409412740 2024-09-13T06:09:55.146 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.139+0000 7f36ef7fe640 1 -- 172.21.15.194:0/3377178399 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38100c5a10 con 0x558409412740 2024-09-13T06:09:55.146 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.139+0000 7f36ef7fe640 1 -- 172.21.15.194:0/3377178399 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38100bc6d0 con 0x558409412740 2024-09-13T06:09:55.146 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.139+0000 7f36ef7fe640 1 -- 172.21.15.194:0/3377178399 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3810109040 con 0x558409412740 2024-09-13T06:09:55.146 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.139+0000 7f36ef7fe640 1 --2- 172.21.15.194:0/3377178399 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f36e80346a0 0x7f36e8036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.146 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.139+0000 7f36ef7fe640 1 -- 172.21.15.194:0/3377178399 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f38101191c0 con 0x558409412740 2024-09-13T06:09:55.146 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.139+0000 7f381d2c2640 1 --2- 172.21.15.194:0/3377178399 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f36e80346a0 0x7f36e8036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.146 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.139+0000 7f381ffb3980 20 rados->read ofs=0 len=0 2024-09-13T06:09:55.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.139+0000 7f381ffb3980 1 --2- 172.21.15.194:0/3377178399 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5584094249a0 0x558409426e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.139+0000 7f381ffb3980 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5584094275b0 con 0x5584094249a0 2024-09-13T06:09:55.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.139+0000 7f381e2c4640 1 --2- 172.21.15.194:0/3377178399 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5584094249a0 0x558409426e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.139+0000 7f381d2c2640 1 --2- 172.21.15.194:0/3377178399 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f36e80346a0 0x7f36e8036b60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x5584093f6500 tx=0x7f3808011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.139+0000 7f381e2c4640 1 --2- 172.21.15.194:0/3377178399 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5584094249a0 0x558409426e60 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.139+0000 7f381e2c4640 1 -- 172.21.15.194:0/3377178399 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f381800a4d0 con 0x5584094249a0 2024-09-13T06:09:55.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.139+0000 7f381ffb3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:55.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.139+0000 7f381ffb3980 20 realm 2024-09-13T06:09:55.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.139+0000 7f381ffb3980 20 rados->read ofs=0 len=0 2024-09-13T06:09:55.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.139+0000 7f381ffb3980 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5584094279c0 con 0x5584094249a0 2024-09-13T06:09:55.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.139+0000 7f381e2c4640 1 -- 172.21.15.194:0/3377178399 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f381800a4d0 con 0x5584094249a0 2024-09-13T06:09:55.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.139+0000 7f381ffb3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:55.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.139+0000 7f381ffb3980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:09:55.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.139+0000 7f381ffb3980 20 rados->read ofs=0 len=0 2024-09-13T06:09:55.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.139+0000 7f381ffb3980 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558409428290 con 0x5584094249a0 2024-09-13T06:09:55.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.139+0000 7f381e2c4640 1 -- 172.21.15.194:0/3377178399 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f381800a4d0 con 0x5584094249a0 2024-09-13T06:09:55.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.139+0000 7f381ffb3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:55.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.139+0000 7f381ffb3980 20 rados->read ofs=0 len=0 2024-09-13T06:09:55.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.139+0000 7f381ffb3980 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558409428630 con 0x5584094249a0 2024-09-13T06:09:55.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.143+0000 7f381e2c4640 1 -- 172.21.15.194:0/3377178399 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f381800a4d0 con 0x5584094249a0 2024-09-13T06:09:55.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.143+0000 7f381ffb3980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:55.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.143+0000 7f381ffb3980 20 rados->read ofs=0 len=0 2024-09-13T06:09:55.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.143+0000 7f381ffb3980 1 --2- 172.21.15.194:0/3377178399 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x558409429390 0x55840942b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.143+0000 7f381ffb3980 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55840942bd90 con 0x558409429390 2024-09-13T06:09:55.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.143+0000 7f381dac3640 1 --2- 172.21.15.194:0/3377178399 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x558409429390 0x55840942b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.143+0000 7f381dac3640 1 --2- 172.21.15.194:0/3377178399 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x558409429390 0x55840942b780 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.143+0000 7f381dac3640 1 -- 172.21.15.194:0/3377178399 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f38100eb070 con 0x558409429390 2024-09-13T06:09:55.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.143+0000 7f381ffb3980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:09:55.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.143+0000 7f381ffb3980 20 searching for the correct realm 2024-09-13T06:09:55.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.143+0000 7f381ffb3980 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55840942d5f0 con 0x558409429390 2024-09-13T06:09:55.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.143+0000 7f381dac3640 1 -- 172.21.15.194:0/3377178399 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38100eb070 con 0x558409429390 2024-09-13T06:09:55.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.143+0000 7f381dac3640 1 --2- 172.21.15.194:0/3377178399 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f381010c040 0x7f38100d20d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.143+0000 7f381dac3640 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55840942d5f0 con 0x7f381010c040 2024-09-13T06:09:55.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.143+0000 7f381d2c2640 1 --2- 172.21.15.194:0/3377178399 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f381010c040 0x7f38100d20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.143+0000 7f381d2c2640 1 --2- 172.21.15.194:0/3377178399 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f381010c040 0x7f38100d20d0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.143+0000 7f381d2c2640 1 -- 172.21.15.194:0/3377178399 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3808036040 con 0x7f381010c040 2024-09-13T06:09:55.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.143+0000 7f381d2c2640 1 --2- 172.21.15.194:0/3377178399 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f380800f3d0 0x7f380800f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.143+0000 7f381d2c2640 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55840942d5f0 con 0x7f380800f3d0 2024-09-13T06:09:55.150 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.143+0000 7f381e2c4640 1 --2- 172.21.15.194:0/3377178399 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f380800f3d0 0x7f380800f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.143+0000 7f381e2c4640 1 --2- 172.21.15.194:0/3377178399 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f380800f3d0 0x7f380800f7f0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.143+0000 7f381e2c4640 1 -- 172.21.15.194:0/3377178399 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f381800a4d0 con 0x7f380800f3d0 2024-09-13T06:09:55.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.143+0000 7f381e2c4640 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558409428630 con 0x5584094249a0 2024-09-13T06:09:55.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.143+0000 7f381e2c4640 1 -- 172.21.15.194:0/3377178399 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f381800a4d0 con 0x5584094249a0 2024-09-13T06:09:55.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.143+0000 7f381e2c4640 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558409428630 con 0x5584094249a0 2024-09-13T06:09:55.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.143+0000 7f381e2c4640 1 -- 172.21.15.194:0/3377178399 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f381800a4d0 con 0x5584094249a0 2024-09-13T06:09:55.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.143+0000 7f381e2c4640 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558409428630 con 0x7f380800f3d0 2024-09-13T06:09:55.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.147+0000 7f381e2c4640 1 -- 172.21.15.194:0/3377178399 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f381800a4d0 con 0x7f380800f3d0 2024-09-13T06:09:55.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.147+0000 7f381e2c4640 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558409428630 con 0x7f380800f3d0 2024-09-13T06:09:55.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.147+0000 7f381e2c4640 1 -- 172.21.15.194:0/3377178399 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f381800a4d0 con 0x7f380800f3d0 2024-09-13T06:09:55.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.147+0000 7f381e2c4640 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558409428630 con 0x7f381010c040 2024-09-13T06:09:55.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.147+0000 7f381d2c2640 1 -- 172.21.15.194:0/3377178399 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3808036040 con 0x7f381010c040 2024-09-13T06:09:55.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.147+0000 7f381d2c2640 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558409428630 con 0x558409429390 2024-09-13T06:09:55.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.147+0000 7f381dac3640 1 -- 172.21.15.194:0/3377178399 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38100eb070 con 0x558409429390 2024-09-13T06:09:55.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.147+0000 7f381dac3640 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558409428630 con 0x5584094249a0 2024-09-13T06:09:55.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.147+0000 7f381e2c4640 1 -- 172.21.15.194:0/3377178399 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f381800a4d0 con 0x5584094249a0 2024-09-13T06:09:55.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.147+0000 7f381e2c4640 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558409428630 con 0x7f380800f3d0 2024-09-13T06:09:55.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.147+0000 7f381e2c4640 1 -- 172.21.15.194:0/3377178399 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f381800a4d0 con 0x7f380800f3d0 2024-09-13T06:09:55.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.147+0000 7f381e2c4640 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558409428630 con 0x5584094249a0 2024-09-13T06:09:55.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.147+0000 7f381e2c4640 1 -- 172.21.15.194:0/3377178399 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f381800a4d0 con 0x5584094249a0 2024-09-13T06:09:55.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.147+0000 7f381e2c4640 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558409428630 con 0x7f381010c040 2024-09-13T06:09:55.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.147+0000 7f381d2c2640 1 -- 172.21.15.194:0/3377178399 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3808036040 con 0x7f381010c040 2024-09-13T06:09:55.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.147+0000 7f381d2c2640 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558409428630 con 0x558409429390 2024-09-13T06:09:55.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.147+0000 7f381dac3640 1 -- 172.21.15.194:0/3377178399 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38100eb070 con 0x558409429390 2024-09-13T06:09:55.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.147+0000 7f381dac3640 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558409428630 con 0x558409429390 2024-09-13T06:09:55.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.147+0000 7f381dac3640 1 -- 172.21.15.194:0/3377178399 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38100eb070 con 0x558409429390 2024-09-13T06:09:55.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.147+0000 7f381dac3640 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558409428630 con 0x7f380800f3d0 2024-09-13T06:09:55.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.147+0000 7f381e2c4640 1 -- 172.21.15.194:0/3377178399 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f381800a4d0 con 0x7f380800f3d0 2024-09-13T06:09:55.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.147+0000 7f381e2c4640 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558409428630 con 0x558409429390 2024-09-13T06:09:55.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.147+0000 7f381dac3640 1 -- 172.21.15.194:0/3377178399 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38100eb070 con 0x558409429390 2024-09-13T06:09:55.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.147+0000 7f381dac3640 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558409428630 con 0x558409429390 2024-09-13T06:09:55.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.151+0000 7f381dac3640 1 -- 172.21.15.194:0/3377178399 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38100eb070 con 0x558409429390 2024-09-13T06:09:55.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.151+0000 7f381dac3640 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558409428630 con 0x5584094249a0 2024-09-13T06:09:55.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.151+0000 7f381e2c4640 1 -- 172.21.15.194:0/3377178399 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f381800a4d0 con 0x5584094249a0 2024-09-13T06:09:55.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.151+0000 7f381e2c4640 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558409428630 con 0x5584094249a0 2024-09-13T06:09:55.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.151+0000 7f381e2c4640 1 -- 172.21.15.194:0/3377178399 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f381800a4d0 con 0x5584094249a0 2024-09-13T06:09:55.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.151+0000 7f381e2c4640 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558409428630 con 0x7f380800f3d0 2024-09-13T06:09:55.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.151+0000 7f381e2c4640 1 -- 172.21.15.194:0/3377178399 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f381800a4d0 con 0x7f380800f3d0 2024-09-13T06:09:55.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.151+0000 7f381e2c4640 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558409428630 con 0x558409429390 2024-09-13T06:09:55.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.151+0000 7f381dac3640 1 -- 172.21.15.194:0/3377178399 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38100eb070 con 0x558409429390 2024-09-13T06:09:55.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.151+0000 7f381dac3640 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558409428630 con 0x7f381010c040 2024-09-13T06:09:55.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.151+0000 7f381d2c2640 1 -- 172.21.15.194:0/3377178399 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3808036040 con 0x7f381010c040 2024-09-13T06:09:55.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.151+0000 7f381d2c2640 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558409428630 con 0x5584094249a0 2024-09-13T06:09:55.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.151+0000 7f381e2c4640 1 -- 172.21.15.194:0/3377178399 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f381800a4d0 con 0x5584094249a0 2024-09-13T06:09:55.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.151+0000 7f381e2c4640 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558409428630 con 0x7f380800f3d0 2024-09-13T06:09:55.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.151+0000 7f381e2c4640 1 -- 172.21.15.194:0/3377178399 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f381800a4d0 con 0x7f380800f3d0 2024-09-13T06:09:55.163 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.151+0000 7f381e2c4640 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558409428630 con 0x558409429390 2024-09-13T06:09:55.163 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.151+0000 7f381dac3640 1 -- 172.21.15.194:0/3377178399 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f38100eb070 con 0x558409429390 2024-09-13T06:09:55.163 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.151+0000 7f381dac3640 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558409428630 con 0x7f380800f3d0 2024-09-13T06:09:55.163 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.151+0000 7f381e2c4640 1 -- 172.21.15.194:0/3377178399 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f381800a4d0 con 0x7f380800f3d0 2024-09-13T06:09:55.163 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.151+0000 7f381e2c4640 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558409428630 con 0x7f381010c040 2024-09-13T06:09:55.163 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.151+0000 7f381d2c2640 1 -- 172.21.15.194:0/3377178399 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3808036040 con 0x7f381010c040 2024-09-13T06:09:55.163 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.155+0000 7f381d2c2640 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558409428630 con 0x558409429390 2024-09-13T06:09:55.163 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.155+0000 7f381dac3640 1 -- 172.21.15.194:0/3377178399 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38100eb070 con 0x558409429390 2024-09-13T06:09:55.163 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.155+0000 7f381dac3640 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558409428630 con 0x7f380800f3d0 2024-09-13T06:09:55.163 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.155+0000 7f381e2c4640 1 -- 172.21.15.194:0/3377178399 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f381800a4d0 con 0x7f380800f3d0 2024-09-13T06:09:55.163 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.155+0000 7f381e2c4640 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558409428630 con 0x5584094249a0 2024-09-13T06:09:55.163 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.155+0000 7f381e2c4640 1 -- 172.21.15.194:0/3377178399 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f381800a4d0 con 0x5584094249a0 2024-09-13T06:09:55.163 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.155+0000 7f381e2c4640 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558409428630 con 0x7f381010c040 2024-09-13T06:09:55.164 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.155+0000 7f381d2c2640 1 -- 172.21.15.194:0/3377178399 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3808036040 con 0x7f381010c040 2024-09-13T06:09:55.164 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.155+0000 7f381ffb3980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:09:55.164 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.155+0000 7f381ffb3980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:09:55.164 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.155+0000 7f381ffb3980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:09:55.164 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.155+0000 7f381ffb3980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:09:55.164 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.155+0000 7f381ffb3980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:09:55.164 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.155+0000 7f381ffb3980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:09:55.164 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.155+0000 7f381ffb3980 20 rados->read ofs=0 len=0 2024-09-13T06:09:55.164 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.155+0000 7f381ffb3980 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55840942c710 con 0x5584094249a0 2024-09-13T06:09:55.164 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.155+0000 7f381e2c4640 1 -- 172.21.15.194:0/3377178399 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f381800a4d0 con 0x5584094249a0 2024-09-13T06:09:55.164 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.155+0000 7f381ffb3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:55.164 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.155+0000 7f381ffb3980 20 rados->read ofs=0 len=0 2024-09-13T06:09:55.165 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.155+0000 7f381ffb3980 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55840942cf60 con 0x5584094249a0 2024-09-13T06:09:55.165 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.155+0000 7f381e2c4640 1 -- 172.21.15.194:0/3377178399 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f381800a4d0 con 0x5584094249a0 2024-09-13T06:09:55.165 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.155+0000 7f381ffb3980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:55.165 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.155+0000 7f381ffb3980 20 rados->read ofs=0 len=0 2024-09-13T06:09:55.165 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.155+0000 7f381ffb3980 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55840942cab0 con 0x7f381010c040 2024-09-13T06:09:55.165 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.155+0000 7f381d2c2640 1 -- 172.21.15.194:0/3377178399 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3808036040 con 0x7f381010c040 2024-09-13T06:09:55.165 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.155+0000 7f381ffb3980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:09:55.165 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.155+0000 7f381ffb3980 20 zone default found 2024-09-13T06:09:55.165 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.155+0000 7f381ffb3980 4 Realm: () 2024-09-13T06:09:55.165 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.155+0000 7f381ffb3980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:09:55.165 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.155+0000 7f381ffb3980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:09:55.165 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.155+0000 7f381ffb3980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:09:55.165 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.155+0000 7f381ffb3980 20 zonegroup default 2024-09-13T06:09:55.166 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.155+0000 7f381ffb3980 20 rados->read ofs=0 len=0 2024-09-13T06:09:55.166 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.155+0000 7f381ffb3980 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55840942da20 con 0x7f380800f3d0 2024-09-13T06:09:55.166 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.155+0000 7f381e2c4640 1 -- 172.21.15.194:0/3377178399 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f381800a4d0 con 0x7f380800f3d0 2024-09-13T06:09:55.166 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.155+0000 7f381ffb3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:55.166 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.155+0000 7f381ffb3980 20 rados->read ofs=0 len=0 2024-09-13T06:09:55.166 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.155+0000 7f381ffb3980 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55840942f490 con 0x558409429390 2024-09-13T06:09:55.166 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.155+0000 7f381dac3640 1 -- 172.21.15.194:0/3377178399 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f38100eb070 con 0x558409429390 2024-09-13T06:09:55.166 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.155+0000 7f381ffb3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:55.166 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.155+0000 7f381ffb3980 20 rados->read ofs=0 len=0 2024-09-13T06:09:55.166 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.155+0000 7f381ffb3980 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55840942f920 con 0x558409429390 2024-09-13T06:09:55.166 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.155+0000 7f381dac3640 1 -- 172.21.15.194:0/3377178399 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f38100eb070 con 0x558409429390 2024-09-13T06:09:55.166 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.155+0000 7f381ffb3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:55.166 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.155+0000 7f381ffb3980 20 started sync module instance, tier type = 2024-09-13T06:09:55.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.155+0000 7f381ffb3980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:09:55.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.155+0000 7f381ffb3980 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55840942e8a0 con 0x7f381010c040 2024-09-13T06:09:55.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.159+0000 7f381d2c2640 1 -- 172.21.15.194:0/3377178399 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(44 notify.0 [create] v33'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3808036040 con 0x7f381010c040 2024-09-13T06:09:55.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.159+0000 7f381ffb3980 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94025579424912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55840942e500 con 0x7f381010c040 2024-09-13T06:09:55.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.159+0000 7f381ffb3980 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558409430850 con 0x5584094249a0 2024-09-13T06:09:55.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.159+0000 7f381d2c2640 1 -- 172.21.15.194:0/3377178399 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94025579424912] v33'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3808036040 con 0x7f381010c040 2024-09-13T06:09:55.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.159+0000 7f381e2c4640 1 -- 172.21.15.194:0/3377178399 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v33'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f381800a4d0 con 0x5584094249a0 2024-09-13T06:09:55.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.159+0000 7f381ffb3980 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94025579430816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5584094307c0 con 0x5584094249a0 2024-09-13T06:09:55.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.159+0000 7f381ffb3980 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5584094315a0 con 0x558409429390 2024-09-13T06:09:55.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.163+0000 7f381e2c4640 1 -- 172.21.15.194:0/3377178399 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94025579430816] v33'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f381800a4d0 con 0x5584094249a0 2024-09-13T06:09:55.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.163+0000 7f381dac3640 1 -- 172.21.15.194:0/3377178399 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v33'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38100eb070 con 0x558409429390 2024-09-13T06:09:55.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.163+0000 7f381ffb3980 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94025579433024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558409431940 con 0x558409429390 2024-09-13T06:09:55.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.163+0000 7f381ffb3980 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558409432300 con 0x7f381010c040 2024-09-13T06:09:55.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.163+0000 7f381d2c2640 1 -- 172.21.15.194:0/3377178399 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(50 notify.3 [create] v33'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3808036040 con 0x7f381010c040 2024-09-13T06:09:55.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.163+0000 7f381ffb3980 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94025579437920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558409432a30 con 0x7f381010c040 2024-09-13T06:09:55.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.163+0000 7f381ffb3980 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558409433530 con 0x5584094249a0 2024-09-13T06:09:55.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.163+0000 7f381dac3640 1 -- 172.21.15.194:0/3377178399 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94025579433024] v33'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38100eb070 con 0x558409429390 2024-09-13T06:09:55.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.163+0000 7f381d2c2640 1 -- 172.21.15.194:0/3377178399 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94025579437920] v33'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3808036040 con 0x7f381010c040 2024-09-13T06:09:55.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.163+0000 7f381e2c4640 1 -- 172.21.15.194:0/3377178399 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v33'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f381800a4d0 con 0x5584094249a0 2024-09-13T06:09:55.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.163+0000 7f381ffb3980 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94025579442208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5584094334f0 con 0x5584094249a0 2024-09-13T06:09:55.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.163+0000 7f381ffb3980 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558409433e00 con 0x7f380800f3d0 2024-09-13T06:09:55.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.167+0000 7f381e2c4640 1 -- 172.21.15.194:0/3377178399 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94025579442208] v33'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f381800a4d0 con 0x5584094249a0 2024-09-13T06:09:55.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.167+0000 7f381e2c4640 1 -- 172.21.15.194:0/3377178399 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(54 notify.5 [create] v33'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f381800a4d0 con 0x7f380800f3d0 2024-09-13T06:09:55.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.167+0000 7f381ffb3980 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94025579434080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5584094334f0 con 0x7f380800f3d0 2024-09-13T06:09:55.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.167+0000 7f381ffb3980 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5584094342c0 con 0x7f380800f3d0 2024-09-13T06:09:55.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.167+0000 7f381e2c4640 1 -- 172.21.15.194:0/3377178399 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94025579434080] v33'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f381800a4d0 con 0x7f380800f3d0 2024-09-13T06:09:55.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.167+0000 7f381e2c4640 1 -- 172.21.15.194:0/3377178399 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(56 notify.6 [create] v33'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f381800a4d0 con 0x7f380800f3d0 2024-09-13T06:09:55.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.167+0000 7f381ffb3980 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94025579444480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558409434280 con 0x7f380800f3d0 2024-09-13T06:09:55.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.171+0000 7f381ffb3980 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558409434c80 con 0x7f380800f3d0 2024-09-13T06:09:55.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.171+0000 7f381e2c4640 1 -- 172.21.15.194:0/3377178399 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(58 notify.7 [create] v33'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f381800a4d0 con 0x7f380800f3d0 2024-09-13T06:09:55.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.171+0000 7f381ffb3980 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94025579448208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5584094350c0 con 0x7f380800f3d0 2024-09-13T06:09:55.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.171+0000 7f381ffb3980 20 add_watcher() i=0 2024-09-13T06:09:55.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.171+0000 7f381ffb3980 20 add_watcher() i=1 2024-09-13T06:09:55.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.171+0000 7f381ffb3980 20 add_watcher() i=2 2024-09-13T06:09:55.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.171+0000 7f381ffb3980 20 add_watcher() i=3 2024-09-13T06:09:55.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.171+0000 7f381ffb3980 20 add_watcher() i=4 2024-09-13T06:09:55.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.171+0000 7f381ffb3980 20 add_watcher() i=5 2024-09-13T06:09:55.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.171+0000 7f381e2c4640 1 -- 172.21.15.194:0/3377178399 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94025579444480] v33'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f381800a4d0 con 0x7f380800f3d0 2024-09-13T06:09:55.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.171+0000 7f381ffb3980 20 add_watcher() i=6 2024-09-13T06:09:55.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.171+0000 7f381e2c4640 1 -- 172.21.15.194:0/3377178399 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94025579448208] v33'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f381800a4d0 con 0x7f380800f3d0 2024-09-13T06:09:55.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.171+0000 7f381ffb3980 20 add_watcher() i=7 2024-09-13T06:09:55.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.171+0000 7f381ffb3980 2 all 8 watchers are set, enabling cache 2024-09-13T06:09:55.175 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.171+0000 7f381ffb3980 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558409433d20 con 0x5584094249a0 2024-09-13T06:09:55.175 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.175+0000 7f381e2c4640 1 -- 172.21.15.194:0/3377178399 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f381800a4d0 con 0x5584094249a0 2024-09-13T06:09:55.175 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.175+0000 7f381ffb3980 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94025579445536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558409435600 con 0x5584094249a0 2024-09-13T06:09:55.176 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.175+0000 7f381e2c4640 1 -- 172.21.15.194:0/3377178399 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94025579445536] v33'72 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f381800a4d0 con 0x5584094249a0 2024-09-13T06:09:55.176 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.175+0000 7f36cf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:55.176 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.175+0000 7f381ffb3980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:09:55.176 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.175+0000 7f381ffb3980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:09:55.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.175+0000 7f381ffb3980 5 note: GC not initialized 2024-09-13T06:09:55.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.175+0000 7f36ce7fc640 20 reqs_thread_entry: start 2024-09-13T06:09:55.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.175+0000 7f381ffb3980 20 init_complete bucket index max shards: 11 2024-09-13T06:09:55.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.175+0000 7f381ffb3980 20 Filter name: none 2024-09-13T06:09:55.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.175+0000 7f3643fff640 20 reqs_thread_entry: start 2024-09-13T06:09:55.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.175+0000 7f381ffb3980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T06:09:55.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.175+0000 7f381ffb3980 20 rados->read ofs=0 len=0 2024-09-13T06:09:55.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.175+0000 7f381ffb3980 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55840945b840 con 0x5584094249a0 2024-09-13T06:09:55.179 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.175+0000 7f381e2c4640 1 -- 172.21.15.194:0/3377178399 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f381800a4d0 con 0x5584094249a0 2024-09-13T06:09:55.179 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.175+0000 7f381ffb3980 20 rados_obj.operate() r=0 bl.length=556 2024-09-13T06:09:55.179 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.175+0000 7f381ffb3980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T06:09:55.179 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.175+0000 7f381ffb3980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:09:55.179 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.175+0000 7f381ffb3980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:09:55.179 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.175+0000 7f381ffb3980 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558409461f70 con 0x5584094249a0 2024-09-13T06:09:55.179 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.175+0000 7f381e2c4640 1 -- 172.21.15.194:0/3377178399 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v33'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f381800a4d0 con 0x5584094249a0 2024-09-13T06:09:55.179 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.175+0000 7f381ffb3980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T06:09:55.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.175+0000 7f381ffb3980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:09:55.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.175+0000 7f381ffb3980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T06:09:55.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.175+0000 7f381ffb3980 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94025579633120 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55840945d6c0 con 0x5584094249a0 2024-09-13T06:09:55.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.175+0000 7f381e2c4640 1 -- 172.21.15.194:0/3377178399 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== watch-notify(notify (1) cookie 94025579442208 notify 141733920774 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7f381802d040 con 0x5584094249a0 2024-09-13T06:09:55.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.175+0000 7f37017fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920774 cookie 94025579442208 notifier 4367 bl.length()=732 2024-09-13T06:09:55.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.175+0000 7f37017fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T06:09:55.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.175+0000 7f37017fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:09:55.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.175+0000 7f381e2c4640 1 -- 172.21.15.194:0/3377178399 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(64 notify.4 [notify cookie 94025579633120 out=8b] v0'0 uv57 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f381800a4d0 con 0x5584094249a0 2024-09-13T06:09:55.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.175+0000 7f37017fa640 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f36e0003eb0 con 0x5584094249a0 2024-09-13T06:09:55.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.179+0000 7f381e2c4640 1 -- 172.21.15.194:0/3377178399 <== osd.1 v2:172.21.15.194:6808/3135444559 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f381800a4d0 con 0x5584094249a0 2024-09-13T06:09:55.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.179+0000 7f381e2c4640 1 -- 172.21.15.194:0/3377178399 <== osd.1 v2:172.21.15.194:6808/3135444559 26 ==== watch-notify(notify_complete (2) cookie 94025579633120 notify 141733920774 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f381801e040 con 0x5584094249a0 2024-09-13T06:09:55.181 INFO:teuthology.orchestra.run.smithi194.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T06:09:53.191222Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:09:53.191207Z","tags":[],"group_ids":[]} 2024-09-13T06:09:55.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.179+0000 7f36cf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:55.182 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.179+0000 7f381ffb3980 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94025579445536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55840945d210 con 0x5584094249a0 2024-09-13T06:09:55.182 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.179+0000 7f381e2c4640 1 -- 172.21.15.194:0/3377178399 <== osd.1 v2:172.21.15.194:6808/3135444559 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94025579445536] v33'73 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f381800a4d0 con 0x5584094249a0 2024-09-13T06:09:55.182 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.179+0000 7f381ffb3980 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94025579424912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55840945d6c0 con 0x7f381010c040 2024-09-13T06:09:55.182 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.179+0000 7f381d2c2640 1 -- 172.21.15.194:0/3377178399 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94025579424912] v33'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3808036040 con 0x7f381010c040 2024-09-13T06:09:55.182 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.179+0000 7f381ffb3980 20 remove_watcher() i=0 2024-09-13T06:09:55.182 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.179+0000 7f381ffb3980 2 removed watcher, disabling cache 2024-09-13T06:09:55.182 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.179+0000 7f381ffb3980 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94025579430816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55840945d6c0 con 0x5584094249a0 2024-09-13T06:09:55.184 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.183+0000 7f381e2c4640 1 -- 172.21.15.194:0/3377178399 <== osd.1 v2:172.21.15.194:6808/3135444559 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94025579430816] v33'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f381800a4d0 con 0x5584094249a0 2024-09-13T06:09:55.184 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.183+0000 7f381ffb3980 20 remove_watcher() i=1 2024-09-13T06:09:55.184 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.183+0000 7f381ffb3980 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94025579433024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55840945d6c0 con 0x558409429390 2024-09-13T06:09:55.186 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.183+0000 7f381dac3640 1 -- 172.21.15.194:0/3377178399 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94025579433024] v33'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38100eb070 con 0x558409429390 2024-09-13T06:09:55.186 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.183+0000 7f381ffb3980 20 remove_watcher() i=2 2024-09-13T06:09:55.186 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.183+0000 7f381ffb3980 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94025579437920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55840942ec90 con 0x7f381010c040 2024-09-13T06:09:55.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.187+0000 7f381d2c2640 1 -- 172.21.15.194:0/3377178399 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94025579437920] v33'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3808036040 con 0x7f381010c040 2024-09-13T06:09:55.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.187+0000 7f381ffb3980 20 remove_watcher() i=3 2024-09-13T06:09:55.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.187+0000 7f381ffb3980 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94025579442208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5584094303a0 con 0x5584094249a0 2024-09-13T06:09:55.188 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.187+0000 7f381e2c4640 1 -- 172.21.15.194:0/3377178399 <== osd.1 v2:172.21.15.194:6808/3135444559 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94025579442208] v33'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f381800a4d0 con 0x5584094249a0 2024-09-13T06:09:55.189 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.187+0000 7f381ffb3980 20 remove_watcher() i=4 2024-09-13T06:09:55.189 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.187+0000 7f381ffb3980 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94025579434080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55840942ec90 con 0x7f380800f3d0 2024-09-13T06:09:55.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.191+0000 7f381e2c4640 1 -- 172.21.15.194:0/3377178399 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94025579434080] v33'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f381800a4d0 con 0x7f380800f3d0 2024-09-13T06:09:55.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.191+0000 7f381ffb3980 20 remove_watcher() i=5 2024-09-13T06:09:55.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.191+0000 7f381ffb3980 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94025579444480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558409433020 con 0x7f380800f3d0 2024-09-13T06:09:55.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.191+0000 7f381e2c4640 1 -- 172.21.15.194:0/3377178399 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94025579444480] v33'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f381800a4d0 con 0x7f380800f3d0 2024-09-13T06:09:55.193 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.191+0000 7f381ffb3980 20 remove_watcher() i=6 2024-09-13T06:09:55.193 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.191+0000 7f381ffb3980 1 -- 172.21.15.194:0/3377178399 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94025579448208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5584094303a0 con 0x7f380800f3d0 2024-09-13T06:09:55.197 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.195+0000 7f381e2c4640 1 -- 172.21.15.194:0/3377178399 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94025579448208] v33'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f381800a4d0 con 0x7f380800f3d0 2024-09-13T06:09:55.197 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.195+0000 7f381ffb3980 20 remove_watcher() i=7 2024-09-13T06:09:55.197 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.195+0000 7f381ffb3980 1 -- 172.21.15.194:0/3377178399 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f380800f3d0 msgr2=0x7f380800f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.197 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.195+0000 7f381ffb3980 1 --2- 172.21.15.194:0/3377178399 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f380800f3d0 0x7f380800f7f0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.197 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.195+0000 7f381ffb3980 1 -- 172.21.15.194:0/3377178399 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5584094249a0 msgr2=0x558409426e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.197 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.195+0000 7f381ffb3980 1 --2- 172.21.15.194:0/3377178399 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5584094249a0 0x558409426e60 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.197 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.195+0000 7f381ffb3980 1 -- 172.21.15.194:0/3377178399 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f381010c040 msgr2=0x7f38100d20d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.197 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.195+0000 7f381ffb3980 1 --2- 172.21.15.194:0/3377178399 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f381010c040 0x7f38100d20d0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.197 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.195+0000 7f381ffb3980 1 -- 172.21.15.194:0/3377178399 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x558409429390 msgr2=0x55840942b780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.197 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.195+0000 7f381ffb3980 1 --2- 172.21.15.194:0/3377178399 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x558409429390 0x55840942b780 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.195+0000 7f381ffb3980 1 -- 172.21.15.194:0/3377178399 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f36e80346a0 msgr2=0x7f36e8036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.195+0000 7f381ffb3980 1 --2- 172.21.15.194:0/3377178399 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f36e80346a0 0x7f36e8036b60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x5584093f6500 tx=0x7f3808011000 comp rx=0 tx=0).stop 2024-09-13T06:09:55.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.195+0000 7f381ffb3980 1 -- 172.21.15.194:0/3377178399 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558409412740 msgr2=0x558409419960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.195+0000 7f381ffb3980 1 --2- 172.21.15.194:0/3377178399 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558409412740 0x558409419960 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f38100ddf00 tx=0x7f38100bcf70 comp rx=0 tx=0).stop 2024-09-13T06:09:55.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.195+0000 7f381e2c4640 1 -- 172.21.15.194:0/3377178399 reap_dead start 2024-09-13T06:09:55.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.195+0000 7f381ffb3980 1 -- 172.21.15.194:0/3377178399 shutdown_connections 2024-09-13T06:09:55.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.195+0000 7f381ffb3980 1 -- 172.21.15.194:0/3377178399 >> 172.21.15.194:0/3377178399 conn(0x55840940eb20 msgr2=0x55840940cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:55.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.195+0000 7f381ffb3980 1 -- 172.21.15.194:0/3377178399 shutdown_connections 2024-09-13T06:09:55.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.195+0000 7f381ffb3980 1 -- 172.21.15.194:0/3377178399 wait complete. 2024-09-13T06:09:55.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.195+0000 7f381ffb3980 1 -- 172.21.15.194:0/2004801703 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f36f8034650 msgr2=0x7f36f8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.195+0000 7f381ffb3980 1 --2- 172.21.15.194:0/2004801703 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f36f8034650 0x7f36f8036b10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x5584093ea490 tx=0x7f3808006000 comp rx=0 tx=0).stop 2024-09-13T06:09:55.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.195+0000 7f381ffb3980 1 -- 172.21.15.194:0/2004801703 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558409269cf0 msgr2=0x558409268370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.195+0000 7f381ffb3980 1 --2- 172.21.15.194:0/2004801703 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558409269cf0 0x558409268370 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f38100c5fd0 tx=0x7f38100bd690 comp rx=0 tx=0).stop 2024-09-13T06:09:55.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.195+0000 7f381ffb3980 1 -- 172.21.15.194:0/2004801703 shutdown_connections 2024-09-13T06:09:55.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.195+0000 7f381ffb3980 1 --2- 172.21.15.194:0/2004801703 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f36f8034650 0x7f36f8036b10 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.195+0000 7f381ffb3980 1 --2- 172.21.15.194:0/2004801703 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558409269cf0 0x558409268370 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.195+0000 7f381ffb3980 1 -- 172.21.15.194:0/2004801703 >> 172.21.15.194:0/2004801703 conn(0x5584093f8d20 msgr2=0x5584093fb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:55.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.195+0000 7f381ffb3980 1 -- 172.21.15.194:0/2004801703 shutdown_connections 2024-09-13T06:09:55.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.195+0000 7f381ffb3980 1 -- 172.21.15.194:0/2004801703 wait complete. 2024-09-13T06:09:55.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.195+0000 7f381ffb3980 1 -- 172.21.15.194:0/2076483842 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5584092f3f40 msgr2=0x5584093ecd30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.195+0000 7f381ffb3980 1 --2- 172.21.15.194:0/2076483842 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5584092f3f40 0x5584093ecd30 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.195+0000 7f381ffb3980 1 -- 172.21.15.194:0/2076483842 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5584093f3620 msgr2=0x5584093f5a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.195+0000 7f381ffb3980 1 --2- 172.21.15.194:0/2076483842 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5584093f3620 0x5584093f5a10 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.195+0000 7f381ffb3980 1 -- 172.21.15.194:0/2076483842 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5584093ef570 msgr2=0x5584093f1a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.195+0000 7f381ffb3980 1 --2- 172.21.15.194:0/2076483842 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5584093ef570 0x5584093f1a30 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.195+0000 7f381ffb3980 1 -- 172.21.15.194:0/2076483842 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3704034650 msgr2=0x7f3704036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.195+0000 7f381ffb3980 1 --2- 172.21.15.194:0/2076483842 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3704034650 0x7f3704036b10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3808001e20 tx=0x7f38080013a0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.195+0000 7f381ffb3980 1 -- 172.21.15.194:0/2076483842 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5584092f35f0 msgr2=0x5584093e5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.195+0000 7f381ffb3980 1 --2- 172.21.15.194:0/2076483842 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5584092f35f0 0x5584093e5d80 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f381000a5c0 tx=0x7f38100180e0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.195+0000 7f381e2c4640 1 -- 172.21.15.194:0/2076483842 reap_dead start 2024-09-13T06:09:55.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.195+0000 7f381ffb3980 1 -- 172.21.15.194:0/2076483842 shutdown_connections 2024-09-13T06:09:55.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.195+0000 7f381ffb3980 1 -- 172.21.15.194:0/2076483842 >> 172.21.15.194:0/2076483842 conn(0x5584092ef110 msgr2=0x5584093d9220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:55.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.195+0000 7f381ffb3980 1 -- 172.21.15.194:0/2076483842 shutdown_connections 2024-09-13T06:09:55.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.195+0000 7f381ffb3980 1 -- 172.21.15.194:0/2076483842 wait complete. 2024-09-13T06:09:55.205 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T06:09:53.191222Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:09:53.191207Z', 'tags': [], 'group_ids': []} 2024-09-13T06:09:55.205 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T06:09:55.205 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T06:09:55.206 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T06:09:55.277 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:09:55.278 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:09:55.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.275+0000 7f0e5280a980 1 Processor -- start 2024-09-13T06:09:55.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.275+0000 7f0e5280a980 1 -- start start 2024-09-13T06:09:55.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.275+0000 7f0e5280a980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55a58b33f540 0x55a58b33f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.275+0000 7f0e5280a980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a58b1c8ae0 con 0x55a58b33fe90 2024-09-13T06:09:55.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.275+0000 7f0e5280a980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x55a58b1ece30 con 0x55a58b33f540 2024-09-13T06:09:55.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.275+0000 7f0e5031a640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55a58b33f540 0x55a58b33f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.275+0000 7f0e5031a640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55a58b33f540 0x55a58b33f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44758/0 (socket says 172.21.15.194:44758) 2024-09-13T06:09:55.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.275+0000 7f0e5031a640 1 -- 172.21.15.194:0/101338903 learned_addr learned my addr 172.21.15.194:0/101338903 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:55.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.275+0000 7f0e5031a640 1 -- 172.21.15.194:0/101338903 >> v1:172.21.15.120:6789/0 conn(0x55a58b33fe90 legacy=0x55a58b344910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.275+0000 7f0e5031a640 1 -- 172.21.15.194:0/101338903 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a58b347160 con 0x55a58b33f540 2024-09-13T06:09:55.280 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.279+0000 7f0e5031a640 1 --2- 172.21.15.194:0/101338903 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a58b33f540 0x55a58b33f920 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0e4800a4e0 tx=0x7f0e4801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=356daa110fba9604 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.280 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.279+0000 7f0e4f318640 1 -- 172.21.15.194:0/101338903 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e480aa540 con 0x55a58b33f540 2024-09-13T06:09:55.280 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.279+0000 7f0e4f318640 1 -- 172.21.15.194:0/101338903 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e480aa6e0 con 0x55a58b33f540 2024-09-13T06:09:55.280 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.279+0000 7f0e4f318640 1 -- 172.21.15.194:0/101338903 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e480aaa40 con 0x55a58b33f540 2024-09-13T06:09:55.280 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.279+0000 7f0e5280a980 1 -- 172.21.15.194:0/101338903 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a58b33f540 msgr2=0x55a58b33f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.280 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.279+0000 7f0e5280a980 1 --2- 172.21.15.194:0/101338903 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a58b33f540 0x55a58b33f920 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0e4800a4e0 tx=0x7f0e4801b090 comp rx=0 tx=0).stop 2024-09-13T06:09:55.280 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.279+0000 7f0e5280a980 1 -- 172.21.15.194:0/101338903 shutdown_connections 2024-09-13T06:09:55.280 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.279+0000 7f0e5280a980 1 --2- 172.21.15.194:0/101338903 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a58b33f540 0x55a58b33f920 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.280 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.279+0000 7f0e5280a980 1 -- 172.21.15.194:0/101338903 >> 172.21.15.194:0/101338903 conn(0x55a58b33b060 msgr2=0x55a58b33d480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:55.280 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.279+0000 7f0e5280a980 1 -- 172.21.15.194:0/101338903 shutdown_connections 2024-09-13T06:09:55.280 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.279+0000 7f0e5280a980 1 -- 172.21.15.194:0/101338903 wait complete. 2024-09-13T06:09:55.292 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.291+0000 7f0e5280a980 1 Processor -- start 2024-09-13T06:09:55.292 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.291+0000 7f0e5280a980 1 -- start start 2024-09-13T06:09:55.292 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.291+0000 7f0e5280a980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a58b33f540 0x55a58b2b43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.292 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.291+0000 7f0e5280a980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55a58b1ee200 con 0x55a58b33f540 2024-09-13T06:09:55.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.291+0000 7f0e5031a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a58b33f540 0x55a58b2b43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.291+0000 7f0e5031a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a58b33f540 0x55a58b2b43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44766/0 (socket says 172.21.15.194:44766) 2024-09-13T06:09:55.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.291+0000 7f0e5031a640 1 -- 172.21.15.194:0/706062302 learned_addr learned my addr 172.21.15.194:0/706062302 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:55.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.291+0000 7f0e5031a640 1 -- 172.21.15.194:0/706062302 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a58b2b49b0 con 0x55a58b33f540 2024-09-13T06:09:55.294 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.291+0000 7f0e5031a640 1 --2- 172.21.15.194:0/706062302 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a58b33f540 0x55a58b2b43e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0e48017ca0 tx=0x7f0e480033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f028a87739f95fe0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.294 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.291+0000 7f0d3e60c640 1 -- 172.21.15.194:0/706062302 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e480b9030 con 0x55a58b33f540 2024-09-13T06:09:55.294 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.291+0000 7f0d3e60c640 1 -- 172.21.15.194:0/706062302 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e480aaac0 con 0x55a58b33f540 2024-09-13T06:09:55.294 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.291+0000 7f0d3e60c640 1 -- 172.21.15.194:0/706062302 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e480aada0 con 0x55a58b33f540 2024-09-13T06:09:55.295 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.295+0000 7f0e5280a980 1 -- 172.21.15.194:0/706062302 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a58b33f540 msgr2=0x55a58b2b43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.296 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.295+0000 7f0e5280a980 1 --2- 172.21.15.194:0/706062302 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a58b33f540 0x55a58b2b43e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0e48017ca0 tx=0x7f0e480033b0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.296 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.295+0000 7f0e5280a980 1 -- 172.21.15.194:0/706062302 shutdown_connections 2024-09-13T06:09:55.296 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.295+0000 7f0e5280a980 1 --2- 172.21.15.194:0/706062302 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a58b33f540 0x55a58b2b43e0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.296 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.295+0000 7f0e5280a980 1 -- 172.21.15.194:0/706062302 >> 172.21.15.194:0/706062302 conn(0x55a58b33b060 msgr2=0x55a58b4265b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:55.296 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.295+0000 7f0e5280a980 1 -- 172.21.15.194:0/706062302 shutdown_connections 2024-09-13T06:09:55.296 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.295+0000 7f0e5280a980 1 -- 172.21.15.194:0/706062302 wait complete. 2024-09-13T06:09:55.296 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.295+0000 7f0e5280a980 1 Processor -- start 2024-09-13T06:09:55.296 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.295+0000 7f0e5280a980 1 -- start start 2024-09-13T06:09:55.296 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.295+0000 7f0e5280a980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a58b33f540 0x55a58b434f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.296 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.295+0000 7f0e5280a980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55a58b346ba0 con 0x55a58b33f540 2024-09-13T06:09:55.296 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.295+0000 7f0e5031a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a58b33f540 0x55a58b434f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.296 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.295+0000 7f0e5031a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a58b33f540 0x55a58b434f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44768/0 (socket says 172.21.15.194:44768) 2024-09-13T06:09:55.296 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.295+0000 7f0e5031a640 1 -- 172.21.15.194:0/2941210077 learned_addr learned my addr 172.21.15.194:0/2941210077 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:55.297 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.295+0000 7f0e5031a640 1 -- 172.21.15.194:0/2941210077 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a58b4354d0 con 0x55a58b33f540 2024-09-13T06:09:55.297 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.295+0000 7f0e5031a640 1 --2- 172.21.15.194:0/2941210077 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a58b33f540 0x55a58b434f90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0e48005cc0 tx=0x7f0e48017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.298 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.295+0000 7f0d3ce09640 1 -- 172.21.15.194:0/2941210077 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e480b9030 con 0x55a58b33f540 2024-09-13T06:09:55.298 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.295+0000 7f0e5280a980 1 -- 172.21.15.194:0/2941210077 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a58b435760 con 0x55a58b33f540 2024-09-13T06:09:55.298 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.295+0000 7f0e5280a980 1 -- 172.21.15.194:0/2941210077 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a58b438440 con 0x55a58b33f540 2024-09-13T06:09:55.298 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.295+0000 7f0d3ce09640 1 -- 172.21.15.194:0/2941210077 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e480c3070 con 0x55a58b33f540 2024-09-13T06:09:55.298 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.295+0000 7f0d3ce09640 1 -- 172.21.15.194:0/2941210077 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e480cc060 con 0x55a58b33f540 2024-09-13T06:09:55.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.299+0000 7f0d3ce09640 1 -- 172.21.15.194:0/2941210077 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0e480c5030 con 0x55a58b33f540 2024-09-13T06:09:55.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.299+0000 7f0d3ce09640 1 --2- 172.21.15.194:0/2941210077 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0d38034650 0x7f0d38036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.299+0000 7f0d3ce09640 1 -- 172.21.15.194:0/2941210077 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f0e480ba070 con 0x55a58b33f540 2024-09-13T06:09:55.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.299+0000 7f0e4fb19640 1 --2- 172.21.15.194:0/2941210077 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0d38034650 0x7f0d38036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.299+0000 7f0e5280a980 1 --2- 172.21.15.194:0/2941210077 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55a58b33fe90 0x55a58b43bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.299+0000 7f0e5280a980 1 -- 172.21.15.194:0/2941210077 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a58b43c590 con 0x55a58b33fe90 2024-09-13T06:09:55.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.299+0000 7f0e50b1b640 1 --2- 172.21.15.194:0/2941210077 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55a58b33fe90 0x55a58b43bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.299+0000 7f0e4fb19640 1 --2- 172.21.15.194:0/2941210077 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0d38034650 0x7f0d38036b10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0e44001e20 tx=0x7f0e440013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.300 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.299+0000 7f0e50b1b640 1 --2- 172.21.15.194:0/2941210077 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55a58b33fe90 0x55a58b43bf20 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.299+0000 7f0e50b1b640 1 -- 172.21.15.194:0/2941210077 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0e400083f0 con 0x55a58b33fe90 2024-09-13T06:09:55.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.299+0000 7f0e5280a980 1 -- 172.21.15.194:0/2941210077 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a58b43cea0 con 0x55a58b33fe90 2024-09-13T06:09:55.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.299+0000 7f0e50b1b640 1 -- 172.21.15.194:0/2941210077 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0e400083f0 con 0x55a58b33fe90 2024-09-13T06:09:55.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.299+0000 7f0e5280a980 1 --2- 172.21.15.194:0/2941210077 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55a58b43e7b0 0x55a58b440c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.299+0000 7f0e5280a980 1 -- 172.21.15.194:0/2941210077 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a58b441400 con 0x55a58b43e7b0 2024-09-13T06:09:55.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.299+0000 7f0e5031a640 1 --2- 172.21.15.194:0/2941210077 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55a58b43e7b0 0x55a58b440c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.299+0000 7f0e5031a640 1 --2- 172.21.15.194:0/2941210077 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55a58b43e7b0 0x55a58b440c70 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.299+0000 7f0e5031a640 1 -- 172.21.15.194:0/2941210077 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0e480c7410 con 0x55a58b43e7b0 2024-09-13T06:09:55.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.299+0000 7f0e5280a980 1 -- 172.21.15.194:0/2941210077 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a58b43d6f0 con 0x55a58b33fe90 2024-09-13T06:09:55.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.299+0000 7f0e50b1b640 1 -- 172.21.15.194:0/2941210077 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0e400083f0 con 0x55a58b33fe90 2024-09-13T06:09:55.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.299+0000 7f0e5280a980 1 --2- 172.21.15.194:0/2941210077 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55a58b442860 0x55a58b444c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.299+0000 7f0e5280a980 1 -- 172.21.15.194:0/2941210077 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a58b445340 con 0x55a58b442860 2024-09-13T06:09:55.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.299+0000 7f0e4fb19640 1 --2- 172.21.15.194:0/2941210077 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55a58b442860 0x55a58b444c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.299+0000 7f0e4fb19640 1 --2- 172.21.15.194:0/2941210077 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55a58b442860 0x55a58b444c50 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.303 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.299+0000 7f0e4fb19640 1 -- 172.21.15.194:0/2941210077 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0e4400d040 con 0x55a58b442860 2024-09-13T06:09:55.304 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.299+0000 7f0e5280a980 1 Processor -- start 2024-09-13T06:09:55.304 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.299+0000 7f0e5280a980 1 -- start start 2024-09-13T06:09:55.304 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.299+0000 7f0e5280a980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a58b452e10 0x55a58b453230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.304 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.299+0000 7f0e5280a980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55a58b247800 con 0x55a58b452e10 2024-09-13T06:09:55.304 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.303+0000 7f0e5031a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a58b452e10 0x55a58b453230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.304 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.303+0000 7f0e5031a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a58b452e10 0x55a58b453230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44772/0 (socket says 172.21.15.194:44772) 2024-09-13T06:09:55.305 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.303+0000 7f0e5031a640 1 -- 172.21.15.194:0/4108956967 learned_addr learned my addr 172.21.15.194:0/4108956967 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:55.305 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.303+0000 7f0e5031a640 1 -- 172.21.15.194:0/4108956967 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a58b453770 con 0x55a58b452e10 2024-09-13T06:09:55.305 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.303+0000 7f0e5031a640 1 --2- 172.21.15.194:0/4108956967 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a58b452e10 0x55a58b453230 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0e480d0920 tx=0x7f0e480c66b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.305 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.303+0000 7f0d35ffb640 1 -- 172.21.15.194:0/4108956967 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e480b4dc0 con 0x55a58b452e10 2024-09-13T06:09:55.305 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.303+0000 7f0e5280a980 1 -- 172.21.15.194:0/4108956967 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a58b453a00 con 0x55a58b452e10 2024-09-13T06:09:55.305 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.303+0000 7f0d35ffb640 1 -- 172.21.15.194:0/4108956967 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e480c6750 con 0x55a58b452e10 2024-09-13T06:09:55.305 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.303+0000 7f0d35ffb640 1 -- 172.21.15.194:0/4108956967 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e480c6a30 con 0x55a58b452e10 2024-09-13T06:09:55.305 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.303+0000 7f0e5280a980 1 -- 172.21.15.194:0/4108956967 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a58b456680 con 0x55a58b452e10 2024-09-13T06:09:55.307 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.303+0000 7f0d35ffb640 1 -- 172.21.15.194:0/4108956967 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0e480b3040 con 0x55a58b452e10 2024-09-13T06:09:55.307 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.303+0000 7f0d35ffb640 1 --2- 172.21.15.194:0/4108956967 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0d28034650 0x7f0d28036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.307 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.303+0000 7f0d35ffb640 1 -- 172.21.15.194:0/4108956967 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f0e480c0040 con 0x55a58b452e10 2024-09-13T06:09:55.307 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.303+0000 7f0e4fb19640 1 --2- 172.21.15.194:0/4108956967 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0d28034650 0x7f0d28036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.307 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.303+0000 7f0e5280a980 1 Processor -- start 2024-09-13T06:09:55.307 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.303+0000 7f0e5280a980 1 -- start start 2024-09-13T06:09:55.307 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.303+0000 7f0e4fb19640 1 --2- 172.21.15.194:0/4108956967 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0d28034650 0x7f0d28036b10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x55a58b4396a0 tx=0x7f0e44006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.307 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.303+0000 7f0e5280a980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a58b45f680 0x55a58b45fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.307 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.303+0000 7f0e5280a980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55a58b2b4c70 con 0x55a58b45f680 2024-09-13T06:09:55.307 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.303+0000 7f0e5031a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a58b45f680 0x55a58b45fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.307 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.303+0000 7f0e5031a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a58b45f680 0x55a58b45fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44778/0 (socket says 172.21.15.194:44778) 2024-09-13T06:09:55.308 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.303+0000 7f0e5031a640 1 -- 172.21.15.194:0/764018980 learned_addr learned my addr 172.21.15.194:0/764018980 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:55.308 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.307+0000 7f0e5031a640 1 -- 172.21.15.194:0/764018980 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a58b460050 con 0x55a58b45f680 2024-09-13T06:09:55.308 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.307+0000 7f0e5031a640 1 --2- 172.21.15.194:0/764018980 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a58b45f680 0x55a58b45fa80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0e480e1010 tx=0x7f0e480e3f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7092ec61b9aa6c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.308 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.307+0000 7f0d2f7fe640 1 -- 172.21.15.194:0/764018980 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e480bc3b0 con 0x55a58b45f680 2024-09-13T06:09:55.308 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.307+0000 7f0d2f7fe640 1 -- 172.21.15.194:0/764018980 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e480ddd00 con 0x55a58b45f680 2024-09-13T06:09:55.308 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.307+0000 7f0d2f7fe640 1 -- 172.21.15.194:0/764018980 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e48004cd0 con 0x55a58b45f680 2024-09-13T06:09:55.310 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.307+0000 7f0e5280a980 1 -- 172.21.15.194:0/764018980 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a58b45f680 msgr2=0x55a58b45fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.310 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.307+0000 7f0e5280a980 1 --2- 172.21.15.194:0/764018980 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a58b45f680 0x55a58b45fa80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0e480e1010 tx=0x7f0e480e3f00 comp rx=0 tx=0).stop 2024-09-13T06:09:55.310 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.307+0000 7f0e5280a980 1 -- 172.21.15.194:0/764018980 shutdown_connections 2024-09-13T06:09:55.310 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.307+0000 7f0e5280a980 1 --2- 172.21.15.194:0/764018980 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a58b45f680 0x55a58b45fa80 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.310 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.307+0000 7f0e5280a980 1 -- 172.21.15.194:0/764018980 >> 172.21.15.194:0/764018980 conn(0x55a58b45bab0 msgr2=0x55a58b459bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:55.310 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.307+0000 7f0e5280a980 1 -- 172.21.15.194:0/764018980 shutdown_connections 2024-09-13T06:09:55.311 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.307+0000 7f0e5280a980 1 -- 172.21.15.194:0/764018980 wait complete. 2024-09-13T06:09:55.311 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.307+0000 7f0e5280a980 1 Processor -- start 2024-09-13T06:09:55.311 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.307+0000 7f0e5280a980 1 -- start start 2024-09-13T06:09:55.311 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.307+0000 7f0e5280a980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a58b45f680 0x55a58b4668c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.311 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.307+0000 7f0e5280a980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55a58b460520 con 0x55a58b45f680 2024-09-13T06:09:55.311 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.307+0000 7f0e5031a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a58b45f680 0x55a58b4668c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.311 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.307+0000 7f0e5031a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a58b45f680 0x55a58b4668c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44784/0 (socket says 172.21.15.194:44784) 2024-09-13T06:09:55.311 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.307+0000 7f0e5031a640 1 -- 172.21.15.194:0/2125938867 learned_addr learned my addr 172.21.15.194:0/2125938867 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:55.311 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.307+0000 7f0e5031a640 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a58b466e00 con 0x55a58b45f680 2024-09-13T06:09:55.311 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.307+0000 7f0e5031a640 1 --2- 172.21.15.194:0/2125938867 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a58b45f680 0x55a58b4668c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0e480d95b0 tx=0x7f0e480eaf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.311 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.307+0000 7f0d2dffb640 1 -- 172.21.15.194:0/2125938867 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e480fd040 con 0x55a58b45f680 2024-09-13T06:09:55.311 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.307+0000 7f0e5280a980 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a58b466e00 con 0x55a58b45f680 2024-09-13T06:09:55.311 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.307+0000 7f0e5280a980 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a58b467270 con 0x55a58b45f680 2024-09-13T06:09:55.311 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.307+0000 7f0d2dffb640 1 -- 172.21.15.194:0/2125938867 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e480bc3b0 con 0x55a58b45f680 2024-09-13T06:09:55.312 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.307+0000 7f0d2dffb640 1 -- 172.21.15.194:0/2125938867 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e480d1cc0 con 0x55a58b45f680 2024-09-13T06:09:55.315 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.311+0000 7f0e5280a980 20 rados->read ofs=0 len=0 2024-09-13T06:09:55.315 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.311+0000 7f0d2dffb640 1 -- 172.21.15.194:0/2125938867 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0e4810a020 con 0x55a58b45f680 2024-09-13T06:09:55.315 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.311+0000 7f0d2dffb640 1 --2- 172.21.15.194:0/2125938867 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0d200345b0 0x7f0d20036a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.315 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.311+0000 7f0d2dffb640 1 -- 172.21.15.194:0/2125938867 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f0e48108020 con 0x55a58b45f680 2024-09-13T06:09:55.315 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.311+0000 7f0e4fb19640 1 --2- 172.21.15.194:0/2125938867 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0d200345b0 0x7f0d20036a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.316 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.311+0000 7f0e5280a980 1 --2- 172.21.15.194:0/2125938867 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55a58b471870 0x55a58b473d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.316 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.311+0000 7f0e5280a980 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a58b474480 con 0x55a58b471870 2024-09-13T06:09:55.316 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.311+0000 7f0e50b1b640 1 --2- 172.21.15.194:0/2125938867 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55a58b471870 0x55a58b473d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.316 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.311+0000 7f0e4fb19640 1 --2- 172.21.15.194:0/2125938867 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0d200345b0 0x7f0d20036a70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x55a58b445740 tx=0x7f0e44011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.316 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.311+0000 7f0e50b1b640 1 --2- 172.21.15.194:0/2125938867 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55a58b471870 0x55a58b473d30 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.316 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.311+0000 7f0e50b1b640 1 -- 172.21.15.194:0/2125938867 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0e400083f0 con 0x55a58b471870 2024-09-13T06:09:55.316 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.311+0000 7f0e5280a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:55.316 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.311+0000 7f0e5280a980 20 realm 2024-09-13T06:09:55.316 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.311+0000 7f0e5280a980 20 rados->read ofs=0 len=0 2024-09-13T06:09:55.316 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.311+0000 7f0e5280a980 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a58b474890 con 0x55a58b471870 2024-09-13T06:09:55.316 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.311+0000 7f0e50b1b640 1 -- 172.21.15.194:0/2125938867 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0e400083f0 con 0x55a58b471870 2024-09-13T06:09:55.316 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.311+0000 7f0e5280a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:55.316 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.311+0000 7f0e5280a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:09:55.316 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.311+0000 7f0e5280a980 20 rados->read ofs=0 len=0 2024-09-13T06:09:55.317 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.311+0000 7f0e5280a980 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a58b475130 con 0x55a58b471870 2024-09-13T06:09:55.317 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.311+0000 7f0e50b1b640 1 -- 172.21.15.194:0/2125938867 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0e400083f0 con 0x55a58b471870 2024-09-13T06:09:55.317 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.311+0000 7f0e5280a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:55.317 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.311+0000 7f0e5280a980 20 rados->read ofs=0 len=0 2024-09-13T06:09:55.317 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.311+0000 7f0e5280a980 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a58b4754d0 con 0x55a58b471870 2024-09-13T06:09:55.317 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.311+0000 7f0e50b1b640 1 -- 172.21.15.194:0/2125938867 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0e400083f0 con 0x55a58b471870 2024-09-13T06:09:55.317 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.311+0000 7f0e5280a980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:55.317 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.311+0000 7f0e5280a980 20 rados->read ofs=0 len=0 2024-09-13T06:09:55.317 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.311+0000 7f0e5280a980 1 --2- 172.21.15.194:0/2125938867 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55a58b476230 0x55a58b478620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.317 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.311+0000 7f0e5280a980 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a58b478b60 con 0x55a58b476230 2024-09-13T06:09:55.317 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.311+0000 7f0e5031a640 1 --2- 172.21.15.194:0/2125938867 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55a58b476230 0x55a58b478620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.317 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.311+0000 7f0e5031a640 1 --2- 172.21.15.194:0/2125938867 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55a58b476230 0x55a58b478620 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.317 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.311+0000 7f0e5031a640 1 -- 172.21.15.194:0/2125938867 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0e480c7410 con 0x55a58b476230 2024-09-13T06:09:55.318 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.311+0000 7f0e5280a980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:09:55.318 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.311+0000 7f0e5280a980 20 searching for the correct realm 2024-09-13T06:09:55.318 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.311+0000 7f0e5280a980 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a58b47a400 con 0x55a58b476230 2024-09-13T06:09:55.318 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.311+0000 7f0e5031a640 1 -- 172.21.15.194:0/2125938867 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e480c7410 con 0x55a58b476230 2024-09-13T06:09:55.318 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.311+0000 7f0e5031a640 1 --2- 172.21.15.194:0/2125938867 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f0e48004610 0x7f0e480bc640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.318 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.311+0000 7f0e5031a640 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a58b47a400 con 0x7f0e48004610 2024-09-13T06:09:55.318 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.311+0000 7f0e4fb19640 1 --2- 172.21.15.194:0/2125938867 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f0e48004610 0x7f0e480bc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.318 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.311+0000 7f0e4fb19640 1 --2- 172.21.15.194:0/2125938867 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f0e48004610 0x7f0e480bc640 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.318 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.311+0000 7f0e4fb19640 1 -- 172.21.15.194:0/2125938867 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0e44036040 con 0x7f0e48004610 2024-09-13T06:09:55.318 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.315+0000 7f0e4fb19640 1 --2- 172.21.15.194:0/2125938867 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f0e4400f3d0 0x7f0e4400f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.318 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.315+0000 7f0e4fb19640 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a58b47a400 con 0x7f0e4400f3d0 2024-09-13T06:09:55.318 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.315+0000 7f0e50b1b640 1 --2- 172.21.15.194:0/2125938867 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f0e4400f3d0 0x7f0e4400f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.318 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.315+0000 7f0e50b1b640 1 --2- 172.21.15.194:0/2125938867 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f0e4400f3d0 0x7f0e4400f7f0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.322 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.315+0000 7f0e50b1b640 1 -- 172.21.15.194:0/2125938867 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e400083f0 con 0x7f0e4400f3d0 2024-09-13T06:09:55.322 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.315+0000 7f0e50b1b640 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a58b4754d0 con 0x55a58b471870 2024-09-13T06:09:55.322 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.315+0000 7f0e50b1b640 1 -- 172.21.15.194:0/2125938867 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e400083f0 con 0x55a58b471870 2024-09-13T06:09:55.322 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.315+0000 7f0e50b1b640 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a58b4754d0 con 0x55a58b471870 2024-09-13T06:09:55.322 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.315+0000 7f0e50b1b640 1 -- 172.21.15.194:0/2125938867 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e400083f0 con 0x55a58b471870 2024-09-13T06:09:55.322 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.315+0000 7f0e50b1b640 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a58b4754d0 con 0x7f0e4400f3d0 2024-09-13T06:09:55.323 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.315+0000 7f0e50b1b640 1 -- 172.21.15.194:0/2125938867 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e400083f0 con 0x7f0e4400f3d0 2024-09-13T06:09:55.323 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.315+0000 7f0e50b1b640 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a58b4754d0 con 0x7f0e4400f3d0 2024-09-13T06:09:55.323 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.315+0000 7f0e50b1b640 1 -- 172.21.15.194:0/2125938867 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e400083f0 con 0x7f0e4400f3d0 2024-09-13T06:09:55.323 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.315+0000 7f0e50b1b640 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a58b4754d0 con 0x7f0e48004610 2024-09-13T06:09:55.323 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.315+0000 7f0e4fb19640 1 -- 172.21.15.194:0/2125938867 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e44036040 con 0x7f0e48004610 2024-09-13T06:09:55.323 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.315+0000 7f0e4fb19640 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a58b4754d0 con 0x55a58b476230 2024-09-13T06:09:55.323 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.319+0000 7f0e5031a640 1 -- 172.21.15.194:0/2125938867 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e480c7410 con 0x55a58b476230 2024-09-13T06:09:55.323 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.319+0000 7f0e5031a640 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a58b4754d0 con 0x55a58b471870 2024-09-13T06:09:55.323 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.319+0000 7f0e50b1b640 1 -- 172.21.15.194:0/2125938867 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e400083f0 con 0x55a58b471870 2024-09-13T06:09:55.323 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.319+0000 7f0e50b1b640 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a58b4754d0 con 0x7f0e4400f3d0 2024-09-13T06:09:55.323 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.319+0000 7f0e50b1b640 1 -- 172.21.15.194:0/2125938867 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e400083f0 con 0x7f0e4400f3d0 2024-09-13T06:09:55.323 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.319+0000 7f0e50b1b640 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a58b4754d0 con 0x55a58b471870 2024-09-13T06:09:55.324 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.319+0000 7f0e50b1b640 1 -- 172.21.15.194:0/2125938867 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e400083f0 con 0x55a58b471870 2024-09-13T06:09:55.324 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.319+0000 7f0e50b1b640 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a58b4754d0 con 0x7f0e48004610 2024-09-13T06:09:55.324 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.319+0000 7f0e4fb19640 1 -- 172.21.15.194:0/2125938867 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0e44036040 con 0x7f0e48004610 2024-09-13T06:09:55.324 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.319+0000 7f0e4fb19640 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a58b4754d0 con 0x55a58b476230 2024-09-13T06:09:55.324 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.319+0000 7f0e5031a640 1 -- 172.21.15.194:0/2125938867 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e480c7410 con 0x55a58b476230 2024-09-13T06:09:55.324 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.319+0000 7f0e5031a640 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a58b4754d0 con 0x55a58b476230 2024-09-13T06:09:55.324 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.319+0000 7f0e5031a640 1 -- 172.21.15.194:0/2125938867 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e480c7410 con 0x55a58b476230 2024-09-13T06:09:55.324 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.319+0000 7f0e5031a640 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a58b4754d0 con 0x7f0e4400f3d0 2024-09-13T06:09:55.324 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.319+0000 7f0e50b1b640 1 -- 172.21.15.194:0/2125938867 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e400083f0 con 0x7f0e4400f3d0 2024-09-13T06:09:55.324 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.319+0000 7f0e50b1b640 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a58b4754d0 con 0x55a58b476230 2024-09-13T06:09:55.324 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.319+0000 7f0e5031a640 1 -- 172.21.15.194:0/2125938867 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e480c7410 con 0x55a58b476230 2024-09-13T06:09:55.324 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.319+0000 7f0e5031a640 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a58b4754d0 con 0x55a58b476230 2024-09-13T06:09:55.325 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.319+0000 7f0e5031a640 1 -- 172.21.15.194:0/2125938867 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e480c7410 con 0x55a58b476230 2024-09-13T06:09:55.325 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.319+0000 7f0e5031a640 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a58b4754d0 con 0x55a58b471870 2024-09-13T06:09:55.325 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.319+0000 7f0e50b1b640 1 -- 172.21.15.194:0/2125938867 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e400083f0 con 0x55a58b471870 2024-09-13T06:09:55.325 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.319+0000 7f0e50b1b640 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a58b4754d0 con 0x55a58b471870 2024-09-13T06:09:55.325 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.319+0000 7f0e50b1b640 1 -- 172.21.15.194:0/2125938867 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0e400083f0 con 0x55a58b471870 2024-09-13T06:09:55.325 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.319+0000 7f0e50b1b640 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a58b4754d0 con 0x7f0e4400f3d0 2024-09-13T06:09:55.325 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.323+0000 7f0e50b1b640 1 -- 172.21.15.194:0/2125938867 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e400083f0 con 0x7f0e4400f3d0 2024-09-13T06:09:55.325 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.323+0000 7f0e50b1b640 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a58b4754d0 con 0x55a58b476230 2024-09-13T06:09:55.330 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.323+0000 7f0e5031a640 1 -- 172.21.15.194:0/2125938867 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e480c7410 con 0x55a58b476230 2024-09-13T06:09:55.330 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.323+0000 7f0e5031a640 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a58b4754d0 con 0x7f0e48004610 2024-09-13T06:09:55.330 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.323+0000 7f0e4fb19640 1 -- 172.21.15.194:0/2125938867 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e44036040 con 0x7f0e48004610 2024-09-13T06:09:55.331 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.323+0000 7f0e4fb19640 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a58b4754d0 con 0x55a58b471870 2024-09-13T06:09:55.331 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.323+0000 7f0e50b1b640 1 -- 172.21.15.194:0/2125938867 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e400083f0 con 0x55a58b471870 2024-09-13T06:09:55.331 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.323+0000 7f0e50b1b640 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a58b4754d0 con 0x7f0e4400f3d0 2024-09-13T06:09:55.331 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.323+0000 7f0e50b1b640 1 -- 172.21.15.194:0/2125938867 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e400083f0 con 0x7f0e4400f3d0 2024-09-13T06:09:55.331 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.323+0000 7f0e50b1b640 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a58b4754d0 con 0x55a58b476230 2024-09-13T06:09:55.331 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.323+0000 7f0e5031a640 1 -- 172.21.15.194:0/2125938867 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0e480c7410 con 0x55a58b476230 2024-09-13T06:09:55.331 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.323+0000 7f0e5031a640 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a58b4754d0 con 0x7f0e4400f3d0 2024-09-13T06:09:55.331 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.323+0000 7f0e50b1b640 1 -- 172.21.15.194:0/2125938867 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e400083f0 con 0x7f0e4400f3d0 2024-09-13T06:09:55.331 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.323+0000 7f0e50b1b640 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a58b4754d0 con 0x7f0e48004610 2024-09-13T06:09:55.331 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.323+0000 7f0e4fb19640 1 -- 172.21.15.194:0/2125938867 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e44036040 con 0x7f0e48004610 2024-09-13T06:09:55.331 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.323+0000 7f0e4fb19640 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a58b4754d0 con 0x55a58b476230 2024-09-13T06:09:55.331 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.323+0000 7f0e5031a640 1 -- 172.21.15.194:0/2125938867 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e480c7410 con 0x55a58b476230 2024-09-13T06:09:55.331 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.323+0000 7f0e5031a640 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a58b4754d0 con 0x7f0e4400f3d0 2024-09-13T06:09:55.332 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.323+0000 7f0e50b1b640 1 -- 172.21.15.194:0/2125938867 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e400083f0 con 0x7f0e4400f3d0 2024-09-13T06:09:55.332 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.323+0000 7f0e50b1b640 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a58b4754d0 con 0x55a58b471870 2024-09-13T06:09:55.332 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.323+0000 7f0e50b1b640 1 -- 172.21.15.194:0/2125938867 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0e400083f0 con 0x55a58b471870 2024-09-13T06:09:55.332 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.323+0000 7f0e50b1b640 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a58b4754d0 con 0x7f0e48004610 2024-09-13T06:09:55.332 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.327+0000 7f0e4fb19640 1 -- 172.21.15.194:0/2125938867 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e44036040 con 0x7f0e48004610 2024-09-13T06:09:55.332 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.327+0000 7f0e5280a980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:09:55.332 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.327+0000 7f0e5280a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:09:55.332 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.327+0000 7f0e5280a980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:09:55.332 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.327+0000 7f0e5280a980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:09:55.332 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.327+0000 7f0e5280a980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:09:55.332 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.327+0000 7f0e5280a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:09:55.332 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.327+0000 7f0e5280a980 20 rados->read ofs=0 len=0 2024-09-13T06:09:55.332 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.327+0000 7f0e5280a980 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a58b4793b0 con 0x55a58b471870 2024-09-13T06:09:55.332 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.327+0000 7f0e50b1b640 1 -- 172.21.15.194:0/2125938867 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0e400083f0 con 0x55a58b471870 2024-09-13T06:09:55.333 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.327+0000 7f0e5280a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:55.333 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.327+0000 7f0e5280a980 20 rados->read ofs=0 len=0 2024-09-13T06:09:55.333 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.327+0000 7f0e5280a980 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a58b4797a0 con 0x55a58b471870 2024-09-13T06:09:55.333 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.327+0000 7f0e50b1b640 1 -- 172.21.15.194:0/2125938867 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0e400083f0 con 0x55a58b471870 2024-09-13T06:09:55.333 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.327+0000 7f0e5280a980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:55.333 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.327+0000 7f0e5280a980 20 rados->read ofs=0 len=0 2024-09-13T06:09:55.333 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.327+0000 7f0e5280a980 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a58b4797a0 con 0x7f0e48004610 2024-09-13T06:09:55.333 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.327+0000 7f0e4fb19640 1 -- 172.21.15.194:0/2125938867 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0e44036040 con 0x7f0e48004610 2024-09-13T06:09:55.333 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.327+0000 7f0e5280a980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:09:55.333 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.327+0000 7f0e5280a980 20 zone default found 2024-09-13T06:09:55.333 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.327+0000 7f0e5280a980 4 Realm: () 2024-09-13T06:09:55.333 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.327+0000 7f0e5280a980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:09:55.333 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.327+0000 7f0e5280a980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:09:55.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.327+0000 7f0e5280a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:09:55.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.327+0000 7f0e5280a980 20 zonegroup default 2024-09-13T06:09:55.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.327+0000 7f0e5280a980 20 rados->read ofs=0 len=0 2024-09-13T06:09:55.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.327+0000 7f0e5280a980 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a58b47a8d0 con 0x7f0e4400f3d0 2024-09-13T06:09:55.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.327+0000 7f0e50b1b640 1 -- 172.21.15.194:0/2125938867 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0e400083f0 con 0x7f0e4400f3d0 2024-09-13T06:09:55.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.327+0000 7f0e5280a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:55.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.327+0000 7f0e5280a980 20 rados->read ofs=0 len=0 2024-09-13T06:09:55.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.327+0000 7f0e5280a980 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a58b47c2b0 con 0x55a58b476230 2024-09-13T06:09:55.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.327+0000 7f0e5031a640 1 -- 172.21.15.194:0/2125938867 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0e480c7410 con 0x55a58b476230 2024-09-13T06:09:55.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.327+0000 7f0e5280a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:55.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.327+0000 7f0e5280a980 20 rados->read ofs=0 len=0 2024-09-13T06:09:55.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.327+0000 7f0e5280a980 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a58b47c650 con 0x55a58b476230 2024-09-13T06:09:55.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.327+0000 7f0e5031a640 1 -- 172.21.15.194:0/2125938867 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0e480c7410 con 0x55a58b476230 2024-09-13T06:09:55.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.327+0000 7f0e5280a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:55.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.327+0000 7f0e5280a980 20 started sync module instance, tier type = 2024-09-13T06:09:55.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.327+0000 7f0e5280a980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:09:55.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.327+0000 7f0e5280a980 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a58b47b750 con 0x7f0e48004610 2024-09-13T06:09:55.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.327+0000 7f0e4fb19640 1 -- 172.21.15.194:0/2125938867 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(44 notify.0 [create] v33'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e44036040 con 0x7f0e48004610 2024-09-13T06:09:55.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.327+0000 7f0e5280a980 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94169494698816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a58b47cef0 con 0x7f0e48004610 2024-09-13T06:09:55.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.327+0000 7f0e5280a980 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a58b47d740 con 0x55a58b471870 2024-09-13T06:09:55.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.331+0000 7f0e4fb19640 1 -- 172.21.15.194:0/2125938867 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94169494698816] v33'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e44036040 con 0x7f0e48004610 2024-09-13T06:09:55.337 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.331+0000 7f0e50b1b640 1 -- 172.21.15.194:0/2125938867 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v33'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e400083f0 con 0x55a58b471870 2024-09-13T06:09:55.337 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.331+0000 7f0e5280a980 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94169494702656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a58b47d740 con 0x55a58b471870 2024-09-13T06:09:55.337 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.331+0000 7f0e5280a980 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a58b47e240 con 0x55a58b476230 2024-09-13T06:09:55.337 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.331+0000 7f0e50b1b640 1 -- 172.21.15.194:0/2125938867 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94169494702656] v33'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e400083f0 con 0x55a58b471870 2024-09-13T06:09:55.337 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.335+0000 7f0e5031a640 1 -- 172.21.15.194:0/2125938867 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v33'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e480c7410 con 0x55a58b476230 2024-09-13T06:09:55.337 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.335+0000 7f0e5280a980 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94169494704784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a58b47d6b0 con 0x55a58b476230 2024-09-13T06:09:55.337 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.335+0000 7f0e5280a980 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a58b47ef90 con 0x7f0e48004610 2024-09-13T06:09:55.337 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.335+0000 7f0e4fb19640 1 -- 172.21.15.194:0/2125938867 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(50 notify.3 [create] v33'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e44036040 con 0x7f0e48004610 2024-09-13T06:09:55.337 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.335+0000 7f0e5280a980 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94169494711280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a58b47f830 con 0x7f0e48004610 2024-09-13T06:09:55.337 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.335+0000 7f0e5280a980 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a58b480230 con 0x55a58b471870 2024-09-13T06:09:55.337 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.335+0000 7f0e5031a640 1 -- 172.21.15.194:0/2125938867 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94169494704784] v33'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e480c7410 con 0x55a58b476230 2024-09-13T06:09:55.337 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.335+0000 7f0e4fb19640 1 -- 172.21.15.194:0/2125938867 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94169494711280] v33'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e44036040 con 0x7f0e48004610 2024-09-13T06:09:55.338 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.335+0000 7f0e50b1b640 1 -- 172.21.15.194:0/2125938867 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v33'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e400083f0 con 0x55a58b471870 2024-09-13T06:09:55.338 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.335+0000 7f0e5280a980 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94169494709808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a58b47f380 con 0x55a58b471870 2024-09-13T06:09:55.338 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.335+0000 7f0e5280a980 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a58b480ad0 con 0x7f0e4400f3d0 2024-09-13T06:09:55.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.339+0000 7f0e50b1b640 1 -- 172.21.15.194:0/2125938867 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94169494709808] v33'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e400083f0 con 0x55a58b471870 2024-09-13T06:09:55.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.339+0000 7f0e50b1b640 1 -- 172.21.15.194:0/2125938867 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(54 notify.5 [create] v33'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e400083f0 con 0x7f0e4400f3d0 2024-09-13T06:09:55.340 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.339+0000 7f0e5280a980 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94169494715712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a58b47f380 con 0x7f0e4400f3d0 2024-09-13T06:09:55.340 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.339+0000 7f0e5280a980 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a58b480f60 con 0x7f0e4400f3d0 2024-09-13T06:09:55.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.339+0000 7f0e50b1b640 1 -- 172.21.15.194:0/2125938867 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(56 notify.6 [create] v33'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e400083f0 con 0x7f0e4400f3d0 2024-09-13T06:09:55.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.339+0000 7f0e5280a980 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94169494719024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a58b4813d0 con 0x7f0e4400f3d0 2024-09-13T06:09:55.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.339+0000 7f0e5280a980 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a58b481eb0 con 0x7f0e4400f3d0 2024-09-13T06:09:55.344 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.343+0000 7f0e50b1b640 1 -- 172.21.15.194:0/2125938867 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(58 notify.7 [create] v33'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e400083f0 con 0x7f0e4400f3d0 2024-09-13T06:09:55.344 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.343+0000 7f0e5280a980 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94169494723008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a58b482360 con 0x7f0e4400f3d0 2024-09-13T06:09:55.344 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.343+0000 7f0e5280a980 20 add_watcher() i=0 2024-09-13T06:09:55.345 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.343+0000 7f0e5280a980 20 add_watcher() i=1 2024-09-13T06:09:55.345 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.343+0000 7f0e5280a980 20 add_watcher() i=2 2024-09-13T06:09:55.345 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.343+0000 7f0e5280a980 20 add_watcher() i=3 2024-09-13T06:09:55.345 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.343+0000 7f0e5280a980 20 add_watcher() i=4 2024-09-13T06:09:55.345 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.343+0000 7f0e50b1b640 1 -- 172.21.15.194:0/2125938867 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94169494715712] v33'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e400083f0 con 0x7f0e4400f3d0 2024-09-13T06:09:55.345 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.343+0000 7f0e5280a980 20 add_watcher() i=5 2024-09-13T06:09:55.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.347+0000 7f0e50b1b640 1 -- 172.21.15.194:0/2125938867 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94169494723008] v33'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e400083f0 con 0x7f0e4400f3d0 2024-09-13T06:09:55.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.347+0000 7f0e50b1b640 1 -- 172.21.15.194:0/2125938867 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94169494719024] v33'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e400083f0 con 0x7f0e4400f3d0 2024-09-13T06:09:55.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.347+0000 7f0e5280a980 20 add_watcher() i=6 2024-09-13T06:09:55.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.347+0000 7f0e5280a980 20 add_watcher() i=7 2024-09-13T06:09:55.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.347+0000 7f0e5280a980 2 all 8 watchers are set, enabling cache 2024-09-13T06:09:55.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.347+0000 7f0e5280a980 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a58b481eb0 con 0x55a58b471870 2024-09-13T06:09:55.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.347+0000 7f0e50b1b640 1 -- 172.21.15.194:0/2125938867 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0e400083f0 con 0x55a58b471870 2024-09-13T06:09:55.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.347+0000 7f0e5280a980 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94169494724272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a58b482300 con 0x55a58b471870 2024-09-13T06:09:55.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.347+0000 7f0e50b1b640 1 -- 172.21.15.194:0/2125938867 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94169494724272] v33'74 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0e400083f0 con 0x55a58b471870 2024-09-13T06:09:55.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.347+0000 7f0d067e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:55.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.347+0000 7f0e5280a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:09:55.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.347+0000 7f0e5280a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:09:55.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.347+0000 7f0e5280a980 5 note: GC not initialized 2024-09-13T06:09:55.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.347+0000 7f0d057e2640 20 reqs_thread_entry: start 2024-09-13T06:09:55.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.347+0000 7f0e5280a980 20 init_complete bucket index max shards: 11 2024-09-13T06:09:55.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.347+0000 7f0e5280a980 20 Filter name: none 2024-09-13T06:09:55.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.347+0000 7f0c7effd640 20 reqs_thread_entry: start 2024-09-13T06:09:55.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.347+0000 7f0e5280a980 20 rados->read ofs=0 len=0 2024-09-13T06:09:55.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.347+0000 7f0e5280a980 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a58b4a7f60 con 0x55a58b471870 2024-09-13T06:09:55.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.347+0000 7f0e50b1b640 1 -- 172.21.15.194:0/2125938867 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f0e400083f0 con 0x55a58b471870 2024-09-13T06:09:55.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.347+0000 7f0e5280a980 20 rados_obj.operate() r=0 bl.length=556 2024-09-13T06:09:55.351 INFO:teuthology.orchestra.run.smithi194.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T06:09:53.191222Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:09:53.191207Z","tags":[],"group_ids":[]} 2024-09-13T06:09:55.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.351+0000 7f0d067e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:55.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.351+0000 7f0e5280a980 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94169494724272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a58b4a6b10 con 0x55a58b471870 2024-09-13T06:09:55.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.351+0000 7f0e50b1b640 1 -- 172.21.15.194:0/2125938867 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94169494724272] v33'75 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0e400083f0 con 0x55a58b471870 2024-09-13T06:09:55.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.351+0000 7f0e5280a980 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94169494698816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a58b481eb0 con 0x7f0e48004610 2024-09-13T06:09:55.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.351+0000 7f0e4fb19640 1 -- 172.21.15.194:0/2125938867 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94169494698816] v33'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e44036040 con 0x7f0e48004610 2024-09-13T06:09:55.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.351+0000 7f0e5280a980 20 remove_watcher() i=0 2024-09-13T06:09:55.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.351+0000 7f0e5280a980 2 removed watcher, disabling cache 2024-09-13T06:09:55.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.351+0000 7f0e5280a980 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94169494702656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a58b47bb40 con 0x55a58b471870 2024-09-13T06:09:55.355 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.355+0000 7f0e50b1b640 1 -- 172.21.15.194:0/2125938867 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94169494702656] v33'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e400083f0 con 0x55a58b471870 2024-09-13T06:09:55.355 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.355+0000 7f0e5280a980 20 remove_watcher() i=1 2024-09-13T06:09:55.355 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.355+0000 7f0e5280a980 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94169494704784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a58b47bb40 con 0x55a58b476230 2024-09-13T06:09:55.357 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.355+0000 7f0e5031a640 1 -- 172.21.15.194:0/2125938867 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94169494704784] v33'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e480c7410 con 0x55a58b476230 2024-09-13T06:09:55.357 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.355+0000 7f0e5280a980 20 remove_watcher() i=2 2024-09-13T06:09:55.357 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.355+0000 7f0e5280a980 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94169494711280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a58b47d290 con 0x7f0e48004610 2024-09-13T06:09:55.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.355+0000 7f0e4fb19640 1 -- 172.21.15.194:0/2125938867 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94169494711280] v33'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e44036040 con 0x7f0e48004610 2024-09-13T06:09:55.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.355+0000 7f0e5280a980 20 remove_watcher() i=3 2024-09-13T06:09:55.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.355+0000 7f0e5280a980 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94169494709808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a58b47bb40 con 0x55a58b471870 2024-09-13T06:09:55.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.359+0000 7f0e50b1b640 1 -- 172.21.15.194:0/2125938867 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94169494709808] v33'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e400083f0 con 0x55a58b471870 2024-09-13T06:09:55.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.359+0000 7f0e5280a980 20 remove_watcher() i=4 2024-09-13T06:09:55.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.359+0000 7f0e5280a980 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94169494715712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a58b47d290 con 0x7f0e4400f3d0 2024-09-13T06:09:55.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.359+0000 7f0e50b1b640 1 -- 172.21.15.194:0/2125938867 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94169494715712] v33'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e400083f0 con 0x7f0e4400f3d0 2024-09-13T06:09:55.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.359+0000 7f0e5280a980 20 remove_watcher() i=5 2024-09-13T06:09:55.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.359+0000 7f0e5280a980 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94169494719024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a58b47bb40 con 0x7f0e4400f3d0 2024-09-13T06:09:55.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.363+0000 7f0e50b1b640 1 -- 172.21.15.194:0/2125938867 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94169494719024] v33'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e400083f0 con 0x7f0e4400f3d0 2024-09-13T06:09:55.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.363+0000 7f0e5280a980 20 remove_watcher() i=6 2024-09-13T06:09:55.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.363+0000 7f0e5280a980 1 -- 172.21.15.194:0/2125938867 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94169494723008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a58b47d290 con 0x7f0e4400f3d0 2024-09-13T06:09:55.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.363+0000 7f0e50b1b640 1 -- 172.21.15.194:0/2125938867 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94169494723008] v33'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e400083f0 con 0x7f0e4400f3d0 2024-09-13T06:09:55.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.363+0000 7f0e5280a980 20 remove_watcher() i=7 2024-09-13T06:09:55.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.363+0000 7f0e5280a980 1 -- 172.21.15.194:0/2125938867 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f0e4400f3d0 msgr2=0x7f0e4400f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.363+0000 7f0e5280a980 1 --2- 172.21.15.194:0/2125938867 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f0e4400f3d0 0x7f0e4400f7f0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.363+0000 7f0e5280a980 1 -- 172.21.15.194:0/2125938867 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55a58b471870 msgr2=0x55a58b473d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.363+0000 7f0e5280a980 1 --2- 172.21.15.194:0/2125938867 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55a58b471870 0x55a58b473d30 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.363+0000 7f0e5280a980 1 -- 172.21.15.194:0/2125938867 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f0e48004610 msgr2=0x7f0e480bc640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.363+0000 7f0e5280a980 1 --2- 172.21.15.194:0/2125938867 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f0e48004610 0x7f0e480bc640 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.363+0000 7f0e5280a980 1 -- 172.21.15.194:0/2125938867 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55a58b476230 msgr2=0x55a58b478620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.363+0000 7f0e5280a980 1 --2- 172.21.15.194:0/2125938867 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55a58b476230 0x55a58b478620 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.363+0000 7f0e5280a980 1 -- 172.21.15.194:0/2125938867 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0d200345b0 msgr2=0x7f0d20036a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.363+0000 7f0e5280a980 1 --2- 172.21.15.194:0/2125938867 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0d200345b0 0x7f0d20036a70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x55a58b445740 tx=0x7f0e44011000 comp rx=0 tx=0).stop 2024-09-13T06:09:55.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.363+0000 7f0e5280a980 1 -- 172.21.15.194:0/2125938867 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a58b45f680 msgr2=0x55a58b4668c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.363+0000 7f0e50b1b640 1 -- 172.21.15.194:0/2125938867 reap_dead start 2024-09-13T06:09:55.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.363+0000 7f0e5280a980 1 --2- 172.21.15.194:0/2125938867 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a58b45f680 0x55a58b4668c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0e480d95b0 tx=0x7f0e480eaf80 comp rx=0 tx=0).stop 2024-09-13T06:09:55.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.363+0000 7f0e5280a980 1 -- 172.21.15.194:0/2125938867 shutdown_connections 2024-09-13T06:09:55.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.363+0000 7f0e5280a980 1 --2- 172.21.15.194:0/2125938867 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a58b45f680 0x55a58b4668c0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.363+0000 7f0e5280a980 1 -- 172.21.15.194:0/2125938867 >> 172.21.15.194:0/2125938867 conn(0x55a58b45bab0 msgr2=0x55a58b459b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:55.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.363+0000 7f0e5280a980 1 -- 172.21.15.194:0/2125938867 shutdown_connections 2024-09-13T06:09:55.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.363+0000 7f0e5280a980 1 -- 172.21.15.194:0/2125938867 wait complete. 2024-09-13T06:09:55.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.363+0000 7f0e5280a980 1 -- 172.21.15.194:0/4108956967 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0d28034650 msgr2=0x7f0d28036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.363+0000 7f0e5280a980 1 --2- 172.21.15.194:0/4108956967 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0d28034650 0x7f0d28036b10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x55a58b4396a0 tx=0x7f0e44006000 comp rx=0 tx=0).stop 2024-09-13T06:09:55.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.363+0000 7f0e5280a980 1 -- 172.21.15.194:0/4108956967 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a58b452e10 msgr2=0x55a58b453230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.363+0000 7f0e5280a980 1 --2- 172.21.15.194:0/4108956967 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a58b452e10 0x55a58b453230 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0e480d0920 tx=0x7f0e480c66b0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.363+0000 7f0e5280a980 1 -- 172.21.15.194:0/4108956967 shutdown_connections 2024-09-13T06:09:55.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.363+0000 7f0e5280a980 1 --2- 172.21.15.194:0/4108956967 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0d28034650 0x7f0d28036b10 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.363+0000 7f0e5280a980 1 --2- 172.21.15.194:0/4108956967 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a58b452e10 0x55a58b453230 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.363+0000 7f0e5280a980 1 -- 172.21.15.194:0/4108956967 >> 172.21.15.194:0/4108956967 conn(0x55a58b447f60 msgr2=0x55a58b44a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:55.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.363+0000 7f0e5280a980 1 -- 172.21.15.194:0/4108956967 shutdown_connections 2024-09-13T06:09:55.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.363+0000 7f0e5280a980 1 -- 172.21.15.194:0/4108956967 wait complete. 2024-09-13T06:09:55.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.367+0000 7f0e5280a980 1 -- 172.21.15.194:0/2941210077 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55a58b33fe90 msgr2=0x55a58b43bf20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.367+0000 7f0e5280a980 1 --2- 172.21.15.194:0/2941210077 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55a58b33fe90 0x55a58b43bf20 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.367+0000 7f0e5280a980 1 -- 172.21.15.194:0/2941210077 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55a58b442860 msgr2=0x55a58b444c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.367+0000 7f0e5280a980 1 --2- 172.21.15.194:0/2941210077 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55a58b442860 0x55a58b444c50 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.367+0000 7f0e5280a980 1 -- 172.21.15.194:0/2941210077 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55a58b43e7b0 msgr2=0x55a58b440c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.367+0000 7f0e5280a980 1 --2- 172.21.15.194:0/2941210077 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55a58b43e7b0 0x55a58b440c70 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.367+0000 7f0e5280a980 1 -- 172.21.15.194:0/2941210077 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0d38034650 msgr2=0x7f0d38036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.367+0000 7f0e5280a980 1 --2- 172.21.15.194:0/2941210077 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0d38034650 0x7f0d38036b10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0e44001e20 tx=0x7f0e440013a0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.367+0000 7f0e5280a980 1 -- 172.21.15.194:0/2941210077 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a58b33f540 msgr2=0x55a58b434f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.367+0000 7f0e5280a980 1 --2- 172.21.15.194:0/2941210077 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a58b33f540 0x55a58b434f90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0e48005cc0 tx=0x7f0e48017e30 comp rx=0 tx=0).stop 2024-09-13T06:09:55.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.367+0000 7f0e50b1b640 1 -- 172.21.15.194:0/2941210077 reap_dead start 2024-09-13T06:09:55.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.367+0000 7f0e5280a980 1 -- 172.21.15.194:0/2941210077 shutdown_connections 2024-09-13T06:09:55.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.367+0000 7f0e5280a980 1 -- 172.21.15.194:0/2941210077 >> 172.21.15.194:0/2941210077 conn(0x55a58b33b060 msgr2=0x55a58b425130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:55.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.367+0000 7f0e5280a980 1 -- 172.21.15.194:0/2941210077 shutdown_connections 2024-09-13T06:09:55.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.367+0000 7f0e5280a980 1 -- 172.21.15.194:0/2941210077 wait complete. 2024-09-13T06:09:55.376 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T06:09:53.191222Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:09:53.191207Z', 'tags': [], 'group_ids': []} 2024-09-13T06:09:55.376 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T06:09:55.376 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T06:09:55.376 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T06:09:55.448 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:09:55.448 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:09:55.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.447+0000 7f7776508980 1 Processor -- start 2024-09-13T06:09:55.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.447+0000 7f7776508980 1 -- start start 2024-09-13T06:09:55.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.447+0000 7f7776508980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x5568126473b0 0x556812645b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.447+0000 7f7776508980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556812558ae0 con 0x5568126477c0 2024-09-13T06:09:55.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.447+0000 7f7776508980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x55681257ce30 con 0x5568126473b0 2024-09-13T06:09:55.450 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.447+0000 7f7774018640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x5568126473b0 0x556812645b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.450 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.447+0000 7f7774018640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x5568126473b0 0x556812645b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44790/0 (socket says 172.21.15.194:44790) 2024-09-13T06:09:55.450 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.447+0000 7f7774018640 1 -- 172.21.15.194:0/268340968 learned_addr learned my addr 172.21.15.194:0/268340968 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:55.450 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.447+0000 7f7773817640 1 --1- 172.21.15.194:0/268340968 >> v1:172.21.15.120:6789/0 conn(0x5568126477c0 0x5568126460b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:51030/0 (socket says 172.21.15.194:51030) 2024-09-13T06:09:55.450 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.447+0000 7f7774018640 1 -- 172.21.15.194:0/268340968 >> v1:172.21.15.120:6789/0 conn(0x5568126477c0 legacy=0x5568126460b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.450 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.447+0000 7f7774018640 1 -- 172.21.15.194:0/268340968 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568126468e0 con 0x5568126473b0 2024-09-13T06:09:55.453 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.451+0000 7f7774018640 1 --2- 172.21.15.194:0/268340968 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5568126473b0 0x556812645b70 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f776400a4e0 tx=0x7f776401b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2c232e90c33bd7f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.453 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.451+0000 7f7773016640 1 -- 172.21.15.194:0/268340968 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77640aa540 con 0x5568126473b0 2024-09-13T06:09:55.453 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.451+0000 7f7773016640 1 -- 172.21.15.194:0/268340968 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77640aa6e0 con 0x5568126473b0 2024-09-13T06:09:55.453 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.451+0000 7f7773016640 1 -- 172.21.15.194:0/268340968 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77640aaa40 con 0x5568126473b0 2024-09-13T06:09:55.454 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.451+0000 7f7776508980 1 -- 172.21.15.194:0/268340968 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5568126473b0 msgr2=0x556812645b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.454 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.451+0000 7f7776508980 1 --2- 172.21.15.194:0/268340968 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5568126473b0 0x556812645b70 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f776400a4e0 tx=0x7f776401b090 comp rx=0 tx=0).stop 2024-09-13T06:09:55.454 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.451+0000 7f7776508980 1 -- 172.21.15.194:0/268340968 shutdown_connections 2024-09-13T06:09:55.454 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.451+0000 7f7776508980 1 --2- 172.21.15.194:0/268340968 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5568126473b0 0x556812645b70 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.454 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.451+0000 7f7776508980 1 -- 172.21.15.194:0/268340968 >> 172.21.15.194:0/268340968 conn(0x5568126cc1b0 msgr2=0x5568126ce5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:55.454 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.451+0000 7f7776508980 1 -- 172.21.15.194:0/268340968 shutdown_connections 2024-09-13T06:09:55.454 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.451+0000 7f7776508980 1 -- 172.21.15.194:0/268340968 wait complete. 2024-09-13T06:09:55.466 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.463+0000 7f7776508980 1 Processor -- start 2024-09-13T06:09:55.466 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.463+0000 7f7776508980 1 -- start start 2024-09-13T06:09:55.466 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.467+0000 7f7776508980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5568126473b0 0x5568127bdb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.466 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.467+0000 7f7776508980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55681257e200 con 0x5568126473b0 2024-09-13T06:09:55.467 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.467+0000 7f7774018640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5568126473b0 0x5568127bdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.467 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.467+0000 7f7774018640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5568126473b0 0x5568127bdb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44800/0 (socket says 172.21.15.194:44800) 2024-09-13T06:09:55.467 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.467+0000 7f7774018640 1 -- 172.21.15.194:0/3829648825 learned_addr learned my addr 172.21.15.194:0/3829648825 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:55.467 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.467+0000 7f7774018640 1 -- 172.21.15.194:0/3829648825 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568127be160 con 0x5568126473b0 2024-09-13T06:09:55.468 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.467+0000 7f7774018640 1 --2- 172.21.15.194:0/3829648825 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5568126473b0 0x5568127bdb90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7764017ca0 tx=0x7f77640033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c39e47b88a777dfa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.469 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.467+0000 7f766260c640 1 -- 172.21.15.194:0/3829648825 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77640b9070 con 0x5568126473b0 2024-09-13T06:09:55.469 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.467+0000 7f766260c640 1 -- 172.21.15.194:0/3829648825 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77640aab30 con 0x5568126473b0 2024-09-13T06:09:55.469 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.467+0000 7f766260c640 1 -- 172.21.15.194:0/3829648825 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77640aae10 con 0x5568126473b0 2024-09-13T06:09:55.469 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.467+0000 7f7776508980 1 -- 172.21.15.194:0/3829648825 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5568126473b0 msgr2=0x5568127bdb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.470 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.467+0000 7f7776508980 1 --2- 172.21.15.194:0/3829648825 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5568126473b0 0x5568127bdb90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7764017ca0 tx=0x7f77640033b0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.470 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.467+0000 7f7776508980 1 -- 172.21.15.194:0/3829648825 shutdown_connections 2024-09-13T06:09:55.470 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.467+0000 7f7776508980 1 --2- 172.21.15.194:0/3829648825 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5568126473b0 0x5568127bdb90 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.470 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.467+0000 7f7776508980 1 -- 172.21.15.194:0/3829648825 >> 172.21.15.194:0/3829648825 conn(0x5568126cc1b0 msgr2=0x5568127b97c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:55.470 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.467+0000 7f7776508980 1 -- 172.21.15.194:0/3829648825 shutdown_connections 2024-09-13T06:09:55.470 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.467+0000 7f7776508980 1 -- 172.21.15.194:0/3829648825 wait complete. 2024-09-13T06:09:55.470 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.467+0000 7f7776508980 1 Processor -- start 2024-09-13T06:09:55.470 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.467+0000 7f7776508980 1 -- start start 2024-09-13T06:09:55.470 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.467+0000 7f7776508980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5568126473b0 0x5568127c4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.470 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.467+0000 7f7776508980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5568126dc200 con 0x5568126473b0 2024-09-13T06:09:55.470 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.467+0000 7f7774018640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5568126473b0 0x5568127c4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.470 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.467+0000 7f7774018640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5568126473b0 0x5568127c4de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44802/0 (socket says 172.21.15.194:44802) 2024-09-13T06:09:55.470 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.467+0000 7f7774018640 1 -- 172.21.15.194:0/88346316 learned_addr learned my addr 172.21.15.194:0/88346316 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:55.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.467+0000 7f7774018640 1 -- 172.21.15.194:0/88346316 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568127c5320 con 0x5568126473b0 2024-09-13T06:09:55.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.471+0000 7f7774018640 1 --2- 172.21.15.194:0/88346316 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5568126473b0 0x5568127c4de0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7764017ca0 tx=0x7f7764017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.471+0000 7f7660e09640 1 -- 172.21.15.194:0/88346316 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77640b9070 con 0x5568126473b0 2024-09-13T06:09:55.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.471+0000 7f7776508980 1 -- 172.21.15.194:0/88346316 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5568127c55b0 con 0x5568126473b0 2024-09-13T06:09:55.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.471+0000 7f7776508980 1 -- 172.21.15.194:0/88346316 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568127c8290 con 0x5568126473b0 2024-09-13T06:09:55.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.471+0000 7f7660e09640 1 -- 172.21.15.194:0/88346316 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77640b5e10 con 0x5568126473b0 2024-09-13T06:09:55.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.471+0000 7f7660e09640 1 -- 172.21.15.194:0/88346316 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77640bd610 con 0x5568126473b0 2024-09-13T06:09:55.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.471+0000 7f7660e09640 1 -- 172.21.15.194:0/88346316 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f77640b3040 con 0x5568126473b0 2024-09-13T06:09:55.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.471+0000 7f7660e09640 1 --2- 172.21.15.194:0/88346316 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f765c0346a0 0x7f765c036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.471+0000 7f7660e09640 1 -- 172.21.15.194:0/88346316 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f77640c4070 con 0x5568126473b0 2024-09-13T06:09:55.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.471+0000 7f7773817640 1 --2- 172.21.15.194:0/88346316 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f765c0346a0 0x7f765c036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.471+0000 7f7776508980 1 --2- 172.21.15.194:0/88346316 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5568126477c0 0x5568127cbd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.471+0000 7f7776508980 1 -- 172.21.15.194:0/88346316 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568127cc3c0 con 0x5568126477c0 2024-09-13T06:09:55.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.471+0000 7f7774819640 1 --2- 172.21.15.194:0/88346316 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5568126477c0 0x5568127cbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.474 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.471+0000 7f7773817640 1 --2- 172.21.15.194:0/88346316 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f765c0346a0 0x7f765c036b60 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f775c000f70 tx=0x7f775c001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.474 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.471+0000 7f7774819640 1 --2- 172.21.15.194:0/88346316 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5568126477c0 0x5568127cbd70 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.476 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.471+0000 7f7774819640 1 -- 172.21.15.194:0/88346316 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f776c0083f0 con 0x5568126477c0 2024-09-13T06:09:55.476 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.471+0000 7f7776508980 1 -- 172.21.15.194:0/88346316 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568127c94b0 con 0x5568126477c0 2024-09-13T06:09:55.476 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.471+0000 7f7774819640 1 -- 172.21.15.194:0/88346316 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f776c0083f0 con 0x5568126477c0 2024-09-13T06:09:55.476 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.471+0000 7f7776508980 1 --2- 172.21.15.194:0/88346316 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5568127ce6f0 0x5568127d0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.476 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.471+0000 7f7776508980 1 -- 172.21.15.194:0/88346316 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568127d11d0 con 0x5568127ce6f0 2024-09-13T06:09:55.476 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.471+0000 7f7774018640 1 --2- 172.21.15.194:0/88346316 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5568127ce6f0 0x5568127d0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.476 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.471+0000 7f7774018640 1 --2- 172.21.15.194:0/88346316 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5568127ce6f0 0x5568127d0ae0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.476 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.471+0000 7f7774018640 1 -- 172.21.15.194:0/88346316 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f77640bdc30 con 0x5568127ce6f0 2024-09-13T06:09:55.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.471+0000 7f7776508980 1 -- 172.21.15.194:0/88346316 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568127cd590 con 0x5568126477c0 2024-09-13T06:09:55.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.475+0000 7f7774819640 1 -- 172.21.15.194:0/88346316 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f776c0083f0 con 0x5568126477c0 2024-09-13T06:09:55.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.475+0000 7f7776508980 1 --2- 172.21.15.194:0/88346316 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5568127d2630 0x5568127d4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.475+0000 7f7776508980 1 -- 172.21.15.194:0/88346316 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568127d5160 con 0x5568127d2630 2024-09-13T06:09:55.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.475+0000 7f7773817640 1 --2- 172.21.15.194:0/88346316 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5568127d2630 0x5568127d4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.475+0000 7f7773817640 1 --2- 172.21.15.194:0/88346316 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5568127d2630 0x5568127d4a20 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.475+0000 7f7773817640 1 -- 172.21.15.194:0/88346316 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f775c00f6a0 con 0x5568127d2630 2024-09-13T06:09:55.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.475+0000 7f7776508980 1 Processor -- start 2024-09-13T06:09:55.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.475+0000 7f7776508980 1 -- start start 2024-09-13T06:09:55.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.475+0000 7f7776508980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5568127e2c30 0x5568127e3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.475+0000 7f7776508980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5568125d7800 con 0x5568127e2c30 2024-09-13T06:09:55.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.475+0000 7f7774018640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5568127e2c30 0x5568127e3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.475+0000 7f7774018640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5568127e2c30 0x5568127e3050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44810/0 (socket says 172.21.15.194:44810) 2024-09-13T06:09:55.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.475+0000 7f7774018640 1 -- 172.21.15.194:0/4019142540 learned_addr learned my addr 172.21.15.194:0/4019142540 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:55.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.475+0000 7f7774018640 1 -- 172.21.15.194:0/4019142540 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568127e3590 con 0x5568127e2c30 2024-09-13T06:09:55.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.475+0000 7f7774018640 1 --2- 172.21.15.194:0/4019142540 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5568127e2c30 0x5568127e3050 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f77640e2f80 tx=0x7f77640cfe00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.475+0000 7f7659ffb640 1 -- 172.21.15.194:0/4019142540 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77640a93c0 con 0x5568127e2c30 2024-09-13T06:09:55.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.475+0000 7f7776508980 1 -- 172.21.15.194:0/4019142540 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5568127e3820 con 0x5568127e2c30 2024-09-13T06:09:55.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.475+0000 7f7659ffb640 1 -- 172.21.15.194:0/4019142540 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77640e9070 con 0x5568127e2c30 2024-09-13T06:09:55.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.475+0000 7f7659ffb640 1 -- 172.21.15.194:0/4019142540 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77640a9690 con 0x5568127e2c30 2024-09-13T06:09:55.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.475+0000 7f7776508980 1 -- 172.21.15.194:0/4019142540 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568127e64a0 con 0x5568127e2c30 2024-09-13T06:09:55.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.479+0000 7f7659ffb640 1 -- 172.21.15.194:0/4019142540 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f77640e43d0 con 0x5568127e2c30 2024-09-13T06:09:55.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.479+0000 7f7659ffb640 1 --2- 172.21.15.194:0/4019142540 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f764c034650 0x7f764c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.479+0000 7f7659ffb640 1 -- 172.21.15.194:0/4019142540 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f77640ad120 con 0x5568127e2c30 2024-09-13T06:09:55.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.479+0000 7f7773817640 1 --2- 172.21.15.194:0/4019142540 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f764c034650 0x7f764c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.479+0000 7f7776508980 1 Processor -- start 2024-09-13T06:09:55.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.479+0000 7f7776508980 1 -- start start 2024-09-13T06:09:55.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.479+0000 7f7773817640 1 --2- 172.21.15.194:0/4019142540 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f764c034650 0x7f764c036b10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x5568127cc870 tx=0x7f775c00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.479+0000 7f7776508980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5568127ef590 0x5568127ef970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.479+0000 7f7776508980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5568127be420 con 0x5568127ef590 2024-09-13T06:09:55.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.479+0000 7f7774018640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5568127ef590 0x5568127ef970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.482 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.479+0000 7f7774018640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5568127ef590 0x5568127ef970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44818/0 (socket says 172.21.15.194:44818) 2024-09-13T06:09:55.482 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.479+0000 7f7774018640 1 -- 172.21.15.194:0/1851223101 learned_addr learned my addr 172.21.15.194:0/1851223101 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:55.482 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.479+0000 7f7774018640 1 -- 172.21.15.194:0/1851223101 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568127eff40 con 0x5568127ef590 2024-09-13T06:09:55.482 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.479+0000 7f7774018640 1 --2- 172.21.15.194:0/1851223101 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5568127ef590 0x5568127ef970 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f77640e9040 tx=0x7f77640e4a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=752d959232b8f44a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.482 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.479+0000 7f76537fe640 1 -- 172.21.15.194:0/1851223101 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77640fe070 con 0x5568127ef590 2024-09-13T06:09:55.482 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.479+0000 7f76537fe640 1 -- 172.21.15.194:0/1851223101 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77640dbe20 con 0x5568127ef590 2024-09-13T06:09:55.482 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.479+0000 7f76537fe640 1 -- 172.21.15.194:0/1851223101 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77640da370 con 0x5568127ef590 2024-09-13T06:09:55.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.479+0000 7f7776508980 1 -- 172.21.15.194:0/1851223101 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5568127ef590 msgr2=0x5568127ef970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.479+0000 7f7776508980 1 --2- 172.21.15.194:0/1851223101 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5568127ef590 0x5568127ef970 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f77640e9040 tx=0x7f77640e4a90 comp rx=0 tx=0).stop 2024-09-13T06:09:55.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.479+0000 7f7776508980 1 -- 172.21.15.194:0/1851223101 shutdown_connections 2024-09-13T06:09:55.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.479+0000 7f7776508980 1 --2- 172.21.15.194:0/1851223101 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5568127ef590 0x5568127ef970 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.479+0000 7f7776508980 1 -- 172.21.15.194:0/1851223101 >> 172.21.15.194:0/1851223101 conn(0x5568127eb970 msgr2=0x5568127e9a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:55.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.479+0000 7f7776508980 1 -- 172.21.15.194:0/1851223101 shutdown_connections 2024-09-13T06:09:55.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.479+0000 7f7776508980 1 -- 172.21.15.194:0/1851223101 wait complete. 2024-09-13T06:09:55.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.479+0000 7f7776508980 1 Processor -- start 2024-09-13T06:09:55.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.479+0000 7f7776508980 1 -- start start 2024-09-13T06:09:55.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.479+0000 7f7776508980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5568127ef590 0x5568127f6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.479+0000 7f7776508980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5568127f03e0 con 0x5568127ef590 2024-09-13T06:09:55.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.479+0000 7f7774018640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5568127ef590 0x5568127f6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.479+0000 7f7774018640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5568127ef590 0x5568127f6750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44824/0 (socket says 172.21.15.194:44824) 2024-09-13T06:09:55.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.479+0000 7f7774018640 1 -- 172.21.15.194:0/3047660629 learned_addr learned my addr 172.21.15.194:0/3047660629 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:55.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.479+0000 7f7774018640 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568127f6c90 con 0x5568127ef590 2024-09-13T06:09:55.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.483+0000 7f7774018640 1 --2- 172.21.15.194:0/3047660629 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5568127ef590 0x5568127f6750 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f77640ed940 tx=0x7f77640f1ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.483+0000 7f7651ffb640 1 -- 172.21.15.194:0/3047660629 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7764113070 con 0x5568127ef590 2024-09-13T06:09:55.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.483+0000 7f7776508980 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5568127f6c90 con 0x5568127ef590 2024-09-13T06:09:55.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.483+0000 7f7651ffb640 1 -- 172.21.15.194:0/3047660629 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77640a9830 con 0x5568127ef590 2024-09-13T06:09:55.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.483+0000 7f7651ffb640 1 -- 172.21.15.194:0/3047660629 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77640edd10 con 0x5568127ef590 2024-09-13T06:09:55.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.483+0000 7f7776508980 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568127f7100 con 0x5568127ef590 2024-09-13T06:09:55.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.483+0000 7f7776508980 20 rados->read ofs=0 len=0 2024-09-13T06:09:55.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.483+0000 7f7651ffb640 1 -- 172.21.15.194:0/3047660629 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7764116070 con 0x5568127ef590 2024-09-13T06:09:55.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.483+0000 7f7651ffb640 1 --2- 172.21.15.194:0/3047660629 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7644034650 0x7f7644036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.483+0000 7f7651ffb640 1 -- 172.21.15.194:0/3047660629 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f776410a030 con 0x5568127ef590 2024-09-13T06:09:55.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.483+0000 7f7773817640 1 --2- 172.21.15.194:0/3047660629 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7644034650 0x7f7644036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.483+0000 7f7776508980 1 --2- 172.21.15.194:0/3047660629 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x556812801820 0x556812803ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.483+0000 7f7776508980 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556812804430 con 0x556812801820 2024-09-13T06:09:55.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.483+0000 7f7774819640 1 --2- 172.21.15.194:0/3047660629 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x556812801820 0x556812803ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.483+0000 7f7773817640 1 --2- 172.21.15.194:0/3047660629 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7644034650 0x7f7644036b10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f775c00c010 tx=0x7f775c010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.483+0000 7f7774819640 1 --2- 172.21.15.194:0/3047660629 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x556812801820 0x556812803ce0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.483+0000 7f7774819640 1 -- 172.21.15.194:0/3047660629 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f776c0083f0 con 0x556812801820 2024-09-13T06:09:55.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.483+0000 7f7776508980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:55.491 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.483+0000 7f7776508980 20 realm 2024-09-13T06:09:55.491 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.483+0000 7f7776508980 20 rados->read ofs=0 len=0 2024-09-13T06:09:55.491 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.483+0000 7f7776508980 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556812804840 con 0x556812801820 2024-09-13T06:09:55.491 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.483+0000 7f7774819640 1 -- 172.21.15.194:0/3047660629 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f776c0083f0 con 0x556812801820 2024-09-13T06:09:55.491 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.483+0000 7f7776508980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:55.491 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.483+0000 7f7776508980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:09:55.491 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.483+0000 7f7776508980 20 rados->read ofs=0 len=0 2024-09-13T06:09:55.491 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.483+0000 7f7776508980 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568128050e0 con 0x556812801820 2024-09-13T06:09:55.491 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.483+0000 7f7774819640 1 -- 172.21.15.194:0/3047660629 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f776c0083f0 con 0x556812801820 2024-09-13T06:09:55.491 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.483+0000 7f7776508980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:55.491 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.483+0000 7f7776508980 20 rados->read ofs=0 len=0 2024-09-13T06:09:55.491 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.483+0000 7f7776508980 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556812805480 con 0x556812801820 2024-09-13T06:09:55.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.483+0000 7f7774819640 1 -- 172.21.15.194:0/3047660629 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f776c0083f0 con 0x556812801820 2024-09-13T06:09:55.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.483+0000 7f7776508980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:55.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.483+0000 7f7776508980 20 rados->read ofs=0 len=0 2024-09-13T06:09:55.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.483+0000 7f7776508980 1 --2- 172.21.15.194:0/3047660629 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5568128061e0 0x5568128085d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.483+0000 7f7776508980 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556812808b10 con 0x5568128061e0 2024-09-13T06:09:55.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.483+0000 7f7774018640 1 --2- 172.21.15.194:0/3047660629 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5568128061e0 0x5568128085d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.487+0000 7f7774018640 1 --2- 172.21.15.194:0/3047660629 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5568128061e0 0x5568128085d0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.487+0000 7f7774018640 1 -- 172.21.15.194:0/3047660629 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7764115030 con 0x5568128061e0 2024-09-13T06:09:55.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.487+0000 7f7776508980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:09:55.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.487+0000 7f7776508980 20 searching for the correct realm 2024-09-13T06:09:55.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.487+0000 7f7776508980 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55681280a3b0 con 0x5568128061e0 2024-09-13T06:09:55.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.487+0000 7f7774018640 1 -- 172.21.15.194:0/3047660629 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7764115030 con 0x5568128061e0 2024-09-13T06:09:55.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.487+0000 7f7774018640 1 --2- 172.21.15.194:0/3047660629 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f7764118060 0x7f77640dda60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.487+0000 7f7774018640 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55681280a3b0 con 0x7f7764118060 2024-09-13T06:09:55.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.487+0000 7f7773817640 1 --2- 172.21.15.194:0/3047660629 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f7764118060 0x7f77640dda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.487+0000 7f7773817640 1 --2- 172.21.15.194:0/3047660629 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f7764118060 0x7f77640dda60 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.487+0000 7f7773817640 1 -- 172.21.15.194:0/3047660629 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f775c037040 con 0x7f7764118060 2024-09-13T06:09:55.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.487+0000 7f7773817640 1 --2- 172.21.15.194:0/3047660629 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f775c01fbe0 0x7f775c03a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.487+0000 7f7773817640 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55681280a3b0 con 0x7f775c01fbe0 2024-09-13T06:09:55.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.487+0000 7f7774819640 1 --2- 172.21.15.194:0/3047660629 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f775c01fbe0 0x7f775c03a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.487+0000 7f7774819640 1 --2- 172.21.15.194:0/3047660629 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f775c01fbe0 0x7f775c03a3c0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.487+0000 7f7774819640 1 -- 172.21.15.194:0/3047660629 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f776c0083f0 con 0x7f775c01fbe0 2024-09-13T06:09:55.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.487+0000 7f7774819640 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556812805480 con 0x556812801820 2024-09-13T06:09:55.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.487+0000 7f7774819640 1 -- 172.21.15.194:0/3047660629 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f776c0083f0 con 0x556812801820 2024-09-13T06:09:55.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.487+0000 7f7774819640 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556812805480 con 0x556812801820 2024-09-13T06:09:55.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.487+0000 7f7774819640 1 -- 172.21.15.194:0/3047660629 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f776c0083f0 con 0x556812801820 2024-09-13T06:09:55.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.487+0000 7f7774819640 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556812805480 con 0x7f775c01fbe0 2024-09-13T06:09:55.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.491+0000 7f7774819640 1 -- 172.21.15.194:0/3047660629 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f776c0083f0 con 0x7f775c01fbe0 2024-09-13T06:09:55.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.491+0000 7f7774819640 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556812805480 con 0x7f775c01fbe0 2024-09-13T06:09:55.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.491+0000 7f7774819640 1 -- 172.21.15.194:0/3047660629 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f776c0083f0 con 0x7f775c01fbe0 2024-09-13T06:09:55.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.491+0000 7f7774819640 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556812805480 con 0x7f7764118060 2024-09-13T06:09:55.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.491+0000 7f7773817640 1 -- 172.21.15.194:0/3047660629 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f775c037040 con 0x7f7764118060 2024-09-13T06:09:55.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.491+0000 7f7773817640 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556812805480 con 0x5568128061e0 2024-09-13T06:09:55.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.491+0000 7f7774018640 1 -- 172.21.15.194:0/3047660629 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7764115030 con 0x5568128061e0 2024-09-13T06:09:55.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.491+0000 7f7774018640 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556812805480 con 0x556812801820 2024-09-13T06:09:55.503 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.491+0000 7f7774819640 1 -- 172.21.15.194:0/3047660629 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f776c0083f0 con 0x556812801820 2024-09-13T06:09:55.503 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.491+0000 7f7774819640 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556812805480 con 0x7f775c01fbe0 2024-09-13T06:09:55.503 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.491+0000 7f7774819640 1 -- 172.21.15.194:0/3047660629 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f776c0083f0 con 0x7f775c01fbe0 2024-09-13T06:09:55.503 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.491+0000 7f7774819640 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556812805480 con 0x556812801820 2024-09-13T06:09:55.503 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.491+0000 7f7774819640 1 -- 172.21.15.194:0/3047660629 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f776c0083f0 con 0x556812801820 2024-09-13T06:09:55.503 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.491+0000 7f7774819640 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556812805480 con 0x7f7764118060 2024-09-13T06:09:55.503 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.491+0000 7f7773817640 1 -- 172.21.15.194:0/3047660629 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f775c037040 con 0x7f7764118060 2024-09-13T06:09:55.503 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.491+0000 7f7773817640 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556812805480 con 0x5568128061e0 2024-09-13T06:09:55.503 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.491+0000 7f7774018640 1 -- 172.21.15.194:0/3047660629 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7764115030 con 0x5568128061e0 2024-09-13T06:09:55.503 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.491+0000 7f7774018640 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556812805480 con 0x5568128061e0 2024-09-13T06:09:55.503 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.491+0000 7f7774018640 1 -- 172.21.15.194:0/3047660629 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7764115030 con 0x5568128061e0 2024-09-13T06:09:55.503 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.491+0000 7f7774018640 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556812805480 con 0x7f775c01fbe0 2024-09-13T06:09:55.503 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.491+0000 7f7774819640 1 -- 172.21.15.194:0/3047660629 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f776c0083f0 con 0x7f775c01fbe0 2024-09-13T06:09:55.504 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.491+0000 7f7774819640 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556812805480 con 0x5568128061e0 2024-09-13T06:09:55.504 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.491+0000 7f7774018640 1 -- 172.21.15.194:0/3047660629 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7764115030 con 0x5568128061e0 2024-09-13T06:09:55.504 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.491+0000 7f7774018640 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556812805480 con 0x5568128061e0 2024-09-13T06:09:55.504 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.491+0000 7f7774018640 1 -- 172.21.15.194:0/3047660629 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7764115030 con 0x5568128061e0 2024-09-13T06:09:55.504 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.491+0000 7f7774018640 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556812805480 con 0x556812801820 2024-09-13T06:09:55.504 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.495+0000 7f7774819640 1 -- 172.21.15.194:0/3047660629 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f776c0083f0 con 0x556812801820 2024-09-13T06:09:55.504 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.495+0000 7f7774819640 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556812805480 con 0x556812801820 2024-09-13T06:09:55.504 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.495+0000 7f7774819640 1 -- 172.21.15.194:0/3047660629 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f776c0083f0 con 0x556812801820 2024-09-13T06:09:55.504 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.495+0000 7f7774819640 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556812805480 con 0x7f775c01fbe0 2024-09-13T06:09:55.504 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.495+0000 7f7774819640 1 -- 172.21.15.194:0/3047660629 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f776c0083f0 con 0x7f775c01fbe0 2024-09-13T06:09:55.504 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.495+0000 7f7774819640 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556812805480 con 0x5568128061e0 2024-09-13T06:09:55.504 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.495+0000 7f7774018640 1 -- 172.21.15.194:0/3047660629 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7764115030 con 0x5568128061e0 2024-09-13T06:09:55.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.495+0000 7f7774018640 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556812805480 con 0x7f7764118060 2024-09-13T06:09:55.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.495+0000 7f7773817640 1 -- 172.21.15.194:0/3047660629 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f775c037040 con 0x7f7764118060 2024-09-13T06:09:55.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.495+0000 7f7773817640 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556812805480 con 0x556812801820 2024-09-13T06:09:55.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.495+0000 7f7774819640 1 -- 172.21.15.194:0/3047660629 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f776c0083f0 con 0x556812801820 2024-09-13T06:09:55.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.495+0000 7f7774819640 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556812805480 con 0x7f775c01fbe0 2024-09-13T06:09:55.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.495+0000 7f7774819640 1 -- 172.21.15.194:0/3047660629 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f776c0083f0 con 0x7f775c01fbe0 2024-09-13T06:09:55.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.495+0000 7f7774819640 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556812805480 con 0x5568128061e0 2024-09-13T06:09:55.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.495+0000 7f7774018640 1 -- 172.21.15.194:0/3047660629 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7764115030 con 0x5568128061e0 2024-09-13T06:09:55.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.495+0000 7f7774018640 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556812805480 con 0x7f775c01fbe0 2024-09-13T06:09:55.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.495+0000 7f7774819640 1 -- 172.21.15.194:0/3047660629 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f776c0083f0 con 0x7f775c01fbe0 2024-09-13T06:09:55.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.495+0000 7f7774819640 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556812805480 con 0x7f7764118060 2024-09-13T06:09:55.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.495+0000 7f7773817640 1 -- 172.21.15.194:0/3047660629 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f775c037040 con 0x7f7764118060 2024-09-13T06:09:55.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.495+0000 7f7773817640 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556812805480 con 0x5568128061e0 2024-09-13T06:09:55.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.495+0000 7f7774018640 1 -- 172.21.15.194:0/3047660629 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7764115030 con 0x5568128061e0 2024-09-13T06:09:55.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.495+0000 7f7774018640 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556812805480 con 0x7f775c01fbe0 2024-09-13T06:09:55.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.499+0000 7f7774819640 1 -- 172.21.15.194:0/3047660629 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f776c0083f0 con 0x7f775c01fbe0 2024-09-13T06:09:55.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.499+0000 7f7774819640 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556812805480 con 0x556812801820 2024-09-13T06:09:55.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.499+0000 7f7774819640 1 -- 172.21.15.194:0/3047660629 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f776c0083f0 con 0x556812801820 2024-09-13T06:09:55.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.499+0000 7f7774819640 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556812805480 con 0x7f7764118060 2024-09-13T06:09:55.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.499+0000 7f7773817640 1 -- 172.21.15.194:0/3047660629 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f775c037040 con 0x7f7764118060 2024-09-13T06:09:55.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.499+0000 7f7776508980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:09:55.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.499+0000 7f7776508980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:09:55.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.499+0000 7f7776508980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:09:55.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.499+0000 7f7776508980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:09:55.507 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.499+0000 7f7776508980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:09:55.507 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.499+0000 7f7776508980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:09:55.507 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.499+0000 7f7776508980 20 rados->read ofs=0 len=0 2024-09-13T06:09:55.507 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.499+0000 7f7776508980 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556812809360 con 0x556812801820 2024-09-13T06:09:55.507 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.499+0000 7f7774819640 1 -- 172.21.15.194:0/3047660629 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f776c0083f0 con 0x556812801820 2024-09-13T06:09:55.507 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.499+0000 7f7776508980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:55.507 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.499+0000 7f7776508980 20 rados->read ofs=0 len=0 2024-09-13T06:09:55.507 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.499+0000 7f7776508980 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556812809750 con 0x556812801820 2024-09-13T06:09:55.507 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.499+0000 7f7774819640 1 -- 172.21.15.194:0/3047660629 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f776c0083f0 con 0x556812801820 2024-09-13T06:09:55.507 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.499+0000 7f7776508980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:55.507 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.499+0000 7f7776508980 20 rados->read ofs=0 len=0 2024-09-13T06:09:55.507 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.499+0000 7f7776508980 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556812809750 con 0x7f7764118060 2024-09-13T06:09:55.508 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.499+0000 7f7773817640 1 -- 172.21.15.194:0/3047660629 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f775c037040 con 0x7f7764118060 2024-09-13T06:09:55.508 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.499+0000 7f7776508980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:09:55.508 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.499+0000 7f7776508980 20 zone default found 2024-09-13T06:09:55.508 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.499+0000 7f7776508980 4 Realm: () 2024-09-13T06:09:55.508 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.499+0000 7f7776508980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:09:55.508 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.499+0000 7f7776508980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:09:55.508 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.499+0000 7f7776508980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:09:55.508 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.499+0000 7f7776508980 20 zonegroup default 2024-09-13T06:09:55.508 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.499+0000 7f7776508980 20 rados->read ofs=0 len=0 2024-09-13T06:09:55.508 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.499+0000 7f7776508980 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55681280a880 con 0x7f775c01fbe0 2024-09-13T06:09:55.508 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.499+0000 7f7774819640 1 -- 172.21.15.194:0/3047660629 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f776c0083f0 con 0x7f775c01fbe0 2024-09-13T06:09:55.508 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.499+0000 7f7776508980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:55.508 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.499+0000 7f7776508980 20 rados->read ofs=0 len=0 2024-09-13T06:09:55.509 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.499+0000 7f7776508980 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55681280c260 con 0x5568128061e0 2024-09-13T06:09:55.509 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.499+0000 7f7774018640 1 -- 172.21.15.194:0/3047660629 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7764115030 con 0x5568128061e0 2024-09-13T06:09:55.509 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.499+0000 7f7776508980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:55.509 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.499+0000 7f7776508980 20 rados->read ofs=0 len=0 2024-09-13T06:09:55.509 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.499+0000 7f7776508980 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55681280c600 con 0x5568128061e0 2024-09-13T06:09:55.509 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.499+0000 7f7774018640 1 -- 172.21.15.194:0/3047660629 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7764115030 con 0x5568128061e0 2024-09-13T06:09:55.509 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.499+0000 7f7776508980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:55.509 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.499+0000 7f7776508980 20 started sync module instance, tier type = 2024-09-13T06:09:55.509 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.499+0000 7f7776508980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:09:55.509 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.499+0000 7f7776508980 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55681280b700 con 0x7f7764118060 2024-09-13T06:09:55.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.503+0000 7f7773817640 1 -- 172.21.15.194:0/3047660629 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(44 notify.0 [create] v33'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f775c037040 con 0x7f7764118060 2024-09-13T06:09:55.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.503+0000 7f7776508980 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93905475383888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55681280c9f0 con 0x7f7764118060 2024-09-13T06:09:55.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.503+0000 7f7776508980 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55681280d240 con 0x556812801820 2024-09-13T06:09:55.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.503+0000 7f7774819640 1 -- 172.21.15.194:0/3047660629 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v33'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f776c0083f0 con 0x556812801820 2024-09-13T06:09:55.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.503+0000 7f7776508980 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93905475390864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55681280d860 con 0x556812801820 2024-09-13T06:09:55.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.503+0000 7f7776508980 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55681280e380 con 0x5568128061e0 2024-09-13T06:09:55.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.503+0000 7f7773817640 1 -- 172.21.15.194:0/3047660629 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93905475383888] v33'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f775c037040 con 0x7f7764118060 2024-09-13T06:09:55.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.507+0000 7f7774018640 1 -- 172.21.15.194:0/3047660629 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v33'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7764115030 con 0x5568128061e0 2024-09-13T06:09:55.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.507+0000 7f7776508980 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93905475395152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55681280e340 con 0x5568128061e0 2024-09-13T06:09:55.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.507+0000 7f7776508980 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55681280ed90 con 0x7f7764118060 2024-09-13T06:09:55.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.507+0000 7f7774819640 1 -- 172.21.15.194:0/3047660629 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93905475390864] v33'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f776c0083f0 con 0x556812801820 2024-09-13T06:09:55.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.507+0000 7f7773817640 1 -- 172.21.15.194:0/3047660629 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(50 notify.3 [create] v33'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f775c037040 con 0x7f7764118060 2024-09-13T06:09:55.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.507+0000 7f7776508980 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93905475397856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55681280f180 con 0x7f7764118060 2024-09-13T06:09:55.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.507+0000 7f7776508980 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55681280fb40 con 0x556812801820 2024-09-13T06:09:55.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.507+0000 7f7774018640 1 -- 172.21.15.194:0/3047660629 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93905475395152] v33'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7764115030 con 0x5568128061e0 2024-09-13T06:09:55.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.507+0000 7f7774819640 1 -- 172.21.15.194:0/3047660629 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v33'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f776c0083f0 con 0x556812801820 2024-09-13T06:09:55.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.507+0000 7f7776508980 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93905475401360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55681280ff60 con 0x556812801820 2024-09-13T06:09:55.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.507+0000 7f7776508980 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556812810830 con 0x7f775c01fbe0 2024-09-13T06:09:55.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.511+0000 7f7773817640 1 -- 172.21.15.194:0/3047660629 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93905475397856] v33'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f775c037040 con 0x7f7764118060 2024-09-13T06:09:55.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.511+0000 7f7774819640 1 -- 172.21.15.194:0/3047660629 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93905475401360] v33'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f776c0083f0 con 0x556812801820 2024-09-13T06:09:55.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.511+0000 7f7774819640 1 -- 172.21.15.194:0/3047660629 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(54 notify.5 [create] v33'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f776c0083f0 con 0x7f775c01fbe0 2024-09-13T06:09:55.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.511+0000 7f7776508980 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93905475392176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55681280ff60 con 0x7f775c01fbe0 2024-09-13T06:09:55.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.511+0000 7f7776508980 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568128110d0 con 0x7f775c01fbe0 2024-09-13T06:09:55.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.511+0000 7f7774819640 1 -- 172.21.15.194:0/3047660629 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93905475392176] v33'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f776c0083f0 con 0x7f775c01fbe0 2024-09-13T06:09:55.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.511+0000 7f7774819640 1 -- 172.21.15.194:0/3047660629 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(56 notify.6 [create] v33'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f776c0083f0 con 0x7f775c01fbe0 2024-09-13T06:09:55.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.511+0000 7f7776508980 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93905475402416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55681280fed0 con 0x7f775c01fbe0 2024-09-13T06:09:55.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.511+0000 7f7776508980 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556812811580 con 0x7f775c01fbe0 2024-09-13T06:09:55.516 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.515+0000 7f7774819640 1 -- 172.21.15.194:0/3047660629 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(58 notify.7 [create] v33'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f776c0083f0 con 0x7f775c01fbe0 2024-09-13T06:09:55.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.515+0000 7f7776508980 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93905475408080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568128119e0 con 0x7f775c01fbe0 2024-09-13T06:09:55.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.515+0000 7f7776508980 20 add_watcher() i=0 2024-09-13T06:09:55.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.515+0000 7f7776508980 20 add_watcher() i=1 2024-09-13T06:09:55.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.515+0000 7f7776508980 20 add_watcher() i=2 2024-09-13T06:09:55.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.515+0000 7f7776508980 20 add_watcher() i=3 2024-09-13T06:09:55.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.515+0000 7f7776508980 20 add_watcher() i=4 2024-09-13T06:09:55.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.515+0000 7f7776508980 20 add_watcher() i=5 2024-09-13T06:09:55.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.515+0000 7f7774819640 1 -- 172.21.15.194:0/3047660629 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93905475402416] v33'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f776c0083f0 con 0x7f775c01fbe0 2024-09-13T06:09:55.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.515+0000 7f7776508980 20 add_watcher() i=6 2024-09-13T06:09:55.518 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.519+0000 7f7774819640 1 -- 172.21.15.194:0/3047660629 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93905475408080] v33'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f776c0083f0 con 0x7f775c01fbe0 2024-09-13T06:09:55.519 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.519+0000 7f7776508980 20 add_watcher() i=7 2024-09-13T06:09:55.519 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.519+0000 7f7776508980 2 all 8 watchers are set, enabling cache 2024-09-13T06:09:55.519 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.519+0000 7f7776508980 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556812810c90 con 0x556812801820 2024-09-13T06:09:55.519 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.519+0000 7f7774819640 1 -- 172.21.15.194:0/3047660629 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f776c0083f0 con 0x556812801820 2024-09-13T06:09:55.519 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.519+0000 7f7776508980 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93905475409136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556812812340 con 0x556812801820 2024-09-13T06:09:55.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.519+0000 7f7774819640 1 -- 172.21.15.194:0/3047660629 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93905475409136] v33'76 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f776c0083f0 con 0x556812801820 2024-09-13T06:09:55.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.519+0000 7f762a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:55.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.519+0000 7f7776508980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:09:55.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.519+0000 7f7776508980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:09:55.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.519+0000 7f7776508980 5 note: GC not initialized 2024-09-13T06:09:55.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.519+0000 7f76297e2640 20 reqs_thread_entry: start 2024-09-13T06:09:55.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.519+0000 7f7776508980 20 init_complete bucket index max shards: 11 2024-09-13T06:09:55.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.519+0000 7f7776508980 20 Filter name: none 2024-09-13T06:09:55.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.519+0000 7f759affd640 20 reqs_thread_entry: start 2024-09-13T06:09:55.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.519+0000 7f7776508980 20 rados->read ofs=0 len=0 2024-09-13T06:09:55.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.519+0000 7f7776508980 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556812837c10 con 0x556812801820 2024-09-13T06:09:55.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.519+0000 7f7774819640 1 -- 172.21.15.194:0/3047660629 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f776c0083f0 con 0x556812801820 2024-09-13T06:09:55.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.519+0000 7f7776508980 20 rados_obj.operate() r=0 bl.length=556 2024-09-13T06:09:55.522 INFO:teuthology.orchestra.run.smithi194.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T06:09:53.191222Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:09:53.191207Z","tags":[],"group_ids":[]} 2024-09-13T06:09:55.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.519+0000 7f762a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:55.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.519+0000 7f7776508980 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93905475409136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568128367c0 con 0x556812801820 2024-09-13T06:09:55.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.523+0000 7f7774819640 1 -- 172.21.15.194:0/3047660629 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93905475409136] v33'77 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f776c0083f0 con 0x556812801820 2024-09-13T06:09:55.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.523+0000 7f7776508980 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93905475383888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568128114f0 con 0x7f7764118060 2024-09-13T06:09:55.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.523+0000 7f7773817640 1 -- 172.21.15.194:0/3047660629 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93905475383888] v33'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f775c037040 con 0x7f7764118060 2024-09-13T06:09:55.524 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.523+0000 7f7776508980 20 remove_watcher() i=0 2024-09-13T06:09:55.524 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.523+0000 7f7776508980 2 removed watcher, disabling cache 2024-09-13T06:09:55.524 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.523+0000 7f7776508980 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93905475390864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568128114f0 con 0x556812801820 2024-09-13T06:09:55.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.523+0000 7f7774819640 1 -- 172.21.15.194:0/3047660629 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93905475390864] v33'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f776c0083f0 con 0x556812801820 2024-09-13T06:09:55.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.523+0000 7f7776508980 20 remove_watcher() i=1 2024-09-13T06:09:55.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.523+0000 7f7776508980 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93905475395152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568128114f0 con 0x5568128061e0 2024-09-13T06:09:55.527 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.527+0000 7f7774018640 1 -- 172.21.15.194:0/3047660629 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93905475395152] v33'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7764115030 con 0x5568128061e0 2024-09-13T06:09:55.527 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.527+0000 7f7776508980 20 remove_watcher() i=2 2024-09-13T06:09:55.528 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.527+0000 7f7776508980 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93905475397856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55681280de50 con 0x7f7764118060 2024-09-13T06:09:55.528 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.527+0000 7f7773817640 1 -- 172.21.15.194:0/3047660629 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93905475397856] v33'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f775c037040 con 0x7f7764118060 2024-09-13T06:09:55.528 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.527+0000 7f7776508980 20 remove_watcher() i=3 2024-09-13T06:09:55.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.527+0000 7f7776508980 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93905475401360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568128114f0 con 0x556812801820 2024-09-13T06:09:55.530 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.531+0000 7f7774819640 1 -- 172.21.15.194:0/3047660629 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93905475401360] v33'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f776c0083f0 con 0x556812801820 2024-09-13T06:09:55.530 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.531+0000 7f7776508980 20 remove_watcher() i=4 2024-09-13T06:09:55.530 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.531+0000 7f7776508980 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93905475392176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55681280e8e0 con 0x7f775c01fbe0 2024-09-13T06:09:55.532 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.531+0000 7f7774819640 1 -- 172.21.15.194:0/3047660629 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93905475392176] v33'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f776c0083f0 con 0x7f775c01fbe0 2024-09-13T06:09:55.532 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.531+0000 7f7776508980 20 remove_watcher() i=5 2024-09-13T06:09:55.532 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.531+0000 7f7776508980 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93905475402416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55681280de50 con 0x7f775c01fbe0 2024-09-13T06:09:55.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.531+0000 7f7774819640 1 -- 172.21.15.194:0/3047660629 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93905475402416] v33'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f776c0083f0 con 0x7f775c01fbe0 2024-09-13T06:09:55.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.531+0000 7f7776508980 20 remove_watcher() i=6 2024-09-13T06:09:55.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.531+0000 7f7776508980 1 -- 172.21.15.194:0/3047660629 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93905475408080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568128114f0 con 0x7f775c01fbe0 2024-09-13T06:09:55.538 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.535+0000 7f7774819640 1 -- 172.21.15.194:0/3047660629 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93905475408080] v33'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f776c0083f0 con 0x7f775c01fbe0 2024-09-13T06:09:55.538 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.535+0000 7f7776508980 20 remove_watcher() i=7 2024-09-13T06:09:55.538 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.535+0000 7f7776508980 1 -- 172.21.15.194:0/3047660629 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f775c01fbe0 msgr2=0x7f775c03a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.538 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.535+0000 7f7776508980 1 --2- 172.21.15.194:0/3047660629 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f775c01fbe0 0x7f775c03a3c0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.538 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.535+0000 7f7776508980 1 -- 172.21.15.194:0/3047660629 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x556812801820 msgr2=0x556812803ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.538 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.535+0000 7f7776508980 1 --2- 172.21.15.194:0/3047660629 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x556812801820 0x556812803ce0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.538 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.535+0000 7f7776508980 1 -- 172.21.15.194:0/3047660629 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f7764118060 msgr2=0x7f77640dda60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.535+0000 7f7776508980 1 --2- 172.21.15.194:0/3047660629 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f7764118060 0x7f77640dda60 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.535+0000 7f7776508980 1 -- 172.21.15.194:0/3047660629 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5568128061e0 msgr2=0x5568128085d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.535+0000 7f7776508980 1 --2- 172.21.15.194:0/3047660629 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5568128061e0 0x5568128085d0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.535+0000 7f7776508980 1 -- 172.21.15.194:0/3047660629 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7644034650 msgr2=0x7f7644036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.535+0000 7f7776508980 1 --2- 172.21.15.194:0/3047660629 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7644034650 0x7f7644036b10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f775c00c010 tx=0x7f775c010000 comp rx=0 tx=0).stop 2024-09-13T06:09:55.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.535+0000 7f7776508980 1 -- 172.21.15.194:0/3047660629 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5568127ef590 msgr2=0x5568127f6750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.535+0000 7f7776508980 1 --2- 172.21.15.194:0/3047660629 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5568127ef590 0x5568127f6750 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f77640ed940 tx=0x7f77640f1ec0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.535+0000 7f7774819640 1 -- 172.21.15.194:0/3047660629 reap_dead start 2024-09-13T06:09:55.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.535+0000 7f7774819640 1 -- 172.21.15.194:0/3047660629 reap_dead start 2024-09-13T06:09:55.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.535+0000 7f7776508980 1 -- 172.21.15.194:0/3047660629 shutdown_connections 2024-09-13T06:09:55.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.535+0000 7f7776508980 1 -- 172.21.15.194:0/3047660629 >> 172.21.15.194:0/3047660629 conn(0x5568127eb970 msgr2=0x5568127e9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:55.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.535+0000 7f7776508980 1 -- 172.21.15.194:0/3047660629 shutdown_connections 2024-09-13T06:09:55.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.535+0000 7f7776508980 1 -- 172.21.15.194:0/3047660629 wait complete. 2024-09-13T06:09:55.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.535+0000 7f7776508980 1 -- 172.21.15.194:0/4019142540 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f764c034650 msgr2=0x7f764c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.535+0000 7f7776508980 1 --2- 172.21.15.194:0/4019142540 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f764c034650 0x7f764c036b10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x5568127cc870 tx=0x7f775c00f000 comp rx=0 tx=0).stop 2024-09-13T06:09:55.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.535+0000 7f7776508980 1 -- 172.21.15.194:0/4019142540 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5568127e2c30 msgr2=0x5568127e3050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.535+0000 7f7776508980 1 --2- 172.21.15.194:0/4019142540 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5568127e2c30 0x5568127e3050 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f77640e2f80 tx=0x7f77640cfe00 comp rx=0 tx=0).stop 2024-09-13T06:09:55.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.535+0000 7f7776508980 1 -- 172.21.15.194:0/4019142540 shutdown_connections 2024-09-13T06:09:55.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.535+0000 7f7776508980 1 --2- 172.21.15.194:0/4019142540 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f764c034650 0x7f764c036b10 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.535+0000 7f7776508980 1 --2- 172.21.15.194:0/4019142540 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5568127e2c30 0x5568127e3050 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.535+0000 7f7776508980 1 -- 172.21.15.194:0/4019142540 >> 172.21.15.194:0/4019142540 conn(0x5568127d7d80 msgr2=0x5568127da800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:55.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.535+0000 7f7776508980 1 -- 172.21.15.194:0/4019142540 shutdown_connections 2024-09-13T06:09:55.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.535+0000 7f7776508980 1 -- 172.21.15.194:0/4019142540 wait complete. 2024-09-13T06:09:55.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.535+0000 7f7776508980 1 -- 172.21.15.194:0/88346316 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5568126477c0 msgr2=0x5568127cbd70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.535+0000 7f7776508980 1 --2- 172.21.15.194:0/88346316 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5568126477c0 0x5568127cbd70 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.535+0000 7f7776508980 1 -- 172.21.15.194:0/88346316 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5568127d2630 msgr2=0x5568127d4a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.541 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.535+0000 7f7776508980 1 --2- 172.21.15.194:0/88346316 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5568127d2630 0x5568127d4a20 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.541 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.535+0000 7f7776508980 1 -- 172.21.15.194:0/88346316 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5568127ce6f0 msgr2=0x5568127d0ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.541 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.535+0000 7f7776508980 1 --2- 172.21.15.194:0/88346316 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5568127ce6f0 0x5568127d0ae0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.541 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.535+0000 7f7776508980 1 -- 172.21.15.194:0/88346316 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f765c0346a0 msgr2=0x7f765c036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.541 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.535+0000 7f7776508980 1 --2- 172.21.15.194:0/88346316 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f765c0346a0 0x7f765c036b60 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f775c000f70 tx=0x7f775c001380 comp rx=0 tx=0).stop 2024-09-13T06:09:55.541 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.535+0000 7f7776508980 1 -- 172.21.15.194:0/88346316 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5568126473b0 msgr2=0x5568127c4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.541 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.535+0000 7f7776508980 1 --2- 172.21.15.194:0/88346316 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5568126473b0 0x5568127c4de0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7764017ca0 tx=0x7f7764017e30 comp rx=0 tx=0).stop 2024-09-13T06:09:55.541 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.535+0000 7f7774819640 1 -- 172.21.15.194:0/88346316 reap_dead start 2024-09-13T06:09:55.541 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.535+0000 7f7776508980 1 -- 172.21.15.194:0/88346316 shutdown_connections 2024-09-13T06:09:55.541 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.535+0000 7f7776508980 1 -- 172.21.15.194:0/88346316 >> 172.21.15.194:0/88346316 conn(0x5568126cc1b0 msgr2=0x5568127b8340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:55.541 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.535+0000 7f7776508980 1 -- 172.21.15.194:0/88346316 shutdown_connections 2024-09-13T06:09:55.541 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.535+0000 7f7776508980 1 -- 172.21.15.194:0/88346316 wait complete. 2024-09-13T06:09:55.546 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T06:09:53.191222Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:09:53.191207Z', 'tags': [], 'group_ids': []} 2024-09-13T06:09:55.547 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-09-13T06:09:55.547 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-09-13T06:09:55.547 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo2 --secret ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy --key-type swift 2024-09-13T06:09:55.628 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:09:55.628 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:09:55.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.627+0000 7ff7a9a12980 1 Processor -- start 2024-09-13T06:09:55.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.627+0000 7ff7a9a12980 1 -- start start 2024-09-13T06:09:55.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.627+0000 7ff7a9a12980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x5586011e6a60 0x5586011e6e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.627+0000 7ff7a9a12980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558601070ae0 con 0x5586011e7380 2024-09-13T06:09:55.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.627+0000 7ff7a9a12980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x558601094e30 con 0x5586011e6a60 2024-09-13T06:09:55.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.627+0000 7ff7a7522640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x5586011e6a60 0x5586011e6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.627+0000 7ff7a7522640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x5586011e6a60 0x5586011e6e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44840/0 (socket says 172.21.15.194:44840) 2024-09-13T06:09:55.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.627+0000 7ff7a7522640 1 -- 172.21.15.194:0/293033711 learned_addr learned my addr 172.21.15.194:0/293033711 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:55.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.627+0000 7ff7a6d21640 1 --1- 172.21.15.194:0/293033711 >> v1:172.21.15.120:6789/0 conn(0x5586011e7380 0x5586011edb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:51036/0 (socket says 172.21.15.194:51036) 2024-09-13T06:09:55.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.627+0000 7ff7a7522640 1 -- 172.21.15.194:0/293033711 >> v1:172.21.15.120:6789/0 conn(0x5586011e7380 legacy=0x5586011edb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.627+0000 7ff7a7522640 1 -- 172.21.15.194:0/293033711 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586011f0260 con 0x5586011e6a60 2024-09-13T06:09:55.633 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.631+0000 7ff7a7522640 1 --2- 172.21.15.194:0/293033711 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5586011e6a60 0x5586011e6e40 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff7a000a4e0 tx=0x7ff7a001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b56d0083b8c87972 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.634 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.631+0000 7ff7a6520640 1 -- 172.21.15.194:0/293033711 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7a00aa540 con 0x5586011e6a60 2024-09-13T06:09:55.634 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.631+0000 7ff7a6520640 1 -- 172.21.15.194:0/293033711 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7a00aa6e0 con 0x5586011e6a60 2024-09-13T06:09:55.634 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.631+0000 7ff7a6520640 1 -- 172.21.15.194:0/293033711 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7a00aaa40 con 0x5586011e6a60 2024-09-13T06:09:55.634 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.631+0000 7ff7a9a12980 1 -- 172.21.15.194:0/293033711 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5586011e6a60 msgr2=0x5586011e6e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.634 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.631+0000 7ff7a9a12980 1 --2- 172.21.15.194:0/293033711 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5586011e6a60 0x5586011e6e40 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff7a000a4e0 tx=0x7ff7a001b090 comp rx=0 tx=0).stop 2024-09-13T06:09:55.634 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.631+0000 7ff7a9a12980 1 -- 172.21.15.194:0/293033711 shutdown_connections 2024-09-13T06:09:55.634 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.631+0000 7ff7a9a12980 1 --2- 172.21.15.194:0/293033711 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5586011e6a60 0x5586011e6e40 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.631+0000 7ff7a9a12980 1 -- 172.21.15.194:0/293033711 >> 172.21.15.194:0/293033711 conn(0x5586011e2740 msgr2=0x5586011e4b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:55.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.631+0000 7ff7a9a12980 1 -- 172.21.15.194:0/293033711 shutdown_connections 2024-09-13T06:09:55.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.631+0000 7ff7a9a12980 1 -- 172.21.15.194:0/293033711 wait complete. 2024-09-13T06:09:55.647 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.647+0000 7ff7a9a12980 1 Processor -- start 2024-09-13T06:09:55.647 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.647+0000 7ff7a9a12980 1 -- start start 2024-09-13T06:09:55.647 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.647+0000 7ff7a9a12980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5586011e6a60 0x5586011e9280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.647 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.647+0000 7ff7a9a12980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x558601096200 con 0x5586011e6a60 2024-09-13T06:09:55.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.647+0000 7ff7a7522640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5586011e6a60 0x5586011e9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.647+0000 7ff7a7522640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5586011e6a60 0x5586011e9280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44846/0 (socket says 172.21.15.194:44846) 2024-09-13T06:09:55.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.647+0000 7ff7a7522640 1 -- 172.21.15.194:0/2224120351 learned_addr learned my addr 172.21.15.194:0/2224120351 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:55.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.647+0000 7ff7a7522640 1 -- 172.21.15.194:0/2224120351 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586011e9850 con 0x5586011e6a60 2024-09-13T06:09:55.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.647+0000 7ff7a7522640 1 --2- 172.21.15.194:0/2224120351 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5586011e6a60 0x5586011e9280 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff7a0017ca0 tx=0x7ff7a00033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da85c98c20d298c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.647+0000 7ff69560a640 1 -- 172.21.15.194:0/2224120351 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7a00b9030 con 0x5586011e6a60 2024-09-13T06:09:55.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.647+0000 7ff69560a640 1 -- 172.21.15.194:0/2224120351 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7a00aaac0 con 0x5586011e6a60 2024-09-13T06:09:55.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.647+0000 7ff69560a640 1 -- 172.21.15.194:0/2224120351 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7a00aada0 con 0x5586011e6a60 2024-09-13T06:09:55.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.647+0000 7ff7a9a12980 1 -- 172.21.15.194:0/2224120351 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5586011e6a60 msgr2=0x5586011e9280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.647+0000 7ff7a9a12980 1 --2- 172.21.15.194:0/2224120351 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5586011e6a60 0x5586011e9280 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff7a0017ca0 tx=0x7ff7a00033b0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.647+0000 7ff7a9a12980 1 -- 172.21.15.194:0/2224120351 shutdown_connections 2024-09-13T06:09:55.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.647+0000 7ff7a9a12980 1 --2- 172.21.15.194:0/2224120351 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5586011e6a60 0x5586011e9280 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.647+0000 7ff7a9a12980 1 -- 172.21.15.194:0/2224120351 >> 172.21.15.194:0/2224120351 conn(0x5586011e2740 msgr2=0x5586012cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:55.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.647+0000 7ff7a9a12980 1 -- 172.21.15.194:0/2224120351 shutdown_connections 2024-09-13T06:09:55.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.647+0000 7ff7a9a12980 1 -- 172.21.15.194:0/2224120351 wait complete. 2024-09-13T06:09:55.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.647+0000 7ff7a9a12980 1 Processor -- start 2024-09-13T06:09:55.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.647+0000 7ff7a9a12980 1 -- start start 2024-09-13T06:09:55.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.647+0000 7ff7a9a12980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5586011e6a60 0x5586012dd020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.647+0000 7ff7a9a12980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5586011efd60 con 0x5586011e6a60 2024-09-13T06:09:55.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.647+0000 7ff7a7522640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5586011e6a60 0x5586012dd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.647+0000 7ff7a7522640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5586011e6a60 0x5586012dd020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44856/0 (socket says 172.21.15.194:44856) 2024-09-13T06:09:55.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.647+0000 7ff7a7522640 1 -- 172.21.15.194:0/3998254141 learned_addr learned my addr 172.21.15.194:0/3998254141 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:55.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.651+0000 7ff7a7522640 1 -- 172.21.15.194:0/3998254141 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586012dd560 con 0x5586011e6a60 2024-09-13T06:09:55.654 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.651+0000 7ff7a7522640 1 --2- 172.21.15.194:0/3998254141 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5586011e6a60 0x5586012dd020 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff7a0005cc0 tx=0x7ff7a0017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.654 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.651+0000 7ff693e07640 1 -- 172.21.15.194:0/3998254141 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7a00b9030 con 0x5586011e6a60 2024-09-13T06:09:55.654 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.651+0000 7ff693e07640 1 -- 172.21.15.194:0/3998254141 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7a00c3070 con 0x5586011e6a60 2024-09-13T06:09:55.654 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.651+0000 7ff693e07640 1 -- 172.21.15.194:0/3998254141 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7a00bf620 con 0x5586011e6a60 2024-09-13T06:09:55.654 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.651+0000 7ff7a9a12980 1 -- 172.21.15.194:0/3998254141 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5586012dd7f0 con 0x5586011e6a60 2024-09-13T06:09:55.654 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.651+0000 7ff7a9a12980 1 -- 172.21.15.194:0/3998254141 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586012e04d0 con 0x5586011e6a60 2024-09-13T06:09:55.654 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.651+0000 7ff693e07640 1 -- 172.21.15.194:0/3998254141 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff7a00c5030 con 0x5586011e6a60 2024-09-13T06:09:55.654 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.651+0000 7ff693e07640 1 --2- 172.21.15.194:0/3998254141 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff68c034650 0x7ff68c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.654 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.651+0000 7ff693e07640 1 -- 172.21.15.194:0/3998254141 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7ff7a00ba070 con 0x5586011e6a60 2024-09-13T06:09:55.654 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.651+0000 7ff7a6d21640 1 --2- 172.21.15.194:0/3998254141 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff68c034650 0x7ff68c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.654 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.651+0000 7ff7a9a12980 1 --2- 172.21.15.194:0/3998254141 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5586011e7380 0x5586012e3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.655 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.651+0000 7ff7a9a12980 1 -- 172.21.15.194:0/3998254141 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5586012e45f0 con 0x5586011e7380 2024-09-13T06:09:55.655 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.651+0000 7ff7a7d23640 1 --2- 172.21.15.194:0/3998254141 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5586011e7380 0x5586012e3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.655 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.651+0000 7ff7a6d21640 1 --2- 172.21.15.194:0/3998254141 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff68c034650 0x7ff68c036b10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff790000f70 tx=0x7ff790001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.655 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.651+0000 7ff7a7d23640 1 --2- 172.21.15.194:0/3998254141 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5586011e7380 0x5586012e3fb0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.655 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.651+0000 7ff7a7d23640 1 -- 172.21.15.194:0/3998254141 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff7980083f0 con 0x5586011e7380 2024-09-13T06:09:55.655 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.651+0000 7ff7a9a12980 1 -- 172.21.15.194:0/3998254141 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5586012e16f0 con 0x5586011e7380 2024-09-13T06:09:55.655 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.651+0000 7ff7a7d23640 1 -- 172.21.15.194:0/3998254141 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff7980083f0 con 0x5586011e7380 2024-09-13T06:09:55.655 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.651+0000 7ff7a9a12980 1 --2- 172.21.15.194:0/3998254141 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5586012e6920 0x5586012e8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.655 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.651+0000 7ff7a9a12980 1 -- 172.21.15.194:0/3998254141 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5586012e93e0 con 0x5586012e6920 2024-09-13T06:09:55.655 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.651+0000 7ff7a7522640 1 --2- 172.21.15.194:0/3998254141 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5586012e6920 0x5586012e8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.651+0000 7ff7a7522640 1 --2- 172.21.15.194:0/3998254141 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5586012e6920 0x5586012e8d10 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.658 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.655+0000 7ff7a7522640 1 -- 172.21.15.194:0/3998254141 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff7a00e5050 con 0x5586012e6920 2024-09-13T06:09:55.658 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.655+0000 7ff7a9a12980 1 -- 172.21.15.194:0/3998254141 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5586012e57c0 con 0x5586011e7380 2024-09-13T06:09:55.658 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.655+0000 7ff7a7d23640 1 -- 172.21.15.194:0/3998254141 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff7980083f0 con 0x5586011e7380 2024-09-13T06:09:55.658 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.655+0000 7ff7a9a12980 1 --2- 172.21.15.194:0/3998254141 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5586012ea820 0x5586012ecc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.658 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.655+0000 7ff7a9a12980 1 -- 172.21.15.194:0/3998254141 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5586012ed380 con 0x5586012ea820 2024-09-13T06:09:55.658 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.655+0000 7ff7a6d21640 1 --2- 172.21.15.194:0/3998254141 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5586012ea820 0x5586012ecc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.658 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.655+0000 7ff7a6d21640 1 --2- 172.21.15.194:0/3998254141 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5586012ea820 0x5586012ecc10 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.658 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.655+0000 7ff7a6d21640 1 -- 172.21.15.194:0/3998254141 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff79000f6a0 con 0x5586012ea820 2024-09-13T06:09:55.658 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.655+0000 7ff7a9a12980 1 Processor -- start 2024-09-13T06:09:55.658 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.655+0000 7ff7a9a12980 1 -- start start 2024-09-13T06:09:55.658 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.655+0000 7ff7a9a12980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5586012fae10 0x5586012fb230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.655+0000 7ff7a9a12980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5586010ef800 con 0x5586012fae10 2024-09-13T06:09:55.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.655+0000 7ff7a7522640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5586012fae10 0x5586012fb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.655+0000 7ff7a7522640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5586012fae10 0x5586012fb230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44866/0 (socket says 172.21.15.194:44866) 2024-09-13T06:09:55.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.655+0000 7ff7a7522640 1 -- 172.21.15.194:0/345991502 learned_addr learned my addr 172.21.15.194:0/345991502 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:55.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.655+0000 7ff7a7522640 1 -- 172.21.15.194:0/345991502 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586012fb770 con 0x5586012fae10 2024-09-13T06:09:55.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.655+0000 7ff7a7522640 1 --2- 172.21.15.194:0/345991502 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5586012fae10 0x5586012fb230 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff7a00a98d0 tx=0x7ff7a00a9be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.655+0000 7ff691602640 1 -- 172.21.15.194:0/345991502 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7a00cc040 con 0x5586012fae10 2024-09-13T06:09:55.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.655+0000 7ff7a9a12980 1 -- 172.21.15.194:0/345991502 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5586012fba00 con 0x5586012fae10 2024-09-13T06:09:55.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.655+0000 7ff691602640 1 -- 172.21.15.194:0/345991502 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7a00e2210 con 0x5586012fae10 2024-09-13T06:09:55.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.655+0000 7ff7a9a12980 1 -- 172.21.15.194:0/345991502 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586012fe680 con 0x5586012fae10 2024-09-13T06:09:55.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.655+0000 7ff691602640 1 -- 172.21.15.194:0/345991502 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7a00ea060 con 0x5586012fae10 2024-09-13T06:09:55.663 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.659+0000 7ff691602640 1 -- 172.21.15.194:0/345991502 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff7a00db030 con 0x5586012fae10 2024-09-13T06:09:55.663 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.659+0000 7ff691602640 1 --2- 172.21.15.194:0/345991502 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff680034650 0x7ff680036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.663 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.659+0000 7ff691602640 1 -- 172.21.15.194:0/345991502 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7ff7a00e6df0 con 0x5586012fae10 2024-09-13T06:09:55.663 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.659+0000 7ff7a6d21640 1 --2- 172.21.15.194:0/345991502 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff680034650 0x7ff680036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.663 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.659+0000 7ff7a9a12980 1 Processor -- start 2024-09-13T06:09:55.663 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.659+0000 7ff7a9a12980 1 -- start start 2024-09-13T06:09:55.663 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.659+0000 7ff7a6d21640 1 --2- 172.21.15.194:0/345991502 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff680034650 0x7ff680036b10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x5586012ed780 tx=0x7ff79000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.663 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.659+0000 7ff7a9a12980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5586013077f0 0x558601307bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.663 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.659+0000 7ff7a9a12980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5586011e79b0 con 0x5586013077f0 2024-09-13T06:09:55.664 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.659+0000 7ff7a7522640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5586013077f0 0x558601307bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.664 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.659+0000 7ff7a7522640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5586013077f0 0x558601307bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44874/0 (socket says 172.21.15.194:44874) 2024-09-13T06:09:55.664 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.659+0000 7ff7a7522640 1 -- 172.21.15.194:0/2922627853 learned_addr learned my addr 172.21.15.194:0/2922627853 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:55.664 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.659+0000 7ff7a7522640 1 -- 172.21.15.194:0/2922627853 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586013081a0 con 0x5586013077f0 2024-09-13T06:09:55.664 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.659+0000 7ff7a7522640 1 --2- 172.21.15.194:0/2922627853 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5586013077f0 0x558601307bd0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff7a0007470 tx=0x7ff7a00c77d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b0e77217928264 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.664 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.659+0000 7ff68affd640 1 -- 172.21.15.194:0/2922627853 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7a00d2440 con 0x5586013077f0 2024-09-13T06:09:55.664 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.659+0000 7ff68affd640 1 -- 172.21.15.194:0/2922627853 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7a00e7dd0 con 0x5586013077f0 2024-09-13T06:09:55.664 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.659+0000 7ff68affd640 1 -- 172.21.15.194:0/2922627853 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7a00dd460 con 0x5586013077f0 2024-09-13T06:09:55.664 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.659+0000 7ff7a9a12980 1 -- 172.21.15.194:0/2922627853 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5586013077f0 msgr2=0x558601307bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.664 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.659+0000 7ff7a9a12980 1 --2- 172.21.15.194:0/2922627853 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5586013077f0 0x558601307bd0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff7a0007470 tx=0x7ff7a00c77d0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.664 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.659+0000 7ff7a9a12980 1 -- 172.21.15.194:0/2922627853 shutdown_connections 2024-09-13T06:09:55.664 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.659+0000 7ff7a9a12980 1 --2- 172.21.15.194:0/2922627853 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5586013077f0 0x558601307bd0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.664 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.659+0000 7ff7a9a12980 1 -- 172.21.15.194:0/2922627853 >> 172.21.15.194:0/2922627853 conn(0x558601303bd0 msgr2=0x558601301cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:55.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.659+0000 7ff7a9a12980 1 -- 172.21.15.194:0/2922627853 shutdown_connections 2024-09-13T06:09:55.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.659+0000 7ff7a9a12980 1 -- 172.21.15.194:0/2922627853 wait complete. 2024-09-13T06:09:55.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.659+0000 7ff7a9a12980 1 Processor -- start 2024-09-13T06:09:55.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.659+0000 7ff7a9a12980 1 -- start start 2024-09-13T06:09:55.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.659+0000 7ff7a9a12980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5586013077f0 0x55860130e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.659+0000 7ff7a9a12980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x558601308640 con 0x5586013077f0 2024-09-13T06:09:55.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.659+0000 7ff7a7522640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5586013077f0 0x55860130e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.659+0000 7ff7a7522640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5586013077f0 0x55860130e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44888/0 (socket says 172.21.15.194:44888) 2024-09-13T06:09:55.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.659+0000 7ff7a7522640 1 -- 172.21.15.194:0/2696009478 learned_addr learned my addr 172.21.15.194:0/2696009478 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:55.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.663+0000 7ff7a7522640 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55860130eef0 con 0x5586013077f0 2024-09-13T06:09:55.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.663+0000 7ff7a7522640 1 --2- 172.21.15.194:0/2696009478 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5586013077f0 0x55860130e9b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff7a00d0f70 tx=0x7ff7a00d4ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.663+0000 7ff6897fa640 1 -- 172.21.15.194:0/2696009478 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7a0108020 con 0x5586013077f0 2024-09-13T06:09:55.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.663+0000 7ff7a9a12980 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55860130eef0 con 0x5586013077f0 2024-09-13T06:09:55.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.663+0000 7ff6897fa640 1 -- 172.21.15.194:0/2696009478 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7a00d2b60 con 0x5586013077f0 2024-09-13T06:09:55.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.663+0000 7ff7a9a12980 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55860130eef0 con 0x5586013077f0 2024-09-13T06:09:55.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.663+0000 7ff6897fa640 1 -- 172.21.15.194:0/2696009478 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7a00d2d10 con 0x5586013077f0 2024-09-13T06:09:55.671 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.663+0000 7ff6897fa640 1 -- 172.21.15.194:0/2696009478 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff7a010b020 con 0x5586013077f0 2024-09-13T06:09:55.671 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.663+0000 7ff7a9a12980 20 rados->read ofs=0 len=0 2024-09-13T06:09:55.671 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.663+0000 7ff6897fa640 1 --2- 172.21.15.194:0/2696009478 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff670034650 0x7ff670036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.671 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.663+0000 7ff6897fa640 1 -- 172.21.15.194:0/2696009478 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7ff7a00ff050 con 0x5586013077f0 2024-09-13T06:09:55.671 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.663+0000 7ff7a6d21640 1 --2- 172.21.15.194:0/2696009478 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff670034650 0x7ff670036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.671 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.663+0000 7ff7a9a12980 1 --2- 172.21.15.194:0/2696009478 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x558601319b10 0x55860131bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.671 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.663+0000 7ff7a9a12980 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55860131c720 con 0x558601319b10 2024-09-13T06:09:55.671 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.663+0000 7ff7a7d23640 1 --2- 172.21.15.194:0/2696009478 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x558601319b10 0x55860131bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.671 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.663+0000 7ff7a6d21640 1 --2- 172.21.15.194:0/2696009478 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff670034650 0x7ff670036b10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff79000c010 tx=0x7ff790010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.671 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.663+0000 7ff7a7d23640 1 --2- 172.21.15.194:0/2696009478 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x558601319b10 0x55860131bfd0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.671 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.663+0000 7ff7a7d23640 1 -- 172.21.15.194:0/2696009478 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff7980083f0 con 0x558601319b10 2024-09-13T06:09:55.671 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.663+0000 7ff7a9a12980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:55.672 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.663+0000 7ff7a9a12980 20 realm 2024-09-13T06:09:55.672 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.663+0000 7ff7a9a12980 20 rados->read ofs=0 len=0 2024-09-13T06:09:55.672 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.663+0000 7ff7a9a12980 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55860131cb30 con 0x558601319b10 2024-09-13T06:09:55.672 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.663+0000 7ff7a7d23640 1 -- 172.21.15.194:0/2696009478 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff7980083f0 con 0x558601319b10 2024-09-13T06:09:55.672 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.663+0000 7ff7a9a12980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:55.672 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.663+0000 7ff7a9a12980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:09:55.672 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.663+0000 7ff7a9a12980 20 rados->read ofs=0 len=0 2024-09-13T06:09:55.672 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.663+0000 7ff7a9a12980 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55860131d3d0 con 0x558601319b10 2024-09-13T06:09:55.672 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.663+0000 7ff7a7d23640 1 -- 172.21.15.194:0/2696009478 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff7980083f0 con 0x558601319b10 2024-09-13T06:09:55.672 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.663+0000 7ff7a9a12980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:55.672 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.663+0000 7ff7a9a12980 20 rados->read ofs=0 len=0 2024-09-13T06:09:55.672 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.663+0000 7ff7a9a12980 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55860131d770 con 0x558601319b10 2024-09-13T06:09:55.672 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.663+0000 7ff7a7d23640 1 -- 172.21.15.194:0/2696009478 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff7980083f0 con 0x558601319b10 2024-09-13T06:09:55.672 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.663+0000 7ff7a9a12980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:55.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.663+0000 7ff7a9a12980 20 rados->read ofs=0 len=0 2024-09-13T06:09:55.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.663+0000 7ff7a9a12980 1 --2- 172.21.15.194:0/2696009478 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55860131e4d0 0x5586013208c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.667+0000 7ff7a9a12980 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558601320f60 con 0x55860131e4d0 2024-09-13T06:09:55.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.667+0000 7ff7a7522640 1 --2- 172.21.15.194:0/2696009478 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55860131e4d0 0x5586013208c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.667+0000 7ff7a7522640 1 --2- 172.21.15.194:0/2696009478 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55860131e4d0 0x5586013208c0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.667+0000 7ff7a7522640 1 -- 172.21.15.194:0/2696009478 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff7a00e5050 con 0x55860131e4d0 2024-09-13T06:09:55.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.667+0000 7ff7a9a12980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:09:55.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.667+0000 7ff7a9a12980 20 searching for the correct realm 2024-09-13T06:09:55.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.667+0000 7ff7a9a12980 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5586013227c0 con 0x55860131e4d0 2024-09-13T06:09:55.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.667+0000 7ff7a7522640 1 -- 172.21.15.194:0/2696009478 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7a00e5050 con 0x55860131e4d0 2024-09-13T06:09:55.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.667+0000 7ff7a7522640 1 --2- 172.21.15.194:0/2696009478 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7ff7a010d020 0x7ff7a00a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.667+0000 7ff7a7522640 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5586013227c0 con 0x7ff7a010d020 2024-09-13T06:09:55.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.667+0000 7ff7a6d21640 1 --2- 172.21.15.194:0/2696009478 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7ff7a010d020 0x7ff7a00a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.674 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.667+0000 7ff7a6d21640 1 --2- 172.21.15.194:0/2696009478 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7ff7a010d020 0x7ff7a00a5140 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.674 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.667+0000 7ff7a6d21640 1 -- 172.21.15.194:0/2696009478 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff790037040 con 0x7ff7a010d020 2024-09-13T06:09:55.674 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.667+0000 7ff7a6d21640 1 --2- 172.21.15.194:0/2696009478 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7ff79001fbe0 0x7ff79003a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.674 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.667+0000 7ff7a6d21640 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5586013227c0 con 0x7ff79001fbe0 2024-09-13T06:09:55.674 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.667+0000 7ff7a7d23640 1 --2- 172.21.15.194:0/2696009478 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7ff79001fbe0 0x7ff79003a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.674 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.667+0000 7ff7a7d23640 1 --2- 172.21.15.194:0/2696009478 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7ff79001fbe0 0x7ff79003a3c0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.674 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.667+0000 7ff7a7d23640 1 -- 172.21.15.194:0/2696009478 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7980083f0 con 0x7ff79001fbe0 2024-09-13T06:09:55.674 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.667+0000 7ff7a7d23640 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55860131d770 con 0x558601319b10 2024-09-13T06:09:55.674 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.667+0000 7ff7a7d23640 1 -- 172.21.15.194:0/2696009478 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7980083f0 con 0x558601319b10 2024-09-13T06:09:55.674 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.667+0000 7ff7a7d23640 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55860131d770 con 0x558601319b10 2024-09-13T06:09:55.674 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.667+0000 7ff7a7d23640 1 -- 172.21.15.194:0/2696009478 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7980083f0 con 0x558601319b10 2024-09-13T06:09:55.674 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.667+0000 7ff7a7d23640 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55860131d770 con 0x7ff79001fbe0 2024-09-13T06:09:55.674 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.671+0000 7ff7a7d23640 1 -- 172.21.15.194:0/2696009478 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7980083f0 con 0x7ff79001fbe0 2024-09-13T06:09:55.675 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.671+0000 7ff7a7d23640 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55860131d770 con 0x7ff79001fbe0 2024-09-13T06:09:55.675 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.671+0000 7ff7a7d23640 1 -- 172.21.15.194:0/2696009478 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7980083f0 con 0x7ff79001fbe0 2024-09-13T06:09:55.675 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.671+0000 7ff7a7d23640 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55860131d770 con 0x7ff7a010d020 2024-09-13T06:09:55.682 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.671+0000 7ff7a6d21640 1 -- 172.21.15.194:0/2696009478 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff790037040 con 0x7ff7a010d020 2024-09-13T06:09:55.683 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.671+0000 7ff7a6d21640 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55860131d770 con 0x55860131e4d0 2024-09-13T06:09:55.683 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.671+0000 7ff7a7522640 1 -- 172.21.15.194:0/2696009478 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7a00e5050 con 0x55860131e4d0 2024-09-13T06:09:55.683 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.671+0000 7ff7a7522640 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55860131d770 con 0x558601319b10 2024-09-13T06:09:55.683 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.671+0000 7ff7a7d23640 1 -- 172.21.15.194:0/2696009478 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7980083f0 con 0x558601319b10 2024-09-13T06:09:55.683 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.671+0000 7ff7a7d23640 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55860131d770 con 0x7ff79001fbe0 2024-09-13T06:09:55.683 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.671+0000 7ff7a7d23640 1 -- 172.21.15.194:0/2696009478 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7980083f0 con 0x7ff79001fbe0 2024-09-13T06:09:55.683 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.671+0000 7ff7a7d23640 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55860131d770 con 0x558601319b10 2024-09-13T06:09:55.683 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.671+0000 7ff7a7d23640 1 -- 172.21.15.194:0/2696009478 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7980083f0 con 0x558601319b10 2024-09-13T06:09:55.683 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.671+0000 7ff7a7d23640 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55860131d770 con 0x7ff7a010d020 2024-09-13T06:09:55.683 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.671+0000 7ff7a6d21640 1 -- 172.21.15.194:0/2696009478 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff790037040 con 0x7ff7a010d020 2024-09-13T06:09:55.683 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.671+0000 7ff7a6d21640 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55860131d770 con 0x55860131e4d0 2024-09-13T06:09:55.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.671+0000 7ff7a7522640 1 -- 172.21.15.194:0/2696009478 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7a00e5050 con 0x55860131e4d0 2024-09-13T06:09:55.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.671+0000 7ff7a7522640 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55860131d770 con 0x55860131e4d0 2024-09-13T06:09:55.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.671+0000 7ff7a7522640 1 -- 172.21.15.194:0/2696009478 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7a00e5050 con 0x55860131e4d0 2024-09-13T06:09:55.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.671+0000 7ff7a7522640 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55860131d770 con 0x7ff79001fbe0 2024-09-13T06:09:55.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.671+0000 7ff7a7d23640 1 -- 172.21.15.194:0/2696009478 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7980083f0 con 0x7ff79001fbe0 2024-09-13T06:09:55.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.671+0000 7ff7a7d23640 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55860131d770 con 0x55860131e4d0 2024-09-13T06:09:55.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.671+0000 7ff7a7522640 1 -- 172.21.15.194:0/2696009478 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7a00e5050 con 0x55860131e4d0 2024-09-13T06:09:55.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.671+0000 7ff7a7522640 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55860131d770 con 0x55860131e4d0 2024-09-13T06:09:55.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.675+0000 7ff7a7522640 1 -- 172.21.15.194:0/2696009478 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7a00e5050 con 0x55860131e4d0 2024-09-13T06:09:55.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.675+0000 7ff7a7522640 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55860131d770 con 0x558601319b10 2024-09-13T06:09:55.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.675+0000 7ff7a7d23640 1 -- 172.21.15.194:0/2696009478 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7980083f0 con 0x558601319b10 2024-09-13T06:09:55.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.675+0000 7ff7a7d23640 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55860131d770 con 0x558601319b10 2024-09-13T06:09:55.685 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.675+0000 7ff7a7d23640 1 -- 172.21.15.194:0/2696009478 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff7980083f0 con 0x558601319b10 2024-09-13T06:09:55.685 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.675+0000 7ff7a7d23640 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55860131d770 con 0x7ff79001fbe0 2024-09-13T06:09:55.685 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.675+0000 7ff7a7d23640 1 -- 172.21.15.194:0/2696009478 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7980083f0 con 0x7ff79001fbe0 2024-09-13T06:09:55.685 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.675+0000 7ff7a7d23640 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55860131d770 con 0x55860131e4d0 2024-09-13T06:09:55.685 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.675+0000 7ff7a7522640 1 -- 172.21.15.194:0/2696009478 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7a00e5050 con 0x55860131e4d0 2024-09-13T06:09:55.685 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.675+0000 7ff7a7522640 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55860131d770 con 0x7ff7a010d020 2024-09-13T06:09:55.685 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.675+0000 7ff7a6d21640 1 -- 172.21.15.194:0/2696009478 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff790037040 con 0x7ff7a010d020 2024-09-13T06:09:55.685 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.675+0000 7ff7a6d21640 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55860131d770 con 0x558601319b10 2024-09-13T06:09:55.685 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.675+0000 7ff7a7d23640 1 -- 172.21.15.194:0/2696009478 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7980083f0 con 0x558601319b10 2024-09-13T06:09:55.685 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.675+0000 7ff7a7d23640 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55860131d770 con 0x7ff79001fbe0 2024-09-13T06:09:55.685 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.675+0000 7ff7a7d23640 1 -- 172.21.15.194:0/2696009478 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7980083f0 con 0x7ff79001fbe0 2024-09-13T06:09:55.685 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.675+0000 7ff7a7d23640 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55860131d770 con 0x55860131e4d0 2024-09-13T06:09:55.685 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.675+0000 7ff7a7522640 1 -- 172.21.15.194:0/2696009478 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff7a00e5050 con 0x55860131e4d0 2024-09-13T06:09:55.686 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.675+0000 7ff7a7522640 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55860131d770 con 0x7ff79001fbe0 2024-09-13T06:09:55.686 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.675+0000 7ff7a7d23640 1 -- 172.21.15.194:0/2696009478 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7980083f0 con 0x7ff79001fbe0 2024-09-13T06:09:55.686 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.675+0000 7ff7a7d23640 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55860131d770 con 0x7ff7a010d020 2024-09-13T06:09:55.686 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.675+0000 7ff7a6d21640 1 -- 172.21.15.194:0/2696009478 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff790037040 con 0x7ff7a010d020 2024-09-13T06:09:55.686 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.675+0000 7ff7a6d21640 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55860131d770 con 0x55860131e4d0 2024-09-13T06:09:55.686 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.679+0000 7ff7a7522640 1 -- 172.21.15.194:0/2696009478 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7a00e5050 con 0x55860131e4d0 2024-09-13T06:09:55.686 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.679+0000 7ff7a7522640 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55860131d770 con 0x7ff79001fbe0 2024-09-13T06:09:55.686 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.679+0000 7ff7a7d23640 1 -- 172.21.15.194:0/2696009478 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7980083f0 con 0x7ff79001fbe0 2024-09-13T06:09:55.686 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.679+0000 7ff7a7d23640 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55860131d770 con 0x558601319b10 2024-09-13T06:09:55.686 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.679+0000 7ff7a7d23640 1 -- 172.21.15.194:0/2696009478 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff7980083f0 con 0x558601319b10 2024-09-13T06:09:55.686 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.679+0000 7ff7a7d23640 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55860131d770 con 0x7ff7a010d020 2024-09-13T06:09:55.686 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.679+0000 7ff7a6d21640 1 -- 172.21.15.194:0/2696009478 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff790037040 con 0x7ff7a010d020 2024-09-13T06:09:55.687 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.679+0000 7ff7a9a12980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:09:55.687 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.679+0000 7ff7a9a12980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:09:55.687 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.679+0000 7ff7a9a12980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:09:55.687 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.679+0000 7ff7a9a12980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:09:55.687 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.679+0000 7ff7a9a12980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:09:55.687 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.679+0000 7ff7a9a12980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:09:55.687 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.679+0000 7ff7a9a12980 20 rados->read ofs=0 len=0 2024-09-13T06:09:55.687 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.679+0000 7ff7a9a12980 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5586013218e0 con 0x558601319b10 2024-09-13T06:09:55.687 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.679+0000 7ff7a7d23640 1 -- 172.21.15.194:0/2696009478 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff7980083f0 con 0x558601319b10 2024-09-13T06:09:55.687 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.679+0000 7ff7a9a12980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:55.687 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.679+0000 7ff7a9a12980 20 rados->read ofs=0 len=0 2024-09-13T06:09:55.687 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.679+0000 7ff7a9a12980 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558601322130 con 0x558601319b10 2024-09-13T06:09:55.687 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.679+0000 7ff7a7d23640 1 -- 172.21.15.194:0/2696009478 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff7980083f0 con 0x558601319b10 2024-09-13T06:09:55.687 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.679+0000 7ff7a9a12980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:55.688 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.679+0000 7ff7a9a12980 20 rados->read ofs=0 len=0 2024-09-13T06:09:55.688 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.679+0000 7ff7a9a12980 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558601321c80 con 0x7ff7a010d020 2024-09-13T06:09:55.688 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.679+0000 7ff7a6d21640 1 -- 172.21.15.194:0/2696009478 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff790037040 con 0x7ff7a010d020 2024-09-13T06:09:55.688 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.679+0000 7ff7a9a12980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:09:55.688 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.679+0000 7ff7a9a12980 20 zone default found 2024-09-13T06:09:55.688 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.679+0000 7ff7a9a12980 4 Realm: () 2024-09-13T06:09:55.688 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.679+0000 7ff7a9a12980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:09:55.688 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.679+0000 7ff7a9a12980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:09:55.688 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.679+0000 7ff7a9a12980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:09:55.688 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.679+0000 7ff7a9a12980 20 zonegroup default 2024-09-13T06:09:55.688 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.679+0000 7ff7a9a12980 20 rados->read ofs=0 len=0 2024-09-13T06:09:55.689 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.679+0000 7ff7a9a12980 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558601322bf0 con 0x7ff79001fbe0 2024-09-13T06:09:55.689 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.679+0000 7ff7a7d23640 1 -- 172.21.15.194:0/2696009478 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff7980083f0 con 0x7ff79001fbe0 2024-09-13T06:09:55.689 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.679+0000 7ff7a9a12980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:55.689 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.679+0000 7ff7a9a12980 20 rados->read ofs=0 len=0 2024-09-13T06:09:55.689 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.679+0000 7ff7a9a12980 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558601324600 con 0x55860131e4d0 2024-09-13T06:09:55.689 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.679+0000 7ff7a7522640 1 -- 172.21.15.194:0/2696009478 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff7a00e5050 con 0x55860131e4d0 2024-09-13T06:09:55.689 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.679+0000 7ff7a9a12980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:55.689 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.679+0000 7ff7a9a12980 20 rados->read ofs=0 len=0 2024-09-13T06:09:55.689 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.679+0000 7ff7a9a12980 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558601324a70 con 0x55860131e4d0 2024-09-13T06:09:55.689 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.679+0000 7ff7a7522640 1 -- 172.21.15.194:0/2696009478 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff7a00e5050 con 0x55860131e4d0 2024-09-13T06:09:55.689 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.679+0000 7ff7a9a12980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:55.689 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.679+0000 7ff7a9a12980 20 started sync module instance, tier type = 2024-09-13T06:09:55.689 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.679+0000 7ff7a9a12980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:09:55.690 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.679+0000 7ff7a9a12980 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558601323a70 con 0x7ff7a010d020 2024-09-13T06:09:55.690 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.683+0000 7ff7a6d21640 1 -- 172.21.15.194:0/2696009478 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(44 notify.0 [create] v33'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff790037040 con 0x7ff7a010d020 2024-09-13T06:09:55.690 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.683+0000 7ff7a9a12980 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94034034048608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5586013236d0 con 0x7ff7a010d020 2024-09-13T06:09:55.690 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.683+0000 7ff7a9a12980 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5586013259a0 con 0x558601319b10 2024-09-13T06:09:55.692 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.683+0000 7ff7a6d21640 1 -- 172.21.15.194:0/2696009478 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94034034048608] v33'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff790037040 con 0x7ff7a010d020 2024-09-13T06:09:55.692 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.683+0000 7ff7a7d23640 1 -- 172.21.15.194:0/2696009478 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v33'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7980083f0 con 0x558601319b10 2024-09-13T06:09:55.692 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.683+0000 7ff7a9a12980 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94034034054384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558601325910 con 0x558601319b10 2024-09-13T06:09:55.692 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.683+0000 7ff7a9a12980 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558601326730 con 0x55860131e4d0 2024-09-13T06:09:55.692 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.687+0000 7ff7a7d23640 1 -- 172.21.15.194:0/2696009478 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94034034054384] v33'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7980083f0 con 0x558601319b10 2024-09-13T06:09:55.692 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.687+0000 7ff7a7522640 1 -- 172.21.15.194:0/2696009478 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v33'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7a00e5050 con 0x55860131e4d0 2024-09-13T06:09:55.692 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.687+0000 7ff7a9a12980 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94034034056592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558601326b20 con 0x55860131e4d0 2024-09-13T06:09:55.692 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.687+0000 7ff7a9a12980 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5586013274e0 con 0x7ff7a010d020 2024-09-13T06:09:55.692 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.687+0000 7ff7a6d21640 1 -- 172.21.15.194:0/2696009478 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(50 notify.3 [create] v33'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff790037040 con 0x7ff7a010d020 2024-09-13T06:09:55.692 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.687+0000 7ff7a9a12980 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94034034063488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558601328150 con 0x7ff7a010d020 2024-09-13T06:09:55.693 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.687+0000 7ff7a9a12980 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558601328b10 con 0x558601319b10 2024-09-13T06:09:55.693 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.687+0000 7ff7a7522640 1 -- 172.21.15.194:0/2696009478 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94034034056592] v33'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7a00e5050 con 0x55860131e4d0 2024-09-13T06:09:55.693 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.687+0000 7ff7a7d23640 1 -- 172.21.15.194:0/2696009478 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v33'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7980083f0 con 0x558601319b10 2024-09-13T06:09:55.693 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.687+0000 7ff7a9a12980 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94034034067040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558601328a80 con 0x558601319b10 2024-09-13T06:09:55.693 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.687+0000 7ff7a9a12980 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558601329860 con 0x7ff79001fbe0 2024-09-13T06:09:55.693 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.687+0000 7ff7a6d21640 1 -- 172.21.15.194:0/2696009478 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94034034063488] v33'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff790037040 con 0x7ff7a010d020 2024-09-13T06:09:55.693 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.691+0000 7ff7a7d23640 1 -- 172.21.15.194:0/2696009478 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94034034067040] v33'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7980083f0 con 0x558601319b10 2024-09-13T06:09:55.693 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.691+0000 7ff7a7d23640 1 -- 172.21.15.194:0/2696009478 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(54 notify.5 [create] v33'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7980083f0 con 0x7ff79001fbe0 2024-09-13T06:09:55.693 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.691+0000 7ff7a9a12980 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94034034064544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558601329320 con 0x7ff79001fbe0 2024-09-13T06:09:55.693 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.691+0000 7ff7a9a12980 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558601329bb0 con 0x7ff79001fbe0 2024-09-13T06:09:55.694 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.691+0000 7ff7a7d23640 1 -- 172.21.15.194:0/2696009478 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94034034064544] v33'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7980083f0 con 0x7ff79001fbe0 2024-09-13T06:09:55.694 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.695+0000 7ff7a7d23640 1 -- 172.21.15.194:0/2696009478 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(56 notify.6 [create] v33'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7980083f0 con 0x7ff79001fbe0 2024-09-13T06:09:55.694 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.695+0000 7ff7a9a12980 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94034034069024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558601329d90 con 0x7ff79001fbe0 2024-09-13T06:09:55.694 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.695+0000 7ff7a9a12980 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55860132a5e0 con 0x7ff79001fbe0 2024-09-13T06:09:55.696 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.695+0000 7ff7a7d23640 1 -- 172.21.15.194:0/2696009478 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(58 notify.7 [create] v33'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7980083f0 con 0x7ff79001fbe0 2024-09-13T06:09:55.696 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.695+0000 7ff7a9a12980 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94034034073456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55860132a980 con 0x7ff79001fbe0 2024-09-13T06:09:55.696 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.695+0000 7ff7a9a12980 20 add_watcher() i=0 2024-09-13T06:09:55.697 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.695+0000 7ff7a9a12980 20 add_watcher() i=1 2024-09-13T06:09:55.697 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.695+0000 7ff7a9a12980 20 add_watcher() i=2 2024-09-13T06:09:55.697 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.695+0000 7ff7a9a12980 20 add_watcher() i=3 2024-09-13T06:09:55.697 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.695+0000 7ff7a9a12980 20 add_watcher() i=4 2024-09-13T06:09:55.697 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.695+0000 7ff7a9a12980 20 add_watcher() i=5 2024-09-13T06:09:55.697 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.695+0000 7ff7a7d23640 1 -- 172.21.15.194:0/2696009478 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94034034069024] v33'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7980083f0 con 0x7ff79001fbe0 2024-09-13T06:09:55.697 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.695+0000 7ff7a9a12980 20 add_watcher() i=6 2024-09-13T06:09:55.698 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.695+0000 7ff7a7d23640 1 -- 172.21.15.194:0/2696009478 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94034034073456] v33'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7980083f0 con 0x7ff79001fbe0 2024-09-13T06:09:55.698 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.695+0000 7ff7a9a12980 20 add_watcher() i=7 2024-09-13T06:09:55.698 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.695+0000 7ff7a9a12980 2 all 8 watchers are set, enabling cache 2024-09-13T06:09:55.698 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.695+0000 7ff7a9a12980 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558601329320 con 0x558601319b10 2024-09-13T06:09:55.698 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.699+0000 7ff7a7d23640 1 -- 172.21.15.194:0/2696009478 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff7980083f0 con 0x558601319b10 2024-09-13T06:09:55.698 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.699+0000 7ff7a9a12980 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94034034070240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55860132aec0 con 0x558601319b10 2024-09-13T06:09:55.701 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.699+0000 7ff7a7d23640 1 -- 172.21.15.194:0/2696009478 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94034034070240] v33'78 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff7980083f0 con 0x558601319b10 2024-09-13T06:09:55.701 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.699+0000 7ff65dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:55.701 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.699+0000 7ff7a9a12980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:09:55.701 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.699+0000 7ff7a9a12980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:09:55.701 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.699+0000 7ff7a9a12980 5 note: GC not initialized 2024-09-13T06:09:55.701 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.699+0000 7ff65cfe1640 20 reqs_thread_entry: start 2024-09-13T06:09:55.701 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.699+0000 7ff7a9a12980 20 init_complete bucket index max shards: 11 2024-09-13T06:09:55.701 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.699+0000 7ff7a9a12980 20 Filter name: none 2024-09-13T06:09:55.701 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.699+0000 7ff5d67fc640 20 reqs_thread_entry: start 2024-09-13T06:09:55.701 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.699+0000 7ff7a9a12980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T06:09:55.701 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.699+0000 7ff7a9a12980 20 rados->read ofs=0 len=0 2024-09-13T06:09:55.702 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.699+0000 7ff7a9a12980 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558601351070 con 0x558601319b10 2024-09-13T06:09:55.702 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.699+0000 7ff7a7d23640 1 -- 172.21.15.194:0/2696009478 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7ff7980083f0 con 0x558601319b10 2024-09-13T06:09:55.702 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.699+0000 7ff7a9a12980 20 rados_obj.operate() r=0 bl.length=556 2024-09-13T06:09:55.702 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.699+0000 7ff7a9a12980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T06:09:55.702 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.699+0000 7ff7a9a12980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:09:55.702 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.699+0000 7ff7a9a12980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:09:55.702 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.699+0000 7ff7a9a12980 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : miss 2024-09-13T06:09:55.702 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.699+0000 7ff7a9a12980 20 rados->read ofs=0 len=0 2024-09-13T06:09:55.702 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.699+0000 7ff7a9a12980 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:63 8.2 8:45671577:users.swift::foo%3afoo2:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558601351db0 con 0x7ff7a010d020 2024-09-13T06:09:55.702 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.699+0000 7ff7a6d21640 1 -- 172.21.15.194:0/2696009478 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(63 foo:foo2 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7ff790037040 con 0x7ff7a010d020 2024-09-13T06:09:55.702 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.699+0000 7ff7a9a12980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:55.702 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.699+0000 7ff7a9a12980 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x0 2024-09-13T06:09:55.702 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.699+0000 7ff7a9a12980 10 adding default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-13T06:09:55.703 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.699+0000 7ff7a9a12980 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : hit (negative entry) 2024-09-13T06:09:55.703 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.699+0000 7ff7a9a12980 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~673 in=673b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558601357b00 con 0x558601319b10 2024-09-13T06:09:55.704 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.699+0000 7ff7a7d23640 1 -- 172.21.15.194:0/2696009478 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~673] v33'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7ff7980083f0 con 0x558601319b10 2024-09-13T06:09:55.704 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.699+0000 7ff7a9a12980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T06:09:55.704 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.699+0000 7ff7a9a12980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:09:55.704 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.699+0000 7ff7a9a12980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T06:09:55.704 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.699+0000 7ff7a9a12980 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94034034259344 in=861b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558601354650 con 0x558601319b10 2024-09-13T06:09:55.704 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.699+0000 7ff7a7d23640 1 -- 172.21.15.194:0/2696009478 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== watch-notify(notify (1) cookie 94034034067040 notify 141733920775 ret 0) ==== 891+0+0 (crc 0 0 0) 0x7ff79803b040 con 0x558601319b10 2024-09-13T06:09:55.704 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.699+0000 7ff68affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920775 cookie 94034034067040 notifier 4388 bl.length()=849 2024-09-13T06:09:55.704 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.699+0000 7ff68affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T06:09:55.704 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.699+0000 7ff68affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:09:55.704 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.699+0000 7ff7a7d23640 1 -- 172.21.15.194:0/2696009478 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(65 notify.4 [notify cookie 94034034259344 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff7980083f0 con 0x558601319b10 2024-09-13T06:09:55.705 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.699+0000 7ff68affd640 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7ff66c003eb0 con 0x558601319b10 2024-09-13T06:09:55.705 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.703+0000 7ff7a7d23640 1 -- 172.21.15.194:0/2696009478 <== osd.1 v2:172.21.15.194:6808/3135444559 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7980083f0 con 0x558601319b10 2024-09-13T06:09:55.705 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.703+0000 7ff7a7d23640 1 -- 172.21.15.194:0/2696009478 <== osd.1 v2:172.21.15.194:6808/3135444559 26 ==== watch-notify(notify_complete (2) cookie 94034034259344 notify 141733920775 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7ff798010040 con 0x558601319b10 2024-09-13T06:09:55.705 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.703+0000 7ff7a9a12980 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:67 8.2 8:45671577:users.swift::foo%3afoo2:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558601357590 con 0x7ff7a010d020 2024-09-13T06:09:55.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.703+0000 7ff7a6d21640 1 -- 172.21.15.194:0/2696009478 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(67 foo:foo2 [delete,create,writefull 0~7] v33'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7ff790037040 con 0x7ff7a010d020 2024-09-13T06:09:55.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.703+0000 7ff7a9a12980 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-09-13T06:09:55.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.703+0000 7ff7a9a12980 10 moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-13T06:09:55.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.703+0000 7ff7a9a12980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-09-13T06:09:55.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.703+0000 7ff7a9a12980 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94034034259344 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558601352180 con 0x7ff7a010d020 2024-09-13T06:09:55.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.703+0000 7ff7a6d21640 1 -- 172.21.15.194:0/2696009478 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== watch-notify(notify (1) cookie 94034034048608 notify 141733920771 ret 0) ==== 208+0+0 (crc 0 0 0) 0x7ff790018040 con 0x7ff7a010d020 2024-09-13T06:09:55.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.703+0000 7ff68a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920771 cookie 94034034048608 notifier 4388 bl.length()=166 2024-09-13T06:09:55.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.703+0000 7ff68a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-09-13T06:09:55.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.703+0000 7ff68a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-13T06:09:55.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.703+0000 7ff68a7fc640 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7ff5dc003410 con 0x7ff7a010d020 2024-09-13T06:09:55.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.703+0000 7ff7a6d21640 1 -- 172.21.15.194:0/2696009478 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== osd_op_reply(68 notify.0 [notify cookie 94034034259344 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff790037040 con 0x7ff7a010d020 2024-09-13T06:09:55.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.703+0000 7ff7a6d21640 1 -- 172.21.15.194:0/2696009478 <== osd.2 v2:172.21.15.194:6800/815615585 16 ==== watch-notify(notify_complete (2) cookie 94034034259344 notify 141733920771 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558601070ae0 con 0x7ff7a010d020 2024-09-13T06:09:55.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.703+0000 7ff7a6d21640 1 -- 172.21.15.194:0/2696009478 <== osd.2 v2:172.21.15.194:6800/815615585 17 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff790037040 con 0x7ff7a010d020 2024-09-13T06:09:55.707 INFO:teuthology.orchestra.run.smithi194.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T06:09:53.191222Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-13T06:09:55.703324Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:09:53.191207Z","tags":[],"group_ids":[]} 2024-09-13T06:09:55.708 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.707+0000 7ff65dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:55.708 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.707+0000 7ff7a9a12980 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94034034070240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5586013503f0 con 0x558601319b10 2024-09-13T06:09:55.708 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.707+0000 7ff7a7d23640 1 -- 172.21.15.194:0/2696009478 <== osd.1 v2:172.21.15.194:6808/3135444559 27 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94034034070240] v33'79 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff7980083f0 con 0x558601319b10 2024-09-13T06:09:55.708 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.707+0000 7ff7a9a12980 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94034034048608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5586013503f0 con 0x7ff7a010d020 2024-09-13T06:09:55.708 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.707+0000 7ff7a6d21640 1 -- 172.21.15.194:0/2696009478 <== osd.2 v2:172.21.15.194:6800/815615585 18 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94034034048608] v33'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff790037040 con 0x7ff7a010d020 2024-09-13T06:09:55.709 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.707+0000 7ff7a9a12980 20 remove_watcher() i=0 2024-09-13T06:09:55.709 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.707+0000 7ff7a9a12980 2 removed watcher, disabling cache 2024-09-13T06:09:55.709 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.707+0000 7ff7a9a12980 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94034034054384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5586013503f0 con 0x558601319b10 2024-09-13T06:09:55.710 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.711+0000 7ff7a7d23640 1 -- 172.21.15.194:0/2696009478 <== osd.1 v2:172.21.15.194:6808/3135444559 28 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94034034054384] v33'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7980083f0 con 0x558601319b10 2024-09-13T06:09:55.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.711+0000 7ff7a9a12980 20 remove_watcher() i=1 2024-09-13T06:09:55.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.711+0000 7ff7a9a12980 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94034034056592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5586013503f0 con 0x55860131e4d0 2024-09-13T06:09:55.712 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.711+0000 7ff7a7522640 1 -- 172.21.15.194:0/2696009478 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94034034056592] v33'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7a00e5050 con 0x55860131e4d0 2024-09-13T06:09:55.712 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.711+0000 7ff7a9a12980 20 remove_watcher() i=2 2024-09-13T06:09:55.712 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.711+0000 7ff7a9a12980 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94034034063488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5586013503f0 con 0x7ff7a010d020 2024-09-13T06:09:55.713 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.711+0000 7ff7a6d21640 1 -- 172.21.15.194:0/2696009478 <== osd.2 v2:172.21.15.194:6800/815615585 19 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94034034063488] v33'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff790037040 con 0x7ff7a010d020 2024-09-13T06:09:55.713 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.711+0000 7ff7a9a12980 20 remove_watcher() i=3 2024-09-13T06:09:55.713 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.711+0000 7ff7a9a12980 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94034034067040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5586013503f0 con 0x558601319b10 2024-09-13T06:09:55.715 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.715+0000 7ff7a7d23640 1 -- 172.21.15.194:0/2696009478 <== osd.1 v2:172.21.15.194:6808/3135444559 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94034034067040] v33'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7980083f0 con 0x558601319b10 2024-09-13T06:09:55.715 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.715+0000 7ff7a9a12980 20 remove_watcher() i=4 2024-09-13T06:09:55.715 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.715+0000 7ff7a9a12980 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94034034064544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5586013503f0 con 0x7ff79001fbe0 2024-09-13T06:09:55.717 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.715+0000 7ff7a7d23640 1 -- 172.21.15.194:0/2696009478 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94034034064544] v33'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7980083f0 con 0x7ff79001fbe0 2024-09-13T06:09:55.717 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.715+0000 7ff7a9a12980 20 remove_watcher() i=5 2024-09-13T06:09:55.718 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.715+0000 7ff7a9a12980 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94034034069024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5586013503f0 con 0x7ff79001fbe0 2024-09-13T06:09:55.719 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.719+0000 7ff7a7d23640 1 -- 172.21.15.194:0/2696009478 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94034034069024] v33'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7980083f0 con 0x7ff79001fbe0 2024-09-13T06:09:55.719 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.719+0000 7ff7a9a12980 20 remove_watcher() i=6 2024-09-13T06:09:55.719 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.719+0000 7ff7a9a12980 1 -- 172.21.15.194:0/2696009478 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94034034073456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558601327d30 con 0x7ff79001fbe0 2024-09-13T06:09:55.723 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.719+0000 7ff7a7d23640 1 -- 172.21.15.194:0/2696009478 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94034034073456] v33'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7980083f0 con 0x7ff79001fbe0 2024-09-13T06:09:55.724 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.719+0000 7ff7a9a12980 20 remove_watcher() i=7 2024-09-13T06:09:55.724 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.719+0000 7ff7a9a12980 1 -- 172.21.15.194:0/2696009478 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7ff79001fbe0 msgr2=0x7ff79003a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.724 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.719+0000 7ff7a9a12980 1 --2- 172.21.15.194:0/2696009478 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7ff79001fbe0 0x7ff79003a3c0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.724 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.719+0000 7ff7a9a12980 1 -- 172.21.15.194:0/2696009478 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x558601319b10 msgr2=0x55860131bfd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.724 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.719+0000 7ff7a9a12980 1 --2- 172.21.15.194:0/2696009478 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x558601319b10 0x55860131bfd0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.724 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.719+0000 7ff7a9a12980 1 -- 172.21.15.194:0/2696009478 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7ff7a010d020 msgr2=0x7ff7a00a5140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.724 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.719+0000 7ff7a9a12980 1 --2- 172.21.15.194:0/2696009478 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7ff7a010d020 0x7ff7a00a5140 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.724 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.719+0000 7ff7a9a12980 1 -- 172.21.15.194:0/2696009478 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55860131e4d0 msgr2=0x5586013208c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.724 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.719+0000 7ff7a9a12980 1 --2- 172.21.15.194:0/2696009478 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55860131e4d0 0x5586013208c0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.724 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.719+0000 7ff7a9a12980 1 -- 172.21.15.194:0/2696009478 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff670034650 msgr2=0x7ff670036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.724 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.719+0000 7ff7a9a12980 1 --2- 172.21.15.194:0/2696009478 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff670034650 0x7ff670036b10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff79000c010 tx=0x7ff790010000 comp rx=0 tx=0).stop 2024-09-13T06:09:55.725 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.719+0000 7ff7a9a12980 1 -- 172.21.15.194:0/2696009478 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5586013077f0 msgr2=0x55860130e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.725 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.719+0000 7ff7a9a12980 1 --2- 172.21.15.194:0/2696009478 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5586013077f0 0x55860130e9b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff7a00d0f70 tx=0x7ff7a00d4ef0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.725 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.719+0000 7ff7a7d23640 1 -- 172.21.15.194:0/2696009478 reap_dead start 2024-09-13T06:09:55.725 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.719+0000 7ff7a9a12980 1 -- 172.21.15.194:0/2696009478 shutdown_connections 2024-09-13T06:09:55.725 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.719+0000 7ff7a9a12980 1 --2- 172.21.15.194:0/2696009478 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5586013077f0 0x55860130e9b0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.725 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.719+0000 7ff7a9a12980 1 -- 172.21.15.194:0/2696009478 >> 172.21.15.194:0/2696009478 conn(0x558601303bd0 msgr2=0x558601301ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:55.725 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.719+0000 7ff7a9a12980 1 -- 172.21.15.194:0/2696009478 shutdown_connections 2024-09-13T06:09:55.725 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.719+0000 7ff7a9a12980 1 -- 172.21.15.194:0/2696009478 wait complete. 2024-09-13T06:09:55.725 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.719+0000 7ff7a9a12980 1 -- 172.21.15.194:0/345991502 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff680034650 msgr2=0x7ff680036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.725 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.719+0000 7ff7a9a12980 1 --2- 172.21.15.194:0/345991502 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff680034650 0x7ff680036b10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x5586012ed780 tx=0x7ff79000f000 comp rx=0 tx=0).stop 2024-09-13T06:09:55.725 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.719+0000 7ff7a9a12980 1 -- 172.21.15.194:0/345991502 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5586012fae10 msgr2=0x5586012fb230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.725 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.719+0000 7ff7a9a12980 1 --2- 172.21.15.194:0/345991502 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5586012fae10 0x5586012fb230 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff7a00a98d0 tx=0x7ff7a00a9be0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.725 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.719+0000 7ff7a9a12980 1 -- 172.21.15.194:0/345991502 shutdown_connections 2024-09-13T06:09:55.726 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.719+0000 7ff7a9a12980 1 --2- 172.21.15.194:0/345991502 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff680034650 0x7ff680036b10 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.726 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.719+0000 7ff7a9a12980 1 --2- 172.21.15.194:0/345991502 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5586012fae10 0x5586012fb230 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.726 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.719+0000 7ff7a9a12980 1 -- 172.21.15.194:0/345991502 >> 172.21.15.194:0/345991502 conn(0x5586012eff60 msgr2=0x5586012f29e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:55.726 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.719+0000 7ff7a9a12980 1 -- 172.21.15.194:0/345991502 shutdown_connections 2024-09-13T06:09:55.726 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.719+0000 7ff7a9a12980 1 -- 172.21.15.194:0/345991502 wait complete. 2024-09-13T06:09:55.726 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.723+0000 7ff7a9a12980 1 -- 172.21.15.194:0/3998254141 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5586011e7380 msgr2=0x5586012e3fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.726 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.723+0000 7ff7a9a12980 1 --2- 172.21.15.194:0/3998254141 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5586011e7380 0x5586012e3fb0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.726 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.723+0000 7ff7a9a12980 1 -- 172.21.15.194:0/3998254141 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5586012ea820 msgr2=0x5586012ecc10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.726 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.723+0000 7ff7a9a12980 1 --2- 172.21.15.194:0/3998254141 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5586012ea820 0x5586012ecc10 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.726 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.723+0000 7ff7a9a12980 1 -- 172.21.15.194:0/3998254141 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5586012e6920 msgr2=0x5586012e8d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.726 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.723+0000 7ff7a9a12980 1 --2- 172.21.15.194:0/3998254141 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5586012e6920 0x5586012e8d10 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.726 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.723+0000 7ff7a9a12980 1 -- 172.21.15.194:0/3998254141 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff68c034650 msgr2=0x7ff68c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.726 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.723+0000 7ff7a9a12980 1 --2- 172.21.15.194:0/3998254141 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff68c034650 0x7ff68c036b10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff790000f70 tx=0x7ff790001380 comp rx=0 tx=0).stop 2024-09-13T06:09:55.727 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.723+0000 7ff7a9a12980 1 -- 172.21.15.194:0/3998254141 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5586011e6a60 msgr2=0x5586012dd020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.727 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.723+0000 7ff7a9a12980 1 --2- 172.21.15.194:0/3998254141 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5586011e6a60 0x5586012dd020 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff7a0005cc0 tx=0x7ff7a0017e30 comp rx=0 tx=0).stop 2024-09-13T06:09:55.727 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.723+0000 7ff7a7d23640 1 -- 172.21.15.194:0/3998254141 reap_dead start 2024-09-13T06:09:55.727 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.723+0000 7ff7a9a12980 1 -- 172.21.15.194:0/3998254141 shutdown_connections 2024-09-13T06:09:55.727 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.723+0000 7ff7a9a12980 1 -- 172.21.15.194:0/3998254141 >> 172.21.15.194:0/3998254141 conn(0x5586011e2740 msgr2=0x5586012cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:55.727 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.723+0000 7ff7a9a12980 1 -- 172.21.15.194:0/3998254141 shutdown_connections 2024-09-13T06:09:55.727 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.723+0000 7ff7a9a12980 1 -- 172.21.15.194:0/3998254141 wait complete. 2024-09-13T06:09:55.732 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T06:09:53.191222Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-13T06:09:55.703324Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:09:53.191207Z', 'tags': [], 'group_ids': []} 2024-09-13T06:09:55.732 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T06:09:55.732 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T06:09:55.733 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T06:09:55.812 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:09:55.812 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:09:55.813 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.811+0000 7f83924f7980 1 Processor -- start 2024-09-13T06:09:55.813 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.811+0000 7f83924f7980 1 -- start start 2024-09-13T06:09:55.813 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.811+0000 7f83924f7980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x559e4f93d8e0 0x559e4f93dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.813 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.811+0000 7f83924f7980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559e4f7c3ae0 con 0x559e4f93e230 2024-09-13T06:09:55.814 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.811+0000 7f83924f7980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x559e4f7e7e30 con 0x559e4f93d8e0 2024-09-13T06:09:55.814 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.811+0000 7f8390007640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x559e4f93d8e0 0x559e4f93dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.814 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.811+0000 7f8390007640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x559e4f93d8e0 0x559e4f93dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44900/0 (socket says 172.21.15.194:44900) 2024-09-13T06:09:55.814 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.811+0000 7f8390007640 1 -- 172.21.15.194:0/3634182226 learned_addr learned my addr 172.21.15.194:0/3634182226 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:55.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.815+0000 7f8390007640 1 -- 172.21.15.194:0/3634182226 >> v1:172.21.15.120:6789/0 conn(0x559e4f93e230 legacy=0x559e4f942c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.815+0000 7f8390007640 1 -- 172.21.15.194:0/3634182226 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e4f9454b0 con 0x559e4f93d8e0 2024-09-13T06:09:55.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.815+0000 7f8390007640 1 --2- 172.21.15.194:0/3634182226 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e4f93d8e0 0x559e4f93dcc0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f838000a5c0 tx=0x7f838001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7924b282cc2e0d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.819+0000 7f838f005640 1 -- 172.21.15.194:0/3634182226 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83800a6070 con 0x559e4f93d8e0 2024-09-13T06:09:55.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.819+0000 7f838f005640 1 -- 172.21.15.194:0/3634182226 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83800af070 con 0x559e4f93d8e0 2024-09-13T06:09:55.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.819+0000 7f838f005640 1 -- 172.21.15.194:0/3634182226 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83800aa5c0 con 0x559e4f93d8e0 2024-09-13T06:09:55.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.819+0000 7f83924f7980 1 -- 172.21.15.194:0/3634182226 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e4f93d8e0 msgr2=0x559e4f93dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.819+0000 7f83924f7980 1 --2- 172.21.15.194:0/3634182226 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e4f93d8e0 0x559e4f93dcc0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f838000a5c0 tx=0x7f838001b340 comp rx=0 tx=0).stop 2024-09-13T06:09:55.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.819+0000 7f83924f7980 1 -- 172.21.15.194:0/3634182226 shutdown_connections 2024-09-13T06:09:55.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.819+0000 7f83924f7980 1 --2- 172.21.15.194:0/3634182226 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e4f93d8e0 0x559e4f93dcc0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.819+0000 7f83924f7980 1 -- 172.21.15.194:0/3634182226 >> 172.21.15.194:0/3634182226 conn(0x559e4f8b1230 msgr2=0x559e4f8b1640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:55.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.819+0000 7f83924f7980 1 -- 172.21.15.194:0/3634182226 shutdown_connections 2024-09-13T06:09:55.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.819+0000 7f83924f7980 1 -- 172.21.15.194:0/3634182226 wait complete. 2024-09-13T06:09:55.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.831+0000 7f83924f7980 1 Processor -- start 2024-09-13T06:09:55.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.831+0000 7f83924f7980 1 -- start start 2024-09-13T06:09:55.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.831+0000 7f83924f7980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e4f93e230 0x559e4fa28d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.831+0000 7f83924f7980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x559e4f7e9200 con 0x559e4f93e230 2024-09-13T06:09:55.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.831+0000 7f8390007640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e4f93e230 0x559e4fa28d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.831+0000 7f8390007640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e4f93e230 0x559e4fa28d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44910/0 (socket says 172.21.15.194:44910) 2024-09-13T06:09:55.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.831+0000 7f8390007640 1 -- 172.21.15.194:0/983790677 learned_addr learned my addr 172.21.15.194:0/983790677 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:55.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.831+0000 7f8390007640 1 -- 172.21.15.194:0/983790677 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e4fa29300 con 0x559e4f93e230 2024-09-13T06:09:55.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.831+0000 7f8390007640 1 --2- 172.21.15.194:0/983790677 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e4f93e230 0x559e4fa28d30 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8380018f70 tx=0x7f8380003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2d6b7b27213e3ac server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.831+0000 7f827e60c640 1 -- 172.21.15.194:0/983790677 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83800aa990 con 0x559e4f93e230 2024-09-13T06:09:55.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.831+0000 7f827e60c640 1 -- 172.21.15.194:0/983790677 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83800aab30 con 0x559e4f93e230 2024-09-13T06:09:55.835 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.831+0000 7f827e60c640 1 -- 172.21.15.194:0/983790677 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83800aae10 con 0x559e4f93e230 2024-09-13T06:09:55.836 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.835+0000 7f83924f7980 1 -- 172.21.15.194:0/983790677 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e4f93e230 msgr2=0x559e4fa28d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.836 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.835+0000 7f83924f7980 1 --2- 172.21.15.194:0/983790677 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e4f93e230 0x559e4fa28d30 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8380018f70 tx=0x7f8380003030 comp rx=0 tx=0).stop 2024-09-13T06:09:55.836 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.835+0000 7f83924f7980 1 -- 172.21.15.194:0/983790677 shutdown_connections 2024-09-13T06:09:55.836 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.835+0000 7f83924f7980 1 --2- 172.21.15.194:0/983790677 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e4f93e230 0x559e4fa28d30 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.836 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.835+0000 7f83924f7980 1 -- 172.21.15.194:0/983790677 >> 172.21.15.194:0/983790677 conn(0x559e4f8b1230 msgr2=0x559e4fa248c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:55.836 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.835+0000 7f83924f7980 1 -- 172.21.15.194:0/983790677 shutdown_connections 2024-09-13T06:09:55.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.835+0000 7f83924f7980 1 -- 172.21.15.194:0/983790677 wait complete. 2024-09-13T06:09:55.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.835+0000 7f83924f7980 1 Processor -- start 2024-09-13T06:09:55.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.835+0000 7f83924f7980 1 -- start start 2024-09-13T06:09:55.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.835+0000 7f83924f7980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e4f93e230 0x559e4fa2ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.835+0000 7f83924f7980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x559e4f944ef0 con 0x559e4f93e230 2024-09-13T06:09:55.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.835+0000 7f8390007640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e4f93e230 0x559e4fa2ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.835+0000 7f8390007640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e4f93e230 0x559e4fa2ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44914/0 (socket says 172.21.15.194:44914) 2024-09-13T06:09:55.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.835+0000 7f8390007640 1 -- 172.21.15.194:0/1908211793 learned_addr learned my addr 172.21.15.194:0/1908211793 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:55.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.835+0000 7f8390007640 1 -- 172.21.15.194:0/1908211793 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e4fa30510 con 0x559e4f93e230 2024-09-13T06:09:55.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.835+0000 7f8390007640 1 --2- 172.21.15.194:0/1908211793 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e4f93e230 0x559e4fa2ffd0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8380005aa0 tx=0x7f83800180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.835+0000 7f827ce09640 1 -- 172.21.15.194:0/1908211793 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83800cb030 con 0x559e4f93e230 2024-09-13T06:09:55.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.835+0000 7f827ce09640 1 -- 172.21.15.194:0/1908211793 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8380000e50 con 0x559e4f93e230 2024-09-13T06:09:55.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.835+0000 7f83924f7980 1 -- 172.21.15.194:0/1908211793 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559e4fa307a0 con 0x559e4f93e230 2024-09-13T06:09:55.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.835+0000 7f827ce09640 1 -- 172.21.15.194:0/1908211793 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83800bd930 con 0x559e4f93e230 2024-09-13T06:09:55.840 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.835+0000 7f83924f7980 1 -- 172.21.15.194:0/1908211793 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e4fa33480 con 0x559e4f93e230 2024-09-13T06:09:55.840 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.835+0000 7f827ce09640 1 -- 172.21.15.194:0/1908211793 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f83800ce070 con 0x559e4f93e230 2024-09-13T06:09:55.840 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.839+0000 7f827ce09640 1 --2- 172.21.15.194:0/1908211793 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8278034650 0x7f8278036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.840 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.839+0000 7f827ce09640 1 -- 172.21.15.194:0/1908211793 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f83800cc070 con 0x559e4f93e230 2024-09-13T06:09:55.840 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.839+0000 7f838f806640 1 --2- 172.21.15.194:0/1908211793 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8278034650 0x7f8278036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.840 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.839+0000 7f83924f7980 1 --2- 172.21.15.194:0/1908211793 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x559e4fa34f50 0x559e4fa37340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.840 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.839+0000 7f83924f7980 1 -- 172.21.15.194:0/1908211793 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa37980 con 0x559e4fa34f50 2024-09-13T06:09:55.840 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.839+0000 7f8390808640 1 --2- 172.21.15.194:0/1908211793 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x559e4fa34f50 0x559e4fa37340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.840 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.839+0000 7f838f806640 1 --2- 172.21.15.194:0/1908211793 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8278034650 0x7f8278036b10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f83840012f0 tx=0x7f83840066b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.840 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.839+0000 7f8390808640 1 --2- 172.21.15.194:0/1908211793 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x559e4fa34f50 0x559e4fa37340 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.840 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.839+0000 7f8390808640 1 -- 172.21.15.194:0/1908211793 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f83880083f0 con 0x559e4fa34f50 2024-09-13T06:09:55.840 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.839+0000 7f83924f7980 1 -- 172.21.15.194:0/1908211793 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa38240 con 0x559e4fa34f50 2024-09-13T06:09:55.842 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.839+0000 7f8390808640 1 -- 172.21.15.194:0/1908211793 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f83880083f0 con 0x559e4fa34f50 2024-09-13T06:09:55.842 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.839+0000 7f83924f7980 1 --2- 172.21.15.194:0/1908211793 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x559e4fa39b50 0x559e4fa3bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.843 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.839+0000 7f83924f7980 1 -- 172.21.15.194:0/1908211793 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa3c780 con 0x559e4fa39b50 2024-09-13T06:09:55.843 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.839+0000 7f8390007640 1 --2- 172.21.15.194:0/1908211793 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x559e4fa39b50 0x559e4fa3bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.843 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.839+0000 7f8390007640 1 --2- 172.21.15.194:0/1908211793 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x559e4fa39b50 0x559e4fa3bff0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.843 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.839+0000 7f8390007640 1 -- 172.21.15.194:0/1908211793 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f83800c6a00 con 0x559e4fa39b50 2024-09-13T06:09:55.843 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.839+0000 7f83924f7980 1 -- 172.21.15.194:0/1908211793 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa38a90 con 0x559e4fa34f50 2024-09-13T06:09:55.843 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.839+0000 7f8390808640 1 -- 172.21.15.194:0/1908211793 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f83880083f0 con 0x559e4fa34f50 2024-09-13T06:09:55.843 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.839+0000 7f83924f7980 1 --2- 172.21.15.194:0/1908211793 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x559e4fa3dbe0 0x559e4fa3ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.843 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.839+0000 7f83924f7980 1 -- 172.21.15.194:0/1908211793 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa40740 con 0x559e4fa3dbe0 2024-09-13T06:09:55.843 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.839+0000 7f838f806640 1 --2- 172.21.15.194:0/1908211793 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x559e4fa3dbe0 0x559e4fa3ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.843 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.839+0000 7f838f806640 1 --2- 172.21.15.194:0/1908211793 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x559e4fa3dbe0 0x559e4fa3ffd0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.843 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.839+0000 7f838f806640 1 -- 172.21.15.194:0/1908211793 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f838400f030 con 0x559e4fa3dbe0 2024-09-13T06:09:55.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.839+0000 7f83924f7980 1 Processor -- start 2024-09-13T06:09:55.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.839+0000 7f83924f7980 1 -- start start 2024-09-13T06:09:55.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.839+0000 7f83924f7980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e4fa4e1e0 0x559e4fa4e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.839+0000 7f83924f7980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x559e4f842800 con 0x559e4fa4e1e0 2024-09-13T06:09:55.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.843+0000 7f8390007640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e4fa4e1e0 0x559e4fa4e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.843+0000 7f8390007640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e4fa4e1e0 0x559e4fa4e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44920/0 (socket says 172.21.15.194:44920) 2024-09-13T06:09:55.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.843+0000 7f8390007640 1 -- 172.21.15.194:0/188232408 learned_addr learned my addr 172.21.15.194:0/188232408 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:55.846 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.843+0000 7f8390007640 1 -- 172.21.15.194:0/188232408 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e4fa4eb40 con 0x559e4fa4e1e0 2024-09-13T06:09:55.846 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.843+0000 7f8390007640 1 --2- 172.21.15.194:0/188232408 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e4fa4e1e0 0x559e4fa4e600 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f83800ce000 tx=0x7f83800c6730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.846 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.843+0000 7f8275ffb640 1 -- 172.21.15.194:0/188232408 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83800e58d0 con 0x559e4fa4e1e0 2024-09-13T06:09:55.846 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.843+0000 7f8275ffb640 1 -- 172.21.15.194:0/188232408 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83800e5a70 con 0x559e4fa4e1e0 2024-09-13T06:09:55.847 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.843+0000 7f8275ffb640 1 -- 172.21.15.194:0/188232408 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83800e5d90 con 0x559e4fa4e1e0 2024-09-13T06:09:55.847 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.843+0000 7f83924f7980 1 -- 172.21.15.194:0/188232408 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559e4fa4edd0 con 0x559e4fa4e1e0 2024-09-13T06:09:55.847 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.843+0000 7f83924f7980 1 -- 172.21.15.194:0/188232408 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e4fa4edd0 con 0x559e4fa4e1e0 2024-09-13T06:09:55.847 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.843+0000 7f8275ffb640 1 -- 172.21.15.194:0/188232408 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f83800e5050 con 0x559e4fa4e1e0 2024-09-13T06:09:55.847 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.843+0000 7f8275ffb640 1 --2- 172.21.15.194:0/188232408 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8268034650 0x7f8268036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.847 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.843+0000 7f8275ffb640 1 -- 172.21.15.194:0/188232408 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f83800eec50 con 0x559e4fa4e1e0 2024-09-13T06:09:55.847 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.843+0000 7f838f806640 1 --2- 172.21.15.194:0/188232408 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8268034650 0x7f8268036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.847 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.843+0000 7f83924f7980 1 Processor -- start 2024-09-13T06:09:55.847 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.843+0000 7f83924f7980 1 -- start start 2024-09-13T06:09:55.847 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.843+0000 7f838f806640 1 --2- 172.21.15.194:0/188232408 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8268034650 0x7f8268036b10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x559e4fa3cb20 tx=0x7f8384011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.847 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.843+0000 7f83924f7980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e4fa5a8c0 0x559e4fa5acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.847 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.843+0000 7f83924f7980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x559e4fa295c0 con 0x559e4fa5a8c0 2024-09-13T06:09:55.848 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.843+0000 7f8390007640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e4fa5a8c0 0x559e4fa5acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.848 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.843+0000 7f8390007640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e4fa5a8c0 0x559e4fa5acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44934/0 (socket says 172.21.15.194:44934) 2024-09-13T06:09:55.848 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.843+0000 7f8390007640 1 -- 172.21.15.194:0/1012576688 learned_addr learned my addr 172.21.15.194:0/1012576688 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:55.848 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.847+0000 7f8390007640 1 -- 172.21.15.194:0/1012576688 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e4fa5b290 con 0x559e4fa5a8c0 2024-09-13T06:09:55.850 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.847+0000 7f8390007640 1 --2- 172.21.15.194:0/1012576688 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e4fa5a8c0 0x559e4fa5acc0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f83800a84f0 tx=0x7f83800a83f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=200483d790c606ef server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.850 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.847+0000 7f82677fe640 1 -- 172.21.15.194:0/1012576688 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83800fb030 con 0x559e4fa5a8c0 2024-09-13T06:09:55.850 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.847+0000 7f82677fe640 1 -- 172.21.15.194:0/1012576688 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83800d9e50 con 0x559e4fa5a8c0 2024-09-13T06:09:55.850 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.847+0000 7f82677fe640 1 -- 172.21.15.194:0/1012576688 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83800cfb00 con 0x559e4fa5a8c0 2024-09-13T06:09:55.850 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.847+0000 7f83924f7980 1 -- 172.21.15.194:0/1012576688 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e4fa5a8c0 msgr2=0x559e4fa5acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.850 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.847+0000 7f83924f7980 1 --2- 172.21.15.194:0/1012576688 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e4fa5a8c0 0x559e4fa5acc0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f83800a84f0 tx=0x7f83800a83f0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.847+0000 7f83924f7980 1 -- 172.21.15.194:0/1012576688 shutdown_connections 2024-09-13T06:09:55.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.847+0000 7f83924f7980 1 --2- 172.21.15.194:0/1012576688 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e4fa5a8c0 0x559e4fa5acc0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.847+0000 7f83924f7980 1 -- 172.21.15.194:0/1012576688 >> 172.21.15.194:0/1012576688 conn(0x559e4fa56cf0 msgr2=0x559e4fa54df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:55.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.847+0000 7f83924f7980 1 -- 172.21.15.194:0/1012576688 shutdown_connections 2024-09-13T06:09:55.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.847+0000 7f83924f7980 1 -- 172.21.15.194:0/1012576688 wait complete. 2024-09-13T06:09:55.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.847+0000 7f83924f7980 1 Processor -- start 2024-09-13T06:09:55.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.847+0000 7f83924f7980 1 -- start start 2024-09-13T06:09:55.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.847+0000 7f83924f7980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e4fa5a8c0 0x559e4fa61950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.847+0000 7f83924f7980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x559e4fa5b290 con 0x559e4fa5a8c0 2024-09-13T06:09:55.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.847+0000 7f8390007640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e4fa5a8c0 0x559e4fa61950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.847+0000 7f8390007640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e4fa5a8c0 0x559e4fa61950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44948/0 (socket says 172.21.15.194:44948) 2024-09-13T06:09:55.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.847+0000 7f8390007640 1 -- 172.21.15.194:0/2254401930 learned_addr learned my addr 172.21.15.194:0/2254401930 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:55.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.847+0000 7f8390007640 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e4fa61e90 con 0x559e4fa5a8c0 2024-09-13T06:09:55.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.847+0000 7f8390007640 1 --2- 172.21.15.194:0/2254401930 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e4fa5a8c0 0x559e4fa61950 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f83800d0000 tx=0x7f83800a8460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.847+0000 7f8265ffb640 1 -- 172.21.15.194:0/2254401930 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83800ade30 con 0x559e4fa5a8c0 2024-09-13T06:09:55.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.847+0000 7f83924f7980 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559e4fa61e90 con 0x559e4fa5a8c0 2024-09-13T06:09:55.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.847+0000 7f8265ffb640 1 -- 172.21.15.194:0/2254401930 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83800b5530 con 0x559e4fa5a8c0 2024-09-13T06:09:55.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.847+0000 7f8265ffb640 1 -- 172.21.15.194:0/2254401930 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83800b5810 con 0x559e4fa5a8c0 2024-09-13T06:09:55.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.847+0000 7f83924f7980 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e4fa61e90 con 0x559e4fa5a8c0 2024-09-13T06:09:55.856 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.851+0000 7f83924f7980 20 rados->read ofs=0 len=0 2024-09-13T06:09:55.857 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.851+0000 7f8265ffb640 1 -- 172.21.15.194:0/2254401930 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f838010f020 con 0x559e4fa5a8c0 2024-09-13T06:09:55.857 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.851+0000 7f8265ffb640 1 --2- 172.21.15.194:0/2254401930 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8258034650 0x7f8258036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.857 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.851+0000 7f8265ffb640 1 -- 172.21.15.194:0/2254401930 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f83800fe070 con 0x559e4fa5a8c0 2024-09-13T06:09:55.857 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.851+0000 7f838f806640 1 --2- 172.21.15.194:0/2254401930 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8258034650 0x7f8258036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.857 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.851+0000 7f83924f7980 1 --2- 172.21.15.194:0/2254401930 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x559e4fa6c870 0x559e4fa6ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.857 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.851+0000 7f83924f7980 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa6f480 con 0x559e4fa6c870 2024-09-13T06:09:55.857 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.851+0000 7f8390808640 1 --2- 172.21.15.194:0/2254401930 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x559e4fa6c870 0x559e4fa6ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.857 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.851+0000 7f838f806640 1 --2- 172.21.15.194:0/2254401930 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8258034650 0x7f8258036b10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x559e4fa40b20 tx=0x7f8384012000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.857 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.851+0000 7f8390808640 1 --2- 172.21.15.194:0/2254401930 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x559e4fa6c870 0x559e4fa6ed30 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.857 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.851+0000 7f8390808640 1 -- 172.21.15.194:0/2254401930 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f83880083f0 con 0x559e4fa6c870 2024-09-13T06:09:55.857 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.851+0000 7f83924f7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:55.857 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.851+0000 7f83924f7980 20 realm 2024-09-13T06:09:55.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.851+0000 7f83924f7980 20 rados->read ofs=0 len=0 2024-09-13T06:09:55.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.851+0000 7f83924f7980 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa6f8e0 con 0x559e4fa6c870 2024-09-13T06:09:55.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.851+0000 7f8390808640 1 -- 172.21.15.194:0/2254401930 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f83880083f0 con 0x559e4fa6c870 2024-09-13T06:09:55.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.851+0000 7f83924f7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:55.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.851+0000 7f83924f7980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:09:55.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.851+0000 7f83924f7980 20 rados->read ofs=0 len=0 2024-09-13T06:09:55.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.851+0000 7f83924f7980 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa70180 con 0x559e4fa6c870 2024-09-13T06:09:55.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.851+0000 7f8390808640 1 -- 172.21.15.194:0/2254401930 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f83880083f0 con 0x559e4fa6c870 2024-09-13T06:09:55.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.851+0000 7f83924f7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:55.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.851+0000 7f83924f7980 20 rados->read ofs=0 len=0 2024-09-13T06:09:55.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.851+0000 7f83924f7980 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa70520 con 0x559e4fa6c870 2024-09-13T06:09:55.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.851+0000 7f8390808640 1 -- 172.21.15.194:0/2254401930 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f83880083f0 con 0x559e4fa6c870 2024-09-13T06:09:55.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.851+0000 7f83924f7980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:55.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.851+0000 7f83924f7980 20 rados->read ofs=0 len=0 2024-09-13T06:09:55.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.851+0000 7f83924f7980 1 --2- 172.21.15.194:0/2254401930 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x559e4fa71280 0x559e4fa73670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.851+0000 7f83924f7980 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa73bf0 con 0x559e4fa71280 2024-09-13T06:09:55.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.851+0000 7f8390007640 1 --2- 172.21.15.194:0/2254401930 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x559e4fa71280 0x559e4fa73670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.851+0000 7f8390007640 1 --2- 172.21.15.194:0/2254401930 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x559e4fa71280 0x559e4fa73670 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.851+0000 7f8390007640 1 -- 172.21.15.194:0/2254401930 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f83800c6a00 con 0x559e4fa71280 2024-09-13T06:09:55.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.851+0000 7f83924f7980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:09:55.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.851+0000 7f83924f7980 20 searching for the correct realm 2024-09-13T06:09:55.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.851+0000 7f83924f7980 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa75450 con 0x559e4fa71280 2024-09-13T06:09:55.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.851+0000 7f8390007640 1 -- 172.21.15.194:0/2254401930 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83800c6a00 con 0x559e4fa71280 2024-09-13T06:09:55.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.851+0000 7f8390007640 1 --2- 172.21.15.194:0/2254401930 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f83800d0030 0x7f83800f1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.851+0000 7f8390007640 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa75450 con 0x7f83800d0030 2024-09-13T06:09:55.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.851+0000 7f838f806640 1 --2- 172.21.15.194:0/2254401930 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f83800d0030 0x7f83800f1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.851+0000 7f838f806640 1 --2- 172.21.15.194:0/2254401930 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f83800d0030 0x7f83800f1310 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.851+0000 7f838f806640 1 -- 172.21.15.194:0/2254401930 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8384021040 con 0x7f83800d0030 2024-09-13T06:09:55.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.851+0000 7f838f806640 1 --2- 172.21.15.194:0/2254401930 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f8384013040 0x7f83840243c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.855+0000 7f838f806640 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa75450 con 0x7f8384013040 2024-09-13T06:09:55.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.855+0000 7f8390808640 1 --2- 172.21.15.194:0/2254401930 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f8384013040 0x7f83840243c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.855+0000 7f8390808640 1 --2- 172.21.15.194:0/2254401930 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f8384013040 0x7f83840243c0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.855+0000 7f8390808640 1 -- 172.21.15.194:0/2254401930 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83880083f0 con 0x7f8384013040 2024-09-13T06:09:55.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.855+0000 7f8390808640 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa70520 con 0x559e4fa6c870 2024-09-13T06:09:55.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.855+0000 7f8390808640 1 -- 172.21.15.194:0/2254401930 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83880083f0 con 0x559e4fa6c870 2024-09-13T06:09:55.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.855+0000 7f8390808640 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa70520 con 0x559e4fa6c870 2024-09-13T06:09:55.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.855+0000 7f8390808640 1 -- 172.21.15.194:0/2254401930 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83880083f0 con 0x559e4fa6c870 2024-09-13T06:09:55.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.855+0000 7f8390808640 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa70520 con 0x7f8384013040 2024-09-13T06:09:55.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.855+0000 7f8390808640 1 -- 172.21.15.194:0/2254401930 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83880083f0 con 0x7f8384013040 2024-09-13T06:09:55.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.855+0000 7f8390808640 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa70520 con 0x7f8384013040 2024-09-13T06:09:55.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.855+0000 7f8390808640 1 -- 172.21.15.194:0/2254401930 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83880083f0 con 0x7f8384013040 2024-09-13T06:09:55.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.855+0000 7f8390808640 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa70520 con 0x7f83800d0030 2024-09-13T06:09:55.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.855+0000 7f838f806640 1 -- 172.21.15.194:0/2254401930 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8384021040 con 0x7f83800d0030 2024-09-13T06:09:55.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.855+0000 7f838f806640 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa70520 con 0x559e4fa71280 2024-09-13T06:09:55.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.855+0000 7f8390007640 1 -- 172.21.15.194:0/2254401930 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83800c6a00 con 0x559e4fa71280 2024-09-13T06:09:55.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.855+0000 7f8390007640 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa70520 con 0x559e4fa6c870 2024-09-13T06:09:55.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.859+0000 7f8390808640 1 -- 172.21.15.194:0/2254401930 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83880083f0 con 0x559e4fa6c870 2024-09-13T06:09:55.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.859+0000 7f8390808640 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa70520 con 0x7f8384013040 2024-09-13T06:09:55.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.859+0000 7f8390808640 1 -- 172.21.15.194:0/2254401930 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83880083f0 con 0x7f8384013040 2024-09-13T06:09:55.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.859+0000 7f8390808640 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa70520 con 0x559e4fa6c870 2024-09-13T06:09:55.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.859+0000 7f8390808640 1 -- 172.21.15.194:0/2254401930 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83880083f0 con 0x559e4fa6c870 2024-09-13T06:09:55.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.859+0000 7f8390808640 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa70520 con 0x7f83800d0030 2024-09-13T06:09:55.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.859+0000 7f838f806640 1 -- 172.21.15.194:0/2254401930 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8384041040 con 0x7f83800d0030 2024-09-13T06:09:55.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.859+0000 7f838f806640 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa70520 con 0x559e4fa71280 2024-09-13T06:09:55.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.859+0000 7f8390007640 1 -- 172.21.15.194:0/2254401930 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83800c6a00 con 0x559e4fa71280 2024-09-13T06:09:55.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.859+0000 7f8390007640 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa70520 con 0x559e4fa71280 2024-09-13T06:09:55.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.859+0000 7f8390007640 1 -- 172.21.15.194:0/2254401930 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83800c6a00 con 0x559e4fa71280 2024-09-13T06:09:55.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.859+0000 7f8390007640 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa70520 con 0x7f8384013040 2024-09-13T06:09:55.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.859+0000 7f8390808640 1 -- 172.21.15.194:0/2254401930 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83880083f0 con 0x7f8384013040 2024-09-13T06:09:55.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.859+0000 7f8390808640 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa70520 con 0x559e4fa71280 2024-09-13T06:09:55.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.859+0000 7f8390007640 1 -- 172.21.15.194:0/2254401930 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83800c6a00 con 0x559e4fa71280 2024-09-13T06:09:55.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.859+0000 7f8390007640 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa70520 con 0x559e4fa71280 2024-09-13T06:09:55.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.859+0000 7f8390007640 1 -- 172.21.15.194:0/2254401930 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83800c6a00 con 0x559e4fa71280 2024-09-13T06:09:55.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.859+0000 7f8390007640 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa70520 con 0x559e4fa6c870 2024-09-13T06:09:55.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.859+0000 7f8390808640 1 -- 172.21.15.194:0/2254401930 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83880083f0 con 0x559e4fa6c870 2024-09-13T06:09:55.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.859+0000 7f8390808640 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa70520 con 0x559e4fa6c870 2024-09-13T06:09:55.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.859+0000 7f8390808640 1 -- 172.21.15.194:0/2254401930 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f83880083f0 con 0x559e4fa6c870 2024-09-13T06:09:55.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.859+0000 7f8390808640 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa70520 con 0x7f8384013040 2024-09-13T06:09:55.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.863+0000 7f8390808640 1 -- 172.21.15.194:0/2254401930 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83880083f0 con 0x7f8384013040 2024-09-13T06:09:55.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.863+0000 7f8390808640 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa70520 con 0x559e4fa71280 2024-09-13T06:09:55.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.863+0000 7f8390007640 1 -- 172.21.15.194:0/2254401930 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83800c6a00 con 0x559e4fa71280 2024-09-13T06:09:55.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.863+0000 7f8390007640 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa70520 con 0x7f83800d0030 2024-09-13T06:09:55.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.863+0000 7f838f806640 1 -- 172.21.15.194:0/2254401930 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8384041040 con 0x7f83800d0030 2024-09-13T06:09:55.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.863+0000 7f838f806640 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa70520 con 0x559e4fa6c870 2024-09-13T06:09:55.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.863+0000 7f8390808640 1 -- 172.21.15.194:0/2254401930 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83880083f0 con 0x559e4fa6c870 2024-09-13T06:09:55.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.863+0000 7f8390808640 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa70520 con 0x7f8384013040 2024-09-13T06:09:55.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.863+0000 7f8390808640 1 -- 172.21.15.194:0/2254401930 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83880083f0 con 0x7f8384013040 2024-09-13T06:09:55.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.863+0000 7f8390808640 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa70520 con 0x559e4fa71280 2024-09-13T06:09:55.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.863+0000 7f8390007640 1 -- 172.21.15.194:0/2254401930 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f83800c6a00 con 0x559e4fa71280 2024-09-13T06:09:55.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.863+0000 7f8390007640 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa70520 con 0x7f8384013040 2024-09-13T06:09:55.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.863+0000 7f8390808640 1 -- 172.21.15.194:0/2254401930 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83880083f0 con 0x7f8384013040 2024-09-13T06:09:55.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.863+0000 7f8390808640 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa70520 con 0x7f83800d0030 2024-09-13T06:09:55.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.863+0000 7f838f806640 1 -- 172.21.15.194:0/2254401930 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8384041040 con 0x7f83800d0030 2024-09-13T06:09:55.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.863+0000 7f838f806640 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa70520 con 0x559e4fa71280 2024-09-13T06:09:55.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.863+0000 7f8390007640 1 -- 172.21.15.194:0/2254401930 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83800c6a00 con 0x559e4fa71280 2024-09-13T06:09:55.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.863+0000 7f8390007640 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa70520 con 0x7f8384013040 2024-09-13T06:09:55.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.863+0000 7f8390808640 1 -- 172.21.15.194:0/2254401930 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83880083f0 con 0x7f8384013040 2024-09-13T06:09:55.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.863+0000 7f8390808640 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa70520 con 0x559e4fa6c870 2024-09-13T06:09:55.873 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.863+0000 7f8390808640 1 -- 172.21.15.194:0/2254401930 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f83880083f0 con 0x559e4fa6c870 2024-09-13T06:09:55.873 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.863+0000 7f8390808640 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa70520 con 0x7f83800d0030 2024-09-13T06:09:55.873 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.867+0000 7f838f806640 1 -- 172.21.15.194:0/2254401930 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8384041040 con 0x7f83800d0030 2024-09-13T06:09:55.873 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.867+0000 7f83924f7980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:09:55.873 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.867+0000 7f83924f7980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:09:55.873 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.867+0000 7f83924f7980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:09:55.873 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.867+0000 7f83924f7980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:09:55.873 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.867+0000 7f83924f7980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:09:55.873 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.867+0000 7f83924f7980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:09:55.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.867+0000 7f83924f7980 20 rados->read ofs=0 len=0 2024-09-13T06:09:55.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.867+0000 7f83924f7980 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa74570 con 0x559e4fa6c870 2024-09-13T06:09:55.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.867+0000 7f8390808640 1 -- 172.21.15.194:0/2254401930 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f83880083f0 con 0x559e4fa6c870 2024-09-13T06:09:55.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.867+0000 7f83924f7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:55.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.867+0000 7f83924f7980 20 rados->read ofs=0 len=0 2024-09-13T06:09:55.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.867+0000 7f83924f7980 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa74e10 con 0x559e4fa6c870 2024-09-13T06:09:55.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.867+0000 7f8390808640 1 -- 172.21.15.194:0/2254401930 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f83880083f0 con 0x559e4fa6c870 2024-09-13T06:09:55.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.867+0000 7f83924f7980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:55.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.867+0000 7f83924f7980 20 rados->read ofs=0 len=0 2024-09-13T06:09:55.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.867+0000 7f83924f7980 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa741b0 con 0x7f83800d0030 2024-09-13T06:09:55.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.867+0000 7f838f806640 1 -- 172.21.15.194:0/2254401930 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8384041040 con 0x7f83800d0030 2024-09-13T06:09:55.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.867+0000 7f83924f7980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:09:55.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.867+0000 7f83924f7980 20 zone default found 2024-09-13T06:09:55.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.867+0000 7f83924f7980 4 Realm: () 2024-09-13T06:09:55.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.867+0000 7f83924f7980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:09:55.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.867+0000 7f83924f7980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:09:55.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.867+0000 7f83924f7980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:09:55.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.867+0000 7f83924f7980 20 zonegroup default 2024-09-13T06:09:55.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.867+0000 7f83924f7980 20 rados->read ofs=0 len=0 2024-09-13T06:09:55.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.867+0000 7f83924f7980 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa74e10 con 0x7f8384013040 2024-09-13T06:09:55.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.867+0000 7f8390808640 1 -- 172.21.15.194:0/2254401930 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f83880083f0 con 0x7f8384013040 2024-09-13T06:09:55.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.867+0000 7f83924f7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:55.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.867+0000 7f83924f7980 20 rados->read ofs=0 len=0 2024-09-13T06:09:55.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.867+0000 7f83924f7980 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa772d0 con 0x559e4fa71280 2024-09-13T06:09:55.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.867+0000 7f8390007640 1 -- 172.21.15.194:0/2254401930 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f83800c6a00 con 0x559e4fa71280 2024-09-13T06:09:55.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.867+0000 7f83924f7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:55.876 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.867+0000 7f83924f7980 20 rados->read ofs=0 len=0 2024-09-13T06:09:55.876 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.867+0000 7f83924f7980 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa77670 con 0x559e4fa71280 2024-09-13T06:09:55.876 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.867+0000 7f8390007640 1 -- 172.21.15.194:0/2254401930 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f83800c6a00 con 0x559e4fa71280 2024-09-13T06:09:55.876 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.867+0000 7f83924f7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:55.876 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.867+0000 7f83924f7980 20 started sync module instance, tier type = 2024-09-13T06:09:55.876 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.867+0000 7f83924f7980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:09:55.876 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.867+0000 7f83924f7980 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa76770 con 0x7f83800d0030 2024-09-13T06:09:55.876 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.867+0000 7f838f806640 1 -- 172.21.15.194:0/2254401930 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(44 notify.0 [create] v33'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8384041040 con 0x7f83800d0030 2024-09-13T06:09:55.876 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.867+0000 7f83924f7980 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94138429565840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa763d0 con 0x7f83800d0030 2024-09-13T06:09:55.876 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.867+0000 7f83924f7980 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa784e0 con 0x559e4fa6c870 2024-09-13T06:09:55.876 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.871+0000 7f838f806640 1 -- 172.21.15.194:0/2254401930 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94138429565840] v33'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8384041040 con 0x7f83800d0030 2024-09-13T06:09:55.876 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.871+0000 7f8390808640 1 -- 172.21.15.194:0/2254401930 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v33'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83880083f0 con 0x559e4fa6c870 2024-09-13T06:09:55.876 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.871+0000 7f83924f7980 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94138429571120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa78450 con 0x559e4fa6c870 2024-09-13T06:09:55.877 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.871+0000 7f83924f7980 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa79230 con 0x559e4fa71280 2024-09-13T06:09:55.878 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.871+0000 7f8390808640 1 -- 172.21.15.194:0/2254401930 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94138429571120] v33'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83880083f0 con 0x559e4fa6c870 2024-09-13T06:09:55.878 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.871+0000 7f8390007640 1 -- 172.21.15.194:0/2254401930 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v33'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83800c6a00 con 0x559e4fa71280 2024-09-13T06:09:55.878 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.871+0000 7f83924f7980 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94138429573328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa79620 con 0x559e4fa71280 2024-09-13T06:09:55.878 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.871+0000 7f83924f7980 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa79fe0 con 0x7f83800d0030 2024-09-13T06:09:55.878 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.875+0000 7f838f806640 1 -- 172.21.15.194:0/2254401930 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(50 notify.3 [create] v33'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8384041040 con 0x7f83800d0030 2024-09-13T06:09:55.878 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.875+0000 7f83924f7980 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94138429580160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa7ac50 con 0x7f83800d0030 2024-09-13T06:09:55.878 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.875+0000 7f83924f7980 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa7b610 con 0x559e4fa6c870 2024-09-13T06:09:55.878 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.875+0000 7f8390007640 1 -- 172.21.15.194:0/2254401930 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94138429573328] v33'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83800c6a00 con 0x559e4fa71280 2024-09-13T06:09:55.878 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.875+0000 7f838f806640 1 -- 172.21.15.194:0/2254401930 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94138429580160] v33'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8384041040 con 0x7f83800d0030 2024-09-13T06:09:55.879 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.875+0000 7f8390808640 1 -- 172.21.15.194:0/2254401930 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v33'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83880083f0 con 0x559e4fa6c870 2024-09-13T06:09:55.879 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.875+0000 7f83924f7980 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94138429574384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa7a8b0 con 0x559e4fa6c870 2024-09-13T06:09:55.879 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.875+0000 7f83924f7980 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa7bd90 con 0x7f8384013040 2024-09-13T06:09:55.879 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.879+0000 7f8390808640 1 -- 172.21.15.194:0/2254401930 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94138429574384] v33'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83880083f0 con 0x559e4fa6c870 2024-09-13T06:09:55.879 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.879+0000 7f8390808640 1 -- 172.21.15.194:0/2254401930 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(54 notify.5 [create] v33'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83880083f0 con 0x7f8384013040 2024-09-13T06:09:55.879 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.879+0000 7f83924f7980 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94138429585504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa7bd50 con 0x7f8384013040 2024-09-13T06:09:55.880 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.879+0000 7f83924f7980 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa7c7a0 con 0x7f8384013040 2024-09-13T06:09:55.881 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.879+0000 7f8390808640 1 -- 172.21.15.194:0/2254401930 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(56 notify.6 [create] v33'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83880083f0 con 0x7f8384013040 2024-09-13T06:09:55.881 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.879+0000 7f83924f7980 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94138429588208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa7cbc0 con 0x7f8384013040 2024-09-13T06:09:55.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.879+0000 7f83924f7980 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa7d610 con 0x7f8384013040 2024-09-13T06:09:55.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.879+0000 7f8390808640 1 -- 172.21.15.194:0/2254401930 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94138429585504] v33'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83880083f0 con 0x7f8384013040 2024-09-13T06:09:55.883 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.883+0000 7f8390808640 1 -- 172.21.15.194:0/2254401930 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94138429588208] v33'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83880083f0 con 0x7f8384013040 2024-09-13T06:09:55.883 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.883+0000 7f8390808640 1 -- 172.21.15.194:0/2254401930 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(58 notify.7 [create] v33'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83880083f0 con 0x7f8384013040 2024-09-13T06:09:55.884 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.883+0000 7f83924f7980 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94138429589264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa7b160 con 0x7f8384013040 2024-09-13T06:09:55.884 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.883+0000 7f83924f7980 20 add_watcher() i=0 2024-09-13T06:09:55.884 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.883+0000 7f83924f7980 20 add_watcher() i=1 2024-09-13T06:09:55.884 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.883+0000 7f83924f7980 20 add_watcher() i=2 2024-09-13T06:09:55.884 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.883+0000 7f83924f7980 20 add_watcher() i=3 2024-09-13T06:09:55.884 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.883+0000 7f83924f7980 20 add_watcher() i=4 2024-09-13T06:09:55.884 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.883+0000 7f83924f7980 20 add_watcher() i=5 2024-09-13T06:09:55.884 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.883+0000 7f83924f7980 20 add_watcher() i=6 2024-09-13T06:09:55.885 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.883+0000 7f8390808640 1 -- 172.21.15.194:0/2254401930 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94138429589264] v33'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83880083f0 con 0x7f8384013040 2024-09-13T06:09:55.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.883+0000 7f83924f7980 20 add_watcher() i=7 2024-09-13T06:09:55.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.883+0000 7f83924f7980 2 all 8 watchers are set, enabling cache 2024-09-13T06:09:55.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.883+0000 7f83924f7980 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa80600 con 0x559e4fa6c870 2024-09-13T06:09:55.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.883+0000 7f8390808640 1 -- 172.21.15.194:0/2254401930 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f83880083f0 con 0x559e4fa6c870 2024-09-13T06:09:55.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.883+0000 7f83924f7980 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94138429591808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa7dab0 con 0x559e4fa6c870 2024-09-13T06:09:55.887 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.887+0000 7f8390808640 1 -- 172.21.15.194:0/2254401930 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94138429591808] v33'80 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f83880083f0 con 0x559e4fa6c870 2024-09-13T06:09:55.887 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.887+0000 7f82467e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:55.887 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.887+0000 7f83924f7980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:09:55.887 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.887+0000 7f83924f7980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:09:55.888 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.887+0000 7f83924f7980 5 note: GC not initialized 2024-09-13T06:09:55.888 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.887+0000 7f82457e2640 20 reqs_thread_entry: start 2024-09-13T06:09:55.888 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.887+0000 7f83924f7980 20 init_complete bucket index max shards: 11 2024-09-13T06:09:55.888 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.887+0000 7f83924f7980 20 Filter name: none 2024-09-13T06:09:55.888 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.887+0000 7f81b6ffd640 20 reqs_thread_entry: start 2024-09-13T06:09:55.888 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.887+0000 7f83924f7980 20 rados->read ofs=0 len=0 2024-09-13T06:09:55.888 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.887+0000 7f83924f7980 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559e4faa36c0 con 0x559e4fa6c870 2024-09-13T06:09:55.889 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.887+0000 7f8390808640 1 -- 172.21.15.194:0/2254401930 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7f83880083f0 con 0x559e4fa6c870 2024-09-13T06:09:55.889 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.887+0000 7f83924f7980 20 rados_obj.operate() r=0 bl.length=673 2024-09-13T06:09:55.889 INFO:teuthology.orchestra.run.smithi194.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T06:09:53.191222Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-13T06:09:55.703324Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:09:53.191207Z","tags":[],"group_ids":[]} 2024-09-13T06:09:55.890 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.887+0000 7f82467e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:55.890 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.887+0000 7f83924f7980 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94138429591808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559e4faa3c00 con 0x559e4fa6c870 2024-09-13T06:09:55.890 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.887+0000 7f8390808640 1 -- 172.21.15.194:0/2254401930 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94138429591808] v33'81 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f83880083f0 con 0x559e4fa6c870 2024-09-13T06:09:55.890 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.887+0000 7f83924f7980 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94138429565840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa7d100 con 0x7f83800d0030 2024-09-13T06:09:55.891 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.891+0000 7f838f806640 1 -- 172.21.15.194:0/2254401930 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94138429565840] v33'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8384041040 con 0x7f83800d0030 2024-09-13T06:09:55.891 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.891+0000 7f83924f7980 20 remove_watcher() i=0 2024-09-13T06:09:55.891 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.891+0000 7f83924f7980 2 removed watcher, disabling cache 2024-09-13T06:09:55.891 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.891+0000 7f83924f7980 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94138429571120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa7d100 con 0x559e4fa6c870 2024-09-13T06:09:55.893 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.891+0000 7f8390808640 1 -- 172.21.15.194:0/2254401930 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94138429571120] v33'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83880083f0 con 0x559e4fa6c870 2024-09-13T06:09:55.893 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.891+0000 7f83924f7980 20 remove_watcher() i=1 2024-09-13T06:09:55.893 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.891+0000 7f83924f7980 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94138429573328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa78030 con 0x559e4fa71280 2024-09-13T06:09:55.895 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.895+0000 7f8390007640 1 -- 172.21.15.194:0/2254401930 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94138429573328] v33'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83800c6a00 con 0x559e4fa71280 2024-09-13T06:09:55.895 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.895+0000 7f83924f7980 20 remove_watcher() i=2 2024-09-13T06:09:55.896 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.895+0000 7f83924f7980 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94138429580160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa7d100 con 0x7f83800d0030 2024-09-13T06:09:55.896 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.895+0000 7f838f806640 1 -- 172.21.15.194:0/2254401930 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94138429580160] v33'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8384041040 con 0x7f83800d0030 2024-09-13T06:09:55.896 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.895+0000 7f83924f7980 20 remove_watcher() i=3 2024-09-13T06:09:55.896 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.895+0000 7f83924f7980 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94138429574384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa788d0 con 0x559e4fa6c870 2024-09-13T06:09:55.898 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.899+0000 7f8390808640 1 -- 172.21.15.194:0/2254401930 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94138429574384] v33'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83880083f0 con 0x559e4fa6c870 2024-09-13T06:09:55.898 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.899+0000 7f83924f7980 20 remove_watcher() i=4 2024-09-13T06:09:55.898 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.899+0000 7f83924f7980 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94138429585504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa78030 con 0x7f8384013040 2024-09-13T06:09:55.901 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.899+0000 7f8390808640 1 -- 172.21.15.194:0/2254401930 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94138429585504] v33'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83880083f0 con 0x7f8384013040 2024-09-13T06:09:55.901 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.899+0000 7f83924f7980 20 remove_watcher() i=5 2024-09-13T06:09:55.901 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.899+0000 7f83924f7980 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94138429588208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa7a380 con 0x7f8384013040 2024-09-13T06:09:55.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.903+0000 7f8390808640 1 -- 172.21.15.194:0/2254401930 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94138429588208] v33'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83880083f0 con 0x7f8384013040 2024-09-13T06:09:55.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.903+0000 7f83924f7980 20 remove_watcher() i=6 2024-09-13T06:09:55.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.903+0000 7f83924f7980 1 -- 172.21.15.194:0/2254401930 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94138429589264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559e4fa7d100 con 0x7f8384013040 2024-09-13T06:09:55.907 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.903+0000 7f8390808640 1 -- 172.21.15.194:0/2254401930 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94138429589264] v33'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83880083f0 con 0x7f8384013040 2024-09-13T06:09:55.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.903+0000 7f83924f7980 20 remove_watcher() i=7 2024-09-13T06:09:55.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.903+0000 7f83924f7980 1 -- 172.21.15.194:0/2254401930 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f8384013040 msgr2=0x7f83840243c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.903+0000 7f83924f7980 1 --2- 172.21.15.194:0/2254401930 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f8384013040 0x7f83840243c0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.903+0000 7f83924f7980 1 -- 172.21.15.194:0/2254401930 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x559e4fa6c870 msgr2=0x559e4fa6ed30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.903+0000 7f83924f7980 1 --2- 172.21.15.194:0/2254401930 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x559e4fa6c870 0x559e4fa6ed30 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.903+0000 7f83924f7980 1 -- 172.21.15.194:0/2254401930 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f83800d0030 msgr2=0x7f83800f1310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.903+0000 7f83924f7980 1 --2- 172.21.15.194:0/2254401930 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f83800d0030 0x7f83800f1310 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.903+0000 7f83924f7980 1 -- 172.21.15.194:0/2254401930 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x559e4fa71280 msgr2=0x559e4fa73670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.903+0000 7f83924f7980 1 --2- 172.21.15.194:0/2254401930 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x559e4fa71280 0x559e4fa73670 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.903+0000 7f83924f7980 1 -- 172.21.15.194:0/2254401930 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8258034650 msgr2=0x7f8258036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.903+0000 7f83924f7980 1 --2- 172.21.15.194:0/2254401930 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8258034650 0x7f8258036b10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x559e4fa40b20 tx=0x7f8384012000 comp rx=0 tx=0).stop 2024-09-13T06:09:55.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.903+0000 7f8390808640 1 -- 172.21.15.194:0/2254401930 reap_dead start 2024-09-13T06:09:55.909 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.903+0000 7f83924f7980 1 -- 172.21.15.194:0/2254401930 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e4fa5a8c0 msgr2=0x559e4fa61950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.909 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.903+0000 7f83924f7980 1 --2- 172.21.15.194:0/2254401930 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e4fa5a8c0 0x559e4fa61950 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f83800d0000 tx=0x7f83800a8460 comp rx=0 tx=0).stop 2024-09-13T06:09:55.909 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.903+0000 7f83924f7980 1 -- 172.21.15.194:0/2254401930 shutdown_connections 2024-09-13T06:09:55.909 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.903+0000 7f83924f7980 1 --2- 172.21.15.194:0/2254401930 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e4fa5a8c0 0x559e4fa61950 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.909 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.903+0000 7f83924f7980 1 -- 172.21.15.194:0/2254401930 >> 172.21.15.194:0/2254401930 conn(0x559e4fa56cf0 msgr2=0x559e4fa54dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:55.909 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.903+0000 7f83924f7980 1 -- 172.21.15.194:0/2254401930 shutdown_connections 2024-09-13T06:09:55.909 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.903+0000 7f83924f7980 1 -- 172.21.15.194:0/2254401930 wait complete. 2024-09-13T06:09:55.909 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.903+0000 7f83924f7980 1 -- 172.21.15.194:0/188232408 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8268034650 msgr2=0x7f8268036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.909 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.903+0000 7f83924f7980 1 --2- 172.21.15.194:0/188232408 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8268034650 0x7f8268036b10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x559e4fa3cb20 tx=0x7f8384011000 comp rx=0 tx=0).stop 2024-09-13T06:09:55.909 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.903+0000 7f83924f7980 1 -- 172.21.15.194:0/188232408 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e4fa4e1e0 msgr2=0x559e4fa4e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.909 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.903+0000 7f83924f7980 1 --2- 172.21.15.194:0/188232408 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e4fa4e1e0 0x559e4fa4e600 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f83800ce000 tx=0x7f83800c6730 comp rx=0 tx=0).stop 2024-09-13T06:09:55.909 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.903+0000 7f83924f7980 1 -- 172.21.15.194:0/188232408 shutdown_connections 2024-09-13T06:09:55.910 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.903+0000 7f83924f7980 1 --2- 172.21.15.194:0/188232408 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8268034650 0x7f8268036b10 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.910 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.903+0000 7f83924f7980 1 --2- 172.21.15.194:0/188232408 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e4fa4e1e0 0x559e4fa4e600 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.910 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.903+0000 7f83924f7980 1 -- 172.21.15.194:0/188232408 >> 172.21.15.194:0/188232408 conn(0x559e4fa43330 msgr2=0x559e4fa45db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:55.910 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.903+0000 7f83924f7980 1 -- 172.21.15.194:0/188232408 shutdown_connections 2024-09-13T06:09:55.910 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.903+0000 7f83924f7980 1 -- 172.21.15.194:0/188232408 wait complete. 2024-09-13T06:09:55.910 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.903+0000 7f83924f7980 1 -- 172.21.15.194:0/1908211793 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x559e4fa34f50 msgr2=0x559e4fa37340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.910 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.903+0000 7f83924f7980 1 --2- 172.21.15.194:0/1908211793 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x559e4fa34f50 0x559e4fa37340 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.910 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.903+0000 7f83924f7980 1 -- 172.21.15.194:0/1908211793 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x559e4fa3dbe0 msgr2=0x559e4fa3ffd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.910 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.903+0000 7f83924f7980 1 --2- 172.21.15.194:0/1908211793 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x559e4fa3dbe0 0x559e4fa3ffd0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.910 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.903+0000 7f83924f7980 1 -- 172.21.15.194:0/1908211793 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x559e4fa39b50 msgr2=0x559e4fa3bff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.910 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.903+0000 7f83924f7980 1 --2- 172.21.15.194:0/1908211793 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x559e4fa39b50 0x559e4fa3bff0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.910 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.907+0000 7f83924f7980 1 -- 172.21.15.194:0/1908211793 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8278034650 msgr2=0x7f8278036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.910 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.907+0000 7f83924f7980 1 --2- 172.21.15.194:0/1908211793 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8278034650 0x7f8278036b10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f83840012f0 tx=0x7f83840066b0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.911 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.907+0000 7f83924f7980 1 -- 172.21.15.194:0/1908211793 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e4f93e230 msgr2=0x559e4fa2ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.911 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.907+0000 7f83924f7980 1 --2- 172.21.15.194:0/1908211793 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e4f93e230 0x559e4fa2ffd0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8380005aa0 tx=0x7f83800180e0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.911 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.907+0000 7f8390808640 1 -- 172.21.15.194:0/1908211793 reap_dead start 2024-09-13T06:09:55.911 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.907+0000 7f83924f7980 1 -- 172.21.15.194:0/1908211793 shutdown_connections 2024-09-13T06:09:55.911 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.907+0000 7f83924f7980 1 -- 172.21.15.194:0/1908211793 >> 172.21.15.194:0/1908211793 conn(0x559e4f8b1230 msgr2=0x559e4fa23440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:55.911 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.907+0000 7f83924f7980 1 -- 172.21.15.194:0/1908211793 shutdown_connections 2024-09-13T06:09:55.911 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.907+0000 7f83924f7980 1 -- 172.21.15.194:0/1908211793 wait complete. 2024-09-13T06:09:55.915 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T06:09:53.191222Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-13T06:09:55.703324Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:09:53.191207Z', 'tags': [], 'group_ids': []} 2024-09-13T06:09:55.916 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-09-13T06:09:55.916 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-09-13T06:09:55.916 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --subuser foo:foo1 --key-type swift 2024-09-13T06:09:55.987 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:09:55.988 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:09:55.988 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.987+0000 7f4489c37980 1 Processor -- start 2024-09-13T06:09:55.989 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.987+0000 7f4489c37980 1 -- start start 2024-09-13T06:09:55.989 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.987+0000 7f4489c37980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x562c0ef98920 0x562c0ef9ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:55.989 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.987+0000 7f4489c37980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562c0ee1dae0 con 0x562c0ef94550 2024-09-13T06:09:55.989 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.987+0000 7f4489c37980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x562c0ee41e30 con 0x562c0ef98920 2024-09-13T06:09:55.990 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.987+0000 7f4486f46640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x562c0ef98920 0x562c0ef9ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:55.990 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.987+0000 7f4486f46640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x562c0ef98920 0x562c0ef9ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44954/0 (socket says 172.21.15.194:44954) 2024-09-13T06:09:55.990 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.987+0000 7f4486f46640 1 -- 172.21.15.194:0/217066102 learned_addr learned my addr 172.21.15.194:0/217066102 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:55.990 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.987+0000 7f4487747640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x562c0ef94550 0x562c0ef94930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:51052/0 (socket says 172.21.15.194:51052) 2024-09-13T06:09:55.990 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.987+0000 7f4486f46640 1 -- 172.21.15.194:0/217066102 >> v1:172.21.15.120:6789/0 conn(0x562c0ef94550 legacy=0x562c0ef94930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.990 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.987+0000 7f4486f46640 1 -- 172.21.15.194:0/217066102 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c0ef9c260 con 0x562c0ef98920 2024-09-13T06:09:55.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.991+0000 7f4486f46640 1 --2- 172.21.15.194:0/217066102 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c0ef98920 0x562c0ef9ad10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f447c00a5c0 tx=0x7f447c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a5f9ca5accdadb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:55.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.991+0000 7f4486745640 1 -- 172.21.15.194:0/217066102 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f447c0a6070 con 0x562c0ef98920 2024-09-13T06:09:55.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.991+0000 7f4486745640 1 -- 172.21.15.194:0/217066102 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f447c0af070 con 0x562c0ef98920 2024-09-13T06:09:55.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.991+0000 7f4486745640 1 -- 172.21.15.194:0/217066102 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f447c0aa5c0 con 0x562c0ef98920 2024-09-13T06:09:55.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.991+0000 7f4489c37980 1 -- 172.21.15.194:0/217066102 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c0ef98920 msgr2=0x562c0ef9ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:55.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.991+0000 7f4489c37980 1 --2- 172.21.15.194:0/217066102 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c0ef98920 0x562c0ef9ad10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f447c00a5c0 tx=0x7f447c01b340 comp rx=0 tx=0).stop 2024-09-13T06:09:55.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.991+0000 7f4489c37980 1 -- 172.21.15.194:0/217066102 shutdown_connections 2024-09-13T06:09:55.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.991+0000 7f4489c37980 1 --2- 172.21.15.194:0/217066102 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c0ef98920 0x562c0ef9ad10 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:55.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.991+0000 7f4489c37980 1 -- 172.21.15.194:0/217066102 >> 172.21.15.194:0/217066102 conn(0x562c0ef90070 msgr2=0x562c0ef92490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:55.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.991+0000 7f4489c37980 1 -- 172.21.15.194:0/217066102 shutdown_connections 2024-09-13T06:09:55.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:55.991+0000 7f4489c37980 1 -- 172.21.15.194:0/217066102 wait complete. 2024-09-13T06:09:56.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.003+0000 7f4489c37980 1 Processor -- start 2024-09-13T06:09:56.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.003+0000 7f4489c37980 1 -- start start 2024-09-13T06:09:56.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.003+0000 7f4489c37980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c0ef94550 0x562c0f07f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.003+0000 7f4489c37980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x562c0ee43200 con 0x562c0ef94550 2024-09-13T06:09:56.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.003+0000 7f4487747640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c0ef94550 0x562c0f07f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.003+0000 7f4487747640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c0ef94550 0x562c0f07f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44964/0 (socket says 172.21.15.194:44964) 2024-09-13T06:09:56.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.003+0000 7f4487747640 1 -- 172.21.15.194:0/250097579 learned_addr learned my addr 172.21.15.194:0/250097579 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:56.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.003+0000 7f4487747640 1 -- 172.21.15.194:0/250097579 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c0f07ff40 con 0x562c0ef94550 2024-09-13T06:09:56.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.007+0000 7f4487747640 1 --2- 172.21.15.194:0/250097579 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c0ef94550 0x562c0f07f970 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4478001e50 tx=0x7f4478001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bb2f17df34e9cab server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.007+0000 7f437560a640 1 -- 172.21.15.194:0/250097579 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f447800e5d0 con 0x562c0ef94550 2024-09-13T06:09:56.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.007+0000 7f437560a640 1 -- 172.21.15.194:0/250097579 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f447800e770 con 0x562c0ef94550 2024-09-13T06:09:56.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.007+0000 7f437560a640 1 -- 172.21.15.194:0/250097579 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f447800eab0 con 0x562c0ef94550 2024-09-13T06:09:56.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.007+0000 7f4489c37980 1 -- 172.21.15.194:0/250097579 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c0ef94550 msgr2=0x562c0f07f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.007+0000 7f4489c37980 1 --2- 172.21.15.194:0/250097579 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c0ef94550 0x562c0f07f970 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4478001e50 tx=0x7f4478001e80 comp rx=0 tx=0).stop 2024-09-13T06:09:56.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.007+0000 7f4489c37980 1 -- 172.21.15.194:0/250097579 shutdown_connections 2024-09-13T06:09:56.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.007+0000 7f4489c37980 1 --2- 172.21.15.194:0/250097579 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c0ef94550 0x562c0f07f970 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.007+0000 7f4489c37980 1 -- 172.21.15.194:0/250097579 >> 172.21.15.194:0/250097579 conn(0x562c0ef90070 msgr2=0x562c0f07b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:56.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.007+0000 7f4489c37980 1 -- 172.21.15.194:0/250097579 shutdown_connections 2024-09-13T06:09:56.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.007+0000 7f4489c37980 1 -- 172.21.15.194:0/250097579 wait complete. 2024-09-13T06:09:56.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.007+0000 7f4489c37980 1 Processor -- start 2024-09-13T06:09:56.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.007+0000 7f4489c37980 1 -- start start 2024-09-13T06:09:56.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.007+0000 7f4489c37980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c0ef94550 0x562c0f086d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.007+0000 7f4489c37980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x562c0ef9bd60 con 0x562c0ef94550 2024-09-13T06:09:56.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.007+0000 7f4487747640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c0ef94550 0x562c0f086d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.007+0000 7f4487747640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c0ef94550 0x562c0f086d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44976/0 (socket says 172.21.15.194:44976) 2024-09-13T06:09:56.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.007+0000 7f4487747640 1 -- 172.21.15.194:0/2634663601 learned_addr learned my addr 172.21.15.194:0/2634663601 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:56.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.007+0000 7f4487747640 1 -- 172.21.15.194:0/2634663601 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c0f087240 con 0x562c0ef94550 2024-09-13T06:09:56.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.007+0000 7f4487747640 1 --2- 172.21.15.194:0/2634663601 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c0ef94550 0x562c0f086d00 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x562c0f080b50 tx=0x7f4478000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.007+0000 7f4373e07640 1 -- 172.21.15.194:0/2634663601 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4478001260 con 0x562c0ef94550 2024-09-13T06:09:56.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.007+0000 7f4489c37980 1 -- 172.21.15.194:0/2634663601 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562c0f0874d0 con 0x562c0ef94550 2024-09-13T06:09:56.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.007+0000 7f4373e07640 1 -- 172.21.15.194:0/2634663601 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f447800fa40 con 0x562c0ef94550 2024-09-13T06:09:56.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.007+0000 7f4373e07640 1 -- 172.21.15.194:0/2634663601 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f447802c060 con 0x562c0ef94550 2024-09-13T06:09:56.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.007+0000 7f4489c37980 1 -- 172.21.15.194:0/2634663601 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c0f08a1b0 con 0x562c0ef94550 2024-09-13T06:09:56.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.011+0000 7f4373e07640 1 -- 172.21.15.194:0/2634663601 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4478017070 con 0x562c0ef94550 2024-09-13T06:09:56.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.011+0000 7f4373e07640 1 --2- 172.21.15.194:0/2634663601 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f436c034650 0x7f436c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.011+0000 7f4373e07640 1 -- 172.21.15.194:0/2634663601 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f4478015020 con 0x562c0ef94550 2024-09-13T06:09:56.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.011+0000 7f4486f46640 1 --2- 172.21.15.194:0/2634663601 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f436c034650 0x7f436c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.011+0000 7f4489c37980 1 --2- 172.21.15.194:0/2634663601 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x562c0ef98920 0x562c0f08dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.011+0000 7f4489c37980 1 -- 172.21.15.194:0/2634663601 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562c0f08e340 con 0x562c0ef98920 2024-09-13T06:09:56.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.011+0000 7f4487f48640 1 --2- 172.21.15.194:0/2634663601 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x562c0ef98920 0x562c0f08dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.011+0000 7f4486f46640 1 --2- 172.21.15.194:0/2634663601 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f436c034650 0x7f436c036b10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f447c0ae000 tx=0x7f447c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.011+0000 7f4487f48640 1 --2- 172.21.15.194:0/2634663601 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x562c0ef98920 0x562c0f08dcd0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.011+0000 7f4487f48640 1 -- 172.21.15.194:0/2634663601 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f448000a4d0 con 0x562c0ef98920 2024-09-13T06:09:56.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.011+0000 7f4489c37980 1 -- 172.21.15.194:0/2634663601 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562c0f08b3d0 con 0x562c0ef98920 2024-09-13T06:09:56.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.011+0000 7f4487f48640 1 -- 172.21.15.194:0/2634663601 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f448000a4d0 con 0x562c0ef98920 2024-09-13T06:09:56.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.011+0000 7f4489c37980 1 --2- 172.21.15.194:0/2634663601 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x562c0f090690 0x562c0f092a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.011+0000 7f4489c37980 1 -- 172.21.15.194:0/2634663601 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562c0f093150 con 0x562c0f090690 2024-09-13T06:09:56.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.011+0000 7f4487747640 1 --2- 172.21.15.194:0/2634663601 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x562c0f090690 0x562c0f092a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.011+0000 7f4487747640 1 --2- 172.21.15.194:0/2634663601 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x562c0f090690 0x562c0f092a80 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.011+0000 7f4487747640 1 -- 172.21.15.194:0/2634663601 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f447802e070 con 0x562c0f090690 2024-09-13T06:09:56.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.011+0000 7f4489c37980 1 -- 172.21.15.194:0/2634663601 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562c0f08f530 con 0x562c0ef98920 2024-09-13T06:09:56.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.011+0000 7f4487f48640 1 -- 172.21.15.194:0/2634663601 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f448000a4d0 con 0x562c0ef98920 2024-09-13T06:09:56.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.011+0000 7f4489c37980 1 --2- 172.21.15.194:0/2634663601 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x562c0f094590 0x562c0f096980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.011+0000 7f4489c37980 1 -- 172.21.15.194:0/2634663601 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562c0f097110 con 0x562c0f094590 2024-09-13T06:09:56.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.011+0000 7f4486f46640 1 --2- 172.21.15.194:0/2634663601 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x562c0f094590 0x562c0f096980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.011+0000 7f4486f46640 1 --2- 172.21.15.194:0/2634663601 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x562c0f094590 0x562c0f096980 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.011+0000 7f4486f46640 1 -- 172.21.15.194:0/2634663601 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f447c0aaae0 con 0x562c0f094590 2024-09-13T06:09:56.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.011+0000 7f4489c37980 1 Processor -- start 2024-09-13T06:09:56.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.011+0000 7f4489c37980 1 -- start start 2024-09-13T06:09:56.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.011+0000 7f4489c37980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c0ef09ca0 0x562c0f0a8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.011+0000 7f4489c37980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x562c0ee9c800 con 0x562c0ef09ca0 2024-09-13T06:09:56.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.015+0000 7f4487747640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c0ef09ca0 0x562c0f0a8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.015+0000 7f4487747640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c0ef09ca0 0x562c0f0a8980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44978/0 (socket says 172.21.15.194:44978) 2024-09-13T06:09:56.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.015+0000 7f4487747640 1 -- 172.21.15.194:0/2328084310 learned_addr learned my addr 172.21.15.194:0/2328084310 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:56.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.015+0000 7f4487747640 1 -- 172.21.15.194:0/2328084310 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c0f0a8ec0 con 0x562c0ef09ca0 2024-09-13T06:09:56.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.015+0000 7f4487747640 1 --2- 172.21.15.194:0/2328084310 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c0ef09ca0 0x562c0f0a8980 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f447801b950 tx=0x7f4478019970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.015+0000 7f4371602640 1 -- 172.21.15.194:0/2328084310 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4478042070 con 0x562c0ef09ca0 2024-09-13T06:09:56.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.015+0000 7f4489c37980 1 -- 172.21.15.194:0/2328084310 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562c0f0a9090 con 0x562c0ef09ca0 2024-09-13T06:09:56.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.015+0000 7f4371602640 1 -- 172.21.15.194:0/2328084310 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4478036070 con 0x562c0ef09ca0 2024-09-13T06:09:56.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.015+0000 7f4371602640 1 -- 172.21.15.194:0/2328084310 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f447801bbd0 con 0x562c0ef09ca0 2024-09-13T06:09:56.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.015+0000 7f4489c37980 1 -- 172.21.15.194:0/2328084310 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c0f0a9090 con 0x562c0ef09ca0 2024-09-13T06:09:56.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.015+0000 7f4371602640 1 -- 172.21.15.194:0/2328084310 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f447801a480 con 0x562c0ef09ca0 2024-09-13T06:09:56.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.015+0000 7f4371602640 1 --2- 172.21.15.194:0/2328084310 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4360034650 0x7f4360036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.015+0000 7f4371602640 1 -- 172.21.15.194:0/2328084310 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f4478010070 con 0x562c0ef09ca0 2024-09-13T06:09:56.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.015+0000 7f4486f46640 1 --2- 172.21.15.194:0/2328084310 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4360034650 0x7f4360036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.015+0000 7f4489c37980 1 Processor -- start 2024-09-13T06:09:56.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.015+0000 7f4489c37980 1 -- start start 2024-09-13T06:09:56.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.015+0000 7f4489c37980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c0f0b23c0 0x562c0f0b27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.015+0000 7f4489c37980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x562c0f0802c0 con 0x562c0f0b23c0 2024-09-13T06:09:56.020 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.015+0000 7f4486f46640 1 --2- 172.21.15.194:0/2328084310 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4360034650 0x7f4360036b10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f447c000c10 tx=0x7f447c005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.015+0000 7f4487747640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c0f0b23c0 0x562c0f0b27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.019+0000 7f4487747640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c0f0b23c0 0x562c0f0b27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44980/0 (socket says 172.21.15.194:44980) 2024-09-13T06:09:56.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.019+0000 7f4487747640 1 -- 172.21.15.194:0/1762379240 learned_addr learned my addr 172.21.15.194:0/1762379240 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:56.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.019+0000 7f4487747640 1 -- 172.21.15.194:0/1762379240 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c0f0b2d70 con 0x562c0f0b23c0 2024-09-13T06:09:56.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.019+0000 7f4487747640 1 --2- 172.21.15.194:0/1762379240 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c0f0b23c0 0x562c0f0b27a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4478028e50 tx=0x7f4478031510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17a412f8cb2340e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.019+0000 7f436affd640 1 -- 172.21.15.194:0/1762379240 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4478042630 con 0x562c0f0b23c0 2024-09-13T06:09:56.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.019+0000 7f436affd640 1 -- 172.21.15.194:0/1762379240 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f447801a770 con 0x562c0f0b23c0 2024-09-13T06:09:56.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.019+0000 7f436affd640 1 -- 172.21.15.194:0/1762379240 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44780472b0 con 0x562c0f0b23c0 2024-09-13T06:09:56.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.019+0000 7f4489c37980 1 -- 172.21.15.194:0/1762379240 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c0f0b23c0 msgr2=0x562c0f0b27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.019+0000 7f4489c37980 1 --2- 172.21.15.194:0/1762379240 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c0f0b23c0 0x562c0f0b27a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4478028e50 tx=0x7f4478031510 comp rx=0 tx=0).stop 2024-09-13T06:09:56.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.019+0000 7f4489c37980 1 -- 172.21.15.194:0/1762379240 shutdown_connections 2024-09-13T06:09:56.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.019+0000 7f4489c37980 1 --2- 172.21.15.194:0/1762379240 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c0f0b23c0 0x562c0f0b27a0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.019+0000 7f4489c37980 1 -- 172.21.15.194:0/1762379240 >> 172.21.15.194:0/1762379240 conn(0x562c0f0ae7a0 msgr2=0x562c0f0ac8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:56.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.019+0000 7f4489c37980 1 -- 172.21.15.194:0/1762379240 shutdown_connections 2024-09-13T06:09:56.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.019+0000 7f4489c37980 1 -- 172.21.15.194:0/1762379240 wait complete. 2024-09-13T06:09:56.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.019+0000 7f4489c37980 1 Processor -- start 2024-09-13T06:09:56.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.019+0000 7f4489c37980 1 -- start start 2024-09-13T06:09:56.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.019+0000 7f4489c37980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c0f0b23c0 0x562c0f0b9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.019+0000 7f4489c37980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x562c0f0b3210 con 0x562c0f0b23c0 2024-09-13T06:09:56.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.019+0000 7f4487747640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c0f0b23c0 0x562c0f0b9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.019+0000 7f4487747640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c0f0b23c0 0x562c0f0b9500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44992/0 (socket says 172.21.15.194:44992) 2024-09-13T06:09:56.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.019+0000 7f4487747640 1 -- 172.21.15.194:0/2010916281 learned_addr learned my addr 172.21.15.194:0/2010916281 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:56.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.019+0000 7f4487747640 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c0f0b9a40 con 0x562c0f0b23c0 2024-09-13T06:09:56.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.019+0000 7f4487747640 1 --2- 172.21.15.194:0/2010916281 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c0f0b23c0 0x562c0f0b9500 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f447803dfd0 tx=0x7f447802ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.019+0000 7f43697fa640 1 -- 172.21.15.194:0/2010916281 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f447806f070 con 0x562c0f0b23c0 2024-09-13T06:09:56.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.019+0000 7f4489c37980 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562c0f0b9a40 con 0x562c0f0b23c0 2024-09-13T06:09:56.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.019+0000 7f43697fa640 1 -- 172.21.15.194:0/2010916281 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f447801d8c0 con 0x562c0f0b23c0 2024-09-13T06:09:56.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.019+0000 7f43697fa640 1 -- 172.21.15.194:0/2010916281 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f447801dba0 con 0x562c0f0b23c0 2024-09-13T06:09:56.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.019+0000 7f4489c37980 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c0f0b9eb0 con 0x562c0f0b23c0 2024-09-13T06:09:56.029 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.023+0000 7f43697fa640 1 -- 172.21.15.194:0/2010916281 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4478072070 con 0x562c0f0b23c0 2024-09-13T06:09:56.029 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.023+0000 7f4489c37980 20 rados->read ofs=0 len=0 2024-09-13T06:09:56.029 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.023+0000 7f43697fa640 1 --2- 172.21.15.194:0/2010916281 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4350034650 0x7f4350036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.029 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.023+0000 7f43697fa640 1 -- 172.21.15.194:0/2010916281 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f4478067070 con 0x562c0f0b23c0 2024-09-13T06:09:56.029 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.023+0000 7f4486f46640 1 --2- 172.21.15.194:0/2010916281 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4350034650 0x7f4350036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.029 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.023+0000 7f4489c37980 1 --2- 172.21.15.194:0/2010916281 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x562c0f0c4630 0x562c0f0c6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.029 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.023+0000 7f4489c37980 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0c7220 con 0x562c0f0c4630 2024-09-13T06:09:56.029 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.023+0000 7f4487f48640 1 --2- 172.21.15.194:0/2010916281 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x562c0f0c4630 0x562c0f0c6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.029 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.023+0000 7f4487f48640 1 --2- 172.21.15.194:0/2010916281 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x562c0f0c4630 0x562c0f0c6ad0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.029 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.023+0000 7f4486f46640 1 --2- 172.21.15.194:0/2010916281 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4350034650 0x7f4350036b10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f447c0aa910 tx=0x7f447c0c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.029 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.023+0000 7f4487f48640 1 -- 172.21.15.194:0/2010916281 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f448000a4d0 con 0x562c0f0c4630 2024-09-13T06:09:56.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.023+0000 7f4489c37980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:56.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.023+0000 7f4489c37980 20 realm 2024-09-13T06:09:56.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.023+0000 7f4489c37980 20 rados->read ofs=0 len=0 2024-09-13T06:09:56.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.023+0000 7f4489c37980 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0c7630 con 0x562c0f0c4630 2024-09-13T06:09:56.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.023+0000 7f4487f48640 1 -- 172.21.15.194:0/2010916281 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f448000a4d0 con 0x562c0f0c4630 2024-09-13T06:09:56.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.023+0000 7f4489c37980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:56.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.023+0000 7f4489c37980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:09:56.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.023+0000 7f4489c37980 20 rados->read ofs=0 len=0 2024-09-13T06:09:56.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.023+0000 7f4489c37980 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0c7ed0 con 0x562c0f0c4630 2024-09-13T06:09:56.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.023+0000 7f4487f48640 1 -- 172.21.15.194:0/2010916281 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f448000a4d0 con 0x562c0f0c4630 2024-09-13T06:09:56.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.023+0000 7f4489c37980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:56.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.023+0000 7f4489c37980 20 rados->read ofs=0 len=0 2024-09-13T06:09:56.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.023+0000 7f4489c37980 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0c8270 con 0x562c0f0c4630 2024-09-13T06:09:56.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.023+0000 7f4487f48640 1 -- 172.21.15.194:0/2010916281 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f448000a4d0 con 0x562c0f0c4630 2024-09-13T06:09:56.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.023+0000 7f4489c37980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:56.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.023+0000 7f4489c37980 20 rados->read ofs=0 len=0 2024-09-13T06:09:56.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.023+0000 7f4489c37980 1 --2- 172.21.15.194:0/2010916281 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x562c0f0c8fd0 0x562c0f0cb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.023+0000 7f4489c37980 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0cba10 con 0x562c0f0c8fd0 2024-09-13T06:09:56.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.023+0000 7f4487747640 1 --2- 172.21.15.194:0/2010916281 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x562c0f0c8fd0 0x562c0f0cb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.023+0000 7f4487747640 1 --2- 172.21.15.194:0/2010916281 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x562c0f0c8fd0 0x562c0f0cb3c0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.023+0000 7f4487747640 1 -- 172.21.15.194:0/2010916281 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4478071030 con 0x562c0f0c8fd0 2024-09-13T06:09:56.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.023+0000 7f4489c37980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:09:56.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.023+0000 7f4489c37980 20 searching for the correct realm 2024-09-13T06:09:56.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.023+0000 7f4489c37980 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0cd270 con 0x562c0f0c8fd0 2024-09-13T06:09:56.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.023+0000 7f4487747640 1 -- 172.21.15.194:0/2010916281 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4478071030 con 0x562c0f0c8fd0 2024-09-13T06:09:56.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.023+0000 7f4487747640 1 --2- 172.21.15.194:0/2010916281 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f4478074060 0x7f4478060640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.023+0000 7f4487747640 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0cd270 con 0x7f4478074060 2024-09-13T06:09:56.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.023+0000 7f4486f46640 1 --2- 172.21.15.194:0/2010916281 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f4478074060 0x7f4478060640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.027+0000 7f4486f46640 1 --2- 172.21.15.194:0/2010916281 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f4478074060 0x7f4478060640 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.027+0000 7f4486f46640 1 -- 172.21.15.194:0/2010916281 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f447c0aaae0 con 0x7f4478074060 2024-09-13T06:09:56.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.027+0000 7f4486f46640 1 --2- 172.21.15.194:0/2010916281 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f447c0e0040 0x7f447c0e0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.027+0000 7f4486f46640 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0cd270 con 0x7f447c0e0040 2024-09-13T06:09:56.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.027+0000 7f4487f48640 1 --2- 172.21.15.194:0/2010916281 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f447c0e0040 0x7f447c0e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.027+0000 7f4487f48640 1 --2- 172.21.15.194:0/2010916281 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f447c0e0040 0x7f447c0e0420 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.027+0000 7f4487f48640 1 -- 172.21.15.194:0/2010916281 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f448000a4d0 con 0x7f447c0e0040 2024-09-13T06:09:56.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.027+0000 7f4487f48640 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0c8270 con 0x562c0f0c4630 2024-09-13T06:09:56.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.027+0000 7f4487f48640 1 -- 172.21.15.194:0/2010916281 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f448000a4d0 con 0x562c0f0c4630 2024-09-13T06:09:56.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.027+0000 7f4487f48640 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0c8270 con 0x562c0f0c4630 2024-09-13T06:09:56.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.027+0000 7f4487f48640 1 -- 172.21.15.194:0/2010916281 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f448000a4d0 con 0x562c0f0c4630 2024-09-13T06:09:56.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.027+0000 7f4487f48640 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0c8270 con 0x7f447c0e0040 2024-09-13T06:09:56.037 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.027+0000 7f4487f48640 1 -- 172.21.15.194:0/2010916281 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f448000a4d0 con 0x7f447c0e0040 2024-09-13T06:09:56.037 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.027+0000 7f4487f48640 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0c8270 con 0x7f447c0e0040 2024-09-13T06:09:56.037 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.027+0000 7f4487f48640 1 -- 172.21.15.194:0/2010916281 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f448000a4d0 con 0x7f447c0e0040 2024-09-13T06:09:56.037 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.027+0000 7f4487f48640 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0c8270 con 0x7f4478074060 2024-09-13T06:09:56.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.027+0000 7f4486f46640 1 -- 172.21.15.194:0/2010916281 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f447c0aaae0 con 0x7f4478074060 2024-09-13T06:09:56.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.027+0000 7f4486f46640 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0c8270 con 0x562c0f0c8fd0 2024-09-13T06:09:56.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.031+0000 7f4487747640 1 -- 172.21.15.194:0/2010916281 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4478071030 con 0x562c0f0c8fd0 2024-09-13T06:09:56.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.031+0000 7f4487747640 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0c8270 con 0x562c0f0c4630 2024-09-13T06:09:56.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.031+0000 7f4487f48640 1 -- 172.21.15.194:0/2010916281 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f448000a4d0 con 0x562c0f0c4630 2024-09-13T06:09:56.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.031+0000 7f4487f48640 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0c8270 con 0x7f447c0e0040 2024-09-13T06:09:56.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.031+0000 7f4487f48640 1 -- 172.21.15.194:0/2010916281 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f448000a4d0 con 0x7f447c0e0040 2024-09-13T06:09:56.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.031+0000 7f4487f48640 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0c8270 con 0x562c0f0c4630 2024-09-13T06:09:56.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.031+0000 7f4487f48640 1 -- 172.21.15.194:0/2010916281 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f448000a4d0 con 0x562c0f0c4630 2024-09-13T06:09:56.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.031+0000 7f4487f48640 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0c8270 con 0x7f4478074060 2024-09-13T06:09:56.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.031+0000 7f4486f46640 1 -- 172.21.15.194:0/2010916281 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f447c0aaae0 con 0x7f4478074060 2024-09-13T06:09:56.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.031+0000 7f4486f46640 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0c8270 con 0x562c0f0c8fd0 2024-09-13T06:09:56.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.031+0000 7f4487747640 1 -- 172.21.15.194:0/2010916281 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4478071030 con 0x562c0f0c8fd0 2024-09-13T06:09:56.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.031+0000 7f4487747640 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0c8270 con 0x562c0f0c8fd0 2024-09-13T06:09:56.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.031+0000 7f4487747640 1 -- 172.21.15.194:0/2010916281 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4478071030 con 0x562c0f0c8fd0 2024-09-13T06:09:56.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.031+0000 7f4487747640 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0c8270 con 0x7f447c0e0040 2024-09-13T06:09:56.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.031+0000 7f4487f48640 1 -- 172.21.15.194:0/2010916281 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f448000a4d0 con 0x7f447c0e0040 2024-09-13T06:09:56.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.031+0000 7f4487f48640 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0c8270 con 0x562c0f0c8fd0 2024-09-13T06:09:56.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.031+0000 7f4487747640 1 -- 172.21.15.194:0/2010916281 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4478071030 con 0x562c0f0c8fd0 2024-09-13T06:09:56.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.031+0000 7f4487747640 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0c8270 con 0x562c0f0c8fd0 2024-09-13T06:09:56.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.031+0000 7f4487747640 1 -- 172.21.15.194:0/2010916281 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4478071030 con 0x562c0f0c8fd0 2024-09-13T06:09:56.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.031+0000 7f4487747640 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0c8270 con 0x562c0f0c4630 2024-09-13T06:09:56.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.031+0000 7f4487f48640 1 -- 172.21.15.194:0/2010916281 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f448000a4d0 con 0x562c0f0c4630 2024-09-13T06:09:56.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.031+0000 7f4487f48640 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0c8270 con 0x562c0f0c4630 2024-09-13T06:09:56.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.031+0000 7f4487f48640 1 -- 172.21.15.194:0/2010916281 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f448000a4d0 con 0x562c0f0c4630 2024-09-13T06:09:56.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.031+0000 7f4487f48640 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0c8270 con 0x7f447c0e0040 2024-09-13T06:09:56.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.035+0000 7f4487f48640 1 -- 172.21.15.194:0/2010916281 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f448000a4d0 con 0x7f447c0e0040 2024-09-13T06:09:56.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.035+0000 7f4487f48640 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0c8270 con 0x562c0f0c8fd0 2024-09-13T06:09:56.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.035+0000 7f4487747640 1 -- 172.21.15.194:0/2010916281 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4478071030 con 0x562c0f0c8fd0 2024-09-13T06:09:56.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.035+0000 7f4487747640 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0c8270 con 0x7f4478074060 2024-09-13T06:09:56.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.035+0000 7f4486f46640 1 -- 172.21.15.194:0/2010916281 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f447c0aaae0 con 0x7f4478074060 2024-09-13T06:09:56.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.035+0000 7f4486f46640 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0c8270 con 0x562c0f0c4630 2024-09-13T06:09:56.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.035+0000 7f4487f48640 1 -- 172.21.15.194:0/2010916281 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f448000a4d0 con 0x562c0f0c4630 2024-09-13T06:09:56.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.035+0000 7f4487f48640 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0c8270 con 0x7f447c0e0040 2024-09-13T06:09:56.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.035+0000 7f4487f48640 1 -- 172.21.15.194:0/2010916281 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f448000a4d0 con 0x7f447c0e0040 2024-09-13T06:09:56.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.035+0000 7f4487f48640 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0c8270 con 0x562c0f0c8fd0 2024-09-13T06:09:56.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.035+0000 7f4487747640 1 -- 172.21.15.194:0/2010916281 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4478071030 con 0x562c0f0c8fd0 2024-09-13T06:09:56.041 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.035+0000 7f4487747640 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0c8270 con 0x7f447c0e0040 2024-09-13T06:09:56.041 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.035+0000 7f4487f48640 1 -- 172.21.15.194:0/2010916281 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f448000a4d0 con 0x7f447c0e0040 2024-09-13T06:09:56.041 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.035+0000 7f4487f48640 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0c8270 con 0x7f4478074060 2024-09-13T06:09:56.041 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.035+0000 7f4486f46640 1 -- 172.21.15.194:0/2010916281 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f447c0aaae0 con 0x7f4478074060 2024-09-13T06:09:56.041 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.035+0000 7f4486f46640 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0c8270 con 0x562c0f0c8fd0 2024-09-13T06:09:56.041 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.035+0000 7f4487747640 1 -- 172.21.15.194:0/2010916281 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4478071030 con 0x562c0f0c8fd0 2024-09-13T06:09:56.041 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.035+0000 7f4487747640 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0c8270 con 0x7f447c0e0040 2024-09-13T06:09:56.044 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.035+0000 7f4487f48640 1 -- 172.21.15.194:0/2010916281 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f448000a4d0 con 0x7f447c0e0040 2024-09-13T06:09:56.044 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.035+0000 7f4487f48640 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0c8270 con 0x562c0f0c4630 2024-09-13T06:09:56.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.035+0000 7f4487f48640 1 -- 172.21.15.194:0/2010916281 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f448000a4d0 con 0x562c0f0c4630 2024-09-13T06:09:56.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.035+0000 7f4487f48640 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0c8270 con 0x7f4478074060 2024-09-13T06:09:56.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.035+0000 7f4486f46640 1 -- 172.21.15.194:0/2010916281 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f447c0aaae0 con 0x7f4478074060 2024-09-13T06:09:56.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.035+0000 7f4489c37980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:09:56.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.035+0000 7f4489c37980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:09:56.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.035+0000 7f4489c37980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:09:56.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.035+0000 7f4489c37980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:09:56.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.035+0000 7f4489c37980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:09:56.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.035+0000 7f4489c37980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:09:56.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.035+0000 7f4489c37980 20 rados->read ofs=0 len=0 2024-09-13T06:09:56.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.035+0000 7f4489c37980 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0cc360 con 0x562c0f0c4630 2024-09-13T06:09:56.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.039+0000 7f4487f48640 1 -- 172.21.15.194:0/2010916281 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f448000a4d0 con 0x562c0f0c4630 2024-09-13T06:09:56.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.039+0000 7f4489c37980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:56.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.039+0000 7f4489c37980 20 rados->read ofs=0 len=0 2024-09-13T06:09:56.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.039+0000 7f4489c37980 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0ccbb0 con 0x562c0f0c4630 2024-09-13T06:09:56.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.039+0000 7f4487f48640 1 -- 172.21.15.194:0/2010916281 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f448000a4d0 con 0x562c0f0c4630 2024-09-13T06:09:56.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.039+0000 7f4489c37980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:56.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.039+0000 7f4489c37980 20 rados->read ofs=0 len=0 2024-09-13T06:09:56.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.039+0000 7f4489c37980 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0cbfc0 con 0x7f4478074060 2024-09-13T06:09:56.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.039+0000 7f4486f46640 1 -- 172.21.15.194:0/2010916281 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f447c0aaae0 con 0x7f4478074060 2024-09-13T06:09:56.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.039+0000 7f4489c37980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:09:56.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.039+0000 7f4489c37980 20 zone default found 2024-09-13T06:09:56.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.039+0000 7f4489c37980 4 Realm: () 2024-09-13T06:09:56.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.039+0000 7f4489c37980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:09:56.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.039+0000 7f4489c37980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:09:56.047 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.039+0000 7f4489c37980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:09:56.047 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.039+0000 7f4489c37980 20 zonegroup default 2024-09-13T06:09:56.047 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.039+0000 7f4489c37980 20 rados->read ofs=0 len=0 2024-09-13T06:09:56.047 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.039+0000 7f4489c37980 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0ccbb0 con 0x7f447c0e0040 2024-09-13T06:09:56.047 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.039+0000 7f4487f48640 1 -- 172.21.15.194:0/2010916281 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f448000a4d0 con 0x7f447c0e0040 2024-09-13T06:09:56.047 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.039+0000 7f4489c37980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:56.047 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.039+0000 7f4489c37980 20 rados->read ofs=0 len=0 2024-09-13T06:09:56.047 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.039+0000 7f4489c37980 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0cf100 con 0x562c0f0c8fd0 2024-09-13T06:09:56.047 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.039+0000 7f4487747640 1 -- 172.21.15.194:0/2010916281 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4478071030 con 0x562c0f0c8fd0 2024-09-13T06:09:56.047 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.039+0000 7f4489c37980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:56.047 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.039+0000 7f4489c37980 20 rados->read ofs=0 len=0 2024-09-13T06:09:56.047 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.039+0000 7f4489c37980 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0cf4f0 con 0x562c0f0c8fd0 2024-09-13T06:09:56.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.039+0000 7f4487747640 1 -- 172.21.15.194:0/2010916281 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4478071030 con 0x562c0f0c8fd0 2024-09-13T06:09:56.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.039+0000 7f4489c37980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:56.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.039+0000 7f4489c37980 20 started sync module instance, tier type = 2024-09-13T06:09:56.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.039+0000 7f4489c37980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:09:56.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.039+0000 7f4489c37980 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0ce5a0 con 0x7f4478074060 2024-09-13T06:09:56.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.039+0000 7f4486f46640 1 -- 172.21.15.194:0/2010916281 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(44 notify.0 [create] v33'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f447c0aaae0 con 0x7f4478074060 2024-09-13T06:09:56.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.039+0000 7f4489c37980 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94747231054224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0ce200 con 0x7f4478074060 2024-09-13T06:09:56.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.039+0000 7f4489c37980 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0d0420 con 0x562c0f0c4630 2024-09-13T06:09:56.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.043+0000 7f4487f48640 1 -- 172.21.15.194:0/2010916281 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v33'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f448000a4d0 con 0x562c0f0c4630 2024-09-13T06:09:56.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.043+0000 7f4489c37980 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94747231060096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0d0b50 con 0x562c0f0c4630 2024-09-13T06:09:56.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.043+0000 7f4489c37980 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0d1650 con 0x562c0f0c8fd0 2024-09-13T06:09:56.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.043+0000 7f4486f46640 1 -- 172.21.15.194:0/2010916281 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94747231054224] v33'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f447c0aaae0 con 0x7f4478074060 2024-09-13T06:09:56.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.043+0000 7f4487f48640 1 -- 172.21.15.194:0/2010916281 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94747231060096] v33'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f448000a4d0 con 0x562c0f0c4630 2024-09-13T06:09:56.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.047+0000 7f4487747640 1 -- 172.21.15.194:0/2010916281 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v33'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4478071030 con 0x562c0f0c8fd0 2024-09-13T06:09:56.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.047+0000 7f4489c37980 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94747231064384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0d05a0 con 0x562c0f0c8fd0 2024-09-13T06:09:56.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.047+0000 7f4489c37980 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0d1f20 con 0x7f4478074060 2024-09-13T06:09:56.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.047+0000 7f4486f46640 1 -- 172.21.15.194:0/2010916281 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(50 notify.3 [create] v33'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f447c0aaae0 con 0x7f4478074060 2024-09-13T06:09:56.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.047+0000 7f4489c37980 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94747231066736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0d2770 con 0x7f4478074060 2024-09-13T06:09:56.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.047+0000 7f4489c37980 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0d3130 con 0x562c0f0c4630 2024-09-13T06:09:56.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.047+0000 7f4487747640 1 -- 172.21.15.194:0/2010916281 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94747231064384] v33'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4478071030 con 0x562c0f0c8fd0 2024-09-13T06:09:56.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.047+0000 7f4486f46640 1 -- 172.21.15.194:0/2010916281 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94747231066736] v33'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f447c0aaae0 con 0x7f4478074060 2024-09-13T06:09:56.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.047+0000 7f4487f48640 1 -- 172.21.15.194:0/2010916281 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v33'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f448000a4d0 con 0x562c0f0c4630 2024-09-13T06:09:56.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.047+0000 7f4489c37980 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94747231071360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0d2770 con 0x562c0f0c4630 2024-09-13T06:09:56.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.047+0000 7f4489c37980 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0d30a0 con 0x7f447c0e0040 2024-09-13T06:09:56.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.051+0000 7f4487f48640 1 -- 172.21.15.194:0/2010916281 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94747231071360] v33'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f448000a4d0 con 0x562c0f0c4630 2024-09-13T06:09:56.052 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.051+0000 7f4487f48640 1 -- 172.21.15.194:0/2010916281 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(54 notify.5 [create] v33'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f448000a4d0 con 0x7f447c0e0040 2024-09-13T06:09:56.052 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.051+0000 7f4489c37980 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94747231068864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0d26e0 con 0x7f447c0e0040 2024-09-13T06:09:56.052 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.051+0000 7f4489c37980 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0d3f60 con 0x7f447c0e0040 2024-09-13T06:09:56.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.051+0000 7f4487f48640 1 -- 172.21.15.194:0/2010916281 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94747231068864] v33'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f448000a4d0 con 0x7f447c0e0040 2024-09-13T06:09:56.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.051+0000 7f4487f48640 1 -- 172.21.15.194:0/2010916281 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(56 notify.6 [create] v33'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f448000a4d0 con 0x7f447c0e0040 2024-09-13T06:09:56.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.051+0000 7f4489c37980 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94747231073424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0d3f60 con 0x7f447c0e0040 2024-09-13T06:09:56.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.051+0000 7f4489c37980 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0d4920 con 0x7f447c0e0040 2024-09-13T06:09:56.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.055+0000 7f4487f48640 1 -- 172.21.15.194:0/2010916281 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94747231073424] v33'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f448000a4d0 con 0x7f447c0e0040 2024-09-13T06:09:56.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.055+0000 7f4487f48640 1 -- 172.21.15.194:0/2010916281 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(58 notify.7 [create] v33'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f448000a4d0 con 0x7f447c0e0040 2024-09-13T06:09:56.057 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.055+0000 7f4489c37980 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94747231074992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0d4b00 con 0x7f447c0e0040 2024-09-13T06:09:56.057 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.055+0000 7f4489c37980 20 add_watcher() i=0 2024-09-13T06:09:56.057 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.055+0000 7f4489c37980 20 add_watcher() i=1 2024-09-13T06:09:56.057 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.055+0000 7f4489c37980 20 add_watcher() i=2 2024-09-13T06:09:56.057 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.055+0000 7f4489c37980 20 add_watcher() i=3 2024-09-13T06:09:56.057 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.055+0000 7f4489c37980 20 add_watcher() i=4 2024-09-13T06:09:56.057 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.055+0000 7f4489c37980 20 add_watcher() i=5 2024-09-13T06:09:56.057 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.055+0000 7f4489c37980 20 add_watcher() i=6 2024-09-13T06:09:56.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.059+0000 7f4487f48640 1 -- 172.21.15.194:0/2010916281 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94747231074992] v33'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f448000a4d0 con 0x7f447c0e0040 2024-09-13T06:09:56.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.059+0000 7f4489c37980 20 add_watcher() i=7 2024-09-13T06:09:56.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.059+0000 7f4489c37980 2 all 8 watchers are set, enabling cache 2024-09-13T06:09:56.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.059+0000 7f4489c37980 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0d7cd0 con 0x562c0f0c4630 2024-09-13T06:09:56.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.059+0000 7f4487f48640 1 -- 172.21.15.194:0/2010916281 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f448000a4d0 con 0x562c0f0c4630 2024-09-13T06:09:56.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.059+0000 7f4489c37980 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94747231090272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0d4a70 con 0x562c0f0c4630 2024-09-13T06:09:56.061 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.059+0000 7f4487f48640 1 -- 172.21.15.194:0/2010916281 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94747231090272] v33'82 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f448000a4d0 con 0x562c0f0c4630 2024-09-13T06:09:56.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.059+0000 7f433e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:56.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.059+0000 7f4489c37980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:09:56.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.059+0000 7f4489c37980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:09:56.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.059+0000 7f4489c37980 5 note: GC not initialized 2024-09-13T06:09:56.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.059+0000 7f433d7e2640 20 reqs_thread_entry: start 2024-09-13T06:09:56.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.059+0000 7f4489c37980 20 init_complete bucket index max shards: 11 2024-09-13T06:09:56.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.059+0000 7f4489c37980 20 Filter name: none 2024-09-13T06:09:56.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.059+0000 7f43367fc640 20 reqs_thread_entry: start 2024-09-13T06:09:56.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.059+0000 7f4489c37980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T06:09:56.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.059+0000 7f4489c37980 20 rados->read ofs=0 len=0 2024-09-13T06:09:56.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.059+0000 7f4489c37980 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0fb440 con 0x562c0f0c4630 2024-09-13T06:09:56.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.059+0000 7f4487f48640 1 -- 172.21.15.194:0/2010916281 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7f448000a4d0 con 0x562c0f0c4630 2024-09-13T06:09:56.063 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.059+0000 7f4489c37980 20 rados_obj.operate() r=0 bl.length=673 2024-09-13T06:09:56.063 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.059+0000 7f4489c37980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T06:09:56.063 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.059+0000 7f4489c37980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:09:56.063 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.059+0000 7f4489c37980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:09:56.063 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.059+0000 7f4489c37980 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562c0f101ee0 con 0x562c0f0c4630 2024-09-13T06:09:56.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.063+0000 7f4487f48640 1 -- 172.21.15.194:0/2010916281 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~582] v33'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f448000a4d0 con 0x562c0f0c4630 2024-09-13T06:09:56.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.063+0000 7f4489c37980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T06:09:56.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.063+0000 7f4489c37980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:09:56.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.063+0000 7f4489c37980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T06:09:56.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.063+0000 7f4489c37980 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94747231263056 in=770b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0fd6c0 con 0x562c0f0c4630 2024-09-13T06:09:56.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.063+0000 7f4487f48640 1 -- 172.21.15.194:0/2010916281 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== watch-notify(notify (1) cookie 94747231071360 notify 141733920776 ret 0) ==== 800+0+0 (crc 0 0 0) 0x7f448002d040 con 0x562c0f0c4630 2024-09-13T06:09:56.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.063+0000 7f436affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920776 cookie 94747231071360 notifier 4402 bl.length()=758 2024-09-13T06:09:56.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.063+0000 7f436affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T06:09:56.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.063+0000 7f436affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:09:56.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.063+0000 7f4487f48640 1 -- 172.21.15.194:0/2010916281 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(64 notify.4 [notify cookie 94747231263056 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f448000a4d0 con 0x562c0f0c4630 2024-09-13T06:09:56.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.063+0000 7f436affd640 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f434c003eb0 con 0x562c0f0c4630 2024-09-13T06:09:56.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.063+0000 7f4487f48640 1 -- 172.21.15.194:0/2010916281 <== osd.1 v2:172.21.15.194:6808/3135444559 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f448000a4d0 con 0x562c0f0c4630 2024-09-13T06:09:56.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.063+0000 7f4487f48640 1 -- 172.21.15.194:0/2010916281 <== osd.1 v2:172.21.15.194:6808/3135444559 26 ==== watch-notify(notify_complete (2) cookie 94747231263056 notify 141733920776 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f448001e040 con 0x562c0f0c4630 2024-09-13T06:09:56.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.063+0000 7f4489c37980 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:66 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562c0f101950 con 0x562c0f0c4630 2024-09-13T06:09:56.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.063+0000 7f4487f48640 1 -- 172.21.15.194:0/2010916281 <== osd.1 v2:172.21.15.194:6808/3135444559 27 ==== osd_op_reply(66 foo:foo1 [delete] v33'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f448000a4d0 con 0x562c0f0c4630 2024-09-13T06:09:56.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.063+0000 7f4489c37980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-09-13T06:09:56.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.063+0000 7f4489c37980 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94747231263056 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0fd210 con 0x7f4478074060 2024-09-13T06:09:56.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.063+0000 7f4486f46640 1 -- 172.21.15.194:0/2010916281 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== watch-notify(notify (1) cookie 94747231054224 notify 141733920772 ret 0) ==== 201+0+0 (crc 0 0 0) 0x562c0ef9c260 con 0x7f4478074060 2024-09-13T06:09:56.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.063+0000 7f436a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920772 cookie 94747231054224 notifier 4402 bl.length()=159 2024-09-13T06:09:56.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.063+0000 7f4486f46640 1 -- 172.21.15.194:0/2010916281 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(67 notify.0 [notify cookie 94747231263056 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f447c0aaae0 con 0x7f4478074060 2024-09-13T06:09:56.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.063+0000 7f436a7fc640 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f42b00032d0 con 0x7f4478074060 2024-09-13T06:09:56.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.063+0000 7f4486f46640 1 -- 172.21.15.194:0/2010916281 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== watch-notify(notify_complete (2) cookie 94747231263056 notify 141733920772 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f447c0bf680 con 0x7f4478074060 2024-09-13T06:09:56.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.063+0000 7f4486f46640 1 -- 172.21.15.194:0/2010916281 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f447c0aaae0 con 0x7f4478074060 2024-09-13T06:09:56.067 INFO:teuthology.orchestra.run.smithi194.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T06:09:53.191222Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-13T06:09:55.703324Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:09:53.191207Z","tags":[],"group_ids":[]} 2024-09-13T06:09:56.068 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.063+0000 7f433e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:56.068 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.063+0000 7f4489c37980 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94747231090272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0f9270 con 0x562c0f0c4630 2024-09-13T06:09:56.068 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.067+0000 7f4487f48640 1 -- 172.21.15.194:0/2010916281 <== osd.1 v2:172.21.15.194:6808/3135444559 28 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94747231090272] v33'83 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f448000a4d0 con 0x562c0f0c4630 2024-09-13T06:09:56.068 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.067+0000 7f4489c37980 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94747231054224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0f9270 con 0x7f4478074060 2024-09-13T06:09:56.068 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.067+0000 7f4486f46640 1 -- 172.21.15.194:0/2010916281 <== osd.2 v2:172.21.15.194:6800/815615585 16 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94747231054224] v33'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f447c0aaae0 con 0x7f4478074060 2024-09-13T06:09:56.068 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.067+0000 7f4489c37980 20 remove_watcher() i=0 2024-09-13T06:09:56.068 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.067+0000 7f4489c37980 2 removed watcher, disabling cache 2024-09-13T06:09:56.069 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.067+0000 7f4489c37980 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94747231060096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0f9270 con 0x562c0f0c4630 2024-09-13T06:09:56.070 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.067+0000 7f4487f48640 1 -- 172.21.15.194:0/2010916281 <== osd.1 v2:172.21.15.194:6808/3135444559 29 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94747231060096] v33'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f448000a4d0 con 0x562c0f0c4630 2024-09-13T06:09:56.070 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.067+0000 7f4489c37980 20 remove_watcher() i=1 2024-09-13T06:09:56.070 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.067+0000 7f4489c37980 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94747231064384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0f9270 con 0x562c0f0c8fd0 2024-09-13T06:09:56.072 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.071+0000 7f4487747640 1 -- 172.21.15.194:0/2010916281 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94747231064384] v33'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4478071030 con 0x562c0f0c8fd0 2024-09-13T06:09:56.072 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.071+0000 7f4489c37980 20 remove_watcher() i=2 2024-09-13T06:09:56.072 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.071+0000 7f4489c37980 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94747231066736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0d1140 con 0x7f4478074060 2024-09-13T06:09:56.073 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.071+0000 7f4486f46640 1 -- 172.21.15.194:0/2010916281 <== osd.2 v2:172.21.15.194:6800/815615585 17 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94747231066736] v33'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f447c0aaae0 con 0x7f4478074060 2024-09-13T06:09:56.073 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.071+0000 7f4489c37980 20 remove_watcher() i=3 2024-09-13T06:09:56.073 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.071+0000 7f4489c37980 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94747231071360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0f9270 con 0x562c0f0c4630 2024-09-13T06:09:56.075 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.075+0000 7f4487f48640 1 -- 172.21.15.194:0/2010916281 <== osd.1 v2:172.21.15.194:6808/3135444559 30 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94747231071360] v33'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f448000a4d0 con 0x562c0f0c4630 2024-09-13T06:09:56.075 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.075+0000 7f4489c37980 20 remove_watcher() i=4 2024-09-13T06:09:56.075 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.075+0000 7f4489c37980 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94747231068864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0d1a70 con 0x7f447c0e0040 2024-09-13T06:09:56.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.075+0000 7f4487f48640 1 -- 172.21.15.194:0/2010916281 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94747231068864] v33'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f448000a4d0 con 0x7f447c0e0040 2024-09-13T06:09:56.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.075+0000 7f4489c37980 20 remove_watcher() i=5 2024-09-13T06:09:56.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.075+0000 7f4489c37980 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94747231073424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0d1140 con 0x7f447c0e0040 2024-09-13T06:09:56.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.079+0000 7f4487f48640 1 -- 172.21.15.194:0/2010916281 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94747231073424] v33'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f448000a4d0 con 0x7f447c0e0040 2024-09-13T06:09:56.079 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.079+0000 7f4489c37980 20 remove_watcher() i=6 2024-09-13T06:09:56.079 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.079+0000 7f4489c37980 1 -- 172.21.15.194:0/2010916281 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94747231074992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562c0f0d2c80 con 0x7f447c0e0040 2024-09-13T06:09:56.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.079+0000 7f4487f48640 1 -- 172.21.15.194:0/2010916281 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94747231074992] v33'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f448000a4d0 con 0x7f447c0e0040 2024-09-13T06:09:56.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.079+0000 7f4489c37980 20 remove_watcher() i=7 2024-09-13T06:09:56.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.079+0000 7f4489c37980 1 -- 172.21.15.194:0/2010916281 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f447c0e0040 msgr2=0x7f447c0e0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.079+0000 7f4489c37980 1 --2- 172.21.15.194:0/2010916281 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f447c0e0040 0x7f447c0e0420 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.079+0000 7f4489c37980 1 -- 172.21.15.194:0/2010916281 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x562c0f0c4630 msgr2=0x562c0f0c6ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.079+0000 7f4489c37980 1 --2- 172.21.15.194:0/2010916281 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x562c0f0c4630 0x562c0f0c6ad0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.079+0000 7f4489c37980 1 -- 172.21.15.194:0/2010916281 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f4478074060 msgr2=0x7f4478060640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.079+0000 7f4489c37980 1 --2- 172.21.15.194:0/2010916281 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f4478074060 0x7f4478060640 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.079+0000 7f4489c37980 1 -- 172.21.15.194:0/2010916281 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x562c0f0c8fd0 msgr2=0x562c0f0cb3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.079+0000 7f4489c37980 1 --2- 172.21.15.194:0/2010916281 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x562c0f0c8fd0 0x562c0f0cb3c0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.079+0000 7f4489c37980 1 -- 172.21.15.194:0/2010916281 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4350034650 msgr2=0x7f4350036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.079+0000 7f4489c37980 1 --2- 172.21.15.194:0/2010916281 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4350034650 0x7f4350036b10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f447c0aa910 tx=0x7f447c0c1040 comp rx=0 tx=0).stop 2024-09-13T06:09:56.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.079+0000 7f4489c37980 1 -- 172.21.15.194:0/2010916281 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c0f0b23c0 msgr2=0x562c0f0b9500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.079+0000 7f4489c37980 1 --2- 172.21.15.194:0/2010916281 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c0f0b23c0 0x562c0f0b9500 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f447803dfd0 tx=0x7f447802ced0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.079+0000 7f4487f48640 1 -- 172.21.15.194:0/2010916281 reap_dead start 2024-09-13T06:09:56.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.079+0000 7f4487f48640 1 -- 172.21.15.194:0/2010916281 reap_dead start 2024-09-13T06:09:56.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.079+0000 7f4489c37980 1 -- 172.21.15.194:0/2010916281 shutdown_connections 2024-09-13T06:09:56.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.079+0000 7f4489c37980 1 -- 172.21.15.194:0/2010916281 >> 172.21.15.194:0/2010916281 conn(0x562c0f0ae7a0 msgr2=0x562c0f0ac870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:56.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.079+0000 7f4489c37980 1 -- 172.21.15.194:0/2010916281 shutdown_connections 2024-09-13T06:09:56.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.079+0000 7f4489c37980 1 -- 172.21.15.194:0/2010916281 wait complete. 2024-09-13T06:09:56.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.079+0000 7f4489c37980 1 -- 172.21.15.194:0/2328084310 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4360034650 msgr2=0x7f4360036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.079+0000 7f4489c37980 1 --2- 172.21.15.194:0/2328084310 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4360034650 0x7f4360036b10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f447c000c10 tx=0x7f447c005ad0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.079+0000 7f4489c37980 1 -- 172.21.15.194:0/2328084310 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c0ef09ca0 msgr2=0x562c0f0a8980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.079+0000 7f4489c37980 1 --2- 172.21.15.194:0/2328084310 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c0ef09ca0 0x562c0f0a8980 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f447801b950 tx=0x7f4478019970 comp rx=0 tx=0).stop 2024-09-13T06:09:56.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.079+0000 7f4489c37980 1 -- 172.21.15.194:0/2328084310 shutdown_connections 2024-09-13T06:09:56.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.079+0000 7f4489c37980 1 --2- 172.21.15.194:0/2328084310 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4360034650 0x7f4360036b10 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.079+0000 7f4489c37980 1 --2- 172.21.15.194:0/2328084310 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c0ef09ca0 0x562c0f0a8980 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.079+0000 7f4489c37980 1 -- 172.21.15.194:0/2328084310 >> 172.21.15.194:0/2328084310 conn(0x562c0f099cf0 msgr2=0x562c0f09c770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:56.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.079+0000 7f4489c37980 1 -- 172.21.15.194:0/2328084310 shutdown_connections 2024-09-13T06:09:56.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.079+0000 7f4489c37980 1 -- 172.21.15.194:0/2328084310 wait complete. 2024-09-13T06:09:56.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.079+0000 7f4489c37980 1 -- 172.21.15.194:0/2634663601 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x562c0ef98920 msgr2=0x562c0f08dcd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.086 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.079+0000 7f4489c37980 1 --2- 172.21.15.194:0/2634663601 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x562c0ef98920 0x562c0f08dcd0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.086 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.079+0000 7f4489c37980 1 -- 172.21.15.194:0/2634663601 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x562c0f094590 msgr2=0x562c0f096980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.086 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.079+0000 7f4489c37980 1 --2- 172.21.15.194:0/2634663601 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x562c0f094590 0x562c0f096980 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.086 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.079+0000 7f4489c37980 1 -- 172.21.15.194:0/2634663601 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x562c0f090690 msgr2=0x562c0f092a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.086 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.079+0000 7f4489c37980 1 --2- 172.21.15.194:0/2634663601 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x562c0f090690 0x562c0f092a80 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.086 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.079+0000 7f4489c37980 1 -- 172.21.15.194:0/2634663601 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f436c034650 msgr2=0x7f436c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.086 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.079+0000 7f4489c37980 1 --2- 172.21.15.194:0/2634663601 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f436c034650 0x7f436c036b10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f447c0ae000 tx=0x7f447c0a6000 comp rx=0 tx=0).stop 2024-09-13T06:09:56.086 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.079+0000 7f4489c37980 1 -- 172.21.15.194:0/2634663601 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c0ef94550 msgr2=0x562c0f086d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.086 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.079+0000 7f4489c37980 1 --2- 172.21.15.194:0/2634663601 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c0ef94550 0x562c0f086d00 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x562c0f080b50 tx=0x7f4478000bd0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.086 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.079+0000 7f4487f48640 1 -- 172.21.15.194:0/2634663601 reap_dead start 2024-09-13T06:09:56.086 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.079+0000 7f4489c37980 1 -- 172.21.15.194:0/2634663601 shutdown_connections 2024-09-13T06:09:56.086 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.079+0000 7f4489c37980 1 -- 172.21.15.194:0/2634663601 >> 172.21.15.194:0/2634663601 conn(0x562c0ef90070 msgr2=0x562c0f07a120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:56.086 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.079+0000 7f4489c37980 1 -- 172.21.15.194:0/2634663601 shutdown_connections 2024-09-13T06:09:56.087 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.079+0000 7f4489c37980 1 -- 172.21.15.194:0/2634663601 wait complete. 2024-09-13T06:09:56.091 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T06:09:53.191222Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-13T06:09:55.703324Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:09:53.191207Z', 'tags': [], 'group_ids': []} 2024-09-13T06:09:56.091 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo1'] 2024-09-13T06:09:56.091 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo1'] 2024-09-13T06:09:56.091 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo1 2024-09-13T06:09:56.165 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:09:56.165 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:09:56.166 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.167+0000 7fa346519980 1 Processor -- start 2024-09-13T06:09:56.166 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.167+0000 7fa346519980 1 -- start start 2024-09-13T06:09:56.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.167+0000 7fa346519980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55f13045dec0 0x55f1304602b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.167+0000 7fa346519980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f1302dfae0 con 0x55f1303cc290 2024-09-13T06:09:56.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.167+0000 7fa346519980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x55f130303e30 con 0x55f13045dec0 2024-09-13T06:09:56.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.167+0000 7fa343828640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55f13045dec0 0x55f1304602b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.167+0000 7fa343828640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55f13045dec0 0x55f1304602b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45006/0 (socket says 172.21.15.194:45006) 2024-09-13T06:09:56.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.167+0000 7fa343828640 1 -- 172.21.15.194:0/800712314 learned_addr learned my addr 172.21.15.194:0/800712314 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:56.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.167+0000 7fa344029640 1 --1- 172.21.15.194:0/800712314 >> v1:172.21.15.120:6789/0 conn(0x55f1303cc290 0x55f13045c7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:51054/0 (socket says 172.21.15.194:51054) 2024-09-13T06:09:56.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.167+0000 7fa343828640 1 -- 172.21.15.194:0/800712314 >> v1:172.21.15.120:6789/0 conn(0x55f1303cc290 legacy=0x55f13045c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.167+0000 7fa343828640 1 -- 172.21.15.194:0/800712314 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1303cc670 con 0x55f13045dec0 2024-09-13T06:09:56.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.167+0000 7fa343828640 1 --2- 172.21.15.194:0/800712314 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f13045dec0 0x55f1304602b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa33000a5c0 tx=0x7fa33001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a61ed5bbcc50d4f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.167+0000 7fa343027640 1 -- 172.21.15.194:0/800712314 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3300a6070 con 0x55f13045dec0 2024-09-13T06:09:56.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.167+0000 7fa343027640 1 -- 172.21.15.194:0/800712314 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3300af070 con 0x55f13045dec0 2024-09-13T06:09:56.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.167+0000 7fa343027640 1 -- 172.21.15.194:0/800712314 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3300aa5c0 con 0x55f13045dec0 2024-09-13T06:09:56.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.171+0000 7fa346519980 1 -- 172.21.15.194:0/800712314 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f13045dec0 msgr2=0x55f1304602b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.171+0000 7fa346519980 1 --2- 172.21.15.194:0/800712314 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f13045dec0 0x55f1304602b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa33000a5c0 tx=0x7fa33001b340 comp rx=0 tx=0).stop 2024-09-13T06:09:56.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.171+0000 7fa346519980 1 -- 172.21.15.194:0/800712314 shutdown_connections 2024-09-13T06:09:56.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.171+0000 7fa346519980 1 --2- 172.21.15.194:0/800712314 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f13045dec0 0x55f1304602b0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.171+0000 7fa346519980 1 -- 172.21.15.194:0/800712314 >> 172.21.15.194:0/800712314 conn(0x55f130452090 msgr2=0x55f1304544b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:56.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.171+0000 7fa346519980 1 -- 172.21.15.194:0/800712314 shutdown_connections 2024-09-13T06:09:56.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.171+0000 7fa346519980 1 -- 172.21.15.194:0/800712314 wait complete. 2024-09-13T06:09:56.184 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.183+0000 7fa346519980 1 Processor -- start 2024-09-13T06:09:56.185 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.183+0000 7fa346519980 1 -- start start 2024-09-13T06:09:56.185 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.183+0000 7fa346519980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f1303cc290 0x55f130544c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.185 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.183+0000 7fa346519980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55f130305200 con 0x55f1303cc290 2024-09-13T06:09:56.185 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.183+0000 7fa344029640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f1303cc290 0x55f130544c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.185 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.183+0000 7fa344029640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f1303cc290 0x55f130544c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45010/0 (socket says 172.21.15.194:45010) 2024-09-13T06:09:56.185 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.183+0000 7fa344029640 1 -- 172.21.15.194:0/3208963279 learned_addr learned my addr 172.21.15.194:0/3208963279 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:56.186 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.183+0000 7fa344029640 1 -- 172.21.15.194:0/3208963279 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f130545230 con 0x55f1303cc290 2024-09-13T06:09:56.186 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.183+0000 7fa344029640 1 --2- 172.21.15.194:0/3208963279 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f1303cc290 0x55f130544c60 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa334001e50 tx=0x7fa334001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9513b0722b3b88b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.186 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.183+0000 7fa231e13640 1 -- 172.21.15.194:0/3208963279 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa33400e5d0 con 0x55f1303cc290 2024-09-13T06:09:56.186 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.183+0000 7fa231e13640 1 -- 172.21.15.194:0/3208963279 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa33400e770 con 0x55f1303cc290 2024-09-13T06:09:56.186 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.183+0000 7fa231e13640 1 -- 172.21.15.194:0/3208963279 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa33400eab0 con 0x55f1303cc290 2024-09-13T06:09:56.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.187+0000 7fa346519980 1 -- 172.21.15.194:0/3208963279 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f1303cc290 msgr2=0x55f130544c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.188 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.187+0000 7fa346519980 1 --2- 172.21.15.194:0/3208963279 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f1303cc290 0x55f130544c60 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa334001e50 tx=0x7fa334001e80 comp rx=0 tx=0).stop 2024-09-13T06:09:56.188 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.187+0000 7fa346519980 1 -- 172.21.15.194:0/3208963279 shutdown_connections 2024-09-13T06:09:56.188 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.187+0000 7fa346519980 1 --2- 172.21.15.194:0/3208963279 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f1303cc290 0x55f130544c60 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.188 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.187+0000 7fa346519980 1 -- 172.21.15.194:0/3208963279 >> 172.21.15.194:0/3208963279 conn(0x55f130452090 msgr2=0x55f130540890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:56.188 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.187+0000 7fa346519980 1 -- 172.21.15.194:0/3208963279 shutdown_connections 2024-09-13T06:09:56.188 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.187+0000 7fa346519980 1 -- 172.21.15.194:0/3208963279 wait complete. 2024-09-13T06:09:56.188 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.187+0000 7fa346519980 1 Processor -- start 2024-09-13T06:09:56.188 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.187+0000 7fa346519980 1 -- start start 2024-09-13T06:09:56.188 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.187+0000 7fa346519980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f1303cc290 0x55f13054bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.188 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.187+0000 7fa346519980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55f130463220 con 0x55f1303cc290 2024-09-13T06:09:56.188 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.187+0000 7fa344029640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f1303cc290 0x55f13054bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.188 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.187+0000 7fa344029640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f1303cc290 0x55f13054bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45012/0 (socket says 172.21.15.194:45012) 2024-09-13T06:09:56.189 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.187+0000 7fa344029640 1 -- 172.21.15.194:0/2831251074 learned_addr learned my addr 172.21.15.194:0/2831251074 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:56.189 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.187+0000 7fa344029640 1 -- 172.21.15.194:0/2831251074 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f13054c2a0 con 0x55f1303cc290 2024-09-13T06:09:56.189 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.187+0000 7fa344029640 1 --2- 172.21.15.194:0/2831251074 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f1303cc290 0x55f13054bd60 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa33400bb60 tx=0x7fa334000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.187+0000 7fa22bfff640 1 -- 172.21.15.194:0/2831251074 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa334001260 con 0x55f1303cc290 2024-09-13T06:09:56.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.187+0000 7fa346519980 1 -- 172.21.15.194:0/2831251074 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f13054c530 con 0x55f1303cc290 2024-09-13T06:09:56.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.187+0000 7fa22bfff640 1 -- 172.21.15.194:0/2831251074 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa33400fda0 con 0x55f1303cc290 2024-09-13T06:09:56.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.187+0000 7fa22bfff640 1 -- 172.21.15.194:0/2831251074 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa33401a5b0 con 0x55f1303cc290 2024-09-13T06:09:56.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.187+0000 7fa346519980 1 -- 172.21.15.194:0/2831251074 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f13054f210 con 0x55f1303cc290 2024-09-13T06:09:56.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.187+0000 7fa22bfff640 1 -- 172.21.15.194:0/2831251074 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa334017070 con 0x55f1303cc290 2024-09-13T06:09:56.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.191+0000 7fa22bfff640 1 --2- 172.21.15.194:0/2831251074 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa22c034650 0x7fa22c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.191+0000 7fa22bfff640 1 -- 172.21.15.194:0/2831251074 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fa334015020 con 0x55f1303cc290 2024-09-13T06:09:56.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.191+0000 7fa343828640 1 --2- 172.21.15.194:0/2831251074 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa22c034650 0x7fa22c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.191+0000 7fa346519980 1 --2- 172.21.15.194:0/2831251074 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55f13045dec0 0x55f130552e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.191+0000 7fa346519980 1 -- 172.21.15.194:0/2831251074 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f1305533a0 con 0x55f13045dec0 2024-09-13T06:09:56.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.191+0000 7fa34482a640 1 --2- 172.21.15.194:0/2831251074 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55f13045dec0 0x55f130552e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.191+0000 7fa343828640 1 --2- 172.21.15.194:0/2831251074 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa22c034650 0x7fa22c036b10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa3300ae000 tx=0x7fa3300a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.191+0000 7fa34482a640 1 --2- 172.21.15.194:0/2831251074 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55f13045dec0 0x55f130552e60 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.191+0000 7fa34482a640 1 -- 172.21.15.194:0/2831251074 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa33c00a4d0 con 0x55f13045dec0 2024-09-13T06:09:56.193 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.191+0000 7fa346519980 1 -- 172.21.15.194:0/2831251074 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f1305503f0 con 0x55f13045dec0 2024-09-13T06:09:56.193 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.191+0000 7fa34482a640 1 -- 172.21.15.194:0/2831251074 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa33c00a4d0 con 0x55f13045dec0 2024-09-13T06:09:56.193 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.191+0000 7fa346519980 1 --2- 172.21.15.194:0/2831251074 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55f1305556c0 0x55f130557ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.193 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.191+0000 7fa346519980 1 -- 172.21.15.194:0/2831251074 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f130558180 con 0x55f1305556c0 2024-09-13T06:09:56.193 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.191+0000 7fa344029640 1 --2- 172.21.15.194:0/2831251074 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55f1305556c0 0x55f130557ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.193 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.191+0000 7fa344029640 1 --2- 172.21.15.194:0/2831251074 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55f1305556c0 0x55f130557ab0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.191+0000 7fa344029640 1 -- 172.21.15.194:0/2831251074 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa33402e070 con 0x55f1305556c0 2024-09-13T06:09:56.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.191+0000 7fa346519980 1 -- 172.21.15.194:0/2831251074 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f130554560 con 0x55f13045dec0 2024-09-13T06:09:56.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.191+0000 7fa34482a640 1 -- 172.21.15.194:0/2831251074 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa33c00a4d0 con 0x55f13045dec0 2024-09-13T06:09:56.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.191+0000 7fa346519980 1 --2- 172.21.15.194:0/2831251074 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55f1305595e0 0x55f13055b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.191+0000 7fa346519980 1 -- 172.21.15.194:0/2831251074 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f13055c110 con 0x55f1305595e0 2024-09-13T06:09:56.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.191+0000 7fa343828640 1 --2- 172.21.15.194:0/2831251074 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55f1305595e0 0x55f13055b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.191+0000 7fa343828640 1 --2- 172.21.15.194:0/2831251074 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55f1305595e0 0x55f13055b9d0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.191+0000 7fa343828640 1 -- 172.21.15.194:0/2831251074 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa3300aaa80 con 0x55f1305595e0 2024-09-13T06:09:56.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.191+0000 7fa346519980 1 Processor -- start 2024-09-13T06:09:56.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.191+0000 7fa346519980 1 -- start start 2024-09-13T06:09:56.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.191+0000 7fa346519980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f130569ba0 0x55f130569fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.191+0000 7fa346519980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55f13035e800 con 0x55f130569ba0 2024-09-13T06:09:56.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.195+0000 7fa344029640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f130569ba0 0x55f130569fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.195+0000 7fa344029640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f130569ba0 0x55f130569fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45024/0 (socket says 172.21.15.194:45024) 2024-09-13T06:09:56.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.195+0000 7fa344029640 1 -- 172.21.15.194:0/1025450105 learned_addr learned my addr 172.21.15.194:0/1025450105 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:56.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.195+0000 7fa344029640 1 -- 172.21.15.194:0/1025450105 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f13056a500 con 0x55f130569ba0 2024-09-13T06:09:56.197 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.195+0000 7fa344029640 1 --2- 172.21.15.194:0/1025450105 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f130569ba0 0x55f130569fc0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa33400bc00 tx=0x7fa33401bb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.197 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.195+0000 7fa2297fa640 1 -- 172.21.15.194:0/1025450105 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa33402c040 con 0x55f130569ba0 2024-09-13T06:09:56.197 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.195+0000 7fa346519980 1 -- 172.21.15.194:0/1025450105 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f13056a790 con 0x55f130569ba0 2024-09-13T06:09:56.197 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.195+0000 7fa2297fa640 1 -- 172.21.15.194:0/1025450105 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa334019720 con 0x55f130569ba0 2024-09-13T06:09:56.197 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.195+0000 7fa346519980 1 -- 172.21.15.194:0/1025450105 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f13056a790 con 0x55f130569ba0 2024-09-13T06:09:56.197 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.195+0000 7fa2297fa640 1 -- 172.21.15.194:0/1025450105 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa334042220 con 0x55f130569ba0 2024-09-13T06:09:56.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.195+0000 7fa2297fa640 1 -- 172.21.15.194:0/1025450105 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa3340423c0 con 0x55f130569ba0 2024-09-13T06:09:56.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.195+0000 7fa2297fa640 1 --2- 172.21.15.194:0/1025450105 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa21c0346f0 0x7fa21c036bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.195+0000 7fa2297fa640 1 -- 172.21.15.194:0/1025450105 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fa334042020 con 0x55f130569ba0 2024-09-13T06:09:56.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.195+0000 7fa343828640 1 --2- 172.21.15.194:0/1025450105 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa21c0346f0 0x7fa21c036bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.195+0000 7fa346519980 1 Processor -- start 2024-09-13T06:09:56.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.195+0000 7fa343828640 1 --2- 172.21.15.194:0/1025450105 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa21c0346f0 0x7fa21c036bb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x55f130553820 tx=0x7fa330005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.195+0000 7fa346519980 1 -- start start 2024-09-13T06:09:56.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.195+0000 7fa346519980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f130576310 0x55f130576710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.195+0000 7fa346519980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55f1305455b0 con 0x55f130576310 2024-09-13T06:09:56.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.199+0000 7fa344029640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f130576310 0x55f130576710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.199+0000 7fa344029640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f130576310 0x55f130576710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45028/0 (socket says 172.21.15.194:45028) 2024-09-13T06:09:56.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.199+0000 7fa344029640 1 -- 172.21.15.194:0/1029362745 learned_addr learned my addr 172.21.15.194:0/1029362745 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:56.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.199+0000 7fa344029640 1 -- 172.21.15.194:0/1029362745 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f130576ce0 con 0x55f130576310 2024-09-13T06:09:56.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.199+0000 7fa344029640 1 --2- 172.21.15.194:0/1029362745 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f130576310 0x55f130576710 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa334036000 tx=0x7fa33403dad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c79b85f348836e7a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.199+0000 7fa222ffd640 1 -- 172.21.15.194:0/1029362745 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa334042850 con 0x55f130576310 2024-09-13T06:09:56.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.199+0000 7fa222ffd640 1 -- 172.21.15.194:0/1029362745 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa33401a9e0 con 0x55f130576310 2024-09-13T06:09:56.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.199+0000 7fa222ffd640 1 -- 172.21.15.194:0/1029362745 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3340429f0 con 0x55f130576310 2024-09-13T06:09:56.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.199+0000 7fa346519980 1 -- 172.21.15.194:0/1029362745 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f130576310 msgr2=0x55f130576710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.199+0000 7fa346519980 1 --2- 172.21.15.194:0/1029362745 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f130576310 0x55f130576710 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa334036000 tx=0x7fa33403dad0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.199+0000 7fa346519980 1 -- 172.21.15.194:0/1029362745 shutdown_connections 2024-09-13T06:09:56.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.199+0000 7fa346519980 1 --2- 172.21.15.194:0/1029362745 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f130576310 0x55f130576710 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.199+0000 7fa346519980 1 -- 172.21.15.194:0/1029362745 >> 172.21.15.194:0/1029362745 conn(0x55f1305726a0 msgr2=0x55f1305707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:56.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.199+0000 7fa346519980 1 -- 172.21.15.194:0/1029362745 shutdown_connections 2024-09-13T06:09:56.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.199+0000 7fa346519980 1 -- 172.21.15.194:0/1029362745 wait complete. 2024-09-13T06:09:56.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.199+0000 7fa346519980 1 Processor -- start 2024-09-13T06:09:56.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.199+0000 7fa346519980 1 -- start start 2024-09-13T06:09:56.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.199+0000 7fa346519980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f130576310 0x55f13057d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.199+0000 7fa346519980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55f130577230 con 0x55f130576310 2024-09-13T06:09:56.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.199+0000 7fa344029640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f130576310 0x55f13057d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.199+0000 7fa344029640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f130576310 0x55f13057d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45036/0 (socket says 172.21.15.194:45036) 2024-09-13T06:09:56.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.199+0000 7fa344029640 1 -- 172.21.15.194:0/1794616674 learned_addr learned my addr 172.21.15.194:0/1794616674 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:56.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.199+0000 7fa344029640 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f13057d960 con 0x55f130576310 2024-09-13T06:09:56.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.199+0000 7fa344029640 1 --2- 172.21.15.194:0/1794616674 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f130576310 0x55f13057d420 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa3340110f0 tx=0x7fa33401de70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.199+0000 7fa2217fa640 1 -- 172.21.15.194:0/1794616674 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa334045b40 con 0x55f130576310 2024-09-13T06:09:56.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.199+0000 7fa346519980 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f13057d960 con 0x55f130576310 2024-09-13T06:09:56.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.199+0000 7fa2217fa640 1 -- 172.21.15.194:0/1794616674 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa33406f070 con 0x55f130576310 2024-09-13T06:09:56.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.199+0000 7fa2217fa640 1 -- 172.21.15.194:0/1794616674 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa334045e50 con 0x55f130576310 2024-09-13T06:09:56.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.199+0000 7fa346519980 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f13057ddd0 con 0x55f130576310 2024-09-13T06:09:56.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.203+0000 7fa2217fa640 1 -- 172.21.15.194:0/1794616674 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa334068030 con 0x55f130576310 2024-09-13T06:09:56.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.203+0000 7fa2217fa640 1 --2- 172.21.15.194:0/1794616674 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa20c034650 0x7fa20c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.203+0000 7fa346519980 20 rados->read ofs=0 len=0 2024-09-13T06:09:56.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.203+0000 7fa2217fa640 1 -- 172.21.15.194:0/1794616674 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fa33405c030 con 0x55f130576310 2024-09-13T06:09:56.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.203+0000 7fa343828640 1 --2- 172.21.15.194:0/1794616674 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa20c034650 0x7fa20c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.203+0000 7fa346519980 1 --2- 172.21.15.194:0/1794616674 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55f1305884e0 0x55f13058a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.203+0000 7fa346519980 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f13058b0f0 con 0x55f1305884e0 2024-09-13T06:09:56.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.203+0000 7fa34482a640 1 --2- 172.21.15.194:0/1794616674 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55f1305884e0 0x55f13058a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.203+0000 7fa343828640 1 --2- 172.21.15.194:0/1794616674 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa20c034650 0x7fa20c036b10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa3300aafd0 tx=0x7fa3300c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.203+0000 7fa34482a640 1 --2- 172.21.15.194:0/1794616674 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55f1305884e0 0x55f13058a9a0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.203+0000 7fa34482a640 1 -- 172.21.15.194:0/1794616674 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa33c00a4d0 con 0x55f1305884e0 2024-09-13T06:09:56.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.203+0000 7fa346519980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:56.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.203+0000 7fa346519980 20 realm 2024-09-13T06:09:56.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.203+0000 7fa346519980 20 rados->read ofs=0 len=0 2024-09-13T06:09:56.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.203+0000 7fa346519980 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f13058b500 con 0x55f1305884e0 2024-09-13T06:09:56.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.203+0000 7fa34482a640 1 -- 172.21.15.194:0/1794616674 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa33c00a4d0 con 0x55f1305884e0 2024-09-13T06:09:56.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.203+0000 7fa346519980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:56.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.203+0000 7fa346519980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:09:56.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.203+0000 7fa346519980 20 rados->read ofs=0 len=0 2024-09-13T06:09:56.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.203+0000 7fa346519980 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f13058bda0 con 0x55f1305884e0 2024-09-13T06:09:56.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.203+0000 7fa34482a640 1 -- 172.21.15.194:0/1794616674 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa33c00a4d0 con 0x55f1305884e0 2024-09-13T06:09:56.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.203+0000 7fa346519980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:56.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.203+0000 7fa346519980 20 rados->read ofs=0 len=0 2024-09-13T06:09:56.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.203+0000 7fa346519980 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f13058c140 con 0x55f1305884e0 2024-09-13T06:09:56.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.203+0000 7fa34482a640 1 -- 172.21.15.194:0/1794616674 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa33c00a4d0 con 0x55f1305884e0 2024-09-13T06:09:56.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.203+0000 7fa346519980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:56.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.203+0000 7fa346519980 20 rados->read ofs=0 len=0 2024-09-13T06:09:56.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.203+0000 7fa346519980 1 --2- 172.21.15.194:0/1794616674 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55f13058cea0 0x55f13058f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.203+0000 7fa344029640 1 --2- 172.21.15.194:0/1794616674 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55f13058cea0 0x55f13058f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.203+0000 7fa344029640 1 --2- 172.21.15.194:0/1794616674 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55f13058cea0 0x55f13058f290 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.203+0000 7fa346519980 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f13058f930 con 0x55f13058cea0 2024-09-13T06:09:56.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.203+0000 7fa344029640 1 -- 172.21.15.194:0/1794616674 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa33402e070 con 0x55f13058cea0 2024-09-13T06:09:56.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.203+0000 7fa346519980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:09:56.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.203+0000 7fa346519980 20 searching for the correct realm 2024-09-13T06:09:56.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.203+0000 7fa346519980 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f130591190 con 0x55f13058cea0 2024-09-13T06:09:56.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.207+0000 7fa344029640 1 -- 172.21.15.194:0/1794616674 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa33402e070 con 0x55f13058cea0 2024-09-13T06:09:56.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.207+0000 7fa344029640 1 --2- 172.21.15.194:0/1794616674 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fa33406ab70 0x7fa334074460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.207+0000 7fa344029640 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f130591190 con 0x7fa33406ab70 2024-09-13T06:09:56.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.207+0000 7fa343828640 1 --2- 172.21.15.194:0/1794616674 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fa33406ab70 0x7fa334074460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.207+0000 7fa343828640 1 --2- 172.21.15.194:0/1794616674 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fa33406ab70 0x7fa334074460 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.207+0000 7fa343828640 1 -- 172.21.15.194:0/1794616674 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa3300aaa80 con 0x7fa33406ab70 2024-09-13T06:09:56.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.207+0000 7fa343828640 1 --2- 172.21.15.194:0/1794616674 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fa3300e0040 0x7fa3300e0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.207+0000 7fa343828640 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f130591190 con 0x7fa3300e0040 2024-09-13T06:09:56.212 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.207+0000 7fa34482a640 1 --2- 172.21.15.194:0/1794616674 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fa3300e0040 0x7fa3300e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.212 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.207+0000 7fa34482a640 1 --2- 172.21.15.194:0/1794616674 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fa3300e0040 0x7fa3300e0420 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.207+0000 7fa34482a640 1 -- 172.21.15.194:0/1794616674 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa33c00a4d0 con 0x7fa3300e0040 2024-09-13T06:09:56.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.207+0000 7fa34482a640 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f13058c140 con 0x55f1305884e0 2024-09-13T06:09:56.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.207+0000 7fa34482a640 1 -- 172.21.15.194:0/1794616674 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa33c00a4d0 con 0x55f1305884e0 2024-09-13T06:09:56.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.207+0000 7fa34482a640 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f13058c140 con 0x55f1305884e0 2024-09-13T06:09:56.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.207+0000 7fa34482a640 1 -- 172.21.15.194:0/1794616674 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa33c00a4d0 con 0x55f1305884e0 2024-09-13T06:09:56.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.207+0000 7fa34482a640 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f13058c140 con 0x7fa3300e0040 2024-09-13T06:09:56.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.207+0000 7fa34482a640 1 -- 172.21.15.194:0/1794616674 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa33c00a4d0 con 0x7fa3300e0040 2024-09-13T06:09:56.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.207+0000 7fa34482a640 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f13058c140 con 0x7fa3300e0040 2024-09-13T06:09:56.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.211+0000 7fa34482a640 1 -- 172.21.15.194:0/1794616674 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa33c00a4d0 con 0x7fa3300e0040 2024-09-13T06:09:56.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.211+0000 7fa34482a640 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f13058c140 con 0x7fa33406ab70 2024-09-13T06:09:56.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.211+0000 7fa343828640 1 -- 172.21.15.194:0/1794616674 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3300aaa80 con 0x7fa33406ab70 2024-09-13T06:09:56.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.211+0000 7fa343828640 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f13058c140 con 0x55f13058cea0 2024-09-13T06:09:56.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.211+0000 7fa344029640 1 -- 172.21.15.194:0/1794616674 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa33402e070 con 0x55f13058cea0 2024-09-13T06:09:56.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.211+0000 7fa344029640 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f13058c140 con 0x55f1305884e0 2024-09-13T06:09:56.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.211+0000 7fa34482a640 1 -- 172.21.15.194:0/1794616674 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa33c00a4d0 con 0x55f1305884e0 2024-09-13T06:09:56.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.211+0000 7fa34482a640 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f13058c140 con 0x7fa3300e0040 2024-09-13T06:09:56.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.211+0000 7fa34482a640 1 -- 172.21.15.194:0/1794616674 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa33c00a4d0 con 0x7fa3300e0040 2024-09-13T06:09:56.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.211+0000 7fa34482a640 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f13058c140 con 0x55f1305884e0 2024-09-13T06:09:56.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.211+0000 7fa34482a640 1 -- 172.21.15.194:0/1794616674 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa33c00a4d0 con 0x55f1305884e0 2024-09-13T06:09:56.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.211+0000 7fa34482a640 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f13058c140 con 0x7fa33406ab70 2024-09-13T06:09:56.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.211+0000 7fa343828640 1 -- 172.21.15.194:0/1794616674 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa3300aaa80 con 0x7fa33406ab70 2024-09-13T06:09:56.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.211+0000 7fa343828640 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f13058c140 con 0x55f13058cea0 2024-09-13T06:09:56.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.211+0000 7fa344029640 1 -- 172.21.15.194:0/1794616674 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa33402e070 con 0x55f13058cea0 2024-09-13T06:09:56.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.211+0000 7fa344029640 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f13058c140 con 0x55f13058cea0 2024-09-13T06:09:56.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.211+0000 7fa344029640 1 -- 172.21.15.194:0/1794616674 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa33402e070 con 0x55f13058cea0 2024-09-13T06:09:56.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.211+0000 7fa344029640 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f13058c140 con 0x7fa3300e0040 2024-09-13T06:09:56.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.211+0000 7fa34482a640 1 -- 172.21.15.194:0/1794616674 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa33c00a4d0 con 0x7fa3300e0040 2024-09-13T06:09:56.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.211+0000 7fa34482a640 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f13058c140 con 0x55f13058cea0 2024-09-13T06:09:56.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.211+0000 7fa344029640 1 -- 172.21.15.194:0/1794616674 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa33402e070 con 0x55f13058cea0 2024-09-13T06:09:56.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.211+0000 7fa344029640 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f13058c140 con 0x55f13058cea0 2024-09-13T06:09:56.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.215+0000 7fa344029640 1 -- 172.21.15.194:0/1794616674 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa33402e070 con 0x55f13058cea0 2024-09-13T06:09:56.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.215+0000 7fa344029640 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f13058c140 con 0x55f1305884e0 2024-09-13T06:09:56.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.215+0000 7fa34482a640 1 -- 172.21.15.194:0/1794616674 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa33c00a4d0 con 0x55f1305884e0 2024-09-13T06:09:56.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.215+0000 7fa34482a640 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f13058c140 con 0x55f1305884e0 2024-09-13T06:09:56.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.215+0000 7fa34482a640 1 -- 172.21.15.194:0/1794616674 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa33c00a4d0 con 0x55f1305884e0 2024-09-13T06:09:56.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.215+0000 7fa34482a640 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f13058c140 con 0x7fa3300e0040 2024-09-13T06:09:56.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.215+0000 7fa34482a640 1 -- 172.21.15.194:0/1794616674 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa33c00a4d0 con 0x7fa3300e0040 2024-09-13T06:09:56.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.215+0000 7fa34482a640 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f13058c140 con 0x55f13058cea0 2024-09-13T06:09:56.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.215+0000 7fa344029640 1 -- 172.21.15.194:0/1794616674 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa33402e070 con 0x55f13058cea0 2024-09-13T06:09:56.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.215+0000 7fa344029640 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f13058c140 con 0x7fa33406ab70 2024-09-13T06:09:56.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.215+0000 7fa343828640 1 -- 172.21.15.194:0/1794616674 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3300aaa80 con 0x7fa33406ab70 2024-09-13T06:09:56.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.215+0000 7fa343828640 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f13058c140 con 0x55f1305884e0 2024-09-13T06:09:56.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.215+0000 7fa34482a640 1 -- 172.21.15.194:0/1794616674 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa33c00a4d0 con 0x55f1305884e0 2024-09-13T06:09:56.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.215+0000 7fa34482a640 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f13058c140 con 0x7fa3300e0040 2024-09-13T06:09:56.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.215+0000 7fa34482a640 1 -- 172.21.15.194:0/1794616674 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa33c00a4d0 con 0x7fa3300e0040 2024-09-13T06:09:56.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.215+0000 7fa34482a640 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f13058c140 con 0x55f13058cea0 2024-09-13T06:09:56.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.215+0000 7fa344029640 1 -- 172.21.15.194:0/1794616674 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa33402e070 con 0x55f13058cea0 2024-09-13T06:09:56.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.215+0000 7fa344029640 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f13058c140 con 0x7fa3300e0040 2024-09-13T06:09:56.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.215+0000 7fa34482a640 1 -- 172.21.15.194:0/1794616674 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa33c00a4d0 con 0x7fa3300e0040 2024-09-13T06:09:56.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.215+0000 7fa34482a640 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f13058c140 con 0x7fa33406ab70 2024-09-13T06:09:56.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.215+0000 7fa343828640 1 -- 172.21.15.194:0/1794616674 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3300aaa80 con 0x7fa33406ab70 2024-09-13T06:09:56.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.215+0000 7fa343828640 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f13058c140 con 0x55f13058cea0 2024-09-13T06:09:56.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.219+0000 7fa344029640 1 -- 172.21.15.194:0/1794616674 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa33402e070 con 0x55f13058cea0 2024-09-13T06:09:56.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.219+0000 7fa344029640 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f13058c140 con 0x7fa3300e0040 2024-09-13T06:09:56.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.219+0000 7fa34482a640 1 -- 172.21.15.194:0/1794616674 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa33c00a4d0 con 0x7fa3300e0040 2024-09-13T06:09:56.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.219+0000 7fa34482a640 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f13058c140 con 0x55f1305884e0 2024-09-13T06:09:56.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.219+0000 7fa34482a640 1 -- 172.21.15.194:0/1794616674 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa33c00a4d0 con 0x55f1305884e0 2024-09-13T06:09:56.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.219+0000 7fa34482a640 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f13058c140 con 0x7fa33406ab70 2024-09-13T06:09:56.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.219+0000 7fa343828640 1 -- 172.21.15.194:0/1794616674 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3300aaa80 con 0x7fa33406ab70 2024-09-13T06:09:56.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.219+0000 7fa346519980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:09:56.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.219+0000 7fa346519980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:09:56.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.219+0000 7fa346519980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:09:56.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.219+0000 7fa346519980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:09:56.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.219+0000 7fa346519980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:09:56.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.219+0000 7fa346519980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:09:56.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.219+0000 7fa346519980 20 rados->read ofs=0 len=0 2024-09-13T06:09:56.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.219+0000 7fa346519980 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f130590280 con 0x55f1305884e0 2024-09-13T06:09:56.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.219+0000 7fa34482a640 1 -- 172.21.15.194:0/1794616674 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa33c00a4d0 con 0x55f1305884e0 2024-09-13T06:09:56.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.219+0000 7fa346519980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:56.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.219+0000 7fa346519980 20 rados->read ofs=0 len=0 2024-09-13T06:09:56.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.219+0000 7fa346519980 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f130590ad0 con 0x55f1305884e0 2024-09-13T06:09:56.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.219+0000 7fa34482a640 1 -- 172.21.15.194:0/1794616674 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa33c00a4d0 con 0x55f1305884e0 2024-09-13T06:09:56.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.219+0000 7fa346519980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:56.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.219+0000 7fa346519980 20 rados->read ofs=0 len=0 2024-09-13T06:09:56.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.219+0000 7fa346519980 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f13058fec0 con 0x7fa33406ab70 2024-09-13T06:09:56.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.219+0000 7fa343828640 1 -- 172.21.15.194:0/1794616674 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa3300aaa80 con 0x7fa33406ab70 2024-09-13T06:09:56.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.219+0000 7fa346519980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:09:56.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.219+0000 7fa346519980 20 zone default found 2024-09-13T06:09:56.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.219+0000 7fa346519980 4 Realm: () 2024-09-13T06:09:56.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.219+0000 7fa346519980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:09:56.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.219+0000 7fa346519980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:09:56.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.219+0000 7fa346519980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:09:56.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.219+0000 7fa346519980 20 zonegroup default 2024-09-13T06:09:56.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.219+0000 7fa346519980 20 rados->read ofs=0 len=0 2024-09-13T06:09:56.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.219+0000 7fa346519980 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f1305915c0 con 0x7fa3300e0040 2024-09-13T06:09:56.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.219+0000 7fa34482a640 1 -- 172.21.15.194:0/1794616674 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa33c00a4d0 con 0x7fa3300e0040 2024-09-13T06:09:56.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.219+0000 7fa346519980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:56.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.219+0000 7fa346519980 20 rados->read ofs=0 len=0 2024-09-13T06:09:56.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.219+0000 7fa346519980 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f130592fa0 con 0x55f13058cea0 2024-09-13T06:09:56.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.219+0000 7fa344029640 1 -- 172.21.15.194:0/1794616674 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa33402e070 con 0x55f13058cea0 2024-09-13T06:09:56.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.219+0000 7fa346519980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:56.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.219+0000 7fa346519980 20 rados->read ofs=0 len=0 2024-09-13T06:09:56.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.219+0000 7fa346519980 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f130593420 con 0x55f13058cea0 2024-09-13T06:09:56.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.219+0000 7fa344029640 1 -- 172.21.15.194:0/1794616674 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa33402e070 con 0x55f13058cea0 2024-09-13T06:09:56.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.219+0000 7fa346519980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:56.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.219+0000 7fa346519980 20 started sync module instance, tier type = 2024-09-13T06:09:56.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.219+0000 7fa346519980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:09:56.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.219+0000 7fa346519980 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f130592440 con 0x7fa33406ab70 2024-09-13T06:09:56.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.223+0000 7fa343828640 1 -- 172.21.15.194:0/1794616674 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(44 notify.0 [create] v33'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3300aaa80 con 0x7fa33406ab70 2024-09-13T06:09:56.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.223+0000 7fa346519980 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94494386628656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f130593d30 con 0x7fa33406ab70 2024-09-13T06:09:56.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.223+0000 7fa346519980 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f130594580 con 0x55f1305884e0 2024-09-13T06:09:56.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.223+0000 7fa343828640 1 -- 172.21.15.194:0/1794616674 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94494386628656] v33'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3300aaa80 con 0x7fa33406ab70 2024-09-13T06:09:56.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.223+0000 7fa34482a640 1 -- 172.21.15.194:0/1794616674 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v33'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa33c00a4d0 con 0x55f1305884e0 2024-09-13T06:09:56.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.223+0000 7fa346519980 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94494386632832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f130594580 con 0x55f1305884e0 2024-09-13T06:09:56.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.223+0000 7fa346519980 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f130595020 con 0x55f13058cea0 2024-09-13T06:09:56.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.227+0000 7fa34482a640 1 -- 172.21.15.194:0/1794616674 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94494386632832] v33'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa33c00a4d0 con 0x55f1305884e0 2024-09-13T06:09:56.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.227+0000 7fa344029640 1 -- 172.21.15.194:0/1794616674 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v33'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa33402e070 con 0x55f13058cea0 2024-09-13T06:09:56.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.227+0000 7fa346519980 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94494386634960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1305944f0 con 0x55f13058cea0 2024-09-13T06:09:56.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.227+0000 7fa346519980 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f130595d70 con 0x7fa33406ab70 2024-09-13T06:09:56.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.227+0000 7fa343828640 1 -- 172.21.15.194:0/1794616674 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(50 notify.3 [create] v33'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3300aaa80 con 0x7fa33406ab70 2024-09-13T06:09:56.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.227+0000 7fa346519980 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94494386643296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f130596a30 con 0x7fa33406ab70 2024-09-13T06:09:56.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.227+0000 7fa346519980 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1305973f0 con 0x55f1305884e0 2024-09-13T06:09:56.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.227+0000 7fa344029640 1 -- 172.21.15.194:0/1794616674 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94494386634960] v33'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa33402e070 con 0x55f13058cea0 2024-09-13T06:09:56.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.227+0000 7fa343828640 1 -- 172.21.15.194:0/1794616674 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94494386643296] v33'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3300aaa80 con 0x7fa33406ab70 2024-09-13T06:09:56.231 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.227+0000 7fa34482a640 1 -- 172.21.15.194:0/1794616674 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v33'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa33c00a4d0 con 0x55f1305884e0 2024-09-13T06:09:56.231 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.231+0000 7fa346519980 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94494386646848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f130596a30 con 0x55f1305884e0 2024-09-13T06:09:56.231 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.231+0000 7fa346519980 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f130597360 con 0x7fa3300e0040 2024-09-13T06:09:56.231 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.231+0000 7fa34482a640 1 -- 172.21.15.194:0/1794616674 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94494386646848] v33'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa33c00a4d0 con 0x55f1305884e0 2024-09-13T06:09:56.232 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.231+0000 7fa34482a640 1 -- 172.21.15.194:0/1794616674 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(54 notify.5 [create] v33'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa33c00a4d0 con 0x7fa3300e0040 2024-09-13T06:09:56.232 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.231+0000 7fa346519980 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94494386644352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1305969a0 con 0x7fa3300e0040 2024-09-13T06:09:56.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.231+0000 7fa346519980 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f130598220 con 0x7fa3300e0040 2024-09-13T06:09:56.235 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.235+0000 7fa34482a640 1 -- 172.21.15.194:0/1794616674 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(56 notify.6 [create] v33'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa33c00a4d0 con 0x7fa3300e0040 2024-09-13T06:09:56.235 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.235+0000 7fa346519980 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94494386650480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f130598640 con 0x7fa3300e0040 2024-09-13T06:09:56.235 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.235+0000 7fa346519980 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f130599130 con 0x7fa3300e0040 2024-09-13T06:09:56.235 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.235+0000 7fa34482a640 1 -- 172.21.15.194:0/1794616674 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94494386644352] v33'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa33c00a4d0 con 0x7fa3300e0040 2024-09-13T06:09:56.237 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.235+0000 7fa34482a640 1 -- 172.21.15.194:0/1794616674 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(58 notify.7 [create] v33'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa33c00a4d0 con 0x7fa3300e0040 2024-09-13T06:09:56.237 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.235+0000 7fa346519980 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94494386654208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1305990f0 con 0x7fa3300e0040 2024-09-13T06:09:56.237 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.235+0000 7fa346519980 20 add_watcher() i=0 2024-09-13T06:09:56.237 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.235+0000 7fa346519980 20 add_watcher() i=1 2024-09-13T06:09:56.237 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.235+0000 7fa346519980 20 add_watcher() i=2 2024-09-13T06:09:56.237 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.235+0000 7fa346519980 20 add_watcher() i=3 2024-09-13T06:09:56.237 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.235+0000 7fa346519980 20 add_watcher() i=4 2024-09-13T06:09:56.237 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.235+0000 7fa346519980 20 add_watcher() i=5 2024-09-13T06:09:56.237 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.235+0000 7fa34482a640 1 -- 172.21.15.194:0/1794616674 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94494386650480] v33'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa33c00a4d0 con 0x7fa3300e0040 2024-09-13T06:09:56.238 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.235+0000 7fa346519980 20 add_watcher() i=6 2024-09-13T06:09:56.238 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.239+0000 7fa34482a640 1 -- 172.21.15.194:0/1794616674 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94494386654208] v33'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa33c00a4d0 con 0x7fa3300e0040 2024-09-13T06:09:56.238 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.239+0000 7fa346519980 20 add_watcher() i=7 2024-09-13T06:09:56.239 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.239+0000 7fa346519980 2 all 8 watchers are set, enabling cache 2024-09-13T06:09:56.239 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.239+0000 7fa346519980 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f130598190 con 0x55f1305884e0 2024-09-13T06:09:56.239 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.239+0000 7fa34482a640 1 -- 172.21.15.194:0/1794616674 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa33c00a4d0 con 0x55f1305884e0 2024-09-13T06:09:56.239 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.239+0000 7fa346519980 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94494386651536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f130599560 con 0x55f1305884e0 2024-09-13T06:09:56.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.239+0000 7fa34482a640 1 -- 172.21.15.194:0/1794616674 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94494386651536] v33'84 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa33c00a4d0 con 0x55f1305884e0 2024-09-13T06:09:56.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.239+0000 7fa1f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:56.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.239+0000 7fa346519980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:09:56.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.239+0000 7fa346519980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:09:56.242 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.239+0000 7fa346519980 5 note: GC not initialized 2024-09-13T06:09:56.242 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.239+0000 7fa1f8fe1640 20 reqs_thread_entry: start 2024-09-13T06:09:56.242 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.239+0000 7fa346519980 20 init_complete bucket index max shards: 11 2024-09-13T06:09:56.242 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.239+0000 7fa346519980 20 Filter name: none 2024-09-13T06:09:56.242 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.239+0000 7fa1727fc640 20 reqs_thread_entry: start 2024-09-13T06:09:56.242 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.239+0000 7fa346519980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T06:09:56.242 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.239+0000 7fa346519980 20 rados->read ofs=0 len=0 2024-09-13T06:09:56.242 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.239+0000 7fa346519980 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f1305bf690 con 0x55f1305884e0 2024-09-13T06:09:56.242 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.239+0000 7fa34482a640 1 -- 172.21.15.194:0/1794616674 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(62 foo [call out=48b,read 0~582 out=582b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+705 (crc 0 0 0) 0x7fa33c00a4d0 con 0x55f1305884e0 2024-09-13T06:09:56.242 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.239+0000 7fa346519980 20 rados_obj.operate() r=0 bl.length=582 2024-09-13T06:09:56.242 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.239+0000 7fa346519980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T06:09:56.242 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.239+0000 7fa346519980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:09:56.242 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.239+0000 7fa346519980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:09:56.243 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.239+0000 7fa346519980 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1305c5cf0 con 0x55f1305884e0 2024-09-13T06:09:56.244 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.243+0000 7fa34482a640 1 -- 172.21.15.194:0/1794616674 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v33'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fa33c00a4d0 con 0x55f1305884e0 2024-09-13T06:09:56.244 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.243+0000 7fa346519980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T06:09:56.244 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.243+0000 7fa346519980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:09:56.244 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.243+0000 7fa346519980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T06:09:56.244 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.243+0000 7fa346519980 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94494386837344 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f1305c1690 con 0x55f1305884e0 2024-09-13T06:09:56.244 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.243+0000 7fa34482a640 1 -- 172.21.15.194:0/1794616674 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== watch-notify(notify (1) cookie 94494386646848 notify 141733920777 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7fa33c02d040 con 0x55f1305884e0 2024-09-13T06:09:56.244 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.243+0000 7fa222ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920777 cookie 94494386646848 notifier 4409 bl.length()=732 2024-09-13T06:09:56.244 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.243+0000 7fa222ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T06:09:56.244 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.243+0000 7fa222ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:09:56.244 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.243+0000 7fa222ffd640 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fa208003eb0 con 0x55f1305884e0 2024-09-13T06:09:56.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.243+0000 7fa34482a640 1 -- 172.21.15.194:0/1794616674 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(64 notify.4 [notify cookie 94494386837344 out=8b] v0'0 uv75 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa33c00a4d0 con 0x55f1305884e0 2024-09-13T06:09:56.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.243+0000 7fa34482a640 1 -- 172.21.15.194:0/1794616674 <== osd.1 v2:172.21.15.194:6808/3135444559 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa33c00a4d0 con 0x55f1305884e0 2024-09-13T06:09:56.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.243+0000 7fa34482a640 1 -- 172.21.15.194:0/1794616674 <== osd.1 v2:172.21.15.194:6808/3135444559 26 ==== watch-notify(notify_complete (2) cookie 94494386837344 notify 141733920777 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fa33c01e040 con 0x55f1305884e0 2024-09-13T06:09:56.245 INFO:teuthology.orchestra.run.smithi194.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T06:09:53.191222Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-13T06:09:55.703324Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:09:53.191207Z","tags":[],"group_ids":[]} 2024-09-13T06:09:56.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.243+0000 7fa1f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:56.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.243+0000 7fa346519980 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94494386651536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1305bd4c0 con 0x55f1305884e0 2024-09-13T06:09:56.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.243+0000 7fa34482a640 1 -- 172.21.15.194:0/1794616674 <== osd.1 v2:172.21.15.194:6808/3135444559 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94494386651536] v33'85 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa33c00a4d0 con 0x55f1305884e0 2024-09-13T06:09:56.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.243+0000 7fa346519980 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94494386628656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1305bd4c0 con 0x7fa33406ab70 2024-09-13T06:09:56.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.243+0000 7fa343828640 1 -- 172.21.15.194:0/1794616674 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94494386628656] v33'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3300aaa80 con 0x7fa33406ab70 2024-09-13T06:09:56.247 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.243+0000 7fa346519980 20 remove_watcher() i=0 2024-09-13T06:09:56.247 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.243+0000 7fa346519980 2 removed watcher, disabling cache 2024-09-13T06:09:56.247 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.243+0000 7fa346519980 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94494386632832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1305bd4c0 con 0x55f1305884e0 2024-09-13T06:09:56.248 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.247+0000 7fa34482a640 1 -- 172.21.15.194:0/1794616674 <== osd.1 v2:172.21.15.194:6808/3135444559 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94494386632832] v33'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa33c00a4d0 con 0x55f1305884e0 2024-09-13T06:09:56.248 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.247+0000 7fa346519980 20 remove_watcher() i=1 2024-09-13T06:09:56.248 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.247+0000 7fa346519980 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94494386634960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f130593880 con 0x55f13058cea0 2024-09-13T06:09:56.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.247+0000 7fa344029640 1 -- 172.21.15.194:0/1794616674 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94494386634960] v33'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa33402e070 con 0x55f13058cea0 2024-09-13T06:09:56.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.247+0000 7fa346519980 20 remove_watcher() i=2 2024-09-13T06:09:56.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.247+0000 7fa346519980 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94494386643296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1305bd4c0 con 0x7fa33406ab70 2024-09-13T06:09:56.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.251+0000 7fa343828640 1 -- 172.21.15.194:0/1794616674 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94494386643296] v33'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3300aaa80 con 0x7fa33406ab70 2024-09-13T06:09:56.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.251+0000 7fa346519980 20 remove_watcher() i=3 2024-09-13T06:09:56.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.251+0000 7fa346519980 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94494386646848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1305940d0 con 0x55f1305884e0 2024-09-13T06:09:56.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.251+0000 7fa34482a640 1 -- 172.21.15.194:0/1794616674 <== osd.1 v2:172.21.15.194:6808/3135444559 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94494386646848] v33'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa33c00a4d0 con 0x55f1305884e0 2024-09-13T06:09:56.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.251+0000 7fa346519980 20 remove_watcher() i=4 2024-09-13T06:09:56.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.251+0000 7fa346519980 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94494386644352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f130596160 con 0x7fa3300e0040 2024-09-13T06:09:56.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.255+0000 7fa34482a640 1 -- 172.21.15.194:0/1794616674 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94494386644352] v33'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa33c00a4d0 con 0x7fa3300e0040 2024-09-13T06:09:56.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.255+0000 7fa346519980 20 remove_watcher() i=5 2024-09-13T06:09:56.256 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.255+0000 7fa346519980 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94494386650480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1305bd4c0 con 0x7fa3300e0040 2024-09-13T06:09:56.257 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.255+0000 7fa34482a640 1 -- 172.21.15.194:0/1794616674 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94494386650480] v33'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa33c00a4d0 con 0x7fa3300e0040 2024-09-13T06:09:56.257 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.255+0000 7fa346519980 20 remove_watcher() i=6 2024-09-13T06:09:56.258 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.255+0000 7fa346519980 1 -- 172.21.15.194:0/1794616674 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94494386654208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f130596f40 con 0x7fa3300e0040 2024-09-13T06:09:56.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.259+0000 7fa34482a640 1 -- 172.21.15.194:0/1794616674 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94494386654208] v33'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa33c00a4d0 con 0x7fa3300e0040 2024-09-13T06:09:56.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.259+0000 7fa346519980 20 remove_watcher() i=7 2024-09-13T06:09:56.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.259+0000 7fa346519980 1 -- 172.21.15.194:0/1794616674 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fa3300e0040 msgr2=0x7fa3300e0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.259+0000 7fa346519980 1 --2- 172.21.15.194:0/1794616674 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fa3300e0040 0x7fa3300e0420 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.259+0000 7fa346519980 1 -- 172.21.15.194:0/1794616674 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55f1305884e0 msgr2=0x55f13058a9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.259+0000 7fa346519980 1 --2- 172.21.15.194:0/1794616674 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55f1305884e0 0x55f13058a9a0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.259+0000 7fa346519980 1 -- 172.21.15.194:0/1794616674 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fa33406ab70 msgr2=0x7fa334074460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.259+0000 7fa346519980 1 --2- 172.21.15.194:0/1794616674 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fa33406ab70 0x7fa334074460 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.259+0000 7fa346519980 1 -- 172.21.15.194:0/1794616674 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55f13058cea0 msgr2=0x55f13058f290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.259+0000 7fa346519980 1 --2- 172.21.15.194:0/1794616674 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55f13058cea0 0x55f13058f290 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.259+0000 7fa346519980 1 -- 172.21.15.194:0/1794616674 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa20c034650 msgr2=0x7fa20c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.259+0000 7fa346519980 1 --2- 172.21.15.194:0/1794616674 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa20c034650 0x7fa20c036b10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa3300aafd0 tx=0x7fa3300c1040 comp rx=0 tx=0).stop 2024-09-13T06:09:56.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.259+0000 7fa346519980 1 -- 172.21.15.194:0/1794616674 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f130576310 msgr2=0x55f13057d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.259+0000 7fa346519980 1 --2- 172.21.15.194:0/1794616674 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f130576310 0x55f13057d420 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa3340110f0 tx=0x7fa33401de70 comp rx=0 tx=0).stop 2024-09-13T06:09:56.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.259+0000 7fa34482a640 1 -- 172.21.15.194:0/1794616674 reap_dead start 2024-09-13T06:09:56.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.259+0000 7fa34482a640 1 -- 172.21.15.194:0/1794616674 reap_dead start 2024-09-13T06:09:56.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.259+0000 7fa346519980 1 -- 172.21.15.194:0/1794616674 shutdown_connections 2024-09-13T06:09:56.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.259+0000 7fa346519980 1 -- 172.21.15.194:0/1794616674 >> 172.21.15.194:0/1794616674 conn(0x55f1305726a0 msgr2=0x55f130570770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:56.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.259+0000 7fa346519980 1 -- 172.21.15.194:0/1794616674 shutdown_connections 2024-09-13T06:09:56.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.259+0000 7fa346519980 1 -- 172.21.15.194:0/1794616674 wait complete. 2024-09-13T06:09:56.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.259+0000 7fa346519980 1 -- 172.21.15.194:0/1025450105 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa21c0346f0 msgr2=0x7fa21c036bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.259+0000 7fa346519980 1 --2- 172.21.15.194:0/1025450105 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa21c0346f0 0x7fa21c036bb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x55f130553820 tx=0x7fa330005ad0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.259+0000 7fa346519980 1 -- 172.21.15.194:0/1025450105 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f130569ba0 msgr2=0x55f130569fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.259+0000 7fa346519980 1 --2- 172.21.15.194:0/1025450105 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f130569ba0 0x55f130569fc0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa33400bc00 tx=0x7fa33401bb30 comp rx=0 tx=0).stop 2024-09-13T06:09:56.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.259+0000 7fa346519980 1 -- 172.21.15.194:0/1025450105 shutdown_connections 2024-09-13T06:09:56.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.259+0000 7fa346519980 1 --2- 172.21.15.194:0/1025450105 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa21c0346f0 0x7fa21c036bb0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.259+0000 7fa346519980 1 --2- 172.21.15.194:0/1025450105 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f130569ba0 0x55f130569fc0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.259+0000 7fa346519980 1 -- 172.21.15.194:0/1025450105 >> 172.21.15.194:0/1025450105 conn(0x55f13055ecf0 msgr2=0x55f130561770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:56.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.259+0000 7fa346519980 1 -- 172.21.15.194:0/1025450105 shutdown_connections 2024-09-13T06:09:56.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.259+0000 7fa346519980 1 -- 172.21.15.194:0/1025450105 wait complete. 2024-09-13T06:09:56.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.259+0000 7fa346519980 1 -- 172.21.15.194:0/2831251074 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55f13045dec0 msgr2=0x55f130552e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.259+0000 7fa346519980 1 --2- 172.21.15.194:0/2831251074 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55f13045dec0 0x55f130552e60 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.259+0000 7fa346519980 1 -- 172.21.15.194:0/2831251074 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55f1305595e0 msgr2=0x55f13055b9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.259+0000 7fa346519980 1 --2- 172.21.15.194:0/2831251074 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55f1305595e0 0x55f13055b9d0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.259+0000 7fa346519980 1 -- 172.21.15.194:0/2831251074 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55f1305556c0 msgr2=0x55f130557ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.259+0000 7fa346519980 1 --2- 172.21.15.194:0/2831251074 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55f1305556c0 0x55f130557ab0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.259+0000 7fa346519980 1 -- 172.21.15.194:0/2831251074 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa22c034650 msgr2=0x7fa22c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.259+0000 7fa346519980 1 --2- 172.21.15.194:0/2831251074 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa22c034650 0x7fa22c036b10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa3300ae000 tx=0x7fa3300a6000 comp rx=0 tx=0).stop 2024-09-13T06:09:56.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.259+0000 7fa346519980 1 -- 172.21.15.194:0/2831251074 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f1303cc290 msgr2=0x55f13054bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.259+0000 7fa346519980 1 --2- 172.21.15.194:0/2831251074 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f1303cc290 0x55f13054bd60 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa33400bb60 tx=0x7fa334000bd0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.259+0000 7fa34482a640 1 -- 172.21.15.194:0/2831251074 reap_dead start 2024-09-13T06:09:56.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.259+0000 7fa346519980 1 -- 172.21.15.194:0/2831251074 shutdown_connections 2024-09-13T06:09:56.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.259+0000 7fa346519980 1 -- 172.21.15.194:0/2831251074 >> 172.21.15.194:0/2831251074 conn(0x55f130452090 msgr2=0x55f13053f410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:56.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.259+0000 7fa346519980 1 -- 172.21.15.194:0/2831251074 shutdown_connections 2024-09-13T06:09:56.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.259+0000 7fa346519980 1 -- 172.21.15.194:0/2831251074 wait complete. 2024-09-13T06:09:56.270 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T06:09:53.191222Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-13T06:09:55.703324Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:09:53.191207Z', 'tags': [], 'group_ids': []} 2024-09-13T06:09:56.270 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-09-13T06:09:56.270 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-09-13T06:09:56.271 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo2 --key-type swift --purge-keys 2024-09-13T06:09:56.347 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:09:56.347 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:09:56.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.347+0000 7f3c5724d980 1 Processor -- start 2024-09-13T06:09:56.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.347+0000 7f3c5724d980 1 -- start start 2024-09-13T06:09:56.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.347+0000 7f3c5724d980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55ac78a05aa0 0x55ac78a966d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.347+0000 7f3c5724d980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ac78919ae0 con 0x55ac78a96c10 2024-09-13T06:09:56.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.347+0000 7f3c5724d980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x55ac7893de30 con 0x55ac78a05aa0 2024-09-13T06:09:56.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.347+0000 7f3c54d5d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55ac78a05aa0 0x55ac78a966d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.347+0000 7f3c54d5d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55ac78a05aa0 0x55ac78a966d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45042/0 (socket says 172.21.15.194:45042) 2024-09-13T06:09:56.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.347+0000 7f3c54d5d640 1 -- 172.21.15.194:0/3859783263 learned_addr learned my addr 172.21.15.194:0/3859783263 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:56.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.347+0000 7f3c54d5d640 1 -- 172.21.15.194:0/3859783263 >> v1:172.21.15.120:6789/0 conn(0x55ac78a96c10 legacy=0x55ac78a99000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.347+0000 7f3c54d5d640 1 -- 172.21.15.194:0/3859783263 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac78a05e80 con 0x55ac78a05aa0 2024-09-13T06:09:56.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.351+0000 7f3c54d5d640 1 --2- 172.21.15.194:0/3859783263 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ac78a05aa0 0x55ac78a966d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c00a4e0 tx=0x7f3c4c01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa1eec96800422b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.351+0000 7f3c53d5b640 1 -- 172.21.15.194:0/3859783263 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c4c0aa540 con 0x55ac78a05aa0 2024-09-13T06:09:56.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.351+0000 7f3c53d5b640 1 -- 172.21.15.194:0/3859783263 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c4c0aa6e0 con 0x55ac78a05aa0 2024-09-13T06:09:56.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.351+0000 7f3c53d5b640 1 -- 172.21.15.194:0/3859783263 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c4c0aaa40 con 0x55ac78a05aa0 2024-09-13T06:09:56.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.351+0000 7f3c5724d980 1 -- 172.21.15.194:0/3859783263 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ac78a05aa0 msgr2=0x55ac78a966d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.351+0000 7f3c5724d980 1 --2- 172.21.15.194:0/3859783263 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ac78a05aa0 0x55ac78a966d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c00a4e0 tx=0x7f3c4c01b090 comp rx=0 tx=0).stop 2024-09-13T06:09:56.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.351+0000 7f3c5724d980 1 -- 172.21.15.194:0/3859783263 shutdown_connections 2024-09-13T06:09:56.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.351+0000 7f3c5724d980 1 --2- 172.21.15.194:0/3859783263 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ac78a05aa0 0x55ac78a966d0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.351+0000 7f3c5724d980 1 -- 172.21.15.194:0/3859783263 >> 172.21.15.194:0/3859783263 conn(0x55ac78a8c000 msgr2=0x55ac78a8e420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:56.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.351+0000 7f3c5724d980 1 -- 172.21.15.194:0/3859783263 shutdown_connections 2024-09-13T06:09:56.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.351+0000 7f3c5724d980 1 -- 172.21.15.194:0/3859783263 wait complete. 2024-09-13T06:09:56.366 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.363+0000 7f3c5724d980 1 Processor -- start 2024-09-13T06:09:56.366 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.363+0000 7f3c5724d980 1 -- start start 2024-09-13T06:09:56.366 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.363+0000 7f3c5724d980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ac78a05aa0 0x55ac78b7ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.366 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.363+0000 7f3c5724d980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55ac7893f200 con 0x55ac78a05aa0 2024-09-13T06:09:56.366 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.367+0000 7f3c54d5d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ac78a05aa0 0x55ac78b7ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.366 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.367+0000 7f3c54d5d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ac78a05aa0 0x55ac78b7ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45048/0 (socket says 172.21.15.194:45048) 2024-09-13T06:09:56.366 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.367+0000 7f3c54d5d640 1 -- 172.21.15.194:0/2045320385 learned_addr learned my addr 172.21.15.194:0/2045320385 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:56.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.367+0000 7f3c54d5d640 1 -- 172.21.15.194:0/2045320385 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac78b7f190 con 0x55ac78a05aa0 2024-09-13T06:09:56.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.367+0000 7f3c54d5d640 1 --2- 172.21.15.194:0/2045320385 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ac78a05aa0 0x55ac78b7ebc0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c019740 tx=0x7f3c4c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d48349a91ca83053 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.367+0000 7f3b42e0d640 1 -- 172.21.15.194:0/2045320385 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c4c0b9070 con 0x55ac78a05aa0 2024-09-13T06:09:56.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.367+0000 7f3b42e0d640 1 -- 172.21.15.194:0/2045320385 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c4c0aab60 con 0x55ac78a05aa0 2024-09-13T06:09:56.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.367+0000 7f3b42e0d640 1 -- 172.21.15.194:0/2045320385 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c4c0b5440 con 0x55ac78a05aa0 2024-09-13T06:09:56.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.367+0000 7f3c5724d980 1 -- 172.21.15.194:0/2045320385 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ac78a05aa0 msgr2=0x55ac78b7ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.367+0000 7f3c5724d980 1 --2- 172.21.15.194:0/2045320385 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ac78a05aa0 0x55ac78b7ebc0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c019740 tx=0x7f3c4c0033b0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.367+0000 7f3c5724d980 1 -- 172.21.15.194:0/2045320385 shutdown_connections 2024-09-13T06:09:56.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.367+0000 7f3c5724d980 1 --2- 172.21.15.194:0/2045320385 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ac78a05aa0 0x55ac78b7ebc0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.367+0000 7f3c5724d980 1 -- 172.21.15.194:0/2045320385 >> 172.21.15.194:0/2045320385 conn(0x55ac78a8c000 msgr2=0x55ac78b7a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:56.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.367+0000 7f3c5724d980 1 -- 172.21.15.194:0/2045320385 shutdown_connections 2024-09-13T06:09:56.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.367+0000 7f3c5724d980 1 -- 172.21.15.194:0/2045320385 wait complete. 2024-09-13T06:09:56.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.367+0000 7f3c5724d980 1 Processor -- start 2024-09-13T06:09:56.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.367+0000 7f3c5724d980 1 -- start start 2024-09-13T06:09:56.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.367+0000 7f3c5724d980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ac78a05aa0 0x55ac78b85f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.367+0000 7f3c5724d980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55ac78a9d1b0 con 0x55ac78a05aa0 2024-09-13T06:09:56.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.367+0000 7f3c54d5d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ac78a05aa0 0x55ac78b85f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.367+0000 7f3c54d5d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ac78a05aa0 0x55ac78b85f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45062/0 (socket says 172.21.15.194:45062) 2024-09-13T06:09:56.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.367+0000 7f3c54d5d640 1 -- 172.21.15.194:0/356298844 learned_addr learned my addr 172.21.15.194:0/356298844 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:56.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.367+0000 7f3c54d5d640 1 -- 172.21.15.194:0/356298844 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac78b86450 con 0x55ac78a05aa0 2024-09-13T06:09:56.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.371+0000 7f3c54d5d640 1 --2- 172.21.15.194:0/356298844 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ac78a05aa0 0x55ac78b85f10 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c018cc0 tx=0x7f3c4c017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.371+0000 7f3b4160a640 1 -- 172.21.15.194:0/356298844 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c4c0b9070 con 0x55ac78a05aa0 2024-09-13T06:09:56.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.371+0000 7f3b4160a640 1 -- 172.21.15.194:0/356298844 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c4c0b5e40 con 0x55ac78a05aa0 2024-09-13T06:09:56.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.371+0000 7f3c5724d980 1 -- 172.21.15.194:0/356298844 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ac78b866e0 con 0x55ac78a05aa0 2024-09-13T06:09:56.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.371+0000 7f3b4160a640 1 -- 172.21.15.194:0/356298844 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c4c0c7410 con 0x55ac78a05aa0 2024-09-13T06:09:56.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.371+0000 7f3c5724d980 1 -- 172.21.15.194:0/356298844 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac78b893c0 con 0x55ac78a05aa0 2024-09-13T06:09:56.374 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.371+0000 7f3b4160a640 1 -- 172.21.15.194:0/356298844 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3c4c0aad10 con 0x55ac78a05aa0 2024-09-13T06:09:56.374 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.371+0000 7f3b4160a640 1 --2- 172.21.15.194:0/356298844 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3b3c034650 0x7f3b3c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.374 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.371+0000 7f3b4160a640 1 -- 172.21.15.194:0/356298844 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f3c4c0c4070 con 0x55ac78a05aa0 2024-09-13T06:09:56.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.371+0000 7f3c5455c640 1 --2- 172.21.15.194:0/356298844 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3b3c034650 0x7f3b3c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.371+0000 7f3c5724d980 1 --2- 172.21.15.194:0/356298844 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ac78a96c10 0x55ac78b8d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.371+0000 7f3c5724d980 1 -- 172.21.15.194:0/356298844 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ac78b8d590 con 0x55ac78a96c10 2024-09-13T06:09:56.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.371+0000 7f3c5555e640 1 --2- 172.21.15.194:0/356298844 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ac78a96c10 0x55ac78b8d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.371+0000 7f3c5455c640 1 --2- 172.21.15.194:0/356298844 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3b3c034650 0x7f3b3c036b10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c001e20 tx=0x7f3c3c0013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.371+0000 7f3c5555e640 1 --2- 172.21.15.194:0/356298844 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ac78a96c10 0x55ac78b8d010 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.371+0000 7f3c5555e640 1 -- 172.21.15.194:0/356298844 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3c440083f0 con 0x55ac78a96c10 2024-09-13T06:09:56.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.371+0000 7f3c5724d980 1 -- 172.21.15.194:0/356298844 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ac78b8de80 con 0x55ac78a96c10 2024-09-13T06:09:56.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.371+0000 7f3c5555e640 1 -- 172.21.15.194:0/356298844 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3c440083f0 con 0x55ac78a96c10 2024-09-13T06:09:56.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.371+0000 7f3c5724d980 1 --2- 172.21.15.194:0/356298844 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ac78b8f790 0x55ac78b91c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.371+0000 7f3c5724d980 1 -- 172.21.15.194:0/356298844 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ac78b923e0 con 0x55ac78b8f790 2024-09-13T06:09:56.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.371+0000 7f3c54d5d640 1 --2- 172.21.15.194:0/356298844 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ac78b8f790 0x55ac78b91c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.371+0000 7f3c54d5d640 1 --2- 172.21.15.194:0/356298844 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ac78b8f790 0x55ac78b91c50 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.371+0000 7f3c54d5d640 1 -- 172.21.15.194:0/356298844 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3c4c0cd060 con 0x55ac78b8f790 2024-09-13T06:09:56.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.371+0000 7f3c5724d980 1 -- 172.21.15.194:0/356298844 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ac78b8e6d0 con 0x55ac78a96c10 2024-09-13T06:09:56.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.375+0000 7f3c5555e640 1 -- 172.21.15.194:0/356298844 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3c440083f0 con 0x55ac78a96c10 2024-09-13T06:09:56.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.375+0000 7f3c5724d980 1 --2- 172.21.15.194:0/356298844 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55ac78b93840 0x55ac78b95c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.375+0000 7f3c5724d980 1 -- 172.21.15.194:0/356298844 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ac78b96320 con 0x55ac78b93840 2024-09-13T06:09:56.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.375+0000 7f3c5455c640 1 --2- 172.21.15.194:0/356298844 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55ac78b93840 0x55ac78b95c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.375+0000 7f3c5455c640 1 --2- 172.21.15.194:0/356298844 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55ac78b93840 0x55ac78b95c30 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.375+0000 7f3c5455c640 1 -- 172.21.15.194:0/356298844 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3c3c00d040 con 0x55ac78b93840 2024-09-13T06:09:56.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.375+0000 7f3c5724d980 1 Processor -- start 2024-09-13T06:09:56.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.375+0000 7f3c5724d980 1 -- start start 2024-09-13T06:09:56.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.375+0000 7f3c5724d980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ac78ba3df0 0x55ac78ba4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.375+0000 7f3c5724d980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55ac78998800 con 0x55ac78ba3df0 2024-09-13T06:09:56.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.375+0000 7f3c54d5d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ac78ba3df0 0x55ac78ba4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.375+0000 7f3c54d5d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ac78ba3df0 0x55ac78ba4210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45070/0 (socket says 172.21.15.194:45070) 2024-09-13T06:09:56.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.375+0000 7f3c54d5d640 1 -- 172.21.15.194:0/1636522239 learned_addr learned my addr 172.21.15.194:0/1636522239 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:56.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.375+0000 7f3c54d5d640 1 -- 172.21.15.194:0/1636522239 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac78ba4750 con 0x55ac78ba3df0 2024-09-13T06:09:56.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.375+0000 7f3c54d5d640 1 --2- 172.21.15.194:0/1636522239 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ac78ba3df0 0x55ac78ba4210 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c01b0d0 tx=0x7f3c4c0c6d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.375+0000 7f3b3a7fc640 1 -- 172.21.15.194:0/1636522239 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c4c0e4a90 con 0x55ac78ba3df0 2024-09-13T06:09:56.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.375+0000 7f3c5724d980 1 -- 172.21.15.194:0/1636522239 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ac78ba49e0 con 0x55ac78ba3df0 2024-09-13T06:09:56.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.375+0000 7f3c5724d980 1 -- 172.21.15.194:0/1636522239 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac78ba49e0 con 0x55ac78ba3df0 2024-09-13T06:09:56.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.375+0000 7f3b3a7fc640 1 -- 172.21.15.194:0/1636522239 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c4c0e4120 con 0x55ac78ba3df0 2024-09-13T06:09:56.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.375+0000 7f3b3a7fc640 1 -- 172.21.15.194:0/1636522239 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c4c0e4440 con 0x55ac78ba3df0 2024-09-13T06:09:56.382 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.379+0000 7f3b3a7fc640 1 -- 172.21.15.194:0/1636522239 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3c4c0eb060 con 0x55ac78ba3df0 2024-09-13T06:09:56.382 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.379+0000 7f3b3a7fc640 1 --2- 172.21.15.194:0/1636522239 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3b2c0346a0 0x7f3b2c036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.382 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.379+0000 7f3b3a7fc640 1 -- 172.21.15.194:0/1636522239 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f3c4c0df030 con 0x55ac78ba3df0 2024-09-13T06:09:56.382 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.379+0000 7f3c5455c640 1 --2- 172.21.15.194:0/1636522239 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3b2c0346a0 0x7f3b2c036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.382 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.379+0000 7f3c5724d980 1 Processor -- start 2024-09-13T06:09:56.382 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.379+0000 7f3c5724d980 1 -- start start 2024-09-13T06:09:56.382 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.379+0000 7f3c5455c640 1 --2- 172.21.15.194:0/1636522239 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3b2c0346a0 0x7f3b2c036b60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x55ac78b8a620 tx=0x7f3c3c006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.382 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.379+0000 7f3c5724d980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ac78bb0520 0x55ac78bb0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.382 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.379+0000 7f3c5724d980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55ac78b7f450 con 0x55ac78bb0520 2024-09-13T06:09:56.383 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.379+0000 7f3c54d5d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ac78bb0520 0x55ac78bb0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.383 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.379+0000 7f3c54d5d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ac78bb0520 0x55ac78bb0920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45072/0 (socket says 172.21.15.194:45072) 2024-09-13T06:09:56.383 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.379+0000 7f3c54d5d640 1 -- 172.21.15.194:0/360179242 learned_addr learned my addr 172.21.15.194:0/360179242 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:56.383 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.379+0000 7f3c54d5d640 1 -- 172.21.15.194:0/360179242 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac78bb0ef0 con 0x55ac78bb0520 2024-09-13T06:09:56.383 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.379+0000 7f3c54d5d640 1 --2- 172.21.15.194:0/360179242 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ac78bb0520 0x55ac78bb0920 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c0c1fd0 tx=0x7f3c4c0c31d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f86341c2976bc43 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.383 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.379+0000 7f3b2bfff640 1 -- 172.21.15.194:0/360179242 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c4c0fd020 con 0x55ac78bb0520 2024-09-13T06:09:56.383 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.379+0000 7f3b2bfff640 1 -- 172.21.15.194:0/360179242 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c4c0c7a40 con 0x55ac78bb0520 2024-09-13T06:09:56.383 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.379+0000 7f3b2bfff640 1 -- 172.21.15.194:0/360179242 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c4c0c7e50 con 0x55ac78bb0520 2024-09-13T06:09:56.383 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.379+0000 7f3c5724d980 1 -- 172.21.15.194:0/360179242 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ac78bb0520 msgr2=0x55ac78bb0920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.383 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.379+0000 7f3c5724d980 1 --2- 172.21.15.194:0/360179242 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ac78bb0520 0x55ac78bb0920 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c0c1fd0 tx=0x7f3c4c0c31d0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.383 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.379+0000 7f3c5724d980 1 -- 172.21.15.194:0/360179242 shutdown_connections 2024-09-13T06:09:56.383 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.379+0000 7f3c5724d980 1 --2- 172.21.15.194:0/360179242 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ac78bb0520 0x55ac78bb0920 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.383 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.379+0000 7f3c5724d980 1 -- 172.21.15.194:0/360179242 >> 172.21.15.194:0/360179242 conn(0x55ac78bac8b0 msgr2=0x55ac78baa9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:56.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.379+0000 7f3c5724d980 1 -- 172.21.15.194:0/360179242 shutdown_connections 2024-09-13T06:09:56.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.379+0000 7f3c5724d980 1 -- 172.21.15.194:0/360179242 wait complete. 2024-09-13T06:09:56.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.379+0000 7f3c5724d980 1 Processor -- start 2024-09-13T06:09:56.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.379+0000 7f3c5724d980 1 -- start start 2024-09-13T06:09:56.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.379+0000 7f3c5724d980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ac78bb0520 0x55ac78bb76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.379+0000 7f3c5724d980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55ac78bb1440 con 0x55ac78bb0520 2024-09-13T06:09:56.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.379+0000 7f3c54d5d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ac78bb0520 0x55ac78bb76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.379+0000 7f3c54d5d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ac78bb0520 0x55ac78bb76f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45084/0 (socket says 172.21.15.194:45084) 2024-09-13T06:09:56.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.379+0000 7f3c54d5d640 1 -- 172.21.15.194:0/3052317802 learned_addr learned my addr 172.21.15.194:0/3052317802 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:56.389 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.383+0000 7f3c54d5d640 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac78bb7c30 con 0x55ac78bb0520 2024-09-13T06:09:56.389 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.383+0000 7f3c54d5d640 1 --2- 172.21.15.194:0/3052317802 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ac78bb0520 0x55ac78bb76f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c0e1a80 tx=0x7f3c4c0a9f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.389 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.383+0000 7f3b2a7fc640 1 -- 172.21.15.194:0/3052317802 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c4c112070 con 0x55ac78bb0520 2024-09-13T06:09:56.389 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.383+0000 7f3b2a7fc640 1 -- 172.21.15.194:0/3052317802 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c4c0e30b0 con 0x55ac78bb0520 2024-09-13T06:09:56.390 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.383+0000 7f3b2a7fc640 1 -- 172.21.15.194:0/3052317802 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c4c0ed780 con 0x55ac78bb0520 2024-09-13T06:09:56.390 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.383+0000 7f3c5724d980 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ac78bb7c30 con 0x55ac78bb0520 2024-09-13T06:09:56.390 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.383+0000 7f3c5724d980 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac78bb7c30 con 0x55ac78bb0520 2024-09-13T06:09:56.390 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.383+0000 7f3b2a7fc640 1 -- 172.21.15.194:0/3052317802 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3c4c115070 con 0x55ac78bb0520 2024-09-13T06:09:56.390 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.383+0000 7f3b2a7fc640 1 --2- 172.21.15.194:0/3052317802 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3b20034650 0x7f3b20036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.390 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.383+0000 7f3b2a7fc640 1 -- 172.21.15.194:0/3052317802 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f3c4c109030 con 0x55ac78bb0520 2024-09-13T06:09:56.390 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.383+0000 7f3c5455c640 1 --2- 172.21.15.194:0/3052317802 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3b20034650 0x7f3b20036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.390 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.383+0000 7f3c5724d980 20 rados->read ofs=0 len=0 2024-09-13T06:09:56.390 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.383+0000 7f3c5724d980 1 --2- 172.21.15.194:0/3052317802 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ac78bc2800 0x55ac78bc4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.390 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.383+0000 7f3c5724d980 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bc5410 con 0x55ac78bc2800 2024-09-13T06:09:56.390 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.383+0000 7f3c5555e640 1 --2- 172.21.15.194:0/3052317802 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ac78bc2800 0x55ac78bc4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.390 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.383+0000 7f3c5455c640 1 --2- 172.21.15.194:0/3052317802 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3b20034650 0x7f3b20036b10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x55ac78b96720 tx=0x7f3c3c011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.390 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.383+0000 7f3c5555e640 1 --2- 172.21.15.194:0/3052317802 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ac78bc2800 0x55ac78bc4cc0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.391 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.383+0000 7f3c5555e640 1 -- 172.21.15.194:0/3052317802 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3c440083f0 con 0x55ac78bc2800 2024-09-13T06:09:56.391 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.383+0000 7f3c5724d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:56.391 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.383+0000 7f3c5724d980 20 realm 2024-09-13T06:09:56.391 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.383+0000 7f3c5724d980 20 rados->read ofs=0 len=0 2024-09-13T06:09:56.391 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.383+0000 7f3c5724d980 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bc5820 con 0x55ac78bc2800 2024-09-13T06:09:56.391 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.383+0000 7f3c5555e640 1 -- 172.21.15.194:0/3052317802 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3c440083f0 con 0x55ac78bc2800 2024-09-13T06:09:56.391 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.383+0000 7f3c5724d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:56.391 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.383+0000 7f3c5724d980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:09:56.391 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.383+0000 7f3c5724d980 20 rados->read ofs=0 len=0 2024-09-13T06:09:56.391 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.383+0000 7f3c5724d980 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bc60f0 con 0x55ac78bc2800 2024-09-13T06:09:56.391 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.383+0000 7f3c5555e640 1 -- 172.21.15.194:0/3052317802 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3c440083f0 con 0x55ac78bc2800 2024-09-13T06:09:56.391 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.383+0000 7f3c5724d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:56.392 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.383+0000 7f3c5724d980 20 rados->read ofs=0 len=0 2024-09-13T06:09:56.392 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.383+0000 7f3c5724d980 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bc6490 con 0x55ac78bc2800 2024-09-13T06:09:56.392 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.387+0000 7f3c5555e640 1 -- 172.21.15.194:0/3052317802 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3c440083f0 con 0x55ac78bc2800 2024-09-13T06:09:56.392 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.387+0000 7f3c5724d980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:56.392 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.387+0000 7f3c5724d980 20 rados->read ofs=0 len=0 2024-09-13T06:09:56.392 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.387+0000 7f3c5724d980 1 --2- 172.21.15.194:0/3052317802 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ac78bc71f0 0x55ac78bc95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.392 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.387+0000 7f3c5724d980 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bc9bf0 con 0x55ac78bc71f0 2024-09-13T06:09:56.392 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.387+0000 7f3c54d5d640 1 --2- 172.21.15.194:0/3052317802 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ac78bc71f0 0x55ac78bc95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.392 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.387+0000 7f3c54d5d640 1 --2- 172.21.15.194:0/3052317802 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ac78bc71f0 0x55ac78bc95e0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.392 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.387+0000 7f3c54d5d640 1 -- 172.21.15.194:0/3052317802 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3c4c114030 con 0x55ac78bc71f0 2024-09-13T06:09:56.392 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.387+0000 7f3c5724d980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:09:56.392 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.387+0000 7f3c5724d980 20 searching for the correct realm 2024-09-13T06:09:56.393 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.387+0000 7f3c5724d980 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bcb4c0 con 0x55ac78bc71f0 2024-09-13T06:09:56.393 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.387+0000 7f3c54d5d640 1 -- 172.21.15.194:0/3052317802 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c4c114030 con 0x55ac78bc71f0 2024-09-13T06:09:56.393 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.387+0000 7f3c54d5d640 1 --2- 172.21.15.194:0/3052317802 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f3c4c117060 0x7f3c4c0cd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.393 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.387+0000 7f3c54d5d640 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bcb4c0 con 0x7f3c4c117060 2024-09-13T06:09:56.393 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.387+0000 7f3c5455c640 1 --2- 172.21.15.194:0/3052317802 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f3c4c117060 0x7f3c4c0cd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.393 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.387+0000 7f3c5455c640 1 --2- 172.21.15.194:0/3052317802 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f3c4c117060 0x7f3c4c0cd2f0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.393 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.387+0000 7f3c5455c640 1 -- 172.21.15.194:0/3052317802 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3c3c036040 con 0x7f3c4c117060 2024-09-13T06:09:56.393 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.387+0000 7f3c5455c640 1 --2- 172.21.15.194:0/3052317802 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f3c3c00f3d0 0x7f3c3c00f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.393 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.387+0000 7f3c5455c640 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bcb4c0 con 0x7f3c3c00f3d0 2024-09-13T06:09:56.393 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.387+0000 7f3c5555e640 1 --2- 172.21.15.194:0/3052317802 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f3c3c00f3d0 0x7f3c3c00f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.393 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.387+0000 7f3c5555e640 1 --2- 172.21.15.194:0/3052317802 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f3c3c00f3d0 0x7f3c3c00f7f0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.399 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.387+0000 7f3c5555e640 1 -- 172.21.15.194:0/3052317802 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c440083f0 con 0x7f3c3c00f3d0 2024-09-13T06:09:56.399 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.387+0000 7f3c5555e640 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bc6490 con 0x55ac78bc2800 2024-09-13T06:09:56.399 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.387+0000 7f3c5555e640 1 -- 172.21.15.194:0/3052317802 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c440083f0 con 0x55ac78bc2800 2024-09-13T06:09:56.399 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.387+0000 7f3c5555e640 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bc6490 con 0x55ac78bc2800 2024-09-13T06:09:56.399 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.387+0000 7f3c5555e640 1 -- 172.21.15.194:0/3052317802 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c440083f0 con 0x55ac78bc2800 2024-09-13T06:09:56.399 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.391+0000 7f3c5555e640 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bc6490 con 0x7f3c3c00f3d0 2024-09-13T06:09:56.399 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.391+0000 7f3c5555e640 1 -- 172.21.15.194:0/3052317802 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c440083f0 con 0x7f3c3c00f3d0 2024-09-13T06:09:56.399 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.391+0000 7f3c5555e640 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bc6490 con 0x7f3c3c00f3d0 2024-09-13T06:09:56.399 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.391+0000 7f3c5555e640 1 -- 172.21.15.194:0/3052317802 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c440083f0 con 0x7f3c3c00f3d0 2024-09-13T06:09:56.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.391+0000 7f3c5555e640 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bc6490 con 0x7f3c4c117060 2024-09-13T06:09:56.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.391+0000 7f3c5455c640 1 -- 172.21.15.194:0/3052317802 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c3c036040 con 0x7f3c4c117060 2024-09-13T06:09:56.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.391+0000 7f3c5455c640 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bc6490 con 0x55ac78bc71f0 2024-09-13T06:09:56.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.391+0000 7f3c54d5d640 1 -- 172.21.15.194:0/3052317802 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c4c114030 con 0x55ac78bc71f0 2024-09-13T06:09:56.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.391+0000 7f3c54d5d640 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bc6490 con 0x55ac78bc2800 2024-09-13T06:09:56.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.391+0000 7f3c5555e640 1 -- 172.21.15.194:0/3052317802 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c440083f0 con 0x55ac78bc2800 2024-09-13T06:09:56.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.391+0000 7f3c5555e640 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bc6490 con 0x7f3c3c00f3d0 2024-09-13T06:09:56.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.391+0000 7f3c5555e640 1 -- 172.21.15.194:0/3052317802 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c440083f0 con 0x7f3c3c00f3d0 2024-09-13T06:09:56.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.391+0000 7f3c5555e640 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bc6490 con 0x55ac78bc2800 2024-09-13T06:09:56.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.391+0000 7f3c5555e640 1 -- 172.21.15.194:0/3052317802 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c440083f0 con 0x55ac78bc2800 2024-09-13T06:09:56.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.391+0000 7f3c5555e640 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bc6490 con 0x7f3c4c117060 2024-09-13T06:09:56.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.391+0000 7f3c5455c640 1 -- 172.21.15.194:0/3052317802 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3c3c036040 con 0x7f3c4c117060 2024-09-13T06:09:56.401 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.391+0000 7f3c5455c640 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bc6490 con 0x55ac78bc71f0 2024-09-13T06:09:56.401 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.391+0000 7f3c54d5d640 1 -- 172.21.15.194:0/3052317802 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c4c114030 con 0x55ac78bc71f0 2024-09-13T06:09:56.401 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.391+0000 7f3c54d5d640 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bc6490 con 0x55ac78bc71f0 2024-09-13T06:09:56.401 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.391+0000 7f3c54d5d640 1 -- 172.21.15.194:0/3052317802 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c4c114030 con 0x55ac78bc71f0 2024-09-13T06:09:56.401 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.391+0000 7f3c54d5d640 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bc6490 con 0x7f3c3c00f3d0 2024-09-13T06:09:56.401 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.395+0000 7f3c5555e640 1 -- 172.21.15.194:0/3052317802 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c440083f0 con 0x7f3c3c00f3d0 2024-09-13T06:09:56.401 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.395+0000 7f3c5555e640 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bc6490 con 0x55ac78bc71f0 2024-09-13T06:09:56.401 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.395+0000 7f3c54d5d640 1 -- 172.21.15.194:0/3052317802 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c4c114030 con 0x55ac78bc71f0 2024-09-13T06:09:56.401 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.395+0000 7f3c54d5d640 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bc6490 con 0x55ac78bc71f0 2024-09-13T06:09:56.401 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.395+0000 7f3c54d5d640 1 -- 172.21.15.194:0/3052317802 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c4c114030 con 0x55ac78bc71f0 2024-09-13T06:09:56.401 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.395+0000 7f3c54d5d640 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bc6490 con 0x55ac78bc2800 2024-09-13T06:09:56.402 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.395+0000 7f3c5555e640 1 -- 172.21.15.194:0/3052317802 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c440083f0 con 0x55ac78bc2800 2024-09-13T06:09:56.402 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.395+0000 7f3c5555e640 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bc6490 con 0x55ac78bc2800 2024-09-13T06:09:56.402 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.395+0000 7f3c5555e640 1 -- 172.21.15.194:0/3052317802 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3c440083f0 con 0x55ac78bc2800 2024-09-13T06:09:56.402 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.395+0000 7f3c5555e640 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bc6490 con 0x7f3c3c00f3d0 2024-09-13T06:09:56.402 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.395+0000 7f3c5555e640 1 -- 172.21.15.194:0/3052317802 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c440083f0 con 0x7f3c3c00f3d0 2024-09-13T06:09:56.402 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.395+0000 7f3c5555e640 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bc6490 con 0x55ac78bc71f0 2024-09-13T06:09:56.402 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.395+0000 7f3c54d5d640 1 -- 172.21.15.194:0/3052317802 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c4c114030 con 0x55ac78bc71f0 2024-09-13T06:09:56.402 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.395+0000 7f3c54d5d640 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bc6490 con 0x7f3c4c117060 2024-09-13T06:09:56.402 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.395+0000 7f3c5455c640 1 -- 172.21.15.194:0/3052317802 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c3c036040 con 0x7f3c4c117060 2024-09-13T06:09:56.402 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.395+0000 7f3c5455c640 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bc6490 con 0x55ac78bc2800 2024-09-13T06:09:56.403 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.395+0000 7f3c5555e640 1 -- 172.21.15.194:0/3052317802 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c440083f0 con 0x55ac78bc2800 2024-09-13T06:09:56.403 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.395+0000 7f3c5555e640 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bc6490 con 0x7f3c3c00f3d0 2024-09-13T06:09:56.403 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.395+0000 7f3c5555e640 1 -- 172.21.15.194:0/3052317802 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c440083f0 con 0x7f3c3c00f3d0 2024-09-13T06:09:56.403 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.395+0000 7f3c5555e640 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bc6490 con 0x55ac78bc71f0 2024-09-13T06:09:56.403 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.395+0000 7f3c54d5d640 1 -- 172.21.15.194:0/3052317802 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3c4c114030 con 0x55ac78bc71f0 2024-09-13T06:09:56.403 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.395+0000 7f3c54d5d640 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bc6490 con 0x7f3c3c00f3d0 2024-09-13T06:09:56.403 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.399+0000 7f3c5555e640 1 -- 172.21.15.194:0/3052317802 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c440083f0 con 0x7f3c3c00f3d0 2024-09-13T06:09:56.403 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.399+0000 7f3c5555e640 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bc6490 con 0x7f3c4c117060 2024-09-13T06:09:56.403 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.399+0000 7f3c5455c640 1 -- 172.21.15.194:0/3052317802 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c3c036040 con 0x7f3c4c117060 2024-09-13T06:09:56.403 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.399+0000 7f3c5455c640 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bc6490 con 0x55ac78bc71f0 2024-09-13T06:09:56.403 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.399+0000 7f3c54d5d640 1 -- 172.21.15.194:0/3052317802 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c4c114030 con 0x55ac78bc71f0 2024-09-13T06:09:56.403 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.399+0000 7f3c54d5d640 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bc6490 con 0x7f3c3c00f3d0 2024-09-13T06:09:56.408 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.399+0000 7f3c5555e640 1 -- 172.21.15.194:0/3052317802 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c440083f0 con 0x7f3c3c00f3d0 2024-09-13T06:09:56.408 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.399+0000 7f3c5555e640 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bc6490 con 0x55ac78bc2800 2024-09-13T06:09:56.408 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.399+0000 7f3c5555e640 1 -- 172.21.15.194:0/3052317802 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3c440083f0 con 0x55ac78bc2800 2024-09-13T06:09:56.408 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.399+0000 7f3c5555e640 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bc6490 con 0x7f3c4c117060 2024-09-13T06:09:56.408 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.399+0000 7f3c5455c640 1 -- 172.21.15.194:0/3052317802 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c3c036040 con 0x7f3c4c117060 2024-09-13T06:09:56.408 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.399+0000 7f3c5724d980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:09:56.408 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.399+0000 7f3c5724d980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:09:56.408 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.399+0000 7f3c5724d980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:09:56.408 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.399+0000 7f3c5724d980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:09:56.408 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.399+0000 7f3c5724d980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:09:56.408 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.399+0000 7f3c5724d980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:09:56.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.399+0000 7f3c5724d980 20 rados->read ofs=0 len=0 2024-09-13T06:09:56.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.399+0000 7f3c5724d980 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bca5e0 con 0x55ac78bc2800 2024-09-13T06:09:56.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.399+0000 7f3c5555e640 1 -- 172.21.15.194:0/3052317802 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3c440083f0 con 0x55ac78bc2800 2024-09-13T06:09:56.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.399+0000 7f3c5724d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:56.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.399+0000 7f3c5724d980 20 rados->read ofs=0 len=0 2024-09-13T06:09:56.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.399+0000 7f3c5724d980 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bca220 con 0x55ac78bc2800 2024-09-13T06:09:56.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.399+0000 7f3c5555e640 1 -- 172.21.15.194:0/3052317802 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3c440083f0 con 0x55ac78bc2800 2024-09-13T06:09:56.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.399+0000 7f3c5724d980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:56.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.399+0000 7f3c5724d980 20 rados->read ofs=0 len=0 2024-09-13T06:09:56.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.399+0000 7f3c5724d980 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bcaf00 con 0x7f3c4c117060 2024-09-13T06:09:56.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.399+0000 7f3c5455c640 1 -- 172.21.15.194:0/3052317802 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3c3c036040 con 0x7f3c4c117060 2024-09-13T06:09:56.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.399+0000 7f3c5724d980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:09:56.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.399+0000 7f3c5724d980 20 zone default found 2024-09-13T06:09:56.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.399+0000 7f3c5724d980 4 Realm: () 2024-09-13T06:09:56.410 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.399+0000 7f3c5724d980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:09:56.410 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.399+0000 7f3c5724d980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:09:56.410 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.399+0000 7f3c5724d980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:09:56.410 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.399+0000 7f3c5724d980 20 zonegroup default 2024-09-13T06:09:56.410 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.399+0000 7f3c5724d980 20 rados->read ofs=0 len=0 2024-09-13T06:09:56.410 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.399+0000 7f3c5724d980 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bcb8f0 con 0x7f3c3c00f3d0 2024-09-13T06:09:56.410 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.399+0000 7f3c5555e640 1 -- 172.21.15.194:0/3052317802 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3c440083f0 con 0x7f3c3c00f3d0 2024-09-13T06:09:56.410 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.399+0000 7f3c5724d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:56.410 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.399+0000 7f3c5724d980 20 rados->read ofs=0 len=0 2024-09-13T06:09:56.410 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.399+0000 7f3c5724d980 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bcd300 con 0x55ac78bc71f0 2024-09-13T06:09:56.410 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.399+0000 7f3c54d5d640 1 -- 172.21.15.194:0/3052317802 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3c4c114030 con 0x55ac78bc71f0 2024-09-13T06:09:56.410 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.399+0000 7f3c5724d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:56.410 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.399+0000 7f3c5724d980 20 rados->read ofs=0 len=0 2024-09-13T06:09:56.410 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.399+0000 7f3c5724d980 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bcd7b0 con 0x55ac78bc71f0 2024-09-13T06:09:56.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.399+0000 7f3c54d5d640 1 -- 172.21.15.194:0/3052317802 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3c4c114030 con 0x55ac78bc71f0 2024-09-13T06:09:56.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.399+0000 7f3c5724d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:56.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.399+0000 7f3c5724d980 20 started sync module instance, tier type = 2024-09-13T06:09:56.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.399+0000 7f3c5724d980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:09:56.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.399+0000 7f3c5724d980 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bcb3d0 con 0x7f3c4c117060 2024-09-13T06:09:56.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.403+0000 7f3c5455c640 1 -- 172.21.15.194:0/3052317802 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(44 notify.0 [create] v33'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c3c036040 con 0x7f3c4c117060 2024-09-13T06:09:56.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.403+0000 7f3c5724d980 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94199248373824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bcdc10 con 0x7f3c4c117060 2024-09-13T06:09:56.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.403+0000 7f3c5724d980 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bce660 con 0x55ac78bc2800 2024-09-13T06:09:56.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.407+0000 7f3c5455c640 1 -- 172.21.15.194:0/3052317802 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94199248373824] v33'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c3c036040 con 0x7f3c4c117060 2024-09-13T06:09:56.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.407+0000 7f3c5555e640 1 -- 172.21.15.194:0/3052317802 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v33'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c440083f0 con 0x55ac78bc2800 2024-09-13T06:09:56.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.407+0000 7f3c5724d980 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94199248380240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bcea80 con 0x55ac78bc2800 2024-09-13T06:09:56.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.407+0000 7f3c5724d980 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bcf440 con 0x55ac78bc71f0 2024-09-13T06:09:56.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.407+0000 7f3c5555e640 1 -- 172.21.15.194:0/3052317802 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94199248380240] v33'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c440083f0 con 0x55ac78bc2800 2024-09-13T06:09:56.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.407+0000 7f3c54d5d640 1 -- 172.21.15.194:0/3052317802 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v33'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c4c114030 con 0x55ac78bc71f0 2024-09-13T06:09:56.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.407+0000 7f3c5724d980 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94199248383888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bcf7e0 con 0x55ac78bc71f0 2024-09-13T06:09:56.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.407+0000 7f3c5724d980 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bd01a0 con 0x7f3c4c117060 2024-09-13T06:09:56.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.411+0000 7f3c5455c640 1 -- 172.21.15.194:0/3052317802 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(50 notify.3 [create] v33'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c3c036040 con 0x7f3c4c117060 2024-09-13T06:09:56.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.411+0000 7f3c5724d980 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94199248387312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bd05c0 con 0x7f3c4c117060 2024-09-13T06:09:56.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.411+0000 7f3c5724d980 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bd10b0 con 0x55ac78bc2800 2024-09-13T06:09:56.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.411+0000 7f3c54d5d640 1 -- 172.21.15.194:0/3052317802 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94199248383888] v33'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c4c114030 con 0x55ac78bc71f0 2024-09-13T06:09:56.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.411+0000 7f3c5455c640 1 -- 172.21.15.194:0/3052317802 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94199248387312] v33'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c3c036040 con 0x7f3c4c117060 2024-09-13T06:09:56.414 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.411+0000 7f3c5555e640 1 -- 172.21.15.194:0/3052317802 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v33'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c440083f0 con 0x55ac78bc2800 2024-09-13T06:09:56.414 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.411+0000 7f3c5724d980 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94199248391040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bd0110 con 0x55ac78bc2800 2024-09-13T06:09:56.414 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.411+0000 7f3c5724d980 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bd1950 con 0x7f3c3c00f3d0 2024-09-13T06:09:56.414 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.415+0000 7f3c5555e640 1 -- 172.21.15.194:0/3052317802 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94199248391040] v33'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c440083f0 con 0x55ac78bc2800 2024-09-13T06:09:56.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.415+0000 7f3c5555e640 1 -- 172.21.15.194:0/3052317802 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(54 notify.5 [create] v33'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c440083f0 con 0x7f3c3c00f3d0 2024-09-13T06:09:56.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.415+0000 7f3c5724d980 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94199248374944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bd0110 con 0x7f3c3c00f3d0 2024-09-13T06:09:56.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.415+0000 7f3c5724d980 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bd1e40 con 0x7f3c3c00f3d0 2024-09-13T06:09:56.417 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.415+0000 7f3c5555e640 1 -- 172.21.15.194:0/3052317802 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(56 notify.6 [create] v33'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c440083f0 con 0x7f3c3c00f3d0 2024-09-13T06:09:56.417 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.415+0000 7f3c5724d980 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94199248394528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bd22f0 con 0x7f3c3c00f3d0 2024-09-13T06:09:56.417 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.415+0000 7f3c5724d980 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bd2de0 con 0x7f3c3c00f3d0 2024-09-13T06:09:56.417 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.415+0000 7f3c5555e640 1 -- 172.21.15.194:0/3052317802 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94199248374944] v33'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c440083f0 con 0x7f3c3c00f3d0 2024-09-13T06:09:56.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.419+0000 7f3c5555e640 1 -- 172.21.15.194:0/3052317802 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(58 notify.7 [create] v33'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c440083f0 con 0x7f3c3c00f3d0 2024-09-13T06:09:56.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.419+0000 7f3c5724d980 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94199248398512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bd2da0 con 0x7f3c3c00f3d0 2024-09-13T06:09:56.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.419+0000 7f3c5724d980 20 add_watcher() i=0 2024-09-13T06:09:56.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.419+0000 7f3c5724d980 20 add_watcher() i=1 2024-09-13T06:09:56.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.419+0000 7f3c5724d980 20 add_watcher() i=2 2024-09-13T06:09:56.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.419+0000 7f3c5724d980 20 add_watcher() i=3 2024-09-13T06:09:56.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.419+0000 7f3c5724d980 20 add_watcher() i=4 2024-09-13T06:09:56.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.419+0000 7f3c5724d980 20 add_watcher() i=5 2024-09-13T06:09:56.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.419+0000 7f3c5555e640 1 -- 172.21.15.194:0/3052317802 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94199248394528] v33'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c440083f0 con 0x7f3c3c00f3d0 2024-09-13T06:09:56.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.419+0000 7f3c5724d980 20 add_watcher() i=6 2024-09-13T06:09:56.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.419+0000 7f3c5555e640 1 -- 172.21.15.194:0/3052317802 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94199248398512] v33'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c440083f0 con 0x7f3c3c00f3d0 2024-09-13T06:09:56.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.419+0000 7f3c5724d980 20 add_watcher() i=7 2024-09-13T06:09:56.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.419+0000 7f3c5724d980 2 all 8 watchers are set, enabling cache 2024-09-13T06:09:56.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.419+0000 7f3c5724d980 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bd1e40 con 0x55ac78bc2800 2024-09-13T06:09:56.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.419+0000 7f3c5555e640 1 -- 172.21.15.194:0/3052317802 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3c440083f0 con 0x55ac78bc2800 2024-09-13T06:09:56.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.419+0000 7f3c5724d980 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94199248395840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bd31e0 con 0x55ac78bc2800 2024-09-13T06:09:56.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.419+0000 7f3c5555e640 1 -- 172.21.15.194:0/3052317802 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94199248395840] v33'86 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3c440083f0 con 0x55ac78bc2800 2024-09-13T06:09:56.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.423+0000 7f3b0b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:56.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.423+0000 7f3c5724d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:09:56.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.423+0000 7f3c5724d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:09:56.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.423+0000 7f3c5724d980 5 note: GC not initialized 2024-09-13T06:09:56.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.423+0000 7f3b0a7e4640 20 reqs_thread_entry: start 2024-09-13T06:09:56.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.423+0000 7f3c5724d980 20 init_complete bucket index max shards: 11 2024-09-13T06:09:56.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.423+0000 7f3c5724d980 20 Filter name: none 2024-09-13T06:09:56.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.423+0000 7f3b037fe640 20 reqs_thread_entry: start 2024-09-13T06:09:56.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.423+0000 7f3c5724d980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T06:09:56.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.423+0000 7f3c5724d980 20 rados->read ofs=0 len=0 2024-09-13T06:09:56.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.423+0000 7f3c5724d980 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bf9310 con 0x55ac78bc2800 2024-09-13T06:09:56.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.423+0000 7f3c5555e640 1 -- 172.21.15.194:0/3052317802 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f3c440083f0 con 0x55ac78bc2800 2024-09-13T06:09:56.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.423+0000 7f3c5724d980 20 rados_obj.operate() r=0 bl.length=556 2024-09-13T06:09:56.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.423+0000 7f3c5724d980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T06:09:56.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.423+0000 7f3c5724d980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:09:56.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.423+0000 7f3c5724d980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:09:56.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.423+0000 7f3c5724d980 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bffa70 con 0x55ac78bc2800 2024-09-13T06:09:56.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.423+0000 7f3c5555e640 1 -- 172.21.15.194:0/3052317802 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v33'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f3c440083f0 con 0x55ac78bc2800 2024-09-13T06:09:56.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.423+0000 7f3c5724d980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T06:09:56.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.423+0000 7f3c5724d980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:09:56.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.423+0000 7f3c5724d980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T06:09:56.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.423+0000 7f3c5724d980 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94199248581856 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bfb1e0 con 0x55ac78bc2800 2024-09-13T06:09:56.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.423+0000 7f3c5555e640 1 -- 172.21.15.194:0/3052317802 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== watch-notify(notify (1) cookie 94199248391040 notify 141733920778 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f3c4403b040 con 0x55ac78bc2800 2024-09-13T06:09:56.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.423+0000 7f3b2bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920778 cookie 94199248391040 notifier 4416 bl.length()=567 2024-09-13T06:09:56.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.423+0000 7f3b2bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T06:09:56.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.423+0000 7f3b2bfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:09:56.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.423+0000 7f3b2bfff640 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f3b18003eb0 con 0x55ac78bc2800 2024-09-13T06:09:56.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.423+0000 7f3c5555e640 1 -- 172.21.15.194:0/3052317802 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(64 notify.4 [notify cookie 94199248581856 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3c440083f0 con 0x55ac78bc2800 2024-09-13T06:09:56.427 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.423+0000 7f3c5555e640 1 -- 172.21.15.194:0/3052317802 <== osd.1 v2:172.21.15.194:6808/3135444559 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c4403d040 con 0x55ac78bc2800 2024-09-13T06:09:56.427 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.423+0000 7f3c5555e640 1 -- 172.21.15.194:0/3052317802 <== osd.1 v2:172.21.15.194:6808/3135444559 26 ==== watch-notify(notify_complete (2) cookie 94199248581856 notify 141733920778 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f3c44010040 con 0x55ac78bc2800 2024-09-13T06:09:56.427 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.423+0000 7f3c5724d980 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:66 8.2 8:45671577:users.swift::foo%3afoo2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bff4e0 con 0x7f3c4c117060 2024-09-13T06:09:56.428 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.427+0000 7f3c5455c640 1 -- 172.21.15.194:0/3052317802 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(66 foo:foo2 [delete] v33'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c3c036040 con 0x7f3c4c117060 2024-09-13T06:09:56.428 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.427+0000 7f3c5724d980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-09-13T06:09:56.428 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.427+0000 7f3c5724d980 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94199248581856 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bfad30 con 0x7f3c4c117060 2024-09-13T06:09:56.428 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.427+0000 7f3c5455c640 1 -- 172.21.15.194:0/3052317802 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== watch-notify(notify (1) cookie 94199248373824 notify 141733920773 ret 0) ==== 201+0+0 (crc 0 0 0) 0x55ac78919ae0 con 0x7f3c4c117060 2024-09-13T06:09:56.428 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.427+0000 7f3b2b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920773 cookie 94199248373824 notifier 4416 bl.length()=159 2024-09-13T06:09:56.429 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.427+0000 7f3c5455c640 1 -- 172.21.15.194:0/3052317802 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(67 notify.0 [notify cookie 94199248581856 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3c3c036040 con 0x7f3c4c117060 2024-09-13T06:09:56.429 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.427+0000 7f3b2b7fe640 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f3a7c0032d0 con 0x7f3c4c117060 2024-09-13T06:09:56.429 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.427+0000 7f3c5455c640 1 -- 172.21.15.194:0/3052317802 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c3c036040 con 0x7f3c4c117060 2024-09-13T06:09:56.429 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.427+0000 7f3c5455c640 1 -- 172.21.15.194:0/3052317802 <== osd.2 v2:172.21.15.194:6800/815615585 16 ==== watch-notify(notify_complete (2) cookie 94199248581856 notify 141733920773 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f3c3c01ee60 con 0x7f3c4c117060 2024-09-13T06:09:56.429 INFO:teuthology.orchestra.run.smithi194.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T06:09:53.191222Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:09:53.191207Z","tags":[],"group_ids":[]} 2024-09-13T06:09:56.429 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.427+0000 7f3b0b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:56.430 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.427+0000 7f3c5724d980 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94199248395840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bfb1e0 con 0x55ac78bc2800 2024-09-13T06:09:56.430 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.427+0000 7f3c5555e640 1 -- 172.21.15.194:0/3052317802 <== osd.1 v2:172.21.15.194:6808/3135444559 27 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94199248395840] v33'87 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3c4403d040 con 0x55ac78bc2800 2024-09-13T06:09:56.430 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.431+0000 7f3c5724d980 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94199248373824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bfb1e0 con 0x7f3c4c117060 2024-09-13T06:09:56.431 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.431+0000 7f3c5455c640 1 -- 172.21.15.194:0/3052317802 <== osd.2 v2:172.21.15.194:6800/815615585 17 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94199248373824] v33'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c3c036040 con 0x7f3c4c117060 2024-09-13T06:09:56.431 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.431+0000 7f3c5724d980 20 remove_watcher() i=0 2024-09-13T06:09:56.431 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.431+0000 7f3c5724d980 2 removed watcher, disabling cache 2024-09-13T06:09:56.431 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.431+0000 7f3c5724d980 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94199248380240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bf7140 con 0x55ac78bc2800 2024-09-13T06:09:56.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.431+0000 7f3c5555e640 1 -- 172.21.15.194:0/3052317802 <== osd.1 v2:172.21.15.194:6808/3135444559 28 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94199248380240] v33'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c4403d040 con 0x55ac78bc2800 2024-09-13T06:09:56.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.431+0000 7f3c5724d980 20 remove_watcher() i=1 2024-09-13T06:09:56.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.431+0000 7f3c5724d980 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94199248383888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bf7140 con 0x55ac78bc71f0 2024-09-13T06:09:56.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.435+0000 7f3c54d5d640 1 -- 172.21.15.194:0/3052317802 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94199248383888] v33'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c4c114030 con 0x55ac78bc71f0 2024-09-13T06:09:56.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.435+0000 7f3c5724d980 20 remove_watcher() i=2 2024-09-13T06:09:56.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.435+0000 7f3c5724d980 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94199248387312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bcef90 con 0x7f3c4c117060 2024-09-13T06:09:56.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.435+0000 7f3c5455c640 1 -- 172.21.15.194:0/3052317802 <== osd.2 v2:172.21.15.194:6800/815615585 18 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94199248387312] v33'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c3c036040 con 0x7f3c4c117060 2024-09-13T06:09:56.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.435+0000 7f3c5724d980 20 remove_watcher() i=3 2024-09-13T06:09:56.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.435+0000 7f3c5724d980 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94199248391040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bf7140 con 0x55ac78bc2800 2024-09-13T06:09:56.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.435+0000 7f3c5555e640 1 -- 172.21.15.194:0/3052317802 <== osd.1 v2:172.21.15.194:6808/3135444559 29 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94199248391040] v33'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c4403d040 con 0x55ac78bc2800 2024-09-13T06:09:56.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.435+0000 7f3c5724d980 20 remove_watcher() i=4 2024-09-13T06:09:56.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.435+0000 7f3c5724d980 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94199248374944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bcfcf0 con 0x7f3c3c00f3d0 2024-09-13T06:09:56.440 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.439+0000 7f3c5555e640 1 -- 172.21.15.194:0/3052317802 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94199248374944] v33'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c4403d040 con 0x7f3c3c00f3d0 2024-09-13T06:09:56.440 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.439+0000 7f3c5724d980 20 remove_watcher() i=5 2024-09-13T06:09:56.440 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.439+0000 7f3c5724d980 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94199248394528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bcef90 con 0x7f3c3c00f3d0 2024-09-13T06:09:56.442 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.439+0000 7f3c5555e640 1 -- 172.21.15.194:0/3052317802 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94199248394528] v33'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c4403d040 con 0x7f3c3c00f3d0 2024-09-13T06:09:56.442 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.439+0000 7f3c5724d980 20 remove_watcher() i=6 2024-09-13T06:09:56.442 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.439+0000 7f3c5724d980 1 -- 172.21.15.194:0/3052317802 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94199248398512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ac78bcef90 con 0x7f3c3c00f3d0 2024-09-13T06:09:56.446 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.443+0000 7f3c5555e640 1 -- 172.21.15.194:0/3052317802 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94199248398512] v33'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c4403d040 con 0x7f3c3c00f3d0 2024-09-13T06:09:56.446 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.443+0000 7f3c5724d980 20 remove_watcher() i=7 2024-09-13T06:09:56.446 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.443+0000 7f3c5724d980 1 -- 172.21.15.194:0/3052317802 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f3c3c00f3d0 msgr2=0x7f3c3c00f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.446 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.443+0000 7f3c5724d980 1 --2- 172.21.15.194:0/3052317802 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f3c3c00f3d0 0x7f3c3c00f7f0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.446 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.443+0000 7f3c5724d980 1 -- 172.21.15.194:0/3052317802 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ac78bc2800 msgr2=0x55ac78bc4cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.446 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.443+0000 7f3c5724d980 1 --2- 172.21.15.194:0/3052317802 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ac78bc2800 0x55ac78bc4cc0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.446 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.443+0000 7f3c5724d980 1 -- 172.21.15.194:0/3052317802 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f3c4c117060 msgr2=0x7f3c4c0cd2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.446 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.443+0000 7f3c5724d980 1 --2- 172.21.15.194:0/3052317802 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f3c4c117060 0x7f3c4c0cd2f0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.443+0000 7f3c5724d980 1 -- 172.21.15.194:0/3052317802 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ac78bc71f0 msgr2=0x55ac78bc95e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.443+0000 7f3c5724d980 1 --2- 172.21.15.194:0/3052317802 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ac78bc71f0 0x55ac78bc95e0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.443+0000 7f3c5724d980 1 -- 172.21.15.194:0/3052317802 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3b20034650 msgr2=0x7f3b20036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.443+0000 7f3c5724d980 1 --2- 172.21.15.194:0/3052317802 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3b20034650 0x7f3b20036b10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x55ac78b96720 tx=0x7f3c3c011000 comp rx=0 tx=0).stop 2024-09-13T06:09:56.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.443+0000 7f3c5724d980 1 -- 172.21.15.194:0/3052317802 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ac78bb0520 msgr2=0x55ac78bb76f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.443+0000 7f3c5555e640 1 -- 172.21.15.194:0/3052317802 reap_dead start 2024-09-13T06:09:56.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.443+0000 7f3c5724d980 1 --2- 172.21.15.194:0/3052317802 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ac78bb0520 0x55ac78bb76f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c0e1a80 tx=0x7f3c4c0a9f10 comp rx=0 tx=0).stop 2024-09-13T06:09:56.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.443+0000 7f3c5724d980 1 -- 172.21.15.194:0/3052317802 shutdown_connections 2024-09-13T06:09:56.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.443+0000 7f3c5724d980 1 --2- 172.21.15.194:0/3052317802 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ac78bb0520 0x55ac78bb76f0 secure :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c0e1a80 tx=0x7f3c4c0a9f10 comp rx=0 tx=0).stop 2024-09-13T06:09:56.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.443+0000 7f3c5724d980 1 -- 172.21.15.194:0/3052317802 >> 172.21.15.194:0/3052317802 conn(0x55ac78bac8b0 msgr2=0x55ac78baa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:56.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.443+0000 7f3c5724d980 1 -- 172.21.15.194:0/3052317802 shutdown_connections 2024-09-13T06:09:56.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.443+0000 7f3c5724d980 1 -- 172.21.15.194:0/3052317802 wait complete. 2024-09-13T06:09:56.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.443+0000 7f3c5724d980 1 -- 172.21.15.194:0/1636522239 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3b2c0346a0 msgr2=0x7f3b2c036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.443+0000 7f3c5724d980 1 --2- 172.21.15.194:0/1636522239 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3b2c0346a0 0x7f3b2c036b60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x55ac78b8a620 tx=0x7f3c3c006000 comp rx=0 tx=0).stop 2024-09-13T06:09:56.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.443+0000 7f3c5724d980 1 -- 172.21.15.194:0/1636522239 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ac78ba3df0 msgr2=0x55ac78ba4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.443+0000 7f3c5724d980 1 --2- 172.21.15.194:0/1636522239 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ac78ba3df0 0x55ac78ba4210 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c01b0d0 tx=0x7f3c4c0c6d10 comp rx=0 tx=0).stop 2024-09-13T06:09:56.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.443+0000 7f3c5724d980 1 -- 172.21.15.194:0/1636522239 shutdown_connections 2024-09-13T06:09:56.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.443+0000 7f3c5724d980 1 --2- 172.21.15.194:0/1636522239 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3b2c0346a0 0x7f3b2c036b60 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.443+0000 7f3c5724d980 1 --2- 172.21.15.194:0/1636522239 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ac78ba3df0 0x55ac78ba4210 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.443+0000 7f3c5724d980 1 -- 172.21.15.194:0/1636522239 >> 172.21.15.194:0/1636522239 conn(0x55ac78b98f40 msgr2=0x55ac78b9b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:56.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.443+0000 7f3c5724d980 1 -- 172.21.15.194:0/1636522239 shutdown_connections 2024-09-13T06:09:56.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.443+0000 7f3c5724d980 1 -- 172.21.15.194:0/1636522239 wait complete. 2024-09-13T06:09:56.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.443+0000 7f3c5724d980 1 -- 172.21.15.194:0/356298844 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ac78a96c10 msgr2=0x55ac78b8d010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.443+0000 7f3c5724d980 1 --2- 172.21.15.194:0/356298844 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ac78a96c10 0x55ac78b8d010 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.443+0000 7f3c5724d980 1 -- 172.21.15.194:0/356298844 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55ac78b93840 msgr2=0x55ac78b95c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.443+0000 7f3c5724d980 1 --2- 172.21.15.194:0/356298844 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55ac78b93840 0x55ac78b95c30 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.443+0000 7f3c5724d980 1 -- 172.21.15.194:0/356298844 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ac78b8f790 msgr2=0x55ac78b91c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.443+0000 7f3c5724d980 1 --2- 172.21.15.194:0/356298844 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ac78b8f790 0x55ac78b91c50 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.443+0000 7f3c5724d980 1 -- 172.21.15.194:0/356298844 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3b3c034650 msgr2=0x7f3b3c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.443+0000 7f3c5724d980 1 --2- 172.21.15.194:0/356298844 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3b3c034650 0x7f3b3c036b10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c001e20 tx=0x7f3c3c0013a0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.443+0000 7f3c5724d980 1 -- 172.21.15.194:0/356298844 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ac78a05aa0 msgr2=0x55ac78b85f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.443+0000 7f3c5724d980 1 --2- 172.21.15.194:0/356298844 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ac78a05aa0 0x55ac78b85f10 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c018cc0 tx=0x7f3c4c017e30 comp rx=0 tx=0).stop 2024-09-13T06:09:56.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.443+0000 7f3c5555e640 1 -- 172.21.15.194:0/356298844 reap_dead start 2024-09-13T06:09:56.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.443+0000 7f3c5724d980 1 -- 172.21.15.194:0/356298844 shutdown_connections 2024-09-13T06:09:56.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.443+0000 7f3c5724d980 1 -- 172.21.15.194:0/356298844 >> 172.21.15.194:0/356298844 conn(0x55ac78a8c000 msgr2=0x55ac78b79370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:56.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.443+0000 7f3c5724d980 1 -- 172.21.15.194:0/356298844 shutdown_connections 2024-09-13T06:09:56.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.443+0000 7f3c5724d980 1 -- 172.21.15.194:0/356298844 wait complete. 2024-09-13T06:09:56.454 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T06:09:53.191222Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:09:53.191207Z', 'tags': [], 'group_ids': []} 2024-09-13T06:09:56.454 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-09-13T06:09:56.454 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-09-13T06:09:56.454 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-09-13T06:09:56.530 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:09:56.531 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:09:56.532 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.531+0000 7f7729b84980 1 Processor -- start 2024-09-13T06:09:56.532 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.531+0000 7f7729b84980 1 -- start start 2024-09-13T06:09:56.532 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.531+0000 7f7729b84980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55757095fe80 0x557570962270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.532 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.531+0000 7f7729b84980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5575707e1ae0 con 0x5575708ce2d0 2024-09-13T06:09:56.532 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.531+0000 7f7729b84980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x557570805e30 con 0x55757095fe80 2024-09-13T06:09:56.532 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.531+0000 7f7726e93640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55757095fe80 0x557570962270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.533 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.531+0000 7f7726e93640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55757095fe80 0x557570962270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45088/0 (socket says 172.21.15.194:45088) 2024-09-13T06:09:56.533 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.531+0000 7f7727694640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x5575708ce2d0 0x55757095e760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:51068/0 (socket says 172.21.15.194:51068) 2024-09-13T06:09:56.533 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.531+0000 7f7726e93640 1 -- 172.21.15.194:0/3157244350 learned_addr learned my addr 172.21.15.194:0/3157244350 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:56.533 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.531+0000 7f7726e93640 1 -- 172.21.15.194:0/3157244350 >> v1:172.21.15.120:6789/0 conn(0x5575708ce2d0 legacy=0x55757095e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.533 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.531+0000 7f7726e93640 1 -- 172.21.15.194:0/3157244350 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575708ce6b0 con 0x55757095fe80 2024-09-13T06:09:56.535 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.535+0000 7f7726e93640 1 --2- 172.21.15.194:0/3157244350 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55757095fe80 0x557570962270 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f771000a5c0 tx=0x7f771001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37b52ece5153efa2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.535 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.535+0000 7f7726692640 1 -- 172.21.15.194:0/3157244350 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77100a6070 con 0x55757095fe80 2024-09-13T06:09:56.535 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.535+0000 7f7726692640 1 -- 172.21.15.194:0/3157244350 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77100af070 con 0x55757095fe80 2024-09-13T06:09:56.535 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.535+0000 7f7726692640 1 -- 172.21.15.194:0/3157244350 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77100aa5c0 con 0x55757095fe80 2024-09-13T06:09:56.536 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.535+0000 7f7729b84980 1 -- 172.21.15.194:0/3157244350 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55757095fe80 msgr2=0x557570962270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.536 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.535+0000 7f7729b84980 1 --2- 172.21.15.194:0/3157244350 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55757095fe80 0x557570962270 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f771000a5c0 tx=0x7f771001b340 comp rx=0 tx=0).stop 2024-09-13T06:09:56.536 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.535+0000 7f7729b84980 1 -- 172.21.15.194:0/3157244350 shutdown_connections 2024-09-13T06:09:56.536 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.535+0000 7f7729b84980 1 --2- 172.21.15.194:0/3157244350 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55757095fe80 0x557570962270 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.537 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.535+0000 7f7729b84980 1 -- 172.21.15.194:0/3157244350 >> 172.21.15.194:0/3157244350 conn(0x557570954090 msgr2=0x5575709564b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:56.537 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.535+0000 7f7729b84980 1 -- 172.21.15.194:0/3157244350 shutdown_connections 2024-09-13T06:09:56.537 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.535+0000 7f7729b84980 1 -- 172.21.15.194:0/3157244350 wait complete. 2024-09-13T06:09:56.549 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.547+0000 7f7729b84980 1 Processor -- start 2024-09-13T06:09:56.549 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.547+0000 7f7729b84980 1 -- start start 2024-09-13T06:09:56.549 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.547+0000 7f7729b84980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5575708ce2d0 0x557570a46be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.550 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.547+0000 7f7729b84980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x557570807200 con 0x5575708ce2d0 2024-09-13T06:09:56.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.547+0000 7f7727694640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5575708ce2d0 0x557570a46be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.547+0000 7f7727694640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5575708ce2d0 0x557570a46be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45090/0 (socket says 172.21.15.194:45090) 2024-09-13T06:09:56.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.547+0000 7f7727694640 1 -- 172.21.15.194:0/3809947455 learned_addr learned my addr 172.21.15.194:0/3809947455 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:56.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.551+0000 7f7727694640 1 -- 172.21.15.194:0/3809947455 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557570a471b0 con 0x5575708ce2d0 2024-09-13T06:09:56.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.551+0000 7f7727694640 1 --2- 172.21.15.194:0/3809947455 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5575708ce2d0 0x557570a46be0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7720001690 tx=0x7f7720001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1e358f1223dbbe9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.551+0000 7f761560a640 1 -- 172.21.15.194:0/3809947455 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7720003460 con 0x5575708ce2d0 2024-09-13T06:09:56.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.551+0000 7f761560a640 1 -- 172.21.15.194:0/3809947455 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7720003600 con 0x5575708ce2d0 2024-09-13T06:09:56.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.551+0000 7f761560a640 1 -- 172.21.15.194:0/3809947455 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7720003920 con 0x5575708ce2d0 2024-09-13T06:09:56.553 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.551+0000 7f7729b84980 1 -- 172.21.15.194:0/3809947455 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5575708ce2d0 msgr2=0x557570a46be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.551+0000 7f7729b84980 1 --2- 172.21.15.194:0/3809947455 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5575708ce2d0 0x557570a46be0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7720001690 tx=0x7f7720001b50 comp rx=0 tx=0).stop 2024-09-13T06:09:56.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.551+0000 7f7729b84980 1 -- 172.21.15.194:0/3809947455 shutdown_connections 2024-09-13T06:09:56.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.551+0000 7f7729b84980 1 --2- 172.21.15.194:0/3809947455 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5575708ce2d0 0x557570a46be0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.551+0000 7f7729b84980 1 -- 172.21.15.194:0/3809947455 >> 172.21.15.194:0/3809947455 conn(0x557570954090 msgr2=0x557570a42810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:56.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.551+0000 7f7729b84980 1 -- 172.21.15.194:0/3809947455 shutdown_connections 2024-09-13T06:09:56.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.551+0000 7f7729b84980 1 -- 172.21.15.194:0/3809947455 wait complete. 2024-09-13T06:09:56.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.551+0000 7f7729b84980 1 Processor -- start 2024-09-13T06:09:56.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.551+0000 7f7729b84980 1 -- start start 2024-09-13T06:09:56.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.551+0000 7f7729b84980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5575708ce2d0 0x557570a4ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.551+0000 7f7729b84980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x557570965210 con 0x5575708ce2d0 2024-09-13T06:09:56.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.551+0000 7f7727694640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5575708ce2d0 0x557570a4ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.551+0000 7f7727694640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5575708ce2d0 0x557570a4ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45096/0 (socket says 172.21.15.194:45096) 2024-09-13T06:09:56.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.551+0000 7f7727694640 1 -- 172.21.15.194:0/3705200944 learned_addr learned my addr 172.21.15.194:0/3705200944 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:56.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.551+0000 7f7727694640 1 -- 172.21.15.194:0/3705200944 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557570a4e410 con 0x5575708ce2d0 2024-09-13T06:09:56.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.551+0000 7f7727694640 1 --2- 172.21.15.194:0/3705200944 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5575708ce2d0 0x557570a4ded0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7720000f90 tx=0x7f7720001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.551+0000 7f7613e07640 1 -- 172.21.15.194:0/3705200944 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7720022020 con 0x5575708ce2d0 2024-09-13T06:09:56.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.551+0000 7f7729b84980 1 -- 172.21.15.194:0/3705200944 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557570a4e6a0 con 0x5575708ce2d0 2024-09-13T06:09:56.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.551+0000 7f7613e07640 1 -- 172.21.15.194:0/3705200944 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7720006840 con 0x5575708ce2d0 2024-09-13T06:09:56.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.551+0000 7f7613e07640 1 -- 172.21.15.194:0/3705200944 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f772001e800 con 0x5575708ce2d0 2024-09-13T06:09:56.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.551+0000 7f7729b84980 1 -- 172.21.15.194:0/3705200944 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557570a51380 con 0x5575708ce2d0 2024-09-13T06:09:56.558 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.555+0000 7f7613e07640 1 -- 172.21.15.194:0/3705200944 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7720025020 con 0x5575708ce2d0 2024-09-13T06:09:56.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.555+0000 7f7613e07640 1 --2- 172.21.15.194:0/3705200944 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f760c034600 0x7f760c036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.555+0000 7f7613e07640 1 -- 172.21.15.194:0/3705200944 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f7720049bb0 con 0x5575708ce2d0 2024-09-13T06:09:56.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.555+0000 7f7726e93640 1 --2- 172.21.15.194:0/3705200944 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f760c034600 0x7f760c036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.555+0000 7f7729b84980 1 --2- 172.21.15.194:0/3705200944 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55757095fe80 0x557570a54fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.555+0000 7f7729b84980 1 -- 172.21.15.194:0/3705200944 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557570a55550 con 0x55757095fe80 2024-09-13T06:09:56.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.555+0000 7f7727e95640 1 --2- 172.21.15.194:0/3705200944 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55757095fe80 0x557570a54fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.555+0000 7f7726e93640 1 --2- 172.21.15.194:0/3705200944 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f760c034600 0x7f760c036ac0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f77100ae000 tx=0x7f77100a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.555+0000 7f7727e95640 1 --2- 172.21.15.194:0/3705200944 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55757095fe80 0x557570a54fd0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.555+0000 7f7727e95640 1 -- 172.21.15.194:0/3705200944 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f77180083f0 con 0x55757095fe80 2024-09-13T06:09:56.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.555+0000 7f7729b84980 1 -- 172.21.15.194:0/3705200944 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557570a525a0 con 0x55757095fe80 2024-09-13T06:09:56.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.555+0000 7f7727e95640 1 -- 172.21.15.194:0/3705200944 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f77180083f0 con 0x55757095fe80 2024-09-13T06:09:56.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.555+0000 7f7729b84980 1 --2- 172.21.15.194:0/3705200944 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x557570a57840 0x557570a59c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.560 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.555+0000 7f7729b84980 1 -- 172.21.15.194:0/3705200944 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557570a5a300 con 0x557570a57840 2024-09-13T06:09:56.560 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.555+0000 7f7727694640 1 --2- 172.21.15.194:0/3705200944 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x557570a57840 0x557570a59c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.560 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.555+0000 7f7727694640 1 --2- 172.21.15.194:0/3705200944 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x557570a57840 0x557570a59c30 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.560 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.555+0000 7f7727694640 1 -- 172.21.15.194:0/3705200944 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f772001b040 con 0x557570a57840 2024-09-13T06:09:56.560 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.555+0000 7f7729b84980 1 -- 172.21.15.194:0/3705200944 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557570a566e0 con 0x55757095fe80 2024-09-13T06:09:56.560 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.555+0000 7f7727e95640 1 -- 172.21.15.194:0/3705200944 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f77180083f0 con 0x55757095fe80 2024-09-13T06:09:56.560 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.555+0000 7f7729b84980 1 --2- 172.21.15.194:0/3705200944 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x557570a5b760 0x557570a5db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.560 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.555+0000 7f7729b84980 1 -- 172.21.15.194:0/3705200944 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557570a5e250 con 0x557570a5b760 2024-09-13T06:09:56.560 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.555+0000 7f7726e93640 1 --2- 172.21.15.194:0/3705200944 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x557570a5b760 0x557570a5db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.560 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.555+0000 7f7726e93640 1 --2- 172.21.15.194:0/3705200944 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x557570a5b760 0x557570a5db50 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.560 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.555+0000 7f7726e93640 1 -- 172.21.15.194:0/3705200944 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f77100aaad0 con 0x557570a5b760 2024-09-13T06:09:56.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.559+0000 7f7729b84980 1 Processor -- start 2024-09-13T06:09:56.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.559+0000 7f7729b84980 1 -- start start 2024-09-13T06:09:56.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.559+0000 7f7729b84980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557570a6bd20 0x557570a6c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.559+0000 7f7729b84980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x557570860800 con 0x557570a6bd20 2024-09-13T06:09:56.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.559+0000 7f7727694640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557570a6bd20 0x557570a6c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.559+0000 7f7727694640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557570a6bd20 0x557570a6c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45112/0 (socket says 172.21.15.194:45112) 2024-09-13T06:09:56.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.559+0000 7f7727694640 1 -- 172.21.15.194:0/1095188217 learned_addr learned my addr 172.21.15.194:0/1095188217 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:56.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.559+0000 7f7727694640 1 -- 172.21.15.194:0/1095188217 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557570a6c680 con 0x557570a6bd20 2024-09-13T06:09:56.564 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.559+0000 7f7727694640 1 --2- 172.21.15.194:0/1095188217 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557570a6bd20 0x557570a6c140 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7720048000 tx=0x7f7720026a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.564 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.559+0000 7f7611602640 1 -- 172.21.15.194:0/1095188217 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f772003f070 con 0x557570a6bd20 2024-09-13T06:09:56.564 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.559+0000 7f7611602640 1 -- 172.21.15.194:0/1095188217 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7720028d00 con 0x557570a6bd20 2024-09-13T06:09:56.564 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.559+0000 7f7729b84980 1 -- 172.21.15.194:0/1095188217 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557570a6c910 con 0x557570a6bd20 2024-09-13T06:09:56.564 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.559+0000 7f7611602640 1 -- 172.21.15.194:0/1095188217 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7720041630 con 0x557570a6bd20 2024-09-13T06:09:56.564 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.559+0000 7f7729b84980 1 -- 172.21.15.194:0/1095188217 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557570a6f590 con 0x557570a6bd20 2024-09-13T06:09:56.564 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.559+0000 7f7611602640 1 -- 172.21.15.194:0/1095188217 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f77200412c0 con 0x557570a6bd20 2024-09-13T06:09:56.564 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.559+0000 7f7611602640 1 --2- 172.21.15.194:0/1095188217 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7600034650 0x7f7600036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.564 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.559+0000 7f7611602640 1 -- 172.21.15.194:0/1095188217 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f772004ea00 con 0x557570a6bd20 2024-09-13T06:09:56.564 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.559+0000 7f7726e93640 1 --2- 172.21.15.194:0/1095188217 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7600034650 0x7f7600036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.564 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.559+0000 7f7729b84980 1 Processor -- start 2024-09-13T06:09:56.564 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.559+0000 7f7729b84980 1 -- start start 2024-09-13T06:09:56.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.563+0000 7f7726e93640 1 --2- 172.21.15.194:0/1095188217 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7600034650 0x7f7600036b10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x557570a55df0 tx=0x7f7710005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.563+0000 7f7729b84980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557570a78690 0x557570a78a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.563+0000 7f7729b84980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x557570a474d0 con 0x557570a78690 2024-09-13T06:09:56.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.563+0000 7f7727694640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557570a78690 0x557570a78a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.563+0000 7f7727694640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557570a78690 0x557570a78a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45114/0 (socket says 172.21.15.194:45114) 2024-09-13T06:09:56.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.563+0000 7f7727694640 1 -- 172.21.15.194:0/1749949313 learned_addr learned my addr 172.21.15.194:0/1749949313 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:56.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.563+0000 7f7727694640 1 -- 172.21.15.194:0/1749949313 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557570a79060 con 0x557570a78690 2024-09-13T06:09:56.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.563+0000 7f7727694640 1 --2- 172.21.15.194:0/1749949313 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557570a78690 0x557570a78a90 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f7720045fb0 tx=0x7f77200499f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e184fbf23d87991 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.572 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.563+0000 7f760affd640 1 -- 172.21.15.194:0/1749949313 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f772005b020 con 0x557570a78690 2024-09-13T06:09:56.572 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.563+0000 7f760affd640 1 -- 172.21.15.194:0/1749949313 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7720030400 con 0x557570a78690 2024-09-13T06:09:56.572 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.563+0000 7f760affd640 1 -- 172.21.15.194:0/1749949313 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f772003d120 con 0x557570a78690 2024-09-13T06:09:56.572 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.563+0000 7f7729b84980 1 -- 172.21.15.194:0/1749949313 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557570a78690 msgr2=0x557570a78a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.572 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.563+0000 7f7729b84980 1 --2- 172.21.15.194:0/1749949313 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557570a78690 0x557570a78a90 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f7720045fb0 tx=0x7f77200499f0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.572 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.563+0000 7f7729b84980 1 -- 172.21.15.194:0/1749949313 shutdown_connections 2024-09-13T06:09:56.572 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.563+0000 7f7729b84980 1 --2- 172.21.15.194:0/1749949313 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557570a78690 0x557570a78a90 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.572 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.563+0000 7f7729b84980 1 -- 172.21.15.194:0/1749949313 >> 172.21.15.194:0/1749949313 conn(0x557570a74a70 msgr2=0x557570a72b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:56.572 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.563+0000 7f7729b84980 1 -- 172.21.15.194:0/1749949313 shutdown_connections 2024-09-13T06:09:56.572 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.563+0000 7f7729b84980 1 -- 172.21.15.194:0/1749949313 wait complete. 2024-09-13T06:09:56.572 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.563+0000 7f7729b84980 1 Processor -- start 2024-09-13T06:09:56.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.563+0000 7f7729b84980 1 -- start start 2024-09-13T06:09:56.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.563+0000 7f7729b84980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557570a78690 0x557570a7f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.563+0000 7f7729b84980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x557570a794e0 con 0x557570a78690 2024-09-13T06:09:56.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.563+0000 7f7727694640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557570a78690 0x557570a7f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.563+0000 7f7727694640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557570a78690 0x557570a7f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45124/0 (socket says 172.21.15.194:45124) 2024-09-13T06:09:56.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.563+0000 7f7727694640 1 -- 172.21.15.194:0/3546510970 learned_addr learned my addr 172.21.15.194:0/3546510970 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:56.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.563+0000 7f7727694640 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557570a7fdb0 con 0x557570a78690 2024-09-13T06:09:56.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.563+0000 7f7727694640 1 --2- 172.21.15.194:0/3546510970 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557570a78690 0x557570a7f870 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f772004ecf0 tx=0x7f7720026b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.567+0000 7f76097fa640 1 -- 172.21.15.194:0/3546510970 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f772006f070 con 0x557570a78690 2024-09-13T06:09:56.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.567+0000 7f7729b84980 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557570a7fdb0 con 0x557570a78690 2024-09-13T06:09:56.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.567+0000 7f76097fa640 1 -- 172.21.15.194:0/3546510970 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f772003aa60 con 0x557570a78690 2024-09-13T06:09:56.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.567+0000 7f7729b84980 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557570a80220 con 0x557570a78690 2024-09-13T06:09:56.574 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.567+0000 7f76097fa640 1 -- 172.21.15.194:0/3546510970 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f772003ac10 con 0x557570a78690 2024-09-13T06:09:56.574 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.567+0000 7f7729b84980 20 rados->read ofs=0 len=0 2024-09-13T06:09:56.574 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.567+0000 7f76097fa640 1 -- 172.21.15.194:0/3546510970 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f772005e020 con 0x557570a78690 2024-09-13T06:09:56.574 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.567+0000 7f76097fa640 1 --2- 172.21.15.194:0/3546510970 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f75f0034650 0x7f75f0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.574 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.567+0000 7f76097fa640 1 -- 172.21.15.194:0/3546510970 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f7720067050 con 0x557570a78690 2024-09-13T06:09:56.574 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.567+0000 7f7726e93640 1 --2- 172.21.15.194:0/3546510970 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f75f0034650 0x7f75f0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.574 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.567+0000 7f7729b84980 1 --2- 172.21.15.194:0/3546510970 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x557570a8a940 0x557570a8ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.574 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.567+0000 7f7729b84980 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557570a8d550 con 0x557570a8a940 2024-09-13T06:09:56.574 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.567+0000 7f7727e95640 1 --2- 172.21.15.194:0/3546510970 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x557570a8a940 0x557570a8ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.574 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.567+0000 7f7726e93640 1 --2- 172.21.15.194:0/3546510970 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f75f0034650 0x7f75f0036b10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7710000c10 tx=0x7f77100c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.574 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.567+0000 7f7727e95640 1 --2- 172.21.15.194:0/3546510970 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x557570a8a940 0x557570a8ce00 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.574 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.567+0000 7f7727e95640 1 -- 172.21.15.194:0/3546510970 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f77180083f0 con 0x557570a8a940 2024-09-13T06:09:56.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.567+0000 7f7729b84980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:56.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.567+0000 7f7729b84980 20 realm 2024-09-13T06:09:56.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.567+0000 7f7729b84980 20 rados->read ofs=0 len=0 2024-09-13T06:09:56.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.567+0000 7f7729b84980 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557570a8d960 con 0x557570a8a940 2024-09-13T06:09:56.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.567+0000 7f7727e95640 1 -- 172.21.15.194:0/3546510970 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f77180083f0 con 0x557570a8a940 2024-09-13T06:09:56.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.567+0000 7f7729b84980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:56.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.567+0000 7f7729b84980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:09:56.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.567+0000 7f7729b84980 20 rados->read ofs=0 len=0 2024-09-13T06:09:56.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.567+0000 7f7729b84980 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557570a8e200 con 0x557570a8a940 2024-09-13T06:09:56.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.567+0000 7f7727e95640 1 -- 172.21.15.194:0/3546510970 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f77180083f0 con 0x557570a8a940 2024-09-13T06:09:56.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.567+0000 7f7729b84980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:56.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.567+0000 7f7729b84980 20 rados->read ofs=0 len=0 2024-09-13T06:09:56.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.567+0000 7f7729b84980 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557570a8e5a0 con 0x557570a8a940 2024-09-13T06:09:56.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.567+0000 7f7727e95640 1 -- 172.21.15.194:0/3546510970 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f77180083f0 con 0x557570a8a940 2024-09-13T06:09:56.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.567+0000 7f7729b84980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:56.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.567+0000 7f7729b84980 20 rados->read ofs=0 len=0 2024-09-13T06:09:56.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.567+0000 7f7729b84980 1 --2- 172.21.15.194:0/3546510970 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x557570a8f300 0x557570a916f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.567+0000 7f7729b84980 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557570a91c30 con 0x557570a8f300 2024-09-13T06:09:56.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.567+0000 7f7727694640 1 --2- 172.21.15.194:0/3546510970 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x557570a8f300 0x557570a916f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.567+0000 7f7727694640 1 --2- 172.21.15.194:0/3546510970 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x557570a8f300 0x557570a916f0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.567+0000 7f7727694640 1 -- 172.21.15.194:0/3546510970 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7720041030 con 0x557570a8f300 2024-09-13T06:09:56.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.567+0000 7f7729b84980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:09:56.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.567+0000 7f7729b84980 20 searching for the correct realm 2024-09-13T06:09:56.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.567+0000 7f7729b84980 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557570a934d0 con 0x557570a8f300 2024-09-13T06:09:56.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.571+0000 7f7727694640 1 -- 172.21.15.194:0/3546510970 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7720041030 con 0x557570a8f300 2024-09-13T06:09:56.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.571+0000 7f7727694640 1 --2- 172.21.15.194:0/3546510970 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f7720060040 0x7f772002c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.571+0000 7f7727694640 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557570a934d0 con 0x7f7720060040 2024-09-13T06:09:56.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.571+0000 7f7726e93640 1 --2- 172.21.15.194:0/3546510970 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f7720060040 0x7f772002c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.571+0000 7f7726e93640 1 --2- 172.21.15.194:0/3546510970 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f7720060040 0x7f772002c210 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.571+0000 7f7726e93640 1 -- 172.21.15.194:0/3546510970 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f77100aaad0 con 0x7f7720060040 2024-09-13T06:09:56.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.571+0000 7f7726e93640 1 --2- 172.21.15.194:0/3546510970 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f77100e0040 0x7f77100e0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.571+0000 7f7726e93640 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557570a934d0 con 0x7f77100e0040 2024-09-13T06:09:56.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.571+0000 7f7727e95640 1 --2- 172.21.15.194:0/3546510970 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f77100e0040 0x7f77100e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.586 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.571+0000 7f7727e95640 1 --2- 172.21.15.194:0/3546510970 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f77100e0040 0x7f77100e0420 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.586 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.571+0000 7f7727e95640 1 -- 172.21.15.194:0/3546510970 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77180083f0 con 0x7f77100e0040 2024-09-13T06:09:56.586 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.571+0000 7f7727e95640 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557570a8e5a0 con 0x557570a8a940 2024-09-13T06:09:56.586 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.571+0000 7f7727e95640 1 -- 172.21.15.194:0/3546510970 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77180083f0 con 0x557570a8a940 2024-09-13T06:09:56.586 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.571+0000 7f7727e95640 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557570a8e5a0 con 0x557570a8a940 2024-09-13T06:09:56.586 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.571+0000 7f7727e95640 1 -- 172.21.15.194:0/3546510970 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77180083f0 con 0x557570a8a940 2024-09-13T06:09:56.586 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.571+0000 7f7727e95640 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557570a8e5a0 con 0x7f77100e0040 2024-09-13T06:09:56.586 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.571+0000 7f7727e95640 1 -- 172.21.15.194:0/3546510970 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77180083f0 con 0x7f77100e0040 2024-09-13T06:09:56.586 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.571+0000 7f7727e95640 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557570a8e5a0 con 0x7f77100e0040 2024-09-13T06:09:56.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.575+0000 7f7727e95640 1 -- 172.21.15.194:0/3546510970 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77180083f0 con 0x7f77100e0040 2024-09-13T06:09:56.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.575+0000 7f7727e95640 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557570a8e5a0 con 0x7f7720060040 2024-09-13T06:09:56.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.575+0000 7f7726e93640 1 -- 172.21.15.194:0/3546510970 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77100aaad0 con 0x7f7720060040 2024-09-13T06:09:56.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.575+0000 7f7726e93640 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557570a8e5a0 con 0x557570a8f300 2024-09-13T06:09:56.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.575+0000 7f7727694640 1 -- 172.21.15.194:0/3546510970 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7720041030 con 0x557570a8f300 2024-09-13T06:09:56.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.575+0000 7f7727694640 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557570a8e5a0 con 0x557570a8a940 2024-09-13T06:09:56.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.575+0000 7f7727e95640 1 -- 172.21.15.194:0/3546510970 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77180083f0 con 0x557570a8a940 2024-09-13T06:09:56.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.575+0000 7f7727e95640 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557570a8e5a0 con 0x7f77100e0040 2024-09-13T06:09:56.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.575+0000 7f7727e95640 1 -- 172.21.15.194:0/3546510970 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77180083f0 con 0x7f77100e0040 2024-09-13T06:09:56.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.575+0000 7f7727e95640 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557570a8e5a0 con 0x557570a8a940 2024-09-13T06:09:56.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.575+0000 7f7727e95640 1 -- 172.21.15.194:0/3546510970 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77180083f0 con 0x557570a8a940 2024-09-13T06:09:56.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.575+0000 7f7727e95640 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557570a8e5a0 con 0x7f7720060040 2024-09-13T06:09:56.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.575+0000 7f7726e93640 1 -- 172.21.15.194:0/3546510970 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f77100aaad0 con 0x7f7720060040 2024-09-13T06:09:56.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.575+0000 7f7726e93640 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557570a8e5a0 con 0x557570a8f300 2024-09-13T06:09:56.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.575+0000 7f7727694640 1 -- 172.21.15.194:0/3546510970 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7720041030 con 0x557570a8f300 2024-09-13T06:09:56.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.575+0000 7f7727694640 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557570a8e5a0 con 0x557570a8f300 2024-09-13T06:09:56.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.575+0000 7f7727694640 1 -- 172.21.15.194:0/3546510970 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7720041030 con 0x557570a8f300 2024-09-13T06:09:56.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.575+0000 7f7727694640 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557570a8e5a0 con 0x7f77100e0040 2024-09-13T06:09:56.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.575+0000 7f7727e95640 1 -- 172.21.15.194:0/3546510970 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77180083f0 con 0x7f77100e0040 2024-09-13T06:09:56.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.575+0000 7f7727e95640 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557570a8e5a0 con 0x557570a8f300 2024-09-13T06:09:56.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.575+0000 7f7727694640 1 -- 172.21.15.194:0/3546510970 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7720041030 con 0x557570a8f300 2024-09-13T06:09:56.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.575+0000 7f7727694640 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557570a8e5a0 con 0x557570a8f300 2024-09-13T06:09:56.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.575+0000 7f7727694640 1 -- 172.21.15.194:0/3546510970 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7720041030 con 0x557570a8f300 2024-09-13T06:09:56.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.575+0000 7f7727694640 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557570a8e5a0 con 0x557570a8a940 2024-09-13T06:09:56.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.575+0000 7f7727e95640 1 -- 172.21.15.194:0/3546510970 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77180083f0 con 0x557570a8a940 2024-09-13T06:09:56.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.575+0000 7f7727e95640 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557570a8e5a0 con 0x557570a8a940 2024-09-13T06:09:56.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.575+0000 7f7727e95640 1 -- 172.21.15.194:0/3546510970 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f77180083f0 con 0x557570a8a940 2024-09-13T06:09:56.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.575+0000 7f7727e95640 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557570a8e5a0 con 0x7f77100e0040 2024-09-13T06:09:56.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.579+0000 7f7727e95640 1 -- 172.21.15.194:0/3546510970 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77180083f0 con 0x7f77100e0040 2024-09-13T06:09:56.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.579+0000 7f7727e95640 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557570a8e5a0 con 0x557570a8f300 2024-09-13T06:09:56.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.579+0000 7f7727694640 1 -- 172.21.15.194:0/3546510970 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7720041030 con 0x557570a8f300 2024-09-13T06:09:56.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.579+0000 7f7727694640 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557570a8e5a0 con 0x7f7720060040 2024-09-13T06:09:56.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.579+0000 7f7726e93640 1 -- 172.21.15.194:0/3546510970 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77100aaad0 con 0x7f7720060040 2024-09-13T06:09:56.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.579+0000 7f7726e93640 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557570a8e5a0 con 0x557570a8a940 2024-09-13T06:09:56.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.579+0000 7f7727e95640 1 -- 172.21.15.194:0/3546510970 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77180083f0 con 0x557570a8a940 2024-09-13T06:09:56.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.579+0000 7f7727e95640 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557570a8e5a0 con 0x7f77100e0040 2024-09-13T06:09:56.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.579+0000 7f7727e95640 1 -- 172.21.15.194:0/3546510970 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77180083f0 con 0x7f77100e0040 2024-09-13T06:09:56.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.579+0000 7f7727e95640 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557570a8e5a0 con 0x557570a8f300 2024-09-13T06:09:56.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.579+0000 7f7727694640 1 -- 172.21.15.194:0/3546510970 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7720041030 con 0x557570a8f300 2024-09-13T06:09:56.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.579+0000 7f7727694640 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557570a8e5a0 con 0x7f77100e0040 2024-09-13T06:09:56.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.579+0000 7f7727e95640 1 -- 172.21.15.194:0/3546510970 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77180083f0 con 0x7f77100e0040 2024-09-13T06:09:56.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.579+0000 7f7727e95640 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557570a8e5a0 con 0x7f7720060040 2024-09-13T06:09:56.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.579+0000 7f7726e93640 1 -- 172.21.15.194:0/3546510970 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77100aaad0 con 0x7f7720060040 2024-09-13T06:09:56.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.579+0000 7f7726e93640 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557570a8e5a0 con 0x557570a8f300 2024-09-13T06:09:56.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.579+0000 7f7727694640 1 -- 172.21.15.194:0/3546510970 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7720041030 con 0x557570a8f300 2024-09-13T06:09:56.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.579+0000 7f7727694640 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557570a8e5a0 con 0x7f77100e0040 2024-09-13T06:09:56.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.583+0000 7f7727e95640 1 -- 172.21.15.194:0/3546510970 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77180083f0 con 0x7f77100e0040 2024-09-13T06:09:56.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.583+0000 7f7727e95640 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557570a8e5a0 con 0x557570a8a940 2024-09-13T06:09:56.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.583+0000 7f7727e95640 1 -- 172.21.15.194:0/3546510970 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f77180083f0 con 0x557570a8a940 2024-09-13T06:09:56.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.583+0000 7f7727e95640 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557570a8e5a0 con 0x7f7720060040 2024-09-13T06:09:56.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.583+0000 7f7726e93640 1 -- 172.21.15.194:0/3546510970 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77100aaad0 con 0x7f7720060040 2024-09-13T06:09:56.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.583+0000 7f7729b84980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:09:56.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.583+0000 7f7729b84980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:09:56.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.583+0000 7f7729b84980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:09:56.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.583+0000 7f7729b84980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:09:56.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.583+0000 7f7729b84980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:09:56.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.583+0000 7f7729b84980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:09:56.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.583+0000 7f7729b84980 20 rados->read ofs=0 len=0 2024-09-13T06:09:56.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.583+0000 7f7729b84980 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557570a92480 con 0x557570a8a940 2024-09-13T06:09:56.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.583+0000 7f7727e95640 1 -- 172.21.15.194:0/3546510970 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f77180083f0 con 0x557570a8a940 2024-09-13T06:09:56.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.583+0000 7f7729b84980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:56.592 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.583+0000 7f7729b84980 20 rados->read ofs=0 len=0 2024-09-13T06:09:56.592 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.583+0000 7f7729b84980 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557570a92870 con 0x557570a8a940 2024-09-13T06:09:56.592 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.583+0000 7f7727e95640 1 -- 172.21.15.194:0/3546510970 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f77180083f0 con 0x557570a8a940 2024-09-13T06:09:56.592 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.583+0000 7f7729b84980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:56.592 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.583+0000 7f7729b84980 20 rados->read ofs=0 len=0 2024-09-13T06:09:56.592 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.583+0000 7f7729b84980 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557570a92870 con 0x7f7720060040 2024-09-13T06:09:56.592 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.583+0000 7f7726e93640 1 -- 172.21.15.194:0/3546510970 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f77100aaad0 con 0x7f7720060040 2024-09-13T06:09:56.592 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.583+0000 7f7729b84980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:09:56.592 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.583+0000 7f7729b84980 20 zone default found 2024-09-13T06:09:56.592 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.583+0000 7f7729b84980 4 Realm: () 2024-09-13T06:09:56.592 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.583+0000 7f7729b84980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:09:56.592 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.583+0000 7f7729b84980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:09:56.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.583+0000 7f7729b84980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:09:56.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.583+0000 7f7729b84980 20 zonegroup default 2024-09-13T06:09:56.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.583+0000 7f7729b84980 20 rados->read ofs=0 len=0 2024-09-13T06:09:56.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.583+0000 7f7729b84980 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557570a939a0 con 0x7f77100e0040 2024-09-13T06:09:56.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.583+0000 7f7727e95640 1 -- 172.21.15.194:0/3546510970 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f77180083f0 con 0x7f77100e0040 2024-09-13T06:09:56.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.583+0000 7f7729b84980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:56.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.583+0000 7f7729b84980 20 rados->read ofs=0 len=0 2024-09-13T06:09:56.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.583+0000 7f7729b84980 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557570a95380 con 0x557570a8f300 2024-09-13T06:09:56.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.583+0000 7f7727694640 1 -- 172.21.15.194:0/3546510970 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7720041030 con 0x557570a8f300 2024-09-13T06:09:56.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.583+0000 7f7729b84980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:56.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.583+0000 7f7729b84980 20 rados->read ofs=0 len=0 2024-09-13T06:09:56.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.583+0000 7f7729b84980 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557570a95720 con 0x557570a8f300 2024-09-13T06:09:56.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.583+0000 7f7727694640 1 -- 172.21.15.194:0/3546510970 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7720041030 con 0x557570a8f300 2024-09-13T06:09:56.594 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.583+0000 7f7729b84980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:56.594 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.583+0000 7f7729b84980 20 started sync module instance, tier type = 2024-09-13T06:09:56.594 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.583+0000 7f7729b84980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:09:56.594 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.583+0000 7f7729b84980 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557570a94820 con 0x7f7720060040 2024-09-13T06:09:56.594 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.583+0000 7f7726e93640 1 -- 172.21.15.194:0/3546510970 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(44 notify.0 [create] v33'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77100aaad0 con 0x7f7720060040 2024-09-13T06:09:56.594 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.583+0000 7f7729b84980 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93962889677840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557570a94480 con 0x7f7720060040 2024-09-13T06:09:56.594 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.583+0000 7f7729b84980 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557570a96590 con 0x557570a8a940 2024-09-13T06:09:56.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.587+0000 7f7726e93640 1 -- 172.21.15.194:0/3546510970 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93962889677840] v33'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77100aaad0 con 0x7f7720060040 2024-09-13T06:09:56.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.587+0000 7f7727e95640 1 -- 172.21.15.194:0/3546510970 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v33'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77180083f0 con 0x557570a8a940 2024-09-13T06:09:56.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.587+0000 7f7729b84980 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93962889683168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557570a96500 con 0x557570a8a940 2024-09-13T06:09:56.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.587+0000 7f7729b84980 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557570a97320 con 0x557570a8f300 2024-09-13T06:09:56.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.587+0000 7f7727e95640 1 -- 172.21.15.194:0/3546510970 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93962889683168] v33'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77180083f0 con 0x557570a8a940 2024-09-13T06:09:56.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.587+0000 7f7727694640 1 -- 172.21.15.194:0/3546510970 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v33'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7720041030 con 0x557570a8f300 2024-09-13T06:09:56.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.587+0000 7f7729b84980 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93962889685376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557570a97710 con 0x557570a8f300 2024-09-13T06:09:56.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.587+0000 7f7729b84980 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557570a980d0 con 0x7f7720060040 2024-09-13T06:09:56.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.591+0000 7f7726e93640 1 -- 172.21.15.194:0/3546510970 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(50 notify.3 [create] v33'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77100aaad0 con 0x7f7720060040 2024-09-13T06:09:56.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.591+0000 7f7729b84980 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93962889692352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557570a98d90 con 0x7f7720060040 2024-09-13T06:09:56.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.591+0000 7f7729b84980 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557570a99750 con 0x557570a8a940 2024-09-13T06:09:56.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.591+0000 7f7727694640 1 -- 172.21.15.194:0/3546510970 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93962889685376] v33'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7720041030 con 0x557570a8f300 2024-09-13T06:09:56.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.591+0000 7f7726e93640 1 -- 172.21.15.194:0/3546510970 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93962889692352] v33'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77100aaad0 con 0x7f7720060040 2024-09-13T06:09:56.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.591+0000 7f7727e95640 1 -- 172.21.15.194:0/3546510970 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v33'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77180083f0 con 0x557570a8a940 2024-09-13T06:09:56.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.591+0000 7f7729b84980 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93962889693408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557570a98d00 con 0x557570a8a940 2024-09-13T06:09:56.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.591+0000 7f7729b84980 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557570a99c00 con 0x7f77100e0040 2024-09-13T06:09:56.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.595+0000 7f7727e95640 1 -- 172.21.15.194:0/3546510970 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93962889693408] v33'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77180083f0 con 0x557570a8a940 2024-09-13T06:09:56.598 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.595+0000 7f7727e95640 1 -- 172.21.15.194:0/3546510970 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(54 notify.5 [create] v33'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77180083f0 con 0x7f77100e0040 2024-09-13T06:09:56.598 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.595+0000 7f7729b84980 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93962889695904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557570a99b70 con 0x7f77100e0040 2024-09-13T06:09:56.598 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.595+0000 7f7729b84980 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557570a9a530 con 0x7f77100e0040 2024-09-13T06:09:56.598 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.595+0000 7f7727e95640 1 -- 172.21.15.194:0/3546510970 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(56 notify.6 [create] v33'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77180083f0 con 0x7f77100e0040 2024-09-13T06:09:56.598 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.595+0000 7f7729b84980 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93962889699456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557570a9a950 con 0x7f77100e0040 2024-09-13T06:09:56.598 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.595+0000 7f7729b84980 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557570a9b3a0 con 0x7f77100e0040 2024-09-13T06:09:56.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.595+0000 7f7727e95640 1 -- 172.21.15.194:0/3546510970 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93962889695904] v33'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77180083f0 con 0x7f77100e0040 2024-09-13T06:09:56.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.599+0000 7f7727e95640 1 -- 172.21.15.194:0/3546510970 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93962889699456] v33'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77180083f0 con 0x7f77100e0040 2024-09-13T06:09:56.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.599+0000 7f7727e95640 1 -- 172.21.15.194:0/3546510970 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(58 notify.7 [create] v33'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77180083f0 con 0x7f77100e0040 2024-09-13T06:09:56.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.599+0000 7f7729b84980 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93962889696960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557570a9a950 con 0x7f77100e0040 2024-09-13T06:09:56.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.599+0000 7f7729b84980 20 add_watcher() i=0 2024-09-13T06:09:56.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.599+0000 7f7729b84980 20 add_watcher() i=1 2024-09-13T06:09:56.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.599+0000 7f7729b84980 20 add_watcher() i=2 2024-09-13T06:09:56.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.599+0000 7f7729b84980 20 add_watcher() i=3 2024-09-13T06:09:56.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.599+0000 7f7729b84980 20 add_watcher() i=4 2024-09-13T06:09:56.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.599+0000 7f7729b84980 20 add_watcher() i=5 2024-09-13T06:09:56.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.599+0000 7f7729b84980 20 add_watcher() i=6 2024-09-13T06:09:56.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.599+0000 7f7727e95640 1 -- 172.21.15.194:0/3546510970 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93962889696960] v33'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77180083f0 con 0x7f77100e0040 2024-09-13T06:09:56.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.599+0000 7f7729b84980 20 add_watcher() i=7 2024-09-13T06:09:56.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.599+0000 7f7729b84980 2 all 8 watchers are set, enabling cache 2024-09-13T06:09:56.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.599+0000 7f7729b84980 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557570a9e390 con 0x557570a8a940 2024-09-13T06:09:56.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.599+0000 7f7727e95640 1 -- 172.21.15.194:0/3546510970 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f77180083f0 con 0x557570a8a940 2024-09-13T06:09:56.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.599+0000 7f7729b84980 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93962889700976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557570a9b810 con 0x557570a8a940 2024-09-13T06:09:56.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.603+0000 7f7727e95640 1 -- 172.21.15.194:0/3546510970 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93962889700976] v33'88 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f77180083f0 con 0x557570a8a940 2024-09-13T06:09:56.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.603+0000 7f75ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:56.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.603+0000 7f7729b84980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:09:56.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.603+0000 7f7729b84980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:09:56.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.603+0000 7f7729b84980 5 note: GC not initialized 2024-09-13T06:09:56.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.603+0000 7f75dcfe1640 20 reqs_thread_entry: start 2024-09-13T06:09:56.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.603+0000 7f7729b84980 20 init_complete bucket index max shards: 11 2024-09-13T06:09:56.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.603+0000 7f7729b84980 20 Filter name: none 2024-09-13T06:09:56.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.603+0000 7f75567fc640 20 reqs_thread_entry: start 2024-09-13T06:09:56.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.603+0000 7f7729b84980 20 rados->read ofs=0 len=0 2024-09-13T06:09:56.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.603+0000 7f7729b84980 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557570ac1410 con 0x557570a8a940 2024-09-13T06:09:56.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.603+0000 7f7727e95640 1 -- 172.21.15.194:0/3546510970 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f77180083f0 con 0x557570a8a940 2024-09-13T06:09:56.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.603+0000 7f7729b84980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T06:09:56.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.603+0000 7f7729b84980 20 rados->read ofs=0 len=0 2024-09-13T06:09:56.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.603+0000 7f7729b84980 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557570ac1e00 con 0x557570a8a940 2024-09-13T06:09:56.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.603+0000 7f7727e95640 1 -- 172.21.15.194:0/3546510970 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f77180083f0 con 0x557570a8a940 2024-09-13T06:09:56.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.603+0000 7f7729b84980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T06:09:56.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.603+0000 7f7729b84980 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557570ac2e10 con 0x7f7720060040 2024-09-13T06:09:56.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.603+0000 7f7726e93640 1 -- 172.21.15.194:0/3546510970 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f77100aaad0 con 0x7f7720060040 2024-09-13T06:09:56.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.603+0000 7f75ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:56.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.603+0000 7f7729b84980 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93962889700976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557570abf2a0 con 0x557570a8a940 2024-09-13T06:09:56.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.607+0000 7f7727e95640 1 -- 172.21.15.194:0/3546510970 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 93962889700976] v33'89 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f77180083f0 con 0x557570a8a940 2024-09-13T06:09:56.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.607+0000 7f7729b84980 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93962889677840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557570abf2a0 con 0x7f7720060040 2024-09-13T06:09:56.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.607+0000 7f7726e93640 1 -- 172.21.15.194:0/3546510970 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 93962889677840] v33'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77100aaad0 con 0x7f7720060040 2024-09-13T06:09:56.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.607+0000 7f7729b84980 20 remove_watcher() i=0 2024-09-13T06:09:56.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.607+0000 7f7729b84980 2 removed watcher, disabling cache 2024-09-13T06:09:56.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.607+0000 7f7729b84980 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93962889683168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557570abf2a0 con 0x557570a8a940 2024-09-13T06:09:56.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.607+0000 7f7727e95640 1 -- 172.21.15.194:0/3546510970 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 93962889683168] v33'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77180083f0 con 0x557570a8a940 2024-09-13T06:09:56.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.607+0000 7f7729b84980 20 remove_watcher() i=1 2024-09-13T06:09:56.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.607+0000 7f7729b84980 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93962889685376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557570a960e0 con 0x557570a8f300 2024-09-13T06:09:56.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.611+0000 7f7727694640 1 -- 172.21.15.194:0/3546510970 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 93962889685376] v33'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7720041030 con 0x557570a8f300 2024-09-13T06:09:56.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.611+0000 7f7729b84980 20 remove_watcher() i=2 2024-09-13T06:09:56.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.611+0000 7f7729b84980 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93962889692352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557570abf2a0 con 0x7f7720060040 2024-09-13T06:09:56.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.611+0000 7f7726e93640 1 -- 172.21.15.194:0/3546510970 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 93962889692352] v33'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77100aaad0 con 0x7f7720060040 2024-09-13T06:09:56.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.611+0000 7f7729b84980 20 remove_watcher() i=3 2024-09-13T06:09:56.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.611+0000 7f7729b84980 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93962889693408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557570a96980 con 0x557570a8a940 2024-09-13T06:09:56.614 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.615+0000 7f7727e95640 1 -- 172.21.15.194:0/3546510970 <== osd.1 v2:172.21.15.194:6808/3135444559 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 93962889693408] v33'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77180083f0 con 0x557570a8a940 2024-09-13T06:09:56.614 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.615+0000 7f7729b84980 20 remove_watcher() i=4 2024-09-13T06:09:56.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.615+0000 7f7729b84980 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93962889695904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557570abf2a0 con 0x7f77100e0040 2024-09-13T06:09:56.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.615+0000 7f7727e95640 1 -- 172.21.15.194:0/3546510970 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 93962889695904] v33'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77180083f0 con 0x7f77100e0040 2024-09-13T06:09:56.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.615+0000 7f7729b84980 20 remove_watcher() i=5 2024-09-13T06:09:56.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.615+0000 7f7729b84980 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93962889699456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557570a96980 con 0x7f77100e0040 2024-09-13T06:09:56.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.619+0000 7f7727e95640 1 -- 172.21.15.194:0/3546510970 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 93962889699456] v33'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77180083f0 con 0x7f77100e0040 2024-09-13T06:09:56.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.619+0000 7f7729b84980 20 remove_watcher() i=6 2024-09-13T06:09:56.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.619+0000 7f7729b84980 1 -- 172.21.15.194:0/3546510970 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93962889696960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557570a992a0 con 0x7f77100e0040 2024-09-13T06:09:56.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.619+0000 7f7727e95640 1 -- 172.21.15.194:0/3546510970 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 93962889696960] v33'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77180083f0 con 0x7f77100e0040 2024-09-13T06:09:56.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.619+0000 7f7729b84980 20 remove_watcher() i=7 2024-09-13T06:09:56.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.619+0000 7f7729b84980 1 -- 172.21.15.194:0/3546510970 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f77100e0040 msgr2=0x7f77100e0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.624 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.619+0000 7f7729b84980 1 --2- 172.21.15.194:0/3546510970 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f77100e0040 0x7f77100e0420 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.624 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.619+0000 7f7729b84980 1 -- 172.21.15.194:0/3546510970 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x557570a8a940 msgr2=0x557570a8ce00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.624 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.619+0000 7f7729b84980 1 --2- 172.21.15.194:0/3546510970 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x557570a8a940 0x557570a8ce00 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.624 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.619+0000 7f7729b84980 1 -- 172.21.15.194:0/3546510970 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f7720060040 msgr2=0x7f772002c210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.624 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.619+0000 7f7729b84980 1 --2- 172.21.15.194:0/3546510970 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f7720060040 0x7f772002c210 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.624 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.619+0000 7f7729b84980 1 -- 172.21.15.194:0/3546510970 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x557570a8f300 msgr2=0x557570a916f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.624 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.619+0000 7f7729b84980 1 --2- 172.21.15.194:0/3546510970 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x557570a8f300 0x557570a916f0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.624 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.619+0000 7f7729b84980 1 -- 172.21.15.194:0/3546510970 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f75f0034650 msgr2=0x7f75f0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.624 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.619+0000 7f7729b84980 1 --2- 172.21.15.194:0/3546510970 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f75f0034650 0x7f75f0036b10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7710000c10 tx=0x7f77100c1040 comp rx=0 tx=0).stop 2024-09-13T06:09:56.624 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.619+0000 7f7729b84980 1 -- 172.21.15.194:0/3546510970 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557570a78690 msgr2=0x557570a7f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.619+0000 7f7727e95640 1 -- 172.21.15.194:0/3546510970 reap_dead start 2024-09-13T06:09:56.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.619+0000 7f7729b84980 1 --2- 172.21.15.194:0/3546510970 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557570a78690 0x557570a7f870 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f772004ecf0 tx=0x7f7720026b90 comp rx=0 tx=0).stop 2024-09-13T06:09:56.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.619+0000 7f7729b84980 1 -- 172.21.15.194:0/3546510970 shutdown_connections 2024-09-13T06:09:56.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.619+0000 7f7729b84980 1 --2- 172.21.15.194:0/3546510970 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557570a78690 0x557570a7f870 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.619+0000 7f7729b84980 1 -- 172.21.15.194:0/3546510970 >> 172.21.15.194:0/3546510970 conn(0x557570a74a70 msgr2=0x557570a72b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:56.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.619+0000 7f7729b84980 1 -- 172.21.15.194:0/3546510970 shutdown_connections 2024-09-13T06:09:56.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.619+0000 7f7729b84980 1 -- 172.21.15.194:0/3546510970 wait complete. 2024-09-13T06:09:56.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.619+0000 7f7729b84980 1 -- 172.21.15.194:0/1095188217 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7600034650 msgr2=0x7f7600036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.619+0000 7f7729b84980 1 --2- 172.21.15.194:0/1095188217 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7600034650 0x7f7600036b10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x557570a55df0 tx=0x7f7710005ad0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.619+0000 7f7729b84980 1 -- 172.21.15.194:0/1095188217 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557570a6bd20 msgr2=0x557570a6c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.619+0000 7f7729b84980 1 --2- 172.21.15.194:0/1095188217 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557570a6bd20 0x557570a6c140 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7720048000 tx=0x7f7720026a00 comp rx=0 tx=0).stop 2024-09-13T06:09:56.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.619+0000 7f7729b84980 1 -- 172.21.15.194:0/1095188217 shutdown_connections 2024-09-13T06:09:56.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.619+0000 7f7729b84980 1 --2- 172.21.15.194:0/1095188217 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7600034650 0x7f7600036b10 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.619+0000 7f7729b84980 1 --2- 172.21.15.194:0/1095188217 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557570a6bd20 0x557570a6c140 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.619+0000 7f7729b84980 1 -- 172.21.15.194:0/1095188217 >> 172.21.15.194:0/1095188217 conn(0x557570a60e70 msgr2=0x557570a638f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:56.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.619+0000 7f7729b84980 1 -- 172.21.15.194:0/1095188217 shutdown_connections 2024-09-13T06:09:56.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.619+0000 7f7729b84980 1 -- 172.21.15.194:0/1095188217 wait complete. 2024-09-13T06:09:56.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.619+0000 7f7729b84980 1 -- 172.21.15.194:0/3705200944 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55757095fe80 msgr2=0x557570a54fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.619+0000 7f7729b84980 1 --2- 172.21.15.194:0/3705200944 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55757095fe80 0x557570a54fd0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.619+0000 7f7729b84980 1 -- 172.21.15.194:0/3705200944 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x557570a5b760 msgr2=0x557570a5db50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.619+0000 7f7729b84980 1 --2- 172.21.15.194:0/3705200944 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x557570a5b760 0x557570a5db50 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.619+0000 7f7729b84980 1 -- 172.21.15.194:0/3705200944 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x557570a57840 msgr2=0x557570a59c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.619+0000 7f7729b84980 1 --2- 172.21.15.194:0/3705200944 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x557570a57840 0x557570a59c30 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.623+0000 7f7729b84980 1 -- 172.21.15.194:0/3705200944 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f760c034600 msgr2=0x7f760c036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.623+0000 7f7729b84980 1 --2- 172.21.15.194:0/3705200944 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f760c034600 0x7f760c036ac0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f77100ae000 tx=0x7f77100a6000 comp rx=0 tx=0).stop 2024-09-13T06:09:56.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.623+0000 7f7729b84980 1 -- 172.21.15.194:0/3705200944 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5575708ce2d0 msgr2=0x557570a4ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.623+0000 7f7729b84980 1 --2- 172.21.15.194:0/3705200944 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5575708ce2d0 0x557570a4ded0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7720000f90 tx=0x7f7720001260 comp rx=0 tx=0).stop 2024-09-13T06:09:56.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.623+0000 7f7727e95640 1 -- 172.21.15.194:0/3705200944 reap_dead start 2024-09-13T06:09:56.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.623+0000 7f7729b84980 1 -- 172.21.15.194:0/3705200944 shutdown_connections 2024-09-13T06:09:56.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.623+0000 7f7729b84980 1 -- 172.21.15.194:0/3705200944 >> 172.21.15.194:0/3705200944 conn(0x557570954090 msgr2=0x557570a41390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:56.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.623+0000 7f7729b84980 1 -- 172.21.15.194:0/3705200944 shutdown_connections 2024-09-13T06:09:56.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.623+0000 7f7729b84980 1 -- 172.21.15.194:0/3705200944 wait complete. 2024-09-13T06:09:56.631 INFO:teuthology.orchestra.run.smithi194.stdout:[] 2024-09-13T06:09:56.631 DEBUG:tasks.util.rgw: json result: [] 2024-09-13T06:09:56.632 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-09-13T06:09:56.632 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-09-13T06:09:56.632 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-09-13T06:09:56.709 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:09:56.709 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:09:56.710 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.707+0000 7fe4aaa85980 1 Processor -- start 2024-09-13T06:09:56.710 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.707+0000 7fe4aaa85980 1 -- start start 2024-09-13T06:09:56.710 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.707+0000 7fe4aaa85980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55661dc39b00 0x55661dcca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.710 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.707+0000 7fe4aaa85980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55661db4dae0 con 0x55661dccac70 2024-09-13T06:09:56.710 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.707+0000 7fe4aaa85980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x55661db71e30 con 0x55661dc39b00 2024-09-13T06:09:56.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.711+0000 7fe4a8595640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55661dc39b00 0x55661dcca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.711+0000 7fe4a8595640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55661dc39b00 0x55661dcca730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45126/0 (socket says 172.21.15.194:45126) 2024-09-13T06:09:56.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.711+0000 7fe4a8595640 1 -- 172.21.15.194:0/3257906203 learned_addr learned my addr 172.21.15.194:0/3257906203 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:56.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.711+0000 7fe4a8595640 1 -- 172.21.15.194:0/3257906203 >> v1:172.21.15.120:6789/0 conn(0x55661dccac70 legacy=0x55661dccd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.711+0000 7fe4a8595640 1 -- 172.21.15.194:0/3257906203 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55661dc39ee0 con 0x55661dc39b00 2024-09-13T06:09:56.713 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.711+0000 7fe4a8595640 1 --2- 172.21.15.194:0/3257906203 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55661dc39b00 0x55661dcca730 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe4a000a4e0 tx=0x7fe4a001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8451508ddbf1dee server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.714 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.711+0000 7fe4a7593640 1 -- 172.21.15.194:0/3257906203 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4a00aa540 con 0x55661dc39b00 2024-09-13T06:09:56.714 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.711+0000 7fe4a7593640 1 -- 172.21.15.194:0/3257906203 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4a00aa6e0 con 0x55661dc39b00 2024-09-13T06:09:56.714 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.711+0000 7fe4a7593640 1 -- 172.21.15.194:0/3257906203 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4a00aaa40 con 0x55661dc39b00 2024-09-13T06:09:56.715 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.715+0000 7fe4aaa85980 1 -- 172.21.15.194:0/3257906203 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55661dc39b00 msgr2=0x55661dcca730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.715 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.715+0000 7fe4aaa85980 1 --2- 172.21.15.194:0/3257906203 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55661dc39b00 0x55661dcca730 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe4a000a4e0 tx=0x7fe4a001b090 comp rx=0 tx=0).stop 2024-09-13T06:09:56.715 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.715+0000 7fe4aaa85980 1 -- 172.21.15.194:0/3257906203 shutdown_connections 2024-09-13T06:09:56.715 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.715+0000 7fe4aaa85980 1 --2- 172.21.15.194:0/3257906203 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55661dc39b00 0x55661dcca730 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.715 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.715+0000 7fe4aaa85980 1 -- 172.21.15.194:0/3257906203 >> 172.21.15.194:0/3257906203 conn(0x55661dcc0060 msgr2=0x55661dcc2480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:56.715 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.715+0000 7fe4aaa85980 1 -- 172.21.15.194:0/3257906203 shutdown_connections 2024-09-13T06:09:56.715 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.715+0000 7fe4aaa85980 1 -- 172.21.15.194:0/3257906203 wait complete. 2024-09-13T06:09:56.728 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.727+0000 7fe4aaa85980 1 Processor -- start 2024-09-13T06:09:56.728 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.727+0000 7fe4aaa85980 1 -- start start 2024-09-13T06:09:56.728 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.727+0000 7fe4aaa85980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55661dc39b00 0x55661ddb2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.728 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.727+0000 7fe4aaa85980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55661db73200 con 0x55661dc39b00 2024-09-13T06:09:56.728 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.727+0000 7fe4a8595640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55661dc39b00 0x55661ddb2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.728 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.727+0000 7fe4a8595640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55661dc39b00 0x55661ddb2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45134/0 (socket says 172.21.15.194:45134) 2024-09-13T06:09:56.728 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.727+0000 7fe4a8595640 1 -- 172.21.15.194:0/3576377176 learned_addr learned my addr 172.21.15.194:0/3576377176 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:56.729 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.727+0000 7fe4a8595640 1 -- 172.21.15.194:0/3576377176 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55661ddb3180 con 0x55661dc39b00 2024-09-13T06:09:56.729 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.727+0000 7fe4a8595640 1 --2- 172.21.15.194:0/3576377176 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55661dc39b00 0x55661ddb2bb0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0019740 tx=0x7fe4a00033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff95106828801002 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.729 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.727+0000 7fe39660c640 1 -- 172.21.15.194:0/3576377176 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4a00b9070 con 0x55661dc39b00 2024-09-13T06:09:56.729 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.727+0000 7fe39660c640 1 -- 172.21.15.194:0/3576377176 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4a00aab60 con 0x55661dc39b00 2024-09-13T06:09:56.729 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.727+0000 7fe39660c640 1 -- 172.21.15.194:0/3576377176 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4a00b5440 con 0x55661dc39b00 2024-09-13T06:09:56.731 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.727+0000 7fe4aaa85980 1 -- 172.21.15.194:0/3576377176 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55661dc39b00 msgr2=0x55661ddb2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.731 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.727+0000 7fe4aaa85980 1 --2- 172.21.15.194:0/3576377176 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55661dc39b00 0x55661ddb2bb0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0019740 tx=0x7fe4a00033b0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.731 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.727+0000 7fe4aaa85980 1 -- 172.21.15.194:0/3576377176 shutdown_connections 2024-09-13T06:09:56.731 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.727+0000 7fe4aaa85980 1 --2- 172.21.15.194:0/3576377176 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55661dc39b00 0x55661ddb2bb0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.731 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.727+0000 7fe4aaa85980 1 -- 172.21.15.194:0/3576377176 >> 172.21.15.194:0/3576377176 conn(0x55661dcc0060 msgr2=0x55661ddae7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:56.731 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.727+0000 7fe4aaa85980 1 -- 172.21.15.194:0/3576377176 shutdown_connections 2024-09-13T06:09:56.731 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.727+0000 7fe4aaa85980 1 -- 172.21.15.194:0/3576377176 wait complete. 2024-09-13T06:09:56.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.727+0000 7fe4aaa85980 1 Processor -- start 2024-09-13T06:09:56.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.731+0000 7fe4aaa85980 1 -- start start 2024-09-13T06:09:56.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.731+0000 7fe4aaa85980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55661dc39b00 0x55661ddb9e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.731+0000 7fe4aaa85980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55661dcd1210 con 0x55661dc39b00 2024-09-13T06:09:56.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.731+0000 7fe4a8595640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55661dc39b00 0x55661ddb9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.731+0000 7fe4a8595640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55661dc39b00 0x55661ddb9e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45148/0 (socket says 172.21.15.194:45148) 2024-09-13T06:09:56.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.731+0000 7fe4a8595640 1 -- 172.21.15.194:0/60909560 learned_addr learned my addr 172.21.15.194:0/60909560 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:56.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.731+0000 7fe4a8595640 1 -- 172.21.15.194:0/60909560 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55661ddba370 con 0x55661dc39b00 2024-09-13T06:09:56.735 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.731+0000 7fe4a8595640 1 --2- 172.21.15.194:0/60909560 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55661dc39b00 0x55661ddb9e30 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe4a001aec0 tx=0x7fe4a0017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.735 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.731+0000 7fe394e09640 1 -- 172.21.15.194:0/60909560 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4a00b9070 con 0x55661dc39b00 2024-09-13T06:09:56.735 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.731+0000 7fe394e09640 1 -- 172.21.15.194:0/60909560 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4a00c7410 con 0x55661dc39b00 2024-09-13T06:09:56.735 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.731+0000 7fe394e09640 1 -- 172.21.15.194:0/60909560 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4a00a3b40 con 0x55661dc39b00 2024-09-13T06:09:56.735 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.731+0000 7fe4aaa85980 1 -- 172.21.15.194:0/60909560 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55661ddba600 con 0x55661dc39b00 2024-09-13T06:09:56.735 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.731+0000 7fe4aaa85980 1 -- 172.21.15.194:0/60909560 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55661ddbd2e0 con 0x55661dc39b00 2024-09-13T06:09:56.735 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.731+0000 7fe394e09640 1 -- 172.21.15.194:0/60909560 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe4a00aad10 con 0x55661dc39b00 2024-09-13T06:09:56.735 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.731+0000 7fe394e09640 1 --2- 172.21.15.194:0/60909560 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fe390034650 0x7fe390036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.735 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.731+0000 7fe394e09640 1 -- 172.21.15.194:0/60909560 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fe4a00c4070 con 0x55661dc39b00 2024-09-13T06:09:56.735 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.731+0000 7fe4a7d94640 1 --2- 172.21.15.194:0/60909560 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fe390034650 0x7fe390036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.736 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.731+0000 7fe4aaa85980 1 --2- 172.21.15.194:0/60909560 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55661dccac70 0x55661ddc0f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.736 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.731+0000 7fe4aaa85980 1 -- 172.21.15.194:0/60909560 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55661ddc14b0 con 0x55661dccac70 2024-09-13T06:09:56.736 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.731+0000 7fe4a8d96640 1 --2- 172.21.15.194:0/60909560 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55661dccac70 0x55661ddc0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.736 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.731+0000 7fe4a7d94640 1 --2- 172.21.15.194:0/60909560 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fe390034650 0x7fe390036b10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe49c000f70 tx=0x7fe49c001420 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.736 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.731+0000 7fe4a8d96640 1 --2- 172.21.15.194:0/60909560 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55661dccac70 0x55661ddc0f30 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.736 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.735+0000 7fe4a8d96640 1 -- 172.21.15.194:0/60909560 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe4980083f0 con 0x55661dccac70 2024-09-13T06:09:56.736 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.735+0000 7fe4aaa85980 1 -- 172.21.15.194:0/60909560 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55661ddbe500 con 0x55661dccac70 2024-09-13T06:09:56.736 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.735+0000 7fe4a8d96640 1 -- 172.21.15.194:0/60909560 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe4980083f0 con 0x55661dccac70 2024-09-13T06:09:56.736 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.735+0000 7fe4aaa85980 1 --2- 172.21.15.194:0/60909560 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55661ddc3830 0x55661ddc5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.736 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.735+0000 7fe4aaa85980 1 -- 172.21.15.194:0/60909560 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55661ddc62f0 con 0x55661ddc3830 2024-09-13T06:09:56.736 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.735+0000 7fe4a8595640 1 --2- 172.21.15.194:0/60909560 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55661ddc3830 0x55661ddc5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.736 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.735+0000 7fe4a8595640 1 --2- 172.21.15.194:0/60909560 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55661ddc3830 0x55661ddc5c20 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.735+0000 7fe4a8595640 1 -- 172.21.15.194:0/60909560 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe4a00cd060 con 0x55661ddc3830 2024-09-13T06:09:56.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.735+0000 7fe4aaa85980 1 -- 172.21.15.194:0/60909560 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55661ddc26d0 con 0x55661dccac70 2024-09-13T06:09:56.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.735+0000 7fe4a8d96640 1 -- 172.21.15.194:0/60909560 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe4980083f0 con 0x55661dccac70 2024-09-13T06:09:56.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.735+0000 7fe4aaa85980 1 --2- 172.21.15.194:0/60909560 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55661ddc7750 0x55661ddc9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.735+0000 7fe4aaa85980 1 -- 172.21.15.194:0/60909560 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55661ddca240 con 0x55661ddc7750 2024-09-13T06:09:56.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.735+0000 7fe4a7d94640 1 --2- 172.21.15.194:0/60909560 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55661ddc7750 0x55661ddc9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.735+0000 7fe4a7d94640 1 --2- 172.21.15.194:0/60909560 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55661ddc7750 0x55661ddc9b40 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.735+0000 7fe4a7d94640 1 -- 172.21.15.194:0/60909560 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe49c00d040 con 0x55661ddc7750 2024-09-13T06:09:56.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.735+0000 7fe4aaa85980 1 Processor -- start 2024-09-13T06:09:56.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.735+0000 7fe4aaa85980 1 -- start start 2024-09-13T06:09:56.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.735+0000 7fe4aaa85980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55661ddd7d10 0x55661ddd8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.740 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.735+0000 7fe4aaa85980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55661dbcc800 con 0x55661ddd7d10 2024-09-13T06:09:56.740 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.735+0000 7fe4a8595640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55661ddd7d10 0x55661ddd8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.740 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.735+0000 7fe4a8595640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55661ddd7d10 0x55661ddd8130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45164/0 (socket says 172.21.15.194:45164) 2024-09-13T06:09:56.740 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.735+0000 7fe4a8595640 1 -- 172.21.15.194:0/375650254 learned_addr learned my addr 172.21.15.194:0/375650254 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:56.740 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.735+0000 7fe4a8595640 1 -- 172.21.15.194:0/375650254 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55661ddd8670 con 0x55661ddd7d10 2024-09-13T06:09:56.740 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.735+0000 7fe4a8595640 1 --2- 172.21.15.194:0/375650254 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55661ddd7d10 0x55661ddd8130 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe4a00e2cb0 tx=0x7fe4a00e4790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.740 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.739+0000 7fe38dffb640 1 -- 172.21.15.194:0/375650254 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4a00df070 con 0x55661ddd7d10 2024-09-13T06:09:56.740 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.739+0000 7fe4aaa85980 1 -- 172.21.15.194:0/375650254 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55661ddd8900 con 0x55661ddd7d10 2024-09-13T06:09:56.740 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.739+0000 7fe4aaa85980 1 -- 172.21.15.194:0/375650254 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55661ddd8900 con 0x55661ddd7d10 2024-09-13T06:09:56.740 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.739+0000 7fe38dffb640 1 -- 172.21.15.194:0/375650254 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4a00c6cf0 con 0x55661ddd7d10 2024-09-13T06:09:56.740 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.739+0000 7fe38dffb640 1 -- 172.21.15.194:0/375650254 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4a00e4a40 con 0x55661ddd7d10 2024-09-13T06:09:56.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.739+0000 7fe38dffb640 1 -- 172.21.15.194:0/375650254 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe4a00b3040 con 0x55661ddd7d10 2024-09-13T06:09:56.744 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.739+0000 7fe38dffb640 1 --2- 172.21.15.194:0/375650254 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fe380034650 0x7fe380036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.744 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.739+0000 7fe38dffb640 1 -- 172.21.15.194:0/375650254 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fe4a00be050 con 0x55661ddd7d10 2024-09-13T06:09:56.744 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.739+0000 7fe4a7d94640 1 --2- 172.21.15.194:0/375650254 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fe380034650 0x7fe380036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.744 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.739+0000 7fe4aaa85980 1 Processor -- start 2024-09-13T06:09:56.744 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.739+0000 7fe4aaa85980 1 -- start start 2024-09-13T06:09:56.744 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.739+0000 7fe4a7d94640 1 --2- 172.21.15.194:0/375650254 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fe380034650 0x7fe380036b10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x55661ddc1de0 tx=0x7fe49c006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.744 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.739+0000 7fe4aaa85980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55661dde4510 0x55661dde4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.744 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.739+0000 7fe4aaa85980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55661ddb3440 con 0x55661dde4510 2024-09-13T06:09:56.744 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.739+0000 7fe4a8595640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55661dde4510 0x55661dde4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.744 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.739+0000 7fe4a8595640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55661dde4510 0x55661dde4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45180/0 (socket says 172.21.15.194:45180) 2024-09-13T06:09:56.744 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.739+0000 7fe4a8595640 1 -- 172.21.15.194:0/2970929567 learned_addr learned my addr 172.21.15.194:0/2970929567 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:56.744 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.739+0000 7fe4a8595640 1 -- 172.21.15.194:0/2970929567 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55661dde4ee0 con 0x55661dde4510 2024-09-13T06:09:56.745 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.739+0000 7fe4a8595640 1 --2- 172.21.15.194:0/2970929567 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55661dde4510 0x55661dde4910 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0009fd0 tx=0x7fe4a00eda60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55e4a06ed2308bca server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.745 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.739+0000 7fe3877fe640 1 -- 172.21.15.194:0/2970929567 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4a00ed3f0 con 0x55661dde4510 2024-09-13T06:09:56.745 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.739+0000 7fe3877fe640 1 -- 172.21.15.194:0/2970929567 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4a00a9c50 con 0x55661dde4510 2024-09-13T06:09:56.745 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.739+0000 7fe3877fe640 1 -- 172.21.15.194:0/2970929567 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4a00ed590 con 0x55661dde4510 2024-09-13T06:09:56.745 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.743+0000 7fe4aaa85980 1 -- 172.21.15.194:0/2970929567 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55661dde4510 msgr2=0x55661dde4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.745 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.743+0000 7fe4aaa85980 1 --2- 172.21.15.194:0/2970929567 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55661dde4510 0x55661dde4910 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0009fd0 tx=0x7fe4a00eda60 comp rx=0 tx=0).stop 2024-09-13T06:09:56.745 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.743+0000 7fe4aaa85980 1 -- 172.21.15.194:0/2970929567 shutdown_connections 2024-09-13T06:09:56.745 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.743+0000 7fe4aaa85980 1 --2- 172.21.15.194:0/2970929567 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55661dde4510 0x55661dde4910 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.745 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.743+0000 7fe4aaa85980 1 -- 172.21.15.194:0/2970929567 >> 172.21.15.194:0/2970929567 conn(0x55661dde0890 msgr2=0x55661ddde990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:56.745 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.743+0000 7fe4aaa85980 1 -- 172.21.15.194:0/2970929567 shutdown_connections 2024-09-13T06:09:56.745 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.743+0000 7fe4aaa85980 1 -- 172.21.15.194:0/2970929567 wait complete. 2024-09-13T06:09:56.745 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.743+0000 7fe4aaa85980 1 Processor -- start 2024-09-13T06:09:56.746 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.743+0000 7fe4aaa85980 1 -- start start 2024-09-13T06:09:56.746 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.743+0000 7fe4aaa85980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55661dde4510 0x55661ddeb620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.746 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.743+0000 7fe4aaa85980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55661dde52a0 con 0x55661dde4510 2024-09-13T06:09:56.746 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.743+0000 7fe4a8595640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55661dde4510 0x55661ddeb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.746 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.743+0000 7fe4a8595640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55661dde4510 0x55661ddeb620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45186/0 (socket says 172.21.15.194:45186) 2024-09-13T06:09:56.746 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.743+0000 7fe4a8595640 1 -- 172.21.15.194:0/2390817269 learned_addr learned my addr 172.21.15.194:0/2390817269 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:56.746 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.743+0000 7fe4a8595640 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55661ddebb60 con 0x55661dde4510 2024-09-13T06:09:56.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.743+0000 7fe4a8595640 1 --2- 172.21.15.194:0/2390817269 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55661dde4510 0x55661ddeb620 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe4a00e2d10 tx=0x7fe4a0009e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.743+0000 7fe385ffb640 1 -- 172.21.15.194:0/2390817269 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4a0107020 con 0x55661dde4510 2024-09-13T06:09:56.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.743+0000 7fe385ffb640 1 -- 172.21.15.194:0/2390817269 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4a00a9e00 con 0x55661dde4510 2024-09-13T06:09:56.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.743+0000 7fe4aaa85980 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55661ddebb60 con 0x55661dde4510 2024-09-13T06:09:56.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.743+0000 7fe385ffb640 1 -- 172.21.15.194:0/2390817269 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4a00e4df0 con 0x55661dde4510 2024-09-13T06:09:56.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.743+0000 7fe4aaa85980 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55661ddebb60 con 0x55661dde4510 2024-09-13T06:09:56.752 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.743+0000 7fe4aaa85980 20 rados->read ofs=0 len=0 2024-09-13T06:09:56.752 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.743+0000 7fe385ffb640 1 -- 172.21.15.194:0/2390817269 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe4a010a020 con 0x55661dde4510 2024-09-13T06:09:56.752 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.743+0000 7fe385ffb640 1 --2- 172.21.15.194:0/2390817269 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fe378034600 0x7fe378036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.752 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.743+0000 7fe385ffb640 1 -- 172.21.15.194:0/2390817269 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fe4a00fe040 con 0x55661dde4510 2024-09-13T06:09:56.752 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.743+0000 7fe4a7d94640 1 --2- 172.21.15.194:0/2390817269 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fe378034600 0x7fe378036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.752 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.743+0000 7fe4aaa85980 1 --2- 172.21.15.194:0/2390817269 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55661ddf6770 0x55661ddf8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.752 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.743+0000 7fe4aaa85980 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55661ddf9380 con 0x55661ddf6770 2024-09-13T06:09:56.752 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.743+0000 7fe4a8d96640 1 --2- 172.21.15.194:0/2390817269 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55661ddf6770 0x55661ddf8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.752 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.747+0000 7fe4a8d96640 1 --2- 172.21.15.194:0/2390817269 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55661ddf6770 0x55661ddf8c30 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.752 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.747+0000 7fe4a7d94640 1 --2- 172.21.15.194:0/2390817269 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fe378034600 0x7fe378036ac0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x55661ddca640 tx=0x7fe49c011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.752 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.747+0000 7fe4a8d96640 1 -- 172.21.15.194:0/2390817269 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe4980083f0 con 0x55661ddf6770 2024-09-13T06:09:56.753 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.747+0000 7fe4aaa85980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:56.753 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.747+0000 7fe4aaa85980 20 realm 2024-09-13T06:09:56.753 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.747+0000 7fe4aaa85980 20 rados->read ofs=0 len=0 2024-09-13T06:09:56.753 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.747+0000 7fe4aaa85980 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55661ddf9790 con 0x55661ddf6770 2024-09-13T06:09:56.753 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.747+0000 7fe4a8d96640 1 -- 172.21.15.194:0/2390817269 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe4980083f0 con 0x55661ddf6770 2024-09-13T06:09:56.753 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.747+0000 7fe4aaa85980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:56.753 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.747+0000 7fe4aaa85980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:09:56.753 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.747+0000 7fe4aaa85980 20 rados->read ofs=0 len=0 2024-09-13T06:09:56.753 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.747+0000 7fe4aaa85980 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55661ddfa030 con 0x55661ddf6770 2024-09-13T06:09:56.753 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.747+0000 7fe4a8d96640 1 -- 172.21.15.194:0/2390817269 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe4980083f0 con 0x55661ddf6770 2024-09-13T06:09:56.753 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.747+0000 7fe4aaa85980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:56.753 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.747+0000 7fe4aaa85980 20 rados->read ofs=0 len=0 2024-09-13T06:09:56.754 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.747+0000 7fe4aaa85980 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55661ddfa3d0 con 0x55661ddf6770 2024-09-13T06:09:56.754 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.747+0000 7fe4a8d96640 1 -- 172.21.15.194:0/2390817269 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe4980083f0 con 0x55661ddf6770 2024-09-13T06:09:56.754 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.747+0000 7fe4aaa85980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:56.754 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.747+0000 7fe4aaa85980 20 rados->read ofs=0 len=0 2024-09-13T06:09:56.754 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.747+0000 7fe4aaa85980 1 --2- 172.21.15.194:0/2390817269 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55661ddfb130 0x55661ddfd520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.754 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.747+0000 7fe4aaa85980 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55661ddfda60 con 0x55661ddfb130 2024-09-13T06:09:56.754 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.747+0000 7fe4a8595640 1 --2- 172.21.15.194:0/2390817269 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55661ddfb130 0x55661ddfd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.754 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.747+0000 7fe4a8595640 1 --2- 172.21.15.194:0/2390817269 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55661ddfb130 0x55661ddfd520 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.754 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.747+0000 7fe4a8595640 1 -- 172.21.15.194:0/2390817269 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe4a00cd060 con 0x55661ddfb130 2024-09-13T06:09:56.754 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.747+0000 7fe4aaa85980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:09:56.754 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.747+0000 7fe4aaa85980 20 searching for the correct realm 2024-09-13T06:09:56.754 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.747+0000 7fe4aaa85980 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55661ddff300 con 0x55661ddfb130 2024-09-13T06:09:56.754 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.747+0000 7fe4a8595640 1 -- 172.21.15.194:0/2390817269 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4a00cd060 con 0x55661ddfb130 2024-09-13T06:09:56.755 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.747+0000 7fe4a8595640 1 --2- 172.21.15.194:0/2390817269 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fe4a010c020 0x7fe4a00db880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.755 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.747+0000 7fe4a8595640 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55661ddff300 con 0x7fe4a010c020 2024-09-13T06:09:56.755 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.747+0000 7fe4a7d94640 1 --2- 172.21.15.194:0/2390817269 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fe4a010c020 0x7fe4a00db880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.755 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.747+0000 7fe4a7d94640 1 --2- 172.21.15.194:0/2390817269 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fe4a010c020 0x7fe4a00db880 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.755 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.747+0000 7fe4a7d94640 1 -- 172.21.15.194:0/2390817269 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe49c036040 con 0x7fe4a010c020 2024-09-13T06:09:56.755 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.747+0000 7fe4a7d94640 1 --2- 172.21.15.194:0/2390817269 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fe49c00f3d0 0x7fe49c00f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.755 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.747+0000 7fe4a7d94640 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55661ddff300 con 0x7fe49c00f3d0 2024-09-13T06:09:56.755 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.747+0000 7fe4a8d96640 1 --2- 172.21.15.194:0/2390817269 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fe49c00f3d0 0x7fe49c00f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.755 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.747+0000 7fe4a8d96640 1 --2- 172.21.15.194:0/2390817269 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fe49c00f3d0 0x7fe49c00f7f0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.755 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.751+0000 7fe4a8d96640 1 -- 172.21.15.194:0/2390817269 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4980083f0 con 0x7fe49c00f3d0 2024-09-13T06:09:56.755 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.751+0000 7fe4a8d96640 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55661ddfa3d0 con 0x55661ddf6770 2024-09-13T06:09:56.755 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.751+0000 7fe4a8d96640 1 -- 172.21.15.194:0/2390817269 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4980083f0 con 0x55661ddf6770 2024-09-13T06:09:56.756 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.751+0000 7fe4a8d96640 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55661ddfa3d0 con 0x55661ddf6770 2024-09-13T06:09:56.756 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.751+0000 7fe4a8d96640 1 -- 172.21.15.194:0/2390817269 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4980083f0 con 0x55661ddf6770 2024-09-13T06:09:56.756 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.751+0000 7fe4a8d96640 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55661ddfa3d0 con 0x7fe49c00f3d0 2024-09-13T06:09:56.763 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.751+0000 7fe4a8d96640 1 -- 172.21.15.194:0/2390817269 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4980083f0 con 0x7fe49c00f3d0 2024-09-13T06:09:56.764 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.751+0000 7fe4a8d96640 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55661ddfa3d0 con 0x7fe49c00f3d0 2024-09-13T06:09:56.764 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.751+0000 7fe4a8d96640 1 -- 172.21.15.194:0/2390817269 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4980083f0 con 0x7fe49c00f3d0 2024-09-13T06:09:56.764 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.751+0000 7fe4a8d96640 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55661ddfa3d0 con 0x7fe4a010c020 2024-09-13T06:09:56.764 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.751+0000 7fe4a7d94640 1 -- 172.21.15.194:0/2390817269 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe49c036040 con 0x7fe4a010c020 2024-09-13T06:09:56.764 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.751+0000 7fe4a7d94640 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55661ddfa3d0 con 0x55661ddfb130 2024-09-13T06:09:56.764 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.751+0000 7fe4a8595640 1 -- 172.21.15.194:0/2390817269 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4a00cd060 con 0x55661ddfb130 2024-09-13T06:09:56.764 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.751+0000 7fe4a8595640 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55661ddfa3d0 con 0x55661ddf6770 2024-09-13T06:09:56.764 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.751+0000 7fe4a8d96640 1 -- 172.21.15.194:0/2390817269 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4980083f0 con 0x55661ddf6770 2024-09-13T06:09:56.764 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.751+0000 7fe4a8d96640 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55661ddfa3d0 con 0x7fe49c00f3d0 2024-09-13T06:09:56.764 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.751+0000 7fe4a8d96640 1 -- 172.21.15.194:0/2390817269 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4980083f0 con 0x7fe49c00f3d0 2024-09-13T06:09:56.765 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.751+0000 7fe4a8d96640 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55661ddfa3d0 con 0x55661ddf6770 2024-09-13T06:09:56.765 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.755+0000 7fe4a8d96640 1 -- 172.21.15.194:0/2390817269 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4980083f0 con 0x55661ddf6770 2024-09-13T06:09:56.765 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.755+0000 7fe4a8d96640 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55661ddfa3d0 con 0x7fe4a010c020 2024-09-13T06:09:56.765 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.755+0000 7fe4a7d94640 1 -- 172.21.15.194:0/2390817269 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe49c036040 con 0x7fe4a010c020 2024-09-13T06:09:56.765 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.755+0000 7fe4a7d94640 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55661ddfa3d0 con 0x55661ddfb130 2024-09-13T06:09:56.765 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.755+0000 7fe4a8595640 1 -- 172.21.15.194:0/2390817269 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4a00cd060 con 0x55661ddfb130 2024-09-13T06:09:56.765 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.755+0000 7fe4a8595640 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55661ddfa3d0 con 0x55661ddfb130 2024-09-13T06:09:56.765 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.755+0000 7fe4a8595640 1 -- 172.21.15.194:0/2390817269 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4a00cd060 con 0x55661ddfb130 2024-09-13T06:09:56.765 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.755+0000 7fe4a8595640 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55661ddfa3d0 con 0x7fe49c00f3d0 2024-09-13T06:09:56.765 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.755+0000 7fe4a8d96640 1 -- 172.21.15.194:0/2390817269 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4980083f0 con 0x7fe49c00f3d0 2024-09-13T06:09:56.765 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.755+0000 7fe4a8d96640 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55661ddfa3d0 con 0x55661ddfb130 2024-09-13T06:09:56.765 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.755+0000 7fe4a8595640 1 -- 172.21.15.194:0/2390817269 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4a00cd060 con 0x55661ddfb130 2024-09-13T06:09:56.766 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.755+0000 7fe4a8595640 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55661ddfa3d0 con 0x55661ddfb130 2024-09-13T06:09:56.766 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.755+0000 7fe4a8595640 1 -- 172.21.15.194:0/2390817269 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4a00cd060 con 0x55661ddfb130 2024-09-13T06:09:56.766 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.755+0000 7fe4a8595640 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55661ddfa3d0 con 0x55661ddf6770 2024-09-13T06:09:56.766 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.755+0000 7fe4a8d96640 1 -- 172.21.15.194:0/2390817269 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4980083f0 con 0x55661ddf6770 2024-09-13T06:09:56.766 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.755+0000 7fe4a8d96640 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55661ddfa3d0 con 0x55661ddf6770 2024-09-13T06:09:56.766 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.755+0000 7fe4a8d96640 1 -- 172.21.15.194:0/2390817269 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe4980083f0 con 0x55661ddf6770 2024-09-13T06:09:56.766 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.755+0000 7fe4a8d96640 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55661ddfa3d0 con 0x7fe49c00f3d0 2024-09-13T06:09:56.766 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.755+0000 7fe4a8d96640 1 -- 172.21.15.194:0/2390817269 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4980083f0 con 0x7fe49c00f3d0 2024-09-13T06:09:56.766 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.755+0000 7fe4a8d96640 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55661ddfa3d0 con 0x55661ddfb130 2024-09-13T06:09:56.766 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.755+0000 7fe4a8595640 1 -- 172.21.15.194:0/2390817269 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4a00cd060 con 0x55661ddfb130 2024-09-13T06:09:56.766 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.755+0000 7fe4a8595640 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55661ddfa3d0 con 0x7fe4a010c020 2024-09-13T06:09:56.766 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.755+0000 7fe4a7d94640 1 -- 172.21.15.194:0/2390817269 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe49c036040 con 0x7fe4a010c020 2024-09-13T06:09:56.766 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.755+0000 7fe4a7d94640 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55661ddfa3d0 con 0x55661ddf6770 2024-09-13T06:09:56.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.755+0000 7fe4a8d96640 1 -- 172.21.15.194:0/2390817269 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4980083f0 con 0x55661ddf6770 2024-09-13T06:09:56.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.755+0000 7fe4a8d96640 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55661ddfa3d0 con 0x7fe49c00f3d0 2024-09-13T06:09:56.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.759+0000 7fe4a8d96640 1 -- 172.21.15.194:0/2390817269 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4980083f0 con 0x7fe49c00f3d0 2024-09-13T06:09:56.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.759+0000 7fe4a8d96640 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55661ddfa3d0 con 0x55661ddfb130 2024-09-13T06:09:56.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.759+0000 7fe4a8595640 1 -- 172.21.15.194:0/2390817269 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe4a00cd060 con 0x55661ddfb130 2024-09-13T06:09:56.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.759+0000 7fe4a8595640 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55661ddfa3d0 con 0x7fe49c00f3d0 2024-09-13T06:09:56.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.759+0000 7fe4a8d96640 1 -- 172.21.15.194:0/2390817269 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4980083f0 con 0x7fe49c00f3d0 2024-09-13T06:09:56.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.759+0000 7fe4a8d96640 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55661ddfa3d0 con 0x7fe4a010c020 2024-09-13T06:09:56.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.759+0000 7fe4a7d94640 1 -- 172.21.15.194:0/2390817269 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe49c036040 con 0x7fe4a010c020 2024-09-13T06:09:56.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.759+0000 7fe4a7d94640 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55661ddfa3d0 con 0x55661ddfb130 2024-09-13T06:09:56.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.759+0000 7fe4a8595640 1 -- 172.21.15.194:0/2390817269 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4a00cd060 con 0x55661ddfb130 2024-09-13T06:09:56.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.759+0000 7fe4a8595640 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55661ddfa3d0 con 0x7fe49c00f3d0 2024-09-13T06:09:56.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.759+0000 7fe4a8d96640 1 -- 172.21.15.194:0/2390817269 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4980083f0 con 0x7fe49c00f3d0 2024-09-13T06:09:56.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.759+0000 7fe4a8d96640 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55661ddfa3d0 con 0x55661ddf6770 2024-09-13T06:09:56.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.759+0000 7fe4a8d96640 1 -- 172.21.15.194:0/2390817269 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe4980083f0 con 0x55661ddf6770 2024-09-13T06:09:56.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.759+0000 7fe4a8d96640 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55661ddfa3d0 con 0x7fe4a010c020 2024-09-13T06:09:56.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.759+0000 7fe4a7d94640 1 -- 172.21.15.194:0/2390817269 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe49c036040 con 0x7fe4a010c020 2024-09-13T06:09:56.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.759+0000 7fe4aaa85980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:09:56.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.759+0000 7fe4aaa85980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:09:56.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.759+0000 7fe4aaa85980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:09:56.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.759+0000 7fe4aaa85980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:09:56.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.759+0000 7fe4aaa85980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:09:56.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.759+0000 7fe4aaa85980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:09:56.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.759+0000 7fe4aaa85980 20 rados->read ofs=0 len=0 2024-09-13T06:09:56.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.759+0000 7fe4aaa85980 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55661ddfe2b0 con 0x55661ddf6770 2024-09-13T06:09:56.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.759+0000 7fe4a8d96640 1 -- 172.21.15.194:0/2390817269 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe4980083f0 con 0x55661ddf6770 2024-09-13T06:09:56.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.759+0000 7fe4aaa85980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:56.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.759+0000 7fe4aaa85980 20 rados->read ofs=0 len=0 2024-09-13T06:09:56.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.759+0000 7fe4aaa85980 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55661ddfe6a0 con 0x55661ddf6770 2024-09-13T06:09:56.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.759+0000 7fe4a8d96640 1 -- 172.21.15.194:0/2390817269 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe4980083f0 con 0x55661ddf6770 2024-09-13T06:09:56.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.759+0000 7fe4aaa85980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:56.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.759+0000 7fe4aaa85980 20 rados->read ofs=0 len=0 2024-09-13T06:09:56.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.759+0000 7fe4aaa85980 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55661ddfe6a0 con 0x7fe4a010c020 2024-09-13T06:09:56.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.759+0000 7fe4a7d94640 1 -- 172.21.15.194:0/2390817269 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe49c036040 con 0x7fe4a010c020 2024-09-13T06:09:56.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.759+0000 7fe4aaa85980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:09:56.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.759+0000 7fe4aaa85980 20 zone default found 2024-09-13T06:09:56.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.759+0000 7fe4aaa85980 4 Realm: () 2024-09-13T06:09:56.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.759+0000 7fe4aaa85980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:09:56.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.759+0000 7fe4aaa85980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:09:56.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.759+0000 7fe4aaa85980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:09:56.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.759+0000 7fe4aaa85980 20 zonegroup default 2024-09-13T06:09:56.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.759+0000 7fe4aaa85980 20 rados->read ofs=0 len=0 2024-09-13T06:09:56.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.759+0000 7fe4aaa85980 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55661ddff7d0 con 0x7fe49c00f3d0 2024-09-13T06:09:56.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.763+0000 7fe4a8d96640 1 -- 172.21.15.194:0/2390817269 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe4980083f0 con 0x7fe49c00f3d0 2024-09-13T06:09:56.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.763+0000 7fe4aaa85980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:56.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.763+0000 7fe4aaa85980 20 rados->read ofs=0 len=0 2024-09-13T06:09:56.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.763+0000 7fe4aaa85980 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55661de011b0 con 0x55661ddfb130 2024-09-13T06:09:56.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.763+0000 7fe4a8595640 1 -- 172.21.15.194:0/2390817269 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe4a00cd060 con 0x55661ddfb130 2024-09-13T06:09:56.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.763+0000 7fe4aaa85980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:56.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.763+0000 7fe4aaa85980 20 rados->read ofs=0 len=0 2024-09-13T06:09:56.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.763+0000 7fe4aaa85980 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55661de01550 con 0x55661ddfb130 2024-09-13T06:09:56.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.763+0000 7fe4a8595640 1 -- 172.21.15.194:0/2390817269 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe4a00cd060 con 0x55661ddfb130 2024-09-13T06:09:56.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.763+0000 7fe4aaa85980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:56.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.763+0000 7fe4aaa85980 20 started sync module instance, tier type = 2024-09-13T06:09:56.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.763+0000 7fe4aaa85980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:09:56.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.763+0000 7fe4aaa85980 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55661de00650 con 0x7fe4a010c020 2024-09-13T06:09:56.773 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.763+0000 7fe4a7d94640 1 -- 172.21.15.194:0/2390817269 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(44 notify.0 [create] v33'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe49c036040 con 0x7fe4a010c020 2024-09-13T06:09:56.773 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.763+0000 7fe4aaa85980 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93897076247152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55661de01df0 con 0x7fe4a010c020 2024-09-13T06:09:56.773 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.763+0000 7fe4aaa85980 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55661de02640 con 0x55661ddf6770 2024-09-13T06:09:56.773 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.763+0000 7fe4a7d94640 1 -- 172.21.15.194:0/2390817269 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93897076247152] v33'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe49c036040 con 0x7fe4a010c020 2024-09-13T06:09:56.773 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.767+0000 7fe4a8d96640 1 -- 172.21.15.194:0/2390817269 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v33'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4980083f0 con 0x55661ddf6770 2024-09-13T06:09:56.773 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.767+0000 7fe4aaa85980 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93897076250944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55661de02680 con 0x55661ddf6770 2024-09-13T06:09:56.773 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.767+0000 7fe4aaa85980 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55661de03190 con 0x55661ddfb130 2024-09-13T06:09:56.773 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.767+0000 7fe4a8d96640 1 -- 172.21.15.194:0/2390817269 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93897076250944] v33'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4980083f0 con 0x55661ddf6770 2024-09-13T06:09:56.774 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.767+0000 7fe4a8595640 1 -- 172.21.15.194:0/2390817269 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v33'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4a00cd060 con 0x55661ddfb130 2024-09-13T06:09:56.774 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.767+0000 7fe4aaa85980 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93897076255808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55661de03580 con 0x55661ddfb130 2024-09-13T06:09:56.774 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.767+0000 7fe4aaa85980 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55661de03f40 con 0x7fe4a010c020 2024-09-13T06:09:56.774 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.767+0000 7fe4a7d94640 1 -- 172.21.15.194:0/2390817269 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(50 notify.3 [create] v33'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe49c036040 con 0x7fe4a010c020 2024-09-13T06:09:56.774 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.767+0000 7fe4aaa85980 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93897076259744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55661de04630 con 0x7fe4a010c020 2024-09-13T06:09:56.774 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.767+0000 7fe4aaa85980 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55661de05150 con 0x55661ddf6770 2024-09-13T06:09:56.774 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.771+0000 7fe4a8595640 1 -- 172.21.15.194:0/2390817269 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93897076255808] v33'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4a00cd060 con 0x55661ddfb130 2024-09-13T06:09:56.774 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.771+0000 7fe4a7d94640 1 -- 172.21.15.194:0/2390817269 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93897076259744] v33'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe49c036040 con 0x7fe4a010c020 2024-09-13T06:09:56.774 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.771+0000 7fe4a8d96640 1 -- 172.21.15.194:0/2390817269 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v33'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4980083f0 con 0x55661ddf6770 2024-09-13T06:09:56.774 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.771+0000 7fe4aaa85980 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93897076263968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55661de05110 con 0x55661ddf6770 2024-09-13T06:09:56.774 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.771+0000 7fe4aaa85980 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55661de059f0 con 0x7fe49c00f3d0 2024-09-13T06:09:56.775 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.771+0000 7fe4a8d96640 1 -- 172.21.15.194:0/2390817269 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93897076263968] v33'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4980083f0 con 0x55661ddf6770 2024-09-13T06:09:56.775 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.771+0000 7fe4a8d96640 1 -- 172.21.15.194:0/2390817269 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(54 notify.5 [create] v33'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4980083f0 con 0x7fe49c00f3d0 2024-09-13T06:09:56.775 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.771+0000 7fe4aaa85980 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93897076253072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55661de055c0 con 0x7fe49c00f3d0 2024-09-13T06:09:56.775 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.771+0000 7fe4aaa85980 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55661de05eb0 con 0x7fe49c00f3d0 2024-09-13T06:09:56.777 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.775+0000 7fe4a8d96640 1 -- 172.21.15.194:0/2390817269 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(56 notify.6 [create] v33'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4980083f0 con 0x7fe49c00f3d0 2024-09-13T06:09:56.777 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.775+0000 7fe4aaa85980 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93897076266432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55661de06540 con 0x7fe49c00f3d0 2024-09-13T06:09:56.777 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.775+0000 7fe4aaa85980 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55661de06df0 con 0x7fe49c00f3d0 2024-09-13T06:09:56.777 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.775+0000 7fe4a8d96640 1 -- 172.21.15.194:0/2390817269 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93897076253072] v33'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4980083f0 con 0x7fe49c00f3d0 2024-09-13T06:09:56.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.779+0000 7fe4a8d96640 1 -- 172.21.15.194:0/2390817269 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(58 notify.7 [create] v33'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4980083f0 con 0x7fe49c00f3d0 2024-09-13T06:09:56.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.779+0000 7fe4aaa85980 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93897076265232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55661de06fd0 con 0x7fe49c00f3d0 2024-09-13T06:09:56.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.779+0000 7fe4aaa85980 20 add_watcher() i=0 2024-09-13T06:09:56.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.779+0000 7fe4aaa85980 20 add_watcher() i=1 2024-09-13T06:09:56.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.779+0000 7fe4aaa85980 20 add_watcher() i=2 2024-09-13T06:09:56.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.779+0000 7fe4aaa85980 20 add_watcher() i=3 2024-09-13T06:09:56.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.779+0000 7fe4aaa85980 20 add_watcher() i=4 2024-09-13T06:09:56.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.779+0000 7fe4aaa85980 20 add_watcher() i=5 2024-09-13T06:09:56.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.779+0000 7fe4a8d96640 1 -- 172.21.15.194:0/2390817269 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93897076266432] v33'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4980083f0 con 0x7fe49c00f3d0 2024-09-13T06:09:56.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.779+0000 7fe4aaa85980 20 add_watcher() i=6 2024-09-13T06:09:56.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.779+0000 7fe4a8d96640 1 -- 172.21.15.194:0/2390817269 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93897076265232] v33'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4980083f0 con 0x7fe49c00f3d0 2024-09-13T06:09:56.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.779+0000 7fe4aaa85980 20 add_watcher() i=7 2024-09-13T06:09:56.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.779+0000 7fe4aaa85980 2 all 8 watchers are set, enabling cache 2024-09-13T06:09:56.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.779+0000 7fe4aaa85980 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55661de09ef0 con 0x55661ddf6770 2024-09-13T06:09:56.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.779+0000 7fe4a8d96640 1 -- 172.21.15.194:0/2390817269 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe4980083f0 con 0x55661ddf6770 2024-09-13T06:09:56.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.779+0000 7fe4aaa85980 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93897076269376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55661de07370 con 0x55661ddf6770 2024-09-13T06:09:56.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.779+0000 7fe4a8d96640 1 -- 172.21.15.194:0/2390817269 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93897076269376] v33'90 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe4980083f0 con 0x55661ddf6770 2024-09-13T06:09:56.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.779+0000 7fe35e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:56.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.779+0000 7fe4aaa85980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:09:56.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.779+0000 7fe4aaa85980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:09:56.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.779+0000 7fe4aaa85980 5 note: GC not initialized 2024-09-13T06:09:56.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.779+0000 7fe35d7e2640 20 reqs_thread_entry: start 2024-09-13T06:09:56.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.779+0000 7fe4aaa85980 20 init_complete bucket index max shards: 11 2024-09-13T06:09:56.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.779+0000 7fe4aaa85980 20 Filter name: none 2024-09-13T06:09:56.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.779+0000 7fe2ceffd640 20 reqs_thread_entry: start 2024-09-13T06:09:56.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.783+0000 7fe4aaa85980 20 rados->read ofs=0 len=0 2024-09-13T06:09:56.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.783+0000 7fe4aaa85980 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55661de2ced0 con 0x55661ddf6770 2024-09-13T06:09:56.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.783+0000 7fe4a8d96640 1 -- 172.21.15.194:0/2390817269 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fe4980083f0 con 0x55661ddf6770 2024-09-13T06:09:56.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.783+0000 7fe4aaa85980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T06:09:56.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.783+0000 7fe4aaa85980 20 rados->read ofs=0 len=0 2024-09-13T06:09:56.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.783+0000 7fe4aaa85980 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55661de2d8c0 con 0x55661ddf6770 2024-09-13T06:09:56.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.783+0000 7fe4a8d96640 1 -- 172.21.15.194:0/2390817269 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fe4980083f0 con 0x55661ddf6770 2024-09-13T06:09:56.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.783+0000 7fe4aaa85980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T06:09:56.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.783+0000 7fe4aaa85980 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55661de2e8d0 con 0x7fe4a010c020 2024-09-13T06:09:56.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.783+0000 7fe4a7d94640 1 -- 172.21.15.194:0/2390817269 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7fe49c036040 con 0x7fe4a010c020 2024-09-13T06:09:56.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.783+0000 7fe35e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:56.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.783+0000 7fe4aaa85980 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93897076269376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55661de2ad60 con 0x55661ddf6770 2024-09-13T06:09:56.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.783+0000 7fe4a8d96640 1 -- 172.21.15.194:0/2390817269 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 93897076269376] v33'91 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe4980083f0 con 0x55661ddf6770 2024-09-13T06:09:56.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.783+0000 7fe4aaa85980 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93897076247152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55661de2ad60 con 0x7fe4a010c020 2024-09-13T06:09:56.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.783+0000 7fe4a7d94640 1 -- 172.21.15.194:0/2390817269 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 93897076247152] v33'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe49c036040 con 0x7fe4a010c020 2024-09-13T06:09:56.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.783+0000 7fe4aaa85980 20 remove_watcher() i=0 2024-09-13T06:09:56.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.783+0000 7fe4aaa85980 2 removed watcher, disabling cache 2024-09-13T06:09:56.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.783+0000 7fe4aaa85980 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93897076250944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55661de00a70 con 0x55661ddf6770 2024-09-13T06:09:56.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.787+0000 7fe4a8d96640 1 -- 172.21.15.194:0/2390817269 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 93897076250944] v33'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4980083f0 con 0x55661ddf6770 2024-09-13T06:09:56.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.787+0000 7fe4aaa85980 20 remove_watcher() i=1 2024-09-13T06:09:56.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.787+0000 7fe4aaa85980 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93897076255808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55661de2ad60 con 0x55661ddfb130 2024-09-13T06:09:56.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.787+0000 7fe4a8595640 1 -- 172.21.15.194:0/2390817269 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 93897076255808] v33'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4a00cd060 con 0x55661ddfb130 2024-09-13T06:09:56.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.787+0000 7fe4aaa85980 20 remove_watcher() i=2 2024-09-13T06:09:56.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.787+0000 7fe4aaa85980 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93897076259744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55661de01940 con 0x7fe4a010c020 2024-09-13T06:09:56.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.791+0000 7fe4a7d94640 1 -- 172.21.15.194:0/2390817269 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 93897076259744] v33'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe49c036040 con 0x7fe4a010c020 2024-09-13T06:09:56.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.791+0000 7fe4aaa85980 20 remove_watcher() i=3 2024-09-13T06:09:56.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.791+0000 7fe4aaa85980 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93897076263968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55661de00a70 con 0x55661ddf6770 2024-09-13T06:09:56.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.791+0000 7fe4a8d96640 1 -- 172.21.15.194:0/2390817269 <== osd.1 v2:172.21.15.194:6808/3135444559 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 93897076263968] v33'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4980083f0 con 0x55661ddf6770 2024-09-13T06:09:56.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.791+0000 7fe4aaa85980 20 remove_watcher() i=4 2024-09-13T06:09:56.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.791+0000 7fe4aaa85980 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93897076253072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55661de02c40 con 0x7fe49c00f3d0 2024-09-13T06:09:56.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.795+0000 7fe4a8d96640 1 -- 172.21.15.194:0/2390817269 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 93897076253072] v33'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4980083f0 con 0x7fe49c00f3d0 2024-09-13T06:09:56.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.795+0000 7fe4aaa85980 20 remove_watcher() i=5 2024-09-13T06:09:56.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.795+0000 7fe4aaa85980 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93897076266432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55661de2ad60 con 0x7fe49c00f3d0 2024-09-13T06:09:56.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.795+0000 7fe4a8d96640 1 -- 172.21.15.194:0/2390817269 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 93897076266432] v33'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4980083f0 con 0x7fe49c00f3d0 2024-09-13T06:09:56.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.795+0000 7fe4aaa85980 20 remove_watcher() i=6 2024-09-13T06:09:56.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.795+0000 7fe4aaa85980 1 -- 172.21.15.194:0/2390817269 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93897076265232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55661de03ba0 con 0x7fe49c00f3d0 2024-09-13T06:09:56.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.799+0000 7fe4a8d96640 1 -- 172.21.15.194:0/2390817269 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 93897076265232] v33'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4980083f0 con 0x7fe49c00f3d0 2024-09-13T06:09:56.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.799+0000 7fe4aaa85980 20 remove_watcher() i=7 2024-09-13T06:09:56.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.799+0000 7fe4aaa85980 1 -- 172.21.15.194:0/2390817269 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fe49c00f3d0 msgr2=0x7fe49c00f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.799+0000 7fe4aaa85980 1 --2- 172.21.15.194:0/2390817269 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fe49c00f3d0 0x7fe49c00f7f0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.799+0000 7fe4aaa85980 1 -- 172.21.15.194:0/2390817269 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55661ddf6770 msgr2=0x55661ddf8c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.799+0000 7fe4aaa85980 1 --2- 172.21.15.194:0/2390817269 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55661ddf6770 0x55661ddf8c30 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.799+0000 7fe4aaa85980 1 -- 172.21.15.194:0/2390817269 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fe4a010c020 msgr2=0x7fe4a00db880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.799+0000 7fe4aaa85980 1 --2- 172.21.15.194:0/2390817269 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fe4a010c020 0x7fe4a00db880 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.799+0000 7fe4aaa85980 1 -- 172.21.15.194:0/2390817269 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55661ddfb130 msgr2=0x55661ddfd520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.799+0000 7fe4aaa85980 1 --2- 172.21.15.194:0/2390817269 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55661ddfb130 0x55661ddfd520 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.799+0000 7fe4aaa85980 1 -- 172.21.15.194:0/2390817269 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fe378034600 msgr2=0x7fe378036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.799+0000 7fe4aaa85980 1 --2- 172.21.15.194:0/2390817269 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fe378034600 0x7fe378036ac0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x55661ddca640 tx=0x7fe49c011000 comp rx=0 tx=0).stop 2024-09-13T06:09:56.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.799+0000 7fe4aaa85980 1 -- 172.21.15.194:0/2390817269 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55661dde4510 msgr2=0x55661ddeb620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.799+0000 7fe4aaa85980 1 --2- 172.21.15.194:0/2390817269 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55661dde4510 0x55661ddeb620 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe4a00e2d10 tx=0x7fe4a0009e70 comp rx=0 tx=0).stop 2024-09-13T06:09:56.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.799+0000 7fe4a8d96640 1 -- 172.21.15.194:0/2390817269 reap_dead start 2024-09-13T06:09:56.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.799+0000 7fe4a8d96640 1 -- 172.21.15.194:0/2390817269 reap_dead start 2024-09-13T06:09:56.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.799+0000 7fe4aaa85980 1 -- 172.21.15.194:0/2390817269 shutdown_connections 2024-09-13T06:09:56.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.799+0000 7fe4aaa85980 1 -- 172.21.15.194:0/2390817269 >> 172.21.15.194:0/2390817269 conn(0x55661dde0890 msgr2=0x55661ddde960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:56.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.799+0000 7fe4aaa85980 1 -- 172.21.15.194:0/2390817269 shutdown_connections 2024-09-13T06:09:56.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.799+0000 7fe4aaa85980 1 -- 172.21.15.194:0/2390817269 wait complete. 2024-09-13T06:09:56.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.799+0000 7fe4aaa85980 1 -- 172.21.15.194:0/375650254 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fe380034650 msgr2=0x7fe380036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.799+0000 7fe4aaa85980 1 --2- 172.21.15.194:0/375650254 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fe380034650 0x7fe380036b10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x55661ddc1de0 tx=0x7fe49c006000 comp rx=0 tx=0).stop 2024-09-13T06:09:56.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.799+0000 7fe4aaa85980 1 -- 172.21.15.194:0/375650254 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55661ddd7d10 msgr2=0x55661ddd8130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.799+0000 7fe4aaa85980 1 --2- 172.21.15.194:0/375650254 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55661ddd7d10 0x55661ddd8130 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe4a00e2cb0 tx=0x7fe4a00e4790 comp rx=0 tx=0).stop 2024-09-13T06:09:56.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.799+0000 7fe4aaa85980 1 -- 172.21.15.194:0/375650254 shutdown_connections 2024-09-13T06:09:56.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.799+0000 7fe4aaa85980 1 --2- 172.21.15.194:0/375650254 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fe380034650 0x7fe380036b10 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.799+0000 7fe4aaa85980 1 --2- 172.21.15.194:0/375650254 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55661ddd7d10 0x55661ddd8130 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.799+0000 7fe4aaa85980 1 -- 172.21.15.194:0/375650254 >> 172.21.15.194:0/375650254 conn(0x55661ddcce60 msgr2=0x55661ddcf8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:56.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.799+0000 7fe4aaa85980 1 -- 172.21.15.194:0/375650254 shutdown_connections 2024-09-13T06:09:56.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.799+0000 7fe4aaa85980 1 -- 172.21.15.194:0/375650254 wait complete. 2024-09-13T06:09:56.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.799+0000 7fe4aaa85980 1 -- 172.21.15.194:0/60909560 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55661dccac70 msgr2=0x55661ddc0f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.799+0000 7fe4aaa85980 1 --2- 172.21.15.194:0/60909560 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55661dccac70 0x55661ddc0f30 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.799+0000 7fe4aaa85980 1 -- 172.21.15.194:0/60909560 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55661ddc7750 msgr2=0x55661ddc9b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.799+0000 7fe4aaa85980 1 --2- 172.21.15.194:0/60909560 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55661ddc7750 0x55661ddc9b40 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.799+0000 7fe4aaa85980 1 -- 172.21.15.194:0/60909560 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55661ddc3830 msgr2=0x55661ddc5c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.799+0000 7fe4aaa85980 1 --2- 172.21.15.194:0/60909560 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55661ddc3830 0x55661ddc5c20 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.799+0000 7fe4aaa85980 1 -- 172.21.15.194:0/60909560 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fe390034650 msgr2=0x7fe390036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.799+0000 7fe4aaa85980 1 --2- 172.21.15.194:0/60909560 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fe390034650 0x7fe390036b10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe49c000f70 tx=0x7fe49c001420 comp rx=0 tx=0).stop 2024-09-13T06:09:56.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.799+0000 7fe4aaa85980 1 -- 172.21.15.194:0/60909560 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55661dc39b00 msgr2=0x55661ddb9e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.799+0000 7fe4aaa85980 1 --2- 172.21.15.194:0/60909560 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55661dc39b00 0x55661ddb9e30 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe4a001aec0 tx=0x7fe4a0017e30 comp rx=0 tx=0).stop 2024-09-13T06:09:56.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.799+0000 7fe4a8d96640 1 -- 172.21.15.194:0/60909560 reap_dead start 2024-09-13T06:09:56.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.799+0000 7fe4aaa85980 1 -- 172.21.15.194:0/60909560 shutdown_connections 2024-09-13T06:09:56.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.799+0000 7fe4aaa85980 1 -- 172.21.15.194:0/60909560 >> 172.21.15.194:0/60909560 conn(0x55661dcc0060 msgr2=0x55661ddad360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:56.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.799+0000 7fe4aaa85980 1 -- 172.21.15.194:0/60909560 shutdown_connections 2024-09-13T06:09:56.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.799+0000 7fe4aaa85980 1 -- 172.21.15.194:0/60909560 wait complete. 2024-09-13T06:09:56.809 INFO:teuthology.orchestra.run.smithi194.stdout:[] 2024-09-13T06:09:56.809 DEBUG:tasks.util.rgw: json result: [] 2024-09-13T06:09:56.945 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T06:09:56.946 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-09-13T06:09:56.946 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-09-13T06:09:56.946 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-09-13T06:09:56.981 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:09:56.981 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:09:56.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.983+0000 7f0ccf705980 1 Processor -- start 2024-09-13T06:09:56.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.983+0000 7f0ccf705980 1 -- start start 2024-09-13T06:09:56.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.983+0000 7f0ccf705980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x5605db1e49f0 0x5605db1e4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:56.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.983+0000 7f0ccf705980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5605db0f2ae0 con 0x5605db1e1680 2024-09-13T06:09:56.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.983+0000 7f0ccf705980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x5605db116e30 con 0x5605db1e49f0 2024-09-13T06:09:56.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.983+0000 7f0ccca14640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x5605db1e49f0 0x5605db1e4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:56.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.983+0000 7f0ccd215640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x5605db1e1680 0x5605db1e1a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:51094/0 (socket says 172.21.15.194:51094) 2024-09-13T06:09:56.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.983+0000 7f0ccd215640 1 -- 172.21.15.194:0/3307375467 learned_addr learned my addr 172.21.15.194:0/3307375467 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-09-13T06:09:56.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.983+0000 7f0ccca14640 1 -- 172.21.15.194:0/3307375467 >> v1:172.21.15.120:6789/0 conn(0x5605db1e1680 legacy=0x5605db1e1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.983+0000 7f0ccca14640 1 -- 172.21.15.194:0/3307375467 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605db1e5340 con 0x5605db1e49f0 2024-09-13T06:09:56.986 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.983+0000 7f0ccca14640 1 --2- 172.21.15.194:0/3307375467 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5605db1e49f0 0x5605db1e4e00 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0cb800a480 tx=0x7f0cb801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c2104d427059870 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:56.986 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.983+0000 7f0cc7fff640 1 -- 172.21.15.194:0/3307375467 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cb80af070 con 0x5605db1e49f0 2024-09-13T06:09:56.986 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.987+0000 7f0cc7fff640 1 -- 172.21.15.194:0/3307375467 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cb80aa530 con 0x5605db1e49f0 2024-09-13T06:09:56.986 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.987+0000 7f0cc7fff640 1 -- 172.21.15.194:0/3307375467 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cb80aa830 con 0x5605db1e49f0 2024-09-13T06:09:56.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.987+0000 7f0ccf705980 1 -- 172.21.15.194:0/3307375467 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5605db1e49f0 msgr2=0x5605db1e4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:56.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.987+0000 7f0ccf705980 1 --2- 172.21.15.194:0/3307375467 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5605db1e49f0 0x5605db1e4e00 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0cb800a480 tx=0x7f0cb801b280 comp rx=0 tx=0).stop 2024-09-13T06:09:56.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.987+0000 7f0ccf705980 1 -- 172.21.15.194:0/3307375467 shutdown_connections 2024-09-13T06:09:56.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.987+0000 7f0ccf705980 1 --2- 172.21.15.194:0/3307375467 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5605db1e49f0 0x5605db1e4e00 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:56.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.987+0000 7f0ccf705980 1 -- 172.21.15.194:0/3307375467 >> 172.21.15.194:0/3307375467 conn(0x5605db1e0230 msgr2=0x5605db1e0640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:56.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.987+0000 7f0ccf705980 1 -- 172.21.15.194:0/3307375467 shutdown_connections 2024-09-13T06:09:56.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.987+0000 7f0ccf705980 1 -- 172.21.15.194:0/3307375467 wait complete. 2024-09-13T06:09:57.001 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.999+0000 7f0ccf705980 1 Processor -- start 2024-09-13T06:09:57.001 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.999+0000 7f0ccf705980 1 -- start start 2024-09-13T06:09:57.001 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.999+0000 7f0ccf705980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5605db1e1680 0x5605db35c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:57.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.999+0000 7f0ccf705980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5605db118200 con 0x5605db1e1680 2024-09-13T06:09:57.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.999+0000 7f0ccd215640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5605db1e1680 0x5605db35c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:57.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.999+0000 7f0ccd215640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5605db1e1680 0x5605db35c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45202/0 (socket says 172.21.15.194:45202) 2024-09-13T06:09:57.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:56.999+0000 7f0ccd215640 1 -- 172.21.15.194:0/3927428812 learned_addr learned my addr 172.21.15.194:0/3927428812 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:57.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.003+0000 7f0ccd215640 1 -- 172.21.15.194:0/3927428812 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605db35c940 con 0x5605db1e1680 2024-09-13T06:09:57.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.003+0000 7f0ccd215640 1 --2- 172.21.15.194:0/3927428812 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5605db1e1680 0x5605db35c370 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f0cc0001d90 tx=0x7f0cc0001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68f2103d34499c86 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:57.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.003+0000 7f0bbb606640 1 -- 172.21.15.194:0/3927428812 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cc0013030 con 0x5605db1e1680 2024-09-13T06:09:57.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.003+0000 7f0bbb606640 1 -- 172.21.15.194:0/3927428812 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cc000e690 con 0x5605db1e1680 2024-09-13T06:09:57.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.003+0000 7f0bbb606640 1 -- 172.21.15.194:0/3927428812 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cc000ea10 con 0x5605db1e1680 2024-09-13T06:09:57.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.003+0000 7f0ccf705980 1 -- 172.21.15.194:0/3927428812 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5605db1e1680 msgr2=0x5605db35c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:57.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.003+0000 7f0ccf705980 1 --2- 172.21.15.194:0/3927428812 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5605db1e1680 0x5605db35c370 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f0cc0001d90 tx=0x7f0cc0001e80 comp rx=0 tx=0).stop 2024-09-13T06:09:57.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.003+0000 7f0ccf705980 1 -- 172.21.15.194:0/3927428812 shutdown_connections 2024-09-13T06:09:57.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.003+0000 7f0ccf705980 1 --2- 172.21.15.194:0/3927428812 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5605db1e1680 0x5605db35c370 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:57.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.003+0000 7f0ccf705980 1 -- 172.21.15.194:0/3927428812 >> 172.21.15.194:0/3927428812 conn(0x5605db1e0230 msgr2=0x5605db357fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:57.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.003+0000 7f0ccf705980 1 -- 172.21.15.194:0/3927428812 shutdown_connections 2024-09-13T06:09:57.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.003+0000 7f0ccf705980 1 -- 172.21.15.194:0/3927428812 wait complete. 2024-09-13T06:09:57.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.003+0000 7f0ccf705980 1 Processor -- start 2024-09-13T06:09:57.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.003+0000 7f0ccf705980 1 -- start start 2024-09-13T06:09:57.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.003+0000 7f0ccf705980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5605db1e1680 0x5605db3636c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:57.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.003+0000 7f0ccf705980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5605db27a920 con 0x5605db1e1680 2024-09-13T06:09:57.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.003+0000 7f0ccd215640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5605db1e1680 0x5605db3636c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:57.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.003+0000 7f0ccd215640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5605db1e1680 0x5605db3636c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45218/0 (socket says 172.21.15.194:45218) 2024-09-13T06:09:57.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.003+0000 7f0ccd215640 1 -- 172.21.15.194:0/4099526676 learned_addr learned my addr 172.21.15.194:0/4099526676 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:57.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.003+0000 7f0ccd215640 1 -- 172.21.15.194:0/4099526676 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605db363c00 con 0x5605db1e1680 2024-09-13T06:09:57.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.003+0000 7f0ccd215640 1 --2- 172.21.15.194:0/4099526676 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5605db1e1680 0x5605db3636c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x5605db35d550 tx=0x7f0cc0000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:57.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.003+0000 7f0bb9e03640 1 -- 172.21.15.194:0/4099526676 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cc0027070 con 0x5605db1e1680 2024-09-13T06:09:57.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.003+0000 7f0ccf705980 1 -- 172.21.15.194:0/4099526676 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5605db363e90 con 0x5605db1e1680 2024-09-13T06:09:57.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.003+0000 7f0bb9e03640 1 -- 172.21.15.194:0/4099526676 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cc0019900 con 0x5605db1e1680 2024-09-13T06:09:57.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.003+0000 7f0bb9e03640 1 -- 172.21.15.194:0/4099526676 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cc0019c20 con 0x5605db1e1680 2024-09-13T06:09:57.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.003+0000 7f0ccf705980 1 -- 172.21.15.194:0/4099526676 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605db366b70 con 0x5605db1e1680 2024-09-13T06:09:57.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.007+0000 7f0bb9e03640 1 -- 172.21.15.194:0/4099526676 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0cc002a070 con 0x5605db1e1680 2024-09-13T06:09:57.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.007+0000 7f0bb9e03640 1 --2- 172.21.15.194:0/4099526676 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0bb4034650 0x7f0bb4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:57.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.007+0000 7f0bb9e03640 1 -- 172.21.15.194:0/4099526676 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f0cc001f070 con 0x5605db1e1680 2024-09-13T06:09:57.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.007+0000 7f0ccca14640 1 --2- 172.21.15.194:0/4099526676 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0bb4034650 0x7f0bb4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:57.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.007+0000 7f0ccf705980 1 --2- 172.21.15.194:0/4099526676 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5605db1e49f0 0x5605db36a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:57.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.007+0000 7f0ccf705980 1 -- 172.21.15.194:0/4099526676 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5605db36acf0 con 0x5605db1e49f0 2024-09-13T06:09:57.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.007+0000 7f0ccda16640 1 --2- 172.21.15.194:0/4099526676 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5605db1e49f0 0x5605db36a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:57.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.007+0000 7f0ccca14640 1 --2- 172.21.15.194:0/4099526676 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0bb4034650 0x7f0bb4036b10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0cb80ac000 tx=0x7f0cb80a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:57.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.007+0000 7f0ccda16640 1 --2- 172.21.15.194:0/4099526676 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5605db1e49f0 0x5605db36a6b0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:57.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.007+0000 7f0ccda16640 1 -- 172.21.15.194:0/4099526676 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0cc800a4d0 con 0x5605db1e49f0 2024-09-13T06:09:57.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.007+0000 7f0ccf705980 1 -- 172.21.15.194:0/4099526676 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5605db367d90 con 0x5605db1e49f0 2024-09-13T06:09:57.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.007+0000 7f0ccda16640 1 -- 172.21.15.194:0/4099526676 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0cc800a4d0 con 0x5605db1e49f0 2024-09-13T06:09:57.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.007+0000 7f0ccf705980 1 --2- 172.21.15.194:0/4099526676 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5605db36d020 0x5605db36f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:57.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.007+0000 7f0ccf705980 1 -- 172.21.15.194:0/4099526676 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5605db36fae0 con 0x5605db36d020 2024-09-13T06:09:57.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.007+0000 7f0ccd215640 1 --2- 172.21.15.194:0/4099526676 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5605db36d020 0x5605db36f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:57.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.007+0000 7f0ccd215640 1 --2- 172.21.15.194:0/4099526676 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5605db36d020 0x5605db36f410 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:57.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.007+0000 7f0ccd215640 1 -- 172.21.15.194:0/4099526676 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0cc0029030 con 0x5605db36d020 2024-09-13T06:09:57.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.007+0000 7f0ccf705980 1 -- 172.21.15.194:0/4099526676 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5605db36bec0 con 0x5605db1e49f0 2024-09-13T06:09:57.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.007+0000 7f0ccda16640 1 -- 172.21.15.194:0/4099526676 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0cc800a4d0 con 0x5605db1e49f0 2024-09-13T06:09:57.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.007+0000 7f0ccf705980 1 --2- 172.21.15.194:0/4099526676 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5605db370f20 0x5605db373310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:57.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.007+0000 7f0ccf705980 1 -- 172.21.15.194:0/4099526676 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5605db373a50 con 0x5605db370f20 2024-09-13T06:09:57.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.007+0000 7f0ccca14640 1 --2- 172.21.15.194:0/4099526676 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5605db370f20 0x5605db373310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:57.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.011+0000 7f0ccca14640 1 --2- 172.21.15.194:0/4099526676 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5605db370f20 0x5605db373310 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:57.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.011+0000 7f0ccca14640 1 -- 172.21.15.194:0/4099526676 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0cb80b2040 con 0x5605db370f20 2024-09-13T06:09:57.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.011+0000 7f0ccf705980 1 Processor -- start 2024-09-13T06:09:57.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.011+0000 7f0ccf705980 1 -- start start 2024-09-13T06:09:57.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.011+0000 7f0ccf705980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5605db3814e0 0x5605db381900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:57.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.011+0000 7f0ccf705980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5605db171800 con 0x5605db3814e0 2024-09-13T06:09:57.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.011+0000 7f0ccd215640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5605db3814e0 0x5605db381900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:57.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.011+0000 7f0ccd215640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5605db3814e0 0x5605db381900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45228/0 (socket says 172.21.15.194:45228) 2024-09-13T06:09:57.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.011+0000 7f0ccd215640 1 -- 172.21.15.194:0/713998925 learned_addr learned my addr 172.21.15.194:0/713998925 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:57.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.011+0000 7f0ccd215640 1 -- 172.21.15.194:0/713998925 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605db381e40 con 0x5605db3814e0 2024-09-13T06:09:57.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.011+0000 7f0ccd215640 1 --2- 172.21.15.194:0/713998925 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5605db3814e0 0x5605db381900 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f0cc000bc00 tx=0x7f0cc0048670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:57.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.011+0000 7f0bb2ffd640 1 -- 172.21.15.194:0/713998925 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cc0048c10 con 0x5605db3814e0 2024-09-13T06:09:57.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.011+0000 7f0bb2ffd640 1 -- 172.21.15.194:0/713998925 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cc0048db0 con 0x5605db3814e0 2024-09-13T06:09:57.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.011+0000 7f0ccf705980 1 -- 172.21.15.194:0/713998925 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5605db382070 con 0x5605db3814e0 2024-09-13T06:09:57.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.011+0000 7f0bb2ffd640 1 -- 172.21.15.194:0/713998925 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cc002a6b0 con 0x5605db3814e0 2024-09-13T06:09:57.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.011+0000 7f0ccf705980 1 -- 172.21.15.194:0/713998925 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605db384c90 con 0x5605db3814e0 2024-09-13T06:09:57.017 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.011+0000 7f0bb2ffd640 1 -- 172.21.15.194:0/713998925 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0cc0016070 con 0x5605db3814e0 2024-09-13T06:09:57.017 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.011+0000 7f0bb2ffd640 1 --2- 172.21.15.194:0/713998925 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0ba4034650 0x7f0ba4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:57.017 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.011+0000 7f0bb2ffd640 1 -- 172.21.15.194:0/713998925 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f0cc0014070 con 0x5605db3814e0 2024-09-13T06:09:57.017 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.015+0000 7f0ccca14640 1 --2- 172.21.15.194:0/713998925 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0ba4034650 0x7f0ba4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:57.017 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.015+0000 7f0ccf705980 1 Processor -- start 2024-09-13T06:09:57.017 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.015+0000 7f0ccf705980 1 -- start start 2024-09-13T06:09:57.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.015+0000 7f0ccca14640 1 --2- 172.21.15.194:0/713998925 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0ba4034650 0x7f0ba4036b10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0cb8018eb0 tx=0x7f0cb8005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:57.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.015+0000 7f0ccf705980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5605db38de20 0x5605db38e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:57.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.015+0000 7f0ccf705980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5605db35ccc0 con 0x5605db38de20 2024-09-13T06:09:57.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.015+0000 7f0ccd215640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5605db38de20 0x5605db38e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:57.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.015+0000 7f0ccd215640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5605db38de20 0x5605db38e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45236/0 (socket says 172.21.15.194:45236) 2024-09-13T06:09:57.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.015+0000 7f0ccd215640 1 -- 172.21.15.194:0/265584498 learned_addr learned my addr 172.21.15.194:0/265584498 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:57.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.015+0000 7f0ccd215640 1 -- 172.21.15.194:0/265584498 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605db38e7d0 con 0x5605db38de20 2024-09-13T06:09:57.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.015+0000 7f0ccd215640 1 --2- 172.21.15.194:0/265584498 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5605db38de20 0x5605db38e200 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f0cc0003fd0 tx=0x7f0cc00225f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6037b8fa53f91fe server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:57.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.015+0000 7f0bb0ff9640 1 -- 172.21.15.194:0/265584498 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cc0060070 con 0x5605db38de20 2024-09-13T06:09:57.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.015+0000 7f0bb0ff9640 1 -- 172.21.15.194:0/265584498 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cc0041530 con 0x5605db38de20 2024-09-13T06:09:57.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.015+0000 7f0bb0ff9640 1 -- 172.21.15.194:0/265584498 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cc0030c40 con 0x5605db38de20 2024-09-13T06:09:57.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.015+0000 7f0ccf705980 1 -- 172.21.15.194:0/265584498 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5605db38de20 msgr2=0x5605db38e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:57.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.015+0000 7f0ccf705980 1 --2- 172.21.15.194:0/265584498 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5605db38de20 0x5605db38e200 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f0cc0003fd0 tx=0x7f0cc00225f0 comp rx=0 tx=0).stop 2024-09-13T06:09:57.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.015+0000 7f0ccf705980 1 -- 172.21.15.194:0/265584498 shutdown_connections 2024-09-13T06:09:57.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.015+0000 7f0ccf705980 1 --2- 172.21.15.194:0/265584498 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5605db38de20 0x5605db38e200 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:57.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.015+0000 7f0ccf705980 1 -- 172.21.15.194:0/265584498 >> 172.21.15.194:0/265584498 conn(0x5605db38a200 msgr2=0x5605db388300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:57.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.015+0000 7f0ccf705980 1 -- 172.21.15.194:0/265584498 shutdown_connections 2024-09-13T06:09:57.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.015+0000 7f0ccf705980 1 -- 172.21.15.194:0/265584498 wait complete. 2024-09-13T06:09:57.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.015+0000 7f0ccf705980 1 Processor -- start 2024-09-13T06:09:57.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.015+0000 7f0ccf705980 1 -- start start 2024-09-13T06:09:57.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.015+0000 7f0ccf705980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5605db38de20 0x5605db3950e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:57.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.015+0000 7f0ccf705980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5605db38ec70 con 0x5605db38de20 2024-09-13T06:09:57.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.015+0000 7f0ccd215640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5605db38de20 0x5605db3950e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:57.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.015+0000 7f0ccd215640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5605db38de20 0x5605db3950e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45238/0 (socket says 172.21.15.194:45238) 2024-09-13T06:09:57.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.015+0000 7f0ccd215640 1 -- 172.21.15.194:0/1438997693 learned_addr learned my addr 172.21.15.194:0/1438997693 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:57.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.015+0000 7f0ccd215640 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605db395620 con 0x5605db38de20 2024-09-13T06:09:57.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.019+0000 7f0ccd215640 1 --2- 172.21.15.194:0/1438997693 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5605db38de20 0x5605db3950e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f0cc0047280 tx=0x7f0cc001ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:57.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.019+0000 7f0ba2ffd640 1 -- 172.21.15.194:0/1438997693 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cc006b020 con 0x5605db38de20 2024-09-13T06:09:57.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.019+0000 7f0ba2ffd640 1 -- 172.21.15.194:0/1438997693 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cc0061040 con 0x5605db38de20 2024-09-13T06:09:57.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.019+0000 7f0ccf705980 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5605db395620 con 0x5605db38de20 2024-09-13T06:09:57.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.019+0000 7f0ba2ffd640 1 -- 172.21.15.194:0/1438997693 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cc0060070 con 0x5605db38de20 2024-09-13T06:09:57.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.019+0000 7f0ccf705980 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605db395a90 con 0x5605db38de20 2024-09-13T06:09:57.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.019+0000 7f0ccf705980 20 rados->read ofs=0 len=0 2024-09-13T06:09:57.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.019+0000 7f0ba2ffd640 1 -- 172.21.15.194:0/1438997693 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0cc006e020 con 0x5605db38de20 2024-09-13T06:09:57.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.019+0000 7f0ba2ffd640 1 --2- 172.21.15.194:0/1438997693 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0b98034650 0x7f0b98036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:57.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.019+0000 7f0ba2ffd640 1 -- 172.21.15.194:0/1438997693 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f0cc0005050 con 0x5605db38de20 2024-09-13T06:09:57.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.019+0000 7f0ccca14640 1 --2- 172.21.15.194:0/1438997693 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0b98034650 0x7f0b98036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:57.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.019+0000 7f0ccf705980 1 --2- 172.21.15.194:0/1438997693 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5605db3a0160 0x5605db3a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:57.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.019+0000 7f0ccf705980 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5605db3a2d50 con 0x5605db3a0160 2024-09-13T06:09:57.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.019+0000 7f0ccda16640 1 --2- 172.21.15.194:0/1438997693 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5605db3a0160 0x5605db3a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:57.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.019+0000 7f0ccca14640 1 --2- 172.21.15.194:0/1438997693 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0b98034650 0x7f0b98036b10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x5605db373e50 tx=0x7f0cb80b8040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:57.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.019+0000 7f0ccda16640 1 --2- 172.21.15.194:0/1438997693 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5605db3a0160 0x5605db3a2600 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:57.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.019+0000 7f0ccda16640 1 -- 172.21.15.194:0/1438997693 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0cc800a4d0 con 0x5605db3a0160 2024-09-13T06:09:57.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.019+0000 7f0ccf705980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:57.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.019+0000 7f0ccf705980 20 realm 2024-09-13T06:09:57.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.019+0000 7f0ccf705980 20 rados->read ofs=0 len=0 2024-09-13T06:09:57.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.019+0000 7f0ccf705980 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5605db3a3160 con 0x5605db3a0160 2024-09-13T06:09:57.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.019+0000 7f0ccda16640 1 -- 172.21.15.194:0/1438997693 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0cc800a4d0 con 0x5605db3a0160 2024-09-13T06:09:57.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.019+0000 7f0ccf705980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:57.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.019+0000 7f0ccf705980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:09:57.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.019+0000 7f0ccf705980 20 rados->read ofs=0 len=0 2024-09-13T06:09:57.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.019+0000 7f0ccf705980 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5605db3a3a00 con 0x5605db3a0160 2024-09-13T06:09:57.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.019+0000 7f0ccda16640 1 -- 172.21.15.194:0/1438997693 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0cc800a4d0 con 0x5605db3a0160 2024-09-13T06:09:57.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.019+0000 7f0ccf705980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:57.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.019+0000 7f0ccf705980 20 rados->read ofs=0 len=0 2024-09-13T06:09:57.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.019+0000 7f0ccf705980 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5605db3a3da0 con 0x5605db3a0160 2024-09-13T06:09:57.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.019+0000 7f0ccda16640 1 -- 172.21.15.194:0/1438997693 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0cc800a4d0 con 0x5605db3a0160 2024-09-13T06:09:57.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.019+0000 7f0ccf705980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:57.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.019+0000 7f0ccf705980 20 rados->read ofs=0 len=0 2024-09-13T06:09:57.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.019+0000 7f0ccf705980 1 --2- 172.21.15.194:0/1438997693 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5605db3a4b00 0x5605db3a6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:57.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.019+0000 7f0ccf705980 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5605db3a7470 con 0x5605db3a4b00 2024-09-13T06:09:57.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.019+0000 7f0ccd215640 1 --2- 172.21.15.194:0/1438997693 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5605db3a4b00 0x5605db3a6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:57.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.023+0000 7f0ccd215640 1 --2- 172.21.15.194:0/1438997693 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5605db3a4b00 0x5605db3a6ef0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:57.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.023+0000 7f0ccd215640 1 -- 172.21.15.194:0/1438997693 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0cc003d070 con 0x5605db3a4b00 2024-09-13T06:09:57.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.023+0000 7f0ccf705980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:09:57.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.023+0000 7f0ccf705980 20 searching for the correct realm 2024-09-13T06:09:57.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.023+0000 7f0ccf705980 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5605db3a8cd0 con 0x5605db3a4b00 2024-09-13T06:09:57.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.023+0000 7f0ccd215640 1 -- 172.21.15.194:0/1438997693 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cc003d070 con 0x5605db3a4b00 2024-09-13T06:09:57.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.023+0000 7f0ccd215640 1 --2- 172.21.15.194:0/1438997693 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f0cc0070020 0x7f0cc002c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:57.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.023+0000 7f0ccd215640 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5605db3a8cd0 con 0x7f0cc0070020 2024-09-13T06:09:57.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.023+0000 7f0ccca14640 1 --2- 172.21.15.194:0/1438997693 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f0cc0070020 0x7f0cc002c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:57.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.023+0000 7f0ccca14640 1 --2- 172.21.15.194:0/1438997693 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f0cc0070020 0x7f0cc002c6d0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:57.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.023+0000 7f0ccca14640 1 -- 172.21.15.194:0/1438997693 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0cb80d7070 con 0x7f0cc0070020 2024-09-13T06:09:57.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.023+0000 7f0ccca14640 1 --2- 172.21.15.194:0/1438997693 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f0cb80cc040 0x7f0cb80b6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:57.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.023+0000 7f0ccca14640 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5605db3a8cd0 con 0x7f0cb80cc040 2024-09-13T06:09:57.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.023+0000 7f0ccda16640 1 --2- 172.21.15.194:0/1438997693 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f0cb80cc040 0x7f0cb80b6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:57.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.023+0000 7f0ccda16640 1 --2- 172.21.15.194:0/1438997693 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f0cb80cc040 0x7f0cb80b6420 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:57.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.023+0000 7f0ccda16640 1 -- 172.21.15.194:0/1438997693 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cc800a4d0 con 0x7f0cb80cc040 2024-09-13T06:09:57.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.023+0000 7f0ccda16640 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5605db3a3da0 con 0x5605db3a0160 2024-09-13T06:09:57.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.023+0000 7f0ccda16640 1 -- 172.21.15.194:0/1438997693 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cc800a4d0 con 0x5605db3a0160 2024-09-13T06:09:57.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.023+0000 7f0ccda16640 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5605db3a3da0 con 0x5605db3a0160 2024-09-13T06:09:57.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.023+0000 7f0ccda16640 1 -- 172.21.15.194:0/1438997693 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cc800a4d0 con 0x5605db3a0160 2024-09-13T06:09:57.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.023+0000 7f0ccda16640 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5605db3a3da0 con 0x7f0cb80cc040 2024-09-13T06:09:57.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.027+0000 7f0ccda16640 1 -- 172.21.15.194:0/1438997693 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cc800a4d0 con 0x7f0cb80cc040 2024-09-13T06:09:57.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.027+0000 7f0ccda16640 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5605db3a3da0 con 0x7f0cb80cc040 2024-09-13T06:09:57.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.027+0000 7f0ccda16640 1 -- 172.21.15.194:0/1438997693 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cc800a4d0 con 0x7f0cb80cc040 2024-09-13T06:09:57.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.027+0000 7f0ccda16640 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5605db3a3da0 con 0x7f0cc0070020 2024-09-13T06:09:57.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.027+0000 7f0ccca14640 1 -- 172.21.15.194:0/1438997693 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cb80d7070 con 0x7f0cc0070020 2024-09-13T06:09:57.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.027+0000 7f0ccca14640 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5605db3a3da0 con 0x5605db3a4b00 2024-09-13T06:09:57.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.027+0000 7f0ccd215640 1 -- 172.21.15.194:0/1438997693 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cc003d070 con 0x5605db3a4b00 2024-09-13T06:09:57.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.027+0000 7f0ccd215640 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5605db3a3da0 con 0x5605db3a0160 2024-09-13T06:09:57.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.027+0000 7f0ccda16640 1 -- 172.21.15.194:0/1438997693 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cc800a4d0 con 0x5605db3a0160 2024-09-13T06:09:57.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.027+0000 7f0ccda16640 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5605db3a3da0 con 0x7f0cb80cc040 2024-09-13T06:09:57.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.027+0000 7f0ccda16640 1 -- 172.21.15.194:0/1438997693 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cc800a4d0 con 0x7f0cb80cc040 2024-09-13T06:09:57.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.027+0000 7f0ccda16640 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5605db3a3da0 con 0x5605db3a0160 2024-09-13T06:09:57.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.027+0000 7f0ccda16640 1 -- 172.21.15.194:0/1438997693 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cc800a4d0 con 0x5605db3a0160 2024-09-13T06:09:57.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.027+0000 7f0ccda16640 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5605db3a3da0 con 0x7f0cc0070020 2024-09-13T06:09:57.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.027+0000 7f0ccca14640 1 -- 172.21.15.194:0/1438997693 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0cb80d7070 con 0x7f0cc0070020 2024-09-13T06:09:57.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.027+0000 7f0ccca14640 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5605db3a3da0 con 0x5605db3a4b00 2024-09-13T06:09:57.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.027+0000 7f0ccd215640 1 -- 172.21.15.194:0/1438997693 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cc003d070 con 0x5605db3a4b00 2024-09-13T06:09:57.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.027+0000 7f0ccd215640 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5605db3a3da0 con 0x5605db3a4b00 2024-09-13T06:09:57.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.027+0000 7f0ccd215640 1 -- 172.21.15.194:0/1438997693 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cc003d070 con 0x5605db3a4b00 2024-09-13T06:09:57.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.027+0000 7f0ccd215640 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5605db3a3da0 con 0x7f0cb80cc040 2024-09-13T06:09:57.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.031+0000 7f0ccda16640 1 -- 172.21.15.194:0/1438997693 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cc800a4d0 con 0x7f0cb80cc040 2024-09-13T06:09:57.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.031+0000 7f0ccda16640 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5605db3a3da0 con 0x5605db3a4b00 2024-09-13T06:09:57.034 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.031+0000 7f0ccd215640 1 -- 172.21.15.194:0/1438997693 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cc003d070 con 0x5605db3a4b00 2024-09-13T06:09:57.034 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.031+0000 7f0ccd215640 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5605db3a3da0 con 0x5605db3a4b00 2024-09-13T06:09:57.034 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.031+0000 7f0ccd215640 1 -- 172.21.15.194:0/1438997693 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cc003d070 con 0x5605db3a4b00 2024-09-13T06:09:57.034 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.031+0000 7f0ccd215640 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5605db3a3da0 con 0x5605db3a0160 2024-09-13T06:09:57.034 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.031+0000 7f0ccda16640 1 -- 172.21.15.194:0/1438997693 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cc800a4d0 con 0x5605db3a0160 2024-09-13T06:09:57.034 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.031+0000 7f0ccda16640 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5605db3a3da0 con 0x5605db3a0160 2024-09-13T06:09:57.034 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.031+0000 7f0ccda16640 1 -- 172.21.15.194:0/1438997693 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0cc800a4d0 con 0x5605db3a0160 2024-09-13T06:09:57.034 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.031+0000 7f0ccda16640 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5605db3a3da0 con 0x7f0cb80cc040 2024-09-13T06:09:57.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.031+0000 7f0ccda16640 1 -- 172.21.15.194:0/1438997693 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cc800a4d0 con 0x7f0cb80cc040 2024-09-13T06:09:57.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.031+0000 7f0ccda16640 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5605db3a3da0 con 0x5605db3a4b00 2024-09-13T06:09:57.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.031+0000 7f0ccd215640 1 -- 172.21.15.194:0/1438997693 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cc003d070 con 0x5605db3a4b00 2024-09-13T06:09:57.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.031+0000 7f0ccd215640 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5605db3a3da0 con 0x7f0cc0070020 2024-09-13T06:09:57.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.031+0000 7f0ccca14640 1 -- 172.21.15.194:0/1438997693 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cb80d7070 con 0x7f0cc0070020 2024-09-13T06:09:57.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.031+0000 7f0ccca14640 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5605db3a3da0 con 0x5605db3a0160 2024-09-13T06:09:57.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.031+0000 7f0ccda16640 1 -- 172.21.15.194:0/1438997693 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cc800a4d0 con 0x5605db3a0160 2024-09-13T06:09:57.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.031+0000 7f0ccda16640 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5605db3a3da0 con 0x7f0cb80cc040 2024-09-13T06:09:57.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.031+0000 7f0ccda16640 1 -- 172.21.15.194:0/1438997693 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cc800a4d0 con 0x7f0cb80cc040 2024-09-13T06:09:57.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.031+0000 7f0ccda16640 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5605db3a3da0 con 0x5605db3a4b00 2024-09-13T06:09:57.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.031+0000 7f0ccd215640 1 -- 172.21.15.194:0/1438997693 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0cc003d070 con 0x5605db3a4b00 2024-09-13T06:09:57.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.031+0000 7f0ccd215640 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5605db3a3da0 con 0x7f0cb80cc040 2024-09-13T06:09:57.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.035+0000 7f0ccda16640 1 -- 172.21.15.194:0/1438997693 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cc800a4d0 con 0x7f0cb80cc040 2024-09-13T06:09:57.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.035+0000 7f0ccda16640 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5605db3a3da0 con 0x7f0cc0070020 2024-09-13T06:09:57.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.035+0000 7f0ccca14640 1 -- 172.21.15.194:0/1438997693 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cb80d7070 con 0x7f0cc0070020 2024-09-13T06:09:57.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.035+0000 7f0ccca14640 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5605db3a3da0 con 0x5605db3a4b00 2024-09-13T06:09:57.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.035+0000 7f0ccd215640 1 -- 172.21.15.194:0/1438997693 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cc003d070 con 0x5605db3a4b00 2024-09-13T06:09:57.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.035+0000 7f0ccd215640 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5605db3a3da0 con 0x7f0cb80cc040 2024-09-13T06:09:57.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.035+0000 7f0ccda16640 1 -- 172.21.15.194:0/1438997693 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cc800a4d0 con 0x7f0cb80cc040 2024-09-13T06:09:57.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.035+0000 7f0ccda16640 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5605db3a3da0 con 0x5605db3a0160 2024-09-13T06:09:57.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.035+0000 7f0ccda16640 1 -- 172.21.15.194:0/1438997693 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0cc800a4d0 con 0x5605db3a0160 2024-09-13T06:09:57.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.035+0000 7f0ccda16640 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5605db3a3da0 con 0x7f0cc0070020 2024-09-13T06:09:57.041 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.035+0000 7f0ccca14640 1 -- 172.21.15.194:0/1438997693 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cb80d7070 con 0x7f0cc0070020 2024-09-13T06:09:57.041 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.035+0000 7f0ccf705980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:09:57.041 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.035+0000 7f0ccf705980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:09:57.041 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.035+0000 7f0ccf705980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:09:57.041 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.035+0000 7f0ccf705980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:09:57.041 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.035+0000 7f0ccf705980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:09:57.041 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.035+0000 7f0ccf705980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:09:57.041 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.035+0000 7f0ccf705980 20 rados->read ofs=0 len=0 2024-09-13T06:09:57.041 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.035+0000 7f0ccf705980 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5605db3a7d80 con 0x5605db3a0160 2024-09-13T06:09:57.041 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.035+0000 7f0ccda16640 1 -- 172.21.15.194:0/1438997693 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0cc800a4d0 con 0x5605db3a0160 2024-09-13T06:09:57.041 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.035+0000 7f0ccf705980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:57.041 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.035+0000 7f0ccf705980 20 rados->read ofs=0 len=0 2024-09-13T06:09:57.041 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.035+0000 7f0ccf705980 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5605db3a8620 con 0x5605db3a0160 2024-09-13T06:09:57.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.035+0000 7f0ccda16640 1 -- 172.21.15.194:0/1438997693 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0cc800a4d0 con 0x5605db3a0160 2024-09-13T06:09:57.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.035+0000 7f0ccf705980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:57.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.035+0000 7f0ccf705980 20 rados->read ofs=0 len=0 2024-09-13T06:09:57.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.035+0000 7f0ccf705980 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5605db3a79c0 con 0x7f0cc0070020 2024-09-13T06:09:57.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.035+0000 7f0ccca14640 1 -- 172.21.15.194:0/1438997693 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0cb80d7070 con 0x7f0cc0070020 2024-09-13T06:09:57.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.035+0000 7f0ccf705980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:09:57.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.035+0000 7f0ccf705980 20 zone default found 2024-09-13T06:09:57.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.035+0000 7f0ccf705980 4 Realm: () 2024-09-13T06:09:57.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.035+0000 7f0ccf705980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:09:57.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.035+0000 7f0ccf705980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:09:57.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.035+0000 7f0ccf705980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:09:57.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.035+0000 7f0ccf705980 20 zonegroup default 2024-09-13T06:09:57.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.035+0000 7f0ccf705980 20 rados->read ofs=0 len=0 2024-09-13T06:09:57.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.035+0000 7f0ccf705980 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5605db3a8620 con 0x7f0cb80cc040 2024-09-13T06:09:57.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.035+0000 7f0ccda16640 1 -- 172.21.15.194:0/1438997693 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0cc800a4d0 con 0x7f0cb80cc040 2024-09-13T06:09:57.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.035+0000 7f0ccf705980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:57.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.035+0000 7f0ccf705980 20 rados->read ofs=0 len=0 2024-09-13T06:09:57.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.035+0000 7f0ccf705980 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5605db3aab80 con 0x5605db3a4b00 2024-09-13T06:09:57.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.035+0000 7f0ccd215640 1 -- 172.21.15.194:0/1438997693 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0cc003d070 con 0x5605db3a4b00 2024-09-13T06:09:57.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.035+0000 7f0ccf705980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:57.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.035+0000 7f0ccf705980 20 rados->read ofs=0 len=0 2024-09-13T06:09:57.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.039+0000 7f0ccf705980 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5605db3aaf20 con 0x5605db3a4b00 2024-09-13T06:09:57.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.039+0000 7f0ccd215640 1 -- 172.21.15.194:0/1438997693 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0cc003d070 con 0x5605db3a4b00 2024-09-13T06:09:57.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.039+0000 7f0ccf705980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:57.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.039+0000 7f0ccf705980 20 started sync module instance, tier type = 2024-09-13T06:09:57.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.039+0000 7f0ccf705980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:09:57.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.039+0000 7f0ccf705980 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5605db3aa020 con 0x7f0cc0070020 2024-09-13T06:09:57.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.039+0000 7f0ccca14640 1 -- 172.21.15.194:0/1438997693 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(44 notify.0 [create] v33'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cb80d7070 con 0x7f0cc0070020 2024-09-13T06:09:57.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.039+0000 7f0ccf705980 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94583152878656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5605db3ab3d0 con 0x7f0cc0070020 2024-09-13T06:09:57.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.039+0000 7f0ccf705980 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5605db3abc20 con 0x5605db3a0160 2024-09-13T06:09:57.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.039+0000 7f0ccca14640 1 -- 172.21.15.194:0/1438997693 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94583152878656] v33'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cb80d7070 con 0x7f0cc0070020 2024-09-13T06:09:57.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.039+0000 7f0ccda16640 1 -- 172.21.15.194:0/1438997693 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v33'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cc800a4d0 con 0x5605db3a0160 2024-09-13T06:09:57.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.039+0000 7f0ccf705980 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94583152881440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5605db3abc20 con 0x5605db3a0160 2024-09-13T06:09:57.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.039+0000 7f0ccf705980 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5605db3ac6a0 con 0x5605db3a4b00 2024-09-13T06:09:57.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.043+0000 7f0ccda16640 1 -- 172.21.15.194:0/1438997693 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94583152881440] v33'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cc800a4d0 con 0x5605db3a0160 2024-09-13T06:09:57.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.043+0000 7f0ccd215640 1 -- 172.21.15.194:0/1438997693 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v33'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cc003d070 con 0x5605db3a4b00 2024-09-13T06:09:57.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.043+0000 7f0ccf705980 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94583152886160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5605db3abc20 con 0x5605db3a4b00 2024-09-13T06:09:57.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.043+0000 7f0ccf705980 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5605db3ad0e0 con 0x7f0cc0070020 2024-09-13T06:09:57.047 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.043+0000 7f0ccca14640 1 -- 172.21.15.194:0/1438997693 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(50 notify.3 [create] v33'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cb80d7070 con 0x7f0cc0070020 2024-09-13T06:09:57.047 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.043+0000 7f0ccf705980 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94583152888880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5605db3ad930 con 0x7f0cc0070020 2024-09-13T06:09:57.047 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.043+0000 7f0ccf705980 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5605db3ae350 con 0x5605db3a0160 2024-09-13T06:09:57.047 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.043+0000 7f0ccca14640 1 -- 172.21.15.194:0/1438997693 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94583152888880] v33'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cb80d7070 con 0x7f0cc0070020 2024-09-13T06:09:57.047 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.047+0000 7f0ccd215640 1 -- 172.21.15.194:0/1438997693 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94583152886160] v33'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cc003d070 con 0x5605db3a4b00 2024-09-13T06:09:57.047 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.047+0000 7f0ccda16640 1 -- 172.21.15.194:0/1438997693 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v33'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cc800a4d0 con 0x5605db3a0160 2024-09-13T06:09:57.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.047+0000 7f0ccf705980 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94583152893504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5605db3ad480 con 0x5605db3a0160 2024-09-13T06:09:57.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.047+0000 7f0ccf705980 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5605db3aebf0 con 0x7f0cb80cc040 2024-09-13T06:09:57.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.047+0000 7f0ccda16640 1 -- 172.21.15.194:0/1438997693 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94583152893504] v33'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cc800a4d0 con 0x5605db3a0160 2024-09-13T06:09:57.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.047+0000 7f0ccda16640 1 -- 172.21.15.194:0/1438997693 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(54 notify.5 [create] v33'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cc800a4d0 con 0x7f0cb80cc040 2024-09-13T06:09:57.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.047+0000 7f0ccf705980 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94583152883568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5605db3ad480 con 0x7f0cb80cc040 2024-09-13T06:09:57.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.047+0000 7f0ccf705980 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5605db3af0e0 con 0x7f0cb80cc040 2024-09-13T06:09:57.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.051+0000 7f0ccda16640 1 -- 172.21.15.194:0/1438997693 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(56 notify.6 [create] v33'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cc800a4d0 con 0x7f0cb80cc040 2024-09-13T06:09:57.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.051+0000 7f0ccf705980 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94583152896976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5605db3af550 con 0x7f0cb80cc040 2024-09-13T06:09:57.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.051+0000 7f0ccf705980 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5605db3b0010 con 0x7f0cb80cc040 2024-09-13T06:09:57.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.051+0000 7f0ccda16640 1 -- 172.21.15.194:0/1438997693 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94583152883568] v33'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cc800a4d0 con 0x7f0cb80cc040 2024-09-13T06:09:57.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.051+0000 7f0ccda16640 1 -- 172.21.15.194:0/1438997693 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94583152896976] v33'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cc800a4d0 con 0x7f0cb80cc040 2024-09-13T06:09:57.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.051+0000 7f0ccda16640 1 -- 172.21.15.194:0/1438997693 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(58 notify.7 [create] v33'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cc800a4d0 con 0x7f0cb80cc040 2024-09-13T06:09:57.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.051+0000 7f0ccf705980 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94583152900800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5605db3af0e0 con 0x7f0cb80cc040 2024-09-13T06:09:57.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.051+0000 7f0ccf705980 20 add_watcher() i=0 2024-09-13T06:09:57.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.051+0000 7f0ccf705980 20 add_watcher() i=1 2024-09-13T06:09:57.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.051+0000 7f0ccf705980 20 add_watcher() i=2 2024-09-13T06:09:57.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.051+0000 7f0ccf705980 20 add_watcher() i=3 2024-09-13T06:09:57.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.051+0000 7f0ccf705980 20 add_watcher() i=4 2024-09-13T06:09:57.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.051+0000 7f0ccf705980 20 add_watcher() i=5 2024-09-13T06:09:57.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.051+0000 7f0ccf705980 20 add_watcher() i=6 2024-09-13T06:09:57.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.055+0000 7f0ccda16640 1 -- 172.21.15.194:0/1438997693 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94583152900800] v33'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cc800a4d0 con 0x7f0cb80cc040 2024-09-13T06:09:57.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.055+0000 7f0ccf705980 20 add_watcher() i=7 2024-09-13T06:09:57.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.055+0000 7f0ccf705980 2 all 8 watchers are set, enabling cache 2024-09-13T06:09:57.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.055+0000 7f0ccf705980 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5605db3b3110 con 0x5605db3a0160 2024-09-13T06:09:57.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.055+0000 7f0ccda16640 1 -- 172.21.15.194:0/1438997693 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0cc800a4d0 con 0x5605db3a0160 2024-09-13T06:09:57.057 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.055+0000 7f0ccf705980 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94583152895328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5605db3b0590 con 0x5605db3a0160 2024-09-13T06:09:57.058 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.055+0000 7f0ccda16640 1 -- 172.21.15.194:0/1438997693 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94583152895328] v33'92 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0cc800a4d0 con 0x5605db3a0160 2024-09-13T06:09:57.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.055+0000 7f0b837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:57.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.055+0000 7f0ccf705980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:09:57.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.055+0000 7f0ccf705980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:09:57.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.055+0000 7f0ccf705980 5 note: GC not initialized 2024-09-13T06:09:57.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.055+0000 7f0b827e4640 20 reqs_thread_entry: start 2024-09-13T06:09:57.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.055+0000 7f0ccf705980 20 init_complete bucket index max shards: 11 2024-09-13T06:09:57.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.055+0000 7f0ccf705980 20 Filter name: none 2024-09-13T06:09:57.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.055+0000 7f0af3fff640 20 reqs_thread_entry: start 2024-09-13T06:09:57.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.055+0000 7f0ccf705980 20 rados->read ofs=0 len=0 2024-09-13T06:09:57.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.055+0000 7f0ccf705980 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5605db3d6060 con 0x5605db3a0160 2024-09-13T06:09:57.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.059+0000 7f0ccda16640 1 -- 172.21.15.194:0/1438997693 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f0cc800a4d0 con 0x5605db3a0160 2024-09-13T06:09:57.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.059+0000 7f0ccf705980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T06:09:57.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.059+0000 7f0ccf705980 20 rados->read ofs=0 len=0 2024-09-13T06:09:57.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.059+0000 7f0ccf705980 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5605db3d6a50 con 0x5605db3a0160 2024-09-13T06:09:57.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.059+0000 7f0ccda16640 1 -- 172.21.15.194:0/1438997693 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f0cc800a4d0 con 0x5605db3a0160 2024-09-13T06:09:57.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.059+0000 7f0ccf705980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T06:09:57.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.059+0000 7f0ccf705980 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5605db3d7a60 con 0x7f0cc0070020 2024-09-13T06:09:57.061 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.059+0000 7f0ccca14640 1 -- 172.21.15.194:0/1438997693 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv2 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f0cb80d7070 con 0x7f0cc0070020 2024-09-13T06:09:57.061 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.059+0000 7f0b837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:57.061 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.059+0000 7f0ccf705980 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94583152895328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5605db3d3f20 con 0x5605db3a0160 2024-09-13T06:09:57.061 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.059+0000 7f0ccda16640 1 -- 172.21.15.194:0/1438997693 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94583152895328] v33'93 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0cc800a4d0 con 0x5605db3a0160 2024-09-13T06:09:57.061 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.059+0000 7f0ccf705980 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94583152878656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5605db3d3f20 con 0x7f0cc0070020 2024-09-13T06:09:57.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.059+0000 7f0ccca14640 1 -- 172.21.15.194:0/1438997693 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94583152878656] v33'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cb80d7070 con 0x7f0cc0070020 2024-09-13T06:09:57.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.059+0000 7f0ccf705980 20 remove_watcher() i=0 2024-09-13T06:09:57.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.059+0000 7f0ccf705980 2 removed watcher, disabling cache 2024-09-13T06:09:57.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.059+0000 7f0ccf705980 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94583152881440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5605db3d3f20 con 0x5605db3a0160 2024-09-13T06:09:57.064 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.063+0000 7f0ccda16640 1 -- 172.21.15.194:0/1438997693 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94583152881440] v33'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cc800a4d0 con 0x5605db3a0160 2024-09-13T06:09:57.064 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.063+0000 7f0ccf705980 20 remove_watcher() i=1 2024-09-13T06:09:57.064 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.063+0000 7f0ccf705980 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94583152886160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5605db3d3f20 con 0x5605db3a4b00 2024-09-13T06:09:57.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.063+0000 7f0ccd215640 1 -- 172.21.15.194:0/1438997693 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94583152886160] v33'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cc003d070 con 0x5605db3a4b00 2024-09-13T06:09:57.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.063+0000 7f0ccf705980 20 remove_watcher() i=2 2024-09-13T06:09:57.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.063+0000 7f0ccf705980 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94583152888880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5605db3d3f20 con 0x7f0cc0070020 2024-09-13T06:09:57.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.067+0000 7f0ccca14640 1 -- 172.21.15.194:0/1438997693 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94583152888880] v33'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cb80d7070 con 0x7f0cc0070020 2024-09-13T06:09:57.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.067+0000 7f0ccf705980 20 remove_watcher() i=3 2024-09-13T06:09:57.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.067+0000 7f0ccf705980 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94583152893504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5605db3d3f20 con 0x5605db3a0160 2024-09-13T06:09:57.069 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.067+0000 7f0ccda16640 1 -- 172.21.15.194:0/1438997693 <== osd.1 v2:172.21.15.194:6808/3135444559 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94583152893504] v33'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cc800a4d0 con 0x5605db3a0160 2024-09-13T06:09:57.069 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.067+0000 7f0ccf705980 20 remove_watcher() i=4 2024-09-13T06:09:57.069 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.067+0000 7f0ccf705980 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94583152883568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5605db3d3f20 con 0x7f0cb80cc040 2024-09-13T06:09:57.071 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.071+0000 7f0ccda16640 1 -- 172.21.15.194:0/1438997693 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94583152883568] v33'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cc800a4d0 con 0x7f0cb80cc040 2024-09-13T06:09:57.071 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.071+0000 7f0ccf705980 20 remove_watcher() i=5 2024-09-13T06:09:57.071 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.071+0000 7f0ccf705980 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94583152896976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5605db3d3f20 con 0x7f0cb80cc040 2024-09-13T06:09:57.073 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.071+0000 7f0ccda16640 1 -- 172.21.15.194:0/1438997693 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94583152896976] v33'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cc800a4d0 con 0x7f0cb80cc040 2024-09-13T06:09:57.073 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.071+0000 7f0ccf705980 20 remove_watcher() i=6 2024-09-13T06:09:57.073 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.071+0000 7f0ccf705980 1 -- 172.21.15.194:0/1438997693 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94583152900800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5605db3d3f20 con 0x7f0cb80cc040 2024-09-13T06:09:57.076 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.075+0000 7f0ccda16640 1 -- 172.21.15.194:0/1438997693 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94583152900800] v33'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cc800a4d0 con 0x7f0cb80cc040 2024-09-13T06:09:57.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.075+0000 7f0ccf705980 20 remove_watcher() i=7 2024-09-13T06:09:57.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.075+0000 7f0ccf705980 1 -- 172.21.15.194:0/1438997693 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f0cb80cc040 msgr2=0x7f0cb80b6420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:57.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.075+0000 7f0ccf705980 1 --2- 172.21.15.194:0/1438997693 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f0cb80cc040 0x7f0cb80b6420 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:57.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.075+0000 7f0ccf705980 1 -- 172.21.15.194:0/1438997693 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5605db3a0160 msgr2=0x5605db3a2600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:57.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.075+0000 7f0ccf705980 1 --2- 172.21.15.194:0/1438997693 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5605db3a0160 0x5605db3a2600 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:57.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.075+0000 7f0ccf705980 1 -- 172.21.15.194:0/1438997693 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f0cc0070020 msgr2=0x7f0cc002c6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:57.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.075+0000 7f0ccf705980 1 --2- 172.21.15.194:0/1438997693 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f0cc0070020 0x7f0cc002c6d0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:57.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.075+0000 7f0ccf705980 1 -- 172.21.15.194:0/1438997693 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5605db3a4b00 msgr2=0x5605db3a6ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:57.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.075+0000 7f0ccf705980 1 --2- 172.21.15.194:0/1438997693 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5605db3a4b00 0x5605db3a6ef0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:57.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.075+0000 7f0ccf705980 1 -- 172.21.15.194:0/1438997693 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0b98034650 msgr2=0x7f0b98036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:57.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.075+0000 7f0ccf705980 1 --2- 172.21.15.194:0/1438997693 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0b98034650 0x7f0b98036b10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x5605db373e50 tx=0x7f0cb80b8040 comp rx=0 tx=0).stop 2024-09-13T06:09:57.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.075+0000 7f0ccf705980 1 -- 172.21.15.194:0/1438997693 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5605db38de20 msgr2=0x5605db3950e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:57.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.075+0000 7f0ccf705980 1 --2- 172.21.15.194:0/1438997693 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5605db38de20 0x5605db3950e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f0cc0047280 tx=0x7f0cc001ce80 comp rx=0 tx=0).stop 2024-09-13T06:09:57.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.075+0000 7f0ccda16640 1 -- 172.21.15.194:0/1438997693 reap_dead start 2024-09-13T06:09:57.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.075+0000 7f0ccf705980 1 -- 172.21.15.194:0/1438997693 shutdown_connections 2024-09-13T06:09:57.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.075+0000 7f0ccf705980 1 --2- 172.21.15.194:0/1438997693 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5605db38de20 0x5605db3950e0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:57.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.075+0000 7f0ccf705980 1 -- 172.21.15.194:0/1438997693 >> 172.21.15.194:0/1438997693 conn(0x5605db38a200 msgr2=0x5605db3882d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:57.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.075+0000 7f0ccf705980 1 -- 172.21.15.194:0/1438997693 shutdown_connections 2024-09-13T06:09:57.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.075+0000 7f0ccf705980 1 -- 172.21.15.194:0/1438997693 wait complete. 2024-09-13T06:09:57.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.075+0000 7f0ccf705980 1 -- 172.21.15.194:0/713998925 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0ba4034650 msgr2=0x7f0ba4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:57.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.075+0000 7f0ccf705980 1 --2- 172.21.15.194:0/713998925 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0ba4034650 0x7f0ba4036b10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0cb8018eb0 tx=0x7f0cb8005a10 comp rx=0 tx=0).stop 2024-09-13T06:09:57.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.075+0000 7f0ccf705980 1 -- 172.21.15.194:0/713998925 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5605db3814e0 msgr2=0x5605db381900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:57.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.075+0000 7f0ccf705980 1 --2- 172.21.15.194:0/713998925 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5605db3814e0 0x5605db381900 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f0cc000bc00 tx=0x7f0cc0048670 comp rx=0 tx=0).stop 2024-09-13T06:09:57.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.075+0000 7f0ccf705980 1 -- 172.21.15.194:0/713998925 shutdown_connections 2024-09-13T06:09:57.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.075+0000 7f0ccf705980 1 --2- 172.21.15.194:0/713998925 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0ba4034650 0x7f0ba4036b10 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:57.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.075+0000 7f0ccf705980 1 --2- 172.21.15.194:0/713998925 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5605db3814e0 0x5605db381900 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:57.079 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.075+0000 7f0ccf705980 1 -- 172.21.15.194:0/713998925 >> 172.21.15.194:0/713998925 conn(0x5605db376630 msgr2=0x5605db3790b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:57.079 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.075+0000 7f0ccf705980 1 -- 172.21.15.194:0/713998925 shutdown_connections 2024-09-13T06:09:57.079 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.075+0000 7f0ccf705980 1 -- 172.21.15.194:0/713998925 wait complete. 2024-09-13T06:09:57.079 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.075+0000 7f0ccf705980 1 -- 172.21.15.194:0/4099526676 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5605db1e49f0 msgr2=0x5605db36a6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:57.079 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.075+0000 7f0ccf705980 1 --2- 172.21.15.194:0/4099526676 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5605db1e49f0 0x5605db36a6b0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:57.079 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.075+0000 7f0ccf705980 1 -- 172.21.15.194:0/4099526676 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5605db370f20 msgr2=0x5605db373310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:57.079 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.075+0000 7f0ccf705980 1 --2- 172.21.15.194:0/4099526676 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5605db370f20 0x5605db373310 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:57.079 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.075+0000 7f0ccf705980 1 -- 172.21.15.194:0/4099526676 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5605db36d020 msgr2=0x5605db36f410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:57.079 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.075+0000 7f0ccf705980 1 --2- 172.21.15.194:0/4099526676 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5605db36d020 0x5605db36f410 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:57.079 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.075+0000 7f0ccf705980 1 -- 172.21.15.194:0/4099526676 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0bb4034650 msgr2=0x7f0bb4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:57.079 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.075+0000 7f0ccf705980 1 --2- 172.21.15.194:0/4099526676 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0bb4034650 0x7f0bb4036b10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0cb80ac000 tx=0x7f0cb80a5000 comp rx=0 tx=0).stop 2024-09-13T06:09:57.079 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.075+0000 7f0ccf705980 1 -- 172.21.15.194:0/4099526676 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5605db1e1680 msgr2=0x5605db3636c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:57.079 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.075+0000 7f0ccf705980 1 --2- 172.21.15.194:0/4099526676 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5605db1e1680 0x5605db3636c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x5605db35d550 tx=0x7f0cc0000bd0 comp rx=0 tx=0).stop 2024-09-13T06:09:57.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.075+0000 7f0ccda16640 1 -- 172.21.15.194:0/4099526676 reap_dead start 2024-09-13T06:09:57.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.075+0000 7f0ccf705980 1 -- 172.21.15.194:0/4099526676 shutdown_connections 2024-09-13T06:09:57.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.075+0000 7f0ccf705980 1 -- 172.21.15.194:0/4099526676 >> 172.21.15.194:0/4099526676 conn(0x5605db1e0230 msgr2=0x5605db356b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:57.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.075+0000 7f0ccf705980 1 -- 172.21.15.194:0/4099526676 shutdown_connections 2024-09-13T06:09:57.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.075+0000 7f0ccf705980 1 -- 172.21.15.194:0/4099526676 wait complete. 2024-09-13T06:09:57.085 INFO:teuthology.orchestra.run.smithi194.stdout:["myfoo"] 2024-09-13T06:09:57.085 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-09-13T06:09:57.160 INFO:tasks.radosgw_admin:RL: list_buckets foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T06:09:57.161 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-09-13T06:09:57.161 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-09-13T06:09:57.161 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-09-13T06:09:57.195 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:09:57.195 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:09:57.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.195+0000 7f3659238980 1 Processor -- start 2024-09-13T06:09:57.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.195+0000 7f3659238980 1 -- start start 2024-09-13T06:09:57.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.195+0000 7f3659238980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x559e925259c0 0x559e92527db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:57.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.195+0000 7f3659238980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559e923a9ae0 con 0x559e92521640 2024-09-13T06:09:57.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.195+0000 7f3659238980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x559e923cde30 con 0x559e925259c0 2024-09-13T06:09:57.197 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.195+0000 7f3656547640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x559e925259c0 0x559e92527db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:57.197 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.195+0000 7f3656547640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x559e925259c0 0x559e92527db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45242/0 (socket says 172.21.15.194:45242) 2024-09-13T06:09:57.197 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.195+0000 7f3656547640 1 -- 172.21.15.194:0/3536252244 learned_addr learned my addr 172.21.15.194:0/3536252244 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:57.197 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.195+0000 7f3656547640 1 -- 172.21.15.194:0/3536252244 >> v1:172.21.15.120:6789/0 conn(0x559e92521640 legacy=0x559e92521a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:57.197 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.195+0000 7f3656547640 1 -- 172.21.15.194:0/3536252244 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e92529300 con 0x559e925259c0 2024-09-13T06:09:57.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.199+0000 7f3656547640 1 --2- 172.21.15.194:0/3536252244 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e925259c0 0x559e92527db0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f364c00a4e0 tx=0x7f364c01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=141cc1ba0772840c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:57.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.199+0000 7f3655d46640 1 -- 172.21.15.194:0/3536252244 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f364c0aa540 con 0x559e925259c0 2024-09-13T06:09:57.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.199+0000 7f3655d46640 1 -- 172.21.15.194:0/3536252244 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f364c0aa6e0 con 0x559e925259c0 2024-09-13T06:09:57.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.199+0000 7f3655d46640 1 -- 172.21.15.194:0/3536252244 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f364c0aaa40 con 0x559e925259c0 2024-09-13T06:09:57.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.199+0000 7f3659238980 1 -- 172.21.15.194:0/3536252244 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e925259c0 msgr2=0x559e92527db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:57.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.199+0000 7f3659238980 1 --2- 172.21.15.194:0/3536252244 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e925259c0 0x559e92527db0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f364c00a4e0 tx=0x7f364c01b090 comp rx=0 tx=0).stop 2024-09-13T06:09:57.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.199+0000 7f3659238980 1 -- 172.21.15.194:0/3536252244 shutdown_connections 2024-09-13T06:09:57.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.199+0000 7f3659238980 1 --2- 172.21.15.194:0/3536252244 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e925259c0 0x559e92527db0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:57.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.199+0000 7f3659238980 1 -- 172.21.15.194:0/3536252244 >> 172.21.15.194:0/3536252244 conn(0x559e9251d160 msgr2=0x559e9251f580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:57.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.199+0000 7f3659238980 1 -- 172.21.15.194:0/3536252244 shutdown_connections 2024-09-13T06:09:57.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.199+0000 7f3659238980 1 -- 172.21.15.194:0/3536252244 wait complete. 2024-09-13T06:09:57.215 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.215+0000 7f3659238980 1 Processor -- start 2024-09-13T06:09:57.215 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.215+0000 7f3659238980 1 -- start start 2024-09-13T06:09:57.215 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.215+0000 7f3659238980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e92521640 0x559e9260ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:57.215 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.215+0000 7f3659238980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x559e923cf200 con 0x559e92521640 2024-09-13T06:09:57.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.215+0000 7f3656d48640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e92521640 0x559e9260ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:57.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.215+0000 7f3656d48640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e92521640 0x559e9260ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45246/0 (socket says 172.21.15.194:45246) 2024-09-13T06:09:57.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.215+0000 7f3656d48640 1 -- 172.21.15.194:0/1839211132 learned_addr learned my addr 172.21.15.194:0/1839211132 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:57.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.215+0000 7f3656d48640 1 -- 172.21.15.194:0/1839211132 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e9260cfe0 con 0x559e92521640 2024-09-13T06:09:57.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.215+0000 7f3656d48640 1 --2- 172.21.15.194:0/1839211132 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e92521640 0x559e9260ca10 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3648001ea0 tx=0x7f364800b680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65fefde6f7a7a02 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:57.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.215+0000 7f3544e09640 1 -- 172.21.15.194:0/1839211132 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f364800a040 con 0x559e92521640 2024-09-13T06:09:57.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.215+0000 7f3544e09640 1 -- 172.21.15.194:0/1839211132 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f364800f620 con 0x559e92521640 2024-09-13T06:09:57.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.215+0000 7f3544e09640 1 -- 172.21.15.194:0/1839211132 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f364800f890 con 0x559e92521640 2024-09-13T06:09:57.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.215+0000 7f3659238980 1 -- 172.21.15.194:0/1839211132 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e92521640 msgr2=0x559e9260ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:57.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.215+0000 7f3659238980 1 --2- 172.21.15.194:0/1839211132 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e92521640 0x559e9260ca10 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3648001ea0 tx=0x7f364800b680 comp rx=0 tx=0).stop 2024-09-13T06:09:57.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.215+0000 7f3659238980 1 -- 172.21.15.194:0/1839211132 shutdown_connections 2024-09-13T06:09:57.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.215+0000 7f3659238980 1 --2- 172.21.15.194:0/1839211132 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e92521640 0x559e9260ca10 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:57.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.215+0000 7f3659238980 1 -- 172.21.15.194:0/1839211132 >> 172.21.15.194:0/1839211132 conn(0x559e9251d160 msgr2=0x559e92608640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:57.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.215+0000 7f3659238980 1 -- 172.21.15.194:0/1839211132 shutdown_connections 2024-09-13T06:09:57.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.215+0000 7f3659238980 1 -- 172.21.15.194:0/1839211132 wait complete. 2024-09-13T06:09:57.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.215+0000 7f3659238980 1 Processor -- start 2024-09-13T06:09:57.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.215+0000 7f3659238980 1 -- start start 2024-09-13T06:09:57.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.215+0000 7f3659238980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e92521640 0x559e92613dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:57.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.215+0000 7f3659238980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x559e92528e00 con 0x559e92521640 2024-09-13T06:09:57.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.215+0000 7f3656d48640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e92521640 0x559e92613dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:57.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.215+0000 7f3656d48640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e92521640 0x559e92613dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45254/0 (socket says 172.21.15.194:45254) 2024-09-13T06:09:57.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.215+0000 7f3656d48640 1 -- 172.21.15.194:0/3678072172 learned_addr learned my addr 172.21.15.194:0/3678072172 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:57.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.219+0000 7f3656d48640 1 -- 172.21.15.194:0/3678072172 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e92614300 con 0x559e92521640 2024-09-13T06:09:57.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.219+0000 7f3656d48640 1 --2- 172.21.15.194:0/3678072172 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e92521640 0x559e92613dc0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3648001fd0 tx=0x7f3648000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:57.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.219+0000 7f3543606640 1 -- 172.21.15.194:0/3678072172 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3648001520 con 0x559e92521640 2024-09-13T06:09:57.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.219+0000 7f3659238980 1 -- 172.21.15.194:0/3678072172 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559e92614590 con 0x559e92521640 2024-09-13T06:09:57.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.219+0000 7f3543606640 1 -- 172.21.15.194:0/3678072172 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f364801ca10 con 0x559e92521640 2024-09-13T06:09:57.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.219+0000 7f3659238980 1 -- 172.21.15.194:0/3678072172 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e92617270 con 0x559e92521640 2024-09-13T06:09:57.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.219+0000 7f3543606640 1 -- 172.21.15.194:0/3678072172 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f364802c060 con 0x559e92521640 2024-09-13T06:09:57.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.219+0000 7f3543606640 1 -- 172.21.15.194:0/3678072172 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3648017050 con 0x559e92521640 2024-09-13T06:09:57.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.219+0000 7f3543606640 1 --2- 172.21.15.194:0/3678072172 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f353c034650 0x7f353c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:57.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.219+0000 7f3543606640 1 -- 172.21.15.194:0/3678072172 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f3648015020 con 0x559e92521640 2024-09-13T06:09:57.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.219+0000 7f3656547640 1 --2- 172.21.15.194:0/3678072172 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f353c034650 0x7f353c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:57.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.219+0000 7f3659238980 1 --2- 172.21.15.194:0/3678072172 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x559e925259c0 0x559e9261aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:57.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.219+0000 7f3659238980 1 -- 172.21.15.194:0/3678072172 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559e9261b440 con 0x559e925259c0 2024-09-13T06:09:57.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.219+0000 7f3657549640 1 --2- 172.21.15.194:0/3678072172 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x559e925259c0 0x559e9261aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:57.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.219+0000 7f3656547640 1 --2- 172.21.15.194:0/3678072172 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f353c034650 0x7f353c036b10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f364c0ab000 tx=0x7f364c0a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:57.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.219+0000 7f3657549640 1 --2- 172.21.15.194:0/3678072172 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x559e925259c0 0x559e9261aec0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:57.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.219+0000 7f3657549640 1 -- 172.21.15.194:0/3678072172 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f36500083f0 con 0x559e925259c0 2024-09-13T06:09:57.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.219+0000 7f3659238980 1 -- 172.21.15.194:0/3678072172 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559e92618490 con 0x559e925259c0 2024-09-13T06:09:57.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.219+0000 7f3657549640 1 -- 172.21.15.194:0/3678072172 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f36500083f0 con 0x559e925259c0 2024-09-13T06:09:57.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.219+0000 7f3659238980 1 --2- 172.21.15.194:0/3678072172 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x559e9261d7c0 0x559e9261fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:57.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.219+0000 7f3659238980 1 -- 172.21.15.194:0/3678072172 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559e926202a0 con 0x559e9261d7c0 2024-09-13T06:09:57.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.219+0000 7f3656d48640 1 --2- 172.21.15.194:0/3678072172 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x559e9261d7c0 0x559e9261fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:57.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.223+0000 7f3656d48640 1 --2- 172.21.15.194:0/3678072172 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x559e9261d7c0 0x559e9261fbb0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:57.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.223+0000 7f3656d48640 1 -- 172.21.15.194:0/3678072172 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f364802e070 con 0x559e9261d7c0 2024-09-13T06:09:57.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.223+0000 7f3659238980 1 -- 172.21.15.194:0/3678072172 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559e9261c630 con 0x559e925259c0 2024-09-13T06:09:57.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.223+0000 7f3657549640 1 -- 172.21.15.194:0/3678072172 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f36500083f0 con 0x559e925259c0 2024-09-13T06:09:57.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.223+0000 7f3659238980 1 --2- 172.21.15.194:0/3678072172 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x559e92621700 0x559e92623af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:57.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.223+0000 7f3659238980 1 -- 172.21.15.194:0/3678072172 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559e926241f0 con 0x559e92621700 2024-09-13T06:09:57.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.223+0000 7f3656547640 1 --2- 172.21.15.194:0/3678072172 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x559e92621700 0x559e92623af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:57.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.223+0000 7f3656547640 1 --2- 172.21.15.194:0/3678072172 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x559e92621700 0x559e92623af0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:57.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.223+0000 7f3656547640 1 -- 172.21.15.194:0/3678072172 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f364c0bc040 con 0x559e92621700 2024-09-13T06:09:57.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.223+0000 7f3659238980 1 Processor -- start 2024-09-13T06:09:57.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.223+0000 7f3659238980 1 -- start start 2024-09-13T06:09:57.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.223+0000 7f3659238980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e92631c80 0x559e926320a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:57.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.223+0000 7f3659238980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x559e92428800 con 0x559e92631c80 2024-09-13T06:09:57.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.223+0000 7f3656d48640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e92631c80 0x559e926320a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:57.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.223+0000 7f3656d48640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e92631c80 0x559e926320a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45260/0 (socket says 172.21.15.194:45260) 2024-09-13T06:09:57.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.223+0000 7f3656d48640 1 -- 172.21.15.194:0/2773278466 learned_addr learned my addr 172.21.15.194:0/2773278466 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:57.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.223+0000 7f3656d48640 1 -- 172.21.15.194:0/2773278466 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e926325e0 con 0x559e92631c80 2024-09-13T06:09:57.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.223+0000 7f3656d48640 1 --2- 172.21.15.194:0/2773278466 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e92631c80 0x559e926320a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f36480487a0 tx=0x7f364800ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:57.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.223+0000 7f3540e01640 1 -- 172.21.15.194:0/2773278466 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f364802fca0 con 0x559e92631c80 2024-09-13T06:09:57.231 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.223+0000 7f3659238980 1 -- 172.21.15.194:0/2773278466 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559e92632870 con 0x559e92631c80 2024-09-13T06:09:57.231 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.223+0000 7f3540e01640 1 -- 172.21.15.194:0/2773278466 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f364802fe40 con 0x559e92631c80 2024-09-13T06:09:57.231 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.223+0000 7f3540e01640 1 -- 172.21.15.194:0/2773278466 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f364801a5b0 con 0x559e92631c80 2024-09-13T06:09:57.231 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.223+0000 7f3659238980 1 -- 172.21.15.194:0/2773278466 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e926354f0 con 0x559e92631c80 2024-09-13T06:09:57.231 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.227+0000 7f3540e01640 1 -- 172.21.15.194:0/2773278466 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f364801a750 con 0x559e92631c80 2024-09-13T06:09:57.231 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.227+0000 7f3540e01640 1 --2- 172.21.15.194:0/2773278466 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3530034650 0x7f3530036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:57.231 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.227+0000 7f3540e01640 1 -- 172.21.15.194:0/2773278466 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f364803ec80 con 0x559e92631c80 2024-09-13T06:09:57.231 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.227+0000 7f3656547640 1 --2- 172.21.15.194:0/2773278466 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3530034650 0x7f3530036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:57.231 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.227+0000 7f3659238980 1 Processor -- start 2024-09-13T06:09:57.231 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.227+0000 7f3659238980 1 -- start start 2024-09-13T06:09:57.231 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.227+0000 7f3656547640 1 --2- 172.21.15.194:0/2773278466 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3530034650 0x7f3530036b10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x559e9261b940 tx=0x7f364c005e50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:57.231 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.227+0000 7f3659238980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e9263e560 0x559e9263e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:57.231 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.227+0000 7f3659238980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x559e9260d360 con 0x559e9263e560 2024-09-13T06:09:57.232 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.227+0000 7f3656d48640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e9263e560 0x559e9263e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:57.232 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.227+0000 7f3656d48640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e9263e560 0x559e9263e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45274/0 (socket says 172.21.15.194:45274) 2024-09-13T06:09:57.232 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.227+0000 7f3656d48640 1 -- 172.21.15.194:0/1083185746 learned_addr learned my addr 172.21.15.194:0/1083185746 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:57.232 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.227+0000 7f3656d48640 1 -- 172.21.15.194:0/1083185746 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e9263ef30 con 0x559e9263e560 2024-09-13T06:09:57.232 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.227+0000 7f3656d48640 1 --2- 172.21.15.194:0/1083185746 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e9263e560 0x559e9263e960 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f3648005fd0 tx=0x7f3648042c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5717dfcbe46d74e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:57.232 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.227+0000 7f353a7fc640 1 -- 172.21.15.194:0/1083185746 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3648026390 con 0x559e9263e560 2024-09-13T06:09:57.232 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.227+0000 7f353a7fc640 1 -- 172.21.15.194:0/1083185746 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f364805a030 con 0x559e9263e560 2024-09-13T06:09:57.232 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.227+0000 7f353a7fc640 1 -- 172.21.15.194:0/1083185746 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3648027c10 con 0x559e9263e560 2024-09-13T06:09:57.232 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.227+0000 7f3659238980 1 -- 172.21.15.194:0/1083185746 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e9263e560 msgr2=0x559e9263e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:57.232 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.227+0000 7f3659238980 1 --2- 172.21.15.194:0/1083185746 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e9263e560 0x559e9263e960 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f3648005fd0 tx=0x7f3648042c80 comp rx=0 tx=0).stop 2024-09-13T06:09:57.232 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.227+0000 7f3659238980 1 -- 172.21.15.194:0/1083185746 shutdown_connections 2024-09-13T06:09:57.232 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.227+0000 7f3659238980 1 --2- 172.21.15.194:0/1083185746 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e9263e560 0x559e9263e960 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:57.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.227+0000 7f3659238980 1 -- 172.21.15.194:0/1083185746 >> 172.21.15.194:0/1083185746 conn(0x559e9263a8f0 msgr2=0x559e926389f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:57.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.227+0000 7f3659238980 1 -- 172.21.15.194:0/1083185746 shutdown_connections 2024-09-13T06:09:57.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.227+0000 7f3659238980 1 -- 172.21.15.194:0/1083185746 wait complete. 2024-09-13T06:09:57.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.227+0000 7f3659238980 1 Processor -- start 2024-09-13T06:09:57.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.227+0000 7f3659238980 1 -- start start 2024-09-13T06:09:57.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.231+0000 7f3659238980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e9263e560 0x559e92645700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:57.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.231+0000 7f3659238980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x559e9263f480 con 0x559e9263e560 2024-09-13T06:09:57.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.231+0000 7f3656d48640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e9263e560 0x559e92645700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:57.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.231+0000 7f3656d48640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e9263e560 0x559e92645700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45290/0 (socket says 172.21.15.194:45290) 2024-09-13T06:09:57.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.231+0000 7f3656d48640 1 -- 172.21.15.194:0/197969602 learned_addr learned my addr 172.21.15.194:0/197969602 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:57.238 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.231+0000 7f3656d48640 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e92645c40 con 0x559e9263e560 2024-09-13T06:09:57.239 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.231+0000 7f3656d48640 1 --2- 172.21.15.194:0/197969602 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e9263e560 0x559e92645700 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f36480475c0 tx=0x7f364804ef50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:57.239 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.231+0000 7f3538ff9640 1 -- 172.21.15.194:0/197969602 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f364806d070 con 0x559e9263e560 2024-09-13T06:09:57.239 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.231+0000 7f3659238980 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559e92645c40 con 0x559e9263e560 2024-09-13T06:09:57.239 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.231+0000 7f3538ff9640 1 -- 172.21.15.194:0/197969602 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36480489b0 con 0x559e9263e560 2024-09-13T06:09:57.239 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.231+0000 7f3538ff9640 1 -- 172.21.15.194:0/197969602 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f364800a780 con 0x559e9263e560 2024-09-13T06:09:57.239 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.231+0000 7f3659238980 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e926460b0 con 0x559e9263e560 2024-09-13T06:09:57.239 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.231+0000 7f3659238980 20 rados->read ofs=0 len=0 2024-09-13T06:09:57.239 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.231+0000 7f3538ff9640 1 -- 172.21.15.194:0/197969602 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3648070070 con 0x559e9263e560 2024-09-13T06:09:57.239 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.231+0000 7f3538ff9640 1 --2- 172.21.15.194:0/197969602 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f35200345b0 0x7f3520036a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:57.239 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.231+0000 7f3538ff9640 1 -- 172.21.15.194:0/197969602 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f3648065070 con 0x559e9263e560 2024-09-13T06:09:57.239 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.231+0000 7f3656547640 1 --2- 172.21.15.194:0/197969602 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f35200345b0 0x7f3520036a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:57.239 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.231+0000 7f3659238980 1 --2- 172.21.15.194:0/197969602 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x559e92650670 0x559e92652b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:57.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.231+0000 7f3659238980 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559e92653260 con 0x559e92650670 2024-09-13T06:09:57.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.231+0000 7f3657549640 1 --2- 172.21.15.194:0/197969602 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x559e92650670 0x559e92652b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:57.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.231+0000 7f3656547640 1 --2- 172.21.15.194:0/197969602 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f35200345b0 0x7f3520036a70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f364c01b0d0 tx=0x7f364c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:57.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.231+0000 7f3657549640 1 --2- 172.21.15.194:0/197969602 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x559e92650670 0x559e92652b10 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:57.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.231+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f36500083f0 con 0x559e92650670 2024-09-13T06:09:57.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.231+0000 7f3659238980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:57.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.231+0000 7f3659238980 20 realm 2024-09-13T06:09:57.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.235+0000 7f3659238980 20 rados->read ofs=0 len=0 2024-09-13T06:09:57.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.235+0000 7f3659238980 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559e92653670 con 0x559e92650670 2024-09-13T06:09:57.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.235+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f36500083f0 con 0x559e92650670 2024-09-13T06:09:57.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.235+0000 7f3659238980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:57.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.235+0000 7f3659238980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:09:57.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.235+0000 7f3659238980 20 rados->read ofs=0 len=0 2024-09-13T06:09:57.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.235+0000 7f3659238980 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559e92653f10 con 0x559e92650670 2024-09-13T06:09:57.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.235+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f36500083f0 con 0x559e92650670 2024-09-13T06:09:57.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.235+0000 7f3659238980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:57.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.235+0000 7f3659238980 20 rados->read ofs=0 len=0 2024-09-13T06:09:57.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.235+0000 7f3659238980 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559e926542b0 con 0x559e92650670 2024-09-13T06:09:57.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.235+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f36500083f0 con 0x559e92650670 2024-09-13T06:09:57.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.235+0000 7f3659238980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:57.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.235+0000 7f3659238980 20 rados->read ofs=0 len=0 2024-09-13T06:09:57.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.235+0000 7f3659238980 1 --2- 172.21.15.194:0/197969602 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x559e92655010 0x559e92657400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:57.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.235+0000 7f3659238980 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559e92657980 con 0x559e92655010 2024-09-13T06:09:57.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.235+0000 7f3656d48640 1 --2- 172.21.15.194:0/197969602 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x559e92655010 0x559e92657400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:57.242 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.235+0000 7f3656d48640 1 --2- 172.21.15.194:0/197969602 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x559e92655010 0x559e92657400 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:57.242 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.235+0000 7f3656d48640 1 -- 172.21.15.194:0/197969602 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f364806f030 con 0x559e92655010 2024-09-13T06:09:57.242 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.235+0000 7f3659238980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:09:57.242 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.235+0000 7f3659238980 20 searching for the correct realm 2024-09-13T06:09:57.242 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.235+0000 7f3659238980 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e926591e0 con 0x559e92655010 2024-09-13T06:09:57.242 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.235+0000 7f3656d48640 1 -- 172.21.15.194:0/197969602 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f364806f030 con 0x559e92655010 2024-09-13T06:09:57.242 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.235+0000 7f3656d48640 1 --2- 172.21.15.194:0/197969602 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f3648072060 0x7f364804e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:57.242 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.235+0000 7f3656d48640 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e926591e0 con 0x7f3648072060 2024-09-13T06:09:57.242 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.235+0000 7f3656547640 1 --2- 172.21.15.194:0/197969602 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f3648072060 0x7f364804e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:57.242 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.235+0000 7f3656547640 1 --2- 172.21.15.194:0/197969602 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f3648072060 0x7f364804e1b0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:57.242 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.235+0000 7f3656547640 1 -- 172.21.15.194:0/197969602 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f364c0ca070 con 0x7f3648072060 2024-09-13T06:09:57.242 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.235+0000 7f3656547640 1 --2- 172.21.15.194:0/197969602 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f364c0dc040 0x7f364c0cd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:57.243 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.235+0000 7f3656547640 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e926591e0 con 0x7f364c0dc040 2024-09-13T06:09:57.243 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.235+0000 7f3657549640 1 --2- 172.21.15.194:0/197969602 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f364c0dc040 0x7f364c0cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:57.243 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.235+0000 7f3657549640 1 --2- 172.21.15.194:0/197969602 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f364c0dc040 0x7f364c0cd430 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:57.243 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.235+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36500083f0 con 0x7f364c0dc040 2024-09-13T06:09:57.243 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.235+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e926542b0 con 0x559e92650670 2024-09-13T06:09:57.243 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.239+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36500083f0 con 0x559e92650670 2024-09-13T06:09:57.243 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.239+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e926542b0 con 0x559e92650670 2024-09-13T06:09:57.243 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.239+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36500083f0 con 0x559e92650670 2024-09-13T06:09:57.243 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.239+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e926542b0 con 0x7f364c0dc040 2024-09-13T06:09:57.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.239+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36500083f0 con 0x7f364c0dc040 2024-09-13T06:09:57.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.239+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e926542b0 con 0x7f364c0dc040 2024-09-13T06:09:57.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.239+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36500083f0 con 0x7f364c0dc040 2024-09-13T06:09:57.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.239+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e926542b0 con 0x7f3648072060 2024-09-13T06:09:57.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.239+0000 7f3656547640 1 -- 172.21.15.194:0/197969602 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f364c0ca070 con 0x7f3648072060 2024-09-13T06:09:57.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.239+0000 7f3656547640 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e926542b0 con 0x559e92655010 2024-09-13T06:09:57.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.239+0000 7f3656d48640 1 -- 172.21.15.194:0/197969602 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f364806f030 con 0x559e92655010 2024-09-13T06:09:57.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.239+0000 7f3656d48640 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e926542b0 con 0x559e92650670 2024-09-13T06:09:57.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.239+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36500083f0 con 0x559e92650670 2024-09-13T06:09:57.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.239+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e926542b0 con 0x7f364c0dc040 2024-09-13T06:09:57.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.239+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36500083f0 con 0x7f364c0dc040 2024-09-13T06:09:57.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.239+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e926542b0 con 0x559e92650670 2024-09-13T06:09:57.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.239+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36500083f0 con 0x559e92650670 2024-09-13T06:09:57.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.239+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e926542b0 con 0x7f3648072060 2024-09-13T06:09:57.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.239+0000 7f3656547640 1 -- 172.21.15.194:0/197969602 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f364c0ca070 con 0x7f3648072060 2024-09-13T06:09:57.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.239+0000 7f3656547640 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e926542b0 con 0x559e92655010 2024-09-13T06:09:57.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.239+0000 7f3656d48640 1 -- 172.21.15.194:0/197969602 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f364806f030 con 0x559e92655010 2024-09-13T06:09:57.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.243+0000 7f3656d48640 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e926542b0 con 0x559e92655010 2024-09-13T06:09:57.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.243+0000 7f3656d48640 1 -- 172.21.15.194:0/197969602 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f364806f030 con 0x559e92655010 2024-09-13T06:09:57.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.243+0000 7f3656d48640 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e926542b0 con 0x7f364c0dc040 2024-09-13T06:09:57.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.243+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36500083f0 con 0x7f364c0dc040 2024-09-13T06:09:57.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.243+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e926542b0 con 0x559e92655010 2024-09-13T06:09:57.252 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.243+0000 7f3656d48640 1 -- 172.21.15.194:0/197969602 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f364806f030 con 0x559e92655010 2024-09-13T06:09:57.252 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.243+0000 7f3656d48640 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e926542b0 con 0x559e92655010 2024-09-13T06:09:57.252 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.243+0000 7f3656d48640 1 -- 172.21.15.194:0/197969602 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f364806f030 con 0x559e92655010 2024-09-13T06:09:57.252 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.243+0000 7f3656d48640 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e926542b0 con 0x559e92650670 2024-09-13T06:09:57.252 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.243+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36500083f0 con 0x559e92650670 2024-09-13T06:09:57.252 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.243+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e926542b0 con 0x559e92650670 2024-09-13T06:09:57.252 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.243+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f36500083f0 con 0x559e92650670 2024-09-13T06:09:57.252 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.243+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e926542b0 con 0x7f364c0dc040 2024-09-13T06:09:57.252 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.243+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36500083f0 con 0x7f364c0dc040 2024-09-13T06:09:57.252 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.243+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e926542b0 con 0x559e92655010 2024-09-13T06:09:57.252 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.243+0000 7f3656d48640 1 -- 172.21.15.194:0/197969602 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f364806f030 con 0x559e92655010 2024-09-13T06:09:57.252 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.243+0000 7f3656d48640 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e926542b0 con 0x7f3648072060 2024-09-13T06:09:57.252 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.243+0000 7f3656547640 1 -- 172.21.15.194:0/197969602 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f364c0ca070 con 0x7f3648072060 2024-09-13T06:09:57.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.243+0000 7f3656547640 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e926542b0 con 0x559e92650670 2024-09-13T06:09:57.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.243+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36500083f0 con 0x559e92650670 2024-09-13T06:09:57.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.243+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e926542b0 con 0x7f364c0dc040 2024-09-13T06:09:57.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.243+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36500083f0 con 0x7f364c0dc040 2024-09-13T06:09:57.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.243+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e926542b0 con 0x559e92655010 2024-09-13T06:09:57.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.247+0000 7f3656d48640 1 -- 172.21.15.194:0/197969602 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f364806f030 con 0x559e92655010 2024-09-13T06:09:57.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.247+0000 7f3656d48640 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e926542b0 con 0x7f364c0dc040 2024-09-13T06:09:57.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.247+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36500083f0 con 0x7f364c0dc040 2024-09-13T06:09:57.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.247+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e926542b0 con 0x7f3648072060 2024-09-13T06:09:57.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.247+0000 7f3656547640 1 -- 172.21.15.194:0/197969602 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f364c0ca070 con 0x7f3648072060 2024-09-13T06:09:57.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.247+0000 7f3656547640 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e926542b0 con 0x559e92655010 2024-09-13T06:09:57.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.247+0000 7f3656d48640 1 -- 172.21.15.194:0/197969602 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f364806f030 con 0x559e92655010 2024-09-13T06:09:57.254 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.247+0000 7f3656d48640 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e926542b0 con 0x7f364c0dc040 2024-09-13T06:09:57.254 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.247+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36500083f0 con 0x7f364c0dc040 2024-09-13T06:09:57.254 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.247+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e926542b0 con 0x559e92650670 2024-09-13T06:09:57.254 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.247+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f36500083f0 con 0x559e92650670 2024-09-13T06:09:57.254 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.247+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e926542b0 con 0x7f3648072060 2024-09-13T06:09:57.254 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.247+0000 7f3656547640 1 -- 172.21.15.194:0/197969602 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f364c0ca070 con 0x7f3648072060 2024-09-13T06:09:57.254 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.247+0000 7f3659238980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:09:57.254 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.247+0000 7f3659238980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:09:57.254 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.247+0000 7f3659238980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:09:57.254 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.247+0000 7f3659238980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:09:57.254 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.247+0000 7f3659238980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:09:57.254 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.247+0000 7f3659238980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:09:57.254 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.247+0000 7f3659238980 20 rados->read ofs=0 len=0 2024-09-13T06:09:57.254 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.247+0000 7f3659238980 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559e926582d0 con 0x559e92650670 2024-09-13T06:09:57.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.247+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f36500083f0 con 0x559e92650670 2024-09-13T06:09:57.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.247+0000 7f3659238980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:57.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.247+0000 7f3659238980 20 rados->read ofs=0 len=0 2024-09-13T06:09:57.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.247+0000 7f3659238980 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559e92657f10 con 0x559e92650670 2024-09-13T06:09:57.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.247+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f36500083f0 con 0x559e92650670 2024-09-13T06:09:57.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.247+0000 7f3659238980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:57.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.247+0000 7f3659238980 20 rados->read ofs=0 len=0 2024-09-13T06:09:57.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.247+0000 7f3659238980 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559e92657ee0 con 0x7f3648072060 2024-09-13T06:09:57.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.247+0000 7f3656547640 1 -- 172.21.15.194:0/197969602 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f364c0ca070 con 0x7f3648072060 2024-09-13T06:09:57.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.247+0000 7f3659238980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:09:57.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.247+0000 7f3659238980 20 zone default found 2024-09-13T06:09:57.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.247+0000 7f3659238980 4 Realm: () 2024-09-13T06:09:57.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.247+0000 7f3659238980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:09:57.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.247+0000 7f3659238980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:09:57.256 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.247+0000 7f3659238980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:09:57.256 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.247+0000 7f3659238980 20 zonegroup default 2024-09-13T06:09:57.256 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.247+0000 7f3659238980 20 rados->read ofs=0 len=0 2024-09-13T06:09:57.256 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.247+0000 7f3659238980 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559e926590f0 con 0x7f364c0dc040 2024-09-13T06:09:57.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.251+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f36500083f0 con 0x7f364c0dc040 2024-09-13T06:09:57.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.251+0000 7f3659238980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:57.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.251+0000 7f3659238980 20 rados->read ofs=0 len=0 2024-09-13T06:09:57.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.251+0000 7f3659238980 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559e9265b090 con 0x559e92655010 2024-09-13T06:09:57.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.251+0000 7f3656d48640 1 -- 172.21.15.194:0/197969602 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f364806f030 con 0x559e92655010 2024-09-13T06:09:57.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.251+0000 7f3659238980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:57.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.251+0000 7f3659238980 20 rados->read ofs=0 len=0 2024-09-13T06:09:57.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.251+0000 7f3659238980 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559e9265b430 con 0x559e92655010 2024-09-13T06:09:57.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.251+0000 7f3656d48640 1 -- 172.21.15.194:0/197969602 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f364806f030 con 0x559e92655010 2024-09-13T06:09:57.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.251+0000 7f3659238980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:57.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.251+0000 7f3659238980 20 started sync module instance, tier type = 2024-09-13T06:09:57.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.251+0000 7f3659238980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:09:57.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.251+0000 7f3659238980 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559e9265a530 con 0x7f3648072060 2024-09-13T06:09:57.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.251+0000 7f3656547640 1 -- 172.21.15.194:0/197969602 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(44 notify.0 [create] v33'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f364c0ca070 con 0x7f3648072060 2024-09-13T06:09:57.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.251+0000 7f3659238980 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94139549329696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559e9265b8e0 con 0x7f3648072060 2024-09-13T06:09:57.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.251+0000 7f3659238980 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559e9265c130 con 0x559e92650670 2024-09-13T06:09:57.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.251+0000 7f3656547640 1 -- 172.21.15.194:0/197969602 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94139549329696] v33'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f364c0ca070 con 0x7f3648072060 2024-09-13T06:09:57.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.251+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v33'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36500083f0 con 0x559e92650670 2024-09-13T06:09:57.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.251+0000 7f3659238980 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94139549332528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559e9265c130 con 0x559e92650670 2024-09-13T06:09:57.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.251+0000 7f3659238980 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559e9265cc10 con 0x559e92655010 2024-09-13T06:09:57.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.255+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94139549332528] v33'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36500083f0 con 0x559e92650670 2024-09-13T06:09:57.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.255+0000 7f3656d48640 1 -- 172.21.15.194:0/197969602 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v33'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f364806f030 con 0x559e92655010 2024-09-13T06:09:57.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.255+0000 7f3659238980 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94139549337376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559e9265c130 con 0x559e92655010 2024-09-13T06:09:57.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.255+0000 7f3659238980 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559e9265d620 con 0x7f3648072060 2024-09-13T06:09:57.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.255+0000 7f3656547640 1 -- 172.21.15.194:0/197969602 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(50 notify.3 [create] v33'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f364c0ca070 con 0x7f3648072060 2024-09-13T06:09:57.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.255+0000 7f3659238980 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94139549340016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559e9265dec0 con 0x7f3648072060 2024-09-13T06:09:57.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.255+0000 7f3659238980 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559e9265e8c0 con 0x559e92650670 2024-09-13T06:09:57.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.259+0000 7f3656d48640 1 -- 172.21.15.194:0/197969602 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94139549337376] v33'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f364806f030 con 0x559e92655010 2024-09-13T06:09:57.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.259+0000 7f3656547640 1 -- 172.21.15.194:0/197969602 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94139549340016] v33'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f364c0ca070 con 0x7f3648072060 2024-09-13T06:09:57.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.259+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v33'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36500083f0 con 0x559e92650670 2024-09-13T06:09:57.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.259+0000 7f3659238980 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94139549342224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559e9265e3d0 con 0x559e92650670 2024-09-13T06:09:57.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.259+0000 7f3659238980 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559e9265f160 con 0x7f364c0dc040 2024-09-13T06:09:57.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.259+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94139549342224] v33'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36500083f0 con 0x559e92650670 2024-09-13T06:09:57.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.259+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(54 notify.5 [create] v33'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36500083f0 con 0x7f364c0dc040 2024-09-13T06:09:57.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.259+0000 7f3659238980 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94139549334656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559e9265f0b0 con 0x7f364c0dc040 2024-09-13T06:09:57.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.259+0000 7f3659238980 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559e9265f960 con 0x7f364c0dc040 2024-09-13T06:09:57.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.263+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(56 notify.6 [create] v33'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36500083f0 con 0x7f364c0dc040 2024-09-13T06:09:57.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.263+0000 7f3659238980 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94139549348016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559e92660010 con 0x7f364c0dc040 2024-09-13T06:09:57.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.263+0000 7f3659238980 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559e926608a0 con 0x7f364c0dc040 2024-09-13T06:09:57.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.263+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94139549334656] v33'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36500083f0 con 0x7f364c0dc040 2024-09-13T06:09:57.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.263+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94139549348016] v33'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36500083f0 con 0x7f364c0dc040 2024-09-13T06:09:57.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.263+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(58 notify.7 [create] v33'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36500083f0 con 0x7f364c0dc040 2024-09-13T06:09:57.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.263+0000 7f3659238980 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94139549346816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559e92660010 con 0x7f364c0dc040 2024-09-13T06:09:57.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.263+0000 7f3659238980 20 add_watcher() i=0 2024-09-13T06:09:57.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.263+0000 7f3659238980 20 add_watcher() i=1 2024-09-13T06:09:57.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.263+0000 7f3659238980 20 add_watcher() i=2 2024-09-13T06:09:57.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.263+0000 7f3659238980 20 add_watcher() i=3 2024-09-13T06:09:57.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.263+0000 7f3659238980 20 add_watcher() i=4 2024-09-13T06:09:57.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.263+0000 7f3659238980 20 add_watcher() i=5 2024-09-13T06:09:57.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.263+0000 7f3659238980 20 add_watcher() i=6 2024-09-13T06:09:57.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.267+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94139549346816] v33'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36500083f0 con 0x7f364c0dc040 2024-09-13T06:09:57.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.267+0000 7f3659238980 20 add_watcher() i=7 2024-09-13T06:09:57.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.267+0000 7f3659238980 2 all 8 watchers are set, enabling cache 2024-09-13T06:09:57.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.267+0000 7f3659238980 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559e926639a0 con 0x559e92650670 2024-09-13T06:09:57.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.267+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f36500083f0 con 0x559e92650670 2024-09-13T06:09:57.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.267+0000 7f3659238980 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94139549350720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559e92660e20 con 0x559e92650670 2024-09-13T06:09:57.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.267+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94139549350720] v33'94 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f36500083f0 con 0x559e92650670 2024-09-13T06:09:57.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.267+0000 7f350d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:57.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.267+0000 7f3659238980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:09:57.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.267+0000 7f3659238980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:09:57.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.267+0000 7f3659238980 5 note: GC not initialized 2024-09-13T06:09:57.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.267+0000 7f3487fff640 20 reqs_thread_entry: start 2024-09-13T06:09:57.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.267+0000 7f3659238980 20 init_complete bucket index max shards: 11 2024-09-13T06:09:57.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.267+0000 7f3659238980 20 Filter name: none 2024-09-13T06:09:57.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.267+0000 7f3485ffb640 20 reqs_thread_entry: start 2024-09-13T06:09:57.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.267+0000 7f3659238980 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e926864a0 con 0x559e92655010 2024-09-13T06:09:57.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.267+0000 7f3656d48640 1 -- 172.21.15.194:0/197969602 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(62 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f364806f030 con 0x559e92655010 2024-09-13T06:09:57.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.267+0000 7f3656d48640 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e9265b090 con 0x559e92655010 2024-09-13T06:09:57.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.267+0000 7f3656d48640 1 -- 172.21.15.194:0/197969602 <== osd.3 v2:172.21.15.194:6816/96632515 16 ==== osd_op_reply(63 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f364806f030 con 0x559e92655010 2024-09-13T06:09:57.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.267+0000 7f3656d48640 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e9265b090 con 0x559e92650670 2024-09-13T06:09:57.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.267+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(64 [pgnls start_epoch 33 out=49b] v33'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36500083f0 con 0x559e92650670 2024-09-13T06:09:57.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.267+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e926582d0 con 0x559e92650670 2024-09-13T06:09:57.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.267+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(65 [pgnls start_epoch 33 out=127b] v33'12 uv12 ondisk = 1) ==== 144+0+127 (crc 0 0 0) 0x7f36500083f0 con 0x559e92650670 2024-09-13T06:09:57.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.267+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e926582d0 con 0x7f3648072060 2024-09-13T06:09:57.273 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.267+0000 7f3656547640 1 -- 172.21.15.194:0/197969602 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(66 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f364c0ca070 con 0x7f3648072060 2024-09-13T06:09:57.273 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.267+0000 7f3656547640 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e9265dec0 con 0x559e92655010 2024-09-13T06:09:57.273 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.267+0000 7f3656d48640 1 -- 172.21.15.194:0/197969602 <== osd.3 v2:172.21.15.194:6816/96632515 17 ==== osd_op_reply(67 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f364806f030 con 0x559e92655010 2024-09-13T06:09:57.273 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.271+0000 7f3656d48640 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e9265dec0 con 0x559e92650670 2024-09-13T06:09:57.274 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.271+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(68 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36500083f0 con 0x559e92650670 2024-09-13T06:09:57.274 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.271+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e9265dec0 con 0x559e92655010 2024-09-13T06:09:57.274 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.271+0000 7f3656d48640 1 -- 172.21.15.194:0/197969602 <== osd.3 v2:172.21.15.194:6816/96632515 18 ==== osd_op_reply(69 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f364806f030 con 0x559e92655010 2024-09-13T06:09:57.274 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.271+0000 7f3656d48640 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e9265dec0 con 0x7f3648072060 2024-09-13T06:09:57.274 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.271+0000 7f3656547640 1 -- 172.21.15.194:0/197969602 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(70 [pgnls start_epoch 33 out=49b] v33'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f364c0ca070 con 0x7f3648072060 2024-09-13T06:09:57.274 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.271+0000 7f3656547640 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e9265dec0 con 0x559e92655010 2024-09-13T06:09:57.274 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.271+0000 7f3656d48640 1 -- 172.21.15.194:0/197969602 <== osd.3 v2:172.21.15.194:6816/96632515 19 ==== osd_op_reply(71 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f364806f030 con 0x559e92655010 2024-09-13T06:09:57.274 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.271+0000 7f3656d48640 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e9265dec0 con 0x559e92650670 2024-09-13T06:09:57.274 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.271+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(72 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36500083f0 con 0x559e92650670 2024-09-13T06:09:57.274 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.271+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e9265dec0 con 0x7f364c0dc040 2024-09-13T06:09:57.274 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.271+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(73 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36500083f0 con 0x7f364c0dc040 2024-09-13T06:09:57.274 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.271+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e9265dec0 con 0x7f364c0dc040 2024-09-13T06:09:57.274 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.271+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(74 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36500083f0 con 0x7f364c0dc040 2024-09-13T06:09:57.275 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.271+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e9265dec0 con 0x559e92655010 2024-09-13T06:09:57.275 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.271+0000 7f3656d48640 1 -- 172.21.15.194:0/197969602 <== osd.3 v2:172.21.15.194:6816/96632515 20 ==== osd_op_reply(75 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f364806f030 con 0x559e92655010 2024-09-13T06:09:57.275 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.271+0000 7f3656d48640 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e9265dec0 con 0x7f364c0dc040 2024-09-13T06:09:57.277 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.271+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(76 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36500083f0 con 0x7f364c0dc040 2024-09-13T06:09:57.277 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.271+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e9265dec0 con 0x7f364c0dc040 2024-09-13T06:09:57.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.271+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 <== osd.0 v2:172.21.15.120:6800/1923744619 20 ==== osd_op_reply(77 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36500083f0 con 0x7f364c0dc040 2024-09-13T06:09:57.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.271+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e9265dec0 con 0x7f364c0dc040 2024-09-13T06:09:57.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.275+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 <== osd.0 v2:172.21.15.120:6800/1923744619 21 ==== osd_op_reply(78 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36500083f0 con 0x7f364c0dc040 2024-09-13T06:09:57.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.275+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e9265dec0 con 0x559e92655010 2024-09-13T06:09:57.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.275+0000 7f3656d48640 1 -- 172.21.15.194:0/197969602 <== osd.3 v2:172.21.15.194:6816/96632515 21 ==== osd_op_reply(79 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f364806f030 con 0x559e92655010 2024-09-13T06:09:57.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.275+0000 7f3656d48640 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e9265dec0 con 0x7f3648072060 2024-09-13T06:09:57.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.275+0000 7f3656547640 1 -- 172.21.15.194:0/197969602 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(80 [pgnls start_epoch 33 out=70b] v33'2 uv2 ondisk = 1) ==== 144+0+70 (crc 0 0 0) 0x7f364c0ca070 con 0x7f3648072060 2024-09-13T06:09:57.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.275+0000 7f3656547640 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e9265dec0 con 0x559e92650670 2024-09-13T06:09:57.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.275+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 <== osd.1 v2:172.21.15.194:6808/3135444559 25 ==== osd_op_reply(81 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36500083f0 con 0x559e92650670 2024-09-13T06:09:57.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.275+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e9265dec0 con 0x559e92650670 2024-09-13T06:09:57.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.275+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 <== osd.1 v2:172.21.15.194:6808/3135444559 26 ==== osd_op_reply(82 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36500083f0 con 0x559e92650670 2024-09-13T06:09:57.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.275+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e9265dec0 con 0x559e92655010 2024-09-13T06:09:57.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.275+0000 7f3656d48640 1 -- 172.21.15.194:0/197969602 <== osd.3 v2:172.21.15.194:6816/96632515 22 ==== osd_op_reply(83 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f364806f030 con 0x559e92655010 2024-09-13T06:09:57.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.275+0000 7f3656d48640 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e9265dec0 con 0x7f3648072060 2024-09-13T06:09:57.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.275+0000 7f3656547640 1 -- 172.21.15.194:0/197969602 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== osd_op_reply(84 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f364c0ca070 con 0x7f3648072060 2024-09-13T06:09:57.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.275+0000 7f3656547640 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e9265dec0 con 0x7f364c0dc040 2024-09-13T06:09:57.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.275+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 <== osd.0 v2:172.21.15.120:6800/1923744619 22 ==== osd_op_reply(85 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36500083f0 con 0x7f364c0dc040 2024-09-13T06:09:57.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.275+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e9265dec0 con 0x559e92650670 2024-09-13T06:09:57.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.275+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 <== osd.1 v2:172.21.15.194:6808/3135444559 27 ==== osd_op_reply(86 [pgnls start_epoch 33 out=49b] v33'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36500083f0 con 0x559e92650670 2024-09-13T06:09:57.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.275+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e9265dec0 con 0x7f364c0dc040 2024-09-13T06:09:57.281 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.279+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 <== osd.0 v2:172.21.15.120:6800/1923744619 23 ==== osd_op_reply(87 [pgnls start_epoch 33 out=49b] v33'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36500083f0 con 0x7f364c0dc040 2024-09-13T06:09:57.281 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.279+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e9265dec0 con 0x559e92655010 2024-09-13T06:09:57.281 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.279+0000 7f3656d48640 1 -- 172.21.15.194:0/197969602 <== osd.3 v2:172.21.15.194:6816/96632515 23 ==== osd_op_reply(88 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f364806f030 con 0x559e92655010 2024-09-13T06:09:57.281 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.279+0000 7f3656d48640 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e9265dec0 con 0x7f3648072060 2024-09-13T06:09:57.281 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.279+0000 7f3656547640 1 -- 172.21.15.194:0/197969602 <== osd.2 v2:172.21.15.194:6800/815615585 16 ==== osd_op_reply(89 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f364c0ca070 con 0x7f3648072060 2024-09-13T06:09:57.282 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.279+0000 7f3656547640 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e9265dec0 con 0x7f364c0dc040 2024-09-13T06:09:57.282 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.279+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 <== osd.0 v2:172.21.15.120:6800/1923744619 24 ==== osd_op_reply(90 [pgnls start_epoch 33 out=49b] v33'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36500083f0 con 0x7f364c0dc040 2024-09-13T06:09:57.282 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.279+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e9265dec0 con 0x559e92650670 2024-09-13T06:09:57.282 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.279+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 <== osd.1 v2:172.21.15.194:6808/3135444559 28 ==== osd_op_reply(91 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36500083f0 con 0x559e92650670 2024-09-13T06:09:57.282 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.279+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e9265dec0 con 0x559e92655010 2024-09-13T06:09:57.282 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.279+0000 7f3656d48640 1 -- 172.21.15.194:0/197969602 <== osd.3 v2:172.21.15.194:6816/96632515 24 ==== osd_op_reply(92 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f364806f030 con 0x559e92655010 2024-09-13T06:09:57.282 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.279+0000 7f3656d48640 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559e9265dec0 con 0x7f3648072060 2024-09-13T06:09:57.282 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.279+0000 7f3656547640 1 -- 172.21.15.194:0/197969602 <== osd.2 v2:172.21.15.194:6800/815615585 17 ==== osd_op_reply(93 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f364c0ca070 con 0x7f3648072060 2024-09-13T06:09:57.282 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.279+0000 7f3659238980 20 RGWRados::pool_iterate: got .bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 2024-09-13T06:09:57.282 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.279+0000 7f3659238980 20 RGWRados::pool_iterate: got myfoo 2024-09-13T06:09:57.282 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.279+0000 7f350d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:57.282 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.279+0000 7f3659238980 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94139549350720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559e9265b090 con 0x559e92650670 2024-09-13T06:09:57.283 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.279+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 <== osd.1 v2:172.21.15.194:6808/3135444559 29 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94139549350720] v33'95 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f36500083f0 con 0x559e92650670 2024-09-13T06:09:57.283 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.283+0000 7f3659238980 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94139549329696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559e926582d0 con 0x7f3648072060 2024-09-13T06:09:57.283 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.283+0000 7f3656547640 1 -- 172.21.15.194:0/197969602 <== osd.2 v2:172.21.15.194:6800/815615585 18 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94139549329696] v33'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f364c0ca070 con 0x7f3648072060 2024-09-13T06:09:57.283 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.283+0000 7f3659238980 20 remove_watcher() i=0 2024-09-13T06:09:57.283 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.283+0000 7f3659238980 2 removed watcher, disabling cache 2024-09-13T06:09:57.284 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.283+0000 7f3659238980 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94139549332528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559e926582d0 con 0x559e92650670 2024-09-13T06:09:57.285 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.283+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 <== osd.1 v2:172.21.15.194:6808/3135444559 30 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94139549332528] v33'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36500083f0 con 0x559e92650670 2024-09-13T06:09:57.286 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.283+0000 7f3659238980 20 remove_watcher() i=1 2024-09-13T06:09:57.286 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.283+0000 7f3659238980 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94139549337376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559e926582d0 con 0x559e92655010 2024-09-13T06:09:57.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.287+0000 7f3656d48640 1 -- 172.21.15.194:0/197969602 <== osd.3 v2:172.21.15.194:6816/96632515 25 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94139549337376] v33'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f364806f030 con 0x559e92655010 2024-09-13T06:09:57.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.287+0000 7f3659238980 20 remove_watcher() i=2 2024-09-13T06:09:57.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.287+0000 7f3659238980 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94139549340016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559e926847c0 con 0x7f3648072060 2024-09-13T06:09:57.288 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.287+0000 7f3656547640 1 -- 172.21.15.194:0/197969602 <== osd.2 v2:172.21.15.194:6800/815615585 19 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94139549340016] v33'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f364c0ca070 con 0x7f3648072060 2024-09-13T06:09:57.288 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.287+0000 7f3659238980 20 remove_watcher() i=3 2024-09-13T06:09:57.288 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.287+0000 7f3659238980 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94139549342224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559e926847c0 con 0x559e92650670 2024-09-13T06:09:57.290 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.291+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 <== osd.1 v2:172.21.15.194:6808/3135444559 31 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94139549342224] v33'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36500083f0 con 0x559e92650670 2024-09-13T06:09:57.290 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.291+0000 7f3659238980 20 remove_watcher() i=4 2024-09-13T06:09:57.290 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.291+0000 7f3659238980 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94139549334656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559e926847c0 con 0x7f364c0dc040 2024-09-13T06:09:57.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.291+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 <== osd.0 v2:172.21.15.120:6800/1923744619 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94139549334656] v33'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36500083f0 con 0x7f364c0dc040 2024-09-13T06:09:57.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.291+0000 7f3659238980 20 remove_watcher() i=5 2024-09-13T06:09:57.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.291+0000 7f3659238980 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94139549348016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559e926847c0 con 0x7f364c0dc040 2024-09-13T06:09:57.294 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.295+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 <== osd.0 v2:172.21.15.120:6800/1923744619 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94139549348016] v33'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36500083f0 con 0x7f364c0dc040 2024-09-13T06:09:57.295 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.295+0000 7f3659238980 20 remove_watcher() i=6 2024-09-13T06:09:57.295 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.295+0000 7f3659238980 1 -- 172.21.15.194:0/197969602 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94139549346816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559e926847c0 con 0x7f364c0dc040 2024-09-13T06:09:57.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.295+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 <== osd.0 v2:172.21.15.120:6800/1923744619 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94139549346816] v33'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36500083f0 con 0x7f364c0dc040 2024-09-13T06:09:57.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.295+0000 7f3659238980 20 remove_watcher() i=7 2024-09-13T06:09:57.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.295+0000 7f3659238980 1 -- 172.21.15.194:0/197969602 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f364c0dc040 msgr2=0x7f364c0cd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:57.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.295+0000 7f3659238980 1 --2- 172.21.15.194:0/197969602 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f364c0dc040 0x7f364c0cd430 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:57.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.295+0000 7f3659238980 1 -- 172.21.15.194:0/197969602 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x559e92650670 msgr2=0x559e92652b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:57.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.295+0000 7f3659238980 1 --2- 172.21.15.194:0/197969602 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x559e92650670 0x559e92652b10 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:57.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.295+0000 7f3659238980 1 -- 172.21.15.194:0/197969602 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f3648072060 msgr2=0x7f364804e1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:57.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.295+0000 7f3659238980 1 --2- 172.21.15.194:0/197969602 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f3648072060 0x7f364804e1b0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:57.300 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.295+0000 7f3659238980 1 -- 172.21.15.194:0/197969602 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x559e92655010 msgr2=0x559e92657400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:57.300 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.295+0000 7f3659238980 1 --2- 172.21.15.194:0/197969602 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x559e92655010 0x559e92657400 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:57.300 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.295+0000 7f3659238980 1 -- 172.21.15.194:0/197969602 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f35200345b0 msgr2=0x7f3520036a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:57.300 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.295+0000 7f3659238980 1 --2- 172.21.15.194:0/197969602 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f35200345b0 0x7f3520036a70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f364c01b0d0 tx=0x7f364c0a6000 comp rx=0 tx=0).stop 2024-09-13T06:09:57.300 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.295+0000 7f3657549640 1 -- 172.21.15.194:0/197969602 reap_dead start 2024-09-13T06:09:57.300 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.295+0000 7f3659238980 1 -- 172.21.15.194:0/197969602 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e9263e560 msgr2=0x559e92645700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:57.300 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.295+0000 7f3659238980 1 --2- 172.21.15.194:0/197969602 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e9263e560 0x559e92645700 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f36480475c0 tx=0x7f364804ef50 comp rx=0 tx=0).stop 2024-09-13T06:09:57.300 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.295+0000 7f3659238980 1 -- 172.21.15.194:0/197969602 shutdown_connections 2024-09-13T06:09:57.300 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.295+0000 7f3659238980 1 --2- 172.21.15.194:0/197969602 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e9263e560 0x559e92645700 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:57.300 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.295+0000 7f3659238980 1 -- 172.21.15.194:0/197969602 >> 172.21.15.194:0/197969602 conn(0x559e9263a8f0 msgr2=0x559e926389c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:57.300 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.295+0000 7f3659238980 1 -- 172.21.15.194:0/197969602 shutdown_connections 2024-09-13T06:09:57.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.295+0000 7f3659238980 1 -- 172.21.15.194:0/197969602 wait complete. 2024-09-13T06:09:57.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.295+0000 7f3659238980 1 -- 172.21.15.194:0/2773278466 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3530034650 msgr2=0x7f3530036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:57.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.295+0000 7f3659238980 1 --2- 172.21.15.194:0/2773278466 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3530034650 0x7f3530036b10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x559e9261b940 tx=0x7f364c005e50 comp rx=0 tx=0).stop 2024-09-13T06:09:57.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.295+0000 7f3659238980 1 -- 172.21.15.194:0/2773278466 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e92631c80 msgr2=0x559e926320a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:57.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.295+0000 7f3659238980 1 --2- 172.21.15.194:0/2773278466 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e92631c80 0x559e926320a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f36480487a0 tx=0x7f364800ee90 comp rx=0 tx=0).stop 2024-09-13T06:09:57.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.295+0000 7f3659238980 1 -- 172.21.15.194:0/2773278466 shutdown_connections 2024-09-13T06:09:57.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.295+0000 7f3659238980 1 --2- 172.21.15.194:0/2773278466 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3530034650 0x7f3530036b10 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:57.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.295+0000 7f3659238980 1 --2- 172.21.15.194:0/2773278466 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e92631c80 0x559e926320a0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:57.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.295+0000 7f3659238980 1 -- 172.21.15.194:0/2773278466 >> 172.21.15.194:0/2773278466 conn(0x559e92626dd0 msgr2=0x559e92629850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:57.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.295+0000 7f3659238980 1 -- 172.21.15.194:0/2773278466 shutdown_connections 2024-09-13T06:09:57.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.295+0000 7f3659238980 1 -- 172.21.15.194:0/2773278466 wait complete. 2024-09-13T06:09:57.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.295+0000 7f3659238980 1 -- 172.21.15.194:0/3678072172 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x559e925259c0 msgr2=0x559e9261aec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:57.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.295+0000 7f3659238980 1 --2- 172.21.15.194:0/3678072172 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x559e925259c0 0x559e9261aec0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:57.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.295+0000 7f3659238980 1 -- 172.21.15.194:0/3678072172 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x559e92621700 msgr2=0x559e92623af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:57.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.295+0000 7f3659238980 1 --2- 172.21.15.194:0/3678072172 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x559e92621700 0x559e92623af0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:57.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.295+0000 7f3659238980 1 -- 172.21.15.194:0/3678072172 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x559e9261d7c0 msgr2=0x559e9261fbb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:57.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.295+0000 7f3659238980 1 --2- 172.21.15.194:0/3678072172 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x559e9261d7c0 0x559e9261fbb0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:57.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.295+0000 7f3659238980 1 -- 172.21.15.194:0/3678072172 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f353c034650 msgr2=0x7f353c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:57.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.295+0000 7f3659238980 1 --2- 172.21.15.194:0/3678072172 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f353c034650 0x7f353c036b10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f364c0ab000 tx=0x7f364c0a5000 comp rx=0 tx=0).stop 2024-09-13T06:09:57.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.295+0000 7f3659238980 1 -- 172.21.15.194:0/3678072172 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e92521640 msgr2=0x559e92613dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:57.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.295+0000 7f3659238980 1 --2- 172.21.15.194:0/3678072172 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559e92521640 0x559e92613dc0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3648001fd0 tx=0x7f3648000bd0 comp rx=0 tx=0).stop 2024-09-13T06:09:57.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.295+0000 7f3657549640 1 -- 172.21.15.194:0/3678072172 reap_dead start 2024-09-13T06:09:57.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.295+0000 7f3659238980 1 -- 172.21.15.194:0/3678072172 shutdown_connections 2024-09-13T06:09:57.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.295+0000 7f3659238980 1 -- 172.21.15.194:0/3678072172 >> 172.21.15.194:0/3678072172 conn(0x559e9251d160 msgr2=0x559e926071c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:57.303 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.295+0000 7f3659238980 1 -- 172.21.15.194:0/3678072172 shutdown_connections 2024-09-13T06:09:57.303 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.295+0000 7f3659238980 1 -- 172.21.15.194:0/3678072172 wait complete. 2024-09-13T06:09:57.307 INFO:teuthology.orchestra.run.smithi194.stdout:["myfoo"] 2024-09-13T06:09:57.307 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-09-13T06:09:57.322 INFO:tasks.radosgw_admin:RL: create_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T06:09:57.336 INFO:tasks.radosgw_admin:RL: create_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T06:09:57.352 INFO:tasks.radosgw_admin:RL: create_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T06:09:57.397 INFO:tasks.radosgw_admin:RL: create_bucket myfoo5 foo bytes_out=0 bytes_in=237 failed=True 2024-09-13T06:09:57.467 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T06:09:57.536 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T06:09:57.608 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T06:09:57.608 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-13T06:09:57.608 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-13T06:09:57.608 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-13T06:09:57.646 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:09:57.646 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:09:57.647 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.647+0000 7fa94ff72980 1 Processor -- start 2024-09-13T06:09:57.647 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.647+0000 7fa94ff72980 1 -- start start 2024-09-13T06:09:57.647 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.647+0000 7fa94ff72980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x559b742afc60 0x559b742b2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:57.647 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.647+0000 7fa94ff72980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559b74131ae0 con 0x559b742ab8e0 2024-09-13T06:09:57.647 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.647+0000 7fa94ff72980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x559b74155e30 con 0x559b742afc60 2024-09-13T06:09:57.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.647+0000 7fa94d281640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x559b742afc60 0x559b742b2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:57.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.647+0000 7fa94d281640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x559b742afc60 0x559b742b2050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45304/0 (socket says 172.21.15.194:45304) 2024-09-13T06:09:57.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.647+0000 7fa94d281640 1 -- 172.21.15.194:0/3022019280 learned_addr learned my addr 172.21.15.194:0/3022019280 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:57.649 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.647+0000 7fa94d281640 1 -- 172.21.15.194:0/3022019280 >> v1:172.21.15.120:6789/0 conn(0x559b742ab8e0 legacy=0x559b742abcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:57.649 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.647+0000 7fa94d281640 1 -- 172.21.15.194:0/3022019280 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b742b35a0 con 0x559b742afc60 2024-09-13T06:09:57.652 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.651+0000 7fa94d281640 1 --2- 172.21.15.194:0/3022019280 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559b742afc60 0x559b742b2050 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa94400a5c0 tx=0x7fa94401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b293daf347caa941 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:57.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.651+0000 7fa94ca80640 1 -- 172.21.15.194:0/3022019280 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9440a6070 con 0x559b742afc60 2024-09-13T06:09:57.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.651+0000 7fa94ca80640 1 -- 172.21.15.194:0/3022019280 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9440af070 con 0x559b742afc60 2024-09-13T06:09:57.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.651+0000 7fa94ca80640 1 -- 172.21.15.194:0/3022019280 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9440aa5c0 con 0x559b742afc60 2024-09-13T06:09:57.654 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.651+0000 7fa94ff72980 1 -- 172.21.15.194:0/3022019280 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559b742afc60 msgr2=0x559b742b2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:57.654 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.651+0000 7fa94ff72980 1 --2- 172.21.15.194:0/3022019280 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559b742afc60 0x559b742b2050 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa94400a5c0 tx=0x7fa94401b340 comp rx=0 tx=0).stop 2024-09-13T06:09:57.654 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.651+0000 7fa94ff72980 1 -- 172.21.15.194:0/3022019280 shutdown_connections 2024-09-13T06:09:57.654 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.651+0000 7fa94ff72980 1 --2- 172.21.15.194:0/3022019280 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559b742afc60 0x559b742b2050 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:57.654 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.651+0000 7fa94ff72980 1 -- 172.21.15.194:0/3022019280 >> 172.21.15.194:0/3022019280 conn(0x559b7421f230 msgr2=0x559b7421f640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:57.654 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.651+0000 7fa94ff72980 1 -- 172.21.15.194:0/3022019280 shutdown_connections 2024-09-13T06:09:57.654 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.651+0000 7fa94ff72980 1 -- 172.21.15.194:0/3022019280 wait complete. 2024-09-13T06:09:57.794 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.667+0000 7fa94ff72980 1 Processor -- start 2024-09-13T06:09:57.794 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.671+0000 7fa94ff72980 1 -- start start 2024-09-13T06:09:57.794 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.671+0000 7fa94ff72980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559b742ab8e0 0x559b74396c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:57.794 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.671+0000 7fa94ff72980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x559b74157200 con 0x559b742ab8e0 2024-09-13T06:09:57.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.671+0000 7fa94da82640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559b742ab8e0 0x559b74396c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:57.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.671+0000 7fa94da82640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559b742ab8e0 0x559b74396c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45306/0 (socket says 172.21.15.194:45306) 2024-09-13T06:09:57.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.671+0000 7fa94da82640 1 -- 172.21.15.194:0/1898891622 learned_addr learned my addr 172.21.15.194:0/1898891622 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:57.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.671+0000 7fa94da82640 1 -- 172.21.15.194:0/1898891622 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b74397200 con 0x559b742ab8e0 2024-09-13T06:09:57.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.671+0000 7fa94da82640 1 --2- 172.21.15.194:0/1898891622 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559b742ab8e0 0x559b74396c30 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fa94000b1f0 tx=0x7fa94000b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8373807a1a23e3a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:57.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.671+0000 7fa83be07640 1 -- 172.21.15.194:0/1898891622 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa94000a040 con 0x559b742ab8e0 2024-09-13T06:09:57.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.671+0000 7fa83be07640 1 -- 172.21.15.194:0/1898891622 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa94000f750 con 0x559b742ab8e0 2024-09-13T06:09:57.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.671+0000 7fa83be07640 1 -- 172.21.15.194:0/1898891622 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa94000fa70 con 0x559b742ab8e0 2024-09-13T06:09:57.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.671+0000 7fa94ff72980 1 -- 172.21.15.194:0/1898891622 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559b742ab8e0 msgr2=0x559b74396c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:57.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.671+0000 7fa94ff72980 1 --2- 172.21.15.194:0/1898891622 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559b742ab8e0 0x559b74396c30 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fa94000b1f0 tx=0x7fa94000b6b0 comp rx=0 tx=0).stop 2024-09-13T06:09:57.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.671+0000 7fa94ff72980 1 -- 172.21.15.194:0/1898891622 shutdown_connections 2024-09-13T06:09:57.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.671+0000 7fa94ff72980 1 --2- 172.21.15.194:0/1898891622 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559b742ab8e0 0x559b74396c30 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:57.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.671+0000 7fa94ff72980 1 -- 172.21.15.194:0/1898891622 >> 172.21.15.194:0/1898891622 conn(0x559b7421f230 msgr2=0x559b74392860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:57.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.671+0000 7fa94ff72980 1 -- 172.21.15.194:0/1898891622 shutdown_connections 2024-09-13T06:09:57.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.671+0000 7fa94ff72980 1 -- 172.21.15.194:0/1898891622 wait complete. 2024-09-13T06:09:57.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.671+0000 7fa94ff72980 1 Processor -- start 2024-09-13T06:09:57.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.671+0000 7fa94ff72980 1 -- start start 2024-09-13T06:09:57.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.671+0000 7fa94ff72980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559b742ab8e0 0x559b7439dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:57.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.671+0000 7fa94ff72980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x559b742b30a0 con 0x559b742ab8e0 2024-09-13T06:09:57.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.671+0000 7fa94da82640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559b742ab8e0 0x559b7439dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:57.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.671+0000 7fa94da82640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559b742ab8e0 0x559b7439dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45308/0 (socket says 172.21.15.194:45308) 2024-09-13T06:09:57.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.671+0000 7fa94da82640 1 -- 172.21.15.194:0/212931433 learned_addr learned my addr 172.21.15.194:0/212931433 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:57.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.675+0000 7fa94da82640 1 -- 172.21.15.194:0/212931433 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b7439e500 con 0x559b742ab8e0 2024-09-13T06:09:57.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.675+0000 7fa94da82640 1 --2- 172.21.15.194:0/212931433 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559b742ab8e0 0x559b7439dfc0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fa94000b6f0 tx=0x7fa940000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:57.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.675+0000 7fa83a604640 1 -- 172.21.15.194:0/212931433 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa940001300 con 0x559b742ab8e0 2024-09-13T06:09:57.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.675+0000 7fa94ff72980 1 -- 172.21.15.194:0/212931433 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559b7439e790 con 0x559b742ab8e0 2024-09-13T06:09:57.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.675+0000 7fa94ff72980 1 -- 172.21.15.194:0/212931433 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b743a1470 con 0x559b742ab8e0 2024-09-13T06:09:57.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.675+0000 7fa83a604640 1 -- 172.21.15.194:0/212931433 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa94001c9c0 con 0x559b742ab8e0 2024-09-13T06:09:57.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.675+0000 7fa83a604640 1 -- 172.21.15.194:0/212931433 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa94002c060 con 0x559b742ab8e0 2024-09-13T06:09:57.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.675+0000 7fa83a604640 1 -- 172.21.15.194:0/212931433 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa940017050 con 0x559b742ab8e0 2024-09-13T06:09:57.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.675+0000 7fa83a604640 1 --2- 172.21.15.194:0/212931433 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa8340346a0 0x7fa834036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:57.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.675+0000 7fa83a604640 1 -- 172.21.15.194:0/212931433 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fa940015020 con 0x559b742ab8e0 2024-09-13T06:09:57.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.675+0000 7fa94d281640 1 --2- 172.21.15.194:0/212931433 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa8340346a0 0x7fa834036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:57.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.675+0000 7fa94ff72980 1 --2- 172.21.15.194:0/212931433 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x559b742afc60 0x559b743a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:57.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.675+0000 7fa94ff72980 1 -- 172.21.15.194:0/212931433 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b743a5600 con 0x559b742afc60 2024-09-13T06:09:57.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.675+0000 7fa94e283640 1 --2- 172.21.15.194:0/212931433 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x559b742afc60 0x559b743a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:57.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.675+0000 7fa94d281640 1 --2- 172.21.15.194:0/212931433 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa8340346a0 0x7fa834036b60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa9440ae000 tx=0x7fa9440a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:57.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.675+0000 7fa94e283640 1 --2- 172.21.15.194:0/212931433 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x559b742afc60 0x559b743a50c0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:57.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.675+0000 7fa94e283640 1 -- 172.21.15.194:0/212931433 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa94800a4d0 con 0x559b742afc60 2024-09-13T06:09:57.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.675+0000 7fa94ff72980 1 -- 172.21.15.194:0/212931433 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b743a2690 con 0x559b742afc60 2024-09-13T06:09:57.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.679+0000 7fa94e283640 1 -- 172.21.15.194:0/212931433 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa94800a4d0 con 0x559b742afc60 2024-09-13T06:09:57.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.679+0000 7fa94ff72980 1 --2- 172.21.15.194:0/212931433 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x559b743a7960 0x559b743a9d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:57.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.679+0000 7fa94ff72980 1 -- 172.21.15.194:0/212931433 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b743aa440 con 0x559b743a7960 2024-09-13T06:09:57.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.679+0000 7fa94da82640 1 --2- 172.21.15.194:0/212931433 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x559b743a7960 0x559b743a9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:57.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.679+0000 7fa94da82640 1 --2- 172.21.15.194:0/212931433 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x559b743a7960 0x559b743a9d50 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:57.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.679+0000 7fa94da82640 1 -- 172.21.15.194:0/212931433 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa94002e070 con 0x559b743a7960 2024-09-13T06:09:57.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.679+0000 7fa94ff72980 1 -- 172.21.15.194:0/212931433 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b743a6800 con 0x559b742afc60 2024-09-13T06:09:57.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.679+0000 7fa94e283640 1 -- 172.21.15.194:0/212931433 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa94800a4d0 con 0x559b742afc60 2024-09-13T06:09:57.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.679+0000 7fa94ff72980 1 --2- 172.21.15.194:0/212931433 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x559b743ab8a0 0x559b743adc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:57.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.679+0000 7fa94ff72980 1 -- 172.21.15.194:0/212931433 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b743ae3d0 con 0x559b743ab8a0 2024-09-13T06:09:57.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.679+0000 7fa94d281640 1 --2- 172.21.15.194:0/212931433 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x559b743ab8a0 0x559b743adc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:57.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.679+0000 7fa94d281640 1 --2- 172.21.15.194:0/212931433 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x559b743ab8a0 0x559b743adc90 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:57.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.679+0000 7fa94d281640 1 -- 172.21.15.194:0/212931433 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa9440aaad0 con 0x559b743ab8a0 2024-09-13T06:09:57.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.679+0000 7fa94ff72980 1 Processor -- start 2024-09-13T06:09:57.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.679+0000 7fa94ff72980 1 -- start start 2024-09-13T06:09:57.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.679+0000 7fa94ff72980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559b743bbe60 0x559b743bc280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:57.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.679+0000 7fa94ff72980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x559b741b0800 con 0x559b743bbe60 2024-09-13T06:09:57.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.679+0000 7fa94da82640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559b743bbe60 0x559b743bc280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:57.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.679+0000 7fa94da82640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559b743bbe60 0x559b743bc280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45322/0 (socket says 172.21.15.194:45322) 2024-09-13T06:09:57.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.679+0000 7fa94da82640 1 -- 172.21.15.194:0/3551483157 learned_addr learned my addr 172.21.15.194:0/3551483157 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:57.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.679+0000 7fa94da82640 1 -- 172.21.15.194:0/3551483157 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b743bc7c0 con 0x559b743bbe60 2024-09-13T06:09:57.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.679+0000 7fa94da82640 1 --2- 172.21.15.194:0/3551483157 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559b743bbe60 0x559b743bc280 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa940000c10 tx=0x7fa9400474b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:57.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.683+0000 7fa8337fe640 1 -- 172.21.15.194:0/3551483157 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa94002f960 con 0x559b743bbe60 2024-09-13T06:09:57.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.683+0000 7fa8337fe640 1 -- 172.21.15.194:0/3551483157 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa94002fb00 con 0x559b743bbe60 2024-09-13T06:09:57.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.683+0000 7fa94ff72980 1 -- 172.21.15.194:0/3551483157 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559b743bca50 con 0x559b743bbe60 2024-09-13T06:09:57.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.683+0000 7fa8337fe640 1 -- 172.21.15.194:0/3551483157 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa94002fe20 con 0x559b743bbe60 2024-09-13T06:09:57.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.683+0000 7fa94ff72980 1 -- 172.21.15.194:0/3551483157 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b743bf6d0 con 0x559b743bbe60 2024-09-13T06:09:57.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.683+0000 7fa8337fe640 1 -- 172.21.15.194:0/3551483157 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa94001a480 con 0x559b743bbe60 2024-09-13T06:09:57.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.683+0000 7fa8337fe640 1 --2- 172.21.15.194:0/3551483157 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa828034650 0x7fa828036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:57.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.683+0000 7fa8337fe640 1 -- 172.21.15.194:0/3551483157 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fa94003dc70 con 0x559b743bbe60 2024-09-13T06:09:57.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.683+0000 7fa94d281640 1 --2- 172.21.15.194:0/3551483157 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa828034650 0x7fa828036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:57.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.683+0000 7fa94ff72980 1 Processor -- start 2024-09-13T06:09:57.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.683+0000 7fa94ff72980 1 -- start start 2024-09-13T06:09:57.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.683+0000 7fa94d281640 1 --2- 172.21.15.194:0/3551483157 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa828034650 0x7fa828036b10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x559b743a5ae0 tx=0x7fa944005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:57.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.683+0000 7fa94ff72980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559b743c8720 0x559b743c8b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:57.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.683+0000 7fa94ff72980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x559b74397580 con 0x559b743c8720 2024-09-13T06:09:57.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.683+0000 7fa94da82640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559b743c8720 0x559b743c8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:57.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.683+0000 7fa94da82640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559b743c8720 0x559b743c8b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45336/0 (socket says 172.21.15.194:45336) 2024-09-13T06:09:57.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.683+0000 7fa94da82640 1 -- 172.21.15.194:0/159205494 learned_addr learned my addr 172.21.15.194:0/159205494 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:57.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.683+0000 7fa94da82640 1 -- 172.21.15.194:0/159205494 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b743c90f0 con 0x559b743c8720 2024-09-13T06:09:57.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.683+0000 7fa94da82640 1 --2- 172.21.15.194:0/159205494 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559b743c8720 0x559b743c8b20 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa940048fd0 tx=0x7fa940042d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8444e4ad7d21ef2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:57.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.683+0000 7fa8317fa640 1 -- 172.21.15.194:0/159205494 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa94000a2b0 con 0x559b743c8720 2024-09-13T06:09:57.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.683+0000 7fa8317fa640 1 -- 172.21.15.194:0/159205494 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa940042500 con 0x559b743c8720 2024-09-13T06:09:57.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.683+0000 7fa8317fa640 1 -- 172.21.15.194:0/159205494 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa94000a450 con 0x559b743c8720 2024-09-13T06:09:57.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.687+0000 7fa94ff72980 1 -- 172.21.15.194:0/159205494 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559b743c8720 msgr2=0x559b743c8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:57.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.687+0000 7fa94ff72980 1 --2- 172.21.15.194:0/159205494 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559b743c8720 0x559b743c8b20 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa940048fd0 tx=0x7fa940042d90 comp rx=0 tx=0).stop 2024-09-13T06:09:57.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.687+0000 7fa94ff72980 1 -- 172.21.15.194:0/159205494 shutdown_connections 2024-09-13T06:09:57.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.687+0000 7fa94ff72980 1 --2- 172.21.15.194:0/159205494 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559b743c8720 0x559b743c8b20 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:57.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.687+0000 7fa94ff72980 1 -- 172.21.15.194:0/159205494 >> 172.21.15.194:0/159205494 conn(0x559b743c4b90 msgr2=0x559b743c2c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:57.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.687+0000 7fa94ff72980 1 -- 172.21.15.194:0/159205494 shutdown_connections 2024-09-13T06:09:57.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.687+0000 7fa94ff72980 1 -- 172.21.15.194:0/159205494 wait complete. 2024-09-13T06:09:57.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.687+0000 7fa94ff72980 1 Processor -- start 2024-09-13T06:09:57.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.687+0000 7fa94ff72980 1 -- start start 2024-09-13T06:09:57.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.687+0000 7fa94ff72980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559b743c8720 0x559b743cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:57.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.687+0000 7fa94ff72980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x559b743c9600 con 0x559b743c8720 2024-09-13T06:09:57.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.687+0000 7fa94da82640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559b743c8720 0x559b743cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:57.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.687+0000 7fa94da82640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559b743c8720 0x559b743cf9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45346/0 (socket says 172.21.15.194:45346) 2024-09-13T06:09:57.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.687+0000 7fa94da82640 1 -- 172.21.15.194:0/1645445439 learned_addr learned my addr 172.21.15.194:0/1645445439 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:57.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.687+0000 7fa94da82640 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b743cff30 con 0x559b743c8720 2024-09-13T06:09:57.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.687+0000 7fa94da82640 1 --2- 172.21.15.194:0/1645445439 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559b743c8720 0x559b743cf9f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa940047590 tx=0x7fa94000de90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:57.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.687+0000 7fa81f7fe640 1 -- 172.21.15.194:0/1645445439 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa94004a480 con 0x559b743c8720 2024-09-13T06:09:57.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.687+0000 7fa81f7fe640 1 -- 172.21.15.194:0/1645445439 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa94006c070 con 0x559b743c8720 2024-09-13T06:09:57.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.687+0000 7fa94ff72980 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559b743cff30 con 0x559b743c8720 2024-09-13T06:09:57.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.687+0000 7fa81f7fe640 1 -- 172.21.15.194:0/1645445439 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa940041760 con 0x559b743c8720 2024-09-13T06:09:57.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.687+0000 7fa94ff72980 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b743cff30 con 0x559b743c8720 2024-09-13T06:09:57.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.687+0000 7fa81f7fe640 1 -- 172.21.15.194:0/1645445439 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa940041900 con 0x559b743c8720 2024-09-13T06:09:57.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.687+0000 7fa94ff72980 20 rados->read ofs=0 len=0 2024-09-13T06:09:57.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.691+0000 7fa81f7fe640 1 --2- 172.21.15.194:0/1645445439 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa818034650 0x7fa818036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:57.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.691+0000 7fa81f7fe640 1 -- 172.21.15.194:0/1645445439 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fa94002b170 con 0x559b743c8720 2024-09-13T06:09:57.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.691+0000 7fa94d281640 1 --2- 172.21.15.194:0/1645445439 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa818034650 0x7fa818036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:57.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.691+0000 7fa94ff72980 1 --2- 172.21.15.194:0/1645445439 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x559b743da900 0x559b743dcdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:57.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.691+0000 7fa94ff72980 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b743dd510 con 0x559b743da900 2024-09-13T06:09:57.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.691+0000 7fa94e283640 1 --2- 172.21.15.194:0/1645445439 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x559b743da900 0x559b743dcdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:57.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.691+0000 7fa94d281640 1 --2- 172.21.15.194:0/1645445439 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa818034650 0x7fa818036b10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa944000c10 tx=0x7fa9440c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:57.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.691+0000 7fa94e283640 1 --2- 172.21.15.194:0/1645445439 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x559b743da900 0x559b743dcdc0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:57.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.691+0000 7fa94e283640 1 -- 172.21.15.194:0/1645445439 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa94800a4d0 con 0x559b743da900 2024-09-13T06:09:57.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.691+0000 7fa94ff72980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:57.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.691+0000 7fa94ff72980 20 realm 2024-09-13T06:09:57.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.691+0000 7fa94ff72980 20 rados->read ofs=0 len=0 2024-09-13T06:09:57.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.691+0000 7fa94ff72980 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b743dd920 con 0x559b743da900 2024-09-13T06:09:57.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.691+0000 7fa94e283640 1 -- 172.21.15.194:0/1645445439 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa94800a4d0 con 0x559b743da900 2024-09-13T06:09:57.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.691+0000 7fa94ff72980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:57.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.691+0000 7fa94ff72980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:09:57.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.691+0000 7fa94ff72980 20 rados->read ofs=0 len=0 2024-09-13T06:09:57.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.691+0000 7fa94ff72980 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b743de1c0 con 0x559b743da900 2024-09-13T06:09:57.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.691+0000 7fa94e283640 1 -- 172.21.15.194:0/1645445439 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa94800a4d0 con 0x559b743da900 2024-09-13T06:09:57.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.691+0000 7fa94ff72980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:57.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.691+0000 7fa94ff72980 20 rados->read ofs=0 len=0 2024-09-13T06:09:57.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.691+0000 7fa94ff72980 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b743de560 con 0x559b743da900 2024-09-13T06:09:57.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.691+0000 7fa94e283640 1 -- 172.21.15.194:0/1645445439 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa94800a4d0 con 0x559b743da900 2024-09-13T06:09:57.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.691+0000 7fa94ff72980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:57.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.691+0000 7fa94ff72980 20 rados->read ofs=0 len=0 2024-09-13T06:09:57.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.691+0000 7fa94ff72980 1 --2- 172.21.15.194:0/1645445439 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x559b743df2c0 0x559b743e16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:57.808 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.691+0000 7fa94ff72980 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b743e1c30 con 0x559b743df2c0 2024-09-13T06:09:57.808 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.691+0000 7fa94da82640 1 --2- 172.21.15.194:0/1645445439 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x559b743df2c0 0x559b743e16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:57.808 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.691+0000 7fa94da82640 1 --2- 172.21.15.194:0/1645445439 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x559b743df2c0 0x559b743e16b0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:57.808 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.691+0000 7fa94da82640 1 -- 172.21.15.194:0/1645445439 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa94002e070 con 0x559b743df2c0 2024-09-13T06:09:57.808 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.691+0000 7fa94ff72980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:09:57.808 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.691+0000 7fa94ff72980 20 searching for the correct realm 2024-09-13T06:09:57.808 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.691+0000 7fa94ff72980 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b743e34d0 con 0x559b743df2c0 2024-09-13T06:09:57.808 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.691+0000 7fa94da82640 1 -- 172.21.15.194:0/1645445439 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa94002e070 con 0x559b743df2c0 2024-09-13T06:09:57.808 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.691+0000 7fa94da82640 1 --2- 172.21.15.194:0/1645445439 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fa9400327e0 0x7fa9400066f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:57.808 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.691+0000 7fa94da82640 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b743e34d0 con 0x7fa9400327e0 2024-09-13T06:09:57.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.691+0000 7fa94d281640 1 --2- 172.21.15.194:0/1645445439 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fa9400327e0 0x7fa9400066f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:57.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.691+0000 7fa94d281640 1 --2- 172.21.15.194:0/1645445439 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fa9400327e0 0x7fa9400066f0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:57.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.695+0000 7fa94d281640 1 -- 172.21.15.194:0/1645445439 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa9440aaad0 con 0x7fa9400327e0 2024-09-13T06:09:57.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.695+0000 7fa94d281640 1 --2- 172.21.15.194:0/1645445439 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fa9440e0040 0x7fa9440e0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:57.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.695+0000 7fa94d281640 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b743e34d0 con 0x7fa9440e0040 2024-09-13T06:09:57.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.695+0000 7fa94e283640 1 --2- 172.21.15.194:0/1645445439 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fa9440e0040 0x7fa9440e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:57.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.695+0000 7fa94e283640 1 --2- 172.21.15.194:0/1645445439 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fa9440e0040 0x7fa9440e0420 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:57.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.695+0000 7fa94e283640 1 -- 172.21.15.194:0/1645445439 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa94800a4d0 con 0x7fa9440e0040 2024-09-13T06:09:57.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.695+0000 7fa94e283640 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b743de560 con 0x559b743da900 2024-09-13T06:09:57.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.695+0000 7fa94e283640 1 -- 172.21.15.194:0/1645445439 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa94800a4d0 con 0x559b743da900 2024-09-13T06:09:57.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.695+0000 7fa94e283640 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b743de560 con 0x559b743da900 2024-09-13T06:09:57.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.695+0000 7fa94e283640 1 -- 172.21.15.194:0/1645445439 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa94800a4d0 con 0x559b743da900 2024-09-13T06:09:57.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.695+0000 7fa94e283640 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b743de560 con 0x7fa9440e0040 2024-09-13T06:09:57.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.695+0000 7fa94e283640 1 -- 172.21.15.194:0/1645445439 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa94800a4d0 con 0x7fa9440e0040 2024-09-13T06:09:57.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.695+0000 7fa94e283640 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b743de560 con 0x7fa9440e0040 2024-09-13T06:09:57.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.695+0000 7fa94e283640 1 -- 172.21.15.194:0/1645445439 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa94800a4d0 con 0x7fa9440e0040 2024-09-13T06:09:57.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.695+0000 7fa94e283640 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b743de560 con 0x7fa9400327e0 2024-09-13T06:09:57.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.695+0000 7fa94d281640 1 -- 172.21.15.194:0/1645445439 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9440aaad0 con 0x7fa9400327e0 2024-09-13T06:09:57.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.695+0000 7fa94d281640 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b743de560 con 0x559b743df2c0 2024-09-13T06:09:57.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.699+0000 7fa94da82640 1 -- 172.21.15.194:0/1645445439 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa94002e070 con 0x559b743df2c0 2024-09-13T06:09:57.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.699+0000 7fa94da82640 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b743de560 con 0x559b743da900 2024-09-13T06:09:57.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.699+0000 7fa94e283640 1 -- 172.21.15.194:0/1645445439 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa94800a4d0 con 0x559b743da900 2024-09-13T06:09:57.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.699+0000 7fa94e283640 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b743de560 con 0x7fa9440e0040 2024-09-13T06:09:57.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.699+0000 7fa94e283640 1 -- 172.21.15.194:0/1645445439 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa94800a4d0 con 0x7fa9440e0040 2024-09-13T06:09:57.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.699+0000 7fa94e283640 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b743de560 con 0x559b743da900 2024-09-13T06:09:57.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.699+0000 7fa94e283640 1 -- 172.21.15.194:0/1645445439 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa94800a4d0 con 0x559b743da900 2024-09-13T06:09:57.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.699+0000 7fa94e283640 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b743de560 con 0x7fa9400327e0 2024-09-13T06:09:57.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.699+0000 7fa94d281640 1 -- 172.21.15.194:0/1645445439 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa9440aaad0 con 0x7fa9400327e0 2024-09-13T06:09:57.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.699+0000 7fa94d281640 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b743de560 con 0x559b743df2c0 2024-09-13T06:09:57.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.699+0000 7fa94da82640 1 -- 172.21.15.194:0/1645445439 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa94002e070 con 0x559b743df2c0 2024-09-13T06:09:57.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.699+0000 7fa94da82640 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b743de560 con 0x559b743df2c0 2024-09-13T06:09:57.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.699+0000 7fa94da82640 1 -- 172.21.15.194:0/1645445439 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa94002e070 con 0x559b743df2c0 2024-09-13T06:09:57.812 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.699+0000 7fa94da82640 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b743de560 con 0x7fa9440e0040 2024-09-13T06:09:57.812 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.699+0000 7fa94e283640 1 -- 172.21.15.194:0/1645445439 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa94800a4d0 con 0x7fa9440e0040 2024-09-13T06:09:57.812 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.699+0000 7fa94e283640 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b743de560 con 0x559b743df2c0 2024-09-13T06:09:57.812 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.699+0000 7fa94da82640 1 -- 172.21.15.194:0/1645445439 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa94002e070 con 0x559b743df2c0 2024-09-13T06:09:57.812 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.699+0000 7fa94da82640 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b743de560 con 0x559b743df2c0 2024-09-13T06:09:57.812 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.699+0000 7fa94da82640 1 -- 172.21.15.194:0/1645445439 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa94002e070 con 0x559b743df2c0 2024-09-13T06:09:57.812 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.699+0000 7fa94da82640 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b743de560 con 0x559b743da900 2024-09-13T06:09:57.812 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.699+0000 7fa94e283640 1 -- 172.21.15.194:0/1645445439 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa94800a4d0 con 0x559b743da900 2024-09-13T06:09:57.812 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.699+0000 7fa94e283640 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b743de560 con 0x559b743da900 2024-09-13T06:09:57.812 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.703+0000 7fa94e283640 1 -- 172.21.15.194:0/1645445439 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa94800a4d0 con 0x559b743da900 2024-09-13T06:09:57.813 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.703+0000 7fa94e283640 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b743de560 con 0x7fa9440e0040 2024-09-13T06:09:57.813 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.703+0000 7fa94e283640 1 -- 172.21.15.194:0/1645445439 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa94800a4d0 con 0x7fa9440e0040 2024-09-13T06:09:57.813 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.703+0000 7fa94e283640 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b743de560 con 0x559b743df2c0 2024-09-13T06:09:57.813 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.703+0000 7fa94da82640 1 -- 172.21.15.194:0/1645445439 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa94002e070 con 0x559b743df2c0 2024-09-13T06:09:57.813 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.703+0000 7fa94da82640 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b743de560 con 0x7fa9400327e0 2024-09-13T06:09:57.813 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.703+0000 7fa94d281640 1 -- 172.21.15.194:0/1645445439 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9440aaad0 con 0x7fa9400327e0 2024-09-13T06:09:57.813 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.703+0000 7fa94d281640 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b743de560 con 0x559b743da900 2024-09-13T06:09:57.813 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.703+0000 7fa94e283640 1 -- 172.21.15.194:0/1645445439 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa94800a4d0 con 0x559b743da900 2024-09-13T06:09:57.813 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.703+0000 7fa94e283640 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b743de560 con 0x7fa9440e0040 2024-09-13T06:09:57.813 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.703+0000 7fa94e283640 1 -- 172.21.15.194:0/1645445439 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa94800a4d0 con 0x7fa9440e0040 2024-09-13T06:09:57.813 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.703+0000 7fa94e283640 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b743de560 con 0x559b743df2c0 2024-09-13T06:09:57.814 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.703+0000 7fa94da82640 1 -- 172.21.15.194:0/1645445439 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa94002e070 con 0x559b743df2c0 2024-09-13T06:09:57.814 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.703+0000 7fa94da82640 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b743de560 con 0x7fa9440e0040 2024-09-13T06:09:57.814 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.703+0000 7fa94e283640 1 -- 172.21.15.194:0/1645445439 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa94800a4d0 con 0x7fa9440e0040 2024-09-13T06:09:57.814 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.703+0000 7fa94e283640 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b743de560 con 0x7fa9400327e0 2024-09-13T06:09:57.814 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.703+0000 7fa94d281640 1 -- 172.21.15.194:0/1645445439 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9440aaad0 con 0x7fa9400327e0 2024-09-13T06:09:57.814 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.703+0000 7fa94d281640 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b743de560 con 0x559b743df2c0 2024-09-13T06:09:57.814 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.703+0000 7fa94da82640 1 -- 172.21.15.194:0/1645445439 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa94002e070 con 0x559b743df2c0 2024-09-13T06:09:57.814 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.703+0000 7fa94da82640 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b743de560 con 0x7fa9440e0040 2024-09-13T06:09:57.814 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.707+0000 7fa94e283640 1 -- 172.21.15.194:0/1645445439 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa94800a4d0 con 0x7fa9440e0040 2024-09-13T06:09:57.814 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.707+0000 7fa94e283640 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b743de560 con 0x559b743da900 2024-09-13T06:09:57.814 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.707+0000 7fa94e283640 1 -- 172.21.15.194:0/1645445439 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa94800a4d0 con 0x559b743da900 2024-09-13T06:09:57.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.707+0000 7fa94e283640 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b743de560 con 0x7fa9400327e0 2024-09-13T06:09:57.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.707+0000 7fa94d281640 1 -- 172.21.15.194:0/1645445439 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9440aaad0 con 0x7fa9400327e0 2024-09-13T06:09:57.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.707+0000 7fa94ff72980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:09:57.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.707+0000 7fa94ff72980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:09:57.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.707+0000 7fa94ff72980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:09:57.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.707+0000 7fa94ff72980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:09:57.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.707+0000 7fa94ff72980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:09:57.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.707+0000 7fa94ff72980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:09:57.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.707+0000 7fa94ff72980 20 rados->read ofs=0 len=0 2024-09-13T06:09:57.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.707+0000 7fa94ff72980 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b743e2480 con 0x559b743da900 2024-09-13T06:09:57.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.707+0000 7fa94e283640 1 -- 172.21.15.194:0/1645445439 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa94800a4d0 con 0x559b743da900 2024-09-13T06:09:57.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.707+0000 7fa94ff72980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:57.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.707+0000 7fa94ff72980 20 rados->read ofs=0 len=0 2024-09-13T06:09:57.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.707+0000 7fa94ff72980 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b743e2870 con 0x559b743da900 2024-09-13T06:09:57.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.707+0000 7fa94e283640 1 -- 172.21.15.194:0/1645445439 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa94800a4d0 con 0x559b743da900 2024-09-13T06:09:57.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.707+0000 7fa94ff72980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:57.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.707+0000 7fa94ff72980 20 rados->read ofs=0 len=0 2024-09-13T06:09:57.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.707+0000 7fa94ff72980 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b743e2870 con 0x7fa9400327e0 2024-09-13T06:09:57.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.707+0000 7fa94d281640 1 -- 172.21.15.194:0/1645445439 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa9440aaad0 con 0x7fa9400327e0 2024-09-13T06:09:57.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.707+0000 7fa94ff72980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:09:57.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.707+0000 7fa94ff72980 20 zone default found 2024-09-13T06:09:57.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.707+0000 7fa94ff72980 4 Realm: () 2024-09-13T06:09:57.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.707+0000 7fa94ff72980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:09:57.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.707+0000 7fa94ff72980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:09:57.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.707+0000 7fa94ff72980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:09:57.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.707+0000 7fa94ff72980 20 zonegroup default 2024-09-13T06:09:57.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.707+0000 7fa94ff72980 20 rados->read ofs=0 len=0 2024-09-13T06:09:57.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.707+0000 7fa94ff72980 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b743e39a0 con 0x7fa9440e0040 2024-09-13T06:09:57.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.707+0000 7fa94e283640 1 -- 172.21.15.194:0/1645445439 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa94800a4d0 con 0x7fa9440e0040 2024-09-13T06:09:57.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.707+0000 7fa94ff72980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:57.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.707+0000 7fa94ff72980 20 rados->read ofs=0 len=0 2024-09-13T06:09:57.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.707+0000 7fa94ff72980 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b743e5380 con 0x559b743df2c0 2024-09-13T06:09:57.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.707+0000 7fa94da82640 1 -- 172.21.15.194:0/1645445439 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa94002e070 con 0x559b743df2c0 2024-09-13T06:09:57.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.707+0000 7fa94ff72980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:57.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.707+0000 7fa94ff72980 20 rados->read ofs=0 len=0 2024-09-13T06:09:57.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.707+0000 7fa94ff72980 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b743e5720 con 0x559b743df2c0 2024-09-13T06:09:57.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.707+0000 7fa94da82640 1 -- 172.21.15.194:0/1645445439 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa94002e070 con 0x559b743df2c0 2024-09-13T06:09:57.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.707+0000 7fa94ff72980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:57.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.707+0000 7fa94ff72980 20 started sync module instance, tier type = 2024-09-13T06:09:57.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.707+0000 7fa94ff72980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:09:57.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.707+0000 7fa94ff72980 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b743e4820 con 0x7fa9400327e0 2024-09-13T06:09:57.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.711+0000 7fa94d281640 1 -- 172.21.15.194:0/1645445439 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(44 notify.0 [create] v33'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9440aaad0 con 0x7fa9400327e0 2024-09-13T06:09:57.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.711+0000 7fa94ff72980 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94126158531648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b743e4480 con 0x7fa9400327e0 2024-09-13T06:09:57.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.711+0000 7fa94ff72980 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b743e6420 con 0x559b743da900 2024-09-13T06:09:57.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.711+0000 7fa94d281640 1 -- 172.21.15.194:0/1645445439 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94126158531648] v33'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9440aaad0 con 0x7fa9400327e0 2024-09-13T06:09:57.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.711+0000 7fa94e283640 1 -- 172.21.15.194:0/1645445439 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v33'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa94800a4d0 con 0x559b743da900 2024-09-13T06:09:57.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.711+0000 7fa94ff72980 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94126158535632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b743e6810 con 0x559b743da900 2024-09-13T06:09:57.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.711+0000 7fa94ff72980 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b743e71d0 con 0x559b743df2c0 2024-09-13T06:09:57.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.715+0000 7fa94e283640 1 -- 172.21.15.194:0/1645445439 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94126158535632] v33'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa94800a4d0 con 0x559b743da900 2024-09-13T06:09:57.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.715+0000 7fa94da82640 1 -- 172.21.15.194:0/1645445439 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v33'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa94002e070 con 0x559b743df2c0 2024-09-13T06:09:57.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.715+0000 7fa94ff72980 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94126158536880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b743e71d0 con 0x559b743df2c0 2024-09-13T06:09:57.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.715+0000 7fa94ff72980 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b743e7be0 con 0x7fa9400327e0 2024-09-13T06:09:57.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.715+0000 7fa94d281640 1 -- 172.21.15.194:0/1645445439 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(50 notify.3 [create] v33'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9440aaad0 con 0x7fa9400327e0 2024-09-13T06:09:57.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.715+0000 7fa94ff72980 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94126158542640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b743e8430 con 0x7fa9400327e0 2024-09-13T06:09:57.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.715+0000 7fa94ff72980 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b743e8e70 con 0x559b743da900 2024-09-13T06:09:57.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.715+0000 7fa94da82640 1 -- 172.21.15.194:0/1645445439 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94126158536880] v33'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa94002e070 con 0x559b743df2c0 2024-09-13T06:09:57.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.719+0000 7fa94e283640 1 -- 172.21.15.194:0/1645445439 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v33'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa94800a4d0 con 0x559b743da900 2024-09-13T06:09:57.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.719+0000 7fa94ff72980 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94126158547264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b743e8e30 con 0x559b743da900 2024-09-13T06:09:57.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.719+0000 7fa94ff72980 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b743e9880 con 0x7fa9440e0040 2024-09-13T06:09:57.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.719+0000 7fa94d281640 1 -- 172.21.15.194:0/1645445439 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94126158542640] v33'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9440aaad0 con 0x7fa9400327e0 2024-09-13T06:09:57.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.719+0000 7fa94e283640 1 -- 172.21.15.194:0/1645445439 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94126158547264] v33'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa94800a4d0 con 0x559b743da900 2024-09-13T06:09:57.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.719+0000 7fa94e283640 1 -- 172.21.15.194:0/1645445439 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(54 notify.5 [create] v33'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa94800a4d0 con 0x7fa9440e0040 2024-09-13T06:09:57.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.719+0000 7fa94ff72980 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94126158540064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b743e93d0 con 0x7fa9440e0040 2024-09-13T06:09:57.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.719+0000 7fa94ff72980 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b743e9c20 con 0x7fa9440e0040 2024-09-13T06:09:57.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.723+0000 7fa94e283640 1 -- 172.21.15.194:0/1645445439 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(56 notify.6 [create] v33'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa94800a4d0 con 0x7fa9440e0040 2024-09-13T06:09:57.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.723+0000 7fa94e283640 1 -- 172.21.15.194:0/1645445439 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94126158540064] v33'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa94800a4d0 con 0x7fa9440e0040 2024-09-13T06:09:57.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.723+0000 7fa94ff72980 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94126158550240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b743e8080 con 0x7fa9440e0040 2024-09-13T06:09:57.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.723+0000 7fa94ff72980 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b743ea590 con 0x7fa9440e0040 2024-09-13T06:09:57.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.723+0000 7fa94e283640 1 -- 172.21.15.194:0/1645445439 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94126158550240] v33'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa94800a4d0 con 0x7fa9440e0040 2024-09-13T06:09:57.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.723+0000 7fa94e283640 1 -- 172.21.15.194:0/1645445439 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(58 notify.7 [create] v33'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa94800a4d0 con 0x7fa9440e0040 2024-09-13T06:09:57.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.723+0000 7fa94ff72980 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94126158551456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b743ea7d0 con 0x7fa9440e0040 2024-09-13T06:09:57.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.723+0000 7fa94ff72980 20 add_watcher() i=0 2024-09-13T06:09:57.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.723+0000 7fa94ff72980 20 add_watcher() i=1 2024-09-13T06:09:57.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.723+0000 7fa94ff72980 20 add_watcher() i=2 2024-09-13T06:09:57.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.723+0000 7fa94ff72980 20 add_watcher() i=3 2024-09-13T06:09:57.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.723+0000 7fa94ff72980 20 add_watcher() i=4 2024-09-13T06:09:57.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.723+0000 7fa94ff72980 20 add_watcher() i=5 2024-09-13T06:09:57.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.723+0000 7fa94ff72980 20 add_watcher() i=6 2024-09-13T06:09:57.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.727+0000 7fa94e283640 1 -- 172.21.15.194:0/1645445439 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94126158551456] v33'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa94800a4d0 con 0x7fa9440e0040 2024-09-13T06:09:57.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.727+0000 7fa94ff72980 20 add_watcher() i=7 2024-09-13T06:09:57.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.727+0000 7fa94ff72980 2 all 8 watchers are set, enabling cache 2024-09-13T06:09:57.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.727+0000 7fa94ff72980 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b743edd10 con 0x559b743da900 2024-09-13T06:09:57.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.727+0000 7fa94e283640 1 -- 172.21.15.194:0/1645445439 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa94800a4d0 con 0x559b743da900 2024-09-13T06:09:57.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.727+0000 7fa94ff72980 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94126158553248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b743eb200 con 0x559b743da900 2024-09-13T06:09:57.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.727+0000 7fa94e283640 1 -- 172.21.15.194:0/1645445439 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94126158553248] v33'96 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa94800a4d0 con 0x559b743da900 2024-09-13T06:09:57.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.727+0000 7fa803fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:57.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.727+0000 7fa94ff72980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:09:57.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.727+0000 7fa94ff72980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:09:57.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.727+0000 7fa94ff72980 5 note: GC not initialized 2024-09-13T06:09:57.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.727+0000 7fa802fe5640 20 reqs_thread_entry: start 2024-09-13T06:09:57.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.727+0000 7fa94ff72980 20 init_complete bucket index max shards: 11 2024-09-13T06:09:57.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.727+0000 7fa94ff72980 20 Filter name: none 2024-09-13T06:09:57.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.727+0000 7fa800fe1640 20 reqs_thread_entry: start 2024-09-13T06:09:57.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.727+0000 7fa94ff72980 20 rados->read ofs=0 len=0 2024-09-13T06:09:57.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.727+0000 7fa94ff72980 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b74411450 con 0x7fa9400327e0 2024-09-13T06:09:57.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.731+0000 7fa94d281640 1 -- 172.21.15.194:0/1645445439 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fa9440aaad0 con 0x7fa9400327e0 2024-09-13T06:09:57.824 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.731+0000 7fa94ff72980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T06:09:57.824 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.731+0000 7fa94ff72980 20 rados->read ofs=0 len=0 2024-09-13T06:09:57.824 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.731+0000 7fa94ff72980 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:63 8.18 8:1a66c368:root::.bucket.meta.myfoo%3a52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b74411ce0 con 0x559b743da900 2024-09-13T06:09:57.824 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.731+0000 7fa94e283640 1 -- 172.21.15.194:0/1645445439 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(63 .bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv12 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fa94800a4d0 con 0x559b743da900 2024-09-13T06:09:57.824 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.731+0000 7fa94ff72980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T06:09:57.824 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.731+0000 7fa94ff72980 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-13T06:09:57.824 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.731+0000 7fa94ff72980 20 rados->read ofs=0 len=0 2024-09-13T06:09:57.824 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.731+0000 7fa94ff72980 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b744107f0 con 0x7fa9400327e0 2024-09-13T06:09:57.824 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.731+0000 7fa94d281640 1 -- 172.21.15.194:0/1645445439 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fa9440aaad0 con 0x7fa9400327e0 2024-09-13T06:09:57.824 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.731+0000 7fa94ff72980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T06:09:57.824 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.731+0000 7fa94ff72980 20 rados->read ofs=0 len=0 2024-09-13T06:09:57.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.731+0000 7fa94ff72980 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:65 8.18 8:1a66c368:root::.bucket.meta.myfoo%3a52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b74413310 con 0x559b743da900 2024-09-13T06:09:57.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.731+0000 7fa94e283640 1 -- 172.21.15.194:0/1645445439 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(65 .bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv12 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fa94800a4d0 con 0x559b743da900 2024-09-13T06:09:57.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.731+0000 7fa94ff72980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T06:09:57.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.731+0000 7fa94ff72980 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-13T06:09:57.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.731+0000 7fa94ff72980 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:66 4.25 4:a5fa2579:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b74412cf0 con 0x559b743df2c0 2024-09-13T06:09:57.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.731+0000 7fa94ff72980 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:67 4.2c 4:3660bce8:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b74417bd0 con 0x559b743da900 2024-09-13T06:09:57.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.731+0000 7fa94ff72980 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:68 4.14 4:2a98937a:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b7441a440 con 0x559b743df2c0 2024-09-13T06:09:57.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.731+0000 7fa94ff72980 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:69 4.27 4:e42c957a:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b7441ccf0 con 0x559b743da900 2024-09-13T06:09:57.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.731+0000 7fa94ff72980 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:70 4.5 4:a24186ed:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b7441f560 con 0x559b743df2c0 2024-09-13T06:09:57.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.731+0000 7fa94ff72980 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:71 4.13 4:cad7efb2:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b74421ee0 con 0x7fa9400327e0 2024-09-13T06:09:57.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.731+0000 7fa94ff72980 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:72 4.3 4:c1107af5:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b74424c20 con 0x559b743da900 2024-09-13T06:09:57.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.731+0000 7fa94ff72980 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:73 4.27 4:e6338292:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b74421ee0 con 0x559b743da900 2024-09-13T06:09:57.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.731+0000 7fa94ff72980 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:74 4.2a 4:57abd676:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b74424c20 con 0x559b743da900 2024-09-13T06:09:57.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.731+0000 7fa94ff72980 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:75 4.38 4:1e9df731:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b7442c1a0 con 0x559b743da900 2024-09-13T06:09:57.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.731+0000 7fa94ff72980 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:76 4.2b 4:d7fbcf05:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b7442f000 con 0x559b743da900 2024-09-13T06:09:57.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.731+0000 7fa94d281640 1 -- 172.21.15.194:0/1645445439 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(71 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa9440aaad0 con 0x7fa9400327e0 2024-09-13T06:09:57.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.731+0000 7fa94e283640 1 -- 172.21.15.194:0/1645445439 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(69 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa94800a4d0 con 0x559b743da900 2024-09-13T06:09:57.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.731+0000 7fa94e283640 1 -- 172.21.15.194:0/1645445439 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(72 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa94800a4d0 con 0x559b743da900 2024-09-13T06:09:57.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.731+0000 7fa94da82640 1 -- 172.21.15.194:0/1645445439 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(66 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa94002e070 con 0x559b743df2c0 2024-09-13T06:09:57.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.731+0000 7fa94da82640 1 -- 172.21.15.194:0/1645445439 <== osd.3 v2:172.21.15.194:6816/96632515 16 ==== osd_op_reply(68 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa94002e070 con 0x559b743df2c0 2024-09-13T06:09:57.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.731+0000 7fa94e283640 1 -- 172.21.15.194:0/1645445439 <== osd.1 v2:172.21.15.194:6808/3135444559 25 ==== osd_op_reply(74 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa94800a4d0 con 0x559b743da900 2024-09-13T06:09:57.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.731+0000 7fa94e283640 1 -- 172.21.15.194:0/1645445439 <== osd.1 v2:172.21.15.194:6808/3135444559 26 ==== osd_op_reply(73 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.7 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa94800a4d0 con 0x559b743da900 2024-09-13T06:09:57.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.731+0000 7fa94da82640 1 -- 172.21.15.194:0/1645445439 <== osd.3 v2:172.21.15.194:6816/96632515 17 ==== osd_op_reply(70 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa94002e070 con 0x559b743df2c0 2024-09-13T06:09:57.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.731+0000 7fa94e283640 1 -- 172.21.15.194:0/1645445439 <== osd.1 v2:172.21.15.194:6808/3135444559 27 ==== osd_op_reply(76 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa94800a4d0 con 0x559b743da900 2024-09-13T06:09:57.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.731+0000 7fa94e283640 1 -- 172.21.15.194:0/1645445439 <== osd.1 v2:172.21.15.194:6808/3135444559 28 ==== osd_op_reply(67 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa94800a4d0 con 0x559b743da900 2024-09-13T06:09:57.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.731+0000 7fa94e283640 1 -- 172.21.15.194:0/1645445439 <== osd.1 v2:172.21.15.194:6808/3135444559 29 ==== osd_op_reply(75 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa94800a4d0 con 0x559b743da900 2024-09-13T06:09:57.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.735+0000 7fa803fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:57.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.735+0000 7fa94ff72980 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94126158553248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b743edaa0 con 0x559b743da900 2024-09-13T06:09:57.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.735+0000 7fa94e283640 1 -- 172.21.15.194:0/1645445439 <== osd.1 v2:172.21.15.194:6808/3135444559 30 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94126158553248] v33'97 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa94800a4d0 con 0x559b743da900 2024-09-13T06:09:57.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.735+0000 7fa94ff72980 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94126158531648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b743edaa0 con 0x7fa9400327e0 2024-09-13T06:09:57.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.735+0000 7fa94d281640 1 -- 172.21.15.194:0/1645445439 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94126158531648] v33'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9440aaad0 con 0x7fa9400327e0 2024-09-13T06:09:57.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.735+0000 7fa94ff72980 20 remove_watcher() i=0 2024-09-13T06:09:57.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.735+0000 7fa94ff72980 2 removed watcher, disabling cache 2024-09-13T06:09:57.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.735+0000 7fa94ff72980 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94126158535632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b743edaa0 con 0x559b743da900 2024-09-13T06:09:57.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.739+0000 7fa94e283640 1 -- 172.21.15.194:0/1645445439 <== osd.1 v2:172.21.15.194:6808/3135444559 31 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94126158535632] v33'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa94800a4d0 con 0x559b743da900 2024-09-13T06:09:57.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.739+0000 7fa94ff72980 20 remove_watcher() i=1 2024-09-13T06:09:57.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.739+0000 7fa94ff72980 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94126158536880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b743edaa0 con 0x559b743df2c0 2024-09-13T06:09:57.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.739+0000 7fa94da82640 1 -- 172.21.15.194:0/1645445439 <== osd.3 v2:172.21.15.194:6816/96632515 18 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94126158536880] v33'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa94002e070 con 0x559b743df2c0 2024-09-13T06:09:57.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.739+0000 7fa94ff72980 20 remove_watcher() i=2 2024-09-13T06:09:57.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.739+0000 7fa94ff72980 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94126158542640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b743edaa0 con 0x7fa9400327e0 2024-09-13T06:09:57.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.743+0000 7fa94d281640 1 -- 172.21.15.194:0/1645445439 <== osd.2 v2:172.21.15.194:6800/815615585 16 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94126158542640] v33'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9440aaad0 con 0x7fa9400327e0 2024-09-13T06:09:57.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.743+0000 7fa94ff72980 20 remove_watcher() i=3 2024-09-13T06:09:57.829 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.743+0000 7fa94ff72980 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94126158547264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b743edaa0 con 0x559b743da900 2024-09-13T06:09:57.829 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.743+0000 7fa94e283640 1 -- 172.21.15.194:0/1645445439 <== osd.1 v2:172.21.15.194:6808/3135444559 32 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94126158547264] v33'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa94800a4d0 con 0x559b743da900 2024-09-13T06:09:57.829 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.743+0000 7fa94ff72980 20 remove_watcher() i=4 2024-09-13T06:09:57.829 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.743+0000 7fa94ff72980 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94126158540064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b743edaa0 con 0x7fa9440e0040 2024-09-13T06:09:57.829 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.747+0000 7fa94e283640 1 -- 172.21.15.194:0/1645445439 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94126158540064] v33'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa94800a4d0 con 0x7fa9440e0040 2024-09-13T06:09:57.829 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.747+0000 7fa94ff72980 20 remove_watcher() i=5 2024-09-13T06:09:57.829 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.747+0000 7fa94ff72980 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94126158550240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b743edaa0 con 0x7fa9440e0040 2024-09-13T06:09:57.829 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.747+0000 7fa94e283640 1 -- 172.21.15.194:0/1645445439 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94126158550240] v33'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa94800a4d0 con 0x7fa9440e0040 2024-09-13T06:09:57.829 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.747+0000 7fa94ff72980 20 remove_watcher() i=6 2024-09-13T06:09:57.829 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.747+0000 7fa94ff72980 1 -- 172.21.15.194:0/1645445439 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94126158551456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b743edaa0 con 0x7fa9440e0040 2024-09-13T06:09:57.829 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.751+0000 7fa94e283640 1 -- 172.21.15.194:0/1645445439 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94126158551456] v33'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa94800a4d0 con 0x7fa9440e0040 2024-09-13T06:09:57.830 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.751+0000 7fa94ff72980 20 remove_watcher() i=7 2024-09-13T06:09:57.830 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.751+0000 7fa94ff72980 1 -- 172.21.15.194:0/1645445439 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fa9440e0040 msgr2=0x7fa9440e0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:57.830 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.751+0000 7fa94ff72980 1 --2- 172.21.15.194:0/1645445439 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fa9440e0040 0x7fa9440e0420 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:57.830 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.751+0000 7fa94ff72980 1 -- 172.21.15.194:0/1645445439 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x559b743da900 msgr2=0x559b743dcdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:57.830 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.751+0000 7fa94ff72980 1 --2- 172.21.15.194:0/1645445439 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x559b743da900 0x559b743dcdc0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:57.830 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.751+0000 7fa94ff72980 1 -- 172.21.15.194:0/1645445439 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fa9400327e0 msgr2=0x7fa9400066f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:57.830 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.751+0000 7fa94ff72980 1 --2- 172.21.15.194:0/1645445439 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fa9400327e0 0x7fa9400066f0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:57.830 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.751+0000 7fa94ff72980 1 -- 172.21.15.194:0/1645445439 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x559b743df2c0 msgr2=0x559b743e16b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:57.830 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.751+0000 7fa94ff72980 1 --2- 172.21.15.194:0/1645445439 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x559b743df2c0 0x559b743e16b0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:57.830 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.751+0000 7fa94ff72980 1 -- 172.21.15.194:0/1645445439 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa818034650 msgr2=0x7fa818036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:57.830 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.751+0000 7fa94ff72980 1 --2- 172.21.15.194:0/1645445439 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa818034650 0x7fa818036b10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa944000c10 tx=0x7fa9440c1040 comp rx=0 tx=0).stop 2024-09-13T06:09:57.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.751+0000 7fa94ff72980 1 -- 172.21.15.194:0/1645445439 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559b743c8720 msgr2=0x559b743cf9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:57.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.751+0000 7fa94ff72980 1 --2- 172.21.15.194:0/1645445439 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559b743c8720 0x559b743cf9f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa940047590 tx=0x7fa94000de90 comp rx=0 tx=0).stop 2024-09-13T06:09:57.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.751+0000 7fa94e283640 1 -- 172.21.15.194:0/1645445439 reap_dead start 2024-09-13T06:09:57.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.751+0000 7fa94ff72980 1 -- 172.21.15.194:0/1645445439 shutdown_connections 2024-09-13T06:09:57.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.751+0000 7fa94ff72980 1 --2- 172.21.15.194:0/1645445439 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559b743c8720 0x559b743cf9f0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:57.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.751+0000 7fa94ff72980 1 -- 172.21.15.194:0/1645445439 >> 172.21.15.194:0/1645445439 conn(0x559b743c4b90 msgr2=0x559b743c2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:57.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.751+0000 7fa94ff72980 1 -- 172.21.15.194:0/1645445439 shutdown_connections 2024-09-13T06:09:57.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.751+0000 7fa94ff72980 1 -- 172.21.15.194:0/1645445439 wait complete. 2024-09-13T06:09:57.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.751+0000 7fa94ff72980 1 -- 172.21.15.194:0/3551483157 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa828034650 msgr2=0x7fa828036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:57.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.751+0000 7fa94ff72980 1 --2- 172.21.15.194:0/3551483157 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa828034650 0x7fa828036b10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x559b743a5ae0 tx=0x7fa944005ad0 comp rx=0 tx=0).stop 2024-09-13T06:09:57.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.751+0000 7fa94ff72980 1 -- 172.21.15.194:0/3551483157 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559b743bbe60 msgr2=0x559b743bc280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:57.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.751+0000 7fa94ff72980 1 --2- 172.21.15.194:0/3551483157 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559b743bbe60 0x559b743bc280 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa940000c10 tx=0x7fa9400474b0 comp rx=0 tx=0).stop 2024-09-13T06:09:57.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.751+0000 7fa94ff72980 1 -- 172.21.15.194:0/3551483157 shutdown_connections 2024-09-13T06:09:57.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.751+0000 7fa94ff72980 1 --2- 172.21.15.194:0/3551483157 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa828034650 0x7fa828036b10 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:57.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.751+0000 7fa94ff72980 1 --2- 172.21.15.194:0/3551483157 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559b743bbe60 0x559b743bc280 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:57.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.751+0000 7fa94ff72980 1 -- 172.21.15.194:0/3551483157 >> 172.21.15.194:0/3551483157 conn(0x559b743b0fb0 msgr2=0x559b743b3a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:57.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.751+0000 7fa94ff72980 1 -- 172.21.15.194:0/3551483157 shutdown_connections 2024-09-13T06:09:57.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.751+0000 7fa94ff72980 1 -- 172.21.15.194:0/3551483157 wait complete. 2024-09-13T06:09:57.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.751+0000 7fa94ff72980 1 -- 172.21.15.194:0/212931433 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x559b742afc60 msgr2=0x559b743a50c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:57.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.751+0000 7fa94ff72980 1 --2- 172.21.15.194:0/212931433 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x559b742afc60 0x559b743a50c0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:57.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.751+0000 7fa94ff72980 1 -- 172.21.15.194:0/212931433 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x559b743ab8a0 msgr2=0x559b743adc90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:57.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.751+0000 7fa94ff72980 1 --2- 172.21.15.194:0/212931433 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x559b743ab8a0 0x559b743adc90 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:57.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.751+0000 7fa94ff72980 1 -- 172.21.15.194:0/212931433 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x559b743a7960 msgr2=0x559b743a9d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:57.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.751+0000 7fa94ff72980 1 --2- 172.21.15.194:0/212931433 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x559b743a7960 0x559b743a9d50 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:57.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.751+0000 7fa94ff72980 1 -- 172.21.15.194:0/212931433 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa8340346a0 msgr2=0x7fa834036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:57.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.751+0000 7fa94ff72980 1 --2- 172.21.15.194:0/212931433 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa8340346a0 0x7fa834036b60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa9440ae000 tx=0x7fa9440a6000 comp rx=0 tx=0).stop 2024-09-13T06:09:57.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.751+0000 7fa94ff72980 1 -- 172.21.15.194:0/212931433 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559b742ab8e0 msgr2=0x559b7439dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:57.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.751+0000 7fa94ff72980 1 --2- 172.21.15.194:0/212931433 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559b742ab8e0 0x559b7439dfc0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fa94000b6f0 tx=0x7fa940000ee0 comp rx=0 tx=0).stop 2024-09-13T06:09:57.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.751+0000 7fa94e283640 1 -- 172.21.15.194:0/212931433 reap_dead start 2024-09-13T06:09:57.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.751+0000 7fa94ff72980 1 -- 172.21.15.194:0/212931433 shutdown_connections 2024-09-13T06:09:57.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.751+0000 7fa94ff72980 1 -- 172.21.15.194:0/212931433 >> 172.21.15.194:0/212931433 conn(0x559b7421f230 msgr2=0x559b743913e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:57.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.751+0000 7fa94ff72980 1 -- 172.21.15.194:0/212931433 shutdown_connections 2024-09-13T06:09:57.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.751+0000 7fa94ff72980 1 -- 172.21.15.194:0/212931433 wait complete. 2024-09-13T06:09:57.834 INFO:teuthology.orchestra.run.smithi194.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"0faf3484-cad7-4c8f-892b-62107a753816","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1","marker":"52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-13T06:09:56.935102Z","creation_time":"2024-09-13T06:09:56.926052Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-09-13T06:09:57.835 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '0faf3484-cad7-4c8f-892b-62107a753816', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1', 'marker': '52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-13T06:09:56.935102Z', 'creation_time': '2024-09-13T06:09:56.926052Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-13T06:09:57.835 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-09-13T06:09:57.835 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-09-13T06:09:57.836 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-09-13T06:09:57.916 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:09:57.916 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:09:57.917 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.915+0000 7f58cfac1980 1 Processor -- start 2024-09-13T06:09:57.917 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.915+0000 7f58cfac1980 1 -- start start 2024-09-13T06:09:57.917 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.915+0000 7f58cfac1980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x5583fe5c7870 0x5583fe5c9c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:57.917 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.915+0000 7f58cfac1980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5583fe44dae0 con 0x5583fe53a2d0 2024-09-13T06:09:57.917 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.915+0000 7f58cfac1980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x5583fe471e30 con 0x5583fe5c7870 2024-09-13T06:09:57.918 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.915+0000 7f58ccdd0640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x5583fe5c7870 0x5583fe5c9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:57.918 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.915+0000 7f58cd5d1640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x5583fe53a2d0 0x5583fe5c6150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:51132/0 (socket says 172.21.15.194:51132) 2024-09-13T06:09:57.918 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.915+0000 7f58cd5d1640 1 -- 172.21.15.194:0/4270025403 learned_addr learned my addr 172.21.15.194:0/4270025403 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-09-13T06:09:57.918 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.915+0000 7f58ccdd0640 1 -- 172.21.15.194:0/4270025403 >> v1:172.21.15.120:6789/0 conn(0x5583fe53a2d0 legacy=0x5583fe5c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:57.918 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.915+0000 7f58ccdd0640 1 -- 172.21.15.194:0/4270025403 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583fe5ca1d0 con 0x5583fe5c7870 2024-09-13T06:09:57.920 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.919+0000 7f58ccdd0640 1 --2- 172.21.15.194:0/4270025403 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5583fe5c7870 0x5583fe5c9c90 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f58c400a480 tx=0x7f58c401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e0844b5098d2dd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:57.921 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.919+0000 7f58bffff640 1 -- 172.21.15.194:0/4270025403 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58c40af070 con 0x5583fe5c7870 2024-09-13T06:09:57.921 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.919+0000 7f58bffff640 1 -- 172.21.15.194:0/4270025403 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58c40a3e50 con 0x5583fe5c7870 2024-09-13T06:09:57.921 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.919+0000 7f58bffff640 1 -- 172.21.15.194:0/4270025403 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58c40aa680 con 0x5583fe5c7870 2024-09-13T06:09:57.922 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.919+0000 7f58cfac1980 1 -- 172.21.15.194:0/4270025403 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5583fe5c7870 msgr2=0x5583fe5c9c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:57.922 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.919+0000 7f58cfac1980 1 --2- 172.21.15.194:0/4270025403 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5583fe5c7870 0x5583fe5c9c90 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f58c400a480 tx=0x7f58c401b280 comp rx=0 tx=0).stop 2024-09-13T06:09:57.922 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.919+0000 7f58cfac1980 1 -- 172.21.15.194:0/4270025403 shutdown_connections 2024-09-13T06:09:57.922 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.919+0000 7f58cfac1980 1 --2- 172.21.15.194:0/4270025403 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5583fe5c7870 0x5583fe5c9c90 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:57.922 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.919+0000 7f58cfac1980 1 -- 172.21.15.194:0/4270025403 >> 172.21.15.194:0/4270025403 conn(0x5583fe5c0090 msgr2=0x5583fe5c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:57.922 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.919+0000 7f58cfac1980 1 -- 172.21.15.194:0/4270025403 shutdown_connections 2024-09-13T06:09:57.922 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.919+0000 7f58cfac1980 1 -- 172.21.15.194:0/4270025403 wait complete. 2024-09-13T06:09:57.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.935+0000 7f58cfac1980 1 Processor -- start 2024-09-13T06:09:57.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.935+0000 7f58cfac1980 1 -- start start 2024-09-13T06:09:57.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.935+0000 7f58cfac1980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5583fe53a2d0 0x5583fe6b73f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:57.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.935+0000 7f58cfac1980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5583fe473200 con 0x5583fe53a2d0 2024-09-13T06:09:57.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.935+0000 7f58cd5d1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5583fe53a2d0 0x5583fe6b73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:57.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.935+0000 7f58cd5d1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5583fe53a2d0 0x5583fe6b73f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45360/0 (socket says 172.21.15.194:45360) 2024-09-13T06:09:57.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.935+0000 7f58cd5d1640 1 -- 172.21.15.194:0/2990092478 learned_addr learned my addr 172.21.15.194:0/2990092478 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:57.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.939+0000 7f58cd5d1640 1 -- 172.21.15.194:0/2990092478 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583fe6b79c0 con 0x5583fe53a2d0 2024-09-13T06:09:57.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.939+0000 7f58cd5d1640 1 --2- 172.21.15.194:0/2990092478 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5583fe53a2d0 0x5583fe6b73f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f58c00015f0 tx=0x7f58c0001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9223560a5372e32 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:57.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.939+0000 7f57bb606640 1 -- 172.21.15.194:0/2990092478 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58c0004530 con 0x5583fe53a2d0 2024-09-13T06:09:57.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.939+0000 7f57bb606640 1 -- 172.21.15.194:0/2990092478 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58c00046f0 con 0x5583fe53a2d0 2024-09-13T06:09:57.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.939+0000 7f57bb606640 1 -- 172.21.15.194:0/2990092478 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58c0004a90 con 0x5583fe53a2d0 2024-09-13T06:09:57.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.939+0000 7f58cfac1980 1 -- 172.21.15.194:0/2990092478 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5583fe53a2d0 msgr2=0x5583fe6b73f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:57.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.939+0000 7f58cfac1980 1 --2- 172.21.15.194:0/2990092478 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5583fe53a2d0 0x5583fe6b73f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f58c00015f0 tx=0x7f58c0001ab0 comp rx=0 tx=0).stop 2024-09-13T06:09:57.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.939+0000 7f58cfac1980 1 -- 172.21.15.194:0/2990092478 shutdown_connections 2024-09-13T06:09:57.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.939+0000 7f58cfac1980 1 --2- 172.21.15.194:0/2990092478 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5583fe53a2d0 0x5583fe6b73f0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:57.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.939+0000 7f58cfac1980 1 -- 172.21.15.194:0/2990092478 >> 172.21.15.194:0/2990092478 conn(0x5583fe5c0090 msgr2=0x5583fe6b3020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:57.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.939+0000 7f58cfac1980 1 -- 172.21.15.194:0/2990092478 shutdown_connections 2024-09-13T06:09:57.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.939+0000 7f58cfac1980 1 -- 172.21.15.194:0/2990092478 wait complete. 2024-09-13T06:09:57.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.939+0000 7f58cfac1980 1 Processor -- start 2024-09-13T06:09:57.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.939+0000 7f58cfac1980 1 -- start start 2024-09-13T06:09:57.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.939+0000 7f58cfac1980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5583fe53a2d0 0x5583fe6be760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:57.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.939+0000 7f58cfac1980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5583fe5d5a00 con 0x5583fe53a2d0 2024-09-13T06:09:57.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.939+0000 7f58cd5d1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5583fe53a2d0 0x5583fe6be760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:57.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.939+0000 7f58cd5d1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5583fe53a2d0 0x5583fe6be760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45372/0 (socket says 172.21.15.194:45372) 2024-09-13T06:09:57.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.939+0000 7f58cd5d1640 1 -- 172.21.15.194:0/4220491149 learned_addr learned my addr 172.21.15.194:0/4220491149 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:57.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.939+0000 7f58cd5d1640 1 -- 172.21.15.194:0/4220491149 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583fe6beca0 con 0x5583fe53a2d0 2024-09-13T06:09:57.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.939+0000 7f58cd5d1640 1 --2- 172.21.15.194:0/4220491149 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5583fe53a2d0 0x5583fe6be760 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x5583fe6b85d0 tx=0x7f58c0000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:57.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.943+0000 7f57b9e03640 1 -- 172.21.15.194:0/4220491149 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58c0013760 con 0x5583fe53a2d0 2024-09-13T06:09:57.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.943+0000 7f58cfac1980 1 -- 172.21.15.194:0/4220491149 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5583fe6bef30 con 0x5583fe53a2d0 2024-09-13T06:09:57.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.943+0000 7f57b9e03640 1 -- 172.21.15.194:0/4220491149 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58c0013900 con 0x5583fe53a2d0 2024-09-13T06:09:57.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.943+0000 7f57b9e03640 1 -- 172.21.15.194:0/4220491149 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58c0013be0 con 0x5583fe53a2d0 2024-09-13T06:09:57.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.943+0000 7f58cfac1980 1 -- 172.21.15.194:0/4220491149 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583fe6c1c10 con 0x5583fe53a2d0 2024-09-13T06:09:57.944 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.943+0000 7f57b9e03640 1 -- 172.21.15.194:0/4220491149 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f58c0010070 con 0x5583fe53a2d0 2024-09-13T06:09:57.945 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.943+0000 7f57b9e03640 1 --2- 172.21.15.194:0/4220491149 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f57b4034650 0x7f57b4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:57.945 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.943+0000 7f57b9e03640 1 -- 172.21.15.194:0/4220491149 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f58c0018070 con 0x5583fe53a2d0 2024-09-13T06:09:57.945 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.943+0000 7f58ccdd0640 1 --2- 172.21.15.194:0/4220491149 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f57b4034650 0x7f57b4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:57.945 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.943+0000 7f58cfac1980 1 --2- 172.21.15.194:0/4220491149 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5583fe5c7870 0x5583fe6c56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:57.945 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.943+0000 7f58cfac1980 1 -- 172.21.15.194:0/4220491149 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5583fe6c5d60 con 0x5583fe5c7870 2024-09-13T06:09:57.945 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.943+0000 7f58cddd2640 1 --2- 172.21.15.194:0/4220491149 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5583fe5c7870 0x5583fe6c56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:57.945 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.943+0000 7f58ccdd0640 1 --2- 172.21.15.194:0/4220491149 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f57b4034650 0x7f57b4036b10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f58c40ac000 tx=0x7f58c40a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:57.945 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.943+0000 7f58cddd2640 1 --2- 172.21.15.194:0/4220491149 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5583fe5c7870 0x5583fe6c56f0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:57.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.943+0000 7f58cddd2640 1 -- 172.21.15.194:0/4220491149 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f58c80083f0 con 0x5583fe5c7870 2024-09-13T06:09:57.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.943+0000 7f58cfac1980 1 -- 172.21.15.194:0/4220491149 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5583fe6c2e30 con 0x5583fe5c7870 2024-09-13T06:09:57.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.943+0000 7f58cddd2640 1 -- 172.21.15.194:0/4220491149 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f58c80083f0 con 0x5583fe5c7870 2024-09-13T06:09:57.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.943+0000 7f58cfac1980 1 --2- 172.21.15.194:0/4220491149 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5583fe6c8100 0x5583fe6ca4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:57.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.943+0000 7f58cfac1980 1 -- 172.21.15.194:0/4220491149 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5583fe6cabe0 con 0x5583fe6c8100 2024-09-13T06:09:57.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.943+0000 7f58cd5d1640 1 --2- 172.21.15.194:0/4220491149 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5583fe6c8100 0x5583fe6ca4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:57.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.943+0000 7f58cd5d1640 1 --2- 172.21.15.194:0/4220491149 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5583fe6c8100 0x5583fe6ca4f0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:57.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.947+0000 7f58cd5d1640 1 -- 172.21.15.194:0/4220491149 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f58c001b030 con 0x5583fe6c8100 2024-09-13T06:09:57.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.947+0000 7f58cfac1980 1 -- 172.21.15.194:0/4220491149 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5583fe6c6fa0 con 0x5583fe5c7870 2024-09-13T06:09:57.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.947+0000 7f58cddd2640 1 -- 172.21.15.194:0/4220491149 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f58c80083f0 con 0x5583fe5c7870 2024-09-13T06:09:57.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.947+0000 7f58cfac1980 1 --2- 172.21.15.194:0/4220491149 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5583fe6cc040 0x5583fe6ce430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:57.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.947+0000 7f58cfac1980 1 -- 172.21.15.194:0/4220491149 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5583fe6ceb70 con 0x5583fe6cc040 2024-09-13T06:09:57.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.947+0000 7f58ccdd0640 1 --2- 172.21.15.194:0/4220491149 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5583fe6cc040 0x5583fe6ce430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:57.949 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.947+0000 7f58ccdd0640 1 --2- 172.21.15.194:0/4220491149 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5583fe6cc040 0x5583fe6ce430 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:57.949 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.947+0000 7f58ccdd0640 1 -- 172.21.15.194:0/4220491149 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f58c40b2040 con 0x5583fe6cc040 2024-09-13T06:09:57.949 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.947+0000 7f58cfac1980 1 Processor -- start 2024-09-13T06:09:57.949 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.947+0000 7f58cfac1980 1 -- start start 2024-09-13T06:09:57.949 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.947+0000 7f58cfac1980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5583fe6dc600 0x5583fe6dca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:57.949 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.947+0000 7f58cfac1980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5583fe4cc800 con 0x5583fe6dc600 2024-09-13T06:09:57.949 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.947+0000 7f58cd5d1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5583fe6dc600 0x5583fe6dca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:57.950 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.947+0000 7f58cd5d1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5583fe6dc600 0x5583fe6dca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45374/0 (socket says 172.21.15.194:45374) 2024-09-13T06:09:57.950 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.947+0000 7f58cd5d1640 1 -- 172.21.15.194:0/2945801758 learned_addr learned my addr 172.21.15.194:0/2945801758 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:57.950 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.947+0000 7f58cd5d1640 1 -- 172.21.15.194:0/2945801758 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583fe6dcf60 con 0x5583fe6dc600 2024-09-13T06:09:57.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.947+0000 7f58cd5d1640 1 --2- 172.21.15.194:0/2945801758 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5583fe6dc600 0x5583fe6dca20 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f58c0023000 tx=0x7f58c0010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:57.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.947+0000 7f57b2ffd640 1 -- 172.21.15.194:0/2945801758 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58c00128f0 con 0x5583fe6dc600 2024-09-13T06:09:57.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.947+0000 7f57b2ffd640 1 -- 172.21.15.194:0/2945801758 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58c0041ab0 con 0x5583fe6dc600 2024-09-13T06:09:57.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.947+0000 7f58cfac1980 1 -- 172.21.15.194:0/2945801758 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5583fe6dd1f0 con 0x5583fe6dc600 2024-09-13T06:09:57.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.947+0000 7f57b2ffd640 1 -- 172.21.15.194:0/2945801758 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58c0041d90 con 0x5583fe6dc600 2024-09-13T06:09:57.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.947+0000 7f58cfac1980 1 -- 172.21.15.194:0/2945801758 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583fe6dfe70 con 0x5583fe6dc600 2024-09-13T06:09:57.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.951+0000 7f57b2ffd640 1 -- 172.21.15.194:0/2945801758 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f58c0020d10 con 0x5583fe6dc600 2024-09-13T06:09:57.953 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.951+0000 7f57b2ffd640 1 --2- 172.21.15.194:0/2945801758 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f57a40346a0 0x7f57a4036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:57.953 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.951+0000 7f57b2ffd640 1 -- 172.21.15.194:0/2945801758 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f58c004fc60 con 0x5583fe6dc600 2024-09-13T06:09:57.953 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.951+0000 7f58ccdd0640 1 --2- 172.21.15.194:0/2945801758 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f57a40346a0 0x7f57a4036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:57.953 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.951+0000 7f58cfac1980 1 Processor -- start 2024-09-13T06:09:57.953 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.951+0000 7f58cfac1980 1 -- start start 2024-09-13T06:09:57.953 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.951+0000 7f58cfac1980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5583fe6e8ec0 0x5583fe6e92a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:57.953 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.951+0000 7f58ccdd0640 1 --2- 172.21.15.194:0/2945801758 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f57a40346a0 0x7f57a4036b60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x5583fe6c6280 tx=0x7f58c4005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:57.953 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.951+0000 7f58cfac1980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5583fe6b7d40 con 0x5583fe6e8ec0 2024-09-13T06:09:57.953 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.951+0000 7f58cd5d1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5583fe6e8ec0 0x5583fe6e92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:57.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.951+0000 7f58cd5d1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5583fe6e8ec0 0x5583fe6e92a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45388/0 (socket says 172.21.15.194:45388) 2024-09-13T06:09:57.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.951+0000 7f58cd5d1640 1 -- 172.21.15.194:0/830217495 learned_addr learned my addr 172.21.15.194:0/830217495 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:57.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.951+0000 7f58cd5d1640 1 -- 172.21.15.194:0/830217495 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583fe6e9870 con 0x5583fe6e8ec0 2024-09-13T06:09:57.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.951+0000 7f58cd5d1640 1 --2- 172.21.15.194:0/830217495 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5583fe6e8ec0 0x5583fe6e92a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f58c004ffd0 tx=0x7f58c004d4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d82602a7ee754c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:57.955 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.951+0000 7f57b0ff9640 1 -- 172.21.15.194:0/830217495 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58c0020470 con 0x5583fe6e8ec0 2024-09-13T06:09:57.956 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.951+0000 7f57b0ff9640 1 -- 172.21.15.194:0/830217495 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58c005d070 con 0x5583fe6e8ec0 2024-09-13T06:09:57.956 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.951+0000 7f57b0ff9640 1 -- 172.21.15.194:0/830217495 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58c0020730 con 0x5583fe6e8ec0 2024-09-13T06:09:57.956 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.951+0000 7f58cfac1980 1 -- 172.21.15.194:0/830217495 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5583fe6e8ec0 msgr2=0x5583fe6e92a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:57.956 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.951+0000 7f58cfac1980 1 --2- 172.21.15.194:0/830217495 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5583fe6e8ec0 0x5583fe6e92a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f58c004ffd0 tx=0x7f58c004d4d0 comp rx=0 tx=0).stop 2024-09-13T06:09:57.956 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.951+0000 7f58cfac1980 1 -- 172.21.15.194:0/830217495 shutdown_connections 2024-09-13T06:09:57.956 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.951+0000 7f58cfac1980 1 --2- 172.21.15.194:0/830217495 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5583fe6e8ec0 0x5583fe6e92a0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:57.956 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.951+0000 7f58cfac1980 1 -- 172.21.15.194:0/830217495 >> 172.21.15.194:0/830217495 conn(0x5583fe6e52a0 msgr2=0x5583fe6e33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:57.956 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.951+0000 7f58cfac1980 1 -- 172.21.15.194:0/830217495 shutdown_connections 2024-09-13T06:09:57.956 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.951+0000 7f58cfac1980 1 -- 172.21.15.194:0/830217495 wait complete. 2024-09-13T06:09:57.956 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.955+0000 7f58cfac1980 1 Processor -- start 2024-09-13T06:09:57.956 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.955+0000 7f58cfac1980 1 -- start start 2024-09-13T06:09:57.956 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.955+0000 7f58cfac1980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5583fe6e8ec0 0x5583fe6f0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:57.957 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.955+0000 7f58cfac1980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5583fe6e9d10 con 0x5583fe6e8ec0 2024-09-13T06:09:57.957 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.955+0000 7f58cd5d1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5583fe6e8ec0 0x5583fe6f0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:57.957 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.955+0000 7f58cd5d1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5583fe6e8ec0 0x5583fe6f0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45396/0 (socket says 172.21.15.194:45396) 2024-09-13T06:09:57.957 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.955+0000 7f58cd5d1640 1 -- 172.21.15.194:0/1099922082 learned_addr learned my addr 172.21.15.194:0/1099922082 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:57.957 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.955+0000 7f58cd5d1640 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583fe6f0540 con 0x5583fe6e8ec0 2024-09-13T06:09:57.957 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.955+0000 7f58cd5d1640 1 --2- 172.21.15.194:0/1099922082 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5583fe6e8ec0 0x5583fe6f0000 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f58c0028f20 tx=0x7f58c0025f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:57.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.955+0000 7f57a2ffd640 1 -- 172.21.15.194:0/1099922082 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58c006b070 con 0x5583fe6e8ec0 2024-09-13T06:09:57.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.955+0000 7f58cfac1980 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5583fe6f0540 con 0x5583fe6e8ec0 2024-09-13T06:09:57.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.955+0000 7f57a2ffd640 1 -- 172.21.15.194:0/1099922082 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58c0048830 con 0x5583fe6e8ec0 2024-09-13T06:09:57.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.955+0000 7f57a2ffd640 1 -- 172.21.15.194:0/1099922082 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58c0028b40 con 0x5583fe6e8ec0 2024-09-13T06:09:57.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.955+0000 7f58cfac1980 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583fe6f09b0 con 0x5583fe6e8ec0 2024-09-13T06:09:57.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.955+0000 7f58cfac1980 20 rados->read ofs=0 len=0 2024-09-13T06:09:57.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.955+0000 7f57a2ffd640 1 -- 172.21.15.194:0/1099922082 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f58c006e070 con 0x5583fe6e8ec0 2024-09-13T06:09:57.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.955+0000 7f57a2ffd640 1 --2- 172.21.15.194:0/1099922082 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f5798034650 0x7f5798036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:57.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.955+0000 7f57a2ffd640 1 -- 172.21.15.194:0/1099922082 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f58c0054030 con 0x5583fe6e8ec0 2024-09-13T06:09:57.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.955+0000 7f58ccdd0640 1 --2- 172.21.15.194:0/1099922082 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f5798034650 0x7f5798036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:57.962 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.955+0000 7f58cfac1980 1 --2- 172.21.15.194:0/1099922082 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5583fe6fafc0 0x5583fe6fd460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:57.962 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.955+0000 7f58cfac1980 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5583fe6fdbb0 con 0x5583fe6fafc0 2024-09-13T06:09:57.962 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.955+0000 7f58cddd2640 1 --2- 172.21.15.194:0/1099922082 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5583fe6fafc0 0x5583fe6fd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:57.962 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.959+0000 7f58cddd2640 1 --2- 172.21.15.194:0/1099922082 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5583fe6fafc0 0x5583fe6fd460 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:57.962 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.959+0000 7f58ccdd0640 1 --2- 172.21.15.194:0/1099922082 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f5798034650 0x7f5798036b10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f58c401b2c0 tx=0x7f58c40b8040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:57.962 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.959+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f58c80083f0 con 0x5583fe6fafc0 2024-09-13T06:09:57.962 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.959+0000 7f58cfac1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:57.962 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.959+0000 7f58cfac1980 20 realm 2024-09-13T06:09:57.962 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.959+0000 7f58cfac1980 20 rados->read ofs=0 len=0 2024-09-13T06:09:57.962 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.959+0000 7f58cfac1980 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5583fe6fe010 con 0x5583fe6fafc0 2024-09-13T06:09:57.962 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.959+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f58c80083f0 con 0x5583fe6fafc0 2024-09-13T06:09:57.962 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.959+0000 7f58cfac1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:57.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.959+0000 7f58cfac1980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:09:57.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.959+0000 7f58cfac1980 20 rados->read ofs=0 len=0 2024-09-13T06:09:57.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.959+0000 7f58cfac1980 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5583fe6fe8b0 con 0x5583fe6fafc0 2024-09-13T06:09:57.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.959+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f58c80083f0 con 0x5583fe6fafc0 2024-09-13T06:09:57.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.959+0000 7f58cfac1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:57.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.959+0000 7f58cfac1980 20 rados->read ofs=0 len=0 2024-09-13T06:09:57.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.959+0000 7f58cfac1980 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5583fe6fec50 con 0x5583fe6fafc0 2024-09-13T06:09:57.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.959+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f58c80083f0 con 0x5583fe6fafc0 2024-09-13T06:09:57.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.959+0000 7f58cfac1980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:57.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.959+0000 7f58cfac1980 20 rados->read ofs=0 len=0 2024-09-13T06:09:57.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.959+0000 7f58cfac1980 1 --2- 172.21.15.194:0/1099922082 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5583fe6ff9b0 0x5583fe701da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:57.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.959+0000 7f58cfac1980 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5583fe7022e0 con 0x5583fe6ff9b0 2024-09-13T06:09:57.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.959+0000 7f58cd5d1640 1 --2- 172.21.15.194:0/1099922082 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5583fe6ff9b0 0x5583fe701da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:57.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.959+0000 7f58cd5d1640 1 --2- 172.21.15.194:0/1099922082 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5583fe6ff9b0 0x5583fe701da0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:57.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.959+0000 7f58cd5d1640 1 -- 172.21.15.194:0/1099922082 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f58c0077070 con 0x5583fe6ff9b0 2024-09-13T06:09:57.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.959+0000 7f58cfac1980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:09:57.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.959+0000 7f58cfac1980 20 searching for the correct realm 2024-09-13T06:09:57.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.959+0000 7f58cfac1980 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5583fe703bb0 con 0x5583fe6ff9b0 2024-09-13T06:09:57.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.959+0000 7f58cd5d1640 1 -- 172.21.15.194:0/1099922082 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58c0077070 con 0x5583fe6ff9b0 2024-09-13T06:09:57.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.959+0000 7f58cd5d1640 1 --2- 172.21.15.194:0/1099922082 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f58c0070070 0x7f58c00411c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:57.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.959+0000 7f58cd5d1640 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5583fe703bb0 con 0x7f58c0070070 2024-09-13T06:09:57.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.959+0000 7f58ccdd0640 1 --2- 172.21.15.194:0/1099922082 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f58c0070070 0x7f58c00411c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:57.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.959+0000 7f58ccdd0640 1 --2- 172.21.15.194:0/1099922082 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f58c0070070 0x7f58c00411c0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:57.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.959+0000 7f58ccdd0640 1 -- 172.21.15.194:0/1099922082 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f58c40d7070 con 0x7f58c0070070 2024-09-13T06:09:57.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.959+0000 7f58ccdd0640 1 --2- 172.21.15.194:0/1099922082 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f58c40cc040 0x7f58c40d9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:57.968 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.959+0000 7f58ccdd0640 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5583fe703bb0 con 0x7f58c40cc040 2024-09-13T06:09:57.968 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.959+0000 7f58cddd2640 1 --2- 172.21.15.194:0/1099922082 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f58c40cc040 0x7f58c40d9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:57.968 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.963+0000 7f58cddd2640 1 --2- 172.21.15.194:0/1099922082 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f58c40cc040 0x7f58c40d9410 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:57.968 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.963+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58c80083f0 con 0x7f58c40cc040 2024-09-13T06:09:57.968 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.963+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5583fe6fec50 con 0x5583fe6fafc0 2024-09-13T06:09:57.968 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.963+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58c80083f0 con 0x5583fe6fafc0 2024-09-13T06:09:57.968 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.963+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5583fe6fec50 con 0x5583fe6fafc0 2024-09-13T06:09:57.968 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.963+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58c80083f0 con 0x5583fe6fafc0 2024-09-13T06:09:57.968 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.963+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5583fe6fec50 con 0x7f58c40cc040 2024-09-13T06:09:57.968 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.963+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58c80083f0 con 0x7f58c40cc040 2024-09-13T06:09:57.968 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.963+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5583fe6fec50 con 0x7f58c40cc040 2024-09-13T06:09:57.968 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.963+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58c80083f0 con 0x7f58c40cc040 2024-09-13T06:09:57.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.963+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5583fe6fec50 con 0x7f58c0070070 2024-09-13T06:09:57.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.963+0000 7f58ccdd0640 1 -- 172.21.15.194:0/1099922082 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58c40e3040 con 0x7f58c0070070 2024-09-13T06:09:57.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.963+0000 7f58ccdd0640 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5583fe6fec50 con 0x5583fe6ff9b0 2024-09-13T06:09:57.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.963+0000 7f58cd5d1640 1 -- 172.21.15.194:0/1099922082 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58c0077070 con 0x5583fe6ff9b0 2024-09-13T06:09:57.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.963+0000 7f58cd5d1640 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5583fe6fec50 con 0x5583fe6fafc0 2024-09-13T06:09:57.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.963+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58c80083f0 con 0x5583fe6fafc0 2024-09-13T06:09:57.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.963+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5583fe6fec50 con 0x7f58c40cc040 2024-09-13T06:09:57.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.967+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58c80083f0 con 0x7f58c40cc040 2024-09-13T06:09:57.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.967+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5583fe6fec50 con 0x5583fe6fafc0 2024-09-13T06:09:57.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.967+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58c80083f0 con 0x5583fe6fafc0 2024-09-13T06:09:57.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.967+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5583fe6fec50 con 0x7f58c0070070 2024-09-13T06:09:57.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.967+0000 7f58ccdd0640 1 -- 172.21.15.194:0/1099922082 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f58c40e3040 con 0x7f58c0070070 2024-09-13T06:09:57.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.967+0000 7f58ccdd0640 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5583fe6fec50 con 0x5583fe6ff9b0 2024-09-13T06:09:57.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.967+0000 7f58cd5d1640 1 -- 172.21.15.194:0/1099922082 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58c0077070 con 0x5583fe6ff9b0 2024-09-13T06:09:57.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.967+0000 7f58cd5d1640 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5583fe6fec50 con 0x5583fe6ff9b0 2024-09-13T06:09:57.972 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.967+0000 7f58cd5d1640 1 -- 172.21.15.194:0/1099922082 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58c0077070 con 0x5583fe6ff9b0 2024-09-13T06:09:57.972 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.967+0000 7f58cd5d1640 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5583fe6fec50 con 0x7f58c40cc040 2024-09-13T06:09:57.972 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.967+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58c80083f0 con 0x7f58c40cc040 2024-09-13T06:09:57.972 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.967+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5583fe6fec50 con 0x5583fe6ff9b0 2024-09-13T06:09:57.973 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.967+0000 7f58cd5d1640 1 -- 172.21.15.194:0/1099922082 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58c0077070 con 0x5583fe6ff9b0 2024-09-13T06:09:57.973 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.967+0000 7f58cd5d1640 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5583fe6fec50 con 0x5583fe6ff9b0 2024-09-13T06:09:57.973 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.967+0000 7f58cd5d1640 1 -- 172.21.15.194:0/1099922082 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58c0077070 con 0x5583fe6ff9b0 2024-09-13T06:09:57.973 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.967+0000 7f58cd5d1640 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5583fe6fec50 con 0x5583fe6fafc0 2024-09-13T06:09:57.973 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.967+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58c80083f0 con 0x5583fe6fafc0 2024-09-13T06:09:57.973 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.967+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5583fe6fec50 con 0x5583fe6fafc0 2024-09-13T06:09:57.973 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.967+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f58c80083f0 con 0x5583fe6fafc0 2024-09-13T06:09:57.973 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.967+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5583fe6fec50 con 0x7f58c40cc040 2024-09-13T06:09:57.973 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.971+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58c80083f0 con 0x7f58c40cc040 2024-09-13T06:09:57.973 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.971+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5583fe6fec50 con 0x5583fe6ff9b0 2024-09-13T06:09:57.973 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.971+0000 7f58cd5d1640 1 -- 172.21.15.194:0/1099922082 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58c0077070 con 0x5583fe6ff9b0 2024-09-13T06:09:57.973 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.971+0000 7f58cd5d1640 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5583fe6fec50 con 0x7f58c0070070 2024-09-13T06:09:57.973 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.971+0000 7f58ccdd0640 1 -- 172.21.15.194:0/1099922082 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58c40e3040 con 0x7f58c0070070 2024-09-13T06:09:57.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.971+0000 7f58ccdd0640 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5583fe6fec50 con 0x5583fe6fafc0 2024-09-13T06:09:57.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.971+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58c80083f0 con 0x5583fe6fafc0 2024-09-13T06:09:57.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.971+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5583fe6fec50 con 0x7f58c40cc040 2024-09-13T06:09:57.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.971+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58c80083f0 con 0x7f58c40cc040 2024-09-13T06:09:57.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.971+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5583fe6fec50 con 0x5583fe6ff9b0 2024-09-13T06:09:57.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.971+0000 7f58cd5d1640 1 -- 172.21.15.194:0/1099922082 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f58c0077070 con 0x5583fe6ff9b0 2024-09-13T06:09:57.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.971+0000 7f58cd5d1640 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5583fe6fec50 con 0x7f58c40cc040 2024-09-13T06:09:57.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.971+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58c80083f0 con 0x7f58c40cc040 2024-09-13T06:09:57.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.971+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5583fe6fec50 con 0x7f58c0070070 2024-09-13T06:09:57.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.971+0000 7f58ccdd0640 1 -- 172.21.15.194:0/1099922082 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58c40e3040 con 0x7f58c0070070 2024-09-13T06:09:57.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.971+0000 7f58ccdd0640 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5583fe6fec50 con 0x5583fe6ff9b0 2024-09-13T06:09:57.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.971+0000 7f58cd5d1640 1 -- 172.21.15.194:0/1099922082 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58c0077070 con 0x5583fe6ff9b0 2024-09-13T06:09:57.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.971+0000 7f58cd5d1640 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5583fe6fec50 con 0x7f58c40cc040 2024-09-13T06:09:57.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.971+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58c80083f0 con 0x7f58c40cc040 2024-09-13T06:09:57.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.971+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5583fe6fec50 con 0x5583fe6fafc0 2024-09-13T06:09:57.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.975+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f58c80083f0 con 0x5583fe6fafc0 2024-09-13T06:09:57.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.975+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5583fe6fec50 con 0x7f58c0070070 2024-09-13T06:09:57.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.975+0000 7f58ccdd0640 1 -- 172.21.15.194:0/1099922082 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58c40e3040 con 0x7f58c0070070 2024-09-13T06:09:57.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.975+0000 7f58cfac1980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:09:57.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.975+0000 7f58cfac1980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:09:57.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.975+0000 7f58cfac1980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:09:57.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.975+0000 7f58cfac1980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:09:57.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.975+0000 7f58cfac1980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:09:57.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.975+0000 7f58cfac1980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:09:57.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.975+0000 7f58cfac1980 20 rados->read ofs=0 len=0 2024-09-13T06:09:57.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.975+0000 7f58cfac1980 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5583fe702cd0 con 0x5583fe6fafc0 2024-09-13T06:09:57.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.975+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f58c80083f0 con 0x5583fe6fafc0 2024-09-13T06:09:57.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.975+0000 7f58cfac1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:57.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.975+0000 7f58cfac1980 20 rados->read ofs=0 len=0 2024-09-13T06:09:57.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.975+0000 7f58cfac1980 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5583fe702910 con 0x5583fe6fafc0 2024-09-13T06:09:57.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.975+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f58c80083f0 con 0x5583fe6fafc0 2024-09-13T06:09:57.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.975+0000 7f58cfac1980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:57.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.975+0000 7f58cfac1980 20 rados->read ofs=0 len=0 2024-09-13T06:09:57.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.975+0000 7f58cfac1980 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5583fe7028e0 con 0x7f58c0070070 2024-09-13T06:09:57.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.975+0000 7f58ccdd0640 1 -- 172.21.15.194:0/1099922082 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f58c40e3040 con 0x7f58c0070070 2024-09-13T06:09:57.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.975+0000 7f58cfac1980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:09:57.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.975+0000 7f58cfac1980 20 zone default found 2024-09-13T06:09:57.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.975+0000 7f58cfac1980 4 Realm: () 2024-09-13T06:09:57.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.975+0000 7f58cfac1980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:09:57.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.975+0000 7f58cfac1980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:09:57.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.975+0000 7f58cfac1980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:09:57.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.975+0000 7f58cfac1980 20 zonegroup default 2024-09-13T06:09:57.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.975+0000 7f58cfac1980 20 rados->read ofs=0 len=0 2024-09-13T06:09:57.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.975+0000 7f58cfac1980 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5583fe703af0 con 0x7f58c40cc040 2024-09-13T06:09:57.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.975+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f58c80083f0 con 0x7f58c40cc040 2024-09-13T06:09:57.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.975+0000 7f58cfac1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:57.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.975+0000 7f58cfac1980 20 rados->read ofs=0 len=0 2024-09-13T06:09:57.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.975+0000 7f58cfac1980 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5583fe705a60 con 0x5583fe6ff9b0 2024-09-13T06:09:57.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.975+0000 7f58cd5d1640 1 -- 172.21.15.194:0/1099922082 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f58c0077070 con 0x5583fe6ff9b0 2024-09-13T06:09:57.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.975+0000 7f58cfac1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:57.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.975+0000 7f58cfac1980 20 rados->read ofs=0 len=0 2024-09-13T06:09:57.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.975+0000 7f58cfac1980 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5583fe705e30 con 0x5583fe6ff9b0 2024-09-13T06:09:57.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.975+0000 7f58cd5d1640 1 -- 172.21.15.194:0/1099922082 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f58c0077070 con 0x5583fe6ff9b0 2024-09-13T06:09:57.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.975+0000 7f58cfac1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:57.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.975+0000 7f58cfac1980 20 started sync module instance, tier type = 2024-09-13T06:09:57.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.975+0000 7f58cfac1980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:09:57.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.975+0000 7f58cfac1980 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5583fe704f00 con 0x7f58c0070070 2024-09-13T06:09:57.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.979+0000 7f58ccdd0640 1 -- 172.21.15.194:0/1099922082 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(44 notify.0 [create] v33'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58c40e3040 con 0x7f58c0070070 2024-09-13T06:09:57.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.979+0000 7f58cfac1980 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94025397850864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5583fe704b60 con 0x7f58c0070070 2024-09-13T06:09:57.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.979+0000 7f58cfac1980 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5583fe706d40 con 0x5583fe6fafc0 2024-09-13T06:09:57.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.979+0000 7f58ccdd0640 1 -- 172.21.15.194:0/1099922082 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94025397850864] v33'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58c40e3040 con 0x7f58c0070070 2024-09-13T06:09:57.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.979+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v33'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58c80083f0 con 0x5583fe6fafc0 2024-09-13T06:09:57.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.979+0000 7f58cfac1980 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94025397856400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5583fe706cb0 con 0x5583fe6fafc0 2024-09-13T06:09:57.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.979+0000 7f58cfac1980 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5583fe707af0 con 0x5583fe6ff9b0 2024-09-13T06:09:57.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.983+0000 7f58cd5d1640 1 -- 172.21.15.194:0/1099922082 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v33'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58c0077070 con 0x5583fe6ff9b0 2024-09-13T06:09:57.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.983+0000 7f58cfac1980 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94025397859808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5583fe708390 con 0x5583fe6ff9b0 2024-09-13T06:09:57.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.983+0000 7f58cfac1980 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5583fe708db0 con 0x7f58c0070070 2024-09-13T06:09:57.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.983+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94025397856400] v33'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58c80083f0 con 0x5583fe6fafc0 2024-09-13T06:09:57.985 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.983+0000 7f58ccdd0640 1 -- 172.21.15.194:0/1099922082 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(50 notify.3 [create] v33'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58c40e3040 con 0x7f58c0070070 2024-09-13T06:09:57.985 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.983+0000 7f58cfac1980 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94025397864608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5583fe7091a0 con 0x7f58c0070070 2024-09-13T06:09:57.985 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.983+0000 7f58cfac1980 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5583fe709b60 con 0x5583fe6fafc0 2024-09-13T06:09:57.985 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.983+0000 7f58cd5d1640 1 -- 172.21.15.194:0/1099922082 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94025397859808] v33'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58c0077070 con 0x5583fe6ff9b0 2024-09-13T06:09:57.986 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.983+0000 7f58ccdd0640 1 -- 172.21.15.194:0/1099922082 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94025397864608] v33'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58c40e3040 con 0x7f58c0070070 2024-09-13T06:09:57.986 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.983+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v33'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58c80083f0 con 0x5583fe6fafc0 2024-09-13T06:09:57.986 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.983+0000 7f58cfac1980 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94025397858608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5583fe7096b0 con 0x5583fe6fafc0 2024-09-13T06:09:57.986 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.983+0000 7f58cfac1980 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5583fe709f00 con 0x7f58c40cc040 2024-09-13T06:09:57.988 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.987+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94025397858608] v33'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58c80083f0 con 0x5583fe6fafc0 2024-09-13T06:09:57.988 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.987+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(54 notify.5 [create] v33'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58c80083f0 con 0x7f58c40cc040 2024-09-13T06:09:57.988 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.987+0000 7f58cfac1980 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94025397868208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5583fe70a2f0 con 0x7f58c40cc040 2024-09-13T06:09:57.989 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.987+0000 7f58cfac1980 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5583fe70ab40 con 0x7f58c40cc040 2024-09-13T06:09:57.990 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.991+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94025397868208] v33'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58c80083f0 con 0x7f58c40cc040 2024-09-13T06:09:57.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.991+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(56 notify.6 [create] v33'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58c80083f0 con 0x7f58c40cc040 2024-09-13T06:09:57.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.991+0000 7f58cfac1980 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94025397869264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5583fe70a7a0 con 0x7f58c40cc040 2024-09-13T06:09:57.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.991+0000 7f58cfac1980 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5583fe70b1f0 con 0x7f58c40cc040 2024-09-13T06:09:57.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.995+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94025397869264] v33'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58c80083f0 con 0x7f58c40cc040 2024-09-13T06:09:57.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.995+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(58 notify.7 [create] v33'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58c80083f0 con 0x7f58c40cc040 2024-09-13T06:09:57.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.995+0000 7f58cfac1980 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94025397873888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5583fe70b3d0 con 0x7f58c40cc040 2024-09-13T06:09:57.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.995+0000 7f58cfac1980 20 add_watcher() i=0 2024-09-13T06:09:57.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.995+0000 7f58cfac1980 20 add_watcher() i=1 2024-09-13T06:09:57.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.995+0000 7f58cfac1980 20 add_watcher() i=2 2024-09-13T06:09:57.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.995+0000 7f58cfac1980 20 add_watcher() i=3 2024-09-13T06:09:57.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.995+0000 7f58cfac1980 20 add_watcher() i=4 2024-09-13T06:09:57.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.995+0000 7f58cfac1980 20 add_watcher() i=5 2024-09-13T06:09:57.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.995+0000 7f58cfac1980 20 add_watcher() i=6 2024-09-13T06:09:57.998 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.995+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94025397873888] v33'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58c80083f0 con 0x7f58c40cc040 2024-09-13T06:09:57.998 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.995+0000 7f58cfac1980 20 add_watcher() i=7 2024-09-13T06:09:57.998 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.995+0000 7f58cfac1980 2 all 8 watchers are set, enabling cache 2024-09-13T06:09:57.998 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.995+0000 7f58cfac1980 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5583fe70e7a0 con 0x5583fe6fafc0 2024-09-13T06:09:57.998 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.995+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f58c80083f0 con 0x5583fe6fafc0 2024-09-13T06:09:57.998 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.995+0000 7f58cfac1980 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94025397875392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5583fe70bb90 con 0x5583fe6fafc0 2024-09-13T06:09:57.999 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.999+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94025397875392] v33'98 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f58c80083f0 con 0x5583fe6fafc0 2024-09-13T06:09:57.999 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.999+0000 7f57837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:57.999 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.999+0000 7f58cfac1980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:09:57.999 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.999+0000 7f58cfac1980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:09:58.000 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.999+0000 7f58cfac1980 5 note: GC not initialized 2024-09-13T06:09:58.001 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.999+0000 7f57827e4640 20 reqs_thread_entry: start 2024-09-13T06:09:58.001 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.999+0000 7f58cfac1980 20 init_complete bucket index max shards: 11 2024-09-13T06:09:58.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.999+0000 7f58cfac1980 20 Filter name: none 2024-09-13T06:09:58.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.999+0000 7f56f3fff640 20 reqs_thread_entry: start 2024-09-13T06:09:58.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.999+0000 7f58cfac1980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.999+0000 7f58cfac1980 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5583fe7317a0 con 0x5583fe6fafc0 2024-09-13T06:09:58.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.999+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f58c80083f0 con 0x5583fe6fafc0 2024-09-13T06:09:58.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.999+0000 7f58cfac1980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T06:09:58.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.999+0000 7f58cfac1980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.999+0000 7f58cfac1980 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5583fe732190 con 0x5583fe6fafc0 2024-09-13T06:09:58.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.999+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f58c80083f0 con 0x5583fe6fafc0 2024-09-13T06:09:58.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.999+0000 7f58cfac1980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T06:09:58.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.999+0000 7f58cfac1980 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5583fe7331a0 con 0x7f58c0070070 2024-09-13T06:09:58.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.999+0000 7f58ccdd0640 1 -- 172.21.15.194:0/1099922082 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f58c40e3040 con 0x7f58c0070070 2024-09-13T06:09:58.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.999+0000 7f58cfac1980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.999+0000 7f58cfac1980 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:65 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5583fe730a50 con 0x7f58c0070070 2024-09-13T06:09:58.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.999+0000 7f58ccdd0640 1 -- 172.21.15.194:0/1099922082 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(65 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f58c40e3040 con 0x7f58c0070070 2024-09-13T06:09:58.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.999+0000 7f58cfac1980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T06:09:58.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.999+0000 7f58cfac1980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:57.999+0000 7f58cfac1980 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:66 8.18 8:1a66c368:root::.bucket.meta.myfoo%3a52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5583fe732dd0 con 0x5583fe6fafc0 2024-09-13T06:09:58.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.003+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(66 .bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv12 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f58c80083f0 con 0x5583fe6fafc0 2024-09-13T06:09:58.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.003+0000 7f58cfac1980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T06:09:58.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.003+0000 7f58cfac1980 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-13T06:09:58.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.003+0000 7f58cfac1980 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:67 4.25 4:a5fa2579:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5583fe7323d0 con 0x5583fe6ff9b0 2024-09-13T06:09:58.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.003+0000 7f58cfac1980 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:68 4.2c 4:3660bce8:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5583fe737930 con 0x5583fe6fafc0 2024-09-13T06:09:58.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.003+0000 7f58cfac1980 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:69 4.14 4:2a98937a:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5583fe732410 con 0x5583fe6ff9b0 2024-09-13T06:09:58.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.003+0000 7f58cfac1980 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:70 4.27 4:e42c957a:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5583fe73c8b0 con 0x5583fe6fafc0 2024-09-13T06:09:58.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.003+0000 7f58cfac1980 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:71 4.5 4:a24186ed:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5583fe73f4e0 con 0x5583fe6ff9b0 2024-09-13T06:09:58.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.003+0000 7f58cfac1980 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:72 4.13 4:cad7efb2:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5583fe7421c0 con 0x7f58c0070070 2024-09-13T06:09:58.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.003+0000 7f58cfac1980 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:73 4.3 4:c1107af5:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5583fe73f4e0 con 0x5583fe6fafc0 2024-09-13T06:09:58.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.003+0000 7f58cfac1980 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:74 4.27 4:e6338292:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5583fe7472c0 con 0x5583fe6fafc0 2024-09-13T06:09:58.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.003+0000 7f58cfac1980 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:75 4.2a 4:57abd676:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5583fe74a180 con 0x5583fe6fafc0 2024-09-13T06:09:58.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.003+0000 7f58cfac1980 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:76 4.38 4:1e9df731:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5583fe74cec0 con 0x5583fe6fafc0 2024-09-13T06:09:58.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.003+0000 7f58cfac1980 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:77 4.2b 4:d7fbcf05:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5583fe74a180 con 0x5583fe6fafc0 2024-09-13T06:09:58.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.003+0000 7f58cd5d1640 1 -- 172.21.15.194:0/1099922082 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(67 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f58c0077070 con 0x5583fe6ff9b0 2024-09-13T06:09:58.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.003+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(68 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f58c80083f0 con 0x5583fe6fafc0 2024-09-13T06:09:58.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.003+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 <== osd.1 v2:172.21.15.194:6808/3135444559 25 ==== osd_op_reply(70 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f58c80083f0 con 0x5583fe6fafc0 2024-09-13T06:09:58.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.003+0000 7f58ccdd0640 1 -- 172.21.15.194:0/1099922082 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(72 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f58c40e3040 con 0x7f58c0070070 2024-09-13T06:09:58.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.003+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 <== osd.1 v2:172.21.15.194:6808/3135444559 26 ==== osd_op_reply(73 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f58c80083f0 con 0x5583fe6fafc0 2024-09-13T06:09:58.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.003+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 <== osd.1 v2:172.21.15.194:6808/3135444559 27 ==== osd_op_reply(74 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.7 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f58c80083f0 con 0x5583fe6fafc0 2024-09-13T06:09:58.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.003+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 <== osd.1 v2:172.21.15.194:6808/3135444559 28 ==== osd_op_reply(75 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f58c80083f0 con 0x5583fe6fafc0 2024-09-13T06:09:58.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.003+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 <== osd.1 v2:172.21.15.194:6808/3135444559 29 ==== osd_op_reply(76 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f58c80083f0 con 0x5583fe6fafc0 2024-09-13T06:09:58.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.003+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 <== osd.1 v2:172.21.15.194:6808/3135444559 30 ==== osd_op_reply(77 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f58c80083f0 con 0x5583fe6fafc0 2024-09-13T06:09:58.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.003+0000 7f58cd5d1640 1 -- 172.21.15.194:0/1099922082 <== osd.3 v2:172.21.15.194:6816/96632515 16 ==== osd_op_reply(69 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f58c0077070 con 0x5583fe6ff9b0 2024-09-13T06:09:58.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.003+0000 7f58cd5d1640 1 -- 172.21.15.194:0/1099922082 <== osd.3 v2:172.21.15.194:6816/96632515 17 ==== osd_op_reply(71 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f58c0077070 con 0x5583fe6ff9b0 2024-09-13T06:09:58.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.003+0000 7f57837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:58.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.003+0000 7f58cfac1980 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94025397875392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5583fe722480 con 0x5583fe6fafc0 2024-09-13T06:09:58.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.007+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 <== osd.1 v2:172.21.15.194:6808/3135444559 31 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 94025397875392] v33'99 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f58c80083f0 con 0x5583fe6fafc0 2024-09-13T06:09:58.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.007+0000 7f58cfac1980 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94025397850864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5583fe722480 con 0x7f58c0070070 2024-09-13T06:09:58.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.007+0000 7f58ccdd0640 1 -- 172.21.15.194:0/1099922082 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 94025397850864] v33'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58c40e3040 con 0x7f58c0070070 2024-09-13T06:09:58.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.007+0000 7f58cfac1980 20 remove_watcher() i=0 2024-09-13T06:09:58.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.007+0000 7f58cfac1980 2 removed watcher, disabling cache 2024-09-13T06:09:58.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.007+0000 7f58cfac1980 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94025397856400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5583fe722480 con 0x5583fe6fafc0 2024-09-13T06:09:58.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.007+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 <== osd.1 v2:172.21.15.194:6808/3135444559 32 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 94025397856400] v33'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58c80083f0 con 0x5583fe6fafc0 2024-09-13T06:09:58.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.007+0000 7f58cfac1980 20 remove_watcher() i=1 2024-09-13T06:09:58.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.007+0000 7f58cfac1980 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94025397859808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5583fe722480 con 0x5583fe6ff9b0 2024-09-13T06:09:58.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.011+0000 7f58cd5d1640 1 -- 172.21.15.194:0/1099922082 <== osd.3 v2:172.21.15.194:6816/96632515 18 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 94025397859808] v33'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58c0077070 con 0x5583fe6ff9b0 2024-09-13T06:09:58.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.011+0000 7f58cfac1980 20 remove_watcher() i=2 2024-09-13T06:09:58.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.011+0000 7f58cfac1980 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94025397864608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5583fe722480 con 0x7f58c0070070 2024-09-13T06:09:58.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.011+0000 7f58ccdd0640 1 -- 172.21.15.194:0/1099922082 <== osd.2 v2:172.21.15.194:6800/815615585 16 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 94025397864608] v33'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58c40e3040 con 0x7f58c0070070 2024-09-13T06:09:58.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.011+0000 7f58cfac1980 20 remove_watcher() i=3 2024-09-13T06:09:58.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.011+0000 7f58cfac1980 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94025397858608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5583fe722480 con 0x5583fe6fafc0 2024-09-13T06:09:58.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.015+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 <== osd.1 v2:172.21.15.194:6808/3135444559 33 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 94025397858608] v33'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58c80083f0 con 0x5583fe6fafc0 2024-09-13T06:09:58.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.015+0000 7f58cfac1980 20 remove_watcher() i=4 2024-09-13T06:09:58.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.015+0000 7f58cfac1980 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94025397868208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5583fe722480 con 0x7f58c40cc040 2024-09-13T06:09:58.017 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.015+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 94025397868208] v33'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58c80083f0 con 0x7f58c40cc040 2024-09-13T06:09:58.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.015+0000 7f58cfac1980 20 remove_watcher() i=5 2024-09-13T06:09:58.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.015+0000 7f58cfac1980 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94025397869264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5583fe722480 con 0x7f58c40cc040 2024-09-13T06:09:58.020 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.019+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 94025397869264] v33'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58c80083f0 con 0x7f58c40cc040 2024-09-13T06:09:58.020 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.019+0000 7f58cfac1980 20 remove_watcher() i=6 2024-09-13T06:09:58.020 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.019+0000 7f58cfac1980 1 -- 172.21.15.194:0/1099922082 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94025397873888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5583fe722480 con 0x7f58c40cc040 2024-09-13T06:09:58.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.019+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 94025397873888] v33'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58c80083f0 con 0x7f58c40cc040 2024-09-13T06:09:58.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.019+0000 7f58cfac1980 20 remove_watcher() i=7 2024-09-13T06:09:58.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.023+0000 7f58cfac1980 1 -- 172.21.15.194:0/1099922082 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f58c40cc040 msgr2=0x7f58c40d9410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.023+0000 7f58cfac1980 1 --2- 172.21.15.194:0/1099922082 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f58c40cc040 0x7f58c40d9410 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.023+0000 7f58cfac1980 1 -- 172.21.15.194:0/1099922082 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5583fe6fafc0 msgr2=0x5583fe6fd460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.023+0000 7f58cfac1980 1 --2- 172.21.15.194:0/1099922082 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5583fe6fafc0 0x5583fe6fd460 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.023+0000 7f58cfac1980 1 -- 172.21.15.194:0/1099922082 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f58c0070070 msgr2=0x7f58c00411c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.023+0000 7f58cfac1980 1 --2- 172.21.15.194:0/1099922082 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f58c0070070 0x7f58c00411c0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.023+0000 7f58cfac1980 1 -- 172.21.15.194:0/1099922082 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5583fe6ff9b0 msgr2=0x5583fe701da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.023+0000 7f58cfac1980 1 --2- 172.21.15.194:0/1099922082 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5583fe6ff9b0 0x5583fe701da0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.023+0000 7f58cfac1980 1 -- 172.21.15.194:0/1099922082 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f5798034650 msgr2=0x7f5798036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.023+0000 7f58cfac1980 1 --2- 172.21.15.194:0/1099922082 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f5798034650 0x7f5798036b10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f58c401b2c0 tx=0x7f58c40b8040 comp rx=0 tx=0).stop 2024-09-13T06:09:58.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.023+0000 7f58cfac1980 1 -- 172.21.15.194:0/1099922082 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5583fe6e8ec0 msgr2=0x5583fe6f0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.023+0000 7f58cddd2640 1 -- 172.21.15.194:0/1099922082 reap_dead start 2024-09-13T06:09:58.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.023+0000 7f58cfac1980 1 --2- 172.21.15.194:0/1099922082 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5583fe6e8ec0 0x5583fe6f0000 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f58c0028f20 tx=0x7f58c0025f80 comp rx=0 tx=0).stop 2024-09-13T06:09:58.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.023+0000 7f58cfac1980 1 -- 172.21.15.194:0/1099922082 shutdown_connections 2024-09-13T06:09:58.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.023+0000 7f58cfac1980 1 --2- 172.21.15.194:0/1099922082 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5583fe6e8ec0 0x5583fe6f0000 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.023+0000 7f58cfac1980 1 -- 172.21.15.194:0/1099922082 >> 172.21.15.194:0/1099922082 conn(0x5583fe6e52a0 msgr2=0x5583fe6e3370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:58.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.023+0000 7f58cfac1980 1 -- 172.21.15.194:0/1099922082 shutdown_connections 2024-09-13T06:09:58.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.023+0000 7f58cfac1980 1 -- 172.21.15.194:0/1099922082 wait complete. 2024-09-13T06:09:58.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.023+0000 7f58cfac1980 1 -- 172.21.15.194:0/2945801758 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f57a40346a0 msgr2=0x7f57a4036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.023+0000 7f58cfac1980 1 --2- 172.21.15.194:0/2945801758 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f57a40346a0 0x7f57a4036b60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x5583fe6c6280 tx=0x7f58c4005a10 comp rx=0 tx=0).stop 2024-09-13T06:09:58.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.023+0000 7f58cfac1980 1 -- 172.21.15.194:0/2945801758 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5583fe6dc600 msgr2=0x5583fe6dca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.023+0000 7f58cfac1980 1 --2- 172.21.15.194:0/2945801758 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5583fe6dc600 0x5583fe6dca20 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f58c0023000 tx=0x7f58c0010d50 comp rx=0 tx=0).stop 2024-09-13T06:09:58.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.023+0000 7f58cfac1980 1 -- 172.21.15.194:0/2945801758 shutdown_connections 2024-09-13T06:09:58.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.023+0000 7f58cfac1980 1 --2- 172.21.15.194:0/2945801758 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f57a40346a0 0x7f57a4036b60 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.023+0000 7f58cfac1980 1 --2- 172.21.15.194:0/2945801758 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5583fe6dc600 0x5583fe6dca20 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.023+0000 7f58cfac1980 1 -- 172.21.15.194:0/2945801758 >> 172.21.15.194:0/2945801758 conn(0x5583fe6d1750 msgr2=0x5583fe6d41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:58.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.023+0000 7f58cfac1980 1 -- 172.21.15.194:0/2945801758 shutdown_connections 2024-09-13T06:09:58.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.023+0000 7f58cfac1980 1 -- 172.21.15.194:0/2945801758 wait complete. 2024-09-13T06:09:58.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.023+0000 7f58cfac1980 1 -- 172.21.15.194:0/4220491149 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5583fe5c7870 msgr2=0x5583fe6c56f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.023+0000 7f58cfac1980 1 --2- 172.21.15.194:0/4220491149 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5583fe5c7870 0x5583fe6c56f0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.023+0000 7f58cfac1980 1 -- 172.21.15.194:0/4220491149 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5583fe6cc040 msgr2=0x5583fe6ce430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.023+0000 7f58cfac1980 1 --2- 172.21.15.194:0/4220491149 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5583fe6cc040 0x5583fe6ce430 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.023+0000 7f58cfac1980 1 -- 172.21.15.194:0/4220491149 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5583fe6c8100 msgr2=0x5583fe6ca4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.023+0000 7f58cfac1980 1 --2- 172.21.15.194:0/4220491149 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5583fe6c8100 0x5583fe6ca4f0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.023+0000 7f58cfac1980 1 -- 172.21.15.194:0/4220491149 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f57b4034650 msgr2=0x7f57b4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.023+0000 7f58cfac1980 1 --2- 172.21.15.194:0/4220491149 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f57b4034650 0x7f57b4036b10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f58c40ac000 tx=0x7f58c40a5000 comp rx=0 tx=0).stop 2024-09-13T06:09:58.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.023+0000 7f58cfac1980 1 -- 172.21.15.194:0/4220491149 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5583fe53a2d0 msgr2=0x5583fe6be760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.023+0000 7f58cfac1980 1 --2- 172.21.15.194:0/4220491149 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5583fe53a2d0 0x5583fe6be760 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x5583fe6b85d0 tx=0x7f58c0000f50 comp rx=0 tx=0).stop 2024-09-13T06:09:58.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.023+0000 7f58cddd2640 1 -- 172.21.15.194:0/4220491149 reap_dead start 2024-09-13T06:09:58.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.023+0000 7f58cfac1980 1 -- 172.21.15.194:0/4220491149 shutdown_connections 2024-09-13T06:09:58.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.023+0000 7f58cfac1980 1 -- 172.21.15.194:0/4220491149 >> 172.21.15.194:0/4220491149 conn(0x5583fe5c0090 msgr2=0x5583fe6b1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:58.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.023+0000 7f58cfac1980 1 -- 172.21.15.194:0/4220491149 shutdown_connections 2024-09-13T06:09:58.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.023+0000 7f58cfac1980 1 -- 172.21.15.194:0/4220491149 wait complete. 2024-09-13T06:09:58.035 INFO:teuthology.orchestra.run.smithi194.stdout:[{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"0faf3484-cad7-4c8f-892b-62107a753816","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1","marker":"52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-13T06:09:56.935102Z","creation_time":"2024-09-13T06:09:56.926052Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}}] 2024-09-13T06:09:58.035 DEBUG:tasks.util.rgw: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '0faf3484-cad7-4c8f-892b-62107a753816', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1', 'marker': '52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-13T06:09:56.935102Z', 'creation_time': '2024-09-13T06:09:56.926052Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}}] 2024-09-13T06:09:58.043 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-13T06:09:58.043 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-13T06:09:58.043 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-13T06:09:58.043 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-13T06:09:58.117 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:09:58.117 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:09:58.118 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.115+0000 7ff53b565980 1 Processor -- start 2024-09-13T06:09:58.118 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.119+0000 7ff53b565980 1 -- start start 2024-09-13T06:09:58.118 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.119+0000 7ff53b565980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x562fcb2a4e50 0x562fcb2a7240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.118 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.119+0000 7ff53b565980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562fcb126ae0 con 0x562fcb212b00 2024-09-13T06:09:58.119 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.119+0000 7ff53b565980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x562fcb14ae30 con 0x562fcb2a4e50 2024-09-13T06:09:58.119 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.119+0000 7ff538874640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x562fcb2a4e50 0x562fcb2a7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.119 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.119+0000 7ff538874640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x562fcb2a4e50 0x562fcb2a7240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45408/0 (socket says 172.21.15.194:45408) 2024-09-13T06:09:58.120 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.119+0000 7ff538874640 1 -- 172.21.15.194:0/669706132 learned_addr learned my addr 172.21.15.194:0/669706132 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:58.120 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.119+0000 7ff538874640 1 -- 172.21.15.194:0/669706132 >> v1:172.21.15.120:6789/0 conn(0x562fcb212b00 legacy=0x562fcb2a3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.120 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.119+0000 7ff538874640 1 -- 172.21.15.194:0/669706132 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fcb212ee0 con 0x562fcb2a4e50 2024-09-13T06:09:58.120 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.119+0000 7ff52bfff640 1 -- 172.21.15.194:0/669706132 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2331481584 0 0) 0x562fcb126ae0 con 0x562fcb212b00 2024-09-13T06:09:58.122 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.123+0000 7ff538874640 1 --2- 172.21.15.194:0/669706132 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562fcb2a4e50 0x562fcb2a7240 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ff53000a5c0 tx=0x7ff53001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86a3e2bf48699ddc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.123 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.123+0000 7ff52bfff640 1 -- 172.21.15.194:0/669706132 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5300a6070 con 0x562fcb2a4e50 2024-09-13T06:09:58.123 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.123+0000 7ff52bfff640 1 -- 172.21.15.194:0/669706132 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5300af070 con 0x562fcb2a4e50 2024-09-13T06:09:58.123 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.123+0000 7ff52bfff640 1 -- 172.21.15.194:0/669706132 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5300aa5c0 con 0x562fcb2a4e50 2024-09-13T06:09:58.123 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.123+0000 7ff53b565980 1 -- 172.21.15.194:0/669706132 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562fcb2a4e50 msgr2=0x562fcb2a7240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.124 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.123+0000 7ff53b565980 1 --2- 172.21.15.194:0/669706132 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562fcb2a4e50 0x562fcb2a7240 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ff53000a5c0 tx=0x7ff53001b340 comp rx=0 tx=0).stop 2024-09-13T06:09:58.124 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.123+0000 7ff53b565980 1 -- 172.21.15.194:0/669706132 shutdown_connections 2024-09-13T06:09:58.124 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.123+0000 7ff53b565980 1 --2- 172.21.15.194:0/669706132 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562fcb2a4e50 0x562fcb2a7240 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.124 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.123+0000 7ff53b565980 1 -- 172.21.15.194:0/669706132 >> 172.21.15.194:0/669706132 conn(0x562fcb299060 msgr2=0x562fcb29b480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:58.124 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.123+0000 7ff53b565980 1 -- 172.21.15.194:0/669706132 shutdown_connections 2024-09-13T06:09:58.124 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.123+0000 7ff53b565980 1 -- 172.21.15.194:0/669706132 wait complete. 2024-09-13T06:09:58.142 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.139+0000 7ff53b565980 1 Processor -- start 2024-09-13T06:09:58.143 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.139+0000 7ff53b565980 1 -- start start 2024-09-13T06:09:58.143 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.139+0000 7ff53b565980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562fcb212b00 0x562fcb38b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.143 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.139+0000 7ff53b565980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x562fcb14c200 con 0x562fcb212b00 2024-09-13T06:09:58.143 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.139+0000 7ff539075640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562fcb212b00 0x562fcb38b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.143 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.139+0000 7ff539075640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562fcb212b00 0x562fcb38b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45410/0 (socket says 172.21.15.194:45410) 2024-09-13T06:09:58.143 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.139+0000 7ff539075640 1 -- 172.21.15.194:0/765818875 learned_addr learned my addr 172.21.15.194:0/765818875 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:58.143 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.139+0000 7ff539075640 1 -- 172.21.15.194:0/765818875 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fcb38bfb0 con 0x562fcb212b00 2024-09-13T06:09:58.143 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.139+0000 7ff539075640 1 --2- 172.21.15.194:0/765818875 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562fcb212b00 0x562fcb38b9e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ff52c00b200 tx=0x7ff52c00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be7c18fa10aa387e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.143 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.139+0000 7ff427606640 1 -- 172.21.15.194:0/765818875 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff52c016070 con 0x562fcb212b00 2024-09-13T06:09:58.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.139+0000 7ff427606640 1 -- 172.21.15.194:0/765818875 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff52c00d5f0 con 0x562fcb212b00 2024-09-13T06:09:58.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.139+0000 7ff427606640 1 -- 172.21.15.194:0/765818875 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff52c00d950 con 0x562fcb212b00 2024-09-13T06:09:58.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.139+0000 7ff53b565980 1 -- 172.21.15.194:0/765818875 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562fcb212b00 msgr2=0x562fcb38b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.139+0000 7ff53b565980 1 --2- 172.21.15.194:0/765818875 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562fcb212b00 0x562fcb38b9e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ff52c00b200 tx=0x7ff52c00b6c0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.139+0000 7ff53b565980 1 -- 172.21.15.194:0/765818875 shutdown_connections 2024-09-13T06:09:58.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.139+0000 7ff53b565980 1 --2- 172.21.15.194:0/765818875 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562fcb212b00 0x562fcb38b9e0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.139+0000 7ff53b565980 1 -- 172.21.15.194:0/765818875 >> 172.21.15.194:0/765818875 conn(0x562fcb299060 msgr2=0x562fcb387610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:58.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.139+0000 7ff53b565980 1 -- 172.21.15.194:0/765818875 shutdown_connections 2024-09-13T06:09:58.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.139+0000 7ff53b565980 1 -- 172.21.15.194:0/765818875 wait complete. 2024-09-13T06:09:58.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.143+0000 7ff53b565980 1 Processor -- start 2024-09-13T06:09:58.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.143+0000 7ff53b565980 1 -- start start 2024-09-13T06:09:58.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.143+0000 7ff53b565980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562fcb212b00 0x562fcb392c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.143+0000 7ff53b565980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x562fcb2aa210 con 0x562fcb212b00 2024-09-13T06:09:58.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.143+0000 7ff539075640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562fcb212b00 0x562fcb392c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.143+0000 7ff539075640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562fcb212b00 0x562fcb392c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45424/0 (socket says 172.21.15.194:45424) 2024-09-13T06:09:58.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.143+0000 7ff539075640 1 -- 172.21.15.194:0/4151309287 learned_addr learned my addr 172.21.15.194:0/4151309287 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:58.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.143+0000 7ff539075640 1 -- 172.21.15.194:0/4151309287 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fcb393180 con 0x562fcb212b00 2024-09-13T06:09:58.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.143+0000 7ff539075640 1 --2- 172.21.15.194:0/4151309287 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562fcb212b00 0x562fcb392c40 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff52c00c010 tx=0x7ff52c000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.143+0000 7ff425e03640 1 -- 172.21.15.194:0/4151309287 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff52c016070 con 0x562fcb212b00 2024-09-13T06:09:58.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.143+0000 7ff425e03640 1 -- 172.21.15.194:0/4151309287 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff52c023070 con 0x562fcb212b00 2024-09-13T06:09:58.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.143+0000 7ff53b565980 1 -- 172.21.15.194:0/4151309287 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562fcb393410 con 0x562fcb212b00 2024-09-13T06:09:58.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.143+0000 7ff425e03640 1 -- 172.21.15.194:0/4151309287 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff52c0012e0 con 0x562fcb212b00 2024-09-13T06:09:58.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.143+0000 7ff53b565980 1 -- 172.21.15.194:0/4151309287 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562fcb3960f0 con 0x562fcb212b00 2024-09-13T06:09:58.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.143+0000 7ff425e03640 1 -- 172.21.15.194:0/4151309287 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff52c028460 con 0x562fcb212b00 2024-09-13T06:09:58.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.143+0000 7ff425e03640 1 --2- 172.21.15.194:0/4151309287 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff420034650 0x7ff420036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.143+0000 7ff425e03640 1 -- 172.21.15.194:0/4151309287 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7ff52c009030 con 0x562fcb212b00 2024-09-13T06:09:58.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.143+0000 7ff538874640 1 --2- 172.21.15.194:0/4151309287 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff420034650 0x7ff420036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.143+0000 7ff53b565980 1 --2- 172.21.15.194:0/4151309287 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x562fcb2a4e50 0x562fcb399bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.143+0000 7ff53b565980 1 -- 172.21.15.194:0/4151309287 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562fcb39a1f0 con 0x562fcb2a4e50 2024-09-13T06:09:58.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.147+0000 7ff539876640 1 --2- 172.21.15.194:0/4151309287 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x562fcb2a4e50 0x562fcb399bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.147+0000 7ff538874640 1 --2- 172.21.15.194:0/4151309287 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff420034650 0x7ff420036b10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff5300ae000 tx=0x7ff5300a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.147+0000 7ff539876640 1 --2- 172.21.15.194:0/4151309287 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x562fcb2a4e50 0x562fcb399bd0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.147+0000 7ff539876640 1 -- 172.21.15.194:0/4151309287 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff53400a4d0 con 0x562fcb2a4e50 2024-09-13T06:09:58.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.147+0000 7ff53b565980 1 -- 172.21.15.194:0/4151309287 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562fcb397310 con 0x562fcb2a4e50 2024-09-13T06:09:58.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.147+0000 7ff539876640 1 -- 172.21.15.194:0/4151309287 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff53400a4d0 con 0x562fcb2a4e50 2024-09-13T06:09:58.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.147+0000 7ff53b565980 1 --2- 172.21.15.194:0/4151309287 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x562fcb39c570 0x562fcb39e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.147+0000 7ff53b565980 1 -- 172.21.15.194:0/4151309287 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562fcb39f030 con 0x562fcb39c570 2024-09-13T06:09:58.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.147+0000 7ff539075640 1 --2- 172.21.15.194:0/4151309287 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x562fcb39c570 0x562fcb39e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.151 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.147+0000 7ff539075640 1 --2- 172.21.15.194:0/4151309287 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x562fcb39c570 0x562fcb39e960 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.151 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.147+0000 7ff539075640 1 -- 172.21.15.194:0/4151309287 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff52c01dc90 con 0x562fcb39c570 2024-09-13T06:09:58.151 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.147+0000 7ff53b565980 1 -- 172.21.15.194:0/4151309287 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562fcb39b410 con 0x562fcb2a4e50 2024-09-13T06:09:58.151 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.147+0000 7ff539876640 1 -- 172.21.15.194:0/4151309287 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff53400a4d0 con 0x562fcb2a4e50 2024-09-13T06:09:58.152 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.147+0000 7ff53b565980 1 --2- 172.21.15.194:0/4151309287 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x562fcb3a0470 0x562fcb3a2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.152 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.147+0000 7ff53b565980 1 -- 172.21.15.194:0/4151309287 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562fcb3a2fd0 con 0x562fcb3a0470 2024-09-13T06:09:58.152 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.147+0000 7ff538874640 1 --2- 172.21.15.194:0/4151309287 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x562fcb3a0470 0x562fcb3a2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.152 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.147+0000 7ff538874640 1 --2- 172.21.15.194:0/4151309287 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x562fcb3a0470 0x562fcb3a2860 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.152 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.147+0000 7ff538874640 1 -- 172.21.15.194:0/4151309287 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff5300aa9e0 con 0x562fcb3a0470 2024-09-13T06:09:58.152 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.147+0000 7ff53b565980 1 Processor -- start 2024-09-13T06:09:58.152 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.147+0000 7ff53b565980 1 -- start start 2024-09-13T06:09:58.152 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.147+0000 7ff53b565980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562fcb3b0a20 0x562fcb3b0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.152 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.147+0000 7ff53b565980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x562fcb1a5800 con 0x562fcb3b0a20 2024-09-13T06:09:58.152 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.151+0000 7ff539075640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562fcb3b0a20 0x562fcb3b0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.152 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.151+0000 7ff539075640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562fcb3b0a20 0x562fcb3b0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45434/0 (socket says 172.21.15.194:45434) 2024-09-13T06:09:58.153 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.151+0000 7ff539075640 1 -- 172.21.15.194:0/526527575 learned_addr learned my addr 172.21.15.194:0/526527575 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:58.153 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.151+0000 7ff539075640 1 -- 172.21.15.194:0/526527575 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fcb3b1380 con 0x562fcb3b0a20 2024-09-13T06:09:58.153 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.151+0000 7ff539075640 1 --2- 172.21.15.194:0/526527575 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562fcb3b0a20 0x562fcb3b0e40 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ff52c029fd0 tx=0x7ff52c00ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.151+0000 7ff41effd640 1 -- 172.21.15.194:0/526527575 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff52c01d370 con 0x562fcb3b0a20 2024-09-13T06:09:58.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.151+0000 7ff53b565980 1 -- 172.21.15.194:0/526527575 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562fcb3b1610 con 0x562fcb3b0a20 2024-09-13T06:09:58.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.151+0000 7ff41effd640 1 -- 172.21.15.194:0/526527575 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff52c017040 con 0x562fcb3b0a20 2024-09-13T06:09:58.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.151+0000 7ff53b565980 1 -- 172.21.15.194:0/526527575 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562fcb3b1610 con 0x562fcb3b0a20 2024-09-13T06:09:58.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.151+0000 7ff41effd640 1 -- 172.21.15.194:0/526527575 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff52c01d510 con 0x562fcb3b0a20 2024-09-13T06:09:58.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.151+0000 7ff41effd640 1 -- 172.21.15.194:0/526527575 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff52c00fa90 con 0x562fcb3b0a20 2024-09-13T06:09:58.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.151+0000 7ff41effd640 1 --2- 172.21.15.194:0/526527575 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff410034650 0x7ff410036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.151+0000 7ff41effd640 1 -- 172.21.15.194:0/526527575 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7ff52c00c040 con 0x562fcb3b0a20 2024-09-13T06:09:58.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.151+0000 7ff538874640 1 --2- 172.21.15.194:0/526527575 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff410034650 0x7ff410036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.151+0000 7ff53b565980 1 Processor -- start 2024-09-13T06:09:58.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.151+0000 7ff53b565980 1 -- start start 2024-09-13T06:09:58.156 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.151+0000 7ff538874640 1 --2- 172.21.15.194:0/526527575 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff410034650 0x7ff410036b10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff530000c10 tx=0x7ff530005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.156 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.151+0000 7ff53b565980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562fcb3bd160 0x562fcb3bd540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.156 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.151+0000 7ff53b565980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x562fcb38c330 con 0x562fcb3bd160 2024-09-13T06:09:58.156 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.155+0000 7ff539075640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562fcb3bd160 0x562fcb3bd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.156 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.155+0000 7ff539075640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562fcb3bd160 0x562fcb3bd540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45446/0 (socket says 172.21.15.194:45446) 2024-09-13T06:09:58.156 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.155+0000 7ff539075640 1 -- 172.21.15.194:0/4059264977 learned_addr learned my addr 172.21.15.194:0/4059264977 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:58.156 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.155+0000 7ff539075640 1 -- 172.21.15.194:0/4059264977 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fcb3bdb10 con 0x562fcb3bd160 2024-09-13T06:09:58.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.155+0000 7ff539075640 1 --2- 172.21.15.194:0/4059264977 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562fcb3bd160 0x562fcb3bd540 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff52c027fd0 tx=0x7ff52c053bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8493ac87e3fb8933 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.155+0000 7ff41cff9640 1 -- 172.21.15.194:0/4059264977 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff52c062020 con 0x562fcb3bd160 2024-09-13T06:09:58.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.155+0000 7ff41cff9640 1 -- 172.21.15.194:0/4059264977 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff52c020df0 con 0x562fcb3bd160 2024-09-13T06:09:58.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.155+0000 7ff41cff9640 1 -- 172.21.15.194:0/4059264977 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff52c00fd80 con 0x562fcb3bd160 2024-09-13T06:09:58.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.155+0000 7ff53b565980 1 -- 172.21.15.194:0/4059264977 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562fcb3bd160 msgr2=0x562fcb3bd540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.155+0000 7ff53b565980 1 --2- 172.21.15.194:0/4059264977 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562fcb3bd160 0x562fcb3bd540 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff52c027fd0 tx=0x7ff52c053bc0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.155+0000 7ff53b565980 1 -- 172.21.15.194:0/4059264977 shutdown_connections 2024-09-13T06:09:58.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.155+0000 7ff53b565980 1 --2- 172.21.15.194:0/4059264977 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562fcb3bd160 0x562fcb3bd540 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.155+0000 7ff53b565980 1 -- 172.21.15.194:0/4059264977 >> 172.21.15.194:0/4059264977 conn(0x562fcb3b9540 msgr2=0x562fcb3b7640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:58.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.155+0000 7ff53b565980 1 -- 172.21.15.194:0/4059264977 shutdown_connections 2024-09-13T06:09:58.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.155+0000 7ff53b565980 1 -- 172.21.15.194:0/4059264977 wait complete. 2024-09-13T06:09:58.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.155+0000 7ff53b565980 1 Processor -- start 2024-09-13T06:09:58.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.155+0000 7ff53b565980 1 -- start start 2024-09-13T06:09:58.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.155+0000 7ff53b565980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562fcb3bd160 0x562fcb3c42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.155+0000 7ff53b565980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x562fcb3bdfb0 con 0x562fcb3bd160 2024-09-13T06:09:58.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.155+0000 7ff539075640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562fcb3bd160 0x562fcb3c42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.155+0000 7ff539075640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562fcb3bd160 0x562fcb3c42d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45450/0 (socket says 172.21.15.194:45450) 2024-09-13T06:09:58.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.155+0000 7ff539075640 1 -- 172.21.15.194:0/1570699580 learned_addr learned my addr 172.21.15.194:0/1570699580 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:58.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.155+0000 7ff539075640 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fcb3c4810 con 0x562fcb3bd160 2024-09-13T06:09:58.163 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.159+0000 7ff539075640 1 --2- 172.21.15.194:0/1570699580 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562fcb3bd160 0x562fcb3c42d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ff52c00de90 tx=0x7ff52c016e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.164 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.159+0000 7ff40effd640 1 -- 172.21.15.194:0/1570699580 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff52c076070 con 0x562fcb3bd160 2024-09-13T06:09:58.164 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.159+0000 7ff53b565980 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562fcb3c4810 con 0x562fcb3bd160 2024-09-13T06:09:58.164 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.159+0000 7ff40effd640 1 -- 172.21.15.194:0/1570699580 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff52c041c20 con 0x562fcb3bd160 2024-09-13T06:09:58.164 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.159+0000 7ff40effd640 1 -- 172.21.15.194:0/1570699580 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff52c053470 con 0x562fcb3bd160 2024-09-13T06:09:58.164 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.159+0000 7ff53b565980 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562fcb3c4810 con 0x562fcb3bd160 2024-09-13T06:09:58.164 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.159+0000 7ff40effd640 1 -- 172.21.15.194:0/1570699580 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff52c079070 con 0x562fcb3bd160 2024-09-13T06:09:58.164 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.159+0000 7ff53b565980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.164 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.159+0000 7ff40effd640 1 --2- 172.21.15.194:0/1570699580 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff404034650 0x7ff404036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.164 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.159+0000 7ff40effd640 1 -- 172.21.15.194:0/1570699580 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7ff52c07cca0 con 0x562fcb3bd160 2024-09-13T06:09:58.164 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.159+0000 7ff538874640 1 --2- 172.21.15.194:0/1570699580 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff404034650 0x7ff404036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.165 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.159+0000 7ff53b565980 1 --2- 172.21.15.194:0/1570699580 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x562fcb3cf400 0x562fcb3d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.165 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.159+0000 7ff53b565980 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562fcb3d2010 con 0x562fcb3cf400 2024-09-13T06:09:58.165 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.159+0000 7ff539876640 1 --2- 172.21.15.194:0/1570699580 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x562fcb3cf400 0x562fcb3d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.165 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.159+0000 7ff538874640 1 --2- 172.21.15.194:0/1570699580 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff404034650 0x7ff404036b10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff53001b380 tx=0x7ff5300c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.165 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.159+0000 7ff539876640 1 --2- 172.21.15.194:0/1570699580 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x562fcb3cf400 0x562fcb3d18c0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.165 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.159+0000 7ff539876640 1 -- 172.21.15.194:0/1570699580 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff53400a4d0 con 0x562fcb3cf400 2024-09-13T06:09:58.165 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.159+0000 7ff53b565980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:58.165 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.159+0000 7ff53b565980 20 realm 2024-09-13T06:09:58.165 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.159+0000 7ff53b565980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.165 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.159+0000 7ff53b565980 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562fcb3d2420 con 0x562fcb3cf400 2024-09-13T06:09:58.165 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.159+0000 7ff539876640 1 -- 172.21.15.194:0/1570699580 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff53400a4d0 con 0x562fcb3cf400 2024-09-13T06:09:58.165 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.159+0000 7ff53b565980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:58.166 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.159+0000 7ff53b565980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:09:58.166 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.159+0000 7ff53b565980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.166 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.159+0000 7ff53b565980 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562fcb3d2cc0 con 0x562fcb3cf400 2024-09-13T06:09:58.166 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.159+0000 7ff539876640 1 -- 172.21.15.194:0/1570699580 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff53400a4d0 con 0x562fcb3cf400 2024-09-13T06:09:58.166 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.159+0000 7ff53b565980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:58.166 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.159+0000 7ff53b565980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.166 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.159+0000 7ff53b565980 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562fcb3d3060 con 0x562fcb3cf400 2024-09-13T06:09:58.166 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.163+0000 7ff539876640 1 -- 172.21.15.194:0/1570699580 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff53400a4d0 con 0x562fcb3cf400 2024-09-13T06:09:58.166 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.163+0000 7ff53b565980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:58.166 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.163+0000 7ff53b565980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.166 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.163+0000 7ff53b565980 1 --2- 172.21.15.194:0/1570699580 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x562fcb3d3dc0 0x562fcb3d61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.166 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.163+0000 7ff53b565980 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562fcb3d6730 con 0x562fcb3d3dc0 2024-09-13T06:09:58.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.163+0000 7ff539075640 1 --2- 172.21.15.194:0/1570699580 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x562fcb3d3dc0 0x562fcb3d61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.163+0000 7ff539075640 1 --2- 172.21.15.194:0/1570699580 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x562fcb3d3dc0 0x562fcb3d61b0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.163+0000 7ff539075640 1 -- 172.21.15.194:0/1570699580 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff52c078030 con 0x562fcb3d3dc0 2024-09-13T06:09:58.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.163+0000 7ff53b565980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:09:58.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.163+0000 7ff53b565980 20 searching for the correct realm 2024-09-13T06:09:58.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.163+0000 7ff53b565980 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562fcb3d7f90 con 0x562fcb3d3dc0 2024-09-13T06:09:58.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.163+0000 7ff539075640 1 -- 172.21.15.194:0/1570699580 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff52c078030 con 0x562fcb3d3dc0 2024-09-13T06:09:58.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.163+0000 7ff539075640 1 --2- 172.21.15.194:0/1570699580 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7ff52c07b060 0x7ff52c067420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.163+0000 7ff539075640 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562fcb3d7f90 con 0x7ff52c07b060 2024-09-13T06:09:58.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.163+0000 7ff538874640 1 --2- 172.21.15.194:0/1570699580 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7ff52c07b060 0x7ff52c067420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.163+0000 7ff538874640 1 --2- 172.21.15.194:0/1570699580 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7ff52c07b060 0x7ff52c067420 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.163+0000 7ff538874640 1 -- 172.21.15.194:0/1570699580 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff5300df040 con 0x7ff52c07b060 2024-09-13T06:09:58.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.163+0000 7ff538874640 1 --2- 172.21.15.194:0/1570699580 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7ff5300e2040 0x7ff5300e2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.163+0000 7ff538874640 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562fcb3d7f90 con 0x7ff5300e2040 2024-09-13T06:09:58.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.163+0000 7ff539876640 1 --2- 172.21.15.194:0/1570699580 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7ff5300e2040 0x7ff5300e2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.163+0000 7ff539876640 1 --2- 172.21.15.194:0/1570699580 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7ff5300e2040 0x7ff5300e2930 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.163+0000 7ff539876640 1 -- 172.21.15.194:0/1570699580 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff53400a4d0 con 0x7ff5300e2040 2024-09-13T06:09:58.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.163+0000 7ff539876640 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562fcb3d3060 con 0x562fcb3cf400 2024-09-13T06:09:58.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.167+0000 7ff539876640 1 -- 172.21.15.194:0/1570699580 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff53400a4d0 con 0x562fcb3cf400 2024-09-13T06:09:58.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.167+0000 7ff539876640 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562fcb3d3060 con 0x562fcb3cf400 2024-09-13T06:09:58.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.167+0000 7ff539876640 1 -- 172.21.15.194:0/1570699580 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff53400a4d0 con 0x562fcb3cf400 2024-09-13T06:09:58.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.167+0000 7ff539876640 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562fcb3d3060 con 0x7ff5300e2040 2024-09-13T06:09:58.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.167+0000 7ff539876640 1 -- 172.21.15.194:0/1570699580 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff53400a4d0 con 0x7ff5300e2040 2024-09-13T06:09:58.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.167+0000 7ff539876640 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562fcb3d3060 con 0x7ff5300e2040 2024-09-13T06:09:58.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.167+0000 7ff539876640 1 -- 172.21.15.194:0/1570699580 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff53400a4d0 con 0x7ff5300e2040 2024-09-13T06:09:58.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.167+0000 7ff539876640 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562fcb3d3060 con 0x7ff52c07b060 2024-09-13T06:09:58.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.167+0000 7ff538874640 1 -- 172.21.15.194:0/1570699580 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5300df040 con 0x7ff52c07b060 2024-09-13T06:09:58.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.167+0000 7ff538874640 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562fcb3d3060 con 0x562fcb3d3dc0 2024-09-13T06:09:58.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.167+0000 7ff539075640 1 -- 172.21.15.194:0/1570699580 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff52c078030 con 0x562fcb3d3dc0 2024-09-13T06:09:58.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.167+0000 7ff539075640 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562fcb3d3060 con 0x562fcb3cf400 2024-09-13T06:09:58.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.167+0000 7ff539876640 1 -- 172.21.15.194:0/1570699580 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff53400a4d0 con 0x562fcb3cf400 2024-09-13T06:09:58.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.167+0000 7ff539876640 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562fcb3d3060 con 0x7ff5300e2040 2024-09-13T06:09:58.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.167+0000 7ff539876640 1 -- 172.21.15.194:0/1570699580 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff53400a4d0 con 0x7ff5300e2040 2024-09-13T06:09:58.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.167+0000 7ff539876640 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562fcb3d3060 con 0x562fcb3cf400 2024-09-13T06:09:58.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.167+0000 7ff539876640 1 -- 172.21.15.194:0/1570699580 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff53400a4d0 con 0x562fcb3cf400 2024-09-13T06:09:58.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.167+0000 7ff539876640 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562fcb3d3060 con 0x7ff52c07b060 2024-09-13T06:09:58.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.167+0000 7ff538874640 1 -- 172.21.15.194:0/1570699580 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff5300df040 con 0x7ff52c07b060 2024-09-13T06:09:58.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.167+0000 7ff538874640 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562fcb3d3060 con 0x562fcb3d3dc0 2024-09-13T06:09:58.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.171+0000 7ff539075640 1 -- 172.21.15.194:0/1570699580 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff52c078030 con 0x562fcb3d3dc0 2024-09-13T06:09:58.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.171+0000 7ff539075640 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562fcb3d3060 con 0x562fcb3d3dc0 2024-09-13T06:09:58.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.171+0000 7ff539075640 1 -- 172.21.15.194:0/1570699580 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff52c078030 con 0x562fcb3d3dc0 2024-09-13T06:09:58.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.171+0000 7ff539075640 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562fcb3d3060 con 0x7ff5300e2040 2024-09-13T06:09:58.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.171+0000 7ff539876640 1 -- 172.21.15.194:0/1570699580 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff53400a4d0 con 0x7ff5300e2040 2024-09-13T06:09:58.175 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.171+0000 7ff539876640 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562fcb3d3060 con 0x562fcb3d3dc0 2024-09-13T06:09:58.175 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.171+0000 7ff539075640 1 -- 172.21.15.194:0/1570699580 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff52c078030 con 0x562fcb3d3dc0 2024-09-13T06:09:58.175 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.171+0000 7ff539075640 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562fcb3d3060 con 0x562fcb3d3dc0 2024-09-13T06:09:58.175 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.171+0000 7ff539075640 1 -- 172.21.15.194:0/1570699580 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff52c078030 con 0x562fcb3d3dc0 2024-09-13T06:09:58.175 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.171+0000 7ff539075640 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562fcb3d3060 con 0x562fcb3cf400 2024-09-13T06:09:58.179 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.171+0000 7ff539876640 1 -- 172.21.15.194:0/1570699580 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff53400a4d0 con 0x562fcb3cf400 2024-09-13T06:09:58.179 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.171+0000 7ff539876640 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562fcb3d3060 con 0x562fcb3cf400 2024-09-13T06:09:58.179 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.171+0000 7ff539876640 1 -- 172.21.15.194:0/1570699580 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff53400a4d0 con 0x562fcb3cf400 2024-09-13T06:09:58.179 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.171+0000 7ff539876640 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562fcb3d3060 con 0x7ff5300e2040 2024-09-13T06:09:58.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.171+0000 7ff539876640 1 -- 172.21.15.194:0/1570699580 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff53400a4d0 con 0x7ff5300e2040 2024-09-13T06:09:58.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.171+0000 7ff539876640 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562fcb3d3060 con 0x562fcb3d3dc0 2024-09-13T06:09:58.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.171+0000 7ff539075640 1 -- 172.21.15.194:0/1570699580 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff52c078030 con 0x562fcb3d3dc0 2024-09-13T06:09:58.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.171+0000 7ff539075640 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562fcb3d3060 con 0x7ff52c07b060 2024-09-13T06:09:58.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.171+0000 7ff538874640 1 -- 172.21.15.194:0/1570699580 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5300df040 con 0x7ff52c07b060 2024-09-13T06:09:58.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.171+0000 7ff538874640 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562fcb3d3060 con 0x562fcb3cf400 2024-09-13T06:09:58.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.175+0000 7ff539876640 1 -- 172.21.15.194:0/1570699580 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff53400a4d0 con 0x562fcb3cf400 2024-09-13T06:09:58.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.175+0000 7ff539876640 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562fcb3d3060 con 0x7ff5300e2040 2024-09-13T06:09:58.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.175+0000 7ff539876640 1 -- 172.21.15.194:0/1570699580 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff53400a4d0 con 0x7ff5300e2040 2024-09-13T06:09:58.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.175+0000 7ff539876640 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562fcb3d3060 con 0x562fcb3d3dc0 2024-09-13T06:09:58.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.175+0000 7ff539075640 1 -- 172.21.15.194:0/1570699580 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff52c078030 con 0x562fcb3d3dc0 2024-09-13T06:09:58.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.175+0000 7ff539075640 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562fcb3d3060 con 0x7ff5300e2040 2024-09-13T06:09:58.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.175+0000 7ff539876640 1 -- 172.21.15.194:0/1570699580 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff53400a4d0 con 0x7ff5300e2040 2024-09-13T06:09:58.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.175+0000 7ff539876640 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562fcb3d3060 con 0x7ff52c07b060 2024-09-13T06:09:58.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.175+0000 7ff538874640 1 -- 172.21.15.194:0/1570699580 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5300df040 con 0x7ff52c07b060 2024-09-13T06:09:58.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.175+0000 7ff538874640 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562fcb3d3060 con 0x562fcb3d3dc0 2024-09-13T06:09:58.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.175+0000 7ff539075640 1 -- 172.21.15.194:0/1570699580 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff52c078030 con 0x562fcb3d3dc0 2024-09-13T06:09:58.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.175+0000 7ff539075640 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562fcb3d3060 con 0x7ff5300e2040 2024-09-13T06:09:58.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.175+0000 7ff539876640 1 -- 172.21.15.194:0/1570699580 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff53400a4d0 con 0x7ff5300e2040 2024-09-13T06:09:58.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.175+0000 7ff539876640 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562fcb3d3060 con 0x562fcb3cf400 2024-09-13T06:09:58.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.175+0000 7ff539876640 1 -- 172.21.15.194:0/1570699580 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff53400a4d0 con 0x562fcb3cf400 2024-09-13T06:09:58.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.175+0000 7ff539876640 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562fcb3d3060 con 0x7ff52c07b060 2024-09-13T06:09:58.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.175+0000 7ff538874640 1 -- 172.21.15.194:0/1570699580 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5300df040 con 0x7ff52c07b060 2024-09-13T06:09:58.182 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.175+0000 7ff53b565980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:09:58.182 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.175+0000 7ff53b565980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:09:58.182 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.175+0000 7ff53b565980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:09:58.182 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.175+0000 7ff53b565980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:09:58.182 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.175+0000 7ff53b565980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:09:58.182 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.175+0000 7ff53b565980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:09:58.182 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.175+0000 7ff53b565980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.182 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.175+0000 7ff53b565980 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562fcb3d70b0 con 0x562fcb3cf400 2024-09-13T06:09:58.182 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.179+0000 7ff539876640 1 -- 172.21.15.194:0/1570699580 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff53400a4d0 con 0x562fcb3cf400 2024-09-13T06:09:58.182 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.179+0000 7ff53b565980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:58.182 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.179+0000 7ff53b565980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.182 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.179+0000 7ff53b565980 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562fcb3d7950 con 0x562fcb3cf400 2024-09-13T06:09:58.183 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.179+0000 7ff539876640 1 -- 172.21.15.194:0/1570699580 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff53400a4d0 con 0x562fcb3cf400 2024-09-13T06:09:58.183 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.179+0000 7ff53b565980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:58.183 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.179+0000 7ff53b565980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.183 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.179+0000 7ff53b565980 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562fcb3d6cf0 con 0x7ff52c07b060 2024-09-13T06:09:58.183 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.179+0000 7ff538874640 1 -- 172.21.15.194:0/1570699580 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff5300df040 con 0x7ff52c07b060 2024-09-13T06:09:58.183 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.179+0000 7ff53b565980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:09:58.183 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.179+0000 7ff53b565980 20 zone default found 2024-09-13T06:09:58.183 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.179+0000 7ff53b565980 4 Realm: () 2024-09-13T06:09:58.183 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.179+0000 7ff53b565980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:09:58.183 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.179+0000 7ff53b565980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:09:58.183 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.179+0000 7ff53b565980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:09:58.183 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.179+0000 7ff53b565980 20 zonegroup default 2024-09-13T06:09:58.184 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.179+0000 7ff53b565980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.184 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.179+0000 7ff53b565980 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562fcb3d7950 con 0x7ff5300e2040 2024-09-13T06:09:58.186 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.179+0000 7ff539876640 1 -- 172.21.15.194:0/1570699580 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff53400a4d0 con 0x7ff5300e2040 2024-09-13T06:09:58.186 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.179+0000 7ff53b565980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:58.186 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.179+0000 7ff53b565980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.186 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.179+0000 7ff53b565980 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562fcb3d9e40 con 0x562fcb3d3dc0 2024-09-13T06:09:58.186 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.179+0000 7ff539075640 1 -- 172.21.15.194:0/1570699580 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff52c078030 con 0x562fcb3d3dc0 2024-09-13T06:09:58.186 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.179+0000 7ff53b565980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:58.186 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.179+0000 7ff53b565980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.186 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.179+0000 7ff53b565980 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562fcb3da1e0 con 0x562fcb3d3dc0 2024-09-13T06:09:58.186 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.179+0000 7ff539075640 1 -- 172.21.15.194:0/1570699580 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff52c078030 con 0x562fcb3d3dc0 2024-09-13T06:09:58.186 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.179+0000 7ff53b565980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:58.186 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.179+0000 7ff53b565980 20 started sync module instance, tier type = 2024-09-13T06:09:58.186 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.179+0000 7ff53b565980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:09:58.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.179+0000 7ff53b565980 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562fcb3d92e0 con 0x7ff52c07b060 2024-09-13T06:09:58.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.179+0000 7ff538874640 1 -- 172.21.15.194:0/1570699580 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(44 notify.0 [create] v33'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5300df040 con 0x7ff52c07b060 2024-09-13T06:09:58.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.179+0000 7ff53b565980 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94763273262720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562fcb3d9aa0 con 0x7ff52c07b060 2024-09-13T06:09:58.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.179+0000 7ff53b565980 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562fcb3db050 con 0x562fcb3cf400 2024-09-13T06:09:58.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.183+0000 7ff539876640 1 -- 172.21.15.194:0/1570699580 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v33'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff53400a4d0 con 0x562fcb3cf400 2024-09-13T06:09:58.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.183+0000 7ff53b565980 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94763273268400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562fcb3db760 con 0x562fcb3cf400 2024-09-13T06:09:58.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.183+0000 7ff538874640 1 -- 172.21.15.194:0/1570699580 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94763273262720] v33'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5300df040 con 0x7ff52c07b060 2024-09-13T06:09:58.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.183+0000 7ff53b565980 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562fcb3dc280 con 0x562fcb3d3dc0 2024-09-13T06:09:58.188 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.187+0000 7ff539075640 1 -- 172.21.15.194:0/1570699580 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v33'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff52c078030 con 0x562fcb3d3dc0 2024-09-13T06:09:58.188 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.187+0000 7ff539876640 1 -- 172.21.15.194:0/1570699580 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94763273268400] v33'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff53400a4d0 con 0x562fcb3cf400 2024-09-13T06:09:58.188 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.187+0000 7ff53b565980 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94763273266640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562fcb3dc240 con 0x562fcb3d3dc0 2024-09-13T06:09:58.188 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.187+0000 7ff53b565980 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562fcb3db1f0 con 0x7ff52c07b060 2024-09-13T06:09:58.189 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.187+0000 7ff538874640 1 -- 172.21.15.194:0/1570699580 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(50 notify.3 [create] v33'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5300df040 con 0x7ff52c07b060 2024-09-13T06:09:58.189 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.187+0000 7ff53b565980 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94763273275216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562fcb3dd020 con 0x7ff52c07b060 2024-09-13T06:09:58.189 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.187+0000 7ff53b565980 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562fcb3dd9e0 con 0x562fcb3cf400 2024-09-13T06:09:58.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.187+0000 7ff539075640 1 -- 172.21.15.194:0/1570699580 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94763273266640] v33'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff52c078030 con 0x562fcb3d3dc0 2024-09-13T06:09:58.191 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.191+0000 7ff539876640 1 -- 172.21.15.194:0/1570699580 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v33'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff53400a4d0 con 0x562fcb3cf400 2024-09-13T06:09:58.191 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.191+0000 7ff53b565980 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94763273278768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562fcb3dde00 con 0x562fcb3cf400 2024-09-13T06:09:58.191 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.191+0000 7ff53b565980 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562fcb3de6b0 con 0x7ff5300e2040 2024-09-13T06:09:58.194 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.191+0000 7ff538874640 1 -- 172.21.15.194:0/1570699580 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94763273275216] v33'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5300df040 con 0x7ff52c07b060 2024-09-13T06:09:58.194 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.191+0000 7ff539876640 1 -- 172.21.15.194:0/1570699580 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94763273278768] v33'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff53400a4d0 con 0x562fcb3cf400 2024-09-13T06:09:58.194 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.191+0000 7ff539876640 1 -- 172.21.15.194:0/1570699580 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(54 notify.5 [create] v33'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff53400a4d0 con 0x7ff5300e2040 2024-09-13T06:09:58.194 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.191+0000 7ff53b565980 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94763273276272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562fcb3dde00 con 0x7ff5300e2040 2024-09-13T06:09:58.194 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.191+0000 7ff53b565980 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562fcb3def50 con 0x7ff5300e2040 2024-09-13T06:09:58.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.195+0000 7ff539876640 1 -- 172.21.15.194:0/1570699580 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(56 notify.6 [create] v33'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff53400a4d0 con 0x7ff5300e2040 2024-09-13T06:09:58.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.195+0000 7ff53b565980 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94763273284256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562fcb3dde00 con 0x7ff5300e2040 2024-09-13T06:09:58.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.195+0000 7ff53b565980 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562fcb3dfa10 con 0x7ff5300e2040 2024-09-13T06:09:58.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.195+0000 7ff539876640 1 -- 172.21.15.194:0/1570699580 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94763273276272] v33'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff53400a4d0 con 0x7ff5300e2040 2024-09-13T06:09:58.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.199+0000 7ff539876640 1 -- 172.21.15.194:0/1570699580 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(58 notify.7 [create] v33'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff53400a4d0 con 0x7ff5300e2040 2024-09-13T06:09:58.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.199+0000 7ff53b565980 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94763273286880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562fcb3dfbf0 con 0x7ff5300e2040 2024-09-13T06:09:58.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.199+0000 7ff53b565980 20 add_watcher() i=0 2024-09-13T06:09:58.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.199+0000 7ff53b565980 20 add_watcher() i=1 2024-09-13T06:09:58.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.199+0000 7ff53b565980 20 add_watcher() i=2 2024-09-13T06:09:58.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.199+0000 7ff53b565980 20 add_watcher() i=3 2024-09-13T06:09:58.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.199+0000 7ff53b565980 20 add_watcher() i=4 2024-09-13T06:09:58.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.199+0000 7ff53b565980 20 add_watcher() i=5 2024-09-13T06:09:58.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.199+0000 7ff539876640 1 -- 172.21.15.194:0/1570699580 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94763273284256] v33'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff53400a4d0 con 0x7ff5300e2040 2024-09-13T06:09:58.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.199+0000 7ff53b565980 20 add_watcher() i=6 2024-09-13T06:09:58.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.199+0000 7ff539876640 1 -- 172.21.15.194:0/1570699580 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94763273286880] v33'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff53400a4d0 con 0x7ff5300e2040 2024-09-13T06:09:58.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.199+0000 7ff53b565980 20 add_watcher() i=7 2024-09-13T06:09:58.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.199+0000 7ff53b565980 2 all 8 watchers are set, enabling cache 2024-09-13T06:09:58.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.199+0000 7ff53b565980 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562fcb3e2b10 con 0x562fcb3cf400 2024-09-13T06:09:58.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.199+0000 7ff539876640 1 -- 172.21.15.194:0/1570699580 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff53400a4d0 con 0x562fcb3cf400 2024-09-13T06:09:58.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.199+0000 7ff53b565980 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94763273285312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562fcb3dff90 con 0x562fcb3cf400 2024-09-13T06:09:58.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.203+0000 7ff539876640 1 -- 172.21.15.194:0/1570699580 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94763273285312] v33'100 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff53400a4d0 con 0x562fcb3cf400 2024-09-13T06:09:58.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.203+0000 7ff3ef7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:58.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.203+0000 7ff53b565980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:09:58.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.203+0000 7ff53b565980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:09:58.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.203+0000 7ff53b565980 5 note: GC not initialized 2024-09-13T06:09:58.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.203+0000 7ff3ee7e4640 20 reqs_thread_entry: start 2024-09-13T06:09:58.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.203+0000 7ff53b565980 20 init_complete bucket index max shards: 11 2024-09-13T06:09:58.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.203+0000 7ff53b565980 20 Filter name: none 2024-09-13T06:09:58.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.203+0000 7ff35ffff640 20 reqs_thread_entry: start 2024-09-13T06:09:58.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.203+0000 7ff53b565980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.203+0000 7ff53b565980 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562fcb405fc0 con 0x7ff52c07b060 2024-09-13T06:09:58.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.203+0000 7ff538874640 1 -- 172.21.15.194:0/1570699580 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7ff5300df040 con 0x7ff52c07b060 2024-09-13T06:09:58.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.203+0000 7ff53b565980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T06:09:58.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.203+0000 7ff53b565980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.203+0000 7ff53b565980 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:63 8.18 8:1a66c368:root::.bucket.meta.myfoo%3a52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562fcb406850 con 0x562fcb3cf400 2024-09-13T06:09:58.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.203+0000 7ff539876640 1 -- 172.21.15.194:0/1570699580 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(63 .bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv12 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7ff53400a4d0 con 0x562fcb3cf400 2024-09-13T06:09:58.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.203+0000 7ff53b565980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T06:09:58.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.203+0000 7ff53b565980 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-13T06:09:58.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.203+0000 7ff53b565980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.203+0000 7ff53b565980 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562fcb405360 con 0x7ff52c07b060 2024-09-13T06:09:58.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.203+0000 7ff538874640 1 -- 172.21.15.194:0/1570699580 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7ff5300df040 con 0x7ff52c07b060 2024-09-13T06:09:58.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.203+0000 7ff53b565980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T06:09:58.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.203+0000 7ff53b565980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.203+0000 7ff53b565980 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:65 8.18 8:1a66c368:root::.bucket.meta.myfoo%3a52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562fcb407eb0 con 0x562fcb3cf400 2024-09-13T06:09:58.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.203+0000 7ff539876640 1 -- 172.21.15.194:0/1570699580 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(65 .bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv12 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7ff53400a4d0 con 0x562fcb3cf400 2024-09-13T06:09:58.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.203+0000 7ff53b565980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T06:09:58.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.203+0000 7ff53b565980 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-13T06:09:58.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.203+0000 7ff53b565980 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:66 4.25 4:a5fa2579:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562fcb407850 con 0x562fcb3d3dc0 2024-09-13T06:09:58.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.203+0000 7ff53b565980 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:67 4.2c 4:3660bce8:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562fcb40c770 con 0x562fcb3cf400 2024-09-13T06:09:58.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.203+0000 7ff53b565980 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:68 4.14 4:2a98937a:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562fcb407850 con 0x562fcb3d3dc0 2024-09-13T06:09:58.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.203+0000 7ff53b565980 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:69 4.27 4:e42c957a:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562fcb411600 con 0x562fcb3cf400 2024-09-13T06:09:58.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.203+0000 7ff53b565980 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:70 4.5 4:a24186ed:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562fcb4141d0 con 0x562fcb3d3dc0 2024-09-13T06:09:58.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.203+0000 7ff53b565980 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:71 4.13 4:cad7efb2:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562fcb416a40 con 0x7ff52c07b060 2024-09-13T06:09:58.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.203+0000 7ff539876640 1 -- 172.21.15.194:0/1570699580 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(67 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff53400a4d0 con 0x562fcb3cf400 2024-09-13T06:09:58.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.203+0000 7ff53b565980 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:72 4.3 4:c1107af5:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562fcb4141d0 con 0x562fcb3cf400 2024-09-13T06:09:58.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.203+0000 7ff539075640 1 -- 172.21.15.194:0/1570699580 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(66 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff52c078030 con 0x562fcb3d3dc0 2024-09-13T06:09:58.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.203+0000 7ff53b565980 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:73 4.27 4:e6338292:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562fcb416a40 con 0x562fcb3cf400 2024-09-13T06:09:58.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.203+0000 7ff539075640 1 -- 172.21.15.194:0/1570699580 <== osd.3 v2:172.21.15.194:6816/96632515 16 ==== osd_op_reply(68 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff52c078030 con 0x562fcb3d3dc0 2024-09-13T06:09:58.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.203+0000 7ff53b565980 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:74 4.2a 4:57abd676:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562fcb40b830 con 0x562fcb3cf400 2024-09-13T06:09:58.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.203+0000 7ff53b565980 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:75 4.38 4:1e9df731:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562fcb40bc50 con 0x562fcb3cf400 2024-09-13T06:09:58.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.203+0000 7ff538874640 1 -- 172.21.15.194:0/1570699580 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(71 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.5 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7ff5300f7040 con 0x7ff52c07b060 2024-09-13T06:09:58.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.203+0000 7ff53b565980 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:76 4.2b 4:d7fbcf05:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562fcb40b830 con 0x562fcb3cf400 2024-09-13T06:09:58.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.203+0000 7ff539075640 1 -- 172.21.15.194:0/1570699580 <== osd.3 v2:172.21.15.194:6816/96632515 17 ==== osd_op_reply(70 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff52c078030 con 0x562fcb3d3dc0 2024-09-13T06:09:58.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.203+0000 7ff539876640 1 -- 172.21.15.194:0/1570699580 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(69 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff53400a4d0 con 0x562fcb3cf400 2024-09-13T06:09:58.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.203+0000 7ff539876640 1 -- 172.21.15.194:0/1570699580 <== osd.1 v2:172.21.15.194:6808/3135444559 25 ==== osd_op_reply(72 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff53400a4d0 con 0x562fcb3cf400 2024-09-13T06:09:58.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.207+0000 7ff539876640 1 -- 172.21.15.194:0/1570699580 <== osd.1 v2:172.21.15.194:6808/3135444559 26 ==== osd_op_reply(73 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.7 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff53400a4d0 con 0x562fcb3cf400 2024-09-13T06:09:58.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.207+0000 7ff539876640 1 -- 172.21.15.194:0/1570699580 <== osd.1 v2:172.21.15.194:6808/3135444559 27 ==== osd_op_reply(74 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff53400a4d0 con 0x562fcb3cf400 2024-09-13T06:09:58.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.207+0000 7ff539876640 1 -- 172.21.15.194:0/1570699580 <== osd.1 v2:172.21.15.194:6808/3135444559 28 ==== osd_op_reply(75 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff53400a4d0 con 0x562fcb3cf400 2024-09-13T06:09:58.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.207+0000 7ff539876640 1 -- 172.21.15.194:0/1570699580 <== osd.1 v2:172.21.15.194:6808/3135444559 29 ==== osd_op_reply(76 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff53400a4d0 con 0x562fcb3cf400 2024-09-13T06:09:58.212 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.207+0000 7ff3ef7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:58.212 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.207+0000 7ff53b565980 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94763273285312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562fcb403920 con 0x562fcb3cf400 2024-09-13T06:09:58.212 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.207+0000 7ff539876640 1 -- 172.21.15.194:0/1570699580 <== osd.1 v2:172.21.15.194:6808/3135444559 30 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94763273285312] v33'101 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff53400a4d0 con 0x562fcb3cf400 2024-09-13T06:09:58.213 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.207+0000 7ff53b565980 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94763273262720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562fcb403920 con 0x7ff52c07b060 2024-09-13T06:09:58.213 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.207+0000 7ff538874640 1 -- 172.21.15.194:0/1570699580 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94763273262720] v33'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5300f7040 con 0x7ff52c07b060 2024-09-13T06:09:58.213 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.207+0000 7ff53b565980 20 remove_watcher() i=0 2024-09-13T06:09:58.213 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.207+0000 7ff53b565980 2 removed watcher, disabling cache 2024-09-13T06:09:58.213 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.207+0000 7ff53b565980 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94763273268400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562fcb3d9680 con 0x562fcb3cf400 2024-09-13T06:09:58.213 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.211+0000 7ff539876640 1 -- 172.21.15.194:0/1570699580 <== osd.1 v2:172.21.15.194:6808/3135444559 31 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94763273268400] v33'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff53400a4d0 con 0x562fcb3cf400 2024-09-13T06:09:58.213 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.211+0000 7ff53b565980 20 remove_watcher() i=1 2024-09-13T06:09:58.213 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.211+0000 7ff53b565980 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94763273266640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562fcb3d9680 con 0x562fcb3d3dc0 2024-09-13T06:09:58.214 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.211+0000 7ff539075640 1 -- 172.21.15.194:0/1570699580 <== osd.3 v2:172.21.15.194:6816/96632515 18 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94763273266640] v33'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff52c078030 con 0x562fcb3d3dc0 2024-09-13T06:09:58.214 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.211+0000 7ff53b565980 20 remove_watcher() i=2 2024-09-13T06:09:58.214 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.211+0000 7ff53b565980 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94763273275216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562fcb3da5d0 con 0x7ff52c07b060 2024-09-13T06:09:58.215 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.215+0000 7ff538874640 1 -- 172.21.15.194:0/1570699580 <== osd.2 v2:172.21.15.194:6800/815615585 16 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94763273275216] v33'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5300f7040 con 0x7ff52c07b060 2024-09-13T06:09:58.215 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.215+0000 7ff53b565980 20 remove_watcher() i=3 2024-09-13T06:09:58.215 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.215+0000 7ff53b565980 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94763273278768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562fcb3d9680 con 0x562fcb3cf400 2024-09-13T06:09:58.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.215+0000 7ff539876640 1 -- 172.21.15.194:0/1570699580 <== osd.1 v2:172.21.15.194:6808/3135444559 32 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94763273278768] v33'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff53400a4d0 con 0x562fcb3cf400 2024-09-13T06:09:58.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.215+0000 7ff53b565980 20 remove_watcher() i=4 2024-09-13T06:09:58.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.215+0000 7ff53b565980 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94763273276272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562fcb3dc750 con 0x7ff5300e2040 2024-09-13T06:09:58.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.219+0000 7ff539876640 1 -- 172.21.15.194:0/1570699580 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94763273276272] v33'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff53400a4d0 con 0x7ff5300e2040 2024-09-13T06:09:58.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.219+0000 7ff53b565980 20 remove_watcher() i=5 2024-09-13T06:09:58.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.219+0000 7ff53b565980 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94763273284256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562fcb3da5d0 con 0x7ff5300e2040 2024-09-13T06:09:58.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.219+0000 7ff539876640 1 -- 172.21.15.194:0/1570699580 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94763273284256] v33'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff53400a4d0 con 0x7ff5300e2040 2024-09-13T06:09:58.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.219+0000 7ff53b565980 20 remove_watcher() i=6 2024-09-13T06:09:58.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.219+0000 7ff53b565980 1 -- 172.21.15.194:0/1570699580 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94763273286880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562fcb3d9680 con 0x7ff5300e2040 2024-09-13T06:09:58.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.223+0000 7ff539876640 1 -- 172.21.15.194:0/1570699580 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94763273286880] v33'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff53400a4d0 con 0x7ff5300e2040 2024-09-13T06:09:58.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.223+0000 7ff53b565980 20 remove_watcher() i=7 2024-09-13T06:09:58.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.223+0000 7ff53b565980 1 -- 172.21.15.194:0/1570699580 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7ff5300e2040 msgr2=0x7ff5300e2930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.223+0000 7ff53b565980 1 --2- 172.21.15.194:0/1570699580 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7ff5300e2040 0x7ff5300e2930 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.223+0000 7ff53b565980 1 -- 172.21.15.194:0/1570699580 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x562fcb3cf400 msgr2=0x562fcb3d18c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.223+0000 7ff53b565980 1 --2- 172.21.15.194:0/1570699580 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x562fcb3cf400 0x562fcb3d18c0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.223+0000 7ff53b565980 1 -- 172.21.15.194:0/1570699580 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7ff52c07b060 msgr2=0x7ff52c067420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.223+0000 7ff53b565980 1 --2- 172.21.15.194:0/1570699580 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7ff52c07b060 0x7ff52c067420 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.223+0000 7ff53b565980 1 -- 172.21.15.194:0/1570699580 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x562fcb3d3dc0 msgr2=0x562fcb3d61b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.223+0000 7ff53b565980 1 --2- 172.21.15.194:0/1570699580 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x562fcb3d3dc0 0x562fcb3d61b0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.223+0000 7ff53b565980 1 -- 172.21.15.194:0/1570699580 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff404034650 msgr2=0x7ff404036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.223+0000 7ff53b565980 1 --2- 172.21.15.194:0/1570699580 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff404034650 0x7ff404036b10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff53001b380 tx=0x7ff5300c1040 comp rx=0 tx=0).stop 2024-09-13T06:09:58.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.223+0000 7ff53b565980 1 -- 172.21.15.194:0/1570699580 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562fcb3bd160 msgr2=0x562fcb3c42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.223+0000 7ff539876640 1 -- 172.21.15.194:0/1570699580 reap_dead start 2024-09-13T06:09:58.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.223+0000 7ff53b565980 1 --2- 172.21.15.194:0/1570699580 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562fcb3bd160 0x562fcb3c42d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ff52c00de90 tx=0x7ff52c016e90 comp rx=0 tx=0).stop 2024-09-13T06:09:58.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.223+0000 7ff53b565980 1 -- 172.21.15.194:0/1570699580 shutdown_connections 2024-09-13T06:09:58.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.223+0000 7ff53b565980 1 --2- 172.21.15.194:0/1570699580 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562fcb3bd160 0x562fcb3c42d0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.223+0000 7ff53b565980 1 -- 172.21.15.194:0/1570699580 >> 172.21.15.194:0/1570699580 conn(0x562fcb3b9540 msgr2=0x562fcb3b7610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:58.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.223+0000 7ff53b565980 1 -- 172.21.15.194:0/1570699580 shutdown_connections 2024-09-13T06:09:58.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.223+0000 7ff53b565980 1 -- 172.21.15.194:0/1570699580 wait complete. 2024-09-13T06:09:58.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.223+0000 7ff53b565980 1 -- 172.21.15.194:0/526527575 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff410034650 msgr2=0x7ff410036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.223+0000 7ff53b565980 1 --2- 172.21.15.194:0/526527575 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff410034650 0x7ff410036b10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff530000c10 tx=0x7ff530005ad0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.223+0000 7ff53b565980 1 -- 172.21.15.194:0/526527575 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562fcb3b0a20 msgr2=0x562fcb3b0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.223+0000 7ff53b565980 1 --2- 172.21.15.194:0/526527575 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562fcb3b0a20 0x562fcb3b0e40 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ff52c029fd0 tx=0x7ff52c00ef00 comp rx=0 tx=0).stop 2024-09-13T06:09:58.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.223+0000 7ff53b565980 1 -- 172.21.15.194:0/526527575 shutdown_connections 2024-09-13T06:09:58.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.223+0000 7ff53b565980 1 --2- 172.21.15.194:0/526527575 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff410034650 0x7ff410036b10 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.223+0000 7ff53b565980 1 --2- 172.21.15.194:0/526527575 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562fcb3b0a20 0x562fcb3b0e40 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.223+0000 7ff53b565980 1 -- 172.21.15.194:0/526527575 >> 172.21.15.194:0/526527575 conn(0x562fcb3a5b70 msgr2=0x562fcb3a85f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:58.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.223+0000 7ff53b565980 1 -- 172.21.15.194:0/526527575 shutdown_connections 2024-09-13T06:09:58.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.223+0000 7ff53b565980 1 -- 172.21.15.194:0/526527575 wait complete. 2024-09-13T06:09:58.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.223+0000 7ff53b565980 1 -- 172.21.15.194:0/4151309287 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x562fcb2a4e50 msgr2=0x562fcb399bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.223+0000 7ff53b565980 1 --2- 172.21.15.194:0/4151309287 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x562fcb2a4e50 0x562fcb399bd0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.223+0000 7ff53b565980 1 -- 172.21.15.194:0/4151309287 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x562fcb3a0470 msgr2=0x562fcb3a2860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.223+0000 7ff53b565980 1 --2- 172.21.15.194:0/4151309287 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x562fcb3a0470 0x562fcb3a2860 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.223+0000 7ff53b565980 1 -- 172.21.15.194:0/4151309287 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x562fcb39c570 msgr2=0x562fcb39e960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.223+0000 7ff53b565980 1 --2- 172.21.15.194:0/4151309287 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x562fcb39c570 0x562fcb39e960 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.223+0000 7ff53b565980 1 -- 172.21.15.194:0/4151309287 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff420034650 msgr2=0x7ff420036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.223+0000 7ff53b565980 1 --2- 172.21.15.194:0/4151309287 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff420034650 0x7ff420036b10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff5300ae000 tx=0x7ff5300a6000 comp rx=0 tx=0).stop 2024-09-13T06:09:58.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.223+0000 7ff53b565980 1 -- 172.21.15.194:0/4151309287 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562fcb212b00 msgr2=0x562fcb392c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.223+0000 7ff53b565980 1 --2- 172.21.15.194:0/4151309287 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562fcb212b00 0x562fcb392c40 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff52c00c010 tx=0x7ff52c000ee0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.223+0000 7ff539876640 1 -- 172.21.15.194:0/4151309287 reap_dead start 2024-09-13T06:09:58.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.223+0000 7ff53b565980 1 -- 172.21.15.194:0/4151309287 shutdown_connections 2024-09-13T06:09:58.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.223+0000 7ff53b565980 1 -- 172.21.15.194:0/4151309287 >> 172.21.15.194:0/4151309287 conn(0x562fcb299060 msgr2=0x562fcb386190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:58.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.223+0000 7ff53b565980 1 -- 172.21.15.194:0/4151309287 shutdown_connections 2024-09-13T06:09:58.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.223+0000 7ff53b565980 1 -- 172.21.15.194:0/4151309287 wait complete. 2024-09-13T06:09:58.236 INFO:teuthology.orchestra.run.smithi194.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"0faf3484-cad7-4c8f-892b-62107a753816","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1","marker":"52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-13T06:09:56.935102Z","creation_time":"2024-09-13T06:09:56.926052Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":3,"size_actual":4096,"size_utilized":3,"size_kb":1,"size_kb_actual":4,"size_kb_utilized":1,"num_objects":1}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-09-13T06:09:58.237 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '0faf3484-cad7-4c8f-892b-62107a753816', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1', 'marker': '52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-13T06:09:56.935102Z', 'creation_time': '2024-09-13T06:09:56.926052Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-13T06:09:58.237 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-09-13T06:09:58.237 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-09-13T06:09:58.237 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user stats --uid foo --sync-stats 2024-09-13T06:09:58.312 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:09:58.312 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:09:58.313 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.311+0000 7f8d00029980 1 Processor -- start 2024-09-13T06:09:58.313 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.311+0000 7f8d00029980 1 -- start start 2024-09-13T06:09:58.313 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.311+0000 7f8d00029980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55bd7aa5aea0 0x55bd7aa5d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.314 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.311+0000 7f8d00029980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55bd7a8dcae0 con 0x55bd7a9c8ad0 2024-09-13T06:09:58.314 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.311+0000 7f8d00029980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x55bd7a900e30 con 0x55bd7aa5aea0 2024-09-13T06:09:58.315 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.311+0000 7f8cfdb39640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x55bd7a9c8ad0 0x55bd7aa59780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:51140/0 (socket says 172.21.15.194:51140) 2024-09-13T06:09:58.315 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.311+0000 7f8cfdb39640 1 -- 172.21.15.194:0/3446514132 learned_addr learned my addr 172.21.15.194:0/3446514132 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-09-13T06:09:58.315 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.311+0000 7f8cfd338640 1 --2- 172.21.15.194:0/3446514132 >> v2:172.21.15.120:3300/0 conn(0x55bd7aa5aea0 0x55bd7aa5d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.315 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.315+0000 7f8cfcb37640 1 -- 172.21.15.194:0/3446514132 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1015949280 0 0) 0x55bd7a8dcae0 con 0x55bd7a9c8ad0 2024-09-13T06:09:58.315 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.315+0000 7f8cfcb37640 1 -- 172.21.15.194:0/3446514132 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ce8001e20 con 0x55bd7a9c8ad0 2024-09-13T06:09:58.315 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.315+0000 7f8cfd338640 1 -- 172.21.15.194:0/3446514132 >> v1:172.21.15.120:6789/0 conn(0x55bd7a9c8ad0 legacy=0x55bd7aa59780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.315 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.315+0000 7f8cfd338640 1 -- 172.21.15.194:0/3446514132 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd7a9c8eb0 con 0x55bd7aa5aea0 2024-09-13T06:09:58.317 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.315+0000 7f8cfd338640 1 --2- 172.21.15.194:0/3446514132 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bd7aa5aea0 0x55bd7aa5d290 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f8cf400a480 tx=0x7f8cf401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=916b083f4e2b4190 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.317 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.315+0000 7f8cfcb37640 1 -- 172.21.15.194:0/3446514132 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cf40b0070 con 0x55bd7aa5aea0 2024-09-13T06:09:58.317 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.315+0000 7f8cfcb37640 1 -- 172.21.15.194:0/3446514132 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cf40ab540 con 0x55bd7aa5aea0 2024-09-13T06:09:58.317 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.315+0000 7f8cfcb37640 1 -- 172.21.15.194:0/3446514132 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cf40ab820 con 0x55bd7aa5aea0 2024-09-13T06:09:58.318 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.315+0000 7f8d00029980 1 -- 172.21.15.194:0/3446514132 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bd7aa5aea0 msgr2=0x55bd7aa5d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.318 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.315+0000 7f8d00029980 1 --2- 172.21.15.194:0/3446514132 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bd7aa5aea0 0x55bd7aa5d290 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f8cf400a480 tx=0x7f8cf401b280 comp rx=0 tx=0).stop 2024-09-13T06:09:58.319 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.315+0000 7f8d00029980 1 -- 172.21.15.194:0/3446514132 shutdown_connections 2024-09-13T06:09:58.319 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.315+0000 7f8d00029980 1 --2- 172.21.15.194:0/3446514132 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bd7aa5aea0 0x55bd7aa5d290 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.319 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.315+0000 7f8d00029980 1 -- 172.21.15.194:0/3446514132 >> 172.21.15.194:0/3446514132 conn(0x55bd7aa4f070 msgr2=0x55bd7aa51490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:58.319 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.315+0000 7f8d00029980 1 -- 172.21.15.194:0/3446514132 shutdown_connections 2024-09-13T06:09:58.319 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.315+0000 7f8d00029980 1 -- 172.21.15.194:0/3446514132 wait complete. 2024-09-13T06:09:58.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.331+0000 7f8d00029980 1 Processor -- start 2024-09-13T06:09:58.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.331+0000 7f8d00029980 1 -- start start 2024-09-13T06:09:58.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.331+0000 7f8d00029980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bd7a9c8ad0 0x55bd7ab41bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.331+0000 7f8d00029980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55bd7a902200 con 0x55bd7a9c8ad0 2024-09-13T06:09:58.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.331+0000 7f8cfdb39640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bd7a9c8ad0 0x55bd7ab41bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.335+0000 7f8cfdb39640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bd7a9c8ad0 0x55bd7ab41bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45470/0 (socket says 172.21.15.194:45470) 2024-09-13T06:09:58.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.335+0000 7f8cfdb39640 1 -- 172.21.15.194:0/2393913208 learned_addr learned my addr 172.21.15.194:0/2393913208 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:58.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.335+0000 7f8cfdb39640 1 -- 172.21.15.194:0/2393913208 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd7ab421a0 con 0x55bd7a9c8ad0 2024-09-13T06:09:58.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.335+0000 7f8cfdb39640 1 --2- 172.21.15.194:0/2393913208 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bd7a9c8ad0 0x55bd7ab41bd0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0006fc0 tx=0x7f8cf0001af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcb8bb769556e42c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.336 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.335+0000 7f8bebe07640 1 -- 172.21.15.194:0/2393913208 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cf0004530 con 0x55bd7a9c8ad0 2024-09-13T06:09:58.337 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.335+0000 7f8bebe07640 1 -- 172.21.15.194:0/2393913208 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cf00046d0 con 0x55bd7a9c8ad0 2024-09-13T06:09:58.337 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.335+0000 7f8bebe07640 1 -- 172.21.15.194:0/2393913208 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cf0004a70 con 0x55bd7a9c8ad0 2024-09-13T06:09:58.337 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.335+0000 7f8d00029980 1 -- 172.21.15.194:0/2393913208 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bd7a9c8ad0 msgr2=0x55bd7ab41bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.337 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.335+0000 7f8d00029980 1 --2- 172.21.15.194:0/2393913208 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bd7a9c8ad0 0x55bd7ab41bd0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0006fc0 tx=0x7f8cf0001af0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.337 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.335+0000 7f8d00029980 1 -- 172.21.15.194:0/2393913208 shutdown_connections 2024-09-13T06:09:58.337 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.335+0000 7f8d00029980 1 --2- 172.21.15.194:0/2393913208 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bd7a9c8ad0 0x55bd7ab41bd0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.337 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.335+0000 7f8d00029980 1 -- 172.21.15.194:0/2393913208 >> 172.21.15.194:0/2393913208 conn(0x55bd7aa4f070 msgr2=0x55bd7ab3d760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:58.337 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.335+0000 7f8d00029980 1 -- 172.21.15.194:0/2393913208 shutdown_connections 2024-09-13T06:09:58.337 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.335+0000 7f8d00029980 1 -- 172.21.15.194:0/2393913208 wait complete. 2024-09-13T06:09:58.337 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.335+0000 7f8d00029980 1 Processor -- start 2024-09-13T06:09:58.337 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.335+0000 7f8d00029980 1 -- start start 2024-09-13T06:09:58.337 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.335+0000 7f8d00029980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bd7ab491a0 0x55bd7ab495c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.338 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.335+0000 7f8d00029980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55bd7aa60260 con 0x55bd7ab491a0 2024-09-13T06:09:58.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.335+0000 7f8cfdb39640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bd7ab491a0 0x55bd7ab495c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.335+0000 7f8cfdb39640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bd7ab491a0 0x55bd7ab495c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45478/0 (socket says 172.21.15.194:45478) 2024-09-13T06:09:58.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.335+0000 7f8cfdb39640 1 -- 172.21.15.194:0/556866317 learned_addr learned my addr 172.21.15.194:0/556866317 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:58.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.335+0000 7f8cfdb39640 1 -- 172.21.15.194:0/556866317 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd7ab49b00 con 0x55bd7ab491a0 2024-09-13T06:09:58.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.335+0000 7f8cfdb39640 1 --2- 172.21.15.194:0/556866317 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bd7ab491a0 0x55bd7ab495c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0002260 tx=0x7f8cf0000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.339+0000 7f8bea604640 1 -- 172.21.15.194:0/556866317 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cf0013760 con 0x55bd7ab491a0 2024-09-13T06:09:58.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.339+0000 7f8bea604640 1 -- 172.21.15.194:0/556866317 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cf0013920 con 0x55bd7ab491a0 2024-09-13T06:09:58.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.339+0000 7f8d00029980 1 -- 172.21.15.194:0/556866317 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bd7ab49d90 con 0x55bd7ab491a0 2024-09-13T06:09:58.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.339+0000 7f8bea604640 1 -- 172.21.15.194:0/556866317 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cf0013c80 con 0x55bd7ab491a0 2024-09-13T06:09:58.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.339+0000 7f8d00029980 1 -- 172.21.15.194:0/556866317 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd7ab4c870 con 0x55bd7ab491a0 2024-09-13T06:09:58.341 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.339+0000 7f8bea604640 1 -- 172.21.15.194:0/556866317 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8cf0010070 con 0x55bd7ab491a0 2024-09-13T06:09:58.341 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.339+0000 7f8bea604640 1 --2- 172.21.15.194:0/556866317 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8be4034650 0x7f8be4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.341 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.339+0000 7f8bea604640 1 -- 172.21.15.194:0/556866317 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f8cf0018070 con 0x55bd7ab491a0 2024-09-13T06:09:58.341 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.339+0000 7f8cfd338640 1 --2- 172.21.15.194:0/556866317 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8be4034650 0x7f8be4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.341 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.339+0000 7f8d00029980 1 --2- 172.21.15.194:0/556866317 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55bd7ab4e560 0x55bd7ab50970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.341 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.339+0000 7f8d00029980 1 -- 172.21.15.194:0/556866317 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bd7ab50fe0 con 0x55bd7ab4e560 2024-09-13T06:09:58.341 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.339+0000 7f8cfe33a640 1 --2- 172.21.15.194:0/556866317 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55bd7ab4e560 0x55bd7ab50970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.341 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.339+0000 7f8cfd338640 1 --2- 172.21.15.194:0/556866317 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8be4034650 0x7f8be4036b10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8cf40ad000 tx=0x7f8cf40a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.339+0000 7f8cfe33a640 1 --2- 172.21.15.194:0/556866317 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55bd7ab4e560 0x55bd7ab50970 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.339+0000 7f8cfe33a640 1 -- 172.21.15.194:0/556866317 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8cf80083f0 con 0x55bd7ab4e560 2024-09-13T06:09:58.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.339+0000 7f8d00029980 1 -- 172.21.15.194:0/556866317 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bd7ab4db40 con 0x55bd7ab4e560 2024-09-13T06:09:58.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.339+0000 7f8cfe33a640 1 -- 172.21.15.194:0/556866317 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8cf80083f0 con 0x55bd7ab4e560 2024-09-13T06:09:58.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.339+0000 7f8d00029980 1 --2- 172.21.15.194:0/556866317 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55bd7ab53310 0x55bd7ab55700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.339+0000 7f8d00029980 1 -- 172.21.15.194:0/556866317 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bd7ab55dd0 con 0x55bd7ab53310 2024-09-13T06:09:58.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.339+0000 7f8cfdb39640 1 --2- 172.21.15.194:0/556866317 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55bd7ab53310 0x55bd7ab55700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.339+0000 7f8cfdb39640 1 --2- 172.21.15.194:0/556866317 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55bd7ab53310 0x55bd7ab55700 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.339+0000 7f8cfdb39640 1 -- 172.21.15.194:0/556866317 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8cf001b030 con 0x55bd7ab53310 2024-09-13T06:09:58.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.343+0000 7f8d00029980 1 -- 172.21.15.194:0/556866317 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bd7ab521b0 con 0x55bd7ab4e560 2024-09-13T06:09:58.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.343+0000 7f8cfe33a640 1 -- 172.21.15.194:0/556866317 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8cf80083f0 con 0x55bd7ab4e560 2024-09-13T06:09:58.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.343+0000 7f8d00029980 1 --2- 172.21.15.194:0/556866317 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55bd7ab57230 0x55bd7ab59620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.343+0000 7f8d00029980 1 -- 172.21.15.194:0/556866317 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bd7ab59d20 con 0x55bd7ab57230 2024-09-13T06:09:58.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.343+0000 7f8cfd338640 1 --2- 172.21.15.194:0/556866317 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55bd7ab57230 0x55bd7ab59620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.343+0000 7f8cfd338640 1 --2- 172.21.15.194:0/556866317 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55bd7ab57230 0x55bd7ab59620 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.343+0000 7f8cfd338640 1 -- 172.21.15.194:0/556866317 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8cf40abba0 con 0x55bd7ab57230 2024-09-13T06:09:58.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.343+0000 7f8d00029980 1 Processor -- start 2024-09-13T06:09:58.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.343+0000 7f8d00029980 1 -- start start 2024-09-13T06:09:58.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.343+0000 7f8d00029980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bd7ab677f0 0x55bd7ab67c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.343+0000 7f8d00029980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55bd7a95b800 con 0x55bd7ab677f0 2024-09-13T06:09:58.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.343+0000 7f8cfdb39640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bd7ab677f0 0x55bd7ab67c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.343+0000 7f8cfdb39640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bd7ab677f0 0x55bd7ab67c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45488/0 (socket says 172.21.15.194:45488) 2024-09-13T06:09:58.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.343+0000 7f8cfdb39640 1 -- 172.21.15.194:0/2358624031 learned_addr learned my addr 172.21.15.194:0/2358624031 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:58.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.343+0000 7f8cfdb39640 1 -- 172.21.15.194:0/2358624031 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd7ab68150 con 0x55bd7ab677f0 2024-09-13T06:09:58.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.343+0000 7f8cfdb39640 1 --2- 172.21.15.194:0/2358624031 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bd7ab677f0 0x55bd7ab67c10 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0048250 tx=0x7f8cf0010d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.343+0000 7f8be37fe640 1 -- 172.21.15.194:0/2358624031 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cf0010e60 con 0x55bd7ab677f0 2024-09-13T06:09:58.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.343+0000 7f8d00029980 1 -- 172.21.15.194:0/2358624031 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bd7ab683e0 con 0x55bd7ab677f0 2024-09-13T06:09:58.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.343+0000 7f8be37fe640 1 -- 172.21.15.194:0/2358624031 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cf0041420 con 0x55bd7ab677f0 2024-09-13T06:09:58.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.343+0000 7f8be37fe640 1 -- 172.21.15.194:0/2358624031 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cf00415f0 con 0x55bd7ab677f0 2024-09-13T06:09:58.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.343+0000 7f8d00029980 1 -- 172.21.15.194:0/2358624031 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd7ab683e0 con 0x55bd7ab677f0 2024-09-13T06:09:58.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.347+0000 7f8be37fe640 1 -- 172.21.15.194:0/2358624031 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8cf003e070 con 0x55bd7ab677f0 2024-09-13T06:09:58.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.347+0000 7f8be37fe640 1 --2- 172.21.15.194:0/2358624031 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8bd8034600 0x7f8bd8036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.347+0000 7f8be37fe640 1 -- 172.21.15.194:0/2358624031 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f8cf0054c90 con 0x55bd7ab677f0 2024-09-13T06:09:58.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.347+0000 7f8cfd338640 1 --2- 172.21.15.194:0/2358624031 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8bd8034600 0x7f8bd8036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.347+0000 7f8d00029980 1 Processor -- start 2024-09-13T06:09:58.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.347+0000 7f8d00029980 1 -- start start 2024-09-13T06:09:58.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.347+0000 7f8d00029980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bd7ab73f40 0x55bd7ab74320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.347+0000 7f8cfd338640 1 --2- 172.21.15.194:0/2358624031 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8bd8034600 0x7f8bd8036ac0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x55bd7ab518c0 tx=0x7f8cf4005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.347+0000 7f8d00029980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55bd7ab42520 con 0x55bd7ab73f40 2024-09-13T06:09:58.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.347+0000 7f8cfdb39640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bd7ab73f40 0x55bd7ab74320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.347+0000 7f8cfdb39640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bd7ab73f40 0x55bd7ab74320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45490/0 (socket says 172.21.15.194:45490) 2024-09-13T06:09:58.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.347+0000 7f8cfdb39640 1 -- 172.21.15.194:0/3369497404 learned_addr learned my addr 172.21.15.194:0/3369497404 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:58.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.347+0000 7f8cfdb39640 1 -- 172.21.15.194:0/3369497404 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd7ab748f0 con 0x55bd7ab73f40 2024-09-13T06:09:58.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.347+0000 7f8cfdb39640 1 --2- 172.21.15.194:0/3369497404 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bd7ab73f40 0x55bd7ab74320 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f8cf00199f0 tx=0x7f8cf0044ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dce18065bde6c28b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.347+0000 7f8be17fa640 1 -- 172.21.15.194:0/3369497404 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cf0044470 con 0x55bd7ab73f40 2024-09-13T06:09:58.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.347+0000 7f8be17fa640 1 -- 172.21.15.194:0/3369497404 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cf0064070 con 0x55bd7ab73f40 2024-09-13T06:09:58.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.347+0000 7f8be17fa640 1 -- 172.21.15.194:0/3369497404 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cf0025280 con 0x55bd7ab73f40 2024-09-13T06:09:58.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.347+0000 7f8d00029980 1 -- 172.21.15.194:0/3369497404 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bd7ab73f40 msgr2=0x55bd7ab74320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.347+0000 7f8d00029980 1 --2- 172.21.15.194:0/3369497404 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bd7ab73f40 0x55bd7ab74320 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f8cf00199f0 tx=0x7f8cf0044ef0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.347+0000 7f8d00029980 1 -- 172.21.15.194:0/3369497404 shutdown_connections 2024-09-13T06:09:58.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.347+0000 7f8d00029980 1 --2- 172.21.15.194:0/3369497404 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bd7ab73f40 0x55bd7ab74320 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.347+0000 7f8d00029980 1 -- 172.21.15.194:0/3369497404 >> 172.21.15.194:0/3369497404 conn(0x55bd7ab70320 msgr2=0x55bd7ab6e420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:58.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.347+0000 7f8d00029980 1 -- 172.21.15.194:0/3369497404 shutdown_connections 2024-09-13T06:09:58.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.347+0000 7f8d00029980 1 -- 172.21.15.194:0/3369497404 wait complete. 2024-09-13T06:09:58.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.347+0000 7f8d00029980 1 Processor -- start 2024-09-13T06:09:58.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.351+0000 7f8d00029980 1 -- start start 2024-09-13T06:09:58.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.351+0000 7f8d00029980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bd7ab73f40 0x55bd7ab7b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.351+0000 7f8d00029980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55bd7ab74d90 con 0x55bd7ab73f40 2024-09-13T06:09:58.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.351+0000 7f8cfdb39640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bd7ab73f40 0x55bd7ab7b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.351+0000 7f8cfdb39640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bd7ab73f40 0x55bd7ab7b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45494/0 (socket says 172.21.15.194:45494) 2024-09-13T06:09:58.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.351+0000 7f8cfdb39640 1 -- 172.21.15.194:0/2733938882 learned_addr learned my addr 172.21.15.194:0/2733938882 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:58.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.351+0000 7f8cfdb39640 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd7ab7b670 con 0x55bd7ab73f40 2024-09-13T06:09:58.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.351+0000 7f8cfdb39640 1 --2- 172.21.15.194:0/2733938882 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bd7ab73f40 0x55bd7ab7b130 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0044f30 tx=0x7f8cf004d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.351+0000 7f8bcf7fe640 1 -- 172.21.15.194:0/2733938882 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cf00404f0 con 0x55bd7ab73f40 2024-09-13T06:09:58.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.351+0000 7f8bcf7fe640 1 -- 172.21.15.194:0/2733938882 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cf0073070 con 0x55bd7ab73f40 2024-09-13T06:09:58.355 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.351+0000 7f8d00029980 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bd7ab7b670 con 0x55bd7ab73f40 2024-09-13T06:09:58.355 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.351+0000 7f8bcf7fe640 1 -- 172.21.15.194:0/2733938882 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cf0033560 con 0x55bd7ab73f40 2024-09-13T06:09:58.355 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.351+0000 7f8d00029980 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd7ab7b670 con 0x55bd7ab73f40 2024-09-13T06:09:58.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.351+0000 7f8bcf7fe640 1 -- 172.21.15.194:0/2733938882 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8cf0029d10 con 0x55bd7ab73f40 2024-09-13T06:09:58.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.351+0000 7f8d00029980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.351+0000 7f8bcf7fe640 1 --2- 172.21.15.194:0/2733938882 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8bc8034650 0x7f8bc8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.351+0000 7f8bcf7fe640 1 -- 172.21.15.194:0/2733938882 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f8cf000c830 con 0x55bd7ab73f40 2024-09-13T06:09:58.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.351+0000 7f8cfd338640 1 --2- 172.21.15.194:0/2733938882 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8bc8034650 0x7f8bc8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.351+0000 7f8d00029980 1 --2- 172.21.15.194:0/2733938882 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55bd7ab85fe0 0x55bd7ab88480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.351+0000 7f8d00029980 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bd7ab88bd0 con 0x55bd7ab85fe0 2024-09-13T06:09:58.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.351+0000 7f8cfe33a640 1 --2- 172.21.15.194:0/2733938882 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55bd7ab85fe0 0x55bd7ab88480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.351+0000 7f8cfd338640 1 --2- 172.21.15.194:0/2733938882 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8bc8034650 0x7f8bc8036b10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x55bd7ab5a120 tx=0x7f8cf40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.355+0000 7f8cfe33a640 1 --2- 172.21.15.194:0/2733938882 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55bd7ab85fe0 0x55bd7ab88480 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.355+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8cf80083f0 con 0x55bd7ab85fe0 2024-09-13T06:09:58.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.355+0000 7f8d00029980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:58.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.355+0000 7f8d00029980 20 realm 2024-09-13T06:09:58.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.355+0000 7f8d00029980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.355+0000 7f8d00029980 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bd7ab88fe0 con 0x55bd7ab85fe0 2024-09-13T06:09:58.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.355+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8cf80083f0 con 0x55bd7ab85fe0 2024-09-13T06:09:58.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.355+0000 7f8d00029980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:58.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.355+0000 7f8d00029980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:09:58.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.355+0000 7f8d00029980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.355+0000 7f8d00029980 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bd7ab89880 con 0x55bd7ab85fe0 2024-09-13T06:09:58.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.355+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8cf80083f0 con 0x55bd7ab85fe0 2024-09-13T06:09:58.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.355+0000 7f8d00029980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:58.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.355+0000 7f8d00029980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.355+0000 7f8d00029980 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bd7ab89c20 con 0x55bd7ab85fe0 2024-09-13T06:09:58.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.355+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8cf80083f0 con 0x55bd7ab85fe0 2024-09-13T06:09:58.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.355+0000 7f8d00029980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:58.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.355+0000 7f8d00029980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.355+0000 7f8d00029980 1 --2- 172.21.15.194:0/2733938882 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55bd7ab8a980 0x55bd7ab8cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.355+0000 7f8d00029980 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bd7ab8d2b0 con 0x55bd7ab8a980 2024-09-13T06:09:58.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.355+0000 7f8cfdb39640 1 --2- 172.21.15.194:0/2733938882 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55bd7ab8a980 0x55bd7ab8cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.355+0000 7f8cfdb39640 1 --2- 172.21.15.194:0/2733938882 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55bd7ab8a980 0x55bd7ab8cd70 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.355+0000 7f8cfdb39640 1 -- 172.21.15.194:0/2733938882 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8cf005c040 con 0x55bd7ab8a980 2024-09-13T06:09:58.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.355+0000 7f8d00029980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:09:58.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.355+0000 7f8d00029980 20 searching for the correct realm 2024-09-13T06:09:58.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.355+0000 7f8d00029980 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bd7ab8eb50 con 0x55bd7ab8a980 2024-09-13T06:09:58.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.355+0000 7f8cfdb39640 1 -- 172.21.15.194:0/2733938882 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cf005c040 con 0x55bd7ab8a980 2024-09-13T06:09:58.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.355+0000 7f8cfdb39640 1 --2- 172.21.15.194:0/2733938882 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55bd7a9c8ad0 0x7f8cf00117a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.355+0000 7f8cfdb39640 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bd7ab8eb50 con 0x55bd7a9c8ad0 2024-09-13T06:09:58.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.355+0000 7f8cfd338640 1 --2- 172.21.15.194:0/2733938882 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55bd7a9c8ad0 0x7f8cf00117a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.355+0000 7f8cfd338640 1 --2- 172.21.15.194:0/2733938882 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55bd7a9c8ad0 0x7f8cf00117a0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.355+0000 7f8cfd338640 1 -- 172.21.15.194:0/2733938882 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8cf40da070 con 0x55bd7a9c8ad0 2024-09-13T06:09:58.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.355+0000 7f8cfd338640 1 --2- 172.21.15.194:0/2733938882 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f8cf40cf040 0x7f8cf40b8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.355+0000 7f8cfd338640 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bd7ab8eb50 con 0x7f8cf40cf040 2024-09-13T06:09:58.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.355+0000 7f8cfe33a640 1 --2- 172.21.15.194:0/2733938882 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f8cf40cf040 0x7f8cf40b8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.359+0000 7f8cfe33a640 1 --2- 172.21.15.194:0/2733938882 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f8cf40cf040 0x7f8cf40b8430 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.359+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cf80083f0 con 0x7f8cf40cf040 2024-09-13T06:09:58.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.359+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bd7ab89c20 con 0x55bd7ab85fe0 2024-09-13T06:09:58.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.359+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cf80083f0 con 0x55bd7ab85fe0 2024-09-13T06:09:58.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.359+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bd7ab89c20 con 0x55bd7ab85fe0 2024-09-13T06:09:58.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.359+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cf80083f0 con 0x55bd7ab85fe0 2024-09-13T06:09:58.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.359+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bd7ab89c20 con 0x7f8cf40cf040 2024-09-13T06:09:58.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.359+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cf80083f0 con 0x7f8cf40cf040 2024-09-13T06:09:58.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.359+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bd7ab89c20 con 0x7f8cf40cf040 2024-09-13T06:09:58.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.359+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cf80083f0 con 0x7f8cf40cf040 2024-09-13T06:09:58.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.359+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bd7ab89c20 con 0x55bd7a9c8ad0 2024-09-13T06:09:58.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.359+0000 7f8cfd338640 1 -- 172.21.15.194:0/2733938882 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cf40da070 con 0x55bd7a9c8ad0 2024-09-13T06:09:58.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.359+0000 7f8cfd338640 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bd7ab89c20 con 0x55bd7ab8a980 2024-09-13T06:09:58.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.359+0000 7f8cfdb39640 1 -- 172.21.15.194:0/2733938882 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cf005c040 con 0x55bd7ab8a980 2024-09-13T06:09:58.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.359+0000 7f8cfdb39640 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bd7ab89c20 con 0x55bd7ab85fe0 2024-09-13T06:09:58.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.359+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cf80083f0 con 0x55bd7ab85fe0 2024-09-13T06:09:58.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.359+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bd7ab89c20 con 0x7f8cf40cf040 2024-09-13T06:09:58.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.363+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cf80083f0 con 0x7f8cf40cf040 2024-09-13T06:09:58.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.363+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bd7ab89c20 con 0x55bd7ab85fe0 2024-09-13T06:09:58.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.363+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cf80083f0 con 0x55bd7ab85fe0 2024-09-13T06:09:58.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.363+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bd7ab89c20 con 0x55bd7a9c8ad0 2024-09-13T06:09:58.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.363+0000 7f8cfd338640 1 -- 172.21.15.194:0/2733938882 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8cf40da070 con 0x55bd7a9c8ad0 2024-09-13T06:09:58.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.363+0000 7f8cfd338640 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bd7ab89c20 con 0x55bd7ab8a980 2024-09-13T06:09:58.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.363+0000 7f8cfdb39640 1 -- 172.21.15.194:0/2733938882 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cf005c040 con 0x55bd7ab8a980 2024-09-13T06:09:58.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.363+0000 7f8cfdb39640 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bd7ab89c20 con 0x55bd7ab8a980 2024-09-13T06:09:58.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.363+0000 7f8cfdb39640 1 -- 172.21.15.194:0/2733938882 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cf005c040 con 0x55bd7ab8a980 2024-09-13T06:09:58.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.363+0000 7f8cfdb39640 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bd7ab89c20 con 0x7f8cf40cf040 2024-09-13T06:09:58.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.363+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cf80083f0 con 0x7f8cf40cf040 2024-09-13T06:09:58.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.363+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bd7ab89c20 con 0x55bd7ab8a980 2024-09-13T06:09:58.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.363+0000 7f8cfdb39640 1 -- 172.21.15.194:0/2733938882 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cf005c040 con 0x55bd7ab8a980 2024-09-13T06:09:58.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.363+0000 7f8cfdb39640 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bd7ab89c20 con 0x55bd7ab8a980 2024-09-13T06:09:58.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.363+0000 7f8cfdb39640 1 -- 172.21.15.194:0/2733938882 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cf005c040 con 0x55bd7ab8a980 2024-09-13T06:09:58.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.363+0000 7f8cfdb39640 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bd7ab89c20 con 0x55bd7ab85fe0 2024-09-13T06:09:58.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.363+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cf80083f0 con 0x55bd7ab85fe0 2024-09-13T06:09:58.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.363+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bd7ab89c20 con 0x55bd7ab85fe0 2024-09-13T06:09:58.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.363+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8cf80083f0 con 0x55bd7ab85fe0 2024-09-13T06:09:58.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.363+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bd7ab89c20 con 0x7f8cf40cf040 2024-09-13T06:09:58.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.363+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cf80083f0 con 0x7f8cf40cf040 2024-09-13T06:09:58.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.363+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bd7ab89c20 con 0x55bd7ab8a980 2024-09-13T06:09:58.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.363+0000 7f8cfdb39640 1 -- 172.21.15.194:0/2733938882 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cf005c040 con 0x55bd7ab8a980 2024-09-13T06:09:58.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.367+0000 7f8cfdb39640 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bd7ab89c20 con 0x55bd7a9c8ad0 2024-09-13T06:09:58.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.367+0000 7f8cfd338640 1 -- 172.21.15.194:0/2733938882 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cf40da070 con 0x55bd7a9c8ad0 2024-09-13T06:09:58.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.367+0000 7f8cfd338640 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bd7ab89c20 con 0x55bd7ab85fe0 2024-09-13T06:09:58.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.367+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cf80083f0 con 0x55bd7ab85fe0 2024-09-13T06:09:58.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.367+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bd7ab89c20 con 0x7f8cf40cf040 2024-09-13T06:09:58.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.367+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cf80083f0 con 0x7f8cf40cf040 2024-09-13T06:09:58.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.367+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bd7ab89c20 con 0x55bd7ab8a980 2024-09-13T06:09:58.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.367+0000 7f8cfdb39640 1 -- 172.21.15.194:0/2733938882 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8cf005c040 con 0x55bd7ab8a980 2024-09-13T06:09:58.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.367+0000 7f8cfdb39640 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bd7ab89c20 con 0x7f8cf40cf040 2024-09-13T06:09:58.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.367+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cf80083f0 con 0x7f8cf40cf040 2024-09-13T06:09:58.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.367+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bd7ab89c20 con 0x55bd7a9c8ad0 2024-09-13T06:09:58.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.367+0000 7f8cfd338640 1 -- 172.21.15.194:0/2733938882 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cf40da070 con 0x55bd7a9c8ad0 2024-09-13T06:09:58.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.367+0000 7f8cfd338640 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bd7ab89c20 con 0x55bd7ab8a980 2024-09-13T06:09:58.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.367+0000 7f8cfdb39640 1 -- 172.21.15.194:0/2733938882 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cf005c040 con 0x55bd7ab8a980 2024-09-13T06:09:58.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.367+0000 7f8cfdb39640 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bd7ab89c20 con 0x7f8cf40cf040 2024-09-13T06:09:58.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.367+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cf80083f0 con 0x7f8cf40cf040 2024-09-13T06:09:58.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.367+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bd7ab89c20 con 0x55bd7ab85fe0 2024-09-13T06:09:58.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.367+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8cf80083f0 con 0x55bd7ab85fe0 2024-09-13T06:09:58.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.367+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bd7ab89c20 con 0x55bd7a9c8ad0 2024-09-13T06:09:58.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.371+0000 7f8cfd338640 1 -- 172.21.15.194:0/2733938882 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cf40da070 con 0x55bd7a9c8ad0 2024-09-13T06:09:58.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.371+0000 7f8d00029980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:09:58.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.371+0000 7f8d00029980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:09:58.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.371+0000 7f8d00029980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:09:58.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.371+0000 7f8d00029980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:09:58.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.371+0000 7f8d00029980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:09:58.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.371+0000 7f8d00029980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:09:58.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.371+0000 7f8d00029980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.371+0000 7f8d00029980 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bd7ab8db00 con 0x55bd7ab85fe0 2024-09-13T06:09:58.377 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.371+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8cf80083f0 con 0x55bd7ab85fe0 2024-09-13T06:09:58.377 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.371+0000 7f8d00029980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:58.377 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.371+0000 7f8d00029980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.377 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.371+0000 7f8d00029980 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bd7ab8def0 con 0x55bd7ab85fe0 2024-09-13T06:09:58.377 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.371+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8cf80083f0 con 0x55bd7ab85fe0 2024-09-13T06:09:58.377 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.371+0000 7f8d00029980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:58.377 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.371+0000 7f8d00029980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.377 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.371+0000 7f8d00029980 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bd7ab8def0 con 0x55bd7a9c8ad0 2024-09-13T06:09:58.377 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.371+0000 7f8cfd338640 1 -- 172.21.15.194:0/2733938882 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8cf40da070 con 0x55bd7a9c8ad0 2024-09-13T06:09:58.377 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.371+0000 7f8d00029980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:09:58.377 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.371+0000 7f8d00029980 20 zone default found 2024-09-13T06:09:58.377 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.371+0000 7f8d00029980 4 Realm: () 2024-09-13T06:09:58.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.371+0000 7f8d00029980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:09:58.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.371+0000 7f8d00029980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:09:58.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.371+0000 7f8d00029980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:09:58.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.371+0000 7f8d00029980 20 zonegroup default 2024-09-13T06:09:58.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.371+0000 7f8d00029980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.371+0000 7f8d00029980 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bd7ab8f020 con 0x7f8cf40cf040 2024-09-13T06:09:58.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.371+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8cf80083f0 con 0x7f8cf40cf040 2024-09-13T06:09:58.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.371+0000 7f8d00029980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:58.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.371+0000 7f8d00029980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.371+0000 7f8d00029980 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bd7ab90a00 con 0x55bd7ab8a980 2024-09-13T06:09:58.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.371+0000 7f8cfdb39640 1 -- 172.21.15.194:0/2733938882 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8cf005c040 con 0x55bd7ab8a980 2024-09-13T06:09:58.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.371+0000 7f8d00029980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:58.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.371+0000 7f8d00029980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.371+0000 7f8d00029980 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bd7ab90da0 con 0x55bd7ab8a980 2024-09-13T06:09:58.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.371+0000 7f8cfdb39640 1 -- 172.21.15.194:0/2733938882 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8cf005c040 con 0x55bd7ab8a980 2024-09-13T06:09:58.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.371+0000 7f8d00029980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:58.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.371+0000 7f8d00029980 20 started sync module instance, tier type = 2024-09-13T06:09:58.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.371+0000 7f8d00029980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:09:58.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.371+0000 7f8d00029980 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bd7ab8fea0 con 0x55bd7a9c8ad0 2024-09-13T06:09:58.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.375+0000 7f8cfd338640 1 -- 172.21.15.194:0/2733938882 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(44 notify.0 [create] v33'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cf40da070 con 0x55bd7a9c8ad0 2024-09-13T06:09:58.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.375+0000 7f8d00029980 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94272296122864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bd7ab911b0 con 0x55bd7a9c8ad0 2024-09-13T06:09:58.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.375+0000 7f8d00029980 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bd7ab91a00 con 0x55bd7ab85fe0 2024-09-13T06:09:58.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.375+0000 7f8cfd338640 1 -- 172.21.15.194:0/2733938882 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94272296122864] v33'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cf40da070 con 0x55bd7a9c8ad0 2024-09-13T06:09:58.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.375+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v33'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cf80083f0 con 0x55bd7ab85fe0 2024-09-13T06:09:58.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.375+0000 7f8d00029980 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94272296125072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bd7ab91a60 con 0x55bd7ab85fe0 2024-09-13T06:09:58.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.375+0000 7f8d00029980 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bd7ab92550 con 0x55bd7ab8a980 2024-09-13T06:09:58.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.379+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94272296125072] v33'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cf80083f0 con 0x55bd7ab85fe0 2024-09-13T06:09:58.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.379+0000 7f8cfdb39640 1 -- 172.21.15.194:0/2733938882 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v33'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cf005c040 con 0x55bd7ab8a980 2024-09-13T06:09:58.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.379+0000 7f8d00029980 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94272296132640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bd7ab92510 con 0x55bd7ab8a980 2024-09-13T06:09:58.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.379+0000 7f8d00029980 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bd7ab92f90 con 0x55bd7a9c8ad0 2024-09-13T06:09:58.382 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.379+0000 7f8cfd338640 1 -- 172.21.15.194:0/2733938882 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(50 notify.3 [create] v33'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cf40da070 con 0x55bd7a9c8ad0 2024-09-13T06:09:58.382 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.379+0000 7f8d00029980 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94272296135392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bd7ab937e0 con 0x55bd7a9c8ad0 2024-09-13T06:09:58.382 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.379+0000 7f8d00029980 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bd7ab941e0 con 0x55bd7ab85fe0 2024-09-13T06:09:58.382 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.379+0000 7f8cfdb39640 1 -- 172.21.15.194:0/2733938882 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94272296132640] v33'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cf005c040 con 0x55bd7ab8a980 2024-09-13T06:09:58.382 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.379+0000 7f8cfd338640 1 -- 172.21.15.194:0/2733938882 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94272296135392] v33'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cf40da070 con 0x55bd7a9c8ad0 2024-09-13T06:09:58.383 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.383+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v33'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cf80083f0 con 0x55bd7ab85fe0 2024-09-13T06:09:58.383 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.383+0000 7f8d00029980 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94272296137520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bd7ab93cf0 con 0x55bd7ab85fe0 2024-09-13T06:09:58.383 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.383+0000 7f8d00029980 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bd7ab94a80 con 0x7f8cf40cf040 2024-09-13T06:09:58.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.383+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94272296137520] v33'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cf80083f0 con 0x55bd7ab85fe0 2024-09-13T06:09:58.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.383+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(54 notify.5 [create] v33'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cf80083f0 con 0x7f8cf40cf040 2024-09-13T06:09:58.385 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.383+0000 7f8d00029980 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94272296129872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bd7ab94a10 con 0x7f8cf40cf040 2024-09-13T06:09:58.385 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.383+0000 7f8d00029980 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bd7ab95490 con 0x7f8cf40cf040 2024-09-13T06:09:58.386 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.387+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94272296129872] v33'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cf80083f0 con 0x7f8cf40cf040 2024-09-13T06:09:58.389 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.387+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(56 notify.6 [create] v33'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cf80083f0 con 0x7f8cf40cf040 2024-09-13T06:09:58.389 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.387+0000 7f8d00029980 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94272296142448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bd7ab95490 con 0x7f8cf40cf040 2024-09-13T06:09:58.389 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.387+0000 7f8d00029980 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bd7ab95d60 con 0x7f8cf40cf040 2024-09-13T06:09:58.392 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.391+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(58 notify.7 [create] v33'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cf80083f0 con 0x7f8cf40cf040 2024-09-13T06:09:58.392 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.391+0000 7f8d00029980 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94272296146064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bd7ab963f0 con 0x7f8cf40cf040 2024-09-13T06:09:58.392 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.391+0000 7f8d00029980 20 add_watcher() i=0 2024-09-13T06:09:58.392 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.391+0000 7f8d00029980 20 add_watcher() i=1 2024-09-13T06:09:58.392 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.391+0000 7f8d00029980 20 add_watcher() i=2 2024-09-13T06:09:58.392 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.391+0000 7f8d00029980 20 add_watcher() i=3 2024-09-13T06:09:58.392 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.391+0000 7f8d00029980 20 add_watcher() i=4 2024-09-13T06:09:58.392 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.391+0000 7f8d00029980 20 add_watcher() i=5 2024-09-13T06:09:58.392 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.391+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94272296142448] v33'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cf80083f0 con 0x7f8cf40cf040 2024-09-13T06:09:58.392 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.391+0000 7f8d00029980 20 add_watcher() i=6 2024-09-13T06:09:58.393 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.391+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94272296146064] v33'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cf80083f0 con 0x7f8cf40cf040 2024-09-13T06:09:58.393 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.391+0000 7f8d00029980 20 add_watcher() i=7 2024-09-13T06:09:58.393 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.391+0000 7f8d00029980 2 all 8 watchers are set, enabling cache 2024-09-13T06:09:58.394 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.391+0000 7f8d00029980 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bd7ab99310 con 0x55bd7ab85fe0 2024-09-13T06:09:58.394 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.391+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8cf80083f0 con 0x55bd7ab85fe0 2024-09-13T06:09:58.394 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.391+0000 7f8d00029980 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94272296148528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bd7ab96700 con 0x55bd7ab85fe0 2024-09-13T06:09:58.395 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.395+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94272296148528] v33'102 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8cf80083f0 con 0x55bd7ab85fe0 2024-09-13T06:09:58.395 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.395+0000 7f8bb3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:58.395 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.395+0000 7f8d00029980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:09:58.396 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.395+0000 7f8d00029980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:09:58.396 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.395+0000 7f8d00029980 5 note: GC not initialized 2024-09-13T06:09:58.396 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.395+0000 7f8bb2fe5640 20 reqs_thread_entry: start 2024-09-13T06:09:58.396 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.395+0000 7f8d00029980 20 init_complete bucket index max shards: 11 2024-09-13T06:09:58.399 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.395+0000 7f8d00029980 20 Filter name: none 2024-09-13T06:09:58.399 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.395+0000 7f8bb0fe1640 20 reqs_thread_entry: start 2024-09-13T06:09:58.399 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.395+0000 7f8d00029980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.399 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.395+0000 7f8d00029980 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bd7abbc350 con 0x55bd7ab85fe0 2024-09-13T06:09:58.399 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.395+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f8cf80083f0 con 0x55bd7ab85fe0 2024-09-13T06:09:58.399 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.395+0000 7f8d00029980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T06:09:58.399 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.395+0000 7f8d00029980 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bd7abbd8a0 con 0x55bd7a9c8ad0 2024-09-13T06:09:58.399 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.395+0000 7f8cfd338640 1 -- 172.21.15.194:0/2733938882 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f8cf40da070 con 0x55bd7a9c8ad0 2024-09-13T06:09:58.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.395+0000 7f8d00029980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.395+0000 7f8d00029980 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:64 8.18 8:1a66c368:root::.bucket.meta.myfoo%3a52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bd7abbd8a0 con 0x55bd7ab85fe0 2024-09-13T06:09:58.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.395+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(64 .bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv12 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f8cf80083f0 con 0x55bd7ab85fe0 2024-09-13T06:09:58.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.395+0000 7f8d00029980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T06:09:58.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.395+0000 7f8d00029980 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-13T06:09:58.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.395+0000 7f8d00029980 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:65 4.25 4:a5fa2579:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bd7abbf310 con 0x55bd7ab8a980 2024-09-13T06:09:58.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.395+0000 7f8d00029980 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:66 4.2c 4:3660bce8:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bd7abc1fc0 con 0x55bd7ab85fe0 2024-09-13T06:09:58.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.395+0000 7f8d00029980 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:67 4.14 4:2a98937a:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bd7abc4b10 con 0x55bd7ab8a980 2024-09-13T06:09:58.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.395+0000 7f8d00029980 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:68 4.27 4:e42c957a:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bd7abc7380 con 0x55bd7ab85fe0 2024-09-13T06:09:58.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.395+0000 7f8d00029980 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:69 4.5 4:a24186ed:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bd7abc9bf0 con 0x55bd7ab8a980 2024-09-13T06:09:58.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.395+0000 7f8d00029980 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:70 4.13 4:cad7efb2:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bd7abcc460 con 0x55bd7a9c8ad0 2024-09-13T06:09:58.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.395+0000 7f8d00029980 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:71 4.3 4:c1107af5:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bd7abcecd0 con 0x55bd7ab85fe0 2024-09-13T06:09:58.401 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.395+0000 7f8d00029980 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:72 4.27 4:e6338292:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bd7abd1950 con 0x55bd7ab85fe0 2024-09-13T06:09:58.401 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.395+0000 7f8d00029980 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:73 4.2a 4:57abd676:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bd7abd46e0 con 0x55bd7ab85fe0 2024-09-13T06:09:58.401 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.395+0000 7f8d00029980 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:74 4.38 4:1e9df731:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bd7abd72f0 con 0x55bd7ab85fe0 2024-09-13T06:09:58.401 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.395+0000 7f8d00029980 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:75 4.2b 4:d7fbcf05:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bd7abd46e0 con 0x55bd7ab85fe0 2024-09-13T06:09:58.401 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.399+0000 7f8cfdb39640 1 -- 172.21.15.194:0/2733938882 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(65 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8cf005c040 con 0x55bd7ab8a980 2024-09-13T06:09:58.401 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.399+0000 7f8cfdb39640 1 -- 172.21.15.194:0/2733938882 <== osd.3 v2:172.21.15.194:6816/96632515 16 ==== osd_op_reply(67 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8cf005c040 con 0x55bd7ab8a980 2024-09-13T06:09:58.401 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.399+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(66 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8cf80083f0 con 0x55bd7ab85fe0 2024-09-13T06:09:58.401 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.399+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(68 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8cf80083f0 con 0x55bd7ab85fe0 2024-09-13T06:09:58.401 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.399+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 <== osd.1 v2:172.21.15.194:6808/3135444559 25 ==== osd_op_reply(71 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8cf80083f0 con 0x55bd7ab85fe0 2024-09-13T06:09:58.401 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.399+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 <== osd.1 v2:172.21.15.194:6808/3135444559 26 ==== osd_op_reply(73 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8cf80083f0 con 0x55bd7ab85fe0 2024-09-13T06:09:58.401 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.399+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 <== osd.1 v2:172.21.15.194:6808/3135444559 27 ==== osd_op_reply(72 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.7 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8cf80083f0 con 0x55bd7ab85fe0 2024-09-13T06:09:58.401 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.399+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 <== osd.1 v2:172.21.15.194:6808/3135444559 28 ==== osd_op_reply(74 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8cf80083f0 con 0x55bd7ab85fe0 2024-09-13T06:09:58.402 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.399+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 <== osd.1 v2:172.21.15.194:6808/3135444559 29 ==== osd_op_reply(75 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f8cf80083f0 con 0x55bd7ab85fe0 2024-09-13T06:09:58.402 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.399+0000 7f8cfdb39640 1 -- 172.21.15.194:0/2733938882 <== osd.3 v2:172.21.15.194:6816/96632515 17 ==== osd_op_reply(69 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8cf005c040 con 0x55bd7ab8a980 2024-09-13T06:09:58.402 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.399+0000 7f8cfd338640 1 -- 172.21.15.194:0/2733938882 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(70 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.5 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f8cf40da070 con 0x55bd7a9c8ad0 2024-09-13T06:09:58.402 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.399+0000 7f8d00029980 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:76 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bd7abc4620 con 0x55bd7a9c8ad0 2024-09-13T06:09:58.402 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.399+0000 7f8cfd338640 1 -- 172.21.15.194:0/2733938882 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(76 foo.buckets [call] v33'15 uv15 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f8cf40da070 con 0x55bd7a9c8ad0 2024-09-13T06:09:58.402 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.399+0000 7f8d00029980 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:77 8.9 8:96d98480:users.uid::foo.buckets:head [call user.complete_stats_sync in=37b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bd7abc4620 con 0x55bd7a9c8ad0 2024-09-13T06:09:58.403 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.403+0000 7f8cfd338640 1 -- 172.21.15.194:0/2733938882 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== osd_op_reply(77 foo.buckets [call] v33'16 uv16 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f8cf40da070 con 0x55bd7a9c8ad0 2024-09-13T06:09:58.403 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.403+0000 7f8d00029980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.403 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.403+0000 7f8d00029980 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:78 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bd7abd4050 con 0x55bd7ab85fe0 2024-09-13T06:09:58.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.403+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 <== osd.1 v2:172.21.15.194:6808/3135444559 30 ==== osd_op_reply(78 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f8cf80083f0 con 0x55bd7ab85fe0 2024-09-13T06:09:58.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.403+0000 7f8d00029980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T06:09:58.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.403+0000 7f8d00029980 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:79 8.9 8:96d98480:users.uid::foo.buckets:head [call user.get_header in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bd7abd4050 con 0x55bd7a9c8ad0 2024-09-13T06:09:58.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.403+0000 7f8cfd338640 1 -- 172.21.15.194:0/2733938882 <== osd.2 v2:172.21.15.194:6800/815615585 16 ==== osd_op_reply(79 foo.buckets [call out=58b] v0'0 uv16 ondisk = 0) ==== 155+0+58 (crc 0 0 0) 0x7f8cf40f5040 con 0x55bd7a9c8ad0 2024-09-13T06:09:58.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.403+0000 7f8bb3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:58.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.403+0000 7f8d00029980 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:80 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94272296148528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bd7abd4050 con 0x55bd7ab85fe0 2024-09-13T06:09:58.406 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.403+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 <== osd.1 v2:172.21.15.194:6808/3135444559 31 ==== osd_op_reply(80 data_loggenerations_metadata [watch unwatch cookie 94272296148528] v33'103 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8cf80083f0 con 0x55bd7ab85fe0 2024-09-13T06:09:58.406 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.403+0000 7f8d00029980 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:81 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94272296122864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bd7abd4050 con 0x55bd7a9c8ad0 2024-09-13T06:09:58.407 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.407+0000 7f8cfd338640 1 -- 172.21.15.194:0/2733938882 <== osd.2 v2:172.21.15.194:6800/815615585 17 ==== osd_op_reply(81 notify.0 [watch unwatch cookie 94272296122864] v33'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cf40f5040 con 0x55bd7a9c8ad0 2024-09-13T06:09:58.407 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.407+0000 7f8d00029980 20 remove_watcher() i=0 2024-09-13T06:09:58.408 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.407+0000 7f8d00029980 2 removed watcher, disabling cache 2024-09-13T06:09:58.408 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.407+0000 7f8d00029980 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:82 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94272296125072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bd7abd4050 con 0x55bd7ab85fe0 2024-09-13T06:09:58.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.407+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 <== osd.1 v2:172.21.15.194:6808/3135444559 32 ==== osd_op_reply(82 notify.1 [watch unwatch cookie 94272296125072] v33'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cf80083f0 con 0x55bd7ab85fe0 2024-09-13T06:09:58.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.407+0000 7f8d00029980 20 remove_watcher() i=1 2024-09-13T06:09:58.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.407+0000 7f8d00029980 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:83 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94272296132640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bd7abd4050 con 0x55bd7ab8a980 2024-09-13T06:09:58.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.411+0000 7f8cfdb39640 1 -- 172.21.15.194:0/2733938882 <== osd.3 v2:172.21.15.194:6816/96632515 18 ==== osd_op_reply(83 notify.2 [watch unwatch cookie 94272296132640] v33'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cf005c040 con 0x55bd7ab8a980 2024-09-13T06:09:58.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.411+0000 7f8d00029980 20 remove_watcher() i=2 2024-09-13T06:09:58.412 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.411+0000 7f8d00029980 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:84 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94272296135392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bd7abd4050 con 0x55bd7a9c8ad0 2024-09-13T06:09:58.412 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.411+0000 7f8cfd338640 1 -- 172.21.15.194:0/2733938882 <== osd.2 v2:172.21.15.194:6800/815615585 18 ==== osd_op_reply(84 notify.3 [watch unwatch cookie 94272296135392] v33'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cf40f5040 con 0x55bd7a9c8ad0 2024-09-13T06:09:58.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.411+0000 7f8d00029980 20 remove_watcher() i=3 2024-09-13T06:09:58.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.411+0000 7f8d00029980 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:85 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94272296137520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bd7abd4050 con 0x55bd7ab85fe0 2024-09-13T06:09:58.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.415+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 <== osd.1 v2:172.21.15.194:6808/3135444559 33 ==== osd_op_reply(85 notify.4 [watch unwatch cookie 94272296137520] v33'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cf80083f0 con 0x55bd7ab85fe0 2024-09-13T06:09:58.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.415+0000 7f8d00029980 20 remove_watcher() i=4 2024-09-13T06:09:58.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.415+0000 7f8d00029980 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:86 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94272296129872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bd7abd4050 con 0x7f8cf40cf040 2024-09-13T06:09:58.417 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.415+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(86 notify.5 [watch unwatch cookie 94272296129872] v33'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cf80083f0 con 0x7f8cf40cf040 2024-09-13T06:09:58.417 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.415+0000 7f8d00029980 20 remove_watcher() i=5 2024-09-13T06:09:58.417 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.415+0000 7f8d00029980 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:87 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94272296142448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bd7abd4050 con 0x7f8cf40cf040 2024-09-13T06:09:58.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.419+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(87 notify.6 [watch unwatch cookie 94272296142448] v33'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cf80083f0 con 0x7f8cf40cf040 2024-09-13T06:09:58.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.419+0000 7f8d00029980 20 remove_watcher() i=6 2024-09-13T06:09:58.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.419+0000 7f8d00029980 1 -- 172.21.15.194:0/2733938882 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:88 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94272296146064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bd7abd4050 con 0x7f8cf40cf040 2024-09-13T06:09:58.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.419+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(88 notify.7 [watch unwatch cookie 94272296146064] v33'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cf80083f0 con 0x7f8cf40cf040 2024-09-13T06:09:58.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.419+0000 7f8d00029980 20 remove_watcher() i=7 2024-09-13T06:09:58.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.419+0000 7f8d00029980 1 -- 172.21.15.194:0/2733938882 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f8cf40cf040 msgr2=0x7f8cf40b8430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.419+0000 7f8d00029980 1 --2- 172.21.15.194:0/2733938882 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f8cf40cf040 0x7f8cf40b8430 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.419+0000 7f8d00029980 1 -- 172.21.15.194:0/2733938882 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55bd7ab85fe0 msgr2=0x55bd7ab88480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.419+0000 7f8d00029980 1 --2- 172.21.15.194:0/2733938882 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55bd7ab85fe0 0x55bd7ab88480 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.419+0000 7f8d00029980 1 -- 172.21.15.194:0/2733938882 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55bd7a9c8ad0 msgr2=0x7f8cf00117a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.419+0000 7f8d00029980 1 --2- 172.21.15.194:0/2733938882 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55bd7a9c8ad0 0x7f8cf00117a0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.419+0000 7f8d00029980 1 -- 172.21.15.194:0/2733938882 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55bd7ab8a980 msgr2=0x55bd7ab8cd70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.419+0000 7f8d00029980 1 --2- 172.21.15.194:0/2733938882 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55bd7ab8a980 0x55bd7ab8cd70 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.419+0000 7f8d00029980 1 -- 172.21.15.194:0/2733938882 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8bc8034650 msgr2=0x7f8bc8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.419+0000 7f8d00029980 1 --2- 172.21.15.194:0/2733938882 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8bc8034650 0x7f8bc8036b10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x55bd7ab5a120 tx=0x7f8cf40a6000 comp rx=0 tx=0).stop 2024-09-13T06:09:58.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.419+0000 7f8d00029980 1 -- 172.21.15.194:0/2733938882 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bd7ab73f40 msgr2=0x55bd7ab7b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.419+0000 7f8cfe33a640 1 -- 172.21.15.194:0/2733938882 reap_dead start 2024-09-13T06:09:58.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.419+0000 7f8d00029980 1 --2- 172.21.15.194:0/2733938882 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bd7ab73f40 0x55bd7ab7b130 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0044f30 tx=0x7f8cf004d000 comp rx=0 tx=0).stop 2024-09-13T06:09:58.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.419+0000 7f8d00029980 1 -- 172.21.15.194:0/2733938882 shutdown_connections 2024-09-13T06:09:58.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.419+0000 7f8d00029980 1 --2- 172.21.15.194:0/2733938882 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bd7ab73f40 0x55bd7ab7b130 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.419+0000 7f8d00029980 1 -- 172.21.15.194:0/2733938882 >> 172.21.15.194:0/2733938882 conn(0x55bd7ab70320 msgr2=0x55bd7ab6e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:58.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.419+0000 7f8d00029980 1 -- 172.21.15.194:0/2733938882 shutdown_connections 2024-09-13T06:09:58.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.419+0000 7f8d00029980 1 -- 172.21.15.194:0/2733938882 wait complete. 2024-09-13T06:09:58.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.419+0000 7f8d00029980 1 -- 172.21.15.194:0/2358624031 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8bd8034600 msgr2=0x7f8bd8036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.423+0000 7f8d00029980 1 --2- 172.21.15.194:0/2358624031 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8bd8034600 0x7f8bd8036ac0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x55bd7ab518c0 tx=0x7f8cf4005a10 comp rx=0 tx=0).stop 2024-09-13T06:09:58.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.423+0000 7f8d00029980 1 -- 172.21.15.194:0/2358624031 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bd7ab677f0 msgr2=0x55bd7ab67c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.423+0000 7f8d00029980 1 --2- 172.21.15.194:0/2358624031 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bd7ab677f0 0x55bd7ab67c10 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0048250 tx=0x7f8cf0010d30 comp rx=0 tx=0).stop 2024-09-13T06:09:58.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.423+0000 7f8d00029980 1 -- 172.21.15.194:0/2358624031 shutdown_connections 2024-09-13T06:09:58.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.423+0000 7f8d00029980 1 --2- 172.21.15.194:0/2358624031 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8bd8034600 0x7f8bd8036ac0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.423+0000 7f8d00029980 1 --2- 172.21.15.194:0/2358624031 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bd7ab677f0 0x55bd7ab67c10 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.423+0000 7f8d00029980 1 -- 172.21.15.194:0/2358624031 >> 172.21.15.194:0/2358624031 conn(0x55bd7ab5c940 msgr2=0x55bd7ab5f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:58.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.423+0000 7f8d00029980 1 -- 172.21.15.194:0/2358624031 shutdown_connections 2024-09-13T06:09:58.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.423+0000 7f8d00029980 1 -- 172.21.15.194:0/2358624031 wait complete. 2024-09-13T06:09:58.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.423+0000 7f8d00029980 1 -- 172.21.15.194:0/556866317 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55bd7ab4e560 msgr2=0x55bd7ab50970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.423+0000 7f8d00029980 1 --2- 172.21.15.194:0/556866317 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55bd7ab4e560 0x55bd7ab50970 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.423+0000 7f8d00029980 1 -- 172.21.15.194:0/556866317 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55bd7ab57230 msgr2=0x55bd7ab59620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.423+0000 7f8d00029980 1 --2- 172.21.15.194:0/556866317 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55bd7ab57230 0x55bd7ab59620 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.423+0000 7f8d00029980 1 -- 172.21.15.194:0/556866317 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55bd7ab53310 msgr2=0x55bd7ab55700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.423+0000 7f8d00029980 1 --2- 172.21.15.194:0/556866317 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55bd7ab53310 0x55bd7ab55700 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.423+0000 7f8d00029980 1 -- 172.21.15.194:0/556866317 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8be4034650 msgr2=0x7f8be4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.423+0000 7f8d00029980 1 --2- 172.21.15.194:0/556866317 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8be4034650 0x7f8be4036b10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8cf40ad000 tx=0x7f8cf40a5040 comp rx=0 tx=0).stop 2024-09-13T06:09:58.427 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.423+0000 7f8d00029980 1 -- 172.21.15.194:0/556866317 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bd7ab491a0 msgr2=0x55bd7ab495c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.427 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.423+0000 7f8d00029980 1 --2- 172.21.15.194:0/556866317 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55bd7ab491a0 0x55bd7ab495c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0002260 tx=0x7f8cf0000f50 comp rx=0 tx=0).stop 2024-09-13T06:09:58.427 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.423+0000 7f8cfe33a640 1 -- 172.21.15.194:0/556866317 reap_dead start 2024-09-13T06:09:58.427 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.423+0000 7f8d00029980 1 -- 172.21.15.194:0/556866317 shutdown_connections 2024-09-13T06:09:58.427 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.423+0000 7f8d00029980 1 -- 172.21.15.194:0/556866317 >> 172.21.15.194:0/556866317 conn(0x55bd7aa4f070 msgr2=0x55bd7ab3c2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:58.427 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.423+0000 7f8d00029980 1 -- 172.21.15.194:0/556866317 shutdown_connections 2024-09-13T06:09:58.427 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.423+0000 7f8d00029980 1 -- 172.21.15.194:0/556866317 wait complete. 2024-09-13T06:09:58.434 INFO:teuthology.orchestra.run.smithi194.stdout:{"stats":{"size":3,"size_actual":4096,"size_kb":1,"size_kb_actual":4,"num_objects":1},"last_stats_sync":"2024-09-13T06:09:58.403777Z","last_stats_update":"2024-09-13T06:09:58.401476Z"} 2024-09-13T06:09:58.434 DEBUG:tasks.util.rgw: json result: {'stats': {'size': 3, 'size_actual': 4096, 'size_kb': 1, 'size_kb_actual': 4, 'num_objects': 1}, 'last_stats_sync': '2024-09-13T06:09:58.403777Z', 'last_stats_update': '2024-09-13T06:09:58.401476Z'} 2024-09-13T06:09:58.441 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T06:09:58.441 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-09-13T06:09:58.441 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-09-13T06:09:58.441 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid foo --bucket myfoo 2024-09-13T06:09:58.512 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:09:58.512 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:09:58.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.511+0000 7f2be9407980 1 Processor -- start 2024-09-13T06:09:58.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.511+0000 7f2be9407980 1 -- start start 2024-09-13T06:09:58.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.511+0000 7f2be9407980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x559384a5d2a0 0x559384aed7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.511+0000 7f2be9407980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559384970ae0 con 0x559384aedcf0 2024-09-13T06:09:58.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.511+0000 7f2be9407980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x559384994e30 con 0x559384a5d2a0 2024-09-13T06:09:58.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.511+0000 7f2be6f17640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x559384a5d2a0 0x559384aed7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.511+0000 7f2be6716640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x559384aedcf0 0x559384af00e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:51152/0 (socket says 172.21.15.194:51152) 2024-09-13T06:09:58.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.511+0000 7f2be6716640 1 -- 172.21.15.194:0/1294116876 learned_addr learned my addr 172.21.15.194:0/1294116876 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-09-13T06:09:58.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.515+0000 7f2be6f17640 1 -- 172.21.15.194:0/1294116876 >> v1:172.21.15.120:6789/0 conn(0x559384aedcf0 legacy=0x559384af00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.515+0000 7f2be6f17640 1 -- 172.21.15.194:0/1294116876 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559384a5d680 con 0x559384a5d2a0 2024-09-13T06:09:58.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.515+0000 7f2be6f17640 1 --2- 172.21.15.194:0/1294116876 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559384a5d2a0 0x559384aed7b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2be000a420 tx=0x7f2be001afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29f1cee3dcc5283b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.515+0000 7f2be5f15640 1 -- 172.21.15.194:0/1294116876 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2be00af070 con 0x559384a5d2a0 2024-09-13T06:09:58.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.515+0000 7f2be5f15640 1 -- 172.21.15.194:0/1294116876 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2be00aa530 con 0x559384a5d2a0 2024-09-13T06:09:58.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.515+0000 7f2be5f15640 1 -- 172.21.15.194:0/1294116876 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2be00aa850 con 0x559384a5d2a0 2024-09-13T06:09:58.518 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.515+0000 7f2be9407980 1 -- 172.21.15.194:0/1294116876 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559384a5d2a0 msgr2=0x559384aed7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.518 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.515+0000 7f2be9407980 1 --2- 172.21.15.194:0/1294116876 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559384a5d2a0 0x559384aed7b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2be000a420 tx=0x7f2be001afd0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.518 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.515+0000 7f2be9407980 1 -- 172.21.15.194:0/1294116876 shutdown_connections 2024-09-13T06:09:58.518 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.515+0000 7f2be9407980 1 --2- 172.21.15.194:0/1294116876 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559384a5d2a0 0x559384aed7b0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.519 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.515+0000 7f2be9407980 1 -- 172.21.15.194:0/1294116876 >> 172.21.15.194:0/1294116876 conn(0x559384ae30a0 msgr2=0x559384ae54c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:58.519 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.515+0000 7f2be9407980 1 -- 172.21.15.194:0/1294116876 shutdown_connections 2024-09-13T06:09:58.519 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.515+0000 7f2be9407980 1 -- 172.21.15.194:0/1294116876 wait complete. 2024-09-13T06:09:58.533 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.531+0000 7f2be9407980 1 Processor -- start 2024-09-13T06:09:58.533 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.531+0000 7f2be9407980 1 -- start start 2024-09-13T06:09:58.533 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.531+0000 7f2be9407980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559384a5d2a0 0x559384bd5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.531+0000 7f2be9407980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x559384996200 con 0x559384a5d2a0 2024-09-13T06:09:58.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.531+0000 7f2be6f17640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559384a5d2a0 0x559384bd5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.531+0000 7f2be6f17640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559384a5d2a0 0x559384bd5c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45524/0 (socket says 172.21.15.194:45524) 2024-09-13T06:09:58.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.531+0000 7f2be6f17640 1 -- 172.21.15.194:0/3252101853 learned_addr learned my addr 172.21.15.194:0/3252101853 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:58.535 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.531+0000 7f2be6f17640 1 -- 172.21.15.194:0/3252101853 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559384bd61e0 con 0x559384a5d2a0 2024-09-13T06:09:58.535 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.535+0000 7f2be6f17640 1 --2- 172.21.15.194:0/3252101853 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559384a5d2a0 0x559384bd5c10 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f2be00ad040 tx=0x7f2be00033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dda5c92a67e059a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.535 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.535+0000 7f2ad4e09640 1 -- 172.21.15.194:0/3252101853 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2be00af040 con 0x559384a5d2a0 2024-09-13T06:09:58.535 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.535+0000 7f2ad4e09640 1 -- 172.21.15.194:0/3252101853 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2be00aa9a0 con 0x559384a5d2a0 2024-09-13T06:09:58.535 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.535+0000 7f2ad4e09640 1 -- 172.21.15.194:0/3252101853 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2be00aac80 con 0x559384a5d2a0 2024-09-13T06:09:58.536 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.535+0000 7f2be9407980 1 -- 172.21.15.194:0/3252101853 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559384a5d2a0 msgr2=0x559384bd5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.536 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.535+0000 7f2be9407980 1 --2- 172.21.15.194:0/3252101853 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559384a5d2a0 0x559384bd5c10 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f2be00ad040 tx=0x7f2be00033b0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.537 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.535+0000 7f2be9407980 1 -- 172.21.15.194:0/3252101853 shutdown_connections 2024-09-13T06:09:58.537 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.535+0000 7f2be9407980 1 --2- 172.21.15.194:0/3252101853 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559384a5d2a0 0x559384bd5c10 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.537 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.535+0000 7f2be9407980 1 -- 172.21.15.194:0/3252101853 >> 172.21.15.194:0/3252101853 conn(0x559384ae30a0 msgr2=0x559384bd1840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:58.537 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.535+0000 7f2be9407980 1 -- 172.21.15.194:0/3252101853 shutdown_connections 2024-09-13T06:09:58.537 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.535+0000 7f2be9407980 1 -- 172.21.15.194:0/3252101853 wait complete. 2024-09-13T06:09:58.537 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.535+0000 7f2be9407980 1 Processor -- start 2024-09-13T06:09:58.537 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.535+0000 7f2be9407980 1 -- start start 2024-09-13T06:09:58.537 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.535+0000 7f2be9407980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559384a5d2a0 0x559384bdce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.537 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.535+0000 7f2be9407980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x559384af4230 con 0x559384a5d2a0 2024-09-13T06:09:58.537 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.535+0000 7f2be6f17640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559384a5d2a0 0x559384bdce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.537 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.535+0000 7f2be6f17640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559384a5d2a0 0x559384bdce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45538/0 (socket says 172.21.15.194:45538) 2024-09-13T06:09:58.538 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.535+0000 7f2be6f17640 1 -- 172.21.15.194:0/4012906230 learned_addr learned my addr 172.21.15.194:0/4012906230 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:58.538 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.535+0000 7f2be6f17640 1 -- 172.21.15.194:0/4012906230 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559384bdd340 con 0x559384a5d2a0 2024-09-13T06:09:58.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.535+0000 7f2be6f17640 1 --2- 172.21.15.194:0/4012906230 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559384a5d2a0 0x559384bdce00 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f2be00aa500 tx=0x7f2be0017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.535+0000 7f2ad3606640 1 -- 172.21.15.194:0/4012906230 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2be00c5070 con 0x559384a5d2a0 2024-09-13T06:09:58.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.535+0000 7f2be9407980 1 -- 172.21.15.194:0/4012906230 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559384bdd5d0 con 0x559384a5d2a0 2024-09-13T06:09:58.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.535+0000 7f2ad3606640 1 -- 172.21.15.194:0/4012906230 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2be00c1880 con 0x559384a5d2a0 2024-09-13T06:09:58.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.535+0000 7f2ad3606640 1 -- 172.21.15.194:0/4012906230 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2be00c1b60 con 0x559384a5d2a0 2024-09-13T06:09:58.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.535+0000 7f2be9407980 1 -- 172.21.15.194:0/4012906230 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559384be02b0 con 0x559384a5d2a0 2024-09-13T06:09:58.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.539+0000 7f2ad3606640 1 -- 172.21.15.194:0/4012906230 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f2be00b5470 con 0x559384a5d2a0 2024-09-13T06:09:58.542 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.539+0000 7f2ad3606640 1 --2- 172.21.15.194:0/4012906230 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f2acc0346a0 0x7f2acc036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.542 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.539+0000 7f2ad3606640 1 -- 172.21.15.194:0/4012906230 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f2be00bb070 con 0x559384a5d2a0 2024-09-13T06:09:58.542 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.539+0000 7f2be6716640 1 --2- 172.21.15.194:0/4012906230 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f2acc0346a0 0x7f2acc036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.542 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.539+0000 7f2be9407980 1 --2- 172.21.15.194:0/4012906230 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x559384aedcf0 0x559384be3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.542 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.539+0000 7f2be9407980 1 -- 172.21.15.194:0/4012906230 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559384be4480 con 0x559384aedcf0 2024-09-13T06:09:58.542 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.539+0000 7f2be7718640 1 --2- 172.21.15.194:0/4012906230 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x559384aedcf0 0x559384be3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.542 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.539+0000 7f2be6716640 1 --2- 172.21.15.194:0/4012906230 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f2acc0346a0 0x7f2acc036b60 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2bd0001da0 tx=0x7f2bd0001300 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.542 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.539+0000 7f2be7718640 1 --2- 172.21.15.194:0/4012906230 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x559384aedcf0 0x559384be3f00 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.542 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.539+0000 7f2be7718640 1 -- 172.21.15.194:0/4012906230 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2bd80083f0 con 0x559384aedcf0 2024-09-13T06:09:58.543 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.539+0000 7f2be9407980 1 -- 172.21.15.194:0/4012906230 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559384be14b0 con 0x559384aedcf0 2024-09-13T06:09:58.543 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.539+0000 7f2be7718640 1 -- 172.21.15.194:0/4012906230 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2bd80083f0 con 0x559384aedcf0 2024-09-13T06:09:58.543 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.539+0000 7f2be9407980 1 --2- 172.21.15.194:0/4012906230 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x559384be6750 0x559384be8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.543 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.539+0000 7f2be9407980 1 -- 172.21.15.194:0/4012906230 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559384be9210 con 0x559384be6750 2024-09-13T06:09:58.543 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.539+0000 7f2be6f17640 1 --2- 172.21.15.194:0/4012906230 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x559384be6750 0x559384be8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.543 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.539+0000 7f2be6f17640 1 --2- 172.21.15.194:0/4012906230 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x559384be6750 0x559384be8b40 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.543 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.539+0000 7f2be6f17640 1 -- 172.21.15.194:0/4012906230 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2be00d0070 con 0x559384be6750 2024-09-13T06:09:58.543 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.539+0000 7f2be9407980 1 -- 172.21.15.194:0/4012906230 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559384be55f0 con 0x559384aedcf0 2024-09-13T06:09:58.543 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.539+0000 7f2be7718640 1 -- 172.21.15.194:0/4012906230 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2bd80083f0 con 0x559384aedcf0 2024-09-13T06:09:58.543 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.539+0000 7f2be9407980 1 --2- 172.21.15.194:0/4012906230 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x559384bea670 0x559384beca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.543 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.539+0000 7f2be9407980 1 -- 172.21.15.194:0/4012906230 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559384bed160 con 0x559384bea670 2024-09-13T06:09:58.543 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.539+0000 7f2be6716640 1 --2- 172.21.15.194:0/4012906230 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x559384bea670 0x559384beca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.552 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.543+0000 7f2be6716640 1 --2- 172.21.15.194:0/4012906230 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x559384bea670 0x559384beca60 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.552 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.543+0000 7f2be6716640 1 -- 172.21.15.194:0/4012906230 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2bd000e6c0 con 0x559384bea670 2024-09-13T06:09:58.553 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.543+0000 7f2be9407980 1 Processor -- start 2024-09-13T06:09:58.553 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.543+0000 7f2be9407980 1 -- start start 2024-09-13T06:09:58.553 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.543+0000 7f2be9407980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559384bfac30 0x559384bfb050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.553 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.543+0000 7f2be9407980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5593849ef800 con 0x559384bfac30 2024-09-13T06:09:58.553 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.543+0000 7f2be6f17640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559384bfac30 0x559384bfb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.553 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.543+0000 7f2be6f17640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559384bfac30 0x559384bfb050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45552/0 (socket says 172.21.15.194:45552) 2024-09-13T06:09:58.553 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.543+0000 7f2be6f17640 1 -- 172.21.15.194:0/1124264126 learned_addr learned my addr 172.21.15.194:0/1124264126 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:58.553 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.543+0000 7f2be6f17640 1 -- 172.21.15.194:0/1124264126 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559384bfb590 con 0x559384bfac30 2024-09-13T06:09:58.553 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.543+0000 7f2be6f17640 1 --2- 172.21.15.194:0/1124264126 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559384bfac30 0x559384bfb050 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2be0003430 tx=0x7f2be00bf880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.553 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.543+0000 7f2ad0e01640 1 -- 172.21.15.194:0/1124264126 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2be00e3910 con 0x559384bfac30 2024-09-13T06:09:58.553 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.543+0000 7f2be9407980 1 -- 172.21.15.194:0/1124264126 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559384bfb820 con 0x559384bfac30 2024-09-13T06:09:58.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.543+0000 7f2ad0e01640 1 -- 172.21.15.194:0/1124264126 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2be00e3ad0 con 0x559384bfac30 2024-09-13T06:09:58.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.543+0000 7f2be9407980 1 -- 172.21.15.194:0/1124264126 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559384bfe4a0 con 0x559384bfac30 2024-09-13T06:09:58.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.543+0000 7f2ad0e01640 1 -- 172.21.15.194:0/1124264126 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2be00e3df0 con 0x559384bfac30 2024-09-13T06:09:58.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.543+0000 7f2ad0e01640 1 -- 172.21.15.194:0/1124264126 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f2be00ec020 con 0x559384bfac30 2024-09-13T06:09:58.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.547+0000 7f2ad0e01640 1 --2- 172.21.15.194:0/1124264126 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f2ac0034650 0x7f2ac0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.547+0000 7f2ad0e01640 1 -- 172.21.15.194:0/1124264126 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f2be00dd990 con 0x559384bfac30 2024-09-13T06:09:58.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.547+0000 7f2be6716640 1 --2- 172.21.15.194:0/1124264126 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f2ac0034650 0x7f2ac0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.547+0000 7f2be9407980 1 Processor -- start 2024-09-13T06:09:58.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.547+0000 7f2be9407980 1 -- start start 2024-09-13T06:09:58.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.547+0000 7f2be6716640 1 --2- 172.21.15.194:0/1124264126 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f2ac0034650 0x7f2ac0036b10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x559384be4d00 tx=0x7f2bd000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.547+0000 7f2be9407980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559384c07320 0x559384c07700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.547+0000 7f2be9407980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x559384bd64a0 con 0x559384c07320 2024-09-13T06:09:58.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.547+0000 7f2be6f17640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559384c07320 0x559384c07700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.547+0000 7f2be6f17640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559384c07320 0x559384c07700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45562/0 (socket says 172.21.15.194:45562) 2024-09-13T06:09:58.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.547+0000 7f2be6f17640 1 -- 172.21.15.194:0/3146262097 learned_addr learned my addr 172.21.15.194:0/3146262097 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:58.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.547+0000 7f2be6f17640 1 -- 172.21.15.194:0/3146262097 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559384c07cd0 con 0x559384c07320 2024-09-13T06:09:58.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.547+0000 7f2be6f17640 1 --2- 172.21.15.194:0/3146262097 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559384c07320 0x559384c07700 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f2be00bd010 tx=0x7f2be00d34a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=652aed5835de5374 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.547+0000 7f2aca7fc640 1 -- 172.21.15.194:0/3146262097 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2be00fd020 con 0x559384c07320 2024-09-13T06:09:58.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.547+0000 7f2aca7fc640 1 -- 172.21.15.194:0/3146262097 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2be00dcd10 con 0x559384c07320 2024-09-13T06:09:58.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.547+0000 7f2aca7fc640 1 -- 172.21.15.194:0/3146262097 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2be00b6550 con 0x559384c07320 2024-09-13T06:09:58.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.547+0000 7f2be9407980 1 -- 172.21.15.194:0/3146262097 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559384c07320 msgr2=0x559384c07700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.547+0000 7f2be9407980 1 --2- 172.21.15.194:0/3146262097 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559384c07320 0x559384c07700 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f2be00bd010 tx=0x7f2be00d34a0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.547+0000 7f2be9407980 1 -- 172.21.15.194:0/3146262097 shutdown_connections 2024-09-13T06:09:58.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.547+0000 7f2be9407980 1 --2- 172.21.15.194:0/3146262097 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559384c07320 0x559384c07700 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.547+0000 7f2be9407980 1 -- 172.21.15.194:0/3146262097 >> 172.21.15.194:0/3146262097 conn(0x559384c03700 msgr2=0x559384c01800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:58.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.547+0000 7f2be9407980 1 -- 172.21.15.194:0/3146262097 shutdown_connections 2024-09-13T06:09:58.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.547+0000 7f2be9407980 1 -- 172.21.15.194:0/3146262097 wait complete. 2024-09-13T06:09:58.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.547+0000 7f2be9407980 1 Processor -- start 2024-09-13T06:09:58.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.547+0000 7f2be9407980 1 -- start start 2024-09-13T06:09:58.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.547+0000 7f2be9407980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559384c07320 0x559384c0e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.547+0000 7f2be9407980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x559384c08170 con 0x559384c07320 2024-09-13T06:09:58.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.547+0000 7f2be6f17640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559384c07320 0x559384c0e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.547+0000 7f2be6f17640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559384c07320 0x559384c0e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45572/0 (socket says 172.21.15.194:45572) 2024-09-13T06:09:58.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.547+0000 7f2be6f17640 1 -- 172.21.15.194:0/1855292148 learned_addr learned my addr 172.21.15.194:0/1855292148 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:58.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.551+0000 7f2be6f17640 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559384c0ea80 con 0x559384c07320 2024-09-13T06:09:58.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.551+0000 7f2be6f17640 1 --2- 172.21.15.194:0/1855292148 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559384c07320 0x559384c0e540 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f2be00d3ba0 tx=0x7f2be00dd5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.551+0000 7f2ac8ff9640 1 -- 172.21.15.194:0/1855292148 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2be0111070 con 0x559384c07320 2024-09-13T06:09:58.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.551+0000 7f2be9407980 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559384c0ea80 con 0x559384c07320 2024-09-13T06:09:58.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.551+0000 7f2ac8ff9640 1 -- 172.21.15.194:0/1855292148 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2be00c98c0 con 0x559384c07320 2024-09-13T06:09:58.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.551+0000 7f2ac8ff9640 1 -- 172.21.15.194:0/1855292148 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2be00dc8b0 con 0x559384c07320 2024-09-13T06:09:58.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.551+0000 7f2be9407980 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559384c0ef50 con 0x559384c07320 2024-09-13T06:09:58.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.551+0000 7f2ac8ff9640 1 -- 172.21.15.194:0/1855292148 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f2be0114070 con 0x559384c07320 2024-09-13T06:09:58.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.551+0000 7f2ac8ff9640 1 --2- 172.21.15.194:0/1855292148 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f2ab0034650 0x7f2ab0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.551+0000 7f2ac8ff9640 1 -- 172.21.15.194:0/1855292148 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f2be0117ca0 con 0x559384c07320 2024-09-13T06:09:58.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.551+0000 7f2be6716640 1 --2- 172.21.15.194:0/1855292148 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f2ab0034650 0x7f2ab0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.551+0000 7f2be9407980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.551+0000 7f2be9407980 1 --2- 172.21.15.194:0/1855292148 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x559384c19590 0x559384c1ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.551+0000 7f2be9407980 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559384c1c1a0 con 0x559384c19590 2024-09-13T06:09:58.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.551+0000 7f2be7718640 1 --2- 172.21.15.194:0/1855292148 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x559384c19590 0x559384c1ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.551+0000 7f2be6716640 1 --2- 172.21.15.194:0/1855292148 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f2ab0034650 0x7f2ab0036b10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x559384bed560 tx=0x7f2bd0010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.551+0000 7f2be7718640 1 --2- 172.21.15.194:0/1855292148 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x559384c19590 0x559384c1ba50 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.551+0000 7f2be7718640 1 -- 172.21.15.194:0/1855292148 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2bd80083f0 con 0x559384c19590 2024-09-13T06:09:58.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.551+0000 7f2be9407980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:58.566 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.551+0000 7f2be9407980 20 realm 2024-09-13T06:09:58.566 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.551+0000 7f2be9407980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.566 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.551+0000 7f2be9407980 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559384c1c5b0 con 0x559384c19590 2024-09-13T06:09:58.566 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.551+0000 7f2be7718640 1 -- 172.21.15.194:0/1855292148 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2bd80083f0 con 0x559384c19590 2024-09-13T06:09:58.566 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.551+0000 7f2be9407980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:58.566 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.551+0000 7f2be9407980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:09:58.566 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.551+0000 7f2be9407980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.566 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.551+0000 7f2be9407980 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559384c1ce80 con 0x559384c19590 2024-09-13T06:09:58.566 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.555+0000 7f2be7718640 1 -- 172.21.15.194:0/1855292148 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2bd80083f0 con 0x559384c19590 2024-09-13T06:09:58.566 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.555+0000 7f2be9407980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:58.566 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.555+0000 7f2be9407980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.566 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.555+0000 7f2be9407980 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559384c1d220 con 0x559384c19590 2024-09-13T06:09:58.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.555+0000 7f2be7718640 1 -- 172.21.15.194:0/1855292148 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2bd80083f0 con 0x559384c19590 2024-09-13T06:09:58.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.555+0000 7f2be9407980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:58.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.555+0000 7f2be9407980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.555+0000 7f2be9407980 1 --2- 172.21.15.194:0/1855292148 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x559384c1df80 0x559384c20370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.555+0000 7f2be9407980 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559384c20980 con 0x559384c1df80 2024-09-13T06:09:58.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.555+0000 7f2be6f17640 1 --2- 172.21.15.194:0/1855292148 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x559384c1df80 0x559384c20370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.555+0000 7f2be6f17640 1 --2- 172.21.15.194:0/1855292148 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x559384c1df80 0x559384c20370 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.555+0000 7f2be6f17640 1 -- 172.21.15.194:0/1855292148 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2be0113030 con 0x559384c1df80 2024-09-13T06:09:58.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.555+0000 7f2be9407980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:09:58.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.555+0000 7f2be9407980 20 searching for the correct realm 2024-09-13T06:09:58.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.555+0000 7f2be9407980 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559384c22250 con 0x559384c1df80 2024-09-13T06:09:58.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.555+0000 7f2be6f17640 1 -- 172.21.15.194:0/1855292148 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2be0113030 con 0x559384c1df80 2024-09-13T06:09:58.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.555+0000 7f2be6f17640 1 --2- 172.21.15.194:0/1855292148 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f2be0116060 0x7f2be00e0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.555+0000 7f2be6f17640 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559384c22250 con 0x7f2be0116060 2024-09-13T06:09:58.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.555+0000 7f2be6716640 1 --2- 172.21.15.194:0/1855292148 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f2be0116060 0x7f2be00e0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.555+0000 7f2be6716640 1 --2- 172.21.15.194:0/1855292148 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f2be0116060 0x7f2be00e0920 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.555+0000 7f2be6716640 1 -- 172.21.15.194:0/1855292148 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2bd000e6c0 con 0x7f2be0116060 2024-09-13T06:09:58.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.555+0000 7f2be6716640 1 --2- 172.21.15.194:0/1855292148 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f2bd0037040 0x7f2bd0036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.555+0000 7f2be6716640 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559384c22250 con 0x7f2bd0037040 2024-09-13T06:09:58.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.555+0000 7f2be7718640 1 --2- 172.21.15.194:0/1855292148 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f2bd0037040 0x7f2bd0036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.555+0000 7f2be7718640 1 --2- 172.21.15.194:0/1855292148 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f2bd0037040 0x7f2bd0036410 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.559+0000 7f2be7718640 1 -- 172.21.15.194:0/1855292148 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2bd80083f0 con 0x7f2bd0037040 2024-09-13T06:09:58.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.559+0000 7f2be7718640 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559384c1d220 con 0x559384c19590 2024-09-13T06:09:58.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.559+0000 7f2be7718640 1 -- 172.21.15.194:0/1855292148 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2bd80083f0 con 0x559384c19590 2024-09-13T06:09:58.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.559+0000 7f2be7718640 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559384c1d220 con 0x559384c19590 2024-09-13T06:09:58.569 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.559+0000 7f2be7718640 1 -- 172.21.15.194:0/1855292148 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2bd80083f0 con 0x559384c19590 2024-09-13T06:09:58.569 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.559+0000 7f2be7718640 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559384c1d220 con 0x7f2bd0037040 2024-09-13T06:09:58.569 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.559+0000 7f2be7718640 1 -- 172.21.15.194:0/1855292148 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2bd80083f0 con 0x7f2bd0037040 2024-09-13T06:09:58.569 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.559+0000 7f2be7718640 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559384c1d220 con 0x7f2bd0037040 2024-09-13T06:09:58.569 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.559+0000 7f2be7718640 1 -- 172.21.15.194:0/1855292148 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2bd80083f0 con 0x7f2bd0037040 2024-09-13T06:09:58.569 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.559+0000 7f2be7718640 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559384c1d220 con 0x7f2be0116060 2024-09-13T06:09:58.569 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.559+0000 7f2be6716640 1 -- 172.21.15.194:0/1855292148 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2bd000e6c0 con 0x7f2be0116060 2024-09-13T06:09:58.569 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.559+0000 7f2be6716640 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559384c1d220 con 0x559384c1df80 2024-09-13T06:09:58.569 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.559+0000 7f2be6f17640 1 -- 172.21.15.194:0/1855292148 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2be0113030 con 0x559384c1df80 2024-09-13T06:09:58.569 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.559+0000 7f2be6f17640 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559384c1d220 con 0x559384c19590 2024-09-13T06:09:58.569 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.559+0000 7f2be7718640 1 -- 172.21.15.194:0/1855292148 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2bd80083f0 con 0x559384c19590 2024-09-13T06:09:58.569 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.559+0000 7f2be7718640 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559384c1d220 con 0x7f2bd0037040 2024-09-13T06:09:58.570 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.559+0000 7f2be7718640 1 -- 172.21.15.194:0/1855292148 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2bd80083f0 con 0x7f2bd0037040 2024-09-13T06:09:58.570 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.563+0000 7f2be7718640 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559384c1d220 con 0x559384c19590 2024-09-13T06:09:58.570 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.563+0000 7f2be7718640 1 -- 172.21.15.194:0/1855292148 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2bd80083f0 con 0x559384c19590 2024-09-13T06:09:58.570 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.563+0000 7f2be7718640 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559384c1d220 con 0x7f2be0116060 2024-09-13T06:09:58.570 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.563+0000 7f2be6716640 1 -- 172.21.15.194:0/1855292148 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2bd000e6c0 con 0x7f2be0116060 2024-09-13T06:09:58.570 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.563+0000 7f2be6716640 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559384c1d220 con 0x559384c1df80 2024-09-13T06:09:58.570 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.563+0000 7f2be6f17640 1 -- 172.21.15.194:0/1855292148 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2be0113030 con 0x559384c1df80 2024-09-13T06:09:58.570 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.563+0000 7f2be6f17640 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559384c1d220 con 0x559384c1df80 2024-09-13T06:09:58.570 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.563+0000 7f2be6f17640 1 -- 172.21.15.194:0/1855292148 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2be0113030 con 0x559384c1df80 2024-09-13T06:09:58.570 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.563+0000 7f2be6f17640 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559384c1d220 con 0x7f2bd0037040 2024-09-13T06:09:58.570 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.563+0000 7f2be7718640 1 -- 172.21.15.194:0/1855292148 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2bd80083f0 con 0x7f2bd0037040 2024-09-13T06:09:58.570 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.563+0000 7f2be7718640 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559384c1d220 con 0x559384c1df80 2024-09-13T06:09:58.571 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.563+0000 7f2be6f17640 1 -- 172.21.15.194:0/1855292148 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2be0113030 con 0x559384c1df80 2024-09-13T06:09:58.571 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.563+0000 7f2be6f17640 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559384c1d220 con 0x559384c1df80 2024-09-13T06:09:58.571 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.563+0000 7f2be6f17640 1 -- 172.21.15.194:0/1855292148 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2be0113030 con 0x559384c1df80 2024-09-13T06:09:58.571 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.563+0000 7f2be6f17640 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559384c1d220 con 0x559384c19590 2024-09-13T06:09:58.571 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.563+0000 7f2be7718640 1 -- 172.21.15.194:0/1855292148 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2bd80083f0 con 0x559384c19590 2024-09-13T06:09:58.571 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.563+0000 7f2be7718640 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559384c1d220 con 0x559384c19590 2024-09-13T06:09:58.571 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.563+0000 7f2be7718640 1 -- 172.21.15.194:0/1855292148 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2bd80083f0 con 0x559384c19590 2024-09-13T06:09:58.571 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.563+0000 7f2be7718640 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559384c1d220 con 0x7f2bd0037040 2024-09-13T06:09:58.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.563+0000 7f2be7718640 1 -- 172.21.15.194:0/1855292148 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2bd80083f0 con 0x7f2bd0037040 2024-09-13T06:09:58.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.563+0000 7f2be7718640 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559384c1d220 con 0x559384c1df80 2024-09-13T06:09:58.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.563+0000 7f2be6f17640 1 -- 172.21.15.194:0/1855292148 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2be0113030 con 0x559384c1df80 2024-09-13T06:09:58.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.563+0000 7f2be6f17640 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559384c1d220 con 0x7f2be0116060 2024-09-13T06:09:58.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.567+0000 7f2be6716640 1 -- 172.21.15.194:0/1855292148 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2bd000e6c0 con 0x7f2be0116060 2024-09-13T06:09:58.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.567+0000 7f2be6716640 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559384c1d220 con 0x559384c19590 2024-09-13T06:09:58.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.567+0000 7f2be7718640 1 -- 172.21.15.194:0/1855292148 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2bd80083f0 con 0x559384c19590 2024-09-13T06:09:58.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.567+0000 7f2be7718640 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559384c1d220 con 0x7f2bd0037040 2024-09-13T06:09:58.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.567+0000 7f2be7718640 1 -- 172.21.15.194:0/1855292148 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2bd80083f0 con 0x7f2bd0037040 2024-09-13T06:09:58.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.567+0000 7f2be7718640 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559384c1d220 con 0x559384c1df80 2024-09-13T06:09:58.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.567+0000 7f2be6f17640 1 -- 172.21.15.194:0/1855292148 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2be0113030 con 0x559384c1df80 2024-09-13T06:09:58.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.567+0000 7f2be6f17640 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559384c1d220 con 0x7f2bd0037040 2024-09-13T06:09:58.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.567+0000 7f2be7718640 1 -- 172.21.15.194:0/1855292148 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2bd80083f0 con 0x7f2bd0037040 2024-09-13T06:09:58.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.567+0000 7f2be7718640 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559384c1d220 con 0x7f2be0116060 2024-09-13T06:09:58.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.567+0000 7f2be6716640 1 -- 172.21.15.194:0/1855292148 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2bd000e6c0 con 0x7f2be0116060 2024-09-13T06:09:58.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.567+0000 7f2be6716640 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559384c1d220 con 0x559384c1df80 2024-09-13T06:09:58.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.567+0000 7f2be6f17640 1 -- 172.21.15.194:0/1855292148 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2be0113030 con 0x559384c1df80 2024-09-13T06:09:58.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.567+0000 7f2be6f17640 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559384c1d220 con 0x7f2bd0037040 2024-09-13T06:09:58.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.567+0000 7f2be7718640 1 -- 172.21.15.194:0/1855292148 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2bd80083f0 con 0x7f2bd0037040 2024-09-13T06:09:58.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.567+0000 7f2be7718640 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559384c1d220 con 0x559384c19590 2024-09-13T06:09:58.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.567+0000 7f2be7718640 1 -- 172.21.15.194:0/1855292148 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2bd80083f0 con 0x559384c19590 2024-09-13T06:09:58.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.567+0000 7f2be7718640 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559384c1d220 con 0x7f2be0116060 2024-09-13T06:09:58.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.571+0000 7f2be6716640 1 -- 172.21.15.194:0/1855292148 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2bd000e6c0 con 0x7f2be0116060 2024-09-13T06:09:58.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.571+0000 7f2be9407980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:09:58.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.571+0000 7f2be9407980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:09:58.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.571+0000 7f2be9407980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:09:58.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.571+0000 7f2be9407980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:09:58.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.571+0000 7f2be9407980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:09:58.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.571+0000 7f2be9407980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:09:58.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.571+0000 7f2be9407980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.571+0000 7f2be9407980 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559384c21370 con 0x559384c19590 2024-09-13T06:09:58.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.571+0000 7f2be7718640 1 -- 172.21.15.194:0/1855292148 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2bd80083f0 con 0x559384c19590 2024-09-13T06:09:58.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.571+0000 7f2be9407980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:58.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.571+0000 7f2be9407980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.571+0000 7f2be9407980 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559384c20fb0 con 0x559384c19590 2024-09-13T06:09:58.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.571+0000 7f2be7718640 1 -- 172.21.15.194:0/1855292148 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2bd80083f0 con 0x559384c19590 2024-09-13T06:09:58.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.571+0000 7f2be9407980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:58.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.571+0000 7f2be9407980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.571+0000 7f2be9407980 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559384c21c90 con 0x7f2be0116060 2024-09-13T06:09:58.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.571+0000 7f2be6716640 1 -- 172.21.15.194:0/1855292148 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2bd000e6c0 con 0x7f2be0116060 2024-09-13T06:09:58.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.571+0000 7f2be9407980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:09:58.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.571+0000 7f2be9407980 20 zone default found 2024-09-13T06:09:58.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.571+0000 7f2be9407980 4 Realm: () 2024-09-13T06:09:58.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.571+0000 7f2be9407980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:09:58.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.571+0000 7f2be9407980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:09:58.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.571+0000 7f2be9407980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:09:58.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.571+0000 7f2be9407980 20 zonegroup default 2024-09-13T06:09:58.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.571+0000 7f2be9407980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.571+0000 7f2be9407980 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559384c22680 con 0x7f2bd0037040 2024-09-13T06:09:58.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.571+0000 7f2be7718640 1 -- 172.21.15.194:0/1855292148 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2bd80083f0 con 0x7f2bd0037040 2024-09-13T06:09:58.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.571+0000 7f2be9407980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:58.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.571+0000 7f2be9407980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.571+0000 7f2be9407980 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559384c24060 con 0x559384c1df80 2024-09-13T06:09:58.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.571+0000 7f2be6f17640 1 -- 172.21.15.194:0/1855292148 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2be0113030 con 0x559384c1df80 2024-09-13T06:09:58.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.571+0000 7f2be9407980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:58.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.571+0000 7f2be9407980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.571+0000 7f2be9407980 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559384c245d0 con 0x559384c1df80 2024-09-13T06:09:58.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.571+0000 7f2be6f17640 1 -- 172.21.15.194:0/1855292148 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2be0113030 con 0x559384c1df80 2024-09-13T06:09:58.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.571+0000 7f2be9407980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:58.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.571+0000 7f2be9407980 20 started sync module instance, tier type = 2024-09-13T06:09:58.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.571+0000 7f2be9407980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:09:58.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.571+0000 7f2be9407980 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559384c23500 con 0x7f2be0116060 2024-09-13T06:09:58.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.571+0000 7f2be6716640 1 -- 172.21.15.194:0/1855292148 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(44 notify.0 [create] v33'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2bd000e6c0 con 0x7f2be0116060 2024-09-13T06:09:58.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.571+0000 7f2be9407980 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94092075874544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559384c24ee0 con 0x7f2be0116060 2024-09-13T06:09:58.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.571+0000 7f2be9407980 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559384c25730 con 0x559384c19590 2024-09-13T06:09:58.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.575+0000 7f2be6716640 1 -- 172.21.15.194:0/1855292148 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94092075874544] v33'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2bd000e6c0 con 0x7f2be0116060 2024-09-13T06:09:58.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.575+0000 7f2be7718640 1 -- 172.21.15.194:0/1855292148 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v33'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2bd80083f0 con 0x559384c19590 2024-09-13T06:09:58.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.575+0000 7f2be9407980 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94092075878960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559384c25730 con 0x559384c19590 2024-09-13T06:09:58.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.575+0000 7f2be9407980 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559384c26150 con 0x559384c1df80 2024-09-13T06:09:58.584 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.579+0000 7f2be7718640 1 -- 172.21.15.194:0/1855292148 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94092075878960] v33'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2bd80083f0 con 0x559384c19590 2024-09-13T06:09:58.584 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.579+0000 7f2be6f17640 1 -- 172.21.15.194:0/1855292148 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v33'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2be0113030 con 0x559384c1df80 2024-09-13T06:09:58.584 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.579+0000 7f2be9407980 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94092075883584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559384c25730 con 0x559384c1df80 2024-09-13T06:09:58.585 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.579+0000 7f2be9407980 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559384c26b60 con 0x7f2be0116060 2024-09-13T06:09:58.585 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.579+0000 7f2be6716640 1 -- 172.21.15.194:0/1855292148 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(50 notify.3 [create] v33'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2bd000e6c0 con 0x7f2be0116060 2024-09-13T06:09:58.585 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.579+0000 7f2be9407980 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94092075886256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559384c273b0 con 0x7f2be0116060 2024-09-13T06:09:58.585 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.579+0000 7f2be9407980 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559384c27df0 con 0x559384c19590 2024-09-13T06:09:58.585 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.579+0000 7f2be6f17640 1 -- 172.21.15.194:0/1855292148 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94092075883584] v33'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2be0113030 con 0x559384c1df80 2024-09-13T06:09:58.585 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.579+0000 7f2be6716640 1 -- 172.21.15.194:0/1855292148 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94092075886256] v33'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2bd000e6c0 con 0x7f2be0116060 2024-09-13T06:09:58.585 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.579+0000 7f2be7718640 1 -- 172.21.15.194:0/1855292148 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v33'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2bd80083f0 con 0x559384c19590 2024-09-13T06:09:58.585 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.579+0000 7f2be9407980 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94092075890880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559384c26f00 con 0x559384c19590 2024-09-13T06:09:58.585 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.579+0000 7f2be9407980 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559384c28690 con 0x7f2bd0037040 2024-09-13T06:09:58.585 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.583+0000 7f2be7718640 1 -- 172.21.15.194:0/1855292148 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94092075890880] v33'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2bd80083f0 con 0x559384c19590 2024-09-13T06:09:58.585 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.583+0000 7f2be7718640 1 -- 172.21.15.194:0/1855292148 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(54 notify.5 [create] v33'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2bd80083f0 con 0x7f2bd0037040 2024-09-13T06:09:58.585 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.583+0000 7f2be9407980 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94092075881088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559384c26f00 con 0x7f2bd0037040 2024-09-13T06:09:58.586 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.583+0000 7f2be9407980 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559384c28b80 con 0x7f2bd0037040 2024-09-13T06:09:58.586 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.583+0000 7f2be7718640 1 -- 172.21.15.194:0/1855292148 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94092075881088] v33'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2bd80083f0 con 0x7f2bd0037040 2024-09-13T06:09:58.586 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.587+0000 7f2be7718640 1 -- 172.21.15.194:0/1855292148 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(56 notify.6 [create] v33'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2bd80083f0 con 0x7f2bd0037040 2024-09-13T06:09:58.586 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.587+0000 7f2be9407980 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94092075894352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559384c28b40 con 0x7f2bd0037040 2024-09-13T06:09:58.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.587+0000 7f2be9407980 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559384c29540 con 0x7f2bd0037040 2024-09-13T06:09:58.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.587+0000 7f2be7718640 1 -- 172.21.15.194:0/1855292148 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94092075894352] v33'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2bd80083f0 con 0x7f2bd0037040 2024-09-13T06:09:58.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.587+0000 7f2be7718640 1 -- 172.21.15.194:0/1855292148 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(58 notify.7 [create] v33'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2bd80083f0 con 0x7f2bd0037040 2024-09-13T06:09:58.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.587+0000 7f2be9407980 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94092075892704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559384c29500 con 0x7f2bd0037040 2024-09-13T06:09:58.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.587+0000 7f2be9407980 20 add_watcher() i=0 2024-09-13T06:09:58.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.587+0000 7f2be9407980 20 add_watcher() i=1 2024-09-13T06:09:58.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.587+0000 7f2be9407980 20 add_watcher() i=2 2024-09-13T06:09:58.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.587+0000 7f2be9407980 20 add_watcher() i=3 2024-09-13T06:09:58.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.587+0000 7f2be9407980 20 add_watcher() i=4 2024-09-13T06:09:58.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.587+0000 7f2be9407980 20 add_watcher() i=5 2024-09-13T06:09:58.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.587+0000 7f2be9407980 20 add_watcher() i=6 2024-09-13T06:09:58.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.591+0000 7f2be7718640 1 -- 172.21.15.194:0/1855292148 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94092075892704] v33'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2bd80083f0 con 0x7f2bd0037040 2024-09-13T06:09:58.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.591+0000 7f2be9407980 20 add_watcher() i=7 2024-09-13T06:09:58.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.591+0000 7f2be9407980 2 all 8 watchers are set, enabling cache 2024-09-13T06:09:58.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.591+0000 7f2be9407980 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559384c2c930 con 0x559384c19590 2024-09-13T06:09:58.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.591+0000 7f2be7718640 1 -- 172.21.15.194:0/1855292148 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2bd80083f0 con 0x559384c19590 2024-09-13T06:09:58.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.591+0000 7f2be9407980 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94092075897376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559384c29e50 con 0x559384c19590 2024-09-13T06:09:58.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.591+0000 7f2be7718640 1 -- 172.21.15.194:0/1855292148 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94092075897376] v33'104 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2bd80083f0 con 0x559384c19590 2024-09-13T06:09:58.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.591+0000 7f2a9d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:58.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.591+0000 7f2be9407980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:09:58.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.591+0000 7f2be9407980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:09:58.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.591+0000 7f2be9407980 5 note: GC not initialized 2024-09-13T06:09:58.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.591+0000 7f2a17fff640 20 reqs_thread_entry: start 2024-09-13T06:09:58.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.591+0000 7f2be9407980 20 init_complete bucket index max shards: 11 2024-09-13T06:09:58.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.591+0000 7f2be9407980 20 Filter name: none 2024-09-13T06:09:58.594 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.591+0000 7f2a15ffb640 20 reqs_thread_entry: start 2024-09-13T06:09:58.594 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.591+0000 7f2be9407980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T06:09:58.594 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.591+0000 7f2be9407980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.594 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.591+0000 7f2be9407980 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559384c4ffe0 con 0x559384c19590 2024-09-13T06:09:58.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.591+0000 7f2be7718640 1 -- 172.21.15.194:0/1855292148 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f2bd80083f0 con 0x559384c19590 2024-09-13T06:09:58.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.591+0000 7f2be9407980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T06:09:58.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.591+0000 7f2be9407980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T06:09:58.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.591+0000 7f2be9407980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:09:58.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.591+0000 7f2be9407980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:09:58.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.591+0000 7f2be9407980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T06:09:58.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.591+0000 7f2be9407980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.591+0000 7f2be9407980 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559384c4fb30 con 0x7f2be0116060 2024-09-13T06:09:58.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.591+0000 7f2be6716640 1 -- 172.21.15.194:0/1855292148 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f2bd000e6c0 con 0x7f2be0116060 2024-09-13T06:09:58.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.591+0000 7f2be9407980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T06:09:58.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.591+0000 7f2be9407980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T06:09:58.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.591+0000 7f2be9407980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T06:09:58.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.591+0000 7f2be9407980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 : miss 2024-09-13T06:09:58.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.591+0000 7f2be9407980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.591+0000 7f2be9407980 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:64 8.18 8:1a66c368:root::.bucket.meta.myfoo%3a52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559384c53cc0 con 0x559384c19590 2024-09-13T06:09:58.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.595+0000 7f2be7718640 1 -- 172.21.15.194:0/1855292148 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(64 .bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv12 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f2bd80083f0 con 0x559384c19590 2024-09-13T06:09:58.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.595+0000 7f2be9407980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T06:09:58.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.595+0000 7f2be9407980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 info.flags=0x17 2024-09-13T06:09:58.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.595+0000 7f2be9407980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 to cache LRU end 2024-09-13T06:09:58.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.595+0000 7f2be9407980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:09:58.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.595+0000 7f2be9407980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T06:09:58.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.595+0000 7f2be9407980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 2024-09-13T06:09:58.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.595+0000 7f2be9407980 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-13T06:09:58.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.595+0000 7f2be9407980 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559384c55160 con 0x7f2be0116060 2024-09-13T06:09:58.598 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.595+0000 7f2be6716640 1 -- 172.21.15.194:0/1855292148 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(65 foo.buckets [call] v33'17 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f2bd000e6c0 con 0x7f2be0116060 2024-09-13T06:09:58.598 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.595+0000 7f2be9407980 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-09-13T06:09:58.598 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.595+0000 7f2be9407980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.595+0000 7f2be9407980 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559384c54cb0 con 0x7f2be0116060 2024-09-13T06:09:58.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.595+0000 7f2be6716640 1 -- 172.21.15.194:0/1855292148 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7f2bd000e6c0 con 0x7f2be0116060 2024-09-13T06:09:58.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.595+0000 7f2be9407980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T06:09:58.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.595+0000 7f2be9407980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-09-13T06:09:58.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.595+0000 7f2be9407980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T06:09:58.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.595+0000 7f2be9407980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:09:58.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.595+0000 7f2be9407980 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559384c5b190 con 0x7f2be0116060 2024-09-13T06:09:58.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.599+0000 7f2be6716640 1 -- 172.21.15.194:0/1855292148 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v33'18 uv18 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7f2bd000e6c0 con 0x7f2be0116060 2024-09-13T06:09:58.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.599+0000 7f2be9407980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-13T06:09:58.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.599+0000 7f2be9407980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T06:09:58.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.599+0000 7f2be9407980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-13T06:09:58.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.599+0000 7f2be9407980 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94092076084384 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559384c58600 con 0x7f2bd0037040 2024-09-13T06:09:58.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.599+0000 7f2be7718640 1 -- 172.21.15.194:0/1855292148 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== watch-notify(notify (1) cookie 94092075894352 notify 141733920770 ret 0) ==== 380+0+0 (crc 0 0 0) 0x559384c540b0 con 0x7f2bd0037040 2024-09-13T06:09:58.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.599+0000 7f2aca7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920770 cookie 94092075894352 notifier 4479 bl.length()=338 2024-09-13T06:09:58.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.599+0000 7f2aca7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-13T06:09:58.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.599+0000 7f2aca7fc640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T06:09:58.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.599+0000 7f2aca7fc640 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f2aac003eb0 con 0x7f2bd0037040 2024-09-13T06:09:58.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.599+0000 7f2be7718640 1 -- 172.21.15.194:0/1855292148 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(68 notify.6 [notify cookie 94092076084384 out=8b] v0'0 uv105 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2bd80083f0 con 0x7f2bd0037040 2024-09-13T06:09:58.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.599+0000 7f2be7718640 1 -- 172.21.15.194:0/1855292148 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2bd80083f0 con 0x7f2bd0037040 2024-09-13T06:09:58.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.599+0000 7f2be7718640 1 -- 172.21.15.194:0/1855292148 <== osd.0 v2:172.21.15.120:6800/1923744619 20 ==== watch-notify(notify_complete (2) cookie 94092076084384 notify 141733920770 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559384c532f0 con 0x7f2bd0037040 2024-09-13T06:09:58.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.603+0000 7f2a9d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:58.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.603+0000 7f2be9407980 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94092075897376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559384c4de10 con 0x559384c19590 2024-09-13T06:09:58.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.603+0000 7f2be7718640 1 -- 172.21.15.194:0/1855292148 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94092075897376] v33'105 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2bd80083f0 con 0x559384c19590 2024-09-13T06:09:58.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.603+0000 7f2be9407980 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94092075874544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559384c4de10 con 0x7f2be0116060 2024-09-13T06:09:58.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.603+0000 7f2be6716640 1 -- 172.21.15.194:0/1855292148 <== osd.2 v2:172.21.15.194:6800/815615585 16 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94092075874544] v33'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2bd000e6c0 con 0x7f2be0116060 2024-09-13T06:09:58.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.603+0000 7f2be9407980 20 remove_watcher() i=0 2024-09-13T06:09:58.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.603+0000 7f2be9407980 2 removed watcher, disabling cache 2024-09-13T06:09:58.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.603+0000 7f2be9407980 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94092075878960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559384c4de10 con 0x559384c19590 2024-09-13T06:09:58.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.607+0000 7f2be7718640 1 -- 172.21.15.194:0/1855292148 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94092075878960] v33'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2bd80083f0 con 0x559384c19590 2024-09-13T06:09:58.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.607+0000 7f2be9407980 20 remove_watcher() i=1 2024-09-13T06:09:58.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.607+0000 7f2be9407980 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94092075883584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559384c24a30 con 0x559384c1df80 2024-09-13T06:09:58.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.607+0000 7f2be6f17640 1 -- 172.21.15.194:0/1855292148 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94092075883584] v33'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2be0113030 con 0x559384c1df80 2024-09-13T06:09:58.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.607+0000 7f2be9407980 20 remove_watcher() i=2 2024-09-13T06:09:58.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.607+0000 7f2be9407980 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94092075886256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559384c4de10 con 0x7f2be0116060 2024-09-13T06:09:58.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.611+0000 7f2be6716640 1 -- 172.21.15.194:0/1855292148 <== osd.2 v2:172.21.15.194:6800/815615585 17 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94092075886256] v33'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2bd000e6c0 con 0x7f2be0116060 2024-09-13T06:09:58.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.611+0000 7f2be9407980 20 remove_watcher() i=3 2024-09-13T06:09:58.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.611+0000 7f2be9407980 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94092075890880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559384c25c40 con 0x559384c19590 2024-09-13T06:09:58.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.611+0000 7f2be7718640 1 -- 172.21.15.194:0/1855292148 <== osd.1 v2:172.21.15.194:6808/3135444559 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94092075890880] v33'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2bd80083f0 con 0x559384c19590 2024-09-13T06:09:58.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.611+0000 7f2be9407980 20 remove_watcher() i=4 2024-09-13T06:09:58.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.611+0000 7f2be9407980 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94092075881088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559384c24a30 con 0x7f2bd0037040 2024-09-13T06:09:58.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.615+0000 7f2be7718640 1 -- 172.21.15.194:0/1855292148 <== osd.0 v2:172.21.15.120:6800/1923744619 21 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94092075881088] v33'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2bd80083f0 con 0x7f2bd0037040 2024-09-13T06:09:58.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.615+0000 7f2be9407980 20 remove_watcher() i=5 2024-09-13T06:09:58.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.615+0000 7f2be9407980 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94092075894352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559384c4de10 con 0x7f2bd0037040 2024-09-13T06:09:58.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.615+0000 7f2be7718640 1 -- 172.21.15.194:0/1855292148 <== osd.0 v2:172.21.15.120:6800/1923744619 22 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94092075894352] v33'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2bd80083f0 con 0x7f2bd0037040 2024-09-13T06:09:58.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.615+0000 7f2be9407980 20 remove_watcher() i=6 2024-09-13T06:09:58.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.615+0000 7f2be9407980 1 -- 172.21.15.194:0/1855292148 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94092075892704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559384c25c40 con 0x7f2bd0037040 2024-09-13T06:09:58.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.619+0000 7f2be7718640 1 -- 172.21.15.194:0/1855292148 <== osd.0 v2:172.21.15.120:6800/1923744619 23 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94092075892704] v33'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2bd80083f0 con 0x7f2bd0037040 2024-09-13T06:09:58.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.619+0000 7f2be9407980 20 remove_watcher() i=7 2024-09-13T06:09:58.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.619+0000 7f2be9407980 1 -- 172.21.15.194:0/1855292148 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f2bd0037040 msgr2=0x7f2bd0036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.619+0000 7f2be9407980 1 --2- 172.21.15.194:0/1855292148 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f2bd0037040 0x7f2bd0036410 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.619+0000 7f2be9407980 1 -- 172.21.15.194:0/1855292148 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x559384c19590 msgr2=0x559384c1ba50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.619+0000 7f2be9407980 1 --2- 172.21.15.194:0/1855292148 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x559384c19590 0x559384c1ba50 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.619+0000 7f2be9407980 1 -- 172.21.15.194:0/1855292148 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f2be0116060 msgr2=0x7f2be00e0920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.619+0000 7f2be9407980 1 --2- 172.21.15.194:0/1855292148 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f2be0116060 0x7f2be00e0920 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.619+0000 7f2be9407980 1 -- 172.21.15.194:0/1855292148 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x559384c1df80 msgr2=0x559384c20370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.619+0000 7f2be9407980 1 --2- 172.21.15.194:0/1855292148 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x559384c1df80 0x559384c20370 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.619+0000 7f2be9407980 1 -- 172.21.15.194:0/1855292148 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f2ab0034650 msgr2=0x7f2ab0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.619+0000 7f2be9407980 1 --2- 172.21.15.194:0/1855292148 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f2ab0034650 0x7f2ab0036b10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x559384bed560 tx=0x7f2bd0010000 comp rx=0 tx=0).stop 2024-09-13T06:09:58.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.619+0000 7f2be9407980 1 -- 172.21.15.194:0/1855292148 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559384c07320 msgr2=0x559384c0e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.619+0000 7f2be7718640 1 -- 172.21.15.194:0/1855292148 reap_dead start 2024-09-13T06:09:58.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.619+0000 7f2be9407980 1 --2- 172.21.15.194:0/1855292148 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559384c07320 0x559384c0e540 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f2be00d3ba0 tx=0x7f2be00dd5e0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.619+0000 7f2be9407980 1 -- 172.21.15.194:0/1855292148 shutdown_connections 2024-09-13T06:09:58.624 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.619+0000 7f2be9407980 1 --2- 172.21.15.194:0/1855292148 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559384c07320 0x559384c0e540 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.624 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.619+0000 7f2be9407980 1 -- 172.21.15.194:0/1855292148 >> 172.21.15.194:0/1855292148 conn(0x559384c03700 msgr2=0x559384c017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:58.624 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.619+0000 7f2be9407980 1 -- 172.21.15.194:0/1855292148 shutdown_connections 2024-09-13T06:09:58.624 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.619+0000 7f2be9407980 1 -- 172.21.15.194:0/1855292148 wait complete. 2024-09-13T06:09:58.624 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.619+0000 7f2be9407980 1 -- 172.21.15.194:0/1124264126 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f2ac0034650 msgr2=0x7f2ac0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.624 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.619+0000 7f2be9407980 1 --2- 172.21.15.194:0/1124264126 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f2ac0034650 0x7f2ac0036b10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x559384be4d00 tx=0x7f2bd000f000 comp rx=0 tx=0).stop 2024-09-13T06:09:58.624 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.619+0000 7f2be9407980 1 -- 172.21.15.194:0/1124264126 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559384bfac30 msgr2=0x559384bfb050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.624 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.619+0000 7f2be9407980 1 --2- 172.21.15.194:0/1124264126 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559384bfac30 0x559384bfb050 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2be0003430 tx=0x7f2be00bf880 comp rx=0 tx=0).stop 2024-09-13T06:09:58.624 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.619+0000 7f2be9407980 1 -- 172.21.15.194:0/1124264126 shutdown_connections 2024-09-13T06:09:58.624 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.619+0000 7f2be9407980 1 --2- 172.21.15.194:0/1124264126 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f2ac0034650 0x7f2ac0036b10 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.624 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.619+0000 7f2be9407980 1 --2- 172.21.15.194:0/1124264126 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559384bfac30 0x559384bfb050 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.624 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.619+0000 7f2be9407980 1 -- 172.21.15.194:0/1124264126 >> 172.21.15.194:0/1124264126 conn(0x559384befd80 msgr2=0x559384bf2800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:58.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.619+0000 7f2be9407980 1 -- 172.21.15.194:0/1124264126 shutdown_connections 2024-09-13T06:09:58.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.619+0000 7f2be9407980 1 -- 172.21.15.194:0/1124264126 wait complete. 2024-09-13T06:09:58.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.619+0000 7f2be9407980 1 -- 172.21.15.194:0/4012906230 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x559384aedcf0 msgr2=0x559384be3f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.619+0000 7f2be9407980 1 --2- 172.21.15.194:0/4012906230 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x559384aedcf0 0x559384be3f00 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.619+0000 7f2be9407980 1 -- 172.21.15.194:0/4012906230 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x559384bea670 msgr2=0x559384beca60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.619+0000 7f2be9407980 1 --2- 172.21.15.194:0/4012906230 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x559384bea670 0x559384beca60 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.619+0000 7f2be9407980 1 -- 172.21.15.194:0/4012906230 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x559384be6750 msgr2=0x559384be8b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.619+0000 7f2be9407980 1 --2- 172.21.15.194:0/4012906230 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x559384be6750 0x559384be8b40 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.619+0000 7f2be9407980 1 -- 172.21.15.194:0/4012906230 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f2acc0346a0 msgr2=0x7f2acc036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.619+0000 7f2be9407980 1 --2- 172.21.15.194:0/4012906230 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f2acc0346a0 0x7f2acc036b60 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2bd0001da0 tx=0x7f2bd0001300 comp rx=0 tx=0).stop 2024-09-13T06:09:58.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.619+0000 7f2be9407980 1 -- 172.21.15.194:0/4012906230 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559384a5d2a0 msgr2=0x559384bdce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.619+0000 7f2be9407980 1 --2- 172.21.15.194:0/4012906230 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559384a5d2a0 0x559384bdce00 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f2be00aa500 tx=0x7f2be0017d70 comp rx=0 tx=0).stop 2024-09-13T06:09:58.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.619+0000 7f2be7718640 1 -- 172.21.15.194:0/4012906230 reap_dead start 2024-09-13T06:09:58.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.619+0000 7f2be9407980 1 -- 172.21.15.194:0/4012906230 shutdown_connections 2024-09-13T06:09:58.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.619+0000 7f2be9407980 1 -- 172.21.15.194:0/4012906230 >> 172.21.15.194:0/4012906230 conn(0x559384ae30a0 msgr2=0x559384bd03c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:58.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.619+0000 7f2be9407980 1 -- 172.21.15.194:0/4012906230 shutdown_connections 2024-09-13T06:09:58.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.619+0000 7f2be9407980 1 -- 172.21.15.194:0/4012906230 wait complete. 2024-09-13T06:09:58.633 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-13T06:09:58.633 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-13T06:09:58.633 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-09-13T06:09:58.717 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:09:58.717 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:09:58.718 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.715+0000 7f9510c53980 1 Processor -- start 2024-09-13T06:09:58.718 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.715+0000 7f9510c53980 1 -- start start 2024-09-13T06:09:58.718 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.715+0000 7f9510c53980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x56258c05a3f0 0x56258c058bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.718 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.715+0000 7f9510c53980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56258bf6bae0 con 0x56258c05a800 2024-09-13T06:09:58.718 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.715+0000 7f9510c53980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x56258bf8fe30 con 0x56258c05a3f0 2024-09-13T06:09:58.719 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.715+0000 7f950e763640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x56258c05a3f0 0x56258c058bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.719 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.719+0000 7f950e763640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x56258c05a3f0 0x56258c058bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45580/0 (socket says 172.21.15.194:45580) 2024-09-13T06:09:58.719 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.719+0000 7f950e763640 1 -- 172.21.15.194:0/3139432832 learned_addr learned my addr 172.21.15.194:0/3139432832 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:58.719 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.719+0000 7f950df62640 1 --1- 172.21.15.194:0/3139432832 >> v1:172.21.15.120:6789/0 conn(0x56258c05a800 0x56258c0590f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:51164/0 (socket says 172.21.15.194:51164) 2024-09-13T06:09:58.719 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.719+0000 7f950e763640 1 -- 172.21.15.194:0/3139432832 >> v1:172.21.15.120:6789/0 conn(0x56258c05a800 legacy=0x56258c0590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.719 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.719+0000 7f950e763640 1 -- 172.21.15.194:0/3139432832 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56258c059920 con 0x56258c05a3f0 2024-09-13T06:09:58.719 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.719+0000 7f950d761640 1 -- 172.21.15.194:0/3139432832 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3463159915 0 0) 0x56258bf6bae0 con 0x56258c05a800 2024-09-13T06:09:58.721 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.719+0000 7f950e763640 1 --2- 172.21.15.194:0/3139432832 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56258c05a3f0 0x56258c058bb0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f950000a4e0 tx=0x7f950001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3059b427e11f4075 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.721 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.719+0000 7f950d761640 1 -- 172.21.15.194:0/3139432832 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95000aa540 con 0x56258c05a3f0 2024-09-13T06:09:58.721 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.719+0000 7f950d761640 1 -- 172.21.15.194:0/3139432832 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95000aa6e0 con 0x56258c05a3f0 2024-09-13T06:09:58.721 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.719+0000 7f950d761640 1 -- 172.21.15.194:0/3139432832 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95000aaa00 con 0x56258c05a3f0 2024-09-13T06:09:58.722 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.719+0000 7f9510c53980 1 -- 172.21.15.194:0/3139432832 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56258c05a3f0 msgr2=0x56258c058bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.723 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.719+0000 7f9510c53980 1 --2- 172.21.15.194:0/3139432832 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56258c05a3f0 0x56258c058bb0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f950000a4e0 tx=0x7f950001b090 comp rx=0 tx=0).stop 2024-09-13T06:09:58.723 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.719+0000 7f9510c53980 1 -- 172.21.15.194:0/3139432832 shutdown_connections 2024-09-13T06:09:58.723 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.719+0000 7f9510c53980 1 --2- 172.21.15.194:0/3139432832 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56258c05a3f0 0x56258c058bb0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.723 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.719+0000 7f9510c53980 1 -- 172.21.15.194:0/3139432832 >> 172.21.15.194:0/3139432832 conn(0x56258c0df1f0 msgr2=0x56258c0e1610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:58.723 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.719+0000 7f9510c53980 1 -- 172.21.15.194:0/3139432832 shutdown_connections 2024-09-13T06:09:58.723 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.723+0000 7f9510c53980 1 -- 172.21.15.194:0/3139432832 wait complete. 2024-09-13T06:09:58.737 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.735+0000 7f9510c53980 1 Processor -- start 2024-09-13T06:09:58.737 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.735+0000 7f9510c53980 1 -- start start 2024-09-13T06:09:58.738 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.735+0000 7f9510c53980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56258c05a3f0 0x56258c1d0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.738 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.735+0000 7f9510c53980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x56258bf91200 con 0x56258c05a3f0 2024-09-13T06:09:58.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.735+0000 7f950e763640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56258c05a3f0 0x56258c1d0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.735+0000 7f950e763640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56258c05a3f0 0x56258c1d0a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45588/0 (socket says 172.21.15.194:45588) 2024-09-13T06:09:58.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.735+0000 7f950e763640 1 -- 172.21.15.194:0/2671015182 learned_addr learned my addr 172.21.15.194:0/2671015182 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:58.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.739+0000 7f950e763640 1 -- 172.21.15.194:0/2671015182 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56258c1d0ff0 con 0x56258c05a3f0 2024-09-13T06:09:58.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.739+0000 7f950e763640 1 --2- 172.21.15.194:0/2671015182 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56258c05a3f0 0x56258c1d0a20 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f95000ac040 tx=0x7f95000033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e90be04271349be8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.739+0000 7f93fc608640 1 -- 172.21.15.194:0/2671015182 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95000b9030 con 0x56258c05a3f0 2024-09-13T06:09:58.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.739+0000 7f93fc608640 1 -- 172.21.15.194:0/2671015182 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95000aab10 con 0x56258c05a3f0 2024-09-13T06:09:58.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.739+0000 7f93fc608640 1 -- 172.21.15.194:0/2671015182 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95000aae30 con 0x56258c05a3f0 2024-09-13T06:09:58.741 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.739+0000 7f9510c53980 1 -- 172.21.15.194:0/2671015182 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56258c05a3f0 msgr2=0x56258c1d0a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.741 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.739+0000 7f9510c53980 1 --2- 172.21.15.194:0/2671015182 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56258c05a3f0 0x56258c1d0a20 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f95000ac040 tx=0x7f95000033b0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.741 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.739+0000 7f9510c53980 1 -- 172.21.15.194:0/2671015182 shutdown_connections 2024-09-13T06:09:58.741 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.739+0000 7f9510c53980 1 --2- 172.21.15.194:0/2671015182 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56258c05a3f0 0x56258c1d0a20 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.741 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.739+0000 7f9510c53980 1 -- 172.21.15.194:0/2671015182 >> 172.21.15.194:0/2671015182 conn(0x56258c0df1f0 msgr2=0x56258c1cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:58.741 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.739+0000 7f9510c53980 1 -- 172.21.15.194:0/2671015182 shutdown_connections 2024-09-13T06:09:58.741 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.739+0000 7f9510c53980 1 -- 172.21.15.194:0/2671015182 wait complete. 2024-09-13T06:09:58.741 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.739+0000 7f9510c53980 1 Processor -- start 2024-09-13T06:09:58.741 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.739+0000 7f9510c53980 1 -- start start 2024-09-13T06:09:58.741 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.739+0000 7f9510c53980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56258c05a3f0 0x56258c1d7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.741 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.739+0000 7f9510c53980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x56258c0ef240 con 0x56258c05a3f0 2024-09-13T06:09:58.742 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.739+0000 7f950e763640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56258c05a3f0 0x56258c1d7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.742 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.739+0000 7f950e763640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56258c05a3f0 0x56258c1d7cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45592/0 (socket says 172.21.15.194:45592) 2024-09-13T06:09:58.742 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.739+0000 7f950e763640 1 -- 172.21.15.194:0/1919201982 learned_addr learned my addr 172.21.15.194:0/1919201982 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:58.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.739+0000 7f950e763640 1 -- 172.21.15.194:0/1919201982 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56258c1d8210 con 0x56258c05a3f0 2024-09-13T06:09:58.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.739+0000 7f950e763640 1 --2- 172.21.15.194:0/1919201982 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56258c05a3f0 0x56258c1d7cd0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f950001aec0 tx=0x7f9500017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.739+0000 7f93fae05640 1 -- 172.21.15.194:0/1919201982 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95000b9070 con 0x56258c05a3f0 2024-09-13T06:09:58.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.739+0000 7f93fae05640 1 -- 172.21.15.194:0/1919201982 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95000c2070 con 0x56258c05a3f0 2024-09-13T06:09:58.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.739+0000 7f9510c53980 1 -- 172.21.15.194:0/1919201982 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56258c1d84a0 con 0x56258c05a3f0 2024-09-13T06:09:58.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.739+0000 7f93fae05640 1 -- 172.21.15.194:0/1919201982 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95000be610 con 0x56258c05a3f0 2024-09-13T06:09:58.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.739+0000 7f9510c53980 1 -- 172.21.15.194:0/1919201982 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56258c1db180 con 0x56258c05a3f0 2024-09-13T06:09:58.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.743+0000 7f93fae05640 1 -- 172.21.15.194:0/1919201982 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f95000b3040 con 0x56258c05a3f0 2024-09-13T06:09:58.745 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.743+0000 7f93fae05640 1 --2- 172.21.15.194:0/1919201982 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f93f4034650 0x7f93f4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.746 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.743+0000 7f93fae05640 1 -- 172.21.15.194:0/1919201982 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f95000ba070 con 0x56258c05a3f0 2024-09-13T06:09:58.746 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.743+0000 7f950df62640 1 --2- 172.21.15.194:0/1919201982 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f93f4034650 0x7f93f4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.746 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.743+0000 7f9510c53980 1 --2- 172.21.15.194:0/1919201982 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x56258c05a800 0x56258c1dedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.746 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.743+0000 7f9510c53980 1 -- 172.21.15.194:0/1919201982 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56258c1df350 con 0x56258c05a800 2024-09-13T06:09:58.746 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.743+0000 7f950ef64640 1 --2- 172.21.15.194:0/1919201982 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x56258c05a800 0x56258c1dedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.746 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.743+0000 7f950df62640 1 --2- 172.21.15.194:0/1919201982 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f93f4034650 0x7f93f4036b10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f94f8000c10 tx=0x7f94f80013c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.746 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.743+0000 7f950ef64640 1 --2- 172.21.15.194:0/1919201982 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x56258c05a800 0x56258c1dedd0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.746 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.743+0000 7f950ef64640 1 -- 172.21.15.194:0/1919201982 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f95080083f0 con 0x56258c05a800 2024-09-13T06:09:58.746 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.743+0000 7f9510c53980 1 -- 172.21.15.194:0/1919201982 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56258c1dc380 con 0x56258c05a800 2024-09-13T06:09:58.746 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.743+0000 7f950ef64640 1 -- 172.21.15.194:0/1919201982 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f95080083f0 con 0x56258c05a800 2024-09-13T06:09:58.746 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.743+0000 7f9510c53980 1 --2- 172.21.15.194:0/1919201982 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x56258c1e1670 0x56258c1e3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.747 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.743+0000 7f9510c53980 1 -- 172.21.15.194:0/1919201982 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56258c1e4130 con 0x56258c1e1670 2024-09-13T06:09:58.747 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.743+0000 7f950e763640 1 --2- 172.21.15.194:0/1919201982 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x56258c1e1670 0x56258c1e3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.747 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.743+0000 7f950e763640 1 --2- 172.21.15.194:0/1919201982 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x56258c1e1670 0x56258c1e3a60 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.747 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.743+0000 7f950e763640 1 -- 172.21.15.194:0/1919201982 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f95000d0440 con 0x56258c1e1670 2024-09-13T06:09:58.747 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.743+0000 7f9510c53980 1 -- 172.21.15.194:0/1919201982 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56258c1e0510 con 0x56258c05a800 2024-09-13T06:09:58.749 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.743+0000 7f950ef64640 1 -- 172.21.15.194:0/1919201982 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f95080083f0 con 0x56258c05a800 2024-09-13T06:09:58.749 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.743+0000 7f9510c53980 1 --2- 172.21.15.194:0/1919201982 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x56258c1e5590 0x56258c1e7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.750 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.743+0000 7f9510c53980 1 -- 172.21.15.194:0/1919201982 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56258c1e8080 con 0x56258c1e5590 2024-09-13T06:09:58.750 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.743+0000 7f950df62640 1 --2- 172.21.15.194:0/1919201982 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x56258c1e5590 0x56258c1e7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.750 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.747+0000 7f950df62640 1 --2- 172.21.15.194:0/1919201982 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x56258c1e5590 0x56258c1e7980 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.750 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.747+0000 7f950df62640 1 -- 172.21.15.194:0/1919201982 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f94f800f680 con 0x56258c1e5590 2024-09-13T06:09:58.750 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.747+0000 7f9510c53980 1 Processor -- start 2024-09-13T06:09:58.750 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.747+0000 7f9510c53980 1 -- start start 2024-09-13T06:09:58.750 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.747+0000 7f9510c53980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56258c1f5b50 0x56258c1f5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.750 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.747+0000 7f9510c53980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x56258bfea800 con 0x56258c1f5b50 2024-09-13T06:09:58.750 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.747+0000 7f950e763640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56258c1f5b50 0x56258c1f5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.750 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.747+0000 7f950e763640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56258c1f5b50 0x56258c1f5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45598/0 (socket says 172.21.15.194:45598) 2024-09-13T06:09:58.750 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.747+0000 7f950e763640 1 -- 172.21.15.194:0/2980668326 learned_addr learned my addr 172.21.15.194:0/2980668326 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:58.750 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.747+0000 7f950e763640 1 -- 172.21.15.194:0/2980668326 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56258c1f64b0 con 0x56258c1f5b50 2024-09-13T06:09:58.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.747+0000 7f950e763640 1 --2- 172.21.15.194:0/2980668326 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56258c1f5b50 0x56258c1f5f70 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f95000bcb30 tx=0x7f95000a9480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.747+0000 7f93f3fff640 1 -- 172.21.15.194:0/2980668326 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95000e50c0 con 0x56258c1f5b50 2024-09-13T06:09:58.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.747+0000 7f9510c53980 1 -- 172.21.15.194:0/2980668326 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56258c1f6740 con 0x56258c1f5b50 2024-09-13T06:09:58.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.747+0000 7f93f3fff640 1 -- 172.21.15.194:0/2980668326 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95000b5e50 con 0x56258c1f5b50 2024-09-13T06:09:58.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.747+0000 7f93f3fff640 1 -- 172.21.15.194:0/2980668326 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95000070a0 con 0x56258c1f5b50 2024-09-13T06:09:58.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.747+0000 7f9510c53980 1 -- 172.21.15.194:0/2980668326 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56258c1f93c0 con 0x56258c1f5b50 2024-09-13T06:09:58.754 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.751+0000 7f93f3fff640 1 -- 172.21.15.194:0/2980668326 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f95000bcba0 con 0x56258c1f5b50 2024-09-13T06:09:58.754 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.751+0000 7f93f3fff640 1 --2- 172.21.15.194:0/2980668326 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f93e8034650 0x7f93e8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.754 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.751+0000 7f93f3fff640 1 -- 172.21.15.194:0/2980668326 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f95000c90c0 con 0x56258c1f5b50 2024-09-13T06:09:58.754 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.751+0000 7f950df62640 1 --2- 172.21.15.194:0/2980668326 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f93e8034650 0x7f93e8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.754 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.751+0000 7f9510c53980 1 Processor -- start 2024-09-13T06:09:58.754 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.751+0000 7f9510c53980 1 -- start start 2024-09-13T06:09:58.755 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.751+0000 7f950df62640 1 --2- 172.21.15.194:0/2980668326 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f93e8034650 0x7f93e8036b10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x56258c1dfc20 tx=0x7f94f8006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.755 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.751+0000 7f9510c53980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56258c202390 0x56258c202790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.755 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.751+0000 7f9510c53980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x56258c1d12b0 con 0x56258c202390 2024-09-13T06:09:58.755 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.751+0000 7f950e763640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56258c202390 0x56258c202790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.755 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.751+0000 7f950e763640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56258c202390 0x56258c202790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45600/0 (socket says 172.21.15.194:45600) 2024-09-13T06:09:58.755 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.751+0000 7f950e763640 1 -- 172.21.15.194:0/2818679004 learned_addr learned my addr 172.21.15.194:0/2818679004 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:58.755 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.751+0000 7f950e763640 1 -- 172.21.15.194:0/2818679004 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56258c202d60 con 0x56258c202390 2024-09-13T06:09:58.755 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.751+0000 7f950e763640 1 --2- 172.21.15.194:0/2818679004 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56258c202390 0x56258c202790 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f95000b4f70 tx=0x7f9500007e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=556ea8e4d26b5f6d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.755 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.751+0000 7f93f1ffb640 1 -- 172.21.15.194:0/2818679004 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95000e5b00 con 0x56258c202390 2024-09-13T06:09:58.755 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.751+0000 7f93f1ffb640 1 -- 172.21.15.194:0/2818679004 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95000bd740 con 0x56258c202390 2024-09-13T06:09:58.755 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.751+0000 7f93f1ffb640 1 -- 172.21.15.194:0/2818679004 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95000b4bb0 con 0x56258c202390 2024-09-13T06:09:58.755 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.751+0000 7f9510c53980 1 -- 172.21.15.194:0/2818679004 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56258c202390 msgr2=0x56258c202790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.756 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.751+0000 7f9510c53980 1 --2- 172.21.15.194:0/2818679004 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56258c202390 0x56258c202790 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f95000b4f70 tx=0x7f9500007e30 comp rx=0 tx=0).stop 2024-09-13T06:09:58.756 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.751+0000 7f9510c53980 1 -- 172.21.15.194:0/2818679004 shutdown_connections 2024-09-13T06:09:58.756 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.751+0000 7f9510c53980 1 --2- 172.21.15.194:0/2818679004 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56258c202390 0x56258c202790 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.756 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.751+0000 7f9510c53980 1 -- 172.21.15.194:0/2818679004 >> 172.21.15.194:0/2818679004 conn(0x56258c1fe710 msgr2=0x56258c1fc810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:58.756 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.751+0000 7f9510c53980 1 -- 172.21.15.194:0/2818679004 shutdown_connections 2024-09-13T06:09:58.756 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.751+0000 7f9510c53980 1 -- 172.21.15.194:0/2818679004 wait complete. 2024-09-13T06:09:58.756 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.751+0000 7f9510c53980 1 Processor -- start 2024-09-13T06:09:58.756 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.751+0000 7f9510c53980 1 -- start start 2024-09-13T06:09:58.756 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.751+0000 7f9510c53980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56258c202390 0x56258c2094a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.756 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.751+0000 7f9510c53980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x56258c203120 con 0x56258c202390 2024-09-13T06:09:58.756 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.755+0000 7f950e763640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56258c202390 0x56258c2094a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.756 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.755+0000 7f950e763640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56258c202390 0x56258c2094a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45604/0 (socket says 172.21.15.194:45604) 2024-09-13T06:09:58.757 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.755+0000 7f950e763640 1 -- 172.21.15.194:0/2012090769 learned_addr learned my addr 172.21.15.194:0/2012090769 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:58.761 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.755+0000 7f950e763640 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56258c2099e0 con 0x56258c202390 2024-09-13T06:09:58.761 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.755+0000 7f950e763640 1 --2- 172.21.15.194:0/2012090769 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56258c202390 0x56258c2094a0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f95000e5ea0 tx=0x7f95000bdf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.761 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.755+0000 7f93dffff640 1 -- 172.21.15.194:0/2012090769 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9500108070 con 0x56258c202390 2024-09-13T06:09:58.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.755+0000 7f93dffff640 1 -- 172.21.15.194:0/2012090769 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95000e9170 con 0x56258c202390 2024-09-13T06:09:58.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.755+0000 7f93dffff640 1 -- 172.21.15.194:0/2012090769 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95000e5ce0 con 0x56258c202390 2024-09-13T06:09:58.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.755+0000 7f9510c53980 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56258c2099e0 con 0x56258c202390 2024-09-13T06:09:58.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.755+0000 7f9510c53980 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56258c2099e0 con 0x56258c202390 2024-09-13T06:09:58.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.755+0000 7f93dffff640 1 -- 172.21.15.194:0/2012090769 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9500101040 con 0x56258c202390 2024-09-13T06:09:58.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.755+0000 7f93dffff640 1 --2- 172.21.15.194:0/2012090769 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f93d80346a0 0x7f93d8036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.755+0000 7f93dffff640 1 -- 172.21.15.194:0/2012090769 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f95000cc210 con 0x56258c202390 2024-09-13T06:09:58.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.755+0000 7f9510c53980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.755+0000 7f950df62640 1 --2- 172.21.15.194:0/2012090769 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f93d80346a0 0x7f93d8036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.755+0000 7f9510c53980 1 --2- 172.21.15.194:0/2012090769 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x56258c214610 0x56258c216ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.755+0000 7f9510c53980 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56258c217220 con 0x56258c214610 2024-09-13T06:09:58.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.755+0000 7f950ef64640 1 --2- 172.21.15.194:0/2012090769 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x56258c214610 0x56258c216ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.763 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.755+0000 7f950ef64640 1 --2- 172.21.15.194:0/2012090769 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x56258c214610 0x56258c216ad0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.763 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.755+0000 7f950df62640 1 --2- 172.21.15.194:0/2012090769 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f93d80346a0 0x7f93d8036b60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f94f800ffd0 tx=0x7f94f8023040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.763 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.755+0000 7f950ef64640 1 -- 172.21.15.194:0/2012090769 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f95080083f0 con 0x56258c214610 2024-09-13T06:09:58.763 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.755+0000 7f9510c53980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:58.763 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.755+0000 7f9510c53980 20 realm 2024-09-13T06:09:58.763 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.755+0000 7f9510c53980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.763 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.755+0000 7f9510c53980 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56258c217630 con 0x56258c214610 2024-09-13T06:09:58.763 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.759+0000 7f950ef64640 1 -- 172.21.15.194:0/2012090769 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f95080083f0 con 0x56258c214610 2024-09-13T06:09:58.763 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.759+0000 7f9510c53980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:58.763 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.759+0000 7f9510c53980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:09:58.763 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.759+0000 7f9510c53980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.763 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.759+0000 7f9510c53980 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56258c217ed0 con 0x56258c214610 2024-09-13T06:09:58.764 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.759+0000 7f950ef64640 1 -- 172.21.15.194:0/2012090769 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f95080083f0 con 0x56258c214610 2024-09-13T06:09:58.764 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.759+0000 7f9510c53980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:58.764 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.759+0000 7f9510c53980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.764 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.759+0000 7f9510c53980 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56258c218270 con 0x56258c214610 2024-09-13T06:09:58.764 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.759+0000 7f950ef64640 1 -- 172.21.15.194:0/2012090769 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f95080083f0 con 0x56258c214610 2024-09-13T06:09:58.764 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.759+0000 7f9510c53980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:58.764 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.759+0000 7f9510c53980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.764 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.759+0000 7f9510c53980 1 --2- 172.21.15.194:0/2012090769 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x56258c218fd0 0x56258c21b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.764 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.759+0000 7f9510c53980 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56258c21ba10 con 0x56258c218fd0 2024-09-13T06:09:58.764 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.759+0000 7f950e763640 1 --2- 172.21.15.194:0/2012090769 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x56258c218fd0 0x56258c21b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.764 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.759+0000 7f950e763640 1 --2- 172.21.15.194:0/2012090769 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x56258c218fd0 0x56258c21b3c0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.765 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.759+0000 7f950e763640 1 -- 172.21.15.194:0/2012090769 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f95000e1020 con 0x56258c218fd0 2024-09-13T06:09:58.765 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.759+0000 7f9510c53980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:09:58.765 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.759+0000 7f9510c53980 20 searching for the correct realm 2024-09-13T06:09:58.765 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.759+0000 7f9510c53980 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56258c21d270 con 0x56258c218fd0 2024-09-13T06:09:58.765 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.759+0000 7f950e763640 1 -- 172.21.15.194:0/2012090769 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95000e1020 con 0x56258c218fd0 2024-09-13T06:09:58.765 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.759+0000 7f950e763640 1 --2- 172.21.15.194:0/2012090769 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f9500104040 0x7f95000ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.765 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.759+0000 7f950e763640 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56258c21d270 con 0x7f9500104040 2024-09-13T06:09:58.765 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.759+0000 7f950df62640 1 --2- 172.21.15.194:0/2012090769 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f9500104040 0x7f95000ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.765 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.759+0000 7f950df62640 1 --2- 172.21.15.194:0/2012090769 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f9500104040 0x7f95000ce2f0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.765 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.759+0000 7f950df62640 1 -- 172.21.15.194:0/2012090769 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f94f8037040 con 0x7f9500104040 2024-09-13T06:09:58.765 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.759+0000 7f950df62640 1 --2- 172.21.15.194:0/2012090769 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f94f801f940 0x7f94f803a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.765 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.759+0000 7f950df62640 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56258c21d270 con 0x7f94f801f940 2024-09-13T06:09:58.765 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.759+0000 7f950ef64640 1 --2- 172.21.15.194:0/2012090769 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f94f801f940 0x7f94f803a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.759+0000 7f950ef64640 1 --2- 172.21.15.194:0/2012090769 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f94f801f940 0x7f94f803a3c0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.763+0000 7f950ef64640 1 -- 172.21.15.194:0/2012090769 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95080083f0 con 0x7f94f801f940 2024-09-13T06:09:58.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.763+0000 7f950ef64640 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56258c218270 con 0x56258c214610 2024-09-13T06:09:58.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.763+0000 7f950ef64640 1 -- 172.21.15.194:0/2012090769 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95080083f0 con 0x56258c214610 2024-09-13T06:09:58.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.763+0000 7f950ef64640 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56258c218270 con 0x56258c214610 2024-09-13T06:09:58.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.763+0000 7f950ef64640 1 -- 172.21.15.194:0/2012090769 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95080083f0 con 0x56258c214610 2024-09-13T06:09:58.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.763+0000 7f950ef64640 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56258c218270 con 0x7f94f801f940 2024-09-13T06:09:58.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.763+0000 7f950ef64640 1 -- 172.21.15.194:0/2012090769 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95080083f0 con 0x7f94f801f940 2024-09-13T06:09:58.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.763+0000 7f950ef64640 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56258c218270 con 0x7f94f801f940 2024-09-13T06:09:58.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.763+0000 7f950ef64640 1 -- 172.21.15.194:0/2012090769 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95080083f0 con 0x7f94f801f940 2024-09-13T06:09:58.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.763+0000 7f950ef64640 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56258c218270 con 0x7f9500104040 2024-09-13T06:09:58.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.763+0000 7f950df62640 1 -- 172.21.15.194:0/2012090769 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94f8037040 con 0x7f9500104040 2024-09-13T06:09:58.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.763+0000 7f950df62640 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56258c218270 con 0x56258c218fd0 2024-09-13T06:09:58.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.763+0000 7f950e763640 1 -- 172.21.15.194:0/2012090769 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95000e1020 con 0x56258c218fd0 2024-09-13T06:09:58.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.763+0000 7f950e763640 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56258c218270 con 0x56258c214610 2024-09-13T06:09:58.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.763+0000 7f950ef64640 1 -- 172.21.15.194:0/2012090769 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95080083f0 con 0x56258c214610 2024-09-13T06:09:58.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.763+0000 7f950ef64640 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56258c218270 con 0x7f94f801f940 2024-09-13T06:09:58.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.763+0000 7f950ef64640 1 -- 172.21.15.194:0/2012090769 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95080083f0 con 0x7f94f801f940 2024-09-13T06:09:58.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.763+0000 7f950ef64640 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56258c218270 con 0x56258c214610 2024-09-13T06:09:58.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.767+0000 7f950ef64640 1 -- 172.21.15.194:0/2012090769 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95080083f0 con 0x56258c214610 2024-09-13T06:09:58.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.767+0000 7f950ef64640 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56258c218270 con 0x7f9500104040 2024-09-13T06:09:58.772 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.767+0000 7f950df62640 1 -- 172.21.15.194:0/2012090769 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f94f8037040 con 0x7f9500104040 2024-09-13T06:09:58.772 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.767+0000 7f950df62640 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56258c218270 con 0x56258c218fd0 2024-09-13T06:09:58.772 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.767+0000 7f950e763640 1 -- 172.21.15.194:0/2012090769 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95000e1020 con 0x56258c218fd0 2024-09-13T06:09:58.772 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.767+0000 7f950e763640 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56258c218270 con 0x56258c218fd0 2024-09-13T06:09:58.772 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.767+0000 7f950e763640 1 -- 172.21.15.194:0/2012090769 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95000e1020 con 0x56258c218fd0 2024-09-13T06:09:58.772 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.767+0000 7f950e763640 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56258c218270 con 0x7f94f801f940 2024-09-13T06:09:58.772 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.767+0000 7f950ef64640 1 -- 172.21.15.194:0/2012090769 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95080083f0 con 0x7f94f801f940 2024-09-13T06:09:58.772 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.767+0000 7f950ef64640 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56258c218270 con 0x56258c218fd0 2024-09-13T06:09:58.772 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.767+0000 7f950e763640 1 -- 172.21.15.194:0/2012090769 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95000e1020 con 0x56258c218fd0 2024-09-13T06:09:58.772 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.767+0000 7f950e763640 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56258c218270 con 0x56258c218fd0 2024-09-13T06:09:58.772 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.767+0000 7f950e763640 1 -- 172.21.15.194:0/2012090769 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95000e1020 con 0x56258c218fd0 2024-09-13T06:09:58.772 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.767+0000 7f950e763640 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56258c218270 con 0x56258c214610 2024-09-13T06:09:58.773 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.767+0000 7f950ef64640 1 -- 172.21.15.194:0/2012090769 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95080083f0 con 0x56258c214610 2024-09-13T06:09:58.773 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.767+0000 7f950ef64640 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56258c218270 con 0x56258c214610 2024-09-13T06:09:58.773 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.767+0000 7f950ef64640 1 -- 172.21.15.194:0/2012090769 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f95080083f0 con 0x56258c214610 2024-09-13T06:09:58.773 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.767+0000 7f950ef64640 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56258c218270 con 0x7f94f801f940 2024-09-13T06:09:58.773 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.767+0000 7f950ef64640 1 -- 172.21.15.194:0/2012090769 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95080083f0 con 0x7f94f801f940 2024-09-13T06:09:58.773 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.767+0000 7f950ef64640 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56258c218270 con 0x56258c218fd0 2024-09-13T06:09:58.773 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.767+0000 7f950e763640 1 -- 172.21.15.194:0/2012090769 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95000e1020 con 0x56258c218fd0 2024-09-13T06:09:58.773 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.767+0000 7f950e763640 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56258c218270 con 0x7f9500104040 2024-09-13T06:09:58.773 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.767+0000 7f950df62640 1 -- 172.21.15.194:0/2012090769 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94f8037040 con 0x7f9500104040 2024-09-13T06:09:58.773 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.767+0000 7f950df62640 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56258c218270 con 0x56258c214610 2024-09-13T06:09:58.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.771+0000 7f950ef64640 1 -- 172.21.15.194:0/2012090769 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95080083f0 con 0x56258c214610 2024-09-13T06:09:58.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.771+0000 7f950ef64640 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56258c218270 con 0x7f94f801f940 2024-09-13T06:09:58.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.771+0000 7f950ef64640 1 -- 172.21.15.194:0/2012090769 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95080083f0 con 0x7f94f801f940 2024-09-13T06:09:58.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.771+0000 7f950ef64640 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56258c218270 con 0x56258c218fd0 2024-09-13T06:09:58.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.771+0000 7f950e763640 1 -- 172.21.15.194:0/2012090769 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f95000e1020 con 0x56258c218fd0 2024-09-13T06:09:58.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.771+0000 7f950e763640 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56258c218270 con 0x7f94f801f940 2024-09-13T06:09:58.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.771+0000 7f950ef64640 1 -- 172.21.15.194:0/2012090769 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95080083f0 con 0x7f94f801f940 2024-09-13T06:09:58.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.771+0000 7f950ef64640 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56258c218270 con 0x7f9500104040 2024-09-13T06:09:58.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.771+0000 7f950df62640 1 -- 172.21.15.194:0/2012090769 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94f8037040 con 0x7f9500104040 2024-09-13T06:09:58.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.771+0000 7f950df62640 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56258c218270 con 0x56258c218fd0 2024-09-13T06:09:58.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.771+0000 7f950e763640 1 -- 172.21.15.194:0/2012090769 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95000e1020 con 0x56258c218fd0 2024-09-13T06:09:58.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.771+0000 7f950e763640 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56258c218270 con 0x7f94f801f940 2024-09-13T06:09:58.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.771+0000 7f950ef64640 1 -- 172.21.15.194:0/2012090769 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95080083f0 con 0x7f94f801f940 2024-09-13T06:09:58.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.771+0000 7f950ef64640 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56258c218270 con 0x56258c214610 2024-09-13T06:09:58.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.771+0000 7f950ef64640 1 -- 172.21.15.194:0/2012090769 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f95080083f0 con 0x56258c214610 2024-09-13T06:09:58.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.771+0000 7f950ef64640 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56258c218270 con 0x7f9500104040 2024-09-13T06:09:58.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.771+0000 7f950df62640 1 -- 172.21.15.194:0/2012090769 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94f8037040 con 0x7f9500104040 2024-09-13T06:09:58.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.771+0000 7f9510c53980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:09:58.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.771+0000 7f9510c53980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:09:58.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.771+0000 7f9510c53980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:09:58.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.771+0000 7f9510c53980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:09:58.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.771+0000 7f9510c53980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:09:58.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.771+0000 7f9510c53980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:09:58.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.771+0000 7f9510c53980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.771+0000 7f9510c53980 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56258c21c390 con 0x56258c214610 2024-09-13T06:09:58.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.771+0000 7f950ef64640 1 -- 172.21.15.194:0/2012090769 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f95080083f0 con 0x56258c214610 2024-09-13T06:09:58.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.771+0000 7f9510c53980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:58.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.771+0000 7f9510c53980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.771+0000 7f9510c53980 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56258c21cbe0 con 0x56258c214610 2024-09-13T06:09:58.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.771+0000 7f950ef64640 1 -- 172.21.15.194:0/2012090769 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f95080083f0 con 0x56258c214610 2024-09-13T06:09:58.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.771+0000 7f9510c53980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:58.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.771+0000 7f9510c53980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.771+0000 7f9510c53980 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56258c21bff0 con 0x7f9500104040 2024-09-13T06:09:58.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.775+0000 7f950df62640 1 -- 172.21.15.194:0/2012090769 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f94f8037040 con 0x7f9500104040 2024-09-13T06:09:58.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.775+0000 7f9510c53980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:09:58.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.775+0000 7f9510c53980 20 zone default found 2024-09-13T06:09:58.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.775+0000 7f9510c53980 4 Realm: () 2024-09-13T06:09:58.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.775+0000 7f9510c53980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:09:58.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.775+0000 7f9510c53980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:09:58.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.775+0000 7f9510c53980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:09:58.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.775+0000 7f9510c53980 20 zonegroup default 2024-09-13T06:09:58.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.775+0000 7f9510c53980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.775+0000 7f9510c53980 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56258c21d6a0 con 0x7f94f801f940 2024-09-13T06:09:58.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.775+0000 7f950ef64640 1 -- 172.21.15.194:0/2012090769 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f95080083f0 con 0x7f94f801f940 2024-09-13T06:09:58.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.775+0000 7f9510c53980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:58.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.775+0000 7f9510c53980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.775+0000 7f9510c53980 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56258c21f110 con 0x56258c218fd0 2024-09-13T06:09:58.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.775+0000 7f950e763640 1 -- 172.21.15.194:0/2012090769 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f95000e1020 con 0x56258c218fd0 2024-09-13T06:09:58.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.775+0000 7f9510c53980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:58.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.775+0000 7f9510c53980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.775+0000 7f9510c53980 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56258c21f590 con 0x56258c218fd0 2024-09-13T06:09:58.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.775+0000 7f950e763640 1 -- 172.21.15.194:0/2012090769 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f95000e1020 con 0x56258c218fd0 2024-09-13T06:09:58.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.775+0000 7f9510c53980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:58.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.775+0000 7f9510c53980 20 started sync module instance, tier type = 2024-09-13T06:09:58.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.775+0000 7f9510c53980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:09:58.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.775+0000 7f9510c53980 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56258c21e520 con 0x7f9500104040 2024-09-13T06:09:58.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.775+0000 7f950df62640 1 -- 172.21.15.194:0/2012090769 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(44 notify.0 [create] v33'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94f8037040 con 0x7f9500104040 2024-09-13T06:09:58.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.775+0000 7f9510c53980 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94719264811280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56258c21ed30 con 0x7f9500104040 2024-09-13T06:09:58.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.775+0000 7f9510c53980 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56258c2204c0 con 0x56258c214610 2024-09-13T06:09:58.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.779+0000 7f950df62640 1 -- 172.21.15.194:0/2012090769 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94719264811280] v33'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94f8037040 con 0x7f9500104040 2024-09-13T06:09:58.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.779+0000 7f950ef64640 1 -- 172.21.15.194:0/2012090769 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v33'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95080083f0 con 0x56258c214610 2024-09-13T06:09:58.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.779+0000 7f9510c53980 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94719264817168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56258c2208e0 con 0x56258c214610 2024-09-13T06:09:58.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.779+0000 7f9510c53980 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56258c221130 con 0x56258c218fd0 2024-09-13T06:09:58.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.779+0000 7f950ef64640 1 -- 172.21.15.194:0/2012090769 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94719264817168] v33'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95080083f0 con 0x56258c214610 2024-09-13T06:09:58.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.779+0000 7f950e763640 1 -- 172.21.15.194:0/2012090769 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v33'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95000e1020 con 0x56258c218fd0 2024-09-13T06:09:58.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.779+0000 7f9510c53980 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94719264818528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56258c221550 con 0x56258c218fd0 2024-09-13T06:09:58.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.779+0000 7f9510c53980 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56258c221f10 con 0x7f9500104040 2024-09-13T06:09:58.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.783+0000 7f950df62640 1 -- 172.21.15.194:0/2012090769 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(50 notify.3 [create] v33'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94f8037040 con 0x7f9500104040 2024-09-13T06:09:58.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.783+0000 7f9510c53980 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94719264826032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56258c222b80 con 0x7f9500104040 2024-09-13T06:09:58.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.783+0000 7f9510c53980 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56258c223540 con 0x56258c214610 2024-09-13T06:09:58.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.783+0000 7f950e763640 1 -- 172.21.15.194:0/2012090769 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94719264818528] v33'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95000e1020 con 0x56258c218fd0 2024-09-13T06:09:58.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.783+0000 7f950df62640 1 -- 172.21.15.194:0/2012090769 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94719264826032] v33'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94f8037040 con 0x7f9500104040 2024-09-13T06:09:58.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.783+0000 7f950ef64640 1 -- 172.21.15.194:0/2012090769 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v33'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95080083f0 con 0x56258c214610 2024-09-13T06:09:58.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.783+0000 7f9510c53980 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94719264819648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56258c2227e0 con 0x56258c214610 2024-09-13T06:09:58.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.783+0000 7f9510c53980 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56258c223540 con 0x7f94f801f940 2024-09-13T06:09:58.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.787+0000 7f950ef64640 1 -- 172.21.15.194:0/2012090769 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94719264819648] v33'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95080083f0 con 0x56258c214610 2024-09-13T06:09:58.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.787+0000 7f950ef64640 1 -- 172.21.15.194:0/2012090769 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(54 notify.5 [create] v33'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95080083f0 con 0x7f94f801f940 2024-09-13T06:09:58.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.787+0000 7f9510c53980 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94719264832384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56258c223540 con 0x7f94f801f940 2024-09-13T06:09:58.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.787+0000 7f9510c53980 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56258c224720 con 0x7f94f801f940 2024-09-13T06:09:58.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.787+0000 7f950ef64640 1 -- 172.21.15.194:0/2012090769 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94719264832384] v33'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95080083f0 con 0x7f94f801f940 2024-09-13T06:09:58.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.787+0000 7f950ef64640 1 -- 172.21.15.194:0/2012090769 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(56 notify.6 [create] v33'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95080083f0 con 0x7f94f801f940 2024-09-13T06:09:58.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.787+0000 7f9510c53980 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94719264829856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56258c224720 con 0x7f94f801f940 2024-09-13T06:09:58.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.787+0000 7f9510c53980 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56258c2250e0 con 0x7f94f801f940 2024-09-13T06:09:58.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.791+0000 7f950ef64640 1 -- 172.21.15.194:0/2012090769 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(58 notify.7 [create] v33'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95080083f0 con 0x7f94f801f940 2024-09-13T06:09:58.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.791+0000 7f9510c53980 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94719264836656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56258c225500 con 0x7f94f801f940 2024-09-13T06:09:58.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.791+0000 7f9510c53980 20 add_watcher() i=0 2024-09-13T06:09:58.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.791+0000 7f9510c53980 20 add_watcher() i=1 2024-09-13T06:09:58.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.791+0000 7f9510c53980 20 add_watcher() i=2 2024-09-13T06:09:58.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.791+0000 7f9510c53980 20 add_watcher() i=3 2024-09-13T06:09:58.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.791+0000 7f9510c53980 20 add_watcher() i=4 2024-09-13T06:09:58.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.791+0000 7f9510c53980 20 add_watcher() i=5 2024-09-13T06:09:58.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.791+0000 7f950ef64640 1 -- 172.21.15.194:0/2012090769 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94719264829856] v33'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95080083f0 con 0x7f94f801f940 2024-09-13T06:09:58.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.791+0000 7f9510c53980 20 add_watcher() i=6 2024-09-13T06:09:58.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.791+0000 7f950ef64640 1 -- 172.21.15.194:0/2012090769 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94719264836656] v33'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95080083f0 con 0x7f94f801f940 2024-09-13T06:09:58.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.791+0000 7f9510c53980 20 add_watcher() i=7 2024-09-13T06:09:58.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.791+0000 7f9510c53980 2 all 8 watchers are set, enabling cache 2024-09-13T06:09:58.794 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.791+0000 7f9510c53980 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56258c225500 con 0x56258c214610 2024-09-13T06:09:58.794 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.791+0000 7f950ef64640 1 -- 172.21.15.194:0/2012090769 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f95080083f0 con 0x56258c214610 2024-09-13T06:09:58.794 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.791+0000 7f9510c53980 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94719264837712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56258c225470 con 0x56258c214610 2024-09-13T06:09:58.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.795+0000 7f950ef64640 1 -- 172.21.15.194:0/2012090769 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94719264837712] v33'106 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f95080083f0 con 0x56258c214610 2024-09-13T06:09:58.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.795+0000 7f93c4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:58.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.795+0000 7f9510c53980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:09:58.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.795+0000 7f9510c53980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:09:58.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.795+0000 7f9510c53980 5 note: GC not initialized 2024-09-13T06:09:58.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.795+0000 7f933f7fe640 20 reqs_thread_entry: start 2024-09-13T06:09:58.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.795+0000 7f9510c53980 20 init_complete bucket index max shards: 11 2024-09-13T06:09:58.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.795+0000 7f9510c53980 20 Filter name: none 2024-09-13T06:09:58.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.795+0000 7f933d7fa640 20 reqs_thread_entry: start 2024-09-13T06:09:58.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.795+0000 7f9510c53980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T06:09:58.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.795+0000 7f9510c53980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.795+0000 7f9510c53980 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56258c24bcb0 con 0x7f94f801f940 2024-09-13T06:09:58.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.795+0000 7f950ef64640 1 -- 172.21.15.194:0/2012090769 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f95080083f0 con 0x7f94f801f940 2024-09-13T06:09:58.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.795+0000 7f9510c53980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:58.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.795+0000 7f9510c53980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-13T06:09:58.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.795+0000 7f9510c53980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T06:09:58.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.795+0000 7f9510c53980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-13T06:09:58.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.795+0000 7f9510c53980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.795+0000 7f9510c53980 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56258c24a450 con 0x7f94f801f940 2024-09-13T06:09:58.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.795+0000 7f950ef64640 1 -- 172.21.15.194:0/2012090769 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f95080083f0 con 0x7f94f801f940 2024-09-13T06:09:58.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.795+0000 7f9510c53980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:58.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.795+0000 7f9510c53980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-13T06:09:58.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.795+0000 7f9510c53980 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T06:09:58.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.795+0000 7f9510c53980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-13T06:09:58.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.795+0000 7f9510c53980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-13T06:09:58.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.795+0000 7f9510c53980 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56258c24acf0 con 0x7f94f801f940 2024-09-13T06:09:58.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.799+0000 7f950ef64640 1 -- 172.21.15.194:0/2012090769 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v33'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f95080083f0 con 0x7f94f801f940 2024-09-13T06:09:58.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.799+0000 7f9510c53980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-13T06:09:58.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.799+0000 7f9510c53980 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T06:09:58.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.799+0000 7f9510c53980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-13T06:09:58.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.799+0000 7f9510c53980 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94719264991296 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56258c24f750 con 0x7f94f801f940 2024-09-13T06:09:58.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.799+0000 7f950ef64640 1 -- 172.21.15.194:0/2012090769 <== osd.0 v2:172.21.15.120:6800/1923744619 20 ==== watch-notify(notify (1) cookie 94719264832384 notify 141733920771 ret 0) ==== 598+0+0 (crc 0 0 0) 0x56258c24b090 con 0x7f94f801f940 2024-09-13T06:09:58.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.799+0000 7f93f1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920771 cookie 94719264832384 notifier 4486 bl.length()=556 2024-09-13T06:09:58.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.799+0000 7f93f1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-13T06:09:58.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.799+0000 7f93f1ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T06:09:58.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.799+0000 7f93f1ffb640 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f93d4003eb0 con 0x7f94f801f940 2024-09-13T06:09:58.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.799+0000 7f950ef64640 1 -- 172.21.15.194:0/2012090769 <== osd.0 v2:172.21.15.120:6800/1923744619 21 ==== osd_op_reply(65 notify.5 [notify cookie 94719264991296 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f95080083f0 con 0x7f94f801f940 2024-09-13T06:09:58.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.799+0000 7f950ef64640 1 -- 172.21.15.194:0/2012090769 <== osd.0 v2:172.21.15.120:6800/1923744619 22 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95080083f0 con 0x7f94f801f940 2024-09-13T06:09:58.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.803+0000 7f950ef64640 1 -- 172.21.15.194:0/2012090769 <== osd.0 v2:172.21.15.120:6800/1923744619 23 ==== watch-notify(notify_complete (2) cookie 94719264991296 notify 141733920771 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56258c24a600 con 0x7f94f801f940 2024-09-13T06:09:58.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.803+0000 7f9510c53980 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56258c24d280 con 0x7f94f801f940 2024-09-13T06:09:58.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.803+0000 7f950ef64640 1 -- 172.21.15.194:0/2012090769 <== osd.0 v2:172.21.15.120:6800/1923744619 24 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v33'3 uv3 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f95080083f0 con 0x7f94f801f940 2024-09-13T06:09:58.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.803+0000 7f9510c53980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-13T06:09:58.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.803+0000 7f9510c53980 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T06:09:58.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.803+0000 7f9510c53980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-13T06:09:58.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.803+0000 7f9510c53980 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94719264991184 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56258c24f750 con 0x56258c218fd0 2024-09-13T06:09:58.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.803+0000 7f950e763640 1 -- 172.21.15.194:0/2012090769 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== watch-notify(notify (1) cookie 94719264818528 notify 141733920776 ret 0) ==== 219+0+0 (crc 0 0 0) 0x56258c1f64b0 con 0x56258c218fd0 2024-09-13T06:09:58.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.803+0000 7f93f17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920776 cookie 94719264818528 notifier 4486 bl.length()=177 2024-09-13T06:09:58.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.803+0000 7f93f17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-13T06:09:58.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.803+0000 7f93f17fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T06:09:58.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.803+0000 7f93f17fa640 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f9344003410 con 0x56258c218fd0 2024-09-13T06:09:58.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.803+0000 7f950e763640 1 -- 172.21.15.194:0/2012090769 <== osd.3 v2:172.21.15.194:6816/96632515 16 ==== osd_op_reply(68 notify.2 [notify cookie 94719264991184 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f95000e1020 con 0x56258c218fd0 2024-09-13T06:09:58.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.803+0000 7f950e763640 1 -- 172.21.15.194:0/2012090769 <== osd.3 v2:172.21.15.194:6816/96632515 17 ==== watch-notify(notify_complete (2) cookie 94719264991184 notify 141733920776 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f95000d6040 con 0x56258c218fd0 2024-09-13T06:09:58.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.803+0000 7f950e763640 1 -- 172.21.15.194:0/2012090769 <== osd.3 v2:172.21.15.194:6816/96632515 18 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95000e1020 con 0x56258c218fd0 2024-09-13T06:09:58.807 INFO:teuthology.orchestra.run.smithi194.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-13T06:09:58.800351Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:09:58.800335Z","tags":[],"group_ids":[]} 2024-09-13T06:09:58.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.807+0000 7f93c4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:58.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.807+0000 7f9510c53980 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94719264837712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56258c249a50 con 0x56258c214610 2024-09-13T06:09:58.808 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.807+0000 7f950ef64640 1 -- 172.21.15.194:0/2012090769 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94719264837712] v33'107 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f95080083f0 con 0x56258c214610 2024-09-13T06:09:58.808 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.807+0000 7f9510c53980 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94719264811280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56258c249a50 con 0x7f9500104040 2024-09-13T06:09:58.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.807+0000 7f950df62640 1 -- 172.21.15.194:0/2012090769 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94719264811280] v33'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94f8037040 con 0x7f9500104040 2024-09-13T06:09:58.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.807+0000 7f9510c53980 20 remove_watcher() i=0 2024-09-13T06:09:58.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.807+0000 7f9510c53980 2 removed watcher, disabling cache 2024-09-13T06:09:58.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.807+0000 7f9510c53980 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94719264817168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56258c21e910 con 0x56258c214610 2024-09-13T06:09:58.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.811+0000 7f950ef64640 1 -- 172.21.15.194:0/2012090769 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94719264817168] v33'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95080083f0 con 0x56258c214610 2024-09-13T06:09:58.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.811+0000 7f9510c53980 20 remove_watcher() i=1 2024-09-13T06:09:58.812 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.811+0000 7f9510c53980 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94719264818528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56258c249a50 con 0x56258c218fd0 2024-09-13T06:09:58.814 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.811+0000 7f950e763640 1 -- 172.21.15.194:0/2012090769 <== osd.3 v2:172.21.15.194:6816/96632515 19 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94719264818528] v33'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95000e1020 con 0x56258c218fd0 2024-09-13T06:09:58.814 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.811+0000 7f9510c53980 20 remove_watcher() i=2 2024-09-13T06:09:58.814 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.811+0000 7f9510c53980 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94719264826032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56258c220010 con 0x7f9500104040 2024-09-13T06:09:58.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.815+0000 7f950df62640 1 -- 172.21.15.194:0/2012090769 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94719264826032] v33'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94f8037040 con 0x7f9500104040 2024-09-13T06:09:58.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.815+0000 7f9510c53980 20 remove_watcher() i=3 2024-09-13T06:09:58.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.815+0000 7f9510c53980 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94719264819648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56258c21e910 con 0x56258c214610 2024-09-13T06:09:58.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.815+0000 7f950ef64640 1 -- 172.21.15.194:0/2012090769 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94719264819648] v33'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95080083f0 con 0x56258c214610 2024-09-13T06:09:58.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.815+0000 7f9510c53980 20 remove_watcher() i=4 2024-09-13T06:09:58.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.815+0000 7f9510c53980 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94719264832384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56258c2209f0 con 0x7f94f801f940 2024-09-13T06:09:58.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.819+0000 7f950ef64640 1 -- 172.21.15.194:0/2012090769 <== osd.0 v2:172.21.15.120:6800/1923744619 25 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94719264832384] v33'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95080083f0 con 0x7f94f801f940 2024-09-13T06:09:58.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.819+0000 7f9510c53980 20 remove_watcher() i=5 2024-09-13T06:09:58.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.819+0000 7f9510c53980 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94719264829856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56258c249a50 con 0x7f94f801f940 2024-09-13T06:09:58.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.819+0000 7f950ef64640 1 -- 172.21.15.194:0/2012090769 <== osd.0 v2:172.21.15.120:6800/1923744619 26 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94719264829856] v33'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95080083f0 con 0x7f94f801f940 2024-09-13T06:09:58.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.819+0000 7f9510c53980 20 remove_watcher() i=6 2024-09-13T06:09:58.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.819+0000 7f9510c53980 1 -- 172.21.15.194:0/2012090769 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94719264836656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56258c2222b0 con 0x7f94f801f940 2024-09-13T06:09:58.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.823+0000 7f950ef64640 1 -- 172.21.15.194:0/2012090769 <== osd.0 v2:172.21.15.120:6800/1923744619 27 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94719264836656] v33'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95080083f0 con 0x7f94f801f940 2024-09-13T06:09:58.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.823+0000 7f9510c53980 20 remove_watcher() i=7 2024-09-13T06:09:58.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.823+0000 7f9510c53980 1 -- 172.21.15.194:0/2012090769 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f94f801f940 msgr2=0x7f94f803a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.823+0000 7f9510c53980 1 --2- 172.21.15.194:0/2012090769 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f94f801f940 0x7f94f803a3c0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.823+0000 7f9510c53980 1 -- 172.21.15.194:0/2012090769 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x56258c214610 msgr2=0x56258c216ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.823+0000 7f9510c53980 1 --2- 172.21.15.194:0/2012090769 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x56258c214610 0x56258c216ad0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.823+0000 7f9510c53980 1 -- 172.21.15.194:0/2012090769 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f9500104040 msgr2=0x7f95000ce2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.823+0000 7f9510c53980 1 --2- 172.21.15.194:0/2012090769 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f9500104040 0x7f95000ce2f0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.823+0000 7f9510c53980 1 -- 172.21.15.194:0/2012090769 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x56258c218fd0 msgr2=0x56258c21b3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.823+0000 7f9510c53980 1 --2- 172.21.15.194:0/2012090769 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x56258c218fd0 0x56258c21b3c0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.823+0000 7f9510c53980 1 -- 172.21.15.194:0/2012090769 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f93d80346a0 msgr2=0x7f93d8036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.823+0000 7f9510c53980 1 --2- 172.21.15.194:0/2012090769 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f93d80346a0 0x7f93d8036b60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f94f800ffd0 tx=0x7f94f8023040 comp rx=0 tx=0).stop 2024-09-13T06:09:58.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.823+0000 7f950ef64640 1 -- 172.21.15.194:0/2012090769 reap_dead start 2024-09-13T06:09:58.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.823+0000 7f9510c53980 1 -- 172.21.15.194:0/2012090769 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56258c202390 msgr2=0x56258c2094a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.823+0000 7f9510c53980 1 --2- 172.21.15.194:0/2012090769 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56258c202390 0x56258c2094a0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f95000e5ea0 tx=0x7f95000bdf80 comp rx=0 tx=0).stop 2024-09-13T06:09:58.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.823+0000 7f9510c53980 1 -- 172.21.15.194:0/2012090769 shutdown_connections 2024-09-13T06:09:58.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.823+0000 7f9510c53980 1 --2- 172.21.15.194:0/2012090769 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56258c202390 0x56258c2094a0 secure :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f95000e5ea0 tx=0x7f95000bdf80 comp rx=0 tx=0).stop 2024-09-13T06:09:58.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.823+0000 7f9510c53980 1 -- 172.21.15.194:0/2012090769 >> 172.21.15.194:0/2012090769 conn(0x56258c1fe710 msgr2=0x56258c1fc7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:58.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.823+0000 7f9510c53980 1 -- 172.21.15.194:0/2012090769 shutdown_connections 2024-09-13T06:09:58.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.823+0000 7f9510c53980 1 -- 172.21.15.194:0/2012090769 wait complete. 2024-09-13T06:09:58.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.823+0000 7f9510c53980 1 -- 172.21.15.194:0/2980668326 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f93e8034650 msgr2=0x7f93e8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.823+0000 7f9510c53980 1 --2- 172.21.15.194:0/2980668326 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f93e8034650 0x7f93e8036b10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x56258c1dfc20 tx=0x7f94f8006000 comp rx=0 tx=0).stop 2024-09-13T06:09:58.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.823+0000 7f9510c53980 1 -- 172.21.15.194:0/2980668326 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56258c1f5b50 msgr2=0x56258c1f5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.823+0000 7f9510c53980 1 --2- 172.21.15.194:0/2980668326 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56258c1f5b50 0x56258c1f5f70 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f95000bcb30 tx=0x7f95000a9480 comp rx=0 tx=0).stop 2024-09-13T06:09:58.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.823+0000 7f9510c53980 1 -- 172.21.15.194:0/2980668326 shutdown_connections 2024-09-13T06:09:58.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.823+0000 7f9510c53980 1 --2- 172.21.15.194:0/2980668326 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f93e8034650 0x7f93e8036b10 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.823+0000 7f9510c53980 1 --2- 172.21.15.194:0/2980668326 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56258c1f5b50 0x56258c1f5f70 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.823+0000 7f9510c53980 1 -- 172.21.15.194:0/2980668326 >> 172.21.15.194:0/2980668326 conn(0x56258c1eaca0 msgr2=0x56258c1ed720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:58.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.823+0000 7f9510c53980 1 -- 172.21.15.194:0/2980668326 shutdown_connections 2024-09-13T06:09:58.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.823+0000 7f9510c53980 1 -- 172.21.15.194:0/2980668326 wait complete. 2024-09-13T06:09:58.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.823+0000 7f9510c53980 1 -- 172.21.15.194:0/1919201982 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x56258c05a800 msgr2=0x56258c1dedd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.823+0000 7f9510c53980 1 --2- 172.21.15.194:0/1919201982 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x56258c05a800 0x56258c1dedd0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.823+0000 7f9510c53980 1 -- 172.21.15.194:0/1919201982 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x56258c1e5590 msgr2=0x56258c1e7980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.823+0000 7f9510c53980 1 --2- 172.21.15.194:0/1919201982 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x56258c1e5590 0x56258c1e7980 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.823+0000 7f9510c53980 1 -- 172.21.15.194:0/1919201982 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x56258c1e1670 msgr2=0x56258c1e3a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.823+0000 7f9510c53980 1 --2- 172.21.15.194:0/1919201982 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x56258c1e1670 0x56258c1e3a60 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.823+0000 7f9510c53980 1 -- 172.21.15.194:0/1919201982 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f93f4034650 msgr2=0x7f93f4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.823+0000 7f9510c53980 1 --2- 172.21.15.194:0/1919201982 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f93f4034650 0x7f93f4036b10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f94f8000c10 tx=0x7f94f80013c0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.823+0000 7f9510c53980 1 -- 172.21.15.194:0/1919201982 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56258c05a3f0 msgr2=0x56258c1d7cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.823+0000 7f9510c53980 1 --2- 172.21.15.194:0/1919201982 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56258c05a3f0 0x56258c1d7cd0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f950001aec0 tx=0x7f9500017e30 comp rx=0 tx=0).stop 2024-09-13T06:09:58.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.823+0000 7f950ef64640 1 -- 172.21.15.194:0/1919201982 reap_dead start 2024-09-13T06:09:58.829 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.823+0000 7f9510c53980 1 -- 172.21.15.194:0/1919201982 shutdown_connections 2024-09-13T06:09:58.829 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.823+0000 7f9510c53980 1 -- 172.21.15.194:0/1919201982 >> 172.21.15.194:0/1919201982 conn(0x56258c0df1f0 msgr2=0x56258c1cb1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:58.829 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.823+0000 7f9510c53980 1 -- 172.21.15.194:0/1919201982 shutdown_connections 2024-09-13T06:09:58.829 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.823+0000 7f9510c53980 1 -- 172.21.15.194:0/1919201982 wait complete. 2024-09-13T06:09:58.836 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-13T06:09:58.800351Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:09:58.800335Z', 'tags': [], 'group_ids': []} 2024-09-13T06:09:58.844 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-13T06:09:58.850 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T06:09:58.850 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:myfoo'] 2024-09-13T06:09:58.850 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:myfoo'] 2024-09-13T06:09:58.851 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:myfoo 2024-09-13T06:09:58.912 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:09:58.912 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:09:58.913 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.911+0000 7fafcd62d980 1 Processor -- start 2024-09-13T06:09:58.913 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.911+0000 7fafcd62d980 1 -- start start 2024-09-13T06:09:58.913 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.911+0000 7fafcd62d980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55f79178b930 0x55f79178dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.913 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.911+0000 7fafcd62d980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f79160dae0 con 0x55f791787df0 2024-09-13T06:09:58.913 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.911+0000 7fafcd62d980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x55f791631e30 con 0x55f79178b930 2024-09-13T06:09:58.914 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.911+0000 7fafca93c640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55f79178b930 0x55f79178dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.914 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.911+0000 7fafcb13d640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x55f791787df0 0x55f79178a1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:51168/0 (socket says 172.21.15.194:51168) 2024-09-13T06:09:58.914 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.911+0000 7fafcb13d640 1 -- 172.21.15.194:0/3252181590 learned_addr learned my addr 172.21.15.194:0/3252181590 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-09-13T06:09:58.914 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.911+0000 7fafca93c640 1 -- 172.21.15.194:0/3252181590 >> v1:172.21.15.120:6789/0 conn(0x55f791787df0 legacy=0x55f79178a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.914 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.911+0000 7fafca93c640 1 -- 172.21.15.194:0/3252181590 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f79178f3f0 con 0x55f79178b930 2024-09-13T06:09:58.916 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.915+0000 7fafca93c640 1 --2- 172.21.15.194:0/3252181590 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f79178b930 0x55f79178dd50 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fafb400a480 tx=0x7fafb401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da940314ec6013c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.917 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.915+0000 7fafca13b640 1 -- 172.21.15.194:0/3252181590 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafb40b0070 con 0x55f79178b930 2024-09-13T06:09:58.917 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.915+0000 7fafca13b640 1 -- 172.21.15.194:0/3252181590 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafb40ab540 con 0x55f79178b930 2024-09-13T06:09:58.917 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.915+0000 7fafca13b640 1 -- 172.21.15.194:0/3252181590 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafb40ab840 con 0x55f79178b930 2024-09-13T06:09:58.917 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.915+0000 7fafcd62d980 1 -- 172.21.15.194:0/3252181590 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f79178b930 msgr2=0x55f79178dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.918 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.915+0000 7fafcd62d980 1 --2- 172.21.15.194:0/3252181590 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f79178b930 0x55f79178dd50 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fafb400a480 tx=0x7fafb401b280 comp rx=0 tx=0).stop 2024-09-13T06:09:58.918 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.915+0000 7fafcd62d980 1 -- 172.21.15.194:0/3252181590 shutdown_connections 2024-09-13T06:09:58.918 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.915+0000 7fafcd62d980 1 --2- 172.21.15.194:0/3252181590 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f79178b930 0x55f79178dd50 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.918 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.915+0000 7fafcd62d980 1 -- 172.21.15.194:0/3252181590 >> 172.21.15.194:0/3252181590 conn(0x55f7916fb280 msgr2=0x55f7916fb690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:58.918 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.915+0000 7fafcd62d980 1 -- 172.21.15.194:0/3252181590 shutdown_connections 2024-09-13T06:09:58.918 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.915+0000 7fafcd62d980 1 -- 172.21.15.194:0/3252181590 wait complete. 2024-09-13T06:09:58.933 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.931+0000 7fafcd62d980 1 Processor -- start 2024-09-13T06:09:58.934 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.931+0000 7fafcd62d980 1 -- start start 2024-09-13T06:09:58.934 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.931+0000 7fafcd62d980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f791787df0 0x55f791872d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.934 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.931+0000 7fafcd62d980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55f791633200 con 0x55f791787df0 2024-09-13T06:09:58.934 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.931+0000 7fafcb13d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f791787df0 0x55f791872d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.934 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.931+0000 7fafcb13d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f791787df0 0x55f791872d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45626/0 (socket says 172.21.15.194:45626) 2024-09-13T06:09:58.934 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.931+0000 7fafcb13d640 1 -- 172.21.15.194:0/1845693906 learned_addr learned my addr 172.21.15.194:0/1845693906 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:58.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.931+0000 7fafcb13d640 1 -- 172.21.15.194:0/1845693906 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f791873300 con 0x55f791787df0 2024-09-13T06:09:58.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.935+0000 7fafcb13d640 1 --2- 172.21.15.194:0/1845693906 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f791787df0 0x55f791872d30 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fafbc0017b0 tx=0x7fafbc001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f661500d841bdb43 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.935+0000 7faeb960a640 1 -- 172.21.15.194:0/1845693906 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafbc016070 con 0x55f791787df0 2024-09-13T06:09:58.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.935+0000 7faeb960a640 1 -- 172.21.15.194:0/1845693906 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafbc004530 con 0x55f791787df0 2024-09-13T06:09:58.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.935+0000 7faeb960a640 1 -- 172.21.15.194:0/1845693906 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafbc004870 con 0x55f791787df0 2024-09-13T06:09:58.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.935+0000 7fafcd62d980 1 -- 172.21.15.194:0/1845693906 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f791787df0 msgr2=0x55f791872d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.935+0000 7fafcd62d980 1 --2- 172.21.15.194:0/1845693906 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f791787df0 0x55f791872d30 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fafbc0017b0 tx=0x7fafbc001c70 comp rx=0 tx=0).stop 2024-09-13T06:09:58.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.935+0000 7fafcd62d980 1 -- 172.21.15.194:0/1845693906 shutdown_connections 2024-09-13T06:09:58.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.935+0000 7fafcd62d980 1 --2- 172.21.15.194:0/1845693906 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f791787df0 0x55f791872d30 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.935+0000 7fafcd62d980 1 -- 172.21.15.194:0/1845693906 >> 172.21.15.194:0/1845693906 conn(0x55f7916fb280 msgr2=0x55f79186e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:58.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.935+0000 7fafcd62d980 1 -- 172.21.15.194:0/1845693906 shutdown_connections 2024-09-13T06:09:58.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.935+0000 7fafcd62d980 1 -- 172.21.15.194:0/1845693906 wait complete. 2024-09-13T06:09:58.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.935+0000 7fafcd62d980 1 Processor -- start 2024-09-13T06:09:58.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.935+0000 7fafcd62d980 1 -- start start 2024-09-13T06:09:58.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.935+0000 7fafcd62d980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f791787df0 0x55f79187a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.935+0000 7fafcd62d980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55f79178eec0 con 0x55f791787df0 2024-09-13T06:09:58.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.935+0000 7fafcb13d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f791787df0 0x55f79187a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.935+0000 7fafcb13d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f791787df0 0x55f79187a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45628/0 (socket says 172.21.15.194:45628) 2024-09-13T06:09:58.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.935+0000 7fafcb13d640 1 -- 172.21.15.194:0/439978235 learned_addr learned my addr 172.21.15.194:0/439978235 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:58.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.935+0000 7fafcb13d640 1 -- 172.21.15.194:0/439978235 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f79187a540 con 0x55f791787df0 2024-09-13T06:09:58.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.935+0000 7fafcb13d640 1 --2- 172.21.15.194:0/439978235 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f791787df0 0x55f79187a000 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fafbc000f90 tx=0x7fafbc001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.935+0000 7faeb7e07640 1 -- 172.21.15.194:0/439978235 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafbc020070 con 0x55f791787df0 2024-09-13T06:09:58.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.935+0000 7fafcd62d980 1 -- 172.21.15.194:0/439978235 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f79187a7d0 con 0x55f791787df0 2024-09-13T06:09:58.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.935+0000 7faeb7e07640 1 -- 172.21.15.194:0/439978235 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafbc011400 con 0x55f791787df0 2024-09-13T06:09:58.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.935+0000 7faeb7e07640 1 -- 172.21.15.194:0/439978235 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafbc016040 con 0x55f791787df0 2024-09-13T06:09:58.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.935+0000 7fafcd62d980 1 -- 172.21.15.194:0/439978235 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f79187d4b0 con 0x55f791787df0 2024-09-13T06:09:58.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.939+0000 7faeb7e07640 1 -- 172.21.15.194:0/439978235 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fafbc023070 con 0x55f791787df0 2024-09-13T06:09:58.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.939+0000 7faeb7e07640 1 --2- 172.21.15.194:0/439978235 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7faeb0034650 0x7faeb0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.939+0000 7faeb7e07640 1 -- 172.21.15.194:0/439978235 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fafbc049230 con 0x55f791787df0 2024-09-13T06:09:58.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.939+0000 7fafca93c640 1 --2- 172.21.15.194:0/439978235 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7faeb0034650 0x7faeb0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.939+0000 7fafcd62d980 1 --2- 172.21.15.194:0/439978235 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55f79178b930 0x55f791881100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.939+0000 7fafcd62d980 1 -- 172.21.15.194:0/439978235 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f791881640 con 0x55f79178b930 2024-09-13T06:09:58.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.939+0000 7fafcb93e640 1 --2- 172.21.15.194:0/439978235 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55f79178b930 0x55f791881100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.939+0000 7fafca93c640 1 --2- 172.21.15.194:0/439978235 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7faeb0034650 0x7faeb0036b10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fafb40ad000 tx=0x7fafb40a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.939+0000 7fafcb93e640 1 --2- 172.21.15.194:0/439978235 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55f79178b930 0x55f791881100 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.939+0000 7fafcb93e640 1 -- 172.21.15.194:0/439978235 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fafc40083f0 con 0x55f79178b930 2024-09-13T06:09:58.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.939+0000 7fafcd62d980 1 -- 172.21.15.194:0/439978235 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f79187e6b0 con 0x55f79178b930 2024-09-13T06:09:58.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.939+0000 7fafcb93e640 1 -- 172.21.15.194:0/439978235 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fafc40083f0 con 0x55f79178b930 2024-09-13T06:09:58.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.939+0000 7fafcd62d980 1 --2- 172.21.15.194:0/439978235 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55f791883910 0x55f791885d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.939+0000 7fafcd62d980 1 -- 172.21.15.194:0/439978235 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f7918863d0 con 0x55f791883910 2024-09-13T06:09:58.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.939+0000 7fafcb13d640 1 --2- 172.21.15.194:0/439978235 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55f791883910 0x55f791885d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.939+0000 7fafcb13d640 1 --2- 172.21.15.194:0/439978235 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55f791883910 0x55f791885d00 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.939+0000 7fafcb13d640 1 -- 172.21.15.194:0/439978235 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fafbc02c070 con 0x55f791883910 2024-09-13T06:09:58.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.939+0000 7fafcd62d980 1 -- 172.21.15.194:0/439978235 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f791882780 con 0x55f79178b930 2024-09-13T06:09:58.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.939+0000 7fafcb93e640 1 -- 172.21.15.194:0/439978235 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fafc40083f0 con 0x55f79178b930 2024-09-13T06:09:58.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.939+0000 7fafcd62d980 1 --2- 172.21.15.194:0/439978235 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55f791887830 0x55f791889c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.939+0000 7fafcd62d980 1 -- 172.21.15.194:0/439978235 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f79188a310 con 0x55f791887830 2024-09-13T06:09:58.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.939+0000 7fafca93c640 1 --2- 172.21.15.194:0/439978235 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55f791887830 0x55f791889c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.944 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.943+0000 7fafca93c640 1 --2- 172.21.15.194:0/439978235 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55f791887830 0x55f791889c20 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.945 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.943+0000 7fafca93c640 1 -- 172.21.15.194:0/439978235 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fafb40b3040 con 0x55f791887830 2024-09-13T06:09:58.945 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.943+0000 7fafcd62d980 1 Processor -- start 2024-09-13T06:09:58.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.943+0000 7fafcd62d980 1 -- start start 2024-09-13T06:09:58.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.943+0000 7fafcd62d980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f791897dc0 0x55f7918981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.943+0000 7fafcd62d980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55f79168c800 con 0x55f791897dc0 2024-09-13T06:09:58.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.943+0000 7fafcb13d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f791897dc0 0x55f7918981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.943+0000 7fafcb13d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f791897dc0 0x55f7918981e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45644/0 (socket says 172.21.15.194:45644) 2024-09-13T06:09:58.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.943+0000 7fafcb13d640 1 -- 172.21.15.194:0/987678902 learned_addr learned my addr 172.21.15.194:0/987678902 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:58.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.943+0000 7fafcb13d640 1 -- 172.21.15.194:0/987678902 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f791898720 con 0x55f791897dc0 2024-09-13T06:09:58.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.943+0000 7fafcb13d640 1 --2- 172.21.15.194:0/987678902 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f791897dc0 0x55f7918981e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fafbc0475c0 tx=0x7fafbc023ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.943+0000 7faeb5602640 1 -- 172.21.15.194:0/987678902 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafbc02a040 con 0x55f791897dc0 2024-09-13T06:09:58.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.943+0000 7fafcd62d980 1 -- 172.21.15.194:0/987678902 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f7918989b0 con 0x55f791897dc0 2024-09-13T06:09:58.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.943+0000 7faeb5602640 1 -- 172.21.15.194:0/987678902 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafbc023db0 con 0x55f791897dc0 2024-09-13T06:09:58.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.943+0000 7fafcd62d980 1 -- 172.21.15.194:0/987678902 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f79189b630 con 0x55f791897dc0 2024-09-13T06:09:58.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.943+0000 7faeb5602640 1 -- 172.21.15.194:0/987678902 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafbc02a420 con 0x55f791897dc0 2024-09-13T06:09:58.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.947+0000 7faeb5602640 1 -- 172.21.15.194:0/987678902 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fafbc011850 con 0x55f791897dc0 2024-09-13T06:09:58.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.947+0000 7faeb5602640 1 --2- 172.21.15.194:0/987678902 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7faea40346a0 0x7faea4036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.947+0000 7faeb5602640 1 -- 172.21.15.194:0/987678902 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fafbc036070 con 0x55f791897dc0 2024-09-13T06:09:58.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.947+0000 7fafca93c640 1 --2- 172.21.15.194:0/987678902 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7faea40346a0 0x7faea4036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.947+0000 7fafcd62d980 1 Processor -- start 2024-09-13T06:09:58.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.947+0000 7fafcd62d980 1 -- start start 2024-09-13T06:09:58.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.947+0000 7fafcd62d980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f7918a46f0 0x55f7918a4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.947+0000 7fafcd62d980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55f791873680 con 0x55f7918a46f0 2024-09-13T06:09:58.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.947+0000 7fafca93c640 1 --2- 172.21.15.194:0/987678902 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7faea40346a0 0x7faea4036b60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x55f791881ec0 tx=0x7fafb4005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.949 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.947+0000 7fafcb13d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f7918a46f0 0x55f7918a4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.949 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.947+0000 7fafcb13d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f7918a46f0 0x55f7918a4ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45650/0 (socket says 172.21.15.194:45650) 2024-09-13T06:09:58.949 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.947+0000 7fafcb13d640 1 -- 172.21.15.194:0/2465477575 learned_addr learned my addr 172.21.15.194:0/2465477575 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:58.950 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.947+0000 7fafcb13d640 1 -- 172.21.15.194:0/2465477575 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7918a50a0 con 0x55f7918a46f0 2024-09-13T06:09:58.950 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.947+0000 7fafcb13d640 1 --2- 172.21.15.194:0/2465477575 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f7918a46f0 0x55f7918a4ad0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fafbc02b000 tx=0x7fafbc02ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5df1859cbf315d58 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.947+0000 7faeaeffd640 1 -- 172.21.15.194:0/2465477575 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafbc02dda0 con 0x55f7918a46f0 2024-09-13T06:09:58.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.947+0000 7faeaeffd640 1 -- 172.21.15.194:0/2465477575 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafbc040670 con 0x55f7918a46f0 2024-09-13T06:09:58.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.947+0000 7faeaeffd640 1 -- 172.21.15.194:0/2465477575 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafbc045dc0 con 0x55f7918a46f0 2024-09-13T06:09:58.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.947+0000 7fafcd62d980 1 -- 172.21.15.194:0/2465477575 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f7918a46f0 msgr2=0x55f7918a4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:58.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.947+0000 7fafcd62d980 1 --2- 172.21.15.194:0/2465477575 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f7918a46f0 0x55f7918a4ad0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fafbc02b000 tx=0x7fafbc02ad10 comp rx=0 tx=0).stop 2024-09-13T06:09:58.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.947+0000 7fafcd62d980 1 -- 172.21.15.194:0/2465477575 shutdown_connections 2024-09-13T06:09:58.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.947+0000 7fafcd62d980 1 --2- 172.21.15.194:0/2465477575 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f7918a46f0 0x55f7918a4ad0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:58.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.947+0000 7fafcd62d980 1 -- 172.21.15.194:0/2465477575 >> 172.21.15.194:0/2465477575 conn(0x55f7918a0ad0 msgr2=0x55f79189ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:58.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.947+0000 7fafcd62d980 1 -- 172.21.15.194:0/2465477575 shutdown_connections 2024-09-13T06:09:58.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.947+0000 7fafcd62d980 1 -- 172.21.15.194:0/2465477575 wait complete. 2024-09-13T06:09:58.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.947+0000 7fafcd62d980 1 Processor -- start 2024-09-13T06:09:58.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.947+0000 7fafcd62d980 1 -- start start 2024-09-13T06:09:58.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.951+0000 7fafcd62d980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f7918a46f0 0x55f7918ab8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.951+0000 7fafcd62d980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55f7918a5540 con 0x55f7918a46f0 2024-09-13T06:09:58.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.951+0000 7fafcb13d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f7918a46f0 0x55f7918ab8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.951+0000 7fafcb13d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f7918a46f0 0x55f7918ab8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45656/0 (socket says 172.21.15.194:45656) 2024-09-13T06:09:58.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.951+0000 7fafcb13d640 1 -- 172.21.15.194:0/1908838660 learned_addr learned my addr 172.21.15.194:0/1908838660 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:58.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.951+0000 7fafcb13d640 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7918abe30 con 0x55f7918a46f0 2024-09-13T06:09:58.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.951+0000 7fafcb13d640 1 --2- 172.21.15.194:0/1908838660 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f7918a46f0 0x55f7918ab8f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fafbc026ae0 tx=0x7fafbc005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.951+0000 7faead7fa640 1 -- 172.21.15.194:0/1908838660 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafbc045e80 con 0x55f7918a46f0 2024-09-13T06:09:58.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.951+0000 7faead7fa640 1 -- 172.21.15.194:0/1908838660 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafbc063070 con 0x55f7918a46f0 2024-09-13T06:09:58.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.951+0000 7fafcd62d980 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f7918abe30 con 0x55f7918a46f0 2024-09-13T06:09:58.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.951+0000 7faead7fa640 1 -- 172.21.15.194:0/1908838660 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafbc026d80 con 0x55f7918a46f0 2024-09-13T06:09:58.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.951+0000 7fafcd62d980 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7918ac300 con 0x55f7918a46f0 2024-09-13T06:09:58.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.951+0000 7faead7fa640 1 -- 172.21.15.194:0/1908838660 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fafbc05a040 con 0x55f7918a46f0 2024-09-13T06:09:58.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.951+0000 7fafcd62d980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.955 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.951+0000 7faead7fa640 1 --2- 172.21.15.194:0/1908838660 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fae94034650 0x7fae94036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.955 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.951+0000 7faead7fa640 1 -- 172.21.15.194:0/1908838660 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fafbc058020 con 0x55f7918a46f0 2024-09-13T06:09:58.955 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.951+0000 7fafca93c640 1 --2- 172.21.15.194:0/1908838660 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fae94034650 0x7fae94036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.955 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.951+0000 7fafcd62d980 1 --2- 172.21.15.194:0/1908838660 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55f7918b68d0 0x55f7918b8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.955 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.951+0000 7fafcd62d980 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f7918b94c0 con 0x55f7918b68d0 2024-09-13T06:09:58.955 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.951+0000 7fafcb93e640 1 --2- 172.21.15.194:0/1908838660 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55f7918b68d0 0x55f7918b8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.955 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.951+0000 7fafca93c640 1 --2- 172.21.15.194:0/1908838660 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fae94034650 0x7fae94036b10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fafb4000c10 tx=0x7fafb40b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.955 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.951+0000 7fafcb93e640 1 --2- 172.21.15.194:0/1908838660 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55f7918b68d0 0x55f7918b8d70 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.965 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.955+0000 7fafcb93e640 1 -- 172.21.15.194:0/1908838660 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fafc40083f0 con 0x55f7918b68d0 2024-09-13T06:09:58.965 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.955+0000 7fafcd62d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:58.965 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.955+0000 7fafcd62d980 20 realm 2024-09-13T06:09:58.965 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.955+0000 7fafcd62d980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.965 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.955+0000 7fafcd62d980 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f7918b98d0 con 0x55f7918b68d0 2024-09-13T06:09:58.965 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.955+0000 7fafcb93e640 1 -- 172.21.15.194:0/1908838660 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fafc40083f0 con 0x55f7918b68d0 2024-09-13T06:09:58.965 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.955+0000 7fafcd62d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:58.965 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.955+0000 7fafcd62d980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:09:58.965 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.955+0000 7fafcd62d980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.955+0000 7fafcd62d980 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f7918ba170 con 0x55f7918b68d0 2024-09-13T06:09:58.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.955+0000 7fafcb93e640 1 -- 172.21.15.194:0/1908838660 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fafc40083f0 con 0x55f7918b68d0 2024-09-13T06:09:58.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.955+0000 7fafcd62d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:58.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.955+0000 7fafcd62d980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.955+0000 7fafcd62d980 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f7918ba510 con 0x55f7918b68d0 2024-09-13T06:09:58.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.955+0000 7fafcb93e640 1 -- 172.21.15.194:0/1908838660 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fafc40083f0 con 0x55f7918b68d0 2024-09-13T06:09:58.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.955+0000 7fafcd62d980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:58.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.955+0000 7fafcd62d980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.955+0000 7fafcd62d980 1 --2- 172.21.15.194:0/1908838660 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55f7918bb270 0x55f7918bd660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.955+0000 7fafcd62d980 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f7918bdbe0 con 0x55f7918bb270 2024-09-13T06:09:58.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.955+0000 7fafcb13d640 1 --2- 172.21.15.194:0/1908838660 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55f7918bb270 0x55f7918bd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.955+0000 7fafcb13d640 1 --2- 172.21.15.194:0/1908838660 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55f7918bb270 0x55f7918bd660 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.955+0000 7fafcb13d640 1 -- 172.21.15.194:0/1908838660 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fafbc02c070 con 0x55f7918bb270 2024-09-13T06:09:58.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.955+0000 7fafcd62d980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:09:58.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.955+0000 7fafcd62d980 20 searching for the correct realm 2024-09-13T06:09:58.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.955+0000 7fafcd62d980 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f7918bf460 con 0x55f7918bb270 2024-09-13T06:09:58.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.955+0000 7fafcb13d640 1 -- 172.21.15.194:0/1908838660 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafbc02c070 con 0x55f7918bb270 2024-09-13T06:09:58.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.955+0000 7fafcb13d640 1 --2- 172.21.15.194:0/1908838660 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fafbc068c20 0x7fafbc0498e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.955+0000 7fafcb13d640 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f7918bf460 con 0x7fafbc068c20 2024-09-13T06:09:58.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.955+0000 7fafca93c640 1 --2- 172.21.15.194:0/1908838660 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fafbc068c20 0x7fafbc0498e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.955+0000 7fafca93c640 1 --2- 172.21.15.194:0/1908838660 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fafbc068c20 0x7fafbc0498e0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.955+0000 7fafca93c640 1 -- 172.21.15.194:0/1908838660 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fafb40c9030 con 0x7fafbc068c20 2024-09-13T06:09:58.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.955+0000 7fafca93c640 1 --2- 172.21.15.194:0/1908838660 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fafb40dc040 0x7fafb40dd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:58.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.955+0000 7fafca93c640 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f7918bf460 con 0x7fafb40dc040 2024-09-13T06:09:58.968 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.955+0000 7fafcb93e640 1 --2- 172.21.15.194:0/1908838660 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fafb40dc040 0x7fafb40dd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:58.968 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.959+0000 7fafcb93e640 1 --2- 172.21.15.194:0/1908838660 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fafb40dc040 0x7fafb40dd430 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:58.968 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.959+0000 7fafcb93e640 1 -- 172.21.15.194:0/1908838660 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc40083f0 con 0x7fafb40dc040 2024-09-13T06:09:58.968 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.959+0000 7fafcb93e640 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f7918ba510 con 0x55f7918b68d0 2024-09-13T06:09:58.968 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.959+0000 7fafcb93e640 1 -- 172.21.15.194:0/1908838660 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc40083f0 con 0x55f7918b68d0 2024-09-13T06:09:58.968 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.959+0000 7fafcb93e640 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f7918ba510 con 0x55f7918b68d0 2024-09-13T06:09:58.968 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.959+0000 7fafcb93e640 1 -- 172.21.15.194:0/1908838660 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc40083f0 con 0x55f7918b68d0 2024-09-13T06:09:58.968 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.959+0000 7fafcb93e640 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f7918ba510 con 0x7fafb40dc040 2024-09-13T06:09:58.968 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.959+0000 7fafcb93e640 1 -- 172.21.15.194:0/1908838660 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc40083f0 con 0x7fafb40dc040 2024-09-13T06:09:58.968 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.959+0000 7fafcb93e640 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f7918ba510 con 0x7fafb40dc040 2024-09-13T06:09:58.968 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.959+0000 7fafcb93e640 1 -- 172.21.15.194:0/1908838660 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc40083f0 con 0x7fafb40dc040 2024-09-13T06:09:58.968 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.959+0000 7fafcb93e640 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f7918ba510 con 0x7fafbc068c20 2024-09-13T06:09:58.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.959+0000 7fafca93c640 1 -- 172.21.15.194:0/1908838660 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafb40c9030 con 0x7fafbc068c20 2024-09-13T06:09:58.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.959+0000 7fafca93c640 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f7918ba510 con 0x55f7918bb270 2024-09-13T06:09:58.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.959+0000 7fafcb13d640 1 -- 172.21.15.194:0/1908838660 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafbc02c070 con 0x55f7918bb270 2024-09-13T06:09:58.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.959+0000 7fafcb13d640 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f7918ba510 con 0x55f7918b68d0 2024-09-13T06:09:58.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.959+0000 7fafcb93e640 1 -- 172.21.15.194:0/1908838660 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc40083f0 con 0x55f7918b68d0 2024-09-13T06:09:58.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.959+0000 7fafcb93e640 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f7918ba510 con 0x7fafb40dc040 2024-09-13T06:09:58.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.963+0000 7fafcb93e640 1 -- 172.21.15.194:0/1908838660 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc40083f0 con 0x7fafb40dc040 2024-09-13T06:09:58.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.963+0000 7fafcb93e640 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f7918ba510 con 0x55f7918b68d0 2024-09-13T06:09:58.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.963+0000 7fafcb93e640 1 -- 172.21.15.194:0/1908838660 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc40083f0 con 0x55f7918b68d0 2024-09-13T06:09:58.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.963+0000 7fafcb93e640 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f7918ba510 con 0x7fafbc068c20 2024-09-13T06:09:58.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.963+0000 7fafca93c640 1 -- 172.21.15.194:0/1908838660 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fafb40c9030 con 0x7fafbc068c20 2024-09-13T06:09:58.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.963+0000 7fafca93c640 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f7918ba510 con 0x55f7918bb270 2024-09-13T06:09:58.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.963+0000 7fafcb13d640 1 -- 172.21.15.194:0/1908838660 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafbc02c070 con 0x55f7918bb270 2024-09-13T06:09:58.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.963+0000 7fafcb13d640 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f7918ba510 con 0x55f7918bb270 2024-09-13T06:09:58.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.963+0000 7fafcb13d640 1 -- 172.21.15.194:0/1908838660 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafbc02c070 con 0x55f7918bb270 2024-09-13T06:09:58.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.963+0000 7fafcb13d640 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f7918ba510 con 0x7fafb40dc040 2024-09-13T06:09:58.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.963+0000 7fafcb93e640 1 -- 172.21.15.194:0/1908838660 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc40083f0 con 0x7fafb40dc040 2024-09-13T06:09:58.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.963+0000 7fafcb93e640 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f7918ba510 con 0x55f7918bb270 2024-09-13T06:09:58.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.963+0000 7fafcb13d640 1 -- 172.21.15.194:0/1908838660 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafbc02c070 con 0x55f7918bb270 2024-09-13T06:09:58.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.963+0000 7fafcb13d640 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f7918ba510 con 0x55f7918bb270 2024-09-13T06:09:58.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.963+0000 7fafcb13d640 1 -- 172.21.15.194:0/1908838660 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafbc02c070 con 0x55f7918bb270 2024-09-13T06:09:58.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.963+0000 7fafcb13d640 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f7918ba510 con 0x55f7918b68d0 2024-09-13T06:09:58.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.963+0000 7fafcb93e640 1 -- 172.21.15.194:0/1908838660 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc40083f0 con 0x55f7918b68d0 2024-09-13T06:09:58.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.963+0000 7fafcb93e640 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f7918ba510 con 0x55f7918b68d0 2024-09-13T06:09:58.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.963+0000 7fafcb93e640 1 -- 172.21.15.194:0/1908838660 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fafc40083f0 con 0x55f7918b68d0 2024-09-13T06:09:58.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.963+0000 7fafcb93e640 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f7918ba510 con 0x7fafb40dc040 2024-09-13T06:09:58.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.963+0000 7fafcb93e640 1 -- 172.21.15.194:0/1908838660 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc40083f0 con 0x7fafb40dc040 2024-09-13T06:09:58.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.963+0000 7fafcb93e640 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f7918ba510 con 0x55f7918bb270 2024-09-13T06:09:58.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.963+0000 7fafcb13d640 1 -- 172.21.15.194:0/1908838660 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafbc02c070 con 0x55f7918bb270 2024-09-13T06:09:58.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.963+0000 7fafcb13d640 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f7918ba510 con 0x7fafbc068c20 2024-09-13T06:09:58.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.967+0000 7fafca93c640 1 -- 172.21.15.194:0/1908838660 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafb40c9030 con 0x7fafbc068c20 2024-09-13T06:09:58.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.967+0000 7fafca93c640 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f7918ba510 con 0x55f7918b68d0 2024-09-13T06:09:58.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.967+0000 7fafcb93e640 1 -- 172.21.15.194:0/1908838660 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc40083f0 con 0x55f7918b68d0 2024-09-13T06:09:58.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.967+0000 7fafcb93e640 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f7918ba510 con 0x7fafb40dc040 2024-09-13T06:09:58.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.967+0000 7fafcb93e640 1 -- 172.21.15.194:0/1908838660 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc40083f0 con 0x7fafb40dc040 2024-09-13T06:09:58.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.967+0000 7fafcb93e640 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f7918ba510 con 0x55f7918bb270 2024-09-13T06:09:58.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.967+0000 7fafcb13d640 1 -- 172.21.15.194:0/1908838660 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fafbc02c070 con 0x55f7918bb270 2024-09-13T06:09:58.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.967+0000 7fafcb13d640 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f7918ba510 con 0x7fafb40dc040 2024-09-13T06:09:58.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.967+0000 7fafcb93e640 1 -- 172.21.15.194:0/1908838660 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc40083f0 con 0x7fafb40dc040 2024-09-13T06:09:58.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.967+0000 7fafcb93e640 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f7918ba510 con 0x7fafbc068c20 2024-09-13T06:09:58.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.967+0000 7fafca93c640 1 -- 172.21.15.194:0/1908838660 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafb40c9030 con 0x7fafbc068c20 2024-09-13T06:09:58.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.967+0000 7fafca93c640 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f7918ba510 con 0x55f7918bb270 2024-09-13T06:09:58.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.967+0000 7fafcb13d640 1 -- 172.21.15.194:0/1908838660 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafbc02c070 con 0x55f7918bb270 2024-09-13T06:09:58.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.967+0000 7fafcb13d640 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f7918ba510 con 0x7fafb40dc040 2024-09-13T06:09:58.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.967+0000 7fafcb93e640 1 -- 172.21.15.194:0/1908838660 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc40083f0 con 0x7fafb40dc040 2024-09-13T06:09:58.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.967+0000 7fafcb93e640 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f7918ba510 con 0x55f7918b68d0 2024-09-13T06:09:58.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.967+0000 7fafcb93e640 1 -- 172.21.15.194:0/1908838660 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fafc40083f0 con 0x55f7918b68d0 2024-09-13T06:09:58.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.967+0000 7fafcb93e640 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f7918ba510 con 0x7fafbc068c20 2024-09-13T06:09:58.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.967+0000 7fafca93c640 1 -- 172.21.15.194:0/1908838660 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafb40c9030 con 0x7fafbc068c20 2024-09-13T06:09:58.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.967+0000 7fafcd62d980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:09:58.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.967+0000 7fafcd62d980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:09:58.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.967+0000 7fafcd62d980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:09:58.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.967+0000 7fafcd62d980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:09:58.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.967+0000 7fafcd62d980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:09:58.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.967+0000 7fafcd62d980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:09:58.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.967+0000 7fafcd62d980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.967+0000 7fafcd62d980 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f7918be430 con 0x55f7918b68d0 2024-09-13T06:09:58.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.971+0000 7fafcb93e640 1 -- 172.21.15.194:0/1908838660 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fafc40083f0 con 0x55f7918b68d0 2024-09-13T06:09:58.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.971+0000 7fafcd62d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:58.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.971+0000 7fafcd62d980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.971+0000 7fafcd62d980 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f7918be820 con 0x55f7918b68d0 2024-09-13T06:09:58.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.971+0000 7fafcb93e640 1 -- 172.21.15.194:0/1908838660 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fafc40083f0 con 0x55f7918b68d0 2024-09-13T06:09:58.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.971+0000 7fafcd62d980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:58.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.971+0000 7fafcd62d980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.971+0000 7fafcd62d980 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f7918be820 con 0x7fafbc068c20 2024-09-13T06:09:58.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.971+0000 7fafca93c640 1 -- 172.21.15.194:0/1908838660 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fafb40c9030 con 0x7fafbc068c20 2024-09-13T06:09:58.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.971+0000 7fafcd62d980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:09:58.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.971+0000 7fafcd62d980 20 zone default found 2024-09-13T06:09:58.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.971+0000 7fafcd62d980 4 Realm: () 2024-09-13T06:09:58.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.971+0000 7fafcd62d980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:09:58.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.971+0000 7fafcd62d980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:09:58.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.971+0000 7fafcd62d980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:09:58.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.971+0000 7fafcd62d980 20 zonegroup default 2024-09-13T06:09:58.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.971+0000 7fafcd62d980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.971+0000 7fafcd62d980 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f7918bf930 con 0x7fafb40dc040 2024-09-13T06:09:58.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.971+0000 7fafcb93e640 1 -- 172.21.15.194:0/1908838660 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fafc40083f0 con 0x7fafb40dc040 2024-09-13T06:09:58.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.971+0000 7fafcd62d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:58.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.971+0000 7fafcd62d980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.971+0000 7fafcd62d980 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f7918c1310 con 0x55f7918bb270 2024-09-13T06:09:58.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.971+0000 7fafcb13d640 1 -- 172.21.15.194:0/1908838660 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fafbc02c070 con 0x55f7918bb270 2024-09-13T06:09:58.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.971+0000 7fafcd62d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:58.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.971+0000 7fafcd62d980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.971+0000 7fafcd62d980 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f7918c16b0 con 0x55f7918bb270 2024-09-13T06:09:58.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.971+0000 7fafcb13d640 1 -- 172.21.15.194:0/1908838660 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fafbc02c070 con 0x55f7918bb270 2024-09-13T06:09:58.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.971+0000 7fafcd62d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:58.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.971+0000 7fafcd62d980 20 started sync module instance, tier type = 2024-09-13T06:09:58.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.971+0000 7fafcd62d980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:09:58.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.971+0000 7fafcd62d980 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f7918c07b0 con 0x7fafbc068c20 2024-09-13T06:09:58.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.971+0000 7fafca93c640 1 -- 172.21.15.194:0/1908838660 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(44 notify.0 [create] v33'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafb40c9030 con 0x7fafbc068c20 2024-09-13T06:09:58.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.971+0000 7fafcd62d980 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94521787157456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f7918c1f00 con 0x7fafbc068c20 2024-09-13T06:09:58.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.971+0000 7fafcd62d980 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f7918c2750 con 0x55f7918b68d0 2024-09-13T06:09:58.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.975+0000 7fafcb93e640 1 -- 172.21.15.194:0/1908838660 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v33'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc40083f0 con 0x55f7918b68d0 2024-09-13T06:09:58.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.975+0000 7fafcd62d980 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94521787163296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f7918c2bb0 con 0x55f7918b68d0 2024-09-13T06:09:58.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.975+0000 7fafcd62d980 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f7918c36b0 con 0x55f7918bb270 2024-09-13T06:09:58.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.975+0000 7fafca93c640 1 -- 172.21.15.194:0/1908838660 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94521787157456] v33'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafb40c9030 con 0x7fafbc068c20 2024-09-13T06:09:58.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.979+0000 7fafcb93e640 1 -- 172.21.15.194:0/1908838660 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94521787163296] v33'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc40083f0 con 0x55f7918b68d0 2024-09-13T06:09:58.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.979+0000 7fafcb13d640 1 -- 172.21.15.194:0/1908838660 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v33'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafbc02c070 con 0x55f7918bb270 2024-09-13T06:09:58.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.979+0000 7fafcd62d980 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94521787167136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f7918c26c0 con 0x55f7918bb270 2024-09-13T06:09:58.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.979+0000 7fafcd62d980 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f7918c3f80 con 0x7fafbc068c20 2024-09-13T06:09:58.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.979+0000 7fafca93c640 1 -- 172.21.15.194:0/1908838660 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(50 notify.3 [create] v33'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafb40c9030 con 0x7fafbc068c20 2024-09-13T06:09:58.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.979+0000 7fafcd62d980 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94521787171616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f7918c4bf0 con 0x7fafbc068c20 2024-09-13T06:09:58.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.979+0000 7fafcd62d980 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f7918c55b0 con 0x55f7918b68d0 2024-09-13T06:09:58.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.979+0000 7fafcb13d640 1 -- 172.21.15.194:0/1908838660 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94521787167136] v33'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafbc02c070 con 0x55f7918bb270 2024-09-13T06:09:58.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.979+0000 7fafca93c640 1 -- 172.21.15.194:0/1908838660 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94521787171616] v33'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafb40c9030 con 0x7fafbc068c20 2024-09-13T06:09:58.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.979+0000 7fafcb93e640 1 -- 172.21.15.194:0/1908838660 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v33'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc40083f0 con 0x55f7918b68d0 2024-09-13T06:09:58.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.979+0000 7fafcd62d980 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94521787172672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f7918c4b60 con 0x55f7918b68d0 2024-09-13T06:09:58.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.979+0000 7fafcd62d980 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f7918c5a60 con 0x7fafb40dc040 2024-09-13T06:09:58.985 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.983+0000 7fafcb93e640 1 -- 172.21.15.194:0/1908838660 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94521787172672] v33'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc40083f0 con 0x55f7918b68d0 2024-09-13T06:09:58.985 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.983+0000 7fafcb93e640 1 -- 172.21.15.194:0/1908838660 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(54 notify.5 [create] v33'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc40083f0 con 0x7fafb40dc040 2024-09-13T06:09:58.985 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.983+0000 7fafcd62d980 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94521787175168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f7918c59d0 con 0x7fafb40dc040 2024-09-13T06:09:58.985 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.983+0000 7fafcd62d980 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f7918c6280 con 0x7fafb40dc040 2024-09-13T06:09:58.986 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.983+0000 7fafcb93e640 1 -- 172.21.15.194:0/1908838660 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94521787175168] v33'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc40083f0 con 0x7fafb40dc040 2024-09-13T06:09:58.986 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.987+0000 7fafcb93e640 1 -- 172.21.15.194:0/1908838660 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(56 notify.6 [create] v33'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc40083f0 con 0x7fafb40dc040 2024-09-13T06:09:58.986 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.987+0000 7fafcd62d980 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94521787176224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f7918c5df0 con 0x7fafb40dc040 2024-09-13T06:09:58.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.987+0000 7fafcd62d980 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f7918c6cd0 con 0x7fafb40dc040 2024-09-13T06:09:58.989 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.987+0000 7fafcb93e640 1 -- 172.21.15.194:0/1908838660 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94521787176224] v33'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc40083f0 con 0x7fafb40dc040 2024-09-13T06:09:58.989 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.987+0000 7fafcb93e640 1 -- 172.21.15.194:0/1908838660 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(58 notify.7 [create] v33'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc40083f0 con 0x7fafb40dc040 2024-09-13T06:09:58.989 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.987+0000 7fafcd62d980 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94521787177280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f7918c6e70 con 0x7fafb40dc040 2024-09-13T06:09:58.989 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.987+0000 7fafcd62d980 20 add_watcher() i=0 2024-09-13T06:09:58.989 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.987+0000 7fafcd62d980 20 add_watcher() i=1 2024-09-13T06:09:58.989 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.987+0000 7fafcd62d980 20 add_watcher() i=2 2024-09-13T06:09:58.989 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.987+0000 7fafcd62d980 20 add_watcher() i=3 2024-09-13T06:09:58.989 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.987+0000 7fafcd62d980 20 add_watcher() i=4 2024-09-13T06:09:58.989 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.987+0000 7fafcd62d980 20 add_watcher() i=5 2024-09-13T06:09:58.989 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.987+0000 7fafcd62d980 20 add_watcher() i=6 2024-09-13T06:09:58.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.991+0000 7fafcb93e640 1 -- 172.21.15.194:0/1908838660 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94521787177280] v33'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc40083f0 con 0x7fafb40dc040 2024-09-13T06:09:58.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.991+0000 7fafcd62d980 20 add_watcher() i=7 2024-09-13T06:09:58.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.991+0000 7fafcd62d980 2 all 8 watchers are set, enabling cache 2024-09-13T06:09:58.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.991+0000 7fafcd62d980 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f7918ca090 con 0x55f7918b68d0 2024-09-13T06:09:58.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.991+0000 7fafcb93e640 1 -- 172.21.15.194:0/1908838660 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fafc40083f0 con 0x55f7918b68d0 2024-09-13T06:09:58.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.991+0000 7fafcd62d980 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94521787194048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f7918c6ed0 con 0x55f7918b68d0 2024-09-13T06:09:58.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.991+0000 7fafcb93e640 1 -- 172.21.15.194:0/1908838660 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94521787194048] v33'108 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fafc40083f0 con 0x55f7918b68d0 2024-09-13T06:09:58.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.991+0000 7fae81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:58.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.991+0000 7fafcd62d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:09:58.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.991+0000 7fafcd62d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:09:58.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.991+0000 7fafcd62d980 5 note: GC not initialized 2024-09-13T06:09:58.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.991+0000 7fae80fe1640 20 reqs_thread_entry: start 2024-09-13T06:09:58.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.991+0000 7fafcd62d980 20 init_complete bucket index max shards: 11 2024-09-13T06:09:58.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.991+0000 7fafcd62d980 20 Filter name: none 2024-09-13T06:09:58.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.991+0000 7fadfa7fc640 20 reqs_thread_entry: start 2024-09-13T06:09:58.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.991+0000 7fafcd62d980 20 rados->read ofs=0 len=0 2024-09-13T06:09:58.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.991+0000 7fafcd62d980 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f7918ed230 con 0x7fafbc068c20 2024-09-13T06:09:58.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.995+0000 7fafca93c640 1 -- 172.21.15.194:0/1908838660 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(62 myfoo [call out=48b,stat out=16b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv18 ondisk = 0) ==== 275+0+304 (crc 0 0 0) 0x7fafb40c9030 con 0x7fafbc068c20 2024-09-13T06:09:58.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.995+0000 7fafcd62d980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T06:09:58.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.995+0000 7fae81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:58.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.995+0000 7fafcd62d980 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94521787194048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f7918eb1f0 con 0x55f7918b68d0 2024-09-13T06:09:58.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.995+0000 7fafcb93e640 1 -- 172.21.15.194:0/1908838660 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94521787194048] v33'109 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fafc40083f0 con 0x55f7918b68d0 2024-09-13T06:09:58.997 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.995+0000 7fafcd62d980 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94521787157456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f7918eb1f0 con 0x7fafbc068c20 2024-09-13T06:09:58.998 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.995+0000 7fafca93c640 1 -- 172.21.15.194:0/1908838660 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94521787157456] v33'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafb40c9030 con 0x7fafbc068c20 2024-09-13T06:09:58.998 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.995+0000 7fafcd62d980 20 remove_watcher() i=0 2024-09-13T06:09:58.998 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.995+0000 7fafcd62d980 2 removed watcher, disabling cache 2024-09-13T06:09:58.998 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.995+0000 7fafcd62d980 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94521787163296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f7918eb1f0 con 0x55f7918b68d0 2024-09-13T06:09:59.000 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.999+0000 7fafcb93e640 1 -- 172.21.15.194:0/1908838660 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94521787163296] v33'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc40083f0 con 0x55f7918b68d0 2024-09-13T06:09:59.000 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.999+0000 7fafcd62d980 20 remove_watcher() i=1 2024-09-13T06:09:59.000 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.999+0000 7fafcd62d980 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94521787167136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f7918eb1f0 con 0x55f7918bb270 2024-09-13T06:09:59.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.999+0000 7fafcb13d640 1 -- 172.21.15.194:0/1908838660 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94521787167136] v33'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafbc02c070 con 0x55f7918bb270 2024-09-13T06:09:59.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.999+0000 7fafcd62d980 20 remove_watcher() i=2 2024-09-13T06:09:59.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:58.999+0000 7fafcd62d980 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94521787171616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f7918eb1f0 con 0x7fafbc068c20 2024-09-13T06:09:59.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.003+0000 7fafca93c640 1 -- 172.21.15.194:0/1908838660 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94521787171616] v33'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafb40c9030 con 0x7fafbc068c20 2024-09-13T06:09:59.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.003+0000 7fafcd62d980 20 remove_watcher() i=3 2024-09-13T06:09:59.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.003+0000 7fafcd62d980 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94521787172672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f7918eb1f0 con 0x55f7918b68d0 2024-09-13T06:09:59.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.003+0000 7fafcb93e640 1 -- 172.21.15.194:0/1908838660 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94521787172672] v33'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc40083f0 con 0x55f7918b68d0 2024-09-13T06:09:59.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.003+0000 7fafcd62d980 20 remove_watcher() i=4 2024-09-13T06:09:59.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.003+0000 7fafcd62d980 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94521787175168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f7918eb1f0 con 0x7fafb40dc040 2024-09-13T06:09:59.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.007+0000 7fafcb93e640 1 -- 172.21.15.194:0/1908838660 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94521787175168] v33'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc40083f0 con 0x7fafb40dc040 2024-09-13T06:09:59.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.007+0000 7fafcd62d980 20 remove_watcher() i=5 2024-09-13T06:09:59.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.007+0000 7fafcd62d980 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94521787176224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f7918eb1f0 con 0x7fafb40dc040 2024-09-13T06:09:59.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.007+0000 7fafcb93e640 1 -- 172.21.15.194:0/1908838660 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94521787176224] v33'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc40083f0 con 0x7fafb40dc040 2024-09-13T06:09:59.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.007+0000 7fafcd62d980 20 remove_watcher() i=6 2024-09-13T06:09:59.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.007+0000 7fafcd62d980 1 -- 172.21.15.194:0/1908838660 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94521787177280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f7918eb1f0 con 0x7fafb40dc040 2024-09-13T06:09:59.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.011+0000 7fafcb93e640 1 -- 172.21.15.194:0/1908838660 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94521787177280] v33'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc40083f0 con 0x7fafb40dc040 2024-09-13T06:09:59.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.011+0000 7fafcd62d980 20 remove_watcher() i=7 2024-09-13T06:09:59.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.011+0000 7fafcd62d980 1 -- 172.21.15.194:0/1908838660 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fafb40dc040 msgr2=0x7fafb40dd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.011+0000 7fafcd62d980 1 --2- 172.21.15.194:0/1908838660 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fafb40dc040 0x7fafb40dd430 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.011+0000 7fafcd62d980 1 -- 172.21.15.194:0/1908838660 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55f7918b68d0 msgr2=0x55f7918b8d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.011+0000 7fafcd62d980 1 --2- 172.21.15.194:0/1908838660 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55f7918b68d0 0x55f7918b8d70 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.011+0000 7fafcd62d980 1 -- 172.21.15.194:0/1908838660 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fafbc068c20 msgr2=0x7fafbc0498e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.011+0000 7fafcd62d980 1 --2- 172.21.15.194:0/1908838660 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fafbc068c20 0x7fafbc0498e0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.011+0000 7fafcd62d980 1 -- 172.21.15.194:0/1908838660 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55f7918bb270 msgr2=0x55f7918bd660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.011+0000 7fafcd62d980 1 --2- 172.21.15.194:0/1908838660 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55f7918bb270 0x55f7918bd660 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.011+0000 7fafcd62d980 1 -- 172.21.15.194:0/1908838660 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fae94034650 msgr2=0x7fae94036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.011+0000 7fafcd62d980 1 --2- 172.21.15.194:0/1908838660 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fae94034650 0x7fae94036b10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fafb4000c10 tx=0x7fafb40b9040 comp rx=0 tx=0).stop 2024-09-13T06:09:59.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.011+0000 7fafcd62d980 1 -- 172.21.15.194:0/1908838660 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f7918a46f0 msgr2=0x55f7918ab8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.011+0000 7fafcd62d980 1 --2- 172.21.15.194:0/1908838660 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f7918a46f0 0x55f7918ab8f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fafbc026ae0 tx=0x7fafbc005e80 comp rx=0 tx=0).stop 2024-09-13T06:09:59.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.011+0000 7fafcb93e640 1 -- 172.21.15.194:0/1908838660 reap_dead start 2024-09-13T06:09:59.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.011+0000 7fafcd62d980 1 -- 172.21.15.194:0/1908838660 shutdown_connections 2024-09-13T06:09:59.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.011+0000 7fafcd62d980 1 --2- 172.21.15.194:0/1908838660 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f7918a46f0 0x55f7918ab8f0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.011+0000 7fafcd62d980 1 -- 172.21.15.194:0/1908838660 >> 172.21.15.194:0/1908838660 conn(0x55f7918a0ad0 msgr2=0x55f79189eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:59.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.011+0000 7fafcd62d980 1 -- 172.21.15.194:0/1908838660 shutdown_connections 2024-09-13T06:09:59.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.011+0000 7fafcd62d980 1 -- 172.21.15.194:0/1908838660 wait complete. 2024-09-13T06:09:59.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.011+0000 7fafcd62d980 1 -- 172.21.15.194:0/987678902 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7faea40346a0 msgr2=0x7faea4036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.011+0000 7fafcd62d980 1 --2- 172.21.15.194:0/987678902 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7faea40346a0 0x7faea4036b60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x55f791881ec0 tx=0x7fafb4005a10 comp rx=0 tx=0).stop 2024-09-13T06:09:59.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.011+0000 7fafcd62d980 1 -- 172.21.15.194:0/987678902 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f791897dc0 msgr2=0x55f7918981e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.011+0000 7fafcd62d980 1 --2- 172.21.15.194:0/987678902 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f791897dc0 0x55f7918981e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fafbc0475c0 tx=0x7fafbc023ac0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.011+0000 7fafcd62d980 1 -- 172.21.15.194:0/987678902 shutdown_connections 2024-09-13T06:09:59.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.011+0000 7fafcd62d980 1 --2- 172.21.15.194:0/987678902 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7faea40346a0 0x7faea4036b60 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.011+0000 7fafcd62d980 1 --2- 172.21.15.194:0/987678902 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f791897dc0 0x55f7918981e0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.011+0000 7fafcd62d980 1 -- 172.21.15.194:0/987678902 >> 172.21.15.194:0/987678902 conn(0x55f79188cf10 msgr2=0x55f79188f990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:59.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.011+0000 7fafcd62d980 1 -- 172.21.15.194:0/987678902 shutdown_connections 2024-09-13T06:09:59.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.011+0000 7fafcd62d980 1 -- 172.21.15.194:0/987678902 wait complete. 2024-09-13T06:09:59.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.011+0000 7fafcd62d980 1 -- 172.21.15.194:0/439978235 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55f79178b930 msgr2=0x55f791881100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.011+0000 7fafcd62d980 1 --2- 172.21.15.194:0/439978235 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55f79178b930 0x55f791881100 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.011+0000 7fafcd62d980 1 -- 172.21.15.194:0/439978235 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55f791887830 msgr2=0x55f791889c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.011+0000 7fafcd62d980 1 --2- 172.21.15.194:0/439978235 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55f791887830 0x55f791889c20 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.011+0000 7fafcd62d980 1 -- 172.21.15.194:0/439978235 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55f791883910 msgr2=0x55f791885d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.011+0000 7fafcd62d980 1 --2- 172.21.15.194:0/439978235 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55f791883910 0x55f791885d00 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.011+0000 7fafcd62d980 1 -- 172.21.15.194:0/439978235 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7faeb0034650 msgr2=0x7faeb0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.011+0000 7fafcd62d980 1 --2- 172.21.15.194:0/439978235 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7faeb0034650 0x7faeb0036b10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fafb40ad000 tx=0x7fafb40a5040 comp rx=0 tx=0).stop 2024-09-13T06:09:59.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.011+0000 7fafcd62d980 1 -- 172.21.15.194:0/439978235 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f791787df0 msgr2=0x55f79187a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.017 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.011+0000 7fafcd62d980 1 --2- 172.21.15.194:0/439978235 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f791787df0 0x55f79187a000 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fafbc000f90 tx=0x7fafbc001260 comp rx=0 tx=0).stop 2024-09-13T06:09:59.017 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.011+0000 7fafcb93e640 1 -- 172.21.15.194:0/439978235 reap_dead start 2024-09-13T06:09:59.017 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.011+0000 7fafcd62d980 1 -- 172.21.15.194:0/439978235 shutdown_connections 2024-09-13T06:09:59.017 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.011+0000 7fafcd62d980 1 -- 172.21.15.194:0/439978235 >> 172.21.15.194:0/439978235 conn(0x55f7916fb280 msgr2=0x55f79186d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:59.017 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.011+0000 7fafcd62d980 1 -- 172.21.15.194:0/439978235 shutdown_connections 2024-09-13T06:09:59.017 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.011+0000 7fafcd62d980 1 -- 172.21.15.194:0/439978235 wait complete. 2024-09-13T06:09:59.024 INFO:teuthology.orchestra.run.smithi194.stdout:{"key":"bucket:myfoo","ver":{"tag":"_dZfKOlqZsk2x6zZ-oYPkONU","ver":2},"mtime":"2024-09-13T06:09:58.600118Z","data":{"bucket":{"name":"myfoo","marker":"52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1","bucket_id":"52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1","tenant":"","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"foo","creation_time":"2024-09-13T06:09:56.926052Z","linked":false,"has_bucket_info":false}} 2024-09-13T06:09:59.024 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:myfoo', 'ver': {'tag': '_dZfKOlqZsk2x6zZ-oYPkONU', 'ver': 2}, 'mtime': '2024-09-13T06:09:58.600118Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1', 'bucket_id': '52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1', 'tenant': '', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'foo', 'creation_time': '2024-09-13T06:09:56.926052Z', 'linked': False, 'has_bucket_info': False}} 2024-09-13T06:09:59.024 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1'] 2024-09-13T06:09:59.025 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1'] 2024-09-13T06:09:59.025 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid fud --bucket myfoo --bucket-id 52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 2024-09-13T06:09:59.102 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:09:59.102 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:09:59.103 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.103+0000 7ff55196a980 1 Processor -- start 2024-09-13T06:09:59.103 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.103+0000 7ff55196a980 1 -- start start 2024-09-13T06:09:59.103 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.103+0000 7ff55196a980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55a0b5d95aa0 0x55a0b5e242d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.103 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.103+0000 7ff55196a980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a0b5ca9ae0 con 0x55a0b5e24810 2024-09-13T06:09:59.104 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.103+0000 7ff55196a980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x55a0b5ccde30 con 0x55a0b5d95aa0 2024-09-13T06:09:59.104 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.103+0000 7ff54f47a640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55a0b5d95aa0 0x55a0b5e242d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.104 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.103+0000 7ff54f47a640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55a0b5d95aa0 0x55a0b5e242d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45660/0 (socket says 172.21.15.194:45660) 2024-09-13T06:09:59.104 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.103+0000 7ff54f47a640 1 -- 172.21.15.194:0/1872418933 learned_addr learned my addr 172.21.15.194:0/1872418933 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:59.105 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.103+0000 7ff54f47a640 1 -- 172.21.15.194:0/1872418933 >> v1:172.21.15.120:6789/0 conn(0x55a0b5e24810 legacy=0x55a0b5e26c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.105 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.103+0000 7ff54f47a640 1 -- 172.21.15.194:0/1872418933 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0b5e29330 con 0x55a0b5d95aa0 2024-09-13T06:09:59.106 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.107+0000 7ff54f47a640 1 --2- 172.21.15.194:0/1872418933 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a0b5d95aa0 0x55a0b5e242d0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ff54000a4e0 tx=0x7ff54001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69759b882a9741bb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.107+0000 7ff54e478640 1 -- 172.21.15.194:0/1872418933 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5400aa540 con 0x55a0b5d95aa0 2024-09-13T06:09:59.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.107+0000 7ff54e478640 1 -- 172.21.15.194:0/1872418933 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5400aa6e0 con 0x55a0b5d95aa0 2024-09-13T06:09:59.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.107+0000 7ff54e478640 1 -- 172.21.15.194:0/1872418933 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5400aaa40 con 0x55a0b5d95aa0 2024-09-13T06:09:59.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.107+0000 7ff55196a980 1 -- 172.21.15.194:0/1872418933 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a0b5d95aa0 msgr2=0x55a0b5e242d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.107+0000 7ff55196a980 1 --2- 172.21.15.194:0/1872418933 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a0b5d95aa0 0x55a0b5e242d0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ff54000a4e0 tx=0x7ff54001b090 comp rx=0 tx=0).stop 2024-09-13T06:09:59.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.107+0000 7ff55196a980 1 -- 172.21.15.194:0/1872418933 shutdown_connections 2024-09-13T06:09:59.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.107+0000 7ff55196a980 1 --2- 172.21.15.194:0/1872418933 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a0b5d95aa0 0x55a0b5e242d0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.107+0000 7ff55196a980 1 -- 172.21.15.194:0/1872418933 >> 172.21.15.194:0/1872418933 conn(0x55a0b5e1c000 msgr2=0x55a0b5e1e420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:59.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.107+0000 7ff55196a980 1 -- 172.21.15.194:0/1872418933 shutdown_connections 2024-09-13T06:09:59.109 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.107+0000 7ff55196a980 1 -- 172.21.15.194:0/1872418933 wait complete. 2024-09-13T06:09:59.123 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.123+0000 7ff55196a980 1 Processor -- start 2024-09-13T06:09:59.124 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.123+0000 7ff55196a980 1 -- start start 2024-09-13T06:09:59.124 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.123+0000 7ff55196a980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a0b5d95aa0 0x55a0b5f0cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.124 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.123+0000 7ff55196a980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55a0b5ccf200 con 0x55a0b5d95aa0 2024-09-13T06:09:59.124 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.123+0000 7ff54f47a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a0b5d95aa0 0x55a0b5f0cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.125 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.123+0000 7ff54f47a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a0b5d95aa0 0x55a0b5f0cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45668/0 (socket says 172.21.15.194:45668) 2024-09-13T06:09:59.125 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.123+0000 7ff54f47a640 1 -- 172.21.15.194:0/2905754617 learned_addr learned my addr 172.21.15.194:0/2905754617 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:59.125 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.123+0000 7ff54f47a640 1 -- 172.21.15.194:0/2905754617 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0b5f0d0b0 con 0x55a0b5d95aa0 2024-09-13T06:09:59.125 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.123+0000 7ff54f47a640 1 --2- 172.21.15.194:0/2905754617 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a0b5d95aa0 0x55a0b5f0cae0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7ff540018cc0 tx=0x7ff5400033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecabd4f757a9faf2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.126 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.123+0000 7ff43d60a640 1 -- 172.21.15.194:0/2905754617 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5400b9070 con 0x55a0b5d95aa0 2024-09-13T06:09:59.126 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.123+0000 7ff43d60a640 1 -- 172.21.15.194:0/2905754617 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5400aab50 con 0x55a0b5d95aa0 2024-09-13T06:09:59.126 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.123+0000 7ff43d60a640 1 -- 172.21.15.194:0/2905754617 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5400aae50 con 0x55a0b5d95aa0 2024-09-13T06:09:59.127 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.123+0000 7ff55196a980 1 -- 172.21.15.194:0/2905754617 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a0b5d95aa0 msgr2=0x55a0b5f0cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.127 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.123+0000 7ff55196a980 1 --2- 172.21.15.194:0/2905754617 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a0b5d95aa0 0x55a0b5f0cae0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7ff540018cc0 tx=0x7ff5400033b0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.127 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.123+0000 7ff55196a980 1 -- 172.21.15.194:0/2905754617 shutdown_connections 2024-09-13T06:09:59.127 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.123+0000 7ff55196a980 1 --2- 172.21.15.194:0/2905754617 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a0b5d95aa0 0x55a0b5f0cae0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.127 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.123+0000 7ff55196a980 1 -- 172.21.15.194:0/2905754617 >> 172.21.15.194:0/2905754617 conn(0x55a0b5e1c000 msgr2=0x55a0b5f08710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:59.127 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.123+0000 7ff55196a980 1 -- 172.21.15.194:0/2905754617 shutdown_connections 2024-09-13T06:09:59.127 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.123+0000 7ff55196a980 1 -- 172.21.15.194:0/2905754617 wait complete. 2024-09-13T06:09:59.127 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.127+0000 7ff55196a980 1 Processor -- start 2024-09-13T06:09:59.127 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.127+0000 7ff55196a980 1 -- start start 2024-09-13T06:09:59.127 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.127+0000 7ff55196a980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a0b5d95aa0 0x55a0b5e21bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.127 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.127+0000 7ff55196a980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55a0b5e28dd0 con 0x55a0b5d95aa0 2024-09-13T06:09:59.129 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.127+0000 7ff54f47a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a0b5d95aa0 0x55a0b5e21bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.129 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.127+0000 7ff54f47a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a0b5d95aa0 0x55a0b5e21bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45684/0 (socket says 172.21.15.194:45684) 2024-09-13T06:09:59.129 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.127+0000 7ff54f47a640 1 -- 172.21.15.194:0/1503544401 learned_addr learned my addr 172.21.15.194:0/1503544401 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:59.129 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.127+0000 7ff54f47a640 1 -- 172.21.15.194:0/1503544401 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0b5e202f0 con 0x55a0b5d95aa0 2024-09-13T06:09:59.129 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.127+0000 7ff54f47a640 1 --2- 172.21.15.194:0/1503544401 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a0b5d95aa0 0x55a0b5e21bd0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7ff540017ca0 tx=0x7ff540017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.129 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.127+0000 7ff43be07640 1 -- 172.21.15.194:0/1503544401 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5400b9070 con 0x55a0b5d95aa0 2024-09-13T06:09:59.129 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.127+0000 7ff55196a980 1 -- 172.21.15.194:0/1503544401 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a0b5e20580 con 0x55a0b5d95aa0 2024-09-13T06:09:59.129 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.127+0000 7ff43be07640 1 -- 172.21.15.194:0/1503544401 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5400b5e40 con 0x55a0b5d95aa0 2024-09-13T06:09:59.129 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.127+0000 7ff43be07640 1 -- 172.21.15.194:0/1503544401 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5400c7580 con 0x55a0b5d95aa0 2024-09-13T06:09:59.129 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.127+0000 7ff55196a980 1 -- 172.21.15.194:0/1503544401 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0b5e20a70 con 0x55a0b5d95aa0 2024-09-13T06:09:59.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.127+0000 7ff43be07640 1 -- 172.21.15.194:0/1503544401 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff5400b3040 con 0x55a0b5d95aa0 2024-09-13T06:09:59.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.127+0000 7ff43be07640 1 --2- 172.21.15.194:0/1503544401 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff434034650 0x7ff434036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.127+0000 7ff43be07640 1 -- 172.21.15.194:0/1503544401 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7ff5400c4070 con 0x55a0b5d95aa0 2024-09-13T06:09:59.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.127+0000 7ff54ec79640 1 --2- 172.21.15.194:0/1503544401 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff434034650 0x7ff434036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.127+0000 7ff55196a980 1 --2- 172.21.15.194:0/1503544401 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55a0b5e24810 0x55a0b5f1d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.132 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.127+0000 7ff55196a980 1 -- 172.21.15.194:0/1503544401 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f1d760 con 0x55a0b5e24810 2024-09-13T06:09:59.132 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.127+0000 7ff54fc7b640 1 --2- 172.21.15.194:0/1503544401 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55a0b5e24810 0x55a0b5f1d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.132 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.127+0000 7ff54ec79640 1 --2- 172.21.15.194:0/1503544401 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff434034650 0x7ff434036b10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff538000f70 tx=0x7ff538001420 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.132 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.131+0000 7ff54fc7b640 1 --2- 172.21.15.194:0/1503544401 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55a0b5e24810 0x55a0b5f1d220 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.132 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.131+0000 7ff54fc7b640 1 -- 172.21.15.194:0/1503544401 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff5480083f0 con 0x55a0b5e24810 2024-09-13T06:09:59.132 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.131+0000 7ff55196a980 1 -- 172.21.15.194:0/1503544401 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5e20e30 con 0x55a0b5e24810 2024-09-13T06:09:59.132 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.131+0000 7ff54fc7b640 1 -- 172.21.15.194:0/1503544401 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff5480083f0 con 0x55a0b5e24810 2024-09-13T06:09:59.132 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.131+0000 7ff55196a980 1 --2- 172.21.15.194:0/1503544401 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55a0b5f1fa00 0x55a0b5f21df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.132 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.131+0000 7ff55196a980 1 -- 172.21.15.194:0/1503544401 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f224e0 con 0x55a0b5f1fa00 2024-09-13T06:09:59.132 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.131+0000 7ff54f47a640 1 --2- 172.21.15.194:0/1503544401 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55a0b5f1fa00 0x55a0b5f21df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.132 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.131+0000 7ff54f47a640 1 --2- 172.21.15.194:0/1503544401 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55a0b5f1fa00 0x55a0b5f21df0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.131+0000 7ff54f47a640 1 -- 172.21.15.194:0/1503544401 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff5400cd060 con 0x55a0b5f1fa00 2024-09-13T06:09:59.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.131+0000 7ff55196a980 1 -- 172.21.15.194:0/1503544401 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f1e870 con 0x55a0b5e24810 2024-09-13T06:09:59.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.131+0000 7ff54fc7b640 1 -- 172.21.15.194:0/1503544401 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff5480083f0 con 0x55a0b5e24810 2024-09-13T06:09:59.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.131+0000 7ff55196a980 1 --2- 172.21.15.194:0/1503544401 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55a0b5f23940 0x55a0b5f25d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.131+0000 7ff55196a980 1 -- 172.21.15.194:0/1503544401 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f26420 con 0x55a0b5f23940 2024-09-13T06:09:59.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.131+0000 7ff54ec79640 1 --2- 172.21.15.194:0/1503544401 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55a0b5f23940 0x55a0b5f25d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.135 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.131+0000 7ff54ec79640 1 --2- 172.21.15.194:0/1503544401 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55a0b5f23940 0x55a0b5f25d30 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.135 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.131+0000 7ff54ec79640 1 -- 172.21.15.194:0/1503544401 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff53800d040 con 0x55a0b5f23940 2024-09-13T06:09:59.135 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.131+0000 7ff55196a980 1 Processor -- start 2024-09-13T06:09:59.135 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.131+0000 7ff55196a980 1 -- start start 2024-09-13T06:09:59.135 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.131+0000 7ff55196a980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a0b5f33ed0 0x55a0b5f342f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.135 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.131+0000 7ff55196a980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55a0b5d28800 con 0x55a0b5f33ed0 2024-09-13T06:09:59.135 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.131+0000 7ff54f47a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a0b5f33ed0 0x55a0b5f342f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.135 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.131+0000 7ff54f47a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a0b5f33ed0 0x55a0b5f342f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45698/0 (socket says 172.21.15.194:45698) 2024-09-13T06:09:59.135 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.131+0000 7ff54f47a640 1 -- 172.21.15.194:0/2760219306 learned_addr learned my addr 172.21.15.194:0/2760219306 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:59.137 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.135+0000 7ff54f47a640 1 -- 172.21.15.194:0/2760219306 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0b5f34830 con 0x55a0b5f33ed0 2024-09-13T06:09:59.137 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.135+0000 7ff54f47a640 1 --2- 172.21.15.194:0/2760219306 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a0b5f33ed0 0x55a0b5f342f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7ff5400ce910 tx=0x7ff5400cf850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.137 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.135+0000 7ff439602640 1 -- 172.21.15.194:0/2760219306 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5400d7280 con 0x55a0b5f33ed0 2024-09-13T06:09:59.137 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.135+0000 7ff55196a980 1 -- 172.21.15.194:0/2760219306 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a0b5f34a60 con 0x55a0b5f33ed0 2024-09-13T06:09:59.137 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.135+0000 7ff439602640 1 -- 172.21.15.194:0/2760219306 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5400c6370 con 0x55a0b5f33ed0 2024-09-13T06:09:59.137 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.135+0000 7ff55196a980 1 -- 172.21.15.194:0/2760219306 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0b5f376e0 con 0x55a0b5f33ed0 2024-09-13T06:09:59.137 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.135+0000 7ff439602640 1 -- 172.21.15.194:0/2760219306 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5400d0960 con 0x55a0b5f33ed0 2024-09-13T06:09:59.137 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.135+0000 7ff439602640 1 -- 172.21.15.194:0/2760219306 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff5400eb060 con 0x55a0b5f33ed0 2024-09-13T06:09:59.137 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.135+0000 7ff439602640 1 --2- 172.21.15.194:0/2760219306 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff428034600 0x7ff428036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.137 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.135+0000 7ff439602640 1 -- 172.21.15.194:0/2760219306 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7ff5400de070 con 0x55a0b5f33ed0 2024-09-13T06:09:59.137 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.135+0000 7ff54ec79640 1 --2- 172.21.15.194:0/2760219306 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff428034600 0x7ff428036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.138 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.135+0000 7ff55196a980 1 Processor -- start 2024-09-13T06:09:59.138 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.135+0000 7ff55196a980 1 -- start start 2024-09-13T06:09:59.140 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.135+0000 7ff54ec79640 1 --2- 172.21.15.194:0/2760219306 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff428034600 0x7ff428036ac0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x55a0b5e20d50 tx=0x7ff538006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.140 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.135+0000 7ff55196a980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a0b5f405c0 0x55a0b5f409a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.140 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.135+0000 7ff55196a980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55a0b5f0d370 con 0x55a0b5f405c0 2024-09-13T06:09:59.140 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.135+0000 7ff54f47a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a0b5f405c0 0x55a0b5f409a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.140 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.135+0000 7ff54f47a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a0b5f405c0 0x55a0b5f409a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45710/0 (socket says 172.21.15.194:45710) 2024-09-13T06:09:59.140 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.135+0000 7ff54f47a640 1 -- 172.21.15.194:0/4282594427 learned_addr learned my addr 172.21.15.194:0/4282594427 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:59.140 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.135+0000 7ff54f47a640 1 -- 172.21.15.194:0/4282594427 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0b5f40f70 con 0x55a0b5f405c0 2024-09-13T06:09:59.140 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.139+0000 7ff54f47a640 1 --2- 172.21.15.194:0/4282594427 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a0b5f405c0 0x55a0b5f409a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ff5400ce820 tx=0x7ff5400e0470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c35bcc60f221ce45 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.140 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.139+0000 7ff432ffd640 1 -- 172.21.15.194:0/4282594427 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5400fb020 con 0x55a0b5f405c0 2024-09-13T06:09:59.140 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.139+0000 7ff432ffd640 1 -- 172.21.15.194:0/4282594427 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5400c2e40 con 0x55a0b5f405c0 2024-09-13T06:09:59.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.139+0000 7ff432ffd640 1 -- 172.21.15.194:0/4282594427 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5400e48c0 con 0x55a0b5f405c0 2024-09-13T06:09:59.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.139+0000 7ff55196a980 1 -- 172.21.15.194:0/4282594427 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a0b5f405c0 msgr2=0x55a0b5f409a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.139+0000 7ff55196a980 1 --2- 172.21.15.194:0/4282594427 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a0b5f405c0 0x55a0b5f409a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ff5400ce820 tx=0x7ff5400e0470 comp rx=0 tx=0).stop 2024-09-13T06:09:59.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.139+0000 7ff55196a980 1 -- 172.21.15.194:0/4282594427 shutdown_connections 2024-09-13T06:09:59.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.139+0000 7ff55196a980 1 --2- 172.21.15.194:0/4282594427 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a0b5f405c0 0x55a0b5f409a0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.139+0000 7ff55196a980 1 -- 172.21.15.194:0/4282594427 >> 172.21.15.194:0/4282594427 conn(0x55a0b5f3c9a0 msgr2=0x55a0b5f3aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:59.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.139+0000 7ff55196a980 1 -- 172.21.15.194:0/4282594427 shutdown_connections 2024-09-13T06:09:59.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.139+0000 7ff55196a980 1 -- 172.21.15.194:0/4282594427 wait complete. 2024-09-13T06:09:59.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.139+0000 7ff55196a980 1 Processor -- start 2024-09-13T06:09:59.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.139+0000 7ff55196a980 1 -- start start 2024-09-13T06:09:59.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.139+0000 7ff55196a980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a0b5f405c0 0x55a0b5f477e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.139+0000 7ff55196a980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55a0b5f41410 con 0x55a0b5f405c0 2024-09-13T06:09:59.143 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.139+0000 7ff54f47a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a0b5f405c0 0x55a0b5f477e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.143 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.139+0000 7ff54f47a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a0b5f405c0 0x55a0b5f477e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45726/0 (socket says 172.21.15.194:45726) 2024-09-13T06:09:59.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.139+0000 7ff54f47a640 1 -- 172.21.15.194:0/3386952681 learned_addr learned my addr 172.21.15.194:0/3386952681 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:59.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.139+0000 7ff54f47a640 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0b5f47d20 con 0x55a0b5f405c0 2024-09-13T06:09:59.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.139+0000 7ff54f47a640 1 --2- 172.21.15.194:0/3386952681 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a0b5f405c0 0x55a0b5f477e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff5400c7fb0 tx=0x7ff540009ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.139+0000 7ff4317fa640 1 -- 172.21.15.194:0/3386952681 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff540110070 con 0x55a0b5f405c0 2024-09-13T06:09:59.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.139+0000 7ff55196a980 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a0b5f47d20 con 0x55a0b5f405c0 2024-09-13T06:09:59.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.139+0000 7ff4317fa640 1 -- 172.21.15.194:0/3386952681 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5400c7ce0 con 0x55a0b5f405c0 2024-09-13T06:09:59.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.139+0000 7ff4317fa640 1 -- 172.21.15.194:0/3386952681 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5400d7c10 con 0x55a0b5f405c0 2024-09-13T06:09:59.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.139+0000 7ff55196a980 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0b5f47d20 con 0x55a0b5f405c0 2024-09-13T06:09:59.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.143+0000 7ff4317fa640 1 -- 172.21.15.194:0/3386952681 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff540113070 con 0x55a0b5f405c0 2024-09-13T06:09:59.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.143+0000 7ff4317fa640 1 --2- 172.21.15.194:0/3386952681 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff418034650 0x7ff418036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.143+0000 7ff4317fa640 1 -- 172.21.15.194:0/3386952681 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7ff540106030 con 0x55a0b5f405c0 2024-09-13T06:09:59.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.143+0000 7ff54ec79640 1 --2- 172.21.15.194:0/3386952681 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff418034650 0x7ff418036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.143+0000 7ff55196a980 20 rados->read ofs=0 len=0 2024-09-13T06:09:59.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.143+0000 7ff55196a980 1 --2- 172.21.15.194:0/3386952681 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55a0b5f52810 0x55a0b5f54cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.143+0000 7ff55196a980 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f55420 con 0x55a0b5f52810 2024-09-13T06:09:59.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.143+0000 7ff54fc7b640 1 --2- 172.21.15.194:0/3386952681 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55a0b5f52810 0x55a0b5f54cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.143+0000 7ff54ec79640 1 --2- 172.21.15.194:0/3386952681 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff418034650 0x7ff418036b10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x55a0b5f26800 tx=0x7ff538011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.143+0000 7ff54fc7b640 1 --2- 172.21.15.194:0/3386952681 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55a0b5f52810 0x55a0b5f54cd0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.143+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff5480083f0 con 0x55a0b5f52810 2024-09-13T06:09:59.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.143+0000 7ff55196a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:59.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.143+0000 7ff55196a980 20 realm 2024-09-13T06:09:59.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.143+0000 7ff55196a980 20 rados->read ofs=0 len=0 2024-09-13T06:09:59.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.143+0000 7ff55196a980 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f55830 con 0x55a0b5f52810 2024-09-13T06:09:59.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.143+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff5480083f0 con 0x55a0b5f52810 2024-09-13T06:09:59.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.143+0000 7ff55196a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:59.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.143+0000 7ff55196a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:09:59.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.143+0000 7ff55196a980 20 rados->read ofs=0 len=0 2024-09-13T06:09:59.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.143+0000 7ff55196a980 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f56100 con 0x55a0b5f52810 2024-09-13T06:09:59.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.143+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff5480083f0 con 0x55a0b5f52810 2024-09-13T06:09:59.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.143+0000 7ff55196a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:59.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.143+0000 7ff55196a980 20 rados->read ofs=0 len=0 2024-09-13T06:09:59.150 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.143+0000 7ff55196a980 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f564a0 con 0x55a0b5f52810 2024-09-13T06:09:59.150 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.143+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff5480083f0 con 0x55a0b5f52810 2024-09-13T06:09:59.150 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.143+0000 7ff55196a980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:59.150 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.143+0000 7ff55196a980 20 rados->read ofs=0 len=0 2024-09-13T06:09:59.150 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.143+0000 7ff55196a980 1 --2- 172.21.15.194:0/3386952681 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55a0b5f57200 0x55a0b5f595f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.150 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.143+0000 7ff55196a980 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f59c40 con 0x55a0b5f57200 2024-09-13T06:09:59.150 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.143+0000 7ff54f47a640 1 --2- 172.21.15.194:0/3386952681 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55a0b5f57200 0x55a0b5f595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.150 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.143+0000 7ff54f47a640 1 --2- 172.21.15.194:0/3386952681 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55a0b5f57200 0x55a0b5f595f0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.150 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.143+0000 7ff54f47a640 1 -- 172.21.15.194:0/3386952681 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff540112030 con 0x55a0b5f57200 2024-09-13T06:09:59.150 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.143+0000 7ff55196a980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:09:59.150 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.143+0000 7ff55196a980 20 searching for the correct realm 2024-09-13T06:09:59.150 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.143+0000 7ff55196a980 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f5b4a0 con 0x55a0b5f57200 2024-09-13T06:09:59.151 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.147+0000 7ff54f47a640 1 -- 172.21.15.194:0/3386952681 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff540112030 con 0x55a0b5f57200 2024-09-13T06:09:59.151 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.147+0000 7ff54f47a640 1 --2- 172.21.15.194:0/3386952681 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7ff540115060 0x7ff5400e0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.151 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.147+0000 7ff54f47a640 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f5b4a0 con 0x7ff540115060 2024-09-13T06:09:59.151 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.147+0000 7ff54ec79640 1 --2- 172.21.15.194:0/3386952681 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7ff540115060 0x7ff5400e0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.151 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.147+0000 7ff54ec79640 1 --2- 172.21.15.194:0/3386952681 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7ff540115060 0x7ff5400e0920 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.151 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.147+0000 7ff54ec79640 1 -- 172.21.15.194:0/3386952681 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff538036040 con 0x7ff540115060 2024-09-13T06:09:59.151 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.147+0000 7ff54ec79640 1 --2- 172.21.15.194:0/3386952681 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7ff53800f3d0 0x7ff53800f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.151 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.147+0000 7ff54ec79640 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f5b4a0 con 0x7ff53800f3d0 2024-09-13T06:09:59.151 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.147+0000 7ff54fc7b640 1 --2- 172.21.15.194:0/3386952681 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7ff53800f3d0 0x7ff53800f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.151 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.147+0000 7ff54fc7b640 1 --2- 172.21.15.194:0/3386952681 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7ff53800f3d0 0x7ff53800f7f0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.151 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.147+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5480083f0 con 0x7ff53800f3d0 2024-09-13T06:09:59.151 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.147+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f564a0 con 0x55a0b5f52810 2024-09-13T06:09:59.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.147+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5480083f0 con 0x55a0b5f52810 2024-09-13T06:09:59.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.147+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f564a0 con 0x55a0b5f52810 2024-09-13T06:09:59.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.147+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5480083f0 con 0x55a0b5f52810 2024-09-13T06:09:59.156 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.147+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f564a0 con 0x7ff53800f3d0 2024-09-13T06:09:59.156 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.147+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5480083f0 con 0x7ff53800f3d0 2024-09-13T06:09:59.156 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.147+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f564a0 con 0x7ff53800f3d0 2024-09-13T06:09:59.156 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.151+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5480083f0 con 0x7ff53800f3d0 2024-09-13T06:09:59.156 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.151+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f564a0 con 0x7ff540115060 2024-09-13T06:09:59.156 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.151+0000 7ff54ec79640 1 -- 172.21.15.194:0/3386952681 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff538036040 con 0x7ff540115060 2024-09-13T06:09:59.156 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.151+0000 7ff54ec79640 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f564a0 con 0x55a0b5f57200 2024-09-13T06:09:59.156 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.151+0000 7ff54f47a640 1 -- 172.21.15.194:0/3386952681 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff540112030 con 0x55a0b5f57200 2024-09-13T06:09:59.156 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.151+0000 7ff54f47a640 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f564a0 con 0x55a0b5f52810 2024-09-13T06:09:59.156 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.151+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5480083f0 con 0x55a0b5f52810 2024-09-13T06:09:59.156 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.151+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f564a0 con 0x7ff53800f3d0 2024-09-13T06:09:59.156 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.151+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5480083f0 con 0x7ff53800f3d0 2024-09-13T06:09:59.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.151+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f564a0 con 0x55a0b5f52810 2024-09-13T06:09:59.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.151+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5480083f0 con 0x55a0b5f52810 2024-09-13T06:09:59.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.151+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f564a0 con 0x7ff540115060 2024-09-13T06:09:59.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.151+0000 7ff54ec79640 1 -- 172.21.15.194:0/3386952681 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff538036040 con 0x7ff540115060 2024-09-13T06:09:59.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.151+0000 7ff54ec79640 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f564a0 con 0x55a0b5f57200 2024-09-13T06:09:59.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.151+0000 7ff54f47a640 1 -- 172.21.15.194:0/3386952681 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff540112030 con 0x55a0b5f57200 2024-09-13T06:09:59.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.151+0000 7ff54f47a640 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f564a0 con 0x55a0b5f57200 2024-09-13T06:09:59.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.151+0000 7ff54f47a640 1 -- 172.21.15.194:0/3386952681 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff540112030 con 0x55a0b5f57200 2024-09-13T06:09:59.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.151+0000 7ff54f47a640 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f564a0 con 0x7ff53800f3d0 2024-09-13T06:09:59.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.151+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5480083f0 con 0x7ff53800f3d0 2024-09-13T06:09:59.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.151+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f564a0 con 0x55a0b5f57200 2024-09-13T06:09:59.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.151+0000 7ff54f47a640 1 -- 172.21.15.194:0/3386952681 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff540112030 con 0x55a0b5f57200 2024-09-13T06:09:59.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.151+0000 7ff54f47a640 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f564a0 con 0x55a0b5f57200 2024-09-13T06:09:59.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.151+0000 7ff54f47a640 1 -- 172.21.15.194:0/3386952681 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff540112030 con 0x55a0b5f57200 2024-09-13T06:09:59.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.151+0000 7ff54f47a640 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f564a0 con 0x55a0b5f52810 2024-09-13T06:09:59.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.155+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5480083f0 con 0x55a0b5f52810 2024-09-13T06:09:59.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.155+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f564a0 con 0x55a0b5f52810 2024-09-13T06:09:59.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.155+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff5480083f0 con 0x55a0b5f52810 2024-09-13T06:09:59.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.155+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f564a0 con 0x7ff53800f3d0 2024-09-13T06:09:59.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.155+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5480083f0 con 0x7ff53800f3d0 2024-09-13T06:09:59.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.155+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f564a0 con 0x55a0b5f57200 2024-09-13T06:09:59.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.155+0000 7ff54f47a640 1 -- 172.21.15.194:0/3386952681 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff540112030 con 0x55a0b5f57200 2024-09-13T06:09:59.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.155+0000 7ff54f47a640 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f564a0 con 0x7ff540115060 2024-09-13T06:09:59.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.155+0000 7ff54ec79640 1 -- 172.21.15.194:0/3386952681 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff538036040 con 0x7ff540115060 2024-09-13T06:09:59.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.155+0000 7ff54ec79640 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f564a0 con 0x55a0b5f52810 2024-09-13T06:09:59.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.155+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5480083f0 con 0x55a0b5f52810 2024-09-13T06:09:59.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.155+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f564a0 con 0x7ff53800f3d0 2024-09-13T06:09:59.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.155+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5480083f0 con 0x7ff53800f3d0 2024-09-13T06:09:59.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.155+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f564a0 con 0x55a0b5f57200 2024-09-13T06:09:59.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.155+0000 7ff54f47a640 1 -- 172.21.15.194:0/3386952681 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff540112030 con 0x55a0b5f57200 2024-09-13T06:09:59.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.155+0000 7ff54f47a640 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f564a0 con 0x7ff53800f3d0 2024-09-13T06:09:59.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.155+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5480083f0 con 0x7ff53800f3d0 2024-09-13T06:09:59.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.155+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f564a0 con 0x7ff540115060 2024-09-13T06:09:59.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.155+0000 7ff54ec79640 1 -- 172.21.15.194:0/3386952681 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff538036040 con 0x7ff540115060 2024-09-13T06:09:59.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.155+0000 7ff54ec79640 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f564a0 con 0x55a0b5f57200 2024-09-13T06:09:59.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.155+0000 7ff54f47a640 1 -- 172.21.15.194:0/3386952681 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff540112030 con 0x55a0b5f57200 2024-09-13T06:09:59.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.155+0000 7ff54f47a640 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f564a0 con 0x7ff53800f3d0 2024-09-13T06:09:59.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.159+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5480083f0 con 0x7ff53800f3d0 2024-09-13T06:09:59.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.159+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f564a0 con 0x55a0b5f52810 2024-09-13T06:09:59.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.159+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff5480083f0 con 0x55a0b5f52810 2024-09-13T06:09:59.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.159+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f564a0 con 0x7ff540115060 2024-09-13T06:09:59.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.159+0000 7ff54ec79640 1 -- 172.21.15.194:0/3386952681 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff538036040 con 0x7ff540115060 2024-09-13T06:09:59.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.159+0000 7ff55196a980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:09:59.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.159+0000 7ff55196a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:09:59.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.159+0000 7ff55196a980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:09:59.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.159+0000 7ff55196a980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:09:59.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.159+0000 7ff55196a980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:09:59.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.159+0000 7ff55196a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:09:59.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.159+0000 7ff55196a980 20 rados->read ofs=0 len=0 2024-09-13T06:09:59.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.159+0000 7ff55196a980 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f5a590 con 0x55a0b5f52810 2024-09-13T06:09:59.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.159+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff5480083f0 con 0x55a0b5f52810 2024-09-13T06:09:59.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.159+0000 7ff55196a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:59.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.159+0000 7ff55196a980 20 rados->read ofs=0 len=0 2024-09-13T06:09:59.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.159+0000 7ff55196a980 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f5ade0 con 0x55a0b5f52810 2024-09-13T06:09:59.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.159+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff5480083f0 con 0x55a0b5f52810 2024-09-13T06:09:59.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.159+0000 7ff55196a980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:59.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.159+0000 7ff55196a980 20 rados->read ofs=0 len=0 2024-09-13T06:09:59.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.159+0000 7ff55196a980 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f5a930 con 0x7ff540115060 2024-09-13T06:09:59.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.159+0000 7ff54ec79640 1 -- 172.21.15.194:0/3386952681 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff538036040 con 0x7ff540115060 2024-09-13T06:09:59.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.159+0000 7ff55196a980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:09:59.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.159+0000 7ff55196a980 20 zone default found 2024-09-13T06:09:59.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.159+0000 7ff55196a980 4 Realm: () 2024-09-13T06:09:59.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.159+0000 7ff55196a980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:09:59.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.159+0000 7ff55196a980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:09:59.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.159+0000 7ff55196a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:09:59.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.159+0000 7ff55196a980 20 zonegroup default 2024-09-13T06:09:59.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.159+0000 7ff55196a980 20 rados->read ofs=0 len=0 2024-09-13T06:09:59.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.159+0000 7ff55196a980 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f5b8d0 con 0x7ff53800f3d0 2024-09-13T06:09:59.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.159+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff5480083f0 con 0x7ff53800f3d0 2024-09-13T06:09:59.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.159+0000 7ff55196a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:59.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.159+0000 7ff55196a980 20 rados->read ofs=0 len=0 2024-09-13T06:09:59.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.159+0000 7ff55196a980 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f5d2b0 con 0x55a0b5f57200 2024-09-13T06:09:59.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.159+0000 7ff54f47a640 1 -- 172.21.15.194:0/3386952681 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff540112030 con 0x55a0b5f57200 2024-09-13T06:09:59.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.159+0000 7ff55196a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:59.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.159+0000 7ff55196a980 20 rados->read ofs=0 len=0 2024-09-13T06:09:59.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.159+0000 7ff55196a980 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f5d740 con 0x55a0b5f57200 2024-09-13T06:09:59.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.159+0000 7ff54f47a640 1 -- 172.21.15.194:0/3386952681 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff540112030 con 0x55a0b5f57200 2024-09-13T06:09:59.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.159+0000 7ff55196a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:59.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.159+0000 7ff55196a980 20 started sync module instance, tier type = 2024-09-13T06:09:59.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.159+0000 7ff55196a980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:09:59.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.159+0000 7ff55196a980 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f5c750 con 0x7ff540115060 2024-09-13T06:09:59.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.163+0000 7ff54ec79640 1 -- 172.21.15.194:0/3386952681 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(44 notify.0 [create] v33'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff538036040 con 0x7ff540115060 2024-09-13T06:09:59.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.163+0000 7ff55196a980 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94148735912816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f5c3b0 con 0x7ff540115060 2024-09-13T06:09:59.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.163+0000 7ff55196a980 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f5e670 con 0x55a0b5f52810 2024-09-13T06:09:59.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.163+0000 7ff54ec79640 1 -- 172.21.15.194:0/3386952681 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94148735912816] v33'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff538036040 con 0x7ff540115060 2024-09-13T06:09:59.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.163+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v33'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5480083f0 con 0x55a0b5f52810 2024-09-13T06:09:59.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.163+0000 7ff55196a980 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94148735918528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f5e5e0 con 0x55a0b5f52810 2024-09-13T06:09:59.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.163+0000 7ff55196a980 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f5f400 con 0x55a0b5f57200 2024-09-13T06:09:59.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.167+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94148735918528] v33'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5480083f0 con 0x55a0b5f52810 2024-09-13T06:09:59.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.167+0000 7ff54f47a640 1 -- 172.21.15.194:0/3386952681 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v33'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff540112030 con 0x55a0b5f57200 2024-09-13T06:09:59.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.167+0000 7ff55196a980 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94148735920736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f5f820 con 0x55a0b5f57200 2024-09-13T06:09:59.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.167+0000 7ff55196a980 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f601e0 con 0x7ff540115060 2024-09-13T06:09:59.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.167+0000 7ff54ec79640 1 -- 172.21.15.194:0/3386952681 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(50 notify.3 [create] v33'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff538036040 con 0x7ff540115060 2024-09-13T06:09:59.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.167+0000 7ff55196a980 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94148735925552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f60600 con 0x7ff540115060 2024-09-13T06:09:59.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.167+0000 7ff55196a980 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f610f0 con 0x55a0b5f52810 2024-09-13T06:09:59.175 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.167+0000 7ff54f47a640 1 -- 172.21.15.194:0/3386952681 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94148735920736] v33'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff540112030 con 0x55a0b5f57200 2024-09-13T06:09:59.175 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.171+0000 7ff54ec79640 1 -- 172.21.15.194:0/3386952681 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94148735925552] v33'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff538036040 con 0x7ff540115060 2024-09-13T06:09:59.175 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.171+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v33'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5480083f0 con 0x55a0b5f52810 2024-09-13T06:09:59.175 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.171+0000 7ff55196a980 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94148735929280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f60150 con 0x55a0b5f52810 2024-09-13T06:09:59.175 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.171+0000 7ff55196a980 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f61990 con 0x7ff53800f3d0 2024-09-13T06:09:59.175 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.171+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(54 notify.5 [create] v33'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5480083f0 con 0x7ff53800f3d0 2024-09-13T06:09:59.175 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.171+0000 7ff55196a980 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94148735931184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f61c00 con 0x7ff53800f3d0 2024-09-13T06:09:59.175 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.171+0000 7ff55196a980 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f62450 con 0x7ff53800f3d0 2024-09-13T06:09:59.175 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.171+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94148735929280] v33'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5480083f0 con 0x55a0b5f52810 2024-09-13T06:09:59.176 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.175+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(56 notify.6 [create] v33'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5480083f0 con 0x7ff53800f3d0 2024-09-13T06:09:59.176 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.175+0000 7ff55196a980 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94148735933440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f624d0 con 0x7ff53800f3d0 2024-09-13T06:09:59.176 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.175+0000 7ff55196a980 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f62e90 con 0x7ff53800f3d0 2024-09-13T06:09:59.176 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.175+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94148735931184] v33'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5480083f0 con 0x7ff53800f3d0 2024-09-13T06:09:59.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.179+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(58 notify.7 [create] v33'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5480083f0 con 0x7ff53800f3d0 2024-09-13T06:09:59.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.179+0000 7ff55196a980 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94148735932240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f62e90 con 0x7ff53800f3d0 2024-09-13T06:09:59.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.179+0000 7ff55196a980 20 add_watcher() i=0 2024-09-13T06:09:59.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.179+0000 7ff55196a980 20 add_watcher() i=1 2024-09-13T06:09:59.179 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.179+0000 7ff55196a980 20 add_watcher() i=2 2024-09-13T06:09:59.179 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.179+0000 7ff55196a980 20 add_watcher() i=3 2024-09-13T06:09:59.179 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.179+0000 7ff55196a980 20 add_watcher() i=4 2024-09-13T06:09:59.179 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.179+0000 7ff55196a980 20 add_watcher() i=5 2024-09-13T06:09:59.179 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.179+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94148735933440] v33'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5480083f0 con 0x7ff53800f3d0 2024-09-13T06:09:59.179 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.179+0000 7ff55196a980 20 add_watcher() i=6 2024-09-13T06:09:59.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.179+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94148735932240] v33'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5480083f0 con 0x7ff53800f3d0 2024-09-13T06:09:59.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.179+0000 7ff55196a980 20 add_watcher() i=7 2024-09-13T06:09:59.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.179+0000 7ff55196a980 2 all 8 watchers are set, enabling cache 2024-09-13T06:09:59.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.179+0000 7ff55196a980 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f65ec0 con 0x55a0b5f52810 2024-09-13T06:09:59.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.179+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff5480083f0 con 0x55a0b5f52810 2024-09-13T06:09:59.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.179+0000 7ff55196a980 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94148735936992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f632b0 con 0x55a0b5f52810 2024-09-13T06:09:59.182 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.179+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94148735936992] v33'110 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff5480083f0 con 0x55a0b5f52810 2024-09-13T06:09:59.182 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.179+0000 7ff405fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:59.182 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.179+0000 7ff55196a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:09:59.182 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.179+0000 7ff55196a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:09:59.182 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.179+0000 7ff55196a980 5 note: GC not initialized 2024-09-13T06:09:59.183 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.183+0000 7ff404fe1640 20 reqs_thread_entry: start 2024-09-13T06:09:59.183 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.183+0000 7ff55196a980 20 init_complete bucket index max shards: 11 2024-09-13T06:09:59.183 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.183+0000 7ff55196a980 20 Filter name: none 2024-09-13T06:09:59.183 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.183+0000 7ff37e7fc640 20 reqs_thread_entry: start 2024-09-13T06:09:59.183 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.183+0000 7ff55196a980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T06:09:59.184 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.183+0000 7ff55196a980 20 rados->read ofs=0 len=0 2024-09-13T06:09:59.184 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.183+0000 7ff55196a980 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f89340 con 0x7ff53800f3d0 2024-09-13T06:09:59.185 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.183+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7ff5480083f0 con 0x7ff53800f3d0 2024-09-13T06:09:59.185 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.183+0000 7ff55196a980 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T06:09:59.186 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.183+0000 7ff55196a980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-13T06:09:59.186 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.183+0000 7ff55196a980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T06:09:59.186 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.183+0000 7ff55196a980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:09:59.186 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.183+0000 7ff55196a980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T06:09:59.186 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.183+0000 7ff55196a980 20 rados->read ofs=0 len=0 2024-09-13T06:09:59.186 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.183+0000 7ff55196a980 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f8b420 con 0x7ff540115060 2024-09-13T06:09:59.186 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.183+0000 7ff54ec79640 1 -- 172.21.15.194:0/3386952681 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv18 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7ff538036040 con 0x7ff540115060 2024-09-13T06:09:59.186 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.183+0000 7ff55196a980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T06:09:59.186 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.183+0000 7ff55196a980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T06:09:59.186 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.183+0000 7ff55196a980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T06:09:59.186 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.183+0000 7ff55196a980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 : miss 2024-09-13T06:09:59.186 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.183+0000 7ff55196a980 20 rados->read ofs=0 len=0 2024-09-13T06:09:59.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.183+0000 7ff55196a980 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:64 8.18 8:1a66c368:root::.bucket.meta.myfoo%3a52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f8ccf0 con 0x55a0b5f52810 2024-09-13T06:09:59.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.183+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(64 .bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv12 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7ff5480083f0 con 0x55a0b5f52810 2024-09-13T06:09:59.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.183+0000 7ff55196a980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T06:09:59.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.183+0000 7ff55196a980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 info.flags=0x17 2024-09-13T06:09:59.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.183+0000 7ff55196a980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 to cache LRU end 2024-09-13T06:09:59.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.183+0000 7ff55196a980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:09:59.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.183+0000 7ff55196a980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T06:09:59.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.183+0000 7ff55196a980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 2024-09-13T06:09:59.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.183+0000 7ff55196a980 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-09-13T06:09:59.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.183+0000 7ff55196a980 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f912d0 con 0x7ff540115060 2024-09-13T06:09:59.188 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.187+0000 7ff54ec79640 1 -- 172.21.15.194:0/3386952681 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(65 foo.buckets [call] v33'19 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7ff538036040 con 0x7ff540115060 2024-09-13T06:09:59.188 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.187+0000 7ff55196a980 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:66 8.18 8:1a66c368:root::.bucket.meta.myfoo%3a52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f97190 con 0x55a0b5f52810 2024-09-13T06:09:59.188 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.187+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(66 .bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v33'13 uv13 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7ff5480083f0 con 0x55a0b5f52810 2024-09-13T06:09:59.189 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.187+0000 7ff55196a980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 info.flags=0x17 2024-09-13T06:09:59.189 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.187+0000 7ff55196a980 10 moving default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 to cache LRU end 2024-09-13T06:09:59.189 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.187+0000 7ff55196a980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T06:09:59.189 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.187+0000 7ff55196a980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1, ofs0, ns] 2024-09-13T06:09:59.189 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.187+0000 7ff55196a980 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:67 7.9 7:93e5b521:::notify.7:head [notify cookie 94148736107936 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f91700 con 0x7ff53800f3d0 2024-09-13T06:09:59.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.187+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== watch-notify(notify (1) cookie 94148735932240 notify 141733920772 ret 0) ==== 794+0+0 (crc 0 0 0) 0x55a0b5f8d0e0 con 0x7ff53800f3d0 2024-09-13T06:09:59.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.187+0000 7ff432ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920772 cookie 94148735932240 notifier 4500 bl.length()=752 2024-09-13T06:09:59.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.187+0000 7ff432ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 info.flags=0x17 2024-09-13T06:09:59.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.187+0000 7ff432ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 to cache LRU end 2024-09-13T06:09:59.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.187+0000 7ff432ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T06:09:59.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.187+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(67 notify.7 [notify cookie 94148736107936 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff5480083f0 con 0x7ff53800f3d0 2024-09-13T06:09:59.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.187+0000 7ff432ffd640 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:68 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7ff414003eb0 con 0x7ff53800f3d0 2024-09-13T06:09:59.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.187+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 <== osd.0 v2:172.21.15.120:6800/1923744619 20 ==== osd_op_reply(68 notify.7 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5480083f0 con 0x7ff53800f3d0 2024-09-13T06:09:59.191 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.191+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 <== osd.0 v2:172.21.15.120:6800/1923744619 21 ==== watch-notify(notify_complete (2) cookie 94148736107936 notify 141733920772 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a0b5f8c210 con 0x7ff53800f3d0 2024-09-13T06:09:59.191 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.191+0000 7ff55196a980 20 handle_bi_update(): bucket=:myfoo[52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1]): orig_sources= new_sources= 2024-09-13T06:09:59.191 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.191+0000 7ff55196a980 20 handle_bi_update(): bucket=:myfoo[52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1]): potential sources added=[] removed=[] 2024-09-13T06:09:59.191 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.191+0000 7ff55196a980 20 handle_bi_update(): bucket=:myfoo[52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1]): orig_dests= new_dests= 2024-09-13T06:09:59.191 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.191+0000 7ff55196a980 20 handle_bi_update(): bucket=:myfoo[52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1]): potential dests added=[] removed=[] 2024-09-13T06:09:59.191 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.191+0000 7ff55196a980 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:69 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f8c5a0 con 0x7ff53800f3d0 2024-09-13T06:09:59.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.191+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 <== osd.0 v2:172.21.15.120:6800/1923744619 22 ==== osd_op_reply(69 fud.buckets [call] v33'5 uv5 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7ff5480083f0 con 0x7ff53800f3d0 2024-09-13T06:09:59.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.191+0000 7ff55196a980 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f96a00 con 0x7ff540115060 2024-09-13T06:09:59.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.195+0000 7ff54ec79640 1 -- 172.21.15.194:0/3386952681 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v33'20 uv20 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7ff538036040 con 0x7ff540115060 2024-09-13T06:09:59.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.195+0000 7ff55196a980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-13T06:09:59.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.195+0000 7ff55196a980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T06:09:59.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.195+0000 7ff55196a980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-13T06:09:59.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.195+0000 7ff55196a980 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94148736107936 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f95ea0 con 0x7ff53800f3d0 2024-09-13T06:09:59.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.195+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 <== osd.0 v2:172.21.15.120:6800/1923744619 23 ==== watch-notify(notify (1) cookie 94148735933440 notify 141733920773 ret 0) ==== 356+0+0 (crc 0 0 0) 0x7ff54803b040 con 0x7ff53800f3d0 2024-09-13T06:09:59.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.195+0000 7ff432ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920773 cookie 94148735933440 notifier 4500 bl.length()=314 2024-09-13T06:09:59.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.195+0000 7ff432ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-13T06:09:59.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.195+0000 7ff432ffd640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T06:09:59.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.195+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 <== osd.0 v2:172.21.15.120:6800/1923744619 24 ==== osd_op_reply(71 notify.6 [notify cookie 94148736107936 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff5480083f0 con 0x7ff53800f3d0 2024-09-13T06:09:59.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.195+0000 7ff432ffd640 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7ff414003eb0 con 0x7ff53800f3d0 2024-09-13T06:09:59.197 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.195+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 <== osd.0 v2:172.21.15.120:6800/1923744619 25 ==== watch-notify(notify_complete (2) cookie 94148736107936 notify 141733920773 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7ff548010040 con 0x7ff53800f3d0 2024-09-13T06:09:59.197 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.195+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 <== osd.0 v2:172.21.15.120:6800/1923744619 26 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5480083f0 con 0x7ff53800f3d0 2024-09-13T06:09:59.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.195+0000 7ff405fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:59.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.195+0000 7ff55196a980 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94148735936992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f87170 con 0x55a0b5f52810 2024-09-13T06:09:59.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.199+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94148735936992] v33'111 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff5480083f0 con 0x55a0b5f52810 2024-09-13T06:09:59.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.199+0000 7ff55196a980 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94148735912816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f87170 con 0x7ff540115060 2024-09-13T06:09:59.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.199+0000 7ff54ec79640 1 -- 172.21.15.194:0/3386952681 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94148735912816] v33'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff538036040 con 0x7ff540115060 2024-09-13T06:09:59.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.199+0000 7ff55196a980 20 remove_watcher() i=0 2024-09-13T06:09:59.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.199+0000 7ff55196a980 2 removed watcher, disabling cache 2024-09-13T06:09:59.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.199+0000 7ff55196a980 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94148735918528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f87170 con 0x55a0b5f52810 2024-09-13T06:09:59.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.199+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94148735918528] v33'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5480083f0 con 0x55a0b5f52810 2024-09-13T06:09:59.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.199+0000 7ff55196a980 20 remove_watcher() i=1 2024-09-13T06:09:59.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.203+0000 7ff55196a980 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94148735920736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f5e1c0 con 0x55a0b5f57200 2024-09-13T06:09:59.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.203+0000 7ff54f47a640 1 -- 172.21.15.194:0/3386952681 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94148735920736] v33'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff540112030 con 0x55a0b5f57200 2024-09-13T06:09:59.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.203+0000 7ff55196a980 20 remove_watcher() i=2 2024-09-13T06:09:59.205 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.203+0000 7ff55196a980 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94148735925552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f87170 con 0x7ff540115060 2024-09-13T06:09:59.205 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.203+0000 7ff54ec79640 1 -- 172.21.15.194:0/3386952681 <== osd.2 v2:172.21.15.194:6800/815615585 16 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94148735925552] v33'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff538036040 con 0x7ff540115060 2024-09-13T06:09:59.206 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.203+0000 7ff55196a980 20 remove_watcher() i=3 2024-09-13T06:09:59.206 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.203+0000 7ff55196a980 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94148735929280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f5e1c0 con 0x55a0b5f52810 2024-09-13T06:09:59.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.207+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 <== osd.1 v2:172.21.15.194:6808/3135444559 25 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94148735929280] v33'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5480083f0 con 0x55a0b5f52810 2024-09-13T06:09:59.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.207+0000 7ff55196a980 20 remove_watcher() i=4 2024-09-13T06:09:59.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.207+0000 7ff55196a980 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94148735931184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f5fd30 con 0x7ff53800f3d0 2024-09-13T06:09:59.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.207+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 <== osd.0 v2:172.21.15.120:6800/1923744619 27 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94148735931184] v33'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5480083f0 con 0x7ff53800f3d0 2024-09-13T06:09:59.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.207+0000 7ff55196a980 20 remove_watcher() i=5 2024-09-13T06:09:59.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.207+0000 7ff55196a980 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94148735933440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f87170 con 0x7ff53800f3d0 2024-09-13T06:09:59.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.211+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 <== osd.0 v2:172.21.15.120:6800/1923744619 28 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94148735933440] v33'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5480083f0 con 0x7ff53800f3d0 2024-09-13T06:09:59.212 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.211+0000 7ff55196a980 20 remove_watcher() i=6 2024-09-13T06:09:59.212 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.211+0000 7ff55196a980 1 -- 172.21.15.194:0/3386952681 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94148735932240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a0b5f5e1c0 con 0x7ff53800f3d0 2024-09-13T06:09:59.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.211+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 <== osd.0 v2:172.21.15.120:6800/1923744619 29 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94148735932240] v33'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5480083f0 con 0x7ff53800f3d0 2024-09-13T06:09:59.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.211+0000 7ff55196a980 20 remove_watcher() i=7 2024-09-13T06:09:59.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.211+0000 7ff55196a980 1 -- 172.21.15.194:0/3386952681 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7ff53800f3d0 msgr2=0x7ff53800f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.211+0000 7ff55196a980 1 --2- 172.21.15.194:0/3386952681 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7ff53800f3d0 0x7ff53800f7f0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.211+0000 7ff55196a980 1 -- 172.21.15.194:0/3386952681 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55a0b5f52810 msgr2=0x55a0b5f54cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.211+0000 7ff55196a980 1 --2- 172.21.15.194:0/3386952681 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55a0b5f52810 0x55a0b5f54cd0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.211+0000 7ff55196a980 1 -- 172.21.15.194:0/3386952681 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7ff540115060 msgr2=0x7ff5400e0920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.211+0000 7ff55196a980 1 --2- 172.21.15.194:0/3386952681 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7ff540115060 0x7ff5400e0920 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.211+0000 7ff55196a980 1 -- 172.21.15.194:0/3386952681 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55a0b5f57200 msgr2=0x55a0b5f595f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.211+0000 7ff55196a980 1 --2- 172.21.15.194:0/3386952681 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55a0b5f57200 0x55a0b5f595f0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.211+0000 7ff55196a980 1 -- 172.21.15.194:0/3386952681 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff418034650 msgr2=0x7ff418036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.211+0000 7ff55196a980 1 --2- 172.21.15.194:0/3386952681 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff418034650 0x7ff418036b10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x55a0b5f26800 tx=0x7ff538011000 comp rx=0 tx=0).stop 2024-09-13T06:09:59.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.211+0000 7ff55196a980 1 -- 172.21.15.194:0/3386952681 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a0b5f405c0 msgr2=0x55a0b5f477e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.211+0000 7ff54fc7b640 1 -- 172.21.15.194:0/3386952681 reap_dead start 2024-09-13T06:09:59.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.211+0000 7ff55196a980 1 --2- 172.21.15.194:0/3386952681 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a0b5f405c0 0x55a0b5f477e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff5400c7fb0 tx=0x7ff540009ee0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.211+0000 7ff55196a980 1 -- 172.21.15.194:0/3386952681 shutdown_connections 2024-09-13T06:09:59.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.211+0000 7ff55196a980 1 --2- 172.21.15.194:0/3386952681 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a0b5f405c0 0x55a0b5f477e0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.211+0000 7ff55196a980 1 -- 172.21.15.194:0/3386952681 >> 172.21.15.194:0/3386952681 conn(0x55a0b5f3c9a0 msgr2=0x55a0b5f3aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:59.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.211+0000 7ff55196a980 1 -- 172.21.15.194:0/3386952681 shutdown_connections 2024-09-13T06:09:59.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.211+0000 7ff55196a980 1 -- 172.21.15.194:0/3386952681 wait complete. 2024-09-13T06:09:59.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.215+0000 7ff55196a980 1 -- 172.21.15.194:0/2760219306 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff428034600 msgr2=0x7ff428036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.215+0000 7ff55196a980 1 --2- 172.21.15.194:0/2760219306 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff428034600 0x7ff428036ac0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x55a0b5e20d50 tx=0x7ff538006000 comp rx=0 tx=0).stop 2024-09-13T06:09:59.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.215+0000 7ff55196a980 1 -- 172.21.15.194:0/2760219306 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a0b5f33ed0 msgr2=0x55a0b5f342f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.215+0000 7ff55196a980 1 --2- 172.21.15.194:0/2760219306 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a0b5f33ed0 0x55a0b5f342f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7ff5400ce910 tx=0x7ff5400cf850 comp rx=0 tx=0).stop 2024-09-13T06:09:59.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.215+0000 7ff55196a980 1 -- 172.21.15.194:0/2760219306 shutdown_connections 2024-09-13T06:09:59.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.215+0000 7ff55196a980 1 --2- 172.21.15.194:0/2760219306 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff428034600 0x7ff428036ac0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.215+0000 7ff55196a980 1 --2- 172.21.15.194:0/2760219306 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a0b5f33ed0 0x55a0b5f342f0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.215+0000 7ff55196a980 1 -- 172.21.15.194:0/2760219306 >> 172.21.15.194:0/2760219306 conn(0x55a0b5f29020 msgr2=0x55a0b5f2baa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:59.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.215+0000 7ff55196a980 1 -- 172.21.15.194:0/2760219306 shutdown_connections 2024-09-13T06:09:59.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.215+0000 7ff55196a980 1 -- 172.21.15.194:0/2760219306 wait complete. 2024-09-13T06:09:59.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.215+0000 7ff55196a980 1 -- 172.21.15.194:0/1503544401 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55a0b5e24810 msgr2=0x55a0b5f1d220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.215+0000 7ff55196a980 1 --2- 172.21.15.194:0/1503544401 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55a0b5e24810 0x55a0b5f1d220 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.215+0000 7ff55196a980 1 -- 172.21.15.194:0/1503544401 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55a0b5f23940 msgr2=0x55a0b5f25d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.215+0000 7ff55196a980 1 --2- 172.21.15.194:0/1503544401 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55a0b5f23940 0x55a0b5f25d30 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.215+0000 7ff55196a980 1 -- 172.21.15.194:0/1503544401 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55a0b5f1fa00 msgr2=0x55a0b5f21df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.215+0000 7ff55196a980 1 --2- 172.21.15.194:0/1503544401 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55a0b5f1fa00 0x55a0b5f21df0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.215+0000 7ff55196a980 1 -- 172.21.15.194:0/1503544401 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff434034650 msgr2=0x7ff434036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.215+0000 7ff55196a980 1 --2- 172.21.15.194:0/1503544401 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff434034650 0x7ff434036b10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff538000f70 tx=0x7ff538001420 comp rx=0 tx=0).stop 2024-09-13T06:09:59.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.215+0000 7ff55196a980 1 -- 172.21.15.194:0/1503544401 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a0b5d95aa0 msgr2=0x55a0b5e21bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.215+0000 7ff55196a980 1 --2- 172.21.15.194:0/1503544401 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a0b5d95aa0 0x55a0b5e21bd0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7ff540017ca0 tx=0x7ff540017e30 comp rx=0 tx=0).stop 2024-09-13T06:09:59.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.215+0000 7ff54fc7b640 1 -- 172.21.15.194:0/1503544401 reap_dead start 2024-09-13T06:09:59.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.215+0000 7ff55196a980 1 -- 172.21.15.194:0/1503544401 shutdown_connections 2024-09-13T06:09:59.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.215+0000 7ff55196a980 1 -- 172.21.15.194:0/1503544401 >> 172.21.15.194:0/1503544401 conn(0x55a0b5e1c000 msgr2=0x55a0b5f07290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:59.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.215+0000 7ff55196a980 1 -- 172.21.15.194:0/1503544401 shutdown_connections 2024-09-13T06:09:59.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.215+0000 7ff55196a980 1 -- 172.21.15.194:0/1503544401 wait complete. 2024-09-13T06:09:59.227 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-13T06:09:59.227 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-13T06:09:59.227 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-13T06:09:59.301 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:09:59.302 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:09:59.303 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.303+0000 7f0a57559980 1 Processor -- start 2024-09-13T06:09:59.303 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.303+0000 7f0a57559980 1 -- start start 2024-09-13T06:09:59.303 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.303+0000 7f0a57559980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55ad0d9da8e0 0x55ad0d9dacc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.303 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.303+0000 7f0a57559980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ad0d860ae0 con 0x55ad0d9db230 2024-09-13T06:09:59.303 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.303+0000 7f0a57559980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x55ad0d884e30 con 0x55ad0d9da8e0 2024-09-13T06:09:59.304 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.303+0000 7f0a55069640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55ad0d9da8e0 0x55ad0d9dacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.304 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.303+0000 7f0a55069640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55ad0d9da8e0 0x55ad0d9dacc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45734/0 (socket says 172.21.15.194:45734) 2024-09-13T06:09:59.304 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.303+0000 7f0a55069640 1 -- 172.21.15.194:0/2730410053 learned_addr learned my addr 172.21.15.194:0/2730410053 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:59.304 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.303+0000 7f0a54868640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x55ad0d9db230 0x55ad0d9dfc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:51192/0 (socket says 172.21.15.194:51192) 2024-09-13T06:09:59.304 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.303+0000 7f0a55069640 1 -- 172.21.15.194:0/2730410053 >> v1:172.21.15.120:6789/0 conn(0x55ad0d9db230 legacy=0x55ad0d9dfc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.304 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.303+0000 7f0a55069640 1 -- 172.21.15.194:0/2730410053 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad0d9e24b0 con 0x55ad0d9da8e0 2024-09-13T06:09:59.306 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.303+0000 7f0a55069640 1 --2- 172.21.15.194:0/2730410053 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad0d9da8e0 0x55ad0d9dacc0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f0a4800a5c0 tx=0x7f0a4801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cb1e3e6530c39cf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.306 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.307+0000 7f0a4ffff640 1 -- 172.21.15.194:0/2730410053 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a480a6070 con 0x55ad0d9da8e0 2024-09-13T06:09:59.306 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.307+0000 7f0a4ffff640 1 -- 172.21.15.194:0/2730410053 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a480af070 con 0x55ad0d9da8e0 2024-09-13T06:09:59.306 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.307+0000 7f0a4ffff640 1 -- 172.21.15.194:0/2730410053 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a480aa5c0 con 0x55ad0d9da8e0 2024-09-13T06:09:59.307 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.307+0000 7f0a57559980 1 -- 172.21.15.194:0/2730410053 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad0d9da8e0 msgr2=0x55ad0d9dacc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.307 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.307+0000 7f0a57559980 1 --2- 172.21.15.194:0/2730410053 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad0d9da8e0 0x55ad0d9dacc0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f0a4800a5c0 tx=0x7f0a4801b340 comp rx=0 tx=0).stop 2024-09-13T06:09:59.307 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.307+0000 7f0a57559980 1 -- 172.21.15.194:0/2730410053 shutdown_connections 2024-09-13T06:09:59.307 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.307+0000 7f0a57559980 1 --2- 172.21.15.194:0/2730410053 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad0d9da8e0 0x55ad0d9dacc0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.308 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.307+0000 7f0a57559980 1 -- 172.21.15.194:0/2730410053 >> 172.21.15.194:0/2730410053 conn(0x55ad0d94e230 msgr2=0x55ad0d94e640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:59.308 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.307+0000 7f0a57559980 1 -- 172.21.15.194:0/2730410053 shutdown_connections 2024-09-13T06:09:59.308 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.307+0000 7f0a57559980 1 -- 172.21.15.194:0/2730410053 wait complete. 2024-09-13T06:09:59.323 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.323+0000 7f0a57559980 1 Processor -- start 2024-09-13T06:09:59.323 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.323+0000 7f0a57559980 1 -- start start 2024-09-13T06:09:59.323 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.323+0000 7f0a57559980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad0d9da8e0 0x55ad0dac5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.323 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.323+0000 7f0a57559980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55ad0d886200 con 0x55ad0d9da8e0 2024-09-13T06:09:59.324 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.323+0000 7f0a55069640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad0d9da8e0 0x55ad0dac5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.324 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.323+0000 7f0a55069640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad0d9da8e0 0x55ad0dac5bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45736/0 (socket says 172.21.15.194:45736) 2024-09-13T06:09:59.324 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.323+0000 7f0a55069640 1 -- 172.21.15.194:0/1619973382 learned_addr learned my addr 172.21.15.194:0/1619973382 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:59.325 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.323+0000 7f0a55069640 1 -- 172.21.15.194:0/1619973382 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad0dac61a0 con 0x55ad0d9da8e0 2024-09-13T06:09:59.325 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.323+0000 7f0a55069640 1 --2- 172.21.15.194:0/1619973382 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad0d9da8e0 0x55ad0dac5bd0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f0a4800a5c0 tx=0x7f0a48003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40cceb4317a0936f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.326 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.323+0000 7f0943606640 1 -- 172.21.15.194:0/1619973382 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a480aa9b0 con 0x55ad0d9da8e0 2024-09-13T06:09:59.326 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.323+0000 7f0943606640 1 -- 172.21.15.194:0/1619973382 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a480aab50 con 0x55ad0d9da8e0 2024-09-13T06:09:59.326 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.323+0000 7f0943606640 1 -- 172.21.15.194:0/1619973382 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a480aae50 con 0x55ad0d9da8e0 2024-09-13T06:09:59.326 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.323+0000 7f0a57559980 1 -- 172.21.15.194:0/1619973382 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad0d9da8e0 msgr2=0x55ad0dac5bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.326 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.323+0000 7f0a57559980 1 --2- 172.21.15.194:0/1619973382 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad0d9da8e0 0x55ad0dac5bd0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f0a4800a5c0 tx=0x7f0a48003030 comp rx=0 tx=0).stop 2024-09-13T06:09:59.326 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.323+0000 7f0a57559980 1 -- 172.21.15.194:0/1619973382 shutdown_connections 2024-09-13T06:09:59.326 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.323+0000 7f0a57559980 1 --2- 172.21.15.194:0/1619973382 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad0d9da8e0 0x55ad0dac5bd0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.327 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.323+0000 7f0a57559980 1 -- 172.21.15.194:0/1619973382 >> 172.21.15.194:0/1619973382 conn(0x55ad0d94e230 msgr2=0x55ad0dac1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:59.327 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.323+0000 7f0a57559980 1 -- 172.21.15.194:0/1619973382 shutdown_connections 2024-09-13T06:09:59.327 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.323+0000 7f0a57559980 1 -- 172.21.15.194:0/1619973382 wait complete. 2024-09-13T06:09:59.327 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.327+0000 7f0a57559980 1 Processor -- start 2024-09-13T06:09:59.327 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.327+0000 7f0a57559980 1 -- start start 2024-09-13T06:09:59.328 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.327+0000 7f0a57559980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad0d9da8e0 0x55ad0dacce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.328 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.327+0000 7f0a57559980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55ad0d9e1ef0 con 0x55ad0d9da8e0 2024-09-13T06:09:59.328 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.327+0000 7f0a55069640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad0d9da8e0 0x55ad0dacce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.329 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.327+0000 7f0a55069640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad0d9da8e0 0x55ad0dacce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45752/0 (socket says 172.21.15.194:45752) 2024-09-13T06:09:59.329 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.327+0000 7f0a55069640 1 -- 172.21.15.194:0/1974413247 learned_addr learned my addr 172.21.15.194:0/1974413247 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:59.329 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.327+0000 7f0a55069640 1 -- 172.21.15.194:0/1974413247 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad0dacd380 con 0x55ad0d9da8e0 2024-09-13T06:09:59.329 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.327+0000 7f0a55069640 1 --2- 172.21.15.194:0/1974413247 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad0d9da8e0 0x55ad0dacce40 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f0a4801bbe0 tx=0x7f0a480180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.329 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.327+0000 7f0941e03640 1 -- 172.21.15.194:0/1974413247 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a480c6750 con 0x55ad0d9da8e0 2024-09-13T06:09:59.329 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.327+0000 7f0a57559980 1 -- 172.21.15.194:0/1974413247 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ad0dacd610 con 0x55ad0d9da8e0 2024-09-13T06:09:59.329 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.327+0000 7f0941e03640 1 -- 172.21.15.194:0/1974413247 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a480c68f0 con 0x55ad0d9da8e0 2024-09-13T06:09:59.329 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.327+0000 7f0941e03640 1 -- 172.21.15.194:0/1974413247 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a480c6c10 con 0x55ad0d9da8e0 2024-09-13T06:09:59.329 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.327+0000 7f0a57559980 1 -- 172.21.15.194:0/1974413247 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad0dad02f0 con 0x55ad0d9da8e0 2024-09-13T06:09:59.331 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.327+0000 7f0941e03640 1 -- 172.21.15.194:0/1974413247 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0a480ce020 con 0x55ad0d9da8e0 2024-09-13T06:09:59.331 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.327+0000 7f0941e03640 1 --2- 172.21.15.194:0/1974413247 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f093c034650 0x7f093c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.331 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.327+0000 7f0941e03640 1 -- 172.21.15.194:0/1974413247 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f0a480cc020 con 0x55ad0d9da8e0 2024-09-13T06:09:59.331 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.327+0000 7f0a54868640 1 --2- 172.21.15.194:0/1974413247 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f093c034650 0x7f093c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.331 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.327+0000 7f0a57559980 1 --2- 172.21.15.194:0/1974413247 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ad0d9db230 0x55ad0dad3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.331 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.327+0000 7f0a57559980 1 -- 172.21.15.194:0/1974413247 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad0dad4480 con 0x55ad0d9db230 2024-09-13T06:09:59.331 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.327+0000 7f0a5586a640 1 --2- 172.21.15.194:0/1974413247 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ad0d9db230 0x55ad0dad3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.331 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.327+0000 7f0a54868640 1 --2- 172.21.15.194:0/1974413247 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f093c034650 0x7f093c036b10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0a40000f70 tx=0x7f0a40001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.331 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.331+0000 7f0a5586a640 1 --2- 172.21.15.194:0/1974413247 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ad0d9db230 0x55ad0dad3e10 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.331 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.331+0000 7f0a5586a640 1 -- 172.21.15.194:0/1974413247 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0a5000a4d0 con 0x55ad0d9db230 2024-09-13T06:09:59.331 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.331+0000 7f0a57559980 1 -- 172.21.15.194:0/1974413247 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad0dad1510 con 0x55ad0d9db230 2024-09-13T06:09:59.333 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.331+0000 7f0a5586a640 1 -- 172.21.15.194:0/1974413247 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0a5000a4d0 con 0x55ad0d9db230 2024-09-13T06:09:59.333 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.331+0000 7f0a57559980 1 --2- 172.21.15.194:0/1974413247 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ad0dad67d0 0x55ad0dad8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.333 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.331+0000 7f0a57559980 1 -- 172.21.15.194:0/1974413247 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad0dad92b0 con 0x55ad0dad67d0 2024-09-13T06:09:59.333 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.331+0000 7f0a55069640 1 --2- 172.21.15.194:0/1974413247 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ad0dad67d0 0x55ad0dad8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.333 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.331+0000 7f0a55069640 1 --2- 172.21.15.194:0/1974413247 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ad0dad67d0 0x55ad0dad8bc0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.331+0000 7f0a55069640 1 -- 172.21.15.194:0/1974413247 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0a480e5050 con 0x55ad0dad67d0 2024-09-13T06:09:59.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.331+0000 7f0a57559980 1 -- 172.21.15.194:0/1974413247 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad0dad5670 con 0x55ad0d9db230 2024-09-13T06:09:59.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.331+0000 7f0a5586a640 1 -- 172.21.15.194:0/1974413247 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0a5000a4d0 con 0x55ad0d9db230 2024-09-13T06:09:59.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.331+0000 7f0a57559980 1 --2- 172.21.15.194:0/1974413247 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55ad0dada710 0x55ad0dadcb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.331+0000 7f0a57559980 1 -- 172.21.15.194:0/1974413247 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad0dadd240 con 0x55ad0dada710 2024-09-13T06:09:59.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.331+0000 7f0a54868640 1 --2- 172.21.15.194:0/1974413247 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55ad0dada710 0x55ad0dadcb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.331+0000 7f0a54868640 1 --2- 172.21.15.194:0/1974413247 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55ad0dada710 0x55ad0dadcb00 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.331+0000 7f0a54868640 1 -- 172.21.15.194:0/1974413247 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0a4000f6a0 con 0x55ad0dada710 2024-09-13T06:09:59.336 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.331+0000 7f0a57559980 1 Processor -- start 2024-09-13T06:09:59.336 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.331+0000 7f0a57559980 1 -- start start 2024-09-13T06:09:59.336 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.331+0000 7f0a57559980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad0daead10 0x55ad0daeb130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.336 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.331+0000 7f0a57559980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55ad0d8df800 con 0x55ad0daead10 2024-09-13T06:09:59.336 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.335+0000 7f0a55069640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad0daead10 0x55ad0daeb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.336 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.335+0000 7f0a55069640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad0daead10 0x55ad0daeb130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45766/0 (socket says 172.21.15.194:45766) 2024-09-13T06:09:59.336 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.335+0000 7f0a55069640 1 -- 172.21.15.194:0/2816418124 learned_addr learned my addr 172.21.15.194:0/2816418124 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:59.336 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.335+0000 7f0a55069640 1 -- 172.21.15.194:0/2816418124 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad0daeb670 con 0x55ad0daead10 2024-09-13T06:09:59.336 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.335+0000 7f0a55069640 1 --2- 172.21.15.194:0/2816418124 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad0daead10 0x55ad0daeb130 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f0a48005410 tx=0x7f0a480bcdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.336 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.335+0000 7f093affd640 1 -- 172.21.15.194:0/2816418124 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a480e9070 con 0x55ad0daead10 2024-09-13T06:09:59.337 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.335+0000 7f0a57559980 1 -- 172.21.15.194:0/2816418124 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ad0daeb900 con 0x55ad0daead10 2024-09-13T06:09:59.337 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.335+0000 7f093affd640 1 -- 172.21.15.194:0/2816418124 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a480e3470 con 0x55ad0daead10 2024-09-13T06:09:59.337 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.335+0000 7f093affd640 1 -- 172.21.15.194:0/2816418124 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a480d0e60 con 0x55ad0daead10 2024-09-13T06:09:59.337 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.335+0000 7f0a57559980 1 -- 172.21.15.194:0/2816418124 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad0daee580 con 0x55ad0daead10 2024-09-13T06:09:59.338 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.335+0000 7f093affd640 1 -- 172.21.15.194:0/2816418124 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0a480d05f0 con 0x55ad0daead10 2024-09-13T06:09:59.338 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.335+0000 7f093affd640 1 --2- 172.21.15.194:0/2816418124 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f092c0345b0 0x7f092c036a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.338 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.335+0000 7f093affd640 1 -- 172.21.15.194:0/2816418124 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f0a480df0d0 con 0x55ad0daead10 2024-09-13T06:09:59.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.335+0000 7f0a54868640 1 --2- 172.21.15.194:0/2816418124 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f092c0345b0 0x7f092c036a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.335+0000 7f0a57559980 1 Processor -- start 2024-09-13T06:09:59.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.335+0000 7f0a57559980 1 -- start start 2024-09-13T06:09:59.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.335+0000 7f0a54868640 1 --2- 172.21.15.194:0/2816418124 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f092c0345b0 0x7f092c036a70 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x55ad0dad4950 tx=0x7f0a4000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.335+0000 7f0a57559980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad0daf7600 0x55ad0daf79e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.335+0000 7f0a57559980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55ad0dac6460 con 0x55ad0daf7600 2024-09-13T06:09:59.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.335+0000 7f0a55069640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad0daf7600 0x55ad0daf79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.335+0000 7f0a55069640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad0daf7600 0x55ad0daf79e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45772/0 (socket says 172.21.15.194:45772) 2024-09-13T06:09:59.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.335+0000 7f0a55069640 1 -- 172.21.15.194:0/3699561441 learned_addr learned my addr 172.21.15.194:0/3699561441 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:59.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.339+0000 7f0a55069640 1 -- 172.21.15.194:0/3699561441 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad0daf7fb0 con 0x55ad0daf7600 2024-09-13T06:09:59.341 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.339+0000 7f0a55069640 1 --2- 172.21.15.194:0/3699561441 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad0daf7600 0x55ad0daf79e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f0a480bcf50 tx=0x7f0a480e56f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec42d8407fff48a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.341 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.339+0000 7f0938ff9640 1 -- 172.21.15.194:0/3699561441 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a480a8bc0 con 0x55ad0daf7600 2024-09-13T06:09:59.341 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.339+0000 7f0938ff9640 1 -- 172.21.15.194:0/3699561441 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a480f1e30 con 0x55ad0daf7600 2024-09-13T06:09:59.341 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.339+0000 7f0938ff9640 1 -- 172.21.15.194:0/3699561441 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a480bc3a0 con 0x55ad0daf7600 2024-09-13T06:09:59.341 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.339+0000 7f0a57559980 1 -- 172.21.15.194:0/3699561441 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad0daf7600 msgr2=0x55ad0daf79e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.339+0000 7f0a57559980 1 --2- 172.21.15.194:0/3699561441 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad0daf7600 0x55ad0daf79e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f0a480bcf50 tx=0x7f0a480e56f0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.339+0000 7f0a57559980 1 -- 172.21.15.194:0/3699561441 shutdown_connections 2024-09-13T06:09:59.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.339+0000 7f0a57559980 1 --2- 172.21.15.194:0/3699561441 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad0daf7600 0x55ad0daf79e0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.339+0000 7f0a57559980 1 -- 172.21.15.194:0/3699561441 >> 172.21.15.194:0/3699561441 conn(0x55ad0daf39e0 msgr2=0x55ad0daf1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:59.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.339+0000 7f0a57559980 1 -- 172.21.15.194:0/3699561441 shutdown_connections 2024-09-13T06:09:59.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.339+0000 7f0a57559980 1 -- 172.21.15.194:0/3699561441 wait complete. 2024-09-13T06:09:59.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.339+0000 7f0a57559980 1 Processor -- start 2024-09-13T06:09:59.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.339+0000 7f0a57559980 1 -- start start 2024-09-13T06:09:59.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.339+0000 7f0a57559980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad0daf7600 0x55ad0dafe680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.339+0000 7f0a57559980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55ad0daf7fb0 con 0x55ad0daf7600 2024-09-13T06:09:59.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.339+0000 7f0a55069640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad0daf7600 0x55ad0dafe680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.343 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.339+0000 7f0a55069640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad0daf7600 0x55ad0dafe680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45776/0 (socket says 172.21.15.194:45776) 2024-09-13T06:09:59.343 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.339+0000 7f0a55069640 1 -- 172.21.15.194:0/2781996058 learned_addr learned my addr 172.21.15.194:0/2781996058 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:59.343 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.339+0000 7f0a55069640 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad0dafebc0 con 0x55ad0daf7600 2024-09-13T06:09:59.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.339+0000 7f0a55069640 1 --2- 172.21.15.194:0/2781996058 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad0daf7600 0x55ad0dafe680 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f0a480cf000 tx=0x7f0a480cef50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.339+0000 7f092affd640 1 -- 172.21.15.194:0/2781996058 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a480c9cc0 con 0x55ad0daf7600 2024-09-13T06:09:59.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.339+0000 7f092affd640 1 -- 172.21.15.194:0/2781996058 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a480c9e60 con 0x55ad0daf7600 2024-09-13T06:09:59.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.339+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ad0dafebc0 con 0x55ad0daf7600 2024-09-13T06:09:59.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.339+0000 7f092affd640 1 -- 172.21.15.194:0/2781996058 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a48006750 con 0x55ad0daf7600 2024-09-13T06:09:59.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.343+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad0dafebc0 con 0x55ad0daf7600 2024-09-13T06:09:59.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.343+0000 7f092affd640 1 -- 172.21.15.194:0/2781996058 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0a48114060 con 0x55ad0daf7600 2024-09-13T06:09:59.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.343+0000 7f092affd640 1 --2- 172.21.15.194:0/2781996058 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0920034650 0x7f0920036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.343+0000 7f092affd640 1 -- 172.21.15.194:0/2781996058 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f0a480cabc0 con 0x55ad0daf7600 2024-09-13T06:09:59.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.343+0000 7f0a54868640 1 --2- 172.21.15.194:0/2781996058 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0920034650 0x7f0920036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.343+0000 7f0a57559980 20 rados->read ofs=0 len=0 2024-09-13T06:09:59.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.343+0000 7f0a57559980 1 --2- 172.21.15.194:0/2781996058 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ad0db094d0 0x55ad0db0b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.343+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db0c0e0 con 0x55ad0db094d0 2024-09-13T06:09:59.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.343+0000 7f0a5586a640 1 --2- 172.21.15.194:0/2781996058 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ad0db094d0 0x55ad0db0b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.343+0000 7f0a54868640 1 --2- 172.21.15.194:0/2781996058 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0920034650 0x7f0920036b10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0a4000c010 tx=0x7f0a40010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.343+0000 7f0a5586a640 1 --2- 172.21.15.194:0/2781996058 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ad0db094d0 0x55ad0db0b990 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.343+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0a5000a4d0 con 0x55ad0db094d0 2024-09-13T06:09:59.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.343+0000 7f0a57559980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:59.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.343+0000 7f0a57559980 20 realm 2024-09-13T06:09:59.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.343+0000 7f0a57559980 20 rados->read ofs=0 len=0 2024-09-13T06:09:59.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.343+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db0c4f0 con 0x55ad0db094d0 2024-09-13T06:09:59.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.343+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0a5000a4d0 con 0x55ad0db094d0 2024-09-13T06:09:59.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.343+0000 7f0a57559980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:59.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.343+0000 7f0a57559980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:09:59.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.343+0000 7f0a57559980 20 rados->read ofs=0 len=0 2024-09-13T06:09:59.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.343+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db0cdc0 con 0x55ad0db094d0 2024-09-13T06:09:59.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.343+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0a5000a4d0 con 0x55ad0db094d0 2024-09-13T06:09:59.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.343+0000 7f0a57559980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:59.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.343+0000 7f0a57559980 20 rados->read ofs=0 len=0 2024-09-13T06:09:59.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.343+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db0d160 con 0x55ad0db094d0 2024-09-13T06:09:59.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.343+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0a5000a4d0 con 0x55ad0db094d0 2024-09-13T06:09:59.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.343+0000 7f0a57559980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:59.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.343+0000 7f0a57559980 20 rados->read ofs=0 len=0 2024-09-13T06:09:59.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.343+0000 7f0a57559980 1 --2- 172.21.15.194:0/2781996058 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ad0db0dec0 0x55ad0db102b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.343+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db108c0 con 0x55ad0db0dec0 2024-09-13T06:09:59.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.343+0000 7f0a55069640 1 --2- 172.21.15.194:0/2781996058 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ad0db0dec0 0x55ad0db102b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.343+0000 7f0a55069640 1 --2- 172.21.15.194:0/2781996058 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ad0db0dec0 0x55ad0db102b0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.347+0000 7f0a55069640 1 -- 172.21.15.194:0/2781996058 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0a480eb070 con 0x55ad0db0dec0 2024-09-13T06:09:59.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.347+0000 7f0a57559980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:09:59.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.347+0000 7f0a57559980 20 searching for the correct realm 2024-09-13T06:09:59.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.347+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db12190 con 0x55ad0db0dec0 2024-09-13T06:09:59.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.347+0000 7f0a55069640 1 -- 172.21.15.194:0/2781996058 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a480eb070 con 0x55ad0db0dec0 2024-09-13T06:09:59.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.347+0000 7f0a55069640 1 --2- 172.21.15.194:0/2781996058 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f0a48116070 0x7f0a480fa480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.347+0000 7f0a55069640 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db12190 con 0x7f0a48116070 2024-09-13T06:09:59.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.347+0000 7f0a54868640 1 --2- 172.21.15.194:0/2781996058 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f0a48116070 0x7f0a480fa480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.347+0000 7f0a54868640 1 --2- 172.21.15.194:0/2781996058 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f0a48116070 0x7f0a480fa480 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.347+0000 7f0a54868640 1 -- 172.21.15.194:0/2781996058 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0a40037040 con 0x7f0a48116070 2024-09-13T06:09:59.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.347+0000 7f0a54868640 1 --2- 172.21.15.194:0/2781996058 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f0a4001fbe0 0x7f0a4003a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.347+0000 7f0a54868640 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db12190 con 0x7f0a4001fbe0 2024-09-13T06:09:59.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.347+0000 7f0a5586a640 1 --2- 172.21.15.194:0/2781996058 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f0a4001fbe0 0x7f0a4003a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.347+0000 7f0a5586a640 1 --2- 172.21.15.194:0/2781996058 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f0a4001fbe0 0x7f0a4003a3c0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.347+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a5000a4d0 con 0x7f0a4001fbe0 2024-09-13T06:09:59.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.347+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db0d160 con 0x55ad0db094d0 2024-09-13T06:09:59.355 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.347+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a5000a4d0 con 0x55ad0db094d0 2024-09-13T06:09:59.355 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.347+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db0d160 con 0x55ad0db094d0 2024-09-13T06:09:59.355 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.347+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a5000a4d0 con 0x55ad0db094d0 2024-09-13T06:09:59.355 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.347+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db0d160 con 0x7f0a4001fbe0 2024-09-13T06:09:59.355 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.351+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a5000a4d0 con 0x7f0a4001fbe0 2024-09-13T06:09:59.355 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.351+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db0d160 con 0x7f0a4001fbe0 2024-09-13T06:09:59.355 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.351+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a5000a4d0 con 0x7f0a4001fbe0 2024-09-13T06:09:59.355 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.351+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db0d160 con 0x7f0a48116070 2024-09-13T06:09:59.355 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.351+0000 7f0a54868640 1 -- 172.21.15.194:0/2781996058 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a40037040 con 0x7f0a48116070 2024-09-13T06:09:59.355 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.351+0000 7f0a54868640 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db0d160 con 0x55ad0db0dec0 2024-09-13T06:09:59.355 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.351+0000 7f0a55069640 1 -- 172.21.15.194:0/2781996058 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a480eb070 con 0x55ad0db0dec0 2024-09-13T06:09:59.355 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.351+0000 7f0a55069640 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f0a48123040 con 0x55ad0db094d0 2024-09-13T06:09:59.356 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.351+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a5000a4d0 con 0x55ad0db094d0 2024-09-13T06:09:59.356 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.351+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f0a48123040 con 0x7f0a4001fbe0 2024-09-13T06:09:59.356 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.351+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a5000a4d0 con 0x7f0a4001fbe0 2024-09-13T06:09:59.356 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.351+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f0a48123040 con 0x55ad0db094d0 2024-09-13T06:09:59.356 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.351+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a5000a4d0 con 0x55ad0db094d0 2024-09-13T06:09:59.356 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.351+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f0a48123040 con 0x7f0a48116070 2024-09-13T06:09:59.356 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.351+0000 7f0a54868640 1 -- 172.21.15.194:0/2781996058 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0a40037040 con 0x7f0a48116070 2024-09-13T06:09:59.356 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.351+0000 7f0a54868640 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f0a48123040 con 0x55ad0db0dec0 2024-09-13T06:09:59.356 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.351+0000 7f0a55069640 1 -- 172.21.15.194:0/2781996058 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a480eb070 con 0x55ad0db0dec0 2024-09-13T06:09:59.356 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.351+0000 7f0a55069640 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f0a48123040 con 0x55ad0db0dec0 2024-09-13T06:09:59.356 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.351+0000 7f0a55069640 1 -- 172.21.15.194:0/2781996058 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a480eb070 con 0x55ad0db0dec0 2024-09-13T06:09:59.356 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.351+0000 7f0a55069640 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f0a48123040 con 0x7f0a4001fbe0 2024-09-13T06:09:59.366 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.355+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a5000a4d0 con 0x7f0a4001fbe0 2024-09-13T06:09:59.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.355+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f0a48123040 con 0x55ad0db0dec0 2024-09-13T06:09:59.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.355+0000 7f0a55069640 1 -- 172.21.15.194:0/2781996058 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a480eb070 con 0x55ad0db0dec0 2024-09-13T06:09:59.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.355+0000 7f0a55069640 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f0a48123040 con 0x55ad0db0dec0 2024-09-13T06:09:59.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.355+0000 7f0a55069640 1 -- 172.21.15.194:0/2781996058 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a480eb070 con 0x55ad0db0dec0 2024-09-13T06:09:59.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.355+0000 7f0a55069640 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f0a48123040 con 0x55ad0db094d0 2024-09-13T06:09:59.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.355+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a5000a4d0 con 0x55ad0db094d0 2024-09-13T06:09:59.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.355+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f0a48123040 con 0x55ad0db094d0 2024-09-13T06:09:59.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.355+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0a5000a4d0 con 0x55ad0db094d0 2024-09-13T06:09:59.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.355+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f0a48123040 con 0x7f0a4001fbe0 2024-09-13T06:09:59.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.355+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a5000a4d0 con 0x7f0a4001fbe0 2024-09-13T06:09:59.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.355+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f0a48123040 con 0x55ad0db0dec0 2024-09-13T06:09:59.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.355+0000 7f0a55069640 1 -- 172.21.15.194:0/2781996058 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a480eb070 con 0x55ad0db0dec0 2024-09-13T06:09:59.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.355+0000 7f0a55069640 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f0a48123040 con 0x7f0a48116070 2024-09-13T06:09:59.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.355+0000 7f0a54868640 1 -- 172.21.15.194:0/2781996058 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a40037040 con 0x7f0a48116070 2024-09-13T06:09:59.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.355+0000 7f0a54868640 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f0a48123040 con 0x55ad0db094d0 2024-09-13T06:09:59.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.355+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a5000a4d0 con 0x55ad0db094d0 2024-09-13T06:09:59.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.355+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f0a48123040 con 0x7f0a4001fbe0 2024-09-13T06:09:59.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.359+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a5000a4d0 con 0x7f0a4001fbe0 2024-09-13T06:09:59.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.359+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f0a48123040 con 0x55ad0db0dec0 2024-09-13T06:09:59.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.359+0000 7f0a55069640 1 -- 172.21.15.194:0/2781996058 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0a480eb070 con 0x55ad0db0dec0 2024-09-13T06:09:59.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.359+0000 7f0a55069640 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f0a48123040 con 0x7f0a4001fbe0 2024-09-13T06:09:59.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.359+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a5000a4d0 con 0x7f0a4001fbe0 2024-09-13T06:09:59.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.359+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f0a48123040 con 0x7f0a48116070 2024-09-13T06:09:59.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.359+0000 7f0a54868640 1 -- 172.21.15.194:0/2781996058 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a40037040 con 0x7f0a48116070 2024-09-13T06:09:59.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.359+0000 7f0a54868640 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f0a48123040 con 0x55ad0db0dec0 2024-09-13T06:09:59.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.359+0000 7f0a55069640 1 -- 172.21.15.194:0/2781996058 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a480eb070 con 0x55ad0db0dec0 2024-09-13T06:09:59.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.359+0000 7f0a55069640 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f0a48123040 con 0x7f0a4001fbe0 2024-09-13T06:09:59.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.359+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a5000a4d0 con 0x7f0a4001fbe0 2024-09-13T06:09:59.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.359+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f0a48123040 con 0x55ad0db094d0 2024-09-13T06:09:59.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.359+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0a5000a4d0 con 0x55ad0db094d0 2024-09-13T06:09:59.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.359+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f0a48123040 con 0x7f0a48116070 2024-09-13T06:09:59.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.359+0000 7f0a54868640 1 -- 172.21.15.194:0/2781996058 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a40037040 con 0x7f0a48116070 2024-09-13T06:09:59.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.359+0000 7f0a57559980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:09:59.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.359+0000 7f0a57559980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:09:59.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.359+0000 7f0a57559980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:09:59.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.359+0000 7f0a57559980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:09:59.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.359+0000 7f0a57559980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:09:59.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.359+0000 7f0a57559980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:09:59.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.359+0000 7f0a57559980 20 rados->read ofs=0 len=0 2024-09-13T06:09:59.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.359+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db11240 con 0x55ad0db094d0 2024-09-13T06:09:59.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.359+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0a5000a4d0 con 0x55ad0db094d0 2024-09-13T06:09:59.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.359+0000 7f0a57559980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:59.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.359+0000 7f0a57559980 20 rados->read ofs=0 len=0 2024-09-13T06:09:59.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.359+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db11ae0 con 0x55ad0db094d0 2024-09-13T06:09:59.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.359+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0a5000a4d0 con 0x55ad0db094d0 2024-09-13T06:09:59.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.359+0000 7f0a57559980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:59.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.359+0000 7f0a57559980 20 rados->read ofs=0 len=0 2024-09-13T06:09:59.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.359+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db11630 con 0x7f0a48116070 2024-09-13T06:09:59.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.359+0000 7f0a54868640 1 -- 172.21.15.194:0/2781996058 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0a40037040 con 0x7f0a48116070 2024-09-13T06:09:59.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.363+0000 7f0a57559980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:09:59.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.363+0000 7f0a57559980 20 zone default found 2024-09-13T06:09:59.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.363+0000 7f0a57559980 4 Realm: () 2024-09-13T06:09:59.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.363+0000 7f0a57559980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:09:59.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.363+0000 7f0a57559980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:09:59.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.363+0000 7f0a57559980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:09:59.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.363+0000 7f0a57559980 20 zonegroup default 2024-09-13T06:09:59.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.363+0000 7f0a57559980 20 rados->read ofs=0 len=0 2024-09-13T06:09:59.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.363+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db125c0 con 0x7f0a4001fbe0 2024-09-13T06:09:59.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.363+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0a5000a4d0 con 0x7f0a4001fbe0 2024-09-13T06:09:59.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.363+0000 7f0a57559980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:59.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.363+0000 7f0a57559980 20 rados->read ofs=0 len=0 2024-09-13T06:09:59.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.363+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db13fd0 con 0x55ad0db0dec0 2024-09-13T06:09:59.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.363+0000 7f0a55069640 1 -- 172.21.15.194:0/2781996058 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0a480eb070 con 0x55ad0db0dec0 2024-09-13T06:09:59.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.363+0000 7f0a57559980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:59.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.363+0000 7f0a57559980 20 rados->read ofs=0 len=0 2024-09-13T06:09:59.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.363+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db144a0 con 0x55ad0db0dec0 2024-09-13T06:09:59.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.363+0000 7f0a55069640 1 -- 172.21.15.194:0/2781996058 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0a480eb070 con 0x55ad0db0dec0 2024-09-13T06:09:59.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.363+0000 7f0a57559980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:59.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.363+0000 7f0a57559980 20 started sync module instance, tier type = 2024-09-13T06:09:59.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.363+0000 7f0a57559980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:09:59.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.363+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db11fc0 con 0x7f0a48116070 2024-09-13T06:09:59.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.363+0000 7f0a54868640 1 -- 172.21.15.194:0/2781996058 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(44 notify.0 [create] v33'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a40037040 con 0x7f0a48116070 2024-09-13T06:09:59.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.363+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94201747420400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db14940 con 0x7f0a48116070 2024-09-13T06:09:59.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.363+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db153e0 con 0x55ad0db094d0 2024-09-13T06:09:59.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.367+0000 7f0a54868640 1 -- 172.21.15.194:0/2781996058 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94201747420400] v33'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a40037040 con 0x7f0a48116070 2024-09-13T06:09:59.374 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.367+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v33'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a5000a4d0 con 0x55ad0db094d0 2024-09-13T06:09:59.374 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.367+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94201747427024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db157d0 con 0x55ad0db094d0 2024-09-13T06:09:59.374 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.367+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db16190 con 0x55ad0db0dec0 2024-09-13T06:09:59.374 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.367+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94201747427024] v33'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a5000a4d0 con 0x55ad0db094d0 2024-09-13T06:09:59.374 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.367+0000 7f0a55069640 1 -- 172.21.15.194:0/2781996058 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v33'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a480eb070 con 0x55ad0db0dec0 2024-09-13T06:09:59.374 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.367+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94201747421712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db16190 con 0x55ad0db0dec0 2024-09-13T06:09:59.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.367+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db16ba0 con 0x7f0a48116070 2024-09-13T06:09:59.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.371+0000 7f0a54868640 1 -- 172.21.15.194:0/2781996058 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(50 notify.3 [create] v33'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a40037040 con 0x7f0a48116070 2024-09-13T06:09:59.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.371+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94201747433200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db17440 con 0x7f0a48116070 2024-09-13T06:09:59.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.371+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db17e80 con 0x55ad0db094d0 2024-09-13T06:09:59.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.371+0000 7f0a55069640 1 -- 172.21.15.194:0/2781996058 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94201747421712] v33'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a480eb070 con 0x55ad0db0dec0 2024-09-13T06:09:59.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.371+0000 7f0a54868640 1 -- 172.21.15.194:0/2781996058 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94201747433200] v33'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a40037040 con 0x7f0a48116070 2024-09-13T06:09:59.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.371+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v33'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a5000a4d0 con 0x55ad0db094d0 2024-09-13T06:09:59.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.371+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94201747435408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db15ce0 con 0x55ad0db094d0 2024-09-13T06:09:59.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.371+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db18720 con 0x7f0a4001fbe0 2024-09-13T06:09:59.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.375+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94201747435408] v33'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a5000a4d0 con 0x55ad0db094d0 2024-09-13T06:09:59.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.375+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(54 notify.5 [create] v33'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a5000a4d0 con 0x7f0a4001fbe0 2024-09-13T06:09:59.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.375+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94201747437904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db18680 con 0x7f0a4001fbe0 2024-09-13T06:09:59.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.375+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db19040 con 0x7f0a4001fbe0 2024-09-13T06:09:59.377 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.375+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94201747437904] v33'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a5000a4d0 con 0x7f0a4001fbe0 2024-09-13T06:09:59.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.375+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(56 notify.6 [create] v33'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a5000a4d0 con 0x7f0a4001fbe0 2024-09-13T06:09:59.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.375+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94201747440352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db19040 con 0x7f0a4001fbe0 2024-09-13T06:09:59.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.375+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db19a00 con 0x7f0a4001fbe0 2024-09-13T06:09:59.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.379+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94201747440352] v33'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a5000a4d0 con 0x7f0a4001fbe0 2024-09-13T06:09:59.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.379+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(58 notify.7 [create] v33'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a5000a4d0 con 0x7f0a4001fbe0 2024-09-13T06:09:59.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.379+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94201747442848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db19a00 con 0x7f0a4001fbe0 2024-09-13T06:09:59.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.379+0000 7f0a57559980 20 add_watcher() i=0 2024-09-13T06:09:59.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.379+0000 7f0a57559980 20 add_watcher() i=1 2024-09-13T06:09:59.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.379+0000 7f0a57559980 20 add_watcher() i=2 2024-09-13T06:09:59.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.379+0000 7f0a57559980 20 add_watcher() i=3 2024-09-13T06:09:59.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.379+0000 7f0a57559980 20 add_watcher() i=4 2024-09-13T06:09:59.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.379+0000 7f0a57559980 20 add_watcher() i=5 2024-09-13T06:09:59.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.379+0000 7f0a57559980 20 add_watcher() i=6 2024-09-13T06:09:59.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.379+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94201747442848] v33'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a5000a4d0 con 0x7f0a4001fbe0 2024-09-13T06:09:59.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.379+0000 7f0a57559980 20 add_watcher() i=7 2024-09-13T06:09:59.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.379+0000 7f0a57559980 2 all 8 watchers are set, enabling cache 2024-09-13T06:09:59.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.379+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db1cd20 con 0x55ad0db094d0 2024-09-13T06:09:59.382 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.379+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0a5000a4d0 con 0x55ad0db094d0 2024-09-13T06:09:59.382 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.379+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94201747457888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db19b70 con 0x55ad0db094d0 2024-09-13T06:09:59.383 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.383+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94201747457888] v33'112 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0a5000a4d0 con 0x55ad0db094d0 2024-09-13T06:09:59.383 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.383+0000 7f090b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:59.383 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.383+0000 7f0a57559980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:09:59.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.383+0000 7f0a57559980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:09:59.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.383+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db1c0d0 con 0x55ad0db094d0 2024-09-13T06:09:59.385 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.383+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0a5000a4d0 con 0x55ad0db094d0 2024-09-13T06:09:59.385 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.383+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db25e60 con 0x7f0a4001fbe0 2024-09-13T06:09:59.387 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.387+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'14 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0a5000a4d0 con 0x7f0a4001fbe0 2024-09-13T06:09:59.387 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.387+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db26260 con 0x55ad0db0dec0 2024-09-13T06:09:59.388 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.387+0000 7f0a55069640 1 -- 172.21.15.194:0/2781996058 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0a480eb070 con 0x55ad0db0dec0 2024-09-13T06:09:59.388 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.387+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db26230 con 0x55ad0db094d0 2024-09-13T06:09:59.390 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.387+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'113 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0a5000a4d0 con 0x55ad0db094d0 2024-09-13T06:09:59.390 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.387+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db266e0 con 0x7f0a48116070 2024-09-13T06:09:59.391 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.391+0000 7f0a54868640 1 -- 172.21.15.194:0/2781996058 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'32 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0a40037040 con 0x7f0a48116070 2024-09-13T06:09:59.391 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.391+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db25450 con 0x55ad0db0dec0 2024-09-13T06:09:59.393 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.391+0000 7f0a55069640 1 -- 172.21.15.194:0/2781996058 <== osd.3 v2:172.21.15.194:6816/96632515 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'22 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0a480eb070 con 0x55ad0db0dec0 2024-09-13T06:09:59.393 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.391+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db25450 con 0x55ad0db094d0 2024-09-13T06:09:59.395 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.395+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0a5000a4d0 con 0x55ad0db094d0 2024-09-13T06:09:59.395 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.395+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db25450 con 0x7f0a4001fbe0 2024-09-13T06:09:59.397 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.395+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'21 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0a5000a4d0 con 0x7f0a4001fbe0 2024-09-13T06:09:59.397 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.395+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db25450 con 0x7f0a48116070 2024-09-13T06:09:59.399 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.399+0000 7f0a54868640 1 -- 172.21.15.194:0/2781996058 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0a40037040 con 0x7f0a48116070 2024-09-13T06:09:59.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.399+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db27290 con 0x55ad0db0dec0 2024-09-13T06:09:59.401 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.399+0000 7f0a55069640 1 -- 172.21.15.194:0/2781996058 <== osd.3 v2:172.21.15.194:6816/96632515 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0a480eb070 con 0x55ad0db0dec0 2024-09-13T06:09:59.401 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.399+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db27290 con 0x7f0a48116070 2024-09-13T06:09:59.402 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.403+0000 7f0a54868640 1 -- 172.21.15.194:0/2781996058 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'33 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0a40037040 con 0x7f0a48116070 2024-09-13T06:09:59.403 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.403+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db27740 con 0x7f0a4001fbe0 2024-09-13T06:09:59.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.403+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0a5000a4d0 con 0x7f0a4001fbe0 2024-09-13T06:09:59.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.403+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db27740 con 0x7f0a48116070 2024-09-13T06:09:59.406 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.403+0000 7f0a54868640 1 -- 172.21.15.194:0/2781996058 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0a40037040 con 0x7f0a48116070 2024-09-13T06:09:59.406 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.403+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db27740 con 0x7f0a4001fbe0 2024-09-13T06:09:59.408 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.407+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 <== osd.0 v2:172.21.15.120:6800/1923744619 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'27 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0a5000a4d0 con 0x7f0a4001fbe0 2024-09-13T06:09:59.408 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.407+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db27740 con 0x55ad0db094d0 2024-09-13T06:09:59.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.407+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'114 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0a5000a4d0 con 0x55ad0db094d0 2024-09-13T06:09:59.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.407+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db27740 con 0x55ad0db0dec0 2024-09-13T06:09:59.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.411+0000 7f0a55069640 1 -- 172.21.15.194:0/2781996058 <== osd.3 v2:172.21.15.194:6816/96632515 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'26 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0a480eb070 con 0x55ad0db0dec0 2024-09-13T06:09:59.412 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.411+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db27740 con 0x7f0a48116070 2024-09-13T06:09:59.412 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.411+0000 7f0a54868640 1 -- 172.21.15.194:0/2781996058 <== osd.2 v2:172.21.15.194:6800/815615585 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'34 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0a40037040 con 0x7f0a48116070 2024-09-13T06:09:59.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.411+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db27740 con 0x55ad0db0dec0 2024-09-13T06:09:59.414 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.411+0000 7f0a55069640 1 -- 172.21.15.194:0/2781996058 <== osd.3 v2:172.21.15.194:6816/96632515 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0a480eb070 con 0x55ad0db0dec0 2024-09-13T06:09:59.414 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.411+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db27740 con 0x55ad0db094d0 2024-09-13T06:09:59.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.415+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 <== osd.1 v2:172.21.15.194:6808/3135444559 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0a5000a4d0 con 0x55ad0db094d0 2024-09-13T06:09:59.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.415+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db27740 con 0x55ad0db094d0 2024-09-13T06:09:59.417 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.415+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 <== osd.1 v2:172.21.15.194:6808/3135444559 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'115 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0a5000a4d0 con 0x55ad0db094d0 2024-09-13T06:09:59.417 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.415+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db27740 con 0x55ad0db0dec0 2024-09-13T06:09:59.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.419+0000 7f0a55069640 1 -- 172.21.15.194:0/2781996058 <== osd.3 v2:172.21.15.194:6816/96632515 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'27 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0a480eb070 con 0x55ad0db0dec0 2024-09-13T06:09:59.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.419+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db27740 con 0x7f0a48116070 2024-09-13T06:09:59.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.419+0000 7f0a54868640 1 -- 172.21.15.194:0/2781996058 <== osd.2 v2:172.21.15.194:6800/815615585 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'24 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0a40037040 con 0x7f0a48116070 2024-09-13T06:09:59.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.419+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db277d0 con 0x55ad0db0dec0 2024-09-13T06:09:59.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.423+0000 7f0a55069640 1 -- 172.21.15.194:0/2781996058 <== osd.3 v2:172.21.15.194:6816/96632515 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0a480eb070 con 0x55ad0db0dec0 2024-09-13T06:09:59.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.423+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db27c80 con 0x55ad0db0dec0 2024-09-13T06:09:59.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.423+0000 7f0a55069640 1 -- 172.21.15.194:0/2781996058 <== osd.3 v2:172.21.15.194:6816/96632515 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0a480eb070 con 0x55ad0db0dec0 2024-09-13T06:09:59.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.423+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db24dd0 con 0x55ad0db0dec0 2024-09-13T06:09:59.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.423+0000 7f0a55069640 1 -- 172.21.15.194:0/2781996058 <== osd.3 v2:172.21.15.194:6816/96632515 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0a480eb070 con 0x55ad0db0dec0 2024-09-13T06:09:59.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.423+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db24dd0 con 0x55ad0db0dec0 2024-09-13T06:09:59.427 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.427+0000 7f0a55069640 1 -- 172.21.15.194:0/2781996058 <== osd.3 v2:172.21.15.194:6816/96632515 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'23 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0a480eb070 con 0x55ad0db0dec0 2024-09-13T06:09:59.427 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.427+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db24dd0 con 0x7f0a4001fbe0 2024-09-13T06:09:59.430 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.427+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 <== osd.0 v2:172.21.15.120:6800/1923744619 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0a5000a4d0 con 0x7f0a4001fbe0 2024-09-13T06:09:59.430 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.427+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db24dd0 con 0x55ad0db0dec0 2024-09-13T06:09:59.431 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.431+0000 7f0a55069640 1 -- 172.21.15.194:0/2781996058 <== osd.3 v2:172.21.15.194:6816/96632515 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0a480eb070 con 0x55ad0db0dec0 2024-09-13T06:09:59.432 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.431+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db24dd0 con 0x7f0a4001fbe0 2024-09-13T06:09:59.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.431+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 <== osd.0 v2:172.21.15.120:6800/1923744619 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'22 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0a5000a4d0 con 0x7f0a4001fbe0 2024-09-13T06:09:59.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.431+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db24dd0 con 0x55ad0db0dec0 2024-09-13T06:09:59.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.435+0000 7f0a55069640 1 -- 172.21.15.194:0/2781996058 <== osd.3 v2:172.21.15.194:6816/96632515 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'28 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0a480eb070 con 0x55ad0db0dec0 2024-09-13T06:09:59.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.435+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db24dd0 con 0x7f0a4001fbe0 2024-09-13T06:09:59.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.435+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 <== osd.0 v2:172.21.15.120:6800/1923744619 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'28 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0a5000a4d0 con 0x7f0a4001fbe0 2024-09-13T06:09:59.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.435+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db24dd0 con 0x7f0a48116070 2024-09-13T06:09:59.440 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.439+0000 7f0a54868640 1 -- 172.21.15.194:0/2781996058 <== osd.2 v2:172.21.15.194:6800/815615585 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0a40037040 con 0x7f0a48116070 2024-09-13T06:09:59.441 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.439+0000 7f090a7e4640 20 reqs_thread_entry: start 2024-09-13T06:09:59.441 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.439+0000 7f0a57559980 20 init_complete bucket index max shards: 11 2024-09-13T06:09:59.441 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.439+0000 7f0a57559980 20 Filter name: none 2024-09-13T06:09:59.441 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.439+0000 7f087bfff640 20 reqs_thread_entry: start 2024-09-13T06:09:59.441 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.439+0000 7f0a57559980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T06:09:59.441 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.439+0000 7f0a57559980 20 rados->read ofs=0 len=0 2024-09-13T06:09:59.441 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.439+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db24da0 con 0x7f0a4001fbe0 2024-09-13T06:09:59.442 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.439+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 <== osd.0 v2:172.21.15.120:6800/1923744619 24 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f0a5000a4d0 con 0x7f0a4001fbe0 2024-09-13T06:09:59.442 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.439+0000 7f0a57559980 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T06:09:59.442 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.439+0000 7f0a57559980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-13T06:09:59.442 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.439+0000 7f0a57559980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T06:09:59.442 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.439+0000 7f0a57559980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:09:59.442 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.439+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db453e0 con 0x7f0a4001fbe0 2024-09-13T06:09:59.443 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.443+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 <== osd.0 v2:172.21.15.120:6800/1923744619 25 ==== osd_op_reply(95 fud.buckets [call out=183b] v0'0 uv5 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f0a5000a4d0 con 0x7f0a4001fbe0 2024-09-13T06:09:59.443 INFO:teuthology.orchestra.run.smithi194.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-13T06:09:59.444 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.443+0000 7f090b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:59.444 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.443+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94201747457888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db02f80 con 0x55ad0db094d0 2024-09-13T06:09:59.445 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.443+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 <== osd.1 v2:172.21.15.194:6808/3135444559 27 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94201747457888] v33'116 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0a5000a4d0 con 0x55ad0db094d0 2024-09-13T06:09:59.445 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.443+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94201747420400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db1c760 con 0x7f0a48116070 2024-09-13T06:09:59.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.447+0000 7f0a54868640 1 -- 172.21.15.194:0/2781996058 <== osd.2 v2:172.21.15.194:6800/815615585 19 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94201747420400] v33'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a40037040 con 0x7f0a48116070 2024-09-13T06:09:59.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.447+0000 7f0a57559980 20 remove_watcher() i=0 2024-09-13T06:09:59.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.447+0000 7f0a57559980 2 removed watcher, disabling cache 2024-09-13T06:09:59.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.447+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94201747427024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db134f0 con 0x55ad0db094d0 2024-09-13T06:09:59.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.447+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 <== osd.1 v2:172.21.15.194:6808/3135444559 28 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94201747427024] v33'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a5000a4d0 con 0x55ad0db094d0 2024-09-13T06:09:59.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.447+0000 7f0a57559980 20 remove_watcher() i=1 2024-09-13T06:09:59.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.447+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94201747421712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db14ed0 con 0x55ad0db0dec0 2024-09-13T06:09:59.451 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.451+0000 7f0a55069640 1 -- 172.21.15.194:0/2781996058 <== osd.3 v2:172.21.15.194:6816/96632515 27 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94201747421712] v33'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a480eb070 con 0x55ad0db0dec0 2024-09-13T06:09:59.451 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.451+0000 7f0a57559980 20 remove_watcher() i=2 2024-09-13T06:09:59.451 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.451+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94201747433200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db14ed0 con 0x7f0a48116070 2024-09-13T06:09:59.452 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.451+0000 7f0a54868640 1 -- 172.21.15.194:0/2781996058 <== osd.2 v2:172.21.15.194:6800/815615585 20 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94201747433200] v33'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a40037040 con 0x7f0a48116070 2024-09-13T06:09:59.453 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.451+0000 7f0a57559980 20 remove_watcher() i=3 2024-09-13T06:09:59.453 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.451+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94201747435408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db14ed0 con 0x55ad0db094d0 2024-09-13T06:09:59.454 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.455+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 <== osd.1 v2:172.21.15.194:6808/3135444559 29 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94201747435408] v33'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a5000a4d0 con 0x55ad0db094d0 2024-09-13T06:09:59.455 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.455+0000 7f0a57559980 20 remove_watcher() i=4 2024-09-13T06:09:59.455 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.455+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94201747437904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db14ed0 con 0x7f0a4001fbe0 2024-09-13T06:09:59.457 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.455+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 <== osd.0 v2:172.21.15.120:6800/1923744619 26 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94201747437904] v33'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a5000a4d0 con 0x7f0a4001fbe0 2024-09-13T06:09:59.457 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.455+0000 7f0a57559980 20 remove_watcher() i=5 2024-09-13T06:09:59.457 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.455+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94201747440352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db17950 con 0x7f0a4001fbe0 2024-09-13T06:09:59.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.459+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 <== osd.0 v2:172.21.15.120:6800/1923744619 27 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94201747440352] v33'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a5000a4d0 con 0x7f0a4001fbe0 2024-09-13T06:09:59.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.459+0000 7f0a57559980 20 remove_watcher() i=6 2024-09-13T06:09:59.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.459+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94201747442848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad0db182e0 con 0x7f0a4001fbe0 2024-09-13T06:09:59.463 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.459+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 <== osd.0 v2:172.21.15.120:6800/1923744619 28 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94201747442848] v33'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a5000a4d0 con 0x7f0a4001fbe0 2024-09-13T06:09:59.463 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.459+0000 7f0a57559980 20 remove_watcher() i=7 2024-09-13T06:09:59.463 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.459+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f0a4001fbe0 msgr2=0x7f0a4003a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.463 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.459+0000 7f0a57559980 1 --2- 172.21.15.194:0/2781996058 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f0a4001fbe0 0x7f0a4003a3c0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.463 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.459+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ad0db094d0 msgr2=0x55ad0db0b990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.463 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.459+0000 7f0a57559980 1 --2- 172.21.15.194:0/2781996058 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ad0db094d0 0x55ad0db0b990 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.463 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.459+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f0a48116070 msgr2=0x7f0a480fa480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.463 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.459+0000 7f0a57559980 1 --2- 172.21.15.194:0/2781996058 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f0a48116070 0x7f0a480fa480 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.463 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.459+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ad0db0dec0 msgr2=0x55ad0db102b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.463 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.459+0000 7f0a57559980 1 --2- 172.21.15.194:0/2781996058 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ad0db0dec0 0x55ad0db102b0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.463 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.459+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0920034650 msgr2=0x7f0920036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.459+0000 7f0a57559980 1 --2- 172.21.15.194:0/2781996058 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0920034650 0x7f0920036b10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0a4000c010 tx=0x7f0a40010000 comp rx=0 tx=0).stop 2024-09-13T06:09:59.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.459+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad0daf7600 msgr2=0x55ad0dafe680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.459+0000 7f0a5586a640 1 -- 172.21.15.194:0/2781996058 reap_dead start 2024-09-13T06:09:59.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.459+0000 7f0a57559980 1 --2- 172.21.15.194:0/2781996058 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad0daf7600 0x55ad0dafe680 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f0a480cf000 tx=0x7f0a480cef50 comp rx=0 tx=0).stop 2024-09-13T06:09:59.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.459+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 shutdown_connections 2024-09-13T06:09:59.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.459+0000 7f0a57559980 1 --2- 172.21.15.194:0/2781996058 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad0daf7600 0x55ad0dafe680 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.459+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 >> 172.21.15.194:0/2781996058 conn(0x55ad0daf39e0 msgr2=0x55ad0daf1ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:59.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.459+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 shutdown_connections 2024-09-13T06:09:59.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.459+0000 7f0a57559980 1 -- 172.21.15.194:0/2781996058 wait complete. 2024-09-13T06:09:59.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.459+0000 7f0a57559980 1 -- 172.21.15.194:0/2816418124 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f092c0345b0 msgr2=0x7f092c036a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.459+0000 7f0a57559980 1 --2- 172.21.15.194:0/2816418124 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f092c0345b0 0x7f092c036a70 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x55ad0dad4950 tx=0x7f0a4000f000 comp rx=0 tx=0).stop 2024-09-13T06:09:59.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.459+0000 7f0a57559980 1 -- 172.21.15.194:0/2816418124 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad0daead10 msgr2=0x55ad0daeb130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.459+0000 7f0a57559980 1 --2- 172.21.15.194:0/2816418124 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad0daead10 0x55ad0daeb130 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f0a48005410 tx=0x7f0a480bcdc0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.465 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.459+0000 7f0a57559980 1 -- 172.21.15.194:0/2816418124 shutdown_connections 2024-09-13T06:09:59.465 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.459+0000 7f0a57559980 1 --2- 172.21.15.194:0/2816418124 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f092c0345b0 0x7f092c036a70 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.465 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.459+0000 7f0a57559980 1 --2- 172.21.15.194:0/2816418124 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad0daead10 0x55ad0daeb130 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.465 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.459+0000 7f0a57559980 1 -- 172.21.15.194:0/2816418124 >> 172.21.15.194:0/2816418124 conn(0x55ad0dadfe60 msgr2=0x55ad0dae28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:59.465 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.459+0000 7f0a57559980 1 -- 172.21.15.194:0/2816418124 shutdown_connections 2024-09-13T06:09:59.465 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.459+0000 7f0a57559980 1 -- 172.21.15.194:0/2816418124 wait complete. 2024-09-13T06:09:59.465 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.459+0000 7f0a57559980 1 -- 172.21.15.194:0/1974413247 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ad0d9db230 msgr2=0x55ad0dad3e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.465 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.459+0000 7f0a57559980 1 --2- 172.21.15.194:0/1974413247 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ad0d9db230 0x55ad0dad3e10 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.465 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.463+0000 7f0a57559980 1 -- 172.21.15.194:0/1974413247 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55ad0dada710 msgr2=0x55ad0dadcb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.465 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.463+0000 7f0a57559980 1 --2- 172.21.15.194:0/1974413247 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55ad0dada710 0x55ad0dadcb00 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.465 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.463+0000 7f0a57559980 1 -- 172.21.15.194:0/1974413247 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ad0dad67d0 msgr2=0x55ad0dad8bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.465 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.463+0000 7f0a57559980 1 --2- 172.21.15.194:0/1974413247 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ad0dad67d0 0x55ad0dad8bc0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.465 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.463+0000 7f0a57559980 1 -- 172.21.15.194:0/1974413247 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f093c034650 msgr2=0x7f093c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.466 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.463+0000 7f0a57559980 1 --2- 172.21.15.194:0/1974413247 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f093c034650 0x7f093c036b10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0a40000f70 tx=0x7f0a40001380 comp rx=0 tx=0).stop 2024-09-13T06:09:59.466 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.463+0000 7f0a57559980 1 -- 172.21.15.194:0/1974413247 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad0d9da8e0 msgr2=0x55ad0dacce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.466 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.463+0000 7f0a57559980 1 --2- 172.21.15.194:0/1974413247 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad0d9da8e0 0x55ad0dacce40 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f0a4801bbe0 tx=0x7f0a480180e0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.466 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.463+0000 7f0a5586a640 1 -- 172.21.15.194:0/1974413247 reap_dead start 2024-09-13T06:09:59.466 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.463+0000 7f0a57559980 1 -- 172.21.15.194:0/1974413247 shutdown_connections 2024-09-13T06:09:59.466 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.463+0000 7f0a57559980 1 -- 172.21.15.194:0/1974413247 >> 172.21.15.194:0/1974413247 conn(0x55ad0d94e230 msgr2=0x55ad0dac0380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:59.466 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.463+0000 7f0a57559980 1 -- 172.21.15.194:0/1974413247 shutdown_connections 2024-09-13T06:09:59.466 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.463+0000 7f0a57559980 1 -- 172.21.15.194:0/1974413247 wait complete. 2024-09-13T06:09:59.474 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-13T06:09:59.474 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-09-13T06:09:59.474 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-09-13T06:09:59.474 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid fud --bucket myfoo 2024-09-13T06:09:59.558 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:09:59.558 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:09:59.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.559+0000 7f195f419980 1 Processor -- start 2024-09-13T06:09:59.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.559+0000 7f195f419980 1 -- start start 2024-09-13T06:09:59.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.559+0000 7f195f419980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55d8f7356550 0x55d8f7356930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.559+0000 7f195f419980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d8f71dfae0 con 0x55d8f7356ea0 2024-09-13T06:09:59.560 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.559+0000 7f195f419980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x55d8f7203e30 con 0x55d8f7356550 2024-09-13T06:09:59.560 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.559+0000 7f195cf29640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55d8f7356550 0x55d8f7356930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.559+0000 7f195cf29640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55d8f7356550 0x55d8f7356930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45778/0 (socket says 172.21.15.194:45778) 2024-09-13T06:09:59.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.559+0000 7f195cf29640 1 -- 172.21.15.194:0/1237450788 learned_addr learned my addr 172.21.15.194:0/1237450788 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:59.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.559+0000 7f195c728640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x55d8f7356ea0 0x55d8f735b920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:51208/0 (socket says 172.21.15.194:51208) 2024-09-13T06:09:59.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.559+0000 7f195cf29640 1 -- 172.21.15.194:0/1237450788 >> v1:172.21.15.120:6789/0 conn(0x55d8f7356ea0 legacy=0x55d8f735b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.559+0000 7f195cf29640 1 -- 172.21.15.194:0/1237450788 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8f735e170 con 0x55d8f7356550 2024-09-13T06:09:59.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.563+0000 7f195cf29640 1 --2- 172.21.15.194:0/1237450788 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d8f7356550 0x55d8f7356930 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f194c00a7a0 tx=0x7f194c01d800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46d1b614c8cc6eaa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.563+0000 7f195bf27640 1 -- 172.21.15.194:0/1237450788 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f194c0b3070 con 0x55d8f7356550 2024-09-13T06:09:59.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.563+0000 7f195bf27640 1 -- 172.21.15.194:0/1237450788 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f194c0a6820 con 0x55d8f7356550 2024-09-13T06:09:59.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.563+0000 7f195bf27640 1 -- 172.21.15.194:0/1237450788 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f194c0a6b20 con 0x55d8f7356550 2024-09-13T06:09:59.564 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.563+0000 7f195f419980 1 -- 172.21.15.194:0/1237450788 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d8f7356550 msgr2=0x55d8f7356930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.564 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.563+0000 7f195f419980 1 --2- 172.21.15.194:0/1237450788 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d8f7356550 0x55d8f7356930 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f194c00a7a0 tx=0x7f194c01d800 comp rx=0 tx=0).stop 2024-09-13T06:09:59.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.563+0000 7f195f419980 1 -- 172.21.15.194:0/1237450788 shutdown_connections 2024-09-13T06:09:59.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.563+0000 7f195f419980 1 --2- 172.21.15.194:0/1237450788 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d8f7356550 0x55d8f7356930 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.563+0000 7f195f419980 1 -- 172.21.15.194:0/1237450788 >> 172.21.15.194:0/1237450788 conn(0x55d8f7352070 msgr2=0x55d8f7354490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:59.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.563+0000 7f195f419980 1 -- 172.21.15.194:0/1237450788 shutdown_connections 2024-09-13T06:09:59.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.563+0000 7f195f419980 1 -- 172.21.15.194:0/1237450788 wait complete. 2024-09-13T06:09:59.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.579+0000 7f195f419980 1 Processor -- start 2024-09-13T06:09:59.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.579+0000 7f195f419980 1 -- start start 2024-09-13T06:09:59.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.579+0000 7f195f419980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d8f7356550 0x55d8f7440890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.579+0000 7f195f419980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55d8f7205200 con 0x55d8f7356550 2024-09-13T06:09:59.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.579+0000 7f195cf29640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d8f7356550 0x55d8f7440890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.579+0000 7f195cf29640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d8f7356550 0x55d8f7440890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45794/0 (socket says 172.21.15.194:45794) 2024-09-13T06:09:59.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.579+0000 7f195cf29640 1 -- 172.21.15.194:0/2786425661 learned_addr learned my addr 172.21.15.194:0/2786425661 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:59.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.579+0000 7f195cf29640 1 -- 172.21.15.194:0/2786425661 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8f7440e60 con 0x55d8f7356550 2024-09-13T06:09:59.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.579+0000 7f195cf29640 1 --2- 172.21.15.194:0/2786425661 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d8f7356550 0x55d8f7440890 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f194c0b1040 tx=0x7f194c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2ee15440db6b662 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.579+0000 7f184ae0d640 1 -- 172.21.15.194:0/2786425661 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f194c0b3070 con 0x55d8f7356550 2024-09-13T06:09:59.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.579+0000 7f184ae0d640 1 -- 172.21.15.194:0/2786425661 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f194c0b4040 con 0x55d8f7356550 2024-09-13T06:09:59.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.579+0000 7f184ae0d640 1 -- 172.21.15.194:0/2786425661 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f194c0a6d30 con 0x55d8f7356550 2024-09-13T06:09:59.583 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.583+0000 7f195f419980 1 -- 172.21.15.194:0/2786425661 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d8f7356550 msgr2=0x55d8f7440890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.583 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.583+0000 7f195f419980 1 --2- 172.21.15.194:0/2786425661 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d8f7356550 0x55d8f7440890 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f194c0b1040 tx=0x7f194c0033b0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.584 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.583+0000 7f195f419980 1 -- 172.21.15.194:0/2786425661 shutdown_connections 2024-09-13T06:09:59.584 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.583+0000 7f195f419980 1 --2- 172.21.15.194:0/2786425661 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d8f7356550 0x55d8f7440890 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.584 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.583+0000 7f195f419980 1 -- 172.21.15.194:0/2786425661 >> 172.21.15.194:0/2786425661 conn(0x55d8f7352070 msgr2=0x55d8f743c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:59.584 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.583+0000 7f195f419980 1 -- 172.21.15.194:0/2786425661 shutdown_connections 2024-09-13T06:09:59.584 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.583+0000 7f195f419980 1 -- 172.21.15.194:0/2786425661 wait complete. 2024-09-13T06:09:59.584 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.583+0000 7f195f419980 1 Processor -- start 2024-09-13T06:09:59.584 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.583+0000 7f195f419980 1 -- start start 2024-09-13T06:09:59.584 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.583+0000 7f195f419980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d8f7356550 0x55d8f7447aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.584 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.583+0000 7f195f419980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55d8f735dbb0 con 0x55d8f7356550 2024-09-13T06:09:59.584 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.583+0000 7f195cf29640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d8f7356550 0x55d8f7447aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.584 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.583+0000 7f195cf29640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d8f7356550 0x55d8f7447aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45802/0 (socket says 172.21.15.194:45802) 2024-09-13T06:09:59.584 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.583+0000 7f195cf29640 1 -- 172.21.15.194:0/1147354567 learned_addr learned my addr 172.21.15.194:0/1147354567 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:59.585 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.583+0000 7f195cf29640 1 -- 172.21.15.194:0/1147354567 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8f7447fe0 con 0x55d8f7356550 2024-09-13T06:09:59.585 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.583+0000 7f195cf29640 1 --2- 172.21.15.194:0/1147354567 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d8f7356550 0x55d8f7447aa0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f194c01e0a0 tx=0x7f194c01a5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.586 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.583+0000 7f184960a640 1 -- 172.21.15.194:0/1147354567 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f194c0c7070 con 0x55d8f7356550 2024-09-13T06:09:59.586 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.583+0000 7f195f419980 1 -- 172.21.15.194:0/1147354567 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d8f7448270 con 0x55d8f7356550 2024-09-13T06:09:59.586 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.583+0000 7f195f419980 1 -- 172.21.15.194:0/1147354567 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8f744af50 con 0x55d8f7356550 2024-09-13T06:09:59.586 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.583+0000 7f184960a640 1 -- 172.21.15.194:0/1147354567 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f194c0aee50 con 0x55d8f7356550 2024-09-13T06:09:59.586 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.583+0000 7f184960a640 1 -- 172.21.15.194:0/1147354567 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f194c0cc580 con 0x55d8f7356550 2024-09-13T06:09:59.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.583+0000 7f184960a640 1 -- 172.21.15.194:0/1147354567 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f194c0cc720 con 0x55d8f7356550 2024-09-13T06:09:59.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.583+0000 7f184960a640 1 --2- 172.21.15.194:0/1147354567 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f1844034650 0x7f1844036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.587+0000 7f184960a640 1 -- 172.21.15.194:0/1147354567 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f194c0bd070 con 0x55d8f7356550 2024-09-13T06:09:59.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.587+0000 7f195c728640 1 --2- 172.21.15.194:0/1147354567 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f1844034650 0x7f1844036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.587+0000 7f195f419980 1 --2- 172.21.15.194:0/1147354567 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55d8f7356ea0 0x55d8f744ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.587+0000 7f195f419980 1 -- 172.21.15.194:0/1147354567 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d8f744f0a0 con 0x55d8f7356ea0 2024-09-13T06:09:59.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.587+0000 7f195d72a640 1 --2- 172.21.15.194:0/1147354567 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55d8f7356ea0 0x55d8f744ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.587+0000 7f195c728640 1 --2- 172.21.15.194:0/1147354567 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f1844034650 0x7f1844036b10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1950000f70 tx=0x7f1950001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.587+0000 7f195d72a640 1 --2- 172.21.15.194:0/1147354567 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55d8f7356ea0 0x55d8f744ea30 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.587+0000 7f195d72a640 1 -- 172.21.15.194:0/1147354567 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f19540083f0 con 0x55d8f7356ea0 2024-09-13T06:09:59.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.587+0000 7f195f419980 1 -- 172.21.15.194:0/1147354567 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d8f744c170 con 0x55d8f7356ea0 2024-09-13T06:09:59.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.587+0000 7f195d72a640 1 -- 172.21.15.194:0/1147354567 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f19540083f0 con 0x55d8f7356ea0 2024-09-13T06:09:59.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.587+0000 7f195f419980 1 --2- 172.21.15.194:0/1147354567 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55d8f7451420 0x55d8f7453810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.587+0000 7f195f419980 1 -- 172.21.15.194:0/1147354567 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d8f7453ee0 con 0x55d8f7451420 2024-09-13T06:09:59.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.587+0000 7f195cf29640 1 --2- 172.21.15.194:0/1147354567 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55d8f7451420 0x55d8f7453810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.587+0000 7f195cf29640 1 --2- 172.21.15.194:0/1147354567 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55d8f7451420 0x55d8f7453810 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.587+0000 7f195cf29640 1 -- 172.21.15.194:0/1147354567 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f194c0c9070 con 0x55d8f7451420 2024-09-13T06:09:59.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.587+0000 7f195f419980 1 -- 172.21.15.194:0/1147354567 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d8f74502c0 con 0x55d8f7356ea0 2024-09-13T06:09:59.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.587+0000 7f195d72a640 1 -- 172.21.15.194:0/1147354567 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f19540083f0 con 0x55d8f7356ea0 2024-09-13T06:09:59.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.587+0000 7f195f419980 1 --2- 172.21.15.194:0/1147354567 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55d8f7455320 0x55d8f7457710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.587+0000 7f195f419980 1 -- 172.21.15.194:0/1147354567 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d8f7457ea0 con 0x55d8f7455320 2024-09-13T06:09:59.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.587+0000 7f195c728640 1 --2- 172.21.15.194:0/1147354567 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55d8f7455320 0x55d8f7457710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.587+0000 7f195c728640 1 --2- 172.21.15.194:0/1147354567 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55d8f7455320 0x55d8f7457710 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.587+0000 7f195c728640 1 -- 172.21.15.194:0/1147354567 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f195000f6a0 con 0x55d8f7455320 2024-09-13T06:09:59.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.587+0000 7f195f419980 1 Processor -- start 2024-09-13T06:09:59.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.587+0000 7f195f419980 1 -- start start 2024-09-13T06:09:59.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.591+0000 7f195f419980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d8f7465930 0x55d8f7465d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.591+0000 7f195f419980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55d8f725e800 con 0x55d8f7465930 2024-09-13T06:09:59.592 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.591+0000 7f195cf29640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d8f7465930 0x55d8f7465d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.592 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.591+0000 7f195cf29640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d8f7465930 0x55d8f7465d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45810/0 (socket says 172.21.15.194:45810) 2024-09-13T06:09:59.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.591+0000 7f195cf29640 1 -- 172.21.15.194:0/1533141441 learned_addr learned my addr 172.21.15.194:0/1533141441 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:59.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.591+0000 7f195cf29640 1 -- 172.21.15.194:0/1533141441 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8f7466290 con 0x55d8f7465930 2024-09-13T06:09:59.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.591+0000 7f195cf29640 1 --2- 172.21.15.194:0/1533141441 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d8f7465930 0x55d8f7465d50 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f194c0ae040 tx=0x7f194c0b84c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.591+0000 7f18427fc640 1 -- 172.21.15.194:0/1533141441 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f194c0ad580 con 0x55d8f7465930 2024-09-13T06:09:59.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.591+0000 7f18427fc640 1 -- 172.21.15.194:0/1533141441 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f194c0ad720 con 0x55d8f7465930 2024-09-13T06:09:59.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.591+0000 7f195f419980 1 -- 172.21.15.194:0/1533141441 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d8f7466520 con 0x55d8f7465930 2024-09-13T06:09:59.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.591+0000 7f18427fc640 1 -- 172.21.15.194:0/1533141441 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f194c0cca60 con 0x55d8f7465930 2024-09-13T06:09:59.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.591+0000 7f195f419980 1 -- 172.21.15.194:0/1533141441 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8f74691a0 con 0x55d8f7465930 2024-09-13T06:09:59.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.591+0000 7f18427fc640 1 -- 172.21.15.194:0/1533141441 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f194c0ed060 con 0x55d8f7465930 2024-09-13T06:09:59.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.591+0000 7f18427fc640 1 --2- 172.21.15.194:0/1533141441 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f1834034650 0x7f1834036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.591+0000 7f18427fc640 1 -- 172.21.15.194:0/1533141441 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f194c0f0c60 con 0x55d8f7465930 2024-09-13T06:09:59.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.591+0000 7f195c728640 1 --2- 172.21.15.194:0/1533141441 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f1834034650 0x7f1834036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.591+0000 7f195f419980 1 Processor -- start 2024-09-13T06:09:59.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.591+0000 7f195f419980 1 -- start start 2024-09-13T06:09:59.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.591+0000 7f195c728640 1 --2- 172.21.15.194:0/1533141441 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f1834034650 0x7f1834036b10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x55d8f74582a0 tx=0x7f195000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.591+0000 7f195f419980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d8f7476690 0x55d8f7476a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.591+0000 7f195f419980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55d8f7441120 con 0x55d8f7476690 2024-09-13T06:09:59.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.591+0000 7f195cf29640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d8f7476690 0x55d8f7476a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.595+0000 7f195cf29640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d8f7476690 0x55d8f7476a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45820/0 (socket says 172.21.15.194:45820) 2024-09-13T06:09:59.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.595+0000 7f195cf29640 1 -- 172.21.15.194:0/495094974 learned_addr learned my addr 172.21.15.194:0/495094974 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:59.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.595+0000 7f195cf29640 1 -- 172.21.15.194:0/495094974 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8f7477060 con 0x55d8f7476690 2024-09-13T06:09:59.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.595+0000 7f195cf29640 1 --2- 172.21.15.194:0/495094974 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d8f7476690 0x55d8f7476a90 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f194c0d8c00 tx=0x7f194c0d8930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8809dcabdec7e328 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.595+0000 7f1833fff640 1 -- 172.21.15.194:0/495094974 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f194c0b1120 con 0x55d8f7476690 2024-09-13T06:09:59.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.595+0000 7f1833fff640 1 -- 172.21.15.194:0/495094974 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f194c0c2df0 con 0x55d8f7476690 2024-09-13T06:09:59.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.595+0000 7f1833fff640 1 -- 172.21.15.194:0/495094974 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f194c0ca350 con 0x55d8f7476690 2024-09-13T06:09:59.598 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.595+0000 7f195f419980 1 -- 172.21.15.194:0/495094974 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d8f7476690 msgr2=0x55d8f7476a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.598 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.595+0000 7f195f419980 1 --2- 172.21.15.194:0/495094974 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d8f7476690 0x55d8f7476a90 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f194c0d8c00 tx=0x7f194c0d8930 comp rx=0 tx=0).stop 2024-09-13T06:09:59.598 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.595+0000 7f195f419980 1 -- 172.21.15.194:0/495094974 shutdown_connections 2024-09-13T06:09:59.598 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.595+0000 7f195f419980 1 --2- 172.21.15.194:0/495094974 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d8f7476690 0x55d8f7476a90 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.598 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.595+0000 7f195f419980 1 -- 172.21.15.194:0/495094974 >> 172.21.15.194:0/495094974 conn(0x55d8f746e660 msgr2=0x55d8f746c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:59.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.595+0000 7f195f419980 1 -- 172.21.15.194:0/495094974 shutdown_connections 2024-09-13T06:09:59.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.595+0000 7f195f419980 1 -- 172.21.15.194:0/495094974 wait complete. 2024-09-13T06:09:59.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.595+0000 7f195f419980 1 Processor -- start 2024-09-13T06:09:59.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.595+0000 7f195f419980 1 -- start start 2024-09-13T06:09:59.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.595+0000 7f195f419980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d8f7476690 0x55d8f747d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.595+0000 7f195f419980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55d8f7477480 con 0x55d8f7476690 2024-09-13T06:09:59.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.595+0000 7f195cf29640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d8f7476690 0x55d8f747d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.595+0000 7f195cf29640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d8f7476690 0x55d8f747d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45836/0 (socket says 172.21.15.194:45836) 2024-09-13T06:09:59.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.595+0000 7f195cf29640 1 -- 172.21.15.194:0/3844765347 learned_addr learned my addr 172.21.15.194:0/3844765347 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:59.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.595+0000 7f195cf29640 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8f747ddd0 con 0x55d8f7476690 2024-09-13T06:09:59.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.595+0000 7f195cf29640 1 --2- 172.21.15.194:0/3844765347 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d8f7476690 0x55d8f747d890 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f194c0c7ff0 tx=0x7f194c0c7ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.595+0000 7f18327fc640 1 -- 172.21.15.194:0/3844765347 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f194c0e3c60 con 0x55d8f7476690 2024-09-13T06:09:59.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.595+0000 7f18327fc640 1 -- 172.21.15.194:0/3844765347 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f194c0bc1d0 con 0x55d8f7476690 2024-09-13T06:09:59.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.595+0000 7f18327fc640 1 -- 172.21.15.194:0/3844765347 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f194c0ccc00 con 0x55d8f7476690 2024-09-13T06:09:59.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.595+0000 7f195f419980 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d8f747ddd0 con 0x55d8f7476690 2024-09-13T06:09:59.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.595+0000 7f195f419980 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8f747ddd0 con 0x55d8f7476690 2024-09-13T06:09:59.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.599+0000 7f18327fc640 1 -- 172.21.15.194:0/3844765347 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f194c0ff040 con 0x55d8f7476690 2024-09-13T06:09:59.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.599+0000 7f195f419980 20 rados->read ofs=0 len=0 2024-09-13T06:09:59.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.599+0000 7f18327fc640 1 --2- 172.21.15.194:0/3844765347 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f1828034650 0x7f1828036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.599+0000 7f18327fc640 1 -- 172.21.15.194:0/3844765347 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f194c0fd020 con 0x55d8f7476690 2024-09-13T06:09:59.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.599+0000 7f195c728640 1 --2- 172.21.15.194:0/3844765347 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f1828034650 0x7f1828036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.599+0000 7f195f419980 1 --2- 172.21.15.194:0/3844765347 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55d8f74887d0 0x55d8f748ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.599+0000 7f195f419980 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d8f748b3c0 con 0x55d8f74887d0 2024-09-13T06:09:59.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.599+0000 7f195d72a640 1 --2- 172.21.15.194:0/3844765347 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55d8f74887d0 0x55d8f748ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.599+0000 7f195c728640 1 --2- 172.21.15.194:0/3844765347 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f1828034650 0x7f1828036b10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f195000c010 tx=0x7f1950010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.599+0000 7f195d72a640 1 --2- 172.21.15.194:0/3844765347 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55d8f74887d0 0x55d8f748ac70 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.599+0000 7f195d72a640 1 -- 172.21.15.194:0/3844765347 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f19540083f0 con 0x55d8f74887d0 2024-09-13T06:09:59.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.599+0000 7f195f419980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:59.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.599+0000 7f195f419980 20 realm 2024-09-13T06:09:59.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.599+0000 7f195f419980 20 rados->read ofs=0 len=0 2024-09-13T06:09:59.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.599+0000 7f195f419980 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d8f748b7d0 con 0x55d8f74887d0 2024-09-13T06:09:59.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.599+0000 7f195d72a640 1 -- 172.21.15.194:0/3844765347 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f19540083f0 con 0x55d8f74887d0 2024-09-13T06:09:59.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.599+0000 7f195f419980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:59.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.599+0000 7f195f419980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:09:59.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.599+0000 7f195f419980 20 rados->read ofs=0 len=0 2024-09-13T06:09:59.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.599+0000 7f195f419980 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d8f748c070 con 0x55d8f74887d0 2024-09-13T06:09:59.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.599+0000 7f195d72a640 1 -- 172.21.15.194:0/3844765347 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f19540083f0 con 0x55d8f74887d0 2024-09-13T06:09:59.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.599+0000 7f195f419980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:59.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.599+0000 7f195f419980 20 rados->read ofs=0 len=0 2024-09-13T06:09:59.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.599+0000 7f195f419980 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d8f748c410 con 0x55d8f74887d0 2024-09-13T06:09:59.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.599+0000 7f195d72a640 1 -- 172.21.15.194:0/3844765347 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f19540083f0 con 0x55d8f74887d0 2024-09-13T06:09:59.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.599+0000 7f195f419980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:59.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.599+0000 7f195f419980 20 rados->read ofs=0 len=0 2024-09-13T06:09:59.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.599+0000 7f195f419980 1 --2- 172.21.15.194:0/3844765347 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55d8f748d170 0x55d8f748f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.599+0000 7f195f419980 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d8f748fc00 con 0x55d8f748d170 2024-09-13T06:09:59.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.599+0000 7f195cf29640 1 --2- 172.21.15.194:0/3844765347 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55d8f748d170 0x55d8f748f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.599+0000 7f195cf29640 1 --2- 172.21.15.194:0/3844765347 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55d8f748d170 0x55d8f748f560 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.599+0000 7f195cf29640 1 -- 172.21.15.194:0/3844765347 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f194c0e1070 con 0x55d8f748d170 2024-09-13T06:09:59.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.599+0000 7f195f419980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:09:59.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.599+0000 7f195f419980 20 searching for the correct realm 2024-09-13T06:09:59.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.603+0000 7f195f419980 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d8f7491460 con 0x55d8f748d170 2024-09-13T06:09:59.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.603+0000 7f195cf29640 1 -- 172.21.15.194:0/3844765347 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f194c0e1070 con 0x55d8f748d170 2024-09-13T06:09:59.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.603+0000 7f195cf29640 1 --2- 172.21.15.194:0/3844765347 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f194c102040 0x7f194c0f88c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.603+0000 7f195cf29640 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d8f7491460 con 0x7f194c102040 2024-09-13T06:09:59.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.603+0000 7f195c728640 1 --2- 172.21.15.194:0/3844765347 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f194c102040 0x7f194c0f88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.603+0000 7f195c728640 1 --2- 172.21.15.194:0/3844765347 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f194c102040 0x7f194c0f88c0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.603+0000 7f195c728640 1 -- 172.21.15.194:0/3844765347 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1950037040 con 0x7f194c102040 2024-09-13T06:09:59.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.603+0000 7f195c728640 1 --2- 172.21.15.194:0/3844765347 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f195001fbe0 0x7f195003a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.603+0000 7f195c728640 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d8f7491460 con 0x7f195001fbe0 2024-09-13T06:09:59.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.603+0000 7f195d72a640 1 --2- 172.21.15.194:0/3844765347 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f195001fbe0 0x7f195003a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.603+0000 7f195d72a640 1 --2- 172.21.15.194:0/3844765347 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f195001fbe0 0x7f195003a3c0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.603+0000 7f195d72a640 1 -- 172.21.15.194:0/3844765347 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19540083f0 con 0x7f195001fbe0 2024-09-13T06:09:59.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.603+0000 7f195d72a640 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d8f748c410 con 0x55d8f74887d0 2024-09-13T06:09:59.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.603+0000 7f195d72a640 1 -- 172.21.15.194:0/3844765347 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19540083f0 con 0x55d8f74887d0 2024-09-13T06:09:59.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.603+0000 7f195d72a640 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d8f748c410 con 0x55d8f74887d0 2024-09-13T06:09:59.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.603+0000 7f195d72a640 1 -- 172.21.15.194:0/3844765347 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19540083f0 con 0x55d8f74887d0 2024-09-13T06:09:59.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.603+0000 7f195d72a640 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d8f748c410 con 0x7f195001fbe0 2024-09-13T06:09:59.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.607+0000 7f195d72a640 1 -- 172.21.15.194:0/3844765347 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19540083f0 con 0x7f195001fbe0 2024-09-13T06:09:59.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.607+0000 7f195d72a640 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d8f748c410 con 0x7f195001fbe0 2024-09-13T06:09:59.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.607+0000 7f195d72a640 1 -- 172.21.15.194:0/3844765347 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19540083f0 con 0x7f195001fbe0 2024-09-13T06:09:59.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.607+0000 7f195d72a640 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d8f748c410 con 0x7f194c102040 2024-09-13T06:09:59.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.607+0000 7f195c728640 1 -- 172.21.15.194:0/3844765347 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1950037040 con 0x7f194c102040 2024-09-13T06:09:59.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.607+0000 7f195c728640 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d8f748c410 con 0x55d8f748d170 2024-09-13T06:09:59.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.607+0000 7f195cf29640 1 -- 172.21.15.194:0/3844765347 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f194c0e1070 con 0x55d8f748d170 2024-09-13T06:09:59.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.607+0000 7f195cf29640 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d8f748c410 con 0x55d8f74887d0 2024-09-13T06:09:59.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.607+0000 7f195d72a640 1 -- 172.21.15.194:0/3844765347 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19540083f0 con 0x55d8f74887d0 2024-09-13T06:09:59.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.607+0000 7f195d72a640 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d8f748c410 con 0x7f195001fbe0 2024-09-13T06:09:59.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.607+0000 7f195d72a640 1 -- 172.21.15.194:0/3844765347 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19540083f0 con 0x7f195001fbe0 2024-09-13T06:09:59.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.607+0000 7f195d72a640 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d8f748c410 con 0x55d8f74887d0 2024-09-13T06:09:59.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.607+0000 7f195d72a640 1 -- 172.21.15.194:0/3844765347 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19540083f0 con 0x55d8f74887d0 2024-09-13T06:09:59.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.607+0000 7f195d72a640 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d8f748c410 con 0x7f194c102040 2024-09-13T06:09:59.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.607+0000 7f195c728640 1 -- 172.21.15.194:0/3844765347 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1950037040 con 0x7f194c102040 2024-09-13T06:09:59.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.607+0000 7f195c728640 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d8f748c410 con 0x55d8f748d170 2024-09-13T06:09:59.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.607+0000 7f195cf29640 1 -- 172.21.15.194:0/3844765347 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f194c0e1070 con 0x55d8f748d170 2024-09-13T06:09:59.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.607+0000 7f195cf29640 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d8f748c410 con 0x55d8f748d170 2024-09-13T06:09:59.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.607+0000 7f195cf29640 1 -- 172.21.15.194:0/3844765347 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f194c0e1070 con 0x55d8f748d170 2024-09-13T06:09:59.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.607+0000 7f195cf29640 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d8f748c410 con 0x7f195001fbe0 2024-09-13T06:09:59.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.607+0000 7f195d72a640 1 -- 172.21.15.194:0/3844765347 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19540083f0 con 0x7f195001fbe0 2024-09-13T06:09:59.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.607+0000 7f195d72a640 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d8f748c410 con 0x55d8f748d170 2024-09-13T06:09:59.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.611+0000 7f195cf29640 1 -- 172.21.15.194:0/3844765347 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f194c0e1070 con 0x55d8f748d170 2024-09-13T06:09:59.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.611+0000 7f195cf29640 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d8f748c410 con 0x55d8f748d170 2024-09-13T06:09:59.614 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.611+0000 7f195cf29640 1 -- 172.21.15.194:0/3844765347 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f194c0e1070 con 0x55d8f748d170 2024-09-13T06:09:59.614 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.611+0000 7f195cf29640 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d8f748c410 con 0x55d8f74887d0 2024-09-13T06:09:59.614 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.611+0000 7f195d72a640 1 -- 172.21.15.194:0/3844765347 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19540083f0 con 0x55d8f74887d0 2024-09-13T06:09:59.614 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.611+0000 7f195d72a640 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d8f748c410 con 0x55d8f74887d0 2024-09-13T06:09:59.614 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.611+0000 7f195d72a640 1 -- 172.21.15.194:0/3844765347 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f19540083f0 con 0x55d8f74887d0 2024-09-13T06:09:59.614 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.611+0000 7f195d72a640 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d8f748c410 con 0x7f195001fbe0 2024-09-13T06:09:59.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.611+0000 7f195d72a640 1 -- 172.21.15.194:0/3844765347 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19540083f0 con 0x7f195001fbe0 2024-09-13T06:09:59.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.611+0000 7f195d72a640 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d8f748c410 con 0x55d8f748d170 2024-09-13T06:09:59.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.611+0000 7f195cf29640 1 -- 172.21.15.194:0/3844765347 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f194c0e1070 con 0x55d8f748d170 2024-09-13T06:09:59.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.611+0000 7f195cf29640 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d8f748c410 con 0x7f194c102040 2024-09-13T06:09:59.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.611+0000 7f195c728640 1 -- 172.21.15.194:0/3844765347 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1950037040 con 0x7f194c102040 2024-09-13T06:09:59.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.611+0000 7f195c728640 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d8f748c410 con 0x55d8f74887d0 2024-09-13T06:09:59.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.611+0000 7f195d72a640 1 -- 172.21.15.194:0/3844765347 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19540083f0 con 0x55d8f74887d0 2024-09-13T06:09:59.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.611+0000 7f195d72a640 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d8f748c410 con 0x7f195001fbe0 2024-09-13T06:09:59.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.611+0000 7f195d72a640 1 -- 172.21.15.194:0/3844765347 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19540083f0 con 0x7f195001fbe0 2024-09-13T06:09:59.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.611+0000 7f195d72a640 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d8f748c410 con 0x55d8f748d170 2024-09-13T06:09:59.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.611+0000 7f195cf29640 1 -- 172.21.15.194:0/3844765347 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f194c0e1070 con 0x55d8f748d170 2024-09-13T06:09:59.620 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.611+0000 7f195cf29640 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d8f748c410 con 0x7f195001fbe0 2024-09-13T06:09:59.620 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.615+0000 7f195d72a640 1 -- 172.21.15.194:0/3844765347 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19540083f0 con 0x7f195001fbe0 2024-09-13T06:09:59.620 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.615+0000 7f195d72a640 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d8f748c410 con 0x7f194c102040 2024-09-13T06:09:59.620 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.615+0000 7f195c728640 1 -- 172.21.15.194:0/3844765347 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1950037040 con 0x7f194c102040 2024-09-13T06:09:59.620 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.615+0000 7f195c728640 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d8f748c410 con 0x55d8f748d170 2024-09-13T06:09:59.620 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.615+0000 7f195cf29640 1 -- 172.21.15.194:0/3844765347 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f194c0e1070 con 0x55d8f748d170 2024-09-13T06:09:59.620 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.615+0000 7f195cf29640 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d8f748c410 con 0x7f195001fbe0 2024-09-13T06:09:59.620 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.615+0000 7f195d72a640 1 -- 172.21.15.194:0/3844765347 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19540083f0 con 0x7f195001fbe0 2024-09-13T06:09:59.620 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.615+0000 7f195d72a640 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d8f748c410 con 0x55d8f74887d0 2024-09-13T06:09:59.620 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.615+0000 7f195d72a640 1 -- 172.21.15.194:0/3844765347 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f19540083f0 con 0x55d8f74887d0 2024-09-13T06:09:59.620 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.615+0000 7f195d72a640 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d8f748c410 con 0x7f194c102040 2024-09-13T06:09:59.620 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.615+0000 7f195c728640 1 -- 172.21.15.194:0/3844765347 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1950037040 con 0x7f194c102040 2024-09-13T06:09:59.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.615+0000 7f195f419980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:09:59.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.615+0000 7f195f419980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:09:59.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.615+0000 7f195f419980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:09:59.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.615+0000 7f195f419980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:09:59.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.615+0000 7f195f419980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:09:59.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.615+0000 7f195f419980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:09:59.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.615+0000 7f195f419980 20 rados->read ofs=0 len=0 2024-09-13T06:09:59.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.615+0000 7f195f419980 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d8f7490580 con 0x55d8f74887d0 2024-09-13T06:09:59.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.615+0000 7f195d72a640 1 -- 172.21.15.194:0/3844765347 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f19540083f0 con 0x55d8f74887d0 2024-09-13T06:09:59.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.615+0000 7f195f419980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:59.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.615+0000 7f195f419980 20 rados->read ofs=0 len=0 2024-09-13T06:09:59.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.615+0000 7f195f419980 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d8f7490dd0 con 0x55d8f74887d0 2024-09-13T06:09:59.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.615+0000 7f195d72a640 1 -- 172.21.15.194:0/3844765347 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f19540083f0 con 0x55d8f74887d0 2024-09-13T06:09:59.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.615+0000 7f195f419980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:59.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.615+0000 7f195f419980 20 rados->read ofs=0 len=0 2024-09-13T06:09:59.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.615+0000 7f195f419980 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d8f74901e0 con 0x7f194c102040 2024-09-13T06:09:59.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.615+0000 7f195c728640 1 -- 172.21.15.194:0/3844765347 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1950037040 con 0x7f194c102040 2024-09-13T06:09:59.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.615+0000 7f195f419980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:09:59.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.615+0000 7f195f419980 20 zone default found 2024-09-13T06:09:59.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.615+0000 7f195f419980 4 Realm: () 2024-09-13T06:09:59.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.615+0000 7f195f419980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:09:59.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.615+0000 7f195f419980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:09:59.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.615+0000 7f195f419980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:09:59.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.615+0000 7f195f419980 20 zonegroup default 2024-09-13T06:09:59.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.615+0000 7f195f419980 20 rados->read ofs=0 len=0 2024-09-13T06:09:59.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.615+0000 7f195f419980 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d8f7491890 con 0x7f195001fbe0 2024-09-13T06:09:59.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.615+0000 7f195d72a640 1 -- 172.21.15.194:0/3844765347 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f19540083f0 con 0x7f195001fbe0 2024-09-13T06:09:59.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.615+0000 7f195f419980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:59.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.615+0000 7f195f419980 20 rados->read ofs=0 len=0 2024-09-13T06:09:59.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.615+0000 7f195f419980 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d8f7493300 con 0x55d8f748d170 2024-09-13T06:09:59.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.615+0000 7f195cf29640 1 -- 172.21.15.194:0/3844765347 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f194c0e1070 con 0x55d8f748d170 2024-09-13T06:09:59.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.619+0000 7f195f419980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:59.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.619+0000 7f195f419980 20 rados->read ofs=0 len=0 2024-09-13T06:09:59.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.619+0000 7f195f419980 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d8f7493790 con 0x55d8f748d170 2024-09-13T06:09:59.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.619+0000 7f195cf29640 1 -- 172.21.15.194:0/3844765347 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f194c0e1070 con 0x55d8f748d170 2024-09-13T06:09:59.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.619+0000 7f195f419980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:59.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.619+0000 7f195f419980 20 started sync module instance, tier type = 2024-09-13T06:09:59.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.619+0000 7f195f419980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:09:59.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.619+0000 7f195f419980 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d8f7492710 con 0x7f194c102040 2024-09-13T06:09:59.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.619+0000 7f195c728640 1 -- 172.21.15.194:0/3844765347 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(44 notify.0 [create] v33'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1950037040 con 0x7f194c102040 2024-09-13T06:09:59.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.619+0000 7f195f419980 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94390350064384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d8f7492f20 con 0x7f194c102040 2024-09-13T06:09:59.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.619+0000 7f195f419980 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d8f74946c0 con 0x55d8f74887d0 2024-09-13T06:09:59.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.619+0000 7f195d72a640 1 -- 172.21.15.194:0/3844765347 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v33'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19540083f0 con 0x55d8f74887d0 2024-09-13T06:09:59.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.619+0000 7f195f419980 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94390350070560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d8f7494dd0 con 0x55d8f74887d0 2024-09-13T06:09:59.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.619+0000 7f195f419980 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d8f74958f0 con 0x55d8f748d170 2024-09-13T06:09:59.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.623+0000 7f195c728640 1 -- 172.21.15.194:0/3844765347 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94390350064384] v33'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1950037040 con 0x7f194c102040 2024-09-13T06:09:59.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.623+0000 7f195cf29640 1 -- 172.21.15.194:0/3844765347 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v33'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f194c0e1070 con 0x55d8f748d170 2024-09-13T06:09:59.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.623+0000 7f195f419980 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94390350074816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d8f7495ce0 con 0x55d8f748d170 2024-09-13T06:09:59.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.623+0000 7f195f419980 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d8f74966a0 con 0x7f194c102040 2024-09-13T06:09:59.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.623+0000 7f195d72a640 1 -- 172.21.15.194:0/3844765347 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94390350070560] v33'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19540083f0 con 0x55d8f74887d0 2024-09-13T06:09:59.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.623+0000 7f195c728640 1 -- 172.21.15.194:0/3844765347 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(50 notify.3 [create] v33'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1950037040 con 0x7f194c102040 2024-09-13T06:09:59.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.623+0000 7f195f419980 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94390350071840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d8f7496f40 con 0x7f194c102040 2024-09-13T06:09:59.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.623+0000 7f195f419980 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d8f7497790 con 0x55d8f74887d0 2024-09-13T06:09:59.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.623+0000 7f195cf29640 1 -- 172.21.15.194:0/3844765347 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94390350074816] v33'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f194c0e1070 con 0x55d8f748d170 2024-09-13T06:09:59.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.623+0000 7f195c728640 1 -- 172.21.15.194:0/3844765347 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94390350071840] v33'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1950037040 con 0x7f194c102040 2024-09-13T06:09:59.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.627+0000 7f195d72a640 1 -- 172.21.15.194:0/3844765347 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v33'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19540083f0 con 0x55d8f74887d0 2024-09-13T06:09:59.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.627+0000 7f195f419980 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94390350068720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d8f7497790 con 0x55d8f74887d0 2024-09-13T06:09:59.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.627+0000 7f195f419980 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d8f7498030 con 0x7f195001fbe0 2024-09-13T06:09:59.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.627+0000 7f195d72a640 1 -- 172.21.15.194:0/3844765347 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94390350068720] v33'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19540083f0 con 0x55d8f74887d0 2024-09-13T06:09:59.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.627+0000 7f195d72a640 1 -- 172.21.15.194:0/3844765347 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(54 notify.5 [create] v33'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19540083f0 con 0x7f195001fbe0 2024-09-13T06:09:59.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.627+0000 7f195f419980 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94390350083056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d8f7497de0 con 0x7f195001fbe0 2024-09-13T06:09:59.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.627+0000 7f195f419980 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d8f74988d0 con 0x7f195001fbe0 2024-09-13T06:09:59.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.631+0000 7f195d72a640 1 -- 172.21.15.194:0/3844765347 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94390350083056] v33'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19540083f0 con 0x7f195001fbe0 2024-09-13T06:09:59.631 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.631+0000 7f195d72a640 1 -- 172.21.15.194:0/3844765347 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(56 notify.6 [create] v33'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19540083f0 con 0x7f195001fbe0 2024-09-13T06:09:59.631 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.631+0000 7f195f419980 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94390350087072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d8f7498890 con 0x7f195001fbe0 2024-09-13T06:09:59.631 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.631+0000 7f195f419980 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d8f7499290 con 0x7f195001fbe0 2024-09-13T06:09:59.633 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.631+0000 7f195d72a640 1 -- 172.21.15.194:0/3844765347 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(58 notify.7 [create] v33'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19540083f0 con 0x7f195001fbe0 2024-09-13T06:09:59.633 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.631+0000 7f195f419980 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94390350089632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d8f74996b0 con 0x7f195001fbe0 2024-09-13T06:09:59.633 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.631+0000 7f195f419980 20 add_watcher() i=0 2024-09-13T06:09:59.633 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.631+0000 7f195f419980 20 add_watcher() i=1 2024-09-13T06:09:59.633 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.631+0000 7f195f419980 20 add_watcher() i=2 2024-09-13T06:09:59.633 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.631+0000 7f195f419980 20 add_watcher() i=3 2024-09-13T06:09:59.633 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.631+0000 7f195f419980 20 add_watcher() i=4 2024-09-13T06:09:59.634 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.631+0000 7f195f419980 20 add_watcher() i=5 2024-09-13T06:09:59.634 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.631+0000 7f195d72a640 1 -- 172.21.15.194:0/3844765347 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94390350087072] v33'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19540083f0 con 0x7f195001fbe0 2024-09-13T06:09:59.634 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.631+0000 7f195f419980 20 add_watcher() i=6 2024-09-13T06:09:59.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.635+0000 7f195d72a640 1 -- 172.21.15.194:0/3844765347 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94390350089632] v33'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19540083f0 con 0x7f195001fbe0 2024-09-13T06:09:59.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.635+0000 7f195f419980 20 add_watcher() i=7 2024-09-13T06:09:59.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.635+0000 7f195f419980 2 all 8 watchers are set, enabling cache 2024-09-13T06:09:59.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.635+0000 7f195f419980 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d8f7497850 con 0x55d8f74887d0 2024-09-13T06:09:59.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.635+0000 7f195d72a640 1 -- 172.21.15.194:0/3844765347 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f19540083f0 con 0x55d8f74887d0 2024-09-13T06:09:59.636 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.635+0000 7f195f419980 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94390350084176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d8f7499bc0 con 0x55d8f74887d0 2024-09-13T06:09:59.637 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.635+0000 7f195d72a640 1 -- 172.21.15.194:0/3844765347 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94390350084176] v33'117 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f19540083f0 con 0x55d8f74887d0 2024-09-13T06:09:59.637 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.635+0000 7f1812fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:59.637 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.635+0000 7f195f419980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:09:59.637 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.635+0000 7f195f419980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:09:59.637 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.635+0000 7f195f419980 5 note: GC not initialized 2024-09-13T06:09:59.637 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.635+0000 7f1811fe3640 20 reqs_thread_entry: start 2024-09-13T06:09:59.638 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.635+0000 7f195f419980 20 init_complete bucket index max shards: 11 2024-09-13T06:09:59.638 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.635+0000 7f195f419980 20 Filter name: none 2024-09-13T06:09:59.638 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.635+0000 7f17837fe640 20 reqs_thread_entry: start 2024-09-13T06:09:59.638 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.635+0000 7f195f419980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T06:09:59.638 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.635+0000 7f195f419980 20 rados->read ofs=0 len=0 2024-09-13T06:09:59.638 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.635+0000 7f195f419980 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d8f74bfd70 con 0x7f195001fbe0 2024-09-13T06:09:59.639 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.635+0000 7f195d72a640 1 -- 172.21.15.194:0/3844765347 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f19540083f0 con 0x7f195001fbe0 2024-09-13T06:09:59.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.635+0000 7f195f419980 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T06:09:59.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.635+0000 7f195f419980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-13T06:09:59.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.635+0000 7f195f419980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T06:09:59.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.635+0000 7f195f419980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:09:59.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.635+0000 7f195f419980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T06:09:59.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.635+0000 7f195f419980 20 rados->read ofs=0 len=0 2024-09-13T06:09:59.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.635+0000 7f195f419980 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d8f74bf890 con 0x7f194c102040 2024-09-13T06:09:59.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.639+0000 7f195c728640 1 -- 172.21.15.194:0/3844765347 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv20 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f1950037040 con 0x7f194c102040 2024-09-13T06:09:59.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.639+0000 7f195f419980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T06:09:59.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.639+0000 7f195f419980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T06:09:59.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.639+0000 7f195f419980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T06:09:59.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.639+0000 7f195f419980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 : miss 2024-09-13T06:09:59.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.639+0000 7f195f419980 20 rados->read ofs=0 len=0 2024-09-13T06:09:59.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.639+0000 7f195f419980 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:64 8.18 8:1a66c368:root::.bucket.meta.myfoo%3a52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d8f74c3a40 con 0x55d8f74887d0 2024-09-13T06:09:59.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.639+0000 7f195d72a640 1 -- 172.21.15.194:0/3844765347 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(64 .bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv13 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f19540083f0 con 0x55d8f74887d0 2024-09-13T06:09:59.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.639+0000 7f195f419980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T06:09:59.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.639+0000 7f195f419980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 info.flags=0x17 2024-09-13T06:09:59.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.639+0000 7f195f419980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 to cache LRU end 2024-09-13T06:09:59.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.639+0000 7f195f419980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:09:59.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.639+0000 7f195f419980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T06:09:59.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.639+0000 7f195f419980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 2024-09-13T06:09:59.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.639+0000 7f195f419980 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-09-13T06:09:59.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.639+0000 7f195f419980 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d8f74c4f70 con 0x7f195001fbe0 2024-09-13T06:09:59.642 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.639+0000 7f195d72a640 1 -- 172.21.15.194:0/3844765347 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(65 fud.buckets [call] v33'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f19540083f0 con 0x7f195001fbe0 2024-09-13T06:09:59.642 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.639+0000 7f195f419980 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-09-13T06:09:59.642 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.639+0000 7f195f419980 20 rados->read ofs=0 len=0 2024-09-13T06:09:59.643 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.639+0000 7f195f419980 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d8f74c5370 con 0x7f194c102040 2024-09-13T06:09:59.643 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.643+0000 7f195c728640 1 -- 172.21.15.194:0/3844765347 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv20 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7f1950037040 con 0x7f194c102040 2024-09-13T06:09:59.643 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.643+0000 7f195f419980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T06:09:59.643 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.643+0000 7f195f419980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-09-13T06:09:59.643 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.643+0000 7f195f419980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T06:09:59.643 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.643+0000 7f195f419980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:09:59.643 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.643+0000 7f195f419980 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d8f74caf60 con 0x7f194c102040 2024-09-13T06:09:59.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.643+0000 7f195c728640 1 -- 172.21.15.194:0/3844765347 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v33'21 uv21 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7f1950037040 con 0x7f194c102040 2024-09-13T06:09:59.645 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.643+0000 7f195f419980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-13T06:09:59.645 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.643+0000 7f195f419980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T06:09:59.645 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.643+0000 7f195f419980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-13T06:09:59.645 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.643+0000 7f195f419980 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94390350277232 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d8f74c8450 con 0x7f195001fbe0 2024-09-13T06:09:59.645 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.643+0000 7f195d72a640 1 -- 172.21.15.194:0/3844765347 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== watch-notify(notify (1) cookie 94390350087072 notify 141733920774 ret 0) ==== 380+0+0 (crc 0 0 0) 0x55d8f74c3e30 con 0x7f195001fbe0 2024-09-13T06:09:59.646 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.643+0000 7f1833fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920774 cookie 94390350087072 notifier 4514 bl.length()=338 2024-09-13T06:09:59.646 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.643+0000 7f1833fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-13T06:09:59.646 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.643+0000 7f1833fff640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T06:09:59.646 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.643+0000 7f1833fff640 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f1820003eb0 con 0x7f195001fbe0 2024-09-13T06:09:59.646 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.643+0000 7f195d72a640 1 -- 172.21.15.194:0/3844765347 <== osd.0 v2:172.21.15.120:6800/1923744619 20 ==== osd_op_reply(68 notify.6 [notify cookie 94390350277232 out=8b] v0'0 uv120 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f19540083f0 con 0x7f195001fbe0 2024-09-13T06:09:59.646 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.647+0000 7f195d72a640 1 -- 172.21.15.194:0/3844765347 <== osd.0 v2:172.21.15.120:6800/1923744619 21 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19540083f0 con 0x7f195001fbe0 2024-09-13T06:09:59.646 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.647+0000 7f195d72a640 1 -- 172.21.15.194:0/3844765347 <== osd.0 v2:172.21.15.120:6800/1923744619 22 ==== watch-notify(notify_complete (2) cookie 94390350277232 notify 141733920774 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d8f74c3040 con 0x7f195001fbe0 2024-09-13T06:09:59.647 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.647+0000 7f1812fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:59.647 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.647+0000 7f195f419980 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94390350084176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d8f74bdba0 con 0x55d8f74887d0 2024-09-13T06:09:59.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.647+0000 7f195d72a640 1 -- 172.21.15.194:0/3844765347 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94390350084176] v33'118 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f19540083f0 con 0x55d8f74887d0 2024-09-13T06:09:59.649 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.647+0000 7f195f419980 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94390350064384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d8f74bdba0 con 0x7f194c102040 2024-09-13T06:09:59.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.647+0000 7f195c728640 1 -- 172.21.15.194:0/3844765347 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94390350064384] v33'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1950037040 con 0x7f194c102040 2024-09-13T06:09:59.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.647+0000 7f195f419980 20 remove_watcher() i=0 2024-09-13T06:09:59.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.647+0000 7f195f419980 2 removed watcher, disabling cache 2024-09-13T06:09:59.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.647+0000 7f195f419980 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94390350070560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d8f74bdba0 con 0x55d8f74887d0 2024-09-13T06:09:59.652 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.651+0000 7f195d72a640 1 -- 172.21.15.194:0/3844765347 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94390350070560] v33'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19540083f0 con 0x55d8f74887d0 2024-09-13T06:09:59.652 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.651+0000 7f195f419980 20 remove_watcher() i=1 2024-09-13T06:09:59.652 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.651+0000 7f195f419980 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94390350074816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d8f7494320 con 0x55d8f748d170 2024-09-13T06:09:59.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.651+0000 7f195cf29640 1 -- 172.21.15.194:0/3844765347 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94390350074816] v33'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f194c0e1070 con 0x55d8f748d170 2024-09-13T06:09:59.654 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.651+0000 7f195f419980 20 remove_watcher() i=2 2024-09-13T06:09:59.654 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.651+0000 7f195f419980 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94390350071840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d8f74bdba0 con 0x7f194c102040 2024-09-13T06:09:59.654 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.655+0000 7f195c728640 1 -- 172.21.15.194:0/3844765347 <== osd.2 v2:172.21.15.194:6800/815615585 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94390350071840] v33'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1950037040 con 0x7f194c102040 2024-09-13T06:09:59.655 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.655+0000 7f195f419980 20 remove_watcher() i=3 2024-09-13T06:09:59.655 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.655+0000 7f195f419980 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94390350068720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d8f7494320 con 0x55d8f74887d0 2024-09-13T06:09:59.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.655+0000 7f195d72a640 1 -- 172.21.15.194:0/3844765347 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94390350068720] v33'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19540083f0 con 0x55d8f74887d0 2024-09-13T06:09:59.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.655+0000 7f195f419980 20 remove_watcher() i=4 2024-09-13T06:09:59.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.655+0000 7f195f419980 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94390350083056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d8f74bdba0 con 0x7f195001fbe0 2024-09-13T06:09:59.658 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.659+0000 7f195d72a640 1 -- 172.21.15.194:0/3844765347 <== osd.0 v2:172.21.15.120:6800/1923744619 23 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94390350083056] v33'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19540083f0 con 0x7f195001fbe0 2024-09-13T06:09:59.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.659+0000 7f195f419980 20 remove_watcher() i=5 2024-09-13T06:09:59.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.659+0000 7f195f419980 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94390350087072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d8f7494320 con 0x7f195001fbe0 2024-09-13T06:09:59.661 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.659+0000 7f195d72a640 1 -- 172.21.15.194:0/3844765347 <== osd.0 v2:172.21.15.120:6800/1923744619 24 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94390350087072] v33'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19540083f0 con 0x7f195001fbe0 2024-09-13T06:09:59.661 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.659+0000 7f195f419980 20 remove_watcher() i=6 2024-09-13T06:09:59.661 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.659+0000 7f195f419980 1 -- 172.21.15.194:0/3844765347 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94390350089632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d8f74bdba0 con 0x7f195001fbe0 2024-09-13T06:09:59.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.663+0000 7f195d72a640 1 -- 172.21.15.194:0/3844765347 <== osd.0 v2:172.21.15.120:6800/1923744619 25 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94390350089632] v33'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19540083f0 con 0x7f195001fbe0 2024-09-13T06:09:59.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.663+0000 7f195f419980 20 remove_watcher() i=7 2024-09-13T06:09:59.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.663+0000 7f195f419980 1 -- 172.21.15.194:0/3844765347 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f195001fbe0 msgr2=0x7f195003a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.663+0000 7f195f419980 1 --2- 172.21.15.194:0/3844765347 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f195001fbe0 0x7f195003a3c0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.663+0000 7f195f419980 1 -- 172.21.15.194:0/3844765347 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55d8f74887d0 msgr2=0x55d8f748ac70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.663+0000 7f195f419980 1 --2- 172.21.15.194:0/3844765347 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55d8f74887d0 0x55d8f748ac70 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.663+0000 7f195f419980 1 -- 172.21.15.194:0/3844765347 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f194c102040 msgr2=0x7f194c0f88c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.663+0000 7f195f419980 1 --2- 172.21.15.194:0/3844765347 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f194c102040 0x7f194c0f88c0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.663+0000 7f195f419980 1 -- 172.21.15.194:0/3844765347 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55d8f748d170 msgr2=0x55d8f748f560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.663+0000 7f195f419980 1 --2- 172.21.15.194:0/3844765347 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55d8f748d170 0x55d8f748f560 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.663+0000 7f195f419980 1 -- 172.21.15.194:0/3844765347 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f1828034650 msgr2=0x7f1828036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.663+0000 7f195f419980 1 --2- 172.21.15.194:0/3844765347 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f1828034650 0x7f1828036b10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f195000c010 tx=0x7f1950010000 comp rx=0 tx=0).stop 2024-09-13T06:09:59.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.663+0000 7f195f419980 1 -- 172.21.15.194:0/3844765347 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d8f7476690 msgr2=0x55d8f747d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.663+0000 7f195d72a640 1 -- 172.21.15.194:0/3844765347 reap_dead start 2024-09-13T06:09:59.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.663+0000 7f195f419980 1 --2- 172.21.15.194:0/3844765347 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d8f7476690 0x55d8f747d890 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f194c0c7ff0 tx=0x7f194c0c7ea0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.663+0000 7f195f419980 1 -- 172.21.15.194:0/3844765347 shutdown_connections 2024-09-13T06:09:59.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.663+0000 7f195f419980 1 --2- 172.21.15.194:0/3844765347 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d8f7476690 0x55d8f747d890 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.663+0000 7f195f419980 1 -- 172.21.15.194:0/3844765347 >> 172.21.15.194:0/3844765347 conn(0x55d8f746e660 msgr2=0x55d8f746c730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:59.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.663+0000 7f195f419980 1 -- 172.21.15.194:0/3844765347 shutdown_connections 2024-09-13T06:09:59.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.663+0000 7f195f419980 1 -- 172.21.15.194:0/3844765347 wait complete. 2024-09-13T06:09:59.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.663+0000 7f195f419980 1 -- 172.21.15.194:0/1533141441 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f1834034650 msgr2=0x7f1834036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.663+0000 7f195f419980 1 --2- 172.21.15.194:0/1533141441 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f1834034650 0x7f1834036b10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x55d8f74582a0 tx=0x7f195000f000 comp rx=0 tx=0).stop 2024-09-13T06:09:59.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.663+0000 7f195f419980 1 -- 172.21.15.194:0/1533141441 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d8f7465930 msgr2=0x55d8f7465d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.663+0000 7f195f419980 1 --2- 172.21.15.194:0/1533141441 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d8f7465930 0x55d8f7465d50 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f194c0ae040 tx=0x7f194c0b84c0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.663+0000 7f195f419980 1 -- 172.21.15.194:0/1533141441 shutdown_connections 2024-09-13T06:09:59.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.663+0000 7f195f419980 1 --2- 172.21.15.194:0/1533141441 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f1834034650 0x7f1834036b10 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.663+0000 7f195f419980 1 --2- 172.21.15.194:0/1533141441 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d8f7465930 0x55d8f7465d50 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.663+0000 7f195f419980 1 -- 172.21.15.194:0/1533141441 >> 172.21.15.194:0/1533141441 conn(0x55d8f745aa80 msgr2=0x55d8f745d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:59.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.663+0000 7f195f419980 1 -- 172.21.15.194:0/1533141441 shutdown_connections 2024-09-13T06:09:59.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.663+0000 7f195f419980 1 -- 172.21.15.194:0/1533141441 wait complete. 2024-09-13T06:09:59.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.663+0000 7f195f419980 1 -- 172.21.15.194:0/1147354567 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55d8f7356ea0 msgr2=0x55d8f744ea30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.663+0000 7f195f419980 1 --2- 172.21.15.194:0/1147354567 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55d8f7356ea0 0x55d8f744ea30 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.663+0000 7f195f419980 1 -- 172.21.15.194:0/1147354567 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55d8f7455320 msgr2=0x55d8f7457710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.663+0000 7f195f419980 1 --2- 172.21.15.194:0/1147354567 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55d8f7455320 0x55d8f7457710 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.663+0000 7f195f419980 1 -- 172.21.15.194:0/1147354567 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55d8f7451420 msgr2=0x55d8f7453810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.663+0000 7f195f419980 1 --2- 172.21.15.194:0/1147354567 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55d8f7451420 0x55d8f7453810 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.663+0000 7f195f419980 1 -- 172.21.15.194:0/1147354567 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f1844034650 msgr2=0x7f1844036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.663+0000 7f195f419980 1 --2- 172.21.15.194:0/1147354567 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f1844034650 0x7f1844036b10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1950000f70 tx=0x7f1950001380 comp rx=0 tx=0).stop 2024-09-13T06:09:59.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.663+0000 7f195f419980 1 -- 172.21.15.194:0/1147354567 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d8f7356550 msgr2=0x55d8f7447aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.663+0000 7f195f419980 1 --2- 172.21.15.194:0/1147354567 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d8f7356550 0x55d8f7447aa0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f194c01e0a0 tx=0x7f194c01a5a0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.663+0000 7f195d72a640 1 -- 172.21.15.194:0/1147354567 reap_dead start 2024-09-13T06:09:59.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.663+0000 7f195f419980 1 -- 172.21.15.194:0/1147354567 shutdown_connections 2024-09-13T06:09:59.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.663+0000 7f195f419980 1 -- 172.21.15.194:0/1147354567 >> 172.21.15.194:0/1147354567 conn(0x55d8f7352070 msgr2=0x55d8f743b040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:59.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.663+0000 7f195f419980 1 -- 172.21.15.194:0/1147354567 shutdown_connections 2024-09-13T06:09:59.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.663+0000 7f195f419980 1 -- 172.21.15.194:0/1147354567 wait complete. 2024-09-13T06:09:59.674 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1'] 2024-09-13T06:09:59.674 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1'] 2024-09-13T06:09:59.674 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid foo --bucket myfoo --bucket-id 52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 2024-09-13T06:09:59.756 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:09:59.756 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:09:59.757 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.755+0000 7f0864d01980 1 Processor -- start 2024-09-13T06:09:59.757 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.755+0000 7f0864d01980 1 -- start start 2024-09-13T06:09:59.757 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.755+0000 7f0864d01980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55daed3ed630 0x55daed3eda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.757 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.755+0000 7f0864d01980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55daed275ae0 con 0x55daed3edf80 2024-09-13T06:09:59.758 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.755+0000 7f0864d01980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x55daed299e30 con 0x55daed3ed630 2024-09-13T06:09:59.758 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.755+0000 7f0862811640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55daed3ed630 0x55daed3eda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.758 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.755+0000 7f0862811640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55daed3ed630 0x55daed3eda10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45840/0 (socket says 172.21.15.194:45840) 2024-09-13T06:09:59.758 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.755+0000 7f085a010640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x55daed3edf80 0x55daed3f29b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:51218/0 (socket says 172.21.15.194:51218) 2024-09-13T06:09:59.758 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.755+0000 7f0862811640 1 -- 172.21.15.194:0/1032904017 learned_addr learned my addr 172.21.15.194:0/1032904017 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:59.758 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.755+0000 7f0862811640 1 -- 172.21.15.194:0/1032904017 >> v1:172.21.15.120:6789/0 conn(0x55daed3edf80 legacy=0x55daed3f29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.758 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.755+0000 7f0862811640 1 -- 172.21.15.194:0/1032904017 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55daed3f5200 con 0x55daed3ed630 2024-09-13T06:09:59.760 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.759+0000 7f0862811640 1 --2- 172.21.15.194:0/1032904017 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55daed3ed630 0x55daed3eda10 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f085400a5c0 tx=0x7f085401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5872055269b022ab server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.760 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.759+0000 7f0862010640 1 -- 172.21.15.194:0/1032904017 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08540a6070 con 0x55daed3ed630 2024-09-13T06:09:59.761 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.759+0000 7f0862010640 1 -- 172.21.15.194:0/1032904017 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08540af070 con 0x55daed3ed630 2024-09-13T06:09:59.761 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.759+0000 7f0862010640 1 -- 172.21.15.194:0/1032904017 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08540aa5c0 con 0x55daed3ed630 2024-09-13T06:09:59.761 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.759+0000 7f0864d01980 1 -- 172.21.15.194:0/1032904017 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55daed3ed630 msgr2=0x55daed3eda10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.761 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.759+0000 7f0864d01980 1 --2- 172.21.15.194:0/1032904017 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55daed3ed630 0x55daed3eda10 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f085400a5c0 tx=0x7f085401b340 comp rx=0 tx=0).stop 2024-09-13T06:09:59.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.759+0000 7f0864d01980 1 -- 172.21.15.194:0/1032904017 shutdown_connections 2024-09-13T06:09:59.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.759+0000 7f0864d01980 1 --2- 172.21.15.194:0/1032904017 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55daed3ed630 0x55daed3eda10 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.759+0000 7f0864d01980 1 -- 172.21.15.194:0/1032904017 >> 172.21.15.194:0/1032904017 conn(0x55daed3e9150 msgr2=0x55daed3eb570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:59.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.759+0000 7f0864d01980 1 -- 172.21.15.194:0/1032904017 shutdown_connections 2024-09-13T06:09:59.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.759+0000 7f0864d01980 1 -- 172.21.15.194:0/1032904017 wait complete. 2024-09-13T06:09:59.776 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.775+0000 7f0864d01980 1 Processor -- start 2024-09-13T06:09:59.776 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.775+0000 7f0864d01980 1 -- start start 2024-09-13T06:09:59.776 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.775+0000 7f0864d01980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55daed3ed630 0x55daed4d8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.776 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.775+0000 7f0864d01980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55daed29b200 con 0x55daed3ed630 2024-09-13T06:09:59.776 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.775+0000 7f0862811640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55daed3ed630 0x55daed4d8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.776 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.775+0000 7f0862811640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55daed3ed630 0x55daed4d8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45852/0 (socket says 172.21.15.194:45852) 2024-09-13T06:09:59.776 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.775+0000 7f0862811640 1 -- 172.21.15.194:0/60552917 learned_addr learned my addr 172.21.15.194:0/60552917 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:59.776 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.775+0000 7f0862811640 1 -- 172.21.15.194:0/60552917 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55daed4d9070 con 0x55daed3ed630 2024-09-13T06:09:59.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.775+0000 7f0862811640 1 --2- 172.21.15.194:0/60552917 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55daed3ed630 0x55daed4d8aa0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f08540199f0 tx=0x7f0854003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62f6ccb06616e8a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.775+0000 7f0750e09640 1 -- 172.21.15.194:0/60552917 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08540aaa00 con 0x55daed3ed630 2024-09-13T06:09:59.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.775+0000 7f0750e09640 1 -- 172.21.15.194:0/60552917 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08540aaba0 con 0x55daed3ed630 2024-09-13T06:09:59.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.775+0000 7f0750e09640 1 -- 172.21.15.194:0/60552917 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08540bd3f0 con 0x55daed3ed630 2024-09-13T06:09:59.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.775+0000 7f0864d01980 1 -- 172.21.15.194:0/60552917 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55daed3ed630 msgr2=0x55daed4d8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.775+0000 7f0864d01980 1 --2- 172.21.15.194:0/60552917 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55daed3ed630 0x55daed4d8aa0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f08540199f0 tx=0x7f0854003030 comp rx=0 tx=0).stop 2024-09-13T06:09:59.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.775+0000 7f0864d01980 1 -- 172.21.15.194:0/60552917 shutdown_connections 2024-09-13T06:09:59.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.775+0000 7f0864d01980 1 --2- 172.21.15.194:0/60552917 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55daed3ed630 0x55daed4d8aa0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.775+0000 7f0864d01980 1 -- 172.21.15.194:0/60552917 >> 172.21.15.194:0/60552917 conn(0x55daed3e9150 msgr2=0x55daed4d46d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:59.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.775+0000 7f0864d01980 1 -- 172.21.15.194:0/60552917 shutdown_connections 2024-09-13T06:09:59.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.775+0000 7f0864d01980 1 -- 172.21.15.194:0/60552917 wait complete. 2024-09-13T06:09:59.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.775+0000 7f0864d01980 1 Processor -- start 2024-09-13T06:09:59.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.775+0000 7f0864d01980 1 -- start start 2024-09-13T06:09:59.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.775+0000 7f0864d01980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55daed3ed630 0x55daed4dfd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.779+0000 7f0864d01980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55daed3f4c40 con 0x55daed3ed630 2024-09-13T06:09:59.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.779+0000 7f0862811640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55daed3ed630 0x55daed4dfd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.779+0000 7f0862811640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55daed3ed630 0x55daed4dfd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45862/0 (socket says 172.21.15.194:45862) 2024-09-13T06:09:59.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.779+0000 7f0862811640 1 -- 172.21.15.194:0/3873160459 learned_addr learned my addr 172.21.15.194:0/3873160459 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:59.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.779+0000 7f0862811640 1 -- 172.21.15.194:0/3873160459 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55daed4e0260 con 0x55daed3ed630 2024-09-13T06:09:59.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.779+0000 7f0862811640 1 --2- 172.21.15.194:0/3873160459 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55daed3ed630 0x55daed4dfd20 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f08540199f0 tx=0x7f08540180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.779+0000 7f074f606640 1 -- 172.21.15.194:0/3873160459 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08540bd7c0 con 0x55daed3ed630 2024-09-13T06:09:59.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.779+0000 7f074f606640 1 -- 172.21.15.194:0/3873160459 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08540bd960 con 0x55daed3ed630 2024-09-13T06:09:59.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.779+0000 7f0864d01980 1 -- 172.21.15.194:0/3873160459 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55daed4e04f0 con 0x55daed3ed630 2024-09-13T06:09:59.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.779+0000 7f074f606640 1 -- 172.21.15.194:0/3873160459 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08540bdc40 con 0x55daed3ed630 2024-09-13T06:09:59.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.779+0000 7f0864d01980 1 -- 172.21.15.194:0/3873160459 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55daed4e31d0 con 0x55daed3ed630 2024-09-13T06:09:59.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.779+0000 7f074f606640 1 -- 172.21.15.194:0/3873160459 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f08540ce020 con 0x55daed3ed630 2024-09-13T06:09:59.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.779+0000 7f074f606640 1 --2- 172.21.15.194:0/3873160459 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0748034650 0x7f0748036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.779+0000 7f074f606640 1 -- 172.21.15.194:0/3873160459 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f08540cc020 con 0x55daed3ed630 2024-09-13T06:09:59.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.779+0000 7f085a010640 1 --2- 172.21.15.194:0/3873160459 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0748034650 0x7f0748036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.779+0000 7f0864d01980 1 --2- 172.21.15.194:0/3873160459 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55daed3edf80 0x55daed4e6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.779+0000 7f0864d01980 1 -- 172.21.15.194:0/3873160459 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55daed4e7360 con 0x55daed3edf80 2024-09-13T06:09:59.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.779+0000 7f0863012640 1 --2- 172.21.15.194:0/3873160459 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55daed3edf80 0x55daed4e6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.779+0000 7f085a010640 1 --2- 172.21.15.194:0/3873160459 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0748034650 0x7f0748036b10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f084c000f70 tx=0x7f084c001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.779+0000 7f0863012640 1 --2- 172.21.15.194:0/3873160459 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55daed3edf80 0x55daed4e6cf0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.783+0000 7f0863012640 1 -- 172.21.15.194:0/3873160459 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f085c00a4d0 con 0x55daed3edf80 2024-09-13T06:09:59.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.783+0000 7f0864d01980 1 -- 172.21.15.194:0/3873160459 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55daed4e43f0 con 0x55daed3edf80 2024-09-13T06:09:59.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.783+0000 7f0863012640 1 -- 172.21.15.194:0/3873160459 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f085c00a4d0 con 0x55daed3edf80 2024-09-13T06:09:59.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.783+0000 7f0864d01980 1 --2- 172.21.15.194:0/3873160459 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55daed4e96b0 0x55daed4ebaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.783+0000 7f0864d01980 1 -- 172.21.15.194:0/3873160459 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55daed4ec190 con 0x55daed4e96b0 2024-09-13T06:09:59.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.783+0000 7f0862811640 1 --2- 172.21.15.194:0/3873160459 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55daed4e96b0 0x55daed4ebaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.783+0000 7f0862811640 1 --2- 172.21.15.194:0/3873160459 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55daed4e96b0 0x55daed4ebaa0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.783+0000 7f0862811640 1 -- 172.21.15.194:0/3873160459 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f08540c53e0 con 0x55daed4e96b0 2024-09-13T06:09:59.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.783+0000 7f0864d01980 1 -- 172.21.15.194:0/3873160459 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55daed4e8550 con 0x55daed3edf80 2024-09-13T06:09:59.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.783+0000 7f0863012640 1 -- 172.21.15.194:0/3873160459 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f085c00a4d0 con 0x55daed3edf80 2024-09-13T06:09:59.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.783+0000 7f0864d01980 1 --2- 172.21.15.194:0/3873160459 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55daed4ed5f0 0x55daed4ef9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.783+0000 7f0864d01980 1 -- 172.21.15.194:0/3873160459 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55daed4f0120 con 0x55daed4ed5f0 2024-09-13T06:09:59.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.783+0000 7f085a010640 1 --2- 172.21.15.194:0/3873160459 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55daed4ed5f0 0x55daed4ef9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.783+0000 7f085a010640 1 --2- 172.21.15.194:0/3873160459 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55daed4ed5f0 0x55daed4ef9e0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.783+0000 7f085a010640 1 -- 172.21.15.194:0/3873160459 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f084c00f6a0 con 0x55daed4ed5f0 2024-09-13T06:09:59.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.783+0000 7f0864d01980 1 Processor -- start 2024-09-13T06:09:59.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.783+0000 7f0864d01980 1 -- start start 2024-09-13T06:09:59.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.783+0000 7f0864d01980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55daed4fdbf0 0x55daed4fe010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.783+0000 7f0864d01980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55daed2f4800 con 0x55daed4fdbf0 2024-09-13T06:09:59.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.783+0000 7f0862811640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55daed4fdbf0 0x55daed4fe010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.783+0000 7f0862811640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55daed4fdbf0 0x55daed4fe010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45868/0 (socket says 172.21.15.194:45868) 2024-09-13T06:09:59.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.783+0000 7f0862811640 1 -- 172.21.15.194:0/529398800 learned_addr learned my addr 172.21.15.194:0/529398800 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:59.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.783+0000 7f0862811640 1 -- 172.21.15.194:0/529398800 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55daed4fe550 con 0x55daed4fdbf0 2024-09-13T06:09:59.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.787+0000 7f0862811640 1 --2- 172.21.15.194:0/529398800 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55daed4fdbf0 0x55daed4fe010 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f08540cf900 tx=0x7f08540e3ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.787+0000 7f074ce01640 1 -- 172.21.15.194:0/529398800 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08540cfd00 con 0x55daed4fdbf0 2024-09-13T06:09:59.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.787+0000 7f074ce01640 1 -- 172.21.15.194:0/529398800 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08540e32d0 con 0x55daed4fdbf0 2024-09-13T06:09:59.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.787+0000 7f0864d01980 1 -- 172.21.15.194:0/529398800 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55daed4fe7e0 con 0x55daed4fdbf0 2024-09-13T06:09:59.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.787+0000 7f074ce01640 1 -- 172.21.15.194:0/529398800 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08540e35d0 con 0x55daed4fdbf0 2024-09-13T06:09:59.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.787+0000 7f0864d01980 1 -- 172.21.15.194:0/529398800 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55daed501460 con 0x55daed4fdbf0 2024-09-13T06:09:59.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.787+0000 7f074ce01640 1 -- 172.21.15.194:0/529398800 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f08540c6480 con 0x55daed4fdbf0 2024-09-13T06:09:59.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.787+0000 7f074ce01640 1 --2- 172.21.15.194:0/529398800 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f073c034650 0x7f073c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.787+0000 7f074ce01640 1 -- 172.21.15.194:0/529398800 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f08540eec50 con 0x55daed4fdbf0 2024-09-13T06:09:59.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.787+0000 7f085a010640 1 --2- 172.21.15.194:0/529398800 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f073c034650 0x7f073c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.787+0000 7f0864d01980 1 Processor -- start 2024-09-13T06:09:59.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.787+0000 7f0864d01980 1 -- start start 2024-09-13T06:09:59.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.787+0000 7f085a010640 1 --2- 172.21.15.194:0/529398800 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f073c034650 0x7f073c036b10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x55daed4e7830 tx=0x7f084c00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.787+0000 7f0864d01980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55daed50a4e0 0x55daed50a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.787+0000 7f0864d01980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55daed4d9330 con 0x55daed50a4e0 2024-09-13T06:09:59.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.787+0000 7f0862811640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55daed50a4e0 0x55daed50a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.787+0000 7f0862811640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55daed50a4e0 0x55daed50a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45874/0 (socket says 172.21.15.194:45874) 2024-09-13T06:09:59.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.787+0000 7f0862811640 1 -- 172.21.15.194:0/2336588139 learned_addr learned my addr 172.21.15.194:0/2336588139 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:59.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.787+0000 7f0862811640 1 -- 172.21.15.194:0/2336588139 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55daed50aeb0 con 0x55daed50a4e0 2024-09-13T06:09:59.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.787+0000 7f0862811640 1 --2- 172.21.15.194:0/2336588139 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55daed50a4e0 0x55daed50a8e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f08540c57a0 tx=0x7f08540a8a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67b749b545b49ff3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.787+0000 7f07467fc640 1 -- 172.21.15.194:0/2336588139 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08540c9cc0 con 0x55daed50a4e0 2024-09-13T06:09:59.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.787+0000 7f07467fc640 1 -- 172.21.15.194:0/2336588139 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08540bc3a0 con 0x55daed50a4e0 2024-09-13T06:09:59.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.787+0000 7f07467fc640 1 -- 172.21.15.194:0/2336588139 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08540c6770 con 0x55daed50a4e0 2024-09-13T06:09:59.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.791+0000 7f0864d01980 1 -- 172.21.15.194:0/2336588139 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55daed50a4e0 msgr2=0x55daed50a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.791+0000 7f0864d01980 1 --2- 172.21.15.194:0/2336588139 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55daed50a4e0 0x55daed50a8e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f08540c57a0 tx=0x7f08540a8a80 comp rx=0 tx=0).stop 2024-09-13T06:09:59.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.791+0000 7f0864d01980 1 -- 172.21.15.194:0/2336588139 shutdown_connections 2024-09-13T06:09:59.794 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.791+0000 7f0864d01980 1 --2- 172.21.15.194:0/2336588139 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55daed50a4e0 0x55daed50a8e0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.794 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.791+0000 7f0864d01980 1 -- 172.21.15.194:0/2336588139 >> 172.21.15.194:0/2336588139 conn(0x55daed5068c0 msgr2=0x55daed5049c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:59.794 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.791+0000 7f0864d01980 1 -- 172.21.15.194:0/2336588139 shutdown_connections 2024-09-13T06:09:59.794 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.791+0000 7f0864d01980 1 -- 172.21.15.194:0/2336588139 wait complete. 2024-09-13T06:09:59.794 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.791+0000 7f0864d01980 1 Processor -- start 2024-09-13T06:09:59.794 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.791+0000 7f0864d01980 1 -- start start 2024-09-13T06:09:59.794 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.791+0000 7f0864d01980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55daed50a4e0 0x55daed3644b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.794 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.791+0000 7f0864d01980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55daed50b2d0 con 0x55daed50a4e0 2024-09-13T06:09:59.794 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.791+0000 7f0862811640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55daed50a4e0 0x55daed3644b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.794 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.791+0000 7f0862811640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55daed50a4e0 0x55daed3644b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45888/0 (socket says 172.21.15.194:45888) 2024-09-13T06:09:59.794 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.791+0000 7f0862811640 1 -- 172.21.15.194:0/2731831681 learned_addr learned my addr 172.21.15.194:0/2731831681 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:59.794 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.791+0000 7f0862811640 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55daed362bd0 con 0x55daed50a4e0 2024-09-13T06:09:59.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.791+0000 7f0862811640 1 --2- 172.21.15.194:0/2731831681 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55daed50a4e0 0x55daed3644b0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f08540b5d60 tx=0x7f08540a9fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.791+0000 7f0744ff9640 1 -- 172.21.15.194:0/2731831681 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0854110070 con 0x55daed50a4e0 2024-09-13T06:09:59.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.791+0000 7f0744ff9640 1 -- 172.21.15.194:0/2731831681 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08540b3590 con 0x55daed50a4e0 2024-09-13T06:09:59.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.791+0000 7f0864d01980 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55daed362bd0 con 0x55daed50a4e0 2024-09-13T06:09:59.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.791+0000 7f0744ff9640 1 -- 172.21.15.194:0/2731831681 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08540f2040 con 0x55daed50a4e0 2024-09-13T06:09:59.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.791+0000 7f0864d01980 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55daed362bd0 con 0x55daed50a4e0 2024-09-13T06:09:59.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.791+0000 7f0744ff9640 1 -- 172.21.15.194:0/2731831681 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0854113070 con 0x55daed50a4e0 2024-09-13T06:09:59.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.791+0000 7f0744ff9640 1 --2- 172.21.15.194:0/2731831681 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f072c034650 0x7f072c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.791+0000 7f0744ff9640 1 -- 172.21.15.194:0/2731831681 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f0854107030 con 0x55daed50a4e0 2024-09-13T06:09:59.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.791+0000 7f0864d01980 20 rados->read ofs=0 len=0 2024-09-13T06:09:59.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.791+0000 7f085a010640 1 --2- 172.21.15.194:0/2731831681 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f072c034650 0x7f072c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.791+0000 7f0864d01980 1 --2- 172.21.15.194:0/2731831681 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55daed51e7a0 0x55daed520c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.791+0000 7f0864d01980 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55daed5213b0 con 0x55daed51e7a0 2024-09-13T06:09:59.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.795+0000 7f0863012640 1 --2- 172.21.15.194:0/2731831681 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55daed51e7a0 0x55daed520c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.795+0000 7f085a010640 1 --2- 172.21.15.194:0/2731831681 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f072c034650 0x7f072c036b10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f084c00c010 tx=0x7f084c010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.795+0000 7f0863012640 1 --2- 172.21.15.194:0/2731831681 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55daed51e7a0 0x55daed520c60 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.795+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f085c00a4d0 con 0x55daed51e7a0 2024-09-13T06:09:59.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.795+0000 7f0864d01980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:59.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.795+0000 7f0864d01980 20 realm 2024-09-13T06:09:59.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.795+0000 7f0864d01980 20 rados->read ofs=0 len=0 2024-09-13T06:09:59.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.795+0000 7f0864d01980 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55daed5217c0 con 0x55daed51e7a0 2024-09-13T06:09:59.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.795+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f085c00a4d0 con 0x55daed51e7a0 2024-09-13T06:09:59.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.795+0000 7f0864d01980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:59.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.795+0000 7f0864d01980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:09:59.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.795+0000 7f0864d01980 20 rados->read ofs=0 len=0 2024-09-13T06:09:59.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.795+0000 7f0864d01980 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55daed522060 con 0x55daed51e7a0 2024-09-13T06:09:59.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.795+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f085c00a4d0 con 0x55daed51e7a0 2024-09-13T06:09:59.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.795+0000 7f0864d01980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:59.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.795+0000 7f0864d01980 20 rados->read ofs=0 len=0 2024-09-13T06:09:59.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.795+0000 7f0864d01980 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55daed522400 con 0x55daed51e7a0 2024-09-13T06:09:59.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.795+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f085c00a4d0 con 0x55daed51e7a0 2024-09-13T06:09:59.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.795+0000 7f0864d01980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:59.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.795+0000 7f0864d01980 20 rados->read ofs=0 len=0 2024-09-13T06:09:59.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.795+0000 7f0864d01980 1 --2- 172.21.15.194:0/2731831681 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55daed523160 0x55daed525550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.795+0000 7f0864d01980 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55daed525bf0 con 0x55daed523160 2024-09-13T06:09:59.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.795+0000 7f0862811640 1 --2- 172.21.15.194:0/2731831681 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55daed523160 0x55daed525550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.795+0000 7f0862811640 1 --2- 172.21.15.194:0/2731831681 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55daed523160 0x55daed525550 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.795+0000 7f0862811640 1 -- 172.21.15.194:0/2731831681 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0854112030 con 0x55daed523160 2024-09-13T06:09:59.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.795+0000 7f0864d01980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:09:59.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.795+0000 7f0864d01980 20 searching for the correct realm 2024-09-13T06:09:59.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.795+0000 7f0864d01980 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55daed527450 con 0x55daed523160 2024-09-13T06:09:59.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.795+0000 7f0862811640 1 -- 172.21.15.194:0/2731831681 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0854112030 con 0x55daed523160 2024-09-13T06:09:59.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.795+0000 7f0862811640 1 --2- 172.21.15.194:0/2731831681 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f0854115060 0x7f0854002560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.795+0000 7f0862811640 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55daed527450 con 0x7f0854115060 2024-09-13T06:09:59.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.795+0000 7f085a010640 1 --2- 172.21.15.194:0/2731831681 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f0854115060 0x7f0854002560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.795+0000 7f085a010640 1 --2- 172.21.15.194:0/2731831681 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f0854115060 0x7f0854002560 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.795+0000 7f085a010640 1 -- 172.21.15.194:0/2731831681 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f084c037040 con 0x7f0854115060 2024-09-13T06:09:59.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.795+0000 7f085a010640 1 --2- 172.21.15.194:0/2731831681 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f084c01fbe0 0x7f084c03a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.795+0000 7f085a010640 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55daed527450 con 0x7f084c01fbe0 2024-09-13T06:09:59.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.795+0000 7f0863012640 1 --2- 172.21.15.194:0/2731831681 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f084c01fbe0 0x7f084c03a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.799+0000 7f0863012640 1 --2- 172.21.15.194:0/2731831681 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f084c01fbe0 0x7f084c03a3c0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.799+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f085c00a4d0 con 0x7f084c01fbe0 2024-09-13T06:09:59.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.799+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55daed522400 con 0x55daed51e7a0 2024-09-13T06:09:59.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.799+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f085c00a4d0 con 0x55daed51e7a0 2024-09-13T06:09:59.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.799+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55daed522400 con 0x55daed51e7a0 2024-09-13T06:09:59.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.799+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f085c00a4d0 con 0x55daed51e7a0 2024-09-13T06:09:59.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.799+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55daed522400 con 0x7f084c01fbe0 2024-09-13T06:09:59.808 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.799+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f085c00a4d0 con 0x7f084c01fbe0 2024-09-13T06:09:59.808 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.799+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55daed522400 con 0x7f084c01fbe0 2024-09-13T06:09:59.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.799+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f085c00a4d0 con 0x7f084c01fbe0 2024-09-13T06:09:59.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.799+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55daed522400 con 0x7f0854115060 2024-09-13T06:09:59.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.799+0000 7f085a010640 1 -- 172.21.15.194:0/2731831681 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f084c037040 con 0x7f0854115060 2024-09-13T06:09:59.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.799+0000 7f085a010640 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55daed522400 con 0x55daed523160 2024-09-13T06:09:59.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.799+0000 7f0862811640 1 -- 172.21.15.194:0/2731831681 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0854112030 con 0x55daed523160 2024-09-13T06:09:59.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.799+0000 7f0862811640 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55daed522400 con 0x55daed51e7a0 2024-09-13T06:09:59.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.799+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f085c00a4d0 con 0x55daed51e7a0 2024-09-13T06:09:59.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.799+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55daed522400 con 0x7f084c01fbe0 2024-09-13T06:09:59.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.799+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f085c00a4d0 con 0x7f084c01fbe0 2024-09-13T06:09:59.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.799+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55daed522400 con 0x55daed51e7a0 2024-09-13T06:09:59.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.799+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f085c00a4d0 con 0x55daed51e7a0 2024-09-13T06:09:59.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.799+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55daed522400 con 0x7f0854115060 2024-09-13T06:09:59.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.803+0000 7f085a010640 1 -- 172.21.15.194:0/2731831681 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f084c037040 con 0x7f0854115060 2024-09-13T06:09:59.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.803+0000 7f085a010640 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55daed522400 con 0x55daed523160 2024-09-13T06:09:59.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.803+0000 7f0862811640 1 -- 172.21.15.194:0/2731831681 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0854112030 con 0x55daed523160 2024-09-13T06:09:59.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.803+0000 7f0862811640 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55daed522400 con 0x55daed523160 2024-09-13T06:09:59.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.803+0000 7f0862811640 1 -- 172.21.15.194:0/2731831681 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0854112030 con 0x55daed523160 2024-09-13T06:09:59.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.803+0000 7f0862811640 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55daed522400 con 0x7f084c01fbe0 2024-09-13T06:09:59.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.803+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f085c00a4d0 con 0x7f084c01fbe0 2024-09-13T06:09:59.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.803+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55daed522400 con 0x55daed523160 2024-09-13T06:09:59.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.803+0000 7f0862811640 1 -- 172.21.15.194:0/2731831681 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0854112030 con 0x55daed523160 2024-09-13T06:09:59.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.803+0000 7f0862811640 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55daed522400 con 0x55daed523160 2024-09-13T06:09:59.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.803+0000 7f0862811640 1 -- 172.21.15.194:0/2731831681 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0854112030 con 0x55daed523160 2024-09-13T06:09:59.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.803+0000 7f0862811640 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55daed522400 con 0x55daed51e7a0 2024-09-13T06:09:59.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.803+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f085c00a4d0 con 0x55daed51e7a0 2024-09-13T06:09:59.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.803+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55daed522400 con 0x55daed51e7a0 2024-09-13T06:09:59.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.803+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f085c00a4d0 con 0x55daed51e7a0 2024-09-13T06:09:59.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.803+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55daed522400 con 0x7f084c01fbe0 2024-09-13T06:09:59.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.803+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f085c00a4d0 con 0x7f084c01fbe0 2024-09-13T06:09:59.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.803+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55daed522400 con 0x55daed523160 2024-09-13T06:09:59.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.803+0000 7f0862811640 1 -- 172.21.15.194:0/2731831681 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0854112030 con 0x55daed523160 2024-09-13T06:09:59.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.803+0000 7f0862811640 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55daed522400 con 0x7f0854115060 2024-09-13T06:09:59.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.803+0000 7f085a010640 1 -- 172.21.15.194:0/2731831681 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f084c037040 con 0x7f0854115060 2024-09-13T06:09:59.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.803+0000 7f085a010640 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55daed522400 con 0x55daed51e7a0 2024-09-13T06:09:59.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.803+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f085c00a4d0 con 0x55daed51e7a0 2024-09-13T06:09:59.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.803+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55daed522400 con 0x7f084c01fbe0 2024-09-13T06:09:59.812 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.807+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f085c00a4d0 con 0x7f084c01fbe0 2024-09-13T06:09:59.812 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.807+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55daed522400 con 0x55daed523160 2024-09-13T06:09:59.812 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.807+0000 7f0862811640 1 -- 172.21.15.194:0/2731831681 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0854112030 con 0x55daed523160 2024-09-13T06:09:59.812 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.807+0000 7f0862811640 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55daed522400 con 0x7f084c01fbe0 2024-09-13T06:09:59.812 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.807+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f085c00a4d0 con 0x7f084c01fbe0 2024-09-13T06:09:59.812 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.807+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55daed522400 con 0x7f0854115060 2024-09-13T06:09:59.812 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.807+0000 7f085a010640 1 -- 172.21.15.194:0/2731831681 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f084c037040 con 0x7f0854115060 2024-09-13T06:09:59.812 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.807+0000 7f085a010640 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55daed522400 con 0x55daed523160 2024-09-13T06:09:59.812 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.807+0000 7f0862811640 1 -- 172.21.15.194:0/2731831681 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0854112030 con 0x55daed523160 2024-09-13T06:09:59.812 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.807+0000 7f0862811640 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55daed522400 con 0x7f084c01fbe0 2024-09-13T06:09:59.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.807+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f085c00a4d0 con 0x7f084c01fbe0 2024-09-13T06:09:59.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.807+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55daed522400 con 0x55daed51e7a0 2024-09-13T06:09:59.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.807+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f085c00a4d0 con 0x55daed51e7a0 2024-09-13T06:09:59.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.807+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55daed522400 con 0x7f0854115060 2024-09-13T06:09:59.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.807+0000 7f085a010640 1 -- 172.21.15.194:0/2731831681 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f084c037040 con 0x7f0854115060 2024-09-13T06:09:59.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.807+0000 7f0864d01980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:09:59.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.807+0000 7f0864d01980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:09:59.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.807+0000 7f0864d01980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:09:59.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.807+0000 7f0864d01980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:09:59.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.807+0000 7f0864d01980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:09:59.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.807+0000 7f0864d01980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:09:59.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.807+0000 7f0864d01980 20 rados->read ofs=0 len=0 2024-09-13T06:09:59.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.807+0000 7f0864d01980 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55daed526570 con 0x55daed51e7a0 2024-09-13T06:09:59.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.807+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f085c00a4d0 con 0x55daed51e7a0 2024-09-13T06:09:59.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.807+0000 7f0864d01980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:59.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.807+0000 7f0864d01980 20 rados->read ofs=0 len=0 2024-09-13T06:09:59.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.807+0000 7f0864d01980 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55daed526dc0 con 0x55daed51e7a0 2024-09-13T06:09:59.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.807+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f085c00a4d0 con 0x55daed51e7a0 2024-09-13T06:09:59.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.811+0000 7f0864d01980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:59.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.811+0000 7f0864d01980 20 rados->read ofs=0 len=0 2024-09-13T06:09:59.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.811+0000 7f0864d01980 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55daed5261d0 con 0x7f0854115060 2024-09-13T06:09:59.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.811+0000 7f085a010640 1 -- 172.21.15.194:0/2731831681 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f084c037040 con 0x7f0854115060 2024-09-13T06:09:59.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.811+0000 7f0864d01980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:09:59.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.811+0000 7f0864d01980 20 zone default found 2024-09-13T06:09:59.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.811+0000 7f0864d01980 4 Realm: () 2024-09-13T06:09:59.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.811+0000 7f0864d01980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:09:59.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.811+0000 7f0864d01980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:09:59.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.811+0000 7f0864d01980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:09:59.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.811+0000 7f0864d01980 20 zonegroup default 2024-09-13T06:09:59.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.811+0000 7f0864d01980 20 rados->read ofs=0 len=0 2024-09-13T06:09:59.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.811+0000 7f0864d01980 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55daed527880 con 0x7f084c01fbe0 2024-09-13T06:09:59.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.811+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f085c00a4d0 con 0x7f084c01fbe0 2024-09-13T06:09:59.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.811+0000 7f0864d01980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:59.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.811+0000 7f0864d01980 20 rados->read ofs=0 len=0 2024-09-13T06:09:59.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.811+0000 7f0864d01980 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55daed5292f0 con 0x55daed523160 2024-09-13T06:09:59.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.811+0000 7f0862811640 1 -- 172.21.15.194:0/2731831681 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0854112030 con 0x55daed523160 2024-09-13T06:09:59.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.811+0000 7f0864d01980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:59.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.811+0000 7f0864d01980 20 rados->read ofs=0 len=0 2024-09-13T06:09:59.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.811+0000 7f0864d01980 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55daed5297e0 con 0x55daed523160 2024-09-13T06:09:59.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.811+0000 7f0862811640 1 -- 172.21.15.194:0/2731831681 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0854112030 con 0x55daed523160 2024-09-13T06:09:59.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.811+0000 7f0864d01980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:59.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.811+0000 7f0864d01980 20 started sync module instance, tier type = 2024-09-13T06:09:59.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.811+0000 7f0864d01980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:09:59.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.811+0000 7f0864d01980 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55daed528700 con 0x7f0854115060 2024-09-13T06:09:59.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.811+0000 7f085a010640 1 -- 172.21.15.194:0/2731831681 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(44 notify.0 [create] v33'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f084c037040 con 0x7f0854115060 2024-09-13T06:09:59.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.811+0000 7f0864d01980 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94398772841248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55daed528360 con 0x7f0854115060 2024-09-13T06:09:59.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.811+0000 7f0864d01980 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55daed52a710 con 0x55daed51e7a0 2024-09-13T06:09:59.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.811+0000 7f085a010640 1 -- 172.21.15.194:0/2731831681 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94398772841248] v33'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f084c037040 con 0x7f0854115060 2024-09-13T06:09:59.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.815+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v33'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f085c00a4d0 con 0x55daed51e7a0 2024-09-13T06:09:59.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.815+0000 7f0864d01980 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94398772847200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55daed52ab30 con 0x55daed51e7a0 2024-09-13T06:09:59.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.815+0000 7f0864d01980 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55daed52b3e0 con 0x55daed523160 2024-09-13T06:09:59.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.815+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94398772847200] v33'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f085c00a4d0 con 0x55daed51e7a0 2024-09-13T06:09:59.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.815+0000 7f0862811640 1 -- 172.21.15.194:0/2731831681 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v33'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0854112030 con 0x55daed523160 2024-09-13T06:09:59.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.815+0000 7f0864d01980 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94398772848528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55daed52b7d0 con 0x55daed523160 2024-09-13T06:09:59.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.815+0000 7f0864d01980 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55daed52c190 con 0x7f0854115060 2024-09-13T06:09:59.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.819+0000 7f085a010640 1 -- 172.21.15.194:0/2731831681 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(50 notify.3 [create] v33'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f084c037040 con 0x7f0854115060 2024-09-13T06:09:59.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.819+0000 7f0864d01980 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94398772853984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55daed52c9e0 con 0x7f0854115060 2024-09-13T06:09:59.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.819+0000 7f0864d01980 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55daed52d3e0 con 0x55daed51e7a0 2024-09-13T06:09:59.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.819+0000 7f0862811640 1 -- 172.21.15.194:0/2731831681 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94398772848528] v33'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0854112030 con 0x55daed523160 2024-09-13T06:09:59.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.819+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v33'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f085c00a4d0 con 0x55daed51e7a0 2024-09-13T06:09:59.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.819+0000 7f0864d01980 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94398772849648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55daed52d7d0 con 0x55daed51e7a0 2024-09-13T06:09:59.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.819+0000 7f0864d01980 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55daed52e190 con 0x7f084c01fbe0 2024-09-13T06:09:59.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.819+0000 7f085a010640 1 -- 172.21.15.194:0/2731831681 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94398772853984] v33'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f084c037040 con 0x7f0854115060 2024-09-13T06:09:59.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.823+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94398772849648] v33'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f085c00a4d0 con 0x55daed51e7a0 2024-09-13T06:09:59.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.823+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(54 notify.5 [create] v33'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f085c00a4d0 con 0x7f084c01fbe0 2024-09-13T06:09:59.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.823+0000 7f0864d01980 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94398772858608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55daed52dce0 con 0x7f084c01fbe0 2024-09-13T06:09:59.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.823+0000 7f0864d01980 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55daed52ea30 con 0x7f084c01fbe0 2024-09-13T06:09:59.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.823+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(56 notify.6 [create] v33'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f085c00a4d0 con 0x7f084c01fbe0 2024-09-13T06:09:59.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.823+0000 7f0864d01980 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94398772864384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55daed52dce0 con 0x7f084c01fbe0 2024-09-13T06:09:59.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.823+0000 7f0864d01980 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55daed52f4f0 con 0x7f084c01fbe0 2024-09-13T06:09:59.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.823+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94398772858608] v33'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f085c00a4d0 con 0x7f084c01fbe0 2024-09-13T06:09:59.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.827+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94398772864384] v33'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f085c00a4d0 con 0x7f084c01fbe0 2024-09-13T06:09:59.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.827+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(58 notify.7 [create] v33'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f085c00a4d0 con 0x7f084c01fbe0 2024-09-13T06:09:59.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.827+0000 7f0864d01980 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94398772865440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55daed52c530 con 0x7f084c01fbe0 2024-09-13T06:09:59.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.827+0000 7f0864d01980 20 add_watcher() i=0 2024-09-13T06:09:59.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.827+0000 7f0864d01980 20 add_watcher() i=1 2024-09-13T06:09:59.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.827+0000 7f0864d01980 20 add_watcher() i=2 2024-09-13T06:09:59.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.827+0000 7f0864d01980 20 add_watcher() i=3 2024-09-13T06:09:59.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.827+0000 7f0864d01980 20 add_watcher() i=4 2024-09-13T06:09:59.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.827+0000 7f0864d01980 20 add_watcher() i=5 2024-09-13T06:09:59.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.827+0000 7f0864d01980 20 add_watcher() i=6 2024-09-13T06:09:59.829 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.827+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94398772865440] v33'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f085c00a4d0 con 0x7f084c01fbe0 2024-09-13T06:09:59.829 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.827+0000 7f0864d01980 20 add_watcher() i=7 2024-09-13T06:09:59.829 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.827+0000 7f0864d01980 2 all 8 watchers are set, enabling cache 2024-09-13T06:09:59.829 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.827+0000 7f0864d01980 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55daed5324e0 con 0x55daed51e7a0 2024-09-13T06:09:59.829 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.827+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f085c00a4d0 con 0x55daed51e7a0 2024-09-13T06:09:59.830 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.827+0000 7f0864d01980 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94398772867008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55daed52f960 con 0x55daed51e7a0 2024-09-13T06:09:59.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.831+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94398772867008] v33'119 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f085c00a4d0 con 0x55daed51e7a0 2024-09-13T06:09:59.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.831+0000 7f07197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:59.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.831+0000 7f0864d01980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:09:59.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.831+0000 7f0864d01980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:09:59.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.831+0000 7f0864d01980 5 note: GC not initialized 2024-09-13T06:09:59.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.831+0000 7f0693fff640 20 reqs_thread_entry: start 2024-09-13T06:09:59.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.831+0000 7f0864d01980 20 init_complete bucket index max shards: 11 2024-09-13T06:09:59.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.831+0000 7f0864d01980 20 Filter name: none 2024-09-13T06:09:59.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.831+0000 7f0691ffb640 20 reqs_thread_entry: start 2024-09-13T06:09:59.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.831+0000 7f0864d01980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T06:09:59.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.831+0000 7f0864d01980 20 rados->read ofs=0 len=0 2024-09-13T06:09:59.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.831+0000 7f0864d01980 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55daed555a60 con 0x55daed51e7a0 2024-09-13T06:09:59.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.831+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f085c00a4d0 con 0x55daed51e7a0 2024-09-13T06:09:59.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.831+0000 7f0864d01980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T06:09:59.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.831+0000 7f0864d01980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T06:09:59.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.831+0000 7f0864d01980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:09:59.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.831+0000 7f0864d01980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:09:59.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.831+0000 7f0864d01980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T06:09:59.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.831+0000 7f0864d01980 20 rados->read ofs=0 len=0 2024-09-13T06:09:59.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.831+0000 7f0864d01980 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55daed557b40 con 0x7f0854115060 2024-09-13T06:09:59.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.831+0000 7f085a010640 1 -- 172.21.15.194:0/2731831681 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv21 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f084c037040 con 0x7f0854115060 2024-09-13T06:09:59.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.831+0000 7f0864d01980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T06:09:59.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.831+0000 7f0864d01980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T06:09:59.835 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.831+0000 7f0864d01980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T06:09:59.835 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.831+0000 7f0864d01980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 : miss 2024-09-13T06:09:59.835 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.831+0000 7f0864d01980 20 rados->read ofs=0 len=0 2024-09-13T06:09:59.835 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.831+0000 7f0864d01980 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:64 8.18 8:1a66c368:root::.bucket.meta.myfoo%3a52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55daed5593e0 con 0x55daed51e7a0 2024-09-13T06:09:59.835 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.831+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(64 .bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv13 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f085c00a4d0 con 0x55daed51e7a0 2024-09-13T06:09:59.835 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.831+0000 7f0864d01980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T06:09:59.835 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.831+0000 7f0864d01980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 info.flags=0x17 2024-09-13T06:09:59.835 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.831+0000 7f0864d01980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 to cache LRU end 2024-09-13T06:09:59.835 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.831+0000 7f0864d01980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:09:59.835 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.831+0000 7f0864d01980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T06:09:59.835 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.831+0000 7f0864d01980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 2024-09-13T06:09:59.835 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.831+0000 7f0864d01980 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-13T06:09:59.836 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.831+0000 7f0864d01980 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55daed55d9e0 con 0x7f084c01fbe0 2024-09-13T06:09:59.836 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.835+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(65 fud.buckets [call] v33'7 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f085c00a4d0 con 0x7f084c01fbe0 2024-09-13T06:09:59.836 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.835+0000 7f0864d01980 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:66 8.18 8:1a66c368:root::.bucket.meta.myfoo%3a52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55daed5638e0 con 0x55daed51e7a0 2024-09-13T06:09:59.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.835+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(66 .bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v33'14 uv14 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f085c00a4d0 con 0x55daed51e7a0 2024-09-13T06:09:59.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.835+0000 7f0864d01980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 info.flags=0x17 2024-09-13T06:09:59.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.835+0000 7f0864d01980 10 moving default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 to cache LRU end 2024-09-13T06:09:59.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.835+0000 7f0864d01980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T06:09:59.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.835+0000 7f0864d01980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1, ofs0, ns] 2024-09-13T06:09:59.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.835+0000 7f0864d01980 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:67 7.9 7:93e5b521:::notify.7:head [notify cookie 94398773038256 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55daed55de10 con 0x7f084c01fbe0 2024-09-13T06:09:59.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.835+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== watch-notify(notify (1) cookie 94398772865440 notify 141733920775 ret 0) ==== 794+0+0 (crc 0 0 0) 0x55daed5597d0 con 0x7f084c01fbe0 2024-09-13T06:09:59.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.835+0000 7f07467fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920775 cookie 94398772865440 notifier 4521 bl.length()=752 2024-09-13T06:09:59.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.835+0000 7f07467fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 info.flags=0x17 2024-09-13T06:09:59.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.835+0000 7f07467fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 to cache LRU end 2024-09-13T06:09:59.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.835+0000 7f07467fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T06:09:59.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.835+0000 7f07467fc640 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:68 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f0728003eb0 con 0x7f084c01fbe0 2024-09-13T06:09:59.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.835+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(67 notify.7 [notify cookie 94398773038256 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f085c00a4d0 con 0x7f084c01fbe0 2024-09-13T06:09:59.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.835+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 <== osd.0 v2:172.21.15.120:6800/1923744619 20 ==== osd_op_reply(68 notify.7 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f085c00a4d0 con 0x7f084c01fbe0 2024-09-13T06:09:59.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.835+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 <== osd.0 v2:172.21.15.120:6800/1923744619 21 ==== watch-notify(notify_complete (2) cookie 94398773038256 notify 141733920775 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55daed558950 con 0x7f084c01fbe0 2024-09-13T06:09:59.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.835+0000 7f0864d01980 20 handle_bi_update(): bucket=:myfoo[52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1]): orig_sources= new_sources= 2024-09-13T06:09:59.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.835+0000 7f0864d01980 20 handle_bi_update(): bucket=:myfoo[52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1]): potential sources added=[] removed=[] 2024-09-13T06:09:59.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.835+0000 7f0864d01980 20 handle_bi_update(): bucket=:myfoo[52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1]): orig_dests= new_dests= 2024-09-13T06:09:59.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.835+0000 7f0864d01980 20 handle_bi_update(): bucket=:myfoo[52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1]): potential dests added=[] removed=[] 2024-09-13T06:09:59.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.835+0000 7f0864d01980 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55daed558cb0 con 0x7f0854115060 2024-09-13T06:09:59.840 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.839+0000 7f085a010640 1 -- 172.21.15.194:0/2731831681 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(69 foo.buckets [call] v33'22 uv22 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f084c037040 con 0x7f0854115060 2024-09-13T06:09:59.840 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.839+0000 7f0864d01980 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55daed558cb0 con 0x7f0854115060 2024-09-13T06:09:59.842 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.843+0000 7f085a010640 1 -- 172.21.15.194:0/2731831681 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v33'23 uv23 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f084c037040 con 0x7f0854115060 2024-09-13T06:09:59.842 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.843+0000 7f0864d01980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-13T06:09:59.842 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.843+0000 7f0864d01980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T06:09:59.843 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.843+0000 7f0864d01980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-13T06:09:59.843 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.843+0000 7f0864d01980 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94398773038256 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55daed5625b0 con 0x7f084c01fbe0 2024-09-13T06:09:59.843 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.843+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 <== osd.0 v2:172.21.15.120:6800/1923744619 22 ==== watch-notify(notify (1) cookie 94398772864384 notify 141733920776 ret 0) ==== 356+0+0 (crc 0 0 0) 0x7f085c02d040 con 0x7f084c01fbe0 2024-09-13T06:09:59.843 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.843+0000 7f0745ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920776 cookie 94398772864384 notifier 4521 bl.length()=314 2024-09-13T06:09:59.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.843+0000 7f0745ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-13T06:09:59.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.843+0000 7f0745ffb640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T06:09:59.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.843+0000 7f0745ffb640 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f0698003410 con 0x7f084c01fbe0 2024-09-13T06:09:59.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.843+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 <== osd.0 v2:172.21.15.120:6800/1923744619 23 ==== osd_op_reply(71 notify.6 [notify cookie 94398773038256 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f085c00a4d0 con 0x7f084c01fbe0 2024-09-13T06:09:59.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.843+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 <== osd.0 v2:172.21.15.120:6800/1923744619 24 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f085c00a4d0 con 0x7f084c01fbe0 2024-09-13T06:09:59.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.843+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 <== osd.0 v2:172.21.15.120:6800/1923744619 25 ==== watch-notify(notify_complete (2) cookie 94398773038256 notify 141733920776 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f085c01e040 con 0x7f084c01fbe0 2024-09-13T06:09:59.845 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.843+0000 7f07197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:09:59.845 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.843+0000 7f0864d01980 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94398772867008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55daed553890 con 0x55daed51e7a0 2024-09-13T06:09:59.846 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.843+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94398772867008] v33'120 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f085c00a4d0 con 0x55daed51e7a0 2024-09-13T06:09:59.846 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.843+0000 7f0864d01980 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94398772841248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55daed52efc0 con 0x7f0854115060 2024-09-13T06:09:59.847 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.847+0000 7f085a010640 1 -- 172.21.15.194:0/2731831681 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94398772841248] v33'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f084c037040 con 0x7f0854115060 2024-09-13T06:09:59.847 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.847+0000 7f0864d01980 20 remove_watcher() i=0 2024-09-13T06:09:59.847 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.847+0000 7f0864d01980 2 removed watcher, disabling cache 2024-09-13T06:09:59.847 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.847+0000 7f0864d01980 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94398772847200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55daed528b20 con 0x55daed51e7a0 2024-09-13T06:09:59.849 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.847+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 <== osd.1 v2:172.21.15.194:6808/3135444559 25 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94398772847200] v33'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f085c00a4d0 con 0x55daed51e7a0 2024-09-13T06:09:59.849 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.847+0000 7f0864d01980 20 remove_watcher() i=1 2024-09-13T06:09:59.849 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.847+0000 7f0864d01980 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94398772848528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55daed52efc0 con 0x55daed523160 2024-09-13T06:09:59.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.851+0000 7f0862811640 1 -- 172.21.15.194:0/2731831681 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94398772848528] v33'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0854112030 con 0x55daed523160 2024-09-13T06:09:59.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.851+0000 7f0864d01980 20 remove_watcher() i=2 2024-09-13T06:09:59.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.851+0000 7f0864d01980 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94398772853984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55daed52a260 con 0x7f0854115060 2024-09-13T06:09:59.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.851+0000 7f085a010640 1 -- 172.21.15.194:0/2731831681 <== osd.2 v2:172.21.15.194:6800/815615585 16 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94398772853984] v33'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f084c037040 con 0x7f0854115060 2024-09-13T06:09:59.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.851+0000 7f0864d01980 20 remove_watcher() i=3 2024-09-13T06:09:59.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.851+0000 7f0864d01980 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94398772849648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55daed528b20 con 0x55daed51e7a0 2024-09-13T06:09:59.854 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.851+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 <== osd.1 v2:172.21.15.194:6808/3135444559 26 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94398772849648] v33'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f085c00a4d0 con 0x55daed51e7a0 2024-09-13T06:09:59.854 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.851+0000 7f0864d01980 20 remove_watcher() i=4 2024-09-13T06:09:59.854 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.851+0000 7f0864d01980 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94398772858608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55daed52efc0 con 0x7f084c01fbe0 2024-09-13T06:09:59.856 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.855+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 <== osd.0 v2:172.21.15.120:6800/1923744619 26 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94398772858608] v33'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f085c00a4d0 con 0x7f084c01fbe0 2024-09-13T06:09:59.856 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.855+0000 7f0864d01980 20 remove_watcher() i=5 2024-09-13T06:09:59.856 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.855+0000 7f0864d01980 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94398772864384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55daed52a260 con 0x7f084c01fbe0 2024-09-13T06:09:59.857 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.855+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 <== osd.0 v2:172.21.15.120:6800/1923744619 27 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94398772864384] v33'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f085c00a4d0 con 0x7f084c01fbe0 2024-09-13T06:09:59.857 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.855+0000 7f0864d01980 20 remove_watcher() i=6 2024-09-13T06:09:59.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.855+0000 7f0864d01980 1 -- 172.21.15.194:0/2731831681 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94398772865440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55daed528b20 con 0x7f084c01fbe0 2024-09-13T06:09:59.861 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.859+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 <== osd.0 v2:172.21.15.120:6800/1923744619 28 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94398772865440] v33'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f085c00a4d0 con 0x7f084c01fbe0 2024-09-13T06:09:59.861 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.859+0000 7f0864d01980 20 remove_watcher() i=7 2024-09-13T06:09:59.861 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.859+0000 7f0864d01980 1 -- 172.21.15.194:0/2731831681 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f084c01fbe0 msgr2=0x7f084c03a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.861 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.859+0000 7f0864d01980 1 --2- 172.21.15.194:0/2731831681 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f084c01fbe0 0x7f084c03a3c0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.861 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.859+0000 7f0864d01980 1 -- 172.21.15.194:0/2731831681 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55daed51e7a0 msgr2=0x55daed520c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.859+0000 7f0864d01980 1 --2- 172.21.15.194:0/2731831681 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55daed51e7a0 0x55daed520c60 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.859+0000 7f0864d01980 1 -- 172.21.15.194:0/2731831681 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f0854115060 msgr2=0x7f0854002560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.859+0000 7f0864d01980 1 --2- 172.21.15.194:0/2731831681 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f0854115060 0x7f0854002560 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.859+0000 7f0864d01980 1 -- 172.21.15.194:0/2731831681 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55daed523160 msgr2=0x55daed525550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.859+0000 7f0864d01980 1 --2- 172.21.15.194:0/2731831681 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55daed523160 0x55daed525550 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.859+0000 7f0864d01980 1 -- 172.21.15.194:0/2731831681 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f072c034650 msgr2=0x7f072c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.859+0000 7f0864d01980 1 --2- 172.21.15.194:0/2731831681 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f072c034650 0x7f072c036b10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f084c00c010 tx=0x7f084c010000 comp rx=0 tx=0).stop 2024-09-13T06:09:59.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.859+0000 7f0864d01980 1 -- 172.21.15.194:0/2731831681 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55daed50a4e0 msgr2=0x55daed3644b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.859+0000 7f0864d01980 1 --2- 172.21.15.194:0/2731831681 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55daed50a4e0 0x55daed3644b0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f08540b5d60 tx=0x7f08540a9fa0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.859+0000 7f0863012640 1 -- 172.21.15.194:0/2731831681 reap_dead start 2024-09-13T06:09:59.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.859+0000 7f0864d01980 1 -- 172.21.15.194:0/2731831681 shutdown_connections 2024-09-13T06:09:59.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.859+0000 7f0864d01980 1 --2- 172.21.15.194:0/2731831681 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55daed50a4e0 0x55daed3644b0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.863 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.859+0000 7f0864d01980 1 -- 172.21.15.194:0/2731831681 >> 172.21.15.194:0/2731831681 conn(0x55daed5068c0 msgr2=0x55daed504990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:59.863 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.859+0000 7f0864d01980 1 -- 172.21.15.194:0/2731831681 shutdown_connections 2024-09-13T06:09:59.863 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.859+0000 7f0864d01980 1 -- 172.21.15.194:0/2731831681 wait complete. 2024-09-13T06:09:59.863 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.859+0000 7f0864d01980 1 -- 172.21.15.194:0/529398800 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f073c034650 msgr2=0x7f073c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.863 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.859+0000 7f0864d01980 1 --2- 172.21.15.194:0/529398800 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f073c034650 0x7f073c036b10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x55daed4e7830 tx=0x7f084c00f000 comp rx=0 tx=0).stop 2024-09-13T06:09:59.863 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.859+0000 7f0864d01980 1 -- 172.21.15.194:0/529398800 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55daed4fdbf0 msgr2=0x55daed4fe010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.863 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.859+0000 7f0864d01980 1 --2- 172.21.15.194:0/529398800 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55daed4fdbf0 0x55daed4fe010 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f08540cf900 tx=0x7f08540e3ed0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.863 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.859+0000 7f0864d01980 1 -- 172.21.15.194:0/529398800 shutdown_connections 2024-09-13T06:09:59.863 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.859+0000 7f0864d01980 1 --2- 172.21.15.194:0/529398800 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f073c034650 0x7f073c036b10 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.863 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.859+0000 7f0864d01980 1 --2- 172.21.15.194:0/529398800 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55daed4fdbf0 0x55daed4fe010 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.863 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.859+0000 7f0864d01980 1 -- 172.21.15.194:0/529398800 >> 172.21.15.194:0/529398800 conn(0x55daed4f2d40 msgr2=0x55daed4f57c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:59.863 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.859+0000 7f0864d01980 1 -- 172.21.15.194:0/529398800 shutdown_connections 2024-09-13T06:09:59.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.859+0000 7f0864d01980 1 -- 172.21.15.194:0/529398800 wait complete. 2024-09-13T06:09:59.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.859+0000 7f0864d01980 1 -- 172.21.15.194:0/3873160459 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55daed3edf80 msgr2=0x55daed4e6cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.859+0000 7f0864d01980 1 --2- 172.21.15.194:0/3873160459 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55daed3edf80 0x55daed4e6cf0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.859+0000 7f0864d01980 1 -- 172.21.15.194:0/3873160459 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55daed4ed5f0 msgr2=0x55daed4ef9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.859+0000 7f0864d01980 1 --2- 172.21.15.194:0/3873160459 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55daed4ed5f0 0x55daed4ef9e0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.859+0000 7f0864d01980 1 -- 172.21.15.194:0/3873160459 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55daed4e96b0 msgr2=0x55daed4ebaa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.859+0000 7f0864d01980 1 --2- 172.21.15.194:0/3873160459 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55daed4e96b0 0x55daed4ebaa0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.859+0000 7f0864d01980 1 -- 172.21.15.194:0/3873160459 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0748034650 msgr2=0x7f0748036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.859+0000 7f0864d01980 1 --2- 172.21.15.194:0/3873160459 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0748034650 0x7f0748036b10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f084c000f70 tx=0x7f084c001380 comp rx=0 tx=0).stop 2024-09-13T06:09:59.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.859+0000 7f0864d01980 1 -- 172.21.15.194:0/3873160459 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55daed3ed630 msgr2=0x55daed4dfd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.859+0000 7f0864d01980 1 --2- 172.21.15.194:0/3873160459 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55daed3ed630 0x55daed4dfd20 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f08540199f0 tx=0x7f08540180e0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.859+0000 7f0863012640 1 -- 172.21.15.194:0/3873160459 reap_dead start 2024-09-13T06:09:59.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.859+0000 7f0864d01980 1 -- 172.21.15.194:0/3873160459 shutdown_connections 2024-09-13T06:09:59.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.859+0000 7f0864d01980 1 -- 172.21.15.194:0/3873160459 >> 172.21.15.194:0/3873160459 conn(0x55daed3e9150 msgr2=0x55daed4d3250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:59.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.859+0000 7f0864d01980 1 -- 172.21.15.194:0/3873160459 shutdown_connections 2024-09-13T06:09:59.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.859+0000 7f0864d01980 1 -- 172.21.15.194:0/3873160459 wait complete. 2024-09-13T06:09:59.870 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-13T06:09:59.870 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-13T06:09:59.870 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-13T06:09:59.948 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:09:59.949 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:09:59.949 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.947+0000 7fef16b28980 1 Processor -- start 2024-09-13T06:09:59.950 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.947+0000 7fef16b28980 1 -- start start 2024-09-13T06:09:59.950 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.947+0000 7fef16b28980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x5636c2534b00 0x5636c25c3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.950 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.947+0000 7fef16b28980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5636c2448ae0 con 0x5636c25c3870 2024-09-13T06:09:59.950 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.947+0000 7fef16b28980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x5636c246ce30 con 0x5636c2534b00 2024-09-13T06:09:59.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.947+0000 7fef14638640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x5636c2534b00 0x5636c25c3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.947+0000 7fef14638640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x5636c2534b00 0x5636c25c3330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45890/0 (socket says 172.21.15.194:45890) 2024-09-13T06:09:59.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.947+0000 7fef13e37640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x5636c25c3870 0x5636c25c5c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:51230/0 (socket says 172.21.15.194:51230) 2024-09-13T06:09:59.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.947+0000 7fef14638640 1 -- 172.21.15.194:0/2475753122 learned_addr learned my addr 172.21.15.194:0/2475753122 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:59.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.951+0000 7fef14638640 1 -- 172.21.15.194:0/2475753122 >> v1:172.21.15.120:6789/0 conn(0x5636c25c3870 legacy=0x5636c25c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.951+0000 7fef14638640 1 -- 172.21.15.194:0/2475753122 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636c25c8390 con 0x5636c2534b00 2024-09-13T06:09:59.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.951+0000 7fef13636640 1 -- 172.21.15.194:0/2475753122 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3886261586 0 0) 0x5636c2448ae0 con 0x5636c25c3870 2024-09-13T06:09:59.953 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.951+0000 7fef14638640 1 --2- 172.21.15.194:0/2475753122 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636c2534b00 0x5636c25c3330 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fef0400a5c0 tx=0x7fef0401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19b10f8e8824c6b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.953 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.951+0000 7fef13636640 1 -- 172.21.15.194:0/2475753122 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef040a6070 con 0x5636c2534b00 2024-09-13T06:09:59.953 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.951+0000 7fef13636640 1 -- 172.21.15.194:0/2475753122 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef040af070 con 0x5636c2534b00 2024-09-13T06:09:59.953 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.951+0000 7fef13636640 1 -- 172.21.15.194:0/2475753122 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef040aa5c0 con 0x5636c2534b00 2024-09-13T06:09:59.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.951+0000 7fef16b28980 1 -- 172.21.15.194:0/2475753122 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636c2534b00 msgr2=0x5636c25c3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.951+0000 7fef16b28980 1 --2- 172.21.15.194:0/2475753122 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636c2534b00 0x5636c25c3330 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fef0400a5c0 tx=0x7fef0401b340 comp rx=0 tx=0).stop 2024-09-13T06:09:59.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.951+0000 7fef16b28980 1 -- 172.21.15.194:0/2475753122 shutdown_connections 2024-09-13T06:09:59.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.951+0000 7fef16b28980 1 --2- 172.21.15.194:0/2475753122 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636c2534b00 0x5636c25c3330 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.951+0000 7fef16b28980 1 -- 172.21.15.194:0/2475753122 >> 172.21.15.194:0/2475753122 conn(0x5636c25bb060 msgr2=0x5636c25bd480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:59.955 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.955+0000 7fef16b28980 1 -- 172.21.15.194:0/2475753122 shutdown_connections 2024-09-13T06:09:59.955 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.955+0000 7fef16b28980 1 -- 172.21.15.194:0/2475753122 wait complete. 2024-09-13T06:09:59.968 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.967+0000 7fef16b28980 1 Processor -- start 2024-09-13T06:09:59.968 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.967+0000 7fef16b28980 1 -- start start 2024-09-13T06:09:59.968 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.967+0000 7fef16b28980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636c2534b00 0x5636c25c0a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.968 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.967+0000 7fef16b28980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5636c246e200 con 0x5636c2534b00 2024-09-13T06:09:59.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.967+0000 7fef14638640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636c2534b00 0x5636c25c0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.967+0000 7fef14638640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636c2534b00 0x5636c25c0a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45898/0 (socket says 172.21.15.194:45898) 2024-09-13T06:09:59.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.967+0000 7fef14638640 1 -- 172.21.15.194:0/337913942 learned_addr learned my addr 172.21.15.194:0/337913942 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:59.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.967+0000 7fef14638640 1 -- 172.21.15.194:0/337913942 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636c25c1060 con 0x5636c2534b00 2024-09-13T06:09:59.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.967+0000 7fef14638640 1 --2- 172.21.15.194:0/337913942 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636c2534b00 0x5636c25c0a90 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fef0400a5c0 tx=0x7fef04003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a08e095097d594a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.967+0000 7fee0260c640 1 -- 172.21.15.194:0/337913942 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef040aa9b0 con 0x5636c2534b00 2024-09-13T06:09:59.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.967+0000 7fee0260c640 1 -- 172.21.15.194:0/337913942 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef040aab50 con 0x5636c2534b00 2024-09-13T06:09:59.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.967+0000 7fee0260c640 1 -- 172.21.15.194:0/337913942 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef040aae50 con 0x5636c2534b00 2024-09-13T06:09:59.971 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.971+0000 7fef16b28980 1 -- 172.21.15.194:0/337913942 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636c2534b00 msgr2=0x5636c25c0a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.971 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.971+0000 7fef16b28980 1 --2- 172.21.15.194:0/337913942 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636c2534b00 0x5636c25c0a90 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fef0400a5c0 tx=0x7fef04003030 comp rx=0 tx=0).stop 2024-09-13T06:09:59.971 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.971+0000 7fef16b28980 1 -- 172.21.15.194:0/337913942 shutdown_connections 2024-09-13T06:09:59.972 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.971+0000 7fef16b28980 1 --2- 172.21.15.194:0/337913942 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636c2534b00 0x5636c25c0a90 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.972 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.971+0000 7fef16b28980 1 -- 172.21.15.194:0/337913942 >> 172.21.15.194:0/337913942 conn(0x5636c25bb060 msgr2=0x5636c26a7460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:59.972 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.971+0000 7fef16b28980 1 -- 172.21.15.194:0/337913942 shutdown_connections 2024-09-13T06:09:59.972 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.971+0000 7fef16b28980 1 -- 172.21.15.194:0/337913942 wait complete. 2024-09-13T06:09:59.972 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.971+0000 7fef16b28980 1 Processor -- start 2024-09-13T06:09:59.972 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.971+0000 7fef16b28980 1 -- start start 2024-09-13T06:09:59.972 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.971+0000 7fef16b28980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636c2534b00 0x5636c26b4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.972 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.971+0000 7fef16b28980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5636c25c7e30 con 0x5636c2534b00 2024-09-13T06:09:59.972 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.971+0000 7fef14638640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636c2534b00 0x5636c26b4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.972 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.971+0000 7fef14638640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636c2534b00 0x5636c26b4c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45902/0 (socket says 172.21.15.194:45902) 2024-09-13T06:09:59.972 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.971+0000 7fef14638640 1 -- 172.21.15.194:0/1042542835 learned_addr learned my addr 172.21.15.194:0/1042542835 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:59.973 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.971+0000 7fef14638640 1 -- 172.21.15.194:0/1042542835 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636c26b51d0 con 0x5636c2534b00 2024-09-13T06:09:59.973 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.971+0000 7fef14638640 1 --2- 172.21.15.194:0/1042542835 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636c2534b00 0x5636c26b4c90 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fef0401bbe0 tx=0x7fef040180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.973 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.971+0000 7fee00e09640 1 -- 172.21.15.194:0/1042542835 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef040c6750 con 0x5636c2534b00 2024-09-13T06:09:59.973 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.971+0000 7fee00e09640 1 -- 172.21.15.194:0/1042542835 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef040c68f0 con 0x5636c2534b00 2024-09-13T06:09:59.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.971+0000 7fee00e09640 1 -- 172.21.15.194:0/1042542835 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef040c6c10 con 0x5636c2534b00 2024-09-13T06:09:59.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.971+0000 7fef16b28980 1 -- 172.21.15.194:0/1042542835 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5636c26b5460 con 0x5636c2534b00 2024-09-13T06:09:59.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.971+0000 7fef16b28980 1 -- 172.21.15.194:0/1042542835 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636c26b8140 con 0x5636c2534b00 2024-09-13T06:09:59.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.971+0000 7fee00e09640 1 -- 172.21.15.194:0/1042542835 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fef040ce020 con 0x5636c2534b00 2024-09-13T06:09:59.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.971+0000 7fee00e09640 1 --2- 172.21.15.194:0/1042542835 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fedfc034650 0x7fedfc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.971+0000 7fee00e09640 1 -- 172.21.15.194:0/1042542835 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fef040cc020 con 0x5636c2534b00 2024-09-13T06:09:59.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.971+0000 7fef13e37640 1 --2- 172.21.15.194:0/1042542835 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fedfc034650 0x7fedfc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.975+0000 7fef16b28980 1 --2- 172.21.15.194:0/1042542835 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5636c25c3870 0x5636c26bbc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.975+0000 7fef16b28980 1 -- 172.21.15.194:0/1042542835 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5636c26bc2d0 con 0x5636c25c3870 2024-09-13T06:09:59.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.975+0000 7fef14e39640 1 --2- 172.21.15.194:0/1042542835 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5636c25c3870 0x5636c26bbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.975+0000 7fef13e37640 1 --2- 172.21.15.194:0/1042542835 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fedfc034650 0x7fedfc036b10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fef08000c10 tx=0x7fef080013c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.975+0000 7fef14e39640 1 --2- 172.21.15.194:0/1042542835 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5636c25c3870 0x5636c26bbc60 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.975+0000 7fef14e39640 1 -- 172.21.15.194:0/1042542835 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fef0c00a4d0 con 0x5636c25c3870 2024-09-13T06:09:59.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.975+0000 7fef16b28980 1 -- 172.21.15.194:0/1042542835 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5636c26b9320 con 0x5636c25c3870 2024-09-13T06:09:59.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.975+0000 7fef14e39640 1 -- 172.21.15.194:0/1042542835 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fef0c00a4d0 con 0x5636c25c3870 2024-09-13T06:09:59.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.975+0000 7fef16b28980 1 --2- 172.21.15.194:0/1042542835 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5636c26be600 0x5636c26c09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.975+0000 7fef16b28980 1 -- 172.21.15.194:0/1042542835 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5636c26c1090 con 0x5636c26be600 2024-09-13T06:09:59.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.975+0000 7fef14638640 1 --2- 172.21.15.194:0/1042542835 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5636c26be600 0x5636c26c09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.975+0000 7fef14638640 1 --2- 172.21.15.194:0/1042542835 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5636c26be600 0x5636c26c09f0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.975+0000 7fef14638640 1 -- 172.21.15.194:0/1042542835 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fef040e5050 con 0x5636c26be600 2024-09-13T06:09:59.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.975+0000 7fef16b28980 1 -- 172.21.15.194:0/1042542835 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5636c26bd4a0 con 0x5636c25c3870 2024-09-13T06:09:59.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.975+0000 7fef14e39640 1 -- 172.21.15.194:0/1042542835 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fef0c00a4d0 con 0x5636c25c3870 2024-09-13T06:09:59.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.975+0000 7fef16b28980 1 --2- 172.21.15.194:0/1042542835 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5636c26c24f0 0x5636c26c48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.975+0000 7fef16b28980 1 -- 172.21.15.194:0/1042542835 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5636c26c4fe0 con 0x5636c26c24f0 2024-09-13T06:09:59.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.975+0000 7fef13e37640 1 --2- 172.21.15.194:0/1042542835 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5636c26c24f0 0x5636c26c48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.975+0000 7fef13e37640 1 --2- 172.21.15.194:0/1042542835 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5636c26c24f0 0x5636c26c48e0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.975+0000 7fef13e37640 1 -- 172.21.15.194:0/1042542835 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fef0800f680 con 0x5636c26c24f0 2024-09-13T06:09:59.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.975+0000 7fef16b28980 1 Processor -- start 2024-09-13T06:09:59.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.975+0000 7fef16b28980 1 -- start start 2024-09-13T06:09:59.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.975+0000 7fef16b28980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636c26d2ab0 0x5636c26d2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.975+0000 7fef16b28980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5636c24c7800 con 0x5636c26d2ab0 2024-09-13T06:09:59.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.975+0000 7fef14638640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636c26d2ab0 0x5636c26d2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.975+0000 7fef14638640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636c26d2ab0 0x5636c26d2ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45908/0 (socket says 172.21.15.194:45908) 2024-09-13T06:09:59.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.975+0000 7fef14638640 1 -- 172.21.15.194:0/1021090674 learned_addr learned my addr 172.21.15.194:0/1021090674 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:59.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.979+0000 7fef14638640 1 -- 172.21.15.194:0/1021090674 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636c26d3410 con 0x5636c26d2ab0 2024-09-13T06:09:59.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.979+0000 7fef14638640 1 --2- 172.21.15.194:0/1021090674 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636c26d2ab0 0x5636c26d2ed0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fef040cf900 tx=0x7fef040bcdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.979+0000 7fedf9ffb640 1 -- 172.21.15.194:0/1021090674 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef040d0e60 con 0x5636c26d2ab0 2024-09-13T06:09:59.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.979+0000 7fedf9ffb640 1 -- 172.21.15.194:0/1021090674 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef040e33d0 con 0x5636c26d2ab0 2024-09-13T06:09:59.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.979+0000 7fedf9ffb640 1 -- 172.21.15.194:0/1021090674 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef040d05f0 con 0x5636c26d2ab0 2024-09-13T06:09:59.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.979+0000 7fef16b28980 1 -- 172.21.15.194:0/1021090674 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5636c26d36a0 con 0x5636c26d2ab0 2024-09-13T06:09:59.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.979+0000 7fef16b28980 1 -- 172.21.15.194:0/1021090674 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636c26d6320 con 0x5636c26d2ab0 2024-09-13T06:09:59.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.979+0000 7fedf9ffb640 1 -- 172.21.15.194:0/1021090674 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fef040d0790 con 0x5636c26d2ab0 2024-09-13T06:09:59.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.979+0000 7fedf9ffb640 1 --2- 172.21.15.194:0/1021090674 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fedec034650 0x7fedec036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.979+0000 7fedf9ffb640 1 -- 172.21.15.194:0/1021090674 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fef040eec50 con 0x5636c26d2ab0 2024-09-13T06:09:59.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.979+0000 7fef13e37640 1 --2- 172.21.15.194:0/1021090674 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fedec034650 0x7fedec036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.979+0000 7fef16b28980 1 Processor -- start 2024-09-13T06:09:59.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.979+0000 7fef13e37640 1 --2- 172.21.15.194:0/1021090674 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fedec034650 0x7fedec036b10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x5636c26bcbb0 tx=0x7fef08006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.979+0000 7fef16b28980 1 -- start start 2024-09-13T06:09:59.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.979+0000 7fef16b28980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636c26df3a0 0x5636c26df7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.979+0000 7fef16b28980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5636c25bf1c0 con 0x5636c26df3a0 2024-09-13T06:09:59.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.979+0000 7fef14638640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636c26df3a0 0x5636c26df7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.979+0000 7fef14638640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636c26df3a0 0x5636c26df7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45918/0 (socket says 172.21.15.194:45918) 2024-09-13T06:09:59.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.979+0000 7fef14638640 1 -- 172.21.15.194:0/444320803 learned_addr learned my addr 172.21.15.194:0/444320803 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:59.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.983+0000 7fef14638640 1 -- 172.21.15.194:0/444320803 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636c26dfd70 con 0x5636c26df3a0 2024-09-13T06:09:59.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.983+0000 7fef14638640 1 --2- 172.21.15.194:0/444320803 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636c26df3a0 0x5636c26df7a0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fef040eefd0 tx=0x7fef040cf970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6928203dee4bbaf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.983+0000 7fedeb7fe640 1 -- 172.21.15.194:0/444320803 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef040e56a0 con 0x5636c26df3a0 2024-09-13T06:09:59.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.983+0000 7fedeb7fe640 1 -- 172.21.15.194:0/444320803 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef040bc8c0 con 0x5636c26df3a0 2024-09-13T06:09:59.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.983+0000 7fedeb7fe640 1 -- 172.21.15.194:0/444320803 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef040c95b0 con 0x5636c26df3a0 2024-09-13T06:09:59.986 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.983+0000 7fef16b28980 1 -- 172.21.15.194:0/444320803 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636c26df3a0 msgr2=0x5636c26df7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:09:59.986 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.983+0000 7fef16b28980 1 --2- 172.21.15.194:0/444320803 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636c26df3a0 0x5636c26df7a0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fef040eefd0 tx=0x7fef040cf970 comp rx=0 tx=0).stop 2024-09-13T06:09:59.986 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.983+0000 7fef16b28980 1 -- 172.21.15.194:0/444320803 shutdown_connections 2024-09-13T06:09:59.986 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.983+0000 7fef16b28980 1 --2- 172.21.15.194:0/444320803 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636c26df3a0 0x5636c26df7a0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:09:59.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.983+0000 7fef16b28980 1 -- 172.21.15.194:0/444320803 >> 172.21.15.194:0/444320803 conn(0x5636c26db780 msgr2=0x5636c26d9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:09:59.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.983+0000 7fef16b28980 1 -- 172.21.15.194:0/444320803 shutdown_connections 2024-09-13T06:09:59.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.983+0000 7fef16b28980 1 -- 172.21.15.194:0/444320803 wait complete. 2024-09-13T06:09:59.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.983+0000 7fef16b28980 1 Processor -- start 2024-09-13T06:09:59.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.983+0000 7fef16b28980 1 -- start start 2024-09-13T06:09:59.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.983+0000 7fef16b28980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636c26df3a0 0x5636c26e6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.983+0000 7fef16b28980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5636c26e0190 con 0x5636c26df3a0 2024-09-13T06:09:59.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.983+0000 7fef14638640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636c26df3a0 0x5636c26e6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.983+0000 7fef14638640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636c26df3a0 0x5636c26e6580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45934/0 (socket says 172.21.15.194:45934) 2024-09-13T06:09:59.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.983+0000 7fef14638640 1 -- 172.21.15.194:0/3668595685 learned_addr learned my addr 172.21.15.194:0/3668595685 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:09:59.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.983+0000 7fef14638640 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636c26e6ac0 con 0x5636c26df3a0 2024-09-13T06:09:59.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.983+0000 7fef14638640 1 --2- 172.21.15.194:0/3668595685 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636c26df3a0 0x5636c26e6580 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fef040c57d0 tx=0x7fef040b3ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.983+0000 7fede9ffb640 1 -- 172.21.15.194:0/3668595685 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef040a8c50 con 0x5636c26df3a0 2024-09-13T06:09:59.988 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.983+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5636c26e6ac0 con 0x5636c26df3a0 2024-09-13T06:09:59.988 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.983+0000 7fede9ffb640 1 -- 172.21.15.194:0/3668595685 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef0410d030 con 0x5636c26df3a0 2024-09-13T06:09:59.988 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.983+0000 7fede9ffb640 1 -- 172.21.15.194:0/3668595685 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef040e54c0 con 0x5636c26df3a0 2024-09-13T06:09:59.988 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.983+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636c26e6ac0 con 0x5636c26df3a0 2024-09-13T06:09:59.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.987+0000 7fede9ffb640 1 -- 172.21.15.194:0/3668595685 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fef04100030 con 0x5636c26df3a0 2024-09-13T06:09:59.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.987+0000 7fede9ffb640 1 --2- 172.21.15.194:0/3668595685 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7feddc0346a0 0x7feddc036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.987+0000 7fede9ffb640 1 -- 172.21.15.194:0/3668595685 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fef040fe070 con 0x5636c26df3a0 2024-09-13T06:09:59.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.987+0000 7fef13e37640 1 --2- 172.21.15.194:0/3668595685 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7feddc0346a0 0x7feddc036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.987+0000 7fef16b28980 20 rados->read ofs=0 len=0 2024-09-13T06:09:59.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.987+0000 7fef16b28980 1 --2- 172.21.15.194:0/3668595685 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5636c26f14a0 0x5636c26f3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.987+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5636c26f40b0 con 0x5636c26f14a0 2024-09-13T06:09:59.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.987+0000 7fef14e39640 1 --2- 172.21.15.194:0/3668595685 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5636c26f14a0 0x5636c26f3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.987+0000 7fef13e37640 1 --2- 172.21.15.194:0/3668595685 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7feddc0346a0 0x7feddc036b60 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x5636c26c53e0 tx=0x7fef08023040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.987+0000 7fef14e39640 1 --2- 172.21.15.194:0/3668595685 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5636c26f14a0 0x5636c26f3960 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.987+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fef0c00a4d0 con 0x5636c26f14a0 2024-09-13T06:09:59.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.987+0000 7fef16b28980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:59.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.987+0000 7fef16b28980 20 realm 2024-09-13T06:09:59.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.987+0000 7fef16b28980 20 rados->read ofs=0 len=0 2024-09-13T06:09:59.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.987+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5636c26f44c0 con 0x5636c26f14a0 2024-09-13T06:09:59.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.987+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fef0c00a4d0 con 0x5636c26f14a0 2024-09-13T06:09:59.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.987+0000 7fef16b28980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:59.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.987+0000 7fef16b28980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:09:59.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.987+0000 7fef16b28980 20 rados->read ofs=0 len=0 2024-09-13T06:09:59.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.987+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5636c26f4d90 con 0x5636c26f14a0 2024-09-13T06:09:59.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.987+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fef0c00a4d0 con 0x5636c26f14a0 2024-09-13T06:09:59.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.987+0000 7fef16b28980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:09:59.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.987+0000 7fef16b28980 20 rados->read ofs=0 len=0 2024-09-13T06:09:59.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.987+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5636c26f5130 con 0x5636c26f14a0 2024-09-13T06:09:59.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.987+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fef0c00a4d0 con 0x5636c26f14a0 2024-09-13T06:09:59.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.987+0000 7fef16b28980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:09:59.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.987+0000 7fef16b28980 20 rados->read ofs=0 len=0 2024-09-13T06:09:59.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.987+0000 7fef16b28980 1 --2- 172.21.15.194:0/3668595685 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5636c26f5e90 0x5636c26f8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.987+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5636c26f8890 con 0x5636c26f5e90 2024-09-13T06:09:59.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.987+0000 7fef14638640 1 --2- 172.21.15.194:0/3668595685 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5636c26f5e90 0x5636c26f8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.987+0000 7fef14638640 1 --2- 172.21.15.194:0/3668595685 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5636c26f5e90 0x5636c26f8280 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.987+0000 7fef14638640 1 -- 172.21.15.194:0/3668595685 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fef04119070 con 0x5636c26f5e90 2024-09-13T06:09:59.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.987+0000 7fef16b28980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:09:59.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.987+0000 7fef16b28980 20 searching for the correct realm 2024-09-13T06:09:59.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.987+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5636c26fa160 con 0x5636c26f5e90 2024-09-13T06:09:59.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.987+0000 7fef14638640 1 -- 172.21.15.194:0/3668595685 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef04119070 con 0x5636c26f5e90 2024-09-13T06:09:59.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.987+0000 7fef14638640 1 --2- 172.21.15.194:0/3668595685 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fef04009040 0x7fef040eb690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.987+0000 7fef14638640 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5636c26fa160 con 0x7fef04009040 2024-09-13T06:09:59.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.987+0000 7fef13e37640 1 --2- 172.21.15.194:0/3668595685 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fef04009040 0x7fef040eb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.991+0000 7fef13e37640 1 --2- 172.21.15.194:0/3668595685 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fef04009040 0x7fef040eb690 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.991+0000 7fef13e37640 1 -- 172.21.15.194:0/3668595685 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fef08037040 con 0x7fef04009040 2024-09-13T06:09:59.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.991+0000 7fef13e37640 1 --2- 172.21.15.194:0/3668595685 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fef0801f940 0x7fef0803a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:09:59.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.991+0000 7fef13e37640 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5636c26fa160 con 0x7fef0801f940 2024-09-13T06:09:59.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.991+0000 7fef14e39640 1 --2- 172.21.15.194:0/3668595685 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fef0801f940 0x7fef0803a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:09:59.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.991+0000 7fef14e39640 1 --2- 172.21.15.194:0/3668595685 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fef0801f940 0x7fef0803a3c0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:09:59.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.991+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef0c00a4d0 con 0x7fef0801f940 2024-09-13T06:09:59.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.991+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5636c26f5130 con 0x5636c26f14a0 2024-09-13T06:09:59.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.991+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef0c00a4d0 con 0x5636c26f14a0 2024-09-13T06:09:59.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.991+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5636c26f5130 con 0x5636c26f14a0 2024-09-13T06:09:59.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.991+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef0c00a4d0 con 0x5636c26f14a0 2024-09-13T06:09:59.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.991+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5636c26f5130 con 0x7fef0801f940 2024-09-13T06:10:00.000 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.991+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef0c00a4d0 con 0x7fef0801f940 2024-09-13T06:10:00.001 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.991+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5636c26f5130 con 0x7fef0801f940 2024-09-13T06:10:00.001 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.991+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef0c00a4d0 con 0x7fef0801f940 2024-09-13T06:10:00.001 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.991+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5636c26f5130 con 0x7fef04009040 2024-09-13T06:10:00.001 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.991+0000 7fef13e37640 1 -- 172.21.15.194:0/3668595685 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef08037040 con 0x7fef04009040 2024-09-13T06:10:00.001 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.991+0000 7fef13e37640 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5636c26f5130 con 0x5636c26f5e90 2024-09-13T06:10:00.001 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.991+0000 7fef14638640 1 -- 172.21.15.194:0/3668595685 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef04119070 con 0x5636c26f5e90 2024-09-13T06:10:00.001 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.991+0000 7fef14638640 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5636c26f5130 con 0x5636c26f14a0 2024-09-13T06:10:00.001 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.995+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef0c00a4d0 con 0x5636c26f14a0 2024-09-13T06:10:00.001 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.995+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5636c26f5130 con 0x7fef0801f940 2024-09-13T06:10:00.001 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.995+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef0c00a4d0 con 0x7fef0801f940 2024-09-13T06:10:00.001 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.995+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5636c26f5130 con 0x5636c26f14a0 2024-09-13T06:10:00.001 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.995+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef0c00a4d0 con 0x5636c26f14a0 2024-09-13T06:10:00.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.995+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5636c26f5130 con 0x7fef04009040 2024-09-13T06:10:00.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.995+0000 7fef13e37640 1 -- 172.21.15.194:0/3668595685 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fef08037040 con 0x7fef04009040 2024-09-13T06:10:00.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.995+0000 7fef13e37640 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5636c26f5130 con 0x5636c26f5e90 2024-09-13T06:10:00.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.995+0000 7fef14638640 1 -- 172.21.15.194:0/3668595685 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef04119070 con 0x5636c26f5e90 2024-09-13T06:10:00.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.995+0000 7fef14638640 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5636c26f5130 con 0x5636c26f5e90 2024-09-13T06:10:00.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.995+0000 7fef14638640 1 -- 172.21.15.194:0/3668595685 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef04119070 con 0x5636c26f5e90 2024-09-13T06:10:00.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.995+0000 7fef14638640 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5636c26f5130 con 0x7fef0801f940 2024-09-13T06:10:00.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.995+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef0c00a4d0 con 0x7fef0801f940 2024-09-13T06:10:00.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.995+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5636c26f5130 con 0x5636c26f5e90 2024-09-13T06:10:00.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.995+0000 7fef14638640 1 -- 172.21.15.194:0/3668595685 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef04119070 con 0x5636c26f5e90 2024-09-13T06:10:00.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.995+0000 7fef14638640 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5636c26f5130 con 0x5636c26f5e90 2024-09-13T06:10:00.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.995+0000 7fef14638640 1 -- 172.21.15.194:0/3668595685 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef04119070 con 0x5636c26f5e90 2024-09-13T06:10:00.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.995+0000 7fef14638640 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5636c26f5130 con 0x5636c26f14a0 2024-09-13T06:10:00.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.995+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef0c00a4d0 con 0x5636c26f14a0 2024-09-13T06:10:00.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.995+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5636c26f5130 con 0x5636c26f14a0 2024-09-13T06:10:00.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.995+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fef0c00a4d0 con 0x5636c26f14a0 2024-09-13T06:10:00.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.995+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5636c26f5130 con 0x7fef0801f940 2024-09-13T06:10:00.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.999+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef0c00a4d0 con 0x7fef0801f940 2024-09-13T06:10:00.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.999+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5636c26f5130 con 0x5636c26f5e90 2024-09-13T06:10:00.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.999+0000 7fef14638640 1 -- 172.21.15.194:0/3668595685 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef04119070 con 0x5636c26f5e90 2024-09-13T06:10:00.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.999+0000 7fef14638640 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5636c26f5130 con 0x7fef04009040 2024-09-13T06:10:00.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.999+0000 7fef13e37640 1 -- 172.21.15.194:0/3668595685 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef08037040 con 0x7fef04009040 2024-09-13T06:10:00.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.999+0000 7fef13e37640 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5636c26f5130 con 0x5636c26f14a0 2024-09-13T06:10:00.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.999+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef0c00a4d0 con 0x5636c26f14a0 2024-09-13T06:10:00.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.999+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5636c26f5130 con 0x7fef0801f940 2024-09-13T06:10:00.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.999+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef0c00a4d0 con 0x7fef0801f940 2024-09-13T06:10:00.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.999+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5636c26f5130 con 0x5636c26f5e90 2024-09-13T06:10:00.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.999+0000 7fef14638640 1 -- 172.21.15.194:0/3668595685 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fef04119070 con 0x5636c26f5e90 2024-09-13T06:10:00.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.999+0000 7fef14638640 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5636c26f5130 con 0x7fef0801f940 2024-09-13T06:10:00.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.999+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef0c00a4d0 con 0x7fef0801f940 2024-09-13T06:10:00.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.999+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5636c26f5130 con 0x7fef04009040 2024-09-13T06:10:00.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.999+0000 7fef13e37640 1 -- 172.21.15.194:0/3668595685 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef08037040 con 0x7fef04009040 2024-09-13T06:10:00.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.999+0000 7fef13e37640 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5636c26f5130 con 0x5636c26f5e90 2024-09-13T06:10:00.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.999+0000 7fef14638640 1 -- 172.21.15.194:0/3668595685 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef04119070 con 0x5636c26f5e90 2024-09-13T06:10:00.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:09:59.999+0000 7fef14638640 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5636c26f5130 con 0x7fef0801f940 2024-09-13T06:10:00.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.003+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef0c00a4d0 con 0x7fef0801f940 2024-09-13T06:10:00.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.003+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5636c26f5130 con 0x5636c26f14a0 2024-09-13T06:10:00.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.003+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fef0c00a4d0 con 0x5636c26f14a0 2024-09-13T06:10:00.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.003+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5636c26f5130 con 0x7fef04009040 2024-09-13T06:10:00.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.003+0000 7fef13e37640 1 -- 172.21.15.194:0/3668595685 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef08037040 con 0x7fef04009040 2024-09-13T06:10:00.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.003+0000 7fef16b28980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:10:00.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.003+0000 7fef16b28980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:10:00.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.003+0000 7fef16b28980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:10:00.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.003+0000 7fef16b28980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:10:00.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.003+0000 7fef16b28980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:10:00.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.003+0000 7fef16b28980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:10:00.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.003+0000 7fef16b28980 20 rados->read ofs=0 len=0 2024-09-13T06:10:00.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.003+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5636c26f9280 con 0x5636c26f14a0 2024-09-13T06:10:00.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.003+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fef0c00a4d0 con 0x5636c26f14a0 2024-09-13T06:10:00.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.003+0000 7fef16b28980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:00.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.003+0000 7fef16b28980 20 rados->read ofs=0 len=0 2024-09-13T06:10:00.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.003+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5636c26f8ec0 con 0x5636c26f14a0 2024-09-13T06:10:00.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.003+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fef0c00a4d0 con 0x5636c26f14a0 2024-09-13T06:10:00.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.003+0000 7fef16b28980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:10:00.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.003+0000 7fef16b28980 20 rados->read ofs=0 len=0 2024-09-13T06:10:00.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.003+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5636c26f9ba0 con 0x7fef04009040 2024-09-13T06:10:00.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.003+0000 7fef13e37640 1 -- 172.21.15.194:0/3668595685 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fef08037040 con 0x7fef04009040 2024-09-13T06:10:00.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.003+0000 7fef16b28980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:10:00.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.003+0000 7fef16b28980 20 zone default found 2024-09-13T06:10:00.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.003+0000 7fef16b28980 4 Realm: () 2024-09-13T06:10:00.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.003+0000 7fef16b28980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:10:00.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.003+0000 7fef16b28980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:10:00.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.003+0000 7fef16b28980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:10:00.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.003+0000 7fef16b28980 20 zonegroup default 2024-09-13T06:10:00.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.003+0000 7fef16b28980 20 rados->read ofs=0 len=0 2024-09-13T06:10:00.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.003+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5636c26fa590 con 0x7fef0801f940 2024-09-13T06:10:00.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.003+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fef0c00a4d0 con 0x7fef0801f940 2024-09-13T06:10:00.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.003+0000 7fef16b28980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:00.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.003+0000 7fef16b28980 20 rados->read ofs=0 len=0 2024-09-13T06:10:00.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.003+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5636c26fbf70 con 0x5636c26f5e90 2024-09-13T06:10:00.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.003+0000 7fef14638640 1 -- 172.21.15.194:0/3668595685 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fef04119070 con 0x5636c26f5e90 2024-09-13T06:10:00.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.003+0000 7fef16b28980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:00.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.003+0000 7fef16b28980 20 rados->read ofs=0 len=0 2024-09-13T06:10:00.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.003+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5636c26fc410 con 0x5636c26f5e90 2024-09-13T06:10:00.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.003+0000 7fef14638640 1 -- 172.21.15.194:0/3668595685 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fef04119070 con 0x5636c26f5e90 2024-09-13T06:10:00.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.003+0000 7fef16b28980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:00.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.003+0000 7fef16b28980 20 started sync module instance, tier type = 2024-09-13T06:10:00.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.003+0000 7fef16b28980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:10:00.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.003+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5636c26fb410 con 0x7fef04009040 2024-09-13T06:10:00.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.003+0000 7fef13e37640 1 -- 172.21.15.194:0/3668595685 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(44 notify.0 [create] v33'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef08037040 con 0x7fef04009040 2024-09-13T06:10:00.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.003+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94793190324224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5636c26fb070 con 0x7fef04009040 2024-09-13T06:10:00.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.003+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5636c26fd340 con 0x5636c26f14a0 2024-09-13T06:10:00.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.007+0000 7fef13e37640 1 -- 172.21.15.194:0/3668595685 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94793190324224] v33'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef08037040 con 0x7fef04009040 2024-09-13T06:10:00.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.007+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v33'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef0c00a4d0 con 0x5636c26f14a0 2024-09-13T06:10:00.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.007+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94793190330000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5636c26fd760 con 0x5636c26f14a0 2024-09-13T06:10:00.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.007+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5636c26fe120 con 0x5636c26f5e90 2024-09-13T06:10:00.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.007+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94793190330000] v33'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef0c00a4d0 con 0x5636c26f14a0 2024-09-13T06:10:00.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.011+0000 7fef14638640 1 -- 172.21.15.194:0/3668595685 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v33'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef04119070 con 0x5636c26f5e90 2024-09-13T06:10:00.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.011+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94793190331056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5636c26fd6d0 con 0x5636c26f5e90 2024-09-13T06:10:00.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.011+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5636c26fee20 con 0x7fef04009040 2024-09-13T06:10:00.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.011+0000 7fef13e37640 1 -- 172.21.15.194:0/3668595685 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(50 notify.3 [create] v33'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef08037040 con 0x7fef04009040 2024-09-13T06:10:00.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.011+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94793190339088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5636c26ffae0 con 0x7fef04009040 2024-09-13T06:10:00.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.011+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5636c27004a0 con 0x5636c26f14a0 2024-09-13T06:10:00.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.011+0000 7fef14638640 1 -- 172.21.15.194:0/3668595685 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94793190331056] v33'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef04119070 con 0x5636c26f5e90 2024-09-13T06:10:00.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.011+0000 7fef13e37640 1 -- 172.21.15.194:0/3668595685 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94793190339088] v33'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef08037040 con 0x7fef04009040 2024-09-13T06:10:00.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.011+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v33'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef0c00a4d0 con 0x5636c26f14a0 2024-09-13T06:10:00.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.011+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94793190335680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5636c27004a0 con 0x5636c26f14a0 2024-09-13T06:10:00.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.011+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5636c2700d40 con 0x7fef0801f940 2024-09-13T06:10:00.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.015+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94793190335680] v33'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef0c00a4d0 con 0x5636c26f14a0 2024-09-13T06:10:00.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.015+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(54 notify.5 [create] v33'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef0c00a4d0 con 0x7fef0801f940 2024-09-13T06:10:00.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.015+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94793190342912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5636c2700ab0 con 0x7fef0801f940 2024-09-13T06:10:00.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.015+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5636c2701570 con 0x7fef0801f940 2024-09-13T06:10:00.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.015+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94793190342912] v33'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef0c00a4d0 con 0x7fef0801f940 2024-09-13T06:10:00.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.019+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(56 notify.6 [create] v33'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef0c00a4d0 con 0x7fef0801f940 2024-09-13T06:10:00.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.019+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94793190346816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5636c2701530 con 0x7fef0801f940 2024-09-13T06:10:00.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.019+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5636c2701f70 con 0x7fef0801f940 2024-09-13T06:10:00.020 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.019+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94793190346816] v33'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef0c00a4d0 con 0x7fef0801f940 2024-09-13T06:10:00.021 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.019+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(58 notify.7 [create] v33'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef0c00a4d0 con 0x7fef0801f940 2024-09-13T06:10:00.021 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.019+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94793190349376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5636c2701f30 con 0x7fef0801f940 2024-09-13T06:10:00.021 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.019+0000 7fef16b28980 20 add_watcher() i=0 2024-09-13T06:10:00.021 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.019+0000 7fef16b28980 20 add_watcher() i=1 2024-09-13T06:10:00.021 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.019+0000 7fef16b28980 20 add_watcher() i=2 2024-09-13T06:10:00.021 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.019+0000 7fef16b28980 20 add_watcher() i=3 2024-09-13T06:10:00.021 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.019+0000 7fef16b28980 20 add_watcher() i=4 2024-09-13T06:10:00.021 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.019+0000 7fef16b28980 20 add_watcher() i=5 2024-09-13T06:10:00.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.019+0000 7fef16b28980 20 add_watcher() i=6 2024-09-13T06:10:00.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.023+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94793190349376] v33'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef0c00a4d0 con 0x7fef0801f940 2024-09-13T06:10:00.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.023+0000 7fef16b28980 20 add_watcher() i=7 2024-09-13T06:10:00.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.023+0000 7fef16b28980 2 all 8 watchers are set, enabling cache 2024-09-13T06:10:00.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.023+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5636c2705390 con 0x5636c26f14a0 2024-09-13T06:10:00.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.023+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fef0c00a4d0 con 0x5636c26f14a0 2024-09-13T06:10:00.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.023+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94793190343968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5636c27028b0 con 0x5636c26f14a0 2024-09-13T06:10:00.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.023+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94793190343968] v33'121 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fef0c00a4d0 con 0x5636c26f14a0 2024-09-13T06:10:00.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.023+0000 7fedca7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:10:00.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.023+0000 7fef16b28980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:10:00.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.023+0000 7fef16b28980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:10:00.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.023+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5636c2705020 con 0x5636c26f14a0 2024-09-13T06:10:00.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.027+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fef0c00a4d0 con 0x5636c26f14a0 2024-09-13T06:10:00.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.027+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5636c270e3e0 con 0x7fef0801f940 2024-09-13T06:10:00.028 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.027+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'15 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fef0c00a4d0 con 0x7fef0801f940 2024-09-13T06:10:00.028 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.027+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5636c270e890 con 0x5636c26f5e90 2024-09-13T06:10:00.029 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.027+0000 7fef14638640 1 -- 172.21.15.194:0/3668595685 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fef04119070 con 0x5636c26f5e90 2024-09-13T06:10:00.029 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.027+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5636c270e890 con 0x5636c26f14a0 2024-09-13T06:10:00.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.031+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'122 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fef0c00a4d0 con 0x5636c26f14a0 2024-09-13T06:10:00.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.031+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5636c270ea60 con 0x7fef04009040 2024-09-13T06:10:00.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.031+0000 7fef13e37640 1 -- 172.21.15.194:0/3668595685 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'35 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fef08037040 con 0x7fef04009040 2024-09-13T06:10:00.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.031+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5636c270efd0 con 0x5636c26f5e90 2024-09-13T06:10:00.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.031+0000 7fef14638640 1 -- 172.21.15.194:0/3668595685 <== osd.3 v2:172.21.15.194:6816/96632515 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'24 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fef04119070 con 0x5636c26f5e90 2024-09-13T06:10:00.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.031+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5636c270f060 con 0x5636c26f14a0 2024-09-13T06:10:00.034 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.035+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fef0c00a4d0 con 0x5636c26f14a0 2024-09-13T06:10:00.034 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.035+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5636c270f0f0 con 0x7fef0801f940 2024-09-13T06:10:00.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.035+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'23 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fef0c00a4d0 con 0x7fef0801f940 2024-09-13T06:10:00.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.035+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5636c270f180 con 0x7fef04009040 2024-09-13T06:10:00.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.039+0000 7fef13e37640 1 -- 172.21.15.194:0/3668595685 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fef08037040 con 0x7fef04009040 2024-09-13T06:10:00.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.039+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5636c270f6f0 con 0x5636c26f5e90 2024-09-13T06:10:00.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.039+0000 7fef14638640 1 -- 172.21.15.194:0/3668595685 <== osd.3 v2:172.21.15.194:6816/96632515 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fef04119070 con 0x5636c26f5e90 2024-09-13T06:10:00.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.039+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5636c270f6f0 con 0x7fef04009040 2024-09-13T06:10:00.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.039+0000 7fef13e37640 1 -- 172.21.15.194:0/3668595685 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'36 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fef08037040 con 0x7fef04009040 2024-09-13T06:10:00.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.039+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5636c270fba0 con 0x7fef0801f940 2024-09-13T06:10:00.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.039+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fef0c00a4d0 con 0x7fef0801f940 2024-09-13T06:10:00.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.043+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5636c270fba0 con 0x7fef04009040 2024-09-13T06:10:00.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.043+0000 7fef13e37640 1 -- 172.21.15.194:0/3668595685 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fef08037040 con 0x7fef04009040 2024-09-13T06:10:00.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.043+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5636c270fc30 con 0x7fef0801f940 2024-09-13T06:10:00.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.043+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 <== osd.0 v2:172.21.15.120:6800/1923744619 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'29 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fef0c00a4d0 con 0x7fef0801f940 2024-09-13T06:10:00.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.043+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5636c270fc30 con 0x5636c26f14a0 2024-09-13T06:10:00.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.043+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'123 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fef0c00a4d0 con 0x5636c26f14a0 2024-09-13T06:10:00.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.047+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5636c270fc30 con 0x5636c26f5e90 2024-09-13T06:10:00.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.047+0000 7fef14638640 1 -- 172.21.15.194:0/3668595685 <== osd.3 v2:172.21.15.194:6816/96632515 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'29 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fef04119070 con 0x5636c26f5e90 2024-09-13T06:10:00.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.047+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5636c270fc30 con 0x7fef04009040 2024-09-13T06:10:00.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.047+0000 7fef13e37640 1 -- 172.21.15.194:0/3668595685 <== osd.2 v2:172.21.15.194:6800/815615585 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'37 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fef08037040 con 0x7fef04009040 2024-09-13T06:10:00.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.047+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5636c270fce0 con 0x5636c26f5e90 2024-09-13T06:10:00.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.047+0000 7fef14638640 1 -- 172.21.15.194:0/3668595685 <== osd.3 v2:172.21.15.194:6816/96632515 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fef04119070 con 0x5636c26f5e90 2024-09-13T06:10:00.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.047+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5636c270fce0 con 0x5636c26f14a0 2024-09-13T06:10:00.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.051+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 <== osd.1 v2:172.21.15.194:6808/3135444559 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'23 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fef0c00a4d0 con 0x5636c26f14a0 2024-09-13T06:10:00.052 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.051+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5636c270fce0 con 0x5636c26f14a0 2024-09-13T06:10:00.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.051+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 <== osd.1 v2:172.21.15.194:6808/3135444559 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'124 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fef0c00a4d0 con 0x5636c26f14a0 2024-09-13T06:10:00.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.051+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5636c270fce0 con 0x5636c26f5e90 2024-09-13T06:10:00.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.055+0000 7fef14638640 1 -- 172.21.15.194:0/3668595685 <== osd.3 v2:172.21.15.194:6816/96632515 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'30 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fef04119070 con 0x5636c26f5e90 2024-09-13T06:10:00.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.055+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5636c270fce0 con 0x7fef04009040 2024-09-13T06:10:00.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.055+0000 7fef13e37640 1 -- 172.21.15.194:0/3668595685 <== osd.2 v2:172.21.15.194:6800/815615585 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'25 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fef08037040 con 0x7fef04009040 2024-09-13T06:10:00.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.055+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5636c270fce0 con 0x5636c26f5e90 2024-09-13T06:10:00.057 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.055+0000 7fef14638640 1 -- 172.21.15.194:0/3668595685 <== osd.3 v2:172.21.15.194:6816/96632515 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fef04119070 con 0x5636c26f5e90 2024-09-13T06:10:00.057 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.055+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5636c270fce0 con 0x5636c26f5e90 2024-09-13T06:10:00.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.059+0000 7fef14638640 1 -- 172.21.15.194:0/3668595685 <== osd.3 v2:172.21.15.194:6816/96632515 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fef04119070 con 0x5636c26f5e90 2024-09-13T06:10:00.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.059+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5636c270fce0 con 0x5636c26f5e90 2024-09-13T06:10:00.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.059+0000 7fef14638640 1 -- 172.21.15.194:0/3668595685 <== osd.3 v2:172.21.15.194:6816/96632515 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fef04119070 con 0x5636c26f5e90 2024-09-13T06:10:00.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.059+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5636c270fce0 con 0x5636c26f5e90 2024-09-13T06:10:00.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.059+0000 7fef14638640 1 -- 172.21.15.194:0/3668595685 <== osd.3 v2:172.21.15.194:6816/96632515 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'25 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fef04119070 con 0x5636c26f5e90 2024-09-13T06:10:00.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.059+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5636c270fce0 con 0x7fef0801f940 2024-09-13T06:10:00.064 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.063+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 <== osd.0 v2:172.21.15.120:6800/1923744619 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fef0c00a4d0 con 0x7fef0801f940 2024-09-13T06:10:00.064 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.063+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5636c270fce0 con 0x5636c26f5e90 2024-09-13T06:10:00.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.067+0000 7fef14638640 1 -- 172.21.15.194:0/3668595685 <== osd.3 v2:172.21.15.194:6816/96632515 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fef04119070 con 0x5636c26f5e90 2024-09-13T06:10:00.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.067+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5636c270fce0 con 0x7fef0801f940 2024-09-13T06:10:00.069 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.067+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 <== osd.0 v2:172.21.15.120:6800/1923744619 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'24 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fef0c00a4d0 con 0x7fef0801f940 2024-09-13T06:10:00.069 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.067+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5636c270fce0 con 0x5636c26f5e90 2024-09-13T06:10:00.071 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.071+0000 7fef14638640 1 -- 172.21.15.194:0/3668595685 <== osd.3 v2:172.21.15.194:6816/96632515 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'31 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fef04119070 con 0x5636c26f5e90 2024-09-13T06:10:00.071 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.071+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5636c270fce0 con 0x7fef0801f940 2024-09-13T06:10:00.073 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.071+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 <== osd.0 v2:172.21.15.120:6800/1923744619 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'30 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fef0c00a4d0 con 0x7fef0801f940 2024-09-13T06:10:00.073 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.071+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5636c270fce0 con 0x7fef04009040 2024-09-13T06:10:00.075 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.075+0000 7fef13e37640 1 -- 172.21.15.194:0/3668595685 <== osd.2 v2:172.21.15.194:6800/815615585 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fef08037040 con 0x7fef04009040 2024-09-13T06:10:00.076 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.075+0000 7fedc97e2640 20 reqs_thread_entry: start 2024-09-13T06:10:00.076 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.075+0000 7fef16b28980 20 init_complete bucket index max shards: 11 2024-09-13T06:10:00.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.075+0000 7fef16b28980 20 Filter name: none 2024-09-13T06:10:00.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.075+0000 7fed3affd640 20 reqs_thread_entry: start 2024-09-13T06:10:00.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.075+0000 7fef16b28980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T06:10:00.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.075+0000 7fef16b28980 20 rados->read ofs=0 len=0 2024-09-13T06:10:00.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.075+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5636c270cf70 con 0x7fef0801f940 2024-09-13T06:10:00.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.075+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 <== osd.0 v2:172.21.15.120:6800/1923744619 24 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fef0c00a4d0 con 0x7fef0801f940 2024-09-13T06:10:00.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.075+0000 7fef16b28980 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T06:10:00.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.075+0000 7fef16b28980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-13T06:10:00.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.075+0000 7fef16b28980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T06:10:00.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.075+0000 7fef16b28980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:10:00.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.075+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5636c270cac0 con 0x7fef0801f940 2024-09-13T06:10:00.079 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.079+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 <== osd.0 v2:172.21.15.120:6800/1923744619 25 ==== osd_op_reply(95 fud.buckets [call out=15b] v0'0 uv6 ondisk = 0) ==== 155+0+15 (crc 0 0 0) 0x7fef0c00a4d0 con 0x7fef0801f940 2024-09-13T06:10:00.079 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.079+0000 7fef16b28980 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-13T06:10:00.079 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.079+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5636c270cac0 con 0x7fef0801f940 2024-09-13T06:10:00.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.079+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 <== osd.0 v2:172.21.15.120:6800/1923744619 26 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v33'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fef0c00a4d0 con 0x7fef0801f940 2024-09-13T06:10:00.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.079+0000 7fef16b28980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-13T06:10:00.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.079+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94793190520448 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5636c272d070 con 0x5636c26f5e90 2024-09-13T06:10:00.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.079+0000 7fef14638640 1 -- 172.21.15.194:0/3668595685 <== osd.3 v2:172.21.15.194:6816/96632515 27 ==== watch-notify(notify (1) cookie 94793190331056 notify 141733920777 ret 0) ==== 212+0+0 (crc 0 0 0) 0x5636c270f0f0 con 0x5636c26f5e90 2024-09-13T06:10:00.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.079+0000 7fedeb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920777 cookie 94793190331056 notifier 4528 bl.length()=170 2024-09-13T06:10:00.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.079+0000 7fef14638640 1 -- 172.21.15.194:0/3668595685 <== osd.3 v2:172.21.15.194:6816/96632515 28 ==== osd_op_reply(97 notify.2 [notify cookie 94793190520448 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fef04119070 con 0x5636c26f5e90 2024-09-13T06:10:00.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.079+0000 7fedeb7fe640 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fedd8003d70 con 0x5636c26f5e90 2024-09-13T06:10:00.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.079+0000 7fef14638640 1 -- 172.21.15.194:0/3668595685 <== osd.3 v2:172.21.15.194:6816/96632515 29 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef04119070 con 0x5636c26f5e90 2024-09-13T06:10:00.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.079+0000 7fef14638640 1 -- 172.21.15.194:0/3668595685 <== osd.3 v2:172.21.15.194:6816/96632515 30 ==== watch-notify(notify_complete (2) cookie 94793190520448 notify 141733920777 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5636c26d3410 con 0x5636c26f5e90 2024-09-13T06:10:00.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.079+0000 7fef16b28980 10 removing email index: 2024-09-13T06:10:00.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.079+0000 7fef16b28980 10 removing user buckets index 2024-09-13T06:10:00.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.079+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:99 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5636c272b680 con 0x7fef0801f940 2024-09-13T06:10:00.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.083+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 <== osd.0 v2:172.21.15.120:6800/1923744619 27 ==== osd_op_reply(99 fud.buckets [delete] v33'8 uv8 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fef0c00a4d0 con 0x7fef0801f940 2024-09-13T06:10:00.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.083+0000 7fef16b28980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-09-13T06:10:00.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.083+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:100 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94793190520448 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5636c272d070 con 0x7fef0801f940 2024-09-13T06:10:00.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.083+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 <== osd.0 v2:172.21.15.120:6800/1923744619 28 ==== watch-notify(notify (1) cookie 94793190346816 notify 141733920777 ret 0) ==== 202+0+0 (crc 0 0 0) 0x5636c270e7d0 con 0x7fef0801f940 2024-09-13T06:10:00.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.083+0000 7fedeaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920777 cookie 94793190346816 notifier 4528 bl.length()=160 2024-09-13T06:10:00.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.083+0000 7fedeaffd640 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fed480032d0 con 0x7fef0801f940 2024-09-13T06:10:00.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.083+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 <== osd.0 v2:172.21.15.120:6800/1923744619 29 ==== osd_op_reply(100 notify.6 [notify cookie 94793190520448 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fef0c00a4d0 con 0x7fef0801f940 2024-09-13T06:10:00.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.083+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 <== osd.0 v2:172.21.15.120:6800/1923744619 30 ==== osd_op_reply(101 notify.6 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef0c00a4d0 con 0x7fef0801f940 2024-09-13T06:10:00.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.083+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 <== osd.0 v2:172.21.15.120:6800/1923744619 31 ==== watch-notify(notify_complete (2) cookie 94793190520448 notify 141733920777 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5636c27051b0 con 0x7fef0801f940 2024-09-13T06:10:00.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.083+0000 7fef16b28980 10 removing user index: fud 2024-09-13T06:10:00.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.083+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:102 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5636c272d020 con 0x7fef0801f940 2024-09-13T06:10:00.087 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.087+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 <== osd.0 v2:172.21.15.120:6800/1923744619 32 ==== osd_op_reply(102 fud [call,call,delete] v33'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fef0c00a4d0 con 0x7fef0801f940 2024-09-13T06:10:00.087 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.087+0000 7fef16b28980 10 removing default.rgw.meta+users.uid+fud from cache 2024-09-13T06:10:00.087 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.087+0000 7fef16b28980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-13T06:10:00.087 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.087+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [notify cookie 94793190521696 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5636c272cf90 con 0x7fef0801f940 2024-09-13T06:10:00.088 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.087+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 <== osd.0 v2:172.21.15.120:6800/1923744619 33 ==== watch-notify(notify (1) cookie 94793190342912 notify 141733920778 ret 0) ==== 194+0+0 (crc 0 0 0) 0x5636c27051b0 con 0x7fef0801f940 2024-09-13T06:10:00.088 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.087+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 <== osd.0 v2:172.21.15.120:6800/1923744619 34 ==== osd_op_reply(103 notify.5 [notify cookie 94793190521696 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fef0c00a4d0 con 0x7fef0801f940 2024-09-13T06:10:00.088 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.087+0000 7fedeb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920778 cookie 94793190342912 notifier 4528 bl.length()=152 2024-09-13T06:10:00.088 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.087+0000 7fedeb7fe640 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:104 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fedd8003d70 con 0x7fef0801f940 2024-09-13T06:10:00.088 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.087+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 <== osd.0 v2:172.21.15.120:6800/1923744619 35 ==== osd_op_reply(104 notify.5 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef0c00a4d0 con 0x7fef0801f940 2024-09-13T06:10:00.089 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.087+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 <== osd.0 v2:172.21.15.120:6800/1923744619 36 ==== watch-notify(notify_complete (2) cookie 94793190521696 notify 141733920778 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5636c2704fe0 con 0x7fef0801f940 2024-09-13T06:10:00.090 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.087+0000 7fedca7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:10:00.090 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.087+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94793190343968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5636c270dce0 con 0x5636c26f14a0 2024-09-13T06:10:00.091 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.091+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 <== osd.1 v2:172.21.15.194:6808/3135444559 27 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94793190343968] v33'125 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fef0c00a4d0 con 0x5636c26f14a0 2024-09-13T06:10:00.091 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.091+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94793190324224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5636c270dce0 con 0x7fef04009040 2024-09-13T06:10:00.092 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.091+0000 7fef13e37640 1 -- 172.21.15.194:0/3668595685 <== osd.2 v2:172.21.15.194:6800/815615585 19 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94793190324224] v33'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef08037040 con 0x7fef04009040 2024-09-13T06:10:00.093 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.091+0000 7fef16b28980 20 remove_watcher() i=0 2024-09-13T06:10:00.093 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.091+0000 7fef16b28980 2 removed watcher, disabling cache 2024-09-13T06:10:00.093 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.091+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94793190330000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5636c270dce0 con 0x5636c26f14a0 2024-09-13T06:10:00.094 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.095+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 <== osd.1 v2:172.21.15.194:6808/3135444559 28 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94793190330000] v33'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef0c00a4d0 con 0x5636c26f14a0 2024-09-13T06:10:00.094 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.095+0000 7fef16b28980 20 remove_watcher() i=1 2024-09-13T06:10:00.094 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.095+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94793190331056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5636c270dce0 con 0x5636c26f5e90 2024-09-13T06:10:00.096 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.095+0000 7fef14638640 1 -- 172.21.15.194:0/3668595685 <== osd.3 v2:172.21.15.194:6816/96632515 31 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94793190331056] v33'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef04119070 con 0x5636c26f5e90 2024-09-13T06:10:00.096 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.095+0000 7fef16b28980 20 remove_watcher() i=2 2024-09-13T06:10:00.096 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.095+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94793190339088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5636c270dce0 con 0x7fef04009040 2024-09-13T06:10:00.097 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.095+0000 7fef13e37640 1 -- 172.21.15.194:0/3668595685 <== osd.2 v2:172.21.15.194:6800/815615585 20 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94793190339088] v33'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef08037040 con 0x7fef04009040 2024-09-13T06:10:00.097 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.095+0000 7fef16b28980 20 remove_watcher() i=3 2024-09-13T06:10:00.097 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.095+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94793190335680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5636c270dce0 con 0x5636c26f14a0 2024-09-13T06:10:00.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.099+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 <== osd.1 v2:172.21.15.194:6808/3135444559 29 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94793190335680] v33'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef0c00a4d0 con 0x5636c26f14a0 2024-09-13T06:10:00.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.099+0000 7fef16b28980 20 remove_watcher() i=4 2024-09-13T06:10:00.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.099+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94793190342912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5636c270dce0 con 0x7fef0801f940 2024-09-13T06:10:00.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.099+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 <== osd.0 v2:172.21.15.120:6800/1923744619 37 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94793190342912] v33'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef0c00a4d0 con 0x7fef0801f940 2024-09-13T06:10:00.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.099+0000 7fef16b28980 20 remove_watcher() i=5 2024-09-13T06:10:00.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.099+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94793190346816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5636c270dce0 con 0x7fef0801f940 2024-09-13T06:10:00.103 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.103+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 <== osd.0 v2:172.21.15.120:6800/1923744619 38 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94793190346816] v33'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef0c046040 con 0x7fef0801f940 2024-09-13T06:10:00.103 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.103+0000 7fef16b28980 20 remove_watcher() i=6 2024-09-13T06:10:00.103 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.103+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94793190349376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5636c270dce0 con 0x7fef0801f940 2024-09-13T06:10:00.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.103+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 <== osd.0 v2:172.21.15.120:6800/1923744619 39 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94793190349376] v33'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef0c046040 con 0x7fef0801f940 2024-09-13T06:10:00.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.103+0000 7fef16b28980 20 remove_watcher() i=7 2024-09-13T06:10:00.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.103+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fef0801f940 msgr2=0x7fef0803a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.103+0000 7fef16b28980 1 --2- 172.21.15.194:0/3668595685 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fef0801f940 0x7fef0803a3c0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.103+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5636c26f14a0 msgr2=0x5636c26f3960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.103+0000 7fef16b28980 1 --2- 172.21.15.194:0/3668595685 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5636c26f14a0 0x5636c26f3960 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.103+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fef04009040 msgr2=0x7fef040eb690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.103+0000 7fef16b28980 1 --2- 172.21.15.194:0/3668595685 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fef04009040 0x7fef040eb690 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.103+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5636c26f5e90 msgr2=0x5636c26f8280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.103+0000 7fef16b28980 1 --2- 172.21.15.194:0/3668595685 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5636c26f5e90 0x5636c26f8280 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.103+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7feddc0346a0 msgr2=0x7feddc036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.103+0000 7fef16b28980 1 --2- 172.21.15.194:0/3668595685 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7feddc0346a0 0x7feddc036b60 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x5636c26c53e0 tx=0x7fef08023040 comp rx=0 tx=0).stop 2024-09-13T06:10:00.109 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.103+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636c26df3a0 msgr2=0x5636c26e6580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.109 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.103+0000 7fef14e39640 1 -- 172.21.15.194:0/3668595685 reap_dead start 2024-09-13T06:10:00.109 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.103+0000 7fef16b28980 1 --2- 172.21.15.194:0/3668595685 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636c26df3a0 0x5636c26e6580 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fef040c57d0 tx=0x7fef040b3ef0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.109 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.103+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 shutdown_connections 2024-09-13T06:10:00.109 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.103+0000 7fef16b28980 1 --2- 172.21.15.194:0/3668595685 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636c26df3a0 0x5636c26e6580 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.109 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.103+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 >> 172.21.15.194:0/3668595685 conn(0x5636c26db780 msgr2=0x5636c26d9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:00.109 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.103+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 shutdown_connections 2024-09-13T06:10:00.109 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.103+0000 7fef16b28980 1 -- 172.21.15.194:0/3668595685 wait complete. 2024-09-13T06:10:00.109 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.103+0000 7fef16b28980 1 -- 172.21.15.194:0/1021090674 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fedec034650 msgr2=0x7fedec036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.109 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.103+0000 7fef16b28980 1 --2- 172.21.15.194:0/1021090674 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fedec034650 0x7fedec036b10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x5636c26bcbb0 tx=0x7fef08006000 comp rx=0 tx=0).stop 2024-09-13T06:10:00.109 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.103+0000 7fef16b28980 1 -- 172.21.15.194:0/1021090674 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636c26d2ab0 msgr2=0x5636c26d2ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.109 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.103+0000 7fef16b28980 1 --2- 172.21.15.194:0/1021090674 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636c26d2ab0 0x5636c26d2ed0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fef040cf900 tx=0x7fef040bcdc0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.110 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.103+0000 7fef16b28980 1 -- 172.21.15.194:0/1021090674 shutdown_connections 2024-09-13T06:10:00.110 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.103+0000 7fef16b28980 1 --2- 172.21.15.194:0/1021090674 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fedec034650 0x7fedec036b10 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.110 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.103+0000 7fef16b28980 1 --2- 172.21.15.194:0/1021090674 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636c26d2ab0 0x5636c26d2ed0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.110 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.103+0000 7fef16b28980 1 -- 172.21.15.194:0/1021090674 >> 172.21.15.194:0/1021090674 conn(0x5636c26c7c00 msgr2=0x5636c26ca680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:00.110 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.103+0000 7fef16b28980 1 -- 172.21.15.194:0/1021090674 shutdown_connections 2024-09-13T06:10:00.110 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.103+0000 7fef16b28980 1 -- 172.21.15.194:0/1021090674 wait complete. 2024-09-13T06:10:00.110 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.107+0000 7fef16b28980 1 -- 172.21.15.194:0/1042542835 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5636c25c3870 msgr2=0x5636c26bbc60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.110 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.107+0000 7fef16b28980 1 --2- 172.21.15.194:0/1042542835 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5636c25c3870 0x5636c26bbc60 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.110 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.107+0000 7fef16b28980 1 -- 172.21.15.194:0/1042542835 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5636c26c24f0 msgr2=0x5636c26c48e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.110 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.107+0000 7fef16b28980 1 --2- 172.21.15.194:0/1042542835 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5636c26c24f0 0x5636c26c48e0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.110 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.107+0000 7fef16b28980 1 -- 172.21.15.194:0/1042542835 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5636c26be600 msgr2=0x5636c26c09f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.110 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.107+0000 7fef16b28980 1 --2- 172.21.15.194:0/1042542835 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5636c26be600 0x5636c26c09f0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.110 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.107+0000 7fef16b28980 1 -- 172.21.15.194:0/1042542835 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fedfc034650 msgr2=0x7fedfc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.111 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.107+0000 7fef16b28980 1 --2- 172.21.15.194:0/1042542835 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fedfc034650 0x7fedfc036b10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fef08000c10 tx=0x7fef080013c0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.111 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.107+0000 7fef16b28980 1 -- 172.21.15.194:0/1042542835 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636c2534b00 msgr2=0x5636c26b4c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.111 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.107+0000 7fef16b28980 1 --2- 172.21.15.194:0/1042542835 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5636c2534b00 0x5636c26b4c90 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fef0401bbe0 tx=0x7fef040180e0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.111 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.107+0000 7fef14e39640 1 -- 172.21.15.194:0/1042542835 reap_dead start 2024-09-13T06:10:00.111 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.107+0000 7fef16b28980 1 -- 172.21.15.194:0/1042542835 shutdown_connections 2024-09-13T06:10:00.111 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.107+0000 7fef16b28980 1 -- 172.21.15.194:0/1042542835 >> 172.21.15.194:0/1042542835 conn(0x5636c25bb060 msgr2=0x5636c25bf6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:00.111 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.107+0000 7fef16b28980 1 -- 172.21.15.194:0/1042542835 shutdown_connections 2024-09-13T06:10:00.111 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.107+0000 7fef16b28980 1 -- 172.21.15.194:0/1042542835 wait complete. 2024-09-13T06:10:00.117 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-13T06:10:00.117 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-13T06:10:00.117 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --tenant testx --uid tenanteduser --display-name tenanted-user --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-09-13T06:10:00.202 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:10:00.202 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:10:00.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.203+0000 7fae298ad980 1 Processor -- start 2024-09-13T06:10:00.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.203+0000 7fae298ad980 1 -- start start 2024-09-13T06:10:00.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.203+0000 7fae298ad980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x563d66550a60 0x563d665df310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.203+0000 7fae298ad980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563d66464ae0 con 0x563d665df850 2024-09-13T06:10:00.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.203+0000 7fae298ad980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x563d66488e30 con 0x563d66550a60 2024-09-13T06:10:00.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.203+0000 7fae273bd640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x563d66550a60 0x563d665df310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.203+0000 7fae26bbc640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x563d665df850 0x563d665e1c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:51240/0 (socket says 172.21.15.194:51240) 2024-09-13T06:10:00.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.203+0000 7fae26bbc640 1 -- 172.21.15.194:0/4209699062 learned_addr learned my addr 172.21.15.194:0/4209699062 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-09-13T06:10:00.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.203+0000 7fae273bd640 1 -- 172.21.15.194:0/4209699062 >> v1:172.21.15.120:6789/0 conn(0x563d665df850 legacy=0x563d665e1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.203+0000 7fae273bd640 1 -- 172.21.15.194:0/4209699062 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d665e4370 con 0x563d66550a60 2024-09-13T06:10:00.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.207+0000 7fae273bd640 1 --2- 172.21.15.194:0/4209699062 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563d66550a60 0x563d665df310 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fae2000a420 tx=0x7fae2001afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e5b15b0e2704624 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.207+0000 7fae263bb640 1 -- 172.21.15.194:0/4209699062 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae200af070 con 0x563d66550a60 2024-09-13T06:10:00.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.207+0000 7fae263bb640 1 -- 172.21.15.194:0/4209699062 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae200aa530 con 0x563d66550a60 2024-09-13T06:10:00.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.207+0000 7fae263bb640 1 -- 172.21.15.194:0/4209699062 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae200aa850 con 0x563d66550a60 2024-09-13T06:10:00.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.207+0000 7fae298ad980 1 -- 172.21.15.194:0/4209699062 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563d66550a60 msgr2=0x563d665df310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.207+0000 7fae298ad980 1 --2- 172.21.15.194:0/4209699062 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563d66550a60 0x563d665df310 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fae2000a420 tx=0x7fae2001afd0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.207+0000 7fae298ad980 1 -- 172.21.15.194:0/4209699062 shutdown_connections 2024-09-13T06:10:00.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.207+0000 7fae298ad980 1 --2- 172.21.15.194:0/4209699062 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563d66550a60 0x563d665df310 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.207+0000 7fae298ad980 1 -- 172.21.15.194:0/4209699062 >> 172.21.15.194:0/4209699062 conn(0x563d665d7000 msgr2=0x563d665d9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:00.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.207+0000 7fae298ad980 1 -- 172.21.15.194:0/4209699062 shutdown_connections 2024-09-13T06:10:00.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.207+0000 7fae298ad980 1 -- 172.21.15.194:0/4209699062 wait complete. 2024-09-13T06:10:00.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.219+0000 7fae298ad980 1 Processor -- start 2024-09-13T06:10:00.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.219+0000 7fae298ad980 1 -- start start 2024-09-13T06:10:00.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.219+0000 7fae298ad980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563d66550a60 0x563d665dca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.219+0000 7fae298ad980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x563d6648a200 con 0x563d66550a60 2024-09-13T06:10:00.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.219+0000 7fae273bd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563d66550a60 0x563d665dca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.219+0000 7fae273bd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563d66550a60 0x563d665dca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45956/0 (socket says 172.21.15.194:45956) 2024-09-13T06:10:00.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.219+0000 7fae273bd640 1 -- 172.21.15.194:0/1616108848 learned_addr learned my addr 172.21.15.194:0/1616108848 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:00.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.219+0000 7fae273bd640 1 -- 172.21.15.194:0/1616108848 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d665dd040 con 0x563d66550a60 2024-09-13T06:10:00.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.219+0000 7fae273bd640 1 --2- 172.21.15.194:0/1616108848 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563d66550a60 0x563d665dca70 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fae2000a420 tx=0x7fae200033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b19ef7bfb0d017a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.219+0000 7fad1560a640 1 -- 172.21.15.194:0/1616108848 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae200af050 con 0x563d66550a60 2024-09-13T06:10:00.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.219+0000 7fad1560a640 1 -- 172.21.15.194:0/1616108848 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae200b0040 con 0x563d66550a60 2024-09-13T06:10:00.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.219+0000 7fad1560a640 1 -- 172.21.15.194:0/1616108848 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae200aac60 con 0x563d66550a60 2024-09-13T06:10:00.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.223+0000 7fae298ad980 1 -- 172.21.15.194:0/1616108848 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563d66550a60 msgr2=0x563d665dca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.223+0000 7fae298ad980 1 --2- 172.21.15.194:0/1616108848 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563d66550a60 0x563d665dca70 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fae2000a420 tx=0x7fae200033b0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.223+0000 7fae298ad980 1 -- 172.21.15.194:0/1616108848 shutdown_connections 2024-09-13T06:10:00.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.223+0000 7fae298ad980 1 --2- 172.21.15.194:0/1616108848 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563d66550a60 0x563d665dca70 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.223+0000 7fae298ad980 1 -- 172.21.15.194:0/1616108848 >> 172.21.15.194:0/1616108848 conn(0x563d665d7000 msgr2=0x563d666c36e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:00.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.223+0000 7fae298ad980 1 -- 172.21.15.194:0/1616108848 shutdown_connections 2024-09-13T06:10:00.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.223+0000 7fae298ad980 1 -- 172.21.15.194:0/1616108848 wait complete. 2024-09-13T06:10:00.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.223+0000 7fae298ad980 1 Processor -- start 2024-09-13T06:10:00.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.223+0000 7fae298ad980 1 -- start start 2024-09-13T06:10:00.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.223+0000 7fae298ad980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563d665df850 0x563d666d1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.223+0000 7fae298ad980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x563d665e3db0 con 0x563d665df850 2024-09-13T06:10:00.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.223+0000 7fae273bd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563d665df850 0x563d666d1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.223+0000 7fae273bd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563d665df850 0x563d666d1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45972/0 (socket says 172.21.15.194:45972) 2024-09-13T06:10:00.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.223+0000 7fae273bd640 1 -- 172.21.15.194:0/2184543568 learned_addr learned my addr 172.21.15.194:0/2184543568 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:00.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.223+0000 7fae273bd640 1 -- 172.21.15.194:0/2184543568 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d666d1670 con 0x563d665df850 2024-09-13T06:10:00.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.223+0000 7fae273bd640 1 --2- 172.21.15.194:0/2184543568 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563d665df850 0x563d666d1130 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fae20000f90 tx=0x7fae20019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.223+0000 7fad13e07640 1 -- 172.21.15.194:0/2184543568 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae200c5030 con 0x563d665df850 2024-09-13T06:10:00.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.223+0000 7fad13e07640 1 -- 172.21.15.194:0/2184543568 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae200c15b0 con 0x563d665df850 2024-09-13T06:10:00.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.223+0000 7fad13e07640 1 -- 172.21.15.194:0/2184543568 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae200c18d0 con 0x563d665df850 2024-09-13T06:10:00.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.223+0000 7fae298ad980 1 -- 172.21.15.194:0/2184543568 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563d666d1900 con 0x563d665df850 2024-09-13T06:10:00.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.223+0000 7fae298ad980 1 -- 172.21.15.194:0/2184543568 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d666d45e0 con 0x563d665df850 2024-09-13T06:10:00.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.227+0000 7fad13e07640 1 -- 172.21.15.194:0/2184543568 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fae200c8070 con 0x563d665df850 2024-09-13T06:10:00.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.227+0000 7fad13e07640 1 --2- 172.21.15.194:0/2184543568 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fad0c034650 0x7fad0c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.227+0000 7fad13e07640 1 -- 172.21.15.194:0/2184543568 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fae200c6070 con 0x563d665df850 2024-09-13T06:10:00.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.227+0000 7fae26bbc640 1 --2- 172.21.15.194:0/2184543568 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fad0c034650 0x7fad0c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.227+0000 7fae298ad980 1 --2- 172.21.15.194:0/2184543568 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x563d666d6220 0x563d666d8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.227+0000 7fae298ad980 1 -- 172.21.15.194:0/2184543568 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563d666d8b90 con 0x563d666d6220 2024-09-13T06:10:00.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.227+0000 7fae27bbe640 1 --2- 172.21.15.194:0/2184543568 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x563d666d6220 0x563d666d8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.227+0000 7fae26bbc640 1 --2- 172.21.15.194:0/2184543568 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fad0c034650 0x7fad0c036b10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fae1c000f70 tx=0x7fae1c0012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.227+0000 7fae27bbe640 1 --2- 172.21.15.194:0/2184543568 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x563d666d6220 0x563d666d8610 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.227+0000 7fae27bbe640 1 -- 172.21.15.194:0/2184543568 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fae180083f0 con 0x563d666d6220 2024-09-13T06:10:00.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.227+0000 7fae298ad980 1 -- 172.21.15.194:0/2184543568 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563d666d5800 con 0x563d666d6220 2024-09-13T06:10:00.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.227+0000 7fae27bbe640 1 -- 172.21.15.194:0/2184543568 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fae180083f0 con 0x563d666d6220 2024-09-13T06:10:00.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.227+0000 7fae298ad980 1 --2- 172.21.15.194:0/2184543568 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x563d666daef0 0x563d666dd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.227+0000 7fae298ad980 1 -- 172.21.15.194:0/2184543568 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563d666dd9b0 con 0x563d666daef0 2024-09-13T06:10:00.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.227+0000 7fae273bd640 1 --2- 172.21.15.194:0/2184543568 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x563d666daef0 0x563d666dd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.232 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.227+0000 7fae273bd640 1 --2- 172.21.15.194:0/2184543568 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x563d666daef0 0x563d666dd2e0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.232 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.227+0000 7fae273bd640 1 -- 172.21.15.194:0/2184543568 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fae200b2070 con 0x563d666daef0 2024-09-13T06:10:00.232 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.227+0000 7fae298ad980 1 -- 172.21.15.194:0/2184543568 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563d666d9d90 con 0x563d666d6220 2024-09-13T06:10:00.232 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.227+0000 7fae27bbe640 1 -- 172.21.15.194:0/2184543568 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fae180083f0 con 0x563d666d6220 2024-09-13T06:10:00.232 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.227+0000 7fae298ad980 1 --2- 172.21.15.194:0/2184543568 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x563d666dee10 0x563d666e1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.227+0000 7fae298ad980 1 -- 172.21.15.194:0/2184543568 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563d666e1900 con 0x563d666dee10 2024-09-13T06:10:00.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.227+0000 7fae26bbc640 1 --2- 172.21.15.194:0/2184543568 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x563d666dee10 0x563d666e1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.227+0000 7fae26bbc640 1 --2- 172.21.15.194:0/2184543568 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x563d666dee10 0x563d666e1200 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.227+0000 7fae26bbc640 1 -- 172.21.15.194:0/2184543568 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fae1c00e620 con 0x563d666dee10 2024-09-13T06:10:00.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.231+0000 7fae298ad980 1 Processor -- start 2024-09-13T06:10:00.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.231+0000 7fae298ad980 1 -- start start 2024-09-13T06:10:00.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.231+0000 7fae298ad980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563d666ef3d0 0x563d666ef7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.231+0000 7fae298ad980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x563d664e3800 con 0x563d666ef3d0 2024-09-13T06:10:00.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.231+0000 7fae273bd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563d666ef3d0 0x563d666ef7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.231+0000 7fae273bd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563d666ef3d0 0x563d666ef7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45980/0 (socket says 172.21.15.194:45980) 2024-09-13T06:10:00.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.231+0000 7fae273bd640 1 -- 172.21.15.194:0/2750736530 learned_addr learned my addr 172.21.15.194:0/2750736530 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:00.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.231+0000 7fae273bd640 1 -- 172.21.15.194:0/2750736530 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d666efd30 con 0x563d666ef3d0 2024-09-13T06:10:00.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.231+0000 7fae273bd640 1 --2- 172.21.15.194:0/2750736530 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563d666ef3d0 0x563d666ef7f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fae200a3c50 tx=0x7fae200a9aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.231+0000 7fad11602640 1 -- 172.21.15.194:0/2750736530 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae200bf580 con 0x563d666ef3d0 2024-09-13T06:10:00.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.231+0000 7fae298ad980 1 -- 172.21.15.194:0/2750736530 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563d666effc0 con 0x563d666ef3d0 2024-09-13T06:10:00.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.231+0000 7fad11602640 1 -- 172.21.15.194:0/2750736530 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae200e2070 con 0x563d666ef3d0 2024-09-13T06:10:00.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.231+0000 7fad11602640 1 -- 172.21.15.194:0/2750736530 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae200bf850 con 0x563d666ef3d0 2024-09-13T06:10:00.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.231+0000 7fae298ad980 1 -- 172.21.15.194:0/2750736530 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d666f2c40 con 0x563d666ef3d0 2024-09-13T06:10:00.238 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.231+0000 7fad11602640 1 -- 172.21.15.194:0/2750736530 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fae200e7070 con 0x563d666ef3d0 2024-09-13T06:10:00.238 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.231+0000 7fad11602640 1 --2- 172.21.15.194:0/2750736530 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fad00034650 0x7fad00036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.238 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.231+0000 7fad11602640 1 -- 172.21.15.194:0/2750736530 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fae200bb070 con 0x563d666ef3d0 2024-09-13T06:10:00.238 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.231+0000 7fae26bbc640 1 --2- 172.21.15.194:0/2750736530 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fad00034650 0x7fad00036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.238 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.231+0000 7fae298ad980 1 Processor -- start 2024-09-13T06:10:00.238 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.231+0000 7fae298ad980 1 -- start start 2024-09-13T06:10:00.238 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.231+0000 7fae26bbc640 1 --2- 172.21.15.194:0/2750736530 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fad00034650 0x7fad00036b10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fae1c00bf60 tx=0x7fae1c00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.238 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.231+0000 7fae298ad980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563d666fbc60 0x563d666fc040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.238 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.231+0000 7fae298ad980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x563d665db1a0 con 0x563d666fbc60 2024-09-13T06:10:00.238 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.235+0000 7fae273bd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563d666fbc60 0x563d666fc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.238 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.235+0000 7fae273bd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563d666fbc60 0x563d666fc040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45990/0 (socket says 172.21.15.194:45990) 2024-09-13T06:10:00.238 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.235+0000 7fae273bd640 1 -- 172.21.15.194:0/1053696682 learned_addr learned my addr 172.21.15.194:0/1053696682 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:00.239 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.235+0000 7fae273bd640 1 -- 172.21.15.194:0/1053696682 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d666fc610 con 0x563d666fbc60 2024-09-13T06:10:00.239 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.235+0000 7fae273bd640 1 --2- 172.21.15.194:0/1053696682 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563d666fbc60 0x563d666fc040 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fae200b5f70 tx=0x7fae200b5960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67c850d60146928f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.239 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.235+0000 7fad0affd640 1 -- 172.21.15.194:0/1053696682 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae200fc020 con 0x563d666fbc60 2024-09-13T06:10:00.239 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.235+0000 7fad0affd640 1 -- 172.21.15.194:0/1053696682 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae200baea0 con 0x563d666fbc60 2024-09-13T06:10:00.239 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.235+0000 7fad0affd640 1 -- 172.21.15.194:0/1053696682 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae200c0920 con 0x563d666fbc60 2024-09-13T06:10:00.239 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.235+0000 7fae298ad980 1 -- 172.21.15.194:0/1053696682 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563d666fbc60 msgr2=0x563d666fc040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.239 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.235+0000 7fae298ad980 1 --2- 172.21.15.194:0/1053696682 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563d666fbc60 0x563d666fc040 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fae200b5f70 tx=0x7fae200b5960 comp rx=0 tx=0).stop 2024-09-13T06:10:00.239 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.235+0000 7fae298ad980 1 -- 172.21.15.194:0/1053696682 shutdown_connections 2024-09-13T06:10:00.239 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.235+0000 7fae298ad980 1 --2- 172.21.15.194:0/1053696682 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563d666fbc60 0x563d666fc040 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.235+0000 7fae298ad980 1 -- 172.21.15.194:0/1053696682 >> 172.21.15.194:0/1053696682 conn(0x563d666f8040 msgr2=0x563d666f6140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:00.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.235+0000 7fae298ad980 1 -- 172.21.15.194:0/1053696682 shutdown_connections 2024-09-13T06:10:00.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.235+0000 7fae298ad980 1 -- 172.21.15.194:0/1053696682 wait complete. 2024-09-13T06:10:00.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.235+0000 7fae298ad980 1 Processor -- start 2024-09-13T06:10:00.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.235+0000 7fae298ad980 1 -- start start 2024-09-13T06:10:00.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.235+0000 7fae298ad980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563d666fbc60 0x563d66702da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.235+0000 7fae298ad980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x563d666fcab0 con 0x563d666fbc60 2024-09-13T06:10:00.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.235+0000 7fae273bd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563d666fbc60 0x563d66702da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.235+0000 7fae273bd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563d666fbc60 0x563d66702da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:46006/0 (socket says 172.21.15.194:46006) 2024-09-13T06:10:00.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.235+0000 7fae273bd640 1 -- 172.21.15.194:0/2357936129 learned_addr learned my addr 172.21.15.194:0/2357936129 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:00.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.235+0000 7fae273bd640 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d667032e0 con 0x563d666fbc60 2024-09-13T06:10:00.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.235+0000 7fae273bd640 1 --2- 172.21.15.194:0/2357936129 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563d666fbc60 0x563d66702da0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fae200b5a30 tx=0x7fae200bf9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.235+0000 7fad097fa640 1 -- 172.21.15.194:0/2357936129 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae20110070 con 0x563d666fbc60 2024-09-13T06:10:00.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.235+0000 7fad097fa640 1 -- 172.21.15.194:0/2357936129 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae200b5c80 con 0x563d666fbc60 2024-09-13T06:10:00.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.235+0000 7fae298ad980 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563d667032e0 con 0x563d666fbc60 2024-09-13T06:10:00.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.235+0000 7fad097fa640 1 -- 172.21.15.194:0/2357936129 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae200b8410 con 0x563d666fbc60 2024-09-13T06:10:00.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.235+0000 7fae298ad980 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d667032e0 con 0x563d666fbc60 2024-09-13T06:10:00.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.239+0000 7fad097fa640 1 -- 172.21.15.194:0/2357936129 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fae20113070 con 0x563d666fbc60 2024-09-13T06:10:00.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.239+0000 7fad097fa640 1 --2- 172.21.15.194:0/2357936129 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7facf00346a0 0x7facf0036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.247 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.239+0000 7fad097fa640 1 -- 172.21.15.194:0/2357936129 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fae20108050 con 0x563d666fbc60 2024-09-13T06:10:00.247 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.239+0000 7fae26bbc640 1 --2- 172.21.15.194:0/2357936129 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7facf00346a0 0x7facf0036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.247 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.239+0000 7fae298ad980 20 rados->read ofs=0 len=0 2024-09-13T06:10:00.247 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.239+0000 7fae298ad980 1 --2- 172.21.15.194:0/2357936129 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x563d6670dd40 0x563d66710200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.247 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.239+0000 7fae298ad980 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563d66710950 con 0x563d6670dd40 2024-09-13T06:10:00.247 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.239+0000 7fae27bbe640 1 --2- 172.21.15.194:0/2357936129 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x563d6670dd40 0x563d66710200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.247 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.239+0000 7fae26bbc640 1 --2- 172.21.15.194:0/2357936129 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7facf00346a0 0x7facf0036b60 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x563d666d94a0 tx=0x7fae1c010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.247 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.239+0000 7fae27bbe640 1 --2- 172.21.15.194:0/2357936129 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x563d6670dd40 0x563d66710200 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.247 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.239+0000 7fae27bbe640 1 -- 172.21.15.194:0/2357936129 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fae180083f0 con 0x563d6670dd40 2024-09-13T06:10:00.247 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.239+0000 7fae298ad980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:00.247 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.239+0000 7fae298ad980 20 realm 2024-09-13T06:10:00.247 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.239+0000 7fae298ad980 20 rados->read ofs=0 len=0 2024-09-13T06:10:00.248 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.239+0000 7fae298ad980 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563d66710d60 con 0x563d6670dd40 2024-09-13T06:10:00.248 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.239+0000 7fae27bbe640 1 -- 172.21.15.194:0/2357936129 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fae180083f0 con 0x563d6670dd40 2024-09-13T06:10:00.248 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.239+0000 7fae298ad980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:00.248 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.239+0000 7fae298ad980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:10:00.248 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.239+0000 7fae298ad980 20 rados->read ofs=0 len=0 2024-09-13T06:10:00.248 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.239+0000 7fae298ad980 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563d66711630 con 0x563d6670dd40 2024-09-13T06:10:00.248 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.239+0000 7fae27bbe640 1 -- 172.21.15.194:0/2357936129 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fae180083f0 con 0x563d6670dd40 2024-09-13T06:10:00.248 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.239+0000 7fae298ad980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:00.248 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.239+0000 7fae298ad980 20 rados->read ofs=0 len=0 2024-09-13T06:10:00.248 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.239+0000 7fae298ad980 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563d667119d0 con 0x563d6670dd40 2024-09-13T06:10:00.248 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.239+0000 7fae27bbe640 1 -- 172.21.15.194:0/2357936129 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fae180083f0 con 0x563d6670dd40 2024-09-13T06:10:00.248 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.239+0000 7fae298ad980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:10:00.249 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.239+0000 7fae298ad980 20 rados->read ofs=0 len=0 2024-09-13T06:10:00.249 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.239+0000 7fae298ad980 1 --2- 172.21.15.194:0/2357936129 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x563d66712730 0x563d66714b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.249 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.239+0000 7fae298ad980 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563d66715130 con 0x563d66712730 2024-09-13T06:10:00.249 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.239+0000 7fae273bd640 1 --2- 172.21.15.194:0/2357936129 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x563d66712730 0x563d66714b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.249 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.239+0000 7fae273bd640 1 --2- 172.21.15.194:0/2357936129 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x563d66712730 0x563d66714b20 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.249 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.239+0000 7fae273bd640 1 -- 172.21.15.194:0/2357936129 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fae20112030 con 0x563d66712730 2024-09-13T06:10:00.249 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.239+0000 7fae298ad980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:10:00.249 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.239+0000 7fae298ad980 20 searching for the correct realm 2024-09-13T06:10:00.249 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.239+0000 7fae298ad980 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563d66716a00 con 0x563d66712730 2024-09-13T06:10:00.249 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.239+0000 7fae273bd640 1 -- 172.21.15.194:0/2357936129 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae20112030 con 0x563d66712730 2024-09-13T06:10:00.249 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.239+0000 7fae273bd640 1 --2- 172.21.15.194:0/2357936129 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fae20115060 0x7fae200db2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.249 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.239+0000 7fae273bd640 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563d66716a00 con 0x7fae20115060 2024-09-13T06:10:00.249 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.239+0000 7fae26bbc640 1 --2- 172.21.15.194:0/2357936129 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fae20115060 0x7fae200db2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.243+0000 7fae26bbc640 1 --2- 172.21.15.194:0/2357936129 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fae20115060 0x7fae200db2b0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.243+0000 7fae26bbc640 1 -- 172.21.15.194:0/2357936129 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fae1c00e620 con 0x7fae20115060 2024-09-13T06:10:00.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.243+0000 7fae26bbc640 1 --2- 172.21.15.194:0/2357936129 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fae1c037040 0x7fae1c036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.243+0000 7fae26bbc640 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563d66716a00 con 0x7fae1c037040 2024-09-13T06:10:00.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.243+0000 7fae27bbe640 1 --2- 172.21.15.194:0/2357936129 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fae1c037040 0x7fae1c036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.243+0000 7fae27bbe640 1 --2- 172.21.15.194:0/2357936129 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fae1c037040 0x7fae1c036410 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.243+0000 7fae27bbe640 1 -- 172.21.15.194:0/2357936129 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae180083f0 con 0x7fae1c037040 2024-09-13T06:10:00.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.243+0000 7fae27bbe640 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563d667119d0 con 0x563d6670dd40 2024-09-13T06:10:00.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.243+0000 7fae27bbe640 1 -- 172.21.15.194:0/2357936129 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae180083f0 con 0x563d6670dd40 2024-09-13T06:10:00.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.243+0000 7fae27bbe640 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563d667119d0 con 0x563d6670dd40 2024-09-13T06:10:00.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.243+0000 7fae27bbe640 1 -- 172.21.15.194:0/2357936129 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae180083f0 con 0x563d6670dd40 2024-09-13T06:10:00.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.243+0000 7fae27bbe640 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563d667119d0 con 0x7fae1c037040 2024-09-13T06:10:00.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.243+0000 7fae27bbe640 1 -- 172.21.15.194:0/2357936129 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae180083f0 con 0x7fae1c037040 2024-09-13T06:10:00.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.243+0000 7fae27bbe640 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563d667119d0 con 0x7fae1c037040 2024-09-13T06:10:00.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.243+0000 7fae27bbe640 1 -- 172.21.15.194:0/2357936129 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae180083f0 con 0x7fae1c037040 2024-09-13T06:10:00.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.243+0000 7fae27bbe640 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563d667119d0 con 0x7fae20115060 2024-09-13T06:10:00.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.243+0000 7fae26bbc640 1 -- 172.21.15.194:0/2357936129 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae1c00e620 con 0x7fae20115060 2024-09-13T06:10:00.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.243+0000 7fae26bbc640 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563d667119d0 con 0x563d66712730 2024-09-13T06:10:00.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.243+0000 7fae273bd640 1 -- 172.21.15.194:0/2357936129 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae20112030 con 0x563d66712730 2024-09-13T06:10:00.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.243+0000 7fae273bd640 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563d667119d0 con 0x563d6670dd40 2024-09-13T06:10:00.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.247+0000 7fae27bbe640 1 -- 172.21.15.194:0/2357936129 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae180083f0 con 0x563d6670dd40 2024-09-13T06:10:00.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.247+0000 7fae27bbe640 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563d667119d0 con 0x7fae1c037040 2024-09-13T06:10:00.258 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.247+0000 7fae27bbe640 1 -- 172.21.15.194:0/2357936129 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae180083f0 con 0x7fae1c037040 2024-09-13T06:10:00.258 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.247+0000 7fae27bbe640 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563d667119d0 con 0x563d6670dd40 2024-09-13T06:10:00.258 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.247+0000 7fae27bbe640 1 -- 172.21.15.194:0/2357936129 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae180083f0 con 0x563d6670dd40 2024-09-13T06:10:00.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.247+0000 7fae27bbe640 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563d667119d0 con 0x7fae20115060 2024-09-13T06:10:00.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.247+0000 7fae26bbc640 1 -- 172.21.15.194:0/2357936129 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fae1c00e620 con 0x7fae20115060 2024-09-13T06:10:00.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.247+0000 7fae26bbc640 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563d667119d0 con 0x563d66712730 2024-09-13T06:10:00.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.247+0000 7fae273bd640 1 -- 172.21.15.194:0/2357936129 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae20112030 con 0x563d66712730 2024-09-13T06:10:00.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.247+0000 7fae273bd640 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563d667119d0 con 0x563d66712730 2024-09-13T06:10:00.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.247+0000 7fae273bd640 1 -- 172.21.15.194:0/2357936129 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae20112030 con 0x563d66712730 2024-09-13T06:10:00.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.247+0000 7fae273bd640 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563d667119d0 con 0x7fae1c037040 2024-09-13T06:10:00.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.247+0000 7fae27bbe640 1 -- 172.21.15.194:0/2357936129 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae180083f0 con 0x7fae1c037040 2024-09-13T06:10:00.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.247+0000 7fae27bbe640 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563d667119d0 con 0x563d66712730 2024-09-13T06:10:00.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.247+0000 7fae273bd640 1 -- 172.21.15.194:0/2357936129 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae20112030 con 0x563d66712730 2024-09-13T06:10:00.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.247+0000 7fae273bd640 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563d667119d0 con 0x563d66712730 2024-09-13T06:10:00.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.247+0000 7fae273bd640 1 -- 172.21.15.194:0/2357936129 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae20112030 con 0x563d66712730 2024-09-13T06:10:00.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.247+0000 7fae273bd640 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563d667119d0 con 0x563d6670dd40 2024-09-13T06:10:00.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.247+0000 7fae27bbe640 1 -- 172.21.15.194:0/2357936129 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae180083f0 con 0x563d6670dd40 2024-09-13T06:10:00.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.247+0000 7fae27bbe640 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563d667119d0 con 0x563d6670dd40 2024-09-13T06:10:00.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.247+0000 7fae27bbe640 1 -- 172.21.15.194:0/2357936129 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fae180083f0 con 0x563d6670dd40 2024-09-13T06:10:00.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.247+0000 7fae27bbe640 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563d667119d0 con 0x7fae1c037040 2024-09-13T06:10:00.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.247+0000 7fae27bbe640 1 -- 172.21.15.194:0/2357936129 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae180083f0 con 0x7fae1c037040 2024-09-13T06:10:00.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.247+0000 7fae27bbe640 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563d667119d0 con 0x563d66712730 2024-09-13T06:10:00.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.251+0000 7fae273bd640 1 -- 172.21.15.194:0/2357936129 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae20112030 con 0x563d66712730 2024-09-13T06:10:00.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.251+0000 7fae273bd640 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563d667119d0 con 0x7fae20115060 2024-09-13T06:10:00.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.251+0000 7fae26bbc640 1 -- 172.21.15.194:0/2357936129 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae1c00e620 con 0x7fae20115060 2024-09-13T06:10:00.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.251+0000 7fae26bbc640 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563d667119d0 con 0x563d6670dd40 2024-09-13T06:10:00.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.251+0000 7fae27bbe640 1 -- 172.21.15.194:0/2357936129 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae180083f0 con 0x563d6670dd40 2024-09-13T06:10:00.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.251+0000 7fae27bbe640 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563d667119d0 con 0x7fae1c037040 2024-09-13T06:10:00.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.251+0000 7fae27bbe640 1 -- 172.21.15.194:0/2357936129 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae180083f0 con 0x7fae1c037040 2024-09-13T06:10:00.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.251+0000 7fae27bbe640 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563d667119d0 con 0x563d66712730 2024-09-13T06:10:00.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.251+0000 7fae273bd640 1 -- 172.21.15.194:0/2357936129 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fae20112030 con 0x563d66712730 2024-09-13T06:10:00.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.251+0000 7fae273bd640 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563d667119d0 con 0x7fae1c037040 2024-09-13T06:10:00.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.251+0000 7fae27bbe640 1 -- 172.21.15.194:0/2357936129 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae180083f0 con 0x7fae1c037040 2024-09-13T06:10:00.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.251+0000 7fae27bbe640 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563d667119d0 con 0x7fae20115060 2024-09-13T06:10:00.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.251+0000 7fae26bbc640 1 -- 172.21.15.194:0/2357936129 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae1c00e620 con 0x7fae20115060 2024-09-13T06:10:00.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.251+0000 7fae26bbc640 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563d667119d0 con 0x563d66712730 2024-09-13T06:10:00.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.251+0000 7fae273bd640 1 -- 172.21.15.194:0/2357936129 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae20112030 con 0x563d66712730 2024-09-13T06:10:00.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.251+0000 7fae273bd640 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563d667119d0 con 0x7fae1c037040 2024-09-13T06:10:00.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.251+0000 7fae27bbe640 1 -- 172.21.15.194:0/2357936129 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae180083f0 con 0x7fae1c037040 2024-09-13T06:10:00.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.251+0000 7fae27bbe640 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563d667119d0 con 0x563d6670dd40 2024-09-13T06:10:00.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.251+0000 7fae27bbe640 1 -- 172.21.15.194:0/2357936129 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fae180083f0 con 0x563d6670dd40 2024-09-13T06:10:00.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.251+0000 7fae27bbe640 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x563d667119d0 con 0x7fae20115060 2024-09-13T06:10:00.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.251+0000 7fae26bbc640 1 -- 172.21.15.194:0/2357936129 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae1c00e620 con 0x7fae20115060 2024-09-13T06:10:00.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.251+0000 7fae298ad980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:10:00.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.251+0000 7fae298ad980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:10:00.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.251+0000 7fae298ad980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:10:00.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.251+0000 7fae298ad980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:10:00.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.251+0000 7fae298ad980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:10:00.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.251+0000 7fae298ad980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:10:00.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.251+0000 7fae298ad980 20 rados->read ofs=0 len=0 2024-09-13T06:10:00.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.251+0000 7fae298ad980 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563d66715ab0 con 0x563d6670dd40 2024-09-13T06:10:00.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.251+0000 7fae27bbe640 1 -- 172.21.15.194:0/2357936129 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fae180083f0 con 0x563d6670dd40 2024-09-13T06:10:00.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.251+0000 7fae298ad980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:00.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.251+0000 7fae298ad980 20 rados->read ofs=0 len=0 2024-09-13T06:10:00.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.251+0000 7fae298ad980 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563d66716350 con 0x563d6670dd40 2024-09-13T06:10:00.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.251+0000 7fae27bbe640 1 -- 172.21.15.194:0/2357936129 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fae180083f0 con 0x563d6670dd40 2024-09-13T06:10:00.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.251+0000 7fae298ad980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:10:00.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.251+0000 7fae298ad980 20 rados->read ofs=0 len=0 2024-09-13T06:10:00.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.251+0000 7fae298ad980 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563d66715ea0 con 0x7fae20115060 2024-09-13T06:10:00.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.255+0000 7fae26bbc640 1 -- 172.21.15.194:0/2357936129 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fae1c00e620 con 0x7fae20115060 2024-09-13T06:10:00.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.255+0000 7fae298ad980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:10:00.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.255+0000 7fae298ad980 20 zone default found 2024-09-13T06:10:00.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.255+0000 7fae298ad980 4 Realm: () 2024-09-13T06:10:00.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.255+0000 7fae298ad980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:10:00.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.255+0000 7fae298ad980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:10:00.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.255+0000 7fae298ad980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:10:00.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.255+0000 7fae298ad980 20 zonegroup default 2024-09-13T06:10:00.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.255+0000 7fae298ad980 20 rados->read ofs=0 len=0 2024-09-13T06:10:00.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.255+0000 7fae298ad980 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563d66716e30 con 0x7fae1c037040 2024-09-13T06:10:00.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.255+0000 7fae27bbe640 1 -- 172.21.15.194:0/2357936129 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fae180083f0 con 0x7fae1c037040 2024-09-13T06:10:00.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.255+0000 7fae298ad980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:00.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.255+0000 7fae298ad980 20 rados->read ofs=0 len=0 2024-09-13T06:10:00.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.255+0000 7fae298ad980 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563d66718810 con 0x563d66712730 2024-09-13T06:10:00.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.255+0000 7fae273bd640 1 -- 172.21.15.194:0/2357936129 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fae20112030 con 0x563d66712730 2024-09-13T06:10:00.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.255+0000 7fae298ad980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:00.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.255+0000 7fae298ad980 20 rados->read ofs=0 len=0 2024-09-13T06:10:00.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.255+0000 7fae298ad980 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563d66718d60 con 0x563d66712730 2024-09-13T06:10:00.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.255+0000 7fae273bd640 1 -- 172.21.15.194:0/2357936129 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fae20112030 con 0x563d66712730 2024-09-13T06:10:00.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.255+0000 7fae298ad980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:00.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.255+0000 7fae298ad980 20 started sync module instance, tier type = 2024-09-13T06:10:00.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.255+0000 7fae298ad980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:10:00.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.255+0000 7fae298ad980 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563d66716830 con 0x7fae20115060 2024-09-13T06:10:00.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.255+0000 7fae26bbc640 1 -- 172.21.15.194:0/2357936129 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(44 notify.0 [create] v33'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae1c00e620 con 0x7fae20115060 2024-09-13T06:10:00.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.255+0000 7fae298ad980 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94821711707520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563d667191c0 con 0x7fae20115060 2024-09-13T06:10:00.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.255+0000 7fae298ad980 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563d66719c00 con 0x563d6670dd40 2024-09-13T06:10:00.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.259+0000 7fae27bbe640 1 -- 172.21.15.194:0/2357936129 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v33'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae180083f0 con 0x563d6670dd40 2024-09-13T06:10:00.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.259+0000 7fae298ad980 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94821711714000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563d6671a4a0 con 0x563d6670dd40 2024-09-13T06:10:00.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.259+0000 7fae298ad980 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563d6671aee0 con 0x563d66712730 2024-09-13T06:10:00.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.259+0000 7fae26bbc640 1 -- 172.21.15.194:0/2357936129 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94821711707520] v33'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae1c00e620 con 0x7fae20115060 2024-09-13T06:10:00.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.259+0000 7fae273bd640 1 -- 172.21.15.194:0/2357936129 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v33'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae20112030 con 0x563d66712730 2024-09-13T06:10:00.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.259+0000 7fae298ad980 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94821711718832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563d6671b2d0 con 0x563d66712730 2024-09-13T06:10:00.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.259+0000 7fae298ad980 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563d6671bc90 con 0x7fae20115060 2024-09-13T06:10:00.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.259+0000 7fae27bbe640 1 -- 172.21.15.194:0/2357936129 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94821711714000] v33'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae180083f0 con 0x563d6670dd40 2024-09-13T06:10:00.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.263+0000 7fae26bbc640 1 -- 172.21.15.194:0/2357936129 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(50 notify.3 [create] v33'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae1c00e620 con 0x7fae20115060 2024-09-13T06:10:00.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.263+0000 7fae298ad980 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94821711716336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563d6671c530 con 0x7fae20115060 2024-09-13T06:10:00.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.263+0000 7fae298ad980 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563d6671cd80 con 0x563d6670dd40 2024-09-13T06:10:00.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.263+0000 7fae273bd640 1 -- 172.21.15.194:0/2357936129 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94821711718832] v33'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae20112030 con 0x563d66712730 2024-09-13T06:10:00.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.263+0000 7fae27bbe640 1 -- 172.21.15.194:0/2357936129 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v33'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae180083f0 con 0x563d6670dd40 2024-09-13T06:10:00.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.263+0000 7fae298ad980 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94821711725872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563d6671d170 con 0x563d6670dd40 2024-09-13T06:10:00.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.263+0000 7fae298ad980 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563d6671d9c0 con 0x7fae1c037040 2024-09-13T06:10:00.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.263+0000 7fae26bbc640 1 -- 172.21.15.194:0/2357936129 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94821711716336] v33'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae1c00e620 con 0x7fae20115060 2024-09-13T06:10:00.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.263+0000 7fae27bbe640 1 -- 172.21.15.194:0/2357936129 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(54 notify.5 [create] v33'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae180083f0 con 0x7fae1c037040 2024-09-13T06:10:00.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.263+0000 7fae298ad980 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94821711728496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563d6671d840 con 0x7fae1c037040 2024-09-13T06:10:00.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.263+0000 7fae298ad980 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563d6671d840 con 0x7fae1c037040 2024-09-13T06:10:00.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.263+0000 7fae27bbe640 1 -- 172.21.15.194:0/2357936129 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94821711725872] v33'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae180083f0 con 0x563d6670dd40 2024-09-13T06:10:00.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.267+0000 7fae27bbe640 1 -- 172.21.15.194:0/2357936129 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94821711728496] v33'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae180083f0 con 0x7fae1c037040 2024-09-13T06:10:00.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.267+0000 7fae27bbe640 1 -- 172.21.15.194:0/2357936129 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(56 notify.6 [create] v33'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae180083f0 con 0x7fae1c037040 2024-09-13T06:10:00.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.267+0000 7fae298ad980 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94821711729552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563d6671dc60 con 0x7fae1c037040 2024-09-13T06:10:00.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.267+0000 7fae298ad980 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563d6671e4f0 con 0x7fae1c037040 2024-09-13T06:10:00.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.267+0000 7fae27bbe640 1 -- 172.21.15.194:0/2357936129 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(58 notify.7 [create] v33'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae180083f0 con 0x7fae1c037040 2024-09-13T06:10:00.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.267+0000 7fae298ad980 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94821711732320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563d6671e910 con 0x7fae1c037040 2024-09-13T06:10:00.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.271+0000 7fae298ad980 20 add_watcher() i=0 2024-09-13T06:10:00.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.271+0000 7fae298ad980 20 add_watcher() i=1 2024-09-13T06:10:00.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.271+0000 7fae298ad980 20 add_watcher() i=2 2024-09-13T06:10:00.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.271+0000 7fae298ad980 20 add_watcher() i=3 2024-09-13T06:10:00.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.271+0000 7fae298ad980 20 add_watcher() i=4 2024-09-13T06:10:00.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.271+0000 7fae298ad980 20 add_watcher() i=5 2024-09-13T06:10:00.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.271+0000 7fae27bbe640 1 -- 172.21.15.194:0/2357936129 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94821711729552] v33'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae180083f0 con 0x7fae1c037040 2024-09-13T06:10:00.272 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.271+0000 7fae298ad980 20 add_watcher() i=6 2024-09-13T06:10:00.272 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.271+0000 7fae27bbe640 1 -- 172.21.15.194:0/2357936129 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94821711732320] v33'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae180083f0 con 0x7fae1c037040 2024-09-13T06:10:00.272 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.271+0000 7fae298ad980 20 add_watcher() i=7 2024-09-13T06:10:00.273 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.271+0000 7fae298ad980 2 all 8 watchers are set, enabling cache 2024-09-13T06:10:00.273 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.271+0000 7fae298ad980 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563d6671d7b0 con 0x563d6670dd40 2024-09-13T06:10:00.273 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.271+0000 7fae27bbe640 1 -- 172.21.15.194:0/2357936129 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fae180083f0 con 0x563d6670dd40 2024-09-13T06:10:00.273 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.271+0000 7fae298ad980 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94821711730608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563d6671ee50 con 0x563d6670dd40 2024-09-13T06:10:00.275 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.271+0000 7fae27bbe640 1 -- 172.21.15.194:0/2357936129 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94821711730608] v33'126 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fae180083f0 con 0x563d6670dd40 2024-09-13T06:10:00.275 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.271+0000 7facddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:10:00.275 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.271+0000 7fae298ad980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:10:00.275 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.271+0000 7fae298ad980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:10:00.275 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.271+0000 7fae298ad980 5 note: GC not initialized 2024-09-13T06:10:00.275 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.271+0000 7facdcfe1640 20 reqs_thread_entry: start 2024-09-13T06:10:00.275 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.271+0000 7fae298ad980 20 init_complete bucket index max shards: 11 2024-09-13T06:10:00.275 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.271+0000 7fae298ad980 20 Filter name: none 2024-09-13T06:10:00.275 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.271+0000 7fac567fc640 20 reqs_thread_entry: start 2024-09-13T06:10:00.276 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.271+0000 7fae298ad980 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-13T06:10:00.276 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.271+0000 7fae298ad980 20 rados->read ofs=0 len=0 2024-09-13T06:10:00.276 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.271+0000 7fae298ad980 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563d66745280 con 0x7fae1c037040 2024-09-13T06:10:00.276 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.275+0000 7fae27bbe640 1 -- 172.21.15.194:0/2357936129 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(62 testx$tenanteduser [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 246+0+0 (crc 0 0 0) 0x7fae180083f0 con 0x7fae1c037040 2024-09-13T06:10:00.276 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.275+0000 7fae298ad980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:00.276 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.275+0000 7fae298ad980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x0 2024-09-13T06:10:00.276 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.275+0000 7fae298ad980 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-13T06:10:00.276 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.275+0000 7fae298ad980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-13T06:10:00.276 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.275+0000 7fae298ad980 20 rados->read ofs=0 len=0 2024-09-13T06:10:00.276 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.275+0000 7fae298ad980 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563d66743970 con 0x7fae1c037040 2024-09-13T06:10:00.276 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.275+0000 7fae27bbe640 1 -- 172.21.15.194:0/2357936129 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fae180083f0 con 0x7fae1c037040 2024-09-13T06:10:00.276 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.275+0000 7fae298ad980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:00.276 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.275+0000 7fae298ad980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-13T06:10:00.277 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.275+0000 7fae298ad980 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T06:10:00.277 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.275+0000 7fae298ad980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-13T06:10:00.277 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.275+0000 7fae298ad980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-13T06:10:00.277 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.275+0000 7fae298ad980 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:64 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [delete,create,call version.set in=58b,writefull 0~419 in=419b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563d66747ed0 con 0x7fae1c037040 2024-09-13T06:10:00.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.275+0000 7fae27bbe640 1 -- 172.21.15.194:0/2357936129 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(64 testx$tenanteduser [delete,create,call,writefull 0~419] v33'5 uv5 ondisk = 0) ==== 288+0+0 (crc 0 0 0) 0x7fae180083f0 con 0x7fae1c037040 2024-09-13T06:10:00.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.275+0000 7fae298ad980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-09-13T06:10:00.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.275+0000 7fae298ad980 10 moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-13T06:10:00.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.275+0000 7fae298ad980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-09-13T06:10:00.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.275+0000 7fae298ad980 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:65 7.e 7:7759931f:::notify.3:head [notify cookie 94821711902864 in=622b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563d66748a00 con 0x7fae20115060 2024-09-13T06:10:00.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.275+0000 7fae26bbc640 1 -- 172.21.15.194:0/2357936129 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== watch-notify(notify (1) cookie 94821711716336 notify 141733920780 ret 0) ==== 652+0+0 (crc 0 0 0) 0x563d66464ae0 con 0x7fae20115060 2024-09-13T06:10:00.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.275+0000 7fad0affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920780 cookie 94821711716336 notifier 4535 bl.length()=610 2024-09-13T06:10:00.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.275+0000 7fad0affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-09-13T06:10:00.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.275+0000 7fad0affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-13T06:10:00.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.275+0000 7fae26bbc640 1 -- 172.21.15.194:0/2357936129 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(65 notify.3 [notify cookie 94821711902864 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fae1c00e620 con 0x7fae20115060 2024-09-13T06:10:00.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.275+0000 7fad0affd640 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:66 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7facec003eb0 con 0x7fae20115060 2024-09-13T06:10:00.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.275+0000 7fae26bbc640 1 -- 172.21.15.194:0/2357936129 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(66 notify.3 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae1c00e620 con 0x7fae20115060 2024-09-13T06:10:00.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.275+0000 7fae26bbc640 1 -- 172.21.15.194:0/2357936129 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== watch-notify(notify_complete (2) cookie 94821711902864 notify 141733920780 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fae1c036c40 con 0x7fae20115060 2024-09-13T06:10:00.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.275+0000 7fae298ad980 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563d667489a0 con 0x7fae1c037040 2024-09-13T06:10:00.280 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.279+0000 7fae27bbe640 1 -- 172.21.15.194:0/2357936129 <== osd.0 v2:172.21.15.120:6800/1923744619 20 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~22] v33'6 uv6 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fae180083f0 con 0x7fae1c037040 2024-09-13T06:10:00.280 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.279+0000 7fae298ad980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-13T06:10:00.280 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.279+0000 7fae298ad980 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T06:10:00.281 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.279+0000 7fae298ad980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-13T06:10:00.281 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.279+0000 7fae298ad980 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94821711902768 in=204b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563d667489a0 con 0x563d66712730 2024-09-13T06:10:00.281 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.279+0000 7fae273bd640 1 -- 172.21.15.194:0/2357936129 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== watch-notify(notify (1) cookie 94821711718832 notify 141733920778 ret 0) ==== 234+0+0 (crc 0 0 0) 0x563d666effc0 con 0x563d66712730 2024-09-13T06:10:00.281 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.279+0000 7fad0affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920778 cookie 94821711718832 notifier 4535 bl.length()=192 2024-09-13T06:10:00.281 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.279+0000 7fad0affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-13T06:10:00.281 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.279+0000 7fad0affd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T06:10:00.281 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.279+0000 7fad0affd640 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7facec003eb0 con 0x563d66712730 2024-09-13T06:10:00.281 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.279+0000 7fae273bd640 1 -- 172.21.15.194:0/2357936129 <== osd.3 v2:172.21.15.194:6816/96632515 16 ==== osd_op_reply(68 notify.2 [notify cookie 94821711902768 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fae20112030 con 0x563d66712730 2024-09-13T06:10:00.281 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.279+0000 7fae273bd640 1 -- 172.21.15.194:0/2357936129 <== osd.3 v2:172.21.15.194:6816/96632515 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae20112030 con 0x563d66712730 2024-09-13T06:10:00.281 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.279+0000 7fae273bd640 1 -- 172.21.15.194:0/2357936129 <== osd.3 v2:172.21.15.194:6816/96632515 18 ==== watch-notify(notify_complete (2) cookie 94821711902768 notify 141733920778 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563d666efd30 con 0x563d66712730 2024-09-13T06:10:00.282 INFO:teuthology.orchestra.run.smithi194.stdout:{"user_id":"testx$tenanteduser","display_name":"tenanted-user","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"testx$tenanteduser","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-13T06:10:00.277579Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:10:00.277561Z","tags":[],"group_ids":[]} 2024-09-13T06:10:00.282 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.279+0000 7facddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:10:00.282 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.279+0000 7fae298ad980 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94821711730608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563d66742e80 con 0x563d6670dd40 2024-09-13T06:10:00.282 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.279+0000 7fae27bbe640 1 -- 172.21.15.194:0/2357936129 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94821711730608] v33'127 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fae180083f0 con 0x563d6670dd40 2024-09-13T06:10:00.282 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.279+0000 7fae298ad980 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94821711707520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563d66742e80 con 0x7fae20115060 2024-09-13T06:10:00.283 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.283+0000 7fae26bbc640 1 -- 172.21.15.194:0/2357936129 <== osd.2 v2:172.21.15.194:6800/815615585 16 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94821711707520] v33'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae1c00e620 con 0x7fae20115060 2024-09-13T06:10:00.283 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.283+0000 7fae298ad980 20 remove_watcher() i=0 2024-09-13T06:10:00.284 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.283+0000 7fae298ad980 2 removed watcher, disabling cache 2024-09-13T06:10:00.284 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.283+0000 7fae298ad980 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94821711714000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563d66742e80 con 0x563d6670dd40 2024-09-13T06:10:00.285 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.283+0000 7fae27bbe640 1 -- 172.21.15.194:0/2357936129 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94821711714000] v33'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae180083f0 con 0x563d6670dd40 2024-09-13T06:10:00.285 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.283+0000 7fae298ad980 20 remove_watcher() i=1 2024-09-13T06:10:00.285 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.283+0000 7fae298ad980 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94821711718832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563d66742e80 con 0x563d66712730 2024-09-13T06:10:00.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.287+0000 7fae273bd640 1 -- 172.21.15.194:0/2357936129 <== osd.3 v2:172.21.15.194:6816/96632515 19 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94821711718832] v33'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae20112030 con 0x563d66712730 2024-09-13T06:10:00.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.287+0000 7fae298ad980 20 remove_watcher() i=2 2024-09-13T06:10:00.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.287+0000 7fae298ad980 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94821711716336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563d66742e80 con 0x7fae20115060 2024-09-13T06:10:00.288 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.287+0000 7fae26bbc640 1 -- 172.21.15.194:0/2357936129 <== osd.2 v2:172.21.15.194:6800/815615585 17 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94821711716336] v33'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae1c00e620 con 0x7fae20115060 2024-09-13T06:10:00.288 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.287+0000 7fae298ad980 20 remove_watcher() i=3 2024-09-13T06:10:00.288 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.287+0000 7fae298ad980 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94821711725872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563d66719ff0 con 0x563d6670dd40 2024-09-13T06:10:00.290 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.287+0000 7fae27bbe640 1 -- 172.21.15.194:0/2357936129 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94821711725872] v33'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae180083f0 con 0x563d6670dd40 2024-09-13T06:10:00.290 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.287+0000 7fae298ad980 20 remove_watcher() i=4 2024-09-13T06:10:00.290 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.287+0000 7fae298ad980 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94821711728496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563d66742e80 con 0x7fae1c037040 2024-09-13T06:10:00.291 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.291+0000 7fae27bbe640 1 -- 172.21.15.194:0/2357936129 <== osd.0 v2:172.21.15.120:6800/1923744619 21 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94821711728496] v33'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae180083f0 con 0x7fae1c037040 2024-09-13T06:10:00.291 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.291+0000 7fae298ad980 20 remove_watcher() i=5 2024-09-13T06:10:00.292 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.291+0000 7fae298ad980 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94821711729552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563d6671c530 con 0x7fae1c037040 2024-09-13T06:10:00.294 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.291+0000 7fae27bbe640 1 -- 172.21.15.194:0/2357936129 <== osd.0 v2:172.21.15.120:6800/1923744619 22 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94821711729552] v33'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae180083f0 con 0x7fae1c037040 2024-09-13T06:10:00.294 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.291+0000 7fae298ad980 20 remove_watcher() i=6 2024-09-13T06:10:00.294 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.291+0000 7fae298ad980 1 -- 172.21.15.194:0/2357936129 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94821711732320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x563d66742e80 con 0x7fae1c037040 2024-09-13T06:10:00.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.295+0000 7fae27bbe640 1 -- 172.21.15.194:0/2357936129 <== osd.0 v2:172.21.15.120:6800/1923744619 23 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94821711732320] v33'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae180083f0 con 0x7fae1c037040 2024-09-13T06:10:00.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.295+0000 7fae298ad980 20 remove_watcher() i=7 2024-09-13T06:10:00.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.295+0000 7fae298ad980 1 -- 172.21.15.194:0/2357936129 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fae1c037040 msgr2=0x7fae1c036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.295+0000 7fae298ad980 1 --2- 172.21.15.194:0/2357936129 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fae1c037040 0x7fae1c036410 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.295+0000 7fae298ad980 1 -- 172.21.15.194:0/2357936129 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x563d6670dd40 msgr2=0x563d66710200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.295+0000 7fae298ad980 1 --2- 172.21.15.194:0/2357936129 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x563d6670dd40 0x563d66710200 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.295+0000 7fae298ad980 1 -- 172.21.15.194:0/2357936129 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fae20115060 msgr2=0x7fae200db2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.295+0000 7fae298ad980 1 --2- 172.21.15.194:0/2357936129 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fae20115060 0x7fae200db2b0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.295+0000 7fae298ad980 1 -- 172.21.15.194:0/2357936129 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x563d66712730 msgr2=0x563d66714b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.295+0000 7fae298ad980 1 --2- 172.21.15.194:0/2357936129 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x563d66712730 0x563d66714b20 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.300 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.295+0000 7fae298ad980 1 -- 172.21.15.194:0/2357936129 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7facf00346a0 msgr2=0x7facf0036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.300 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.295+0000 7fae298ad980 1 --2- 172.21.15.194:0/2357936129 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7facf00346a0 0x7facf0036b60 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x563d666d94a0 tx=0x7fae1c010000 comp rx=0 tx=0).stop 2024-09-13T06:10:00.300 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.295+0000 7fae298ad980 1 -- 172.21.15.194:0/2357936129 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563d666fbc60 msgr2=0x563d66702da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.300 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.295+0000 7fae27bbe640 1 -- 172.21.15.194:0/2357936129 reap_dead start 2024-09-13T06:10:00.300 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.295+0000 7fae298ad980 1 --2- 172.21.15.194:0/2357936129 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563d666fbc60 0x563d66702da0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fae200b5a30 tx=0x7fae200bf9f0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.300 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.295+0000 7fae298ad980 1 -- 172.21.15.194:0/2357936129 shutdown_connections 2024-09-13T06:10:00.300 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.295+0000 7fae298ad980 1 --2- 172.21.15.194:0/2357936129 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563d666fbc60 0x563d66702da0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.300 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.295+0000 7fae298ad980 1 -- 172.21.15.194:0/2357936129 >> 172.21.15.194:0/2357936129 conn(0x563d666f8040 msgr2=0x563d666f6110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:00.300 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.295+0000 7fae298ad980 1 -- 172.21.15.194:0/2357936129 shutdown_connections 2024-09-13T06:10:00.300 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.295+0000 7fae298ad980 1 -- 172.21.15.194:0/2357936129 wait complete. 2024-09-13T06:10:00.300 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.295+0000 7fae298ad980 1 -- 172.21.15.194:0/2750736530 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fad00034650 msgr2=0x7fad00036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.300 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.295+0000 7fae298ad980 1 --2- 172.21.15.194:0/2750736530 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fad00034650 0x7fad00036b10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fae1c00bf60 tx=0x7fae1c00f000 comp rx=0 tx=0).stop 2024-09-13T06:10:00.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.295+0000 7fae298ad980 1 -- 172.21.15.194:0/2750736530 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563d666ef3d0 msgr2=0x563d666ef7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.295+0000 7fae298ad980 1 --2- 172.21.15.194:0/2750736530 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563d666ef3d0 0x563d666ef7f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fae200a3c50 tx=0x7fae200a9aa0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.295+0000 7fae298ad980 1 -- 172.21.15.194:0/2750736530 shutdown_connections 2024-09-13T06:10:00.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.295+0000 7fae298ad980 1 --2- 172.21.15.194:0/2750736530 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fad00034650 0x7fad00036b10 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.295+0000 7fae298ad980 1 --2- 172.21.15.194:0/2750736530 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563d666ef3d0 0x563d666ef7f0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.295+0000 7fae298ad980 1 -- 172.21.15.194:0/2750736530 >> 172.21.15.194:0/2750736530 conn(0x563d666e4520 msgr2=0x563d666e6fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:00.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.295+0000 7fae298ad980 1 -- 172.21.15.194:0/2750736530 shutdown_connections 2024-09-13T06:10:00.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.295+0000 7fae298ad980 1 -- 172.21.15.194:0/2750736530 wait complete. 2024-09-13T06:10:00.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.295+0000 7fae298ad980 1 -- 172.21.15.194:0/2184543568 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x563d666d6220 msgr2=0x563d666d8610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.295+0000 7fae298ad980 1 --2- 172.21.15.194:0/2184543568 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x563d666d6220 0x563d666d8610 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.295+0000 7fae298ad980 1 -- 172.21.15.194:0/2184543568 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x563d666dee10 msgr2=0x563d666e1200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.295+0000 7fae298ad980 1 --2- 172.21.15.194:0/2184543568 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x563d666dee10 0x563d666e1200 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.295+0000 7fae298ad980 1 -- 172.21.15.194:0/2184543568 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x563d666daef0 msgr2=0x563d666dd2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.295+0000 7fae298ad980 1 --2- 172.21.15.194:0/2184543568 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x563d666daef0 0x563d666dd2e0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.295+0000 7fae298ad980 1 -- 172.21.15.194:0/2184543568 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fad0c034650 msgr2=0x7fad0c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.295+0000 7fae298ad980 1 --2- 172.21.15.194:0/2184543568 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fad0c034650 0x7fad0c036b10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fae1c000f70 tx=0x7fae1c0012c0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.295+0000 7fae298ad980 1 -- 172.21.15.194:0/2184543568 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563d665df850 msgr2=0x563d666d1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.295+0000 7fae298ad980 1 --2- 172.21.15.194:0/2184543568 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563d665df850 0x563d666d1130 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fae20000f90 tx=0x7fae20019810 comp rx=0 tx=0).stop 2024-09-13T06:10:00.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.295+0000 7fae27bbe640 1 -- 172.21.15.194:0/2184543568 reap_dead start 2024-09-13T06:10:00.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.295+0000 7fae298ad980 1 -- 172.21.15.194:0/2184543568 shutdown_connections 2024-09-13T06:10:00.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.295+0000 7fae298ad980 1 -- 172.21.15.194:0/2184543568 >> 172.21.15.194:0/2184543568 conn(0x563d665d7000 msgr2=0x563d665db740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:00.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.295+0000 7fae298ad980 1 -- 172.21.15.194:0/2184543568 shutdown_connections 2024-09-13T06:10:00.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.295+0000 7fae298ad980 1 -- 172.21.15.194:0/2184543568 wait complete. 2024-09-13T06:10:00.307 DEBUG:tasks.util.rgw: json result: {'user_id': 'testx$tenanteduser', 'display_name': 'tenanted-user', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'testx$tenanteduser', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-13T06:10:00.277579Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:10:00.277561Z', 'tags': [], 'group_ids': []} 2024-09-13T06:10:00.307 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-13T06:10:00.307 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-13T06:10:00.307 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket /myfoo --tenant testx --uid tenanteduser 2024-09-13T06:10:00.385 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:10:00.385 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:10:00.386 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.383+0000 7f2f6610f980 1 Processor -- start 2024-09-13T06:10:00.386 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.383+0000 7f2f6610f980 1 -- start start 2024-09-13T06:10:00.386 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.383+0000 7f2f6610f980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x5621a200ca60 0x5621a200ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.386 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.383+0000 7f2f6610f980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5621a1e96ae0 con 0x5621a200d380 2024-09-13T06:10:00.386 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.383+0000 7f2f6610f980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x5621a1ebae30 con 0x5621a200ca60 2024-09-13T06:10:00.387 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.383+0000 7f2f63c1f640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x5621a200ca60 0x5621a200ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.387 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.387+0000 7f2f6341e640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x5621a200d380 0x5621a2013b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:51252/0 (socket says 172.21.15.194:51252) 2024-09-13T06:10:00.387 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.387+0000 7f2f6341e640 1 -- 172.21.15.194:0/938583169 learned_addr learned my addr 172.21.15.194:0/938583169 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-09-13T06:10:00.387 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.387+0000 7f2f63c1f640 1 -- 172.21.15.194:0/938583169 >> v1:172.21.15.120:6789/0 conn(0x5621a200d380 legacy=0x5621a2013b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.387 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.387+0000 7f2f63c1f640 1 -- 172.21.15.194:0/938583169 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621a2016260 con 0x5621a200ca60 2024-09-13T06:10:00.393 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.387+0000 7f2f63c1f640 1 --2- 172.21.15.194:0/938583169 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5621a200ca60 0x5621a200ce40 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f2f5400a480 tx=0x7f2f5401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34fee3934022fccc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.393 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.387+0000 7f2f62c1d640 1 -- 172.21.15.194:0/938583169 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f540b0070 con 0x5621a200ca60 2024-09-13T06:10:00.393 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.391+0000 7f2f62c1d640 1 -- 172.21.15.194:0/938583169 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f540ab540 con 0x5621a200ca60 2024-09-13T06:10:00.393 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.391+0000 7f2f62c1d640 1 -- 172.21.15.194:0/938583169 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f540ab840 con 0x5621a200ca60 2024-09-13T06:10:00.393 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.391+0000 7f2f6610f980 1 -- 172.21.15.194:0/938583169 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5621a200ca60 msgr2=0x5621a200ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.394 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.391+0000 7f2f6610f980 1 --2- 172.21.15.194:0/938583169 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5621a200ca60 0x5621a200ce40 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f2f5400a480 tx=0x7f2f5401b280 comp rx=0 tx=0).stop 2024-09-13T06:10:00.394 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.391+0000 7f2f6610f980 1 -- 172.21.15.194:0/938583169 shutdown_connections 2024-09-13T06:10:00.394 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.391+0000 7f2f6610f980 1 --2- 172.21.15.194:0/938583169 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5621a200ca60 0x5621a200ce40 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.394 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.391+0000 7f2f6610f980 1 -- 172.21.15.194:0/938583169 >> 172.21.15.194:0/938583169 conn(0x5621a2008740 msgr2=0x5621a200ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:00.394 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.391+0000 7f2f6610f980 1 -- 172.21.15.194:0/938583169 shutdown_connections 2024-09-13T06:10:00.394 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.391+0000 7f2f6610f980 1 -- 172.21.15.194:0/938583169 wait complete. 2024-09-13T06:10:00.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.403+0000 7f2f6610f980 1 Processor -- start 2024-09-13T06:10:00.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.403+0000 7f2f6610f980 1 -- start start 2024-09-13T06:10:00.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.403+0000 7f2f6610f980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5621a200ca60 0x5621a20f99e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.403+0000 7f2f6610f980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5621a1ebc200 con 0x5621a200ca60 2024-09-13T06:10:00.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.403+0000 7f2f63c1f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5621a200ca60 0x5621a20f99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.403+0000 7f2f63c1f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5621a200ca60 0x5621a20f99e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:46026/0 (socket says 172.21.15.194:46026) 2024-09-13T06:10:00.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.403+0000 7f2f63c1f640 1 -- 172.21.15.194:0/2283795174 learned_addr learned my addr 172.21.15.194:0/2283795174 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:00.408 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.403+0000 7f2f63c1f640 1 -- 172.21.15.194:0/2283795174 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621a20f9fb0 con 0x5621a200ca60 2024-09-13T06:10:00.408 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.403+0000 7f2f63c1f640 1 --2- 172.21.15.194:0/2283795174 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5621a200ca60 0x5621a20f99e0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f2f540ae040 tx=0x7f2f54003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25b69ae4580c1be3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.408 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.403+0000 7f2e51e0b640 1 -- 172.21.15.194:0/2283795174 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f540b0040 con 0x5621a200ca60 2024-09-13T06:10:00.408 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.403+0000 7f2e51e0b640 1 -- 172.21.15.194:0/2283795174 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f540ab9b0 con 0x5621a200ca60 2024-09-13T06:10:00.408 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.403+0000 7f2e51e0b640 1 -- 172.21.15.194:0/2283795174 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f540abc90 con 0x5621a200ca60 2024-09-13T06:10:00.408 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.407+0000 7f2f6610f980 1 -- 172.21.15.194:0/2283795174 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5621a200ca60 msgr2=0x5621a20f99e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.408 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.407+0000 7f2f6610f980 1 --2- 172.21.15.194:0/2283795174 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5621a200ca60 0x5621a20f99e0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f2f540ae040 tx=0x7f2f54003030 comp rx=0 tx=0).stop 2024-09-13T06:10:00.408 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.407+0000 7f2f6610f980 1 -- 172.21.15.194:0/2283795174 shutdown_connections 2024-09-13T06:10:00.408 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.407+0000 7f2f6610f980 1 --2- 172.21.15.194:0/2283795174 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5621a200ca60 0x5621a20f99e0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.407+0000 7f2f6610f980 1 -- 172.21.15.194:0/2283795174 >> 172.21.15.194:0/2283795174 conn(0x5621a2008740 msgr2=0x5621a20f5610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:00.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.407+0000 7f2f6610f980 1 -- 172.21.15.194:0/2283795174 shutdown_connections 2024-09-13T06:10:00.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.407+0000 7f2f6610f980 1 -- 172.21.15.194:0/2283795174 wait complete. 2024-09-13T06:10:00.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.407+0000 7f2f6610f980 1 Processor -- start 2024-09-13T06:10:00.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.407+0000 7f2f6610f980 1 -- start start 2024-09-13T06:10:00.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.407+0000 7f2f6610f980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5621a200ca60 0x5621a2100c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.407+0000 7f2f6610f980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5621a2015d60 con 0x5621a200ca60 2024-09-13T06:10:00.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.407+0000 7f2f63c1f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5621a200ca60 0x5621a2100c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.407+0000 7f2f63c1f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5621a200ca60 0x5621a2100c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:46040/0 (socket says 172.21.15.194:46040) 2024-09-13T06:10:00.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.407+0000 7f2f63c1f640 1 -- 172.21.15.194:0/1646092024 learned_addr learned my addr 172.21.15.194:0/1646092024 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:00.412 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.407+0000 7f2f63c1f640 1 -- 172.21.15.194:0/1646092024 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621a21011b0 con 0x5621a200ca60 2024-09-13T06:10:00.412 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.407+0000 7f2f63c1f640 1 --2- 172.21.15.194:0/1646092024 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5621a200ca60 0x5621a2100c70 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f2f540030b0 tx=0x7f2f54018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.407+0000 7f2e4bfff640 1 -- 172.21.15.194:0/1646092024 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f540c5070 con 0x5621a200ca60 2024-09-13T06:10:00.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.407+0000 7f2e4bfff640 1 -- 172.21.15.194:0/1646092024 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f540b6970 con 0x5621a200ca60 2024-09-13T06:10:00.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.407+0000 7f2f6610f980 1 -- 172.21.15.194:0/1646092024 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5621a2101440 con 0x5621a200ca60 2024-09-13T06:10:00.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.407+0000 7f2f6610f980 1 -- 172.21.15.194:0/1646092024 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621a2104120 con 0x5621a200ca60 2024-09-13T06:10:00.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.407+0000 7f2e4bfff640 1 -- 172.21.15.194:0/1646092024 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f540b0050 con 0x5621a200ca60 2024-09-13T06:10:00.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.411+0000 7f2e4bfff640 1 -- 172.21.15.194:0/1646092024 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f2f540c8070 con 0x5621a200ca60 2024-09-13T06:10:00.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.411+0000 7f2e4bfff640 1 --2- 172.21.15.194:0/1646092024 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f2e4c034650 0x7f2e4c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.411+0000 7f2e4bfff640 1 -- 172.21.15.194:0/1646092024 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f2f540bc070 con 0x5621a200ca60 2024-09-13T06:10:00.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.411+0000 7f2f6341e640 1 --2- 172.21.15.194:0/1646092024 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f2e4c034650 0x7f2e4c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.411+0000 7f2f6610f980 1 --2- 172.21.15.194:0/1646092024 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5621a200d380 0x5621a2107c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.411+0000 7f2f6610f980 1 -- 172.21.15.194:0/1646092024 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5621a2108290 con 0x5621a200d380 2024-09-13T06:10:00.414 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.411+0000 7f2f64420640 1 --2- 172.21.15.194:0/1646092024 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5621a200d380 0x5621a2107c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.414 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.411+0000 7f2f6341e640 1 --2- 172.21.15.194:0/1646092024 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f2e4c034650 0x7f2e4c036b10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c000f70 tx=0x7f2f4c0012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.414 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.411+0000 7f2f64420640 1 --2- 172.21.15.194:0/1646092024 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5621a200d380 0x5621a2107c20 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.414 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.411+0000 7f2f64420640 1 -- 172.21.15.194:0/1646092024 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f5c00a4d0 con 0x5621a200d380 2024-09-13T06:10:00.414 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.411+0000 7f2f6610f980 1 -- 172.21.15.194:0/1646092024 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5621a2105340 con 0x5621a200d380 2024-09-13T06:10:00.414 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.411+0000 7f2f64420640 1 -- 172.21.15.194:0/1646092024 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2f5c00a4d0 con 0x5621a200d380 2024-09-13T06:10:00.414 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.411+0000 7f2f6610f980 1 --2- 172.21.15.194:0/1646092024 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5621a210a5c0 0x5621a210c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.414 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.411+0000 7f2f6610f980 1 -- 172.21.15.194:0/1646092024 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5621a210d080 con 0x5621a210a5c0 2024-09-13T06:10:00.414 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.411+0000 7f2f63c1f640 1 --2- 172.21.15.194:0/1646092024 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5621a210a5c0 0x5621a210c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.414 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.411+0000 7f2f63c1f640 1 --2- 172.21.15.194:0/1646092024 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5621a210a5c0 0x5621a210c9b0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.414 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.411+0000 7f2f63c1f640 1 -- 172.21.15.194:0/1646092024 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2f540c7030 con 0x5621a210a5c0 2024-09-13T06:10:00.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.411+0000 7f2f6610f980 1 -- 172.21.15.194:0/1646092024 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5621a2109460 con 0x5621a200d380 2024-09-13T06:10:00.418 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.411+0000 7f2f64420640 1 -- 172.21.15.194:0/1646092024 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2f5c00a4d0 con 0x5621a200d380 2024-09-13T06:10:00.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.411+0000 7f2f6610f980 1 --2- 172.21.15.194:0/1646092024 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5621a210e4c0 0x5621a21108b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.411+0000 7f2f6610f980 1 -- 172.21.15.194:0/1646092024 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5621a2111040 con 0x5621a210e4c0 2024-09-13T06:10:00.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.411+0000 7f2f6341e640 1 --2- 172.21.15.194:0/1646092024 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5621a210e4c0 0x5621a21108b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.411+0000 7f2f6341e640 1 --2- 172.21.15.194:0/1646092024 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5621a210e4c0 0x5621a21108b0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.411+0000 7f2f6341e640 1 -- 172.21.15.194:0/1646092024 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2f4c00e620 con 0x5621a210e4c0 2024-09-13T06:10:00.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.411+0000 7f2f6610f980 1 Processor -- start 2024-09-13T06:10:00.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.411+0000 7f2f6610f980 1 -- start start 2024-09-13T06:10:00.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.415+0000 7f2f6610f980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5621a200f480 0x5621a200db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.415+0000 7f2f6610f980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5621a1f15800 con 0x5621a200f480 2024-09-13T06:10:00.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.415+0000 7f2f63c1f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5621a200f480 0x5621a200db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.415+0000 7f2f63c1f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5621a200f480 0x5621a200db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:46046/0 (socket says 172.21.15.194:46046) 2024-09-13T06:10:00.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.415+0000 7f2f63c1f640 1 -- 172.21.15.194:0/3438424441 learned_addr learned my addr 172.21.15.194:0/3438424441 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:00.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.415+0000 7f2f63c1f640 1 -- 172.21.15.194:0/3438424441 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621a200f8a0 con 0x5621a200f480 2024-09-13T06:10:00.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.415+0000 7f2f63c1f640 1 --2- 172.21.15.194:0/3438424441 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5621a200f480 0x5621a200db00 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f2f540e1fd0 tx=0x7f2f540aacb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.415+0000 7f2e497fa640 1 -- 172.21.15.194:0/3438424441 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f540d5040 con 0x5621a200f480 2024-09-13T06:10:00.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.415+0000 7f2e497fa640 1 -- 172.21.15.194:0/3438424441 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f540ad000 con 0x5621a200f480 2024-09-13T06:10:00.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.415+0000 7f2e497fa640 1 -- 172.21.15.194:0/3438424441 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f540ad1b0 con 0x5621a200f480 2024-09-13T06:10:00.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.415+0000 7f2f6610f980 1 -- 172.21.15.194:0/3438424441 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5621a200e0a0 con 0x5621a200f480 2024-09-13T06:10:00.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.415+0000 7f2f6610f980 1 -- 172.21.15.194:0/3438424441 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621a200e570 con 0x5621a200f480 2024-09-13T06:10:00.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.415+0000 7f2e497fa640 1 -- 172.21.15.194:0/3438424441 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f2f540c93b0 con 0x5621a200f480 2024-09-13T06:10:00.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.415+0000 7f2e497fa640 1 --2- 172.21.15.194:0/3438424441 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f2e3c0346a0 0x7f2e3c036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.415+0000 7f2e497fa640 1 -- 172.21.15.194:0/3438424441 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f2f540a8070 con 0x5621a200f480 2024-09-13T06:10:00.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.415+0000 7f2f6341e640 1 --2- 172.21.15.194:0/3438424441 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f2e3c0346a0 0x7f2e3c036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.415+0000 7f2f6610f980 1 Processor -- start 2024-09-13T06:10:00.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.415+0000 7f2f6610f980 1 -- start start 2024-09-13T06:10:00.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.415+0000 7f2f6341e640 1 --2- 172.21.15.194:0/3438424441 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f2e3c0346a0 0x7f2e3c036b60 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c00bf60 tx=0x7f2f4c00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.415+0000 7f2f6610f980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5621a212d590 0x5621a212d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.415+0000 7f2f6610f980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5621a20fa270 con 0x5621a212d590 2024-09-13T06:10:00.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.415+0000 7f2f63c1f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5621a212d590 0x5621a212d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.415+0000 7f2f63c1f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5621a212d590 0x5621a212d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:46048/0 (socket says 172.21.15.194:46048) 2024-09-13T06:10:00.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.415+0000 7f2f63c1f640 1 -- 172.21.15.194:0/14189517 learned_addr learned my addr 172.21.15.194:0/14189517 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:00.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.419+0000 7f2f63c1f640 1 -- 172.21.15.194:0/14189517 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621a212df60 con 0x5621a212d590 2024-09-13T06:10:00.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.419+0000 7f2f63c1f640 1 --2- 172.21.15.194:0/14189517 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5621a212d590 0x5621a212d990 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f2f540b7c50 tx=0x7f2f540dd8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efa06cd55c147e26 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.430 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.419+0000 7f2e42ffd640 1 -- 172.21.15.194:0/14189517 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f540fe070 con 0x5621a212d590 2024-09-13T06:10:00.430 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.419+0000 7f2e42ffd640 1 -- 172.21.15.194:0/14189517 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f540aa730 con 0x5621a212d590 2024-09-13T06:10:00.430 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.419+0000 7f2e42ffd640 1 -- 172.21.15.194:0/14189517 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f540b90d0 con 0x5621a212d590 2024-09-13T06:10:00.430 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.419+0000 7f2f6610f980 1 -- 172.21.15.194:0/14189517 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5621a212d590 msgr2=0x5621a212d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.431 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.419+0000 7f2f6610f980 1 --2- 172.21.15.194:0/14189517 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5621a212d590 0x5621a212d990 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f2f540b7c50 tx=0x7f2f540dd8f0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.431 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.419+0000 7f2f6610f980 1 -- 172.21.15.194:0/14189517 shutdown_connections 2024-09-13T06:10:00.431 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.419+0000 7f2f6610f980 1 --2- 172.21.15.194:0/14189517 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5621a212d590 0x5621a212d990 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.431 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.419+0000 7f2f6610f980 1 -- 172.21.15.194:0/14189517 >> 172.21.15.194:0/14189517 conn(0x5621a2129a00 msgr2=0x5621a2127b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:00.431 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.419+0000 7f2f6610f980 1 -- 172.21.15.194:0/14189517 shutdown_connections 2024-09-13T06:10:00.431 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.419+0000 7f2f6610f980 1 -- 172.21.15.194:0/14189517 wait complete. 2024-09-13T06:10:00.431 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.419+0000 7f2f6610f980 1 Processor -- start 2024-09-13T06:10:00.431 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.419+0000 7f2f6610f980 1 -- start start 2024-09-13T06:10:00.431 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.419+0000 7f2f6610f980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5621a212d590 0x5621a2134840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.431 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.419+0000 7f2f6610f980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5621a212e470 con 0x5621a212d590 2024-09-13T06:10:00.432 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.419+0000 7f2f63c1f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5621a212d590 0x5621a2134840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.432 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.419+0000 7f2f63c1f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5621a212d590 0x5621a2134840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:46056/0 (socket says 172.21.15.194:46056) 2024-09-13T06:10:00.432 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.419+0000 7f2f63c1f640 1 -- 172.21.15.194:0/1689103900 learned_addr learned my addr 172.21.15.194:0/1689103900 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:00.432 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.419+0000 7f2f63c1f640 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621a2134d80 con 0x5621a212d590 2024-09-13T06:10:00.432 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.419+0000 7f2f63c1f640 1 --2- 172.21.15.194:0/1689103900 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5621a212d590 0x5621a2134840 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f2f540e5040 tx=0x7f2f540cee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.432 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.419+0000 7f2e417fa640 1 -- 172.21.15.194:0/1689103900 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f54108070 con 0x5621a212d590 2024-09-13T06:10:00.433 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.419+0000 7f2e417fa640 1 -- 172.21.15.194:0/1689103900 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f540ad350 con 0x5621a212d590 2024-09-13T06:10:00.433 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.419+0000 7f2f6610f980 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5621a2134d80 con 0x5621a212d590 2024-09-13T06:10:00.433 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.419+0000 7f2e417fa640 1 -- 172.21.15.194:0/1689103900 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f540fe040 con 0x5621a212d590 2024-09-13T06:10:00.433 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.419+0000 7f2f6610f980 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621a2134d80 con 0x5621a212d590 2024-09-13T06:10:00.433 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.423+0000 7f2e417fa640 1 -- 172.21.15.194:0/1689103900 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f2f540e3470 con 0x5621a212d590 2024-09-13T06:10:00.433 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.423+0000 7f2e417fa640 1 --2- 172.21.15.194:0/1689103900 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f2e2c034650 0x7f2e2c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.433 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.423+0000 7f2e417fa640 1 -- 172.21.15.194:0/1689103900 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f2f54105c50 con 0x5621a212d590 2024-09-13T06:10:00.433 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.423+0000 7f2f6341e640 1 --2- 172.21.15.194:0/1689103900 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f2e2c034650 0x7f2e2c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.433 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.423+0000 7f2f6610f980 20 rados->read ofs=0 len=0 2024-09-13T06:10:00.433 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.423+0000 7f2f6610f980 1 --2- 172.21.15.194:0/1689103900 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5621a213f770 0x5621a2141c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.433 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.423+0000 7f2f6610f980 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5621a2142380 con 0x5621a213f770 2024-09-13T06:10:00.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.423+0000 7f2f64420640 1 --2- 172.21.15.194:0/1689103900 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5621a213f770 0x5621a2141c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.423+0000 7f2f6341e640 1 --2- 172.21.15.194:0/1689103900 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f2e2c034650 0x7f2e2c036b10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x5621a2111440 tx=0x7f2f4c010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.423+0000 7f2f64420640 1 --2- 172.21.15.194:0/1689103900 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5621a213f770 0x5621a2141c30 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.423+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f5c00a4d0 con 0x5621a213f770 2024-09-13T06:10:00.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.423+0000 7f2f6610f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:00.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.423+0000 7f2f6610f980 20 realm 2024-09-13T06:10:00.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.423+0000 7f2f6610f980 20 rados->read ofs=0 len=0 2024-09-13T06:10:00.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.423+0000 7f2f6610f980 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5621a2142790 con 0x5621a213f770 2024-09-13T06:10:00.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.423+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f5c00a4d0 con 0x5621a213f770 2024-09-13T06:10:00.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.423+0000 7f2f6610f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:00.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.423+0000 7f2f6610f980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:10:00.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.423+0000 7f2f6610f980 20 rados->read ofs=0 len=0 2024-09-13T06:10:00.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.423+0000 7f2f6610f980 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5621a2143060 con 0x5621a213f770 2024-09-13T06:10:00.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.423+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f5c00a4d0 con 0x5621a213f770 2024-09-13T06:10:00.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.423+0000 7f2f6610f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:00.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.423+0000 7f2f6610f980 20 rados->read ofs=0 len=0 2024-09-13T06:10:00.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.423+0000 7f2f6610f980 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5621a2143400 con 0x5621a213f770 2024-09-13T06:10:00.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.423+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2f5c00a4d0 con 0x5621a213f770 2024-09-13T06:10:00.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.423+0000 7f2f6610f980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:10:00.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.423+0000 7f2f6610f980 20 rados->read ofs=0 len=0 2024-09-13T06:10:00.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.423+0000 7f2f6610f980 1 --2- 172.21.15.194:0/1689103900 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5621a2144160 0x5621a2146550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.423+0000 7f2f6610f980 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5621a2146b20 con 0x5621a2144160 2024-09-13T06:10:00.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.423+0000 7f2f63c1f640 1 --2- 172.21.15.194:0/1689103900 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5621a2144160 0x5621a2146550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.423+0000 7f2f63c1f640 1 --2- 172.21.15.194:0/1689103900 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5621a2144160 0x5621a2146550 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.423+0000 7f2f63c1f640 1 -- 172.21.15.194:0/1689103900 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2f54101050 con 0x5621a2144160 2024-09-13T06:10:00.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.423+0000 7f2f6610f980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:10:00.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.423+0000 7f2f6610f980 20 searching for the correct realm 2024-09-13T06:10:00.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.423+0000 7f2f6610f980 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5621a21483f0 con 0x5621a2144160 2024-09-13T06:10:00.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.423+0000 7f2f63c1f640 1 -- 172.21.15.194:0/1689103900 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f54101050 con 0x5621a2144160 2024-09-13T06:10:00.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.423+0000 7f2f63c1f640 1 --2- 172.21.15.194:0/1689103900 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f2f540ca060 0x7f2f540ca440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.423+0000 7f2f63c1f640 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5621a21483f0 con 0x7f2f540ca060 2024-09-13T06:10:00.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.423+0000 7f2f6341e640 1 --2- 172.21.15.194:0/1689103900 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f2f540ca060 0x7f2f540ca440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.437 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.423+0000 7f2f6341e640 1 --2- 172.21.15.194:0/1689103900 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f2f540ca060 0x7f2f540ca440 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.437 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.427+0000 7f2f6341e640 1 -- 172.21.15.194:0/1689103900 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2f4c00e620 con 0x7f2f540ca060 2024-09-13T06:10:00.437 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.427+0000 7f2f6341e640 1 --2- 172.21.15.194:0/1689103900 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f2f4c037040 0x7f2f4c036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.437 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.427+0000 7f2f6341e640 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5621a21483f0 con 0x7f2f4c037040 2024-09-13T06:10:00.437 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.427+0000 7f2f64420640 1 --2- 172.21.15.194:0/1689103900 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f2f4c037040 0x7f2f4c036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.437 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.427+0000 7f2f64420640 1 --2- 172.21.15.194:0/1689103900 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f2f4c037040 0x7f2f4c036410 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.437 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.427+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f5c00a4d0 con 0x7f2f4c037040 2024-09-13T06:10:00.437 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.427+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5621a2143400 con 0x5621a213f770 2024-09-13T06:10:00.437 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.427+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f5c00a4d0 con 0x5621a213f770 2024-09-13T06:10:00.437 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.427+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5621a2143400 con 0x5621a213f770 2024-09-13T06:10:00.437 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.427+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f5c00a4d0 con 0x5621a213f770 2024-09-13T06:10:00.437 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.427+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5621a2143400 con 0x7f2f4c037040 2024-09-13T06:10:00.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.427+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f5c00a4d0 con 0x7f2f4c037040 2024-09-13T06:10:00.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.427+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5621a2143400 con 0x7f2f4c037040 2024-09-13T06:10:00.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.427+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f5c00a4d0 con 0x7f2f4c037040 2024-09-13T06:10:00.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.427+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5621a2143400 con 0x7f2f540ca060 2024-09-13T06:10:00.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.427+0000 7f2f6341e640 1 -- 172.21.15.194:0/1689103900 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f4c00e620 con 0x7f2f540ca060 2024-09-13T06:10:00.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.427+0000 7f2f6341e640 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5621a2143400 con 0x5621a2144160 2024-09-13T06:10:00.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.431+0000 7f2f63c1f640 1 -- 172.21.15.194:0/1689103900 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f54101050 con 0x5621a2144160 2024-09-13T06:10:00.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.431+0000 7f2f63c1f640 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5621a2143400 con 0x5621a213f770 2024-09-13T06:10:00.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.431+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f5c00a4d0 con 0x5621a213f770 2024-09-13T06:10:00.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.431+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5621a2143400 con 0x7f2f4c037040 2024-09-13T06:10:00.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.431+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f5c00a4d0 con 0x7f2f4c037040 2024-09-13T06:10:00.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.431+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5621a2143400 con 0x5621a213f770 2024-09-13T06:10:00.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.431+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f5c00a4d0 con 0x5621a213f770 2024-09-13T06:10:00.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.431+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5621a2143400 con 0x7f2f540ca060 2024-09-13T06:10:00.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.431+0000 7f2f6341e640 1 -- 172.21.15.194:0/1689103900 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2f4c00e620 con 0x7f2f540ca060 2024-09-13T06:10:00.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.431+0000 7f2f6341e640 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5621a2143400 con 0x5621a2144160 2024-09-13T06:10:00.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.431+0000 7f2f63c1f640 1 -- 172.21.15.194:0/1689103900 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f54101050 con 0x5621a2144160 2024-09-13T06:10:00.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.431+0000 7f2f63c1f640 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5621a2143400 con 0x5621a2144160 2024-09-13T06:10:00.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.431+0000 7f2f63c1f640 1 -- 172.21.15.194:0/1689103900 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f54101050 con 0x5621a2144160 2024-09-13T06:10:00.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.431+0000 7f2f63c1f640 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5621a2143400 con 0x7f2f4c037040 2024-09-13T06:10:00.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.431+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f5c00a4d0 con 0x7f2f4c037040 2024-09-13T06:10:00.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.431+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5621a2143400 con 0x5621a2144160 2024-09-13T06:10:00.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.431+0000 7f2f63c1f640 1 -- 172.21.15.194:0/1689103900 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f54101050 con 0x5621a2144160 2024-09-13T06:10:00.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.431+0000 7f2f63c1f640 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5621a2143400 con 0x5621a2144160 2024-09-13T06:10:00.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.431+0000 7f2f63c1f640 1 -- 172.21.15.194:0/1689103900 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f54101050 con 0x5621a2144160 2024-09-13T06:10:00.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.431+0000 7f2f63c1f640 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5621a2143400 con 0x5621a213f770 2024-09-13T06:10:00.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.431+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f5c00a4d0 con 0x5621a213f770 2024-09-13T06:10:00.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.431+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5621a2143400 con 0x5621a213f770 2024-09-13T06:10:00.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.431+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2f5c00a4d0 con 0x5621a213f770 2024-09-13T06:10:00.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.431+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5621a2143400 con 0x7f2f4c037040 2024-09-13T06:10:00.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.435+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f5c00a4d0 con 0x7f2f4c037040 2024-09-13T06:10:00.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.435+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5621a2143400 con 0x5621a2144160 2024-09-13T06:10:00.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.435+0000 7f2f63c1f640 1 -- 172.21.15.194:0/1689103900 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f54101050 con 0x5621a2144160 2024-09-13T06:10:00.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.435+0000 7f2f63c1f640 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5621a2143400 con 0x7f2f540ca060 2024-09-13T06:10:00.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.435+0000 7f2f6341e640 1 -- 172.21.15.194:0/1689103900 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f4c00e620 con 0x7f2f540ca060 2024-09-13T06:10:00.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.435+0000 7f2f6341e640 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5621a2143400 con 0x5621a213f770 2024-09-13T06:10:00.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.435+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f5c00a4d0 con 0x5621a213f770 2024-09-13T06:10:00.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.435+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5621a2143400 con 0x7f2f4c037040 2024-09-13T06:10:00.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.435+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f5c00a4d0 con 0x7f2f4c037040 2024-09-13T06:10:00.450 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.435+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5621a2143400 con 0x5621a2144160 2024-09-13T06:10:00.450 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.435+0000 7f2f63c1f640 1 -- 172.21.15.194:0/1689103900 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2f54101050 con 0x5621a2144160 2024-09-13T06:10:00.450 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.435+0000 7f2f63c1f640 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5621a2143400 con 0x7f2f4c037040 2024-09-13T06:10:00.450 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.435+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f5c00a4d0 con 0x7f2f4c037040 2024-09-13T06:10:00.450 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.435+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5621a2143400 con 0x7f2f540ca060 2024-09-13T06:10:00.450 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.435+0000 7f2f6341e640 1 -- 172.21.15.194:0/1689103900 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f4c00e620 con 0x7f2f540ca060 2024-09-13T06:10:00.450 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.435+0000 7f2f6341e640 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5621a2143400 con 0x5621a2144160 2024-09-13T06:10:00.450 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.435+0000 7f2f63c1f640 1 -- 172.21.15.194:0/1689103900 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f54101050 con 0x5621a2144160 2024-09-13T06:10:00.450 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.435+0000 7f2f63c1f640 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5621a2143400 con 0x7f2f4c037040 2024-09-13T06:10:00.450 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.435+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f5c00a4d0 con 0x7f2f4c037040 2024-09-13T06:10:00.450 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.435+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5621a2143400 con 0x5621a213f770 2024-09-13T06:10:00.450 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.439+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2f5c00a4d0 con 0x5621a213f770 2024-09-13T06:10:00.451 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.439+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5621a2143400 con 0x7f2f540ca060 2024-09-13T06:10:00.451 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.439+0000 7f2f6341e640 1 -- 172.21.15.194:0/1689103900 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f4c00e620 con 0x7f2f540ca060 2024-09-13T06:10:00.451 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.439+0000 7f2f6610f980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:10:00.451 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.439+0000 7f2f6610f980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:10:00.451 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.439+0000 7f2f6610f980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:10:00.451 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.439+0000 7f2f6610f980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:10:00.451 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.439+0000 7f2f6610f980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:10:00.451 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.439+0000 7f2f6610f980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:10:00.451 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.439+0000 7f2f6610f980 20 rados->read ofs=0 len=0 2024-09-13T06:10:00.451 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.439+0000 7f2f6610f980 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5621a2147510 con 0x5621a213f770 2024-09-13T06:10:00.451 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.439+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f5c00a4d0 con 0x5621a213f770 2024-09-13T06:10:00.452 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.439+0000 7f2f6610f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:00.452 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.439+0000 7f2f6610f980 20 rados->read ofs=0 len=0 2024-09-13T06:10:00.452 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.439+0000 7f2f6610f980 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5621a2147db0 con 0x5621a213f770 2024-09-13T06:10:00.452 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.439+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2f5c00a4d0 con 0x5621a213f770 2024-09-13T06:10:00.452 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.439+0000 7f2f6610f980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:10:00.452 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.439+0000 7f2f6610f980 20 rados->read ofs=0 len=0 2024-09-13T06:10:00.452 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.439+0000 7f2f6610f980 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5621a2147900 con 0x7f2f540ca060 2024-09-13T06:10:00.452 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.439+0000 7f2f6341e640 1 -- 172.21.15.194:0/1689103900 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2f4c00e620 con 0x7f2f540ca060 2024-09-13T06:10:00.452 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.439+0000 7f2f6610f980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:10:00.452 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.439+0000 7f2f6610f980 20 zone default found 2024-09-13T06:10:00.452 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.439+0000 7f2f6610f980 4 Realm: () 2024-09-13T06:10:00.452 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.439+0000 7f2f6610f980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:10:00.453 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.439+0000 7f2f6610f980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:10:00.453 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.439+0000 7f2f6610f980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:10:00.453 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.439+0000 7f2f6610f980 20 zonegroup default 2024-09-13T06:10:00.453 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.439+0000 7f2f6610f980 20 rados->read ofs=0 len=0 2024-09-13T06:10:00.453 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.439+0000 7f2f6610f980 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5621a2148820 con 0x7f2f4c037040 2024-09-13T06:10:00.453 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.439+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2f5c00a4d0 con 0x7f2f4c037040 2024-09-13T06:10:00.453 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.439+0000 7f2f6610f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:00.453 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.439+0000 7f2f6610f980 20 rados->read ofs=0 len=0 2024-09-13T06:10:00.453 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.439+0000 7f2f6610f980 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5621a214a290 con 0x5621a2144160 2024-09-13T06:10:00.453 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.439+0000 7f2f63c1f640 1 -- 172.21.15.194:0/1689103900 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2f54101050 con 0x5621a2144160 2024-09-13T06:10:00.453 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.439+0000 7f2f6610f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:00.453 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.439+0000 7f2f6610f980 20 rados->read ofs=0 len=0 2024-09-13T06:10:00.454 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.439+0000 7f2f6610f980 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5621a214a760 con 0x5621a2144160 2024-09-13T06:10:00.454 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.439+0000 7f2f63c1f640 1 -- 172.21.15.194:0/1689103900 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2f54101050 con 0x5621a2144160 2024-09-13T06:10:00.454 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.439+0000 7f2f6610f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:00.454 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.439+0000 7f2f6610f980 20 started sync module instance, tier type = 2024-09-13T06:10:00.454 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.439+0000 7f2f6610f980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:10:00.454 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.439+0000 7f2f6610f980 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621a21496a0 con 0x7f2f540ca060 2024-09-13T06:10:00.454 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.439+0000 7f2f6341e640 1 -- 172.21.15.194:0/1689103900 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(44 notify.0 [create] v33'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f4c00e620 con 0x7f2f540ca060 2024-09-13T06:10:00.454 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.439+0000 7f2f6610f980 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94702453168784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621a214b070 con 0x7f2f540ca060 2024-09-13T06:10:00.454 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.439+0000 7f2f6610f980 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621a214b8c0 con 0x5621a213f770 2024-09-13T06:10:00.454 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.443+0000 7f2f6341e640 1 -- 172.21.15.194:0/1689103900 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94702453168784] v33'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f4c00e620 con 0x7f2f540ca060 2024-09-13T06:10:00.454 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.443+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v33'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f5c00a4d0 con 0x5621a213f770 2024-09-13T06:10:00.455 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.443+0000 7f2f6610f980 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94702453173184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621a214b8c0 con 0x5621a213f770 2024-09-13T06:10:00.455 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.443+0000 7f2f6610f980 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621a214c340 con 0x5621a2144160 2024-09-13T06:10:00.455 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.443+0000 7f2f63c1f640 1 -- 172.21.15.194:0/1689103900 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v33'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f54101050 con 0x5621a2144160 2024-09-13T06:10:00.455 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.443+0000 7f2f6610f980 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94702453177904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621a214cc10 con 0x5621a2144160 2024-09-13T06:10:00.455 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.443+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94702453173184] v33'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f5c00a4d0 con 0x5621a213f770 2024-09-13T06:10:00.455 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.443+0000 7f2f6610f980 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621a214b410 con 0x7f2f540ca060 2024-09-13T06:10:00.455 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.447+0000 7f2f6341e640 1 -- 172.21.15.194:0/1689103900 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(50 notify.3 [create] v33'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f4c00e620 con 0x7f2f540ca060 2024-09-13T06:10:00.455 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.447+0000 7f2f6610f980 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94702453183024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621a214dbe0 con 0x7f2f540ca060 2024-09-13T06:10:00.455 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.447+0000 7f2f6610f980 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621a214e6e0 con 0x5621a213f770 2024-09-13T06:10:00.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.447+0000 7f2f63c1f640 1 -- 172.21.15.194:0/1689103900 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94702453177904] v33'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f54101050 con 0x5621a2144160 2024-09-13T06:10:00.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.447+0000 7f2f6341e640 1 -- 172.21.15.194:0/1689103900 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94702453183024] v33'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f4c00e620 con 0x7f2f540ca060 2024-09-13T06:10:00.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.447+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v33'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f5c00a4d0 con 0x5621a213f770 2024-09-13T06:10:00.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.447+0000 7f2f6610f980 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94702453187024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621a214e6a0 con 0x5621a213f770 2024-09-13T06:10:00.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.447+0000 7f2f6610f980 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621a214efb0 con 0x7f2f4c037040 2024-09-13T06:10:00.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.451+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94702453187024] v33'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f5c00a4d0 con 0x5621a213f770 2024-09-13T06:10:00.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.451+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(54 notify.5 [create] v33'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f5c00a4d0 con 0x7f2f4c037040 2024-09-13T06:10:00.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.451+0000 7f2f6610f980 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94702453180256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621a214e6a0 con 0x7f2f4c037040 2024-09-13T06:10:00.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.451+0000 7f2f6610f980 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621a214f550 con 0x7f2f4c037040 2024-09-13T06:10:00.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.451+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94702453180256] v33'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f5c00a4d0 con 0x7f2f4c037040 2024-09-13T06:10:00.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.451+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(56 notify.6 [create] v33'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f5c00a4d0 con 0x7f2f4c037040 2024-09-13T06:10:00.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.451+0000 7f2f6610f980 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94702453189248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621a214f550 con 0x7f2f4c037040 2024-09-13T06:10:00.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.451+0000 7f2f6610f980 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621a214ff10 con 0x7f2f4c037040 2024-09-13T06:10:00.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.455+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94702453189248] v33'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f5c00a4d0 con 0x7f2f4c037040 2024-09-13T06:10:00.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.455+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(58 notify.7 [create] v33'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f5c00a4d0 con 0x7f2f4c037040 2024-09-13T06:10:00.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.455+0000 7f2f6610f980 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94702453191088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621a214ff10 con 0x7f2f4c037040 2024-09-13T06:10:00.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.455+0000 7f2f6610f980 20 add_watcher() i=0 2024-09-13T06:10:00.460 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.455+0000 7f2f6610f980 20 add_watcher() i=1 2024-09-13T06:10:00.460 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.455+0000 7f2f6610f980 20 add_watcher() i=2 2024-09-13T06:10:00.460 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.455+0000 7f2f6610f980 20 add_watcher() i=3 2024-09-13T06:10:00.460 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.455+0000 7f2f6610f980 20 add_watcher() i=4 2024-09-13T06:10:00.460 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.455+0000 7f2f6610f980 20 add_watcher() i=5 2024-09-13T06:10:00.460 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.455+0000 7f2f6610f980 20 add_watcher() i=6 2024-09-13T06:10:00.460 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.455+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94702453191088] v33'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f5c00a4d0 con 0x7f2f4c037040 2024-09-13T06:10:00.460 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.455+0000 7f2f6610f980 20 add_watcher() i=7 2024-09-13T06:10:00.460 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.455+0000 7f2f6610f980 2 all 8 watchers are set, enabling cache 2024-09-13T06:10:00.460 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.455+0000 7f2f6610f980 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5621a2153230 con 0x5621a213f770 2024-09-13T06:10:00.460 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.455+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2f5c00a4d0 con 0x5621a213f770 2024-09-13T06:10:00.460 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.455+0000 7f2f6610f980 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94702453206128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621a2150080 con 0x5621a213f770 2024-09-13T06:10:00.463 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.459+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94702453206128] v33'128 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2f5c00a4d0 con 0x5621a213f770 2024-09-13T06:10:00.463 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.459+0000 7f2e19fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:10:00.463 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.459+0000 7f2f6610f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:10:00.463 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.459+0000 7f2f6610f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:10:00.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.459+0000 7f2f6610f980 5 note: GC not initialized 2024-09-13T06:10:00.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.459+0000 7f2e18fe1640 20 reqs_thread_entry: start 2024-09-13T06:10:00.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.459+0000 7f2f6610f980 20 init_complete bucket index max shards: 11 2024-09-13T06:10:00.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.459+0000 7f2f6610f980 20 Filter name: none 2024-09-13T06:10:00.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.459+0000 7f2d927fc640 20 reqs_thread_entry: start 2024-09-13T06:10:00.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.459+0000 7f2f6610f980 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-13T06:10:00.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.459+0000 7f2f6610f980 20 rados->read ofs=0 len=0 2024-09-13T06:10:00.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.459+0000 7f2f6610f980 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5621a2176b40 con 0x7f2f4c037040 2024-09-13T06:10:00.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.459+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(62 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7f2f5c00a4d0 con 0x7f2f4c037040 2024-09-13T06:10:00.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.459+0000 7f2f6610f980 20 rados_obj.operate() r=0 bl.length=419 2024-09-13T06:10:00.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.459+0000 7f2f6610f980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-09-13T06:10:00.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.459+0000 7f2f6610f980 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-13T06:10:00.465 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.459+0000 7f2f6610f980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:10:00.465 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.459+0000 7f2f6610f980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T06:10:00.465 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.459+0000 7f2f6610f980 20 rados->read ofs=0 len=0 2024-09-13T06:10:00.465 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.459+0000 7f2f6610f980 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5621a2176590 con 0x7f2f540ca060 2024-09-13T06:10:00.465 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.459+0000 7f2f6341e640 1 -- 172.21.15.194:0/1689103900 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv23 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f2f4c00e620 con 0x7f2f540ca060 2024-09-13T06:10:00.465 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.459+0000 7f2f6610f980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T06:10:00.465 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.459+0000 7f2f6610f980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T06:10:00.465 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.459+0000 7f2f6610f980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T06:10:00.465 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.459+0000 7f2f6610f980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 : miss 2024-09-13T06:10:00.465 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.459+0000 7f2f6610f980 20 rados->read ofs=0 len=0 2024-09-13T06:10:00.465 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.459+0000 7f2f6610f980 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:64 8.18 8:1a66c368:root::.bucket.meta.myfoo%3a52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5621a217a2f0 con 0x5621a213f770 2024-09-13T06:10:00.465 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.459+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(64 .bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv14 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f2f5c00a4d0 con 0x5621a213f770 2024-09-13T06:10:00.465 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.459+0000 7f2f6610f980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T06:10:00.466 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.459+0000 7f2f6610f980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 info.flags=0x17 2024-09-13T06:10:00.466 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.459+0000 7f2f6610f980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 to cache LRU end 2024-09-13T06:10:00.466 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.459+0000 7f2f6610f980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:10:00.466 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.459+0000 7f2f6610f980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T06:10:00.466 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.459+0000 7f2f6610f980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 2024-09-13T06:10:00.466 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.459+0000 7f2f6610f980 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : hit (requested=0x13, cached=0x13) 2024-09-13T06:10:00.466 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.459+0000 7f2f6610f980 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621a217e800 con 0x7f2f540ca060 2024-09-13T06:10:00.467 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.463+0000 7f2f6341e640 1 -- 172.21.15.194:0/1689103900 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(65 foo.buckets [call] v33'24 uv24 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f2f4c00e620 con 0x7f2f540ca060 2024-09-13T06:10:00.467 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.463+0000 7f2f6610f980 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:66 8.e 8:75efaca1:root::.bucket.meta.testx%3amyfoo%3a52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1:head [create,call version.inc in=38b,writefull 0~412 in=412b,setxattr user.rgw.acl (203) in=215b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621a2182110 con 0x7f2f4c037040 2024-09-13T06:10:00.467 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.467+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(66 .bucket.meta.testx:myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 [create,call,writefull 0~412,setxattr (203)] v33'3 uv3 ondisk = 0) ==== 338+0+0 (crc 0 0 0) 0x7f2f5c00a4d0 con 0x7f2f4c037040 2024-09-13T06:10:00.467 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.467+0000 7f2f6610f980 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 info.flags=0x7 2024-09-13T06:10:00.467 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.467+0000 7f2f6610f980 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 to cache LRU end 2024-09-13T06:10:00.468 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.467+0000 7f2f6610f980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-13T06:10:00.468 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.467+0000 7f2f6610f980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1, ofs0, ns] 2024-09-13T06:10:00.468 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.467+0000 7f2f6610f980 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:67 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94702453391168 in=859b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5621a2181bc0 con 0x7f2f4c037040 2024-09-13T06:10:00.468 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.467+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== watch-notify(notify (1) cookie 94702453189248 notify 141733920779 ret 0) ==== 889+0+0 (crc 0 0 0) 0x5621a21824b0 con 0x7f2f4c037040 2024-09-13T06:10:00.468 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.467+0000 7f2e42ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920779 cookie 94702453189248 notifier 4542 bl.length()=847 2024-09-13T06:10:00.468 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.467+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 <== osd.0 v2:172.21.15.120:6800/1923744619 20 ==== osd_op_reply(67 notify.6 [notify cookie 94702453391168 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2f5c00a4d0 con 0x7f2f4c037040 2024-09-13T06:10:00.468 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.467+0000 7f2e42ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 info.flags=0x7 2024-09-13T06:10:00.468 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.467+0000 7f2e42ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.testx:myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 to cache LRU end 2024-09-13T06:10:00.468 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.467+0000 7f2e42ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-13T06:10:00.468 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.467+0000 7f2e42ffd640 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f2e28003eb0 con 0x7f2f4c037040 2024-09-13T06:10:00.469 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.467+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 <== osd.0 v2:172.21.15.120:6800/1923744619 21 ==== osd_op_reply(68 notify.6 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f5c00a4d0 con 0x7f2f4c037040 2024-09-13T06:10:00.469 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.467+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 <== osd.0 v2:172.21.15.120:6800/1923744619 22 ==== watch-notify(notify_complete (2) cookie 94702453391168 notify 141733920779 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5621a217e650 con 0x7f2f4c037040 2024-09-13T06:10:00.470 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.467+0000 7f2f6610f980 20 handle_bi_update(): bucket=testx:myfoo[52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1]): orig_sources= new_sources= 2024-09-13T06:10:00.470 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.467+0000 7f2f6610f980 20 handle_bi_update(): bucket=testx:myfoo[52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1]): potential sources added=[] removed=[] 2024-09-13T06:10:00.470 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.467+0000 7f2f6610f980 20 handle_bi_update(): bucket=testx:myfoo[52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1]): orig_dests= new_dests= 2024-09-13T06:10:00.470 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.467+0000 7f2f6610f980 20 handle_bi_update(): bucket=testx:myfoo[52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1]): potential dests added=[] removed=[] 2024-09-13T06:10:00.470 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.467+0000 7f2f6610f980 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:69 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621a2181c60 con 0x5621a213f770 2024-09-13T06:10:00.470 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.467+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(69 testx$tenanteduser.buckets [call] v33'1 uv1 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f2f5c00a4d0 con 0x5621a213f770 2024-09-13T06:10:00.470 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.467+0000 7f2f6610f980 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:70 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [delete,create,call version.inc in=38b,writefull 0~193 in=193b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621a2181c60 con 0x5621a213f770 2024-09-13T06:10:00.471 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.471+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(70 testx/myfoo [delete,create,call,writefull 0~193] v33'1 uv1 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7f2f5c00a4d0 con 0x5621a213f770 2024-09-13T06:10:00.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.471+0000 7f2f6610f980 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-09-13T06:10:00.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.471+0000 7f2f6610f980 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-13T06:10:00.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.471+0000 7f2f6610f980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-09-13T06:10:00.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.471+0000 7f2f6610f980 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify cookie 94702453397424 in=360b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5621a2181bd0 con 0x5621a213f770 2024-09-13T06:10:00.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.471+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== watch-notify(notify (1) cookie 94702453187024 notify 141733920779 ret 0) ==== 390+0+0 (crc 0 0 0) 0x5621a2182000 con 0x5621a213f770 2024-09-13T06:10:00.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.471+0000 7f2e42ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920779 cookie 94702453187024 notifier 4542 bl.length()=348 2024-09-13T06:10:00.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.471+0000 7f2e42ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-09-13T06:10:00.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.471+0000 7f2e42ffd640 10 rgw watcher librados: moving default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-13T06:10:00.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.471+0000 7f2e42ffd640 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f2e28003eb0 con 0x5621a213f770 2024-09-13T06:10:00.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.471+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 <== osd.1 v2:172.21.15.194:6808/3135444559 25 ==== osd_op_reply(71 notify.4 [notify cookie 94702453397424 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2f5c00a4d0 con 0x5621a213f770 2024-09-13T06:10:00.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.471+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 <== osd.1 v2:172.21.15.194:6808/3135444559 26 ==== osd_op_reply(72 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f5c00a4d0 con 0x5621a213f770 2024-09-13T06:10:00.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.471+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 <== osd.1 v2:172.21.15.194:6808/3135444559 27 ==== watch-notify(notify_complete (2) cookie 94702453397424 notify 141733920779 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5621a2180f50 con 0x5621a213f770 2024-09-13T06:10:00.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.471+0000 7f2f6610f980 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:73 8.9 8:91b71841:root::myfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621a2181c60 con 0x7f2f540ca060 2024-09-13T06:10:00.474 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.471+0000 7f2f6341e640 1 -- 172.21.15.194:0/1689103900 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(73 myfoo [call,delete] v33'25 uv25 ondisk = 0) ==== 191+0+0 (crc 0 0 0) 0x7f2f4c00e620 con 0x7f2f540ca060 2024-09-13T06:10:00.474 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.471+0000 7f2f6610f980 10 removing default.rgw.meta+root+myfoo from cache 2024-09-13T06:10:00.474 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.471+0000 7f2f6610f980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-13T06:10:00.474 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.471+0000 7f2f6610f980 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94702453397424 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5621a2181bd0 con 0x7f2f4c037040 2024-09-13T06:10:00.474 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.471+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 <== osd.0 v2:172.21.15.120:6800/1923744619 23 ==== watch-notify(notify (1) cookie 94702453189248 notify 141733920780 ret 0) ==== 191+0+0 (crc 0 0 0) 0x5621a2180f50 con 0x7f2f4c037040 2024-09-13T06:10:00.474 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.471+0000 7f2e427fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920780 cookie 94702453189248 notifier 4542 bl.length()=149 2024-09-13T06:10:00.474 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.471+0000 7f2e427fc640 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:75 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f2d980032d0 con 0x7f2f4c037040 2024-09-13T06:10:00.474 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.471+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 <== osd.0 v2:172.21.15.120:6800/1923744619 24 ==== osd_op_reply(74 notify.6 [notify cookie 94702453397424 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2f5c00a4d0 con 0x7f2f4c037040 2024-09-13T06:10:00.475 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.475+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 <== osd.0 v2:172.21.15.120:6800/1923744619 25 ==== watch-notify(notify_complete (2) cookie 94702453397424 notify 141733920780 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5621a217e650 con 0x7f2f4c037040 2024-09-13T06:10:00.475 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.475+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 <== osd.0 v2:172.21.15.120:6800/1923744619 26 ==== osd_op_reply(75 notify.6 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f5c00a4d0 con 0x7f2f4c037040 2024-09-13T06:10:00.475 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.475+0000 7f2f6610f980 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:76 8.18 8:1a66c368:root::.bucket.meta.myfoo%3a52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621a2181c60 con 0x5621a213f770 2024-09-13T06:10:00.476 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.475+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 <== osd.1 v2:172.21.15.194:6808/3135444559 28 ==== osd_op_reply(76 .bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 [call,delete] v33'15 uv15 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f2f5c00a4d0 con 0x5621a213f770 2024-09-13T06:10:00.476 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.475+0000 7f2f6610f980 10 removing default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 from cache 2024-09-13T06:10:00.476 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.475+0000 7f2f6610f980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1, ofs0, ns] 2024-09-13T06:10:00.476 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.475+0000 7f2f6610f980 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [notify cookie 94702453365696 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5621a2181c60 con 0x7f2f4c037040 2024-09-13T06:10:00.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.475+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 <== osd.0 v2:172.21.15.120:6800/1923744619 27 ==== watch-notify(notify (1) cookie 94702453191088 notify 141733920781 ret 0) ==== 248+0+0 (crc 0 0 0) 0x5621a217e650 con 0x7f2f4c037040 2024-09-13T06:10:00.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.475+0000 7f2e42ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920781 cookie 94702453191088 notifier 4542 bl.length()=206 2024-09-13T06:10:00.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.475+0000 7f2e42ffd640 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f2e28003eb0 con 0x7f2f4c037040 2024-09-13T06:10:00.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.475+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 <== osd.0 v2:172.21.15.120:6800/1923744619 28 ==== osd_op_reply(77 notify.7 [notify cookie 94702453365696 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2f5c00a4d0 con 0x7f2f4c037040 2024-09-13T06:10:00.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.475+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 <== osd.0 v2:172.21.15.120:6800/1923744619 29 ==== osd_op_reply(78 notify.7 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f5c00a4d0 con 0x7f2f4c037040 2024-09-13T06:10:00.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.475+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 <== osd.0 v2:172.21.15.120:6800/1923744619 30 ==== watch-notify(notify_complete (2) cookie 94702453365696 notify 141733920781 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5621a217a6e0 con 0x7f2f4c037040 2024-09-13T06:10:00.479 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.479+0000 7f2e19fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:10:00.479 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.479+0000 7f2f6610f980 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94702453206128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621a21747d0 con 0x5621a213f770 2024-09-13T06:10:00.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.479+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 <== osd.1 v2:172.21.15.194:6808/3135444559 29 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94702453206128] v33'129 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2f5c00a4d0 con 0x5621a213f770 2024-09-13T06:10:00.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.479+0000 7f2f6610f980 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94702453168784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621a21747d0 con 0x7f2f540ca060 2024-09-13T06:10:00.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.479+0000 7f2f6341e640 1 -- 172.21.15.194:0/1689103900 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94702453168784] v33'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f4c00e620 con 0x7f2f540ca060 2024-09-13T06:10:00.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.479+0000 7f2f6610f980 20 remove_watcher() i=0 2024-09-13T06:10:00.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.479+0000 7f2f6610f980 2 removed watcher, disabling cache 2024-09-13T06:10:00.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.479+0000 7f2f6610f980 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94702453173184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621a21747d0 con 0x5621a213f770 2024-09-13T06:10:00.483 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.483+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 <== osd.1 v2:172.21.15.194:6808/3135444559 30 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94702453173184] v33'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f5c00a4d0 con 0x5621a213f770 2024-09-13T06:10:00.483 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.483+0000 7f2f6610f980 20 remove_watcher() i=1 2024-09-13T06:10:00.483 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.483+0000 7f2f6610f980 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94702453177904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621a214abc0 con 0x5621a2144160 2024-09-13T06:10:00.485 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.483+0000 7f2f63c1f640 1 -- 172.21.15.194:0/1689103900 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94702453177904] v33'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f54101050 con 0x5621a2144160 2024-09-13T06:10:00.485 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.483+0000 7f2f6610f980 20 remove_watcher() i=2 2024-09-13T06:10:00.485 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.483+0000 7f2f6610f980 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94702453183024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621a21747d0 con 0x7f2f540ca060 2024-09-13T06:10:00.486 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.483+0000 7f2f6341e640 1 -- 172.21.15.194:0/1689103900 <== osd.2 v2:172.21.15.194:6800/815615585 16 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94702453183024] v33'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f4c00e620 con 0x7f2f540ca060 2024-09-13T06:10:00.486 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.483+0000 7f2f6610f980 20 remove_watcher() i=3 2024-09-13T06:10:00.486 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.483+0000 7f2f6610f980 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94702453187024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621a214d230 con 0x5621a213f770 2024-09-13T06:10:00.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.487+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 <== osd.1 v2:172.21.15.194:6808/3135444559 31 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94702453187024] v33'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f5c00a4d0 con 0x5621a213f770 2024-09-13T06:10:00.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.487+0000 7f2f6610f980 20 remove_watcher() i=4 2024-09-13T06:10:00.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.487+0000 7f2f6610f980 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94702453180256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621a21747d0 con 0x7f2f4c037040 2024-09-13T06:10:00.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.487+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 <== osd.0 v2:172.21.15.120:6800/1923744619 31 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94702453180256] v33'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f5c00a4d0 con 0x7f2f4c037040 2024-09-13T06:10:00.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.487+0000 7f2f6610f980 20 remove_watcher() i=5 2024-09-13T06:10:00.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.487+0000 7f2f6610f980 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94702453189248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621a214e1d0 con 0x7f2f4c037040 2024-09-13T06:10:00.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.491+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 <== osd.0 v2:172.21.15.120:6800/1923744619 32 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94702453189248] v33'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f5c00a4d0 con 0x7f2f4c037040 2024-09-13T06:10:00.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.491+0000 7f2f6610f980 20 remove_watcher() i=6 2024-09-13T06:10:00.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.491+0000 7f2f6610f980 1 -- 172.21.15.194:0/1689103900 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94702453191088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621a214d230 con 0x7f2f4c037040 2024-09-13T06:10:00.496 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.491+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 <== osd.0 v2:172.21.15.120:6800/1923744619 33 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94702453191088] v33'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f5c00a4d0 con 0x7f2f4c037040 2024-09-13T06:10:00.496 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.491+0000 7f2f6610f980 20 remove_watcher() i=7 2024-09-13T06:10:00.496 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.491+0000 7f2f6610f980 1 -- 172.21.15.194:0/1689103900 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f2f4c037040 msgr2=0x7f2f4c036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.496 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.491+0000 7f2f6610f980 1 --2- 172.21.15.194:0/1689103900 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f2f4c037040 0x7f2f4c036410 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.491+0000 7f2f6610f980 1 -- 172.21.15.194:0/1689103900 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5621a213f770 msgr2=0x5621a2141c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.491+0000 7f2f6610f980 1 --2- 172.21.15.194:0/1689103900 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5621a213f770 0x5621a2141c30 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.491+0000 7f2f6610f980 1 -- 172.21.15.194:0/1689103900 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f2f540ca060 msgr2=0x7f2f540ca440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.491+0000 7f2f6610f980 1 --2- 172.21.15.194:0/1689103900 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f2f540ca060 0x7f2f540ca440 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.491+0000 7f2f6610f980 1 -- 172.21.15.194:0/1689103900 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5621a2144160 msgr2=0x5621a2146550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.491+0000 7f2f6610f980 1 --2- 172.21.15.194:0/1689103900 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5621a2144160 0x5621a2146550 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.495+0000 7f2f6610f980 1 -- 172.21.15.194:0/1689103900 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f2e2c034650 msgr2=0x7f2e2c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.495+0000 7f2f6610f980 1 --2- 172.21.15.194:0/1689103900 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f2e2c034650 0x7f2e2c036b10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x5621a2111440 tx=0x7f2f4c010000 comp rx=0 tx=0).stop 2024-09-13T06:10:00.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.495+0000 7f2f6610f980 1 -- 172.21.15.194:0/1689103900 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5621a212d590 msgr2=0x5621a2134840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.495+0000 7f2f64420640 1 -- 172.21.15.194:0/1689103900 reap_dead start 2024-09-13T06:10:00.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.495+0000 7f2f6610f980 1 --2- 172.21.15.194:0/1689103900 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5621a212d590 0x5621a2134840 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f2f540e5040 tx=0x7f2f540cee80 comp rx=0 tx=0).stop 2024-09-13T06:10:00.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.495+0000 7f2f6610f980 1 -- 172.21.15.194:0/1689103900 shutdown_connections 2024-09-13T06:10:00.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.495+0000 7f2f6610f980 1 --2- 172.21.15.194:0/1689103900 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5621a212d590 0x5621a2134840 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.495+0000 7f2f6610f980 1 -- 172.21.15.194:0/1689103900 >> 172.21.15.194:0/1689103900 conn(0x5621a2129a00 msgr2=0x5621a2127ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:00.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.495+0000 7f2f6610f980 1 -- 172.21.15.194:0/1689103900 shutdown_connections 2024-09-13T06:10:00.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.495+0000 7f2f6610f980 1 -- 172.21.15.194:0/1689103900 wait complete. 2024-09-13T06:10:00.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.495+0000 7f2f6610f980 1 -- 172.21.15.194:0/3438424441 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f2e3c0346a0 msgr2=0x7f2e3c036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.495+0000 7f2f6610f980 1 --2- 172.21.15.194:0/3438424441 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f2e3c0346a0 0x7f2e3c036b60 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c00bf60 tx=0x7f2f4c00f000 comp rx=0 tx=0).stop 2024-09-13T06:10:00.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.495+0000 7f2f6610f980 1 -- 172.21.15.194:0/3438424441 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5621a200f480 msgr2=0x5621a200db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.495+0000 7f2f6610f980 1 --2- 172.21.15.194:0/3438424441 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5621a200f480 0x5621a200db00 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f2f540e1fd0 tx=0x7f2f540aacb0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.495+0000 7f2f6610f980 1 -- 172.21.15.194:0/3438424441 shutdown_connections 2024-09-13T06:10:00.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.495+0000 7f2f6610f980 1 --2- 172.21.15.194:0/3438424441 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f2e3c0346a0 0x7f2e3c036b60 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.495+0000 7f2f6610f980 1 --2- 172.21.15.194:0/3438424441 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5621a200f480 0x5621a200db00 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.495+0000 7f2f6610f980 1 -- 172.21.15.194:0/3438424441 >> 172.21.15.194:0/3438424441 conn(0x5621a2113c20 msgr2=0x5621a21166a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:00.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.495+0000 7f2f6610f980 1 -- 172.21.15.194:0/3438424441 shutdown_connections 2024-09-13T06:10:00.499 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.495+0000 7f2f6610f980 1 -- 172.21.15.194:0/3438424441 wait complete. 2024-09-13T06:10:00.499 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.495+0000 7f2f6610f980 1 -- 172.21.15.194:0/1646092024 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5621a200d380 msgr2=0x5621a2107c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.499 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.495+0000 7f2f6610f980 1 --2- 172.21.15.194:0/1646092024 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5621a200d380 0x5621a2107c20 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.499 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.495+0000 7f2f6610f980 1 -- 172.21.15.194:0/1646092024 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5621a210e4c0 msgr2=0x5621a21108b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.499 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.495+0000 7f2f6610f980 1 --2- 172.21.15.194:0/1646092024 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5621a210e4c0 0x5621a21108b0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.499 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.495+0000 7f2f6610f980 1 -- 172.21.15.194:0/1646092024 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5621a210a5c0 msgr2=0x5621a210c9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.499 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.495+0000 7f2f6610f980 1 --2- 172.21.15.194:0/1646092024 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5621a210a5c0 0x5621a210c9b0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.499 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.495+0000 7f2f6610f980 1 -- 172.21.15.194:0/1646092024 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f2e4c034650 msgr2=0x7f2e4c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.499 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.495+0000 7f2f6610f980 1 --2- 172.21.15.194:0/1646092024 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f2e4c034650 0x7f2e4c036b10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c000f70 tx=0x7f2f4c0012c0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.499 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.495+0000 7f2f6610f980 1 -- 172.21.15.194:0/1646092024 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5621a200ca60 msgr2=0x5621a2100c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.499 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.495+0000 7f2f6610f980 1 --2- 172.21.15.194:0/1646092024 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5621a200ca60 0x5621a2100c70 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f2f540030b0 tx=0x7f2f54018020 comp rx=0 tx=0).stop 2024-09-13T06:10:00.499 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.495+0000 7f2f64420640 1 -- 172.21.15.194:0/1646092024 reap_dead start 2024-09-13T06:10:00.499 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.495+0000 7f2f6610f980 1 -- 172.21.15.194:0/1646092024 shutdown_connections 2024-09-13T06:10:00.500 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.495+0000 7f2f6610f980 1 -- 172.21.15.194:0/1646092024 >> 172.21.15.194:0/1646092024 conn(0x5621a2008740 msgr2=0x5621a20f4190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:00.500 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.495+0000 7f2f6610f980 1 -- 172.21.15.194:0/1646092024 shutdown_connections 2024-09-13T06:10:00.500 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.495+0000 7f2f6610f980 1 -- 172.21.15.194:0/1646092024 wait complete. 2024-09-13T06:10:00.505 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:testx/myfoo'] 2024-09-13T06:10:00.505 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:testx/myfoo'] 2024-09-13T06:10:00.505 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo 2024-09-13T06:10:00.574 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:10:00.574 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:10:00.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.575+0000 7f3e793ab980 1 Processor -- start 2024-09-13T06:10:00.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.575+0000 7f3e793ab980 1 -- start start 2024-09-13T06:10:00.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.575+0000 7f3e793ab980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55ecc31cc290 0x55ecc325a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.575+0000 7f3e793ab980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ecc30dfae0 con 0x55ecc325a8e0 2024-09-13T06:10:00.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.575+0000 7f3e793ab980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x55ecc3103e30 con 0x55ecc31cc290 2024-09-13T06:10:00.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.575+0000 7f3e76ebb640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55ecc31cc290 0x55ecc325a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.575+0000 7f3e766ba640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x55ecc325a8e0 0x55ecc325ccd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:51262/0 (socket says 172.21.15.194:51262) 2024-09-13T06:10:00.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.575+0000 7f3e766ba640 1 -- 172.21.15.194:0/3731796800 learned_addr learned my addr 172.21.15.194:0/3731796800 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-09-13T06:10:00.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.575+0000 7f3e76ebb640 1 -- 172.21.15.194:0/3731796800 >> v1:172.21.15.120:6789/0 conn(0x55ecc325a8e0 legacy=0x55ecc325ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.575+0000 7f3e76ebb640 1 -- 172.21.15.194:0/3731796800 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecc31cc820 con 0x55ecc31cc290 2024-09-13T06:10:00.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.579+0000 7f3e76ebb640 1 --2- 172.21.15.194:0/3731796800 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ecc31cc290 0x55ecc325a3a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f3e6800a480 tx=0x7f3e6801b110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abf180a5c8a69de6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.579+0000 7f3e75eb9640 1 -- 172.21.15.194:0/3731796800 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e680af070 con 0x55ecc31cc290 2024-09-13T06:10:00.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.579+0000 7f3e75eb9640 1 -- 172.21.15.194:0/3731796800 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e680a3e50 con 0x55ecc31cc290 2024-09-13T06:10:00.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.579+0000 7f3e75eb9640 1 -- 172.21.15.194:0/3731796800 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e680aa680 con 0x55ecc31cc290 2024-09-13T06:10:00.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.579+0000 7f3e793ab980 1 -- 172.21.15.194:0/3731796800 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ecc31cc290 msgr2=0x55ecc325a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.579+0000 7f3e793ab980 1 --2- 172.21.15.194:0/3731796800 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ecc31cc290 0x55ecc325a3a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f3e6800a480 tx=0x7f3e6801b110 comp rx=0 tx=0).stop 2024-09-13T06:10:00.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.579+0000 7f3e793ab980 1 -- 172.21.15.194:0/3731796800 shutdown_connections 2024-09-13T06:10:00.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.579+0000 7f3e793ab980 1 --2- 172.21.15.194:0/3731796800 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ecc31cc290 0x55ecc325a3a0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.579+0000 7f3e793ab980 1 -- 172.21.15.194:0/3731796800 >> 172.21.15.194:0/3731796800 conn(0x55ecc3252090 msgr2=0x55ecc32544b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:00.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.579+0000 7f3e793ab980 1 -- 172.21.15.194:0/3731796800 shutdown_connections 2024-09-13T06:10:00.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.579+0000 7f3e793ab980 1 -- 172.21.15.194:0/3731796800 wait complete. 2024-09-13T06:10:00.594 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.591+0000 7f3e793ab980 1 Processor -- start 2024-09-13T06:10:00.594 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.591+0000 7f3e793ab980 1 -- start start 2024-09-13T06:10:00.594 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.591+0000 7f3e793ab980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ecc31cc290 0x55ecc3342a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.594 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.595+0000 7f3e793ab980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55ecc3105200 con 0x55ecc31cc290 2024-09-13T06:10:00.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.595+0000 7f3e76ebb640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ecc31cc290 0x55ecc3342a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.595+0000 7f3e76ebb640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ecc31cc290 0x55ecc3342a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:46060/0 (socket says 172.21.15.194:46060) 2024-09-13T06:10:00.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.595+0000 7f3e76ebb640 1 -- 172.21.15.194:0/3992459378 learned_addr learned my addr 172.21.15.194:0/3992459378 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:00.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.595+0000 7f3e76ebb640 1 -- 172.21.15.194:0/3992459378 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecc3343030 con 0x55ecc31cc290 2024-09-13T06:10:00.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.595+0000 7f3e76ebb640 1 --2- 172.21.15.194:0/3992459378 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ecc31cc290 0x55ecc3342a60 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f3e680ad040 tx=0x7f3e68003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=547d0b9969164422 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.598 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.595+0000 7f3d64e09640 1 -- 172.21.15.194:0/3992459378 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e680af040 con 0x55ecc31cc290 2024-09-13T06:10:00.598 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.595+0000 7f3d64e09640 1 -- 172.21.15.194:0/3992459378 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e680aa870 con 0x55ecc31cc290 2024-09-13T06:10:00.598 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.595+0000 7f3d64e09640 1 -- 172.21.15.194:0/3992459378 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e680aab50 con 0x55ecc31cc290 2024-09-13T06:10:00.598 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.595+0000 7f3e793ab980 1 -- 172.21.15.194:0/3992459378 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ecc31cc290 msgr2=0x55ecc3342a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.598 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.595+0000 7f3e793ab980 1 --2- 172.21.15.194:0/3992459378 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ecc31cc290 0x55ecc3342a60 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f3e680ad040 tx=0x7f3e68003030 comp rx=0 tx=0).stop 2024-09-13T06:10:00.598 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.595+0000 7f3e793ab980 1 -- 172.21.15.194:0/3992459378 shutdown_connections 2024-09-13T06:10:00.598 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.595+0000 7f3e793ab980 1 --2- 172.21.15.194:0/3992459378 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ecc31cc290 0x55ecc3342a60 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.598 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.595+0000 7f3e793ab980 1 -- 172.21.15.194:0/3992459378 >> 172.21.15.194:0/3992459378 conn(0x55ecc3252090 msgr2=0x55ecc333e690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:00.598 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.595+0000 7f3e793ab980 1 -- 172.21.15.194:0/3992459378 shutdown_connections 2024-09-13T06:10:00.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.595+0000 7f3e793ab980 1 -- 172.21.15.194:0/3992459378 wait complete. 2024-09-13T06:10:00.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.595+0000 7f3e793ab980 1 Processor -- start 2024-09-13T06:10:00.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.595+0000 7f3e793ab980 1 -- start start 2024-09-13T06:10:00.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.595+0000 7f3e793ab980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ecc31cc290 0x55ecc3257ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.595+0000 7f3e793ab980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55ecc325ef00 con 0x55ecc31cc290 2024-09-13T06:10:00.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.595+0000 7f3e76ebb640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ecc31cc290 0x55ecc3257ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.595+0000 7f3e76ebb640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ecc31cc290 0x55ecc3257ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:46070/0 (socket says 172.21.15.194:46070) 2024-09-13T06:10:00.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.595+0000 7f3e76ebb640 1 -- 172.21.15.194:0/1233915758 learned_addr learned my addr 172.21.15.194:0/1233915758 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:00.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.599+0000 7f3e76ebb640 1 -- 172.21.15.194:0/1233915758 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecc32563c0 con 0x55ecc31cc290 2024-09-13T06:10:00.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.599+0000 7f3e76ebb640 1 --2- 172.21.15.194:0/1233915758 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ecc31cc290 0x55ecc3257ca0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f3e6800a480 tx=0x7f3e68017eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.599+0000 7f3d63606640 1 -- 172.21.15.194:0/1233915758 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e680c2070 con 0x55ecc31cc290 2024-09-13T06:10:00.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.599+0000 7f3d63606640 1 -- 172.21.15.194:0/1233915758 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e680b5b70 con 0x55ecc31cc290 2024-09-13T06:10:00.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.599+0000 7f3e793ab980 1 -- 172.21.15.194:0/1233915758 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ecc3256650 con 0x55ecc31cc290 2024-09-13T06:10:00.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.599+0000 7f3d63606640 1 -- 172.21.15.194:0/1233915758 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e680cc060 con 0x55ecc31cc290 2024-09-13T06:10:00.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.599+0000 7f3e793ab980 1 -- 172.21.15.194:0/1233915758 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ecc3256b40 con 0x55ecc31cc290 2024-09-13T06:10:00.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.599+0000 7f3d63606640 1 -- 172.21.15.194:0/1233915758 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3e680c5070 con 0x55ecc31cc290 2024-09-13T06:10:00.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.599+0000 7f3d63606640 1 --2- 172.21.15.194:0/1233915758 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3d5c034650 0x7f3d5c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.599+0000 7f3d63606640 1 -- 172.21.15.194:0/1233915758 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f3e680ba070 con 0x55ecc31cc290 2024-09-13T06:10:00.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.599+0000 7f3e766ba640 1 --2- 172.21.15.194:0/1233915758 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3d5c034650 0x7f3d5c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.599+0000 7f3e793ab980 1 --2- 172.21.15.194:0/1233915758 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ecc325a8e0 0x55ecc33530b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.599+0000 7f3e793ab980 1 -- 172.21.15.194:0/1233915758 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ecc33535f0 con 0x55ecc325a8e0 2024-09-13T06:10:00.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.599+0000 7f3e776bc640 1 --2- 172.21.15.194:0/1233915758 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ecc325a8e0 0x55ecc33530b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.599+0000 7f3e766ba640 1 --2- 172.21.15.194:0/1233915758 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3d5c034650 0x7f3d5c036b10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c00b330 tx=0x7f3e6c0014b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.599+0000 7f3e776bc640 1 --2- 172.21.15.194:0/1233915758 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ecc325a8e0 0x55ecc33530b0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.599+0000 7f3e776bc640 1 -- 172.21.15.194:0/1233915758 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3e7000a4d0 con 0x55ecc325a8e0 2024-09-13T06:10:00.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.599+0000 7f3e793ab980 1 -- 172.21.15.194:0/1233915758 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ecc33539d0 con 0x55ecc325a8e0 2024-09-13T06:10:00.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.599+0000 7f3e776bc640 1 -- 172.21.15.194:0/1233915758 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3e7000a4d0 con 0x55ecc325a8e0 2024-09-13T06:10:00.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.599+0000 7f3e793ab980 1 --2- 172.21.15.194:0/1233915758 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ecc33557b0 0x55ecc3357ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.599+0000 7f3e793ab980 1 -- 172.21.15.194:0/1233915758 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ecc33582e0 con 0x55ecc33557b0 2024-09-13T06:10:00.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.599+0000 7f3e76ebb640 1 --2- 172.21.15.194:0/1233915758 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ecc33557b0 0x55ecc3357ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.599+0000 7f3e76ebb640 1 --2- 172.21.15.194:0/1233915758 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ecc33557b0 0x55ecc3357ba0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.603+0000 7f3e76ebb640 1 -- 172.21.15.194:0/1233915758 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3e680c4030 con 0x55ecc33557b0 2024-09-13T06:10:00.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.603+0000 7f3e793ab980 1 -- 172.21.15.194:0/1233915758 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ecc33545f0 con 0x55ecc325a8e0 2024-09-13T06:10:00.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.603+0000 7f3e776bc640 1 -- 172.21.15.194:0/1233915758 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3e7000a4d0 con 0x55ecc325a8e0 2024-09-13T06:10:00.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.603+0000 7f3e793ab980 1 --2- 172.21.15.194:0/1233915758 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55ecc3359720 0x55ecc335bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.603+0000 7f3e793ab980 1 -- 172.21.15.194:0/1233915758 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ecc335c200 con 0x55ecc3359720 2024-09-13T06:10:00.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.603+0000 7f3e766ba640 1 --2- 172.21.15.194:0/1233915758 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55ecc3359720 0x55ecc335bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.603+0000 7f3e766ba640 1 --2- 172.21.15.194:0/1233915758 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55ecc3359720 0x55ecc335bb10 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.603+0000 7f3e766ba640 1 -- 172.21.15.194:0/1233915758 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3e6c00f7a0 con 0x55ecc3359720 2024-09-13T06:10:00.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.603+0000 7f3e793ab980 1 Processor -- start 2024-09-13T06:10:00.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.603+0000 7f3e793ab980 1 -- start start 2024-09-13T06:10:00.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.603+0000 7f3e793ab980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ecc3369c90 0x55ecc336a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.603+0000 7f3e793ab980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55ecc315e800 con 0x55ecc3369c90 2024-09-13T06:10:00.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.603+0000 7f3e76ebb640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ecc3369c90 0x55ecc336a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.603+0000 7f3e76ebb640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ecc3369c90 0x55ecc336a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:46084/0 (socket says 172.21.15.194:46084) 2024-09-13T06:10:00.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.603+0000 7f3e76ebb640 1 -- 172.21.15.194:0/2990154779 learned_addr learned my addr 172.21.15.194:0/2990154779 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:00.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.603+0000 7f3e76ebb640 1 -- 172.21.15.194:0/2990154779 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecc336a5f0 con 0x55ecc3369c90 2024-09-13T06:10:00.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.603+0000 7f3e76ebb640 1 --2- 172.21.15.194:0/2990154779 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ecc3369c90 0x55ecc336a0b0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f3e680e2fe0 tx=0x7f3e680e46f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.603+0000 7f3d60e01640 1 -- 172.21.15.194:0/2990154779 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e680d9600 con 0x55ecc3369c90 2024-09-13T06:10:00.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.603+0000 7f3d60e01640 1 -- 172.21.15.194:0/2990154779 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e680e9070 con 0x55ecc3369c90 2024-09-13T06:10:00.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.603+0000 7f3e793ab980 1 -- 172.21.15.194:0/2990154779 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ecc336a820 con 0x55ecc3369c90 2024-09-13T06:10:00.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.603+0000 7f3d60e01640 1 -- 172.21.15.194:0/2990154779 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e680d98f0 con 0x55ecc3369c90 2024-09-13T06:10:00.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.603+0000 7f3e793ab980 1 -- 172.21.15.194:0/2990154779 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ecc336a820 con 0x55ecc3369c90 2024-09-13T06:10:00.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.607+0000 7f3d60e01640 1 -- 172.21.15.194:0/2990154779 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3e680d9a90 con 0x55ecc3369c90 2024-09-13T06:10:00.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.607+0000 7f3d60e01640 1 --2- 172.21.15.194:0/2990154779 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3d50034600 0x7f3d50036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.607+0000 7f3d60e01640 1 -- 172.21.15.194:0/2990154779 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f3e680e0070 con 0x55ecc3369c90 2024-09-13T06:10:00.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.607+0000 7f3e766ba640 1 --2- 172.21.15.194:0/2990154779 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3d50034600 0x7f3d50036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.607+0000 7f3e793ab980 1 Processor -- start 2024-09-13T06:10:00.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.607+0000 7f3e793ab980 1 -- start start 2024-09-13T06:10:00.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.607+0000 7f3e766ba640 1 --2- 172.21.15.194:0/2990154779 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3d50034600 0x7f3d50036ac0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x55ecc335c600 tx=0x7f3e6c006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.607+0000 7f3e793ab980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ecc3376250 0x55ecc3376630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.607+0000 7f3e793ab980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55ecc33432f0 con 0x55ecc3376250 2024-09-13T06:10:00.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.607+0000 7f3e76ebb640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ecc3376250 0x55ecc3376630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.607+0000 7f3e76ebb640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ecc3376250 0x55ecc3376630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:46088/0 (socket says 172.21.15.194:46088) 2024-09-13T06:10:00.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.607+0000 7f3e76ebb640 1 -- 172.21.15.194:0/1253881489 learned_addr learned my addr 172.21.15.194:0/1253881489 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:00.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.607+0000 7f3e76ebb640 1 -- 172.21.15.194:0/1253881489 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecc3376c00 con 0x55ecc3376250 2024-09-13T06:10:00.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.607+0000 7f3e76ebb640 1 --2- 172.21.15.194:0/1253881489 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ecc3376250 0x55ecc3376630 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f3e680d4fd0 tx=0x7f3e680d9d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5d808c37cf14a51 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.607+0000 7f3d5a7fc640 1 -- 172.21.15.194:0/1253881489 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e680ed5a0 con 0x55ecc3376250 2024-09-13T06:10:00.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.607+0000 7f3d5a7fc640 1 -- 172.21.15.194:0/1253881489 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e680a93a0 con 0x55ecc3376250 2024-09-13T06:10:00.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.607+0000 7f3d5a7fc640 1 -- 172.21.15.194:0/1253881489 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e680ed3c0 con 0x55ecc3376250 2024-09-13T06:10:00.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.607+0000 7f3e793ab980 1 -- 172.21.15.194:0/1253881489 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ecc3376250 msgr2=0x55ecc3376630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.607+0000 7f3e793ab980 1 --2- 172.21.15.194:0/1253881489 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ecc3376250 0x55ecc3376630 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f3e680d4fd0 tx=0x7f3e680d9d80 comp rx=0 tx=0).stop 2024-09-13T06:10:00.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.607+0000 7f3e793ab980 1 -- 172.21.15.194:0/1253881489 shutdown_connections 2024-09-13T06:10:00.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.607+0000 7f3e793ab980 1 --2- 172.21.15.194:0/1253881489 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ecc3376250 0x55ecc3376630 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.607+0000 7f3e793ab980 1 -- 172.21.15.194:0/1253881489 >> 172.21.15.194:0/1253881489 conn(0x55ecc3372630 msgr2=0x55ecc3370730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:00.614 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.607+0000 7f3e793ab980 1 -- 172.21.15.194:0/1253881489 shutdown_connections 2024-09-13T06:10:00.614 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.607+0000 7f3e793ab980 1 -- 172.21.15.194:0/1253881489 wait complete. 2024-09-13T06:10:00.614 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.607+0000 7f3e793ab980 1 Processor -- start 2024-09-13T06:10:00.614 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.607+0000 7f3e793ab980 1 -- start start 2024-09-13T06:10:00.614 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.607+0000 7f3e793ab980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ecc3376250 0x55ecc337d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.614 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.607+0000 7f3e793ab980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55ecc33770a0 con 0x55ecc3376250 2024-09-13T06:10:00.614 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.611+0000 7f3e76ebb640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ecc3376250 0x55ecc337d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.614 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.611+0000 7f3e76ebb640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ecc3376250 0x55ecc337d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:46104/0 (socket says 172.21.15.194:46104) 2024-09-13T06:10:00.614 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.611+0000 7f3e76ebb640 1 -- 172.21.15.194:0/2006135831 learned_addr learned my addr 172.21.15.194:0/2006135831 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:00.624 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.611+0000 7f3e76ebb640 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecc337da30 con 0x55ecc3376250 2024-09-13T06:10:00.624 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.611+0000 7f3e76ebb640 1 --2- 172.21.15.194:0/2006135831 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ecc3376250 0x55ecc337d4f0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f3e680e1e00 tx=0x7f3e680d5ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.624 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.611+0000 7f3d58ff9640 1 -- 172.21.15.194:0/2006135831 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e680ed5a0 con 0x55ecc3376250 2024-09-13T06:10:00.624 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.611+0000 7f3e793ab980 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ecc337da30 con 0x55ecc3376250 2024-09-13T06:10:00.624 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.611+0000 7f3d58ff9640 1 -- 172.21.15.194:0/2006135831 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e680a9550 con 0x55ecc3376250 2024-09-13T06:10:00.624 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.611+0000 7f3d58ff9640 1 -- 172.21.15.194:0/2006135831 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e680d0a40 con 0x55ecc3376250 2024-09-13T06:10:00.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.611+0000 7f3e793ab980 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ecc337dea0 con 0x55ecc3376250 2024-09-13T06:10:00.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.611+0000 7f3e793ab980 20 rados->read ofs=0 len=0 2024-09-13T06:10:00.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.611+0000 7f3d58ff9640 1 -- 172.21.15.194:0/2006135831 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3e68112020 con 0x55ecc3376250 2024-09-13T06:10:00.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.611+0000 7f3d58ff9640 1 --2- 172.21.15.194:0/2006135831 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3d40034650 0x7f3d40036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.611+0000 7f3d58ff9640 1 -- 172.21.15.194:0/2006135831 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f3e68110020 con 0x55ecc3376250 2024-09-13T06:10:00.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.611+0000 7f3e766ba640 1 --2- 172.21.15.194:0/2006135831 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3d40034650 0x7f3d40036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.611+0000 7f3e793ab980 1 --2- 172.21.15.194:0/2006135831 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ecc33885a0 0x55ecc338aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.611+0000 7f3e793ab980 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ecc338b1b0 con 0x55ecc33885a0 2024-09-13T06:10:00.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.611+0000 7f3e776bc640 1 --2- 172.21.15.194:0/2006135831 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ecc33885a0 0x55ecc338aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.611+0000 7f3e776bc640 1 --2- 172.21.15.194:0/2006135831 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ecc33885a0 0x55ecc338aa60 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.611+0000 7f3e766ba640 1 --2- 172.21.15.194:0/2006135831 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3d40034650 0x7f3d40036b10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c00fbd0 tx=0x7f3e6c023040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.611+0000 7f3e776bc640 1 -- 172.21.15.194:0/2006135831 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3e7000a4d0 con 0x55ecc33885a0 2024-09-13T06:10:00.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.611+0000 7f3e793ab980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:00.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.611+0000 7f3e793ab980 20 realm 2024-09-13T06:10:00.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.611+0000 7f3e793ab980 20 rados->read ofs=0 len=0 2024-09-13T06:10:00.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.611+0000 7f3e793ab980 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ecc338b5c0 con 0x55ecc33885a0 2024-09-13T06:10:00.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.611+0000 7f3e776bc640 1 -- 172.21.15.194:0/2006135831 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3e7000a4d0 con 0x55ecc33885a0 2024-09-13T06:10:00.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.611+0000 7f3e793ab980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:00.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.611+0000 7f3e793ab980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:10:00.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.611+0000 7f3e793ab980 20 rados->read ofs=0 len=0 2024-09-13T06:10:00.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.611+0000 7f3e793ab980 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ecc338be60 con 0x55ecc33885a0 2024-09-13T06:10:00.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.611+0000 7f3e776bc640 1 -- 172.21.15.194:0/2006135831 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3e7000a4d0 con 0x55ecc33885a0 2024-09-13T06:10:00.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.611+0000 7f3e793ab980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:00.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.611+0000 7f3e793ab980 20 rados->read ofs=0 len=0 2024-09-13T06:10:00.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.611+0000 7f3e793ab980 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ecc338c200 con 0x55ecc33885a0 2024-09-13T06:10:00.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.615+0000 7f3e776bc640 1 -- 172.21.15.194:0/2006135831 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3e7000a4d0 con 0x55ecc33885a0 2024-09-13T06:10:00.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.615+0000 7f3e793ab980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:10:00.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.615+0000 7f3e793ab980 20 rados->read ofs=0 len=0 2024-09-13T06:10:00.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.615+0000 7f3e793ab980 1 --2- 172.21.15.194:0/2006135831 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ecc338cf60 0x55ecc338f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.615+0000 7f3e793ab980 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ecc338f8d0 con 0x55ecc338cf60 2024-09-13T06:10:00.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.615+0000 7f3e76ebb640 1 --2- 172.21.15.194:0/2006135831 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ecc338cf60 0x55ecc338f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.615+0000 7f3e76ebb640 1 --2- 172.21.15.194:0/2006135831 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ecc338cf60 0x55ecc338f350 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.615+0000 7f3e76ebb640 1 -- 172.21.15.194:0/2006135831 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3e680e4d70 con 0x55ecc338cf60 2024-09-13T06:10:00.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.615+0000 7f3e793ab980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:10:00.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.615+0000 7f3e793ab980 20 searching for the correct realm 2024-09-13T06:10:00.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.615+0000 7f3e793ab980 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ecc3391130 con 0x55ecc338cf60 2024-09-13T06:10:00.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.615+0000 7f3e76ebb640 1 -- 172.21.15.194:0/2006135831 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e680e4d70 con 0x55ecc338cf60 2024-09-13T06:10:00.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.615+0000 7f3e76ebb640 1 --2- 172.21.15.194:0/2006135831 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f3e680c7070 0x7f3e680e0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.615+0000 7f3e76ebb640 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ecc3391130 con 0x7f3e680c7070 2024-09-13T06:10:00.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.615+0000 7f3e766ba640 1 --2- 172.21.15.194:0/2006135831 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f3e680c7070 0x7f3e680e0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.615+0000 7f3e766ba640 1 --2- 172.21.15.194:0/2006135831 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f3e680c7070 0x7f3e680e0a20 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.615+0000 7f3e766ba640 1 -- 172.21.15.194:0/2006135831 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3e6c037040 con 0x7f3e680c7070 2024-09-13T06:10:00.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.615+0000 7f3e766ba640 1 --2- 172.21.15.194:0/2006135831 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f3e6c01f940 0x7f3e6c03a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.615+0000 7f3e766ba640 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ecc3391130 con 0x7f3e6c01f940 2024-09-13T06:10:00.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.615+0000 7f3e776bc640 1 --2- 172.21.15.194:0/2006135831 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f3e6c01f940 0x7f3e6c03a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.615+0000 7f3e776bc640 1 --2- 172.21.15.194:0/2006135831 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f3e6c01f940 0x7f3e6c03a3c0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.615+0000 7f3e776bc640 1 -- 172.21.15.194:0/2006135831 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e7000a4d0 con 0x7f3e6c01f940 2024-09-13T06:10:00.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.615+0000 7f3e776bc640 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ecc338c200 con 0x55ecc33885a0 2024-09-13T06:10:00.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.615+0000 7f3e776bc640 1 -- 172.21.15.194:0/2006135831 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e7000a4d0 con 0x55ecc33885a0 2024-09-13T06:10:00.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.615+0000 7f3e776bc640 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ecc338c200 con 0x55ecc33885a0 2024-09-13T06:10:00.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.615+0000 7f3e776bc640 1 -- 172.21.15.194:0/2006135831 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e7000a4d0 con 0x55ecc33885a0 2024-09-13T06:10:00.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.615+0000 7f3e776bc640 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ecc338c200 con 0x7f3e6c01f940 2024-09-13T06:10:00.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.619+0000 7f3e776bc640 1 -- 172.21.15.194:0/2006135831 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e7000a4d0 con 0x7f3e6c01f940 2024-09-13T06:10:00.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.619+0000 7f3e776bc640 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ecc338c200 con 0x7f3e6c01f940 2024-09-13T06:10:00.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.619+0000 7f3e776bc640 1 -- 172.21.15.194:0/2006135831 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e7000a4d0 con 0x7f3e6c01f940 2024-09-13T06:10:00.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.619+0000 7f3e776bc640 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ecc338c200 con 0x7f3e680c7070 2024-09-13T06:10:00.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.619+0000 7f3e766ba640 1 -- 172.21.15.194:0/2006135831 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e6c037040 con 0x7f3e680c7070 2024-09-13T06:10:00.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.619+0000 7f3e766ba640 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ecc338c200 con 0x55ecc338cf60 2024-09-13T06:10:00.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.619+0000 7f3e76ebb640 1 -- 172.21.15.194:0/2006135831 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e680e4d70 con 0x55ecc338cf60 2024-09-13T06:10:00.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.619+0000 7f3e76ebb640 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ecc338c200 con 0x55ecc33885a0 2024-09-13T06:10:00.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.619+0000 7f3e776bc640 1 -- 172.21.15.194:0/2006135831 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e7000a4d0 con 0x55ecc33885a0 2024-09-13T06:10:00.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.619+0000 7f3e776bc640 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ecc338c200 con 0x7f3e6c01f940 2024-09-13T06:10:00.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.619+0000 7f3e776bc640 1 -- 172.21.15.194:0/2006135831 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e7000a4d0 con 0x7f3e6c01f940 2024-09-13T06:10:00.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.619+0000 7f3e776bc640 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ecc338c200 con 0x55ecc33885a0 2024-09-13T06:10:00.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.619+0000 7f3e776bc640 1 -- 172.21.15.194:0/2006135831 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e7000a4d0 con 0x55ecc33885a0 2024-09-13T06:10:00.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.619+0000 7f3e776bc640 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ecc338c200 con 0x7f3e680c7070 2024-09-13T06:10:00.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.619+0000 7f3e766ba640 1 -- 172.21.15.194:0/2006135831 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3e6c037040 con 0x7f3e680c7070 2024-09-13T06:10:00.631 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.619+0000 7f3e766ba640 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ecc338c200 con 0x55ecc338cf60 2024-09-13T06:10:00.631 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.619+0000 7f3e76ebb640 1 -- 172.21.15.194:0/2006135831 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e680e4d70 con 0x55ecc338cf60 2024-09-13T06:10:00.631 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.619+0000 7f3e76ebb640 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ecc338c200 con 0x55ecc338cf60 2024-09-13T06:10:00.631 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.619+0000 7f3e76ebb640 1 -- 172.21.15.194:0/2006135831 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e680e4d70 con 0x55ecc338cf60 2024-09-13T06:10:00.631 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.619+0000 7f3e76ebb640 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ecc338c200 con 0x7f3e6c01f940 2024-09-13T06:10:00.631 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.619+0000 7f3e776bc640 1 -- 172.21.15.194:0/2006135831 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e7000a4d0 con 0x7f3e6c01f940 2024-09-13T06:10:00.631 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.619+0000 7f3e776bc640 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ecc338c200 con 0x55ecc338cf60 2024-09-13T06:10:00.631 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.619+0000 7f3e76ebb640 1 -- 172.21.15.194:0/2006135831 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e680e4d70 con 0x55ecc338cf60 2024-09-13T06:10:00.631 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.619+0000 7f3e76ebb640 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ecc338c200 con 0x55ecc338cf60 2024-09-13T06:10:00.631 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.623+0000 7f3e76ebb640 1 -- 172.21.15.194:0/2006135831 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e680e4d70 con 0x55ecc338cf60 2024-09-13T06:10:00.631 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.623+0000 7f3e76ebb640 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ecc338c200 con 0x55ecc33885a0 2024-09-13T06:10:00.631 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.623+0000 7f3e776bc640 1 -- 172.21.15.194:0/2006135831 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e7000a4d0 con 0x55ecc33885a0 2024-09-13T06:10:00.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.623+0000 7f3e776bc640 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ecc338c200 con 0x55ecc33885a0 2024-09-13T06:10:00.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.623+0000 7f3e776bc640 1 -- 172.21.15.194:0/2006135831 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3e7000a4d0 con 0x55ecc33885a0 2024-09-13T06:10:00.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.623+0000 7f3e776bc640 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ecc338c200 con 0x7f3e6c01f940 2024-09-13T06:10:00.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.623+0000 7f3e776bc640 1 -- 172.21.15.194:0/2006135831 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e7000a4d0 con 0x7f3e6c01f940 2024-09-13T06:10:00.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.623+0000 7f3e776bc640 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ecc338c200 con 0x55ecc338cf60 2024-09-13T06:10:00.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.623+0000 7f3e76ebb640 1 -- 172.21.15.194:0/2006135831 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e680e4d70 con 0x55ecc338cf60 2024-09-13T06:10:00.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.623+0000 7f3e76ebb640 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ecc338c200 con 0x7f3e680c7070 2024-09-13T06:10:00.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.623+0000 7f3e766ba640 1 -- 172.21.15.194:0/2006135831 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e6c037040 con 0x7f3e680c7070 2024-09-13T06:10:00.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.623+0000 7f3e766ba640 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ecc338c200 con 0x55ecc33885a0 2024-09-13T06:10:00.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.623+0000 7f3e776bc640 1 -- 172.21.15.194:0/2006135831 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e7000a4d0 con 0x55ecc33885a0 2024-09-13T06:10:00.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.623+0000 7f3e776bc640 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ecc338c200 con 0x7f3e6c01f940 2024-09-13T06:10:00.638 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.623+0000 7f3e776bc640 1 -- 172.21.15.194:0/2006135831 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e7000a4d0 con 0x7f3e6c01f940 2024-09-13T06:10:00.639 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.623+0000 7f3e776bc640 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ecc338c200 con 0x55ecc338cf60 2024-09-13T06:10:00.639 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.623+0000 7f3e76ebb640 1 -- 172.21.15.194:0/2006135831 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3e680e4d70 con 0x55ecc338cf60 2024-09-13T06:10:00.639 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.623+0000 7f3e76ebb640 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ecc338c200 con 0x7f3e6c01f940 2024-09-13T06:10:00.639 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.623+0000 7f3e776bc640 1 -- 172.21.15.194:0/2006135831 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e7000a4d0 con 0x7f3e6c01f940 2024-09-13T06:10:00.639 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.623+0000 7f3e776bc640 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ecc338c200 con 0x7f3e680c7070 2024-09-13T06:10:00.639 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.623+0000 7f3e766ba640 1 -- 172.21.15.194:0/2006135831 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e6c037040 con 0x7f3e680c7070 2024-09-13T06:10:00.639 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.623+0000 7f3e766ba640 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ecc338c200 con 0x55ecc338cf60 2024-09-13T06:10:00.639 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.623+0000 7f3e76ebb640 1 -- 172.21.15.194:0/2006135831 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e680e4d70 con 0x55ecc338cf60 2024-09-13T06:10:00.639 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.623+0000 7f3e76ebb640 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ecc338c200 con 0x7f3e6c01f940 2024-09-13T06:10:00.639 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.627+0000 7f3e776bc640 1 -- 172.21.15.194:0/2006135831 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e7000a4d0 con 0x7f3e6c01f940 2024-09-13T06:10:00.639 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.627+0000 7f3e776bc640 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ecc338c200 con 0x55ecc33885a0 2024-09-13T06:10:00.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.627+0000 7f3e776bc640 1 -- 172.21.15.194:0/2006135831 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3e7000a4d0 con 0x55ecc33885a0 2024-09-13T06:10:00.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.627+0000 7f3e776bc640 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ecc338c200 con 0x7f3e680c7070 2024-09-13T06:10:00.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.627+0000 7f3e766ba640 1 -- 172.21.15.194:0/2006135831 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e6c037040 con 0x7f3e680c7070 2024-09-13T06:10:00.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.627+0000 7f3e793ab980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:10:00.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.627+0000 7f3e793ab980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:10:00.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.627+0000 7f3e793ab980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:10:00.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.627+0000 7f3e793ab980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:10:00.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.627+0000 7f3e793ab980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:10:00.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.627+0000 7f3e793ab980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:10:00.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.627+0000 7f3e793ab980 20 rados->read ofs=0 len=0 2024-09-13T06:10:00.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.627+0000 7f3e793ab980 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ecc33901e0 con 0x55ecc33885a0 2024-09-13T06:10:00.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.627+0000 7f3e776bc640 1 -- 172.21.15.194:0/2006135831 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3e7000a4d0 con 0x55ecc33885a0 2024-09-13T06:10:00.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.627+0000 7f3e793ab980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:00.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.627+0000 7f3e793ab980 20 rados->read ofs=0 len=0 2024-09-13T06:10:00.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.627+0000 7f3e793ab980 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ecc3390a80 con 0x55ecc33885a0 2024-09-13T06:10:00.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.627+0000 7f3e776bc640 1 -- 172.21.15.194:0/2006135831 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3e7000a4d0 con 0x55ecc33885a0 2024-09-13T06:10:00.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.627+0000 7f3e793ab980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:10:00.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.627+0000 7f3e793ab980 20 rados->read ofs=0 len=0 2024-09-13T06:10:00.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.627+0000 7f3e793ab980 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ecc338fe20 con 0x7f3e680c7070 2024-09-13T06:10:00.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.627+0000 7f3e766ba640 1 -- 172.21.15.194:0/2006135831 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3e6c037040 con 0x7f3e680c7070 2024-09-13T06:10:00.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.627+0000 7f3e793ab980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:10:00.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.627+0000 7f3e793ab980 20 zone default found 2024-09-13T06:10:00.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.627+0000 7f3e793ab980 4 Realm: () 2024-09-13T06:10:00.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.627+0000 7f3e793ab980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:10:00.642 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.627+0000 7f3e793ab980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:10:00.642 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.627+0000 7f3e793ab980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:10:00.642 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.627+0000 7f3e793ab980 20 zonegroup default 2024-09-13T06:10:00.642 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.627+0000 7f3e793ab980 20 rados->read ofs=0 len=0 2024-09-13T06:10:00.642 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.627+0000 7f3e793ab980 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ecc3390a80 con 0x7f3e6c01f940 2024-09-13T06:10:00.642 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.627+0000 7f3e776bc640 1 -- 172.21.15.194:0/2006135831 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3e7000a4d0 con 0x7f3e6c01f940 2024-09-13T06:10:00.642 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.627+0000 7f3e793ab980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:00.642 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.627+0000 7f3e793ab980 20 rados->read ofs=0 len=0 2024-09-13T06:10:00.642 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.627+0000 7f3e793ab980 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ecc3392fe0 con 0x55ecc338cf60 2024-09-13T06:10:00.642 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.627+0000 7f3e76ebb640 1 -- 172.21.15.194:0/2006135831 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3e680e4d70 con 0x55ecc338cf60 2024-09-13T06:10:00.642 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.627+0000 7f3e793ab980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:00.642 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.627+0000 7f3e793ab980 20 rados->read ofs=0 len=0 2024-09-13T06:10:00.643 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.627+0000 7f3e793ab980 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ecc3393380 con 0x55ecc338cf60 2024-09-13T06:10:00.643 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.627+0000 7f3e76ebb640 1 -- 172.21.15.194:0/2006135831 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3e680e4d70 con 0x55ecc338cf60 2024-09-13T06:10:00.643 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.627+0000 7f3e793ab980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:00.643 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.627+0000 7f3e793ab980 20 started sync module instance, tier type = 2024-09-13T06:10:00.643 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.627+0000 7f3e793ab980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:10:00.643 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.627+0000 7f3e793ab980 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ecc3392480 con 0x7f3e680c7070 2024-09-13T06:10:00.643 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.631+0000 7f3e766ba640 1 -- 172.21.15.194:0/2006135831 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(44 notify.0 [create] v33'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e6c037040 con 0x7f3e680c7070 2024-09-13T06:10:00.643 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.631+0000 7f3e793ab980 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94475375945840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ecc3393bd0 con 0x7f3e680c7070 2024-09-13T06:10:00.643 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.631+0000 7f3e793ab980 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ecc3394420 con 0x55ecc33885a0 2024-09-13T06:10:00.643 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.631+0000 7f3e766ba640 1 -- 172.21.15.194:0/2006135831 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94475375945840] v33'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e6c037040 con 0x7f3e680c7070 2024-09-13T06:10:00.643 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.631+0000 7f3e776bc640 1 -- 172.21.15.194:0/2006135831 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v33'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e7000a4d0 con 0x55ecc33885a0 2024-09-13T06:10:00.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.631+0000 7f3e793ab980 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94475375949600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ecc3394420 con 0x55ecc33885a0 2024-09-13T06:10:00.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.631+0000 7f3e793ab980 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ecc3394ea0 con 0x55ecc338cf60 2024-09-13T06:10:00.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.635+0000 7f3e776bc640 1 -- 172.21.15.194:0/2006135831 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94475375949600] v33'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e7000a4d0 con 0x55ecc33885a0 2024-09-13T06:10:00.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.635+0000 7f3e76ebb640 1 -- 172.21.15.194:0/2006135831 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v33'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e680e4d70 con 0x55ecc338cf60 2024-09-13T06:10:00.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.635+0000 7f3e793ab980 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94475375954320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ecc3394420 con 0x55ecc338cf60 2024-09-13T06:10:00.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.635+0000 7f3e793ab980 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ecc33958b0 con 0x7f3e680c7070 2024-09-13T06:10:00.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.635+0000 7f3e766ba640 1 -- 172.21.15.194:0/2006135831 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(50 notify.3 [create] v33'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e6c037040 con 0x7f3e680c7070 2024-09-13T06:10:00.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.635+0000 7f3e793ab980 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94475375956992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ecc3396150 con 0x7f3e680c7070 2024-09-13T06:10:00.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.635+0000 7f3e793ab980 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ecc3396b50 con 0x55ecc33885a0 2024-09-13T06:10:00.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.635+0000 7f3e76ebb640 1 -- 172.21.15.194:0/2006135831 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94475375954320] v33'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e680e4d70 con 0x55ecc338cf60 2024-09-13T06:10:00.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.635+0000 7f3e766ba640 1 -- 172.21.15.194:0/2006135831 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94475375956992] v33'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e6c037040 con 0x7f3e680c7070 2024-09-13T06:10:00.645 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.635+0000 7f3e776bc640 1 -- 172.21.15.194:0/2006135831 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v33'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e7000a4d0 con 0x55ecc33885a0 2024-09-13T06:10:00.645 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.635+0000 7f3e793ab980 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94475375959200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ecc3396660 con 0x55ecc33885a0 2024-09-13T06:10:00.645 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.635+0000 7f3e793ab980 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ecc33973f0 con 0x7f3e6c01f940 2024-09-13T06:10:00.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.639+0000 7f3e776bc640 1 -- 172.21.15.194:0/2006135831 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(54 notify.5 [create] v33'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e7000a4d0 con 0x7f3e6c01f940 2024-09-13T06:10:00.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.639+0000 7f3e793ab980 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94475375963808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ecc3397770 con 0x7f3e6c01f940 2024-09-13T06:10:00.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.639+0000 7f3e793ab980 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ecc33981e0 con 0x7f3e6c01f940 2024-09-13T06:10:00.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.639+0000 7f3e776bc640 1 -- 172.21.15.194:0/2006135831 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94475375959200] v33'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e7000a4d0 con 0x55ecc33885a0 2024-09-13T06:10:00.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.639+0000 7f3e776bc640 1 -- 172.21.15.194:0/2006135831 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(56 notify.6 [create] v33'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e7000a4d0 con 0x7f3e6c01f940 2024-09-13T06:10:00.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.639+0000 7f3e776bc640 1 -- 172.21.15.194:0/2006135831 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94475375963808] v33'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e7000a4d0 con 0x7f3e6c01f940 2024-09-13T06:10:00.649 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.639+0000 7f3e793ab980 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94475375967408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ecc33981a0 con 0x7f3e6c01f940 2024-09-13T06:10:00.649 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.639+0000 7f3e793ab980 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ecc33972e0 con 0x7f3e6c01f940 2024-09-13T06:10:00.649 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.643+0000 7f3e776bc640 1 -- 172.21.15.194:0/2006135831 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(58 notify.7 [create] v33'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e7000a4d0 con 0x7f3e6c01f940 2024-09-13T06:10:00.649 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.643+0000 7f3e793ab980 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94475375969968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ecc33972e0 con 0x7f3e6c01f940 2024-09-13T06:10:00.649 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.643+0000 7f3e793ab980 20 add_watcher() i=0 2024-09-13T06:10:00.649 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.643+0000 7f3e793ab980 20 add_watcher() i=1 2024-09-13T06:10:00.649 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.643+0000 7f3e793ab980 20 add_watcher() i=2 2024-09-13T06:10:00.649 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.643+0000 7f3e793ab980 20 add_watcher() i=3 2024-09-13T06:10:00.649 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.643+0000 7f3e793ab980 20 add_watcher() i=4 2024-09-13T06:10:00.649 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.643+0000 7f3e793ab980 20 add_watcher() i=5 2024-09-13T06:10:00.649 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.643+0000 7f3e776bc640 1 -- 172.21.15.194:0/2006135831 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94475375967408] v33'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e7000a4d0 con 0x7f3e6c01f940 2024-09-13T06:10:00.649 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.643+0000 7f3e793ab980 20 add_watcher() i=6 2024-09-13T06:10:00.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.643+0000 7f3e776bc640 1 -- 172.21.15.194:0/2006135831 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94475375969968] v33'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e7000a4d0 con 0x7f3e6c01f940 2024-09-13T06:10:00.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.643+0000 7f3e793ab980 20 add_watcher() i=7 2024-09-13T06:10:00.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.643+0000 7f3e793ab980 2 all 8 watchers are set, enabling cache 2024-09-13T06:10:00.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.643+0000 7f3e793ab980 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ecc339bb00 con 0x55ecc33885a0 2024-09-13T06:10:00.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.643+0000 7f3e776bc640 1 -- 172.21.15.194:0/2006135831 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3e7000a4d0 con 0x55ecc33885a0 2024-09-13T06:10:00.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.643+0000 7f3e793ab980 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94475375951728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ecc3398fb0 con 0x55ecc33885a0 2024-09-13T06:10:00.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.647+0000 7f3e776bc640 1 -- 172.21.15.194:0/2006135831 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94475375951728] v33'130 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3e7000a4d0 con 0x55ecc33885a0 2024-09-13T06:10:00.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.647+0000 7f3d2d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:10:00.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.647+0000 7f3e793ab980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:10:00.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.647+0000 7f3e793ab980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:10:00.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.647+0000 7f3e793ab980 5 note: GC not initialized 2024-09-13T06:10:00.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.647+0000 7f3ca7fff640 20 reqs_thread_entry: start 2024-09-13T06:10:00.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.647+0000 7f3e793ab980 20 init_complete bucket index max shards: 11 2024-09-13T06:10:00.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.647+0000 7f3e793ab980 20 Filter name: none 2024-09-13T06:10:00.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.647+0000 7f3ca5ffb640 20 reqs_thread_entry: start 2024-09-13T06:10:00.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.647+0000 7f3e793ab980 20 rados->read ofs=0 len=0 2024-09-13T06:10:00.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.647+0000 7f3e793ab980 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:62 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ecc33bebd0 con 0x55ecc33885a0 2024-09-13T06:10:00.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.647+0000 7f3e776bc640 1 -- 172.21.15.194:0/2006135831 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(62 testx/myfoo [call out=48b,stat out=16b,read 0~193 out=193b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 281+0+332 (crc 0 0 0) 0x7f3e7000a4d0 con 0x55ecc33885a0 2024-09-13T06:10:00.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.647+0000 7f3e793ab980 20 rados_obj.operate() r=0 bl.length=193 2024-09-13T06:10:00.652 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.647+0000 7f3d2d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:10:00.652 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.647+0000 7f3e793ab980 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94475375951728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ecc33bcb40 con 0x55ecc33885a0 2024-09-13T06:10:00.652 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.647+0000 7f3e776bc640 1 -- 172.21.15.194:0/2006135831 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94475375951728] v33'131 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3e7000a4d0 con 0x55ecc33885a0 2024-09-13T06:10:00.652 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.647+0000 7f3e793ab980 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94475375945840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ecc3393f70 con 0x7f3e680c7070 2024-09-13T06:10:00.652 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.651+0000 7f3e766ba640 1 -- 172.21.15.194:0/2006135831 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94475375945840] v33'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e6c037040 con 0x7f3e680c7070 2024-09-13T06:10:00.652 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.651+0000 7f3e793ab980 20 remove_watcher() i=0 2024-09-13T06:10:00.652 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.651+0000 7f3e793ab980 2 removed watcher, disabling cache 2024-09-13T06:10:00.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.651+0000 7f3e793ab980 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94475375949600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ecc3393f70 con 0x55ecc33885a0 2024-09-13T06:10:00.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.651+0000 7f3e776bc640 1 -- 172.21.15.194:0/2006135831 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94475375949600] v33'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e7000a4d0 con 0x55ecc33885a0 2024-09-13T06:10:00.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.651+0000 7f3e793ab980 20 remove_watcher() i=1 2024-09-13T06:10:00.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.651+0000 7f3e793ab980 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94475375954320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ecc3393f70 con 0x55ecc338cf60 2024-09-13T06:10:00.655 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.655+0000 7f3e76ebb640 1 -- 172.21.15.194:0/2006135831 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94475375954320] v33'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e680e4d70 con 0x55ecc338cf60 2024-09-13T06:10:00.655 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.655+0000 7f3e793ab980 20 remove_watcher() i=2 2024-09-13T06:10:00.655 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.655+0000 7f3e793ab980 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94475375956992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ecc3393f70 con 0x7f3e680c7070 2024-09-13T06:10:00.656 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.655+0000 7f3e766ba640 1 -- 172.21.15.194:0/2006135831 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94475375956992] v33'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e6c037040 con 0x7f3e680c7070 2024-09-13T06:10:00.656 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.655+0000 7f3e793ab980 20 remove_watcher() i=3 2024-09-13T06:10:00.656 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.655+0000 7f3e793ab980 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94475375959200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ecc3393f70 con 0x55ecc33885a0 2024-09-13T06:10:00.658 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.655+0000 7f3e776bc640 1 -- 172.21.15.194:0/2006135831 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94475375959200] v33'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e7000a4d0 con 0x55ecc33885a0 2024-09-13T06:10:00.658 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.655+0000 7f3e793ab980 20 remove_watcher() i=4 2024-09-13T06:10:00.658 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.655+0000 7f3e793ab980 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94475375963808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ecc3395ca0 con 0x7f3e6c01f940 2024-09-13T06:10:00.660 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.659+0000 7f3e776bc640 1 -- 172.21.15.194:0/2006135831 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94475375963808] v33'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e7000a4d0 con 0x7f3e6c01f940 2024-09-13T06:10:00.660 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.659+0000 7f3e793ab980 20 remove_watcher() i=5 2024-09-13T06:10:00.660 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.659+0000 7f3e793ab980 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94475375967408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ecc3393f70 con 0x7f3e6c01f940 2024-09-13T06:10:00.662 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.659+0000 7f3e776bc640 1 -- 172.21.15.194:0/2006135831 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94475375967408] v33'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e7000a4d0 con 0x7f3e6c01f940 2024-09-13T06:10:00.662 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.659+0000 7f3e793ab980 20 remove_watcher() i=6 2024-09-13T06:10:00.662 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.659+0000 7f3e793ab980 1 -- 172.21.15.194:0/2006135831 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94475375969968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ecc3396ea0 con 0x7f3e6c01f940 2024-09-13T06:10:00.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.663+0000 7f3e776bc640 1 -- 172.21.15.194:0/2006135831 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94475375969968] v33'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e7000a4d0 con 0x7f3e6c01f940 2024-09-13T06:10:00.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.663+0000 7f3e793ab980 20 remove_watcher() i=7 2024-09-13T06:10:00.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.663+0000 7f3e793ab980 1 -- 172.21.15.194:0/2006135831 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f3e6c01f940 msgr2=0x7f3e6c03a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.663+0000 7f3e793ab980 1 --2- 172.21.15.194:0/2006135831 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f3e6c01f940 0x7f3e6c03a3c0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.663+0000 7f3e793ab980 1 -- 172.21.15.194:0/2006135831 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ecc33885a0 msgr2=0x55ecc338aa60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.663+0000 7f3e793ab980 1 --2- 172.21.15.194:0/2006135831 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ecc33885a0 0x55ecc338aa60 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.663+0000 7f3e793ab980 1 -- 172.21.15.194:0/2006135831 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f3e680c7070 msgr2=0x7f3e680e0a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.663+0000 7f3e793ab980 1 --2- 172.21.15.194:0/2006135831 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f3e680c7070 0x7f3e680e0a20 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.663+0000 7f3e793ab980 1 -- 172.21.15.194:0/2006135831 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ecc338cf60 msgr2=0x55ecc338f350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.663+0000 7f3e793ab980 1 --2- 172.21.15.194:0/2006135831 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ecc338cf60 0x55ecc338f350 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.663+0000 7f3e793ab980 1 -- 172.21.15.194:0/2006135831 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3d40034650 msgr2=0x7f3d40036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.663+0000 7f3e793ab980 1 --2- 172.21.15.194:0/2006135831 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3d40034650 0x7f3d40036b10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c00fbd0 tx=0x7f3e6c023040 comp rx=0 tx=0).stop 2024-09-13T06:10:00.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.663+0000 7f3e793ab980 1 -- 172.21.15.194:0/2006135831 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ecc3376250 msgr2=0x55ecc337d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.663+0000 7f3e793ab980 1 --2- 172.21.15.194:0/2006135831 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ecc3376250 0x55ecc337d4f0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f3e680e1e00 tx=0x7f3e680d5ed0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.663+0000 7f3e776bc640 1 -- 172.21.15.194:0/2006135831 reap_dead start 2024-09-13T06:10:00.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.663+0000 7f3e793ab980 1 -- 172.21.15.194:0/2006135831 shutdown_connections 2024-09-13T06:10:00.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.663+0000 7f3e793ab980 1 --2- 172.21.15.194:0/2006135831 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ecc3376250 0x55ecc337d4f0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.663+0000 7f3e793ab980 1 -- 172.21.15.194:0/2006135831 >> 172.21.15.194:0/2006135831 conn(0x55ecc3372630 msgr2=0x55ecc3370700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:00.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.663+0000 7f3e793ab980 1 -- 172.21.15.194:0/2006135831 shutdown_connections 2024-09-13T06:10:00.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.663+0000 7f3e793ab980 1 -- 172.21.15.194:0/2006135831 wait complete. 2024-09-13T06:10:00.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.663+0000 7f3e793ab980 1 -- 172.21.15.194:0/2990154779 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3d50034600 msgr2=0x7f3d50036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.663+0000 7f3e793ab980 1 --2- 172.21.15.194:0/2990154779 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3d50034600 0x7f3d50036ac0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x55ecc335c600 tx=0x7f3e6c006000 comp rx=0 tx=0).stop 2024-09-13T06:10:00.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.663+0000 7f3e793ab980 1 -- 172.21.15.194:0/2990154779 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ecc3369c90 msgr2=0x55ecc336a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.663+0000 7f3e793ab980 1 --2- 172.21.15.194:0/2990154779 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ecc3369c90 0x55ecc336a0b0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f3e680e2fe0 tx=0x7f3e680e46f0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.663+0000 7f3e793ab980 1 -- 172.21.15.194:0/2990154779 shutdown_connections 2024-09-13T06:10:00.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.663+0000 7f3e793ab980 1 --2- 172.21.15.194:0/2990154779 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3d50034600 0x7f3d50036ac0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.663+0000 7f3e793ab980 1 --2- 172.21.15.194:0/2990154779 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ecc3369c90 0x55ecc336a0b0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.663+0000 7f3e793ab980 1 -- 172.21.15.194:0/2990154779 >> 172.21.15.194:0/2990154779 conn(0x55ecc335ede0 msgr2=0x55ecc3361860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:00.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.663+0000 7f3e793ab980 1 -- 172.21.15.194:0/2990154779 shutdown_connections 2024-09-13T06:10:00.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.663+0000 7f3e793ab980 1 -- 172.21.15.194:0/2990154779 wait complete. 2024-09-13T06:10:00.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.663+0000 7f3e793ab980 1 -- 172.21.15.194:0/1233915758 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ecc325a8e0 msgr2=0x55ecc33530b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.663+0000 7f3e793ab980 1 --2- 172.21.15.194:0/1233915758 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ecc325a8e0 0x55ecc33530b0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.663+0000 7f3e793ab980 1 -- 172.21.15.194:0/1233915758 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55ecc3359720 msgr2=0x55ecc335bb10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.663+0000 7f3e793ab980 1 --2- 172.21.15.194:0/1233915758 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55ecc3359720 0x55ecc335bb10 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.663+0000 7f3e793ab980 1 -- 172.21.15.194:0/1233915758 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ecc33557b0 msgr2=0x55ecc3357ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.663+0000 7f3e793ab980 1 --2- 172.21.15.194:0/1233915758 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ecc33557b0 0x55ecc3357ba0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.663+0000 7f3e793ab980 1 -- 172.21.15.194:0/1233915758 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3d5c034650 msgr2=0x7f3d5c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.663+0000 7f3e793ab980 1 --2- 172.21.15.194:0/1233915758 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3d5c034650 0x7f3d5c036b10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c00b330 tx=0x7f3e6c0014b0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.663+0000 7f3e793ab980 1 -- 172.21.15.194:0/1233915758 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ecc31cc290 msgr2=0x55ecc3257ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.663+0000 7f3e793ab980 1 --2- 172.21.15.194:0/1233915758 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ecc31cc290 0x55ecc3257ca0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f3e6800a480 tx=0x7f3e68017eb0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.663+0000 7f3e776bc640 1 -- 172.21.15.194:0/1233915758 reap_dead start 2024-09-13T06:10:00.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.663+0000 7f3e793ab980 1 -- 172.21.15.194:0/1233915758 shutdown_connections 2024-09-13T06:10:00.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.663+0000 7f3e793ab980 1 -- 172.21.15.194:0/1233915758 >> 172.21.15.194:0/1233915758 conn(0x55ecc3252090 msgr2=0x55ecc333d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:00.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.663+0000 7f3e793ab980 1 -- 172.21.15.194:0/1233915758 shutdown_connections 2024-09-13T06:10:00.670 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.663+0000 7f3e793ab980 1 -- 172.21.15.194:0/1233915758 wait complete. 2024-09-13T06:10:00.675 INFO:teuthology.orchestra.run.smithi194.stdout:{"key":"bucket:testx/myfoo","ver":{"tag":"xb32kefikQVeq2P4ojoef2uw","ver":2},"mtime":"2024-09-13T06:10:00.472110Z","data":{"bucket":{"name":"myfoo","marker":"52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1","bucket_id":"52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1","tenant":"testx","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"testx$tenanteduser","creation_time":"2024-09-13T06:09:56.926052Z","linked":true,"has_bucket_info":false}} 2024-09-13T06:10:00.675 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:testx/myfoo', 'ver': {'tag': 'xb32kefikQVeq2P4ojoef2uw', 'ver': 2}, 'mtime': '2024-09-13T06:10:00.472110Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1', 'bucket_id': '52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1', 'tenant': 'testx', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'testx$tenanteduser', 'creation_time': '2024-09-13T06:09:56.926052Z', 'linked': True, 'has_bucket_info': False}} 2024-09-13T06:10:00.675 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-09-13T06:10:00.675 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-09-13T06:10:00.675 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket testx/myfoo --uid foo 2024-09-13T06:10:00.752 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:10:00.753 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:10:00.755 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.751+0000 7fb7f7481980 1 Processor -- start 2024-09-13T06:10:00.755 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.751+0000 7fb7f7481980 1 -- start start 2024-09-13T06:10:00.755 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.751+0000 7fb7f7481980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55be27930a20 0x55be27932e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.755 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.751+0000 7fb7f7481980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55be277b4ae0 con 0x55be2792c6a0 2024-09-13T06:10:00.755 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.751+0000 7fb7f7481980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x55be277d8e30 con 0x55be27930a20 2024-09-13T06:10:00.755 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.751+0000 7fb7f4f91640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x55be2792c6a0 0x55be2792ca80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:51268/0 (socket says 172.21.15.194:51268) 2024-09-13T06:10:00.755 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.751+0000 7fb7f4790640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55be27930a20 0x55be27932e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.755 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.751+0000 7fb7f4f91640 1 -- 172.21.15.194:0/2421759711 learned_addr learned my addr 172.21.15.194:0/2421759711 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-09-13T06:10:00.755 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.755+0000 7fb7f3f8f640 1 -- 172.21.15.194:0/2421759711 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3323892638 0 0) 0x55be277b4ae0 con 0x55be2792c6a0 2024-09-13T06:10:00.755 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.755+0000 7fb7f3f8f640 1 -- 172.21.15.194:0/2421759711 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7dc001e20 con 0x55be2792c6a0 2024-09-13T06:10:00.755 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.755+0000 7fb7f4790640 1 -- 172.21.15.194:0/2421759711 >> v1:172.21.15.120:6789/0 conn(0x55be2792c6a0 legacy=0x55be2792ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.756 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.755+0000 7fb7f4790640 1 -- 172.21.15.194:0/2421759711 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be27934360 con 0x55be27930a20 2024-09-13T06:10:00.757 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.755+0000 7fb7f4790640 1 --2- 172.21.15.194:0/2421759711 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55be27930a20 0x55be27932e10 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fb7e800a480 tx=0x7fb7e801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2411f27f1c47be02 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.758 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.755+0000 7fb7f3f8f640 1 -- 172.21.15.194:0/2421759711 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7e80b0070 con 0x55be27930a20 2024-09-13T06:10:00.759 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.755+0000 7fb7f3f8f640 1 -- 172.21.15.194:0/2421759711 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7e80ab540 con 0x55be27930a20 2024-09-13T06:10:00.759 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.755+0000 7fb7f3f8f640 1 -- 172.21.15.194:0/2421759711 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7e80ab820 con 0x55be27930a20 2024-09-13T06:10:00.759 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.759+0000 7fb7f7481980 1 -- 172.21.15.194:0/2421759711 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55be27930a20 msgr2=0x55be27932e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.759 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.759+0000 7fb7f7481980 1 --2- 172.21.15.194:0/2421759711 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55be27930a20 0x55be27932e10 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fb7e800a480 tx=0x7fb7e801b280 comp rx=0 tx=0).stop 2024-09-13T06:10:00.759 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.759+0000 7fb7f7481980 1 -- 172.21.15.194:0/2421759711 shutdown_connections 2024-09-13T06:10:00.759 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.759+0000 7fb7f7481980 1 --2- 172.21.15.194:0/2421759711 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55be27930a20 0x55be27932e10 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.759 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.759+0000 7fb7f7481980 1 -- 172.21.15.194:0/2421759711 >> 172.21.15.194:0/2421759711 conn(0x55be279281c0 msgr2=0x55be2792a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:00.759 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.759+0000 7fb7f7481980 1 -- 172.21.15.194:0/2421759711 shutdown_connections 2024-09-13T06:10:00.759 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.759+0000 7fb7f7481980 1 -- 172.21.15.194:0/2421759711 wait complete. 2024-09-13T06:10:00.777 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.771+0000 7fb7f7481980 1 Processor -- start 2024-09-13T06:10:00.777 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.771+0000 7fb7f7481980 1 -- start start 2024-09-13T06:10:00.777 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.771+0000 7fb7f7481980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55be2792c6a0 0x55be27a17840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.777 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.771+0000 7fb7f7481980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55be277da200 con 0x55be2792c6a0 2024-09-13T06:10:00.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.771+0000 7fb7f4f91640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55be2792c6a0 0x55be27a17840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.771+0000 7fb7f4f91640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55be2792c6a0 0x55be27a17840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:46122/0 (socket says 172.21.15.194:46122) 2024-09-13T06:10:00.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.771+0000 7fb7f4f91640 1 -- 172.21.15.194:0/3049143966 learned_addr learned my addr 172.21.15.194:0/3049143966 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:00.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.771+0000 7fb7f4f91640 1 -- 172.21.15.194:0/3049143966 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be27a17e10 con 0x55be2792c6a0 2024-09-13T06:10:00.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.771+0000 7fb7f4f91640 1 --2- 172.21.15.194:0/3049143966 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55be2792c6a0 0x55be27a17840 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec006fc0 tx=0x7fb7ec001af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=925f4a03126d4f8d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.771+0000 7fb6e2e0d640 1 -- 172.21.15.194:0/3049143966 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7ec004530 con 0x55be2792c6a0 2024-09-13T06:10:00.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.771+0000 7fb6e2e0d640 1 -- 172.21.15.194:0/3049143966 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7ec0046d0 con 0x55be2792c6a0 2024-09-13T06:10:00.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.771+0000 7fb6e2e0d640 1 -- 172.21.15.194:0/3049143966 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7ec004a70 con 0x55be2792c6a0 2024-09-13T06:10:00.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.775+0000 7fb7f7481980 1 -- 172.21.15.194:0/3049143966 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55be2792c6a0 msgr2=0x55be27a17840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.775+0000 7fb7f7481980 1 --2- 172.21.15.194:0/3049143966 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55be2792c6a0 0x55be27a17840 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec006fc0 tx=0x7fb7ec001af0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.775+0000 7fb7f7481980 1 -- 172.21.15.194:0/3049143966 shutdown_connections 2024-09-13T06:10:00.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.775+0000 7fb7f7481980 1 --2- 172.21.15.194:0/3049143966 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55be2792c6a0 0x55be27a17840 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.775+0000 7fb7f7481980 1 -- 172.21.15.194:0/3049143966 >> 172.21.15.194:0/3049143966 conn(0x55be279281c0 msgr2=0x55be27a13470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:00.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.775+0000 7fb7f7481980 1 -- 172.21.15.194:0/3049143966 shutdown_connections 2024-09-13T06:10:00.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.775+0000 7fb7f7481980 1 -- 172.21.15.194:0/3049143966 wait complete. 2024-09-13T06:10:00.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.775+0000 7fb7f7481980 1 Processor -- start 2024-09-13T06:10:00.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.775+0000 7fb7f7481980 1 -- start start 2024-09-13T06:10:00.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.775+0000 7fb7f7481980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55be2792c6a0 0x55be27a1ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.775+0000 7fb7f7481980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55be27933e60 con 0x55be2792c6a0 2024-09-13T06:10:00.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.775+0000 7fb7f4f91640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55be2792c6a0 0x55be27a1ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.775+0000 7fb7f4f91640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55be2792c6a0 0x55be27a1ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:46136/0 (socket says 172.21.15.194:46136) 2024-09-13T06:10:00.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.775+0000 7fb7f4f91640 1 -- 172.21.15.194:0/579814004 learned_addr learned my addr 172.21.15.194:0/579814004 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:00.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.775+0000 7fb7f4f91640 1 -- 172.21.15.194:0/579814004 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be27a1f0f0 con 0x55be2792c6a0 2024-09-13T06:10:00.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.775+0000 7fb7f4f91640 1 --2- 172.21.15.194:0/579814004 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55be2792c6a0 0x55be27a1ebb0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec002260 tx=0x7fb7ec000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.775+0000 7fb6e160a640 1 -- 172.21.15.194:0/579814004 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7ec013760 con 0x55be2792c6a0 2024-09-13T06:10:00.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.775+0000 7fb7f7481980 1 -- 172.21.15.194:0/579814004 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55be27a1f380 con 0x55be2792c6a0 2024-09-13T06:10:00.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.775+0000 7fb6e160a640 1 -- 172.21.15.194:0/579814004 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7ec013900 con 0x55be2792c6a0 2024-09-13T06:10:00.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.775+0000 7fb6e160a640 1 -- 172.21.15.194:0/579814004 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7ec013c00 con 0x55be2792c6a0 2024-09-13T06:10:00.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.775+0000 7fb7f7481980 1 -- 172.21.15.194:0/579814004 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be27a22060 con 0x55be2792c6a0 2024-09-13T06:10:00.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.775+0000 7fb6e160a640 1 -- 172.21.15.194:0/579814004 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb7ec010070 con 0x55be2792c6a0 2024-09-13T06:10:00.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.775+0000 7fb6e160a640 1 --2- 172.21.15.194:0/579814004 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fb6dc034650 0x7fb6dc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.775+0000 7fb6e160a640 1 -- 172.21.15.194:0/579814004 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fb7ec018070 con 0x55be2792c6a0 2024-09-13T06:10:00.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.775+0000 7fb7f4790640 1 --2- 172.21.15.194:0/579814004 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fb6dc034650 0x7fb6dc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.779+0000 7fb7f7481980 1 --2- 172.21.15.194:0/579814004 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55be27930a20 0x55be27a25b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.779+0000 7fb7f7481980 1 -- 172.21.15.194:0/579814004 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55be27a26160 con 0x55be27930a20 2024-09-13T06:10:00.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.779+0000 7fb7f5792640 1 --2- 172.21.15.194:0/579814004 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55be27930a20 0x55be27a25b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.779+0000 7fb7f4790640 1 --2- 172.21.15.194:0/579814004 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fb6dc034650 0x7fb6dc036b10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb7e80ad000 tx=0x7fb7e80a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.779+0000 7fb7f5792640 1 --2- 172.21.15.194:0/579814004 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55be27930a20 0x55be27a25b40 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.779+0000 7fb7f5792640 1 -- 172.21.15.194:0/579814004 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb7e40083f0 con 0x55be27930a20 2024-09-13T06:10:00.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.779+0000 7fb7f7481980 1 -- 172.21.15.194:0/579814004 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55be27a23280 con 0x55be27930a20 2024-09-13T06:10:00.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.779+0000 7fb7f5792640 1 -- 172.21.15.194:0/579814004 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb7e40083f0 con 0x55be27930a20 2024-09-13T06:10:00.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.779+0000 7fb7f7481980 1 --2- 172.21.15.194:0/579814004 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55be27a284b0 0x55be27a2a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.779+0000 7fb7f7481980 1 -- 172.21.15.194:0/579814004 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55be27a2af70 con 0x55be27a284b0 2024-09-13T06:10:00.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.779+0000 7fb7f4f91640 1 --2- 172.21.15.194:0/579814004 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55be27a284b0 0x55be27a2a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.779+0000 7fb7f4f91640 1 --2- 172.21.15.194:0/579814004 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55be27a284b0 0x55be27a2a8a0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.779+0000 7fb7f4f91640 1 -- 172.21.15.194:0/579814004 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb7ec01b030 con 0x55be27a284b0 2024-09-13T06:10:00.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.779+0000 7fb7f7481980 1 -- 172.21.15.194:0/579814004 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55be27a27350 con 0x55be27930a20 2024-09-13T06:10:00.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.779+0000 7fb7f5792640 1 -- 172.21.15.194:0/579814004 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb7e40083f0 con 0x55be27930a20 2024-09-13T06:10:00.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.779+0000 7fb7f7481980 1 --2- 172.21.15.194:0/579814004 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55be27a2c3b0 0x55be27a2e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.779+0000 7fb7f7481980 1 -- 172.21.15.194:0/579814004 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55be27a2ef30 con 0x55be27a2c3b0 2024-09-13T06:10:00.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.779+0000 7fb7f4790640 1 --2- 172.21.15.194:0/579814004 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55be27a2c3b0 0x55be27a2e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.779+0000 7fb7f4790640 1 --2- 172.21.15.194:0/579814004 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55be27a2c3b0 0x55be27a2e7a0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.779+0000 7fb7f4790640 1 -- 172.21.15.194:0/579814004 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb7e80b3040 con 0x55be27a2c3b0 2024-09-13T06:10:00.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.779+0000 7fb7f7481980 1 Processor -- start 2024-09-13T06:10:00.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.779+0000 7fb7f7481980 1 -- start start 2024-09-13T06:10:00.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.779+0000 7fb7f7481980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55be27a3c9e0 0x55be27a3ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.779+0000 7fb7f7481980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55be27833800 con 0x55be27a3c9e0 2024-09-13T06:10:00.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.779+0000 7fb7f4f91640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55be27a3c9e0 0x55be27a3ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.779+0000 7fb7f4f91640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55be27a3c9e0 0x55be27a3ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:46146/0 (socket says 172.21.15.194:46146) 2024-09-13T06:10:00.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.779+0000 7fb7f4f91640 1 -- 172.21.15.194:0/3576047991 learned_addr learned my addr 172.21.15.194:0/3576047991 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:00.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.783+0000 7fb7f4f91640 1 -- 172.21.15.194:0/3576047991 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be27a3d340 con 0x55be27a3c9e0 2024-09-13T06:10:00.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.783+0000 7fb7f4f91640 1 --2- 172.21.15.194:0/3576047991 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55be27a3c9e0 0x55be27a3ce00 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec048470 tx=0x7fb7ec010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.783+0000 7fb6da7fc640 1 -- 172.21.15.194:0/3576047991 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7ec037070 con 0x55be27a3c9e0 2024-09-13T06:10:00.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.783+0000 7fb6da7fc640 1 -- 172.21.15.194:0/3576047991 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7ec0128d0 con 0x55be27a3c9e0 2024-09-13T06:10:00.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.783+0000 7fb7f7481980 1 -- 172.21.15.194:0/3576047991 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55be27a3d5d0 con 0x55be27a3c9e0 2024-09-13T06:10:00.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.783+0000 7fb6da7fc640 1 -- 172.21.15.194:0/3576047991 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7ec041c00 con 0x55be27a3c9e0 2024-09-13T06:10:00.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.783+0000 7fb7f7481980 1 -- 172.21.15.194:0/3576047991 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be27a40250 con 0x55be27a3c9e0 2024-09-13T06:10:00.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.783+0000 7fb6da7fc640 1 -- 172.21.15.194:0/3576047991 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb7ec029d10 con 0x55be27a3c9e0 2024-09-13T06:10:00.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.783+0000 7fb6da7fc640 1 --2- 172.21.15.194:0/3576047991 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fb6cc0346a0 0x7fb6cc036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.783+0000 7fb6da7fc640 1 -- 172.21.15.194:0/3576047991 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fb7ec03b020 con 0x55be27a3c9e0 2024-09-13T06:10:00.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.783+0000 7fb7f4790640 1 --2- 172.21.15.194:0/3576047991 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fb6cc0346a0 0x7fb6cc036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.783+0000 7fb7f7481980 1 Processor -- start 2024-09-13T06:10:00.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.783+0000 7fb7f7481980 1 -- start start 2024-09-13T06:10:00.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.783+0000 7fb7f7481980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55be27a49320 0x55be27a49700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.783+0000 7fb7f7481980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55be27a18190 con 0x55be27a49320 2024-09-13T06:10:00.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.783+0000 7fb7f4790640 1 --2- 172.21.15.194:0/3576047991 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fb6cc0346a0 0x7fb6cc036b60 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb7e801b2c0 tx=0x7fb7e8005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.783+0000 7fb7f4f91640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55be27a49320 0x55be27a49700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.783+0000 7fb7f4f91640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55be27a49320 0x55be27a49700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:46152/0 (socket says 172.21.15.194:46152) 2024-09-13T06:10:00.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.783+0000 7fb7f4f91640 1 -- 172.21.15.194:0/902170914 learned_addr learned my addr 172.21.15.194:0/902170914 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:00.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.783+0000 7fb7f4f91640 1 -- 172.21.15.194:0/902170914 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be27a49cd0 con 0x55be27a49320 2024-09-13T06:10:00.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.783+0000 7fb7f4f91640 1 --2- 172.21.15.194:0/902170914 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55be27a49320 0x55be27a49700 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec033fd0 tx=0x7fb7ec032b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9991f9db970ff504 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.787+0000 7fb6cbfff640 1 -- 172.21.15.194:0/902170914 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7ec063070 con 0x55be27a49320 2024-09-13T06:10:00.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.787+0000 7fb6cbfff640 1 -- 172.21.15.194:0/902170914 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7ec015e40 con 0x55be27a49320 2024-09-13T06:10:00.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.787+0000 7fb6cbfff640 1 -- 172.21.15.194:0/902170914 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7ec056070 con 0x55be27a49320 2024-09-13T06:10:00.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.787+0000 7fb7f7481980 1 -- 172.21.15.194:0/902170914 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55be27a49320 msgr2=0x55be27a49700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.787+0000 7fb7f7481980 1 --2- 172.21.15.194:0/902170914 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55be27a49320 0x55be27a49700 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec033fd0 tx=0x7fb7ec032b10 comp rx=0 tx=0).stop 2024-09-13T06:10:00.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.787+0000 7fb7f7481980 1 -- 172.21.15.194:0/902170914 shutdown_connections 2024-09-13T06:10:00.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.787+0000 7fb7f7481980 1 --2- 172.21.15.194:0/902170914 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55be27a49320 0x55be27a49700 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.787+0000 7fb7f7481980 1 -- 172.21.15.194:0/902170914 >> 172.21.15.194:0/902170914 conn(0x55be27a45700 msgr2=0x55be27a43800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:00.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.787+0000 7fb7f7481980 1 -- 172.21.15.194:0/902170914 shutdown_connections 2024-09-13T06:10:00.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.787+0000 7fb7f7481980 1 -- 172.21.15.194:0/902170914 wait complete. 2024-09-13T06:10:00.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.787+0000 7fb7f7481980 1 Processor -- start 2024-09-13T06:10:00.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.787+0000 7fb7f7481980 1 -- start start 2024-09-13T06:10:00.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.787+0000 7fb7f7481980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55be27a49320 0x55be27a50460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.787+0000 7fb7f7481980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55be27a4a170 con 0x55be27a49320 2024-09-13T06:10:00.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.787+0000 7fb7f4f91640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55be27a49320 0x55be27a50460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.787+0000 7fb7f4f91640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55be27a49320 0x55be27a50460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:46154/0 (socket says 172.21.15.194:46154) 2024-09-13T06:10:00.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.787+0000 7fb7f4f91640 1 -- 172.21.15.194:0/2722726494 learned_addr learned my addr 172.21.15.194:0/2722726494 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:00.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.787+0000 7fb7f4f91640 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be27a509a0 con 0x55be27a49320 2024-09-13T06:10:00.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.787+0000 7fb7f4f91640 1 --2- 172.21.15.194:0/2722726494 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55be27a49320 0x55be27a50460 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec033fd0 tx=0x7fb7ec042130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.787+0000 7fb6ca7fc640 1 -- 172.21.15.194:0/2722726494 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7ec063030 con 0x55be27a49320 2024-09-13T06:10:00.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.787+0000 7fb7f7481980 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55be27a509a0 con 0x55be27a49320 2024-09-13T06:10:00.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.787+0000 7fb6ca7fc640 1 -- 172.21.15.194:0/2722726494 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7ec064040 con 0x55be27a49320 2024-09-13T06:10:00.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.787+0000 7fb6ca7fc640 1 -- 172.21.15.194:0/2722726494 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7ec059040 con 0x55be27a49320 2024-09-13T06:10:00.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.787+0000 7fb7f7481980 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be27a50e10 con 0x55be27a49320 2024-09-13T06:10:00.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.791+0000 7fb6ca7fc640 1 -- 172.21.15.194:0/2722726494 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb7ec0323c0 con 0x55be27a49320 2024-09-13T06:10:00.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.791+0000 7fb7f7481980 20 rados->read ofs=0 len=0 2024-09-13T06:10:00.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.791+0000 7fb6ca7fc640 1 --2- 172.21.15.194:0/2722726494 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fb6c0034600 0x7fb6c0036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.791+0000 7fb6ca7fc640 1 -- 172.21.15.194:0/2722726494 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fb7ec06e930 con 0x55be27a49320 2024-09-13T06:10:00.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.791+0000 7fb7f4790640 1 --2- 172.21.15.194:0/2722726494 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fb6c0034600 0x7fb6c0036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.791+0000 7fb7f7481980 1 --2- 172.21.15.194:0/2722726494 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55be27a5b5d0 0x55be27a5da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.791+0000 7fb7f7481980 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55be27a5e1e0 con 0x55be27a5b5d0 2024-09-13T06:10:00.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.791+0000 7fb7f5792640 1 --2- 172.21.15.194:0/2722726494 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55be27a5b5d0 0x55be27a5da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.791+0000 7fb7f4790640 1 --2- 172.21.15.194:0/2722726494 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fb6c0034600 0x7fb6c0036ac0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb7e80abaa0 tx=0x7fb7e80b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.791+0000 7fb7f5792640 1 --2- 172.21.15.194:0/2722726494 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55be27a5b5d0 0x55be27a5da90 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.791+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb7e40083f0 con 0x55be27a5b5d0 2024-09-13T06:10:00.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.791+0000 7fb7f7481980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:00.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.791+0000 7fb7f7481980 20 realm 2024-09-13T06:10:00.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.791+0000 7fb7f7481980 20 rados->read ofs=0 len=0 2024-09-13T06:10:00.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.791+0000 7fb7f7481980 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55be27a5e5f0 con 0x55be27a5b5d0 2024-09-13T06:10:00.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.791+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb7e40083f0 con 0x55be27a5b5d0 2024-09-13T06:10:00.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.791+0000 7fb7f7481980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:00.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.791+0000 7fb7f7481980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:10:00.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.791+0000 7fb7f7481980 20 rados->read ofs=0 len=0 2024-09-13T06:10:00.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.791+0000 7fb7f7481980 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55be27a5ee90 con 0x55be27a5b5d0 2024-09-13T06:10:00.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.791+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb7e40083f0 con 0x55be27a5b5d0 2024-09-13T06:10:00.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.791+0000 7fb7f7481980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:00.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.791+0000 7fb7f7481980 20 rados->read ofs=0 len=0 2024-09-13T06:10:00.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.791+0000 7fb7f7481980 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55be27a5f230 con 0x55be27a5b5d0 2024-09-13T06:10:00.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.791+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb7e40083f0 con 0x55be27a5b5d0 2024-09-13T06:10:00.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.791+0000 7fb7f7481980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:10:00.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.791+0000 7fb7f7481980 20 rados->read ofs=0 len=0 2024-09-13T06:10:00.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.791+0000 7fb7f7481980 1 --2- 172.21.15.194:0/2722726494 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55be27a5ff90 0x55be27a62380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.791+0000 7fb7f7481980 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55be27a62a20 con 0x55be27a5ff90 2024-09-13T06:10:00.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.791+0000 7fb7f4f91640 1 --2- 172.21.15.194:0/2722726494 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55be27a5ff90 0x55be27a62380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.791+0000 7fb7f4f91640 1 --2- 172.21.15.194:0/2722726494 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55be27a5ff90 0x55be27a62380 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.791+0000 7fb7f4f91640 1 -- 172.21.15.194:0/2722726494 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb7ec01b030 con 0x55be27a5ff90 2024-09-13T06:10:00.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.791+0000 7fb7f7481980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:10:00.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.791+0000 7fb7f7481980 20 searching for the correct realm 2024-09-13T06:10:00.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.791+0000 7fb7f7481980 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55be27a64280 con 0x55be27a5ff90 2024-09-13T06:10:00.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.791+0000 7fb7f4f91640 1 -- 172.21.15.194:0/2722726494 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7ec01b030 con 0x55be27a5ff90 2024-09-13T06:10:00.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.791+0000 7fb7f4f91640 1 --2- 172.21.15.194:0/2722726494 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fb7ec06e0e0 0x7fb7ec076690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.791+0000 7fb7f4f91640 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55be27a62a20 con 0x7fb7ec06e0e0 2024-09-13T06:10:00.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.791+0000 7fb7f4790640 1 --2- 172.21.15.194:0/2722726494 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fb7ec06e0e0 0x7fb7ec076690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.791+0000 7fb7f4790640 1 --2- 172.21.15.194:0/2722726494 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fb7ec06e0e0 0x7fb7ec076690 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.791+0000 7fb7f4790640 1 -- 172.21.15.194:0/2722726494 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb7e80c9030 con 0x7fb7ec06e0e0 2024-09-13T06:10:00.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.791+0000 7fb7f4790640 1 --2- 172.21.15.194:0/2722726494 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fb7e80dc040 0x7fb7e80ce430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.791+0000 7fb7f4790640 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55be27a62a20 con 0x7fb7e80dc040 2024-09-13T06:10:00.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.791+0000 7fb7f5792640 1 --2- 172.21.15.194:0/2722726494 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fb7e80dc040 0x7fb7e80ce430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.795+0000 7fb7f5792640 1 --2- 172.21.15.194:0/2722726494 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fb7e80dc040 0x7fb7e80ce430 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.795+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e40083f0 con 0x7fb7e80dc040 2024-09-13T06:10:00.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.795+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55be27a5f230 con 0x55be27a5b5d0 2024-09-13T06:10:00.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.795+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e40083f0 con 0x55be27a5b5d0 2024-09-13T06:10:00.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.795+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55be27a5f230 con 0x55be27a5b5d0 2024-09-13T06:10:00.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.795+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e40083f0 con 0x55be27a5b5d0 2024-09-13T06:10:00.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.795+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55be27a5f230 con 0x7fb7e80dc040 2024-09-13T06:10:00.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.795+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e40083f0 con 0x7fb7e80dc040 2024-09-13T06:10:00.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.795+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55be27a5f230 con 0x7fb7e80dc040 2024-09-13T06:10:00.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.795+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e40083f0 con 0x7fb7e80dc040 2024-09-13T06:10:00.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.795+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55be27a5f230 con 0x7fb7ec06e0e0 2024-09-13T06:10:00.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.795+0000 7fb7f4790640 1 -- 172.21.15.194:0/2722726494 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e80c9030 con 0x7fb7ec06e0e0 2024-09-13T06:10:00.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.795+0000 7fb7f4790640 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55be27a5f230 con 0x55be27a5ff90 2024-09-13T06:10:00.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.795+0000 7fb7f4f91640 1 -- 172.21.15.194:0/2722726494 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7ec01b030 con 0x55be27a5ff90 2024-09-13T06:10:00.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.795+0000 7fb7f4f91640 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55be27a5f230 con 0x55be27a5b5d0 2024-09-13T06:10:00.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.795+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e40083f0 con 0x55be27a5b5d0 2024-09-13T06:10:00.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.795+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55be27a5f230 con 0x7fb7e80dc040 2024-09-13T06:10:00.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.799+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e40083f0 con 0x7fb7e80dc040 2024-09-13T06:10:00.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.799+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55be27a5f230 con 0x55be27a5b5d0 2024-09-13T06:10:00.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.799+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e40083f0 con 0x55be27a5b5d0 2024-09-13T06:10:00.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.799+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55be27a5f230 con 0x7fb7ec06e0e0 2024-09-13T06:10:00.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.799+0000 7fb7f4790640 1 -- 172.21.15.194:0/2722726494 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb7e80c9030 con 0x7fb7ec06e0e0 2024-09-13T06:10:00.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.799+0000 7fb7f4790640 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55be27a5f230 con 0x55be27a5ff90 2024-09-13T06:10:00.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.799+0000 7fb7f4f91640 1 -- 172.21.15.194:0/2722726494 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7ec01b030 con 0x55be27a5ff90 2024-09-13T06:10:00.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.799+0000 7fb7f4f91640 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55be27a5f230 con 0x55be27a5ff90 2024-09-13T06:10:00.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.799+0000 7fb7f4f91640 1 -- 172.21.15.194:0/2722726494 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7ec01b030 con 0x55be27a5ff90 2024-09-13T06:10:00.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.799+0000 7fb7f4f91640 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55be27a5f230 con 0x7fb7e80dc040 2024-09-13T06:10:00.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.799+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e40083f0 con 0x7fb7e80dc040 2024-09-13T06:10:00.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.799+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55be27a5f230 con 0x55be27a5ff90 2024-09-13T06:10:00.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.799+0000 7fb7f4f91640 1 -- 172.21.15.194:0/2722726494 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7ec01b030 con 0x55be27a5ff90 2024-09-13T06:10:00.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.799+0000 7fb7f4f91640 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55be27a5f230 con 0x55be27a5ff90 2024-09-13T06:10:00.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.799+0000 7fb7f4f91640 1 -- 172.21.15.194:0/2722726494 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7ec01b030 con 0x55be27a5ff90 2024-09-13T06:10:00.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.799+0000 7fb7f4f91640 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55be27a5f230 con 0x55be27a5b5d0 2024-09-13T06:10:00.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.799+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e40083f0 con 0x55be27a5b5d0 2024-09-13T06:10:00.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.799+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55be27a5f230 con 0x55be27a5b5d0 2024-09-13T06:10:00.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.799+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb7e40083f0 con 0x55be27a5b5d0 2024-09-13T06:10:00.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.799+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55be27a5f230 con 0x7fb7e80dc040 2024-09-13T06:10:00.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.799+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e40083f0 con 0x7fb7e80dc040 2024-09-13T06:10:00.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.799+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55be27a5f230 con 0x55be27a5ff90 2024-09-13T06:10:00.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.803+0000 7fb7f4f91640 1 -- 172.21.15.194:0/2722726494 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7ec01b030 con 0x55be27a5ff90 2024-09-13T06:10:00.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.803+0000 7fb7f4f91640 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55be27a5f230 con 0x7fb7ec06e0e0 2024-09-13T06:10:00.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.803+0000 7fb7f4790640 1 -- 172.21.15.194:0/2722726494 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e80c9030 con 0x7fb7ec06e0e0 2024-09-13T06:10:00.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.803+0000 7fb7f4790640 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55be27a5f230 con 0x55be27a5b5d0 2024-09-13T06:10:00.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.803+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e40083f0 con 0x55be27a5b5d0 2024-09-13T06:10:00.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.803+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55be27a5f230 con 0x7fb7e80dc040 2024-09-13T06:10:00.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.803+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e40083f0 con 0x7fb7e80dc040 2024-09-13T06:10:00.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.803+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55be27a5f230 con 0x55be27a5ff90 2024-09-13T06:10:00.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.803+0000 7fb7f4f91640 1 -- 172.21.15.194:0/2722726494 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb7ec01b030 con 0x55be27a5ff90 2024-09-13T06:10:00.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.803+0000 7fb7f4f91640 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55be27a5f230 con 0x7fb7e80dc040 2024-09-13T06:10:00.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.803+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e40083f0 con 0x7fb7e80dc040 2024-09-13T06:10:00.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.803+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55be27a5f230 con 0x7fb7ec06e0e0 2024-09-13T06:10:00.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.803+0000 7fb7f4790640 1 -- 172.21.15.194:0/2722726494 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e80c9030 con 0x7fb7ec06e0e0 2024-09-13T06:10:00.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.803+0000 7fb7f4790640 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55be27a5f230 con 0x55be27a5ff90 2024-09-13T06:10:00.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.803+0000 7fb7f4f91640 1 -- 172.21.15.194:0/2722726494 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7ec01b030 con 0x55be27a5ff90 2024-09-13T06:10:00.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.803+0000 7fb7f4f91640 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55be27a5f230 con 0x7fb7e80dc040 2024-09-13T06:10:00.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.803+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e40083f0 con 0x7fb7e80dc040 2024-09-13T06:10:00.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.803+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55be27a5f230 con 0x55be27a5b5d0 2024-09-13T06:10:00.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.803+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb7e40083f0 con 0x55be27a5b5d0 2024-09-13T06:10:00.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.803+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55be27a5f230 con 0x7fb7ec06e0e0 2024-09-13T06:10:00.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.803+0000 7fb7f4790640 1 -- 172.21.15.194:0/2722726494 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e80c9030 con 0x7fb7ec06e0e0 2024-09-13T06:10:00.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.803+0000 7fb7f7481980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:10:00.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.803+0000 7fb7f7481980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:10:00.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.803+0000 7fb7f7481980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:10:00.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.803+0000 7fb7f7481980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:10:00.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.803+0000 7fb7f7481980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:10:00.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.803+0000 7fb7f7481980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:10:00.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.803+0000 7fb7f7481980 20 rados->read ofs=0 len=0 2024-09-13T06:10:00.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.803+0000 7fb7f7481980 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55be27a62fd0 con 0x55be27a5b5d0 2024-09-13T06:10:00.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.807+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb7e40083f0 con 0x55be27a5b5d0 2024-09-13T06:10:00.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.807+0000 7fb7f7481980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:00.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.807+0000 7fb7f7481980 20 rados->read ofs=0 len=0 2024-09-13T06:10:00.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.807+0000 7fb7f7481980 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55be27a63820 con 0x55be27a5b5d0 2024-09-13T06:10:00.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.807+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb7e40083f0 con 0x55be27a5b5d0 2024-09-13T06:10:00.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.807+0000 7fb7f7481980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:10:00.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.807+0000 7fb7f7481980 20 rados->read ofs=0 len=0 2024-09-13T06:10:00.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.807+0000 7fb7f7481980 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55be27a63820 con 0x7fb7ec06e0e0 2024-09-13T06:10:00.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.807+0000 7fb7f4790640 1 -- 172.21.15.194:0/2722726494 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb7e80c9030 con 0x7fb7ec06e0e0 2024-09-13T06:10:00.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.807+0000 7fb7f7481980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:10:00.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.807+0000 7fb7f7481980 20 zone default found 2024-09-13T06:10:00.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.807+0000 7fb7f7481980 4 Realm: () 2024-09-13T06:10:00.824 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.807+0000 7fb7f7481980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:10:00.824 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.807+0000 7fb7f7481980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:10:00.824 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.807+0000 7fb7f7481980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:10:00.824 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.807+0000 7fb7f7481980 20 zonegroup default 2024-09-13T06:10:00.824 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.807+0000 7fb7f7481980 20 rados->read ofs=0 len=0 2024-09-13T06:10:00.824 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.807+0000 7fb7f7481980 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55be27a640f0 con 0x7fb7e80dc040 2024-09-13T06:10:00.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.807+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb7e40083f0 con 0x7fb7e80dc040 2024-09-13T06:10:00.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.807+0000 7fb7f7481980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:00.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.807+0000 7fb7f7481980 20 rados->read ofs=0 len=0 2024-09-13T06:10:00.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.807+0000 7fb7f7481980 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55be27a640f0 con 0x55be27a5ff90 2024-09-13T06:10:00.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.807+0000 7fb7f4f91640 1 -- 172.21.15.194:0/2722726494 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb7ec01b030 con 0x55be27a5ff90 2024-09-13T06:10:00.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.807+0000 7fb7f7481980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:00.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.807+0000 7fb7f7481980 20 rados->read ofs=0 len=0 2024-09-13T06:10:00.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.807+0000 7fb7f7481980 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55be27a660f0 con 0x55be27a5ff90 2024-09-13T06:10:00.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.807+0000 7fb7f4f91640 1 -- 172.21.15.194:0/2722726494 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb7ec01b030 con 0x55be27a5ff90 2024-09-13T06:10:00.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.807+0000 7fb7f7481980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:00.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.807+0000 7fb7f7481980 20 started sync module instance, tier type = 2024-09-13T06:10:00.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.807+0000 7fb7f7481980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:10:00.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.807+0000 7fb7f7481980 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55be27a65560 con 0x7fb7ec06e0e0 2024-09-13T06:10:00.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.807+0000 7fb7f4790640 1 -- 172.21.15.194:0/2722726494 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(44 notify.0 [create] v33'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e80c9030 con 0x7fb7ec06e0e0 2024-09-13T06:10:00.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.807+0000 7fb7f7481980 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94275197358256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55be27a66530 con 0x7fb7ec06e0e0 2024-09-13T06:10:00.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.807+0000 7fb7f7481980 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55be27a66d80 con 0x55be27a5b5d0 2024-09-13T06:10:00.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.811+0000 7fb7f4790640 1 -- 172.21.15.194:0/2722726494 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94275197358256] v33'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e80c9030 con 0x7fb7ec06e0e0 2024-09-13T06:10:00.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.811+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v33'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e40083f0 con 0x55be27a5b5d0 2024-09-13T06:10:00.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.811+0000 7fb7f7481980 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94275197360512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55be27a66e20 con 0x55be27a5b5d0 2024-09-13T06:10:00.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.811+0000 7fb7f7481980 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55be27a67940 con 0x55be27a5ff90 2024-09-13T06:10:00.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.811+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94275197360512] v33'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e40083f0 con 0x55be27a5b5d0 2024-09-13T06:10:00.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.811+0000 7fb7f4f91640 1 -- 172.21.15.194:0/2722726494 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v33'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7ec01b030 con 0x55be27a5ff90 2024-09-13T06:10:00.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.811+0000 7fb7f7481980 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94275197367312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55be27a67900 con 0x55be27a5ff90 2024-09-13T06:10:00.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.811+0000 7fb7f7481980 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55be27a68350 con 0x7fb7ec06e0e0 2024-09-13T06:10:00.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.815+0000 7fb7f4790640 1 -- 172.21.15.194:0/2722726494 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(50 notify.3 [create] v33'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e80c9030 con 0x7fb7ec06e0e0 2024-09-13T06:10:00.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.815+0000 7fb7f7481980 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94275197370016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55be27a68bf0 con 0x7fb7ec06e0e0 2024-09-13T06:10:00.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.815+0000 7fb7f7481980 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55be27a695f0 con 0x55be27a5b5d0 2024-09-13T06:10:00.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.815+0000 7fb7f4f91640 1 -- 172.21.15.194:0/2722726494 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94275197367312] v33'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7ec09b040 con 0x55be27a5ff90 2024-09-13T06:10:00.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.815+0000 7fb7f4790640 1 -- 172.21.15.194:0/2722726494 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94275197370016] v33'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e80c9030 con 0x7fb7ec06e0e0 2024-09-13T06:10:00.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.815+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v33'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e40083f0 con 0x55be27a5b5d0 2024-09-13T06:10:00.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.815+0000 7fb7f7481980 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94275197364432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55be27a68740 con 0x55be27a5b5d0 2024-09-13T06:10:00.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.815+0000 7fb7f7481980 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55be27a69ec0 con 0x7fb7e80dc040 2024-09-13T06:10:00.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.819+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94275197364432] v33'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e40083f0 con 0x55be27a5b5d0 2024-09-13T06:10:00.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.819+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(54 notify.5 [create] v33'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e40083f0 con 0x7fb7e80dc040 2024-09-13T06:10:00.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.819+0000 7fb7f7481980 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94275197374720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55be27a68740 con 0x7fb7e80dc040 2024-09-13T06:10:00.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.819+0000 7fb7f7481980 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55be27a6a3b0 con 0x7fb7e80dc040 2024-09-13T06:10:00.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.819+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94275197374720] v33'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e40083f0 con 0x7fb7e80dc040 2024-09-13T06:10:00.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.819+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(56 notify.6 [create] v33'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e40083f0 con 0x7fb7e80dc040 2024-09-13T06:10:00.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.819+0000 7fb7f7481980 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94275197378208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55be27a6a370 con 0x7fb7e80dc040 2024-09-13T06:10:00.835 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.819+0000 7fb7f7481980 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55be27a6ad90 con 0x7fb7e80dc040 2024-09-13T06:10:00.835 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.823+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(58 notify.7 [create] v33'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e40083f0 con 0x7fb7e80dc040 2024-09-13T06:10:00.835 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.823+0000 7fb7f7481980 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94275197380736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55be27a6b200 con 0x7fb7e80dc040 2024-09-13T06:10:00.835 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.823+0000 7fb7f7481980 20 add_watcher() i=0 2024-09-13T06:10:00.835 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.823+0000 7fb7f7481980 20 add_watcher() i=1 2024-09-13T06:10:00.835 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.823+0000 7fb7f7481980 20 add_watcher() i=2 2024-09-13T06:10:00.835 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.823+0000 7fb7f7481980 20 add_watcher() i=3 2024-09-13T06:10:00.835 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.823+0000 7fb7f7481980 20 add_watcher() i=4 2024-09-13T06:10:00.835 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.823+0000 7fb7f7481980 20 add_watcher() i=5 2024-09-13T06:10:00.835 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.823+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94275197378208] v33'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e40083f0 con 0x7fb7e80dc040 2024-09-13T06:10:00.836 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.823+0000 7fb7f7481980 20 add_watcher() i=6 2024-09-13T06:10:00.836 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.823+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94275197380736] v33'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e40083f0 con 0x7fb7e80dc040 2024-09-13T06:10:00.836 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.823+0000 7fb7f7481980 20 add_watcher() i=7 2024-09-13T06:10:00.836 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.823+0000 7fb7f7481980 2 all 8 watchers are set, enabling cache 2024-09-13T06:10:00.836 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.823+0000 7fb7f7481980 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55be27a69850 con 0x55be27a5b5d0 2024-09-13T06:10:00.836 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.823+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb7e40083f0 con 0x55be27a5b5d0 2024-09-13T06:10:00.836 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.823+0000 7fb7f7481980 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94275197376592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55be27a6b6e0 con 0x55be27a5b5d0 2024-09-13T06:10:00.836 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.827+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94275197376592] v33'132 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb7e40083f0 con 0x55be27a5b5d0 2024-09-13T06:10:00.836 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.827+0000 7fb6ab7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:10:00.836 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.827+0000 7fb7f7481980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:10:00.836 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.827+0000 7fb7f7481980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:10:00.836 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.827+0000 7fb7f7481980 5 note: GC not initialized 2024-09-13T06:10:00.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.827+0000 7fb6aa7e4640 20 reqs_thread_entry: start 2024-09-13T06:10:00.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.827+0000 7fb7f7481980 20 init_complete bucket index max shards: 11 2024-09-13T06:10:00.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.827+0000 7fb7f7481980 20 Filter name: none 2024-09-13T06:10:00.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.827+0000 7fb6a37fe640 20 reqs_thread_entry: start 2024-09-13T06:10:00.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.827+0000 7fb7f7481980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T06:10:00.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.827+0000 7fb7f7481980 20 rados->read ofs=0 len=0 2024-09-13T06:10:00.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.827+0000 7fb7f7481980 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55be27a91880 con 0x55be27a5b5d0 2024-09-13T06:10:00.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.827+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fb7e40083f0 con 0x55be27a5b5d0 2024-09-13T06:10:00.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.827+0000 7fb7f7481980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T06:10:00.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.827+0000 7fb7f7481980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T06:10:00.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.827+0000 7fb7f7481980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:10:00.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.827+0000 7fb7f7481980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:10:00.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.827+0000 7fb7f7481980 10 cache get: name=default.rgw.meta+root+testx/myfoo : miss 2024-09-13T06:10:00.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.827+0000 7fb7f7481980 20 rados->read ofs=0 len=0 2024-09-13T06:10:00.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.827+0000 7fb7f7481980 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:63 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55be27a93960 con 0x55be27a5b5d0 2024-09-13T06:10:00.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.827+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(63 testx/myfoo [call out=48b,read 0~193 out=193b] v0'0 uv1 ondisk = 0) ==== 197+0+241 (crc 0 0 0) 0x7fb7e40083f0 con 0x55be27a5b5d0 2024-09-13T06:10:00.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.827+0000 7fb7f7481980 20 rados_obj.operate() r=0 bl.length=193 2024-09-13T06:10:00.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.827+0000 7fb7f7481980 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x11 2024-09-13T06:10:00.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.827+0000 7fb7f7481980 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-13T06:10:00.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.827+0000 7fb7f7481980 10 cache get: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 : miss 2024-09-13T06:10:00.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.827+0000 7fb7f7481980 20 rados->read ofs=0 len=0 2024-09-13T06:10:00.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.827+0000 7fb7f7481980 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:64 8.e 8:75efaca1:root::.bucket.meta.testx%3amyfoo%3a52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55be27a951d0 con 0x7fb7e80dc040 2024-09-13T06:10:00.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.827+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(64 .bucket.meta.testx:myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 [call out=48b,stat out=16b,read 0~412 out=412b,getxattrs out=298b] v0'0 uv3 ondisk = 0) ==== 338+0+774 (crc 0 0 0) 0x7fb7e40083f0 con 0x7fb7e80dc040 2024-09-13T06:10:00.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.827+0000 7fb7f7481980 20 rados_obj.operate() r=0 bl.length=412 2024-09-13T06:10:00.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.827+0000 7fb7f7481980 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 info.flags=0x17 2024-09-13T06:10:00.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.827+0000 7fb7f7481980 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 to cache LRU end 2024-09-13T06:10:00.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.827+0000 7fb7f7481980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:10:00.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.827+0000 7fb7f7481980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-13T06:10:00.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.827+0000 7fb7f7481980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.testx:myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 2024-09-13T06:10:00.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.827+0000 7fb7f7481980 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-13T06:10:00.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.827+0000 7fb7f7481980 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:65 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55be27a99850 con 0x55be27a5b5d0 2024-09-13T06:10:00.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.827+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(65 testx$tenanteduser.buckets [call] v33'2 uv2 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7fb7e40083f0 con 0x55be27a5b5d0 2024-09-13T06:10:00.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.827+0000 7fb7f7481980 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:66 8.18 8:1a66c368:root::.bucket.meta.myfoo%3a52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1:head [create,call version.inc in=38b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55be27a9d160 con 0x55be27a5b5d0 2024-09-13T06:10:00.840 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.831+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(66 .bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 [create,call,writefull 0~379,setxattr (123)] v33'16 uv16 ondisk = 0) ==== 332+0+0 (crc 0 0 0) 0x7fb7e40083f0 con 0x55be27a5b5d0 2024-09-13T06:10:00.840 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.831+0000 7fb7f7481980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 info.flags=0x7 2024-09-13T06:10:00.840 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.831+0000 7fb7f7481980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 to cache LRU end 2024-09-13T06:10:00.840 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.831+0000 7fb7f7481980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T06:10:00.840 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.831+0000 7fb7f7481980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1, ofs0, ns] 2024-09-13T06:10:00.840 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.831+0000 7fb7f7481980 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:67 7.9 7:93e5b521:::notify.7:head [notify cookie 94275197579008 in=740b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55be27a9cb60 con 0x7fb7e80dc040 2024-09-13T06:10:00.840 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.831+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== watch-notify(notify (1) cookie 94275197380736 notify 141733920782 ret 0) ==== 770+0+0 (crc 0 0 0) 0x55be27a9d500 con 0x7fb7e80dc040 2024-09-13T06:10:00.840 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.831+0000 7fb6cbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920782 cookie 94275197380736 notifier 4556 bl.length()=728 2024-09-13T06:10:00.840 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.831+0000 7fb6cbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 info.flags=0x7 2024-09-13T06:10:00.840 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.831+0000 7fb6cbfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 to cache LRU end 2024-09-13T06:10:00.840 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.831+0000 7fb6cbfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T06:10:00.840 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.831+0000 7fb6cbfff640 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:68 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fb6b8003eb0 con 0x7fb7e80dc040 2024-09-13T06:10:00.841 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.831+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(67 notify.7 [notify cookie 94275197579008 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb7e40083f0 con 0x7fb7e80dc040 2024-09-13T06:10:00.841 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.831+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 <== osd.0 v2:172.21.15.120:6800/1923744619 20 ==== osd_op_reply(68 notify.7 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e40083f0 con 0x7fb7e80dc040 2024-09-13T06:10:00.841 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.831+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 <== osd.0 v2:172.21.15.120:6800/1923744619 21 ==== watch-notify(notify_complete (2) cookie 94275197579008 notify 141733920782 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55be27a99280 con 0x7fb7e80dc040 2024-09-13T06:10:00.841 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.831+0000 7fb7f7481980 20 handle_bi_update(): bucket=:myfoo[52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1]): orig_sources= new_sources= 2024-09-13T06:10:00.841 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.831+0000 7fb7f7481980 20 handle_bi_update(): bucket=:myfoo[52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1]): potential sources added=[] removed=[] 2024-09-13T06:10:00.841 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.831+0000 7fb7f7481980 20 handle_bi_update(): bucket=:myfoo[52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1]): orig_dests= new_dests= 2024-09-13T06:10:00.841 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.831+0000 7fb7f7481980 20 handle_bi_update(): bucket=:myfoo[52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1]): potential dests added=[] removed=[] 2024-09-13T06:10:00.841 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.831+0000 7fb7f7481980 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55be27a9cc80 con 0x7fb7ec06e0e0 2024-09-13T06:10:00.843 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.835+0000 7fb7f4790640 1 -- 172.21.15.194:0/2722726494 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(69 foo.buckets [call] v33'26 uv26 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fb7e80c9030 con 0x7fb7ec06e0e0 2024-09-13T06:10:00.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.835+0000 7fb7f7481980 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55be27a9cc80 con 0x7fb7ec06e0e0 2024-09-13T06:10:00.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.839+0000 7fb7f4790640 1 -- 172.21.15.194:0/2722726494 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v33'27 uv27 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7fb7e80c9030 con 0x7fb7ec06e0e0 2024-09-13T06:10:00.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.839+0000 7fb7f7481980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-13T06:10:00.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.839+0000 7fb7f7481980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T06:10:00.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.839+0000 7fb7f7481980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-13T06:10:00.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.839+0000 7fb7f7481980 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94275197585360 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55be27a9cbf0 con 0x7fb7e80dc040 2024-09-13T06:10:00.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.839+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 <== osd.0 v2:172.21.15.120:6800/1923744619 22 ==== watch-notify(notify (1) cookie 94275197378208 notify 141733920783 ret 0) ==== 356+0+0 (crc 0 0 0) 0x55be27a955c0 con 0x7fb7e80dc040 2024-09-13T06:10:00.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.839+0000 7fb6cb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920783 cookie 94275197378208 notifier 4556 bl.length()=314 2024-09-13T06:10:00.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.839+0000 7fb6cb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-13T06:10:00.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.839+0000 7fb6cb7fe640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T06:10:00.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.839+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 <== osd.0 v2:172.21.15.120:6800/1923744619 23 ==== osd_op_reply(71 notify.6 [notify cookie 94275197585360 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb7e40083f0 con 0x7fb7e80dc040 2024-09-13T06:10:00.845 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.839+0000 7fb6cb7fe640 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fb61c003410 con 0x7fb7e80dc040 2024-09-13T06:10:00.845 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.839+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 <== osd.0 v2:172.21.15.120:6800/1923744619 24 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e40083f0 con 0x7fb7e80dc040 2024-09-13T06:10:00.845 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.839+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 <== osd.0 v2:172.21.15.120:6800/1923744619 25 ==== watch-notify(notify_complete (2) cookie 94275197585360 notify 141733920783 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55be27a946f0 con 0x7fb7e80dc040 2024-09-13T06:10:00.845 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.839+0000 7fb7f7481980 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:73 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55be27a9cc80 con 0x55be27a5b5d0 2024-09-13T06:10:00.845 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.839+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 <== osd.1 v2:172.21.15.194:6808/3135444559 25 ==== osd_op_reply(73 testx/myfoo [call,delete] v33'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7fb7e40083f0 con 0x55be27a5b5d0 2024-09-13T06:10:00.845 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.839+0000 7fb7f7481980 10 removing default.rgw.meta+root+testx/myfoo from cache 2024-09-13T06:10:00.845 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.839+0000 7fb7f7481980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-09-13T06:10:00.845 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.839+0000 7fb7f7481980 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [notify cookie 94275197585360 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55be27a9cbf0 con 0x55be27a5b5d0 2024-09-13T06:10:00.845 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.839+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 <== osd.1 v2:172.21.15.194:6808/3135444559 26 ==== watch-notify(notify (1) cookie 94275197364432 notify 141733920780 ret 0) ==== 197+0+0 (crc 0 0 0) 0x55be27a946f0 con 0x55be27a5b5d0 2024-09-13T06:10:00.846 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.839+0000 7fb6cb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920780 cookie 94275197364432 notifier 4556 bl.length()=155 2024-09-13T06:10:00.846 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.839+0000 7fb6cb7fe640 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fb61c003410 con 0x55be27a5b5d0 2024-09-13T06:10:00.846 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.839+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 <== osd.1 v2:172.21.15.194:6808/3135444559 27 ==== osd_op_reply(74 notify.4 [notify cookie 94275197585360 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb7e40083f0 con 0x55be27a5b5d0 2024-09-13T06:10:00.846 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.839+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 <== osd.1 v2:172.21.15.194:6808/3135444559 28 ==== osd_op_reply(75 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e40083f0 con 0x55be27a5b5d0 2024-09-13T06:10:00.846 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.839+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 <== osd.1 v2:172.21.15.194:6808/3135444559 29 ==== watch-notify(notify_complete (2) cookie 94275197585360 notify 141733920780 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fb7e403b040 con 0x55be27a5b5d0 2024-09-13T06:10:00.846 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.839+0000 7fb7f7481980 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:76 8.e 8:75efaca1:root::.bucket.meta.testx%3amyfoo%3a52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55be27a9cc80 con 0x7fb7e80dc040 2024-09-13T06:10:00.847 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.843+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 <== osd.0 v2:172.21.15.120:6800/1923744619 26 ==== osd_op_reply(76 .bucket.meta.testx:myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 [call,delete] v33'4 uv4 ondisk = 0) ==== 254+0+0 (crc 0 0 0) 0x7fb7e40083f0 con 0x7fb7e80dc040 2024-09-13T06:10:00.847 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.843+0000 7fb7f7481980 10 removing default.rgw.meta+root+.bucket.meta.testx:myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 from cache 2024-09-13T06:10:00.848 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.843+0000 7fb7f7481980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1, ofs0, ns] 2024-09-13T06:10:00.848 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.843+0000 7fb7f7481980 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94275197553280 in=224b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55be27a9cc80 con 0x7fb7e80dc040 2024-09-13T06:10:00.848 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.843+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 <== osd.0 v2:172.21.15.120:6800/1923744619 27 ==== watch-notify(notify (1) cookie 94275197378208 notify 141733920784 ret 0) ==== 254+0+0 (crc 0 0 0) 0x7fb7e403b040 con 0x7fb7e80dc040 2024-09-13T06:10:00.848 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.843+0000 7fb6cbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920784 cookie 94275197378208 notifier 4556 bl.length()=212 2024-09-13T06:10:00.848 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.843+0000 7fb6cbfff640 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:78 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fb6b8003eb0 con 0x7fb7e80dc040 2024-09-13T06:10:00.848 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.843+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 <== osd.0 v2:172.21.15.120:6800/1923744619 28 ==== osd_op_reply(77 notify.6 [notify cookie 94275197553280 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb7e40083f0 con 0x7fb7e80dc040 2024-09-13T06:10:00.848 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.843+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 <== osd.0 v2:172.21.15.120:6800/1923744619 29 ==== osd_op_reply(78 notify.6 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e40083f0 con 0x7fb7e80dc040 2024-09-13T06:10:00.848 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.843+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 <== osd.0 v2:172.21.15.120:6800/1923744619 30 ==== watch-notify(notify_complete (2) cookie 94275197553280 notify 141733920784 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fb7e4010040 con 0x7fb7e80dc040 2024-09-13T06:10:00.848 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.847+0000 7fb6ab7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:10:00.848 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.847+0000 7fb7f7481980 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94275197376592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55be27a82360 con 0x55be27a5b5d0 2024-09-13T06:10:00.849 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.847+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 <== osd.1 v2:172.21.15.194:6808/3135444559 30 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94275197376592] v33'133 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb7e40083f0 con 0x55be27a5b5d0 2024-09-13T06:10:00.849 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.847+0000 7fb7f7481980 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94275197358256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55be27a82360 con 0x7fb7ec06e0e0 2024-09-13T06:10:00.849 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.847+0000 7fb7f4790640 1 -- 172.21.15.194:0/2722726494 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94275197358256] v33'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e80c9030 con 0x7fb7ec06e0e0 2024-09-13T06:10:00.849 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.847+0000 7fb7f7481980 20 remove_watcher() i=0 2024-09-13T06:10:00.850 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.847+0000 7fb7f7481980 2 removed watcher, disabling cache 2024-09-13T06:10:00.850 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.847+0000 7fb7f7481980 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94275197360512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55be27a82360 con 0x55be27a5b5d0 2024-09-13T06:10:00.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.851+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 <== osd.1 v2:172.21.15.194:6808/3135444559 31 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94275197360512] v33'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e40083f0 con 0x55be27a5b5d0 2024-09-13T06:10:00.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.851+0000 7fb7f7481980 20 remove_watcher() i=1 2024-09-13T06:10:00.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.851+0000 7fb7f7481980 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94275197367312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55be27a82360 con 0x55be27a5ff90 2024-09-13T06:10:00.853 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.851+0000 7fb7f4f91640 1 -- 172.21.15.194:0/2722726494 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94275197367312] v33'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7ec09b040 con 0x55be27a5ff90 2024-09-13T06:10:00.853 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.851+0000 7fb7f7481980 20 remove_watcher() i=2 2024-09-13T06:10:00.853 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.851+0000 7fb7f7481980 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94275197370016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55be27a82360 con 0x7fb7ec06e0e0 2024-09-13T06:10:00.854 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.851+0000 7fb7f4790640 1 -- 172.21.15.194:0/2722726494 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94275197370016] v33'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e80c9030 con 0x7fb7ec06e0e0 2024-09-13T06:10:00.854 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.851+0000 7fb7f7481980 20 remove_watcher() i=3 2024-09-13T06:10:00.854 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.851+0000 7fb7f7481980 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94275197364432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55be27a82360 con 0x55be27a5b5d0 2024-09-13T06:10:00.856 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.855+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 <== osd.1 v2:172.21.15.194:6808/3135444559 32 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94275197364432] v33'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e40083f0 con 0x55be27a5b5d0 2024-09-13T06:10:00.856 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.855+0000 7fb7f7481980 20 remove_watcher() i=4 2024-09-13T06:10:00.856 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.855+0000 7fb7f7481980 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94275197374720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55be27a82360 con 0x7fb7e80dc040 2024-09-13T06:10:00.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.855+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 <== osd.0 v2:172.21.15.120:6800/1923744619 31 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94275197374720] v33'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e40083f0 con 0x7fb7e80dc040 2024-09-13T06:10:00.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.855+0000 7fb7f7481980 20 remove_watcher() i=5 2024-09-13T06:10:00.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.855+0000 7fb7f7481980 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94275197378208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55be27a82360 con 0x7fb7e80dc040 2024-09-13T06:10:00.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.859+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 <== osd.0 v2:172.21.15.120:6800/1923744619 32 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94275197378208] v33'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e40083f0 con 0x7fb7e80dc040 2024-09-13T06:10:00.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.859+0000 7fb7f7481980 20 remove_watcher() i=6 2024-09-13T06:10:00.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.859+0000 7fb7f7481980 1 -- 172.21.15.194:0/2722726494 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94275197380736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55be27a82360 con 0x7fb7e80dc040 2024-09-13T06:10:00.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.863+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 <== osd.0 v2:172.21.15.120:6800/1923744619 33 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94275197380736] v33'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e40083f0 con 0x7fb7e80dc040 2024-09-13T06:10:00.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.863+0000 7fb7f7481980 20 remove_watcher() i=7 2024-09-13T06:10:00.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.863+0000 7fb7f7481980 1 -- 172.21.15.194:0/2722726494 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fb7e80dc040 msgr2=0x7fb7e80ce430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.863+0000 7fb7f7481980 1 --2- 172.21.15.194:0/2722726494 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fb7e80dc040 0x7fb7e80ce430 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.863+0000 7fb7f7481980 1 -- 172.21.15.194:0/2722726494 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55be27a5b5d0 msgr2=0x55be27a5da90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.863+0000 7fb7f7481980 1 --2- 172.21.15.194:0/2722726494 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55be27a5b5d0 0x55be27a5da90 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.863+0000 7fb7f7481980 1 -- 172.21.15.194:0/2722726494 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fb7ec06e0e0 msgr2=0x7fb7ec076690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.863+0000 7fb7f7481980 1 --2- 172.21.15.194:0/2722726494 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fb7ec06e0e0 0x7fb7ec076690 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.863+0000 7fb7f7481980 1 -- 172.21.15.194:0/2722726494 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55be27a5ff90 msgr2=0x55be27a62380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.863+0000 7fb7f7481980 1 --2- 172.21.15.194:0/2722726494 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55be27a5ff90 0x55be27a62380 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.863+0000 7fb7f7481980 1 -- 172.21.15.194:0/2722726494 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fb6c0034600 msgr2=0x7fb6c0036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.863+0000 7fb7f7481980 1 --2- 172.21.15.194:0/2722726494 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fb6c0034600 0x7fb6c0036ac0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb7e80abaa0 tx=0x7fb7e80b9040 comp rx=0 tx=0).stop 2024-09-13T06:10:00.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.863+0000 7fb7f7481980 1 -- 172.21.15.194:0/2722726494 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55be27a49320 msgr2=0x55be27a50460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.863+0000 7fb7f5792640 1 -- 172.21.15.194:0/2722726494 reap_dead start 2024-09-13T06:10:00.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.863+0000 7fb7f7481980 1 --2- 172.21.15.194:0/2722726494 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55be27a49320 0x55be27a50460 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec033fd0 tx=0x7fb7ec042130 comp rx=0 tx=0).stop 2024-09-13T06:10:00.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.863+0000 7fb7f7481980 1 -- 172.21.15.194:0/2722726494 shutdown_connections 2024-09-13T06:10:00.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.863+0000 7fb7f7481980 1 --2- 172.21.15.194:0/2722726494 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55be27a49320 0x55be27a50460 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.863+0000 7fb7f7481980 1 -- 172.21.15.194:0/2722726494 >> 172.21.15.194:0/2722726494 conn(0x55be27a45700 msgr2=0x55be27a437d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:00.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.863+0000 7fb7f7481980 1 -- 172.21.15.194:0/2722726494 shutdown_connections 2024-09-13T06:10:00.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.863+0000 7fb7f7481980 1 -- 172.21.15.194:0/2722726494 wait complete. 2024-09-13T06:10:00.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.863+0000 7fb7f7481980 1 -- 172.21.15.194:0/3576047991 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fb6cc0346a0 msgr2=0x7fb6cc036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.863+0000 7fb7f7481980 1 --2- 172.21.15.194:0/3576047991 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fb6cc0346a0 0x7fb6cc036b60 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb7e801b2c0 tx=0x7fb7e8005a10 comp rx=0 tx=0).stop 2024-09-13T06:10:00.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.863+0000 7fb7f7481980 1 -- 172.21.15.194:0/3576047991 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55be27a3c9e0 msgr2=0x55be27a3ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.863+0000 7fb7f7481980 1 --2- 172.21.15.194:0/3576047991 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55be27a3c9e0 0x55be27a3ce00 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec048470 tx=0x7fb7ec010d50 comp rx=0 tx=0).stop 2024-09-13T06:10:00.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.863+0000 7fb7f7481980 1 -- 172.21.15.194:0/3576047991 shutdown_connections 2024-09-13T06:10:00.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.863+0000 7fb7f7481980 1 --2- 172.21.15.194:0/3576047991 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fb6cc0346a0 0x7fb6cc036b60 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.863+0000 7fb7f7481980 1 --2- 172.21.15.194:0/3576047991 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55be27a3c9e0 0x55be27a3ce00 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.863+0000 7fb7f7481980 1 -- 172.21.15.194:0/3576047991 >> 172.21.15.194:0/3576047991 conn(0x55be27a31b30 msgr2=0x55be27a345b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:00.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.863+0000 7fb7f7481980 1 -- 172.21.15.194:0/3576047991 shutdown_connections 2024-09-13T06:10:00.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.863+0000 7fb7f7481980 1 -- 172.21.15.194:0/3576047991 wait complete. 2024-09-13T06:10:00.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.863+0000 7fb7f7481980 1 -- 172.21.15.194:0/579814004 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55be27930a20 msgr2=0x55be27a25b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.863+0000 7fb7f7481980 1 --2- 172.21.15.194:0/579814004 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55be27930a20 0x55be27a25b40 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.863+0000 7fb7f7481980 1 -- 172.21.15.194:0/579814004 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55be27a2c3b0 msgr2=0x55be27a2e7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.863+0000 7fb7f7481980 1 --2- 172.21.15.194:0/579814004 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55be27a2c3b0 0x55be27a2e7a0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.863+0000 7fb7f7481980 1 -- 172.21.15.194:0/579814004 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55be27a284b0 msgr2=0x55be27a2a8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.863+0000 7fb7f7481980 1 --2- 172.21.15.194:0/579814004 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55be27a284b0 0x55be27a2a8a0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.863+0000 7fb7f7481980 1 -- 172.21.15.194:0/579814004 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fb6dc034650 msgr2=0x7fb6dc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.863+0000 7fb7f7481980 1 --2- 172.21.15.194:0/579814004 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fb6dc034650 0x7fb6dc036b10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb7e80ad000 tx=0x7fb7e80a5040 comp rx=0 tx=0).stop 2024-09-13T06:10:00.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.863+0000 7fb7f7481980 1 -- 172.21.15.194:0/579814004 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55be2792c6a0 msgr2=0x55be27a1ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.863+0000 7fb7f7481980 1 --2- 172.21.15.194:0/579814004 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55be2792c6a0 0x55be27a1ebb0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec002260 tx=0x7fb7ec000f50 comp rx=0 tx=0).stop 2024-09-13T06:10:00.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.863+0000 7fb7f5792640 1 -- 172.21.15.194:0/579814004 reap_dead start 2024-09-13T06:10:00.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.863+0000 7fb7f7481980 1 -- 172.21.15.194:0/579814004 shutdown_connections 2024-09-13T06:10:00.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.863+0000 7fb7f7481980 1 -- 172.21.15.194:0/579814004 >> 172.21.15.194:0/579814004 conn(0x55be279281c0 msgr2=0x55be27a11ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:00.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.863+0000 7fb7f7481980 1 -- 172.21.15.194:0/579814004 shutdown_connections 2024-09-13T06:10:00.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.863+0000 7fb7f7481980 1 -- 172.21.15.194:0/579814004 wait complete. 2024-09-13T06:10:00.873 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-13T06:10:00.874 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-13T06:10:00.874 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --tenant testx --uid tenanteduser 2024-09-13T06:10:00.946 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:10:00.946 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:10:00.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.947+0000 7f4dc1c69980 1 Processor -- start 2024-09-13T06:10:00.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.947+0000 7f4dc1c69980 1 -- start start 2024-09-13T06:10:00.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.947+0000 7f4dc1c69980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x5641f220b6a0 0x5641f220ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.947+0000 7f4dc1c69980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5641f2093ae0 con 0x5641f220bff0 2024-09-13T06:10:00.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.947+0000 7f4dc1c69980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x5641f20b7e30 con 0x5641f220b6a0 2024-09-13T06:10:00.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.947+0000 7f4dbf779640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x5641f220b6a0 0x5641f220ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.947+0000 7f4dbef78640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x5641f220bff0 0x5641f2210a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:51274/0 (socket says 172.21.15.194:51274) 2024-09-13T06:10:00.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.947+0000 7f4dbef78640 1 -- 172.21.15.194:0/495298517 learned_addr learned my addr 172.21.15.194:0/495298517 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-09-13T06:10:00.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.947+0000 7f4dbf779640 1 -- 172.21.15.194:0/495298517 >> v1:172.21.15.120:6789/0 conn(0x5641f220bff0 legacy=0x5641f2210a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.947+0000 7f4dbf779640 1 -- 172.21.15.194:0/495298517 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641f2213270 con 0x5641f220b6a0 2024-09-13T06:10:00.950 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.947+0000 7f4dbf779640 1 --2- 172.21.15.194:0/495298517 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5641f220b6a0 0x5641f220ba80 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f4db800a420 tx=0x7f4db801afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24da0fc23d197d2d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.951+0000 7f4dbe777640 1 -- 172.21.15.194:0/495298517 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4db80af070 con 0x5641f220b6a0 2024-09-13T06:10:00.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.951+0000 7f4dbe777640 1 -- 172.21.15.194:0/495298517 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4db80aa530 con 0x5641f220b6a0 2024-09-13T06:10:00.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.951+0000 7f4dbe777640 1 -- 172.21.15.194:0/495298517 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4db80aa850 con 0x5641f220b6a0 2024-09-13T06:10:00.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.951+0000 7f4dc1c69980 1 -- 172.21.15.194:0/495298517 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5641f220b6a0 msgr2=0x5641f220ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.951+0000 7f4dc1c69980 1 --2- 172.21.15.194:0/495298517 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5641f220b6a0 0x5641f220ba80 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f4db800a420 tx=0x7f4db801afd0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.951+0000 7f4dc1c69980 1 -- 172.21.15.194:0/495298517 shutdown_connections 2024-09-13T06:10:00.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.951+0000 7f4dc1c69980 1 --2- 172.21.15.194:0/495298517 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5641f220b6a0 0x5641f220ba80 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.951+0000 7f4dc1c69980 1 -- 172.21.15.194:0/495298517 >> 172.21.15.194:0/495298517 conn(0x5641f22071c0 msgr2=0x5641f22095e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:00.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.951+0000 7f4dc1c69980 1 -- 172.21.15.194:0/495298517 shutdown_connections 2024-09-13T06:10:00.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.951+0000 7f4dc1c69980 1 -- 172.21.15.194:0/495298517 wait complete. 2024-09-13T06:10:00.965 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.963+0000 7f4dc1c69980 1 Processor -- start 2024-09-13T06:10:00.965 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.963+0000 7f4dc1c69980 1 -- start start 2024-09-13T06:10:00.965 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.963+0000 7f4dc1c69980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5641f220bff0 0x5641f22f6c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.965 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.963+0000 7f4dc1c69980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5641f20b9200 con 0x5641f220bff0 2024-09-13T06:10:00.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.963+0000 7f4dbf779640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5641f220bff0 0x5641f22f6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.963+0000 7f4dbf779640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5641f220bff0 0x5641f22f6c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:46176/0 (socket says 172.21.15.194:46176) 2024-09-13T06:10:00.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.963+0000 7f4dbf779640 1 -- 172.21.15.194:0/4170483325 learned_addr learned my addr 172.21.15.194:0/4170483325 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:00.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.963+0000 7f4dbf779640 1 -- 172.21.15.194:0/4170483325 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641f22f71f0 con 0x5641f220bff0 2024-09-13T06:10:00.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.967+0000 7f4dbf779640 1 --2- 172.21.15.194:0/4170483325 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5641f220bff0 0x5641f22f6c20 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f4db80aa500 tx=0x7f4db80033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef5cf20ac0bd1e32 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.967+0000 7f4cad60a640 1 -- 172.21.15.194:0/4170483325 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4db80af040 con 0x5641f220bff0 2024-09-13T06:10:00.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.967+0000 7f4cad60a640 1 -- 172.21.15.194:0/4170483325 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4db80aba40 con 0x5641f220bff0 2024-09-13T06:10:00.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.967+0000 7f4cad60a640 1 -- 172.21.15.194:0/4170483325 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4db80abd20 con 0x5641f220bff0 2024-09-13T06:10:00.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.967+0000 7f4dc1c69980 1 -- 172.21.15.194:0/4170483325 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5641f220bff0 msgr2=0x5641f22f6c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.967+0000 7f4dc1c69980 1 --2- 172.21.15.194:0/4170483325 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5641f220bff0 0x5641f22f6c20 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f4db80aa500 tx=0x7f4db80033b0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.967+0000 7f4dc1c69980 1 -- 172.21.15.194:0/4170483325 shutdown_connections 2024-09-13T06:10:00.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.967+0000 7f4dc1c69980 1 --2- 172.21.15.194:0/4170483325 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5641f220bff0 0x5641f22f6c20 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.967+0000 7f4dc1c69980 1 -- 172.21.15.194:0/4170483325 >> 172.21.15.194:0/4170483325 conn(0x5641f22071c0 msgr2=0x5641f22f27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:00.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.967+0000 7f4dc1c69980 1 -- 172.21.15.194:0/4170483325 shutdown_connections 2024-09-13T06:10:00.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.967+0000 7f4dc1c69980 1 -- 172.21.15.194:0/4170483325 wait complete. 2024-09-13T06:10:00.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.967+0000 7f4dc1c69980 1 Processor -- start 2024-09-13T06:10:00.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.967+0000 7f4dc1c69980 1 -- start start 2024-09-13T06:10:00.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.967+0000 7f4dc1c69980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5641f220bff0 0x5641f22fddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.967+0000 7f4dc1c69980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5641f2212cb0 con 0x5641f220bff0 2024-09-13T06:10:00.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.967+0000 7f4dbf779640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5641f220bff0 0x5641f22fddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.967+0000 7f4dbf779640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5641f220bff0 0x5641f22fddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:46188/0 (socket says 172.21.15.194:46188) 2024-09-13T06:10:00.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.967+0000 7f4dbf779640 1 -- 172.21.15.194:0/443243251 learned_addr learned my addr 172.21.15.194:0/443243251 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:00.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.967+0000 7f4dbf779640 1 -- 172.21.15.194:0/443243251 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641f22fe310 con 0x5641f220bff0 2024-09-13T06:10:00.971 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.967+0000 7f4dbf779640 1 --2- 172.21.15.194:0/443243251 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5641f220bff0 0x5641f22fddd0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f4db801b4b0 tx=0x7f4db8017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.967+0000 7f4cabe07640 1 -- 172.21.15.194:0/443243251 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4db80b57b0 con 0x5641f220bff0 2024-09-13T06:10:00.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.967+0000 7f4cabe07640 1 -- 172.21.15.194:0/443243251 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4db80b5950 con 0x5641f220bff0 2024-09-13T06:10:00.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.967+0000 7f4dc1c69980 1 -- 172.21.15.194:0/443243251 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5641f22fe5a0 con 0x5641f220bff0 2024-09-13T06:10:00.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.967+0000 7f4cabe07640 1 -- 172.21.15.194:0/443243251 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4db80b5c30 con 0x5641f220bff0 2024-09-13T06:10:00.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.967+0000 7f4dc1c69980 1 -- 172.21.15.194:0/443243251 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641f2301280 con 0x5641f220bff0 2024-09-13T06:10:00.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.971+0000 7f4cabe07640 1 -- 172.21.15.194:0/443243251 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4db80c0440 con 0x5641f220bff0 2024-09-13T06:10:00.975 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.971+0000 7f4cabe07640 1 --2- 172.21.15.194:0/443243251 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4ca4034650 0x7f4ca4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.975 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.971+0000 7f4cabe07640 1 -- 172.21.15.194:0/443243251 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f4db80bb070 con 0x5641f220bff0 2024-09-13T06:10:00.975 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.971+0000 7f4dbef78640 1 --2- 172.21.15.194:0/443243251 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4ca4034650 0x7f4ca4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.975 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.971+0000 7f4dc1c69980 1 --2- 172.21.15.194:0/443243251 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5641f2302d50 0x5641f2305140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.975 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.971+0000 7f4dc1c69980 1 -- 172.21.15.194:0/443243251 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5641f2305790 con 0x5641f2302d50 2024-09-13T06:10:00.975 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.971+0000 7f4dbff7a640 1 --2- 172.21.15.194:0/443243251 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5641f2302d50 0x5641f2305140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.975 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.971+0000 7f4dbef78640 1 --2- 172.21.15.194:0/443243251 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4ca4034650 0x7f4ca4036b10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4da8000f70 tx=0x7f4da80012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.975 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.971+0000 7f4dbff7a640 1 --2- 172.21.15.194:0/443243251 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5641f2302d50 0x5641f2305140 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.975 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.971+0000 7f4dbff7a640 1 -- 172.21.15.194:0/443243251 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4db00083f0 con 0x5641f2302d50 2024-09-13T06:10:00.975 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.971+0000 7f4dc1c69980 1 -- 172.21.15.194:0/443243251 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5641f23024a0 con 0x5641f2302d50 2024-09-13T06:10:00.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.971+0000 7f4dbff7a640 1 -- 172.21.15.194:0/443243251 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4db00083f0 con 0x5641f2302d50 2024-09-13T06:10:00.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.971+0000 7f4dc1c69980 1 --2- 172.21.15.194:0/443243251 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5641f2307af0 0x5641f2309ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.971+0000 7f4dc1c69980 1 -- 172.21.15.194:0/443243251 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5641f230a5b0 con 0x5641f2307af0 2024-09-13T06:10:00.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.971+0000 7f4dbf779640 1 --2- 172.21.15.194:0/443243251 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5641f2307af0 0x5641f2309ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.971+0000 7f4dbf779640 1 --2- 172.21.15.194:0/443243251 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5641f2307af0 0x5641f2309ee0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.971+0000 7f4dbf779640 1 -- 172.21.15.194:0/443243251 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4db80d1070 con 0x5641f2307af0 2024-09-13T06:10:00.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.971+0000 7f4dc1c69980 1 -- 172.21.15.194:0/443243251 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5641f2306990 con 0x5641f2302d50 2024-09-13T06:10:00.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.971+0000 7f4dbff7a640 1 -- 172.21.15.194:0/443243251 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4db00083f0 con 0x5641f2302d50 2024-09-13T06:10:00.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.971+0000 7f4dc1c69980 1 --2- 172.21.15.194:0/443243251 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5641f230ba10 0x5641f230de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.971+0000 7f4dc1c69980 1 -- 172.21.15.194:0/443243251 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5641f230e500 con 0x5641f230ba10 2024-09-13T06:10:00.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.971+0000 7f4dbef78640 1 --2- 172.21.15.194:0/443243251 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5641f230ba10 0x5641f230de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.971+0000 7f4dbef78640 1 --2- 172.21.15.194:0/443243251 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5641f230ba10 0x5641f230de00 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.975+0000 7f4dbef78640 1 -- 172.21.15.194:0/443243251 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4da800e620 con 0x5641f230ba10 2024-09-13T06:10:00.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.975+0000 7f4dc1c69980 1 Processor -- start 2024-09-13T06:10:00.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.975+0000 7f4dc1c69980 1 -- start start 2024-09-13T06:10:00.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.975+0000 7f4dc1c69980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5641f231bfd0 0x5641f231c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.975+0000 7f4dc1c69980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5641f2112800 con 0x5641f231bfd0 2024-09-13T06:10:00.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.975+0000 7f4dbf779640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5641f231bfd0 0x5641f231c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.975+0000 7f4dbf779640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5641f231bfd0 0x5641f231c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:46200/0 (socket says 172.21.15.194:46200) 2024-09-13T06:10:00.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.975+0000 7f4dbf779640 1 -- 172.21.15.194:0/1941656947 learned_addr learned my addr 172.21.15.194:0/1941656947 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:00.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.975+0000 7f4dbf779640 1 -- 172.21.15.194:0/1941656947 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641f231c930 con 0x5641f231bfd0 2024-09-13T06:10:00.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.975+0000 7f4dbf779640 1 --2- 172.21.15.194:0/1941656947 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5641f231bfd0 0x5641f231c3f0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f4db80e36f0 tx=0x7f4db80be900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.975+0000 7f4ca9602640 1 -- 172.21.15.194:0/1941656947 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4db80a9910 con 0x5641f231bfd0 2024-09-13T06:10:00.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.975+0000 7f4dc1c69980 1 -- 172.21.15.194:0/1941656947 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5641f231cbc0 con 0x5641f231bfd0 2024-09-13T06:10:00.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.975+0000 7f4ca9602640 1 -- 172.21.15.194:0/1941656947 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4db80a9ab0 con 0x5641f231bfd0 2024-09-13T06:10:00.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.975+0000 7f4ca9602640 1 -- 172.21.15.194:0/1941656947 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4db80a9d90 con 0x5641f231bfd0 2024-09-13T06:10:00.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.975+0000 7f4dc1c69980 1 -- 172.21.15.194:0/1941656947 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641f231f840 con 0x5641f231bfd0 2024-09-13T06:10:00.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.975+0000 7f4ca9602640 1 -- 172.21.15.194:0/1941656947 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4db80de070 con 0x5641f231bfd0 2024-09-13T06:10:00.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.975+0000 7f4ca9602640 1 --2- 172.21.15.194:0/1941656947 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4c98034650 0x7f4c98036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.975+0000 7f4ca9602640 1 -- 172.21.15.194:0/1941656947 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f4db80ed0b0 con 0x5641f231bfd0 2024-09-13T06:10:00.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.975+0000 7f4dbef78640 1 --2- 172.21.15.194:0/1941656947 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4c98034650 0x7f4c98036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.979+0000 7f4dc1c69980 1 Processor -- start 2024-09-13T06:10:00.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.979+0000 7f4dc1c69980 1 -- start start 2024-09-13T06:10:00.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.979+0000 7f4dbef78640 1 --2- 172.21.15.194:0/1941656947 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4c98034650 0x7f4c98036b10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4da800bf60 tx=0x7f4da800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.979+0000 7f4dc1c69980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5641f2181e20 0x5641f2182220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.979+0000 7f4dc1c69980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5641f22f74b0 con 0x5641f2181e20 2024-09-13T06:10:00.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.979+0000 7f4dbf779640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5641f2181e20 0x5641f2182220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.979+0000 7f4dbf779640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5641f2181e20 0x5641f2182220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:46202/0 (socket says 172.21.15.194:46202) 2024-09-13T06:10:00.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.979+0000 7f4dbf779640 1 -- 172.21.15.194:0/3261917959 learned_addr learned my addr 172.21.15.194:0/3261917959 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:00.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.979+0000 7f4dbf779640 1 -- 172.21.15.194:0/3261917959 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641f21827f0 con 0x5641f2181e20 2024-09-13T06:10:00.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.979+0000 7f4dbf779640 1 --2- 172.21.15.194:0/3261917959 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5641f2181e20 0x5641f2182220 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f4db80ddf90 tx=0x7f4db80ca400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eac5efd126f8ee5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.979+0000 7f4ca2ffd640 1 -- 172.21.15.194:0/3261917959 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4db80e3940 con 0x5641f2181e20 2024-09-13T06:10:00.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.979+0000 7f4ca2ffd640 1 -- 172.21.15.194:0/3261917959 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4db80c9610 con 0x5641f2181e20 2024-09-13T06:10:00.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.979+0000 7f4ca2ffd640 1 -- 172.21.15.194:0/3261917959 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4db80e3cc0 con 0x5641f2181e20 2024-09-13T06:10:00.990 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.979+0000 7f4dc1c69980 1 -- 172.21.15.194:0/3261917959 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5641f2181e20 msgr2=0x5641f2182220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:00.990 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.979+0000 7f4dc1c69980 1 --2- 172.21.15.194:0/3261917959 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5641f2181e20 0x5641f2182220 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f4db80ddf90 tx=0x7f4db80ca400 comp rx=0 tx=0).stop 2024-09-13T06:10:00.990 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.979+0000 7f4dc1c69980 1 -- 172.21.15.194:0/3261917959 shutdown_connections 2024-09-13T06:10:00.990 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.979+0000 7f4dc1c69980 1 --2- 172.21.15.194:0/3261917959 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5641f2181e20 0x5641f2182220 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:00.990 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.979+0000 7f4dc1c69980 1 -- 172.21.15.194:0/3261917959 >> 172.21.15.194:0/3261917959 conn(0x5641f2324ce0 msgr2=0x5641f2322de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:00.990 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.979+0000 7f4dc1c69980 1 -- 172.21.15.194:0/3261917959 shutdown_connections 2024-09-13T06:10:00.990 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.979+0000 7f4dc1c69980 1 -- 172.21.15.194:0/3261917959 wait complete. 2024-09-13T06:10:00.990 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.979+0000 7f4dc1c69980 1 Processor -- start 2024-09-13T06:10:00.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.979+0000 7f4dc1c69980 1 -- start start 2024-09-13T06:10:00.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.979+0000 7f4dc1c69980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5641f2181e20 0x5641f2331d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.979+0000 7f4dc1c69980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5641f2180a00 con 0x5641f2181e20 2024-09-13T06:10:00.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.979+0000 7f4dbf779640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5641f2181e20 0x5641f2331d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.979+0000 7f4dbf779640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5641f2181e20 0x5641f2331d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:46208/0 (socket says 172.21.15.194:46208) 2024-09-13T06:10:00.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.979+0000 7f4dbf779640 1 -- 172.21.15.194:0/478524096 learned_addr learned my addr 172.21.15.194:0/478524096 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:00.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.979+0000 7f4dbf779640 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641f2332250 con 0x5641f2181e20 2024-09-13T06:10:00.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.979+0000 7f4dbf779640 1 --2- 172.21.15.194:0/478524096 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5641f2181e20 0x5641f2331d10 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f4db80ca5b0 tx=0x7f4db80d5f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.983+0000 7f4ca17fa640 1 -- 172.21.15.194:0/478524096 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4db80ba1d0 con 0x5641f2181e20 2024-09-13T06:10:00.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.983+0000 7f4ca17fa640 1 -- 172.21.15.194:0/478524096 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4db80ba370 con 0x5641f2181e20 2024-09-13T06:10:00.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.983+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5641f2332250 con 0x5641f2181e20 2024-09-13T06:10:00.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.983+0000 7f4ca17fa640 1 -- 172.21.15.194:0/478524096 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4db80df860 con 0x5641f2181e20 2024-09-13T06:10:00.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.983+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641f2332250 con 0x5641f2181e20 2024-09-13T06:10:00.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.983+0000 7f4ca17fa640 1 -- 172.21.15.194:0/478524096 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4db80dfa00 con 0x5641f2181e20 2024-09-13T06:10:00.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.983+0000 7f4dc1c69980 20 rados->read ofs=0 len=0 2024-09-13T06:10:00.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.983+0000 7f4ca17fa640 1 --2- 172.21.15.194:0/478524096 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4c88034650 0x7f4c88036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.983+0000 7f4ca17fa640 1 -- 172.21.15.194:0/478524096 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f4db8101ca0 con 0x5641f2181e20 2024-09-13T06:10:00.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.983+0000 7f4dbef78640 1 --2- 172.21.15.194:0/478524096 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4c88034650 0x7f4c88036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.983+0000 7f4dc1c69980 1 --2- 172.21.15.194:0/478524096 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5641f233ce30 0x5641f233f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.983+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5641f233fa20 con 0x5641f233ce30 2024-09-13T06:10:00.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.983+0000 7f4dbff7a640 1 --2- 172.21.15.194:0/478524096 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5641f233ce30 0x5641f233f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.983+0000 7f4dbef78640 1 --2- 172.21.15.194:0/478524096 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4c88034650 0x7f4c88036b10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x5641f23060a0 tx=0x7f4da8010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.983+0000 7f4dbff7a640 1 --2- 172.21.15.194:0/478524096 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5641f233ce30 0x5641f233f2d0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.983+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4db00083f0 con 0x5641f233ce30 2024-09-13T06:10:00.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.983+0000 7f4dc1c69980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:00.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.983+0000 7f4dc1c69980 20 realm 2024-09-13T06:10:00.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.983+0000 7f4dc1c69980 20 rados->read ofs=0 len=0 2024-09-13T06:10:00.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.983+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5641f233fe30 con 0x5641f233ce30 2024-09-13T06:10:00.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.983+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4db00083f0 con 0x5641f233ce30 2024-09-13T06:10:00.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.983+0000 7f4dc1c69980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:00.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.983+0000 7f4dc1c69980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:10:00.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.983+0000 7f4dc1c69980 20 rados->read ofs=0 len=0 2024-09-13T06:10:00.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.983+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5641f23406d0 con 0x5641f233ce30 2024-09-13T06:10:00.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.983+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4db00083f0 con 0x5641f233ce30 2024-09-13T06:10:00.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.983+0000 7f4dc1c69980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:00.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.983+0000 7f4dc1c69980 20 rados->read ofs=0 len=0 2024-09-13T06:10:00.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.983+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5641f2340a70 con 0x5641f233ce30 2024-09-13T06:10:00.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.983+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4db00083f0 con 0x5641f233ce30 2024-09-13T06:10:00.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.983+0000 7f4dc1c69980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:10:00.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.983+0000 7f4dc1c69980 20 rados->read ofs=0 len=0 2024-09-13T06:10:00.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.983+0000 7f4dc1c69980 1 --2- 172.21.15.194:0/478524096 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5641f23417d0 0x5641f2343bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.983+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5641f2344210 con 0x5641f23417d0 2024-09-13T06:10:00.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.983+0000 7f4dbf779640 1 --2- 172.21.15.194:0/478524096 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5641f23417d0 0x5641f2343bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.987+0000 7f4dbf779640 1 --2- 172.21.15.194:0/478524096 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5641f23417d0 0x5641f2343bc0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.987+0000 7f4dbf779640 1 -- 172.21.15.194:0/478524096 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4db80d1070 con 0x5641f23417d0 2024-09-13T06:10:00.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.987+0000 7f4dc1c69980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:10:00.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.987+0000 7f4dc1c69980 20 searching for the correct realm 2024-09-13T06:10:00.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.987+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5641f2345a70 con 0x5641f23417d0 2024-09-13T06:10:00.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.987+0000 7f4dbf779640 1 -- 172.21.15.194:0/478524096 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4db80d1070 con 0x5641f23417d0 2024-09-13T06:10:00.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.987+0000 7f4dbf779640 1 --2- 172.21.15.194:0/478524096 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f4db80ca020 0x7f4db80f7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.987+0000 7f4dbf779640 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5641f2345a70 con 0x7f4db80ca020 2024-09-13T06:10:00.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.987+0000 7f4dbef78640 1 --2- 172.21.15.194:0/478524096 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f4db80ca020 0x7f4db80f7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.987+0000 7f4dbef78640 1 --2- 172.21.15.194:0/478524096 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f4db80ca020 0x7f4db80f7440 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.987+0000 7f4dbef78640 1 -- 172.21.15.194:0/478524096 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4da800e620 con 0x7f4db80ca020 2024-09-13T06:10:00.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.987+0000 7f4dbef78640 1 --2- 172.21.15.194:0/478524096 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f4da8037040 0x7f4da8036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:00.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.987+0000 7f4dbef78640 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5641f2345a70 con 0x7f4da8037040 2024-09-13T06:10:00.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.987+0000 7f4dbff7a640 1 --2- 172.21.15.194:0/478524096 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f4da8037040 0x7f4da8036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:00.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.987+0000 7f4dbff7a640 1 --2- 172.21.15.194:0/478524096 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f4da8037040 0x7f4da8036410 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:00.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.987+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4db00083f0 con 0x7f4da8037040 2024-09-13T06:10:00.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.987+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5641f2340a70 con 0x5641f233ce30 2024-09-13T06:10:00.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.987+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4db00083f0 con 0x5641f233ce30 2024-09-13T06:10:00.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.987+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5641f2340a70 con 0x5641f233ce30 2024-09-13T06:10:00.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.987+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4db00083f0 con 0x5641f233ce30 2024-09-13T06:10:00.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.987+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5641f2340a70 con 0x7f4da8037040 2024-09-13T06:10:01.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.991+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4db00083f0 con 0x7f4da8037040 2024-09-13T06:10:01.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.991+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5641f2340a70 con 0x7f4da8037040 2024-09-13T06:10:01.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.991+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4db00083f0 con 0x7f4da8037040 2024-09-13T06:10:01.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.991+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5641f2340a70 con 0x7f4db80ca020 2024-09-13T06:10:01.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.991+0000 7f4dbef78640 1 -- 172.21.15.194:0/478524096 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da800e620 con 0x7f4db80ca020 2024-09-13T06:10:01.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.991+0000 7f4dbef78640 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5641f2340a70 con 0x5641f23417d0 2024-09-13T06:10:01.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.991+0000 7f4dbf779640 1 -- 172.21.15.194:0/478524096 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4db80d1070 con 0x5641f23417d0 2024-09-13T06:10:01.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.991+0000 7f4dbf779640 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5641f2340a70 con 0x5641f233ce30 2024-09-13T06:10:01.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.991+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4db00083f0 con 0x5641f233ce30 2024-09-13T06:10:01.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.991+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5641f2340a70 con 0x7f4da8037040 2024-09-13T06:10:01.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.991+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4db00083f0 con 0x7f4da8037040 2024-09-13T06:10:01.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.991+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5641f2340a70 con 0x5641f233ce30 2024-09-13T06:10:01.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.991+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4db00083f0 con 0x5641f233ce30 2024-09-13T06:10:01.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.991+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5641f2340a70 con 0x7f4db80ca020 2024-09-13T06:10:01.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.991+0000 7f4dbef78640 1 -- 172.21.15.194:0/478524096 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4da800e620 con 0x7f4db80ca020 2024-09-13T06:10:01.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.991+0000 7f4dbef78640 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5641f2340a70 con 0x5641f23417d0 2024-09-13T06:10:01.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.991+0000 7f4dbf779640 1 -- 172.21.15.194:0/478524096 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4db80d1070 con 0x5641f23417d0 2024-09-13T06:10:01.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.991+0000 7f4dbf779640 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5641f2340a70 con 0x5641f23417d0 2024-09-13T06:10:01.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.991+0000 7f4dbf779640 1 -- 172.21.15.194:0/478524096 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4db80d1070 con 0x5641f23417d0 2024-09-13T06:10:01.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.991+0000 7f4dbf779640 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5641f2340a70 con 0x7f4da8037040 2024-09-13T06:10:01.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.991+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4db00083f0 con 0x7f4da8037040 2024-09-13T06:10:01.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.991+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5641f2340a70 con 0x5641f23417d0 2024-09-13T06:10:01.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.995+0000 7f4dbf779640 1 -- 172.21.15.194:0/478524096 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4db80d1070 con 0x5641f23417d0 2024-09-13T06:10:01.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.995+0000 7f4dbf779640 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5641f2340a70 con 0x5641f23417d0 2024-09-13T06:10:01.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.995+0000 7f4dbf779640 1 -- 172.21.15.194:0/478524096 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4db80d1070 con 0x5641f23417d0 2024-09-13T06:10:01.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.995+0000 7f4dbf779640 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5641f2340a70 con 0x5641f233ce30 2024-09-13T06:10:01.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.995+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4db00083f0 con 0x5641f233ce30 2024-09-13T06:10:01.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.995+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5641f2340a70 con 0x5641f233ce30 2024-09-13T06:10:01.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.995+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4db00083f0 con 0x5641f233ce30 2024-09-13T06:10:01.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.995+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5641f2340a70 con 0x7f4da8037040 2024-09-13T06:10:01.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.995+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4db00083f0 con 0x7f4da8037040 2024-09-13T06:10:01.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.995+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5641f2340a70 con 0x5641f23417d0 2024-09-13T06:10:01.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.995+0000 7f4dbf779640 1 -- 172.21.15.194:0/478524096 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4db80d1070 con 0x5641f23417d0 2024-09-13T06:10:01.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.995+0000 7f4dbf779640 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5641f2340a70 con 0x7f4db80ca020 2024-09-13T06:10:01.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.995+0000 7f4dbef78640 1 -- 172.21.15.194:0/478524096 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da800e620 con 0x7f4db80ca020 2024-09-13T06:10:01.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.995+0000 7f4dbef78640 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5641f2340a70 con 0x5641f233ce30 2024-09-13T06:10:01.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.995+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4db00083f0 con 0x5641f233ce30 2024-09-13T06:10:01.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.995+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5641f2340a70 con 0x7f4da8037040 2024-09-13T06:10:01.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.995+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4db00083f0 con 0x7f4da8037040 2024-09-13T06:10:01.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.995+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5641f2340a70 con 0x5641f23417d0 2024-09-13T06:10:01.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.995+0000 7f4dbf779640 1 -- 172.21.15.194:0/478524096 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4db80d1070 con 0x5641f23417d0 2024-09-13T06:10:01.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.995+0000 7f4dbf779640 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5641f2340a70 con 0x7f4da8037040 2024-09-13T06:10:01.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.995+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4db00083f0 con 0x7f4da8037040 2024-09-13T06:10:01.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.999+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5641f2340a70 con 0x7f4db80ca020 2024-09-13T06:10:01.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.999+0000 7f4dbef78640 1 -- 172.21.15.194:0/478524096 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da800e620 con 0x7f4db80ca020 2024-09-13T06:10:01.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.999+0000 7f4dbef78640 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5641f2340a70 con 0x5641f23417d0 2024-09-13T06:10:01.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.999+0000 7f4dbf779640 1 -- 172.21.15.194:0/478524096 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4db80d1070 con 0x5641f23417d0 2024-09-13T06:10:01.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.999+0000 7f4dbf779640 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5641f2340a70 con 0x7f4da8037040 2024-09-13T06:10:01.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.999+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4db00083f0 con 0x7f4da8037040 2024-09-13T06:10:01.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.999+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5641f2340a70 con 0x5641f233ce30 2024-09-13T06:10:01.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.999+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4db00083f0 con 0x5641f233ce30 2024-09-13T06:10:01.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.999+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5641f2340a70 con 0x7f4db80ca020 2024-09-13T06:10:01.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.999+0000 7f4dbef78640 1 -- 172.21.15.194:0/478524096 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da800e620 con 0x7f4db80ca020 2024-09-13T06:10:01.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.999+0000 7f4dc1c69980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:10:01.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.999+0000 7f4dc1c69980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:10:01.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.999+0000 7f4dc1c69980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:10:01.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.999+0000 7f4dc1c69980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:10:01.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.999+0000 7f4dc1c69980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:10:01.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.999+0000 7f4dc1c69980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:10:01.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.999+0000 7f4dc1c69980 20 rados->read ofs=0 len=0 2024-09-13T06:10:01.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.999+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5641f2344b90 con 0x5641f233ce30 2024-09-13T06:10:01.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.999+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4db00083f0 con 0x5641f233ce30 2024-09-13T06:10:01.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.999+0000 7f4dc1c69980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:01.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.999+0000 7f4dc1c69980 20 rados->read ofs=0 len=0 2024-09-13T06:10:01.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.999+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5641f23453e0 con 0x5641f233ce30 2024-09-13T06:10:01.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.999+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4db00083f0 con 0x5641f233ce30 2024-09-13T06:10:01.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.999+0000 7f4dc1c69980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:10:01.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.999+0000 7f4dc1c69980 20 rados->read ofs=0 len=0 2024-09-13T06:10:01.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.999+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5641f2344f30 con 0x7f4db80ca020 2024-09-13T06:10:01.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.999+0000 7f4dbef78640 1 -- 172.21.15.194:0/478524096 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4da800e620 con 0x7f4db80ca020 2024-09-13T06:10:01.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.999+0000 7f4dc1c69980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:10:01.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.999+0000 7f4dc1c69980 20 zone default found 2024-09-13T06:10:01.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.999+0000 7f4dc1c69980 4 Realm: () 2024-09-13T06:10:01.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.999+0000 7f4dc1c69980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:10:01.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.999+0000 7f4dc1c69980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:10:01.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.999+0000 7f4dc1c69980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:10:01.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.999+0000 7f4dc1c69980 20 zonegroup default 2024-09-13T06:10:01.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.999+0000 7f4dc1c69980 20 rados->read ofs=0 len=0 2024-09-13T06:10:01.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.999+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5641f2345ea0 con 0x7f4da8037040 2024-09-13T06:10:01.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.999+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4db00083f0 con 0x7f4da8037040 2024-09-13T06:10:01.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.999+0000 7f4dc1c69980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:01.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.999+0000 7f4dc1c69980 20 rados->read ofs=0 len=0 2024-09-13T06:10:01.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.999+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5641f2347880 con 0x5641f23417d0 2024-09-13T06:10:01.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.999+0000 7f4dbf779640 1 -- 172.21.15.194:0/478524096 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4db80d1070 con 0x5641f23417d0 2024-09-13T06:10:01.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.999+0000 7f4dc1c69980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:01.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.999+0000 7f4dc1c69980 20 rados->read ofs=0 len=0 2024-09-13T06:10:01.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.999+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5641f2347d80 con 0x5641f23417d0 2024-09-13T06:10:01.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.999+0000 7f4dbf779640 1 -- 172.21.15.194:0/478524096 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4db80d1070 con 0x5641f23417d0 2024-09-13T06:10:01.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.999+0000 7f4dc1c69980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:01.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.999+0000 7f4dc1c69980 20 started sync module instance, tier type = 2024-09-13T06:10:01.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.999+0000 7f4dc1c69980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:10:01.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:00.999+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5641f2346d20 con 0x7f4db80ca020 2024-09-13T06:10:01.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.003+0000 7f4dbef78640 1 -- 172.21.15.194:0/478524096 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(44 notify.0 [create] v33'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4da800e620 con 0x7f4db80ca020 2024-09-13T06:10:01.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.003+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94841236386064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5641f2348690 con 0x7f4db80ca020 2024-09-13T06:10:01.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.003+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5641f2348ee0 con 0x5641f233ce30 2024-09-13T06:10:01.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.003+0000 7f4dbef78640 1 -- 172.21.15.194:0/478524096 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94841236386064] v33'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4da800e620 con 0x7f4db80ca020 2024-09-13T06:10:01.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.003+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v33'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4db00083f0 con 0x5641f233ce30 2024-09-13T06:10:01.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.003+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94841236390368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5641f2348ee0 con 0x5641f233ce30 2024-09-13T06:10:01.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.003+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5641f2349980 con 0x5641f23417d0 2024-09-13T06:10:01.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.007+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94841236390368] v33'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4db00083f0 con 0x5641f233ce30 2024-09-13T06:10:01.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.007+0000 7f4dbf779640 1 -- 172.21.15.194:0/478524096 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v33'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4db80d1070 con 0x5641f23417d0 2024-09-13T06:10:01.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.007+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94841236395088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5641f2348ee0 con 0x5641f23417d0 2024-09-13T06:10:01.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.007+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5641f234a390 con 0x7f4db80ca020 2024-09-13T06:10:01.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.007+0000 7f4dbef78640 1 -- 172.21.15.194:0/478524096 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(50 notify.3 [create] v33'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4da800e620 con 0x7f4db80ca020 2024-09-13T06:10:01.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.007+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94841236397792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5641f234abe0 con 0x7f4db80ca020 2024-09-13T06:10:01.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.007+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5641f234b5a0 con 0x5641f233ce30 2024-09-13T06:10:01.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.007+0000 7f4dbf779640 1 -- 172.21.15.194:0/478524096 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94841236395088] v33'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4db80d1070 con 0x5641f23417d0 2024-09-13T06:10:01.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.007+0000 7f4dbef78640 1 -- 172.21.15.194:0/478524096 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94841236397792] v33'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4da800e620 con 0x7f4db80ca020 2024-09-13T06:10:01.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.011+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v33'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4db00083f0 con 0x5641f233ce30 2024-09-13T06:10:01.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.011+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94841236399920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5641f234b5a0 con 0x5641f233ce30 2024-09-13T06:10:01.020 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.011+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5641f234ab50 con 0x7f4da8037040 2024-09-13T06:10:01.021 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.011+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(54 notify.5 [create] v33'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4db00083f0 con 0x7f4da8037040 2024-09-13T06:10:01.021 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.011+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94841236400976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5641f234bd80 con 0x7f4da8037040 2024-09-13T06:10:01.021 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.011+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5641f234c8a0 con 0x7f4da8037040 2024-09-13T06:10:01.021 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.011+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94841236399920] v33'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4db00083f0 con 0x5641f233ce30 2024-09-13T06:10:01.021 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.015+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(56 notify.6 [create] v33'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4db00083f0 con 0x7f4da8037040 2024-09-13T06:10:01.021 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.015+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94841236407152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5641f234c860 con 0x7f4da8037040 2024-09-13T06:10:01.021 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.015+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5641f234d2a0 con 0x7f4da8037040 2024-09-13T06:10:01.021 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.015+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94841236400976] v33'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4db00083f0 con 0x7f4da8037040 2024-09-13T06:10:01.021 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.015+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(58 notify.7 [create] v33'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4db00083f0 con 0x7f4da8037040 2024-09-13T06:10:01.021 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.015+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94841236409712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5641f234d260 con 0x7f4da8037040 2024-09-13T06:10:01.021 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.015+0000 7f4dc1c69980 20 add_watcher() i=0 2024-09-13T06:10:01.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.015+0000 7f4dc1c69980 20 add_watcher() i=1 2024-09-13T06:10:01.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.015+0000 7f4dc1c69980 20 add_watcher() i=2 2024-09-13T06:10:01.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.015+0000 7f4dc1c69980 20 add_watcher() i=3 2024-09-13T06:10:01.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.015+0000 7f4dc1c69980 20 add_watcher() i=4 2024-09-13T06:10:01.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.015+0000 7f4dc1c69980 20 add_watcher() i=5 2024-09-13T06:10:01.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.015+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94841236407152] v33'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4db00083f0 con 0x7f4da8037040 2024-09-13T06:10:01.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.015+0000 7f4dc1c69980 20 add_watcher() i=6 2024-09-13T06:10:01.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.019+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94841236409712] v33'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4db00083f0 con 0x7f4da8037040 2024-09-13T06:10:01.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.019+0000 7f4dc1c69980 20 add_watcher() i=7 2024-09-13T06:10:01.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.019+0000 7f4dc1c69980 2 all 8 watchers are set, enabling cache 2024-09-13T06:10:01.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.019+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5641f234b0f0 con 0x5641f233ce30 2024-09-13T06:10:01.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.019+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4db00083f0 con 0x5641f233ce30 2024-09-13T06:10:01.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.019+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94841236402416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5641f234d6c0 con 0x5641f233ce30 2024-09-13T06:10:01.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.019+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94841236402416] v33'134 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4db00083f0 con 0x5641f233ce30 2024-09-13T06:10:01.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.019+0000 7f4c75fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:10:01.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.019+0000 7f4dc1c69980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:10:01.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.019+0000 7f4dc1c69980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:10:01.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.019+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5641f2358af0 con 0x5641f233ce30 2024-09-13T06:10:01.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.023+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4db00083f0 con 0x5641f233ce30 2024-09-13T06:10:01.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.023+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5641f2359140 con 0x7f4da8037040 2024-09-13T06:10:01.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.023+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'16 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4db00083f0 con 0x7f4da8037040 2024-09-13T06:10:01.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.023+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5641f23595a0 con 0x5641f23417d0 2024-09-13T06:10:01.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.023+0000 7f4dbf779640 1 -- 172.21.15.194:0/478524096 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4db80d1070 con 0x5641f23417d0 2024-09-13T06:10:01.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.023+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5641f23594c0 con 0x5641f233ce30 2024-09-13T06:10:01.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.027+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'135 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4db00083f0 con 0x5641f233ce30 2024-09-13T06:10:01.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.027+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5641f23598e0 con 0x7f4db80ca020 2024-09-13T06:10:01.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.027+0000 7f4dbef78640 1 -- 172.21.15.194:0/478524096 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'38 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4da800e620 con 0x7f4db80ca020 2024-09-13T06:10:01.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.027+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5641f2359e50 con 0x5641f23417d0 2024-09-13T06:10:01.028 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.027+0000 7f4dbf779640 1 -- 172.21.15.194:0/478524096 <== osd.3 v2:172.21.15.194:6816/96632515 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'26 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4db80d1070 con 0x5641f23417d0 2024-09-13T06:10:01.028 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.027+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5641f2359e50 con 0x5641f233ce30 2024-09-13T06:10:01.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.031+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4db00083f0 con 0x5641f233ce30 2024-09-13T06:10:01.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.031+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5641f235a300 con 0x7f4da8037040 2024-09-13T06:10:01.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.031+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'25 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4db00083f0 con 0x7f4da8037040 2024-09-13T06:10:01.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.031+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5641f235a300 con 0x7f4db80ca020 2024-09-13T06:10:01.034 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.035+0000 7f4dbef78640 1 -- 172.21.15.194:0/478524096 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4da800e620 con 0x7f4db80ca020 2024-09-13T06:10:01.034 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.035+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5641f235a870 con 0x5641f23417d0 2024-09-13T06:10:01.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.035+0000 7f4dbf779640 1 -- 172.21.15.194:0/478524096 <== osd.3 v2:172.21.15.194:6816/96632515 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4db80d1070 con 0x5641f23417d0 2024-09-13T06:10:01.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.035+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5641f235a870 con 0x7f4db80ca020 2024-09-13T06:10:01.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.035+0000 7f4dbef78640 1 -- 172.21.15.194:0/478524096 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'39 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4da800e620 con 0x7f4db80ca020 2024-09-13T06:10:01.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.035+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5641f235ad20 con 0x7f4da8037040 2024-09-13T06:10:01.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.039+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4db00083f0 con 0x7f4da8037040 2024-09-13T06:10:01.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.039+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5641f235ad20 con 0x7f4db80ca020 2024-09-13T06:10:01.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.039+0000 7f4dbef78640 1 -- 172.21.15.194:0/478524096 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4da800e620 con 0x7f4db80ca020 2024-09-13T06:10:01.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.039+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5641f235ad20 con 0x7f4da8037040 2024-09-13T06:10:01.041 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.039+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 <== osd.0 v2:172.21.15.120:6800/1923744619 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'31 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4db00083f0 con 0x7f4da8037040 2024-09-13T06:10:01.041 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.039+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5641f235ad20 con 0x5641f233ce30 2024-09-13T06:10:01.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.043+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'136 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4db00083f0 con 0x5641f233ce30 2024-09-13T06:10:01.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.043+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5641f235ad20 con 0x5641f23417d0 2024-09-13T06:10:01.044 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.043+0000 7f4dbf779640 1 -- 172.21.15.194:0/478524096 <== osd.3 v2:172.21.15.194:6816/96632515 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'32 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4db80d1070 con 0x5641f23417d0 2024-09-13T06:10:01.044 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.043+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5641f235ad20 con 0x7f4db80ca020 2024-09-13T06:10:01.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.043+0000 7f4dbef78640 1 -- 172.21.15.194:0/478524096 <== osd.2 v2:172.21.15.194:6800/815615585 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'40 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4da800e620 con 0x7f4db80ca020 2024-09-13T06:10:01.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.043+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5641f235ad20 con 0x5641f23417d0 2024-09-13T06:10:01.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.047+0000 7f4dbf779640 1 -- 172.21.15.194:0/478524096 <== osd.3 v2:172.21.15.194:6816/96632515 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4db80d1070 con 0x5641f23417d0 2024-09-13T06:10:01.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.047+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5641f235ad20 con 0x5641f233ce30 2024-09-13T06:10:01.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.047+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 <== osd.1 v2:172.21.15.194:6808/3135444559 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'24 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4db00083f0 con 0x5641f233ce30 2024-09-13T06:10:01.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.047+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5641f235ad20 con 0x5641f233ce30 2024-09-13T06:10:01.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.047+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 <== osd.1 v2:172.21.15.194:6808/3135444559 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'137 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4db00083f0 con 0x5641f233ce30 2024-09-13T06:10:01.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.047+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5641f235ad20 con 0x5641f23417d0 2024-09-13T06:10:01.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.051+0000 7f4dbf779640 1 -- 172.21.15.194:0/478524096 <== osd.3 v2:172.21.15.194:6816/96632515 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'33 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4db80d1070 con 0x5641f23417d0 2024-09-13T06:10:01.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.051+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5641f235ad20 con 0x7f4db80ca020 2024-09-13T06:10:01.052 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.051+0000 7f4dbef78640 1 -- 172.21.15.194:0/478524096 <== osd.2 v2:172.21.15.194:6800/815615585 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'26 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4da800e620 con 0x7f4db80ca020 2024-09-13T06:10:01.052 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.051+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5641f235ad20 con 0x5641f23417d0 2024-09-13T06:10:01.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.051+0000 7f4dbf779640 1 -- 172.21.15.194:0/478524096 <== osd.3 v2:172.21.15.194:6816/96632515 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4db80d1070 con 0x5641f23417d0 2024-09-13T06:10:01.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.051+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5641f235ade0 con 0x5641f23417d0 2024-09-13T06:10:01.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.055+0000 7f4dbf779640 1 -- 172.21.15.194:0/478524096 <== osd.3 v2:172.21.15.194:6816/96632515 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4db80d1070 con 0x5641f23417d0 2024-09-13T06:10:01.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.055+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5641f235a870 con 0x5641f23417d0 2024-09-13T06:10:01.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.055+0000 7f4dbf779640 1 -- 172.21.15.194:0/478524096 <== osd.3 v2:172.21.15.194:6816/96632515 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4db80d1070 con 0x5641f23417d0 2024-09-13T06:10:01.057 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.055+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5641f235a870 con 0x5641f23417d0 2024-09-13T06:10:01.057 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.055+0000 7f4dbf779640 1 -- 172.21.15.194:0/478524096 <== osd.3 v2:172.21.15.194:6816/96632515 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'27 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4db80d1070 con 0x5641f23417d0 2024-09-13T06:10:01.058 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.055+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5641f235a870 con 0x7f4da8037040 2024-09-13T06:10:01.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.059+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 <== osd.0 v2:172.21.15.120:6800/1923744619 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4db00083f0 con 0x7f4da8037040 2024-09-13T06:10:01.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.059+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5641f235a870 con 0x5641f23417d0 2024-09-13T06:10:01.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.059+0000 7f4dbf779640 1 -- 172.21.15.194:0/478524096 <== osd.3 v2:172.21.15.194:6816/96632515 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4db80d1070 con 0x5641f23417d0 2024-09-13T06:10:01.061 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.059+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5641f235a870 con 0x7f4da8037040 2024-09-13T06:10:01.063 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.063+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 <== osd.0 v2:172.21.15.120:6800/1923744619 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'26 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4db00083f0 con 0x7f4da8037040 2024-09-13T06:10:01.063 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.063+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5641f235a870 con 0x5641f23417d0 2024-09-13T06:10:01.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.063+0000 7f4dbf779640 1 -- 172.21.15.194:0/478524096 <== osd.3 v2:172.21.15.194:6816/96632515 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'34 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4db80d1070 con 0x5641f23417d0 2024-09-13T06:10:01.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.063+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5641f235a870 con 0x7f4da8037040 2024-09-13T06:10:01.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.067+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 <== osd.0 v2:172.21.15.120:6800/1923744619 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'32 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4db00083f0 con 0x7f4da8037040 2024-09-13T06:10:01.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.067+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5641f235a870 con 0x7f4db80ca020 2024-09-13T06:10:01.069 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.067+0000 7f4dbef78640 1 -- 172.21.15.194:0/478524096 <== osd.2 v2:172.21.15.194:6800/815615585 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4da800e620 con 0x7f4db80ca020 2024-09-13T06:10:01.070 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.067+0000 7f4c74fe1640 20 reqs_thread_entry: start 2024-09-13T06:10:01.070 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.067+0000 7f4dc1c69980 20 init_complete bucket index max shards: 11 2024-09-13T06:10:01.070 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.067+0000 7f4dc1c69980 20 Filter name: none 2024-09-13T06:10:01.070 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.067+0000 7f4bee7fc640 20 reqs_thread_entry: start 2024-09-13T06:10:01.070 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.067+0000 7f4dc1c69980 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-13T06:10:01.070 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.067+0000 7f4dc1c69980 20 rados->read ofs=0 len=0 2024-09-13T06:10:01.070 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.067+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:94 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5641f2376520 con 0x7f4da8037040 2024-09-13T06:10:01.071 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.071+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 <== osd.0 v2:172.21.15.120:6800/1923744619 24 ==== osd_op_reply(94 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7f4db00083f0 con 0x7f4da8037040 2024-09-13T06:10:01.071 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.071+0000 7f4dc1c69980 20 rados_obj.operate() r=0 bl.length=419 2024-09-13T06:10:01.071 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.071+0000 7f4dc1c69980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-09-13T06:10:01.071 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.071+0000 7f4dc1c69980 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-13T06:10:01.071 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.071+0000 7f4dc1c69980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:10:01.071 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.071+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:95 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5641f23789f0 con 0x5641f233ce30 2024-09-13T06:10:01.072 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.071+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 <== osd.1 v2:172.21.15.194:6808/3135444559 27 ==== osd_op_reply(95 testx$tenanteduser.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 170+0+15 (crc 0 0 0) 0x7f4db00083f0 con 0x5641f233ce30 2024-09-13T06:10:01.073 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.071+0000 7f4dc1c69980 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-13T06:10:01.073 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.071+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5641f23769d0 con 0x7f4da8037040 2024-09-13T06:10:01.075 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.071+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 <== osd.0 v2:172.21.15.120:6800/1923744619 25 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v33'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f4db00083f0 con 0x7f4da8037040 2024-09-13T06:10:01.075 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.071+0000 7f4dc1c69980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-13T06:10:01.075 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.071+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94841236583728 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5641f2378f10 con 0x5641f23417d0 2024-09-13T06:10:01.075 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.075+0000 7f4dbf779640 1 -- 172.21.15.194:0/478524096 <== osd.3 v2:172.21.15.194:6816/96632515 27 ==== watch-notify(notify (1) cookie 94841236395088 notify 141733920779 ret 0) ==== 212+0+0 (crc 0 0 0) 0x5641f2359e50 con 0x5641f23417d0 2024-09-13T06:10:01.075 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.075+0000 7f4ca2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920779 cookie 94841236395088 notifier 4563 bl.length()=170 2024-09-13T06:10:01.076 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.075+0000 7f4dbf779640 1 -- 172.21.15.194:0/478524096 <== osd.3 v2:172.21.15.194:6816/96632515 28 ==== osd_op_reply(97 notify.2 [notify cookie 94841236583728 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4db80d1070 con 0x5641f23417d0 2024-09-13T06:10:01.076 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.075+0000 7f4ca2ffd640 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f4c84003d70 con 0x5641f23417d0 2024-09-13T06:10:01.076 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.075+0000 7f4dbf779640 1 -- 172.21.15.194:0/478524096 <== osd.3 v2:172.21.15.194:6816/96632515 29 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4db80d1070 con 0x5641f23417d0 2024-09-13T06:10:01.076 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.075+0000 7f4dbf779640 1 -- 172.21.15.194:0/478524096 <== osd.3 v2:172.21.15.194:6816/96632515 30 ==== watch-notify(notify_complete (2) cookie 94841236583728 notify 141733920779 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5641f231c930 con 0x5641f23417d0 2024-09-13T06:10:01.076 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.075+0000 7f4dc1c69980 10 removing email index: 2024-09-13T06:10:01.076 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.075+0000 7f4dc1c69980 10 removing user buckets index 2024-09-13T06:10:01.076 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.075+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:99 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5641f2378e90 con 0x5641f233ce30 2024-09-13T06:10:01.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.075+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 <== osd.1 v2:172.21.15.194:6808/3135444559 28 ==== osd_op_reply(99 testx$tenanteduser.buckets [delete] v33'3 uv3 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f4db00083f0 con 0x5641f233ce30 2024-09-13T06:10:01.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.075+0000 7f4dc1c69980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser.buckets, ofs0, ns] 2024-09-13T06:10:01.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.075+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [notify cookie 94841236579616 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5641f2378e90 con 0x5641f233ce30 2024-09-13T06:10:01.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.075+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 <== osd.1 v2:172.21.15.194:6808/3135444559 29 ==== watch-notify(notify (1) cookie 94841236399920 notify 141733920781 ret 0) ==== 217+0+0 (crc 0 0 0) 0x5641f235a020 con 0x5641f233ce30 2024-09-13T06:10:01.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.075+0000 7f4ca27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920781 cookie 94841236399920 notifier 4563 bl.length()=175 2024-09-13T06:10:01.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.075+0000 7f4ca27fc640 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f4bf40032d0 con 0x5641f233ce30 2024-09-13T06:10:01.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.075+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 <== osd.1 v2:172.21.15.194:6808/3135444559 30 ==== osd_op_reply(100 notify.4 [notify cookie 94841236579616 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4db00083f0 con 0x5641f233ce30 2024-09-13T06:10:01.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.075+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 <== osd.1 v2:172.21.15.194:6808/3135444559 31 ==== watch-notify(notify_complete (2) cookie 94841236579616 notify 141733920781 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5641f2358cc0 con 0x5641f233ce30 2024-09-13T06:10:01.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.075+0000 7f4dc1c69980 10 removing user index: testx$tenanteduser 2024-09-13T06:10:01.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.075+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 <== osd.1 v2:172.21.15.194:6808/3135444559 32 ==== osd_op_reply(101 notify.4 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4db00083f0 con 0x5641f233ce30 2024-09-13T06:10:01.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.075+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:102 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5641f2378a20 con 0x7f4da8037040 2024-09-13T06:10:01.079 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.079+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 <== osd.0 v2:172.21.15.120:6800/1923744619 26 ==== osd_op_reply(102 testx$tenanteduser [call,call,delete] v33'8 uv8 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7f4db00083f0 con 0x7f4da8037040 2024-09-13T06:10:01.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.079+0000 7f4dc1c69980 10 removing default.rgw.meta+users.uid+testx$tenanteduser from cache 2024-09-13T06:10:01.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.079+0000 7f4dc1c69980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-09-13T06:10:01.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.079+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:103 7.e 7:7759931f:::notify.3:head [notify cookie 94841236579616 in=179b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5641f2377ec0 con 0x7f4db80ca020 2024-09-13T06:10:01.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.079+0000 7f4dbef78640 1 -- 172.21.15.194:0/478524096 <== osd.2 v2:172.21.15.194:6800/815615585 19 ==== watch-notify(notify (1) cookie 94841236397792 notify 141733920781 ret 0) ==== 209+0+0 (crc 0 0 0) 0x5641f235a310 con 0x7f4db80ca020 2024-09-13T06:10:01.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.079+0000 7f4ca2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920781 cookie 94841236397792 notifier 4563 bl.length()=167 2024-09-13T06:10:01.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.079+0000 7f4ca2ffd640 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f4c84003d70 con 0x7f4db80ca020 2024-09-13T06:10:01.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.079+0000 7f4dbef78640 1 -- 172.21.15.194:0/478524096 <== osd.2 v2:172.21.15.194:6800/815615585 20 ==== osd_op_reply(103 notify.3 [notify cookie 94841236579616 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4da800e620 con 0x7f4db80ca020 2024-09-13T06:10:01.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.079+0000 7f4dbef78640 1 -- 172.21.15.194:0/478524096 <== osd.2 v2:172.21.15.194:6800/815615585 21 ==== osd_op_reply(104 notify.3 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4da800e620 con 0x7f4db80ca020 2024-09-13T06:10:01.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.079+0000 7f4dbef78640 1 -- 172.21.15.194:0/478524096 <== osd.2 v2:172.21.15.194:6800/815615585 22 ==== watch-notify(notify_complete (2) cookie 94841236579616 notify 141733920781 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5641f23598e0 con 0x7f4db80ca020 2024-09-13T06:10:01.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.079+0000 7f4c75fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:10:01.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.079+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94841236402416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5641f2355a60 con 0x5641f233ce30 2024-09-13T06:10:01.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.083+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 <== osd.1 v2:172.21.15.194:6808/3135444559 33 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94841236402416] v33'138 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4db00083f0 con 0x5641f233ce30 2024-09-13T06:10:01.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.083+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94841236386064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5641f234b0f0 con 0x7f4db80ca020 2024-09-13T06:10:01.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.083+0000 7f4dbef78640 1 -- 172.21.15.194:0/478524096 <== osd.2 v2:172.21.15.194:6800/815615585 23 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94841236386064] v33'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4da800e620 con 0x7f4db80ca020 2024-09-13T06:10:01.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.083+0000 7f4dc1c69980 20 remove_watcher() i=0 2024-09-13T06:10:01.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.083+0000 7f4dc1c69980 2 removed watcher, disabling cache 2024-09-13T06:10:01.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.083+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94841236390368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5641f2347110 con 0x5641f233ce30 2024-09-13T06:10:01.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.083+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 <== osd.1 v2:172.21.15.194:6808/3135444559 34 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94841236390368] v33'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4db00083f0 con 0x5641f233ce30 2024-09-13T06:10:01.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.083+0000 7f4dc1c69980 20 remove_watcher() i=1 2024-09-13T06:10:01.086 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.083+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94841236395088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5641f2347110 con 0x5641f23417d0 2024-09-13T06:10:01.087 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.087+0000 7f4dbf779640 1 -- 172.21.15.194:0/478524096 <== osd.3 v2:172.21.15.194:6816/96632515 31 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94841236395088] v33'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4db80d1070 con 0x5641f23417d0 2024-09-13T06:10:01.088 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.087+0000 7f4dc1c69980 20 remove_watcher() i=2 2024-09-13T06:10:01.088 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.087+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94841236397792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5641f2347110 con 0x7f4db80ca020 2024-09-13T06:10:01.089 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.087+0000 7f4dbef78640 1 -- 172.21.15.194:0/478524096 <== osd.2 v2:172.21.15.194:6800/815615585 24 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94841236397792] v33'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4da800e620 con 0x7f4db80ca020 2024-09-13T06:10:01.089 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.087+0000 7f4dc1c69980 20 remove_watcher() i=3 2024-09-13T06:10:01.089 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.087+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94841236399920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5641f2347110 con 0x5641f233ce30 2024-09-13T06:10:01.091 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.091+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 <== osd.1 v2:172.21.15.194:6808/3135444559 35 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94841236399920] v33'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4db00083f0 con 0x5641f233ce30 2024-09-13T06:10:01.091 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.091+0000 7f4dc1c69980 20 remove_watcher() i=4 2024-09-13T06:10:01.091 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.091+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94841236400976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5641f234a730 con 0x7f4da8037040 2024-09-13T06:10:01.093 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.091+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 <== osd.0 v2:172.21.15.120:6800/1923744619 27 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94841236400976] v33'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4db00083f0 con 0x7f4da8037040 2024-09-13T06:10:01.093 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.091+0000 7f4dc1c69980 20 remove_watcher() i=5 2024-09-13T06:10:01.093 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.091+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94841236407152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5641f2347110 con 0x7f4da8037040 2024-09-13T06:10:01.095 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.095+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 <== osd.0 v2:172.21.15.120:6800/1923744619 28 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94841236407152] v33'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4db00083f0 con 0x7f4da8037040 2024-09-13T06:10:01.095 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.095+0000 7f4dc1c69980 20 remove_watcher() i=6 2024-09-13T06:10:01.095 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.095+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94841236409712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5641f2347110 con 0x7f4da8037040 2024-09-13T06:10:01.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.095+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 <== osd.0 v2:172.21.15.120:6800/1923744619 29 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94841236409712] v33'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4db00083f0 con 0x7f4da8037040 2024-09-13T06:10:01.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.095+0000 7f4dc1c69980 20 remove_watcher() i=7 2024-09-13T06:10:01.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.095+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f4da8037040 msgr2=0x7f4da8036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.095+0000 7f4dc1c69980 1 --2- 172.21.15.194:0/478524096 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f4da8037040 0x7f4da8036410 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.095+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5641f233ce30 msgr2=0x5641f233f2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.095+0000 7f4dc1c69980 1 --2- 172.21.15.194:0/478524096 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5641f233ce30 0x5641f233f2d0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.095+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f4db80ca020 msgr2=0x7f4db80f7440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.095+0000 7f4dc1c69980 1 --2- 172.21.15.194:0/478524096 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f4db80ca020 0x7f4db80f7440 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.095+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5641f23417d0 msgr2=0x5641f2343bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.095+0000 7f4dc1c69980 1 --2- 172.21.15.194:0/478524096 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5641f23417d0 0x5641f2343bc0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.095+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4c88034650 msgr2=0x7f4c88036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.095+0000 7f4dc1c69980 1 --2- 172.21.15.194:0/478524096 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4c88034650 0x7f4c88036b10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x5641f23060a0 tx=0x7f4da8010000 comp rx=0 tx=0).stop 2024-09-13T06:10:01.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.095+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5641f2181e20 msgr2=0x5641f2331d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.095+0000 7f4dbff7a640 1 -- 172.21.15.194:0/478524096 reap_dead start 2024-09-13T06:10:01.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.095+0000 7f4dc1c69980 1 --2- 172.21.15.194:0/478524096 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5641f2181e20 0x5641f2331d10 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f4db80ca5b0 tx=0x7f4db80d5f90 comp rx=0 tx=0).stop 2024-09-13T06:10:01.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.095+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 shutdown_connections 2024-09-13T06:10:01.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.095+0000 7f4dc1c69980 1 --2- 172.21.15.194:0/478524096 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5641f2181e20 0x5641f2331d10 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.095+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 >> 172.21.15.194:0/478524096 conn(0x5641f2324ce0 msgr2=0x5641f2322db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:01.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.095+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 shutdown_connections 2024-09-13T06:10:01.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.095+0000 7f4dc1c69980 1 -- 172.21.15.194:0/478524096 wait complete. 2024-09-13T06:10:01.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.099+0000 7f4dc1c69980 1 -- 172.21.15.194:0/1941656947 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4c98034650 msgr2=0x7f4c98036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.099+0000 7f4dc1c69980 1 --2- 172.21.15.194:0/1941656947 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4c98034650 0x7f4c98036b10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4da800bf60 tx=0x7f4da800f000 comp rx=0 tx=0).stop 2024-09-13T06:10:01.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.099+0000 7f4dc1c69980 1 -- 172.21.15.194:0/1941656947 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5641f231bfd0 msgr2=0x5641f231c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.099+0000 7f4dc1c69980 1 --2- 172.21.15.194:0/1941656947 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5641f231bfd0 0x5641f231c3f0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f4db80e36f0 tx=0x7f4db80be900 comp rx=0 tx=0).stop 2024-09-13T06:10:01.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.099+0000 7f4dc1c69980 1 -- 172.21.15.194:0/1941656947 shutdown_connections 2024-09-13T06:10:01.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.099+0000 7f4dc1c69980 1 --2- 172.21.15.194:0/1941656947 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4c98034650 0x7f4c98036b10 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.103 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.099+0000 7f4dc1c69980 1 --2- 172.21.15.194:0/1941656947 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5641f231bfd0 0x5641f231c3f0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.103 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.099+0000 7f4dc1c69980 1 -- 172.21.15.194:0/1941656947 >> 172.21.15.194:0/1941656947 conn(0x5641f2311120 msgr2=0x5641f2313ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:01.103 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.099+0000 7f4dc1c69980 1 -- 172.21.15.194:0/1941656947 shutdown_connections 2024-09-13T06:10:01.103 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.099+0000 7f4dc1c69980 1 -- 172.21.15.194:0/1941656947 wait complete. 2024-09-13T06:10:01.103 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.099+0000 7f4dc1c69980 1 -- 172.21.15.194:0/443243251 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5641f2302d50 msgr2=0x5641f2305140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.103 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.099+0000 7f4dc1c69980 1 --2- 172.21.15.194:0/443243251 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5641f2302d50 0x5641f2305140 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.103 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.099+0000 7f4dc1c69980 1 -- 172.21.15.194:0/443243251 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5641f230ba10 msgr2=0x5641f230de00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.103 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.099+0000 7f4dc1c69980 1 --2- 172.21.15.194:0/443243251 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5641f230ba10 0x5641f230de00 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.103 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.099+0000 7f4dc1c69980 1 -- 172.21.15.194:0/443243251 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5641f2307af0 msgr2=0x5641f2309ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.103 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.099+0000 7f4dc1c69980 1 --2- 172.21.15.194:0/443243251 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5641f2307af0 0x5641f2309ee0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.103 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.099+0000 7f4dc1c69980 1 -- 172.21.15.194:0/443243251 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4ca4034650 msgr2=0x7f4ca4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.103 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.099+0000 7f4dc1c69980 1 --2- 172.21.15.194:0/443243251 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4ca4034650 0x7f4ca4036b10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4da8000f70 tx=0x7f4da80012c0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.103 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.099+0000 7f4dc1c69980 1 -- 172.21.15.194:0/443243251 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5641f220bff0 msgr2=0x5641f22fddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.104 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.099+0000 7f4dc1c69980 1 --2- 172.21.15.194:0/443243251 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5641f220bff0 0x5641f22fddd0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f4db801b4b0 tx=0x7f4db8017d70 comp rx=0 tx=0).stop 2024-09-13T06:10:01.104 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.099+0000 7f4dbff7a640 1 -- 172.21.15.194:0/443243251 reap_dead start 2024-09-13T06:10:01.104 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.099+0000 7f4dc1c69980 1 -- 172.21.15.194:0/443243251 shutdown_connections 2024-09-13T06:10:01.104 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.099+0000 7f4dc1c69980 1 -- 172.21.15.194:0/443243251 >> 172.21.15.194:0/443243251 conn(0x5641f22071c0 msgr2=0x5641f22f1330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:01.104 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.099+0000 7f4dc1c69980 1 -- 172.21.15.194:0/443243251 shutdown_connections 2024-09-13T06:10:01.104 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.099+0000 7f4dc1c69980 1 -- 172.21.15.194:0/443243251 wait complete. 2024-09-13T06:10:01.116 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-09-13T06:10:01.119 INFO:tasks.radosgw_admin:RL: get_obj myfoo foo bytes_out=0 bytes_in=4 failed=False 2024-09-13T06:10:01.122 INFO:tasks.radosgw_admin:RL: list_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T06:10:01.122 INFO:tasks.util.rgw:rgwadmin: client.0 : ['object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-09-13T06:10:01.122 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-09-13T06:10:01.122 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph object rm --bucket myfoo --object four 2024-09-13T06:10:01.185 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:10:01.186 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:10:01.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.183+0000 7fe2e591a980 1 Processor -- start 2024-09-13T06:10:01.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.183+0000 7fe2e591a980 1 -- start start 2024-09-13T06:10:01.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.187+0000 7fe2e591a980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x562d31ce4fb0 0x562d31ce3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:01.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.187+0000 7fe2e591a980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562d31bf6ae0 con 0x562d31ce4ba0 2024-09-13T06:10:01.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.187+0000 7fe2e591a980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x562d31c1ae30 con 0x562d31ce4fb0 2024-09-13T06:10:01.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.187+0000 7fe2e2c29640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x562d31ce4fb0 0x562d31ce3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:01.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.187+0000 7fe2e2c29640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x562d31ce4fb0 0x562d31ce3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:46210/0 (socket says 172.21.15.194:46210) 2024-09-13T06:10:01.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.187+0000 7fe2e2c29640 1 -- 172.21.15.194:0/3627010832 learned_addr learned my addr 172.21.15.194:0/3627010832 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:01.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.187+0000 7fe2e342a640 1 --1- 172.21.15.194:0/3627010832 >> v1:172.21.15.120:6789/0 conn(0x562d31ce4ba0 0x562d31ce3360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:51284/0 (socket says 172.21.15.194:51284) 2024-09-13T06:10:01.188 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.187+0000 7fe2e2c29640 1 -- 172.21.15.194:0/3627010832 >> v1:172.21.15.120:6789/0 conn(0x562d31ce4ba0 legacy=0x562d31ce3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.188 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.187+0000 7fe2e2c29640 1 -- 172.21.15.194:0/3627010832 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d31ce40d0 con 0x562d31ce4fb0 2024-09-13T06:10:01.189 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.187+0000 7fe2e2c29640 1 --2- 172.21.15.194:0/3627010832 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562d31ce4fb0 0x562d31ce3a70 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc00a5c0 tx=0x7fe2cc01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ed2d315caf6ae39 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:01.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.187+0000 7fe2e2428640 1 -- 172.21.15.194:0/3627010832 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2cc0a6070 con 0x562d31ce4fb0 2024-09-13T06:10:01.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.187+0000 7fe2e2428640 1 -- 172.21.15.194:0/3627010832 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2cc0af070 con 0x562d31ce4fb0 2024-09-13T06:10:01.191 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.187+0000 7fe2e2428640 1 -- 172.21.15.194:0/3627010832 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2cc0aa5c0 con 0x562d31ce4fb0 2024-09-13T06:10:01.191 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.191+0000 7fe2e591a980 1 -- 172.21.15.194:0/3627010832 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562d31ce4fb0 msgr2=0x562d31ce3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.191 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.191+0000 7fe2e591a980 1 --2- 172.21.15.194:0/3627010832 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562d31ce4fb0 0x562d31ce3a70 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc00a5c0 tx=0x7fe2cc01b340 comp rx=0 tx=0).stop 2024-09-13T06:10:01.191 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.191+0000 7fe2e591a980 1 -- 172.21.15.194:0/3627010832 shutdown_connections 2024-09-13T06:10:01.191 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.191+0000 7fe2e591a980 1 --2- 172.21.15.194:0/3627010832 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562d31ce4fb0 0x562d31ce3a70 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.191 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.191+0000 7fe2e591a980 1 -- 172.21.15.194:0/3627010832 >> 172.21.15.194:0/3627010832 conn(0x562d31d6a180 msgr2=0x562d31d6c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:01.191 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.191+0000 7fe2e591a980 1 -- 172.21.15.194:0/3627010832 shutdown_connections 2024-09-13T06:10:01.191 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.191+0000 7fe2e591a980 1 -- 172.21.15.194:0/3627010832 wait complete. 2024-09-13T06:10:01.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.203+0000 7fe2e591a980 1 Processor -- start 2024-09-13T06:10:01.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.203+0000 7fe2e591a980 1 -- start start 2024-09-13T06:10:01.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.203+0000 7fe2e591a980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562d31ce4ba0 0x562d31e5bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:01.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.203+0000 7fe2e591a980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x562d31c1c200 con 0x562d31ce4ba0 2024-09-13T06:10:01.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.203+0000 7fe2e342a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562d31ce4ba0 0x562d31e5bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:01.205 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.203+0000 7fe2e342a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562d31ce4ba0 0x562d31e5bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:46218/0 (socket says 172.21.15.194:46218) 2024-09-13T06:10:01.205 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.203+0000 7fe2e342a640 1 -- 172.21.15.194:0/2113458276 learned_addr learned my addr 172.21.15.194:0/2113458276 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:01.205 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.203+0000 7fe2e342a640 1 -- 172.21.15.194:0/2113458276 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d31e5c1a0 con 0x562d31ce4ba0 2024-09-13T06:10:01.205 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.203+0000 7fe2e342a640 1 --2- 172.21.15.194:0/2113458276 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562d31ce4ba0 0x562d31e5bbd0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fe2d4001e50 tx=0x7fe2d4001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cda65e1f944682a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:01.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.203+0000 7fe1d160a640 1 -- 172.21.15.194:0/2113458276 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2d400e5d0 con 0x562d31ce4ba0 2024-09-13T06:10:01.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.203+0000 7fe1d160a640 1 -- 172.21.15.194:0/2113458276 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2d400e770 con 0x562d31ce4ba0 2024-09-13T06:10:01.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.203+0000 7fe1d160a640 1 -- 172.21.15.194:0/2113458276 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2d400eab0 con 0x562d31ce4ba0 2024-09-13T06:10:01.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.203+0000 7fe2e591a980 1 -- 172.21.15.194:0/2113458276 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562d31ce4ba0 msgr2=0x562d31e5bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.203+0000 7fe2e591a980 1 --2- 172.21.15.194:0/2113458276 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562d31ce4ba0 0x562d31e5bbd0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fe2d4001e50 tx=0x7fe2d4001e80 comp rx=0 tx=0).stop 2024-09-13T06:10:01.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.203+0000 7fe2e591a980 1 -- 172.21.15.194:0/2113458276 shutdown_connections 2024-09-13T06:10:01.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.203+0000 7fe2e591a980 1 --2- 172.21.15.194:0/2113458276 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562d31ce4ba0 0x562d31e5bbd0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.203+0000 7fe2e591a980 1 -- 172.21.15.194:0/2113458276 >> 172.21.15.194:0/2113458276 conn(0x562d31d6a180 msgr2=0x562d31e57800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:01.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.203+0000 7fe2e591a980 1 -- 172.21.15.194:0/2113458276 shutdown_connections 2024-09-13T06:10:01.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.203+0000 7fe2e591a980 1 -- 172.21.15.194:0/2113458276 wait complete. 2024-09-13T06:10:01.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.207+0000 7fe2e591a980 1 Processor -- start 2024-09-13T06:10:01.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.207+0000 7fe2e591a980 1 -- start start 2024-09-13T06:10:01.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.207+0000 7fe2e591a980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562d31ce4ba0 0x562d31e62f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:01.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.207+0000 7fe2e591a980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x562d31d7a1d0 con 0x562d31ce4ba0 2024-09-13T06:10:01.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.207+0000 7fe2e342a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562d31ce4ba0 0x562d31e62f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:01.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.207+0000 7fe2e342a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562d31ce4ba0 0x562d31e62f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:46222/0 (socket says 172.21.15.194:46222) 2024-09-13T06:10:01.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.207+0000 7fe2e342a640 1 -- 172.21.15.194:0/2777774839 learned_addr learned my addr 172.21.15.194:0/2777774839 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:01.213 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.207+0000 7fe2e342a640 1 -- 172.21.15.194:0/2777774839 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d31e634a0 con 0x562d31ce4ba0 2024-09-13T06:10:01.213 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.207+0000 7fe2e342a640 1 --2- 172.21.15.194:0/2777774839 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562d31ce4ba0 0x562d31e62f60 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x562d31e5cdb0 tx=0x7fe2d4000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:01.213 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.207+0000 7fe1cfe07640 1 -- 172.21.15.194:0/2777774839 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2d4001260 con 0x562d31ce4ba0 2024-09-13T06:10:01.213 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.207+0000 7fe2e591a980 1 -- 172.21.15.194:0/2777774839 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562d31e63730 con 0x562d31ce4ba0 2024-09-13T06:10:01.213 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.207+0000 7fe1cfe07640 1 -- 172.21.15.194:0/2777774839 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2d400fa40 con 0x562d31ce4ba0 2024-09-13T06:10:01.213 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.207+0000 7fe1cfe07640 1 -- 172.21.15.194:0/2777774839 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2d400fd80 con 0x562d31ce4ba0 2024-09-13T06:10:01.213 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.207+0000 7fe2e591a980 1 -- 172.21.15.194:0/2777774839 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d31e66410 con 0x562d31ce4ba0 2024-09-13T06:10:01.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.207+0000 7fe1cfe07640 1 -- 172.21.15.194:0/2777774839 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe2d4017070 con 0x562d31ce4ba0 2024-09-13T06:10:01.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.207+0000 7fe1cfe07640 1 --2- 172.21.15.194:0/2777774839 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fe1c8034650 0x7fe1c8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:01.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.207+0000 7fe1cfe07640 1 -- 172.21.15.194:0/2777774839 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fe2d4015020 con 0x562d31ce4ba0 2024-09-13T06:10:01.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.207+0000 7fe2e2c29640 1 --2- 172.21.15.194:0/2777774839 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fe1c8034650 0x7fe1c8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:01.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.207+0000 7fe2e591a980 1 --2- 172.21.15.194:0/2777774839 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x562d31ce4fb0 0x562d31e69f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:01.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.207+0000 7fe2e591a980 1 -- 172.21.15.194:0/2777774839 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562d31e6a5c0 con 0x562d31ce4fb0 2024-09-13T06:10:01.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.207+0000 7fe2e3c2b640 1 --2- 172.21.15.194:0/2777774839 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x562d31ce4fb0 0x562d31e69f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:01.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.207+0000 7fe2e2c29640 1 --2- 172.21.15.194:0/2777774839 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fe1c8034650 0x7fe1c8036b10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc0ae000 tx=0x7fe2cc0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:01.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.211+0000 7fe2e3c2b640 1 --2- 172.21.15.194:0/2777774839 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x562d31ce4fb0 0x562d31e69f50 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:01.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.211+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/2777774839 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe2dc00a4d0 con 0x562d31ce4fb0 2024-09-13T06:10:01.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.211+0000 7fe2e591a980 1 -- 172.21.15.194:0/2777774839 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562d31e67610 con 0x562d31ce4fb0 2024-09-13T06:10:01.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.211+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/2777774839 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe2dc00a4d0 con 0x562d31ce4fb0 2024-09-13T06:10:01.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.211+0000 7fe2e591a980 1 --2- 172.21.15.194:0/2777774839 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x562d31e6c8f0 0x562d31e6ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:01.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.211+0000 7fe2e591a980 1 -- 172.21.15.194:0/2777774839 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562d31e6f3b0 con 0x562d31e6c8f0 2024-09-13T06:10:01.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.211+0000 7fe2e342a640 1 --2- 172.21.15.194:0/2777774839 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x562d31e6c8f0 0x562d31e6ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:01.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.211+0000 7fe2e342a640 1 --2- 172.21.15.194:0/2777774839 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x562d31e6c8f0 0x562d31e6ece0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:01.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.211+0000 7fe2e342a640 1 -- 172.21.15.194:0/2777774839 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe2d402e070 con 0x562d31e6c8f0 2024-09-13T06:10:01.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.211+0000 7fe2e591a980 1 -- 172.21.15.194:0/2777774839 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562d31e6b790 con 0x562d31ce4fb0 2024-09-13T06:10:01.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.211+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/2777774839 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe2dc00a4d0 con 0x562d31ce4fb0 2024-09-13T06:10:01.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.211+0000 7fe2e591a980 1 --2- 172.21.15.194:0/2777774839 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x562d31e707f0 0x562d31e72be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:01.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.211+0000 7fe2e591a980 1 -- 172.21.15.194:0/2777774839 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562d31e73370 con 0x562d31e707f0 2024-09-13T06:10:01.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.211+0000 7fe2e2c29640 1 --2- 172.21.15.194:0/2777774839 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x562d31e707f0 0x562d31e72be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:01.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.211+0000 7fe2e2c29640 1 --2- 172.21.15.194:0/2777774839 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x562d31e707f0 0x562d31e72be0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:01.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.211+0000 7fe2e2c29640 1 -- 172.21.15.194:0/2777774839 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe2cc0aab30 con 0x562d31e707f0 2024-09-13T06:10:01.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.211+0000 7fe2e591a980 1 Processor -- start 2024-09-13T06:10:01.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.211+0000 7fe2e591a980 1 -- start start 2024-09-13T06:10:01.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.211+0000 7fe2e591a980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562d31e80e00 0x562d31e81220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:01.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.211+0000 7fe2e591a980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x562d31c75800 con 0x562d31e80e00 2024-09-13T06:10:01.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.211+0000 7fe2e342a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562d31e80e00 0x562d31e81220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:01.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.211+0000 7fe2e342a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562d31e80e00 0x562d31e81220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:46226/0 (socket says 172.21.15.194:46226) 2024-09-13T06:10:01.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.211+0000 7fe2e342a640 1 -- 172.21.15.194:0/4120192837 learned_addr learned my addr 172.21.15.194:0/4120192837 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:01.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.211+0000 7fe2e342a640 1 -- 172.21.15.194:0/4120192837 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d31e81760 con 0x562d31e80e00 2024-09-13T06:10:01.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.215+0000 7fe2e342a640 1 --2- 172.21.15.194:0/4120192837 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562d31e80e00 0x562d31e81220 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fe2d4048f40 tx=0x7fe2d4017d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:01.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.215+0000 7fe1cd602640 1 -- 172.21.15.194:0/4120192837 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2d403f020 con 0x562d31e80e00 2024-09-13T06:10:01.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.215+0000 7fe1cd602640 1 -- 172.21.15.194:0/4120192837 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2d4042850 con 0x562d31e80e00 2024-09-13T06:10:01.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.215+0000 7fe2e591a980 1 -- 172.21.15.194:0/4120192837 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562d31e819f0 con 0x562d31e80e00 2024-09-13T06:10:01.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.215+0000 7fe1cd602640 1 -- 172.21.15.194:0/4120192837 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2d4019860 con 0x562d31e80e00 2024-09-13T06:10:01.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.215+0000 7fe2e591a980 1 -- 172.21.15.194:0/4120192837 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d31e819f0 con 0x562d31e80e00 2024-09-13T06:10:01.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.215+0000 7fe1cd602640 1 -- 172.21.15.194:0/4120192837 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe2d403a070 con 0x562d31e80e00 2024-09-13T06:10:01.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.215+0000 7fe1cd602640 1 --2- 172.21.15.194:0/4120192837 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fe1bc0346a0 0x7fe1bc036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:01.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.215+0000 7fe1cd602640 1 -- 172.21.15.194:0/4120192837 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fe2d404fa60 con 0x562d31e80e00 2024-09-13T06:10:01.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.215+0000 7fe2e2c29640 1 --2- 172.21.15.194:0/4120192837 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fe1bc0346a0 0x7fe1bc036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:01.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.215+0000 7fe2e591a980 1 Processor -- start 2024-09-13T06:10:01.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.215+0000 7fe2e591a980 1 -- start start 2024-09-13T06:10:01.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.215+0000 7fe2e2c29640 1 --2- 172.21.15.194:0/4120192837 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fe1bc0346a0 0x7fe1bc036b60 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc01b380 tx=0x7fe2cc005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:01.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.215+0000 7fe2e591a980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562d31e8d4e0 0x562d31e8d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:01.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.215+0000 7fe2e591a980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x562d31e5c520 con 0x562d31e8d4e0 2024-09-13T06:10:01.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.215+0000 7fe2e342a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562d31e8d4e0 0x562d31e8d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:01.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.215+0000 7fe2e342a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562d31e8d4e0 0x562d31e8d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:46234/0 (socket says 172.21.15.194:46234) 2024-09-13T06:10:01.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.215+0000 7fe2e342a640 1 -- 172.21.15.194:0/1824549879 learned_addr learned my addr 172.21.15.194:0/1824549879 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:01.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.215+0000 7fe2e342a640 1 -- 172.21.15.194:0/1824549879 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d31e8deb0 con 0x562d31e8d4e0 2024-09-13T06:10:01.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.215+0000 7fe2e342a640 1 --2- 172.21.15.194:0/1824549879 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562d31e8d4e0 0x562d31e8d8e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe2d40178c0 tx=0x7fe2d404a1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9c800578c00b224 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:01.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.219+0000 7fe1c6ffd640 1 -- 172.21.15.194:0/1824549879 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2d405e020 con 0x562d31e8d4e0 2024-09-13T06:10:01.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.219+0000 7fe1c6ffd640 1 -- 172.21.15.194:0/1824549879 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2d40317b0 con 0x562d31e8d4e0 2024-09-13T06:10:01.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.219+0000 7fe1c6ffd640 1 -- 172.21.15.194:0/1824549879 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2d404fec0 con 0x562d31e8d4e0 2024-09-13T06:10:01.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.219+0000 7fe2e591a980 1 -- 172.21.15.194:0/1824549879 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562d31e8d4e0 msgr2=0x562d31e8d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.219+0000 7fe2e591a980 1 --2- 172.21.15.194:0/1824549879 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562d31e8d4e0 0x562d31e8d8e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe2d40178c0 tx=0x7fe2d404a1b0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.219+0000 7fe2e591a980 1 -- 172.21.15.194:0/1824549879 shutdown_connections 2024-09-13T06:10:01.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.219+0000 7fe2e591a980 1 --2- 172.21.15.194:0/1824549879 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562d31e8d4e0 0x562d31e8d8e0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.219+0000 7fe2e591a980 1 -- 172.21.15.194:0/1824549879 >> 172.21.15.194:0/1824549879 conn(0x562d31e89950 msgr2=0x562d31e87a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:01.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.219+0000 7fe2e591a980 1 -- 172.21.15.194:0/1824549879 shutdown_connections 2024-09-13T06:10:01.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.219+0000 7fe2e591a980 1 -- 172.21.15.194:0/1824549879 wait complete. 2024-09-13T06:10:01.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.219+0000 7fe2e591a980 1 Processor -- start 2024-09-13T06:10:01.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.219+0000 7fe2e591a980 1 -- start start 2024-09-13T06:10:01.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.219+0000 7fe2e591a980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562d31e8d4e0 0x562d31e947d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:01.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.219+0000 7fe2e591a980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x562d31e8e3c0 con 0x562d31e8d4e0 2024-09-13T06:10:01.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.219+0000 7fe2e342a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562d31e8d4e0 0x562d31e947d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:01.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.219+0000 7fe2e342a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562d31e8d4e0 0x562d31e947d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:46238/0 (socket says 172.21.15.194:46238) 2024-09-13T06:10:01.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.219+0000 7fe2e342a640 1 -- 172.21.15.194:0/1870555640 learned_addr learned my addr 172.21.15.194:0/1870555640 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:01.231 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.219+0000 7fe2e342a640 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d31e94d10 con 0x562d31e8d4e0 2024-09-13T06:10:01.231 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.219+0000 7fe2e342a640 1 --2- 172.21.15.194:0/1870555640 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562d31e8d4e0 0x562d31e947d0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fe2d40483b0 tx=0x7fe2d4048340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:01.231 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.219+0000 7fe1c57fa640 1 -- 172.21.15.194:0/1870555640 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2d4023240 con 0x562d31e8d4e0 2024-09-13T06:10:01.231 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.219+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562d31e94d10 con 0x562d31e8d4e0 2024-09-13T06:10:01.231 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.219+0000 7fe1c57fa640 1 -- 172.21.15.194:0/1870555640 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2d40233e0 con 0x562d31e8d4e0 2024-09-13T06:10:01.231 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.219+0000 7fe1c57fa640 1 -- 172.21.15.194:0/1870555640 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2d403b790 con 0x562d31e8d4e0 2024-09-13T06:10:01.232 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.219+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d31e95180 con 0x562d31e8d4e0 2024-09-13T06:10:01.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.219+0000 7fe1c57fa640 1 -- 172.21.15.194:0/1870555640 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe2d4061020 con 0x562d31e8d4e0 2024-09-13T06:10:01.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.219+0000 7fe2e591a980 20 rados->read ofs=0 len=0 2024-09-13T06:10:01.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.219+0000 7fe1c57fa640 1 --2- 172.21.15.194:0/1870555640 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fe1ac034650 0x7fe1ac036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:01.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.223+0000 7fe1c57fa640 1 -- 172.21.15.194:0/1870555640 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fe2d4070ca0 con 0x562d31e8d4e0 2024-09-13T06:10:01.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.223+0000 7fe2e2c29640 1 --2- 172.21.15.194:0/1870555640 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fe1ac034650 0x7fe1ac036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:01.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.223+0000 7fe2e591a980 1 --2- 172.21.15.194:0/1870555640 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x562d31e9f860 0x562d31ea1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:01.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.223+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562d31ea2450 con 0x562d31e9f860 2024-09-13T06:10:01.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.223+0000 7fe2e3c2b640 1 --2- 172.21.15.194:0/1870555640 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x562d31e9f860 0x562d31ea1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:01.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.223+0000 7fe2e2c29640 1 --2- 172.21.15.194:0/1870555640 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fe1ac034650 0x7fe1ac036b10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc0aafd0 tx=0x7fe2cc0c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:01.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.223+0000 7fe2e3c2b640 1 --2- 172.21.15.194:0/1870555640 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x562d31e9f860 0x562d31ea1d00 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:01.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.223+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe2dc00a4d0 con 0x562d31e9f860 2024-09-13T06:10:01.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.223+0000 7fe2e591a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:01.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.223+0000 7fe2e591a980 20 realm 2024-09-13T06:10:01.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.223+0000 7fe2e591a980 20 rados->read ofs=0 len=0 2024-09-13T06:10:01.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.223+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562d31ea2860 con 0x562d31e9f860 2024-09-13T06:10:01.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.223+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe2dc00a4d0 con 0x562d31e9f860 2024-09-13T06:10:01.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.223+0000 7fe2e591a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:01.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.223+0000 7fe2e591a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:10:01.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.223+0000 7fe2e591a980 20 rados->read ofs=0 len=0 2024-09-13T06:10:01.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.223+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562d31ea3100 con 0x562d31e9f860 2024-09-13T06:10:01.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.223+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe2dc00a4d0 con 0x562d31e9f860 2024-09-13T06:10:01.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.223+0000 7fe2e591a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:01.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.223+0000 7fe2e591a980 20 rados->read ofs=0 len=0 2024-09-13T06:10:01.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.223+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562d31ea34a0 con 0x562d31e9f860 2024-09-13T06:10:01.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.223+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe2dc00a4d0 con 0x562d31e9f860 2024-09-13T06:10:01.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.223+0000 7fe2e591a980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:10:01.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.223+0000 7fe2e591a980 20 rados->read ofs=0 len=0 2024-09-13T06:10:01.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.223+0000 7fe2e591a980 1 --2- 172.21.15.194:0/1870555640 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x562d31ea4200 0x562d31ea65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:01.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.223+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562d31ea6c40 con 0x562d31ea4200 2024-09-13T06:10:01.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.223+0000 7fe2e342a640 1 --2- 172.21.15.194:0/1870555640 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x562d31ea4200 0x562d31ea65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:01.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.223+0000 7fe2e342a640 1 --2- 172.21.15.194:0/1870555640 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x562d31ea4200 0x562d31ea65f0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:01.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.223+0000 7fe2e342a640 1 -- 172.21.15.194:0/1870555640 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe2d4041020 con 0x562d31ea4200 2024-09-13T06:10:01.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.223+0000 7fe2e591a980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:10:01.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.223+0000 7fe2e591a980 20 searching for the correct realm 2024-09-13T06:10:01.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.223+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562d31ea84a0 con 0x562d31ea4200 2024-09-13T06:10:01.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.223+0000 7fe2e342a640 1 -- 172.21.15.194:0/1870555640 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2d4041020 con 0x562d31ea4200 2024-09-13T06:10:01.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.223+0000 7fe2e342a640 1 --2- 172.21.15.194:0/1870555640 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fe2d4063050 0x7fe2d40748b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:01.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.223+0000 7fe2e342a640 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562d31ea84a0 con 0x7fe2d4063050 2024-09-13T06:10:01.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.223+0000 7fe2e2c29640 1 --2- 172.21.15.194:0/1870555640 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fe2d4063050 0x7fe2d40748b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:01.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.223+0000 7fe2e2c29640 1 --2- 172.21.15.194:0/1870555640 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fe2d4063050 0x7fe2d40748b0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:01.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.223+0000 7fe2e2c29640 1 -- 172.21.15.194:0/1870555640 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe2cc0aab30 con 0x7fe2d4063050 2024-09-13T06:10:01.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.223+0000 7fe2e2c29640 1 --2- 172.21.15.194:0/1870555640 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fe2cc0e0040 0x7fe2cc0e0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:01.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.223+0000 7fe2e2c29640 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562d31ea84a0 con 0x7fe2cc0e0040 2024-09-13T06:10:01.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.223+0000 7fe2e3c2b640 1 --2- 172.21.15.194:0/1870555640 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fe2cc0e0040 0x7fe2cc0e0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:01.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.227+0000 7fe2e3c2b640 1 --2- 172.21.15.194:0/1870555640 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fe2cc0e0040 0x7fe2cc0e0930 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:01.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.227+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2dc00a4d0 con 0x7fe2cc0e0040 2024-09-13T06:10:01.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.227+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562d31ea34a0 con 0x562d31e9f860 2024-09-13T06:10:01.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.227+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2dc00a4d0 con 0x562d31e9f860 2024-09-13T06:10:01.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.227+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562d31ea34a0 con 0x562d31e9f860 2024-09-13T06:10:01.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.227+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2dc00a4d0 con 0x562d31e9f860 2024-09-13T06:10:01.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.227+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562d31ea34a0 con 0x7fe2cc0e0040 2024-09-13T06:10:01.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.227+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2dc00a4d0 con 0x7fe2cc0e0040 2024-09-13T06:10:01.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.227+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562d31ea34a0 con 0x7fe2cc0e0040 2024-09-13T06:10:01.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.227+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2dc00a4d0 con 0x7fe2cc0e0040 2024-09-13T06:10:01.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.227+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562d31ea34a0 con 0x7fe2d4063050 2024-09-13T06:10:01.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.227+0000 7fe2e2c29640 1 -- 172.21.15.194:0/1870555640 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2cc0aab30 con 0x7fe2d4063050 2024-09-13T06:10:01.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.227+0000 7fe2e2c29640 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562d31ea34a0 con 0x562d31ea4200 2024-09-13T06:10:01.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.227+0000 7fe2e342a640 1 -- 172.21.15.194:0/1870555640 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2d4041020 con 0x562d31ea4200 2024-09-13T06:10:01.272 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.227+0000 7fe2e342a640 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562d31ea34a0 con 0x562d31e9f860 2024-09-13T06:10:01.272 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.227+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2dc00a4d0 con 0x562d31e9f860 2024-09-13T06:10:01.272 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.227+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562d31ea34a0 con 0x7fe2cc0e0040 2024-09-13T06:10:01.272 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.231+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2dc00a4d0 con 0x7fe2cc0e0040 2024-09-13T06:10:01.272 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.231+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562d31ea34a0 con 0x562d31e9f860 2024-09-13T06:10:01.272 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.231+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2dc00a4d0 con 0x562d31e9f860 2024-09-13T06:10:01.272 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.231+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562d31ea34a0 con 0x7fe2d4063050 2024-09-13T06:10:01.272 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.231+0000 7fe2e2c29640 1 -- 172.21.15.194:0/1870555640 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe2cc0aab30 con 0x7fe2d4063050 2024-09-13T06:10:01.272 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.231+0000 7fe2e2c29640 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562d31ea34a0 con 0x562d31ea4200 2024-09-13T06:10:01.272 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.231+0000 7fe2e342a640 1 -- 172.21.15.194:0/1870555640 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2d4041020 con 0x562d31ea4200 2024-09-13T06:10:01.272 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.231+0000 7fe2e342a640 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562d31ea34a0 con 0x562d31ea4200 2024-09-13T06:10:01.273 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.231+0000 7fe2e342a640 1 -- 172.21.15.194:0/1870555640 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2d4041020 con 0x562d31ea4200 2024-09-13T06:10:01.273 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.231+0000 7fe2e342a640 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562d31ea34a0 con 0x7fe2cc0e0040 2024-09-13T06:10:01.273 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.231+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2dc00a4d0 con 0x7fe2cc0e0040 2024-09-13T06:10:01.273 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.231+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562d31ea34a0 con 0x562d31ea4200 2024-09-13T06:10:01.273 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.231+0000 7fe2e342a640 1 -- 172.21.15.194:0/1870555640 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2d4041020 con 0x562d31ea4200 2024-09-13T06:10:01.273 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.231+0000 7fe2e342a640 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562d31ea34a0 con 0x562d31ea4200 2024-09-13T06:10:01.273 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.231+0000 7fe2e342a640 1 -- 172.21.15.194:0/1870555640 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2d4041020 con 0x562d31ea4200 2024-09-13T06:10:01.273 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.231+0000 7fe2e342a640 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562d31ea34a0 con 0x562d31e9f860 2024-09-13T06:10:01.273 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.231+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2dc00a4d0 con 0x562d31e9f860 2024-09-13T06:10:01.273 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.231+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562d31ea34a0 con 0x562d31e9f860 2024-09-13T06:10:01.273 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.231+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe2dc00a4d0 con 0x562d31e9f860 2024-09-13T06:10:01.273 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.231+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562d31ea34a0 con 0x7fe2cc0e0040 2024-09-13T06:10:01.273 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.231+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2dc00a4d0 con 0x7fe2cc0e0040 2024-09-13T06:10:01.274 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.231+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562d31ea34a0 con 0x562d31ea4200 2024-09-13T06:10:01.274 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.231+0000 7fe2e342a640 1 -- 172.21.15.194:0/1870555640 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2d4041020 con 0x562d31ea4200 2024-09-13T06:10:01.274 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.231+0000 7fe2e342a640 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562d31ea34a0 con 0x7fe2d4063050 2024-09-13T06:10:01.274 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.235+0000 7fe2e2c29640 1 -- 172.21.15.194:0/1870555640 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2cc0aab30 con 0x7fe2d4063050 2024-09-13T06:10:01.274 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.235+0000 7fe2e2c29640 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562d31ea34a0 con 0x562d31e9f860 2024-09-13T06:10:01.274 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.235+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2dc00a4d0 con 0x562d31e9f860 2024-09-13T06:10:01.274 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.235+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562d31ea34a0 con 0x7fe2cc0e0040 2024-09-13T06:10:01.274 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.235+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2dc00a4d0 con 0x7fe2cc0e0040 2024-09-13T06:10:01.274 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.235+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562d31ea34a0 con 0x562d31ea4200 2024-09-13T06:10:01.274 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.235+0000 7fe2e342a640 1 -- 172.21.15.194:0/1870555640 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe2d4041020 con 0x562d31ea4200 2024-09-13T06:10:01.274 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.235+0000 7fe2e342a640 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562d31ea34a0 con 0x7fe2cc0e0040 2024-09-13T06:10:01.274 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.235+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2dc00a4d0 con 0x7fe2cc0e0040 2024-09-13T06:10:01.274 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.235+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562d31ea34a0 con 0x7fe2d4063050 2024-09-13T06:10:01.275 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.235+0000 7fe2e2c29640 1 -- 172.21.15.194:0/1870555640 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2cc0aab30 con 0x7fe2d4063050 2024-09-13T06:10:01.275 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.235+0000 7fe2e2c29640 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562d31ea34a0 con 0x562d31ea4200 2024-09-13T06:10:01.275 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.235+0000 7fe2e342a640 1 -- 172.21.15.194:0/1870555640 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2d4041020 con 0x562d31ea4200 2024-09-13T06:10:01.275 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.235+0000 7fe2e342a640 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562d31ea34a0 con 0x7fe2cc0e0040 2024-09-13T06:10:01.275 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.235+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2dc00a4d0 con 0x7fe2cc0e0040 2024-09-13T06:10:01.275 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.235+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562d31ea34a0 con 0x562d31e9f860 2024-09-13T06:10:01.275 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.235+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe2dc00a4d0 con 0x562d31e9f860 2024-09-13T06:10:01.275 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.235+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x562d31ea34a0 con 0x7fe2d4063050 2024-09-13T06:10:01.275 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.235+0000 7fe2e2c29640 1 -- 172.21.15.194:0/1870555640 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2cc0aab30 con 0x7fe2d4063050 2024-09-13T06:10:01.275 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.235+0000 7fe2e591a980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:10:01.275 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.235+0000 7fe2e591a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:10:01.275 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.235+0000 7fe2e591a980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:10:01.276 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.235+0000 7fe2e591a980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:10:01.276 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.235+0000 7fe2e591a980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:10:01.276 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.235+0000 7fe2e591a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:10:01.276 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.235+0000 7fe2e591a980 20 rados->read ofs=0 len=0 2024-09-13T06:10:01.276 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.235+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562d31ea75c0 con 0x562d31e9f860 2024-09-13T06:10:01.276 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.239+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe2dc00a4d0 con 0x562d31e9f860 2024-09-13T06:10:01.276 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.239+0000 7fe2e591a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:01.276 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.239+0000 7fe2e591a980 20 rados->read ofs=0 len=0 2024-09-13T06:10:01.276 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.239+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562d31ea7e10 con 0x562d31e9f860 2024-09-13T06:10:01.276 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.239+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe2dc00a4d0 con 0x562d31e9f860 2024-09-13T06:10:01.276 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.239+0000 7fe2e591a980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:10:01.276 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.239+0000 7fe2e591a980 20 rados->read ofs=0 len=0 2024-09-13T06:10:01.277 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.239+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562d31ea7220 con 0x7fe2d4063050 2024-09-13T06:10:01.277 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.239+0000 7fe2e2c29640 1 -- 172.21.15.194:0/1870555640 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe2cc0aab30 con 0x7fe2d4063050 2024-09-13T06:10:01.277 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.239+0000 7fe2e591a980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:10:01.277 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.239+0000 7fe2e591a980 20 zone default found 2024-09-13T06:10:01.277 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.239+0000 7fe2e591a980 4 Realm: () 2024-09-13T06:10:01.277 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.239+0000 7fe2e591a980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:10:01.277 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.239+0000 7fe2e591a980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:10:01.277 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.239+0000 7fe2e591a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:10:01.277 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.239+0000 7fe2e591a980 20 zonegroup default 2024-09-13T06:10:01.277 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.239+0000 7fe2e591a980 20 rados->read ofs=0 len=0 2024-09-13T06:10:01.277 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.239+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562d31ea88d0 con 0x7fe2cc0e0040 2024-09-13T06:10:01.277 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.239+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe2dc00a4d0 con 0x7fe2cc0e0040 2024-09-13T06:10:01.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.239+0000 7fe2e591a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:01.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.239+0000 7fe2e591a980 20 rados->read ofs=0 len=0 2024-09-13T06:10:01.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.239+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562d31eaa2e0 con 0x562d31ea4200 2024-09-13T06:10:01.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.239+0000 7fe2e342a640 1 -- 172.21.15.194:0/1870555640 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe2d4041020 con 0x562d31ea4200 2024-09-13T06:10:01.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.239+0000 7fe2e591a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:01.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.239+0000 7fe2e591a980 20 rados->read ofs=0 len=0 2024-09-13T06:10:01.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.239+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562d31eaa750 con 0x562d31ea4200 2024-09-13T06:10:01.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.239+0000 7fe2e342a640 1 -- 172.21.15.194:0/1870555640 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe2d4041020 con 0x562d31ea4200 2024-09-13T06:10:01.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.239+0000 7fe2e591a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:01.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.239+0000 7fe2e591a980 20 started sync module instance, tier type = 2024-09-13T06:10:01.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.239+0000 7fe2e591a980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:10:01.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.239+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562d31ea9750 con 0x7fe2d4063050 2024-09-13T06:10:01.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.239+0000 7fe2e2c29640 1 -- 172.21.15.194:0/1870555640 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(44 notify.0 [create] v33'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2cc0aab30 con 0x7fe2d4063050 2024-09-13T06:10:01.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.239+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94752110975808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562d31ea93b0 con 0x7fe2d4063050 2024-09-13T06:10:01.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.239+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562d31eab680 con 0x562d31e9f860 2024-09-13T06:10:01.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.239+0000 7fe2e2c29640 1 -- 172.21.15.194:0/1870555640 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94752110975808] v33'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2cc0aab30 con 0x7fe2d4063050 2024-09-13T06:10:01.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.243+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v33'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2dc00a4d0 con 0x562d31e9f860 2024-09-13T06:10:01.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.243+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94752110981584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562d31eabaa0 con 0x562d31e9f860 2024-09-13T06:10:01.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.243+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562d31eac370 con 0x562d31ea4200 2024-09-13T06:10:01.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.243+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94752110981584] v33'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2dc00a4d0 con 0x562d31e9f860 2024-09-13T06:10:01.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.243+0000 7fe2e342a640 1 -- 172.21.15.194:0/1870555640 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v33'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2d4041020 con 0x562d31ea4200 2024-09-13T06:10:01.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.243+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94752110982912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562d31eac760 con 0x562d31ea4200 2024-09-13T06:10:01.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.243+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562d31ead120 con 0x7fe2d4063050 2024-09-13T06:10:01.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.247+0000 7fe2e2c29640 1 -- 172.21.15.194:0/1870555640 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(50 notify.3 [create] v33'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2cc0aab30 con 0x7fe2d4063050 2024-09-13T06:10:01.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.247+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94752110990528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562d31eadd90 con 0x7fe2d4063050 2024-09-13T06:10:01.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.247+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562d31eae750 con 0x562d31e9f860 2024-09-13T06:10:01.280 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.247+0000 7fe2e342a640 1 -- 172.21.15.194:0/1870555640 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94752110982912] v33'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2d4041020 con 0x562d31ea4200 2024-09-13T06:10:01.280 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.247+0000 7fe2e2c29640 1 -- 172.21.15.194:0/1870555640 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94752110990528] v33'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2cc0aab30 con 0x7fe2d4063050 2024-09-13T06:10:01.280 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.247+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v33'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2dc00a4d0 con 0x562d31e9f860 2024-09-13T06:10:01.280 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.247+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94752110994080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562d31eadd90 con 0x562d31e9f860 2024-09-13T06:10:01.280 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.247+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562d31eae6c0 con 0x7fe2cc0e0040 2024-09-13T06:10:01.280 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.251+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94752110994080] v33'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2dc00a4d0 con 0x562d31e9f860 2024-09-13T06:10:01.280 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.251+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(54 notify.5 [create] v33'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2dc00a4d0 con 0x7fe2cc0e0040 2024-09-13T06:10:01.280 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.251+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94752110991584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562d31eadd00 con 0x7fe2cc0e0040 2024-09-13T06:10:01.280 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.251+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562d31eaf580 con 0x7fe2cc0e0040 2024-09-13T06:10:01.280 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.251+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(56 notify.6 [create] v33'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2dc00a4d0 con 0x7fe2cc0e0040 2024-09-13T06:10:01.280 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.251+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94752110991584] v33'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2dc00a4d0 con 0x7fe2cc0e0040 2024-09-13T06:10:01.280 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.251+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94752110997712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562d31eaf9a0 con 0x7fe2cc0e0040 2024-09-13T06:10:01.281 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.251+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562d31eaeaf0 con 0x7fe2cc0e0040 2024-09-13T06:10:01.281 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.255+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94752110997712] v33'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2dc00a4d0 con 0x7fe2cc0e0040 2024-09-13T06:10:01.281 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.255+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(58 notify.7 [create] v33'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2dc00a4d0 con 0x7fe2cc0e0040 2024-09-13T06:10:01.281 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.255+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94752110998768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562d31eaf910 con 0x7fe2cc0e0040 2024-09-13T06:10:01.281 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.255+0000 7fe2e591a980 20 add_watcher() i=0 2024-09-13T06:10:01.281 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.255+0000 7fe2e591a980 20 add_watcher() i=1 2024-09-13T06:10:01.281 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.255+0000 7fe2e591a980 20 add_watcher() i=2 2024-09-13T06:10:01.281 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.255+0000 7fe2e591a980 20 add_watcher() i=3 2024-09-13T06:10:01.281 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.255+0000 7fe2e591a980 20 add_watcher() i=4 2024-09-13T06:10:01.281 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.255+0000 7fe2e591a980 20 add_watcher() i=5 2024-09-13T06:10:01.281 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.255+0000 7fe2e591a980 20 add_watcher() i=6 2024-09-13T06:10:01.281 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.255+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94752110998768] v33'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2dc00a4d0 con 0x7fe2cc0e0040 2024-09-13T06:10:01.281 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.255+0000 7fe2e591a980 20 add_watcher() i=7 2024-09-13T06:10:01.282 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.255+0000 7fe2e591a980 2 all 8 watchers are set, enabling cache 2024-09-13T06:10:01.282 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.255+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562d31eb3440 con 0x562d31e9f860 2024-09-13T06:10:01.282 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.255+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe2dc00a4d0 con 0x562d31e9f860 2024-09-13T06:10:01.282 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.255+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94752111001440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562d31eb08a0 con 0x562d31e9f860 2024-09-13T06:10:01.282 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.259+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94752111001440] v33'139 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe2dc00a4d0 con 0x562d31e9f860 2024-09-13T06:10:01.282 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.259+0000 7fe199fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:10:01.282 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.259+0000 7fe2e591a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:10:01.282 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.259+0000 7fe2e591a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:10:01.282 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.259+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562d31ebbcc0 con 0x562d31e9f860 2024-09-13T06:10:01.282 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.259+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe2dc00a4d0 con 0x562d31e9f860 2024-09-13T06:10:01.282 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.259+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562d31ebc310 con 0x7fe2cc0e0040 2024-09-13T06:10:01.282 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.263+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'17 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe2dc00a4d0 con 0x7fe2cc0e0040 2024-09-13T06:10:01.282 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.263+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562d31ebc770 con 0x562d31ea4200 2024-09-13T06:10:01.283 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.263+0000 7fe2e342a640 1 -- 172.21.15.194:0/1870555640 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe2d4041020 con 0x562d31ea4200 2024-09-13T06:10:01.283 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.263+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562d31ebcb10 con 0x562d31e9f860 2024-09-13T06:10:01.285 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.263+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'140 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe2dc00a4d0 con 0x562d31e9f860 2024-09-13T06:10:01.286 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.263+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562d31ebcfc0 con 0x7fe2d4063050 2024-09-13T06:10:01.286 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.267+0000 7fe2e2c29640 1 -- 172.21.15.194:0/1870555640 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'41 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe2cc0aab30 con 0x7fe2d4063050 2024-09-13T06:10:01.286 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.267+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562d31ebad70 con 0x562d31ea4200 2024-09-13T06:10:01.286 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.267+0000 7fe2e342a640 1 -- 172.21.15.194:0/1870555640 <== osd.3 v2:172.21.15.194:6816/96632515 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'28 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe2d4041020 con 0x562d31ea4200 2024-09-13T06:10:01.286 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.267+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562d31ebad70 con 0x562d31e9f860 2024-09-13T06:10:01.286 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.267+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe2dc00a4d0 con 0x562d31e9f860 2024-09-13T06:10:01.286 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.267+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562d31ebad70 con 0x7fe2cc0e0040 2024-09-13T06:10:01.286 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.271+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'27 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe2dc00a4d0 con 0x7fe2cc0e0040 2024-09-13T06:10:01.286 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.271+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562d31ebad70 con 0x7fe2d4063050 2024-09-13T06:10:01.286 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.271+0000 7fe2e2c29640 1 -- 172.21.15.194:0/1870555640 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe2cc0aab30 con 0x7fe2d4063050 2024-09-13T06:10:01.286 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.271+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562d31ebdb20 con 0x562d31ea4200 2024-09-13T06:10:01.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.275+0000 7fe2e342a640 1 -- 172.21.15.194:0/1870555640 <== osd.3 v2:172.21.15.194:6816/96632515 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'23 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe2d4041020 con 0x562d31ea4200 2024-09-13T06:10:01.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.275+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562d31ebdb20 con 0x7fe2d4063050 2024-09-13T06:10:01.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.275+0000 7fe2e2c29640 1 -- 172.21.15.194:0/1870555640 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'42 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2cc0aab30 con 0x7fe2d4063050 2024-09-13T06:10:01.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.275+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562d31ebe090 con 0x7fe2cc0e0040 2024-09-13T06:10:01.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.275+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2dc00a4d0 con 0x7fe2cc0e0040 2024-09-13T06:10:01.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.275+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562d31ebe090 con 0x7fe2d4063050 2024-09-13T06:10:01.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.279+0000 7fe2e2c29640 1 -- 172.21.15.194:0/1870555640 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2cc0aab30 con 0x7fe2d4063050 2024-09-13T06:10:01.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.279+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562d31ebe310 con 0x7fe2cc0e0040 2024-09-13T06:10:01.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.279+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 <== osd.0 v2:172.21.15.120:6800/1923744619 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'33 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2dc00a4d0 con 0x7fe2cc0e0040 2024-09-13T06:10:01.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.279+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562d31ebe310 con 0x562d31e9f860 2024-09-13T06:10:01.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.283+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'141 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2dc00a4d0 con 0x562d31e9f860 2024-09-13T06:10:01.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.283+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562d31ebe280 con 0x562d31ea4200 2024-09-13T06:10:01.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.283+0000 7fe2e342a640 1 -- 172.21.15.194:0/1870555640 <== osd.3 v2:172.21.15.194:6816/96632515 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'35 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2d4041020 con 0x562d31ea4200 2024-09-13T06:10:01.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.283+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562d31ebe280 con 0x7fe2d4063050 2024-09-13T06:10:01.288 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.283+0000 7fe2e2c29640 1 -- 172.21.15.194:0/1870555640 <== osd.2 v2:172.21.15.194:6800/815615585 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'43 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2cc0aab30 con 0x7fe2d4063050 2024-09-13T06:10:01.288 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.283+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562d31ebe280 con 0x562d31ea4200 2024-09-13T06:10:01.288 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.287+0000 7fe2e342a640 1 -- 172.21.15.194:0/1870555640 <== osd.3 v2:172.21.15.194:6816/96632515 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2d4041020 con 0x562d31ea4200 2024-09-13T06:10:01.288 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.287+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562d31ebe280 con 0x562d31e9f860 2024-09-13T06:10:01.289 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.287+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 <== osd.1 v2:172.21.15.194:6808/3135444559 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'25 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2dc00a4d0 con 0x562d31e9f860 2024-09-13T06:10:01.289 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.287+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562d31ebe280 con 0x562d31e9f860 2024-09-13T06:10:01.290 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.287+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 <== osd.1 v2:172.21.15.194:6808/3135444559 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'142 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2dc00a4d0 con 0x562d31e9f860 2024-09-13T06:10:01.290 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.287+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562d31ebe280 con 0x562d31ea4200 2024-09-13T06:10:01.292 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.291+0000 7fe2e342a640 1 -- 172.21.15.194:0/1870555640 <== osd.3 v2:172.21.15.194:6816/96632515 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'36 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2d4041020 con 0x562d31ea4200 2024-09-13T06:10:01.292 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.291+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562d31ebe280 con 0x7fe2d4063050 2024-09-13T06:10:01.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.291+0000 7fe2e2c29640 1 -- 172.21.15.194:0/1870555640 <== osd.2 v2:172.21.15.194:6800/815615585 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'27 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2cc0aab30 con 0x7fe2d4063050 2024-09-13T06:10:01.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.291+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562d31ebe310 con 0x562d31ea4200 2024-09-13T06:10:01.294 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.291+0000 7fe2e342a640 1 -- 172.21.15.194:0/1870555640 <== osd.3 v2:172.21.15.194:6816/96632515 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2d4041020 con 0x562d31ea4200 2024-09-13T06:10:01.294 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.291+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562d31ebe310 con 0x562d31ea4200 2024-09-13T06:10:01.295 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.295+0000 7fe2e342a640 1 -- 172.21.15.194:0/1870555640 <== osd.3 v2:172.21.15.194:6816/96632515 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2d4041020 con 0x562d31ea4200 2024-09-13T06:10:01.295 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.295+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562d31ebe310 con 0x562d31ea4200 2024-09-13T06:10:01.296 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.295+0000 7fe2e342a640 1 -- 172.21.15.194:0/1870555640 <== osd.3 v2:172.21.15.194:6816/96632515 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2d4041020 con 0x562d31ea4200 2024-09-13T06:10:01.296 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.295+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562d31ebe310 con 0x562d31ea4200 2024-09-13T06:10:01.298 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.295+0000 7fe2e342a640 1 -- 172.21.15.194:0/1870555640 <== osd.3 v2:172.21.15.194:6816/96632515 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'29 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2d4041020 con 0x562d31ea4200 2024-09-13T06:10:01.298 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.295+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562d31ebe310 con 0x7fe2cc0e0040 2024-09-13T06:10:01.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.299+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 <== osd.0 v2:172.21.15.120:6800/1923744619 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2dc00a4d0 con 0x7fe2cc0e0040 2024-09-13T06:10:01.300 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.299+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562d31ebe310 con 0x562d31ea4200 2024-09-13T06:10:01.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.299+0000 7fe2e342a640 1 -- 172.21.15.194:0/1870555640 <== osd.3 v2:172.21.15.194:6816/96632515 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2d4041020 con 0x562d31ea4200 2024-09-13T06:10:01.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.299+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562d31ebe310 con 0x7fe2cc0e0040 2024-09-13T06:10:01.303 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.303+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 <== osd.0 v2:172.21.15.120:6800/1923744619 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'28 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2dc00a4d0 con 0x7fe2cc0e0040 2024-09-13T06:10:01.303 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.303+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562d31ebe310 con 0x562d31ea4200 2024-09-13T06:10:01.305 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.303+0000 7fe2e342a640 1 -- 172.21.15.194:0/1870555640 <== osd.3 v2:172.21.15.194:6816/96632515 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'37 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2d4041020 con 0x562d31ea4200 2024-09-13T06:10:01.305 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.303+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562d31ebe310 con 0x7fe2cc0e0040 2024-09-13T06:10:01.307 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.307+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 <== osd.0 v2:172.21.15.120:6800/1923744619 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'34 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2dc00a4d0 con 0x7fe2cc0e0040 2024-09-13T06:10:01.307 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.307+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562d31ebe310 con 0x7fe2d4063050 2024-09-13T06:10:01.308 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.307+0000 7fe2e2c29640 1 -- 172.21.15.194:0/1870555640 <== osd.2 v2:172.21.15.194:6800/815615585 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2cc0aab30 con 0x7fe2d4063050 2024-09-13T06:10:01.311 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.307+0000 7fe198fe1640 20 reqs_thread_entry: start 2024-09-13T06:10:01.311 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.307+0000 7fe2e591a980 20 init_complete bucket index max shards: 11 2024-09-13T06:10:01.311 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.307+0000 7fe2e591a980 20 Filter name: none 2024-09-13T06:10:01.311 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.307+0000 7fe1127fc640 20 reqs_thread_entry: start 2024-09-13T06:10:01.311 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.307+0000 7fe2e591a980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T06:10:01.311 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.307+0000 7fe2e591a980 20 rados->read ofs=0 len=0 2024-09-13T06:10:01.311 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.307+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562d31ed99b0 con 0x7fe2d4063050 2024-09-13T06:10:01.311 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.307+0000 7fe2e2c29640 1 -- 172.21.15.194:0/1870555640 <== osd.2 v2:172.21.15.194:6800/815615585 19 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fe2cc0aab30 con 0x7fe2d4063050 2024-09-13T06:10:01.311 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.307+0000 7fe2e591a980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T06:10:01.311 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.307+0000 7fe2e591a980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T06:10:01.311 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.307+0000 7fe2e591a980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T06:10:01.312 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.307+0000 7fe2e591a980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 : miss 2024-09-13T06:10:01.312 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.307+0000 7fe2e591a980 20 rados->read ofs=0 len=0 2024-09-13T06:10:01.312 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.307+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:95 8.18 8:1a66c368:root::.bucket.meta.myfoo%3a52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562d31edb1c0 con 0x562d31e9f860 2024-09-13T06:10:01.312 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.307+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 <== osd.1 v2:172.21.15.194:6808/3135444559 27 ==== osd_op_reply(95 .bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv16 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fe2dc00a4d0 con 0x562d31e9f860 2024-09-13T06:10:01.312 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.307+0000 7fe2e591a980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T06:10:01.312 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.307+0000 7fe2e591a980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 info.flags=0x17 2024-09-13T06:10:01.312 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.307+0000 7fe2e591a980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 to cache LRU end 2024-09-13T06:10:01.312 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.307+0000 7fe2e591a980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:10:01.312 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.307+0000 7fe2e591a980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T06:10:01.312 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.307+0000 7fe2e591a980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 2024-09-13T06:10:01.312 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.307+0000 7fe2e591a980 20 get_obj_state: octx=0x7fe2cc0c89b0 obj=myfoo:four state=0x562d31edbf58 s->prefetch_data=0 2024-09-13T06:10:01.312 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.307+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:96 3.13s0 3:ca1c9b9b:::52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1_four:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x562d31edd030 con 0x562d31ea4200 2024-09-13T06:10:01.312 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.311+0000 7fe2e342a640 1 -- 172.21.15.194:0/1870555640 <== osd.3 v2:172.21.15.194:6816/96632515 27 ==== osd_op_reply(96 52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1_four [getxattrs out=851b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 234+0+867 (crc 0 0 0) 0x7fe2d4041020 con 0x562d31ea4200 2024-09-13T06:10:01.312 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.311+0000 7fe2e591a980 10 manifest: total_size = 4 2024-09-13T06:10:01.313 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.311+0000 7fe2e591a980 20 get_obj_state: setting s->obj_tag to 52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.15974532575512904911 2024-09-13T06:10:01.313 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.311+0000 7fe2e591a980 20 get_obj_state: octx=0x7fe2cc0c89b0 obj=myfoo:four state=0x562d31edbf58 s->prefetch_data=0 2024-09-13T06:10:01.313 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.311+0000 7fe2e591a980 20 prepare_atomic_modification: state is not atomic. state=0x562d31edbf58 2024-09-13T06:10:01.313 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.311+0000 7fe2e591a980 20 bucket index object: :.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.6 2024-09-13T06:10:01.313 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.311+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:97 4.3 4:c1107af5:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=182b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562d31ee19f0 con 0x562d31e9f860 2024-09-13T06:10:01.313 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.311+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 <== osd.1 v2:172.21.15.194:6808/3135444559 28 ==== osd_op_reply(97 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.6 [stat,call,call] v33'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fe2dc00a4d0 con 0x562d31e9f860 2024-09-13T06:10:01.313 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.311+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:98 3.13s0 3:ca1c9b9b:::52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1_four:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562d31ee19f0 con 0x562d31ea4200 2024-09-13T06:10:01.314 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.311+0000 7fe2e342a640 1 -- 172.21.15.194:0/1870555640 <== osd.3 v2:172.21.15.194:6816/96632515 28 ==== osd_op_reply(98 52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1_four [call] v33'4 uv4 ondisk = 0) ==== 192+0+0 (crc 0 0 0) 0x7fe2d4041020 con 0x562d31ea4200 2024-09-13T06:10:01.314 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.311+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:99 4.3 4:c1107af5:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=259b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562d31ee2480 con 0x562d31e9f860 2024-09-13T06:10:01.316 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.315+0000 7fe199fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:10:01.316 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.315+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 <== osd.1 v2:172.21.15.194:6808/3135444559 29 ==== osd_op_reply(99 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.6 [stat,call,call] v33'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fe2dc00a4d0 con 0x562d31e9f860 2024-09-13T06:10:01.316 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.315+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94752111001440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562d31ee1fd0 con 0x562d31e9f860 2024-09-13T06:10:01.316 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.315+0000 7fe1c6ffd640 20 handle_completion(): completion ok for obj=four 2024-09-13T06:10:01.317 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.315+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 <== osd.1 v2:172.21.15.194:6808/3135444559 30 ==== osd_op_reply(100 data_loggenerations_metadata [watch unwatch cookie 94752111001440] v33'143 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe2dc00a4d0 con 0x562d31e9f860 2024-09-13T06:10:01.317 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.315+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94752110975808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562d31eaff60 con 0x7fe2d4063050 2024-09-13T06:10:01.318 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.315+0000 7fe2e2c29640 1 -- 172.21.15.194:0/1870555640 <== osd.2 v2:172.21.15.194:6800/815615585 20 ==== osd_op_reply(101 notify.0 [watch unwatch cookie 94752110975808] v33'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2cc0aab30 con 0x7fe2d4063050 2024-09-13T06:10:01.318 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.315+0000 7fe2e591a980 20 remove_watcher() i=0 2024-09-13T06:10:01.318 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.315+0000 7fe2e591a980 2 removed watcher, disabling cache 2024-09-13T06:10:01.318 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.315+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:102 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94752110981584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562d31eaff60 con 0x562d31e9f860 2024-09-13T06:10:01.320 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.319+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 <== osd.1 v2:172.21.15.194:6808/3135444559 31 ==== osd_op_reply(102 notify.1 [watch unwatch cookie 94752110981584] v33'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2dc00a4d0 con 0x562d31e9f860 2024-09-13T06:10:01.320 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.319+0000 7fe2e591a980 20 remove_watcher() i=1 2024-09-13T06:10:01.320 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.319+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:103 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94752110982912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562d31eab1d0 con 0x562d31ea4200 2024-09-13T06:10:01.322 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.319+0000 7fe2e342a640 1 -- 172.21.15.194:0/1870555640 <== osd.3 v2:172.21.15.194:6816/96632515 29 ==== osd_op_reply(103 notify.2 [watch unwatch cookie 94752110982912] v33'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2d4041020 con 0x562d31ea4200 2024-09-13T06:10:01.322 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.319+0000 7fe2e591a980 20 remove_watcher() i=2 2024-09-13T06:10:01.322 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.319+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94752110990528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562d31eaff60 con 0x7fe2d4063050 2024-09-13T06:10:01.323 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.323+0000 7fe2e2c29640 1 -- 172.21.15.194:0/1870555640 <== osd.2 v2:172.21.15.194:6800/815615585 21 ==== osd_op_reply(104 notify.3 [watch unwatch cookie 94752110990528] v33'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2cc0aab30 con 0x7fe2d4063050 2024-09-13T06:10:01.323 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.323+0000 7fe2e591a980 20 remove_watcher() i=3 2024-09-13T06:10:01.323 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.323+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:105 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94752110994080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562d31eab700 con 0x562d31e9f860 2024-09-13T06:10:01.325 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.323+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 <== osd.1 v2:172.21.15.194:6808/3135444559 32 ==== osd_op_reply(105 notify.4 [watch unwatch cookie 94752110994080] v33'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2dc00a4d0 con 0x562d31e9f860 2024-09-13T06:10:01.325 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.323+0000 7fe2e591a980 20 remove_watcher() i=4 2024-09-13T06:10:01.325 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.323+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:106 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94752110991584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562d31eab1d0 con 0x7fe2cc0e0040 2024-09-13T06:10:01.327 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.327+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 <== osd.0 v2:172.21.15.120:6800/1923744619 24 ==== osd_op_reply(106 notify.5 [watch unwatch cookie 94752110991584] v33'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2dc00a4d0 con 0x7fe2cc0e0040 2024-09-13T06:10:01.327 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.327+0000 7fe2e591a980 20 remove_watcher() i=5 2024-09-13T06:10:01.327 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.327+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:107 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94752110997712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562d31eaff60 con 0x7fe2cc0e0040 2024-09-13T06:10:01.329 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.327+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 <== osd.0 v2:172.21.15.120:6800/1923744619 25 ==== osd_op_reply(107 notify.6 [watch unwatch cookie 94752110997712] v33'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2dc00a4d0 con 0x7fe2cc0e0040 2024-09-13T06:10:01.329 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.327+0000 7fe2e591a980 20 remove_watcher() i=6 2024-09-13T06:10:01.329 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.327+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:108 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94752110998768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x562d31eae2a0 con 0x7fe2cc0e0040 2024-09-13T06:10:01.333 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.331+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 <== osd.0 v2:172.21.15.120:6800/1923744619 26 ==== osd_op_reply(108 notify.7 [watch unwatch cookie 94752110998768] v33'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2dc00a4d0 con 0x7fe2cc0e0040 2024-09-13T06:10:01.333 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.331+0000 7fe2e591a980 20 remove_watcher() i=7 2024-09-13T06:10:01.333 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.331+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fe2cc0e0040 msgr2=0x7fe2cc0e0930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.333 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.331+0000 7fe2e591a980 1 --2- 172.21.15.194:0/1870555640 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fe2cc0e0040 0x7fe2cc0e0930 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.331+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x562d31e9f860 msgr2=0x562d31ea1d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.331+0000 7fe2e591a980 1 --2- 172.21.15.194:0/1870555640 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x562d31e9f860 0x562d31ea1d00 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.331+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fe2d4063050 msgr2=0x7fe2d40748b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.331+0000 7fe2e591a980 1 --2- 172.21.15.194:0/1870555640 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fe2d4063050 0x7fe2d40748b0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.331+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x562d31ea4200 msgr2=0x562d31ea65f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.331+0000 7fe2e591a980 1 --2- 172.21.15.194:0/1870555640 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x562d31ea4200 0x562d31ea65f0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.331+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fe1ac034650 msgr2=0x7fe1ac036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.331+0000 7fe2e591a980 1 --2- 172.21.15.194:0/1870555640 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fe1ac034650 0x7fe1ac036b10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc0aafd0 tx=0x7fe2cc0c1040 comp rx=0 tx=0).stop 2024-09-13T06:10:01.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.331+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562d31e8d4e0 msgr2=0x562d31e947d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.331+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/1870555640 reap_dead start 2024-09-13T06:10:01.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.331+0000 7fe2e591a980 1 --2- 172.21.15.194:0/1870555640 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562d31e8d4e0 0x562d31e947d0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fe2d40483b0 tx=0x7fe2d4048340 comp rx=0 tx=0).stop 2024-09-13T06:10:01.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.331+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 shutdown_connections 2024-09-13T06:10:01.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.331+0000 7fe2e591a980 1 --2- 172.21.15.194:0/1870555640 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562d31e8d4e0 0x562d31e947d0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.331+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 >> 172.21.15.194:0/1870555640 conn(0x562d31e89950 msgr2=0x562d31e87a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:01.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.331+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 shutdown_connections 2024-09-13T06:10:01.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.331+0000 7fe2e591a980 1 -- 172.21.15.194:0/1870555640 wait complete. 2024-09-13T06:10:01.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.331+0000 7fe2e591a980 1 -- 172.21.15.194:0/4120192837 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fe1bc0346a0 msgr2=0x7fe1bc036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.331+0000 7fe2e591a980 1 --2- 172.21.15.194:0/4120192837 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fe1bc0346a0 0x7fe1bc036b60 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc01b380 tx=0x7fe2cc005ad0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.331+0000 7fe2e591a980 1 -- 172.21.15.194:0/4120192837 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562d31e80e00 msgr2=0x562d31e81220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.331+0000 7fe2e591a980 1 --2- 172.21.15.194:0/4120192837 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562d31e80e00 0x562d31e81220 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fe2d4048f40 tx=0x7fe2d4017d50 comp rx=0 tx=0).stop 2024-09-13T06:10:01.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.331+0000 7fe2e591a980 1 -- 172.21.15.194:0/4120192837 shutdown_connections 2024-09-13T06:10:01.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.331+0000 7fe2e591a980 1 --2- 172.21.15.194:0/4120192837 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fe1bc0346a0 0x7fe1bc036b60 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.331+0000 7fe2e591a980 1 --2- 172.21.15.194:0/4120192837 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562d31e80e00 0x562d31e81220 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.331+0000 7fe2e591a980 1 -- 172.21.15.194:0/4120192837 >> 172.21.15.194:0/4120192837 conn(0x562d31e75f50 msgr2=0x562d31e789d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:01.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.331+0000 7fe2e591a980 1 -- 172.21.15.194:0/4120192837 shutdown_connections 2024-09-13T06:10:01.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.331+0000 7fe2e591a980 1 -- 172.21.15.194:0/4120192837 wait complete. 2024-09-13T06:10:01.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.331+0000 7fe2e591a980 1 -- 172.21.15.194:0/2777774839 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x562d31ce4fb0 msgr2=0x562d31e69f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.336 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.331+0000 7fe2e591a980 1 --2- 172.21.15.194:0/2777774839 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x562d31ce4fb0 0x562d31e69f50 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.336 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.331+0000 7fe2e591a980 1 -- 172.21.15.194:0/2777774839 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x562d31e707f0 msgr2=0x562d31e72be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.336 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.331+0000 7fe2e591a980 1 --2- 172.21.15.194:0/2777774839 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x562d31e707f0 0x562d31e72be0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.336 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.331+0000 7fe2e591a980 1 -- 172.21.15.194:0/2777774839 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x562d31e6c8f0 msgr2=0x562d31e6ece0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.336 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.331+0000 7fe2e591a980 1 --2- 172.21.15.194:0/2777774839 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x562d31e6c8f0 0x562d31e6ece0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.336 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.331+0000 7fe2e591a980 1 -- 172.21.15.194:0/2777774839 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fe1c8034650 msgr2=0x7fe1c8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.336 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.331+0000 7fe2e591a980 1 --2- 172.21.15.194:0/2777774839 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fe1c8034650 0x7fe1c8036b10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc0ae000 tx=0x7fe2cc0a6000 comp rx=0 tx=0).stop 2024-09-13T06:10:01.337 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.331+0000 7fe2e591a980 1 -- 172.21.15.194:0/2777774839 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562d31ce4ba0 msgr2=0x562d31e62f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.337 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.331+0000 7fe2e591a980 1 --2- 172.21.15.194:0/2777774839 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562d31ce4ba0 0x562d31e62f60 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x562d31e5cdb0 tx=0x7fe2d4000bd0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.337 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.331+0000 7fe2e3c2b640 1 -- 172.21.15.194:0/2777774839 reap_dead start 2024-09-13T06:10:01.337 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.331+0000 7fe2e591a980 1 -- 172.21.15.194:0/2777774839 shutdown_connections 2024-09-13T06:10:01.337 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.331+0000 7fe2e591a980 1 -- 172.21.15.194:0/2777774839 >> 172.21.15.194:0/2777774839 conn(0x562d31d6a180 msgr2=0x562d31e56380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:01.337 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.331+0000 7fe2e591a980 1 -- 172.21.15.194:0/2777774839 shutdown_connections 2024-09-13T06:10:01.337 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.331+0000 7fe2e591a980 1 -- 172.21.15.194:0/2777774839 wait complete. 2024-09-13T06:10:01.342 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-13T06:10:01.343 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-13T06:10:01.343 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-13T06:10:01.418 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:10:01.419 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:10:01.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.419+0000 7f9f3d9ce980 1 Processor -- start 2024-09-13T06:10:01.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.419+0000 7f9f3d9ce980 1 -- start start 2024-09-13T06:10:01.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.419+0000 7f9f3d9ce980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55865eaeb8e0 0x55865eaebcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:01.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.419+0000 7f9f3d9ce980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55865e971ae0 con 0x55865eaec230 2024-09-13T06:10:01.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.419+0000 7f9f3d9ce980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x55865e995e30 con 0x55865eaeb8e0 2024-09-13T06:10:01.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.419+0000 7f9f3b4de640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55865eaeb8e0 0x55865eaebcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:01.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.419+0000 7f9f3acdd640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x55865eaec230 0x55865eaf0c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:51290/0 (socket says 172.21.15.194:51290) 2024-09-13T06:10:01.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.419+0000 7f9f3acdd640 1 -- 172.21.15.194:0/3467552922 learned_addr learned my addr 172.21.15.194:0/3467552922 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-09-13T06:10:01.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.419+0000 7f9f3b4de640 1 -- 172.21.15.194:0/3467552922 >> v1:172.21.15.120:6789/0 conn(0x55865eaec230 legacy=0x55865eaf0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.419+0000 7f9f3b4de640 1 -- 172.21.15.194:0/3467552922 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55865eaf34b0 con 0x55865eaeb8e0 2024-09-13T06:10:01.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.423+0000 7f9f3b4de640 1 --2- 172.21.15.194:0/3467552922 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55865eaeb8e0 0x55865eaebcc0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c00a480 tx=0x7f9f2c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1e50db1223b526c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:01.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.423+0000 7f9f3a4dc640 1 -- 172.21.15.194:0/3467552922 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f2c0b0070 con 0x55865eaeb8e0 2024-09-13T06:10:01.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.423+0000 7f9f3a4dc640 1 -- 172.21.15.194:0/3467552922 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f2c0ab540 con 0x55865eaeb8e0 2024-09-13T06:10:01.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.423+0000 7f9f3a4dc640 1 -- 172.21.15.194:0/3467552922 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f2c0ab840 con 0x55865eaeb8e0 2024-09-13T06:10:01.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.423+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/3467552922 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55865eaeb8e0 msgr2=0x55865eaebcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.423+0000 7f9f3d9ce980 1 --2- 172.21.15.194:0/3467552922 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55865eaeb8e0 0x55865eaebcc0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c00a480 tx=0x7f9f2c01b280 comp rx=0 tx=0).stop 2024-09-13T06:10:01.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.423+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/3467552922 shutdown_connections 2024-09-13T06:10:01.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.423+0000 7f9f3d9ce980 1 --2- 172.21.15.194:0/3467552922 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55865eaeb8e0 0x55865eaebcc0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.423+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/3467552922 >> 172.21.15.194:0/3467552922 conn(0x55865ea5f230 msgr2=0x55865ea5f640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:01.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.423+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/3467552922 shutdown_connections 2024-09-13T06:10:01.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.423+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/3467552922 wait complete. 2024-09-13T06:10:01.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.439+0000 7f9f3d9ce980 1 Processor -- start 2024-09-13T06:10:01.439 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.439+0000 7f9f3d9ce980 1 -- start start 2024-09-13T06:10:01.439 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.439+0000 7f9f3d9ce980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55865eaeb8e0 0x55865ebd6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:01.439 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.439+0000 7f9f3d9ce980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55865e997200 con 0x55865eaeb8e0 2024-09-13T06:10:01.440 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.439+0000 7f9f3b4de640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55865eaeb8e0 0x55865ebd6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:01.440 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.439+0000 7f9f3b4de640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55865eaeb8e0 0x55865ebd6c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:46258/0 (socket says 172.21.15.194:46258) 2024-09-13T06:10:01.440 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.439+0000 7f9f3b4de640 1 -- 172.21.15.194:0/697547178 learned_addr learned my addr 172.21.15.194:0/697547178 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:01.440 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.439+0000 7f9f3b4de640 1 -- 172.21.15.194:0/697547178 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55865ebd7220 con 0x55865eaeb8e0 2024-09-13T06:10:01.440 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.439+0000 7f9f3b4de640 1 --2- 172.21.15.194:0/697547178 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55865eaeb8e0 0x55865ebd6c50 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c0ae040 tx=0x7f9f2c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5de2ebee4285a04 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:01.440 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.439+0000 7f9e2960a640 1 -- 172.21.15.194:0/697547178 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f2c0b0040 con 0x55865eaeb8e0 2024-09-13T06:10:01.440 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.439+0000 7f9e2960a640 1 -- 172.21.15.194:0/697547178 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f2c0ab9d0 con 0x55865eaeb8e0 2024-09-13T06:10:01.441 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.439+0000 7f9e2960a640 1 -- 172.21.15.194:0/697547178 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f2c0abcf0 con 0x55865eaeb8e0 2024-09-13T06:10:01.442 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.439+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/697547178 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55865eaeb8e0 msgr2=0x55865ebd6c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.442 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.439+0000 7f9f3d9ce980 1 --2- 172.21.15.194:0/697547178 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55865eaeb8e0 0x55865ebd6c50 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c0ae040 tx=0x7f9f2c003030 comp rx=0 tx=0).stop 2024-09-13T06:10:01.442 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.439+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/697547178 shutdown_connections 2024-09-13T06:10:01.442 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.439+0000 7f9f3d9ce980 1 --2- 172.21.15.194:0/697547178 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55865eaeb8e0 0x55865ebd6c50 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.442 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.439+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/697547178 >> 172.21.15.194:0/697547178 conn(0x55865ea5f230 msgr2=0x55865ebd2880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:01.443 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.439+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/697547178 shutdown_connections 2024-09-13T06:10:01.443 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.439+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/697547178 wait complete. 2024-09-13T06:10:01.443 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.439+0000 7f9f3d9ce980 1 Processor -- start 2024-09-13T06:10:01.443 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.439+0000 7f9f3d9ce980 1 -- start start 2024-09-13T06:10:01.443 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.439+0000 7f9f3d9ce980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55865eaeb8e0 0x55865ebdde80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:01.443 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.439+0000 7f9f3d9ce980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55865eaf2ef0 con 0x55865eaeb8e0 2024-09-13T06:10:01.443 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.439+0000 7f9f3b4de640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55865eaeb8e0 0x55865ebdde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:01.443 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.439+0000 7f9f3b4de640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55865eaeb8e0 0x55865ebdde80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:46268/0 (socket says 172.21.15.194:46268) 2024-09-13T06:10:01.443 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.439+0000 7f9f3b4de640 1 -- 172.21.15.194:0/1337609533 learned_addr learned my addr 172.21.15.194:0/1337609533 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:01.443 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.443+0000 7f9f3b4de640 1 -- 172.21.15.194:0/1337609533 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55865ebde3c0 con 0x55865eaeb8e0 2024-09-13T06:10:01.443 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.443+0000 7f9f3b4de640 1 --2- 172.21.15.194:0/1337609533 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55865eaeb8e0 0x55865ebdde80 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c019930 tx=0x7f9f2c018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:01.446 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.443+0000 7f9e27e07640 1 -- 172.21.15.194:0/1337609533 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f2c0b0070 con 0x55865eaeb8e0 2024-09-13T06:10:01.446 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.443+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/1337609533 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55865ebde650 con 0x55865eaeb8e0 2024-09-13T06:10:01.446 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.443+0000 7f9e27e07640 1 -- 172.21.15.194:0/1337609533 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f2c0b68b0 con 0x55865eaeb8e0 2024-09-13T06:10:01.446 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.443+0000 7f9e27e07640 1 -- 172.21.15.194:0/1337609533 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f2c0b6b90 con 0x55865eaeb8e0 2024-09-13T06:10:01.446 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.443+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/1337609533 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55865ebe1330 con 0x55865eaeb8e0 2024-09-13T06:10:01.446 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.443+0000 7f9e27e07640 1 -- 172.21.15.194:0/1337609533 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9f2c0bf3f0 con 0x55865eaeb8e0 2024-09-13T06:10:01.446 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.443+0000 7f9e27e07640 1 --2- 172.21.15.194:0/1337609533 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f9e20034650 0x7f9e20036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:01.446 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.443+0000 7f9e27e07640 1 -- 172.21.15.194:0/1337609533 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f9f2c0bc070 con 0x55865eaeb8e0 2024-09-13T06:10:01.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.443+0000 7f9f3acdd640 1 --2- 172.21.15.194:0/1337609533 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f9e20034650 0x7f9e20036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:01.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.443+0000 7f9f3d9ce980 1 --2- 172.21.15.194:0/1337609533 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55865eaec230 0x55865ebe4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:01.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.443+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/1337609533 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55865ebe5430 con 0x55865eaec230 2024-09-13T06:10:01.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.443+0000 7f9f3bcdf640 1 --2- 172.21.15.194:0/1337609533 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55865eaec230 0x55865ebe4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:01.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.443+0000 7f9f3acdd640 1 --2- 172.21.15.194:0/1337609533 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f9e20034650 0x7f9e20036b10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9f30001da0 tx=0x7f9f30001300 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:01.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.443+0000 7f9f3bcdf640 1 --2- 172.21.15.194:0/1337609533 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55865eaec230 0x55865ebe4e10 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:01.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.443+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/1337609533 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9f3400a4d0 con 0x55865eaec230 2024-09-13T06:10:01.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.443+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/1337609533 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55865ebe5cf0 con 0x55865eaec230 2024-09-13T06:10:01.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.443+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/1337609533 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9f3400a4d0 con 0x55865eaec230 2024-09-13T06:10:01.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.443+0000 7f9f3d9ce980 1 --2- 172.21.15.194:0/1337609533 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55865ebe7600 0x55865ebe9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:01.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.443+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/1337609533 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55865ebea230 con 0x55865ebe7600 2024-09-13T06:10:01.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.443+0000 7f9f3b4de640 1 --2- 172.21.15.194:0/1337609533 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55865ebe7600 0x55865ebe9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:01.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.447+0000 7f9f3b4de640 1 --2- 172.21.15.194:0/1337609533 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55865ebe7600 0x55865ebe9aa0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:01.450 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.447+0000 7f9f3b4de640 1 -- 172.21.15.194:0/1337609533 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9f2c0b3040 con 0x55865ebe7600 2024-09-13T06:10:01.450 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.447+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/1337609533 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55865ebe6540 con 0x55865eaec230 2024-09-13T06:10:01.450 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.447+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/1337609533 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9f3400a4d0 con 0x55865eaec230 2024-09-13T06:10:01.450 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.447+0000 7f9f3d9ce980 1 --2- 172.21.15.194:0/1337609533 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55865ebeb690 0x55865ebeda80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:01.450 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.447+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/1337609533 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55865ebee1f0 con 0x55865ebeb690 2024-09-13T06:10:01.450 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.447+0000 7f9f3acdd640 1 --2- 172.21.15.194:0/1337609533 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55865ebeb690 0x55865ebeda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:01.451 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.447+0000 7f9f3acdd640 1 --2- 172.21.15.194:0/1337609533 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55865ebeb690 0x55865ebeda80 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:01.451 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.447+0000 7f9f3acdd640 1 -- 172.21.15.194:0/1337609533 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9f3000e6c0 con 0x55865ebeb690 2024-09-13T06:10:01.451 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.447+0000 7f9f3d9ce980 1 Processor -- start 2024-09-13T06:10:01.451 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.447+0000 7f9f3d9ce980 1 -- start start 2024-09-13T06:10:01.451 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.447+0000 7f9f3d9ce980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55865ebfbca0 0x55865ebfc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:01.451 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.447+0000 7f9f3d9ce980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55865e9f0800 con 0x55865ebfbca0 2024-09-13T06:10:01.451 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.447+0000 7f9f3b4de640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55865ebfbca0 0x55865ebfc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:01.451 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.447+0000 7f9f3b4de640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55865ebfbca0 0x55865ebfc0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:46272/0 (socket says 172.21.15.194:46272) 2024-09-13T06:10:01.451 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.447+0000 7f9f3b4de640 1 -- 172.21.15.194:0/2857750439 learned_addr learned my addr 172.21.15.194:0/2857750439 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:01.451 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.447+0000 7f9f3b4de640 1 -- 172.21.15.194:0/2857750439 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55865ebfc600 con 0x55865ebfbca0 2024-09-13T06:10:01.451 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.447+0000 7f9f3b4de640 1 --2- 172.21.15.194:0/2857750439 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55865ebfbca0 0x55865ebfc0c0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c006b40 tx=0x7f9f2c0b56c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:01.451 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.447+0000 7f9e25602640 1 -- 172.21.15.194:0/2857750439 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f2c0b4c60 con 0x55865ebfbca0 2024-09-13T06:10:01.451 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.447+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2857750439 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55865ebfc890 con 0x55865ebfbca0 2024-09-13T06:10:01.452 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.447+0000 7f9e25602640 1 -- 172.21.15.194:0/2857750439 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f2c0b4e00 con 0x55865ebfbca0 2024-09-13T06:10:01.452 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.447+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2857750439 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55865ebff510 con 0x55865ebfbca0 2024-09-13T06:10:01.452 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.447+0000 7f9e25602640 1 -- 172.21.15.194:0/2857750439 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f2c0e9060 con 0x55865ebfbca0 2024-09-13T06:10:01.454 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.451+0000 7f9e25602640 1 -- 172.21.15.194:0/2857750439 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9f2c0bf730 con 0x55865ebfbca0 2024-09-13T06:10:01.455 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.451+0000 7f9e25602640 1 --2- 172.21.15.194:0/2857750439 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f9e14034650 0x7f9e14036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:01.455 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.451+0000 7f9e25602640 1 -- 172.21.15.194:0/2857750439 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f9f2c0a8070 con 0x55865ebfbca0 2024-09-13T06:10:01.455 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.451+0000 7f9f3acdd640 1 --2- 172.21.15.194:0/2857750439 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f9e14034650 0x7f9e14036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:01.455 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.451+0000 7f9f3d9ce980 1 Processor -- start 2024-09-13T06:10:01.455 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.451+0000 7f9f3d9ce980 1 -- start start 2024-09-13T06:10:01.455 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.451+0000 7f9f3acdd640 1 --2- 172.21.15.194:0/2857750439 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f9e14034650 0x7f9e14036b10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x55865ebea5d0 tx=0x7f9f3000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:01.455 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.451+0000 7f9f3d9ce980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55865ec08380 0x55865ec08780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:01.455 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.451+0000 7f9f3d9ce980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55865ebd74e0 con 0x55865ec08380 2024-09-13T06:10:01.455 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.451+0000 7f9f3b4de640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55865ec08380 0x55865ec08780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:01.455 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.451+0000 7f9f3b4de640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55865ec08380 0x55865ec08780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:46274/0 (socket says 172.21.15.194:46274) 2024-09-13T06:10:01.456 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.451+0000 7f9f3b4de640 1 -- 172.21.15.194:0/266089318 learned_addr learned my addr 172.21.15.194:0/266089318 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:01.456 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.451+0000 7f9f3b4de640 1 -- 172.21.15.194:0/266089318 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55865ec08d50 con 0x55865ec08380 2024-09-13T06:10:01.456 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.451+0000 7f9f3b4de640 1 --2- 172.21.15.194:0/266089318 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55865ec08380 0x55865ec08780 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c0b2fd0 tx=0x7f9f2c0bfa20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba33f58269a98b69 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:01.456 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.451+0000 7f9e1effd640 1 -- 172.21.15.194:0/266089318 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f2c0fc070 con 0x55865ec08380 2024-09-13T06:10:01.456 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.451+0000 7f9e1effd640 1 -- 172.21.15.194:0/266089318 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f2c0b3e30 con 0x55865ec08380 2024-09-13T06:10:01.456 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.451+0000 7f9e1effd640 1 -- 172.21.15.194:0/266089318 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f2c002d50 con 0x55865ec08380 2024-09-13T06:10:01.456 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.451+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/266089318 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55865ec08380 msgr2=0x55865ec08780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.456 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.451+0000 7f9f3d9ce980 1 --2- 172.21.15.194:0/266089318 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55865ec08380 0x55865ec08780 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c0b2fd0 tx=0x7f9f2c0bfa20 comp rx=0 tx=0).stop 2024-09-13T06:10:01.456 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.451+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/266089318 shutdown_connections 2024-09-13T06:10:01.456 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.451+0000 7f9f3d9ce980 1 --2- 172.21.15.194:0/266089318 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55865ec08380 0x55865ec08780 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.456 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.451+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/266089318 >> 172.21.15.194:0/266089318 conn(0x55865ec047f0 msgr2=0x55865ec028f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:01.456 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.451+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/266089318 shutdown_connections 2024-09-13T06:10:01.457 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.451+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/266089318 wait complete. 2024-09-13T06:10:01.457 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.455+0000 7f9f3d9ce980 1 Processor -- start 2024-09-13T06:10:01.457 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.455+0000 7f9f3d9ce980 1 -- start start 2024-09-13T06:10:01.457 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.455+0000 7f9f3d9ce980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55865ec08380 0x55865ec0f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:01.457 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.455+0000 7f9f3d9ce980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55865ec09260 con 0x55865ec08380 2024-09-13T06:10:01.457 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.455+0000 7f9f3b4de640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55865ec08380 0x55865ec0f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:01.457 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.455+0000 7f9f3b4de640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55865ec08380 0x55865ec0f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:46280/0 (socket says 172.21.15.194:46280) 2024-09-13T06:10:01.457 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.455+0000 7f9f3b4de640 1 -- 172.21.15.194:0/2896603289 learned_addr learned my addr 172.21.15.194:0/2896603289 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:01.462 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.455+0000 7f9f3b4de640 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55865ec0fb90 con 0x55865ec08380 2024-09-13T06:10:01.462 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.455+0000 7f9f3b4de640 1 --2- 172.21.15.194:0/2896603289 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55865ec08380 0x55865ec0f650 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c0aef90 tx=0x7f9f2c0a6f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:01.462 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.455+0000 7f9e1d7fa640 1 -- 172.21.15.194:0/2896603289 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f2c106070 con 0x55865ec08380 2024-09-13T06:10:01.462 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.455+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55865ec0fb90 con 0x55865ec08380 2024-09-13T06:10:01.462 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.455+0000 7f9e1d7fa640 1 -- 172.21.15.194:0/2896603289 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f2c0c0590 con 0x55865ec08380 2024-09-13T06:10:01.462 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.455+0000 7f9e1d7fa640 1 -- 172.21.15.194:0/2896603289 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f2c0fc040 con 0x55865ec08380 2024-09-13T06:10:01.462 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.455+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55865ec10060 con 0x55865ec08380 2024-09-13T06:10:01.462 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.455+0000 7f9f3d9ce980 20 rados->read ofs=0 len=0 2024-09-13T06:10:01.462 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.455+0000 7f9e1d7fa640 1 -- 172.21.15.194:0/2896603289 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9f2c109070 con 0x55865ec08380 2024-09-13T06:10:01.462 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.455+0000 7f9e1d7fa640 1 --2- 172.21.15.194:0/2896603289 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f9e04034600 0x7f9e04036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:01.463 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.455+0000 7f9e1d7fa640 1 -- 172.21.15.194:0/2896603289 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f9f2c0f4070 con 0x55865ec08380 2024-09-13T06:10:01.463 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.455+0000 7f9f3acdd640 1 --2- 172.21.15.194:0/2896603289 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f9e04034600 0x7f9e04036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:01.463 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.455+0000 7f9f3d9ce980 1 --2- 172.21.15.194:0/2896603289 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55865ec1a6c0 0x55865ec1cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:01.463 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.455+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55865ec1d2a0 con 0x55865ec1a6c0 2024-09-13T06:10:01.463 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.455+0000 7f9f3bcdf640 1 --2- 172.21.15.194:0/2896603289 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55865ec1a6c0 0x55865ec1cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:01.463 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.455+0000 7f9f3acdd640 1 --2- 172.21.15.194:0/2896603289 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f9e04034600 0x7f9e04036ac0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x55865ebee5d0 tx=0x7f9f30010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:01.463 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.455+0000 7f9f3bcdf640 1 --2- 172.21.15.194:0/2896603289 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55865ec1a6c0 0x55865ec1cb50 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:01.463 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.455+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/2896603289 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9f3400a4d0 con 0x55865ec1a6c0 2024-09-13T06:10:01.463 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.455+0000 7f9f3d9ce980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:01.463 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.455+0000 7f9f3d9ce980 20 realm 2024-09-13T06:10:01.463 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.455+0000 7f9f3d9ce980 20 rados->read ofs=0 len=0 2024-09-13T06:10:01.463 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.455+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55865ec1d6b0 con 0x55865ec1a6c0 2024-09-13T06:10:01.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.459+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/2896603289 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9f3400a4d0 con 0x55865ec1a6c0 2024-09-13T06:10:01.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.459+0000 7f9f3d9ce980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:01.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.459+0000 7f9f3d9ce980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:10:01.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.459+0000 7f9f3d9ce980 20 rados->read ofs=0 len=0 2024-09-13T06:10:01.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.459+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55865ec1df50 con 0x55865ec1a6c0 2024-09-13T06:10:01.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.459+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/2896603289 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9f3400a4d0 con 0x55865ec1a6c0 2024-09-13T06:10:01.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.459+0000 7f9f3d9ce980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:01.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.459+0000 7f9f3d9ce980 20 rados->read ofs=0 len=0 2024-09-13T06:10:01.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.459+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55865ec1e2f0 con 0x55865ec1a6c0 2024-09-13T06:10:01.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.459+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/2896603289 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9f3400a4d0 con 0x55865ec1a6c0 2024-09-13T06:10:01.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.459+0000 7f9f3d9ce980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:10:01.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.459+0000 7f9f3d9ce980 20 rados->read ofs=0 len=0 2024-09-13T06:10:01.465 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.459+0000 7f9f3d9ce980 1 --2- 172.21.15.194:0/2896603289 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55865ec1f050 0x55865ec21440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:01.465 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.459+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55865ec219c0 con 0x55865ec1f050 2024-09-13T06:10:01.465 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.459+0000 7f9f3b4de640 1 --2- 172.21.15.194:0/2896603289 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55865ec1f050 0x55865ec21440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:01.465 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.459+0000 7f9f3b4de640 1 --2- 172.21.15.194:0/2896603289 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55865ec1f050 0x55865ec21440 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:01.465 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.459+0000 7f9f3b4de640 1 -- 172.21.15.194:0/2896603289 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9f2c112070 con 0x55865ec1f050 2024-09-13T06:10:01.465 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.459+0000 7f9f3d9ce980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:10:01.465 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.459+0000 7f9f3d9ce980 20 searching for the correct realm 2024-09-13T06:10:01.465 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.459+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55865ec23220 con 0x55865ec1f050 2024-09-13T06:10:01.465 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.459+0000 7f9f3b4de640 1 -- 172.21.15.194:0/2896603289 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f2c112070 con 0x55865ec1f050 2024-09-13T06:10:01.465 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.459+0000 7f9f3b4de640 1 --2- 172.21.15.194:0/2896603289 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f9f2c10b070 0x7f9f2c0ed820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:01.465 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.459+0000 7f9f3b4de640 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55865ec23220 con 0x7f9f2c10b070 2024-09-13T06:10:01.465 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.459+0000 7f9f3acdd640 1 --2- 172.21.15.194:0/2896603289 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f9f2c10b070 0x7f9f2c0ed820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:01.465 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.459+0000 7f9f3acdd640 1 --2- 172.21.15.194:0/2896603289 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f9f2c10b070 0x7f9f2c0ed820 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:01.466 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.459+0000 7f9f3acdd640 1 -- 172.21.15.194:0/2896603289 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9f3000e6c0 con 0x7f9f2c10b070 2024-09-13T06:10:01.466 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.459+0000 7f9f3acdd640 1 --2- 172.21.15.194:0/2896603289 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f9f30037040 0x7f9f30036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:01.466 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.459+0000 7f9f3acdd640 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55865ec23220 con 0x7f9f30037040 2024-09-13T06:10:01.466 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.459+0000 7f9f3bcdf640 1 --2- 172.21.15.194:0/2896603289 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f9f30037040 0x7f9f30036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:01.466 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.459+0000 7f9f3bcdf640 1 --2- 172.21.15.194:0/2896603289 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f9f30037040 0x7f9f30036410 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:01.470 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.463+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/2896603289 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f3400a4d0 con 0x7f9f30037040 2024-09-13T06:10:01.470 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.463+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55865ec1e2f0 con 0x55865ec1a6c0 2024-09-13T06:10:01.470 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.463+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/2896603289 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f3400a4d0 con 0x55865ec1a6c0 2024-09-13T06:10:01.470 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.463+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55865ec1e2f0 con 0x55865ec1a6c0 2024-09-13T06:10:01.471 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.463+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/2896603289 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f3400a4d0 con 0x55865ec1a6c0 2024-09-13T06:10:01.471 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.463+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55865ec1e2f0 con 0x7f9f30037040 2024-09-13T06:10:01.471 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.463+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/2896603289 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f3400a4d0 con 0x7f9f30037040 2024-09-13T06:10:01.471 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.463+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55865ec1e2f0 con 0x7f9f30037040 2024-09-13T06:10:01.471 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.463+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/2896603289 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f3400a4d0 con 0x7f9f30037040 2024-09-13T06:10:01.471 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.463+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55865ec1e2f0 con 0x7f9f2c10b070 2024-09-13T06:10:01.471 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.463+0000 7f9f3acdd640 1 -- 172.21.15.194:0/2896603289 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f3000e6c0 con 0x7f9f2c10b070 2024-09-13T06:10:01.471 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.463+0000 7f9f3acdd640 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55865ec1e2f0 con 0x55865ec1f050 2024-09-13T06:10:01.471 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.463+0000 7f9f3b4de640 1 -- 172.21.15.194:0/2896603289 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f2c112070 con 0x55865ec1f050 2024-09-13T06:10:01.471 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.463+0000 7f9f3b4de640 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55865ec1e2f0 con 0x55865ec1a6c0 2024-09-13T06:10:01.471 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.463+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/2896603289 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f3400a4d0 con 0x55865ec1a6c0 2024-09-13T06:10:01.471 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.463+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55865ec1e2f0 con 0x7f9f30037040 2024-09-13T06:10:01.471 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.463+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/2896603289 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f3400a4d0 con 0x7f9f30037040 2024-09-13T06:10:01.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.463+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55865ec1e2f0 con 0x55865ec1a6c0 2024-09-13T06:10:01.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.463+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/2896603289 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f3400a4d0 con 0x55865ec1a6c0 2024-09-13T06:10:01.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.463+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55865ec1e2f0 con 0x7f9f2c10b070 2024-09-13T06:10:01.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.467+0000 7f9f3acdd640 1 -- 172.21.15.194:0/2896603289 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9f3000e6c0 con 0x7f9f2c10b070 2024-09-13T06:10:01.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.467+0000 7f9f3acdd640 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55865ec1e2f0 con 0x55865ec1f050 2024-09-13T06:10:01.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.467+0000 7f9f3b4de640 1 -- 172.21.15.194:0/2896603289 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f2c112070 con 0x55865ec1f050 2024-09-13T06:10:01.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.467+0000 7f9f3b4de640 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55865ec1e2f0 con 0x55865ec1f050 2024-09-13T06:10:01.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.467+0000 7f9f3b4de640 1 -- 172.21.15.194:0/2896603289 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f2c112070 con 0x55865ec1f050 2024-09-13T06:10:01.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.467+0000 7f9f3b4de640 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55865ec1e2f0 con 0x7f9f30037040 2024-09-13T06:10:01.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.467+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/2896603289 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f3400a4d0 con 0x7f9f30037040 2024-09-13T06:10:01.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.467+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55865ec1e2f0 con 0x55865ec1f050 2024-09-13T06:10:01.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.467+0000 7f9f3b4de640 1 -- 172.21.15.194:0/2896603289 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f2c112070 con 0x55865ec1f050 2024-09-13T06:10:01.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.467+0000 7f9f3b4de640 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55865ec1e2f0 con 0x55865ec1f050 2024-09-13T06:10:01.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.467+0000 7f9f3b4de640 1 -- 172.21.15.194:0/2896603289 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f2c112070 con 0x55865ec1f050 2024-09-13T06:10:01.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.467+0000 7f9f3b4de640 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55865ec1e2f0 con 0x55865ec1a6c0 2024-09-13T06:10:01.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.467+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/2896603289 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f3400a4d0 con 0x55865ec1a6c0 2024-09-13T06:10:01.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.467+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55865ec1e2f0 con 0x55865ec1a6c0 2024-09-13T06:10:01.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.467+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/2896603289 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9f3400a4d0 con 0x55865ec1a6c0 2024-09-13T06:10:01.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.467+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55865ec1e2f0 con 0x7f9f30037040 2024-09-13T06:10:01.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.467+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/2896603289 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f3400a4d0 con 0x7f9f30037040 2024-09-13T06:10:01.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.467+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55865ec1e2f0 con 0x55865ec1f050 2024-09-13T06:10:01.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.467+0000 7f9f3b4de640 1 -- 172.21.15.194:0/2896603289 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f2c112070 con 0x55865ec1f050 2024-09-13T06:10:01.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.467+0000 7f9f3b4de640 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55865ec1e2f0 con 0x7f9f2c10b070 2024-09-13T06:10:01.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.467+0000 7f9f3acdd640 1 -- 172.21.15.194:0/2896603289 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f3000e6c0 con 0x7f9f2c10b070 2024-09-13T06:10:01.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.467+0000 7f9f3acdd640 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55865ec1e2f0 con 0x55865ec1a6c0 2024-09-13T06:10:01.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.467+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/2896603289 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f3400a4d0 con 0x55865ec1a6c0 2024-09-13T06:10:01.474 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.467+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55865ec1e2f0 con 0x7f9f30037040 2024-09-13T06:10:01.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.471+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/2896603289 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f3400a4d0 con 0x7f9f30037040 2024-09-13T06:10:01.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.471+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55865ec1e2f0 con 0x55865ec1f050 2024-09-13T06:10:01.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.471+0000 7f9f3b4de640 1 -- 172.21.15.194:0/2896603289 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9f2c112070 con 0x55865ec1f050 2024-09-13T06:10:01.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.471+0000 7f9f3b4de640 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55865ec1e2f0 con 0x7f9f30037040 2024-09-13T06:10:01.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.471+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/2896603289 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f3400a4d0 con 0x7f9f30037040 2024-09-13T06:10:01.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.471+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55865ec1e2f0 con 0x7f9f2c10b070 2024-09-13T06:10:01.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.471+0000 7f9f3acdd640 1 -- 172.21.15.194:0/2896603289 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f3000e6c0 con 0x7f9f2c10b070 2024-09-13T06:10:01.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.471+0000 7f9f3acdd640 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55865ec1e2f0 con 0x55865ec1f050 2024-09-13T06:10:01.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.471+0000 7f9f3b4de640 1 -- 172.21.15.194:0/2896603289 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f2c112070 con 0x55865ec1f050 2024-09-13T06:10:01.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.471+0000 7f9f3b4de640 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55865ec1e2f0 con 0x7f9f30037040 2024-09-13T06:10:01.479 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.471+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/2896603289 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f3400a4d0 con 0x7f9f30037040 2024-09-13T06:10:01.479 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.471+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55865ec1e2f0 con 0x55865ec1a6c0 2024-09-13T06:10:01.479 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.471+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/2896603289 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9f3400a4d0 con 0x55865ec1a6c0 2024-09-13T06:10:01.479 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.471+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55865ec1e2f0 con 0x7f9f2c10b070 2024-09-13T06:10:01.479 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.471+0000 7f9f3acdd640 1 -- 172.21.15.194:0/2896603289 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f3000e6c0 con 0x7f9f2c10b070 2024-09-13T06:10:01.479 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.471+0000 7f9f3d9ce980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:10:01.479 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.471+0000 7f9f3d9ce980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:10:01.479 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.471+0000 7f9f3d9ce980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:10:01.479 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.471+0000 7f9f3d9ce980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:10:01.479 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.471+0000 7f9f3d9ce980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:10:01.479 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.471+0000 7f9f3d9ce980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:10:01.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.471+0000 7f9f3d9ce980 20 rados->read ofs=0 len=0 2024-09-13T06:10:01.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.471+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55865ec22340 con 0x55865ec1a6c0 2024-09-13T06:10:01.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.471+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/2896603289 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9f3400a4d0 con 0x55865ec1a6c0 2024-09-13T06:10:01.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.471+0000 7f9f3d9ce980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:01.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.471+0000 7f9f3d9ce980 20 rados->read ofs=0 len=0 2024-09-13T06:10:01.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.471+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55865ec22be0 con 0x55865ec1a6c0 2024-09-13T06:10:01.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.471+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/2896603289 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9f3400a4d0 con 0x55865ec1a6c0 2024-09-13T06:10:01.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.471+0000 7f9f3d9ce980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:10:01.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.471+0000 7f9f3d9ce980 20 rados->read ofs=0 len=0 2024-09-13T06:10:01.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.471+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55865ec21f80 con 0x7f9f2c10b070 2024-09-13T06:10:01.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.475+0000 7f9f3acdd640 1 -- 172.21.15.194:0/2896603289 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9f3000e6c0 con 0x7f9f2c10b070 2024-09-13T06:10:01.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.475+0000 7f9f3d9ce980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:10:01.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.475+0000 7f9f3d9ce980 20 zone default found 2024-09-13T06:10:01.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.475+0000 7f9f3d9ce980 4 Realm: () 2024-09-13T06:10:01.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.475+0000 7f9f3d9ce980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:10:01.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.475+0000 7f9f3d9ce980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:10:01.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.475+0000 7f9f3d9ce980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:10:01.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.475+0000 7f9f3d9ce980 20 zonegroup default 2024-09-13T06:10:01.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.475+0000 7f9f3d9ce980 20 rados->read ofs=0 len=0 2024-09-13T06:10:01.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.475+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55865ec22be0 con 0x7f9f30037040 2024-09-13T06:10:01.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.475+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/2896603289 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9f3400a4d0 con 0x7f9f30037040 2024-09-13T06:10:01.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.475+0000 7f9f3d9ce980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:01.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.475+0000 7f9f3d9ce980 20 rados->read ofs=0 len=0 2024-09-13T06:10:01.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.475+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55865ec250d0 con 0x55865ec1f050 2024-09-13T06:10:01.482 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.475+0000 7f9f3b4de640 1 -- 172.21.15.194:0/2896603289 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9f2c112070 con 0x55865ec1f050 2024-09-13T06:10:01.482 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.475+0000 7f9f3d9ce980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:01.482 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.475+0000 7f9f3d9ce980 20 rados->read ofs=0 len=0 2024-09-13T06:10:01.482 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.475+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55865ec25470 con 0x55865ec1f050 2024-09-13T06:10:01.482 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.475+0000 7f9f3b4de640 1 -- 172.21.15.194:0/2896603289 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9f2c112070 con 0x55865ec1f050 2024-09-13T06:10:01.482 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.475+0000 7f9f3d9ce980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:01.482 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.475+0000 7f9f3d9ce980 20 started sync module instance, tier type = 2024-09-13T06:10:01.482 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.475+0000 7f9f3d9ce980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:10:01.482 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.475+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55865ec24570 con 0x7f9f2c10b070 2024-09-13T06:10:01.482 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.475+0000 7f9f3acdd640 1 -- 172.21.15.194:0/2896603289 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(44 notify.0 [create] v33'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f3000e6c0 con 0x7f9f2c10b070 2024-09-13T06:10:01.482 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.475+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94035603769696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55865ec241d0 con 0x7f9f2c10b070 2024-09-13T06:10:01.482 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.475+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55865ec262e0 con 0x55865ec1a6c0 2024-09-13T06:10:01.484 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.479+0000 7f9f3acdd640 1 -- 172.21.15.194:0/2896603289 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94035603769696] v33'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f3000e6c0 con 0x7f9f2c10b070 2024-09-13T06:10:01.484 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.479+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/2896603289 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v33'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f3400a4d0 con 0x55865ec1a6c0 2024-09-13T06:10:01.484 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.479+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94035603775024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55865ec26250 con 0x55865ec1a6c0 2024-09-13T06:10:01.484 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.479+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55865ec27090 con 0x55865ec1f050 2024-09-13T06:10:01.484 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.479+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/2896603289 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94035603775024] v33'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f3400a4d0 con 0x55865ec1a6c0 2024-09-13T06:10:01.484 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.479+0000 7f9f3b4de640 1 -- 172.21.15.194:0/2896603289 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v33'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f2c112070 con 0x55865ec1f050 2024-09-13T06:10:01.484 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.479+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94035603777232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55865ec27050 con 0x55865ec1f050 2024-09-13T06:10:01.484 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.479+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55865ec27aa0 con 0x7f9f2c10b070 2024-09-13T06:10:01.484 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.483+0000 7f9f3acdd640 1 -- 172.21.15.194:0/2896603289 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(50 notify.3 [create] v33'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f3000e6c0 con 0x7f9f2c10b070 2024-09-13T06:10:01.484 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.483+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94035603781104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55865ec282f0 con 0x7f9f2c10b070 2024-09-13T06:10:01.484 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.483+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55865ec28d30 con 0x55865ec1a6c0 2024-09-13T06:10:01.484 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.483+0000 7f9f3b4de640 1 -- 172.21.15.194:0/2896603289 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94035603777232] v33'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f2c112070 con 0x55865ec1f050 2024-09-13T06:10:01.485 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.483+0000 7f9f3acdd640 1 -- 172.21.15.194:0/2896603289 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94035603781104] v33'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f3000e6c0 con 0x7f9f2c10b070 2024-09-13T06:10:01.485 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.483+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/2896603289 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v33'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f3400a4d0 con 0x55865ec1a6c0 2024-09-13T06:10:01.485 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.483+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94035603785728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55865ec27e40 con 0x55865ec1a6c0 2024-09-13T06:10:01.485 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.483+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55865ec295d0 con 0x7f9f30037040 2024-09-13T06:10:01.487 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.487+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/2896603289 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94035603785728] v33'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f3400a4d0 con 0x55865ec1a6c0 2024-09-13T06:10:01.487 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.487+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/2896603289 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(54 notify.5 [create] v33'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f3400a4d0 con 0x7f9f30037040 2024-09-13T06:10:01.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.487+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94035603778288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55865ec27e40 con 0x7f9f30037040 2024-09-13T06:10:01.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.487+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55865ec29ab0 con 0x7f9f30037040 2024-09-13T06:10:01.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.487+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/2896603289 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(56 notify.6 [create] v33'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f3400a4d0 con 0x7f9f30037040 2024-09-13T06:10:01.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.491+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94035603789248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55865ec29ef0 con 0x7f9f30037040 2024-09-13T06:10:01.491 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.491+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/2896603289 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94035603778288] v33'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f3400a4d0 con 0x7f9f30037040 2024-09-13T06:10:01.491 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.491+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55865ec28fd0 con 0x7f9f30037040 2024-09-13T06:10:01.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.491+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/2896603289 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94035603789248] v33'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f3400a4d0 con 0x7f9f30037040 2024-09-13T06:10:01.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.491+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/2896603289 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(58 notify.7 [create] v33'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f3400a4d0 con 0x7f9f30037040 2024-09-13T06:10:01.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.491+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94035603787728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55865ec2a4b0 con 0x7f9f30037040 2024-09-13T06:10:01.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.491+0000 7f9f3d9ce980 20 add_watcher() i=0 2024-09-13T06:10:01.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.491+0000 7f9f3d9ce980 20 add_watcher() i=1 2024-09-13T06:10:01.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.491+0000 7f9f3d9ce980 20 add_watcher() i=2 2024-09-13T06:10:01.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.491+0000 7f9f3d9ce980 20 add_watcher() i=3 2024-09-13T06:10:01.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.491+0000 7f9f3d9ce980 20 add_watcher() i=4 2024-09-13T06:10:01.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.491+0000 7f9f3d9ce980 20 add_watcher() i=5 2024-09-13T06:10:01.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.491+0000 7f9f3d9ce980 20 add_watcher() i=6 2024-09-13T06:10:01.494 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.491+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/2896603289 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94035603787728] v33'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f3400a4d0 con 0x7f9f30037040 2024-09-13T06:10:01.494 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.491+0000 7f9f3d9ce980 20 add_watcher() i=7 2024-09-13T06:10:01.494 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.491+0000 7f9f3d9ce980 2 all 8 watchers are set, enabling cache 2024-09-13T06:10:01.494 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.491+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55865ec2d8b0 con 0x55865ec1a6c0 2024-09-13T06:10:01.495 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.495+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/2896603289 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9f3400a4d0 con 0x55865ec1a6c0 2024-09-13T06:10:01.495 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.495+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94035603790304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55865ec2ad70 con 0x55865ec1a6c0 2024-09-13T06:10:01.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.495+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/2896603289 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94035603790304] v33'144 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9f3400a4d0 con 0x55865ec1a6c0 2024-09-13T06:10:01.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.495+0000 7f9df1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:10:01.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.495+0000 7f9f3d9ce980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:10:01.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.495+0000 7f9f3d9ce980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:10:01.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.495+0000 7f9f3d9ce980 5 note: GC not initialized 2024-09-13T06:10:01.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.495+0000 7f9df0fe1640 20 reqs_thread_entry: start 2024-09-13T06:10:01.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.495+0000 7f9f3d9ce980 20 init_complete bucket index max shards: 11 2024-09-13T06:10:01.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.495+0000 7f9f3d9ce980 20 Filter name: none 2024-09-13T06:10:01.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.495+0000 7f9d6a7fc640 20 reqs_thread_entry: start 2024-09-13T06:10:01.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.495+0000 7f9f3d9ce980 20 rados->read ofs=0 len=0 2024-09-13T06:10:01.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.495+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55865ec50f60 con 0x7f9f2c10b070 2024-09-13T06:10:01.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.495+0000 7f9f3acdd640 1 -- 172.21.15.194:0/2896603289 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f9f3000e6c0 con 0x7f9f2c10b070 2024-09-13T06:10:01.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.495+0000 7f9f3d9ce980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T06:10:01.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.495+0000 7f9f3d9ce980 20 rados->read ofs=0 len=0 2024-09-13T06:10:01.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.495+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:63 8.18 8:1a66c368:root::.bucket.meta.myfoo%3a52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55865ec517f0 con 0x55865ec1a6c0 2024-09-13T06:10:01.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.495+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/2896603289 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(63 .bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv16 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f9f3400a4d0 con 0x55865ec1a6c0 2024-09-13T06:10:01.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.495+0000 7f9f3d9ce980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T06:10:01.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.495+0000 7f9f3d9ce980 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-13T06:10:01.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.495+0000 7f9f3d9ce980 20 rados->read ofs=0 len=0 2024-09-13T06:10:01.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.495+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55865ec50300 con 0x7f9f2c10b070 2024-09-13T06:10:01.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.495+0000 7f9f3acdd640 1 -- 172.21.15.194:0/2896603289 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f9f3000e6c0 con 0x7f9f2c10b070 2024-09-13T06:10:01.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.495+0000 7f9f3d9ce980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T06:10:01.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.495+0000 7f9f3d9ce980 20 rados->read ofs=0 len=0 2024-09-13T06:10:01.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.495+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:65 8.18 8:1a66c368:root::.bucket.meta.myfoo%3a52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55865ec52e50 con 0x55865ec1a6c0 2024-09-13T06:10:01.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.499+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/2896603289 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(65 .bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv16 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f9f3400a4d0 con 0x55865ec1a6c0 2024-09-13T06:10:01.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.499+0000 7f9f3d9ce980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T06:10:01.503 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.499+0000 7f9f3d9ce980 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-13T06:10:01.503 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.499+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:66 4.25 4:a5fa2579:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55865ec527f0 con 0x55865ec1f050 2024-09-13T06:10:01.503 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.499+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:67 4.2c 4:3660bce8:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55865ec57710 con 0x55865ec1a6c0 2024-09-13T06:10:01.503 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.499+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:68 4.14 4:2a98937a:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55865ec527f0 con 0x55865ec1f050 2024-09-13T06:10:01.503 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.499+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:69 4.27 4:e42c957a:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55865ec5c4e0 con 0x55865ec1a6c0 2024-09-13T06:10:01.503 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.499+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:70 4.5 4:a24186ed:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55865ec5ee90 con 0x55865ec1f050 2024-09-13T06:10:01.503 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.499+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:71 4.13 4:cad7efb2:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55865ec619f0 con 0x7f9f2c10b070 2024-09-13T06:10:01.503 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.499+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:72 4.3 4:c1107af5:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55865ec64710 con 0x55865ec1a6c0 2024-09-13T06:10:01.503 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.499+0000 7f9f3b4de640 1 -- 172.21.15.194:0/2896603289 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(66 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9f2c112070 con 0x55865ec1f050 2024-09-13T06:10:01.503 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.499+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/2896603289 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(67 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9f3400a4d0 con 0x55865ec1a6c0 2024-09-13T06:10:01.503 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.499+0000 7f9f3b4de640 1 -- 172.21.15.194:0/2896603289 <== osd.3 v2:172.21.15.194:6816/96632515 16 ==== osd_op_reply(68 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9f2c112070 con 0x55865ec1f050 2024-09-13T06:10:01.503 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.499+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:73 4.27 4:e6338292:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55865ec619f0 con 0x55865ec1a6c0 2024-09-13T06:10:01.503 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.499+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:74 4.2a 4:57abd676:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55865ec64710 con 0x55865ec1a6c0 2024-09-13T06:10:01.504 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.499+0000 7f9f3acdd640 1 -- 172.21.15.194:0/2896603289 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(71 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.5 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f9f3000e6c0 con 0x7f9f2c10b070 2024-09-13T06:10:01.504 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.499+0000 7f9f3b4de640 1 -- 172.21.15.194:0/2896603289 <== osd.3 v2:172.21.15.194:6816/96632515 17 ==== osd_op_reply(70 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9f2c112070 con 0x55865ec1f050 2024-09-13T06:10:01.504 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.499+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/2896603289 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(69 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9f3400a4d0 con 0x55865ec1a6c0 2024-09-13T06:10:01.504 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.499+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/2896603289 <== osd.1 v2:172.21.15.194:6808/3135444559 25 ==== osd_op_reply(72 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.6 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f9f3400a4d0 con 0x55865ec1a6c0 2024-09-13T06:10:01.504 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.499+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:75 4.38 4:1e9df731:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55865ec64710 con 0x55865ec1a6c0 2024-09-13T06:10:01.504 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.499+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:76 4.2b 4:d7fbcf05:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55865ec640e0 con 0x55865ec1a6c0 2024-09-13T06:10:01.504 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.499+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/2896603289 <== osd.1 v2:172.21.15.194:6808/3135444559 26 ==== osd_op_reply(73 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.7 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9f3400a4d0 con 0x55865ec1a6c0 2024-09-13T06:10:01.504 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.499+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/2896603289 <== osd.1 v2:172.21.15.194:6808/3135444559 27 ==== osd_op_reply(74 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.8 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f9f3400a4d0 con 0x55865ec1a6c0 2024-09-13T06:10:01.504 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.499+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/2896603289 <== osd.1 v2:172.21.15.194:6808/3135444559 28 ==== osd_op_reply(75 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9f3400a4d0 con 0x55865ec1a6c0 2024-09-13T06:10:01.504 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.499+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/2896603289 <== osd.1 v2:172.21.15.194:6808/3135444559 29 ==== osd_op_reply(76 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f9f3400a4d0 con 0x55865ec1a6c0 2024-09-13T06:10:01.504 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.499+0000 7f9df1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:10:01.504 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.499+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94035603790304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55865ec2d6d0 con 0x55865ec1a6c0 2024-09-13T06:10:01.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.503+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/2896603289 <== osd.1 v2:172.21.15.194:6808/3135444559 30 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94035603790304] v33'145 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9f3400a4d0 con 0x55865ec1a6c0 2024-09-13T06:10:01.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.503+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94035603769696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55865ec2d6d0 con 0x7f9f2c10b070 2024-09-13T06:10:01.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.503+0000 7f9f3acdd640 1 -- 172.21.15.194:0/2896603289 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94035603769696] v33'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f3000e6c0 con 0x7f9f2c10b070 2024-09-13T06:10:01.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.503+0000 7f9f3d9ce980 20 remove_watcher() i=0 2024-09-13T06:10:01.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.503+0000 7f9f3d9ce980 2 removed watcher, disabling cache 2024-09-13T06:10:01.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.503+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94035603775024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55865ec2d6d0 con 0x55865ec1a6c0 2024-09-13T06:10:01.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.503+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/2896603289 <== osd.1 v2:172.21.15.194:6808/3135444559 31 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94035603775024] v33'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f3400a4d0 con 0x55865ec1a6c0 2024-09-13T06:10:01.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.503+0000 7f9f3d9ce980 20 remove_watcher() i=1 2024-09-13T06:10:01.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.503+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94035603777232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55865ec2d6d0 con 0x55865ec1f050 2024-09-13T06:10:01.508 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.507+0000 7f9f3b4de640 1 -- 172.21.15.194:0/2896603289 <== osd.3 v2:172.21.15.194:6816/96632515 18 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94035603777232] v33'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f2c112070 con 0x55865ec1f050 2024-09-13T06:10:01.508 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.507+0000 7f9f3d9ce980 20 remove_watcher() i=2 2024-09-13T06:10:01.508 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.507+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94035603781104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55865ec2d6d0 con 0x7f9f2c10b070 2024-09-13T06:10:01.509 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.507+0000 7f9f3acdd640 1 -- 172.21.15.194:0/2896603289 <== osd.2 v2:172.21.15.194:6800/815615585 16 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94035603781104] v33'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f3000e6c0 con 0x7f9f2c10b070 2024-09-13T06:10:01.509 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.507+0000 7f9f3d9ce980 20 remove_watcher() i=3 2024-09-13T06:10:01.509 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.507+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94035603785728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55865ec2d6d0 con 0x55865ec1a6c0 2024-09-13T06:10:01.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.511+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/2896603289 <== osd.1 v2:172.21.15.194:6808/3135444559 32 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94035603785728] v33'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f3400a4d0 con 0x55865ec1a6c0 2024-09-13T06:10:01.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.511+0000 7f9f3d9ce980 20 remove_watcher() i=4 2024-09-13T06:10:01.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.511+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94035603778288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55865ec2d6d0 con 0x7f9f30037040 2024-09-13T06:10:01.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.511+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/2896603289 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94035603778288] v33'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f3400a4d0 con 0x7f9f30037040 2024-09-13T06:10:01.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.511+0000 7f9f3d9ce980 20 remove_watcher() i=5 2024-09-13T06:10:01.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.511+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94035603789248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55865ec2d6d0 con 0x7f9f30037040 2024-09-13T06:10:01.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.515+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/2896603289 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94035603789248] v33'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f3400a4d0 con 0x7f9f30037040 2024-09-13T06:10:01.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.515+0000 7f9f3d9ce980 20 remove_watcher() i=6 2024-09-13T06:10:01.516 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.515+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2896603289 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94035603787728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55865ec2d6d0 con 0x7f9f30037040 2024-09-13T06:10:01.519 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.515+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/2896603289 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94035603787728] v33'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f3400a4d0 con 0x7f9f30037040 2024-09-13T06:10:01.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.515+0000 7f9f3d9ce980 20 remove_watcher() i=7 2024-09-13T06:10:01.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.515+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2896603289 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f9f30037040 msgr2=0x7f9f30036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.515+0000 7f9f3d9ce980 1 --2- 172.21.15.194:0/2896603289 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f9f30037040 0x7f9f30036410 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.515+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2896603289 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55865ec1a6c0 msgr2=0x55865ec1cb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.515+0000 7f9f3d9ce980 1 --2- 172.21.15.194:0/2896603289 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55865ec1a6c0 0x55865ec1cb50 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.515+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2896603289 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f9f2c10b070 msgr2=0x7f9f2c0ed820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.515+0000 7f9f3d9ce980 1 --2- 172.21.15.194:0/2896603289 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f9f2c10b070 0x7f9f2c0ed820 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.515+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2896603289 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55865ec1f050 msgr2=0x55865ec21440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.515+0000 7f9f3d9ce980 1 --2- 172.21.15.194:0/2896603289 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55865ec1f050 0x55865ec21440 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.515+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2896603289 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f9e04034600 msgr2=0x7f9e04036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.515+0000 7f9f3d9ce980 1 --2- 172.21.15.194:0/2896603289 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f9e04034600 0x7f9e04036ac0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x55865ebee5d0 tx=0x7f9f30010000 comp rx=0 tx=0).stop 2024-09-13T06:10:01.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.515+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2896603289 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55865ec08380 msgr2=0x55865ec0f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.515+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/2896603289 reap_dead start 2024-09-13T06:10:01.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.515+0000 7f9f3d9ce980 1 --2- 172.21.15.194:0/2896603289 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55865ec08380 0x55865ec0f650 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c0aef90 tx=0x7f9f2c0a6f50 comp rx=0 tx=0).stop 2024-09-13T06:10:01.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.515+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2896603289 shutdown_connections 2024-09-13T06:10:01.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.515+0000 7f9f3d9ce980 1 --2- 172.21.15.194:0/2896603289 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55865ec08380 0x55865ec0f650 secure :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c0aef90 tx=0x7f9f2c0a6f50 comp rx=0 tx=0).stop 2024-09-13T06:10:01.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.515+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2896603289 >> 172.21.15.194:0/2896603289 conn(0x55865ec047f0 msgr2=0x55865ec028c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:01.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.515+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2896603289 shutdown_connections 2024-09-13T06:10:01.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.515+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2896603289 wait complete. 2024-09-13T06:10:01.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.519+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2857750439 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f9e14034650 msgr2=0x7f9e14036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.519+0000 7f9f3d9ce980 1 --2- 172.21.15.194:0/2857750439 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f9e14034650 0x7f9e14036b10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x55865ebea5d0 tx=0x7f9f3000f000 comp rx=0 tx=0).stop 2024-09-13T06:10:01.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.519+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2857750439 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55865ebfbca0 msgr2=0x55865ebfc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.519+0000 7f9f3d9ce980 1 --2- 172.21.15.194:0/2857750439 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55865ebfbca0 0x55865ebfc0c0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c006b40 tx=0x7f9f2c0b56c0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.519+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2857750439 shutdown_connections 2024-09-13T06:10:01.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.519+0000 7f9f3d9ce980 1 --2- 172.21.15.194:0/2857750439 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f9e14034650 0x7f9e14036b10 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.519+0000 7f9f3d9ce980 1 --2- 172.21.15.194:0/2857750439 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55865ebfbca0 0x55865ebfc0c0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.519+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2857750439 >> 172.21.15.194:0/2857750439 conn(0x55865ebf0df0 msgr2=0x55865ebf3870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:01.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.519+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2857750439 shutdown_connections 2024-09-13T06:10:01.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.519+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/2857750439 wait complete. 2024-09-13T06:10:01.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.519+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/1337609533 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55865eaec230 msgr2=0x55865ebe4e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.519+0000 7f9f3d9ce980 1 --2- 172.21.15.194:0/1337609533 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55865eaec230 0x55865ebe4e10 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.519+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/1337609533 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55865ebeb690 msgr2=0x55865ebeda80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.519+0000 7f9f3d9ce980 1 --2- 172.21.15.194:0/1337609533 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55865ebeb690 0x55865ebeda80 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.519+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/1337609533 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55865ebe7600 msgr2=0x55865ebe9aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.519+0000 7f9f3d9ce980 1 --2- 172.21.15.194:0/1337609533 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55865ebe7600 0x55865ebe9aa0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.519+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/1337609533 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f9e20034650 msgr2=0x7f9e20036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.519+0000 7f9f3d9ce980 1 --2- 172.21.15.194:0/1337609533 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f9e20034650 0x7f9e20036b10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9f30001da0 tx=0x7f9f30001300 comp rx=0 tx=0).stop 2024-09-13T06:10:01.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.519+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/1337609533 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55865eaeb8e0 msgr2=0x55865ebdde80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.519+0000 7f9f3d9ce980 1 --2- 172.21.15.194:0/1337609533 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55865eaeb8e0 0x55865ebdde80 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c019930 tx=0x7f9f2c018020 comp rx=0 tx=0).stop 2024-09-13T06:10:01.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.519+0000 7f9f3bcdf640 1 -- 172.21.15.194:0/1337609533 reap_dead start 2024-09-13T06:10:01.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.519+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/1337609533 shutdown_connections 2024-09-13T06:10:01.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.519+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/1337609533 >> 172.21.15.194:0/1337609533 conn(0x55865ea5f230 msgr2=0x55865ebd1400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:01.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.519+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/1337609533 shutdown_connections 2024-09-13T06:10:01.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.519+0000 7f9f3d9ce980 1 -- 172.21.15.194:0/1337609533 wait complete. 2024-09-13T06:10:01.530 INFO:teuthology.orchestra.run.smithi194.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"0faf3484-cad7-4c8f-892b-62107a753816","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1","marker":"52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-13T06:10:00.832857Z","creation_time":"2024-09-13T06:09:56.926052Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":0,"size_actual":0,"size_utilized":0,"size_kb":0,"size_kb_actual":0,"size_kb_utilized":0,"num_objects":0}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-09-13T06:10:01.530 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '0faf3484-cad7-4c8f-892b-62107a753816', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1', 'marker': '52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-13T06:10:00.832857Z', 'creation_time': '2024-09-13T06:09:56.926052Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-13T06:10:01.530 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'list'] 2024-09-13T06:10:01.531 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'list'] 2024-09-13T06:10:01.531 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log list 2024-09-13T06:10:01.605 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:10:01.605 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:10:01.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.603+0000 7f80ab41d980 1 Processor -- start 2024-09-13T06:10:01.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.603+0000 7f80ab41d980 1 -- start start 2024-09-13T06:10:01.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.607+0000 7f80ab41d980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55a9409d0530 0x55a9409d0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:01.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.607+0000 7f80ab41d980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a940859ae0 con 0x55a9409d0e80 2024-09-13T06:10:01.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.607+0000 7f80ab41d980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x55a94087de30 con 0x55a9409d0530 2024-09-13T06:10:01.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.607+0000 7f80a8f2d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55a9409d0530 0x55a9409d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:01.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.607+0000 7f80a8f2d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55a9409d0530 0x55a9409d0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:46296/0 (socket says 172.21.15.194:46296) 2024-09-13T06:10:01.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.607+0000 7f80a8f2d640 1 -- 172.21.15.194:0/3527450350 learned_addr learned my addr 172.21.15.194:0/3527450350 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:01.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.607+0000 7f80a8f2d640 1 -- 172.21.15.194:0/3527450350 >> v1:172.21.15.120:6789/0 conn(0x55a9409d0e80 legacy=0x55a9409d5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.607+0000 7f80a8f2d640 1 -- 172.21.15.194:0/3527450350 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9409d8150 con 0x55a9409d0530 2024-09-13T06:10:01.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.607+0000 7f80a8f2d640 1 --2- 172.21.15.194:0/3527450350 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a9409d0530 0x55a9409d0910 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f80a000a750 tx=0x7f80a001d200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb2f74f5e4947e4e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:01.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.607+0000 7f80a7f2b640 1 -- 172.21.15.194:0/3527450350 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80a00b1070 con 0x55a9409d0530 2024-09-13T06:10:01.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.607+0000 7f80a7f2b640 1 -- 172.21.15.194:0/3527450350 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80a000a200 con 0x55a9409d0530 2024-09-13T06:10:01.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.607+0000 7f80a7f2b640 1 -- 172.21.15.194:0/3527450350 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80a00085a0 con 0x55a9409d0530 2024-09-13T06:10:01.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.611+0000 7f80ab41d980 1 -- 172.21.15.194:0/3527450350 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a9409d0530 msgr2=0x55a9409d0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.611+0000 7f80ab41d980 1 --2- 172.21.15.194:0/3527450350 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a9409d0530 0x55a9409d0910 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f80a000a750 tx=0x7f80a001d200 comp rx=0 tx=0).stop 2024-09-13T06:10:01.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.611+0000 7f80ab41d980 1 -- 172.21.15.194:0/3527450350 shutdown_connections 2024-09-13T06:10:01.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.611+0000 7f80ab41d980 1 --2- 172.21.15.194:0/3527450350 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a9409d0530 0x55a9409d0910 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.611+0000 7f80ab41d980 1 -- 172.21.15.194:0/3527450350 >> 172.21.15.194:0/3527450350 conn(0x55a9409cc050 msgr2=0x55a9409ce470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:01.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.611+0000 7f80ab41d980 1 -- 172.21.15.194:0/3527450350 shutdown_connections 2024-09-13T06:10:01.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.611+0000 7f80ab41d980 1 -- 172.21.15.194:0/3527450350 wait complete. 2024-09-13T06:10:01.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.627+0000 7f80ab41d980 1 Processor -- start 2024-09-13T06:10:01.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.627+0000 7f80ab41d980 1 -- start start 2024-09-13T06:10:01.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.627+0000 7f80ab41d980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a9409d0530 0x55a940aba870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:01.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.627+0000 7f80ab41d980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55a94087f200 con 0x55a9409d0530 2024-09-13T06:10:01.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.627+0000 7f80a8f2d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a9409d0530 0x55a940aba870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:01.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.627+0000 7f80a8f2d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a9409d0530 0x55a940aba870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:46312/0 (socket says 172.21.15.194:46312) 2024-09-13T06:10:01.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.627+0000 7f80a8f2d640 1 -- 172.21.15.194:0/320077225 learned_addr learned my addr 172.21.15.194:0/320077225 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:01.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.627+0000 7f80a8f2d640 1 -- 172.21.15.194:0/320077225 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a940abae40 con 0x55a9409d0530 2024-09-13T06:10:01.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.627+0000 7f80a8f2d640 1 --2- 172.21.15.194:0/320077225 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a9409d0530 0x55a940aba870 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f80a000a750 tx=0x7f80a0003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2e7ae22e51755e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:01.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.627+0000 7f7f96e0d640 1 -- 172.21.15.194:0/320077225 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80a00b1050 con 0x55a9409d0530 2024-09-13T06:10:01.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.627+0000 7f7f96e0d640 1 -- 172.21.15.194:0/320077225 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80a00b2040 con 0x55a9409d0530 2024-09-13T06:10:01.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.627+0000 7f7f96e0d640 1 -- 172.21.15.194:0/320077225 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80a0008820 con 0x55a9409d0530 2024-09-13T06:10:01.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.627+0000 7f80ab41d980 1 -- 172.21.15.194:0/320077225 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a9409d0530 msgr2=0x55a940aba870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.627+0000 7f80ab41d980 1 --2- 172.21.15.194:0/320077225 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a9409d0530 0x55a940aba870 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f80a000a750 tx=0x7f80a0003030 comp rx=0 tx=0).stop 2024-09-13T06:10:01.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.627+0000 7f80ab41d980 1 -- 172.21.15.194:0/320077225 shutdown_connections 2024-09-13T06:10:01.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.627+0000 7f80ab41d980 1 --2- 172.21.15.194:0/320077225 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a9409d0530 0x55a940aba870 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.627+0000 7f80ab41d980 1 -- 172.21.15.194:0/320077225 >> 172.21.15.194:0/320077225 conn(0x55a9409cc050 msgr2=0x55a940ab64a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:01.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.627+0000 7f80ab41d980 1 -- 172.21.15.194:0/320077225 shutdown_connections 2024-09-13T06:10:01.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.627+0000 7f80ab41d980 1 -- 172.21.15.194:0/320077225 wait complete. 2024-09-13T06:10:01.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.627+0000 7f80ab41d980 1 Processor -- start 2024-09-13T06:10:01.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.627+0000 7f80ab41d980 1 -- start start 2024-09-13T06:10:01.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.627+0000 7f80ab41d980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a9409d0530 0x55a940ac5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:01.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.627+0000 7f80ab41d980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55a9409d7b90 con 0x55a9409d0530 2024-09-13T06:10:01.631 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.627+0000 7f80a8f2d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a9409d0530 0x55a940ac5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:01.631 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.627+0000 7f80a8f2d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a9409d0530 0x55a940ac5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:46320/0 (socket says 172.21.15.194:46320) 2024-09-13T06:10:01.631 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.627+0000 7f80a8f2d640 1 -- 172.21.15.194:0/2030210716 learned_addr learned my addr 172.21.15.194:0/2030210716 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:01.631 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.631+0000 7f80a8f2d640 1 -- 172.21.15.194:0/2030210716 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a940ac63f0 con 0x55a9409d0530 2024-09-13T06:10:01.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.631+0000 7f80a8f2d640 1 --2- 172.21.15.194:0/2030210716 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a9409d0530 0x55a940ac5eb0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f80a001daa0 tx=0x7f80a0019fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:01.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.631+0000 7f7f9560a640 1 -- 172.21.15.194:0/2030210716 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80a00c4070 con 0x55a9409d0530 2024-09-13T06:10:01.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.631+0000 7f7f9560a640 1 -- 172.21.15.194:0/2030210716 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80a0007740 con 0x55a9409d0530 2024-09-13T06:10:01.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.631+0000 7f80ab41d980 1 -- 172.21.15.194:0/2030210716 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a940ac6680 con 0x55a9409d0530 2024-09-13T06:10:01.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.631+0000 7f7f9560a640 1 -- 172.21.15.194:0/2030210716 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80a0007a40 con 0x55a9409d0530 2024-09-13T06:10:01.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.631+0000 7f80ab41d980 1 -- 172.21.15.194:0/2030210716 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a940ac9360 con 0x55a9409d0530 2024-09-13T06:10:01.634 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.631+0000 7f7f9560a640 1 -- 172.21.15.194:0/2030210716 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f80a00c7070 con 0x55a9409d0530 2024-09-13T06:10:01.634 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.631+0000 7f7f9560a640 1 --2- 172.21.15.194:0/2030210716 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7f900346a0 0x7f7f90036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:01.634 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.631+0000 7f7f9560a640 1 -- 172.21.15.194:0/2030210716 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f80a00bd070 con 0x55a9409d0530 2024-09-13T06:10:01.634 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.631+0000 7f80a872c640 1 --2- 172.21.15.194:0/2030210716 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7f900346a0 0x7f7f90036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:01.634 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.631+0000 7f80ab41d980 1 --2- 172.21.15.194:0/2030210716 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55a9409d0e80 0x55a940accfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:01.634 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.631+0000 7f80ab41d980 1 -- 172.21.15.194:0/2030210716 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a940acd4f0 con 0x55a9409d0e80 2024-09-13T06:10:01.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.631+0000 7f80a972e640 1 --2- 172.21.15.194:0/2030210716 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55a9409d0e80 0x55a940accfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:01.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.631+0000 7f80a872c640 1 --2- 172.21.15.194:0/2030210716 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7f900346a0 0x7f7f90036b60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8090001e20 tx=0x7f80900013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:01.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.631+0000 7f80a972e640 1 --2- 172.21.15.194:0/2030210716 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55a9409d0e80 0x55a940accfb0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:01.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.631+0000 7f80a972e640 1 -- 172.21.15.194:0/2030210716 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f809800a4d0 con 0x55a9409d0e80 2024-09-13T06:10:01.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.631+0000 7f80ab41d980 1 -- 172.21.15.194:0/2030210716 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a940aca580 con 0x55a9409d0e80 2024-09-13T06:10:01.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.631+0000 7f80a972e640 1 -- 172.21.15.194:0/2030210716 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f809800a4d0 con 0x55a9409d0e80 2024-09-13T06:10:01.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.631+0000 7f80ab41d980 1 --2- 172.21.15.194:0/2030210716 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55a940acf840 0x55a940ad1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:01.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.631+0000 7f80ab41d980 1 -- 172.21.15.194:0/2030210716 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a940ad2320 con 0x55a940acf840 2024-09-13T06:10:01.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.631+0000 7f80a8f2d640 1 --2- 172.21.15.194:0/2030210716 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55a940acf840 0x55a940ad1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:01.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.635+0000 7f80a8f2d640 1 --2- 172.21.15.194:0/2030210716 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55a940acf840 0x55a940ad1c30 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:01.637 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.635+0000 7f80a8f2d640 1 -- 172.21.15.194:0/2030210716 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f80a00d0070 con 0x55a940acf840 2024-09-13T06:10:01.637 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.635+0000 7f80ab41d980 1 -- 172.21.15.194:0/2030210716 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a940ace6e0 con 0x55a9409d0e80 2024-09-13T06:10:01.637 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.635+0000 7f80a972e640 1 -- 172.21.15.194:0/2030210716 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f809800a4d0 con 0x55a9409d0e80 2024-09-13T06:10:01.637 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.635+0000 7f80ab41d980 1 --2- 172.21.15.194:0/2030210716 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55a940ad3780 0x55a940ad5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:01.637 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.635+0000 7f80ab41d980 1 -- 172.21.15.194:0/2030210716 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a940ad6260 con 0x55a940ad3780 2024-09-13T06:10:01.637 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.635+0000 7f80a872c640 1 --2- 172.21.15.194:0/2030210716 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55a940ad3780 0x55a940ad5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:01.637 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.635+0000 7f80a872c640 1 --2- 172.21.15.194:0/2030210716 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55a940ad3780 0x55a940ad5b70 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:01.638 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.635+0000 7f80a872c640 1 -- 172.21.15.194:0/2030210716 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f809000d040 con 0x55a940ad3780 2024-09-13T06:10:01.638 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.635+0000 7f80ab41d980 1 Processor -- start 2024-09-13T06:10:01.638 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.635+0000 7f80ab41d980 1 -- start start 2024-09-13T06:10:01.638 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.635+0000 7f80ab41d980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a940ae3d30 0x55a940ae4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:01.638 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.635+0000 7f80ab41d980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55a9408d8800 con 0x55a940ae3d30 2024-09-13T06:10:01.638 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.635+0000 7f80a8f2d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a940ae3d30 0x55a940ae4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:01.638 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.635+0000 7f80a8f2d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a940ae3d30 0x55a940ae4150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:46328/0 (socket says 172.21.15.194:46328) 2024-09-13T06:10:01.638 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.635+0000 7f80a8f2d640 1 -- 172.21.15.194:0/3550557486 learned_addr learned my addr 172.21.15.194:0/3550557486 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:01.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.635+0000 7f80a8f2d640 1 -- 172.21.15.194:0/3550557486 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a940ae4690 con 0x55a940ae3d30 2024-09-13T06:10:01.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.635+0000 7f80a8f2d640 1 --2- 172.21.15.194:0/3550557486 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a940ae3d30 0x55a940ae4150 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f80a0000c10 tx=0x7f80a00e4480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:01.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.635+0000 7f7f8e7fc640 1 -- 172.21.15.194:0/3550557486 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80a00c0920 con 0x55a940ae3d30 2024-09-13T06:10:01.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.635+0000 7f7f8e7fc640 1 -- 172.21.15.194:0/3550557486 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80a00c0ac0 con 0x55a940ae3d30 2024-09-13T06:10:01.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.635+0000 7f80ab41d980 1 -- 172.21.15.194:0/3550557486 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a940ae4920 con 0x55a940ae3d30 2024-09-13T06:10:01.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.635+0000 7f7f8e7fc640 1 -- 172.21.15.194:0/3550557486 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80a00e49e0 con 0x55a940ae3d30 2024-09-13T06:10:01.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.639+0000 7f80ab41d980 1 -- 172.21.15.194:0/3550557486 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a940ae75a0 con 0x55a940ae3d30 2024-09-13T06:10:01.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.639+0000 7f7f8e7fc640 1 -- 172.21.15.194:0/3550557486 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f80a00dc030 con 0x55a940ae3d30 2024-09-13T06:10:01.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.639+0000 7f7f8e7fc640 1 --2- 172.21.15.194:0/3550557486 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7f80034650 0x7f7f80036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:01.642 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.639+0000 7f7f8e7fc640 1 -- 172.21.15.194:0/3550557486 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f80a0009040 con 0x55a940ae3d30 2024-09-13T06:10:01.642 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.639+0000 7f80a872c640 1 --2- 172.21.15.194:0/3550557486 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7f80034650 0x7f7f80036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:01.642 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.639+0000 7f80ab41d980 1 Processor -- start 2024-09-13T06:10:01.642 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.639+0000 7f80ab41d980 1 -- start start 2024-09-13T06:10:01.642 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.639+0000 7f80a872c640 1 --2- 172.21.15.194:0/3550557486 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7f80034650 0x7f7f80036b10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x55a940ad26f0 tx=0x7f8090006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:01.642 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.639+0000 7f80ab41d980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a940af06a0 0x55a940af0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:01.642 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.639+0000 7f80ab41d980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55a940abb100 con 0x55a940af06a0 2024-09-13T06:10:01.642 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.639+0000 7f80a8f2d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a940af06a0 0x55a940af0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:01.642 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.639+0000 7f80a8f2d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a940af06a0 0x55a940af0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:46330/0 (socket says 172.21.15.194:46330) 2024-09-13T06:10:01.642 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.639+0000 7f80a8f2d640 1 -- 172.21.15.194:0/292432739 learned_addr learned my addr 172.21.15.194:0/292432739 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:01.642 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.639+0000 7f80a8f2d640 1 -- 172.21.15.194:0/292432739 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a940af1070 con 0x55a940af06a0 2024-09-13T06:10:01.645 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.639+0000 7f80a8f2d640 1 --2- 172.21.15.194:0/292432739 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a940af06a0 0x55a940af0aa0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f80a00b3d70 tx=0x7f80a00d3ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b31cb733f80f55f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:01.645 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.639+0000 7f7f7ffff640 1 -- 172.21.15.194:0/292432739 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80a00fd070 con 0x55a940af06a0 2024-09-13T06:10:01.645 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.639+0000 7f7f7ffff640 1 -- 172.21.15.194:0/292432739 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80a00c9d70 con 0x55a940af06a0 2024-09-13T06:10:01.645 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.639+0000 7f7f7ffff640 1 -- 172.21.15.194:0/292432739 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80a00b3390 con 0x55a940af06a0 2024-09-13T06:10:01.645 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.639+0000 7f80ab41d980 1 -- 172.21.15.194:0/292432739 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a940af06a0 msgr2=0x55a940af0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.645 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.639+0000 7f80ab41d980 1 --2- 172.21.15.194:0/292432739 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a940af06a0 0x55a940af0aa0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f80a00b3d70 tx=0x7f80a00d3ae0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.645 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.639+0000 7f80ab41d980 1 -- 172.21.15.194:0/292432739 shutdown_connections 2024-09-13T06:10:01.645 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.639+0000 7f80ab41d980 1 --2- 172.21.15.194:0/292432739 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a940af06a0 0x55a940af0aa0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.645 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.639+0000 7f80ab41d980 1 -- 172.21.15.194:0/292432739 >> 172.21.15.194:0/292432739 conn(0x55a940aeca80 msgr2=0x55a940aeab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:01.645 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.639+0000 7f80ab41d980 1 -- 172.21.15.194:0/292432739 shutdown_connections 2024-09-13T06:10:01.646 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.643+0000 7f80ab41d980 1 -- 172.21.15.194:0/292432739 wait complete. 2024-09-13T06:10:01.646 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.643+0000 7f80ab41d980 1 Processor -- start 2024-09-13T06:10:01.646 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.643+0000 7f80ab41d980 1 -- start start 2024-09-13T06:10:01.646 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.643+0000 7f80ab41d980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a940af06a0 0x55a940af78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:01.646 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.643+0000 7f80ab41d980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55a940af14f0 con 0x55a940af06a0 2024-09-13T06:10:01.646 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.643+0000 7f80a8f2d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a940af06a0 0x55a940af78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:01.646 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.643+0000 7f80a8f2d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a940af06a0 0x55a940af78e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:46336/0 (socket says 172.21.15.194:46336) 2024-09-13T06:10:01.646 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.643+0000 7f80a8f2d640 1 -- 172.21.15.194:0/846101145 learned_addr learned my addr 172.21.15.194:0/846101145 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:01.646 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.643+0000 7f80a8f2d640 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a940af7e20 con 0x55a940af06a0 2024-09-13T06:10:01.646 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.643+0000 7f80a8f2d640 1 --2- 172.21.15.194:0/846101145 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a940af06a0 0x55a940af78e0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f80a00b3d70 tx=0x7f80a00dfee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:01.646 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.643+0000 7f7f7e7fc640 1 -- 172.21.15.194:0/846101145 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80a0106070 con 0x55a940af06a0 2024-09-13T06:10:01.646 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.643+0000 7f7f7e7fc640 1 -- 172.21.15.194:0/846101145 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80a00edb50 con 0x55a940af06a0 2024-09-13T06:10:01.646 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.643+0000 7f80ab41d980 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a940af7e20 con 0x55a940af06a0 2024-09-13T06:10:01.647 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.643+0000 7f7f7e7fc640 1 -- 172.21.15.194:0/846101145 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80a00fd040 con 0x55a940af06a0 2024-09-13T06:10:01.647 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.643+0000 7f80ab41d980 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a940af7e20 con 0x55a940af06a0 2024-09-13T06:10:01.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.643+0000 7f7f7e7fc640 1 -- 172.21.15.194:0/846101145 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f80a0109070 con 0x55a940af06a0 2024-09-13T06:10:01.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.643+0000 7f80ab41d980 20 rados->read ofs=0 len=0 2024-09-13T06:10:01.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.643+0000 7f7f7e7fc640 1 --2- 172.21.15.194:0/846101145 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7f740346a0 0x7f7f74036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:01.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.643+0000 7f7f7e7fc640 1 -- 172.21.15.194:0/846101145 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f80a010ccb0 con 0x55a940af06a0 2024-09-13T06:10:01.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.643+0000 7f80a872c640 1 --2- 172.21.15.194:0/846101145 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7f740346a0 0x7f7f74036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:01.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.643+0000 7f80ab41d980 1 --2- 172.21.15.194:0/846101145 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55a940b02920 0x55a940b04dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:01.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.643+0000 7f80ab41d980 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a940b05510 con 0x55a940b02920 2024-09-13T06:10:01.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.643+0000 7f80a972e640 1 --2- 172.21.15.194:0/846101145 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55a940b02920 0x55a940b04dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:01.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.647+0000 7f80a872c640 1 --2- 172.21.15.194:0/846101145 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7f740346a0 0x7f7f74036b60 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x55a940ace6b0 tx=0x7f8090011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:01.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.647+0000 7f80a972e640 1 --2- 172.21.15.194:0/846101145 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55a940b02920 0x55a940b04dc0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:01.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.647+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f809800a4d0 con 0x55a940b02920 2024-09-13T06:10:01.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.647+0000 7f80ab41d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:01.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.647+0000 7f80ab41d980 20 realm 2024-09-13T06:10:01.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.647+0000 7f80ab41d980 20 rados->read ofs=0 len=0 2024-09-13T06:10:01.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.647+0000 7f80ab41d980 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a940b05920 con 0x55a940b02920 2024-09-13T06:10:01.652 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.647+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f809800a4d0 con 0x55a940b02920 2024-09-13T06:10:01.652 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.647+0000 7f80ab41d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:01.652 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.647+0000 7f80ab41d980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:10:01.652 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.647+0000 7f80ab41d980 20 rados->read ofs=0 len=0 2024-09-13T06:10:01.652 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.647+0000 7f80ab41d980 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a940b061c0 con 0x55a940b02920 2024-09-13T06:10:01.652 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.647+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f809800a4d0 con 0x55a940b02920 2024-09-13T06:10:01.652 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.647+0000 7f80ab41d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:01.652 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.647+0000 7f80ab41d980 20 rados->read ofs=0 len=0 2024-09-13T06:10:01.652 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.647+0000 7f80ab41d980 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a940b06560 con 0x55a940b02920 2024-09-13T06:10:01.652 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.647+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f809800a4d0 con 0x55a940b02920 2024-09-13T06:10:01.652 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.647+0000 7f80ab41d980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:10:01.652 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.647+0000 7f80ab41d980 20 rados->read ofs=0 len=0 2024-09-13T06:10:01.652 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.647+0000 7f80ab41d980 1 --2- 172.21.15.194:0/846101145 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55a940b072c0 0x55a940b096b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:01.652 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.647+0000 7f80ab41d980 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a940b09c30 con 0x55a940b072c0 2024-09-13T06:10:01.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.647+0000 7f80a8f2d640 1 --2- 172.21.15.194:0/846101145 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55a940b072c0 0x55a940b096b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:01.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.647+0000 7f80a8f2d640 1 --2- 172.21.15.194:0/846101145 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55a940b072c0 0x55a940b096b0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:01.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.647+0000 7f80a8f2d640 1 -- 172.21.15.194:0/846101145 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f80a0112070 con 0x55a940b072c0 2024-09-13T06:10:01.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.647+0000 7f80ab41d980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:10:01.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.647+0000 7f80ab41d980 20 searching for the correct realm 2024-09-13T06:10:01.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.647+0000 7f80ab41d980 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a940b0b490 con 0x55a940b072c0 2024-09-13T06:10:01.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.647+0000 7f80a8f2d640 1 -- 172.21.15.194:0/846101145 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80a0112070 con 0x55a940b072c0 2024-09-13T06:10:01.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.647+0000 7f80a8f2d640 1 --2- 172.21.15.194:0/846101145 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f80a010b070 0x7f80a0119540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:01.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.647+0000 7f80a8f2d640 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a940b0b490 con 0x7f80a010b070 2024-09-13T06:10:01.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.647+0000 7f80a872c640 1 --2- 172.21.15.194:0/846101145 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f80a010b070 0x7f80a0119540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:01.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.647+0000 7f80a872c640 1 --2- 172.21.15.194:0/846101145 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f80a010b070 0x7f80a0119540 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:01.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.647+0000 7f80a872c640 1 -- 172.21.15.194:0/846101145 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8090036040 con 0x7f80a010b070 2024-09-13T06:10:01.654 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.647+0000 7f80a872c640 1 --2- 172.21.15.194:0/846101145 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f809000f3d0 0x7f809000f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:01.654 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.647+0000 7f80a872c640 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a940b0b490 con 0x7f809000f3d0 2024-09-13T06:10:01.654 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.647+0000 7f80a972e640 1 --2- 172.21.15.194:0/846101145 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f809000f3d0 0x7f809000f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:01.654 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.651+0000 7f80a972e640 1 --2- 172.21.15.194:0/846101145 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f809000f3d0 0x7f809000f7d0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:01.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.651+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f809800a4d0 con 0x7f809000f3d0 2024-09-13T06:10:01.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.651+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a940b06560 con 0x55a940b02920 2024-09-13T06:10:01.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.651+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f809800a4d0 con 0x55a940b02920 2024-09-13T06:10:01.658 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.651+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a940b06560 con 0x55a940b02920 2024-09-13T06:10:01.658 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.651+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f809800a4d0 con 0x55a940b02920 2024-09-13T06:10:01.658 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.651+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a940b06560 con 0x7f809000f3d0 2024-09-13T06:10:01.658 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.651+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f809800a4d0 con 0x7f809000f3d0 2024-09-13T06:10:01.658 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.651+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a940b06560 con 0x7f809000f3d0 2024-09-13T06:10:01.658 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.651+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f809800a4d0 con 0x7f809000f3d0 2024-09-13T06:10:01.658 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.651+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a940b06560 con 0x7f80a010b070 2024-09-13T06:10:01.658 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.651+0000 7f80a872c640 1 -- 172.21.15.194:0/846101145 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8090036040 con 0x7f80a010b070 2024-09-13T06:10:01.658 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.651+0000 7f80a872c640 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a940b06560 con 0x55a940b072c0 2024-09-13T06:10:01.658 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.651+0000 7f80a8f2d640 1 -- 172.21.15.194:0/846101145 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80a0112070 con 0x55a940b072c0 2024-09-13T06:10:01.658 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.651+0000 7f80a8f2d640 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a940b06560 con 0x55a940b02920 2024-09-13T06:10:01.658 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.651+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f809800a4d0 con 0x55a940b02920 2024-09-13T06:10:01.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.651+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a940b06560 con 0x7f809000f3d0 2024-09-13T06:10:01.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.655+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f809800a4d0 con 0x7f809000f3d0 2024-09-13T06:10:01.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.655+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a940b06560 con 0x55a940b02920 2024-09-13T06:10:01.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.655+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f809800a4d0 con 0x55a940b02920 2024-09-13T06:10:01.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.655+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a940b06560 con 0x7f80a010b070 2024-09-13T06:10:01.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.655+0000 7f80a872c640 1 -- 172.21.15.194:0/846101145 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8090036040 con 0x7f80a010b070 2024-09-13T06:10:01.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.655+0000 7f80a872c640 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a940b06560 con 0x55a940b072c0 2024-09-13T06:10:01.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.655+0000 7f80a8f2d640 1 -- 172.21.15.194:0/846101145 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80a0112070 con 0x55a940b072c0 2024-09-13T06:10:01.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.655+0000 7f80a8f2d640 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a940b06560 con 0x55a940b072c0 2024-09-13T06:10:01.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.655+0000 7f80a8f2d640 1 -- 172.21.15.194:0/846101145 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80a0112070 con 0x55a940b072c0 2024-09-13T06:10:01.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.655+0000 7f80a8f2d640 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a940b06560 con 0x7f809000f3d0 2024-09-13T06:10:01.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.655+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f809800a4d0 con 0x7f809000f3d0 2024-09-13T06:10:01.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.655+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a940b06560 con 0x55a940b072c0 2024-09-13T06:10:01.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.655+0000 7f80a8f2d640 1 -- 172.21.15.194:0/846101145 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80a0112070 con 0x55a940b072c0 2024-09-13T06:10:01.660 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.655+0000 7f80a8f2d640 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a940b06560 con 0x55a940b072c0 2024-09-13T06:10:01.660 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.655+0000 7f80a8f2d640 1 -- 172.21.15.194:0/846101145 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80a0112070 con 0x55a940b072c0 2024-09-13T06:10:01.660 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.655+0000 7f80a8f2d640 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a940b06560 con 0x55a940b02920 2024-09-13T06:10:01.660 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.655+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f809800a4d0 con 0x55a940b02920 2024-09-13T06:10:01.660 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.655+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a940b06560 con 0x55a940b02920 2024-09-13T06:10:01.660 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.655+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f809800a4d0 con 0x55a940b02920 2024-09-13T06:10:01.660 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.655+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a940b06560 con 0x7f809000f3d0 2024-09-13T06:10:01.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.659+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f809800a4d0 con 0x7f809000f3d0 2024-09-13T06:10:01.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.659+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a940b06560 con 0x55a940b072c0 2024-09-13T06:10:01.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.659+0000 7f80a8f2d640 1 -- 172.21.15.194:0/846101145 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80a0112070 con 0x55a940b072c0 2024-09-13T06:10:01.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.659+0000 7f80a8f2d640 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a940b06560 con 0x7f80a010b070 2024-09-13T06:10:01.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.659+0000 7f80a872c640 1 -- 172.21.15.194:0/846101145 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8090036040 con 0x7f80a010b070 2024-09-13T06:10:01.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.659+0000 7f80a872c640 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a940b06560 con 0x55a940b02920 2024-09-13T06:10:01.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.659+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f809800a4d0 con 0x55a940b02920 2024-09-13T06:10:01.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.659+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a940b06560 con 0x7f809000f3d0 2024-09-13T06:10:01.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.659+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f809800a4d0 con 0x7f809000f3d0 2024-09-13T06:10:01.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.659+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a940b06560 con 0x55a940b072c0 2024-09-13T06:10:01.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.659+0000 7f80a8f2d640 1 -- 172.21.15.194:0/846101145 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f80a0112070 con 0x55a940b072c0 2024-09-13T06:10:01.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.659+0000 7f80a8f2d640 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a940b06560 con 0x7f809000f3d0 2024-09-13T06:10:01.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.659+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f809800a4d0 con 0x7f809000f3d0 2024-09-13T06:10:01.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.659+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a940b06560 con 0x7f80a010b070 2024-09-13T06:10:01.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.659+0000 7f80a872c640 1 -- 172.21.15.194:0/846101145 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8090036040 con 0x7f80a010b070 2024-09-13T06:10:01.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.659+0000 7f80a872c640 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a940b06560 con 0x55a940b072c0 2024-09-13T06:10:01.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.659+0000 7f80a8f2d640 1 -- 172.21.15.194:0/846101145 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80a0112070 con 0x55a940b072c0 2024-09-13T06:10:01.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.659+0000 7f80a8f2d640 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a940b06560 con 0x7f809000f3d0 2024-09-13T06:10:01.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.659+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f809800a4d0 con 0x7f809000f3d0 2024-09-13T06:10:01.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.659+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a940b06560 con 0x55a940b02920 2024-09-13T06:10:01.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.659+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f809800a4d0 con 0x55a940b02920 2024-09-13T06:10:01.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.659+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a940b06560 con 0x7f80a010b070 2024-09-13T06:10:01.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.659+0000 7f80a872c640 1 -- 172.21.15.194:0/846101145 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8090036040 con 0x7f80a010b070 2024-09-13T06:10:01.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.659+0000 7f80ab41d980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:10:01.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.659+0000 7f80ab41d980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:10:01.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.659+0000 7f80ab41d980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:10:01.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.659+0000 7f80ab41d980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:10:01.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.659+0000 7f80ab41d980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:10:01.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.659+0000 7f80ab41d980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:10:01.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.659+0000 7f80ab41d980 20 rados->read ofs=0 len=0 2024-09-13T06:10:01.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.659+0000 7f80ab41d980 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a940b0a580 con 0x55a940b02920 2024-09-13T06:10:01.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.663+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f809800a4d0 con 0x55a940b02920 2024-09-13T06:10:01.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.663+0000 7f80ab41d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:01.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.663+0000 7f80ab41d980 20 rados->read ofs=0 len=0 2024-09-13T06:10:01.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.663+0000 7f80ab41d980 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a940b0ae20 con 0x55a940b02920 2024-09-13T06:10:01.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.663+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f809800a4d0 con 0x55a940b02920 2024-09-13T06:10:01.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.663+0000 7f80ab41d980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:10:01.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.663+0000 7f80ab41d980 20 rados->read ofs=0 len=0 2024-09-13T06:10:01.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.663+0000 7f80ab41d980 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a940b0a1c0 con 0x7f80a010b070 2024-09-13T06:10:01.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.663+0000 7f80a872c640 1 -- 172.21.15.194:0/846101145 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8090036040 con 0x7f80a010b070 2024-09-13T06:10:01.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.663+0000 7f80ab41d980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:10:01.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.663+0000 7f80ab41d980 20 zone default found 2024-09-13T06:10:01.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.663+0000 7f80ab41d980 4 Realm: () 2024-09-13T06:10:01.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.663+0000 7f80ab41d980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:10:01.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.663+0000 7f80ab41d980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:10:01.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.663+0000 7f80ab41d980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:10:01.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.663+0000 7f80ab41d980 20 zonegroup default 2024-09-13T06:10:01.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.663+0000 7f80ab41d980 20 rados->read ofs=0 len=0 2024-09-13T06:10:01.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.663+0000 7f80ab41d980 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a940b0ae20 con 0x7f809000f3d0 2024-09-13T06:10:01.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.663+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f809800a4d0 con 0x7f809000f3d0 2024-09-13T06:10:01.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.663+0000 7f80ab41d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:01.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.663+0000 7f80ab41d980 20 rados->read ofs=0 len=0 2024-09-13T06:10:01.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.663+0000 7f80ab41d980 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a940b0d320 con 0x55a940b072c0 2024-09-13T06:10:01.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.663+0000 7f80a8f2d640 1 -- 172.21.15.194:0/846101145 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f80a0112070 con 0x55a940b072c0 2024-09-13T06:10:01.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.663+0000 7f80ab41d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:01.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.663+0000 7f80ab41d980 20 rados->read ofs=0 len=0 2024-09-13T06:10:01.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.663+0000 7f80ab41d980 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a940b0d6c0 con 0x55a940b072c0 2024-09-13T06:10:01.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.663+0000 7f80a8f2d640 1 -- 172.21.15.194:0/846101145 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f80a0112070 con 0x55a940b072c0 2024-09-13T06:10:01.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.663+0000 7f80ab41d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:01.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.663+0000 7f80ab41d980 20 started sync module instance, tier type = 2024-09-13T06:10:01.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.663+0000 7f80ab41d980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:10:01.670 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.663+0000 7f80ab41d980 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a940b0c7c0 con 0x7f80a010b070 2024-09-13T06:10:01.671 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.663+0000 7f80a872c640 1 -- 172.21.15.194:0/846101145 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(44 notify.0 [create] v33'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8090036040 con 0x7f80a010b070 2024-09-13T06:10:01.671 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.663+0000 7f80ab41d980 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94185423162288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a940b0df10 con 0x7f80a010b070 2024-09-13T06:10:01.671 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.663+0000 7f80ab41d980 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a940b0e760 con 0x55a940b02920 2024-09-13T06:10:01.671 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.667+0000 7f80a872c640 1 -- 172.21.15.194:0/846101145 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94185423162288] v33'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8090036040 con 0x7f80a010b070 2024-09-13T06:10:01.672 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.667+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v33'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f809800a4d0 con 0x55a940b02920 2024-09-13T06:10:01.672 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.667+0000 7f80ab41d980 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94185423166048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a940b0e760 con 0x55a940b02920 2024-09-13T06:10:01.672 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.667+0000 7f80ab41d980 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a940b0f240 con 0x55a940b072c0 2024-09-13T06:10:01.672 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.667+0000 7f80a8f2d640 1 -- 172.21.15.194:0/846101145 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v33'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80a0112070 con 0x55a940b072c0 2024-09-13T06:10:01.672 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.667+0000 7f80ab41d980 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94185423170896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a940b0fae0 con 0x55a940b072c0 2024-09-13T06:10:01.672 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.667+0000 7f80ab41d980 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a940b104e0 con 0x7f80a010b070 2024-09-13T06:10:01.672 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.671+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94185423166048] v33'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f809800a4d0 con 0x55a940b02920 2024-09-13T06:10:01.672 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.671+0000 7f80a872c640 1 -- 172.21.15.194:0/846101145 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(50 notify.3 [create] v33'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8090036040 con 0x7f80a010b070 2024-09-13T06:10:01.672 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.671+0000 7f80ab41d980 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94185423168176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a940b108d0 con 0x7f80a010b070 2024-09-13T06:10:01.672 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.671+0000 7f80ab41d980 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a940b11290 con 0x55a940b02920 2024-09-13T06:10:01.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.671+0000 7f80a8f2d640 1 -- 172.21.15.194:0/846101145 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94185423170896] v33'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80a0112070 con 0x55a940b072c0 2024-09-13T06:10:01.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.671+0000 7f80a872c640 1 -- 172.21.15.194:0/846101145 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94185423168176] v33'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8090036040 con 0x7f80a010b070 2024-09-13T06:10:01.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.671+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v33'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f809800a4d0 con 0x55a940b02920 2024-09-13T06:10:01.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.671+0000 7f80ab41d980 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94185423175664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a940b10de0 con 0x55a940b02920 2024-09-13T06:10:01.674 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.671+0000 7f80ab41d980 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a940b11b30 con 0x7f809000f3d0 2024-09-13T06:10:01.675 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.675+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94185423175664] v33'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f809800a4d0 con 0x55a940b02920 2024-09-13T06:10:01.675 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.675+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(54 notify.5 [create] v33'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f809800a4d0 con 0x7f809000f3d0 2024-09-13T06:10:01.675 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.675+0000 7f80ab41d980 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94185423173168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a940b11850 con 0x7f809000f3d0 2024-09-13T06:10:01.676 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.675+0000 7f80ab41d980 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a940b120a0 con 0x7f809000f3d0 2024-09-13T06:10:01.677 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.675+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94185423173168] v33'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f809800a4d0 con 0x7f809000f3d0 2024-09-13T06:10:01.678 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.675+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(56 notify.6 [create] v33'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f809800a4d0 con 0x7f809000f3d0 2024-09-13T06:10:01.678 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.675+0000 7f80ab41d980 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94185423181184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a940b11ef0 con 0x7f809000f3d0 2024-09-13T06:10:01.678 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.675+0000 7f80ab41d980 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a940b12a10 con 0x7f809000f3d0 2024-09-13T06:10:01.679 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.679+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94185423181184] v33'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f809800a4d0 con 0x7f809000f3d0 2024-09-13T06:10:01.680 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.679+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(58 notify.7 [create] v33'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f809800a4d0 con 0x7f809000f3d0 2024-09-13T06:10:01.680 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.679+0000 7f80ab41d980 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94185423185120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a940b129d0 con 0x7f809000f3d0 2024-09-13T06:10:01.680 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.679+0000 7f80ab41d980 20 add_watcher() i=0 2024-09-13T06:10:01.680 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.679+0000 7f80ab41d980 20 add_watcher() i=1 2024-09-13T06:10:01.680 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.679+0000 7f80ab41d980 20 add_watcher() i=2 2024-09-13T06:10:01.680 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.679+0000 7f80ab41d980 20 add_watcher() i=3 2024-09-13T06:10:01.680 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.679+0000 7f80ab41d980 20 add_watcher() i=4 2024-09-13T06:10:01.680 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.679+0000 7f80ab41d980 20 add_watcher() i=5 2024-09-13T06:10:01.680 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.679+0000 7f80ab41d980 20 add_watcher() i=6 2024-09-13T06:10:01.681 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.679+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94185423185120] v33'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f809800a4d0 con 0x7f809000f3d0 2024-09-13T06:10:01.682 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.679+0000 7f80ab41d980 20 add_watcher() i=7 2024-09-13T06:10:01.682 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.679+0000 7f80ab41d980 2 all 8 watchers are set, enabling cache 2024-09-13T06:10:01.682 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.679+0000 7f80ab41d980 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a940b15e30 con 0x55a940b02920 2024-09-13T06:10:01.682 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.679+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f809800a4d0 con 0x55a940b02920 2024-09-13T06:10:01.682 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.679+0000 7f80ab41d980 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94185423182240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a940b13320 con 0x55a940b02920 2024-09-13T06:10:01.683 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.683+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94185423182240] v33'146 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f809800a4d0 con 0x55a940b02920 2024-09-13T06:10:01.683 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.683+0000 7f7f5efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:10:01.683 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.683+0000 7f80ab41d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:10:01.683 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.683+0000 7f80ab41d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:10:01.683 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.683+0000 7f80ab41d980 5 note: GC not initialized 2024-09-13T06:10:01.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.683+0000 7f7f5dfe3640 20 reqs_thread_entry: start 2024-09-13T06:10:01.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.683+0000 7f80ab41d980 20 init_complete bucket index max shards: 11 2024-09-13T06:10:01.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.683+0000 7f80ab41d980 20 Filter name: none 2024-09-13T06:10:01.685 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.683+0000 7f7ecf7fe640 20 reqs_thread_entry: start 2024-09-13T06:10:01.685 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.683+0000 7f80ab41d980 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:62 6.0 6:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a940b38aa0 con 0x7f809000f3d0 2024-09-13T06:10:01.686 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.683+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(62 [pgnls start_epoch 33 out=254b] v33'34 uv18 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f809800a4d0 con 0x7f809000f3d0 2024-09-13T06:10:01.686 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.683+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:63 6.10 6:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a940b0a580 con 0x7f809000f3d0 2024-09-13T06:10:01.686 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.683+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(63 [pgnls start_epoch 33 out=131b] v33'4 uv4 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7f809800a4d0 con 0x7f809000f3d0 2024-09-13T06:10:01.686 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.683+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:64 6.8 6:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a940b0a580 con 0x55a940b072c0 2024-09-13T06:10:01.686 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.683+0000 7f80a8f2d640 1 -- 172.21.15.194:0/846101145 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(64 [pgnls start_epoch 33 out=295b] v33'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f80a0112070 con 0x55a940b072c0 2024-09-13T06:10:01.686 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.683+0000 7f80a8f2d640 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:65 6.18 6:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a940b0a580 con 0x7f809000f3d0 2024-09-13T06:10:01.687 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.687+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(65 [pgnls start_epoch 33 out=172b] v33'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f809800a4d0 con 0x7f809000f3d0 2024-09-13T06:10:01.687 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.687+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:66 6.4 6:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a940b0a580 con 0x55a940b02920 2024-09-13T06:10:01.687 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.687+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(66 [pgnls start_epoch 33 out=335b] v33'146 uv23 ondisk = 1) ==== 144+0+335 (crc 0 0 0) 0x7f809800a4d0 con 0x55a940b02920 2024-09-13T06:10:01.687 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.687+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:67 6.14 6:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a940b0a580 con 0x7f80a010b070 2024-09-13T06:10:01.688 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.687+0000 7f80a872c640 1 -- 172.21.15.194:0/846101145 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(67 [pgnls start_epoch 33 out=213b] v33'10 uv10 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f8090036040 con 0x7f80a010b070 2024-09-13T06:10:01.688 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.687+0000 7f80a872c640 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:68 6.c 6:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a940b0df10 con 0x55a940b072c0 2024-09-13T06:10:01.688 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.687+0000 7f80a8f2d640 1 -- 172.21.15.194:0/846101145 <== osd.3 v2:172.21.15.194:6816/96632515 16 ==== osd_op_reply(68 [pgnls start_epoch 33 out=254b] v33'10 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f80a0112070 con 0x55a940b072c0 2024-09-13T06:10:01.688 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.687+0000 7f80a8f2d640 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:69 6.1c 6:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a940b0df10 con 0x55a940b072c0 2024-09-13T06:10:01.688 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.687+0000 7f80a8f2d640 1 -- 172.21.15.194:0/846101145 <== osd.3 v2:172.21.15.194:6816/96632515 17 ==== osd_op_reply(69 [pgnls start_epoch 33 out=295b] v33'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f80a0112070 con 0x55a940b072c0 2024-09-13T06:10:01.689 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.687+0000 7f80a8f2d640 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:70 6.2 6:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a940b0df10 con 0x55a940b072c0 2024-09-13T06:10:01.689 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.687+0000 7f80a8f2d640 1 -- 172.21.15.194:0/846101145 <== osd.3 v2:172.21.15.194:6816/96632515 18 ==== osd_op_reply(70 [pgnls start_epoch 33 out=213b] v33'10 uv10 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f80a0112070 con 0x55a940b072c0 2024-09-13T06:10:01.689 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.687+0000 7f80a8f2d640 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:71 6.12 6:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a940b0df10 con 0x7f80a010b070 2024-09-13T06:10:01.691 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.687+0000 7f80a872c640 1 -- 172.21.15.194:0/846101145 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(71 [pgnls start_epoch 33 out=172b] v33'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f8090036040 con 0x7f80a010b070 2024-09-13T06:10:01.691 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.687+0000 7f80a872c640 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:72 6.a 6:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a940b0df10 con 0x7f80a010b070 2024-09-13T06:10:01.691 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.687+0000 7f80a872c640 1 -- 172.21.15.194:0/846101145 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(72 [pgnls start_epoch 33 out=336b] v33'27 uv19 ondisk = 1) ==== 144+0+336 (crc 0 0 0) 0x7f8090036040 con 0x7f80a010b070 2024-09-13T06:10:01.691 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.687+0000 7f80a872c640 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:73 6.1a 6:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a940b0df10 con 0x55a940b072c0 2024-09-13T06:10:01.691 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.687+0000 7f80a8f2d640 1 -- 172.21.15.194:0/846101145 <== osd.3 v2:172.21.15.194:6816/96632515 19 ==== osd_op_reply(73 [pgnls start_epoch 33 out=131b] v33'17 uv9 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7f80a0112070 con 0x55a940b072c0 2024-09-13T06:10:01.691 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.687+0000 7f80a8f2d640 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:74 6.6 6:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a940b0df10 con 0x55a940b072c0 2024-09-13T06:10:01.691 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.687+0000 7f80a8f2d640 1 -- 172.21.15.194:0/846101145 <== osd.3 v2:172.21.15.194:6816/96632515 20 ==== osd_op_reply(74 [pgnls start_epoch 33 out=254b] v33'12 uv12 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f80a0112070 con 0x55a940b072c0 2024-09-13T06:10:01.691 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.687+0000 7f80a8f2d640 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:75 6.16 6:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a940b0df10 con 0x55a940b072c0 2024-09-13T06:10:01.691 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.687+0000 7f80a8f2d640 1 -- 172.21.15.194:0/846101145 <== osd.3 v2:172.21.15.194:6816/96632515 21 ==== osd_op_reply(75 [pgnls start_epoch 33 out=90b] v33'17 uv9 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7f80a0112070 con 0x55a940b072c0 2024-09-13T06:10:01.691 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.687+0000 7f80a8f2d640 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:76 6.e 6:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a940b0df10 con 0x55a940b02920 2024-09-13T06:10:01.692 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.691+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(76 [pgnls start_epoch 33 out=213b] v33'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f809800a4d0 con 0x55a940b02920 2024-09-13T06:10:01.692 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.691+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:77 6.1e 6:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a940b0df10 con 0x55a940b072c0 2024-09-13T06:10:01.692 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.691+0000 7f80a8f2d640 1 -- 172.21.15.194:0/846101145 <== osd.3 v2:172.21.15.194:6816/96632515 22 ==== osd_op_reply(77 [pgnls start_epoch 33 out=254b] v33'10 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f80a0112070 con 0x55a940b072c0 2024-09-13T06:10:01.692 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.691+0000 7f80a8f2d640 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:78 6.1 6:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a940b0df10 con 0x55a940b02920 2024-09-13T06:10:01.693 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.691+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(78 [pgnls start_epoch 33 out=254b] v33'14 uv14 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f809800a4d0 con 0x55a940b02920 2024-09-13T06:10:01.694 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.691+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:79 6.11 6:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a940b0df10 con 0x55a940b072c0 2024-09-13T06:10:01.694 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.691+0000 7f80a8f2d640 1 -- 172.21.15.194:0/846101145 <== osd.3 v2:172.21.15.194:6816/96632515 23 ==== osd_op_reply(79 [pgnls start_epoch 33 out=213b] v33'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f80a0112070 con 0x55a940b072c0 2024-09-13T06:10:01.694 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.691+0000 7f80a8f2d640 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:80 6.9 6:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a940b0df10 con 0x55a940b072c0 2024-09-13T06:10:01.694 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.691+0000 7f80a8f2d640 1 -- 172.21.15.194:0/846101145 <== osd.3 v2:172.21.15.194:6816/96632515 24 ==== osd_op_reply(80 [pgnls start_epoch 33 out=172b] v33'29 uv12 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f80a0112070 con 0x55a940b072c0 2024-09-13T06:10:01.694 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.691+0000 7f80a8f2d640 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:81 6.19 6:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a940b0df10 con 0x55a940b02920 2024-09-13T06:10:01.694 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.691+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(81 [pgnls start_epoch 33 out=295b] v33'24 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f809800a4d0 con 0x55a940b02920 2024-09-13T06:10:01.694 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.691+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:82 6.5 6:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a940b0df10 con 0x7f80a010b070 2024-09-13T06:10:01.694 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.691+0000 7f80a872c640 1 -- 172.21.15.194:0/846101145 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== osd_op_reply(82 [pgnls start_epoch 33 out=276b] v33'15 uv15 ondisk = 1) ==== 144+0+276 (crc 0 0 0) 0x7f8090036040 con 0x7f80a010b070 2024-09-13T06:10:01.694 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.691+0000 7f80a872c640 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:83 6.15 6:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a940b0df10 con 0x7f80a010b070 2024-09-13T06:10:01.694 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.691+0000 7f80a872c640 1 -- 172.21.15.194:0/846101145 <== osd.2 v2:172.21.15.194:6800/815615585 16 ==== osd_op_reply(83 [pgnls start_epoch 33 out=172b] v33'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f8090036040 con 0x7f80a010b070 2024-09-13T06:10:01.694 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.691+0000 7f80a872c640 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:84 6.d 6:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a940b0df10 con 0x55a940b02920 2024-09-13T06:10:01.694 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.691+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 <== osd.1 v2:172.21.15.194:6808/3135444559 25 ==== osd_op_reply(84 [pgnls start_epoch 33 out=295b] v33'25 uv17 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f809800a4d0 con 0x55a940b02920 2024-09-13T06:10:01.695 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.691+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:85 6.1d 6:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a940b0df10 con 0x7f809000f3d0 2024-09-13T06:10:01.695 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.695+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 <== osd.0 v2:172.21.15.120:6800/1923744619 20 ==== osd_op_reply(85 [pgnls start_epoch 33 out=172b] v33'28 uv12 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f809800a4d0 con 0x7f809000f3d0 2024-09-13T06:10:01.695 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.695+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:86 6.3 6:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a940b0df10 con 0x7f80a010b070 2024-09-13T06:10:01.695 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.695+0000 7f80a872c640 1 -- 172.21.15.194:0/846101145 <== osd.2 v2:172.21.15.194:6800/815615585 17 ==== osd_op_reply(86 [pgnls start_epoch 33 out=213b] v33'43 uv19 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f8090036040 con 0x7f80a010b070 2024-09-13T06:10:01.695 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.695+0000 7f80a872c640 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:87 6.13 6:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a940b0df10 con 0x7f809000f3d0 2024-09-13T06:10:01.696 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.695+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 <== osd.0 v2:172.21.15.120:6800/1923744619 21 ==== osd_op_reply(87 [pgnls start_epoch 33 out=172b] v33'19 uv11 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f809800a4d0 con 0x7f809000f3d0 2024-09-13T06:10:01.697 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.695+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:88 6.b 6:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a940b0df10 con 0x55a940b072c0 2024-09-13T06:10:01.697 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.695+0000 7f80a8f2d640 1 -- 172.21.15.194:0/846101145 <== osd.3 v2:172.21.15.194:6816/96632515 25 ==== osd_op_reply(88 [pgnls start_epoch 33 out=172b] v33'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f80a0112070 con 0x55a940b072c0 2024-09-13T06:10:01.697 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.695+0000 7f80a8f2d640 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:89 6.1b 6:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a940b0df10 con 0x55a940b072c0 2024-09-13T06:10:01.697 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.695+0000 7f80a8f2d640 1 -- 172.21.15.194:0/846101145 <== osd.3 v2:172.21.15.194:6816/96632515 26 ==== osd_op_reply(89 [pgnls start_epoch 33 out=90b] v33'13 uv5 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7f80a0112070 con 0x55a940b072c0 2024-09-13T06:10:01.697 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.695+0000 7f80a8f2d640 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:90 6.7 6:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a940b0df10 con 0x55a940b072c0 2024-09-13T06:10:01.697 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.695+0000 7f80a8f2d640 1 -- 172.21.15.194:0/846101145 <== osd.3 v2:172.21.15.194:6816/96632515 27 ==== osd_op_reply(90 [pgnls start_epoch 33 out=90b] v33'37 uv13 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7f80a0112070 con 0x55a940b072c0 2024-09-13T06:10:01.697 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.695+0000 7f80a8f2d640 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:91 6.17 6:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a940b0df10 con 0x55a940b02920 2024-09-13T06:10:01.698 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.695+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 <== osd.1 v2:172.21.15.194:6808/3135444559 26 ==== osd_op_reply(91 [pgnls start_epoch 33 out=131b] v33'6 uv6 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7f809800a4d0 con 0x55a940b02920 2024-09-13T06:10:01.698 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.695+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:92 6.f 6:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a940b0df10 con 0x7f80a010b070 2024-09-13T06:10:01.698 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.695+0000 7f80a872c640 1 -- 172.21.15.194:0/846101145 <== osd.2 v2:172.21.15.194:6800/815615585 18 ==== osd_op_reply(92 [pgnls start_epoch 33 out=295b] v33'24 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f8090036040 con 0x7f80a010b070 2024-09-13T06:10:01.698 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.695+0000 7f80a872c640 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:93 6.1f 6:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a940b0df10 con 0x7f809000f3d0 2024-09-13T06:10:01.698 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.699+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 <== osd.0 v2:172.21.15.120:6800/1923744619 22 ==== osd_op_reply(93 [pgnls start_epoch 33 out=213b] v33'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f809800a4d0 con 0x7f809000f3d0 2024-09-13T06:10:01.699 INFO:teuthology.orchestra.run.smithi194.stdout:["obj_delete_at_hint.0000000078","obj_delete_at_hint.0000000070","obj_delete_at_hint.0000000104","obj_delete_at_hint.0000000026","obj_delete_at_hint.0000000028","obj_delete_at_hint.0000000040","obj_delete_at_hint.0000000015","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","obj_delete_at_hint.0000000024","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","data_loggenerations_metadata","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","obj_delete_at_hint.0000000110","obj_delete_at_hint.0000000096","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","obj_delete_at_hint.0000000016","obj_delete_at_hint.0000000041","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","obj_delete_at_hint.0000000014","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","obj_delete_at_hint.0000000074","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","obj_delete_at_hint.0000000116","obj_delete_at_hint.0000000034","obj_delete_at_hint.0000000101","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","obj_delete_at_hint.0000000066","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","obj_delete_at_hint.0000000118","obj_delete_at_hint.0000000036","obj_delete_at_hint.0000000103","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","obj_delete_at_hint.0000000027","obj_delete_at_hint.0000000019","obj_delete_at_hint.0000000039","obj_delete_at_hint.0000000100","obj_delete_at_hint.0000000093","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","obj_delete_at_hint.0000000057","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","data_log.0","obj_delete_at_hint.0000000012","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","obj_delete_at_hint.0000000020","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","obj_delete_at_hint.0000000115","obj_delete_at_hint.0000000033","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","obj_delete_at_hint.0000000108","obj_delete_at_hint.0000000094","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","obj_delete_at_hint.0000000013","obj_delete_at_hint.0000000051","obj_delete_at_hint.0000000106","obj_delete_at_hint.0000000017","obj_delete_at_hint.0000000023","obj_delete_at_hint.0000000107","obj_delete_at_hint.0000000046","obj_delete_at_hint.0000000067","obj_delete_at_hint.0000000086","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","obj_delete_at_hint.0000000124","obj_delete_at_hint.0000000001","obj_delete_at_hint.0000000126","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","obj_delete_at_hint.0000000097","obj_delete_at_hint.0000000042","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030"] 2024-09-13T06:10:01.700 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.699+0000 7f7f5efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:10:01.700 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.699+0000 7f80ab41d980 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94185423182240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a940b36ec0 con 0x55a940b02920 2024-09-13T06:10:01.702 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.699+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 <== osd.1 v2:172.21.15.194:6808/3135444559 27 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94185423182240] v33'147 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f809800a4d0 con 0x55a940b02920 2024-09-13T06:10:01.702 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.699+0000 7f80ab41d980 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94185423162288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a940b119a0 con 0x7f80a010b070 2024-09-13T06:10:01.703 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.703+0000 7f80a872c640 1 -- 172.21.15.194:0/846101145 <== osd.2 v2:172.21.15.194:6800/815615585 19 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94185423162288] v33'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8090036040 con 0x7f80a010b070 2024-09-13T06:10:01.703 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.703+0000 7f80ab41d980 20 remove_watcher() i=0 2024-09-13T06:10:01.703 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.703+0000 7f80ab41d980 2 removed watcher, disabling cache 2024-09-13T06:10:01.704 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.703+0000 7f80ab41d980 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94185423166048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a940b0cbb0 con 0x55a940b02920 2024-09-13T06:10:01.705 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.703+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 <== osd.1 v2:172.21.15.194:6808/3135444559 28 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94185423166048] v33'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f809800a4d0 con 0x55a940b02920 2024-09-13T06:10:01.705 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.703+0000 7f80ab41d980 20 remove_watcher() i=1 2024-09-13T06:10:01.705 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.703+0000 7f80ab41d980 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94185423170896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a940b0cbb0 con 0x55a940b072c0 2024-09-13T06:10:01.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.707+0000 7f80a8f2d640 1 -- 172.21.15.194:0/846101145 <== osd.3 v2:172.21.15.194:6816/96632515 28 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94185423170896] v33'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80a0112070 con 0x55a940b072c0 2024-09-13T06:10:01.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.707+0000 7f80ab41d980 20 remove_watcher() i=2 2024-09-13T06:10:01.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.707+0000 7f80ab41d980 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94185423168176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a940b0ed50 con 0x7f80a010b070 2024-09-13T06:10:01.708 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.707+0000 7f80a872c640 1 -- 172.21.15.194:0/846101145 <== osd.2 v2:172.21.15.194:6800/815615585 20 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94185423168176] v33'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8090036040 con 0x7f80a010b070 2024-09-13T06:10:01.709 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.707+0000 7f80ab41d980 20 remove_watcher() i=3 2024-09-13T06:10:01.709 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.707+0000 7f80ab41d980 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94185423175664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a940b0ed50 con 0x55a940b02920 2024-09-13T06:10:01.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.711+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 <== osd.1 v2:172.21.15.194:6808/3135444559 29 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94185423175664] v33'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f809800a4d0 con 0x55a940b02920 2024-09-13T06:10:01.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.711+0000 7f80ab41d980 20 remove_watcher() i=4 2024-09-13T06:10:01.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.711+0000 7f80ab41d980 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94185423173168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a940b0fff0 con 0x7f809000f3d0 2024-09-13T06:10:01.713 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.711+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 <== osd.0 v2:172.21.15.120:6800/1923744619 23 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94185423173168] v33'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f809800a4d0 con 0x7f809000f3d0 2024-09-13T06:10:01.713 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.711+0000 7f80ab41d980 20 remove_watcher() i=5 2024-09-13T06:10:01.713 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.711+0000 7f80ab41d980 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94185423181184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a940b0ed50 con 0x7f809000f3d0 2024-09-13T06:10:01.715 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.715+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 <== osd.0 v2:172.21.15.120:6800/1923744619 24 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94185423181184] v33'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f809800a4d0 con 0x7f809000f3d0 2024-09-13T06:10:01.715 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.715+0000 7f80ab41d980 20 remove_watcher() i=6 2024-09-13T06:10:01.715 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.715+0000 7f80ab41d980 1 -- 172.21.15.194:0/846101145 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94185423185120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a940b11580 con 0x7f809000f3d0 2024-09-13T06:10:01.720 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.715+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 <== osd.0 v2:172.21.15.120:6800/1923744619 25 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94185423185120] v33'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f809800a4d0 con 0x7f809000f3d0 2024-09-13T06:10:01.720 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.715+0000 7f80ab41d980 20 remove_watcher() i=7 2024-09-13T06:10:01.720 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.715+0000 7f80ab41d980 1 -- 172.21.15.194:0/846101145 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f809000f3d0 msgr2=0x7f809000f7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.720 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.715+0000 7f80ab41d980 1 --2- 172.21.15.194:0/846101145 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f809000f3d0 0x7f809000f7d0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.720 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.715+0000 7f80ab41d980 1 -- 172.21.15.194:0/846101145 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55a940b02920 msgr2=0x55a940b04dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.720 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.715+0000 7f80ab41d980 1 --2- 172.21.15.194:0/846101145 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55a940b02920 0x55a940b04dc0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.720 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.715+0000 7f80ab41d980 1 -- 172.21.15.194:0/846101145 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f80a010b070 msgr2=0x7f80a0119540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.720 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.715+0000 7f80ab41d980 1 --2- 172.21.15.194:0/846101145 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f80a010b070 0x7f80a0119540 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.720 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.715+0000 7f80ab41d980 1 -- 172.21.15.194:0/846101145 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55a940b072c0 msgr2=0x55a940b096b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.720 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.715+0000 7f80ab41d980 1 --2- 172.21.15.194:0/846101145 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55a940b072c0 0x55a940b096b0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.721 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.715+0000 7f80ab41d980 1 -- 172.21.15.194:0/846101145 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7f740346a0 msgr2=0x7f7f74036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.721 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.715+0000 7f80ab41d980 1 --2- 172.21.15.194:0/846101145 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7f740346a0 0x7f7f74036b60 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x55a940ace6b0 tx=0x7f8090011000 comp rx=0 tx=0).stop 2024-09-13T06:10:01.721 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.715+0000 7f80ab41d980 1 -- 172.21.15.194:0/846101145 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a940af06a0 msgr2=0x55a940af78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.721 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.715+0000 7f80a972e640 1 -- 172.21.15.194:0/846101145 reap_dead start 2024-09-13T06:10:01.721 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.715+0000 7f80ab41d980 1 --2- 172.21.15.194:0/846101145 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a940af06a0 0x55a940af78e0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f80a00b3d70 tx=0x7f80a00dfee0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.721 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.715+0000 7f80ab41d980 1 -- 172.21.15.194:0/846101145 shutdown_connections 2024-09-13T06:10:01.721 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.715+0000 7f80ab41d980 1 --2- 172.21.15.194:0/846101145 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a940af06a0 0x55a940af78e0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.721 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.715+0000 7f80ab41d980 1 -- 172.21.15.194:0/846101145 >> 172.21.15.194:0/846101145 conn(0x55a940aeca80 msgr2=0x55a940aeab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:01.721 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.715+0000 7f80ab41d980 1 -- 172.21.15.194:0/846101145 shutdown_connections 2024-09-13T06:10:01.721 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.715+0000 7f80ab41d980 1 -- 172.21.15.194:0/846101145 wait complete. 2024-09-13T06:10:01.721 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.719+0000 7f80ab41d980 1 -- 172.21.15.194:0/3550557486 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7f80034650 msgr2=0x7f7f80036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.721 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.719+0000 7f80ab41d980 1 --2- 172.21.15.194:0/3550557486 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7f80034650 0x7f7f80036b10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x55a940ad26f0 tx=0x7f8090006000 comp rx=0 tx=0).stop 2024-09-13T06:10:01.721 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.719+0000 7f80ab41d980 1 -- 172.21.15.194:0/3550557486 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a940ae3d30 msgr2=0x55a940ae4150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.721 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.719+0000 7f80ab41d980 1 --2- 172.21.15.194:0/3550557486 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a940ae3d30 0x55a940ae4150 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f80a0000c10 tx=0x7f80a00e4480 comp rx=0 tx=0).stop 2024-09-13T06:10:01.722 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.719+0000 7f80ab41d980 1 -- 172.21.15.194:0/3550557486 shutdown_connections 2024-09-13T06:10:01.722 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.719+0000 7f80ab41d980 1 --2- 172.21.15.194:0/3550557486 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7f80034650 0x7f7f80036b10 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.722 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.719+0000 7f80ab41d980 1 --2- 172.21.15.194:0/3550557486 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a940ae3d30 0x55a940ae4150 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.722 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.719+0000 7f80ab41d980 1 -- 172.21.15.194:0/3550557486 >> 172.21.15.194:0/3550557486 conn(0x55a940ad8e80 msgr2=0x55a940adb900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:01.722 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.719+0000 7f80ab41d980 1 -- 172.21.15.194:0/3550557486 shutdown_connections 2024-09-13T06:10:01.722 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.719+0000 7f80ab41d980 1 -- 172.21.15.194:0/3550557486 wait complete. 2024-09-13T06:10:01.722 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.719+0000 7f80ab41d980 1 -- 172.21.15.194:0/2030210716 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55a9409d0e80 msgr2=0x55a940accfb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.722 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.719+0000 7f80ab41d980 1 --2- 172.21.15.194:0/2030210716 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55a9409d0e80 0x55a940accfb0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.722 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.719+0000 7f80ab41d980 1 -- 172.21.15.194:0/2030210716 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55a940ad3780 msgr2=0x55a940ad5b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.722 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.719+0000 7f80ab41d980 1 --2- 172.21.15.194:0/2030210716 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55a940ad3780 0x55a940ad5b70 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.722 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.719+0000 7f80ab41d980 1 -- 172.21.15.194:0/2030210716 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55a940acf840 msgr2=0x55a940ad1c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.722 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.719+0000 7f80ab41d980 1 --2- 172.21.15.194:0/2030210716 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55a940acf840 0x55a940ad1c30 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.722 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.719+0000 7f80ab41d980 1 -- 172.21.15.194:0/2030210716 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7f900346a0 msgr2=0x7f7f90036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.723 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.719+0000 7f80ab41d980 1 --2- 172.21.15.194:0/2030210716 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7f900346a0 0x7f7f90036b60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8090001e20 tx=0x7f80900013a0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.723 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.719+0000 7f80ab41d980 1 -- 172.21.15.194:0/2030210716 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a9409d0530 msgr2=0x55a940ac5eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.723 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.719+0000 7f80ab41d980 1 --2- 172.21.15.194:0/2030210716 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a9409d0530 0x55a940ac5eb0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f80a001daa0 tx=0x7f80a0019fa0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.723 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.719+0000 7f80a972e640 1 -- 172.21.15.194:0/2030210716 reap_dead start 2024-09-13T06:10:01.723 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.719+0000 7f80ab41d980 1 -- 172.21.15.194:0/2030210716 shutdown_connections 2024-09-13T06:10:01.723 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.719+0000 7f80ab41d980 1 -- 172.21.15.194:0/2030210716 >> 172.21.15.194:0/2030210716 conn(0x55a9409cc050 msgr2=0x55a940ab5020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:01.723 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.719+0000 7f80ab41d980 1 -- 172.21.15.194:0/2030210716 shutdown_connections 2024-09-13T06:10:01.723 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.719+0000 7f80ab41d980 1 -- 172.21.15.194:0/2030210716 wait complete. 2024-09-13T06:10:01.730 DEBUG:tasks.util.rgw: json result: ['obj_delete_at_hint.0000000078', 'obj_delete_at_hint.0000000070', 'obj_delete_at_hint.0000000104', 'obj_delete_at_hint.0000000026', 'obj_delete_at_hint.0000000028', 'obj_delete_at_hint.0000000040', 'obj_delete_at_hint.0000000015', 'obj_delete_at_hint.0000000069', 'obj_delete_at_hint.0000000095', 'obj_delete_at_hint.0000000003', 'obj_delete_at_hint.0000000047', 'obj_delete_at_hint.0000000035', 'obj_delete_at_hint.0000000037', 'obj_delete_at_hint.0000000024', 'obj_delete_at_hint.0000000000', 'obj_delete_at_hint.0000000031', 'data_loggenerations_metadata', 'obj_delete_at_hint.0000000076', 'obj_delete_at_hint.0000000113', 'obj_delete_at_hint.0000000005', 'obj_delete_at_hint.0000000011', 'obj_delete_at_hint.0000000058', 'obj_delete_at_hint.0000000052', 'obj_delete_at_hint.0000000088', 'obj_delete_at_hint.0000000080', 'obj_delete_at_hint.0000000090', 'obj_delete_at_hint.0000000110', 'obj_delete_at_hint.0000000096', 'obj_delete_at_hint.0000000087', 'obj_delete_at_hint.0000000008', 'obj_delete_at_hint.0000000006', 'obj_delete_at_hint.0000000029', 'obj_delete_at_hint.0000000089', 'obj_delete_at_hint.0000000022', 'obj_delete_at_hint.0000000016', 'obj_delete_at_hint.0000000041', 'obj_delete_at_hint.0000000018', 'obj_delete_at_hint.0000000092', 'obj_delete_at_hint.0000000014', 'obj_delete_at_hint.0000000112', 'obj_delete_at_hint.0000000007', 'obj_delete_at_hint.0000000021', 'obj_delete_at_hint.0000000064', 'obj_delete_at_hint.0000000071', 'obj_delete_at_hint.0000000074', 'obj_delete_at_hint.0000000081', 'obj_delete_at_hint.0000000009', 'obj_delete_at_hint.0000000121', 'obj_delete_at_hint.0000000125', 'obj_delete_at_hint.0000000082', 'obj_delete_at_hint.0000000105', 'obj_delete_at_hint.0000000059', 'obj_delete_at_hint.0000000077', 'obj_delete_at_hint.0000000032', 'obj_delete_at_hint.0000000053', 'obj_delete_at_hint.0000000091', 'obj_delete_at_hint.0000000065', 'obj_delete_at_hint.0000000083', 'obj_delete_at_hint.0000000010', 'obj_delete_at_hint.0000000045', 'obj_delete_at_hint.0000000002', 'obj_delete_at_hint.0000000116', 'obj_delete_at_hint.0000000034', 'obj_delete_at_hint.0000000101', 'obj_delete_at_hint.0000000079', 'obj_delete_at_hint.0000000049', 'obj_delete_at_hint.0000000117', 'obj_delete_at_hint.0000000044', 'obj_delete_at_hint.0000000066', 'obj_delete_at_hint.0000000068', 'obj_delete_at_hint.0000000085', 'obj_delete_at_hint.0000000073', 'obj_delete_at_hint.0000000038', 'obj_delete_at_hint.0000000118', 'obj_delete_at_hint.0000000036', 'obj_delete_at_hint.0000000103', 'obj_delete_at_hint.0000000119', 'obj_delete_at_hint.0000000098', 'obj_delete_at_hint.0000000027', 'obj_delete_at_hint.0000000019', 'obj_delete_at_hint.0000000039', 'obj_delete_at_hint.0000000100', 'obj_delete_at_hint.0000000093', 'obj_delete_at_hint.0000000004', 'obj_delete_at_hint.0000000063', 'obj_delete_at_hint.0000000122', 'obj_delete_at_hint.0000000057', 'obj_delete_at_hint.0000000054', 'obj_delete_at_hint.0000000114', 'data_log.0', 'obj_delete_at_hint.0000000012', 'obj_delete_at_hint.0000000084', 'obj_delete_at_hint.0000000043', 'obj_delete_at_hint.0000000111', 'obj_delete_at_hint.0000000048', 'obj_delete_at_hint.0000000020', 'obj_delete_at_hint.0000000099', 'obj_delete_at_hint.0000000056', 'obj_delete_at_hint.0000000072', 'obj_delete_at_hint.0000000062', 'obj_delete_at_hint.0000000115', 'obj_delete_at_hint.0000000033', 'obj_delete_at_hint.0000000025', 'obj_delete_at_hint.0000000123', 'obj_delete_at_hint.0000000108', 'obj_delete_at_hint.0000000094', 'obj_delete_at_hint.0000000060', 'obj_delete_at_hint.0000000109', 'obj_delete_at_hint.0000000013', 'obj_delete_at_hint.0000000051', 'obj_delete_at_hint.0000000106', 'obj_delete_at_hint.0000000017', 'obj_delete_at_hint.0000000023', 'obj_delete_at_hint.0000000107', 'obj_delete_at_hint.0000000046', 'obj_delete_at_hint.0000000067', 'obj_delete_at_hint.0000000086', 'obj_delete_at_hint.0000000050', 'obj_delete_at_hint.0000000102', 'obj_delete_at_hint.0000000124', 'obj_delete_at_hint.0000000001', 'obj_delete_at_hint.0000000126', 'obj_delete_at_hint.0000000055', 'obj_delete_at_hint.0000000061', 'obj_delete_at_hint.0000000097', 'obj_delete_at_hint.0000000042', 'obj_delete_at_hint.0000000075', 'obj_delete_at_hint.0000000120', 'obj_delete_at_hint.0000000030'] 2024-09-13T06:10:01.730 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-09-13T06:10:01.730 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-09-13T06:10:01.730 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-09-13T06:10:01.803 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:10:01.804 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:10:01.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.803+0000 7fa76d1fd980 1 Processor -- start 2024-09-13T06:10:01.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.803+0000 7fa76d1fd980 1 -- start start 2024-09-13T06:10:01.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.803+0000 7fa76d1fd980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55b4c8bb3690 0x55b4c8bb3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:01.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.803+0000 7fa76d1fd980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b4c8a3bae0 con 0x55b4c8bb3fe0 2024-09-13T06:10:01.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.803+0000 7fa76d1fd980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x55b4c8a5fe30 con 0x55b4c8bb3690 2024-09-13T06:10:01.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.803+0000 7fa76ad0d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55b4c8bb3690 0x55b4c8bb3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:01.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.803+0000 7fa76ad0d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55b4c8bb3690 0x55b4c8bb3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:46348/0 (socket says 172.21.15.194:46348) 2024-09-13T06:10:01.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.803+0000 7fa76ad0d640 1 -- 172.21.15.194:0/2062300187 learned_addr learned my addr 172.21.15.194:0/2062300187 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:01.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.803+0000 7fa76ad0d640 1 -- 172.21.15.194:0/2062300187 >> v1:172.21.15.120:6789/0 conn(0x55b4c8bb3fe0 legacy=0x55b4c8bb8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.803+0000 7fa76ad0d640 1 -- 172.21.15.194:0/2062300187 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4c8bbb260 con 0x55b4c8bb3690 2024-09-13T06:10:01.808 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.807+0000 7fa76ad0d640 1 --2- 172.21.15.194:0/2062300187 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b4c8bb3690 0x55b4c8bb3a70 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fa75400a4e0 tx=0x7fa75401b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dac105fe01e0264c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:01.808 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.807+0000 7fa769d0b640 1 -- 172.21.15.194:0/2062300187 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7540aa540 con 0x55b4c8bb3690 2024-09-13T06:10:01.808 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.807+0000 7fa769d0b640 1 -- 172.21.15.194:0/2062300187 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7540aa6e0 con 0x55b4c8bb3690 2024-09-13T06:10:01.808 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.807+0000 7fa769d0b640 1 -- 172.21.15.194:0/2062300187 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7540aaa40 con 0x55b4c8bb3690 2024-09-13T06:10:01.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.807+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2062300187 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b4c8bb3690 msgr2=0x55b4c8bb3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.807+0000 7fa76d1fd980 1 --2- 172.21.15.194:0/2062300187 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b4c8bb3690 0x55b4c8bb3a70 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fa75400a4e0 tx=0x7fa75401b090 comp rx=0 tx=0).stop 2024-09-13T06:10:01.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.807+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2062300187 shutdown_connections 2024-09-13T06:10:01.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.807+0000 7fa76d1fd980 1 --2- 172.21.15.194:0/2062300187 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b4c8bb3690 0x55b4c8bb3a70 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.807+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2062300187 >> 172.21.15.194:0/2062300187 conn(0x55b4c8baf1b0 msgr2=0x55b4c8bb15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:01.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.807+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2062300187 shutdown_connections 2024-09-13T06:10:01.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.807+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2062300187 wait complete. 2024-09-13T06:10:01.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.823+0000 7fa76d1fd980 1 Processor -- start 2024-09-13T06:10:01.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.823+0000 7fa76d1fd980 1 -- start start 2024-09-13T06:10:01.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.823+0000 7fa76d1fd980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b4c8bb3690 0x55b4c8c9ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:01.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.823+0000 7fa76d1fd980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55b4c8a61200 con 0x55b4c8bb3690 2024-09-13T06:10:01.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.823+0000 7fa76ad0d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b4c8bb3690 0x55b4c8c9ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:01.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.823+0000 7fa76ad0d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b4c8bb3690 0x55b4c8c9ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:46352/0 (socket says 172.21.15.194:46352) 2024-09-13T06:10:01.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.823+0000 7fa76ad0d640 1 -- 172.21.15.194:0/4282503965 learned_addr learned my addr 172.21.15.194:0/4282503965 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:01.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.823+0000 7fa76ad0d640 1 -- 172.21.15.194:0/4282503965 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4c8c9f010 con 0x55b4c8bb3690 2024-09-13T06:10:01.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.823+0000 7fa76ad0d640 1 --2- 172.21.15.194:0/4282503965 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b4c8bb3690 0x55b4c8c9ea40 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fa754017ca0 tx=0x7fa7540033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bea3069487a1469 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:01.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.823+0000 7fa657e17640 1 -- 172.21.15.194:0/4282503965 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7540b9030 con 0x55b4c8bb3690 2024-09-13T06:10:01.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.823+0000 7fa657e17640 1 -- 172.21.15.194:0/4282503965 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7540aaac0 con 0x55b4c8bb3690 2024-09-13T06:10:01.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.823+0000 7fa657e17640 1 -- 172.21.15.194:0/4282503965 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7540aada0 con 0x55b4c8bb3690 2024-09-13T06:10:01.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.823+0000 7fa76d1fd980 1 -- 172.21.15.194:0/4282503965 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b4c8bb3690 msgr2=0x55b4c8c9ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.823+0000 7fa76d1fd980 1 --2- 172.21.15.194:0/4282503965 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b4c8bb3690 0x55b4c8c9ea40 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fa754017ca0 tx=0x7fa7540033b0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.823+0000 7fa76d1fd980 1 -- 172.21.15.194:0/4282503965 shutdown_connections 2024-09-13T06:10:01.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.823+0000 7fa76d1fd980 1 --2- 172.21.15.194:0/4282503965 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b4c8bb3690 0x55b4c8c9ea40 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.823+0000 7fa76d1fd980 1 -- 172.21.15.194:0/4282503965 >> 172.21.15.194:0/4282503965 conn(0x55b4c8baf1b0 msgr2=0x55b4c8c9a670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:01.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.823+0000 7fa76d1fd980 1 -- 172.21.15.194:0/4282503965 shutdown_connections 2024-09-13T06:10:01.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.823+0000 7fa76d1fd980 1 -- 172.21.15.194:0/4282503965 wait complete. 2024-09-13T06:10:01.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.827+0000 7fa76d1fd980 1 Processor -- start 2024-09-13T06:10:01.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.827+0000 7fa76d1fd980 1 -- start start 2024-09-13T06:10:01.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.827+0000 7fa76d1fd980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b4c8bb3690 0x55b4c8ca5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:01.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.827+0000 7fa76d1fd980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55b4c8bbaca0 con 0x55b4c8bb3690 2024-09-13T06:10:01.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.827+0000 7fa76ad0d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b4c8bb3690 0x55b4c8ca5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:01.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.827+0000 7fa76ad0d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b4c8bb3690 0x55b4c8ca5c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:46356/0 (socket says 172.21.15.194:46356) 2024-09-13T06:10:01.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.827+0000 7fa76ad0d640 1 -- 172.21.15.194:0/1092300557 learned_addr learned my addr 172.21.15.194:0/1092300557 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:01.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.827+0000 7fa76ad0d640 1 -- 172.21.15.194:0/1092300557 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4c8ca6180 con 0x55b4c8bb3690 2024-09-13T06:10:01.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.827+0000 7fa76ad0d640 1 --2- 172.21.15.194:0/1092300557 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b4c8bb3690 0x55b4c8ca5c40 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fa754005cc0 tx=0x7fa754017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:01.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.827+0000 7fa656614640 1 -- 172.21.15.194:0/1092300557 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7540b9030 con 0x55b4c8bb3690 2024-09-13T06:10:01.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.827+0000 7fa656614640 1 -- 172.21.15.194:0/1092300557 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7540c3070 con 0x55b4c8bb3690 2024-09-13T06:10:01.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.827+0000 7fa76d1fd980 1 -- 172.21.15.194:0/1092300557 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b4c8ca6410 con 0x55b4c8bb3690 2024-09-13T06:10:01.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.827+0000 7fa656614640 1 -- 172.21.15.194:0/1092300557 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7540bf750 con 0x55b4c8bb3690 2024-09-13T06:10:01.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.827+0000 7fa76d1fd980 1 -- 172.21.15.194:0/1092300557 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4c8ca90f0 con 0x55b4c8bb3690 2024-09-13T06:10:01.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.827+0000 7fa656614640 1 -- 172.21.15.194:0/1092300557 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa7540c5030 con 0x55b4c8bb3690 2024-09-13T06:10:01.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.827+0000 7fa656614640 1 --2- 172.21.15.194:0/1092300557 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa650034650 0x7fa650036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:01.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.827+0000 7fa656614640 1 -- 172.21.15.194:0/1092300557 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fa7540ba070 con 0x55b4c8bb3690 2024-09-13T06:10:01.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.827+0000 7fa76a50c640 1 --2- 172.21.15.194:0/1092300557 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa650034650 0x7fa650036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:01.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.827+0000 7fa76d1fd980 1 --2- 172.21.15.194:0/1092300557 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55b4c8bb3fe0 0x55b4c8cacbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:01.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.827+0000 7fa76d1fd980 1 -- 172.21.15.194:0/1092300557 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8cad240 con 0x55b4c8bb3fe0 2024-09-13T06:10:01.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.827+0000 7fa76b50e640 1 --2- 172.21.15.194:0/1092300557 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55b4c8bb3fe0 0x55b4c8cacbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:01.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.827+0000 7fa76a50c640 1 --2- 172.21.15.194:0/1092300557 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa650034650 0x7fa650036b10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa75c001e20 tx=0x7fa75c0013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:01.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.827+0000 7fa76b50e640 1 --2- 172.21.15.194:0/1092300557 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55b4c8bb3fe0 0x55b4c8cacbd0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:01.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.831+0000 7fa76b50e640 1 -- 172.21.15.194:0/1092300557 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa7640083f0 con 0x55b4c8bb3fe0 2024-09-13T06:10:01.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.831+0000 7fa76d1fd980 1 -- 172.21.15.194:0/1092300557 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8cadb50 con 0x55b4c8bb3fe0 2024-09-13T06:10:01.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.831+0000 7fa76b50e640 1 -- 172.21.15.194:0/1092300557 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa7640083f0 con 0x55b4c8bb3fe0 2024-09-13T06:10:01.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.831+0000 7fa76d1fd980 1 --2- 172.21.15.194:0/1092300557 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55b4c8caf460 0x55b4c8cb1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:01.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.831+0000 7fa76d1fd980 1 -- 172.21.15.194:0/1092300557 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8cb20b0 con 0x55b4c8caf460 2024-09-13T06:10:01.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.831+0000 7fa76ad0d640 1 --2- 172.21.15.194:0/1092300557 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55b4c8caf460 0x55b4c8cb1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:01.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.831+0000 7fa76ad0d640 1 --2- 172.21.15.194:0/1092300557 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55b4c8caf460 0x55b4c8cb1920 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:01.836 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.831+0000 7fa76ad0d640 1 -- 172.21.15.194:0/1092300557 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa7540ce070 con 0x55b4c8caf460 2024-09-13T06:10:01.836 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.831+0000 7fa76d1fd980 1 -- 172.21.15.194:0/1092300557 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8cae3a0 con 0x55b4c8bb3fe0 2024-09-13T06:10:01.836 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.831+0000 7fa76b50e640 1 -- 172.21.15.194:0/1092300557 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa7640083f0 con 0x55b4c8bb3fe0 2024-09-13T06:10:01.836 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.831+0000 7fa76d1fd980 1 --2- 172.21.15.194:0/1092300557 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55b4c8cb3510 0x55b4c8cb5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:01.836 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.831+0000 7fa76d1fd980 1 -- 172.21.15.194:0/1092300557 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8cb5ff0 con 0x55b4c8cb3510 2024-09-13T06:10:01.836 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.831+0000 7fa76a50c640 1 --2- 172.21.15.194:0/1092300557 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55b4c8cb3510 0x55b4c8cb5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:01.836 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.831+0000 7fa76a50c640 1 --2- 172.21.15.194:0/1092300557 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55b4c8cb3510 0x55b4c8cb5900 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:01.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.831+0000 7fa76a50c640 1 -- 172.21.15.194:0/1092300557 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa75c00d040 con 0x55b4c8cb3510 2024-09-13T06:10:01.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.831+0000 7fa76d1fd980 1 Processor -- start 2024-09-13T06:10:01.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.831+0000 7fa76d1fd980 1 -- start start 2024-09-13T06:10:01.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.831+0000 7fa76d1fd980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b4c8cc3ac0 0x55b4c8cc3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:01.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.831+0000 7fa76d1fd980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55b4c8aba800 con 0x55b4c8cc3ac0 2024-09-13T06:10:01.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.831+0000 7fa76ad0d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b4c8cc3ac0 0x55b4c8cc3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:01.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.831+0000 7fa76ad0d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b4c8cc3ac0 0x55b4c8cc3ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:46360/0 (socket says 172.21.15.194:46360) 2024-09-13T06:10:01.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.831+0000 7fa76ad0d640 1 -- 172.21.15.194:0/2086751582 learned_addr learned my addr 172.21.15.194:0/2086751582 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:01.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.835+0000 7fa76ad0d640 1 -- 172.21.15.194:0/2086751582 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4c8cc4420 con 0x55b4c8cc3ac0 2024-09-13T06:10:01.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.835+0000 7fa76ad0d640 1 --2- 172.21.15.194:0/2086751582 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b4c8cc3ac0 0x55b4c8cc3ee0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fa7540bdad0 tx=0x7fa7540a9f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:01.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.835+0000 7fa64f7fe640 1 -- 172.21.15.194:0/2086751582 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7540c63c0 con 0x55b4c8cc3ac0 2024-09-13T06:10:01.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.835+0000 7fa64f7fe640 1 -- 172.21.15.194:0/2086751582 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7540c6560 con 0x55b4c8cc3ac0 2024-09-13T06:10:01.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.835+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2086751582 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b4c8cc4650 con 0x55b4c8cc3ac0 2024-09-13T06:10:01.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.835+0000 7fa64f7fe640 1 -- 172.21.15.194:0/2086751582 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7540b4a20 con 0x55b4c8cc3ac0 2024-09-13T06:10:01.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.835+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2086751582 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4c8cc72d0 con 0x55b4c8cc3ac0 2024-09-13T06:10:01.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.835+0000 7fa64f7fe640 1 -- 172.21.15.194:0/2086751582 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa7540b3040 con 0x55b4c8cc3ac0 2024-09-13T06:10:01.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.835+0000 7fa64f7fe640 1 --2- 172.21.15.194:0/2086751582 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa6440346a0 0x7fa644036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:01.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.835+0000 7fa64f7fe640 1 -- 172.21.15.194:0/2086751582 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fa7540d7070 con 0x55b4c8cc3ac0 2024-09-13T06:10:01.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.835+0000 7fa76a50c640 1 --2- 172.21.15.194:0/2086751582 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa6440346a0 0x7fa644036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:01.840 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.835+0000 7fa76d1fd980 1 Processor -- start 2024-09-13T06:10:01.841 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.835+0000 7fa76d1fd980 1 -- start start 2024-09-13T06:10:01.841 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.835+0000 7fa76a50c640 1 --2- 172.21.15.194:0/2086751582 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa6440346a0 0x7fa644036b60 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x55b4c8caa350 tx=0x7fa75c006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:01.841 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.835+0000 7fa76d1fd980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b4c8cd0370 0x55b4c8cd0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:01.841 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.835+0000 7fa76d1fd980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55b4c8c9f2d0 con 0x55b4c8cd0370 2024-09-13T06:10:01.841 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.835+0000 7fa76ad0d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b4c8cd0370 0x55b4c8cd0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:01.841 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.835+0000 7fa76ad0d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b4c8cd0370 0x55b4c8cd0770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:46374/0 (socket says 172.21.15.194:46374) 2024-09-13T06:10:01.841 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.835+0000 7fa76ad0d640 1 -- 172.21.15.194:0/1937142087 learned_addr learned my addr 172.21.15.194:0/1937142087 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:01.841 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.835+0000 7fa76ad0d640 1 -- 172.21.15.194:0/1937142087 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4c8cd0d40 con 0x55b4c8cd0370 2024-09-13T06:10:01.841 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.835+0000 7fa76ad0d640 1 --2- 172.21.15.194:0/1937142087 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b4c8cd0370 0x55b4c8cd0770 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fa7540c1fd0 tx=0x7fa7540c7d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e560fd02ef8527b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:01.841 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.835+0000 7fa64d7fa640 1 -- 172.21.15.194:0/1937142087 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7540dc850 con 0x55b4c8cd0370 2024-09-13T06:10:01.841 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.839+0000 7fa64d7fa640 1 -- 172.21.15.194:0/1937142087 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7540dcb50 con 0x55b4c8cd0370 2024-09-13T06:10:01.841 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.839+0000 7fa64d7fa640 1 -- 172.21.15.194:0/1937142087 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7540c7410 con 0x55b4c8cd0370 2024-09-13T06:10:01.842 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.839+0000 7fa76d1fd980 1 -- 172.21.15.194:0/1937142087 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b4c8cd0370 msgr2=0x55b4c8cd0770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.842 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.839+0000 7fa76d1fd980 1 --2- 172.21.15.194:0/1937142087 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b4c8cd0370 0x55b4c8cd0770 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fa7540c1fd0 tx=0x7fa7540c7d60 comp rx=0 tx=0).stop 2024-09-13T06:10:01.842 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.839+0000 7fa76d1fd980 1 -- 172.21.15.194:0/1937142087 shutdown_connections 2024-09-13T06:10:01.842 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.839+0000 7fa76d1fd980 1 --2- 172.21.15.194:0/1937142087 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b4c8cd0370 0x55b4c8cd0770 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.842 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.839+0000 7fa76d1fd980 1 -- 172.21.15.194:0/1937142087 >> 172.21.15.194:0/1937142087 conn(0x55b4c8ccc750 msgr2=0x55b4c8cca850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:01.842 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.839+0000 7fa76d1fd980 1 -- 172.21.15.194:0/1937142087 shutdown_connections 2024-09-13T06:10:01.842 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.839+0000 7fa76d1fd980 1 -- 172.21.15.194:0/1937142087 wait complete. 2024-09-13T06:10:01.842 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.839+0000 7fa76d1fd980 1 Processor -- start 2024-09-13T06:10:01.842 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.839+0000 7fa76d1fd980 1 -- start start 2024-09-13T06:10:01.842 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.839+0000 7fa76d1fd980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b4c8cd0370 0x55b4c8cd7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:01.842 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.839+0000 7fa76d1fd980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55b4c8cd0d40 con 0x55b4c8cd0370 2024-09-13T06:10:01.842 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.839+0000 7fa76ad0d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b4c8cd0370 0x55b4c8cd7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:01.842 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.839+0000 7fa76ad0d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b4c8cd0370 0x55b4c8cd7490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:46390/0 (socket says 172.21.15.194:46390) 2024-09-13T06:10:01.843 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.839+0000 7fa76ad0d640 1 -- 172.21.15.194:0/2735858624 learned_addr learned my addr 172.21.15.194:0/2735858624 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:01.843 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.839+0000 7fa76ad0d640 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4c8cd79d0 con 0x55b4c8cd0370 2024-09-13T06:10:01.843 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.839+0000 7fa76ad0d640 1 --2- 172.21.15.194:0/2735858624 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b4c8cd0370 0x55b4c8cd7490 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fa7540c7da0 tx=0x7fa7540c9080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:01.848 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.839+0000 7fa63b7fe640 1 -- 172.21.15.194:0/2735858624 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa754109070 con 0x55b4c8cd0370 2024-09-13T06:10:01.848 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.839+0000 7fa63b7fe640 1 -- 172.21.15.194:0/2735858624 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7540b4dd0 con 0x55b4c8cd0370 2024-09-13T06:10:01.848 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.839+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b4c8cd79d0 con 0x55b4c8cd0370 2024-09-13T06:10:01.848 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.839+0000 7fa63b7fe640 1 -- 172.21.15.194:0/2735858624 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7540c78c0 con 0x55b4c8cd0370 2024-09-13T06:10:01.848 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.839+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4c8cd7e40 con 0x55b4c8cd0370 2024-09-13T06:10:01.848 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.843+0000 7fa76d1fd980 20 rados->read ofs=0 len=0 2024-09-13T06:10:01.848 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.843+0000 7fa63b7fe640 1 -- 172.21.15.194:0/2735858624 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa75410c070 con 0x55b4c8cd0370 2024-09-13T06:10:01.848 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.843+0000 7fa63b7fe640 1 --2- 172.21.15.194:0/2735858624 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa6340346a0 0x7fa634036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:01.848 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.843+0000 7fa63b7fe640 1 -- 172.21.15.194:0/2735858624 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7fa7540f7070 con 0x55b4c8cd0370 2024-09-13T06:10:01.848 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.843+0000 7fa76a50c640 1 --2- 172.21.15.194:0/2735858624 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa6340346a0 0x7fa634036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:01.848 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.843+0000 7fa76d1fd980 1 --2- 172.21.15.194:0/2735858624 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55b4c8ce2310 0x55b4c8ce47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:01.849 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.843+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8ce4ef0 con 0x55b4c8ce2310 2024-09-13T06:10:01.849 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.843+0000 7fa76b50e640 1 --2- 172.21.15.194:0/2735858624 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55b4c8ce2310 0x55b4c8ce47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:01.849 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.843+0000 7fa76a50c640 1 --2- 172.21.15.194:0/2735858624 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa6340346a0 0x7fa634036b60 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x55b4c8cb63f0 tx=0x7fa75c011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:01.849 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.843+0000 7fa76b50e640 1 --2- 172.21.15.194:0/2735858624 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55b4c8ce2310 0x55b4c8ce47a0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:01.849 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.843+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa7640083f0 con 0x55b4c8ce2310 2024-09-13T06:10:01.849 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.843+0000 7fa76d1fd980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:01.849 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.843+0000 7fa76d1fd980 20 realm 2024-09-13T06:10:01.849 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.843+0000 7fa76d1fd980 20 rados->read ofs=0 len=0 2024-09-13T06:10:01.849 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.843+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8ce5300 con 0x55b4c8ce2310 2024-09-13T06:10:01.849 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.843+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa7640083f0 con 0x55b4c8ce2310 2024-09-13T06:10:01.849 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.843+0000 7fa76d1fd980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:01.849 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.843+0000 7fa76d1fd980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:10:01.850 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.843+0000 7fa76d1fd980 20 rados->read ofs=0 len=0 2024-09-13T06:10:01.850 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.843+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8ce5ba0 con 0x55b4c8ce2310 2024-09-13T06:10:01.850 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.843+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa7640083f0 con 0x55b4c8ce2310 2024-09-13T06:10:01.850 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.843+0000 7fa76d1fd980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:01.850 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.843+0000 7fa76d1fd980 20 rados->read ofs=0 len=0 2024-09-13T06:10:01.850 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.843+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8ce5f40 con 0x55b4c8ce2310 2024-09-13T06:10:01.850 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.843+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa7640083f0 con 0x55b4c8ce2310 2024-09-13T06:10:01.850 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.843+0000 7fa76d1fd980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:10:01.850 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.843+0000 7fa76d1fd980 20 rados->read ofs=0 len=0 2024-09-13T06:10:01.850 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.843+0000 7fa76d1fd980 1 --2- 172.21.15.194:0/2735858624 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55b4c8ce6ca0 0x55b4c8ce9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:01.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.843+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8ce96e0 con 0x55b4c8ce6ca0 2024-09-13T06:10:01.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.843+0000 7fa76ad0d640 1 --2- 172.21.15.194:0/2735858624 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55b4c8ce6ca0 0x55b4c8ce9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:01.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.843+0000 7fa76ad0d640 1 --2- 172.21.15.194:0/2735858624 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55b4c8ce6ca0 0x55b4c8ce9090 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:01.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.843+0000 7fa76ad0d640 1 -- 172.21.15.194:0/2735858624 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa754115070 con 0x55b4c8ce6ca0 2024-09-13T06:10:01.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.843+0000 7fa76d1fd980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:10:01.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.843+0000 7fa76d1fd980 20 searching for the correct realm 2024-09-13T06:10:01.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.843+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8ceaf40 con 0x55b4c8ce6ca0 2024-09-13T06:10:01.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.843+0000 7fa76ad0d640 1 -- 172.21.15.194:0/2735858624 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa754115070 con 0x55b4c8ce6ca0 2024-09-13T06:10:01.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.843+0000 7fa76ad0d640 1 --2- 172.21.15.194:0/2735858624 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fa75410e070 0x7fa7540a65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:01.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.843+0000 7fa76ad0d640 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8ceaf40 con 0x7fa75410e070 2024-09-13T06:10:01.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.847+0000 7fa76a50c640 1 --2- 172.21.15.194:0/2735858624 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fa75410e070 0x7fa7540a65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:01.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.847+0000 7fa76a50c640 1 --2- 172.21.15.194:0/2735858624 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fa75410e070 0x7fa7540a65e0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:01.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.847+0000 7fa76a50c640 1 -- 172.21.15.194:0/2735858624 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa75c036040 con 0x7fa75410e070 2024-09-13T06:10:01.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.847+0000 7fa76a50c640 1 --2- 172.21.15.194:0/2735858624 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fa75c00f3d0 0x7fa75c00f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:01.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.847+0000 7fa76a50c640 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8ceaf40 con 0x7fa75c00f3d0 2024-09-13T06:10:01.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.847+0000 7fa76b50e640 1 --2- 172.21.15.194:0/2735858624 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fa75c00f3d0 0x7fa75c00f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:01.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.847+0000 7fa76b50e640 1 --2- 172.21.15.194:0/2735858624 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fa75c00f3d0 0x7fa75c00f7f0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:01.857 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.847+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7640083f0 con 0x7fa75c00f3d0 2024-09-13T06:10:01.857 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.847+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8ce5f40 con 0x55b4c8ce2310 2024-09-13T06:10:01.857 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.847+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7640083f0 con 0x55b4c8ce2310 2024-09-13T06:10:01.857 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.847+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8ce5f40 con 0x55b4c8ce2310 2024-09-13T06:10:01.857 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.847+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7640083f0 con 0x55b4c8ce2310 2024-09-13T06:10:01.857 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.847+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8ce5f40 con 0x7fa75c00f3d0 2024-09-13T06:10:01.857 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.847+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7640083f0 con 0x7fa75c00f3d0 2024-09-13T06:10:01.857 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.847+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8ce5f40 con 0x7fa75c00f3d0 2024-09-13T06:10:01.857 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.851+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7640083f0 con 0x7fa75c00f3d0 2024-09-13T06:10:01.857 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.851+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8ce5f40 con 0x7fa75410e070 2024-09-13T06:10:01.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.851+0000 7fa76a50c640 1 -- 172.21.15.194:0/2735858624 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa75c036040 con 0x7fa75410e070 2024-09-13T06:10:01.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.851+0000 7fa76a50c640 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8ce5f40 con 0x55b4c8ce6ca0 2024-09-13T06:10:01.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.851+0000 7fa76ad0d640 1 -- 172.21.15.194:0/2735858624 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa754115070 con 0x55b4c8ce6ca0 2024-09-13T06:10:01.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.851+0000 7fa76ad0d640 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8ce5f40 con 0x55b4c8ce2310 2024-09-13T06:10:01.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.851+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7640083f0 con 0x55b4c8ce2310 2024-09-13T06:10:01.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.851+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8ce5f40 con 0x7fa75c00f3d0 2024-09-13T06:10:01.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.851+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7640083f0 con 0x7fa75c00f3d0 2024-09-13T06:10:01.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.851+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8ce5f40 con 0x55b4c8ce2310 2024-09-13T06:10:01.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.851+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7640083f0 con 0x55b4c8ce2310 2024-09-13T06:10:01.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.851+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8ce5f40 con 0x7fa75410e070 2024-09-13T06:10:01.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.851+0000 7fa76a50c640 1 -- 172.21.15.194:0/2735858624 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa75c036040 con 0x7fa75410e070 2024-09-13T06:10:01.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.851+0000 7fa76a50c640 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8ce5f40 con 0x55b4c8ce6ca0 2024-09-13T06:10:01.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.851+0000 7fa76ad0d640 1 -- 172.21.15.194:0/2735858624 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa754115070 con 0x55b4c8ce6ca0 2024-09-13T06:10:01.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.851+0000 7fa76ad0d640 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8ce5f40 con 0x55b4c8ce6ca0 2024-09-13T06:10:01.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.851+0000 7fa76ad0d640 1 -- 172.21.15.194:0/2735858624 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa754115070 con 0x55b4c8ce6ca0 2024-09-13T06:10:01.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.851+0000 7fa76ad0d640 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8ce5f40 con 0x7fa75c00f3d0 2024-09-13T06:10:01.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.851+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7640083f0 con 0x7fa75c00f3d0 2024-09-13T06:10:01.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.851+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8ce5f40 con 0x55b4c8ce6ca0 2024-09-13T06:10:01.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.851+0000 7fa76ad0d640 1 -- 172.21.15.194:0/2735858624 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa754115070 con 0x55b4c8ce6ca0 2024-09-13T06:10:01.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.851+0000 7fa76ad0d640 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8ce5f40 con 0x55b4c8ce6ca0 2024-09-13T06:10:01.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.851+0000 7fa76ad0d640 1 -- 172.21.15.194:0/2735858624 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa754115070 con 0x55b4c8ce6ca0 2024-09-13T06:10:01.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.851+0000 7fa76ad0d640 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8ce5f40 con 0x55b4c8ce2310 2024-09-13T06:10:01.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.855+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7640083f0 con 0x55b4c8ce2310 2024-09-13T06:10:01.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.855+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8ce5f40 con 0x55b4c8ce2310 2024-09-13T06:10:01.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.855+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa7640083f0 con 0x55b4c8ce2310 2024-09-13T06:10:01.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.855+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8ce5f40 con 0x7fa75c00f3d0 2024-09-13T06:10:01.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.855+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7640083f0 con 0x7fa75c00f3d0 2024-09-13T06:10:01.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.855+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8ce5f40 con 0x55b4c8ce6ca0 2024-09-13T06:10:01.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.855+0000 7fa76ad0d640 1 -- 172.21.15.194:0/2735858624 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa754115070 con 0x55b4c8ce6ca0 2024-09-13T06:10:01.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.855+0000 7fa76ad0d640 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8ce5f40 con 0x7fa75410e070 2024-09-13T06:10:01.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.855+0000 7fa76a50c640 1 -- 172.21.15.194:0/2735858624 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa75c036040 con 0x7fa75410e070 2024-09-13T06:10:01.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.855+0000 7fa76a50c640 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8ce5f40 con 0x55b4c8ce2310 2024-09-13T06:10:01.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.855+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7640083f0 con 0x55b4c8ce2310 2024-09-13T06:10:01.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.855+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8ce5f40 con 0x7fa75c00f3d0 2024-09-13T06:10:01.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.855+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7640083f0 con 0x7fa75c00f3d0 2024-09-13T06:10:01.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.855+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8ce5f40 con 0x55b4c8ce6ca0 2024-09-13T06:10:01.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.855+0000 7fa76ad0d640 1 -- 172.21.15.194:0/2735858624 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa754115070 con 0x55b4c8ce6ca0 2024-09-13T06:10:01.861 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.855+0000 7fa76ad0d640 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8ce5f40 con 0x7fa75c00f3d0 2024-09-13T06:10:01.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.855+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7640083f0 con 0x7fa75c00f3d0 2024-09-13T06:10:01.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.855+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8ce5f40 con 0x7fa75410e070 2024-09-13T06:10:01.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.855+0000 7fa76a50c640 1 -- 172.21.15.194:0/2735858624 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa75c036040 con 0x7fa75410e070 2024-09-13T06:10:01.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.855+0000 7fa76a50c640 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8ce5f40 con 0x55b4c8ce6ca0 2024-09-13T06:10:01.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.855+0000 7fa76ad0d640 1 -- 172.21.15.194:0/2735858624 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa754115070 con 0x55b4c8ce6ca0 2024-09-13T06:10:01.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.855+0000 7fa76ad0d640 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8ce5f40 con 0x7fa75c00f3d0 2024-09-13T06:10:01.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.859+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7640083f0 con 0x7fa75c00f3d0 2024-09-13T06:10:01.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.859+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8ce5f40 con 0x55b4c8ce2310 2024-09-13T06:10:01.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.859+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa7640083f0 con 0x55b4c8ce2310 2024-09-13T06:10:01.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.859+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8ce5f40 con 0x7fa75410e070 2024-09-13T06:10:01.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.859+0000 7fa76a50c640 1 -- 172.21.15.194:0/2735858624 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa75c036040 con 0x7fa75410e070 2024-09-13T06:10:01.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.859+0000 7fa76d1fd980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:10:01.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.859+0000 7fa76d1fd980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:10:01.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.859+0000 7fa76d1fd980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:10:01.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.859+0000 7fa76d1fd980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:10:01.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.859+0000 7fa76d1fd980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:10:01.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.859+0000 7fa76d1fd980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:10:01.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.859+0000 7fa76d1fd980 20 rados->read ofs=0 len=0 2024-09-13T06:10:01.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.859+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8ce9ff0 con 0x55b4c8ce2310 2024-09-13T06:10:01.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.859+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa7640083f0 con 0x55b4c8ce2310 2024-09-13T06:10:01.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.859+0000 7fa76d1fd980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:01.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.859+0000 7fa76d1fd980 20 rados->read ofs=0 len=0 2024-09-13T06:10:01.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.859+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8cea840 con 0x55b4c8ce2310 2024-09-13T06:10:01.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.859+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa7640083f0 con 0x55b4c8ce2310 2024-09-13T06:10:01.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.859+0000 7fa76d1fd980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:10:01.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.859+0000 7fa76d1fd980 20 rados->read ofs=0 len=0 2024-09-13T06:10:01.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.859+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8cea390 con 0x7fa75410e070 2024-09-13T06:10:01.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.859+0000 7fa76a50c640 1 -- 172.21.15.194:0/2735858624 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa75c036040 con 0x7fa75410e070 2024-09-13T06:10:01.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.859+0000 7fa76d1fd980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:10:01.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.859+0000 7fa76d1fd980 20 zone default found 2024-09-13T06:10:01.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.859+0000 7fa76d1fd980 4 Realm: () 2024-09-13T06:10:01.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.859+0000 7fa76d1fd980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:10:01.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.859+0000 7fa76d1fd980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:10:01.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.859+0000 7fa76d1fd980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:10:01.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.859+0000 7fa76d1fd980 20 zonegroup default 2024-09-13T06:10:01.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.859+0000 7fa76d1fd980 20 rados->read ofs=0 len=0 2024-09-13T06:10:01.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.859+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8ceb370 con 0x7fa75c00f3d0 2024-09-13T06:10:01.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.859+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa7640083f0 con 0x7fa75c00f3d0 2024-09-13T06:10:01.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.859+0000 7fa76d1fd980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:01.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.859+0000 7fa76d1fd980 20 rados->read ofs=0 len=0 2024-09-13T06:10:01.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.859+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8cecd80 con 0x55b4c8ce6ca0 2024-09-13T06:10:01.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.859+0000 7fa76ad0d640 1 -- 172.21.15.194:0/2735858624 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa754115070 con 0x55b4c8ce6ca0 2024-09-13T06:10:01.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.859+0000 7fa76d1fd980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:01.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.859+0000 7fa76d1fd980 20 rados->read ofs=0 len=0 2024-09-13T06:10:01.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.859+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8ced230 con 0x55b4c8ce6ca0 2024-09-13T06:10:01.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.859+0000 7fa76ad0d640 1 -- 172.21.15.194:0/2735858624 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa754115070 con 0x55b4c8ce6ca0 2024-09-13T06:10:01.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.859+0000 7fa76d1fd980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:01.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.859+0000 7fa76d1fd980 20 started sync module instance, tier type = 2024-09-13T06:10:01.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.859+0000 7fa76d1fd980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:10:01.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.859+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8cec1f0 con 0x7fa75410e070 2024-09-13T06:10:01.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.863+0000 7fa76a50c640 1 -- 172.21.15.194:0/2735858624 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(44 notify.0 [create] v33'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa75c036040 con 0x7fa75410e070 2024-09-13T06:10:01.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.863+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94234951468512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8cedb40 con 0x7fa75410e070 2024-09-13T06:10:01.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.863+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8cee390 con 0x55b4c8ce2310 2024-09-13T06:10:01.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.863+0000 7fa76a50c640 1 -- 172.21.15.194:0/2735858624 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94234951468512] v33'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa75c036040 con 0x7fa75410e070 2024-09-13T06:10:01.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.863+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v33'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7640083f0 con 0x55b4c8ce2310 2024-09-13T06:10:01.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.863+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94234951472784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8cee390 con 0x55b4c8ce2310 2024-09-13T06:10:01.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.863+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8ceee00 con 0x55b4c8ce6ca0 2024-09-13T06:10:01.871 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.867+0000 7fa76ad0d640 1 -- 172.21.15.194:0/2735858624 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v33'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa754115070 con 0x55b4c8ce6ca0 2024-09-13T06:10:01.871 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.867+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94234951477456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8cef6a0 con 0x55b4c8ce6ca0 2024-09-13T06:10:01.871 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.867+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8cf00e0 con 0x7fa75410e070 2024-09-13T06:10:01.871 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.867+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94234951472784] v33'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7640083f0 con 0x55b4c8ce2310 2024-09-13T06:10:01.871 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.867+0000 7fa76a50c640 1 -- 172.21.15.194:0/2735858624 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(50 notify.3 [create] v33'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa75c036040 con 0x7fa75410e070 2024-09-13T06:10:01.871 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.867+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94234951482288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8cf04d0 con 0x7fa75410e070 2024-09-13T06:10:01.871 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.867+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8cf0e90 con 0x55b4c8ce2310 2024-09-13T06:10:01.871 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.867+0000 7fa76ad0d640 1 -- 172.21.15.194:0/2735858624 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94234951477456] v33'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa754115070 con 0x55b4c8ce6ca0 2024-09-13T06:10:01.871 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.867+0000 7fa76a50c640 1 -- 172.21.15.194:0/2735858624 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94234951482288] v33'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa75c036040 con 0x7fa75410e070 2024-09-13T06:10:01.871 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.867+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v33'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7640083f0 con 0x55b4c8ce2310 2024-09-13T06:10:01.871 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.871+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94234951474912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8cf09e0 con 0x55b4c8ce2310 2024-09-13T06:10:01.871 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.871+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8cf1230 con 0x7fa75c00f3d0 2024-09-13T06:10:01.872 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.871+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94234951474912] v33'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7640083f0 con 0x55b4c8ce2310 2024-09-13T06:10:01.872 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.871+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(54 notify.5 [create] v33'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7640083f0 con 0x7fa75c00f3d0 2024-09-13T06:10:01.872 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.871+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94234951485920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8cf1620 con 0x7fa75c00f3d0 2024-09-13T06:10:01.872 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.871+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8cf1e70 con 0x7fa75c00f3d0 2024-09-13T06:10:01.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.871+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94234951485920] v33'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7640083f0 con 0x7fa75c00f3d0 2024-09-13T06:10:01.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.875+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(56 notify.6 [create] v33'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7640083f0 con 0x7fa75c00f3d0 2024-09-13T06:10:01.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.875+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94234951486976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8cf1a80 con 0x7fa75c00f3d0 2024-09-13T06:10:01.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.875+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8cf2560 con 0x7fa75c00f3d0 2024-09-13T06:10:01.876 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.875+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(58 notify.7 [create] v33'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7640083f0 con 0x7fa75c00f3d0 2024-09-13T06:10:01.876 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.875+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94234951491696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8cf2560 con 0x7fa75c00f3d0 2024-09-13T06:10:01.877 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.875+0000 7fa76d1fd980 20 add_watcher() i=0 2024-09-13T06:10:01.877 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.875+0000 7fa76d1fd980 20 add_watcher() i=1 2024-09-13T06:10:01.877 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.875+0000 7fa76d1fd980 20 add_watcher() i=2 2024-09-13T06:10:01.877 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.875+0000 7fa76d1fd980 20 add_watcher() i=3 2024-09-13T06:10:01.877 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.875+0000 7fa76d1fd980 20 add_watcher() i=4 2024-09-13T06:10:01.877 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.875+0000 7fa76d1fd980 20 add_watcher() i=5 2024-09-13T06:10:01.877 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.875+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94234951486976] v33'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7640083f0 con 0x7fa75c00f3d0 2024-09-13T06:10:01.877 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.875+0000 7fa76d1fd980 20 add_watcher() i=6 2024-09-13T06:10:01.878 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.875+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94234951491696] v33'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7640083f0 con 0x7fa75c00f3d0 2024-09-13T06:10:01.878 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.875+0000 7fa76d1fd980 20 add_watcher() i=7 2024-09-13T06:10:01.878 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.875+0000 7fa76d1fd980 2 all 8 watchers are set, enabling cache 2024-09-13T06:10:01.878 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.875+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8cf15d0 con 0x55b4c8ce2310 2024-09-13T06:10:01.879 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.879+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa7640083f0 con 0x55b4c8ce2310 2024-09-13T06:10:01.879 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.879+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94234951488976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8cf2f00 con 0x55b4c8ce2310 2024-09-13T06:10:01.881 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.879+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94234951488976] v33'148 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa7640083f0 con 0x55b4c8ce2310 2024-09-13T06:10:01.881 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.879+0000 7fa6137fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:10:01.881 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.879+0000 7fa76d1fd980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:10:01.881 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.879+0000 7fa76d1fd980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:10:01.881 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.879+0000 7fa76d1fd980 5 note: GC not initialized 2024-09-13T06:10:01.881 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.879+0000 7fa6127fc640 20 reqs_thread_entry: start 2024-09-13T06:10:01.881 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.879+0000 7fa76d1fd980 20 init_complete bucket index max shards: 11 2024-09-13T06:10:01.881 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.879+0000 7fa76d1fd980 20 Filter name: none 2024-09-13T06:10:01.881 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.879+0000 7fa58bfff640 20 reqs_thread_entry: start 2024-09-13T06:10:01.881 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.879+0000 7fa76d1fd980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T06:10:01.881 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.879+0000 7fa76d1fd980 20 rados->read ofs=0 len=0 2024-09-13T06:10:01.881 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.879+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8d1b2b0 con 0x55b4c8ce2310 2024-09-13T06:10:01.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.879+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fa7640083f0 con 0x55b4c8ce2310 2024-09-13T06:10:01.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.879+0000 7fa76d1fd980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T06:10:01.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.879+0000 7fa76d1fd980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T06:10:01.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.879+0000 7fa76d1fd980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:10:01.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.879+0000 7fa76d1fd980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:10:01.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.879+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8d1ad90 con 0x7fa75410e070 2024-09-13T06:10:01.884 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.879+0000 7fa76a50c640 1 -- 172.21.15.194:0/2735858624 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fa75c036040 con 0x7fa75410e070 2024-09-13T06:10:01.884 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.879+0000 7fa76d1fd980 20 disabling bucket name=myfoo 2024-09-13T06:10:01.885 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.879+0000 7fa76d1fd980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T06:10:01.885 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.879+0000 7fa76d1fd980 20 rados->read ofs=0 len=0 2024-09-13T06:10:01.885 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.879+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8d1bd20 con 0x7fa75410e070 2024-09-13T06:10:01.885 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.879+0000 7fa76a50c640 1 -- 172.21.15.194:0/2735858624 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7fa75c036040 con 0x7fa75410e070 2024-09-13T06:10:01.885 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.879+0000 7fa76d1fd980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T06:10:01.885 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.879+0000 7fa76d1fd980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-09-13T06:10:01.885 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.879+0000 7fa76d1fd980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T06:10:01.885 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.879+0000 7fa76d1fd980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 : miss 2024-09-13T06:10:01.885 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.879+0000 7fa76d1fd980 20 rados->read ofs=0 len=0 2024-09-13T06:10:01.885 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.879+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:65 8.18 8:1a66c368:root::.bucket.meta.myfoo%3a52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8d1d600 con 0x55b4c8ce2310 2024-09-13T06:10:01.885 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.879+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(65 .bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv16 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fa7640083f0 con 0x55b4c8ce2310 2024-09-13T06:10:01.885 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.879+0000 7fa76d1fd980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T06:10:01.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.879+0000 7fa76d1fd980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 info.flags=0x17 2024-09-13T06:10:01.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.879+0000 7fa76d1fd980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 to cache LRU end 2024-09-13T06:10:01.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.879+0000 7fa76d1fd980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:10:01.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.879+0000 7fa76d1fd980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T06:10:01.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.879+0000 7fa76d1fd980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 2024-09-13T06:10:01.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.879+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:66 8.18 8:1a66c368:root::.bucket.meta.myfoo%3a52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8d25f40 con 0x55b4c8ce2310 2024-09-13T06:10:01.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.883+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(66 .bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v33'17 uv17 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7fa7640083f0 con 0x55b4c8ce2310 2024-09-13T06:10:01.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.883+0000 7fa76d1fd980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 info.flags=0x17 2024-09-13T06:10:01.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.883+0000 7fa76d1fd980 10 moving default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 to cache LRU end 2024-09-13T06:10:01.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.883+0000 7fa76d1fd980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T06:10:01.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.883+0000 7fa76d1fd980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1, ofs0, ns] 2024-09-13T06:10:01.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.883+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:67 7.9 7:93e5b521:::notify.7:head [notify cookie 94234951698336 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8d1e240 con 0x7fa75c00f3d0 2024-09-13T06:10:01.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.883+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== watch-notify(notify (1) cookie 94234951491696 notify 141733920785 ret 0) ==== 794+0+0 (crc 0 0 0) 0x55b4c8d1d9f0 con 0x7fa75c00f3d0 2024-09-13T06:10:01.887 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.883+0000 7fa64d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920785 cookie 94234951491696 notifier 4591 bl.length()=752 2024-09-13T06:10:01.887 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.883+0000 7fa64d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 info.flags=0x17 2024-09-13T06:10:01.887 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.883+0000 7fa64d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 to cache LRU end 2024-09-13T06:10:01.887 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.883+0000 7fa64d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T06:10:01.887 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.883+0000 7fa64d7fa640 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:68 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fa62c003eb0 con 0x7fa75c00f3d0 2024-09-13T06:10:01.887 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.883+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(67 notify.7 [notify cookie 94234951698336 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa7640083f0 con 0x7fa75c00f3d0 2024-09-13T06:10:01.887 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.883+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(68 notify.7 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7640083f0 con 0x7fa75c00f3d0 2024-09-13T06:10:01.889 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.883+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 <== osd.0 v2:172.21.15.120:6800/1923744619 20 ==== watch-notify(notify_complete (2) cookie 94234951698336 notify 141733920785 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b4c8d1ba60 con 0x7fa75c00f3d0 2024-09-13T06:10:01.889 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.883+0000 7fa76d1fd980 20 handle_bi_update(): bucket=:myfoo[52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1]): orig_sources= new_sources= 2024-09-13T06:10:01.889 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.883+0000 7fa76d1fd980 20 handle_bi_update(): bucket=:myfoo[52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1]): potential sources added=[] removed=[] 2024-09-13T06:10:01.889 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.883+0000 7fa76d1fd980 20 handle_bi_update(): bucket=:myfoo[52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1]): orig_dests= new_dests= 2024-09-13T06:10:01.889 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.883+0000 7fa76d1fd980 20 handle_bi_update(): bucket=:myfoo[52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1]): potential dests added=[] removed=[] 2024-09-13T06:10:01.889 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.883+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8d257b0 con 0x55b4c8ce2310 2024-09-13T06:10:01.889 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.887+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v33'18 uv18 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fa7640083f0 con 0x55b4c8ce2310 2024-09-13T06:10:01.889 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.887+0000 7fa76d1fd980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T06:10:01.889 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.887+0000 7fa76d1fd980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:10:01.889 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.887+0000 7fa76d1fd980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T06:10:01.889 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.887+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94234951698336 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8d21980 con 0x55b4c8ce2310 2024-09-13T06:10:01.889 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.887+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 <== osd.1 v2:172.21.15.194:6808/3135444559 25 ==== watch-notify(notify (1) cookie 94234951474912 notify 141733920782 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55b4c8d1ba60 con 0x55b4c8ce2310 2024-09-13T06:10:01.890 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.887+0000 7fa64cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920782 cookie 94234951474912 notifier 4591 bl.length()=567 2024-09-13T06:10:01.890 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.887+0000 7fa64cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T06:10:01.890 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.887+0000 7fa64cff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:10:01.890 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.887+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 <== osd.1 v2:172.21.15.194:6808/3135444559 26 ==== osd_op_reply(70 notify.4 [notify cookie 94234951698336 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa7640083f0 con 0x55b4c8ce2310 2024-09-13T06:10:01.890 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.887+0000 7fa64cff9640 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fa594003440 con 0x55b4c8ce2310 2024-09-13T06:10:01.890 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.887+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 <== osd.1 v2:172.21.15.194:6808/3135444559 27 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7640083f0 con 0x55b4c8ce2310 2024-09-13T06:10:01.890 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.887+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 <== osd.1 v2:172.21.15.194:6808/3135444559 28 ==== watch-notify(notify_complete (2) cookie 94234951698336 notify 141733920782 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fa76403b040 con 0x55b4c8ce2310 2024-09-13T06:10:01.890 INFO:teuthology.orchestra.run.smithi194.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T06:09:53.191222Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:09:53.191207Z","tags":[],"group_ids":[]} 2024-09-13T06:10:01.891 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.887+0000 7fa6137fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:10:01.891 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.887+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94234951488976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8d190e0 con 0x55b4c8ce2310 2024-09-13T06:10:01.891 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.887+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 <== osd.1 v2:172.21.15.194:6808/3135444559 29 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94234951488976] v33'149 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa7640083f0 con 0x55b4c8ce2310 2024-09-13T06:10:01.891 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.887+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94234951468512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8d190e0 con 0x7fa75410e070 2024-09-13T06:10:01.892 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.887+0000 7fa76a50c640 1 -- 172.21.15.194:0/2735858624 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94234951468512] v33'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa75c036040 con 0x7fa75410e070 2024-09-13T06:10:01.892 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.887+0000 7fa76d1fd980 20 remove_watcher() i=0 2024-09-13T06:10:01.892 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.887+0000 7fa76d1fd980 2 removed watcher, disabling cache 2024-09-13T06:10:01.892 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.887+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94234951472784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8d190e0 con 0x55b4c8ce2310 2024-09-13T06:10:01.892 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.891+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 <== osd.1 v2:172.21.15.194:6808/3135444559 30 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94234951472784] v33'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7640083f0 con 0x55b4c8ce2310 2024-09-13T06:10:01.892 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.891+0000 7fa76d1fd980 20 remove_watcher() i=1 2024-09-13T06:10:01.893 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.891+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94234951477456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8ced690 con 0x55b4c8ce6ca0 2024-09-13T06:10:01.894 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.891+0000 7fa76ad0d640 1 -- 172.21.15.194:0/2735858624 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94234951477456] v33'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa754115070 con 0x55b4c8ce6ca0 2024-09-13T06:10:01.894 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.891+0000 7fa76d1fd980 20 remove_watcher() i=2 2024-09-13T06:10:01.894 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.891+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94234951482288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8d190e0 con 0x7fa75410e070 2024-09-13T06:10:01.895 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.895+0000 7fa76a50c640 1 -- 172.21.15.194:0/2735858624 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94234951482288] v33'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa75c036040 con 0x7fa75410e070 2024-09-13T06:10:01.895 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.895+0000 7fa76d1fd980 20 remove_watcher() i=3 2024-09-13T06:10:01.895 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.895+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94234951474912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8d190e0 con 0x55b4c8ce2310 2024-09-13T06:10:01.897 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.895+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 <== osd.1 v2:172.21.15.194:6808/3135444559 31 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94234951474912] v33'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7640083f0 con 0x55b4c8ce2310 2024-09-13T06:10:01.897 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.895+0000 7fa76d1fd980 20 remove_watcher() i=4 2024-09-13T06:10:01.897 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.895+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94234951485920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8d190e0 con 0x7fa75c00f3d0 2024-09-13T06:10:01.899 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.899+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 <== osd.0 v2:172.21.15.120:6800/1923744619 21 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94234951485920] v33'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7640083f0 con 0x7fa75c00f3d0 2024-09-13T06:10:01.899 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.899+0000 7fa76d1fd980 20 remove_watcher() i=5 2024-09-13T06:10:01.899 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.899+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94234951486976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8cf09e0 con 0x7fa75c00f3d0 2024-09-13T06:10:01.901 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.899+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 <== osd.0 v2:172.21.15.120:6800/1923744619 22 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94234951486976] v33'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7640083f0 con 0x7fa75c00f3d0 2024-09-13T06:10:01.901 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.899+0000 7fa76d1fd980 20 remove_watcher() i=6 2024-09-13T06:10:01.901 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.899+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2735858624 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94234951491696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b4c8cf09e0 con 0x7fa75c00f3d0 2024-09-13T06:10:01.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.903+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 <== osd.0 v2:172.21.15.120:6800/1923744619 23 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94234951491696] v33'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7640083f0 con 0x7fa75c00f3d0 2024-09-13T06:10:01.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.903+0000 7fa76d1fd980 20 remove_watcher() i=7 2024-09-13T06:10:01.906 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.903+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2735858624 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fa75c00f3d0 msgr2=0x7fa75c00f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.906 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.903+0000 7fa76d1fd980 1 --2- 172.21.15.194:0/2735858624 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fa75c00f3d0 0x7fa75c00f7f0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.906 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.903+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2735858624 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55b4c8ce2310 msgr2=0x55b4c8ce47a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.906 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.903+0000 7fa76d1fd980 1 --2- 172.21.15.194:0/2735858624 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55b4c8ce2310 0x55b4c8ce47a0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.906 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.903+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2735858624 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fa75410e070 msgr2=0x7fa7540a65e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.906 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.903+0000 7fa76d1fd980 1 --2- 172.21.15.194:0/2735858624 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fa75410e070 0x7fa7540a65e0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.906 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.903+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2735858624 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55b4c8ce6ca0 msgr2=0x55b4c8ce9090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.906 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.903+0000 7fa76d1fd980 1 --2- 172.21.15.194:0/2735858624 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55b4c8ce6ca0 0x55b4c8ce9090 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.906 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.903+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2735858624 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa6340346a0 msgr2=0x7fa634036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.906 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.903+0000 7fa76d1fd980 1 --2- 172.21.15.194:0/2735858624 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa6340346a0 0x7fa634036b60 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x55b4c8cb63f0 tx=0x7fa75c011000 comp rx=0 tx=0).stop 2024-09-13T06:10:01.906 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.903+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2735858624 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b4c8cd0370 msgr2=0x55b4c8cd7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.907 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.903+0000 7fa76b50e640 1 -- 172.21.15.194:0/2735858624 reap_dead start 2024-09-13T06:10:01.907 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.903+0000 7fa76d1fd980 1 --2- 172.21.15.194:0/2735858624 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b4c8cd0370 0x55b4c8cd7490 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fa7540c7da0 tx=0x7fa7540c9080 comp rx=0 tx=0).stop 2024-09-13T06:10:01.907 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.903+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2735858624 shutdown_connections 2024-09-13T06:10:01.907 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.903+0000 7fa76d1fd980 1 --2- 172.21.15.194:0/2735858624 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b4c8cd0370 0x55b4c8cd7490 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.907 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.903+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2735858624 >> 172.21.15.194:0/2735858624 conn(0x55b4c8ccc750 msgr2=0x55b4c8cca820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:01.907 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.903+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2735858624 shutdown_connections 2024-09-13T06:10:01.907 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.903+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2735858624 wait complete. 2024-09-13T06:10:01.907 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.903+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2086751582 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa6440346a0 msgr2=0x7fa644036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.907 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.903+0000 7fa76d1fd980 1 --2- 172.21.15.194:0/2086751582 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa6440346a0 0x7fa644036b60 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x55b4c8caa350 tx=0x7fa75c006000 comp rx=0 tx=0).stop 2024-09-13T06:10:01.907 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.903+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2086751582 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b4c8cc3ac0 msgr2=0x55b4c8cc3ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.907 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.903+0000 7fa76d1fd980 1 --2- 172.21.15.194:0/2086751582 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b4c8cc3ac0 0x55b4c8cc3ee0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fa7540bdad0 tx=0x7fa7540a9f70 comp rx=0 tx=0).stop 2024-09-13T06:10:01.907 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.903+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2086751582 shutdown_connections 2024-09-13T06:10:01.907 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.903+0000 7fa76d1fd980 1 --2- 172.21.15.194:0/2086751582 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa6440346a0 0x7fa644036b60 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.907 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.903+0000 7fa76d1fd980 1 --2- 172.21.15.194:0/2086751582 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b4c8cc3ac0 0x55b4c8cc3ee0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.903+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2086751582 >> 172.21.15.194:0/2086751582 conn(0x55b4c8cb8c10 msgr2=0x55b4c8cbb690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:01.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.903+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2086751582 shutdown_connections 2024-09-13T06:10:01.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.903+0000 7fa76d1fd980 1 -- 172.21.15.194:0/2086751582 wait complete. 2024-09-13T06:10:01.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.903+0000 7fa76d1fd980 1 -- 172.21.15.194:0/1092300557 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55b4c8bb3fe0 msgr2=0x55b4c8cacbd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.903+0000 7fa76d1fd980 1 --2- 172.21.15.194:0/1092300557 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55b4c8bb3fe0 0x55b4c8cacbd0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.903+0000 7fa76d1fd980 1 -- 172.21.15.194:0/1092300557 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55b4c8cb3510 msgr2=0x55b4c8cb5900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.903+0000 7fa76d1fd980 1 --2- 172.21.15.194:0/1092300557 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55b4c8cb3510 0x55b4c8cb5900 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.903+0000 7fa76d1fd980 1 -- 172.21.15.194:0/1092300557 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55b4c8caf460 msgr2=0x55b4c8cb1920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.903+0000 7fa76d1fd980 1 --2- 172.21.15.194:0/1092300557 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55b4c8caf460 0x55b4c8cb1920 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.903+0000 7fa76d1fd980 1 -- 172.21.15.194:0/1092300557 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa650034650 msgr2=0x7fa650036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.903+0000 7fa76d1fd980 1 --2- 172.21.15.194:0/1092300557 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa650034650 0x7fa650036b10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa75c001e20 tx=0x7fa75c0013a0 comp rx=0 tx=0).stop 2024-09-13T06:10:01.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.903+0000 7fa76d1fd980 1 -- 172.21.15.194:0/1092300557 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b4c8bb3690 msgr2=0x55b4c8ca5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.909 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.903+0000 7fa76d1fd980 1 --2- 172.21.15.194:0/1092300557 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b4c8bb3690 0x55b4c8ca5c40 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fa754005cc0 tx=0x7fa754017e30 comp rx=0 tx=0).stop 2024-09-13T06:10:01.909 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.903+0000 7fa76b50e640 1 -- 172.21.15.194:0/1092300557 reap_dead start 2024-09-13T06:10:01.909 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.903+0000 7fa76d1fd980 1 -- 172.21.15.194:0/1092300557 shutdown_connections 2024-09-13T06:10:01.909 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.903+0000 7fa76d1fd980 1 -- 172.21.15.194:0/1092300557 >> 172.21.15.194:0/1092300557 conn(0x55b4c8baf1b0 msgr2=0x55b4c8c991f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:01.909 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.903+0000 7fa76d1fd980 1 -- 172.21.15.194:0/1092300557 shutdown_connections 2024-09-13T06:10:01.909 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.903+0000 7fa76d1fd980 1 -- 172.21.15.194:0/1092300557 wait complete. 2024-09-13T06:10:01.914 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T06:09:53.191222Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:09:53.191207Z', 'tags': [], 'group_ids': []} 2024-09-13T06:10:01.916 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-09-13T06:10:01.916 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-09-13T06:10:01.916 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-09-13T06:10:01.994 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:10:01.994 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:10:01.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.995+0000 7f7dc3b44980 1 Processor -- start 2024-09-13T06:10:01.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.995+0000 7f7dc3b44980 1 -- start start 2024-09-13T06:10:01.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.995+0000 7f7dc3b44980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x5590865f5ac0 0x5590865f7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:01.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.995+0000 7f7dc3b44980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559086479ae0 con 0x559086566290 2024-09-13T06:10:01.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.995+0000 7f7dc3b44980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x55908649de30 con 0x5590865f5ac0 2024-09-13T06:10:01.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.995+0000 7f7dc0e53640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x5590865f5ac0 0x5590865f7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:01.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.995+0000 7f7dc0e53640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x5590865f5ac0 0x5590865f7eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:46400/0 (socket says 172.21.15.194:46400) 2024-09-13T06:10:01.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.995+0000 7f7dc0e53640 1 -- 172.21.15.194:0/615905917 learned_addr learned my addr 172.21.15.194:0/615905917 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:01.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.995+0000 7f7dc1654640 1 --1- 172.21.15.194:0/615905917 >> v1:172.21.15.120:6789/0 conn(0x559086566290 0x5590865f43a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:51322/0 (socket says 172.21.15.194:51322) 2024-09-13T06:10:01.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.995+0000 7f7dc0e53640 1 -- 172.21.15.194:0/615905917 >> v1:172.21.15.120:6789/0 conn(0x559086566290 legacy=0x5590865f43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.995+0000 7f7dc0e53640 1 -- 172.21.15.194:0/615905917 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559086566820 con 0x5590865f5ac0 2024-09-13T06:10:01.998 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.999+0000 7f7dc0e53640 1 --2- 172.21.15.194:0/615905917 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5590865f5ac0 0x5590865f7eb0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f7db800a5c0 tx=0x7f7db801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34c7a189695ec7af server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:01.998 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.999+0000 7f7db3fff640 1 -- 172.21.15.194:0/615905917 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7db80a6070 con 0x5590865f5ac0 2024-09-13T06:10:01.998 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.999+0000 7f7db3fff640 1 -- 172.21.15.194:0/615905917 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7db80af070 con 0x5590865f5ac0 2024-09-13T06:10:01.999 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.999+0000 7f7db3fff640 1 -- 172.21.15.194:0/615905917 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7db80aa5c0 con 0x5590865f5ac0 2024-09-13T06:10:01.999 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.999+0000 7f7dc3b44980 1 -- 172.21.15.194:0/615905917 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5590865f5ac0 msgr2=0x5590865f7eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:01.999 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.999+0000 7f7dc3b44980 1 --2- 172.21.15.194:0/615905917 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5590865f5ac0 0x5590865f7eb0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f7db800a5c0 tx=0x7f7db801b340 comp rx=0 tx=0).stop 2024-09-13T06:10:01.999 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.999+0000 7f7dc3b44980 1 -- 172.21.15.194:0/615905917 shutdown_connections 2024-09-13T06:10:02.000 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.999+0000 7f7dc3b44980 1 --2- 172.21.15.194:0/615905917 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5590865f5ac0 0x5590865f7eb0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:02.000 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.999+0000 7f7dc3b44980 1 -- 172.21.15.194:0/615905917 >> 172.21.15.194:0/615905917 conn(0x5590865ec090 msgr2=0x5590865ee4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:02.000 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.999+0000 7f7dc3b44980 1 -- 172.21.15.194:0/615905917 shutdown_connections 2024-09-13T06:10:02.000 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:01.999+0000 7f7dc3b44980 1 -- 172.21.15.194:0/615905917 wait complete. 2024-09-13T06:10:02.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.011+0000 7f7dc3b44980 1 Processor -- start 2024-09-13T06:10:02.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.011+0000 7f7dc3b44980 1 -- start start 2024-09-13T06:10:02.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.011+0000 7f7dc3b44980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559086566290 0x5590866dca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:02.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.011+0000 7f7dc3b44980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55908649f200 con 0x559086566290 2024-09-13T06:10:02.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.011+0000 7f7dc1654640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559086566290 0x5590866dca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:02.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.011+0000 7f7dc1654640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559086566290 0x5590866dca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:46406/0 (socket says 172.21.15.194:46406) 2024-09-13T06:10:02.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.011+0000 7f7dc1654640 1 -- 172.21.15.194:0/2841078917 learned_addr learned my addr 172.21.15.194:0/2841078917 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:02.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.011+0000 7f7dc1654640 1 -- 172.21.15.194:0/2841078917 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590866dcfd0 con 0x559086566290 2024-09-13T06:10:02.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.011+0000 7f7dc1654640 1 --2- 172.21.15.194:0/2841078917 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559086566290 0x5590866dca00 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f7db4001e50 tx=0x7f7db4001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea9936e0b762812b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:02.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.015+0000 7f7caf606640 1 -- 172.21.15.194:0/2841078917 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7db400e5d0 con 0x559086566290 2024-09-13T06:10:02.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.015+0000 7f7caf606640 1 -- 172.21.15.194:0/2841078917 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7db400e770 con 0x559086566290 2024-09-13T06:10:02.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.015+0000 7f7caf606640 1 -- 172.21.15.194:0/2841078917 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7db400eab0 con 0x559086566290 2024-09-13T06:10:02.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.015+0000 7f7dc3b44980 1 -- 172.21.15.194:0/2841078917 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559086566290 msgr2=0x5590866dca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:02.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.015+0000 7f7dc3b44980 1 --2- 172.21.15.194:0/2841078917 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559086566290 0x5590866dca00 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f7db4001e50 tx=0x7f7db4001e80 comp rx=0 tx=0).stop 2024-09-13T06:10:02.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.015+0000 7f7dc3b44980 1 -- 172.21.15.194:0/2841078917 shutdown_connections 2024-09-13T06:10:02.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.015+0000 7f7dc3b44980 1 --2- 172.21.15.194:0/2841078917 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559086566290 0x5590866dca00 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:02.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.015+0000 7f7dc3b44980 1 -- 172.21.15.194:0/2841078917 >> 172.21.15.194:0/2841078917 conn(0x5590865ec090 msgr2=0x5590866d8630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:02.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.015+0000 7f7dc3b44980 1 -- 172.21.15.194:0/2841078917 shutdown_connections 2024-09-13T06:10:02.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.015+0000 7f7dc3b44980 1 -- 172.21.15.194:0/2841078917 wait complete. 2024-09-13T06:10:02.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.015+0000 7f7dc3b44980 1 Processor -- start 2024-09-13T06:10:02.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.015+0000 7f7dc3b44980 1 -- start start 2024-09-13T06:10:02.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.015+0000 7f7dc3b44980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559086566290 0x5590866e3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:02.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.015+0000 7f7dc3b44980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5590865f8f00 con 0x559086566290 2024-09-13T06:10:02.017 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.015+0000 7f7dc1654640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559086566290 0x5590866e3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:02.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.015+0000 7f7dc1654640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559086566290 0x5590866e3d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:46410/0 (socket says 172.21.15.194:46410) 2024-09-13T06:10:02.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.015+0000 7f7dc1654640 1 -- 172.21.15.194:0/273205514 learned_addr learned my addr 172.21.15.194:0/273205514 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:02.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.015+0000 7f7dc1654640 1 -- 172.21.15.194:0/273205514 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590866e4290 con 0x559086566290 2024-09-13T06:10:02.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.015+0000 7f7dc1654640 1 --2- 172.21.15.194:0/273205514 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559086566290 0x5590866e3d50 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x5590866ddbe0 tx=0x7f7db4000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:02.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.015+0000 7f7cade03640 1 -- 172.21.15.194:0/273205514 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7db4001260 con 0x559086566290 2024-09-13T06:10:02.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.015+0000 7f7dc3b44980 1 -- 172.21.15.194:0/273205514 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5590866e4520 con 0x559086566290 2024-09-13T06:10:02.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.015+0000 7f7cade03640 1 -- 172.21.15.194:0/273205514 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7db400fa40 con 0x559086566290 2024-09-13T06:10:02.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.015+0000 7f7cade03640 1 -- 172.21.15.194:0/273205514 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7db400fd80 con 0x559086566290 2024-09-13T06:10:02.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.015+0000 7f7dc3b44980 1 -- 172.21.15.194:0/273205514 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590866e7200 con 0x559086566290 2024-09-13T06:10:02.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.019+0000 7f7cade03640 1 -- 172.21.15.194:0/273205514 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7db4017070 con 0x559086566290 2024-09-13T06:10:02.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.019+0000 7f7cade03640 1 --2- 172.21.15.194:0/273205514 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7ca8034650 0x7f7ca8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:02.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.019+0000 7f7cade03640 1 -- 172.21.15.194:0/273205514 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f7db4015020 con 0x559086566290 2024-09-13T06:10:02.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.019+0000 7f7dc0e53640 1 --2- 172.21.15.194:0/273205514 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7ca8034650 0x7f7ca8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:02.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.019+0000 7f7dc3b44980 1 --2- 172.21.15.194:0/273205514 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5590865f5ac0 0x5590866eae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:02.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.019+0000 7f7dc3b44980 1 -- 172.21.15.194:0/273205514 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5590866eb3d0 con 0x5590865f5ac0 2024-09-13T06:10:02.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.019+0000 7f7dc1e55640 1 --2- 172.21.15.194:0/273205514 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5590865f5ac0 0x5590866eae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:02.020 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.019+0000 7f7dc1e55640 1 --2- 172.21.15.194:0/273205514 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5590865f5ac0 0x5590866eae50 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:02.020 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.019+0000 7f7dc0e53640 1 --2- 172.21.15.194:0/273205514 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7ca8034650 0x7f7ca8036b10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7db80ae000 tx=0x7f7db80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:02.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.019+0000 7f7dc1e55640 1 -- 172.21.15.194:0/273205514 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7dbc00a4d0 con 0x5590865f5ac0 2024-09-13T06:10:02.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.019+0000 7f7dc3b44980 1 -- 172.21.15.194:0/273205514 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5590866e8420 con 0x5590865f5ac0 2024-09-13T06:10:02.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.019+0000 7f7dc1e55640 1 -- 172.21.15.194:0/273205514 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7dbc00a4d0 con 0x5590865f5ac0 2024-09-13T06:10:02.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.019+0000 7f7dc3b44980 1 --2- 172.21.15.194:0/273205514 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5590866ed6e0 0x5590866efad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:02.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.019+0000 7f7dc3b44980 1 -- 172.21.15.194:0/273205514 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5590866f01c0 con 0x5590866ed6e0 2024-09-13T06:10:02.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.019+0000 7f7dc1654640 1 --2- 172.21.15.194:0/273205514 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5590866ed6e0 0x5590866efad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:02.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.019+0000 7f7dc1654640 1 --2- 172.21.15.194:0/273205514 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5590866ed6e0 0x5590866efad0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:02.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.019+0000 7f7dc1654640 1 -- 172.21.15.194:0/273205514 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7db402e070 con 0x5590866ed6e0 2024-09-13T06:10:02.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.019+0000 7f7dc3b44980 1 -- 172.21.15.194:0/273205514 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5590866ec580 con 0x5590865f5ac0 2024-09-13T06:10:02.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.019+0000 7f7dc1e55640 1 -- 172.21.15.194:0/273205514 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7dbc00a4d0 con 0x5590865f5ac0 2024-09-13T06:10:02.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.019+0000 7f7dc3b44980 1 --2- 172.21.15.194:0/273205514 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5590866f1620 0x5590866f3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:02.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.019+0000 7f7dc3b44980 1 -- 172.21.15.194:0/273205514 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5590866f4150 con 0x5590866f1620 2024-09-13T06:10:02.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.019+0000 7f7dc0e53640 1 --2- 172.21.15.194:0/273205514 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5590866f1620 0x5590866f3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:02.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.019+0000 7f7dc0e53640 1 --2- 172.21.15.194:0/273205514 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5590866f1620 0x5590866f3a10 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:02.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.019+0000 7f7dc0e53640 1 -- 172.21.15.194:0/273205514 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7db80aaae0 con 0x5590866f1620 2024-09-13T06:10:02.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.019+0000 7f7dc3b44980 1 Processor -- start 2024-09-13T06:10:02.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.019+0000 7f7dc3b44980 1 -- start start 2024-09-13T06:10:02.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.019+0000 7f7dc3b44980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559086701c20 0x559086702040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:02.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.019+0000 7f7dc3b44980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5590864f8800 con 0x559086701c20 2024-09-13T06:10:02.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.023+0000 7f7dc1654640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559086701c20 0x559086702040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:02.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.023+0000 7f7dc1654640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559086701c20 0x559086702040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:46426/0 (socket says 172.21.15.194:46426) 2024-09-13T06:10:02.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.023+0000 7f7dc1654640 1 -- 172.21.15.194:0/3598805378 learned_addr learned my addr 172.21.15.194:0/3598805378 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:02.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.023+0000 7f7dc1654640 1 -- 172.21.15.194:0/3598805378 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559086702580 con 0x559086701c20 2024-09-13T06:10:02.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.023+0000 7f7dc1654640 1 --2- 172.21.15.194:0/3598805378 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559086701c20 0x559086702040 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f7db401cfd0 tx=0x7f7db401bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:02.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.023+0000 7f7ca6ffd640 1 -- 172.21.15.194:0/3598805378 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7db4027430 con 0x559086701c20 2024-09-13T06:10:02.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.023+0000 7f7ca6ffd640 1 -- 172.21.15.194:0/3598805378 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7db40275d0 con 0x559086701c20 2024-09-13T06:10:02.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.023+0000 7f7dc3b44980 1 -- 172.21.15.194:0/3598805378 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559086702810 con 0x559086701c20 2024-09-13T06:10:02.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.023+0000 7f7ca6ffd640 1 -- 172.21.15.194:0/3598805378 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7db4017980 con 0x559086701c20 2024-09-13T06:10:02.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.023+0000 7f7dc3b44980 1 -- 172.21.15.194:0/3598805378 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559086702810 con 0x559086701c20 2024-09-13T06:10:02.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.023+0000 7f7ca6ffd640 1 -- 172.21.15.194:0/3598805378 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7db4017b20 con 0x559086701c20 2024-09-13T06:10:02.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.023+0000 7f7ca6ffd640 1 --2- 172.21.15.194:0/3598805378 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7c980346a0 0x7f7c98036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:02.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.023+0000 7f7ca6ffd640 1 -- 172.21.15.194:0/3598805378 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f7db403dc60 con 0x559086701c20 2024-09-13T06:10:02.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.023+0000 7f7dc0e53640 1 --2- 172.21.15.194:0/3598805378 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7c980346a0 0x7f7c98036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:02.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.023+0000 7f7dc3b44980 1 Processor -- start 2024-09-13T06:10:02.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.023+0000 7f7dc3b44980 1 -- start start 2024-09-13T06:10:02.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.023+0000 7f7dc0e53640 1 --2- 172.21.15.194:0/3598805378 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7c980346a0 0x7f7c98036b60 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x5590866eb860 tx=0x7f7db8005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:02.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.023+0000 7f7dc3b44980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55908670e290 0x55908670e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:02.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.023+0000 7f7dc3b44980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5590866dd350 con 0x55908670e290 2024-09-13T06:10:02.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.023+0000 7f7dc1654640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55908670e290 0x55908670e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:02.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.023+0000 7f7dc1654640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55908670e290 0x55908670e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:46430/0 (socket says 172.21.15.194:46430) 2024-09-13T06:10:02.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.023+0000 7f7dc1654640 1 -- 172.21.15.194:0/3923084358 learned_addr learned my addr 172.21.15.194:0/3923084358 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:02.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.027+0000 7f7dc1654640 1 -- 172.21.15.194:0/3923084358 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55908670ec60 con 0x55908670e290 2024-09-13T06:10:02.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.027+0000 7f7dc1654640 1 --2- 172.21.15.194:0/3923084358 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55908670e290 0x55908670e690 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f7db401bde0 tx=0x7f7db4023420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=365d870893231d05 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:02.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.027+0000 7f7ca4ff9640 1 -- 172.21.15.194:0/3923084358 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7db405a070 con 0x55908670e290 2024-09-13T06:10:02.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.027+0000 7f7ca4ff9640 1 -- 172.21.15.194:0/3923084358 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7db4011e10 con 0x55908670e290 2024-09-13T06:10:02.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.027+0000 7f7ca4ff9640 1 -- 172.21.15.194:0/3923084358 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7db4023600 con 0x55908670e290 2024-09-13T06:10:02.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.027+0000 7f7dc3b44980 1 -- 172.21.15.194:0/3923084358 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55908670e290 msgr2=0x55908670e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:02.037 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.027+0000 7f7dc3b44980 1 --2- 172.21.15.194:0/3923084358 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55908670e290 0x55908670e690 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f7db401bde0 tx=0x7f7db4023420 comp rx=0 tx=0).stop 2024-09-13T06:10:02.037 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.027+0000 7f7dc3b44980 1 -- 172.21.15.194:0/3923084358 shutdown_connections 2024-09-13T06:10:02.037 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.027+0000 7f7dc3b44980 1 --2- 172.21.15.194:0/3923084358 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55908670e290 0x55908670e690 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:02.037 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.027+0000 7f7dc3b44980 1 -- 172.21.15.194:0/3923084358 >> 172.21.15.194:0/3923084358 conn(0x55908670a700 msgr2=0x559086708800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:02.037 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.027+0000 7f7dc3b44980 1 -- 172.21.15.194:0/3923084358 shutdown_connections 2024-09-13T06:10:02.037 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.027+0000 7f7dc3b44980 1 -- 172.21.15.194:0/3923084358 wait complete. 2024-09-13T06:10:02.037 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.027+0000 7f7dc3b44980 1 Processor -- start 2024-09-13T06:10:02.037 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.027+0000 7f7dc3b44980 1 -- start start 2024-09-13T06:10:02.037 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.027+0000 7f7dc3b44980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55908670e290 0x5590867154f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:02.037 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.027+0000 7f7dc3b44980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55908670f170 con 0x55908670e290 2024-09-13T06:10:02.037 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.027+0000 7f7dc1654640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55908670e290 0x5590867154f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:02.037 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.027+0000 7f7dc1654640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55908670e290 0x5590867154f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:46442/0 (socket says 172.21.15.194:46442) 2024-09-13T06:10:02.037 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.027+0000 7f7dc1654640 1 -- 172.21.15.194:0/1754886724 learned_addr learned my addr 172.21.15.194:0/1754886724 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:02.037 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.027+0000 7f7dc1654640 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559086715a30 con 0x55908670e290 2024-09-13T06:10:02.037 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.027+0000 7f7dc1654640 1 --2- 172.21.15.194:0/1754886724 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55908670e290 0x5590867154f0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f7db401bde0 tx=0x7f7db404b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:02.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.027+0000 7f7c96ffd640 1 -- 172.21.15.194:0/1754886724 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7db4023810 con 0x55908670e290 2024-09-13T06:10:02.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.027+0000 7f7c96ffd640 1 -- 172.21.15.194:0/1754886724 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7db4023600 con 0x55908670e290 2024-09-13T06:10:02.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.027+0000 7f7dc3b44980 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559086715a30 con 0x55908670e290 2024-09-13T06:10:02.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.027+0000 7f7c96ffd640 1 -- 172.21.15.194:0/1754886724 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7db401a8e0 con 0x55908670e290 2024-09-13T06:10:02.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.027+0000 7f7dc3b44980 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559086715a30 con 0x55908670e290 2024-09-13T06:10:02.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.031+0000 7f7c96ffd640 1 -- 172.21.15.194:0/1754886724 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7db405d070 con 0x55908670e290 2024-09-13T06:10:02.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.031+0000 7f7c96ffd640 1 --2- 172.21.15.194:0/1754886724 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7c8c034650 0x7f7c8c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:02.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.031+0000 7f7c96ffd640 1 -- 172.21.15.194:0/1754886724 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6133+0+0 (secure 0 0 0) 0x7f7db4067070 con 0x55908670e290 2024-09-13T06:10:02.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.031+0000 7f7dc3b44980 20 rados->read ofs=0 len=0 2024-09-13T06:10:02.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.031+0000 7f7dc0e53640 1 --2- 172.21.15.194:0/1754886724 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7c8c034650 0x7f7c8c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:02.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.031+0000 7f7dc3b44980 1 --2- 172.21.15.194:0/1754886724 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x559086720610 0x559086722ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:02.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.031+0000 7f7dc3b44980 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559086723200 con 0x559086720610 2024-09-13T06:10:02.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.031+0000 7f7dc1e55640 1 --2- 172.21.15.194:0/1754886724 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x559086720610 0x559086722ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:02.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.031+0000 7f7dc0e53640 1 --2- 172.21.15.194:0/1754886724 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7c8c034650 0x7f7c8c036b10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7db8000c10 tx=0x7f7db80c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:02.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.031+0000 7f7dc1e55640 1 --2- 172.21.15.194:0/1754886724 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x559086720610 0x559086722ab0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:02.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.031+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7dbc00a4d0 con 0x559086720610 2024-09-13T06:10:02.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.031+0000 7f7dc3b44980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:02.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.031+0000 7f7dc3b44980 20 realm 2024-09-13T06:10:02.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.031+0000 7f7dc3b44980 20 rados->read ofs=0 len=0 2024-09-13T06:10:02.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.031+0000 7f7dc3b44980 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559086723610 con 0x559086720610 2024-09-13T06:10:02.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.031+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7dbc00a4d0 con 0x559086720610 2024-09-13T06:10:02.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.031+0000 7f7dc3b44980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:02.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.031+0000 7f7dc3b44980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:10:02.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.031+0000 7f7dc3b44980 20 rados->read ofs=0 len=0 2024-09-13T06:10:02.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.031+0000 7f7dc3b44980 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559086723eb0 con 0x559086720610 2024-09-13T06:10:02.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.031+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7dbc00a4d0 con 0x559086720610 2024-09-13T06:10:02.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.031+0000 7f7dc3b44980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:02.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.031+0000 7f7dc3b44980 20 rados->read ofs=0 len=0 2024-09-13T06:10:02.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.031+0000 7f7dc3b44980 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559086724250 con 0x559086720610 2024-09-13T06:10:02.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.031+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7dbc00a4d0 con 0x559086720610 2024-09-13T06:10:02.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.031+0000 7f7dc3b44980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:10:02.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.031+0000 7f7dc3b44980 20 rados->read ofs=0 len=0 2024-09-13T06:10:02.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.031+0000 7f7dc3b44980 1 --2- 172.21.15.194:0/1754886724 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x559086724fb0 0x5590867273a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:02.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.031+0000 7f7dc3b44980 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559086727a40 con 0x559086724fb0 2024-09-13T06:10:02.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.031+0000 7f7dc1654640 1 --2- 172.21.15.194:0/1754886724 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x559086724fb0 0x5590867273a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:02.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.031+0000 7f7dc1654640 1 --2- 172.21.15.194:0/1754886724 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x559086724fb0 0x5590867273a0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:02.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.031+0000 7f7dc1654640 1 -- 172.21.15.194:0/1754886724 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7db4070020 con 0x559086724fb0 2024-09-13T06:10:02.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.031+0000 7f7dc3b44980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:10:02.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.031+0000 7f7dc3b44980 20 searching for the correct realm 2024-09-13T06:10:02.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.031+0000 7f7dc3b44980 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5590867292a0 con 0x559086724fb0 2024-09-13T06:10:02.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.031+0000 7f7dc1654640 1 -- 172.21.15.194:0/1754886724 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7db4070020 con 0x559086724fb0 2024-09-13T06:10:02.041 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.031+0000 7f7dc1654640 1 --2- 172.21.15.194:0/1754886724 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f7db406a030 0x7f7db401d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:02.041 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.031+0000 7f7dc1654640 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5590867292a0 con 0x7f7db406a030 2024-09-13T06:10:02.041 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.031+0000 7f7dc0e53640 1 --2- 172.21.15.194:0/1754886724 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f7db406a030 0x7f7db401d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:02.041 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.035+0000 7f7dc0e53640 1 --2- 172.21.15.194:0/1754886724 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f7db406a030 0x7f7db401d930 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:02.041 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.035+0000 7f7dc0e53640 1 -- 172.21.15.194:0/1754886724 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7db80aaae0 con 0x7f7db406a030 2024-09-13T06:10:02.041 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.035+0000 7f7dc0e53640 1 --2- 172.21.15.194:0/1754886724 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f7db80e0040 0x7f7db80e0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:02.041 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.035+0000 7f7dc0e53640 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5590867292a0 con 0x7f7db80e0040 2024-09-13T06:10:02.041 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.035+0000 7f7dc1e55640 1 --2- 172.21.15.194:0/1754886724 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f7db80e0040 0x7f7db80e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:02.041 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.035+0000 7f7dc1e55640 1 --2- 172.21.15.194:0/1754886724 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f7db80e0040 0x7f7db80e0420 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:02.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.035+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dbc00a4d0 con 0x7f7db80e0040 2024-09-13T06:10:02.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.035+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559086724250 con 0x559086720610 2024-09-13T06:10:02.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.035+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dbc00a4d0 con 0x559086720610 2024-09-13T06:10:02.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.035+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559086724250 con 0x559086720610 2024-09-13T06:10:02.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.035+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dbc00a4d0 con 0x559086720610 2024-09-13T06:10:02.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.035+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559086724250 con 0x7f7db80e0040 2024-09-13T06:10:02.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.035+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dbc00a4d0 con 0x7f7db80e0040 2024-09-13T06:10:02.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.035+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559086724250 con 0x7f7db80e0040 2024-09-13T06:10:02.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.035+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dbc00a4d0 con 0x7f7db80e0040 2024-09-13T06:10:02.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.035+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559086724250 con 0x7f7db406a030 2024-09-13T06:10:02.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.035+0000 7f7dc0e53640 1 -- 172.21.15.194:0/1754886724 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7db80aaae0 con 0x7f7db406a030 2024-09-13T06:10:02.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.035+0000 7f7dc0e53640 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559086724250 con 0x559086724fb0 2024-09-13T06:10:02.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.039+0000 7f7dc1654640 1 -- 172.21.15.194:0/1754886724 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7db4070020 con 0x559086724fb0 2024-09-13T06:10:02.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.039+0000 7f7dc1654640 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559086724250 con 0x559086720610 2024-09-13T06:10:02.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.039+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dbc00a4d0 con 0x559086720610 2024-09-13T06:10:02.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.039+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559086724250 con 0x7f7db80e0040 2024-09-13T06:10:02.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.039+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dbc00a4d0 con 0x7f7db80e0040 2024-09-13T06:10:02.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.039+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559086724250 con 0x559086720610 2024-09-13T06:10:02.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.039+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dbc00a4d0 con 0x559086720610 2024-09-13T06:10:02.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.039+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559086724250 con 0x7f7db406a030 2024-09-13T06:10:02.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.039+0000 7f7dc0e53640 1 -- 172.21.15.194:0/1754886724 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7db80aaae0 con 0x7f7db406a030 2024-09-13T06:10:02.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.039+0000 7f7dc0e53640 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559086724250 con 0x559086724fb0 2024-09-13T06:10:02.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.039+0000 7f7dc1654640 1 -- 172.21.15.194:0/1754886724 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7db4070020 con 0x559086724fb0 2024-09-13T06:10:02.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.039+0000 7f7dc1654640 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559086724250 con 0x559086724fb0 2024-09-13T06:10:02.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.039+0000 7f7dc1654640 1 -- 172.21.15.194:0/1754886724 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7db4070020 con 0x559086724fb0 2024-09-13T06:10:02.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.039+0000 7f7dc1654640 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559086724250 con 0x7f7db80e0040 2024-09-13T06:10:02.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.039+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dbc00a4d0 con 0x7f7db80e0040 2024-09-13T06:10:02.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.039+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559086724250 con 0x559086724fb0 2024-09-13T06:10:02.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.039+0000 7f7dc1654640 1 -- 172.21.15.194:0/1754886724 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7db4070020 con 0x559086724fb0 2024-09-13T06:10:02.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.039+0000 7f7dc1654640 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559086724250 con 0x559086724fb0 2024-09-13T06:10:02.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.039+0000 7f7dc1654640 1 -- 172.21.15.194:0/1754886724 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7db4070020 con 0x559086724fb0 2024-09-13T06:10:02.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.039+0000 7f7dc1654640 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559086724250 con 0x559086720610 2024-09-13T06:10:02.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.039+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dbc00a4d0 con 0x559086720610 2024-09-13T06:10:02.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.039+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559086724250 con 0x559086720610 2024-09-13T06:10:02.052 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.039+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7dbc00a4d0 con 0x559086720610 2024-09-13T06:10:02.052 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.039+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559086724250 con 0x7f7db80e0040 2024-09-13T06:10:02.052 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.043+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dbc00a4d0 con 0x7f7db80e0040 2024-09-13T06:10:02.052 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.043+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559086724250 con 0x559086724fb0 2024-09-13T06:10:02.052 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.043+0000 7f7dc1654640 1 -- 172.21.15.194:0/1754886724 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7db4070020 con 0x559086724fb0 2024-09-13T06:10:02.052 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.043+0000 7f7dc1654640 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559086724250 con 0x7f7db406a030 2024-09-13T06:10:02.052 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.043+0000 7f7dc0e53640 1 -- 172.21.15.194:0/1754886724 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7db80aaae0 con 0x7f7db406a030 2024-09-13T06:10:02.052 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.043+0000 7f7dc0e53640 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559086724250 con 0x559086720610 2024-09-13T06:10:02.052 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.043+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dbc00a4d0 con 0x559086720610 2024-09-13T06:10:02.052 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.043+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559086724250 con 0x7f7db80e0040 2024-09-13T06:10:02.052 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.043+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dbc00a4d0 con 0x7f7db80e0040 2024-09-13T06:10:02.052 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.043+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559086724250 con 0x559086724fb0 2024-09-13T06:10:02.052 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.043+0000 7f7dc1654640 1 -- 172.21.15.194:0/1754886724 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7db4070020 con 0x559086724fb0 2024-09-13T06:10:02.052 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.043+0000 7f7dc1654640 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559086724250 con 0x7f7db80e0040 2024-09-13T06:10:02.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.043+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dbc00a4d0 con 0x7f7db80e0040 2024-09-13T06:10:02.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.043+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559086724250 con 0x7f7db406a030 2024-09-13T06:10:02.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.043+0000 7f7dc0e53640 1 -- 172.21.15.194:0/1754886724 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7db80aaae0 con 0x7f7db406a030 2024-09-13T06:10:02.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.043+0000 7f7dc0e53640 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559086724250 con 0x559086724fb0 2024-09-13T06:10:02.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.043+0000 7f7dc1654640 1 -- 172.21.15.194:0/1754886724 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7db4070020 con 0x559086724fb0 2024-09-13T06:10:02.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.043+0000 7f7dc1654640 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559086724250 con 0x7f7db80e0040 2024-09-13T06:10:02.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.043+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dbc00a4d0 con 0x7f7db80e0040 2024-09-13T06:10:02.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.043+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559086724250 con 0x559086720610 2024-09-13T06:10:02.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.047+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7dbc00a4d0 con 0x559086720610 2024-09-13T06:10:02.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.047+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559086724250 con 0x7f7db406a030 2024-09-13T06:10:02.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.047+0000 7f7dc0e53640 1 -- 172.21.15.194:0/1754886724 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7db80aaae0 con 0x7f7db406a030 2024-09-13T06:10:02.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.047+0000 7f7dc3b44980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:10:02.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.047+0000 7f7dc3b44980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:10:02.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.047+0000 7f7dc3b44980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:10:02.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.047+0000 7f7dc3b44980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:10:02.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.047+0000 7f7dc3b44980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:10:02.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.047+0000 7f7dc3b44980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:10:02.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.047+0000 7f7dc3b44980 20 rados->read ofs=0 len=0 2024-09-13T06:10:02.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.047+0000 7f7dc3b44980 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5590867283c0 con 0x559086720610 2024-09-13T06:10:02.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.047+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7dbc00a4d0 con 0x559086720610 2024-09-13T06:10:02.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.047+0000 7f7dc3b44980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:02.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.047+0000 7f7dc3b44980 20 rados->read ofs=0 len=0 2024-09-13T06:10:02.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.047+0000 7f7dc3b44980 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559086728c10 con 0x559086720610 2024-09-13T06:10:02.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.047+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7dbc00a4d0 con 0x559086720610 2024-09-13T06:10:02.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.047+0000 7f7dc3b44980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:10:02.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.047+0000 7f7dc3b44980 20 rados->read ofs=0 len=0 2024-09-13T06:10:02.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.047+0000 7f7dc3b44980 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559086728020 con 0x7f7db406a030 2024-09-13T06:10:02.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.047+0000 7f7dc0e53640 1 -- 172.21.15.194:0/1754886724 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7db80aaae0 con 0x7f7db406a030 2024-09-13T06:10:02.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.047+0000 7f7dc3b44980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:10:02.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.047+0000 7f7dc3b44980 20 zone default found 2024-09-13T06:10:02.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.047+0000 7f7dc3b44980 4 Realm: () 2024-09-13T06:10:02.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.047+0000 7f7dc3b44980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:10:02.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.047+0000 7f7dc3b44980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:10:02.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.047+0000 7f7dc3b44980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:10:02.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.047+0000 7f7dc3b44980 20 zonegroup default 2024-09-13T06:10:02.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.047+0000 7f7dc3b44980 20 rados->read ofs=0 len=0 2024-09-13T06:10:02.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.047+0000 7f7dc3b44980 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5590867296d0 con 0x7f7db80e0040 2024-09-13T06:10:02.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.047+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7dbc00a4d0 con 0x7f7db80e0040 2024-09-13T06:10:02.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.047+0000 7f7dc3b44980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:02.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.047+0000 7f7dc3b44980 20 rados->read ofs=0 len=0 2024-09-13T06:10:02.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.047+0000 7f7dc3b44980 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55908672b0b0 con 0x559086724fb0 2024-09-13T06:10:02.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.047+0000 7f7dc1654640 1 -- 172.21.15.194:0/1754886724 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7db4070020 con 0x559086724fb0 2024-09-13T06:10:02.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.047+0000 7f7dc3b44980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:02.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.047+0000 7f7dc3b44980 20 rados->read ofs=0 len=0 2024-09-13T06:10:02.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.047+0000 7f7dc3b44980 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55908672b570 con 0x559086724fb0 2024-09-13T06:10:02.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.047+0000 7f7dc1654640 1 -- 172.21.15.194:0/1754886724 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7db4070020 con 0x559086724fb0 2024-09-13T06:10:02.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.047+0000 7f7dc3b44980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:02.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.047+0000 7f7dc3b44980 20 started sync module instance, tier type = 2024-09-13T06:10:02.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.047+0000 7f7dc3b44980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:10:02.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.047+0000 7f7dc3b44980 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55908672a550 con 0x7f7db406a030 2024-09-13T06:10:02.058 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.047+0000 7f7dc0e53640 1 -- 172.21.15.194:0/1754886724 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(44 notify.0 [create] v33'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7db80aaae0 con 0x7f7db406a030 2024-09-13T06:10:02.058 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.047+0000 7f7dc3b44980 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94079219313008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55908672a1b0 con 0x7f7db406a030 2024-09-13T06:10:02.058 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.047+0000 7f7dc3b44980 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55908672c4a0 con 0x559086720610 2024-09-13T06:10:02.058 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.051+0000 7f7dc0e53640 1 -- 172.21.15.194:0/1754886724 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94079219313008] v33'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7db80aaae0 con 0x7f7db406a030 2024-09-13T06:10:02.058 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.051+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v33'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7dbc00a4d0 con 0x559086720610 2024-09-13T06:10:02.058 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.051+0000 7f7dc3b44980 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94079219318768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55908672c8c0 con 0x559086720610 2024-09-13T06:10:02.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.051+0000 7f7dc3b44980 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55908672d280 con 0x559086724fb0 2024-09-13T06:10:02.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.051+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94079219318768] v33'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7dbc00a4d0 con 0x559086720610 2024-09-13T06:10:02.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.051+0000 7f7dc1654640 1 -- 172.21.15.194:0/1754886724 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v33'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7db4070020 con 0x559086724fb0 2024-09-13T06:10:02.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.051+0000 7f7dc3b44980 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94079219319824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55908672c830 con 0x559086724fb0 2024-09-13T06:10:02.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.051+0000 7f7dc3b44980 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55908672df80 con 0x7f7db406a030 2024-09-13T06:10:02.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.055+0000 7f7dc0e53640 1 -- 172.21.15.194:0/1754886724 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(50 notify.3 [create] v33'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7db80aaae0 con 0x7f7db406a030 2024-09-13T06:10:02.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.055+0000 7f7dc3b44980 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94079219327856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55908672ec40 con 0x7f7db406a030 2024-09-13T06:10:02.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.055+0000 7f7dc3b44980 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55908672f600 con 0x559086720610 2024-09-13T06:10:02.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.055+0000 7f7dc1654640 1 -- 172.21.15.194:0/1754886724 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94079219319824] v33'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7db4070020 con 0x559086724fb0 2024-09-13T06:10:02.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.055+0000 7f7dc0e53640 1 -- 172.21.15.194:0/1754886724 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94079219327856] v33'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7db80aaae0 con 0x7f7db406a030 2024-09-13T06:10:02.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.055+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v33'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7dbc00a4d0 con 0x559086720610 2024-09-13T06:10:02.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.055+0000 7f7dc3b44980 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94079219331408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55908672ec40 con 0x559086720610 2024-09-13T06:10:02.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.055+0000 7f7dc3b44980 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55908672f570 con 0x7f7db80e0040 2024-09-13T06:10:02.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.059+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94079219331408] v33'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7dbc00a4d0 con 0x559086720610 2024-09-13T06:10:02.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.059+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(54 notify.5 [create] v33'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7dbc00a4d0 con 0x7f7db80e0040 2024-09-13T06:10:02.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.059+0000 7f7dc3b44980 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94079219328912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55908672ebb0 con 0x7f7db80e0040 2024-09-13T06:10:02.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.059+0000 7f7dc3b44980 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559086730470 con 0x7f7db80e0040 2024-09-13T06:10:02.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.059+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94079219328912] v33'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7dbc00a4d0 con 0x7f7db80e0040 2024-09-13T06:10:02.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.063+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(56 notify.6 [create] v33'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7dbc00a4d0 con 0x7f7db80e0040 2024-09-13T06:10:02.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.063+0000 7f7dc3b44980 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94079219333536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559086730470 con 0x7f7db80e0040 2024-09-13T06:10:02.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.063+0000 7f7dc3b44980 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559086730e30 con 0x7f7db80e0040 2024-09-13T06:10:02.064 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.063+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94079219333536] v33'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7dbc00a4d0 con 0x7f7db80e0040 2024-09-13T06:10:02.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.063+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(58 notify.7 [create] v33'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7dbc00a4d0 con 0x7f7db80e0040 2024-09-13T06:10:02.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.063+0000 7f7dc3b44980 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94079219335376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559086730e30 con 0x7f7db80e0040 2024-09-13T06:10:02.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.063+0000 7f7dc3b44980 20 add_watcher() i=0 2024-09-13T06:10:02.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.063+0000 7f7dc3b44980 20 add_watcher() i=1 2024-09-13T06:10:02.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.063+0000 7f7dc3b44980 20 add_watcher() i=2 2024-09-13T06:10:02.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.063+0000 7f7dc3b44980 20 add_watcher() i=3 2024-09-13T06:10:02.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.063+0000 7f7dc3b44980 20 add_watcher() i=4 2024-09-13T06:10:02.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.063+0000 7f7dc3b44980 20 add_watcher() i=5 2024-09-13T06:10:02.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.063+0000 7f7dc3b44980 20 add_watcher() i=6 2024-09-13T06:10:02.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.067+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94079219335376] v33'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7dbc00a4d0 con 0x7f7db80e0040 2024-09-13T06:10:02.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.067+0000 7f7dc3b44980 20 add_watcher() i=7 2024-09-13T06:10:02.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.067+0000 7f7dc3b44980 2 all 8 watchers are set, enabling cache 2024-09-13T06:10:02.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.067+0000 7f7dc3b44980 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559086734130 con 0x559086720610 2024-09-13T06:10:02.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.067+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7dbc00a4d0 con 0x559086720610 2024-09-13T06:10:02.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.067+0000 7f7dc3b44980 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94079219337968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5590867313c0 con 0x559086720610 2024-09-13T06:10:02.069 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.067+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94079219337968] v33'150 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7dbc00a4d0 con 0x559086720610 2024-09-13T06:10:02.069 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.067+0000 7f7c777e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:10:02.069 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.067+0000 7f7dc3b44980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:10:02.069 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.067+0000 7f7dc3b44980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:10:02.069 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.067+0000 7f7dc3b44980 5 note: GC not initialized 2024-09-13T06:10:02.069 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.067+0000 7f7c767e4640 20 reqs_thread_entry: start 2024-09-13T06:10:02.069 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.067+0000 7f7dc3b44980 20 init_complete bucket index max shards: 11 2024-09-13T06:10:02.070 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.067+0000 7f7dc3b44980 20 Filter name: none 2024-09-13T06:10:02.070 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.067+0000 7f7be7fff640 20 reqs_thread_entry: start 2024-09-13T06:10:02.070 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.067+0000 7f7dc3b44980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T06:10:02.070 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.067+0000 7f7dc3b44980 20 rados->read ofs=0 len=0 2024-09-13T06:10:02.070 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.067+0000 7f7dc3b44980 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559086757830 con 0x559086720610 2024-09-13T06:10:02.072 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.067+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv18 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f7dbc00a4d0 con 0x559086720610 2024-09-13T06:10:02.072 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.067+0000 7f7dc3b44980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T06:10:02.072 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.067+0000 7f7dc3b44980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T06:10:02.072 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.067+0000 7f7dc3b44980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:10:02.072 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.067+0000 7f7dc3b44980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:10:02.072 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.067+0000 7f7dc3b44980 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55908675a2c0 con 0x7f7db406a030 2024-09-13T06:10:02.072 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.067+0000 7f7dc0e53640 1 -- 172.21.15.194:0/1754886724 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f7db80aaae0 con 0x7f7db406a030 2024-09-13T06:10:02.072 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.067+0000 7f7dc3b44980 20 enabling bucket name=myfoo 2024-09-13T06:10:02.072 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.071+0000 7f7dc3b44980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T06:10:02.072 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.071+0000 7f7dc3b44980 20 rados->read ofs=0 len=0 2024-09-13T06:10:02.073 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.071+0000 7f7dc3b44980 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5590867582a0 con 0x7f7db406a030 2024-09-13T06:10:02.073 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.071+0000 7f7dc0e53640 1 -- 172.21.15.194:0/1754886724 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7f7db80aaae0 con 0x7f7db406a030 2024-09-13T06:10:02.073 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.071+0000 7f7dc3b44980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T06:10:02.073 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.071+0000 7f7dc3b44980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-09-13T06:10:02.073 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.071+0000 7f7dc3b44980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T06:10:02.073 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.071+0000 7f7dc3b44980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 : miss 2024-09-13T06:10:02.073 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.071+0000 7f7dc3b44980 20 rados->read ofs=0 len=0 2024-09-13T06:10:02.073 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.071+0000 7f7dc3b44980 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:65 8.18 8:1a66c368:root::.bucket.meta.myfoo%3a52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55908675abd0 con 0x559086720610 2024-09-13T06:10:02.073 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.071+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(65 .bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv17 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f7dbc00a4d0 con 0x559086720610 2024-09-13T06:10:02.073 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.071+0000 7f7dc3b44980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T06:10:02.073 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.071+0000 7f7dc3b44980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 info.flags=0x17 2024-09-13T06:10:02.073 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.071+0000 7f7dc3b44980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 to cache LRU end 2024-09-13T06:10:02.073 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.071+0000 7f7dc3b44980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:10:02.073 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.071+0000 7f7dc3b44980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T06:10:02.074 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.071+0000 7f7dc3b44980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 2024-09-13T06:10:02.074 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.071+0000 7f7dc3b44980 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:66 8.18 8:1a66c368:root::.bucket.meta.myfoo%3a52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559086762500 con 0x559086720610 2024-09-13T06:10:02.076 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.071+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(66 .bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v33'19 uv19 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f7dbc00a4d0 con 0x559086720610 2024-09-13T06:10:02.076 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.071+0000 7f7dc3b44980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 info.flags=0x17 2024-09-13T06:10:02.076 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.071+0000 7f7dc3b44980 10 moving default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 to cache LRU end 2024-09-13T06:10:02.076 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.071+0000 7f7dc3b44980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T06:10:02.076 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.071+0000 7f7dc3b44980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1, ofs0, ns] 2024-09-13T06:10:02.076 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.071+0000 7f7dc3b44980 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:67 7.9 7:93e5b521:::notify.7:head [notify cookie 94079219508304 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55908675db70 con 0x7f7db80e0040 2024-09-13T06:10:02.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.071+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== watch-notify(notify (1) cookie 94079219335376 notify 141733920786 ret 0) ==== 794+0+0 (crc 0 0 0) 0x55908675afc0 con 0x7f7db80e0040 2024-09-13T06:10:02.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.071+0000 7f7ca4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920786 cookie 94079219335376 notifier 4598 bl.length()=752 2024-09-13T06:10:02.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.071+0000 7f7ca4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 info.flags=0x17 2024-09-13T06:10:02.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.071+0000 7f7ca4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1 to cache LRU end 2024-09-13T06:10:02.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.071+0000 7f7ca4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T06:10:02.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.071+0000 7f7ca4ff9640 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:68 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f7c84003eb0 con 0x7f7db80e0040 2024-09-13T06:10:02.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.071+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(67 notify.7 [notify cookie 94079219508304 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7dbc00a4d0 con 0x7f7db80e0040 2024-09-13T06:10:02.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.071+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(68 notify.7 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7dbc00a4d0 con 0x7f7db80e0040 2024-09-13T06:10:02.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.071+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 <== osd.0 v2:172.21.15.120:6800/1923744619 20 ==== watch-notify(notify_complete (2) cookie 94079219508304 notify 141733920786 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55908675a0e0 con 0x7f7db80e0040 2024-09-13T06:10:02.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.071+0000 7f7dc3b44980 20 handle_bi_update(): bucket=:myfoo[52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1]): orig_sources= new_sources= 2024-09-13T06:10:02.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.071+0000 7f7dc3b44980 20 handle_bi_update(): bucket=:myfoo[52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1]): potential sources added=[] removed=[] 2024-09-13T06:10:02.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.071+0000 7f7dc3b44980 20 handle_bi_update(): bucket=:myfoo[52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1]): orig_dests= new_dests= 2024-09-13T06:10:02.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.071+0000 7f7dc3b44980 20 handle_bi_update(): bucket=:myfoo[52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1]): potential dests added=[] removed=[] 2024-09-13T06:10:02.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.071+0000 7f7dc3b44980 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55908675d680 con 0x559086720610 2024-09-13T06:10:02.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.075+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v33'20 uv20 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f7dbc00a4d0 con 0x559086720610 2024-09-13T06:10:02.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.075+0000 7f7dc3b44980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T06:10:02.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.075+0000 7f7dc3b44980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:10:02.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.075+0000 7f7dc3b44980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T06:10:02.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.075+0000 7f7dc3b44980 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94079219490704 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55908675d680 con 0x559086720610 2024-09-13T06:10:02.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.075+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 <== osd.1 v2:172.21.15.194:6808/3135444559 25 ==== watch-notify(notify (1) cookie 94079219331408 notify 141733920783 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55908675a0e0 con 0x559086720610 2024-09-13T06:10:02.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.075+0000 7f7c97fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920783 cookie 94079219331408 notifier 4598 bl.length()=567 2024-09-13T06:10:02.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.075+0000 7f7c97fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T06:10:02.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.075+0000 7f7c97fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:10:02.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.075+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 <== osd.1 v2:172.21.15.194:6808/3135444559 26 ==== osd_op_reply(70 notify.4 [notify cookie 94079219490704 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7dbc00a4d0 con 0x559086720610 2024-09-13T06:10:02.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.075+0000 7f7c97fff640 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f7bf4003440 con 0x559086720610 2024-09-13T06:10:02.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.075+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 <== osd.1 v2:172.21.15.194:6808/3135444559 27 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7dbc00a4d0 con 0x559086720610 2024-09-13T06:10:02.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.075+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 <== osd.1 v2:172.21.15.194:6808/3135444559 28 ==== watch-notify(notify_complete (2) cookie 94079219490704 notify 141733920783 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f7dbc02d040 con 0x559086720610 2024-09-13T06:10:02.079 INFO:teuthology.orchestra.run.smithi194.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T06:09:53.191222Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:09:53.191207Z","tags":[],"group_ids":[]} 2024-09-13T06:10:02.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.075+0000 7f7c777e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:10:02.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.075+0000 7f7dc3b44980 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94079219337968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559086755660 con 0x559086720610 2024-09-13T06:10:02.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.075+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 <== osd.1 v2:172.21.15.194:6808/3135444559 29 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94079219337968] v33'151 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7dbc00a4d0 con 0x559086720610 2024-09-13T06:10:02.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.075+0000 7f7dc3b44980 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94079219313008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559086755660 con 0x7f7db406a030 2024-09-13T06:10:02.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.079+0000 7f7dc0e53640 1 -- 172.21.15.194:0/1754886724 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94079219313008] v33'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7db80aaae0 con 0x7f7db406a030 2024-09-13T06:10:02.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.079+0000 7f7dc3b44980 20 remove_watcher() i=0 2024-09-13T06:10:02.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.079+0000 7f7dc3b44980 2 removed watcher, disabling cache 2024-09-13T06:10:02.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.079+0000 7f7dc3b44980 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94079219318768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559086755660 con 0x559086720610 2024-09-13T06:10:02.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.079+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 <== osd.1 v2:172.21.15.194:6808/3135444559 30 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94079219318768] v33'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7dbc00a4d0 con 0x559086720610 2024-09-13T06:10:02.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.079+0000 7f7dc3b44980 20 remove_watcher() i=1 2024-09-13T06:10:02.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.079+0000 7f7dc3b44980 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94079219319824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559086755660 con 0x559086724fb0 2024-09-13T06:10:02.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.083+0000 7f7dc1654640 1 -- 172.21.15.194:0/1754886724 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94079219319824] v33'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7db4070020 con 0x559086724fb0 2024-09-13T06:10:02.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.083+0000 7f7dc3b44980 20 remove_watcher() i=2 2024-09-13T06:10:02.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.083+0000 7f7dc3b44980 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94079219327856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55908672a970 con 0x7f7db406a030 2024-09-13T06:10:02.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.083+0000 7f7dc0e53640 1 -- 172.21.15.194:0/1754886724 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94079219327856] v33'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7db80aaae0 con 0x7f7db406a030 2024-09-13T06:10:02.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.083+0000 7f7dc3b44980 20 remove_watcher() i=3 2024-09-13T06:10:02.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.083+0000 7f7dc3b44980 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94079219331408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55908672e370 con 0x559086720610 2024-09-13T06:10:02.086 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.087+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 <== osd.1 v2:172.21.15.194:6808/3135444559 31 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94079219331408] v33'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7dbc00a4d0 con 0x559086720610 2024-09-13T06:10:02.086 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.087+0000 7f7dc3b44980 20 remove_watcher() i=4 2024-09-13T06:10:02.086 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.087+0000 7f7dc3b44980 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94079219328912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55908672e370 con 0x7f7db80e0040 2024-09-13T06:10:02.088 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.087+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 <== osd.0 v2:172.21.15.120:6800/1923744619 21 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94079219328912] v33'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7dbc00a4d0 con 0x7f7db80e0040 2024-09-13T06:10:02.088 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.087+0000 7f7dc3b44980 20 remove_watcher() i=5 2024-09-13T06:10:02.088 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.087+0000 7f7dc3b44980 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94079219333536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55908672f150 con 0x7f7db80e0040 2024-09-13T06:10:02.090 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.091+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 <== osd.0 v2:172.21.15.120:6800/1923744619 22 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94079219333536] v33'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7dbc00a4d0 con 0x7f7db80e0040 2024-09-13T06:10:02.090 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.091+0000 7f7dc3b44980 20 remove_watcher() i=6 2024-09-13T06:10:02.091 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.091+0000 7f7dc3b44980 1 -- 172.21.15.194:0/1754886724 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94079219335376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55908672f150 con 0x7f7db80e0040 2024-09-13T06:10:02.094 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.091+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 <== osd.0 v2:172.21.15.120:6800/1923744619 23 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94079219335376] v33'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7dbc00a4d0 con 0x7f7db80e0040 2024-09-13T06:10:02.095 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.091+0000 7f7dc3b44980 20 remove_watcher() i=7 2024-09-13T06:10:02.095 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.091+0000 7f7dc3b44980 1 -- 172.21.15.194:0/1754886724 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f7db80e0040 msgr2=0x7f7db80e0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:02.095 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.091+0000 7f7dc3b44980 1 --2- 172.21.15.194:0/1754886724 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f7db80e0040 0x7f7db80e0420 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:02.095 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.091+0000 7f7dc3b44980 1 -- 172.21.15.194:0/1754886724 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x559086720610 msgr2=0x559086722ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:02.095 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.091+0000 7f7dc3b44980 1 --2- 172.21.15.194:0/1754886724 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x559086720610 0x559086722ab0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:02.095 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.091+0000 7f7dc3b44980 1 -- 172.21.15.194:0/1754886724 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f7db406a030 msgr2=0x7f7db401d930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:02.095 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.091+0000 7f7dc3b44980 1 --2- 172.21.15.194:0/1754886724 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f7db406a030 0x7f7db401d930 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:02.095 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.091+0000 7f7dc3b44980 1 -- 172.21.15.194:0/1754886724 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x559086724fb0 msgr2=0x5590867273a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:02.095 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.091+0000 7f7dc3b44980 1 --2- 172.21.15.194:0/1754886724 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x559086724fb0 0x5590867273a0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:02.095 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.091+0000 7f7dc3b44980 1 -- 172.21.15.194:0/1754886724 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7c8c034650 msgr2=0x7f7c8c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:02.095 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.091+0000 7f7dc3b44980 1 --2- 172.21.15.194:0/1754886724 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7c8c034650 0x7f7c8c036b10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7db8000c10 tx=0x7f7db80c1040 comp rx=0 tx=0).stop 2024-09-13T06:10:02.095 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.091+0000 7f7dc3b44980 1 -- 172.21.15.194:0/1754886724 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55908670e290 msgr2=0x5590867154f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:02.095 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.091+0000 7f7dc1e55640 1 -- 172.21.15.194:0/1754886724 reap_dead start 2024-09-13T06:10:02.095 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.091+0000 7f7dc3b44980 1 --2- 172.21.15.194:0/1754886724 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55908670e290 0x5590867154f0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f7db401bde0 tx=0x7f7db404b7c0 comp rx=0 tx=0).stop 2024-09-13T06:10:02.096 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.091+0000 7f7dc3b44980 1 -- 172.21.15.194:0/1754886724 shutdown_connections 2024-09-13T06:10:02.096 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.091+0000 7f7dc3b44980 1 --2- 172.21.15.194:0/1754886724 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55908670e290 0x5590867154f0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:02.096 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.091+0000 7f7dc3b44980 1 -- 172.21.15.194:0/1754886724 >> 172.21.15.194:0/1754886724 conn(0x55908670a700 msgr2=0x5590867087d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:02.096 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.091+0000 7f7dc3b44980 1 -- 172.21.15.194:0/1754886724 shutdown_connections 2024-09-13T06:10:02.096 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.091+0000 7f7dc3b44980 1 -- 172.21.15.194:0/1754886724 wait complete. 2024-09-13T06:10:02.096 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.091+0000 7f7dc3b44980 1 -- 172.21.15.194:0/3598805378 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7c980346a0 msgr2=0x7f7c98036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:02.096 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.091+0000 7f7dc3b44980 1 --2- 172.21.15.194:0/3598805378 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7c980346a0 0x7f7c98036b60 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x5590866eb860 tx=0x7f7db8005ad0 comp rx=0 tx=0).stop 2024-09-13T06:10:02.096 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.091+0000 7f7dc3b44980 1 -- 172.21.15.194:0/3598805378 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559086701c20 msgr2=0x559086702040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:02.096 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.091+0000 7f7dc3b44980 1 --2- 172.21.15.194:0/3598805378 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559086701c20 0x559086702040 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f7db401cfd0 tx=0x7f7db401bd50 comp rx=0 tx=0).stop 2024-09-13T06:10:02.096 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.091+0000 7f7dc3b44980 1 -- 172.21.15.194:0/3598805378 shutdown_connections 2024-09-13T06:10:02.096 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.091+0000 7f7dc3b44980 1 --2- 172.21.15.194:0/3598805378 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7c980346a0 0x7f7c98036b60 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:02.096 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.091+0000 7f7dc3b44980 1 --2- 172.21.15.194:0/3598805378 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559086701c20 0x559086702040 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:02.096 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.091+0000 7f7dc3b44980 1 -- 172.21.15.194:0/3598805378 >> 172.21.15.194:0/3598805378 conn(0x5590866f6d70 msgr2=0x5590866f97f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:02.097 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.091+0000 7f7dc3b44980 1 -- 172.21.15.194:0/3598805378 shutdown_connections 2024-09-13T06:10:02.097 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.091+0000 7f7dc3b44980 1 -- 172.21.15.194:0/3598805378 wait complete. 2024-09-13T06:10:02.097 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.091+0000 7f7dc3b44980 1 -- 172.21.15.194:0/273205514 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5590865f5ac0 msgr2=0x5590866eae50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:02.097 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.091+0000 7f7dc3b44980 1 --2- 172.21.15.194:0/273205514 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5590865f5ac0 0x5590866eae50 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:02.097 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.091+0000 7f7dc3b44980 1 -- 172.21.15.194:0/273205514 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5590866f1620 msgr2=0x5590866f3a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:02.097 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.091+0000 7f7dc3b44980 1 --2- 172.21.15.194:0/273205514 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5590866f1620 0x5590866f3a10 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:02.097 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.091+0000 7f7dc3b44980 1 -- 172.21.15.194:0/273205514 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5590866ed6e0 msgr2=0x5590866efad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:02.097 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.091+0000 7f7dc3b44980 1 --2- 172.21.15.194:0/273205514 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5590866ed6e0 0x5590866efad0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:02.097 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.091+0000 7f7dc3b44980 1 -- 172.21.15.194:0/273205514 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7ca8034650 msgr2=0x7f7ca8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:02.097 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.091+0000 7f7dc3b44980 1 --2- 172.21.15.194:0/273205514 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7ca8034650 0x7f7ca8036b10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7db80ae000 tx=0x7f7db80a6000 comp rx=0 tx=0).stop 2024-09-13T06:10:02.097 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.091+0000 7f7dc3b44980 1 -- 172.21.15.194:0/273205514 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559086566290 msgr2=0x5590866e3d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:02.097 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.091+0000 7f7dc3b44980 1 --2- 172.21.15.194:0/273205514 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559086566290 0x5590866e3d50 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x5590866ddbe0 tx=0x7f7db4000bd0 comp rx=0 tx=0).stop 2024-09-13T06:10:02.098 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.091+0000 7f7dc1e55640 1 -- 172.21.15.194:0/273205514 reap_dead start 2024-09-13T06:10:02.098 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.091+0000 7f7dc3b44980 1 -- 172.21.15.194:0/273205514 shutdown_connections 2024-09-13T06:10:02.098 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.091+0000 7f7dc3b44980 1 -- 172.21.15.194:0/273205514 >> 172.21.15.194:0/273205514 conn(0x5590865ec090 msgr2=0x5590866d71b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:02.098 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.091+0000 7f7dc3b44980 1 -- 172.21.15.194:0/273205514 shutdown_connections 2024-09-13T06:10:02.098 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:02.091+0000 7f7dc3b44980 1 -- 172.21.15.194:0/273205514 wait complete. 2024-09-13T06:10:02.103 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T06:09:53.191222Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:09:53.191207Z', 'tags': [], 'group_ids': []} 2024-09-13T06:10:02.136 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-13T06:10:02.454 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=30000000 bytes_in=0 failed=False 2024-09-13T06:10:02.469 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T06:10:17.469 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-09-13T06:10:17.470 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-09-13T06:10:17.470 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-09-13T06:10:17.509 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:10:17.509 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:10:17.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.511+0000 7f4255180980 1 Processor -- start 2024-09-13T06:10:17.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.511+0000 7f4255180980 1 -- start start 2024-09-13T06:10:17.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.511+0000 7f4255180980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x5624a4b44690 0x5624a4b44a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:17.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.511+0000 7f4255180980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5624a49ccae0 con 0x5624a4b44fe0 2024-09-13T06:10:17.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.511+0000 7f4255180980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x5624a49f0e30 con 0x5624a4b44690 2024-09-13T06:10:17.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.511+0000 7f4252c90640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x5624a4b44690 0x5624a4b44a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:17.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.511+0000 7f4252c90640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x5624a4b44690 0x5624a4b44a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:50426/0 (socket says 172.21.15.194:50426) 2024-09-13T06:10:17.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.511+0000 7f4252c90640 1 -- 172.21.15.194:0/1685099272 learned_addr learned my addr 172.21.15.194:0/1685099272 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:17.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.511+0000 7f425248f640 1 --1- 172.21.15.194:0/1685099272 >> v1:172.21.15.120:6789/0 conn(0x5624a4b44fe0 0x5624a4b49a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:59030/0 (socket says 172.21.15.194:59030) 2024-09-13T06:10:17.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.511+0000 7f4252c90640 1 -- 172.21.15.194:0/1685099272 >> v1:172.21.15.120:6789/0 conn(0x5624a4b44fe0 legacy=0x5624a4b49a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:17.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.511+0000 7f4252c90640 1 -- 172.21.15.194:0/1685099272 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624a4b4c260 con 0x5624a4b44690 2024-09-13T06:10:17.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.515+0000 7f4252c90640 1 --2- 172.21.15.194:0/1685099272 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5624a4b44690 0x5624a4b44a70 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f424400a5c0 tx=0x7f424401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a436048f9bf5759c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:17.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.515+0000 7f4251c8e640 1 -- 172.21.15.194:0/1685099272 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42440a6070 con 0x5624a4b44690 2024-09-13T06:10:17.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.515+0000 7f4251c8e640 1 -- 172.21.15.194:0/1685099272 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42440af070 con 0x5624a4b44690 2024-09-13T06:10:17.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.515+0000 7f4251c8e640 1 -- 172.21.15.194:0/1685099272 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42440aa5c0 con 0x5624a4b44690 2024-09-13T06:10:17.516 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.515+0000 7f4255180980 1 -- 172.21.15.194:0/1685099272 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5624a4b44690 msgr2=0x5624a4b44a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:17.516 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.515+0000 7f4255180980 1 --2- 172.21.15.194:0/1685099272 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5624a4b44690 0x5624a4b44a70 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f424400a5c0 tx=0x7f424401b340 comp rx=0 tx=0).stop 2024-09-13T06:10:17.516 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.515+0000 7f4255180980 1 -- 172.21.15.194:0/1685099272 shutdown_connections 2024-09-13T06:10:17.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.515+0000 7f4255180980 1 --2- 172.21.15.194:0/1685099272 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5624a4b44690 0x5624a4b44a70 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:17.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.515+0000 7f4255180980 1 -- 172.21.15.194:0/1685099272 >> 172.21.15.194:0/1685099272 conn(0x5624a4b401b0 msgr2=0x5624a4b425d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:17.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.515+0000 7f4255180980 1 -- 172.21.15.194:0/1685099272 shutdown_connections 2024-09-13T06:10:17.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.515+0000 7f4255180980 1 -- 172.21.15.194:0/1685099272 wait complete. 2024-09-13T06:10:17.532 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.531+0000 7f4255180980 1 Processor -- start 2024-09-13T06:10:17.532 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.531+0000 7f4255180980 1 -- start start 2024-09-13T06:10:17.532 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.531+0000 7f4255180980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5624a4b44690 0x5624a4c2fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:17.532 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.531+0000 7f4255180980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5624a49f2200 con 0x5624a4b44690 2024-09-13T06:10:17.533 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.531+0000 7f4252c90640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5624a4b44690 0x5624a4c2fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:17.533 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.531+0000 7f4252c90640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5624a4b44690 0x5624a4c2fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:50440/0 (socket says 172.21.15.194:50440) 2024-09-13T06:10:17.533 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.531+0000 7f4252c90640 1 -- 172.21.15.194:0/3804699842 learned_addr learned my addr 172.21.15.194:0/3804699842 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:17.533 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.531+0000 7f4252c90640 1 -- 172.21.15.194:0/3804699842 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624a4c30010 con 0x5624a4b44690 2024-09-13T06:10:17.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.531+0000 7f4252c90640 1 --2- 172.21.15.194:0/3804699842 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5624a4b44690 0x5624a4c2fa40 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f42440199f0 tx=0x7f4244003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=682d5a5fd25cb135 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:17.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.531+0000 7f4140e09640 1 -- 172.21.15.194:0/3804699842 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42440aaa00 con 0x5624a4b44690 2024-09-13T06:10:17.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.531+0000 7f4140e09640 1 -- 172.21.15.194:0/3804699842 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42440aaba0 con 0x5624a4b44690 2024-09-13T06:10:17.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.531+0000 7f4140e09640 1 -- 172.21.15.194:0/3804699842 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42440bd3f0 con 0x5624a4b44690 2024-09-13T06:10:17.535 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.535+0000 7f4255180980 1 -- 172.21.15.194:0/3804699842 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5624a4b44690 msgr2=0x5624a4c2fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:17.535 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.535+0000 7f4255180980 1 --2- 172.21.15.194:0/3804699842 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5624a4b44690 0x5624a4c2fa40 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f42440199f0 tx=0x7f4244003030 comp rx=0 tx=0).stop 2024-09-13T06:10:17.535 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.535+0000 7f4255180980 1 -- 172.21.15.194:0/3804699842 shutdown_connections 2024-09-13T06:10:17.535 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.535+0000 7f4255180980 1 --2- 172.21.15.194:0/3804699842 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5624a4b44690 0x5624a4c2fa40 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:17.535 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.535+0000 7f4255180980 1 -- 172.21.15.194:0/3804699842 >> 172.21.15.194:0/3804699842 conn(0x5624a4b401b0 msgr2=0x5624a4c2b670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:17.536 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.535+0000 7f4255180980 1 -- 172.21.15.194:0/3804699842 shutdown_connections 2024-09-13T06:10:17.536 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.535+0000 7f4255180980 1 -- 172.21.15.194:0/3804699842 wait complete. 2024-09-13T06:10:17.536 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.535+0000 7f4255180980 1 Processor -- start 2024-09-13T06:10:17.536 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.535+0000 7f4255180980 1 -- start start 2024-09-13T06:10:17.536 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.535+0000 7f4255180980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5624a4b44fe0 0x5624a4c36e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:17.536 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.535+0000 7f4255180980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5624a4b4bca0 con 0x5624a4b44fe0 2024-09-13T06:10:17.537 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.535+0000 7f4252c90640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5624a4b44fe0 0x5624a4c36e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:17.537 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.535+0000 7f4252c90640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5624a4b44fe0 0x5624a4c36e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:50444/0 (socket says 172.21.15.194:50444) 2024-09-13T06:10:17.537 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.535+0000 7f4252c90640 1 -- 172.21.15.194:0/3036002424 learned_addr learned my addr 172.21.15.194:0/3036002424 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:17.537 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.535+0000 7f4252c90640 1 -- 172.21.15.194:0/3036002424 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624a4c37380 con 0x5624a4b44fe0 2024-09-13T06:10:17.538 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.535+0000 7f4252c90640 1 --2- 172.21.15.194:0/3036002424 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5624a4b44fe0 0x5624a4c36e40 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f42440199f0 tx=0x7f42440180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:17.538 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.535+0000 7f413f606640 1 -- 172.21.15.194:0/3036002424 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42440c6690 con 0x5624a4b44fe0 2024-09-13T06:10:17.538 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.535+0000 7f4255180980 1 -- 172.21.15.194:0/3036002424 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5624a4c37610 con 0x5624a4b44fe0 2024-09-13T06:10:17.538 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.535+0000 7f413f606640 1 -- 172.21.15.194:0/3036002424 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42440c6830 con 0x5624a4b44fe0 2024-09-13T06:10:17.538 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.535+0000 7f413f606640 1 -- 172.21.15.194:0/3036002424 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42440c6b10 con 0x5624a4b44fe0 2024-09-13T06:10:17.538 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.535+0000 7f4255180980 1 -- 172.21.15.194:0/3036002424 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624a4c3a2f0 con 0x5624a4b44fe0 2024-09-13T06:10:17.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.539+0000 7f413f606640 1 -- 172.21.15.194:0/3036002424 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f42440ce030 con 0x5624a4b44fe0 2024-09-13T06:10:17.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.539+0000 7f413f606640 1 --2- 172.21.15.194:0/3036002424 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4138034650 0x7f4138036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:17.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.539+0000 7f413f606640 1 -- 172.21.15.194:0/3036002424 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f42440cc020 con 0x5624a4b44fe0 2024-09-13T06:10:17.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.539+0000 7f425248f640 1 --2- 172.21.15.194:0/3036002424 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4138034650 0x7f4138036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:17.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.539+0000 7f4255180980 1 --2- 172.21.15.194:0/3036002424 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5624a4c3bdc0 0x5624a4c3e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:17.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.539+0000 7f4255180980 1 -- 172.21.15.194:0/3036002424 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c3e850 con 0x5624a4c3bdc0 2024-09-13T06:10:17.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.539+0000 7f4253491640 1 --2- 172.21.15.194:0/3036002424 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5624a4c3bdc0 0x5624a4c3e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:17.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.539+0000 7f425248f640 1 --2- 172.21.15.194:0/3036002424 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4138034650 0x7f4138036b10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4248000f70 tx=0x7f4248001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:17.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.539+0000 7f4253491640 1 --2- 172.21.15.194:0/3036002424 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5624a4c3bdc0 0x5624a4c3e210 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:17.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.539+0000 7f4253491640 1 -- 172.21.15.194:0/3036002424 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f424c00a4d0 con 0x5624a4c3bdc0 2024-09-13T06:10:17.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.539+0000 7f4255180980 1 -- 172.21.15.194:0/3036002424 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c3b510 con 0x5624a4c3bdc0 2024-09-13T06:10:17.542 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.539+0000 7f4253491640 1 -- 172.21.15.194:0/3036002424 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f424c00a4d0 con 0x5624a4c3bdc0 2024-09-13T06:10:17.542 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.539+0000 7f4255180980 1 --2- 172.21.15.194:0/3036002424 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5624a4c40bd0 0x5624a4c42fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:17.542 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.539+0000 7f4255180980 1 -- 172.21.15.194:0/3036002424 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c43690 con 0x5624a4c40bd0 2024-09-13T06:10:17.542 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.539+0000 7f4252c90640 1 --2- 172.21.15.194:0/3036002424 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5624a4c40bd0 0x5624a4c42fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:17.542 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.539+0000 7f4252c90640 1 --2- 172.21.15.194:0/3036002424 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5624a4c40bd0 0x5624a4c42fc0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:17.543 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.539+0000 7f4252c90640 1 -- 172.21.15.194:0/3036002424 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f42440d0a70 con 0x5624a4c40bd0 2024-09-13T06:10:17.543 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.539+0000 7f4255180980 1 -- 172.21.15.194:0/3036002424 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c3fa70 con 0x5624a4c3bdc0 2024-09-13T06:10:17.543 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.539+0000 7f4253491640 1 -- 172.21.15.194:0/3036002424 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f424c00a4d0 con 0x5624a4c3bdc0 2024-09-13T06:10:17.543 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.539+0000 7f4255180980 1 --2- 172.21.15.194:0/3036002424 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5624a4c44ad0 0x5624a4c46ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:17.543 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.539+0000 7f4255180980 1 -- 172.21.15.194:0/3036002424 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c47600 con 0x5624a4c44ad0 2024-09-13T06:10:17.543 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.539+0000 7f425248f640 1 --2- 172.21.15.194:0/3036002424 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5624a4c44ad0 0x5624a4c46ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:17.543 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.539+0000 7f425248f640 1 --2- 172.21.15.194:0/3036002424 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5624a4c44ad0 0x5624a4c46ec0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:17.543 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.543+0000 7f425248f640 1 -- 172.21.15.194:0/3036002424 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f424800f6a0 con 0x5624a4c44ad0 2024-09-13T06:10:17.543 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.543+0000 7f4255180980 1 Processor -- start 2024-09-13T06:10:17.543 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.543+0000 7f4255180980 1 -- start start 2024-09-13T06:10:17.545 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.543+0000 7f4255180980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5624a4c55090 0x5624a4c554b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:17.545 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.543+0000 7f4255180980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5624a4a4b800 con 0x5624a4c55090 2024-09-13T06:10:17.545 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.543+0000 7f4252c90640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5624a4c55090 0x5624a4c554b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:17.545 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.543+0000 7f4252c90640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5624a4c55090 0x5624a4c554b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:50448/0 (socket says 172.21.15.194:50448) 2024-09-13T06:10:17.545 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.543+0000 7f4252c90640 1 -- 172.21.15.194:0/3086668552 learned_addr learned my addr 172.21.15.194:0/3086668552 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:17.545 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.543+0000 7f4252c90640 1 -- 172.21.15.194:0/3086668552 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624a4c559f0 con 0x5624a4c55090 2024-09-13T06:10:17.545 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.543+0000 7f4252c90640 1 --2- 172.21.15.194:0/3086668552 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5624a4c55090 0x5624a4c554b0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f42440e3530 tx=0x7f42440d0770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:17.545 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.543+0000 7f413ce01640 1 -- 172.21.15.194:0/3086668552 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42440cfa40 con 0x5624a4c55090 2024-09-13T06:10:17.545 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.543+0000 7f4255180980 1 -- 172.21.15.194:0/3086668552 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5624a4c55c80 con 0x5624a4c55090 2024-09-13T06:10:17.545 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.543+0000 7f413ce01640 1 -- 172.21.15.194:0/3086668552 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42440cfbe0 con 0x5624a4c55090 2024-09-13T06:10:17.546 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.543+0000 7f413ce01640 1 -- 172.21.15.194:0/3086668552 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42440c7520 con 0x5624a4c55090 2024-09-13T06:10:17.546 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.543+0000 7f4255180980 1 -- 172.21.15.194:0/3086668552 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624a4c58900 con 0x5624a4c55090 2024-09-13T06:10:17.547 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.543+0000 7f413ce01640 1 -- 172.21.15.194:0/3086668552 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f42440c76c0 con 0x5624a4c55090 2024-09-13T06:10:17.547 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.543+0000 7f413ce01640 1 --2- 172.21.15.194:0/3086668552 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f412c034650 0x7f412c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:17.547 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.543+0000 7f413ce01640 1 -- 172.21.15.194:0/3086668552 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f42440f4ab0 con 0x5624a4c55090 2024-09-13T06:10:17.547 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.543+0000 7f425248f640 1 --2- 172.21.15.194:0/3086668552 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f412c034650 0x7f412c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:17.547 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.547+0000 7f4255180980 1 Processor -- start 2024-09-13T06:10:17.548 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.547+0000 7f4255180980 1 -- start start 2024-09-13T06:10:17.548 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.547+0000 7f425248f640 1 --2- 172.21.15.194:0/3086668552 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f412c034650 0x7f412c036b10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x5624a4c47a00 tx=0x7f424800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:17.548 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.547+0000 7f4255180980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5624a4c61b00 0x5624a4c61ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:17.548 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.547+0000 7f4255180980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5624a4c302d0 con 0x5624a4c61b00 2024-09-13T06:10:17.548 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.547+0000 7f4252c90640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5624a4c61b00 0x5624a4c61ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:17.548 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.547+0000 7f4252c90640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5624a4c61b00 0x5624a4c61ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:50458/0 (socket says 172.21.15.194:50458) 2024-09-13T06:10:17.548 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.547+0000 7f4252c90640 1 -- 172.21.15.194:0/353824058 learned_addr learned my addr 172.21.15.194:0/353824058 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:17.548 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.547+0000 7f4252c90640 1 -- 172.21.15.194:0/353824058 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624a4c624b0 con 0x5624a4c61b00 2024-09-13T06:10:17.550 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.547+0000 7f4252c90640 1 --2- 172.21.15.194:0/353824058 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5624a4c61b00 0x5624a4c61ee0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f42440dacf0 tx=0x7f42440dad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f14da4897ba7b5e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:17.550 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.547+0000 7f41367fc640 1 -- 172.21.15.194:0/353824058 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4244102020 con 0x5624a4c61b00 2024-09-13T06:10:17.550 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.547+0000 7f41367fc640 1 -- 172.21.15.194:0/353824058 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42440e6a70 con 0x5624a4c61b00 2024-09-13T06:10:17.550 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.547+0000 7f41367fc640 1 -- 172.21.15.194:0/353824058 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42440e6d30 con 0x5624a4c61b00 2024-09-13T06:10:17.550 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.547+0000 7f4255180980 1 -- 172.21.15.194:0/353824058 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5624a4c61b00 msgr2=0x5624a4c61ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:17.550 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.547+0000 7f4255180980 1 --2- 172.21.15.194:0/353824058 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5624a4c61b00 0x5624a4c61ee0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f42440dacf0 tx=0x7f42440dad20 comp rx=0 tx=0).stop 2024-09-13T06:10:17.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.547+0000 7f4255180980 1 -- 172.21.15.194:0/353824058 shutdown_connections 2024-09-13T06:10:17.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.547+0000 7f4255180980 1 --2- 172.21.15.194:0/353824058 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5624a4c61b00 0x5624a4c61ee0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:17.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.547+0000 7f4255180980 1 -- 172.21.15.194:0/353824058 >> 172.21.15.194:0/353824058 conn(0x5624a4c5de30 msgr2=0x5624a4c5bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:17.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.547+0000 7f4255180980 1 -- 172.21.15.194:0/353824058 shutdown_connections 2024-09-13T06:10:17.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.547+0000 7f4255180980 1 -- 172.21.15.194:0/353824058 wait complete. 2024-09-13T06:10:17.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.547+0000 7f4255180980 1 Processor -- start 2024-09-13T06:10:17.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.547+0000 7f4255180980 1 -- start start 2024-09-13T06:10:17.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.547+0000 7f4255180980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5624a4c61b00 0x5624a4c68c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:17.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.547+0000 7f4255180980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5624a4c62840 con 0x5624a4c61b00 2024-09-13T06:10:17.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.547+0000 7f4252c90640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5624a4c61b00 0x5624a4c68c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:17.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.547+0000 7f4252c90640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5624a4c61b00 0x5624a4c68c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:50466/0 (socket says 172.21.15.194:50466) 2024-09-13T06:10:17.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.547+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 learned_addr learned my addr 172.21.15.194:0/1170370482 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:17.552 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.551+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624a4c691b0 con 0x5624a4c61b00 2024-09-13T06:10:17.552 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.551+0000 7f4252c90640 1 --2- 172.21.15.194:0/1170370482 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5624a4c61b00 0x5624a4c68c70 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f42440e2350 tx=0x7f42440e0f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:17.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.551+0000 7f4134ff9640 1 -- 172.21.15.194:0/1170370482 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4244117070 con 0x5624a4c61b00 2024-09-13T06:10:17.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.551+0000 7f4134ff9640 1 -- 172.21.15.194:0/1170370482 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42440e3760 con 0x5624a4c61b00 2024-09-13T06:10:17.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.551+0000 7f4134ff9640 1 -- 172.21.15.194:0/1170370482 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42440bf240 con 0x5624a4c61b00 2024-09-13T06:10:17.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.551+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5624a4c691b0 con 0x5624a4c61b00 2024-09-13T06:10:17.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.551+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624a4c691b0 con 0x5624a4c61b00 2024-09-13T06:10:17.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.551+0000 7f4255180980 20 rados->read ofs=0 len=0 2024-09-13T06:10:17.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.551+0000 7f4134ff9640 1 -- 172.21.15.194:0/1170370482 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f424411a070 con 0x5624a4c61b00 2024-09-13T06:10:17.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.551+0000 7f4134ff9640 1 --2- 172.21.15.194:0/1170370482 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f411c034650 0x7f411c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:17.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.551+0000 7f4134ff9640 1 -- 172.21.15.194:0/1170370482 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f424410e030 con 0x5624a4c61b00 2024-09-13T06:10:17.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.551+0000 7f425248f640 1 --2- 172.21.15.194:0/1170370482 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f411c034650 0x7f411c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:17.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.551+0000 7f4255180980 1 --2- 172.21.15.194:0/1170370482 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5624a4c73b70 0x5624a4c76030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:17.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.551+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c76780 con 0x5624a4c73b70 2024-09-13T06:10:17.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.551+0000 7f4253491640 1 --2- 172.21.15.194:0/1170370482 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5624a4c73b70 0x5624a4c76030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:17.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.551+0000 7f425248f640 1 --2- 172.21.15.194:0/1170370482 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f411c034650 0x7f411c036b10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f424800c010 tx=0x7f4248010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:17.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.551+0000 7f4253491640 1 --2- 172.21.15.194:0/1170370482 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5624a4c73b70 0x5624a4c76030 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:17.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.551+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f424c00a4d0 con 0x5624a4c73b70 2024-09-13T06:10:17.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.551+0000 7f4255180980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:17.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.551+0000 7f4255180980 20 realm 2024-09-13T06:10:17.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.551+0000 7f4255180980 20 rados->read ofs=0 len=0 2024-09-13T06:10:17.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.551+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c76b90 con 0x5624a4c73b70 2024-09-13T06:10:17.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.551+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f424c00a4d0 con 0x5624a4c73b70 2024-09-13T06:10:17.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.551+0000 7f4255180980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:17.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.551+0000 7f4255180980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:10:17.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.551+0000 7f4255180980 20 rados->read ofs=0 len=0 2024-09-13T06:10:17.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.551+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c77430 con 0x5624a4c73b70 2024-09-13T06:10:17.558 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.555+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f424c00a4d0 con 0x5624a4c73b70 2024-09-13T06:10:17.558 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.555+0000 7f4255180980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:17.558 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.555+0000 7f4255180980 20 rados->read ofs=0 len=0 2024-09-13T06:10:17.558 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.555+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c777d0 con 0x5624a4c73b70 2024-09-13T06:10:17.558 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.555+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f424c00a4d0 con 0x5624a4c73b70 2024-09-13T06:10:17.558 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.555+0000 7f4255180980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:10:17.558 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.555+0000 7f4255180980 20 rados->read ofs=0 len=0 2024-09-13T06:10:17.558 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.555+0000 7f4255180980 1 --2- 172.21.15.194:0/1170370482 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5624a4c78530 0x5624a4c7a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:17.558 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.555+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c7aea0 con 0x5624a4c78530 2024-09-13T06:10:17.558 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.555+0000 7f4252c90640 1 --2- 172.21.15.194:0/1170370482 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5624a4c78530 0x5624a4c7a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:17.558 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.555+0000 7f4252c90640 1 --2- 172.21.15.194:0/1170370482 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5624a4c78530 0x5624a4c7a920 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:17.558 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.555+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4244119030 con 0x5624a4c78530 2024-09-13T06:10:17.558 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.555+0000 7f4255180980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:10:17.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.555+0000 7f4255180980 20 searching for the correct realm 2024-09-13T06:10:17.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.555+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c7c700 con 0x5624a4c78530 2024-09-13T06:10:17.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.555+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4244119030 con 0x5624a4c78530 2024-09-13T06:10:17.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.555+0000 7f4252c90640 1 --2- 172.21.15.194:0/1170370482 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f424411c060 0x7f42440bf8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:17.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.555+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c7c700 con 0x7f424411c060 2024-09-13T06:10:17.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.555+0000 7f425248f640 1 --2- 172.21.15.194:0/1170370482 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f424411c060 0x7f42440bf8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:17.562 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.555+0000 7f425248f640 1 --2- 172.21.15.194:0/1170370482 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f424411c060 0x7f42440bf8e0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:17.562 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.555+0000 7f425248f640 1 -- 172.21.15.194:0/1170370482 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4248037040 con 0x7f424411c060 2024-09-13T06:10:17.562 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.555+0000 7f425248f640 1 --2- 172.21.15.194:0/1170370482 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f424801fbe0 0x7f424803a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:17.562 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.555+0000 7f425248f640 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c7c700 con 0x7f424801fbe0 2024-09-13T06:10:17.562 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.555+0000 7f4253491640 1 --2- 172.21.15.194:0/1170370482 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f424801fbe0 0x7f424803a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:17.562 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.555+0000 7f4253491640 1 --2- 172.21.15.194:0/1170370482 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f424801fbe0 0x7f424803a3c0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:17.562 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.559+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f424c00a4d0 con 0x7f424801fbe0 2024-09-13T06:10:17.562 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.559+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c777d0 con 0x5624a4c73b70 2024-09-13T06:10:17.562 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.559+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f424c00a4d0 con 0x5624a4c73b70 2024-09-13T06:10:17.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.559+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c777d0 con 0x5624a4c73b70 2024-09-13T06:10:17.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.559+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f424c00a4d0 con 0x5624a4c73b70 2024-09-13T06:10:17.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.559+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c777d0 con 0x7f424801fbe0 2024-09-13T06:10:17.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.559+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f424c00a4d0 con 0x7f424801fbe0 2024-09-13T06:10:17.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.559+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c777d0 con 0x7f424801fbe0 2024-09-13T06:10:17.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.559+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f424c00a4d0 con 0x7f424801fbe0 2024-09-13T06:10:17.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.559+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c777d0 con 0x7f424411c060 2024-09-13T06:10:17.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.559+0000 7f425248f640 1 -- 172.21.15.194:0/1170370482 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4248037040 con 0x7f424411c060 2024-09-13T06:10:17.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.559+0000 7f425248f640 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c777d0 con 0x5624a4c78530 2024-09-13T06:10:17.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.559+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4244119030 con 0x5624a4c78530 2024-09-13T06:10:17.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.559+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c777d0 con 0x5624a4c73b70 2024-09-13T06:10:17.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.559+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f424c00a4d0 con 0x5624a4c73b70 2024-09-13T06:10:17.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.559+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c777d0 con 0x7f424801fbe0 2024-09-13T06:10:17.564 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.559+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f424c00a4d0 con 0x7f424801fbe0 2024-09-13T06:10:17.564 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.559+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c777d0 con 0x5624a4c73b70 2024-09-13T06:10:17.564 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.563+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f424c00a4d0 con 0x5624a4c73b70 2024-09-13T06:10:17.564 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.563+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c777d0 con 0x7f424411c060 2024-09-13T06:10:17.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.563+0000 7f425248f640 1 -- 172.21.15.194:0/1170370482 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4248037040 con 0x7f424411c060 2024-09-13T06:10:17.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.563+0000 7f425248f640 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c777d0 con 0x5624a4c78530 2024-09-13T06:10:17.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.563+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4244119030 con 0x5624a4c78530 2024-09-13T06:10:17.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.563+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c777d0 con 0x5624a4c78530 2024-09-13T06:10:17.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.563+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4244119030 con 0x5624a4c78530 2024-09-13T06:10:17.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.563+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c777d0 con 0x7f424801fbe0 2024-09-13T06:10:17.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.563+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f424c00a4d0 con 0x7f424801fbe0 2024-09-13T06:10:17.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.563+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c777d0 con 0x5624a4c78530 2024-09-13T06:10:17.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.563+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4244119030 con 0x5624a4c78530 2024-09-13T06:10:17.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.563+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c777d0 con 0x5624a4c78530 2024-09-13T06:10:17.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.563+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4244119030 con 0x5624a4c78530 2024-09-13T06:10:17.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.563+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c777d0 con 0x5624a4c73b70 2024-09-13T06:10:17.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.563+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f424c00a4d0 con 0x5624a4c73b70 2024-09-13T06:10:17.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.563+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c777d0 con 0x5624a4c73b70 2024-09-13T06:10:17.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.563+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f424c00a4d0 con 0x5624a4c73b70 2024-09-13T06:10:17.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.563+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c777d0 con 0x7f424411c060 2024-09-13T06:10:17.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.563+0000 7f425248f640 1 -- 172.21.15.194:0/1170370482 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4248037040 con 0x7f424411c060 2024-09-13T06:10:17.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.563+0000 7f425248f640 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c777d0 con 0x5624a4c78530 2024-09-13T06:10:17.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.563+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4244119030 con 0x5624a4c78530 2024-09-13T06:10:17.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.563+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c777d0 con 0x7f424411c060 2024-09-13T06:10:17.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.563+0000 7f425248f640 1 -- 172.21.15.194:0/1170370482 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4248037040 con 0x7f424411c060 2024-09-13T06:10:17.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.563+0000 7f425248f640 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c777d0 con 0x5624a4c73b70 2024-09-13T06:10:17.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.567+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f424c00a4d0 con 0x5624a4c73b70 2024-09-13T06:10:17.569 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.567+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c777d0 con 0x7f424801fbe0 2024-09-13T06:10:17.569 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.567+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f424c00a4d0 con 0x7f424801fbe0 2024-09-13T06:10:17.569 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.567+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c777d0 con 0x5624a4c78530 2024-09-13T06:10:17.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.567+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4244119030 con 0x5624a4c78530 2024-09-13T06:10:17.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.567+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c777d0 con 0x7f424411c060 2024-09-13T06:10:17.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.567+0000 7f425248f640 1 -- 172.21.15.194:0/1170370482 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4248037040 con 0x7f424411c060 2024-09-13T06:10:17.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.567+0000 7f425248f640 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c777d0 con 0x7f424411c060 2024-09-13T06:10:17.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.567+0000 7f425248f640 1 -- 172.21.15.194:0/1170370482 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f424804a040 con 0x7f424411c060 2024-09-13T06:10:17.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.567+0000 7f425248f640 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c777d0 con 0x5624a4c78530 2024-09-13T06:10:17.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.567+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4244119030 con 0x5624a4c78530 2024-09-13T06:10:17.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.567+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c777d0 con 0x7f424801fbe0 2024-09-13T06:10:17.574 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.567+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f424c00a4d0 con 0x7f424801fbe0 2024-09-13T06:10:17.574 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.567+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c777d0 con 0x5624a4c73b70 2024-09-13T06:10:17.574 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.567+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f424c00a4d0 con 0x5624a4c73b70 2024-09-13T06:10:17.574 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.567+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c777d0 con 0x7f424411c060 2024-09-13T06:10:17.574 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.567+0000 7f425248f640 1 -- 172.21.15.194:0/1170370482 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f424804a040 con 0x7f424411c060 2024-09-13T06:10:17.574 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.567+0000 7f4255180980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:10:17.574 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.567+0000 7f4255180980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:10:17.574 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.567+0000 7f4255180980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:10:17.574 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.567+0000 7f4255180980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:10:17.574 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.567+0000 7f4255180980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:10:17.574 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.567+0000 7f4255180980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:10:17.574 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.567+0000 7f4255180980 20 rados->read ofs=0 len=0 2024-09-13T06:10:17.574 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.567+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c7b820 con 0x5624a4c73b70 2024-09-13T06:10:17.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.571+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f424c00a4d0 con 0x5624a4c73b70 2024-09-13T06:10:17.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.571+0000 7f4255180980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:17.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.571+0000 7f4255180980 20 rados->read ofs=0 len=0 2024-09-13T06:10:17.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.571+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c7c0c0 con 0x5624a4c73b70 2024-09-13T06:10:17.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.571+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f424c00a4d0 con 0x5624a4c73b70 2024-09-13T06:10:17.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.571+0000 7f4255180980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:10:17.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.571+0000 7f4255180980 20 rados->read ofs=0 len=0 2024-09-13T06:10:17.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.571+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c7b460 con 0x7f424411c060 2024-09-13T06:10:17.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.571+0000 7f425248f640 1 -- 172.21.15.194:0/1170370482 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f424804a040 con 0x7f424411c060 2024-09-13T06:10:17.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.571+0000 7f4255180980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:10:17.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.571+0000 7f4255180980 20 zone default found 2024-09-13T06:10:17.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.571+0000 7f4255180980 4 Realm: () 2024-09-13T06:10:17.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.571+0000 7f4255180980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:10:17.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.571+0000 7f4255180980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:10:17.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.571+0000 7f4255180980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:10:17.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.571+0000 7f4255180980 20 zonegroup default 2024-09-13T06:10:17.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.571+0000 7f4255180980 20 rados->read ofs=0 len=0 2024-09-13T06:10:17.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.571+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c7c0c0 con 0x7f424801fbe0 2024-09-13T06:10:17.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.571+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f424c00a4d0 con 0x7f424801fbe0 2024-09-13T06:10:17.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.571+0000 7f4255180980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:17.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.571+0000 7f4255180980 20 rados->read ofs=0 len=0 2024-09-13T06:10:17.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.571+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c7e5b0 con 0x5624a4c78530 2024-09-13T06:10:17.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.571+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4244119030 con 0x5624a4c78530 2024-09-13T06:10:17.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.571+0000 7f4255180980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:17.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.571+0000 7f4255180980 20 rados->read ofs=0 len=0 2024-09-13T06:10:17.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.571+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c7e950 con 0x5624a4c78530 2024-09-13T06:10:17.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.571+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4244119030 con 0x5624a4c78530 2024-09-13T06:10:17.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.571+0000 7f4255180980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:17.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.571+0000 7f4255180980 20 started sync module instance, tier type = 2024-09-13T06:10:17.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.571+0000 7f4255180980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:10:17.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.571+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c7da50 con 0x7f424411c060 2024-09-13T06:10:17.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.571+0000 7f425248f640 1 -- 172.21.15.194:0/1170370482 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(44 notify.0 [create] v35'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f424804a040 con 0x7f424411c060 2024-09-13T06:10:17.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.571+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94715383373424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c7d6b0 con 0x7f424411c060 2024-09-13T06:10:17.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.571+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c7f810 con 0x5624a4c73b70 2024-09-13T06:10:17.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.575+0000 7f425248f640 1 -- 172.21.15.194:0/1170370482 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94715383373424] v35'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f424804a040 con 0x7f424411c060 2024-09-13T06:10:17.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.575+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v35'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f424c00a4d0 con 0x5624a4c73b70 2024-09-13T06:10:17.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.575+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94715383378784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c7fc30 con 0x5624a4c73b70 2024-09-13T06:10:17.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.575+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c805f0 con 0x5624a4c78530 2024-09-13T06:10:17.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.575+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94715383378784] v35'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f424c00a4d0 con 0x5624a4c73b70 2024-09-13T06:10:17.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.579+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v35'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4244119030 con 0x5624a4c78530 2024-09-13T06:10:17.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.579+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94715383379840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c7fba0 con 0x5624a4c78530 2024-09-13T06:10:17.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.579+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c812f0 con 0x7f424411c060 2024-09-13T06:10:17.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.579+0000 7f425248f640 1 -- 172.21.15.194:0/1170370482 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(50 notify.3 [create] v35'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f424804a040 con 0x7f424411c060 2024-09-13T06:10:17.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.579+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94715383385664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c81b90 con 0x7f424411c060 2024-09-13T06:10:17.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.579+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c82550 con 0x5624a4c73b70 2024-09-13T06:10:17.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.579+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94715383379840] v35'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4244119030 con 0x5624a4c78530 2024-09-13T06:10:17.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.579+0000 7f425248f640 1 -- 172.21.15.194:0/1170370482 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94715383385664] v35'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f424804a040 con 0x7f424411c060 2024-09-13T06:10:17.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.579+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v35'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f424c00a4d0 con 0x5624a4c73b70 2024-09-13T06:10:17.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.583+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94715383384464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c82550 con 0x5624a4c73b70 2024-09-13T06:10:17.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.583+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c82e20 con 0x7f424801fbe0 2024-09-13T06:10:17.583 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.583+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94715383384464] v35'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f424c00a4d0 con 0x5624a4c73b70 2024-09-13T06:10:17.584 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.583+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(54 notify.5 [create] v35'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f424c00a4d0 con 0x7f424801fbe0 2024-09-13T06:10:17.584 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.583+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94715383390640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c82bc0 con 0x7f424801fbe0 2024-09-13T06:10:17.584 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.583+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c83680 con 0x7f424801fbe0 2024-09-13T06:10:17.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.587+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(56 notify.6 [create] v35'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f424c00a4d0 con 0x7f424801fbe0 2024-09-13T06:10:17.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.587+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94715383394640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c83af0 con 0x7f424801fbe0 2024-09-13T06:10:17.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.587+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c845b0 con 0x7f424801fbe0 2024-09-13T06:10:17.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.587+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94715383390640] v35'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f424c00a4d0 con 0x7f424801fbe0 2024-09-13T06:10:17.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.587+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94715383394640] v35'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f424c00a4d0 con 0x7f424801fbe0 2024-09-13T06:10:17.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.587+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(58 notify.7 [create] v35'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f424c00a4d0 con 0x7f424801fbe0 2024-09-13T06:10:17.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.587+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94715383398528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c83640 con 0x7f424801fbe0 2024-09-13T06:10:17.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.587+0000 7f4255180980 20 add_watcher() i=0 2024-09-13T06:10:17.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.587+0000 7f4255180980 20 add_watcher() i=1 2024-09-13T06:10:17.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.587+0000 7f4255180980 20 add_watcher() i=2 2024-09-13T06:10:17.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.587+0000 7f4255180980 20 add_watcher() i=3 2024-09-13T06:10:17.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.587+0000 7f4255180980 20 add_watcher() i=4 2024-09-13T06:10:17.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.587+0000 7f4255180980 20 add_watcher() i=5 2024-09-13T06:10:17.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.587+0000 7f4255180980 20 add_watcher() i=6 2024-09-13T06:10:17.592 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.591+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94715383398528] v35'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f424c00a4d0 con 0x7f424801fbe0 2024-09-13T06:10:17.592 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.591+0000 7f4255180980 20 add_watcher() i=7 2024-09-13T06:10:17.592 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.591+0000 7f4255180980 2 all 8 watchers are set, enabling cache 2024-09-13T06:10:17.592 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.591+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c876b0 con 0x5624a4c73b70 2024-09-13T06:10:17.592 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.591+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f424c00a4d0 con 0x5624a4c73b70 2024-09-13T06:10:17.592 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.591+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94715383391760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c84b30 con 0x5624a4c73b70 2024-09-13T06:10:17.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.591+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94715383391760] v35'152 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f424c00a4d0 con 0x5624a4c73b70 2024-09-13T06:10:17.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.591+0000 7f41097e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:10:17.594 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.591+0000 7f4255180980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:10:17.594 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.591+0000 7f4255180980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:10:17.594 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.591+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8fae0 con 0x5624a4c73b70 2024-09-13T06:10:17.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.595+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v35'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f424c00a4d0 con 0x5624a4c73b70 2024-09-13T06:10:17.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.595+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c90050 con 0x7f424801fbe0 2024-09-13T06:10:17.598 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.599+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v35'18 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f424c00a4d0 con 0x7f424801fbe0 2024-09-13T06:10:17.598 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.599+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c90490 con 0x5624a4c78530 2024-09-13T06:10:17.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.599+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v35'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4244119030 con 0x5624a4c78530 2024-09-13T06:10:17.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.599+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c90390 con 0x5624a4c73b70 2024-09-13T06:10:17.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.599+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v35'153 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f424c00a4d0 con 0x5624a4c73b70 2024-09-13T06:10:17.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.599+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c907b0 con 0x7f424411c060 2024-09-13T06:10:17.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.603+0000 7f425248f640 1 -- 172.21.15.194:0/1170370482 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v35'44 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f424804a040 con 0x7f424411c060 2024-09-13T06:10:17.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.603+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c90d20 con 0x5624a4c78530 2024-09-13T06:10:17.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.603+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 <== osd.3 v2:172.21.15.194:6816/96632515 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v35'30 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4244119030 con 0x5624a4c78530 2024-09-13T06:10:17.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.603+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c90d20 con 0x5624a4c73b70 2024-09-13T06:10:17.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.603+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v35'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f424c00a4d0 con 0x5624a4c73b70 2024-09-13T06:10:17.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.603+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c90e50 con 0x7f424801fbe0 2024-09-13T06:10:17.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.607+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v35'29 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f424c00a4d0 con 0x7f424801fbe0 2024-09-13T06:10:17.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.607+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c912d0 con 0x7f424411c060 2024-09-13T06:10:17.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.611+0000 7f425248f640 1 -- 172.21.15.194:0/1170370482 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v35'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f424804a040 con 0x7f424411c060 2024-09-13T06:10:17.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.611+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c91780 con 0x5624a4c78530 2024-09-13T06:10:17.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.611+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 <== osd.3 v2:172.21.15.194:6816/96632515 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v35'24 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4244119030 con 0x5624a4c78530 2024-09-13T06:10:17.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.611+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c91780 con 0x7f424411c060 2024-09-13T06:10:17.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.611+0000 7f425248f640 1 -- 172.21.15.194:0/1170370482 <== osd.2 v2:172.21.15.194:6800/815615585 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v35'45 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f424804a040 con 0x7f424411c060 2024-09-13T06:10:17.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.611+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c91810 con 0x7f424801fbe0 2024-09-13T06:10:17.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.615+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v35'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f424c00a4d0 con 0x7f424801fbe0 2024-09-13T06:10:17.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.615+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c91810 con 0x7f424411c060 2024-09-13T06:10:17.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.615+0000 7f425248f640 1 -- 172.21.15.194:0/1170370482 <== osd.2 v2:172.21.15.194:6800/815615585 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v35'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f424804a040 con 0x7f424411c060 2024-09-13T06:10:17.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.615+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c918a0 con 0x7f424801fbe0 2024-09-13T06:10:17.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.619+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v35'35 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f424c00a4d0 con 0x7f424801fbe0 2024-09-13T06:10:17.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.619+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c918a0 con 0x5624a4c73b70 2024-09-13T06:10:17.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.619+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v35'154 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f424c00a4d0 con 0x5624a4c73b70 2024-09-13T06:10:17.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.619+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c918a0 con 0x5624a4c78530 2024-09-13T06:10:17.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.623+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 <== osd.3 v2:172.21.15.194:6816/96632515 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v35'38 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4244119030 con 0x5624a4c78530 2024-09-13T06:10:17.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.623+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c918a0 con 0x7f424411c060 2024-09-13T06:10:17.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.623+0000 7f425248f640 1 -- 172.21.15.194:0/1170370482 <== osd.2 v2:172.21.15.194:6800/815615585 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v35'46 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f424804a040 con 0x7f424411c060 2024-09-13T06:10:17.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.623+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c91930 con 0x5624a4c78530 2024-09-13T06:10:17.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.627+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 <== osd.3 v2:172.21.15.194:6816/96632515 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v35'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4244119030 con 0x5624a4c78530 2024-09-13T06:10:17.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.627+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c91930 con 0x5624a4c73b70 2024-09-13T06:10:17.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.627+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.1 v2:172.21.15.194:6808/3135444559 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v35'26 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f424c00a4d0 con 0x5624a4c73b70 2024-09-13T06:10:17.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.627+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c91930 con 0x5624a4c73b70 2024-09-13T06:10:17.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.631+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.1 v2:172.21.15.194:6808/3135444559 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v35'155 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f424c00a4d0 con 0x5624a4c73b70 2024-09-13T06:10:17.631 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.631+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c91930 con 0x5624a4c78530 2024-09-13T06:10:17.633 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.631+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 <== osd.3 v2:172.21.15.194:6816/96632515 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v35'39 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4244119030 con 0x5624a4c78530 2024-09-13T06:10:17.633 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.631+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c91930 con 0x7f424411c060 2024-09-13T06:10:17.634 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.635+0000 7f425248f640 1 -- 172.21.15.194:0/1170370482 <== osd.2 v2:172.21.15.194:6800/815615585 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v35'28 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f424804a040 con 0x7f424411c060 2024-09-13T06:10:17.634 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.635+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c919c0 con 0x5624a4c78530 2024-09-13T06:10:17.636 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.635+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 <== osd.3 v2:172.21.15.194:6816/96632515 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v35'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4244119030 con 0x5624a4c78530 2024-09-13T06:10:17.636 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.635+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c919c0 con 0x5624a4c78530 2024-09-13T06:10:17.638 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.635+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 <== osd.3 v2:172.21.15.194:6816/96632515 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v35'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4244119030 con 0x5624a4c78530 2024-09-13T06:10:17.638 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.635+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c919c0 con 0x5624a4c78530 2024-09-13T06:10:17.639 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.639+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 <== osd.3 v2:172.21.15.194:6816/96632515 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v35'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4244119030 con 0x5624a4c78530 2024-09-13T06:10:17.639 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.639+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c919c0 con 0x5624a4c78530 2024-09-13T06:10:17.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.639+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 <== osd.3 v2:172.21.15.194:6816/96632515 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v35'31 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4244119030 con 0x5624a4c78530 2024-09-13T06:10:17.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.639+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c919c0 con 0x7f424801fbe0 2024-09-13T06:10:17.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.643+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v35'21 uv20 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f424c00a4d0 con 0x7f424801fbe0 2024-09-13T06:10:17.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.643+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c919c0 con 0x5624a4c78530 2024-09-13T06:10:17.646 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.643+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 <== osd.3 v2:172.21.15.194:6816/96632515 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v35'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4244119030 con 0x5624a4c78530 2024-09-13T06:10:17.646 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.647+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c919c0 con 0x7f424801fbe0 2024-09-13T06:10:17.649 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.647+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.0 v2:172.21.15.120:6800/1923744619 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v35'30 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f424c00a4d0 con 0x7f424801fbe0 2024-09-13T06:10:17.649 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.647+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c919c0 con 0x5624a4c78530 2024-09-13T06:10:17.652 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.651+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 <== osd.3 v2:172.21.15.194:6816/96632515 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v35'40 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4244119030 con 0x5624a4c78530 2024-09-13T06:10:17.652 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.651+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c919c0 con 0x7f424801fbe0 2024-09-13T06:10:17.654 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.655+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.0 v2:172.21.15.120:6800/1923744619 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v35'36 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f424c00a4d0 con 0x7f424801fbe0 2024-09-13T06:10:17.654 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.655+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c919c0 con 0x7f424411c060 2024-09-13T06:10:17.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.655+0000 7f425248f640 1 -- 172.21.15.194:0/1170370482 <== osd.2 v2:172.21.15.194:6800/815615585 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v35'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f424804a040 con 0x7f424411c060 2024-09-13T06:10:17.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.655+0000 7f4083fff640 20 reqs_thread_entry: start 2024-09-13T06:10:17.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.655+0000 7f4255180980 20 init_complete bucket index max shards: 11 2024-09-13T06:10:17.658 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.655+0000 7f4255180980 20 Filter name: none 2024-09-13T06:10:17.658 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.659+0000 7f4081ffb640 20 reqs_thread_entry: start 2024-09-13T06:10:17.658 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.659+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4cad510 con 0x5624a4c73b70 2024-09-13T06:10:17.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.659+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.1 v2:172.21.15.194:6808/3135444559 27 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f424c00a4d0 con 0x5624a4c73b70 2024-09-13T06:10:17.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.659+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8d700 con 0x5624a4c73b70 2024-09-13T06:10:17.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.659+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.1 v2:172.21.15.194:6808/3135444559 28 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f424c00a4d0 con 0x5624a4c73b70 2024-09-13T06:10:17.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.659+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4cad510 con 0x5624a4c73b70 2024-09-13T06:10:17.660 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.659+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.1 v2:172.21.15.194:6808/3135444559 29 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f424c00a4d0 con 0x5624a4c73b70 2024-09-13T06:10:17.660 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.659+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4cad510 con 0x7f424801fbe0 2024-09-13T06:10:17.660 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.659+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.0 v2:172.21.15.120:6800/1923744619 22 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f424c00a4d0 con 0x7f424801fbe0 2024-09-13T06:10:17.660 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.659+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8d700 con 0x7f424801fbe0 2024-09-13T06:10:17.661 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.659+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.0 v2:172.21.15.120:6800/1923744619 23 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv9 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f424c00a4d0 con 0x7f424801fbe0 2024-09-13T06:10:17.661 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.659+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4cad510 con 0x7f424801fbe0 2024-09-13T06:10:17.662 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.659+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.0 v2:172.21.15.120:6800/1923744619 24 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f424c00a4d0 con 0x7f424801fbe0 2024-09-13T06:10:17.662 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.663+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4cad510 con 0x5624a4c78530 2024-09-13T06:10:17.663 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.663+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 <== osd.3 v2:172.21.15.194:6816/96632515 27 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4244119030 con 0x5624a4c78530 2024-09-13T06:10:17.663 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.663+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8d700 con 0x5624a4c78530 2024-09-13T06:10:17.663 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.663+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 <== osd.3 v2:172.21.15.194:6816/96632515 28 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4244119030 con 0x5624a4c78530 2024-09-13T06:10:17.663 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.663+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8d250 con 0x5624a4c78530 2024-09-13T06:10:17.664 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.663+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 <== osd.3 v2:172.21.15.194:6816/96632515 29 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4244119030 con 0x5624a4c78530 2024-09-13T06:10:17.664 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.663+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8d250 con 0x5624a4c73b70 2024-09-13T06:10:17.664 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.663+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.1 v2:172.21.15.194:6808/3135444559 30 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv15 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f424c00a4d0 con 0x5624a4c73b70 2024-09-13T06:10:17.664 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.663+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8d250 con 0x5624a4c73b70 2024-09-13T06:10:17.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.663+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.1 v2:172.21.15.194:6808/3135444559 31 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv15 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f424c00a4d0 con 0x5624a4c73b70 2024-09-13T06:10:17.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.663+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8d250 con 0x5624a4c73b70 2024-09-13T06:10:17.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.663+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.1 v2:172.21.15.194:6808/3135444559 32 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv15 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f424c00a4d0 con 0x5624a4c73b70 2024-09-13T06:10:17.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.663+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8d250 con 0x7f424411c060 2024-09-13T06:10:17.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.663+0000 7f425248f640 1 -- 172.21.15.194:0/1170370482 <== osd.2 v2:172.21.15.194:6800/815615585 21 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv13 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f424804a040 con 0x7f424411c060 2024-09-13T06:10:17.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.663+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8d250 con 0x7f424411c060 2024-09-13T06:10:17.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.663+0000 7f425248f640 1 -- 172.21.15.194:0/1170370482 <== osd.2 v2:172.21.15.194:6800/815615585 22 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv13 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f424804a040 con 0x7f424411c060 2024-09-13T06:10:17.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.663+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8d250 con 0x7f424411c060 2024-09-13T06:10:17.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.663+0000 7f425248f640 1 -- 172.21.15.194:0/1170370482 <== osd.2 v2:172.21.15.194:6800/815615585 23 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv13 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f424804a040 con 0x7f424411c060 2024-09-13T06:10:17.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.663+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8d250 con 0x5624a4c78530 2024-09-13T06:10:17.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.667+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 <== osd.3 v2:172.21.15.194:6816/96632515 30 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv10 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4244119030 con 0x5624a4c78530 2024-09-13T06:10:17.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.667+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8d250 con 0x5624a4c78530 2024-09-13T06:10:17.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.667+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 <== osd.3 v2:172.21.15.194:6816/96632515 31 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv10 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4244119030 con 0x5624a4c78530 2024-09-13T06:10:17.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.667+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4cad510 con 0x5624a4c78530 2024-09-13T06:10:17.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.667+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 <== osd.3 v2:172.21.15.194:6816/96632515 32 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv10 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4244119030 con 0x5624a4c78530 2024-09-13T06:10:17.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.667+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4cad510 con 0x5624a4c73b70 2024-09-13T06:10:17.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.667+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.1 v2:172.21.15.194:6808/3135444559 33 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv7 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f424c00a4d0 con 0x5624a4c73b70 2024-09-13T06:10:17.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.667+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8d700 con 0x5624a4c73b70 2024-09-13T06:10:17.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.667+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.1 v2:172.21.15.194:6808/3135444559 34 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv7 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f424c00a4d0 con 0x5624a4c73b70 2024-09-13T06:10:17.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.667+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4cad510 con 0x5624a4c73b70 2024-09-13T06:10:17.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.667+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.1 v2:172.21.15.194:6808/3135444559 35 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv7 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f424c00a4d0 con 0x5624a4c73b70 2024-09-13T06:10:17.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.667+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4cad510 con 0x7f424801fbe0 2024-09-13T06:10:17.670 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.667+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.0 v2:172.21.15.120:6800/1923744619 25 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv8 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f424c00a4d0 con 0x7f424801fbe0 2024-09-13T06:10:17.670 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.667+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8d700 con 0x7f424801fbe0 2024-09-13T06:10:17.670 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.667+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.0 v2:172.21.15.120:6800/1923744619 26 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv8 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f424c00a4d0 con 0x7f424801fbe0 2024-09-13T06:10:17.670 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.667+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4cad510 con 0x7f424801fbe0 2024-09-13T06:10:17.670 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.671+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.0 v2:172.21.15.120:6800/1923744619 27 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv8 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f424c00a4d0 con 0x7f424801fbe0 2024-09-13T06:10:17.670 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.671+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4cad510 con 0x7f424411c060 2024-09-13T06:10:17.671 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.671+0000 7f425248f640 1 -- 172.21.15.194:0/1170370482 <== osd.2 v2:172.21.15.194:6800/815615585 24 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f424804a040 con 0x7f424411c060 2024-09-13T06:10:17.671 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.671+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8d700 con 0x7f424411c060 2024-09-13T06:10:17.671 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.671+0000 7f425248f640 1 -- 172.21.15.194:0/1170370482 <== osd.2 v2:172.21.15.194:6800/815615585 25 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f424804a040 con 0x7f424411c060 2024-09-13T06:10:17.672 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.671+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4cad510 con 0x7f424411c060 2024-09-13T06:10:17.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.671+0000 7f425248f640 1 -- 172.21.15.194:0/1170370482 <== osd.2 v2:172.21.15.194:6800/815615585 26 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f424804a040 con 0x7f424411c060 2024-09-13T06:10:17.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.671+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4cad510 con 0x5624a4c78530 2024-09-13T06:10:17.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.671+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 <== osd.3 v2:172.21.15.194:6816/96632515 33 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4244119030 con 0x5624a4c78530 2024-09-13T06:10:17.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.671+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8d700 con 0x5624a4c78530 2024-09-13T06:10:17.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.671+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 <== osd.3 v2:172.21.15.194:6816/96632515 34 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4244119030 con 0x5624a4c78530 2024-09-13T06:10:17.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.671+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8d700 con 0x5624a4c78530 2024-09-13T06:10:17.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.671+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 <== osd.3 v2:172.21.15.194:6816/96632515 35 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4244119030 con 0x5624a4c78530 2024-09-13T06:10:17.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.671+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8d700 con 0x7f424411c060 2024-09-13T06:10:17.674 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.671+0000 7f425248f640 1 -- 172.21.15.194:0/1170370482 <== osd.2 v2:172.21.15.194:6800/815615585 27 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f424804a040 con 0x7f424411c060 2024-09-13T06:10:17.674 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.671+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8d700 con 0x7f424411c060 2024-09-13T06:10:17.675 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.671+0000 7f425248f640 1 -- 172.21.15.194:0/1170370482 <== osd.2 v2:172.21.15.194:6800/815615585 28 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f424804a040 con 0x7f424411c060 2024-09-13T06:10:17.675 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.671+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8d700 con 0x7f424411c060 2024-09-13T06:10:17.675 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.675+0000 7f425248f640 1 -- 172.21.15.194:0/1170370482 <== osd.2 v2:172.21.15.194:6800/815615585 29 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f424804a040 con 0x7f424411c060 2024-09-13T06:10:17.675 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.675+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8d700 con 0x7f424801fbe0 2024-09-13T06:10:17.675 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.675+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.0 v2:172.21.15.120:6800/1923744619 28 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f424c00a4d0 con 0x7f424801fbe0 2024-09-13T06:10:17.675 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.675+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8d700 con 0x7f424801fbe0 2024-09-13T06:10:17.676 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.675+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.0 v2:172.21.15.120:6800/1923744619 29 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f424c00a4d0 con 0x7f424801fbe0 2024-09-13T06:10:17.677 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.675+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8d700 con 0x7f424801fbe0 2024-09-13T06:10:17.677 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.675+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.0 v2:172.21.15.120:6800/1923744619 30 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f424c00a4d0 con 0x7f424801fbe0 2024-09-13T06:10:17.678 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.675+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8d700 con 0x7f424411c060 2024-09-13T06:10:17.678 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.679+0000 7f425248f640 1 -- 172.21.15.194:0/1170370482 <== osd.2 v2:172.21.15.194:6800/815615585 30 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f424804a040 con 0x7f424411c060 2024-09-13T06:10:17.678 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.679+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8d700 con 0x7f424411c060 2024-09-13T06:10:17.680 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.679+0000 7f425248f640 1 -- 172.21.15.194:0/1170370482 <== osd.2 v2:172.21.15.194:6800/815615585 31 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f424804a040 con 0x7f424411c060 2024-09-13T06:10:17.680 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.679+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8d700 con 0x7f424411c060 2024-09-13T06:10:17.680 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.679+0000 7f425248f640 1 -- 172.21.15.194:0/1170370482 <== osd.2 v2:172.21.15.194:6800/815615585 32 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f424804a040 con 0x7f424411c060 2024-09-13T06:10:17.680 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.679+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8d700 con 0x7f424801fbe0 2024-09-13T06:10:17.681 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.679+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.0 v2:172.21.15.120:6800/1923744619 31 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f424c00a4d0 con 0x7f424801fbe0 2024-09-13T06:10:17.681 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.679+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8d700 con 0x7f424801fbe0 2024-09-13T06:10:17.681 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.679+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.0 v2:172.21.15.120:6800/1923744619 32 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv4 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f424c00a4d0 con 0x7f424801fbe0 2024-09-13T06:10:17.681 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.679+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8d700 con 0x7f424801fbe0 2024-09-13T06:10:17.682 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.679+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.0 v2:172.21.15.120:6800/1923744619 33 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f424c00a4d0 con 0x7f424801fbe0 2024-09-13T06:10:17.682 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.679+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8d700 con 0x5624a4c73b70 2024-09-13T06:10:17.683 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.683+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.1 v2:172.21.15.194:6808/3135444559 36 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f424c00a4d0 con 0x5624a4c73b70 2024-09-13T06:10:17.683 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.683+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8d700 con 0x5624a4c73b70 2024-09-13T06:10:17.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.683+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.1 v2:172.21.15.194:6808/3135444559 37 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv9 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f424c00a4d0 con 0x5624a4c73b70 2024-09-13T06:10:17.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.683+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8d700 con 0x5624a4c73b70 2024-09-13T06:10:17.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.683+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.1 v2:172.21.15.194:6808/3135444559 38 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f424c00a4d0 con 0x5624a4c73b70 2024-09-13T06:10:17.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.683+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8d700 con 0x5624a4c78530 2024-09-13T06:10:17.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.683+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 <== osd.3 v2:172.21.15.194:6816/96632515 36 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4244119030 con 0x5624a4c78530 2024-09-13T06:10:17.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.683+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8d700 con 0x5624a4c78530 2024-09-13T06:10:17.685 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.683+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 <== osd.3 v2:172.21.15.194:6816/96632515 37 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4244119030 con 0x5624a4c78530 2024-09-13T06:10:17.685 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.683+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4cad510 con 0x5624a4c78530 2024-09-13T06:10:17.685 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.683+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 <== osd.3 v2:172.21.15.194:6816/96632515 38 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4244119030 con 0x5624a4c78530 2024-09-13T06:10:17.685 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.683+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4cad510 con 0x7f424411c060 2024-09-13T06:10:17.685 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.683+0000 7f425248f640 1 -- 172.21.15.194:0/1170370482 <== osd.2 v2:172.21.15.194:6800/815615585 33 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f424804a040 con 0x7f424411c060 2024-09-13T06:10:17.686 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.683+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8d700 con 0x7f424411c060 2024-09-13T06:10:17.687 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.683+0000 7f425248f640 1 -- 172.21.15.194:0/1170370482 <== osd.2 v2:172.21.15.194:6800/815615585 34 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv9 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4248057040 con 0x7f424411c060 2024-09-13T06:10:17.687 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.683+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4cad510 con 0x7f424411c060 2024-09-13T06:10:17.687 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.687+0000 7f425248f640 1 -- 172.21.15.194:0/1170370482 <== osd.2 v2:172.21.15.194:6800/815615585 35 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4248057040 con 0x7f424411c060 2024-09-13T06:10:17.687 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.687+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4cad510 con 0x5624a4c78530 2024-09-13T06:10:17.687 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.687+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 <== osd.3 v2:172.21.15.194:6816/96632515 39 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4244119030 con 0x5624a4c78530 2024-09-13T06:10:17.687 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.687+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8d700 con 0x5624a4c78530 2024-09-13T06:10:17.687 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.687+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 <== osd.3 v2:172.21.15.194:6816/96632515 40 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4244119030 con 0x5624a4c78530 2024-09-13T06:10:17.687 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.687+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4cad510 con 0x5624a4c78530 2024-09-13T06:10:17.689 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.687+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 <== osd.3 v2:172.21.15.194:6816/96632515 41 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4244119030 con 0x5624a4c78530 2024-09-13T06:10:17.689 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.687+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4cad510 con 0x5624a4c73b70 2024-09-13T06:10:17.689 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.687+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.1 v2:172.21.15.194:6808/3135444559 39 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f424c00a4d0 con 0x5624a4c73b70 2024-09-13T06:10:17.689 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.687+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8d700 con 0x5624a4c73b70 2024-09-13T06:10:17.689 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.687+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.1 v2:172.21.15.194:6808/3135444559 40 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f424c00a4d0 con 0x5624a4c73b70 2024-09-13T06:10:17.689 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.687+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4cad510 con 0x5624a4c73b70 2024-09-13T06:10:17.689 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.687+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.1 v2:172.21.15.194:6808/3135444559 41 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f424c00a4d0 con 0x5624a4c73b70 2024-09-13T06:10:17.689 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.687+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4cad510 con 0x5624a4c73b70 2024-09-13T06:10:17.691 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.687+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.1 v2:172.21.15.194:6808/3135444559 42 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f424c00a4d0 con 0x5624a4c73b70 2024-09-13T06:10:17.691 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.687+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8d700 con 0x5624a4c73b70 2024-09-13T06:10:17.691 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.687+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.1 v2:172.21.15.194:6808/3135444559 43 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv13 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f424c00a4d0 con 0x5624a4c73b70 2024-09-13T06:10:17.691 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.687+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4cad510 con 0x5624a4c73b70 2024-09-13T06:10:17.691 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.691+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.1 v2:172.21.15.194:6808/3135444559 44 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f424c00a4d0 con 0x5624a4c73b70 2024-09-13T06:10:17.691 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.691+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4cad510 con 0x5624a4c78530 2024-09-13T06:10:17.691 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.691+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 <== osd.3 v2:172.21.15.194:6816/96632515 42 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4244119030 con 0x5624a4c78530 2024-09-13T06:10:17.691 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.691+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8d700 con 0x5624a4c78530 2024-09-13T06:10:17.692 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.691+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 <== osd.3 v2:172.21.15.194:6816/96632515 43 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv9 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4244119030 con 0x5624a4c78530 2024-09-13T06:10:17.692 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.691+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4cad510 con 0x5624a4c78530 2024-09-13T06:10:17.692 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.691+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 <== osd.3 v2:172.21.15.194:6816/96632515 44 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4244119030 con 0x5624a4c78530 2024-09-13T06:10:17.693 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.691+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4cad510 con 0x7f424411c060 2024-09-13T06:10:17.693 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.691+0000 7f425248f640 1 -- 172.21.15.194:0/1170370482 <== osd.2 v2:172.21.15.194:6800/815615585 36 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4248057040 con 0x7f424411c060 2024-09-13T06:10:17.693 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.691+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8d700 con 0x7f424411c060 2024-09-13T06:10:17.693 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.691+0000 7f425248f640 1 -- 172.21.15.194:0/1170370482 <== osd.2 v2:172.21.15.194:6800/815615585 37 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4248057040 con 0x7f424411c060 2024-09-13T06:10:17.694 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.691+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4cad510 con 0x7f424411c060 2024-09-13T06:10:17.694 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.691+0000 7f425248f640 1 -- 172.21.15.194:0/1170370482 <== osd.2 v2:172.21.15.194:6800/815615585 38 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4248057040 con 0x7f424411c060 2024-09-13T06:10:17.694 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.691+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4cad510 con 0x5624a4c78530 2024-09-13T06:10:17.694 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.695+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 <== osd.3 v2:172.21.15.194:6816/96632515 45 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4244119030 con 0x5624a4c78530 2024-09-13T06:10:17.695 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.695+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8d700 con 0x5624a4c78530 2024-09-13T06:10:17.695 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.695+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 <== osd.3 v2:172.21.15.194:6816/96632515 46 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4244119030 con 0x5624a4c78530 2024-09-13T06:10:17.695 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.695+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8d250 con 0x5624a4c78530 2024-09-13T06:10:17.695 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.695+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 <== osd.3 v2:172.21.15.194:6816/96632515 47 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4244119030 con 0x5624a4c78530 2024-09-13T06:10:17.695 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.695+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8d700 con 0x5624a4c78530 2024-09-13T06:10:17.696 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.695+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 <== osd.3 v2:172.21.15.194:6816/96632515 48 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4244119030 con 0x5624a4c78530 2024-09-13T06:10:17.696 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.695+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8d700 con 0x5624a4c78530 2024-09-13T06:10:17.696 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.695+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 <== osd.3 v2:172.21.15.194:6816/96632515 49 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4244119030 con 0x5624a4c78530 2024-09-13T06:10:17.696 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.695+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4cad510 con 0x5624a4c78530 2024-09-13T06:10:17.697 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.695+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 <== osd.3 v2:172.21.15.194:6816/96632515 50 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4244119030 con 0x5624a4c78530 2024-09-13T06:10:17.697 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.695+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4cad510 con 0x5624a4c78530 2024-09-13T06:10:17.697 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.695+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 <== osd.3 v2:172.21.15.194:6816/96632515 51 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4244119030 con 0x5624a4c78530 2024-09-13T06:10:17.697 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.695+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8d700 con 0x5624a4c78530 2024-09-13T06:10:17.698 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.695+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 <== osd.3 v2:172.21.15.194:6816/96632515 52 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4244119030 con 0x5624a4c78530 2024-09-13T06:10:17.698 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.695+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4cad510 con 0x5624a4c78530 2024-09-13T06:10:17.699 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.699+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 <== osd.3 v2:172.21.15.194:6816/96632515 53 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4244119030 con 0x5624a4c78530 2024-09-13T06:10:17.699 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.699+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4cad510 con 0x5624a4c78530 2024-09-13T06:10:17.699 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.699+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 <== osd.3 v2:172.21.15.194:6816/96632515 54 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv6 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4244119030 con 0x5624a4c78530 2024-09-13T06:10:17.699 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.699+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8d700 con 0x5624a4c78530 2024-09-13T06:10:17.700 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.699+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 <== osd.3 v2:172.21.15.194:6816/96632515 55 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv6 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4244119030 con 0x5624a4c78530 2024-09-13T06:10:17.700 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.699+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4cad510 con 0x5624a4c78530 2024-09-13T06:10:17.700 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.699+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 <== osd.3 v2:172.21.15.194:6816/96632515 56 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv6 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4244119030 con 0x5624a4c78530 2024-09-13T06:10:17.700 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.699+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4cad510 con 0x7f424801fbe0 2024-09-13T06:10:17.701 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.699+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.0 v2:172.21.15.120:6800/1923744619 34 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f424c00a4d0 con 0x7f424801fbe0 2024-09-13T06:10:17.701 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.699+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8d700 con 0x7f424801fbe0 2024-09-13T06:10:17.702 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.703+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.0 v2:172.21.15.120:6800/1923744619 35 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f424c00a4d0 con 0x7f424801fbe0 2024-09-13T06:10:17.702 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.703+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8d250 con 0x7f424801fbe0 2024-09-13T06:10:17.703 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.703+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.0 v2:172.21.15.120:6800/1923744619 36 ==== osd_op_reply(174 gc.26 [call out=1699b] v0'0 uv20 ondisk = 0) ==== 149+0+1699 (crc 0 0 0) 0x7f424c00a4d0 con 0x7f424801fbe0 2024-09-13T06:10:17.703 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.703+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8dfe0 con 0x5624a4c78530 2024-09-13T06:10:17.704 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.703+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 <== osd.3 v2:172.21.15.194:6816/96632515 57 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4244119030 con 0x5624a4c78530 2024-09-13T06:10:17.704 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.703+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8dfe0 con 0x5624a4c78530 2024-09-13T06:10:17.704 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.703+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 <== osd.3 v2:172.21.15.194:6816/96632515 58 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4244119030 con 0x5624a4c78530 2024-09-13T06:10:17.704 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.703+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8dfe0 con 0x5624a4c78530 2024-09-13T06:10:17.705 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.703+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 <== osd.3 v2:172.21.15.194:6816/96632515 59 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4244119030 con 0x5624a4c78530 2024-09-13T06:10:17.705 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.703+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8dfe0 con 0x7f424801fbe0 2024-09-13T06:10:17.705 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.703+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.0 v2:172.21.15.120:6800/1923744619 37 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f424c00a4d0 con 0x7f424801fbe0 2024-09-13T06:10:17.705 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.703+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8dfe0 con 0x7f424801fbe0 2024-09-13T06:10:17.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.707+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.0 v2:172.21.15.120:6800/1923744619 38 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv4 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f424c00a4d0 con 0x7f424801fbe0 2024-09-13T06:10:17.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.707+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8dfe0 con 0x7f424801fbe0 2024-09-13T06:10:17.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.707+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.0 v2:172.21.15.120:6800/1923744619 39 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f424c00a4d0 con 0x7f424801fbe0 2024-09-13T06:10:17.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.707+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8dfe0 con 0x5624a4c78530 2024-09-13T06:10:17.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.707+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 <== osd.3 v2:172.21.15.194:6816/96632515 60 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4244119030 con 0x5624a4c78530 2024-09-13T06:10:17.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.707+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8dfe0 con 0x5624a4c78530 2024-09-13T06:10:17.708 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.707+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 <== osd.3 v2:172.21.15.194:6816/96632515 61 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv11 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4244119030 con 0x5624a4c78530 2024-09-13T06:10:17.708 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.707+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8dfe0 con 0x5624a4c78530 2024-09-13T06:10:17.709 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.707+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 <== osd.3 v2:172.21.15.194:6816/96632515 62 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4244119030 con 0x5624a4c78530 2024-09-13T06:10:17.709 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.707+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8dfe0 con 0x7f424801fbe0 2024-09-13T06:10:17.710 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.707+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.0 v2:172.21.15.120:6800/1923744619 40 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv10 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f424c00a4d0 con 0x7f424801fbe0 2024-09-13T06:10:17.710 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.707+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8dfe0 con 0x7f424801fbe0 2024-09-13T06:10:17.710 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.711+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.0 v2:172.21.15.120:6800/1923744619 41 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv10 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f424c00a4d0 con 0x7f424801fbe0 2024-09-13T06:10:17.710 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.711+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8dfe0 con 0x7f424801fbe0 2024-09-13T06:10:17.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.711+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.0 v2:172.21.15.120:6800/1923744619 42 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv10 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f424c00a4d0 con 0x7f424801fbe0 2024-09-13T06:10:17.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.711+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8dfe0 con 0x7f424411c060 2024-09-13T06:10:17.712 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.711+0000 7f425248f640 1 -- 172.21.15.194:0/1170370482 <== osd.2 v2:172.21.15.194:6800/815615585 39 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4248057040 con 0x7f424411c060 2024-09-13T06:10:17.712 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.711+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8dfe0 con 0x7f424411c060 2024-09-13T06:10:17.713 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.711+0000 7f425248f640 1 -- 172.21.15.194:0/1170370482 <== osd.2 v2:172.21.15.194:6800/815615585 40 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4248057040 con 0x7f424411c060 2024-09-13T06:10:17.713 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.711+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8dfe0 con 0x7f424411c060 2024-09-13T06:10:17.714 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.711+0000 7f425248f640 1 -- 172.21.15.194:0/1170370482 <== osd.2 v2:172.21.15.194:6800/815615585 41 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4248057040 con 0x7f424411c060 2024-09-13T06:10:17.715 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.715+0000 7f41097e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:10:17.715 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.715+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94715383391760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8ce60 con 0x5624a4c73b70 2024-09-13T06:10:17.717 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.715+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.1 v2:172.21.15.194:6808/3135444559 45 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94715383391760] v35'156 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f424c00a4d0 con 0x5624a4c73b70 2024-09-13T06:10:17.718 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.715+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94715383373424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8ce60 con 0x7f424411c060 2024-09-13T06:10:17.720 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.719+0000 7f425248f640 1 -- 172.21.15.194:0/1170370482 <== osd.2 v2:172.21.15.194:6800/815615585 42 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94715383373424] v35'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4248057040 con 0x7f424411c060 2024-09-13T06:10:17.720 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.719+0000 7f4255180980 20 remove_watcher() i=0 2024-09-13T06:10:17.720 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.719+0000 7f4255180980 2 removed watcher, disabling cache 2024-09-13T06:10:17.720 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.719+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94715383378784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8ce60 con 0x5624a4c73b70 2024-09-13T06:10:17.722 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.723+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.1 v2:172.21.15.194:6808/3135444559 46 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94715383378784] v35'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f424c00a4d0 con 0x5624a4c73b70 2024-09-13T06:10:17.722 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.723+0000 7f4255180980 20 remove_watcher() i=1 2024-09-13T06:10:17.722 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.723+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94715383379840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8ce60 con 0x5624a4c78530 2024-09-13T06:10:17.724 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.723+0000 7f4252c90640 1 -- 172.21.15.194:0/1170370482 <== osd.3 v2:172.21.15.194:6816/96632515 63 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94715383379840] v35'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4244119030 con 0x5624a4c78530 2024-09-13T06:10:17.725 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.723+0000 7f4255180980 20 remove_watcher() i=2 2024-09-13T06:10:17.725 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.723+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94715383385664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8ce60 con 0x7f424411c060 2024-09-13T06:10:17.726 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.727+0000 7f425248f640 1 -- 172.21.15.194:0/1170370482 <== osd.2 v2:172.21.15.194:6800/815615585 43 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94715383385664] v35'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4248057040 con 0x7f424411c060 2024-09-13T06:10:17.726 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.727+0000 7f4255180980 20 remove_watcher() i=3 2024-09-13T06:10:17.726 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.727+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94715383384464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8ce60 con 0x5624a4c73b70 2024-09-13T06:10:17.729 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.727+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.1 v2:172.21.15.194:6808/3135444559 47 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94715383384464] v35'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f424c00a4d0 con 0x5624a4c73b70 2024-09-13T06:10:17.729 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.727+0000 7f4255180980 20 remove_watcher() i=4 2024-09-13T06:10:17.729 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.727+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94715383390640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8ce60 con 0x7f424801fbe0 2024-09-13T06:10:17.731 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.731+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.0 v2:172.21.15.120:6800/1923744619 43 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94715383390640] v35'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f424c00a4d0 con 0x7f424801fbe0 2024-09-13T06:10:17.731 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.731+0000 7f4255180980 20 remove_watcher() i=5 2024-09-13T06:10:17.731 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.731+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94715383394640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8ce60 con 0x7f424801fbe0 2024-09-13T06:10:17.733 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.731+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.0 v2:172.21.15.120:6800/1923744619 44 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94715383394640] v35'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f424c00a4d0 con 0x7f424801fbe0 2024-09-13T06:10:17.733 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.731+0000 7f4255180980 20 remove_watcher() i=6 2024-09-13T06:10:17.734 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.731+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94715383398528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5624a4c8ce60 con 0x7f424801fbe0 2024-09-13T06:10:17.737 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.735+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 <== osd.0 v2:172.21.15.120:6800/1923744619 45 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94715383398528] v35'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f424c00a4d0 con 0x7f424801fbe0 2024-09-13T06:10:17.737 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.735+0000 7f4255180980 20 remove_watcher() i=7 2024-09-13T06:10:17.737 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.735+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f424801fbe0 msgr2=0x7f424803a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:17.737 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.735+0000 7f4255180980 1 --2- 172.21.15.194:0/1170370482 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f424801fbe0 0x7f424803a3c0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:17.737 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.735+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5624a4c73b70 msgr2=0x5624a4c76030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:17.737 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.735+0000 7f4255180980 1 --2- 172.21.15.194:0/1170370482 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5624a4c73b70 0x5624a4c76030 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:17.737 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.735+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f424411c060 msgr2=0x7f42440bf8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:17.737 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.735+0000 7f4255180980 1 --2- 172.21.15.194:0/1170370482 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f424411c060 0x7f42440bf8e0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:17.737 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.735+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5624a4c78530 msgr2=0x5624a4c7a920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:17.738 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.735+0000 7f4255180980 1 --2- 172.21.15.194:0/1170370482 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5624a4c78530 0x5624a4c7a920 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:17.738 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.735+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f411c034650 msgr2=0x7f411c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:17.738 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.735+0000 7f4255180980 1 --2- 172.21.15.194:0/1170370482 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f411c034650 0x7f411c036b10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f424800c010 tx=0x7f4248010000 comp rx=0 tx=0).stop 2024-09-13T06:10:17.738 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.735+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5624a4c61b00 msgr2=0x5624a4c68c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:17.738 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.735+0000 7f4253491640 1 -- 172.21.15.194:0/1170370482 reap_dead start 2024-09-13T06:10:17.738 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.735+0000 7f4255180980 1 --2- 172.21.15.194:0/1170370482 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5624a4c61b00 0x5624a4c68c70 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f42440e2350 tx=0x7f42440e0f70 comp rx=0 tx=0).stop 2024-09-13T06:10:17.738 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.735+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 shutdown_connections 2024-09-13T06:10:17.738 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.735+0000 7f4255180980 1 --2- 172.21.15.194:0/1170370482 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5624a4c61b00 0x5624a4c68c70 secure :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f42440e2350 tx=0x7f42440e0f70 comp rx=0 tx=0).stop 2024-09-13T06:10:17.738 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.735+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 >> 172.21.15.194:0/1170370482 conn(0x5624a4c5de30 msgr2=0x5624a4c5bf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:17.738 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.735+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 shutdown_connections 2024-09-13T06:10:17.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.735+0000 7f4255180980 1 -- 172.21.15.194:0/1170370482 wait complete. 2024-09-13T06:10:17.740 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.735+0000 7f4255180980 1 -- 172.21.15.194:0/3086668552 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f412c034650 msgr2=0x7f412c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:17.740 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.735+0000 7f4255180980 1 --2- 172.21.15.194:0/3086668552 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f412c034650 0x7f412c036b10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x5624a4c47a00 tx=0x7f424800f000 comp rx=0 tx=0).stop 2024-09-13T06:10:17.740 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.735+0000 7f4255180980 1 -- 172.21.15.194:0/3086668552 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5624a4c55090 msgr2=0x5624a4c554b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:17.740 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.735+0000 7f4255180980 1 --2- 172.21.15.194:0/3086668552 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5624a4c55090 0x5624a4c554b0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f42440e3530 tx=0x7f42440d0770 comp rx=0 tx=0).stop 2024-09-13T06:10:17.741 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.735+0000 7f4255180980 1 -- 172.21.15.194:0/3086668552 shutdown_connections 2024-09-13T06:10:17.741 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.735+0000 7f4255180980 1 --2- 172.21.15.194:0/3086668552 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f412c034650 0x7f412c036b10 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:17.741 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.735+0000 7f4255180980 1 --2- 172.21.15.194:0/3086668552 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5624a4c55090 0x5624a4c554b0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:17.741 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.735+0000 7f4255180980 1 -- 172.21.15.194:0/3086668552 >> 172.21.15.194:0/3086668552 conn(0x5624a4c4a1e0 msgr2=0x5624a4c4cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:17.741 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.735+0000 7f4255180980 1 -- 172.21.15.194:0/3086668552 shutdown_connections 2024-09-13T06:10:17.741 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.735+0000 7f4255180980 1 -- 172.21.15.194:0/3086668552 wait complete. 2024-09-13T06:10:17.741 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.739+0000 7f4255180980 1 -- 172.21.15.194:0/3036002424 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5624a4c3bdc0 msgr2=0x5624a4c3e210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:17.741 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.739+0000 7f4255180980 1 --2- 172.21.15.194:0/3036002424 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5624a4c3bdc0 0x5624a4c3e210 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:17.741 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.739+0000 7f4255180980 1 -- 172.21.15.194:0/3036002424 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5624a4c44ad0 msgr2=0x5624a4c46ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:17.741 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.739+0000 7f4255180980 1 --2- 172.21.15.194:0/3036002424 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5624a4c44ad0 0x5624a4c46ec0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:17.741 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.739+0000 7f4255180980 1 -- 172.21.15.194:0/3036002424 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5624a4c40bd0 msgr2=0x5624a4c42fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:17.742 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.739+0000 7f4255180980 1 --2- 172.21.15.194:0/3036002424 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5624a4c40bd0 0x5624a4c42fc0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:17.742 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.739+0000 7f4255180980 1 -- 172.21.15.194:0/3036002424 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4138034650 msgr2=0x7f4138036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:17.742 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.739+0000 7f4255180980 1 --2- 172.21.15.194:0/3036002424 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4138034650 0x7f4138036b10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4248000f70 tx=0x7f4248001380 comp rx=0 tx=0).stop 2024-09-13T06:10:17.742 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.739+0000 7f4255180980 1 -- 172.21.15.194:0/3036002424 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5624a4b44fe0 msgr2=0x5624a4c36e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:17.742 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.739+0000 7f4255180980 1 --2- 172.21.15.194:0/3036002424 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5624a4b44fe0 0x5624a4c36e40 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f42440199f0 tx=0x7f42440180e0 comp rx=0 tx=0).stop 2024-09-13T06:10:17.742 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.739+0000 7f4253491640 1 -- 172.21.15.194:0/3036002424 reap_dead start 2024-09-13T06:10:17.742 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.739+0000 7f4255180980 1 -- 172.21.15.194:0/3036002424 shutdown_connections 2024-09-13T06:10:17.742 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.739+0000 7f4255180980 1 -- 172.21.15.194:0/3036002424 >> 172.21.15.194:0/3036002424 conn(0x5624a4b401b0 msgr2=0x5624a4c2a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:17.742 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.739+0000 7f4255180980 1 -- 172.21.15.194:0/3036002424 shutdown_connections 2024-09-13T06:10:17.742 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.739+0000 7f4255180980 1 -- 172.21.15.194:0/3036002424 wait complete. 2024-09-13T06:10:17.752 INFO:teuthology.orchestra.run.smithi194.stdout:[{"tag":"52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.38910030277681561\u0000","time":"2024-09-13T06:10:17.470233+0000","objs":[{"pool":"default.rgw.buckets.data","oid":"52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1__shadow_.fbqI_lYPU7fC4AOYhizaE5Gq2--rjHp_1","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1__shadow_.fbqI_lYPU7fC4AOYhizaE5Gq2--rjHp_2","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1__shadow_.fbqI_lYPU7fC4AOYhizaE5Gq2--rjHp_3","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1__shadow_.fbqI_lYPU7fC4AOYhizaE5Gq2--rjHp_4","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1__shadow_.fbqI_lYPU7fC4AOYhizaE5Gq2--rjHp_5","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1__shadow_.fbqI_lYPU7fC4AOYhizaE5Gq2--rjHp_6","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1__shadow_.fbqI_lYPU7fC4AOYhizaE5Gq2--rjHp_7","key":"","instance":""}]}] 2024-09-13T06:10:17.753 DEBUG:tasks.util.rgw: json result: [{'tag': '52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.38910030277681561\x00', 'time': '2024-09-13T06:10:17.470233+0000', 'objs': [{'pool': 'default.rgw.buckets.data', 'oid': '52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1__shadow_.fbqI_lYPU7fC4AOYhizaE5Gq2--rjHp_1', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1__shadow_.fbqI_lYPU7fC4AOYhizaE5Gq2--rjHp_2', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1__shadow_.fbqI_lYPU7fC4AOYhizaE5Gq2--rjHp_3', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1__shadow_.fbqI_lYPU7fC4AOYhizaE5Gq2--rjHp_4', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1__shadow_.fbqI_lYPU7fC4AOYhizaE5Gq2--rjHp_5', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1__shadow_.fbqI_lYPU7fC4AOYhizaE5Gq2--rjHp_6', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1__shadow_.fbqI_lYPU7fC4AOYhizaE5Gq2--rjHp_7', 'key': '', 'instance': ''}]}] 2024-09-13T06:10:17.753 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process'] 2024-09-13T06:10:17.753 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process'] 2024-09-13T06:10:17.753 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process 2024-09-13T06:10:17.828 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:10:17.828 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:10:17.829 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.827+0000 7fe2ba510980 1 Processor -- start 2024-09-13T06:10:17.829 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.827+0000 7fe2ba510980 1 -- start start 2024-09-13T06:10:17.829 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.827+0000 7fe2ba510980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x557fa258b560 0x557fa258b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:17.829 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.827+0000 7fe2ba510980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557fa2414ae0 con 0x557fa258beb0 2024-09-13T06:10:17.830 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.827+0000 7fe2ba510980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x557fa2438e30 con 0x557fa258b560 2024-09-13T06:10:17.830 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.827+0000 7fe2b8020640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x557fa258b560 0x557fa258b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:17.830 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.831+0000 7fe2b781f640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x557fa258beb0 0x557fa25908e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:59038/0 (socket says 172.21.15.194:59038) 2024-09-13T06:10:17.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.831+0000 7fe2b781f640 1 -- 172.21.15.194:0/2716279810 learned_addr learned my addr 172.21.15.194:0/2716279810 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-09-13T06:10:17.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.831+0000 7fe2b8020640 1 -- 172.21.15.194:0/2716279810 >> v1:172.21.15.120:6789/0 conn(0x557fa258beb0 legacy=0x557fa25908e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:17.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.831+0000 7fe2b701e640 1 -- 172.21.15.194:0/2716279810 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2709444924 0 0) 0x557fa2414ae0 con 0x557fa258beb0 2024-09-13T06:10:17.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.831+0000 7fe2b8020640 1 -- 172.21.15.194:0/2716279810 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fa2593130 con 0x557fa258b560 2024-09-13T06:10:17.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.831+0000 7fe2b8020640 1 --2- 172.21.15.194:0/2716279810 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557fa258b560 0x557fa258b940 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fe2a800a420 tx=0x7fe2a801afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c340b7e30ed1a963 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:17.835 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.835+0000 7fe2b701e640 1 -- 172.21.15.194:0/2716279810 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2a80af070 con 0x557fa258b560 2024-09-13T06:10:17.835 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.835+0000 7fe2b701e640 1 -- 172.21.15.194:0/2716279810 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2a80aa530 con 0x557fa258b560 2024-09-13T06:10:17.835 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.835+0000 7fe2b701e640 1 -- 172.21.15.194:0/2716279810 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2a80aa810 con 0x557fa258b560 2024-09-13T06:10:17.835 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.835+0000 7fe2ba510980 1 -- 172.21.15.194:0/2716279810 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557fa258b560 msgr2=0x557fa258b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:17.835 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.835+0000 7fe2ba510980 1 --2- 172.21.15.194:0/2716279810 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557fa258b560 0x557fa258b940 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fe2a800a420 tx=0x7fe2a801afd0 comp rx=0 tx=0).stop 2024-09-13T06:10:17.835 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.835+0000 7fe2ba510980 1 -- 172.21.15.194:0/2716279810 shutdown_connections 2024-09-13T06:10:17.835 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.835+0000 7fe2ba510980 1 --2- 172.21.15.194:0/2716279810 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557fa258b560 0x557fa258b940 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:17.835 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.835+0000 7fe2ba510980 1 -- 172.21.15.194:0/2716279810 >> 172.21.15.194:0/2716279810 conn(0x557fa2587080 msgr2=0x557fa25894a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:17.835 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.835+0000 7fe2ba510980 1 -- 172.21.15.194:0/2716279810 shutdown_connections 2024-09-13T06:10:17.835 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.835+0000 7fe2ba510980 1 -- 172.21.15.194:0/2716279810 wait complete. 2024-09-13T06:10:17.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.851+0000 7fe2ba510980 1 Processor -- start 2024-09-13T06:10:17.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.851+0000 7fe2ba510980 1 -- start start 2024-09-13T06:10:17.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.851+0000 7fe2ba510980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557fa258b560 0x557fa2676750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:17.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.851+0000 7fe2ba510980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x557fa243a200 con 0x557fa258b560 2024-09-13T06:10:17.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.851+0000 7fe2b8020640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557fa258b560 0x557fa2676750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:17.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.851+0000 7fe2b8020640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557fa258b560 0x557fa2676750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:50488/0 (socket says 172.21.15.194:50488) 2024-09-13T06:10:17.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.851+0000 7fe2b8020640 1 -- 172.21.15.194:0/3050808358 learned_addr learned my addr 172.21.15.194:0/3050808358 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:17.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.851+0000 7fe2b8020640 1 -- 172.21.15.194:0/3050808358 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fa2676d20 con 0x557fa258b560 2024-09-13T06:10:17.853 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.851+0000 7fe2b8020640 1 --2- 172.21.15.194:0/3050808358 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557fa258b560 0x557fa2676750 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fe2a80ad040 tx=0x7fe2a80033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=815bda3ae53b54a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:17.853 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.851+0000 7fe1a660c640 1 -- 172.21.15.194:0/3050808358 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2a80af050 con 0x557fa258b560 2024-09-13T06:10:17.853 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.851+0000 7fe1a660c640 1 -- 172.21.15.194:0/3050808358 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2a80b0040 con 0x557fa258b560 2024-09-13T06:10:17.853 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.851+0000 7fe1a660c640 1 -- 172.21.15.194:0/3050808358 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2a80aaca0 con 0x557fa258b560 2024-09-13T06:10:17.854 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.851+0000 7fe2ba510980 1 -- 172.21.15.194:0/3050808358 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557fa258b560 msgr2=0x557fa2676750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:17.854 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.851+0000 7fe2ba510980 1 --2- 172.21.15.194:0/3050808358 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557fa258b560 0x557fa2676750 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fe2a80ad040 tx=0x7fe2a80033b0 comp rx=0 tx=0).stop 2024-09-13T06:10:17.854 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.851+0000 7fe2ba510980 1 -- 172.21.15.194:0/3050808358 shutdown_connections 2024-09-13T06:10:17.855 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.851+0000 7fe2ba510980 1 --2- 172.21.15.194:0/3050808358 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557fa258b560 0x557fa2676750 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:17.855 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.851+0000 7fe2ba510980 1 -- 172.21.15.194:0/3050808358 >> 172.21.15.194:0/3050808358 conn(0x557fa2587080 msgr2=0x557fa2672380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:17.855 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.851+0000 7fe2ba510980 1 -- 172.21.15.194:0/3050808358 shutdown_connections 2024-09-13T06:10:17.855 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.851+0000 7fe2ba510980 1 -- 172.21.15.194:0/3050808358 wait complete. 2024-09-13T06:10:17.855 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.855+0000 7fe2ba510980 1 Processor -- start 2024-09-13T06:10:17.855 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.855+0000 7fe2ba510980 1 -- start start 2024-09-13T06:10:17.855 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.855+0000 7fe2ba510980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557fa258b560 0x557fa2501400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:17.855 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.855+0000 7fe2ba510980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x557fa2592b70 con 0x557fa258b560 2024-09-13T06:10:17.856 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.855+0000 7fe2b8020640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557fa258b560 0x557fa2501400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:17.856 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.855+0000 7fe2b8020640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557fa258b560 0x557fa2501400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:50490/0 (socket says 172.21.15.194:50490) 2024-09-13T06:10:17.856 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.855+0000 7fe2b8020640 1 -- 172.21.15.194:0/4225840753 learned_addr learned my addr 172.21.15.194:0/4225840753 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:17.856 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.855+0000 7fe2b8020640 1 -- 172.21.15.194:0/4225840753 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fa2681700 con 0x557fa258b560 2024-09-13T06:10:17.856 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.855+0000 7fe2b8020640 1 --2- 172.21.15.194:0/4225840753 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557fa258b560 0x557fa2501400 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8019680 tx=0x7fe2a8019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:17.856 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.855+0000 7fe1a4e09640 1 -- 172.21.15.194:0/4225840753 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2a80c5070 con 0x557fa258b560 2024-09-13T06:10:17.857 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.855+0000 7fe2ba510980 1 -- 172.21.15.194:0/4225840753 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557fa26818d0 con 0x557fa258b560 2024-09-13T06:10:17.857 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.855+0000 7fe1a4e09640 1 -- 172.21.15.194:0/4225840753 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2a80b6d60 con 0x557fa258b560 2024-09-13T06:10:17.857 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.855+0000 7fe1a4e09640 1 -- 172.21.15.194:0/4225840753 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2a80c15f0 con 0x557fa258b560 2024-09-13T06:10:17.857 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.855+0000 7fe2ba510980 1 -- 172.21.15.194:0/4225840753 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557fa2681d60 con 0x557fa258b560 2024-09-13T06:10:17.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.855+0000 7fe1a4e09640 1 -- 172.21.15.194:0/4225840753 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe2a80c8070 con 0x557fa258b560 2024-09-13T06:10:17.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.855+0000 7fe1a4e09640 1 --2- 172.21.15.194:0/4225840753 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fe1a0034650 0x7fe1a0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:17.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.855+0000 7fe1a4e09640 1 -- 172.21.15.194:0/4225840753 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fe2a80bb070 con 0x557fa258b560 2024-09-13T06:10:17.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.855+0000 7fe2b781f640 1 --2- 172.21.15.194:0/4225840753 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fe1a0034650 0x7fe1a0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:17.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.855+0000 7fe2ba510980 1 --2- 172.21.15.194:0/4225840753 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x557fa258beb0 0x557fa2685a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:17.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.855+0000 7fe2ba510980 1 -- 172.21.15.194:0/4225840753 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa2686080 con 0x557fa258beb0 2024-09-13T06:10:17.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.859+0000 7fe2b8821640 1 --2- 172.21.15.194:0/4225840753 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x557fa258beb0 0x557fa2685a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:17.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.859+0000 7fe2b781f640 1 --2- 172.21.15.194:0/4225840753 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fe1a0034650 0x7fe1a0036b10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe2a0000c10 tx=0x7fe2a00013c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:17.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.859+0000 7fe2b8821640 1 --2- 172.21.15.194:0/4225840753 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x557fa258beb0 0x557fa2685a60 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:17.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.859+0000 7fe2b8821640 1 -- 172.21.15.194:0/4225840753 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe2b00083f0 con 0x557fa258beb0 2024-09-13T06:10:17.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.859+0000 7fe2ba510980 1 -- 172.21.15.194:0/4225840753 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa2683010 con 0x557fa258beb0 2024-09-13T06:10:17.861 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.859+0000 7fe2b8821640 1 -- 172.21.15.194:0/4225840753 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe2b00083f0 con 0x557fa258beb0 2024-09-13T06:10:17.861 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.859+0000 7fe2ba510980 1 --2- 172.21.15.194:0/4225840753 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x557fa2688320 0x557fa268a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:17.861 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.859+0000 7fe2ba510980 1 -- 172.21.15.194:0/4225840753 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa268ade0 con 0x557fa2688320 2024-09-13T06:10:17.861 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.859+0000 7fe2b8020640 1 --2- 172.21.15.194:0/4225840753 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x557fa2688320 0x557fa268a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:17.861 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.859+0000 7fe2b8020640 1 --2- 172.21.15.194:0/4225840753 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x557fa2688320 0x557fa268a710 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:17.861 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.859+0000 7fe2b8020640 1 -- 172.21.15.194:0/4225840753 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe2a80d1070 con 0x557fa2688320 2024-09-13T06:10:17.861 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.859+0000 7fe2ba510980 1 -- 172.21.15.194:0/4225840753 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26871c0 con 0x557fa258beb0 2024-09-13T06:10:17.861 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.859+0000 7fe2b8821640 1 -- 172.21.15.194:0/4225840753 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe2b00083f0 con 0x557fa258beb0 2024-09-13T06:10:17.861 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.859+0000 7fe2ba510980 1 --2- 172.21.15.194:0/4225840753 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x557fa268c220 0x557fa268e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:17.861 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.859+0000 7fe2ba510980 1 -- 172.21.15.194:0/4225840753 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa268eda0 con 0x557fa268c220 2024-09-13T06:10:17.861 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.859+0000 7fe2b781f640 1 --2- 172.21.15.194:0/4225840753 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x557fa268c220 0x557fa268e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:17.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.859+0000 7fe2b781f640 1 --2- 172.21.15.194:0/4225840753 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x557fa268c220 0x557fa268e610 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:17.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.859+0000 7fe2b781f640 1 -- 172.21.15.194:0/4225840753 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe2a000f680 con 0x557fa268c220 2024-09-13T06:10:17.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.859+0000 7fe2ba510980 1 Processor -- start 2024-09-13T06:10:17.863 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.859+0000 7fe2ba510980 1 -- start start 2024-09-13T06:10:17.863 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.859+0000 7fe2ba510980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557fa267f060 0x557fa267d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:17.863 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.863+0000 7fe2ba510980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x557fa2493800 con 0x557fa267f060 2024-09-13T06:10:17.863 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.863+0000 7fe2b8020640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557fa267f060 0x557fa267d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:17.863 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.863+0000 7fe2b8020640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557fa267f060 0x557fa267d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:50492/0 (socket says 172.21.15.194:50492) 2024-09-13T06:10:17.863 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.863+0000 7fe2b8020640 1 -- 172.21.15.194:0/915321046 learned_addr learned my addr 172.21.15.194:0/915321046 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:17.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.863+0000 7fe2b8020640 1 -- 172.21.15.194:0/915321046 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fa267f480 con 0x557fa267f060 2024-09-13T06:10:17.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.863+0000 7fe2b8020640 1 --2- 172.21.15.194:0/915321046 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557fa267f060 0x557fa267d6e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fe2a80bf480 tx=0x7fe2a80d7260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:17.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.863+0000 7fe19dffb640 1 -- 172.21.15.194:0/915321046 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2a80e51d0 con 0x557fa267f060 2024-09-13T06:10:17.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.863+0000 7fe2ba510980 1 -- 172.21.15.194:0/915321046 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557fa267dc80 con 0x557fa267f060 2024-09-13T06:10:17.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.863+0000 7fe19dffb640 1 -- 172.21.15.194:0/915321046 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2a80e2020 con 0x557fa267f060 2024-09-13T06:10:17.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.863+0000 7fe19dffb640 1 -- 172.21.15.194:0/915321046 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2a80bfa50 con 0x557fa267f060 2024-09-13T06:10:17.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.863+0000 7fe2ba510980 1 -- 172.21.15.194:0/915321046 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557fa267e150 con 0x557fa267f060 2024-09-13T06:10:17.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.863+0000 7fe19dffb640 1 -- 172.21.15.194:0/915321046 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe2a80bfbf0 con 0x557fa267f060 2024-09-13T06:10:17.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.863+0000 7fe19dffb640 1 --2- 172.21.15.194:0/915321046 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fe190034650 0x7fe190036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:17.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.863+0000 7fe19dffb640 1 -- 172.21.15.194:0/915321046 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fe2a80de070 con 0x557fa267f060 2024-09-13T06:10:17.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.863+0000 7fe2b781f640 1 --2- 172.21.15.194:0/915321046 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fe190034650 0x7fe190036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:17.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.863+0000 7fe2ba510980 1 Processor -- start 2024-09-13T06:10:17.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.863+0000 7fe2ba510980 1 -- start start 2024-09-13T06:10:17.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.863+0000 7fe2ba510980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557fa26ab380 0x557fa26ab760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:17.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.863+0000 7fe2ba510980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x557fa2676fe0 con 0x557fa26ab380 2024-09-13T06:10:17.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.863+0000 7fe2b781f640 1 --2- 172.21.15.194:0/915321046 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fe190034650 0x7fe190036b10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x557fa268f1a0 tx=0x7fe2a0006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:17.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.867+0000 7fe2b8020640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557fa26ab380 0x557fa26ab760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:17.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.867+0000 7fe2b8020640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557fa26ab380 0x557fa26ab760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:50496/0 (socket says 172.21.15.194:50496) 2024-09-13T06:10:17.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.867+0000 7fe2b8020640 1 -- 172.21.15.194:0/2783676377 learned_addr learned my addr 172.21.15.194:0/2783676377 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:17.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.867+0000 7fe2b8020640 1 -- 172.21.15.194:0/2783676377 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fa26abd30 con 0x557fa26ab380 2024-09-13T06:10:17.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.867+0000 7fe2b8020640 1 --2- 172.21.15.194:0/2783676377 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557fa26ab380 0x557fa26ab760 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fe2a80b4710 tx=0x7fe2a80d7d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=556a9742bc386095 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:17.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.867+0000 7fe1977fe640 1 -- 172.21.15.194:0/2783676377 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2a80fc070 con 0x557fa26ab380 2024-09-13T06:10:17.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.867+0000 7fe1977fe640 1 -- 172.21.15.194:0/2783676377 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2a80c1c90 con 0x557fa26ab380 2024-09-13T06:10:17.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.867+0000 7fe1977fe640 1 -- 172.21.15.194:0/2783676377 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2a80dfdc0 con 0x557fa26ab380 2024-09-13T06:10:17.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.867+0000 7fe2ba510980 1 -- 172.21.15.194:0/2783676377 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557fa26ab380 msgr2=0x557fa26ab760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:17.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.867+0000 7fe2ba510980 1 --2- 172.21.15.194:0/2783676377 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557fa26ab380 0x557fa26ab760 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fe2a80b4710 tx=0x7fe2a80d7d90 comp rx=0 tx=0).stop 2024-09-13T06:10:17.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.867+0000 7fe2ba510980 1 -- 172.21.15.194:0/2783676377 shutdown_connections 2024-09-13T06:10:17.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.867+0000 7fe2ba510980 1 --2- 172.21.15.194:0/2783676377 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557fa26ab380 0x557fa26ab760 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:17.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.867+0000 7fe2ba510980 1 -- 172.21.15.194:0/2783676377 >> 172.21.15.194:0/2783676377 conn(0x557fa26a7760 msgr2=0x557fa26a5860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:17.870 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.867+0000 7fe2ba510980 1 -- 172.21.15.194:0/2783676377 shutdown_connections 2024-09-13T06:10:17.870 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.867+0000 7fe2ba510980 1 -- 172.21.15.194:0/2783676377 wait complete. 2024-09-13T06:10:17.870 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.867+0000 7fe2ba510980 1 Processor -- start 2024-09-13T06:10:17.870 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.867+0000 7fe2ba510980 1 -- start start 2024-09-13T06:10:17.870 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.867+0000 7fe2ba510980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557fa26ab380 0x557fa26b2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:17.870 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.867+0000 7fe2ba510980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x557fa26ac1d0 con 0x557fa26ab380 2024-09-13T06:10:17.870 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.867+0000 7fe2b8020640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557fa26ab380 0x557fa26b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:17.870 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.867+0000 7fe2b8020640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557fa26ab380 0x557fa26b2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:50498/0 (socket says 172.21.15.194:50498) 2024-09-13T06:10:17.870 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.867+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 learned_addr learned my addr 172.21.15.194:0/2997260001 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:17.870 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.867+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fa26b2aa0 con 0x557fa26ab380 2024-09-13T06:10:17.872 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.867+0000 7fe2b8020640 1 --2- 172.21.15.194:0/2997260001 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557fa26ab380 0x557fa26b2560 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fe2a80c8800 tx=0x7fe2a80d7f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:17.872 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.867+0000 7fe195ffb640 1 -- 172.21.15.194:0/2997260001 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2a80fc040 con 0x557fa26ab380 2024-09-13T06:10:17.872 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.871+0000 7fe195ffb640 1 -- 172.21.15.194:0/2997260001 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2a80e3e60 con 0x557fa26ab380 2024-09-13T06:10:17.872 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.871+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557fa26b2aa0 con 0x557fa26ab380 2024-09-13T06:10:17.872 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.871+0000 7fe195ffb640 1 -- 172.21.15.194:0/2997260001 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2a80e5860 con 0x557fa26ab380 2024-09-13T06:10:17.872 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.871+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557fa26b2aa0 con 0x557fa26ab380 2024-09-13T06:10:17.872 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.871+0000 7fe195ffb640 1 -- 172.21.15.194:0/2997260001 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe2a8109020 con 0x557fa26ab380 2024-09-13T06:10:17.872 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.871+0000 7fe195ffb640 1 --2- 172.21.15.194:0/2997260001 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fe188034600 0x7fe188036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:17.873 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.871+0000 7fe195ffb640 1 -- 172.21.15.194:0/2997260001 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fe2a80f11c0 con 0x557fa26ab380 2024-09-13T06:10:17.873 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.871+0000 7fe2b781f640 1 --2- 172.21.15.194:0/2997260001 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fe188034600 0x7fe188036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:17.873 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.871+0000 7fe2ba510980 20 rados->read ofs=0 len=0 2024-09-13T06:10:17.873 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.871+0000 7fe2ba510980 1 --2- 172.21.15.194:0/2997260001 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x557fa26bd610 0x557fa26bfad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:17.873 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.871+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26c0220 con 0x557fa26bd610 2024-09-13T06:10:17.873 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.871+0000 7fe2b8821640 1 --2- 172.21.15.194:0/2997260001 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x557fa26bd610 0x557fa26bfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:17.873 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.871+0000 7fe2b781f640 1 --2- 172.21.15.194:0/2997260001 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fe188034600 0x7fe188036ac0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe2a000ba80 tx=0x7fe2a0023040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:17.876 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.871+0000 7fe2b8821640 1 --2- 172.21.15.194:0/2997260001 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x557fa26bd610 0x557fa26bfad0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:17.876 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.871+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe2b00083f0 con 0x557fa26bd610 2024-09-13T06:10:17.876 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.871+0000 7fe2ba510980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:17.876 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.871+0000 7fe2ba510980 20 realm 2024-09-13T06:10:17.877 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.871+0000 7fe2ba510980 20 rados->read ofs=0 len=0 2024-09-13T06:10:17.877 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.871+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26c0630 con 0x557fa26bd610 2024-09-13T06:10:17.877 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.871+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe2b00083f0 con 0x557fa26bd610 2024-09-13T06:10:17.877 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.871+0000 7fe2ba510980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:17.877 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.871+0000 7fe2ba510980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:10:17.877 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.871+0000 7fe2ba510980 20 rados->read ofs=0 len=0 2024-09-13T06:10:17.877 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.871+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26c0f00 con 0x557fa26bd610 2024-09-13T06:10:17.877 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.871+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe2b00083f0 con 0x557fa26bd610 2024-09-13T06:10:17.877 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.871+0000 7fe2ba510980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:17.877 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.871+0000 7fe2ba510980 20 rados->read ofs=0 len=0 2024-09-13T06:10:17.877 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.871+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26c12a0 con 0x557fa26bd610 2024-09-13T06:10:17.877 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.871+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe2b00083f0 con 0x557fa26bd610 2024-09-13T06:10:17.878 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.871+0000 7fe2ba510980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:10:17.878 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.871+0000 7fe2ba510980 20 rados->read ofs=0 len=0 2024-09-13T06:10:17.878 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.871+0000 7fe2ba510980 1 --2- 172.21.15.194:0/2997260001 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x557fa26c2000 0x557fa26c43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:17.878 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.871+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26c4a00 con 0x557fa26c2000 2024-09-13T06:10:17.878 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.871+0000 7fe2b8020640 1 --2- 172.21.15.194:0/2997260001 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x557fa26c2000 0x557fa26c43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:17.878 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.875+0000 7fe2b8020640 1 --2- 172.21.15.194:0/2997260001 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x557fa26c2000 0x557fa26c43f0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:17.878 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.875+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:17.878 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.875+0000 7fe2ba510980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:10:17.878 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.875+0000 7fe2ba510980 20 searching for the correct realm 2024-09-13T06:10:17.878 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.875+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557fa26c62d0 con 0x557fa26c2000 2024-09-13T06:10:17.878 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.875+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:17.878 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.875+0000 7fe2b8020640 1 --2- 172.21.15.194:0/2997260001 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fe2a80cb730 0x7fe2a80ab5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:17.878 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.875+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557fa26c62d0 con 0x7fe2a80cb730 2024-09-13T06:10:17.878 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.875+0000 7fe2b781f640 1 --2- 172.21.15.194:0/2997260001 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fe2a80cb730 0x7fe2a80ab5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:17.879 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.875+0000 7fe2b781f640 1 --2- 172.21.15.194:0/2997260001 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fe2a80cb730 0x7fe2a80ab5b0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:17.879 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.875+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe2a0037040 con 0x7fe2a80cb730 2024-09-13T06:10:17.879 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.875+0000 7fe2b781f640 1 --2- 172.21.15.194:0/2997260001 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fe2a001f940 0x7fe2a003a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:17.879 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.875+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557fa26c62d0 con 0x7fe2a001f940 2024-09-13T06:10:17.879 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.875+0000 7fe2b8821640 1 --2- 172.21.15.194:0/2997260001 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fe2a001f940 0x7fe2a003a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:17.881 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.875+0000 7fe2b8821640 1 --2- 172.21.15.194:0/2997260001 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fe2a001f940 0x7fe2a003a3c0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:17.881 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.875+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:17.881 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.875+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557fa26c12a0 con 0x557fa26bd610 2024-09-13T06:10:17.881 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.875+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2b00083f0 con 0x557fa26bd610 2024-09-13T06:10:17.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.875+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557fa26c12a0 con 0x557fa26bd610 2024-09-13T06:10:17.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.879+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2b00083f0 con 0x557fa26bd610 2024-09-13T06:10:17.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.879+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557fa26c12a0 con 0x7fe2a001f940 2024-09-13T06:10:17.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.879+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:17.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.879+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557fa26c12a0 con 0x7fe2a001f940 2024-09-13T06:10:17.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.879+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:17.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.879+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557fa26c12a0 con 0x7fe2a80cb730 2024-09-13T06:10:17.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.879+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2a0037040 con 0x7fe2a80cb730 2024-09-13T06:10:17.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.879+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557fa26c12a0 con 0x557fa26c2000 2024-09-13T06:10:17.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.879+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:17.883 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.879+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557fa26c12a0 con 0x557fa26bd610 2024-09-13T06:10:17.883 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.879+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2b00083f0 con 0x557fa26bd610 2024-09-13T06:10:17.883 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.879+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557fa26c12a0 con 0x7fe2a001f940 2024-09-13T06:10:17.883 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.879+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:17.883 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.879+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557fa26c12a0 con 0x557fa26bd610 2024-09-13T06:10:17.883 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.879+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2b00083f0 con 0x557fa26bd610 2024-09-13T06:10:17.883 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.879+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557fa26c12a0 con 0x7fe2a80cb730 2024-09-13T06:10:17.883 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.879+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe2a0037040 con 0x7fe2a80cb730 2024-09-13T06:10:17.883 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.879+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557fa26c12a0 con 0x557fa26c2000 2024-09-13T06:10:17.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.879+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:17.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.879+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557fa26c12a0 con 0x557fa26c2000 2024-09-13T06:10:17.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.883+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:17.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.883+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fe2a8126040 con 0x7fe2a001f940 2024-09-13T06:10:17.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.883+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:17.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.883+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fe2a8126040 con 0x557fa26c2000 2024-09-13T06:10:17.887 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.883+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:17.887 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.883+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fe2a8126040 con 0x557fa26c2000 2024-09-13T06:10:17.887 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.883+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:17.887 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.883+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fe2a8126040 con 0x557fa26bd610 2024-09-13T06:10:17.887 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.883+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2b00083f0 con 0x557fa26bd610 2024-09-13T06:10:17.887 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.883+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fe2a8126040 con 0x557fa26bd610 2024-09-13T06:10:17.887 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.883+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe2b00083f0 con 0x557fa26bd610 2024-09-13T06:10:17.887 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.883+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fe2a8126040 con 0x7fe2a80cb730 2024-09-13T06:10:17.887 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.883+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2a0037040 con 0x7fe2a80cb730 2024-09-13T06:10:17.887 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.883+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fe2a8126040 con 0x557fa26c2000 2024-09-13T06:10:17.887 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.883+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:17.887 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.883+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fe2a8126040 con 0x7fe2a80cb730 2024-09-13T06:10:17.887 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.883+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2a0037040 con 0x7fe2a80cb730 2024-09-13T06:10:17.888 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.883+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fe2a8126040 con 0x557fa26bd610 2024-09-13T06:10:17.888 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.883+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2b00083f0 con 0x557fa26bd610 2024-09-13T06:10:17.888 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.883+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fe2a8126040 con 0x7fe2a001f940 2024-09-13T06:10:17.888 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.887+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:17.888 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.887+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fe2a8126040 con 0x557fa26c2000 2024-09-13T06:10:17.888 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.887+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:17.888 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.887+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fe2a8126040 con 0x7fe2a80cb730 2024-09-13T06:10:17.892 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.887+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2a0037040 con 0x7fe2a80cb730 2024-09-13T06:10:17.892 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.887+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fe2a8126040 con 0x7fe2a80cb730 2024-09-13T06:10:17.892 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.887+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2a004a040 con 0x7fe2a80cb730 2024-09-13T06:10:17.892 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.887+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fe2a8126040 con 0x557fa26c2000 2024-09-13T06:10:17.892 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.887+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:17.892 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.887+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fe2a8126040 con 0x7fe2a001f940 2024-09-13T06:10:17.893 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.887+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:17.893 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.887+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fe2a8126040 con 0x557fa26bd610 2024-09-13T06:10:17.893 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.887+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe2b00083f0 con 0x557fa26bd610 2024-09-13T06:10:17.893 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.887+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fe2a8126040 con 0x7fe2a80cb730 2024-09-13T06:10:17.893 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.887+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2a004a040 con 0x7fe2a80cb730 2024-09-13T06:10:17.893 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.887+0000 7fe2ba510980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:10:17.893 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.887+0000 7fe2ba510980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:10:17.893 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.887+0000 7fe2ba510980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:10:17.893 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.887+0000 7fe2ba510980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:10:17.893 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.887+0000 7fe2ba510980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:10:17.893 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.887+0000 7fe2ba510980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:10:17.893 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.887+0000 7fe2ba510980 20 rados->read ofs=0 len=0 2024-09-13T06:10:17.893 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.887+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26c53f0 con 0x557fa26bd610 2024-09-13T06:10:17.894 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.887+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe2b00083f0 con 0x557fa26bd610 2024-09-13T06:10:17.894 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.887+0000 7fe2ba510980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:17.894 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.887+0000 7fe2ba510980 20 rados->read ofs=0 len=0 2024-09-13T06:10:17.894 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.887+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26c5030 con 0x557fa26bd610 2024-09-13T06:10:17.894 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.887+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe2b00083f0 con 0x557fa26bd610 2024-09-13T06:10:17.894 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.887+0000 7fe2ba510980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:10:17.894 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.887+0000 7fe2ba510980 20 rados->read ofs=0 len=0 2024-09-13T06:10:17.894 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.887+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26c5d10 con 0x7fe2a80cb730 2024-09-13T06:10:17.894 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.887+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe2a004a040 con 0x7fe2a80cb730 2024-09-13T06:10:17.894 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.887+0000 7fe2ba510980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:10:17.894 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.887+0000 7fe2ba510980 20 zone default found 2024-09-13T06:10:17.894 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.887+0000 7fe2ba510980 4 Realm: () 2024-09-13T06:10:17.894 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.887+0000 7fe2ba510980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:10:17.895 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.887+0000 7fe2ba510980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:10:17.895 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.887+0000 7fe2ba510980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:10:17.895 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.887+0000 7fe2ba510980 20 zonegroup default 2024-09-13T06:10:17.895 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.887+0000 7fe2ba510980 20 rados->read ofs=0 len=0 2024-09-13T06:10:17.895 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.887+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26c6700 con 0x7fe2a001f940 2024-09-13T06:10:17.895 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.891+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:17.895 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.891+0000 7fe2ba510980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:17.895 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.891+0000 7fe2ba510980 20 rados->read ofs=0 len=0 2024-09-13T06:10:17.895 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.891+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26c8110 con 0x557fa26c2000 2024-09-13T06:10:17.895 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.891+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:17.895 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.891+0000 7fe2ba510980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:17.895 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.891+0000 7fe2ba510980 20 rados->read ofs=0 len=0 2024-09-13T06:10:17.895 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.891+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26c85e0 con 0x557fa26c2000 2024-09-13T06:10:17.896 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.891+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:17.896 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.891+0000 7fe2ba510980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:17.896 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.891+0000 7fe2ba510980 20 started sync module instance, tier type = 2024-09-13T06:10:17.896 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.891+0000 7fe2ba510980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:10:17.896 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.891+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26c61e0 con 0x7fe2a80cb730 2024-09-13T06:10:17.897 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.891+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(44 notify.0 [create] v35'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2a004a040 con 0x7fe2a80cb730 2024-09-13T06:10:17.897 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.891+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94006674224688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26c8a40 con 0x7fe2a80cb730 2024-09-13T06:10:17.897 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.891+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26c9490 con 0x557fa26bd610 2024-09-13T06:10:17.898 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.891+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94006674224688] v35'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2a004a040 con 0x7fe2a80cb730 2024-09-13T06:10:17.898 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.895+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v35'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2b00083f0 con 0x557fa26bd610 2024-09-13T06:10:17.898 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.895+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94006674231168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26c9880 con 0x557fa26bd610 2024-09-13T06:10:17.898 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.895+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26ca240 con 0x557fa26c2000 2024-09-13T06:10:17.898 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.895+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94006674231168] v35'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2b00083f0 con 0x557fa26bd610 2024-09-13T06:10:17.898 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.895+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v35'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:17.898 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.895+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94006674225808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26ca240 con 0x557fa26c2000 2024-09-13T06:10:17.898 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.895+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26cac50 con 0x7fe2a80cb730 2024-09-13T06:10:17.899 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.899+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(50 notify.3 [create] v35'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2a004a040 con 0x7fe2a80cb730 2024-09-13T06:10:17.899 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.899+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94006674237344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26cb4a0 con 0x7fe2a80cb730 2024-09-13T06:10:17.899 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.899+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26cbec0 con 0x557fa26bd610 2024-09-13T06:10:17.899 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.899+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94006674225808] v35'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:17.901 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.899+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v35'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2b00083f0 con 0x557fa26bd610 2024-09-13T06:10:17.901 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.899+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94006674241968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26cc2b0 con 0x557fa26bd610 2024-09-13T06:10:17.901 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.899+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26ccc70 con 0x7fe2a001f940 2024-09-13T06:10:17.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.903+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94006674237344] v35'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2a004a040 con 0x7fe2a80cb730 2024-09-13T06:10:17.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.903+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94006674241968] v35'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2b00083f0 con 0x557fa26bd610 2024-09-13T06:10:17.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.903+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(54 notify.5 [create] v35'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:17.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.903+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94006674234768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26cc7c0 con 0x7fe2a001f940 2024-09-13T06:10:17.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.903+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26cd010 con 0x7fe2a001f940 2024-09-13T06:10:17.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.903+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94006674234768] v35'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:17.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.903+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(56 notify.6 [create] v35'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:17.906 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.903+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94006674245568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26cd090 con 0x7fe2a001f940 2024-09-13T06:10:17.906 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.903+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26cda50 con 0x7fe2a001f940 2024-09-13T06:10:17.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.907+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94006674245568] v35'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:17.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.907+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(58 notify.7 [create] v35'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:17.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.907+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94006674246896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26cda50 con 0x7fe2a001f940 2024-09-13T06:10:17.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.907+0000 7fe2ba510980 20 add_watcher() i=0 2024-09-13T06:10:17.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.907+0000 7fe2ba510980 20 add_watcher() i=1 2024-09-13T06:10:17.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.907+0000 7fe2ba510980 20 add_watcher() i=2 2024-09-13T06:10:17.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.907+0000 7fe2ba510980 20 add_watcher() i=3 2024-09-13T06:10:17.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.907+0000 7fe2ba510980 20 add_watcher() i=4 2024-09-13T06:10:17.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.907+0000 7fe2ba510980 20 add_watcher() i=5 2024-09-13T06:10:17.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.907+0000 7fe2ba510980 20 add_watcher() i=6 2024-09-13T06:10:17.910 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.907+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94006674246896] v35'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:17.910 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.907+0000 7fe2ba510980 20 add_watcher() i=7 2024-09-13T06:10:17.910 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.907+0000 7fe2ba510980 2 all 8 watchers are set, enabling cache 2024-09-13T06:10:17.910 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.907+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26d0d80 con 0x557fa26bd610 2024-09-13T06:10:17.910 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.911+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe2b00083f0 con 0x557fa26bd610 2024-09-13T06:10:17.910 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.911+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94006674261936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26cdbc0 con 0x557fa26bd610 2024-09-13T06:10:17.911 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.911+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94006674261936] v35'157 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe2b00083f0 con 0x557fa26bd610 2024-09-13T06:10:17.911 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.911+0000 7fe16efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:10:17.912 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.911+0000 7fe2ba510980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:10:17.912 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.911+0000 7fe2ba510980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:10:17.912 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.911+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26d00b0 con 0x557fa26bd610 2024-09-13T06:10:17.914 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.911+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v35'26 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe2b00083f0 con 0x557fa26bd610 2024-09-13T06:10:17.914 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.911+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26d9e40 con 0x7fe2a001f940 2024-09-13T06:10:17.916 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.915+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v35'19 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:17.916 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.915+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26d9e40 con 0x557fa26c2000 2024-09-13T06:10:17.917 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.915+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v35'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:17.917 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.915+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26da2f0 con 0x557fa26bd610 2024-09-13T06:10:17.918 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.919+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v35'158 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe2b00083f0 con 0x557fa26bd610 2024-09-13T06:10:17.918 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.919+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26da860 con 0x7fe2a80cb730 2024-09-13T06:10:17.919 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.919+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v35'47 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe2a004a040 con 0x7fe2a80cb730 2024-09-13T06:10:17.920 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.919+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26dac20 con 0x557fa26c2000 2024-09-13T06:10:17.921 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.919+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v35'32 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:17.921 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.919+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26dacb0 con 0x557fa26bd610 2024-09-13T06:10:17.923 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.923+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v35'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe2b00083f0 con 0x557fa26bd610 2024-09-13T06:10:17.923 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.923+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26dad40 con 0x7fe2a001f940 2024-09-13T06:10:17.925 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.923+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v35'31 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:17.925 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.923+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26dad40 con 0x7fe2a80cb730 2024-09-13T06:10:17.927 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.927+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v35'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe2a004a040 con 0x7fe2a80cb730 2024-09-13T06:10:17.927 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.927+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26db390 con 0x557fa26c2000 2024-09-13T06:10:17.928 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.927+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v35'25 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:17.928 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.927+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26db390 con 0x7fe2a80cb730 2024-09-13T06:10:17.929 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.927+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 <== osd.2 v2:172.21.15.194:6800/815615585 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v35'48 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2a004a040 con 0x7fe2a80cb730 2024-09-13T06:10:17.929 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.927+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26db840 con 0x7fe2a001f940 2024-09-13T06:10:17.932 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.931+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v35'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:17.932 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.931+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26db840 con 0x7fe2a80cb730 2024-09-13T06:10:17.933 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.931+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 <== osd.2 v2:172.21.15.194:6800/815615585 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v35'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2a004a040 con 0x7fe2a80cb730 2024-09-13T06:10:17.934 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.931+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26db8d0 con 0x7fe2a001f940 2024-09-13T06:10:17.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.935+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v35'37 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:17.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.935+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26db8d0 con 0x557fa26bd610 2024-09-13T06:10:17.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.935+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v35'159 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2b00083f0 con 0x557fa26bd610 2024-09-13T06:10:17.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.935+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26db8d0 con 0x557fa26c2000 2024-09-13T06:10:17.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.939+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v35'41 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:17.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.939+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26db960 con 0x7fe2a80cb730 2024-09-13T06:10:17.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.939+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 <== osd.2 v2:172.21.15.194:6800/815615585 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v35'49 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2a004a040 con 0x7fe2a80cb730 2024-09-13T06:10:17.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.939+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26db9f0 con 0x557fa26c2000 2024-09-13T06:10:17.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.943+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v35'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:17.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.943+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26db9f0 con 0x557fa26bd610 2024-09-13T06:10:17.945 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.943+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.1 v2:172.21.15.194:6808/3135444559 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v35'27 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2b00083f0 con 0x557fa26bd610 2024-09-13T06:10:17.945 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.943+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26db9f0 con 0x557fa26bd610 2024-09-13T06:10:17.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.947+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.1 v2:172.21.15.194:6808/3135444559 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v35'160 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2b00083f0 con 0x557fa26bd610 2024-09-13T06:10:17.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.947+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26db9f0 con 0x557fa26c2000 2024-09-13T06:10:17.949 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.947+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v35'42 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:17.949 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.947+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26db9f0 con 0x7fe2a80cb730 2024-09-13T06:10:17.950 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.951+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 <== osd.2 v2:172.21.15.194:6800/815615585 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v35'29 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2a004a040 con 0x7fe2a80cb730 2024-09-13T06:10:17.950 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.951+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26dba80 con 0x557fa26c2000 2024-09-13T06:10:17.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.951+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v35'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:17.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.951+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26dba80 con 0x557fa26c2000 2024-09-13T06:10:17.953 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.951+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v35'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:17.953 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.951+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26dba80 con 0x557fa26c2000 2024-09-13T06:10:17.955 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.955+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v35'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:17.955 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.955+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26db420 con 0x557fa26c2000 2024-09-13T06:10:17.956 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.955+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v35'33 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:17.956 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.955+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26db420 con 0x7fe2a001f940 2024-09-13T06:10:17.958 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.959+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v35'22 uv20 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:17.959 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.959+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26db420 con 0x557fa26c2000 2024-09-13T06:10:17.960 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.959+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v35'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:17.960 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.959+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26db420 con 0x7fe2a001f940 2024-09-13T06:10:17.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.963+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v35'32 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:17.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.963+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26dbf40 con 0x557fa26c2000 2024-09-13T06:10:17.965 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.963+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v35'43 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:17.965 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.963+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26dbee0 con 0x7fe2a001f940 2024-09-13T06:10:17.968 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.967+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v35'38 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:17.968 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.967+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26db420 con 0x7fe2a80cb730 2024-09-13T06:10:17.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.971+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 <== osd.2 v2:172.21.15.194:6800/815615585 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v35'26 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2a004a040 con 0x7fe2a80cb730 2024-09-13T06:10:17.971 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.971+0000 7fe16dfe3640 20 reqs_thread_entry: start 2024-09-13T06:10:17.971 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.971+0000 7fe2ba510980 20 init_complete bucket index max shards: 11 2024-09-13T06:10:17.971 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.971+0000 7fe2ba510980 20 Filter name: none 2024-09-13T06:10:17.971 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.971+0000 7fe166ffd640 20 reqs_thread_entry: start 2024-09-13T06:10:17.971 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.971+0000 7fe2ba510980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=1 2024-09-13T06:10:17.971 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.971+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:94 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f7ff0 con 0x7fe2a80cb730 2024-09-13T06:10:17.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.971+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 <== osd.2 v2:172.21.15.194:6800/815615585 21 ==== osd_op_reply(94 gc.16 [call] v35'50 uv50 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe2a004a040 con 0x7fe2a80cb730 2024-09-13T06:10:17.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.971+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:95 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f7ff0 con 0x7fe2a80cb730 2024-09-13T06:10:17.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.971+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 <== osd.2 v2:172.21.15.194:6800/815615585 22 ==== osd_op_reply(95 gc.16 [call out=15b] v0'0 uv50 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2a004a040 con 0x7fe2a80cb730 2024-09-13T06:10:17.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.971+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:10:17.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.971+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:96 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f6fe0 con 0x7fe2a80cb730 2024-09-13T06:10:17.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.971+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 <== osd.2 v2:172.21.15.194:6800/815615585 23 ==== osd_op_reply(96 gc.16 [call out=24b] v0'0 uv50 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe2a004a040 con 0x7fe2a80cb730 2024-09-13T06:10:17.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.971+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:97 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f7ff0 con 0x7fe2a80cb730 2024-09-13T06:10:17.975 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.971+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 <== osd.2 v2:172.21.15.194:6800/815615585 24 ==== osd_op_reply(97 gc.16 [call out=15b] v0'0 uv50 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2a004a040 con 0x7fe2a80cb730 2024-09-13T06:10:17.975 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.975+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:10:17.975 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.975+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:98 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f7ff0 con 0x7fe2a80cb730 2024-09-13T06:10:17.975 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.975+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 <== osd.2 v2:172.21.15.194:6800/815615585 25 ==== osd_op_reply(98 gc.16 [call out=15b] v0'0 uv50 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2a004a040 con 0x7fe2a80cb730 2024-09-13T06:10:17.975 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.975+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:10:17.975 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.975+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:99 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f7ff0 con 0x7fe2a80cb730 2024-09-13T06:10:17.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.975+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 <== osd.2 v2:172.21.15.194:6800/815615585 26 ==== osd_op_reply(99 gc.16 [call] v35'51 uv51 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe2a004a040 con 0x7fe2a80cb730 2024-09-13T06:10:17.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.975+0000 7fe2ba510980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=1 2024-09-13T06:10:17.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.975+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:100 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f7ff0 con 0x557fa26c2000 2024-09-13T06:10:17.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.975+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 27 ==== osd_op_reply(100 gc.17 [call] v35'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:17.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.975+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:101 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f7ff0 con 0x557fa26c2000 2024-09-13T06:10:17.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.975+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 28 ==== osd_op_reply(101 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:17.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.975+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:10:17.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.975+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:102 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f6fe0 con 0x557fa26c2000 2024-09-13T06:10:17.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.975+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 29 ==== osd_op_reply(102 gc.17 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:17.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.975+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:103 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f7ff0 con 0x557fa26c2000 2024-09-13T06:10:17.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.979+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 30 ==== osd_op_reply(103 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:17.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.979+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:10:17.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.979+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:104 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f7ff0 con 0x557fa26c2000 2024-09-13T06:10:17.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.979+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 31 ==== osd_op_reply(104 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:17.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.979+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:10:17.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.979+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:105 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f7ff0 con 0x557fa26c2000 2024-09-13T06:10:17.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.979+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 32 ==== osd_op_reply(105 gc.17 [call] v35'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:17.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.979+0000 7fe2ba510980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=1 2024-09-13T06:10:17.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.979+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:106 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f7ff0 con 0x557fa26bd610 2024-09-13T06:10:17.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.983+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.1 v2:172.21.15.194:6808/3135444559 27 ==== osd_op_reply(106 gc.18 [call] v35'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe2b00083f0 con 0x557fa26bd610 2024-09-13T06:10:17.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.983+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:107 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f7ff0 con 0x557fa26bd610 2024-09-13T06:10:17.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.983+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.1 v2:172.21.15.194:6808/3135444559 28 ==== osd_op_reply(107 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2b00083f0 con 0x557fa26bd610 2024-09-13T06:10:17.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.983+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:10:17.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.983+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:108 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f6fe0 con 0x557fa26bd610 2024-09-13T06:10:17.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.983+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.1 v2:172.21.15.194:6808/3135444559 29 ==== osd_op_reply(108 gc.18 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe2b00083f0 con 0x557fa26bd610 2024-09-13T06:10:17.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.983+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:109 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f7ff0 con 0x557fa26bd610 2024-09-13T06:10:17.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.983+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.1 v2:172.21.15.194:6808/3135444559 30 ==== osd_op_reply(109 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2b00083f0 con 0x557fa26bd610 2024-09-13T06:10:17.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.983+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:10:17.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.983+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:110 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f7ff0 con 0x557fa26bd610 2024-09-13T06:10:17.985 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.983+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.1 v2:172.21.15.194:6808/3135444559 31 ==== osd_op_reply(110 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2b00083f0 con 0x557fa26bd610 2024-09-13T06:10:17.985 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.983+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:10:17.985 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.983+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:111 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f7ff0 con 0x557fa26bd610 2024-09-13T06:10:17.986 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.987+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.1 v2:172.21.15.194:6808/3135444559 32 ==== osd_op_reply(111 gc.18 [call] v35'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe2b00083f0 con 0x557fa26bd610 2024-09-13T06:10:17.986 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.987+0000 7fe2ba510980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=1 2024-09-13T06:10:17.986 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.987+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:112 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f7ff0 con 0x557fa26bd610 2024-09-13T06:10:17.988 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.987+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.1 v2:172.21.15.194:6808/3135444559 33 ==== osd_op_reply(112 gc.19 [call] v35'161 uv161 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe2b00083f0 con 0x557fa26bd610 2024-09-13T06:10:17.988 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.987+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:113 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f7ff0 con 0x557fa26bd610 2024-09-13T06:10:17.988 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.987+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.1 v2:172.21.15.194:6808/3135444559 34 ==== osd_op_reply(113 gc.19 [call out=15b] v0'0 uv161 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2b00083f0 con 0x557fa26bd610 2024-09-13T06:10:17.988 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.987+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:10:17.988 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.987+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:114 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f6fe0 con 0x557fa26bd610 2024-09-13T06:10:17.989 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.987+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.1 v2:172.21.15.194:6808/3135444559 35 ==== osd_op_reply(114 gc.19 [call out=24b] v0'0 uv161 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe2b00083f0 con 0x557fa26bd610 2024-09-13T06:10:17.989 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.987+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:115 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f7ff0 con 0x557fa26bd610 2024-09-13T06:10:17.990 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.987+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.1 v2:172.21.15.194:6808/3135444559 36 ==== osd_op_reply(115 gc.19 [call out=15b] v0'0 uv161 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2b00083f0 con 0x557fa26bd610 2024-09-13T06:10:17.990 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.987+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:10:17.990 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.987+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:116 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f7ff0 con 0x557fa26bd610 2024-09-13T06:10:17.990 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.987+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.1 v2:172.21.15.194:6808/3135444559 37 ==== osd_op_reply(116 gc.19 [call out=15b] v0'0 uv161 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2b00083f0 con 0x557fa26bd610 2024-09-13T06:10:17.990 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.987+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:10:17.990 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.987+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:117 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f7ff0 con 0x557fa26bd610 2024-09-13T06:10:17.990 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.991+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.1 v2:172.21.15.194:6808/3135444559 38 ==== osd_op_reply(117 gc.19 [call] v35'162 uv162 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe2b00083f0 con 0x557fa26bd610 2024-09-13T06:10:17.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.991+0000 7fe2ba510980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=1 2024-09-13T06:10:17.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.991+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:118 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f7ff0 con 0x557fa26c2000 2024-09-13T06:10:17.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.991+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 33 ==== osd_op_reply(118 gc.20 [call] v35'44 uv44 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:17.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.991+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:119 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f7ff0 con 0x557fa26c2000 2024-09-13T06:10:17.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.991+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 34 ==== osd_op_reply(119 gc.20 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:17.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.991+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:10:17.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.991+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:120 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f6fe0 con 0x557fa26c2000 2024-09-13T06:10:17.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.995+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 35 ==== osd_op_reply(120 gc.20 [call out=24b] v0'0 uv44 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:17.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.995+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:121 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f7ff0 con 0x557fa26c2000 2024-09-13T06:10:17.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.995+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 36 ==== osd_op_reply(121 gc.20 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:17.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.995+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:10:17.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.995+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:122 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f7ff0 con 0x557fa26c2000 2024-09-13T06:10:17.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.995+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 37 ==== osd_op_reply(122 gc.20 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:17.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.995+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:10:17.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.995+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:123 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f7ff0 con 0x557fa26c2000 2024-09-13T06:10:17.997 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.995+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 38 ==== osd_op_reply(123 gc.20 [call] v35'45 uv45 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:17.997 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.995+0000 7fe2ba510980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=1 2024-09-13T06:10:17.997 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.995+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:124 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f7ff0 con 0x7fe2a80cb730 2024-09-13T06:10:17.998 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.999+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 <== osd.2 v2:172.21.15.194:6800/815615585 27 ==== osd_op_reply(124 gc.21 [call] v35'30 uv30 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe2a004a040 con 0x7fe2a80cb730 2024-09-13T06:10:17.999 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.999+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:125 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f7ff0 con 0x7fe2a80cb730 2024-09-13T06:10:17.999 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.999+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 <== osd.2 v2:172.21.15.194:6800/815615585 28 ==== osd_op_reply(125 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2a004a040 con 0x7fe2a80cb730 2024-09-13T06:10:17.999 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.999+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:10:17.999 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.999+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:126 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f6fe0 con 0x7fe2a80cb730 2024-09-13T06:10:18.000 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.999+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 <== osd.2 v2:172.21.15.194:6800/815615585 29 ==== osd_op_reply(126 gc.21 [call out=24b] v0'0 uv30 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe2a004a040 con 0x7fe2a80cb730 2024-09-13T06:10:18.000 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.999+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:127 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f7ff0 con 0x7fe2a80cb730 2024-09-13T06:10:18.000 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.999+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 <== osd.2 v2:172.21.15.194:6800/815615585 30 ==== osd_op_reply(127 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2a004a040 con 0x7fe2a80cb730 2024-09-13T06:10:18.001 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.999+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:10:18.001 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.999+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:128 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f7ff0 con 0x7fe2a80cb730 2024-09-13T06:10:18.001 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.999+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 <== osd.2 v2:172.21.15.194:6800/815615585 31 ==== osd_op_reply(128 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2a004a040 con 0x7fe2a80cb730 2024-09-13T06:10:18.001 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.999+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:10:18.001 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:17.999+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:129 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f7ff0 con 0x7fe2a80cb730 2024-09-13T06:10:18.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.003+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 <== osd.2 v2:172.21.15.194:6800/815615585 32 ==== osd_op_reply(129 gc.21 [call] v35'31 uv31 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe2a004a040 con 0x7fe2a80cb730 2024-09-13T06:10:18.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.003+0000 7fe2ba510980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=1 2024-09-13T06:10:18.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.003+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:130 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f7ff0 con 0x557fa26c2000 2024-09-13T06:10:18.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.003+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 39 ==== osd_op_reply(130 gc.22 [call] v35'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:18.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.003+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:131 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f7ff0 con 0x557fa26c2000 2024-09-13T06:10:18.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.003+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 40 ==== osd_op_reply(131 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:18.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.003+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:10:18.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.003+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:132 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f6fe0 con 0x557fa26c2000 2024-09-13T06:10:18.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.003+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 41 ==== osd_op_reply(132 gc.22 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:18.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.003+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:133 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f7ff0 con 0x557fa26c2000 2024-09-13T06:10:18.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.003+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 42 ==== osd_op_reply(133 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:18.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.003+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:10:18.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.003+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:134 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f7ff0 con 0x557fa26c2000 2024-09-13T06:10:18.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.007+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 43 ==== osd_op_reply(134 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:18.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.007+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:10:18.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.007+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:135 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f7ff0 con 0x557fa26c2000 2024-09-13T06:10:18.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.007+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 44 ==== osd_op_reply(135 gc.22 [call] v35'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:18.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.007+0000 7fe2ba510980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=1 2024-09-13T06:10:18.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.007+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:136 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f7ff0 con 0x557fa26c2000 2024-09-13T06:10:18.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.011+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 45 ==== osd_op_reply(136 gc.23 [call] v35'26 uv26 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:18.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.011+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:137 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f7ff0 con 0x557fa26c2000 2024-09-13T06:10:18.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.011+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 46 ==== osd_op_reply(137 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:18.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.011+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:10:18.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.011+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:138 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f6fe0 con 0x557fa26c2000 2024-09-13T06:10:18.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.011+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 47 ==== osd_op_reply(138 gc.23 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:18.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.011+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:139 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f7ff0 con 0x557fa26c2000 2024-09-13T06:10:18.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.011+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 48 ==== osd_op_reply(139 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:18.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.011+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:10:18.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.011+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:140 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f7ff0 con 0x557fa26c2000 2024-09-13T06:10:18.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.011+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 49 ==== osd_op_reply(140 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:18.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.011+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:10:18.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.011+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:141 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f7ff0 con 0x557fa26c2000 2024-09-13T06:10:18.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.011+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 50 ==== osd_op_reply(141 gc.23 [call] v35'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:18.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.011+0000 7fe2ba510980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=1 2024-09-13T06:10:18.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.011+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:142 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f7ff0 con 0x557fa26c2000 2024-09-13T06:10:18.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.015+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 51 ==== osd_op_reply(142 gc.24 [call] v35'16 uv16 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:18.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.015+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:143 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f7ff0 con 0x557fa26c2000 2024-09-13T06:10:18.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.015+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 52 ==== osd_op_reply(143 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:18.017 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.015+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:10:18.017 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.015+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:144 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f6fe0 con 0x557fa26c2000 2024-09-13T06:10:18.017 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.015+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 53 ==== osd_op_reply(144 gc.24 [call out=24b] v0'0 uv16 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:18.017 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.015+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:145 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f7ff0 con 0x557fa26c2000 2024-09-13T06:10:18.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.015+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 54 ==== osd_op_reply(145 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:18.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.015+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:10:18.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.015+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:146 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f7ff0 con 0x557fa26c2000 2024-09-13T06:10:18.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.019+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 55 ==== osd_op_reply(146 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:18.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.019+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:10:18.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.019+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:147 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f7ff0 con 0x557fa26c2000 2024-09-13T06:10:18.021 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.019+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 56 ==== osd_op_reply(147 gc.24 [call] v35'17 uv17 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:18.021 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.019+0000 7fe2ba510980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=1 2024-09-13T06:10:18.021 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.019+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:148 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f7ff0 con 0x557fa26c2000 2024-09-13T06:10:18.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.023+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 57 ==== osd_op_reply(148 gc.25 [call] v35'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:18.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.023+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:149 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f7ff0 con 0x557fa26c2000 2024-09-13T06:10:18.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.023+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 58 ==== osd_op_reply(149 gc.25 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:18.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.023+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:10:18.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.023+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:150 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f6fe0 con 0x557fa26c2000 2024-09-13T06:10:18.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.023+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 59 ==== osd_op_reply(150 gc.25 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:18.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.023+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:151 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f7ff0 con 0x557fa26c2000 2024-09-13T06:10:18.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.023+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 60 ==== osd_op_reply(151 gc.25 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:18.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.023+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:10:18.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.023+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:152 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f7ff0 con 0x557fa26c2000 2024-09-13T06:10:18.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.023+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 61 ==== osd_op_reply(152 gc.25 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:18.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.023+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:10:18.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.023+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:153 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f7ff0 con 0x557fa26c2000 2024-09-13T06:10:18.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.027+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 62 ==== osd_op_reply(153 gc.25 [call] v35'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:18.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.027+0000 7fe2ba510980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=1 2024-09-13T06:10:18.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.027+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:154 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f7ff0 con 0x7fe2a001f940 2024-09-13T06:10:18.029 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.027+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 22 ==== osd_op_reply(154 gc.26 [call] v35'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:18.029 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.027+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:155 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f7ff0 con 0x7fe2a001f940 2024-09-13T06:10:18.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.031+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 23 ==== osd_op_reply(155 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:18.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.031+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:10:18.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.031+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:156 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f6fe0 con 0x7fe2a001f940 2024-09-13T06:10:18.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.031+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 24 ==== osd_op_reply(156 gc.26 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:18.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.031+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:157 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f7ff0 con 0x7fe2a001f940 2024-09-13T06:10:18.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.031+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 25 ==== osd_op_reply(157 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:18.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.031+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:10:18.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.031+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:158 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f7ff0 con 0x7fe2a001f940 2024-09-13T06:10:18.034 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.031+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 26 ==== osd_op_reply(158 gc.26 [call out=1699b] v0'0 uv23 ondisk = 0) ==== 149+0+1699 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:18.034 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.031+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-13T06:10:18.034 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.031+0000 7fe2ba510980 20 garbage collection: RGWGC::process iterating over entry tag='52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.38910030277681561', time=2024-09-13T06:10:17.470233+0000, chain.objs.size()=7 2024-09-13T06:10:18.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.031+0000 7fe2ba510980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1__shadow_.fbqI_lYPU7fC4AOYhizaE5Gq2--rjHp_1 2024-09-13T06:10:18.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.031+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:159 3.21s0 3:86a01400:::52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1__shadow_.fbqI_lYPU7fC4AOYhizaE5Gq2--rjHp_1:head [call refcount.put in=82b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f8500 con 0x7fe2a001f940 2024-09-13T06:10:18.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.031+0000 7fe2ba510980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1__shadow_.fbqI_lYPU7fC4AOYhizaE5Gq2--rjHp_2 2024-09-13T06:10:18.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.031+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:160 3.2s0 3:42026de0:::52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1__shadow_.fbqI_lYPU7fC4AOYhizaE5Gq2--rjHp_2:head [call refcount.put in=82b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26fb0e0 con 0x557fa26c2000 2024-09-13T06:10:18.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.031+0000 7fe2ba510980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1__shadow_.fbqI_lYPU7fC4AOYhizaE5Gq2--rjHp_3 2024-09-13T06:10:18.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.031+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:161 3.35s0 3:ad5a7ddf:::52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1__shadow_.fbqI_lYPU7fC4AOYhizaE5Gq2--rjHp_3:head [call refcount.put in=82b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26fd9f0 con 0x557fa26bd610 2024-09-13T06:10:18.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.031+0000 7fe2ba510980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1__shadow_.fbqI_lYPU7fC4AOYhizaE5Gq2--rjHp_4 2024-09-13T06:10:18.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.031+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:162 3.16s0 3:6aacb334:::52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1__shadow_.fbqI_lYPU7fC4AOYhizaE5Gq2--rjHp_4:head [call refcount.put in=82b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa2700260 con 0x7fe2a80cb730 2024-09-13T06:10:18.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.031+0000 7fe2ba510980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1__shadow_.fbqI_lYPU7fC4AOYhizaE5Gq2--rjHp_5 2024-09-13T06:10:18.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.031+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:163 3.3es0 3:7d3011df:::52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1__shadow_.fbqI_lYPU7fC4AOYhizaE5Gq2--rjHp_5:head [call refcount.put in=82b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa2702ad0 con 0x7fe2a001f940 2024-09-13T06:10:18.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.031+0000 7fe2ba510980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1__shadow_.fbqI_lYPU7fC4AOYhizaE5Gq2--rjHp_6 2024-09-13T06:10:18.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.031+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:164 3.3bs0 3:df24c676:::52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1__shadow_.fbqI_lYPU7fC4AOYhizaE5Gq2--rjHp_6:head [call refcount.put in=82b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa2700260 con 0x557fa26c2000 2024-09-13T06:10:18.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.031+0000 7fe2ba510980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1__shadow_.fbqI_lYPU7fC4AOYhizaE5Gq2--rjHp_7 2024-09-13T06:10:18.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.035+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:165 3.29s0 3:96d45076:::52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1__shadow_.fbqI_lYPU7fC4AOYhizaE5Gq2--rjHp_7:head [call refcount.put in=82b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa2707800 con 0x7fe2a001f940 2024-09-13T06:10:18.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.039+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.1 v2:172.21.15.194:6808/3135444559 39 ==== osd_op_reply(161 52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1__shadow_.fbqI_lYPU7fC4AOYhizaE5Gq2--rjHp_3 [call] v35'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fe2b00083f0 con 0x557fa26bd610 2024-09-13T06:10:18.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.039+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 63 ==== osd_op_reply(160 52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1__shadow_.fbqI_lYPU7fC4AOYhizaE5Gq2--rjHp_2 [call] v35'4 uv4 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:18.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.039+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 27 ==== osd_op_reply(159 52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1__shadow_.fbqI_lYPU7fC4AOYhizaE5Gq2--rjHp_1 [call] v35'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:18.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.039+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 28 ==== osd_op_reply(163 52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1__shadow_.fbqI_lYPU7fC4AOYhizaE5Gq2--rjHp_5 [call] v35'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:18.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.039+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 29 ==== osd_op_reply(165 52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1__shadow_.fbqI_lYPU7fC4AOYhizaE5Gq2--rjHp_7 [call] v35'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:18.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.039+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 <== osd.2 v2:172.21.15.194:6800/815615585 33 ==== osd_op_reply(162 52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1__shadow_.fbqI_lYPU7fC4AOYhizaE5Gq2--rjHp_4 [call] v35'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fe2a004a040 con 0x7fe2a80cb730 2024-09-13T06:10:18.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.043+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 64 ==== osd_op_reply(164 52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.1__shadow_.fbqI_lYPU7fC4AOYhizaE5Gq2--rjHp_6 [call] v35'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:18.044 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.043+0000 7fe2ba510980 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-13T06:10:18.044 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.043+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:166 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa2707800 con 0x7fe2a001f940 2024-09-13T06:10:18.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.047+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 30 ==== osd_op_reply(166 gc.26 [call] v35'24 uv24 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:18.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.047+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:167 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa2707800 con 0x7fe2a001f940 2024-09-13T06:10:18.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.051+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 31 ==== osd_op_reply(167 gc.26 [call] v35'25 uv25 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:18.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.051+0000 7fe2ba510980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=1 2024-09-13T06:10:18.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.051+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:168 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa2707800 con 0x557fa26c2000 2024-09-13T06:10:18.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.051+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 65 ==== osd_op_reply(168 gc.27 [call] v35'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:18.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.051+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:169 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa2707800 con 0x557fa26c2000 2024-09-13T06:10:18.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.051+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 66 ==== osd_op_reply(169 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:18.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.051+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:10:18.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.051+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:170 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa2707800 con 0x557fa26c2000 2024-09-13T06:10:18.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.055+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 67 ==== osd_op_reply(170 gc.27 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:18.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.055+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:171 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa2707800 con 0x557fa26c2000 2024-09-13T06:10:18.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.055+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 68 ==== osd_op_reply(171 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:18.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.055+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:10:18.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.055+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:172 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa2707800 con 0x557fa26c2000 2024-09-13T06:10:18.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.055+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 69 ==== osd_op_reply(172 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:18.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.055+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:10:18.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.055+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:173 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa2707800 con 0x557fa26c2000 2024-09-13T06:10:18.057 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.055+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 70 ==== osd_op_reply(173 gc.27 [call] v35'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:18.057 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.055+0000 7fe2ba510980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=1 2024-09-13T06:10:18.057 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.055+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:174 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa2707800 con 0x7fe2a001f940 2024-09-13T06:10:18.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.059+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 32 ==== osd_op_reply(174 gc.28 [call] v35'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:18.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.059+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:175 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26fb4e0 con 0x7fe2a001f940 2024-09-13T06:10:18.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.059+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 33 ==== osd_op_reply(175 gc.28 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:18.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.059+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:10:18.061 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.059+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:176 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26fb4e0 con 0x7fe2a001f940 2024-09-13T06:10:18.061 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.059+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 34 ==== osd_op_reply(176 gc.28 [call out=24b] v0'0 uv33 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:18.061 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.059+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:177 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26fb4e0 con 0x7fe2a001f940 2024-09-13T06:10:18.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.063+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 35 ==== osd_op_reply(177 gc.28 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:18.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.063+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:10:18.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.063+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26fb4e0 con 0x7fe2a001f940 2024-09-13T06:10:18.063 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.063+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 36 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:18.063 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.063+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:10:18.063 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.063+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26fb4e0 con 0x7fe2a001f940 2024-09-13T06:10:18.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.063+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 37 ==== osd_op_reply(179 gc.28 [call] v35'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:18.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.063+0000 7fe2ba510980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=1 2024-09-13T06:10:18.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.063+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:180 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26fb4e0 con 0x557fa26c2000 2024-09-13T06:10:18.068 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.067+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 71 ==== osd_op_reply(180 gc.29 [call] v35'46 uv46 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:18.068 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.067+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26fb4e0 con 0x557fa26c2000 2024-09-13T06:10:18.069 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.067+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 72 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:18.069 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.067+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:10:18.069 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.067+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f6fe0 con 0x557fa26c2000 2024-09-13T06:10:18.069 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.067+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 73 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv46 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:18.070 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.067+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26fb350 con 0x557fa26c2000 2024-09-13T06:10:18.070 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.067+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 74 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:18.070 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.067+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:10:18.070 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.067+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:184 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26fb350 con 0x557fa26c2000 2024-09-13T06:10:18.070 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.067+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 75 ==== osd_op_reply(184 gc.29 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:18.070 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.067+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:10:18.070 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.067+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:185 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26fb350 con 0x557fa26c2000 2024-09-13T06:10:18.071 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.071+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 76 ==== osd_op_reply(185 gc.29 [call] v35'47 uv47 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:18.071 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.071+0000 7fe2ba510980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=1 2024-09-13T06:10:18.072 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.071+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26fb350 con 0x7fe2a001f940 2024-09-13T06:10:18.073 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.071+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 38 ==== osd_op_reply(186 gc.30 [call] v35'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:18.074 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.071+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:187 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26fb350 con 0x7fe2a001f940 2024-09-13T06:10:18.074 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.075+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 39 ==== osd_op_reply(187 gc.30 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:18.074 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.075+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:10:18.074 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.075+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:188 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26fb350 con 0x7fe2a001f940 2024-09-13T06:10:18.075 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.075+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 40 ==== osd_op_reply(188 gc.30 [call out=24b] v0'0 uv39 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:18.075 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.075+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:189 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x7fe2a001f940 2024-09-13T06:10:18.075 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.075+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 41 ==== osd_op_reply(189 gc.30 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:18.076 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.075+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:10:18.076 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.075+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:190 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x7fe2a001f940 2024-09-13T06:10:18.076 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.075+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 42 ==== osd_op_reply(190 gc.30 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:18.076 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.075+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:10:18.076 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.075+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:191 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x7fe2a001f940 2024-09-13T06:10:18.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.079+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 43 ==== osd_op_reply(191 gc.30 [call] v35'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:18.079 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.079+0000 7fe2ba510980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=1 2024-09-13T06:10:18.079 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.079+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:192 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x7fe2a80cb730 2024-09-13T06:10:18.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.079+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 <== osd.2 v2:172.21.15.194:6800/815615585 34 ==== osd_op_reply(192 gc.31 [call] v35'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe2a004a040 con 0x7fe2a80cb730 2024-09-13T06:10:18.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.079+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:193 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x7fe2a80cb730 2024-09-13T06:10:18.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.079+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 <== osd.2 v2:172.21.15.194:6800/815615585 35 ==== osd_op_reply(193 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2a004a040 con 0x7fe2a80cb730 2024-09-13T06:10:18.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.079+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:10:18.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.079+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:194 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x7fe2a80cb730 2024-09-13T06:10:18.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.083+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 <== osd.2 v2:172.21.15.194:6800/815615585 36 ==== osd_op_reply(194 gc.31 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe2a004a040 con 0x7fe2a80cb730 2024-09-13T06:10:18.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.083+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:195 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x7fe2a80cb730 2024-09-13T06:10:18.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.083+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 <== osd.2 v2:172.21.15.194:6800/815615585 37 ==== osd_op_reply(195 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2a004a040 con 0x7fe2a80cb730 2024-09-13T06:10:18.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.083+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:10:18.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.083+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:196 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x7fe2a80cb730 2024-09-13T06:10:18.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.083+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 <== osd.2 v2:172.21.15.194:6800/815615585 38 ==== osd_op_reply(196 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2a004a040 con 0x7fe2a80cb730 2024-09-13T06:10:18.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.083+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:10:18.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.083+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:197 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x7fe2a80cb730 2024-09-13T06:10:18.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.083+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 <== osd.2 v2:172.21.15.194:6800/815615585 39 ==== osd_op_reply(197 gc.31 [call] v35'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe2a004a040 con 0x7fe2a80cb730 2024-09-13T06:10:18.086 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.083+0000 7fe2ba510980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=1 2024-09-13T06:10:18.086 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.083+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:198 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x557fa26bd610 2024-09-13T06:10:18.088 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.087+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.1 v2:172.21.15.194:6808/3135444559 40 ==== osd_op_reply(198 gc.0 [call] v35'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe2b00083f0 con 0x557fa26bd610 2024-09-13T06:10:18.088 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.087+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:199 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x557fa26bd610 2024-09-13T06:10:18.089 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.087+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.1 v2:172.21.15.194:6808/3135444559 41 ==== osd_op_reply(199 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe2b00083f0 con 0x557fa26bd610 2024-09-13T06:10:18.089 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.087+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:10:18.089 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.087+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:200 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x557fa26bd610 2024-09-13T06:10:18.089 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.087+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.1 v2:172.21.15.194:6808/3135444559 42 ==== osd_op_reply(200 gc.0 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe2b00083f0 con 0x557fa26bd610 2024-09-13T06:10:18.089 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.087+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:201 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x557fa26bd610 2024-09-13T06:10:18.089 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.087+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.1 v2:172.21.15.194:6808/3135444559 43 ==== osd_op_reply(201 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe2b00083f0 con 0x557fa26bd610 2024-09-13T06:10:18.089 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.087+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:10:18.090 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.087+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:202 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x557fa26bd610 2024-09-13T06:10:18.090 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.087+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.1 v2:172.21.15.194:6808/3135444559 44 ==== osd_op_reply(202 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe2b00083f0 con 0x557fa26bd610 2024-09-13T06:10:18.090 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.087+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:10:18.090 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.087+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:203 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x557fa26bd610 2024-09-13T06:10:18.092 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.091+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.1 v2:172.21.15.194:6808/3135444559 45 ==== osd_op_reply(203 gc.0 [call] v35'28 uv28 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe2b00083f0 con 0x557fa26bd610 2024-09-13T06:10:18.092 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.091+0000 7fe2ba510980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=1 2024-09-13T06:10:18.092 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.091+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:204 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x7fe2a001f940 2024-09-13T06:10:18.094 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.091+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 44 ==== osd_op_reply(204 gc.1 [call] v35'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:18.094 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.091+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:205 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x7fe2a001f940 2024-09-13T06:10:18.094 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.095+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 45 ==== osd_op_reply(205 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:18.094 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.095+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:10:18.094 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.095+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:206 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x7fe2a001f940 2024-09-13T06:10:18.095 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.095+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 46 ==== osd_op_reply(206 gc.1 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:18.095 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.095+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:207 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x7fe2a001f940 2024-09-13T06:10:18.096 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.095+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 47 ==== osd_op_reply(207 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:18.096 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.095+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:10:18.096 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.095+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:208 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x7fe2a001f940 2024-09-13T06:10:18.097 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.095+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 48 ==== osd_op_reply(208 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:18.097 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.095+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:10:18.097 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.095+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:209 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x7fe2a001f940 2024-09-13T06:10:18.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.099+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 49 ==== osd_op_reply(209 gc.1 [call] v35'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:18.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.099+0000 7fe2ba510980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=1 2024-09-13T06:10:18.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.099+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:210 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x557fa26c2000 2024-09-13T06:10:18.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.099+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 77 ==== osd_op_reply(210 gc.2 [call] v35'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:18.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.099+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:211 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x557fa26c2000 2024-09-13T06:10:18.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.099+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 78 ==== osd_op_reply(211 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:18.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.099+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:10:18.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.099+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:212 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x557fa26c2000 2024-09-13T06:10:18.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.099+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 79 ==== osd_op_reply(212 gc.2 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:18.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.099+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:213 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x557fa26c2000 2024-09-13T06:10:18.103 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.103+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 80 ==== osd_op_reply(213 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:18.103 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.103+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:10:18.103 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.103+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:214 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x557fa26c2000 2024-09-13T06:10:18.103 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.103+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 81 ==== osd_op_reply(214 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:18.103 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.103+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:10:18.103 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.103+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:215 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x557fa26c2000 2024-09-13T06:10:18.104 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.103+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 82 ==== osd_op_reply(215 gc.2 [call] v35'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:18.104 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.103+0000 7fe2ba510980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=1 2024-09-13T06:10:18.104 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.103+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:216 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x557fa26bd610 2024-09-13T06:10:18.106 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.103+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.1 v2:172.21.15.194:6808/3135444559 46 ==== osd_op_reply(216 gc.3 [call] v35'163 uv163 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe2b00083f0 con 0x557fa26bd610 2024-09-13T06:10:18.106 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.107+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:217 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x557fa26bd610 2024-09-13T06:10:18.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.107+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.1 v2:172.21.15.194:6808/3135444559 47 ==== osd_op_reply(217 gc.3 [call out=15b] v0'0 uv163 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe2b00083f0 con 0x557fa26bd610 2024-09-13T06:10:18.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.107+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:10:18.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.107+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:218 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x557fa26bd610 2024-09-13T06:10:18.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.107+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.1 v2:172.21.15.194:6808/3135444559 48 ==== osd_op_reply(218 gc.3 [call out=24b] v0'0 uv163 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe2b00083f0 con 0x557fa26bd610 2024-09-13T06:10:18.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.107+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:219 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x557fa26bd610 2024-09-13T06:10:18.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.107+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.1 v2:172.21.15.194:6808/3135444559 49 ==== osd_op_reply(219 gc.3 [call out=15b] v0'0 uv163 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe2b00083f0 con 0x557fa26bd610 2024-09-13T06:10:18.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.107+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:10:18.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.107+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:220 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x557fa26bd610 2024-09-13T06:10:18.109 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.107+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.1 v2:172.21.15.194:6808/3135444559 50 ==== osd_op_reply(220 gc.3 [call out=15b] v0'0 uv163 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe2b00083f0 con 0x557fa26bd610 2024-09-13T06:10:18.109 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.107+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:10:18.109 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.107+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:221 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x557fa26bd610 2024-09-13T06:10:18.110 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.111+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.1 v2:172.21.15.194:6808/3135444559 51 ==== osd_op_reply(221 gc.3 [call] v35'164 uv164 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe2b00083f0 con 0x557fa26bd610 2024-09-13T06:10:18.110 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.111+0000 7fe2ba510980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=1 2024-09-13T06:10:18.111 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.111+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:222 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x7fe2a80cb730 2024-09-13T06:10:18.112 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.111+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 <== osd.2 v2:172.21.15.194:6800/815615585 40 ==== osd_op_reply(222 gc.4 [call] v35'52 uv52 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe2a004a040 con 0x7fe2a80cb730 2024-09-13T06:10:18.112 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.111+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:223 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x7fe2a80cb730 2024-09-13T06:10:18.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.111+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 <== osd.2 v2:172.21.15.194:6800/815615585 41 ==== osd_op_reply(223 gc.4 [call out=15b] v0'0 uv52 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe2a004a040 con 0x7fe2a80cb730 2024-09-13T06:10:18.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.111+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:10:18.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.111+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:224 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x7fe2a80cb730 2024-09-13T06:10:18.114 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.111+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 <== osd.2 v2:172.21.15.194:6800/815615585 42 ==== osd_op_reply(224 gc.4 [call out=24b] v0'0 uv52 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe2a004a040 con 0x7fe2a80cb730 2024-09-13T06:10:18.114 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.111+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:225 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x7fe2a80cb730 2024-09-13T06:10:18.114 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.111+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 <== osd.2 v2:172.21.15.194:6800/815615585 43 ==== osd_op_reply(225 gc.4 [call out=15b] v0'0 uv52 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe2a004a040 con 0x7fe2a80cb730 2024-09-13T06:10:18.114 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.111+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:10:18.114 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.111+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:226 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x7fe2a80cb730 2024-09-13T06:10:18.114 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.111+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 <== osd.2 v2:172.21.15.194:6800/815615585 44 ==== osd_op_reply(226 gc.4 [call out=15b] v0'0 uv52 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe2a004a040 con 0x7fe2a80cb730 2024-09-13T06:10:18.114 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.111+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:10:18.114 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.111+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:227 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x7fe2a80cb730 2024-09-13T06:10:18.115 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.115+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 <== osd.2 v2:172.21.15.194:6800/815615585 45 ==== osd_op_reply(227 gc.4 [call] v35'53 uv53 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe2a004a040 con 0x7fe2a80cb730 2024-09-13T06:10:18.115 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.115+0000 7fe2ba510980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=1 2024-09-13T06:10:18.115 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.115+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:228 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x557fa26c2000 2024-09-13T06:10:18.117 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.115+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 83 ==== osd_op_reply(228 gc.5 [call] v35'36 uv36 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:18.117 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.115+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:229 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x557fa26c2000 2024-09-13T06:10:18.118 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.115+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 84 ==== osd_op_reply(229 gc.5 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:18.118 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.115+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:10:18.118 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.115+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:230 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x557fa26c2000 2024-09-13T06:10:18.118 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.119+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 85 ==== osd_op_reply(230 gc.5 [call out=24b] v0'0 uv36 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:18.118 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.119+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:231 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x557fa26c2000 2024-09-13T06:10:18.119 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.119+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 86 ==== osd_op_reply(231 gc.5 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:18.119 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.119+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:10:18.119 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.119+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:232 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x557fa26c2000 2024-09-13T06:10:18.119 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.119+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 87 ==== osd_op_reply(232 gc.5 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:18.119 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.119+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:10:18.120 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.119+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:233 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x557fa26c2000 2024-09-13T06:10:18.121 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.119+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 88 ==== osd_op_reply(233 gc.5 [call] v35'37 uv37 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:18.121 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.119+0000 7fe2ba510980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=1 2024-09-13T06:10:18.121 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.119+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:234 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x557fa26bd610 2024-09-13T06:10:18.123 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.123+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.1 v2:172.21.15.194:6808/3135444559 52 ==== osd_op_reply(234 gc.6 [call] v35'22 uv22 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe2b00083f0 con 0x557fa26bd610 2024-09-13T06:10:18.123 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.123+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:235 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x557fa26bd610 2024-09-13T06:10:18.124 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.123+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.1 v2:172.21.15.194:6808/3135444559 53 ==== osd_op_reply(235 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe2b00083f0 con 0x557fa26bd610 2024-09-13T06:10:18.124 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.123+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:10:18.124 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.123+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:236 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x557fa26bd610 2024-09-13T06:10:18.125 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.123+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.1 v2:172.21.15.194:6808/3135444559 54 ==== osd_op_reply(236 gc.6 [call out=24b] v0'0 uv22 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe2b00083f0 con 0x557fa26bd610 2024-09-13T06:10:18.125 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.123+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:237 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x557fa26bd610 2024-09-13T06:10:18.125 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.123+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.1 v2:172.21.15.194:6808/3135444559 55 ==== osd_op_reply(237 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe2b00083f0 con 0x557fa26bd610 2024-09-13T06:10:18.126 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.123+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:10:18.126 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.123+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:238 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x557fa26bd610 2024-09-13T06:10:18.126 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.123+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.1 v2:172.21.15.194:6808/3135444559 56 ==== osd_op_reply(238 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe2b00083f0 con 0x557fa26bd610 2024-09-13T06:10:18.126 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.123+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:10:18.126 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.123+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:239 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x557fa26bd610 2024-09-13T06:10:18.128 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.127+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.1 v2:172.21.15.194:6808/3135444559 57 ==== osd_op_reply(239 gc.6 [call] v35'23 uv23 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe2b00083f0 con 0x557fa26bd610 2024-09-13T06:10:18.129 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.127+0000 7fe2ba510980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=1 2024-09-13T06:10:18.129 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.127+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:240 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x7fe2a001f940 2024-09-13T06:10:18.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.131+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 50 ==== osd_op_reply(240 gc.7 [call] v35'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:18.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.131+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:241 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x7fe2a001f940 2024-09-13T06:10:18.132 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.131+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 51 ==== osd_op_reply(241 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:18.132 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.131+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:10:18.132 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.131+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:242 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x7fe2a001f940 2024-09-13T06:10:18.132 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.131+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 52 ==== osd_op_reply(242 gc.7 [call out=24b] v0'0 uv35 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:18.132 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.131+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:243 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x7fe2a001f940 2024-09-13T06:10:18.133 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.131+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 53 ==== osd_op_reply(243 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:18.133 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.131+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:10:18.133 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.131+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:244 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x7fe2a001f940 2024-09-13T06:10:18.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.135+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 54 ==== osd_op_reply(244 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:18.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.135+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:10:18.135 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.135+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:245 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x7fe2a001f940 2024-09-13T06:10:18.137 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.135+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 55 ==== osd_op_reply(245 gc.7 [call] v35'36 uv36 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:18.137 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.135+0000 7fe2ba510980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=1 2024-09-13T06:10:18.137 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.135+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:246 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x7fe2a80cb730 2024-09-13T06:10:18.139 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.139+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 <== osd.2 v2:172.21.15.194:6800/815615585 46 ==== osd_op_reply(246 gc.8 [call] v35'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe2a004a040 con 0x7fe2a80cb730 2024-09-13T06:10:18.139 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.139+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:247 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x7fe2a80cb730 2024-09-13T06:10:18.140 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.139+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 <== osd.2 v2:172.21.15.194:6800/815615585 47 ==== osd_op_reply(247 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe2a004a040 con 0x7fe2a80cb730 2024-09-13T06:10:18.140 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.139+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:10:18.140 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.139+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:248 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x7fe2a80cb730 2024-09-13T06:10:18.140 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.139+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 <== osd.2 v2:172.21.15.194:6800/815615585 48 ==== osd_op_reply(248 gc.8 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe2a004a040 con 0x7fe2a80cb730 2024-09-13T06:10:18.140 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.139+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:249 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x7fe2a80cb730 2024-09-13T06:10:18.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.139+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 <== osd.2 v2:172.21.15.194:6800/815615585 49 ==== osd_op_reply(249 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe2a004a040 con 0x7fe2a80cb730 2024-09-13T06:10:18.142 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.139+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:10:18.142 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.139+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:250 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x7fe2a80cb730 2024-09-13T06:10:18.142 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.139+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 <== osd.2 v2:172.21.15.194:6800/815615585 50 ==== osd_op_reply(250 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe2a004a040 con 0x7fe2a80cb730 2024-09-13T06:10:18.142 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.139+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:10:18.142 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.139+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:251 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x7fe2a80cb730 2024-09-13T06:10:18.143 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.143+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 <== osd.2 v2:172.21.15.194:6800/815615585 51 ==== osd_op_reply(251 gc.8 [call] v35'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe2a0058040 con 0x7fe2a80cb730 2024-09-13T06:10:18.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.143+0000 7fe2ba510980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=1 2024-09-13T06:10:18.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.143+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:252 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x557fa26c2000 2024-09-13T06:10:18.146 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.143+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 89 ==== osd_op_reply(252 gc.9 [call] v35'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:18.146 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.143+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:253 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x557fa26c2000 2024-09-13T06:10:18.146 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.147+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 90 ==== osd_op_reply(253 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:18.146 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.147+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:10:18.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.147+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:254 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x557fa26c2000 2024-09-13T06:10:18.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.147+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 91 ==== osd_op_reply(254 gc.9 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:18.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.147+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:255 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x557fa26c2000 2024-09-13T06:10:18.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.147+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 92 ==== osd_op_reply(255 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:18.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.147+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:10:18.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.147+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:256 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x557fa26c2000 2024-09-13T06:10:18.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.147+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 93 ==== osd_op_reply(256 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:18.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.147+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:10:18.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.147+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:257 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x557fa26c2000 2024-09-13T06:10:18.150 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.151+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 94 ==== osd_op_reply(257 gc.9 [call] v35'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:18.150 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.151+0000 7fe2ba510980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=1 2024-09-13T06:10:18.151 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.151+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:258 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x7fe2a80cb730 2024-09-13T06:10:18.152 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.151+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 <== osd.2 v2:172.21.15.194:6800/815615585 52 ==== osd_op_reply(258 gc.10 [call] v35'54 uv54 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe2a0058040 con 0x7fe2a80cb730 2024-09-13T06:10:18.152 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.151+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:259 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x7fe2a80cb730 2024-09-13T06:10:18.153 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.151+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 <== osd.2 v2:172.21.15.194:6800/815615585 53 ==== osd_op_reply(259 gc.10 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2a0058040 con 0x7fe2a80cb730 2024-09-13T06:10:18.153 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.151+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:10:18.153 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.151+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:260 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x7fe2a80cb730 2024-09-13T06:10:18.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.151+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 <== osd.2 v2:172.21.15.194:6800/815615585 54 ==== osd_op_reply(260 gc.10 [call out=24b] v0'0 uv54 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe2a0058040 con 0x7fe2a80cb730 2024-09-13T06:10:18.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.151+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:261 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x7fe2a80cb730 2024-09-13T06:10:18.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.155+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 <== osd.2 v2:172.21.15.194:6800/815615585 55 ==== osd_op_reply(261 gc.10 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2a0058040 con 0x7fe2a80cb730 2024-09-13T06:10:18.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.155+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:10:18.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.155+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:262 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x7fe2a80cb730 2024-09-13T06:10:18.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.155+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 <== osd.2 v2:172.21.15.194:6800/815615585 56 ==== osd_op_reply(262 gc.10 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2a0058040 con 0x7fe2a80cb730 2024-09-13T06:10:18.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.155+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:10:18.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.155+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:263 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x7fe2a80cb730 2024-09-13T06:10:18.156 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.155+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 <== osd.2 v2:172.21.15.194:6800/815615585 57 ==== osd_op_reply(263 gc.10 [call] v35'55 uv55 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe2a0058040 con 0x7fe2a80cb730 2024-09-13T06:10:18.156 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.155+0000 7fe2ba510980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=1 2024-09-13T06:10:18.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.155+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:264 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x7fe2a001f940 2024-09-13T06:10:18.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.159+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 56 ==== osd_op_reply(264 gc.11 [call] v35'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:18.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.159+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:265 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x7fe2a001f940 2024-09-13T06:10:18.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.159+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 57 ==== osd_op_reply(265 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:18.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.159+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:10:18.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.159+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:266 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x7fe2a001f940 2024-09-13T06:10:18.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.159+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 58 ==== osd_op_reply(266 gc.11 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:18.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.159+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:267 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x7fe2a001f940 2024-09-13T06:10:18.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.159+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 59 ==== osd_op_reply(267 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:18.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.159+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:10:18.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.159+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:268 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x7fe2a001f940 2024-09-13T06:10:18.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.159+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 60 ==== osd_op_reply(268 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:18.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.159+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:10:18.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.163+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:269 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x7fe2a001f940 2024-09-13T06:10:18.164 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.163+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 61 ==== osd_op_reply(269 gc.11 [call] v35'24 uv24 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:18.164 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.163+0000 7fe2ba510980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=1 2024-09-13T06:10:18.165 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.163+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:270 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x7fe2a80cb730 2024-09-13T06:10:18.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.167+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 <== osd.2 v2:172.21.15.194:6800/815615585 58 ==== osd_op_reply(270 gc.12 [call] v35'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe2a0058040 con 0x7fe2a80cb730 2024-09-13T06:10:18.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.167+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:271 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x7fe2a80cb730 2024-09-13T06:10:18.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.167+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 <== osd.2 v2:172.21.15.194:6800/815615585 59 ==== osd_op_reply(271 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2a0058040 con 0x7fe2a80cb730 2024-09-13T06:10:18.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.167+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:10:18.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.167+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:272 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x7fe2a80cb730 2024-09-13T06:10:18.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.167+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 <== osd.2 v2:172.21.15.194:6800/815615585 60 ==== osd_op_reply(272 gc.12 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe2a0058040 con 0x7fe2a80cb730 2024-09-13T06:10:18.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.167+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:273 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x7fe2a80cb730 2024-09-13T06:10:18.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.167+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 <== osd.2 v2:172.21.15.194:6800/815615585 61 ==== osd_op_reply(273 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2a0058040 con 0x7fe2a80cb730 2024-09-13T06:10:18.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.167+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:10:18.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.167+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:274 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x7fe2a80cb730 2024-09-13T06:10:18.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.167+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 <== osd.2 v2:172.21.15.194:6800/815615585 62 ==== osd_op_reply(274 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2a0058040 con 0x7fe2a80cb730 2024-09-13T06:10:18.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.167+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:10:18.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.167+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:275 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x7fe2a80cb730 2024-09-13T06:10:18.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.171+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 <== osd.2 v2:172.21.15.194:6800/815615585 63 ==== osd_op_reply(275 gc.12 [call] v35'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe2a0058040 con 0x7fe2a80cb730 2024-09-13T06:10:18.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.171+0000 7fe2ba510980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=1 2024-09-13T06:10:18.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.171+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:276 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x7fe2a001f940 2024-09-13T06:10:18.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.171+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 62 ==== osd_op_reply(276 gc.13 [call] v35'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:18.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.175+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:277 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x7fe2a001f940 2024-09-13T06:10:18.175 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.175+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 63 ==== osd_op_reply(277 gc.13 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:18.175 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.175+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:10:18.175 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.175+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:278 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x7fe2a001f940 2024-09-13T06:10:18.176 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.175+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 64 ==== osd_op_reply(278 gc.13 [call out=24b] v0'0 uv41 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:18.176 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.175+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:279 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x7fe2a001f940 2024-09-13T06:10:18.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.175+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 65 ==== osd_op_reply(279 gc.13 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:18.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.175+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:10:18.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.175+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:280 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x7fe2a001f940 2024-09-13T06:10:18.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.175+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 66 ==== osd_op_reply(280 gc.13 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:18.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.175+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:10:18.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.175+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:281 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x7fe2a001f940 2024-09-13T06:10:18.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.179+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 67 ==== osd_op_reply(281 gc.13 [call] v35'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:18.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.179+0000 7fe2ba510980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=1 2024-09-13T06:10:18.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.179+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:282 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x557fa26bd610 2024-09-13T06:10:18.183 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.183+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.1 v2:172.21.15.194:6808/3135444559 58 ==== osd_op_reply(282 gc.14 [call] v35'165 uv165 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe2b00083f0 con 0x557fa26bd610 2024-09-13T06:10:18.183 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.183+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:283 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x557fa26bd610 2024-09-13T06:10:18.183 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.183+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.1 v2:172.21.15.194:6808/3135444559 59 ==== osd_op_reply(283 gc.14 [call out=15b] v0'0 uv165 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2b00083f0 con 0x557fa26bd610 2024-09-13T06:10:18.183 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.183+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:10:18.183 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.183+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:284 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x557fa26bd610 2024-09-13T06:10:18.184 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.183+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.1 v2:172.21.15.194:6808/3135444559 60 ==== osd_op_reply(284 gc.14 [call out=24b] v0'0 uv165 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe2b00083f0 con 0x557fa26bd610 2024-09-13T06:10:18.184 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.183+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:285 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x557fa26bd610 2024-09-13T06:10:18.184 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.183+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.1 v2:172.21.15.194:6808/3135444559 61 ==== osd_op_reply(285 gc.14 [call out=15b] v0'0 uv165 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2b00083f0 con 0x557fa26bd610 2024-09-13T06:10:18.184 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.183+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:10:18.185 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.183+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:286 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x557fa26bd610 2024-09-13T06:10:18.185 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.183+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.1 v2:172.21.15.194:6808/3135444559 62 ==== osd_op_reply(286 gc.14 [call out=15b] v0'0 uv165 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2b00083f0 con 0x557fa26bd610 2024-09-13T06:10:18.185 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.183+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:10:18.185 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.183+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:287 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x557fa26bd610 2024-09-13T06:10:18.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.187+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.1 v2:172.21.15.194:6808/3135444559 63 ==== osd_op_reply(287 gc.14 [call] v35'166 uv166 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe2b00083f0 con 0x557fa26bd610 2024-09-13T06:10:18.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.187+0000 7fe2ba510980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=1 2024-09-13T06:10:18.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.187+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:288 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x557fa26c2000 2024-09-13T06:10:18.189 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.187+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 95 ==== osd_op_reply(288 gc.15 [call] v35'48 uv48 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:18.189 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.187+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:289 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x557fa26c2000 2024-09-13T06:10:18.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.191+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 96 ==== osd_op_reply(289 gc.15 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:18.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.191+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:10:18.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.191+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:290 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x557fa26c2000 2024-09-13T06:10:18.191 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.191+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 97 ==== osd_op_reply(290 gc.15 [call out=24b] v0'0 uv48 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:18.191 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.191+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:291 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x557fa26c2000 2024-09-13T06:10:18.191 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.191+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 98 ==== osd_op_reply(291 gc.15 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:18.191 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.191+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:10:18.191 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.191+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:292 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x557fa26c2000 2024-09-13T06:10:18.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.191+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 99 ==== osd_op_reply(292 gc.15 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:18.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.191+0000 7fe2ba510980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:10:18.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.191+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:293 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x557fa26c2000 2024-09-13T06:10:18.194 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.195+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 100 ==== osd_op_reply(293 gc.15 [call] v35'49 uv49 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:18.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.195+0000 7fe16efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:10:18.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.195+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94006674261936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x557fa26bd610 2024-09-13T06:10:18.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.195+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.1 v2:172.21.15.194:6808/3135444559 64 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94006674261936] v35'167 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe2b00083f0 con 0x557fa26bd610 2024-09-13T06:10:18.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.195+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94006674224688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x7fe2a80cb730 2024-09-13T06:10:18.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.199+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 <== osd.2 v2:172.21.15.194:6800/815615585 64 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94006674224688] v35'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2a0058040 con 0x7fe2a80cb730 2024-09-13T06:10:18.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.199+0000 7fe2ba510980 20 remove_watcher() i=0 2024-09-13T06:10:18.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.199+0000 7fe2ba510980 2 removed watcher, disabling cache 2024-09-13T06:10:18.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.199+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94006674231168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x557fa26bd610 2024-09-13T06:10:18.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.199+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.1 v2:172.21.15.194:6808/3135444559 65 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94006674231168] v35'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2b00083f0 con 0x557fa26bd610 2024-09-13T06:10:18.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.199+0000 7fe2ba510980 20 remove_watcher() i=1 2024-09-13T06:10:18.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.199+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94006674225808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x557fa26c2000 2024-09-13T06:10:18.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.203+0000 7fe2b8020640 1 -- 172.21.15.194:0/2997260001 <== osd.3 v2:172.21.15.194:6816/96632515 101 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94006674225808] v35'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2a80fe070 con 0x557fa26c2000 2024-09-13T06:10:18.205 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.203+0000 7fe2ba510980 20 remove_watcher() i=2 2024-09-13T06:10:18.205 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.203+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94006674237344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26f89c0 con 0x7fe2a80cb730 2024-09-13T06:10:18.206 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.207+0000 7fe2b781f640 1 -- 172.21.15.194:0/2997260001 <== osd.2 v2:172.21.15.194:6800/815615585 65 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94006674237344] v35'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2a0058040 con 0x7fe2a80cb730 2024-09-13T06:10:18.206 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.207+0000 7fe2ba510980 20 remove_watcher() i=3 2024-09-13T06:10:18.206 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.207+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94006674241968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26c7ae0 con 0x557fa26bd610 2024-09-13T06:10:18.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.207+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.1 v2:172.21.15.194:6808/3135444559 66 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94006674241968] v35'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2b00083f0 con 0x557fa26bd610 2024-09-13T06:10:18.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.207+0000 7fe2ba510980 20 remove_watcher() i=4 2024-09-13T06:10:18.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.207+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94006674234768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26c7ae0 con 0x7fe2a001f940 2024-09-13T06:10:18.212 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.211+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 68 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94006674234768] v35'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:18.212 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.211+0000 7fe2ba510980 20 remove_watcher() i=5 2024-09-13T06:10:18.212 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.211+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94006674245568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26c7ae0 con 0x7fe2a001f940 2024-09-13T06:10:18.213 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.211+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 69 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94006674245568] v35'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:18.213 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.211+0000 7fe2ba510980 20 remove_watcher() i=6 2024-09-13T06:10:18.213 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.211+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94006674246896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fa26c7ae0 con 0x7fe2a001f940 2024-09-13T06:10:18.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.215+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 <== osd.0 v2:172.21.15.120:6800/1923744619 70 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94006674246896] v35'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2b00083f0 con 0x7fe2a001f940 2024-09-13T06:10:18.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.215+0000 7fe2ba510980 20 remove_watcher() i=7 2024-09-13T06:10:18.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.215+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fe2a001f940 msgr2=0x7fe2a003a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:18.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.215+0000 7fe2ba510980 1 --2- 172.21.15.194:0/2997260001 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fe2a001f940 0x7fe2a003a3c0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:18.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.215+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x557fa26bd610 msgr2=0x557fa26bfad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:18.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.215+0000 7fe2ba510980 1 --2- 172.21.15.194:0/2997260001 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x557fa26bd610 0x557fa26bfad0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:18.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.215+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fe2a80cb730 msgr2=0x7fe2a80ab5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:18.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.215+0000 7fe2ba510980 1 --2- 172.21.15.194:0/2997260001 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fe2a80cb730 0x7fe2a80ab5b0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:18.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.215+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x557fa26c2000 msgr2=0x557fa26c43f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:18.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.215+0000 7fe2ba510980 1 --2- 172.21.15.194:0/2997260001 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x557fa26c2000 0x557fa26c43f0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:18.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.215+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fe188034600 msgr2=0x7fe188036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:18.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.215+0000 7fe2ba510980 1 --2- 172.21.15.194:0/2997260001 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fe188034600 0x7fe188036ac0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe2a000ba80 tx=0x7fe2a0023040 comp rx=0 tx=0).stop 2024-09-13T06:10:18.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.215+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557fa26ab380 msgr2=0x557fa26b2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:18.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.215+0000 7fe2b8821640 1 -- 172.21.15.194:0/2997260001 reap_dead start 2024-09-13T06:10:18.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.215+0000 7fe2ba510980 1 --2- 172.21.15.194:0/2997260001 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557fa26ab380 0x557fa26b2560 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fe2a80c8800 tx=0x7fe2a80d7f90 comp rx=0 tx=0).stop 2024-09-13T06:10:18.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.215+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 shutdown_connections 2024-09-13T06:10:18.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.215+0000 7fe2ba510980 1 --2- 172.21.15.194:0/2997260001 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557fa26ab380 0x557fa26b2560 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:18.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.215+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 >> 172.21.15.194:0/2997260001 conn(0x557fa26a7760 msgr2=0x557fa26a5830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:18.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.215+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 shutdown_connections 2024-09-13T06:10:18.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.215+0000 7fe2ba510980 1 -- 172.21.15.194:0/2997260001 wait complete. 2024-09-13T06:10:18.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.215+0000 7fe2ba510980 1 -- 172.21.15.194:0/915321046 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fe190034650 msgr2=0x7fe190036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:18.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.215+0000 7fe2ba510980 1 --2- 172.21.15.194:0/915321046 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fe190034650 0x7fe190036b10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x557fa268f1a0 tx=0x7fe2a0006000 comp rx=0 tx=0).stop 2024-09-13T06:10:18.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.215+0000 7fe2ba510980 1 -- 172.21.15.194:0/915321046 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557fa267f060 msgr2=0x557fa267d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:18.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.215+0000 7fe2ba510980 1 --2- 172.21.15.194:0/915321046 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557fa267f060 0x557fa267d6e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fe2a80bf480 tx=0x7fe2a80d7260 comp rx=0 tx=0).stop 2024-09-13T06:10:18.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.219+0000 7fe2ba510980 1 -- 172.21.15.194:0/915321046 shutdown_connections 2024-09-13T06:10:18.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.219+0000 7fe2ba510980 1 --2- 172.21.15.194:0/915321046 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fe190034650 0x7fe190036b10 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:18.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.219+0000 7fe2ba510980 1 --2- 172.21.15.194:0/915321046 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557fa267f060 0x557fa267d6e0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:18.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.219+0000 7fe2ba510980 1 -- 172.21.15.194:0/915321046 >> 172.21.15.194:0/915321046 conn(0x557fa2691980 msgr2=0x557fa2694400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:18.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.219+0000 7fe2ba510980 1 -- 172.21.15.194:0/915321046 shutdown_connections 2024-09-13T06:10:18.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.219+0000 7fe2ba510980 1 -- 172.21.15.194:0/915321046 wait complete. 2024-09-13T06:10:18.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.219+0000 7fe2ba510980 1 -- 172.21.15.194:0/4225840753 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x557fa258beb0 msgr2=0x557fa2685a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:18.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.219+0000 7fe2ba510980 1 --2- 172.21.15.194:0/4225840753 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x557fa258beb0 0x557fa2685a60 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:18.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.219+0000 7fe2ba510980 1 -- 172.21.15.194:0/4225840753 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x557fa268c220 msgr2=0x557fa268e610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:18.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.219+0000 7fe2ba510980 1 --2- 172.21.15.194:0/4225840753 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x557fa268c220 0x557fa268e610 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:18.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.219+0000 7fe2ba510980 1 -- 172.21.15.194:0/4225840753 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x557fa2688320 msgr2=0x557fa268a710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:18.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.219+0000 7fe2ba510980 1 --2- 172.21.15.194:0/4225840753 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x557fa2688320 0x557fa268a710 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:18.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.219+0000 7fe2ba510980 1 -- 172.21.15.194:0/4225840753 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fe1a0034650 msgr2=0x7fe1a0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:18.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.219+0000 7fe2ba510980 1 --2- 172.21.15.194:0/4225840753 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fe1a0034650 0x7fe1a0036b10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe2a0000c10 tx=0x7fe2a00013c0 comp rx=0 tx=0).stop 2024-09-13T06:10:18.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.219+0000 7fe2ba510980 1 -- 172.21.15.194:0/4225840753 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557fa258b560 msgr2=0x557fa2501400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:18.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.219+0000 7fe2ba510980 1 --2- 172.21.15.194:0/4225840753 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557fa258b560 0x557fa2501400 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8019680 tx=0x7fe2a8019810 comp rx=0 tx=0).stop 2024-09-13T06:10:18.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.219+0000 7fe2b8821640 1 -- 172.21.15.194:0/4225840753 reap_dead start 2024-09-13T06:10:18.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.219+0000 7fe2ba510980 1 -- 172.21.15.194:0/4225840753 shutdown_connections 2024-09-13T06:10:18.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.219+0000 7fe2ba510980 1 -- 172.21.15.194:0/4225840753 >> 172.21.15.194:0/4225840753 conn(0x557fa2587080 msgr2=0x557fa2670f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:18.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.219+0000 7fe2ba510980 1 -- 172.21.15.194:0/4225840753 shutdown_connections 2024-09-13T06:10:18.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.219+0000 7fe2ba510980 1 -- 172.21.15.194:0/4225840753 wait complete. 2024-09-13T06:10:18.234 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-09-13T06:10:18.234 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-09-13T06:10:18.234 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-09-13T06:10:18.315 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:10:18.315 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:10:18.316 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.315+0000 7f0521cef980 1 Processor -- start 2024-09-13T06:10:18.316 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.315+0000 7f0521cef980 1 -- start start 2024-09-13T06:10:18.316 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.315+0000 7f0521cef980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x564c4dc458e0 0x564c4dc45cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:18.316 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.315+0000 7f0521cef980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564c4dacbae0 con 0x564c4dc46230 2024-09-13T06:10:18.316 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.315+0000 7f0521cef980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x564c4daefe30 con 0x564c4dc458e0 2024-09-13T06:10:18.317 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.315+0000 7f051f7ff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x564c4dc458e0 0x564c4dc45cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:18.317 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.315+0000 7f051f7ff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x564c4dc458e0 0x564c4dc45cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:50514/0 (socket says 172.21.15.194:50514) 2024-09-13T06:10:18.317 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.315+0000 7f051f7ff640 1 -- 172.21.15.194:0/3156025904 learned_addr learned my addr 172.21.15.194:0/3156025904 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:18.317 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.315+0000 7f051effe640 1 --1- 172.21.15.194:0/3156025904 >> v1:172.21.15.120:6789/0 conn(0x564c4dc46230 0x564c4dc4ac60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:59054/0 (socket says 172.21.15.194:59054) 2024-09-13T06:10:18.317 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.315+0000 7f051f7ff640 1 -- 172.21.15.194:0/3156025904 >> v1:172.21.15.120:6789/0 conn(0x564c4dc46230 legacy=0x564c4dc4ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:18.317 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.315+0000 7f051f7ff640 1 -- 172.21.15.194:0/3156025904 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c4dc4d4b0 con 0x564c4dc458e0 2024-09-13T06:10:18.319 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.319+0000 7f051f7ff640 1 --2- 172.21.15.194:0/3156025904 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564c4dc458e0 0x564c4dc45cc0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f051000a4e0 tx=0x7f051001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa21065833cef1ca server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:18.320 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.319+0000 7f051e7fd640 1 -- 172.21.15.194:0/3156025904 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05100aa540 con 0x564c4dc458e0 2024-09-13T06:10:18.320 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.319+0000 7f051e7fd640 1 -- 172.21.15.194:0/3156025904 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05100aa6e0 con 0x564c4dc458e0 2024-09-13T06:10:18.321 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.319+0000 7f051e7fd640 1 -- 172.21.15.194:0/3156025904 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05100aaa40 con 0x564c4dc458e0 2024-09-13T06:10:18.321 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.319+0000 7f0521cef980 1 -- 172.21.15.194:0/3156025904 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564c4dc458e0 msgr2=0x564c4dc45cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:18.321 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.319+0000 7f0521cef980 1 --2- 172.21.15.194:0/3156025904 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564c4dc458e0 0x564c4dc45cc0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f051000a4e0 tx=0x7f051001b090 comp rx=0 tx=0).stop 2024-09-13T06:10:18.321 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.319+0000 7f0521cef980 1 -- 172.21.15.194:0/3156025904 shutdown_connections 2024-09-13T06:10:18.321 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.319+0000 7f0521cef980 1 --2- 172.21.15.194:0/3156025904 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564c4dc458e0 0x564c4dc45cc0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:18.321 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.319+0000 7f0521cef980 1 -- 172.21.15.194:0/3156025904 >> 172.21.15.194:0/3156025904 conn(0x564c4dbb9230 msgr2=0x564c4dbb9640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:18.321 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.319+0000 7f0521cef980 1 -- 172.21.15.194:0/3156025904 shutdown_connections 2024-09-13T06:10:18.321 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.319+0000 7f0521cef980 1 -- 172.21.15.194:0/3156025904 wait complete. 2024-09-13T06:10:18.336 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.335+0000 7f0521cef980 1 Processor -- start 2024-09-13T06:10:18.336 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.335+0000 7f0521cef980 1 -- start start 2024-09-13T06:10:18.336 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.335+0000 7f0521cef980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564c4dc458e0 0x564c4dd30bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:18.336 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.335+0000 7f0521cef980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x564c4daf1200 con 0x564c4dc458e0 2024-09-13T06:10:18.337 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.335+0000 7f051f7ff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564c4dc458e0 0x564c4dd30bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:18.337 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.335+0000 7f051f7ff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564c4dc458e0 0x564c4dd30bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:50526/0 (socket says 172.21.15.194:50526) 2024-09-13T06:10:18.337 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.335+0000 7f051f7ff640 1 -- 172.21.15.194:0/3251631858 learned_addr learned my addr 172.21.15.194:0/3251631858 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:18.338 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.335+0000 7f051f7ff640 1 -- 172.21.15.194:0/3251631858 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c4dd311a0 con 0x564c4dc458e0 2024-09-13T06:10:18.338 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.335+0000 7f051f7ff640 1 --2- 172.21.15.194:0/3251631858 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564c4dc458e0 0x564c4dd30bd0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f0510017ca0 tx=0x7f05100033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e31a3e541394878 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:18.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.335+0000 7f040d60a640 1 -- 172.21.15.194:0/3251631858 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05100b9070 con 0x564c4dc458e0 2024-09-13T06:10:18.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.335+0000 7f040d60a640 1 -- 172.21.15.194:0/3251631858 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05100aaa80 con 0x564c4dc458e0 2024-09-13T06:10:18.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.335+0000 7f040d60a640 1 -- 172.21.15.194:0/3251631858 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05100aad60 con 0x564c4dc458e0 2024-09-13T06:10:18.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.339+0000 7f0521cef980 1 -- 172.21.15.194:0/3251631858 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564c4dc458e0 msgr2=0x564c4dd30bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:18.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.339+0000 7f0521cef980 1 --2- 172.21.15.194:0/3251631858 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564c4dc458e0 0x564c4dd30bd0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f0510017ca0 tx=0x7f05100033b0 comp rx=0 tx=0).stop 2024-09-13T06:10:18.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.339+0000 7f0521cef980 1 -- 172.21.15.194:0/3251631858 shutdown_connections 2024-09-13T06:10:18.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.339+0000 7f0521cef980 1 --2- 172.21.15.194:0/3251631858 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564c4dc458e0 0x564c4dd30bd0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:18.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.339+0000 7f0521cef980 1 -- 172.21.15.194:0/3251631858 >> 172.21.15.194:0/3251631858 conn(0x564c4dbb9230 msgr2=0x564c4dd2c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:18.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.339+0000 7f0521cef980 1 -- 172.21.15.194:0/3251631858 shutdown_connections 2024-09-13T06:10:18.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.339+0000 7f0521cef980 1 -- 172.21.15.194:0/3251631858 wait complete. 2024-09-13T06:10:18.341 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.339+0000 7f0521cef980 1 Processor -- start 2024-09-13T06:10:18.341 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.339+0000 7f0521cef980 1 -- start start 2024-09-13T06:10:18.341 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.339+0000 7f0521cef980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564c4dc458e0 0x564c4dd37e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:18.341 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.339+0000 7f0521cef980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x564c4dc4cef0 con 0x564c4dc458e0 2024-09-13T06:10:18.341 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.339+0000 7f051f7ff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564c4dc458e0 0x564c4dd37e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:18.341 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.339+0000 7f051f7ff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564c4dc458e0 0x564c4dd37e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:50534/0 (socket says 172.21.15.194:50534) 2024-09-13T06:10:18.341 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.339+0000 7f051f7ff640 1 -- 172.21.15.194:0/1409738553 learned_addr learned my addr 172.21.15.194:0/1409738553 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:18.341 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.339+0000 7f051f7ff640 1 -- 172.21.15.194:0/1409738553 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c4dd38380 con 0x564c4dc458e0 2024-09-13T06:10:18.341 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.339+0000 7f051f7ff640 1 --2- 172.21.15.194:0/1409738553 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564c4dc458e0 0x564c4dd37e40 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f051001aec0 tx=0x7f0510017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:18.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.339+0000 7f040be07640 1 -- 172.21.15.194:0/1409738553 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05100cc070 con 0x564c4dc458e0 2024-09-13T06:10:18.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.339+0000 7f0521cef980 1 -- 172.21.15.194:0/1409738553 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564c4dd38610 con 0x564c4dc458e0 2024-09-13T06:10:18.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.339+0000 7f040be07640 1 -- 172.21.15.194:0/1409738553 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05100c7410 con 0x564c4dc458e0 2024-09-13T06:10:18.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.339+0000 7f040be07640 1 -- 172.21.15.194:0/1409738553 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05100b9070 con 0x564c4dc458e0 2024-09-13T06:10:18.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.339+0000 7f0521cef980 1 -- 172.21.15.194:0/1409738553 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c4dd3b2f0 con 0x564c4dc458e0 2024-09-13T06:10:18.343 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.343+0000 7f040be07640 1 -- 172.21.15.194:0/1409738553 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f05100b3040 con 0x564c4dc458e0 2024-09-13T06:10:18.343 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.343+0000 7f040be07640 1 --2- 172.21.15.194:0/1409738553 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0404034650 0x7f0404036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:18.343 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.343+0000 7f040be07640 1 -- 172.21.15.194:0/1409738553 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f05100c4070 con 0x564c4dc458e0 2024-09-13T06:10:18.344 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.343+0000 7f051effe640 1 --2- 172.21.15.194:0/1409738553 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0404034650 0x7f0404036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:18.344 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.343+0000 7f0521cef980 1 --2- 172.21.15.194:0/1409738553 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x564c4dc46230 0x564c4dd3ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:18.344 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.343+0000 7f0521cef980 1 -- 172.21.15.194:0/1409738553 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd3f510 con 0x564c4dc46230 2024-09-13T06:10:18.344 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.343+0000 7f0520000640 1 --2- 172.21.15.194:0/1409738553 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x564c4dc46230 0x564c4dd3ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:18.344 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.343+0000 7f051effe640 1 --2- 172.21.15.194:0/1409738553 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0404034650 0x7f0404036b10 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0508000f70 tx=0x7f0508001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:18.344 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.343+0000 7f0520000640 1 --2- 172.21.15.194:0/1409738553 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x564c4dc46230 0x564c4dd3ef40 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:18.344 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.343+0000 7f0520000640 1 -- 172.21.15.194:0/1409738553 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f05180083f0 con 0x564c4dc46230 2024-09-13T06:10:18.344 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.343+0000 7f0521cef980 1 -- 172.21.15.194:0/1409738553 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd3c510 con 0x564c4dc46230 2024-09-13T06:10:18.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.343+0000 7f0520000640 1 -- 172.21.15.194:0/1409738553 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f05180083f0 con 0x564c4dc46230 2024-09-13T06:10:18.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.343+0000 7f0521cef980 1 --2- 172.21.15.194:0/1409738553 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x564c4dd41820 0x564c4dd43c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:18.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.343+0000 7f0521cef980 1 -- 172.21.15.194:0/1409738553 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd442e0 con 0x564c4dd41820 2024-09-13T06:10:18.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.343+0000 7f051f7ff640 1 --2- 172.21.15.194:0/1409738553 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x564c4dd41820 0x564c4dd43c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:18.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.343+0000 7f051f7ff640 1 --2- 172.21.15.194:0/1409738553 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x564c4dd41820 0x564c4dd43c10 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:18.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.343+0000 7f051f7ff640 1 -- 172.21.15.194:0/1409738553 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f05100ce310 con 0x564c4dd41820 2024-09-13T06:10:18.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.343+0000 7f0521cef980 1 -- 172.21.15.194:0/1409738553 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd406c0 con 0x564c4dc46230 2024-09-13T06:10:18.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.343+0000 7f0520000640 1 -- 172.21.15.194:0/1409738553 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f05180083f0 con 0x564c4dc46230 2024-09-13T06:10:18.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.343+0000 7f0521cef980 1 --2- 172.21.15.194:0/1409738553 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x564c4dd45740 0x564c4dd47b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:18.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.343+0000 7f0521cef980 1 -- 172.21.15.194:0/1409738553 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd48230 con 0x564c4dd45740 2024-09-13T06:10:18.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.343+0000 7f051effe640 1 --2- 172.21.15.194:0/1409738553 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x564c4dd45740 0x564c4dd47b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:18.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.343+0000 7f051effe640 1 --2- 172.21.15.194:0/1409738553 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x564c4dd45740 0x564c4dd47b30 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:18.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.343+0000 7f051effe640 1 -- 172.21.15.194:0/1409738553 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f050800f6a0 con 0x564c4dd45740 2024-09-13T06:10:18.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.347+0000 7f0521cef980 1 Processor -- start 2024-09-13T06:10:18.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.347+0000 7f0521cef980 1 -- start start 2024-09-13T06:10:18.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.347+0000 7f0521cef980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564c4dd55d00 0x564c4dd56120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:18.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.347+0000 7f0521cef980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x564c4db4a800 con 0x564c4dd55d00 2024-09-13T06:10:18.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.347+0000 7f051f7ff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564c4dd55d00 0x564c4dd56120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:18.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.347+0000 7f051f7ff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564c4dd55d00 0x564c4dd56120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:50542/0 (socket says 172.21.15.194:50542) 2024-09-13T06:10:18.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.347+0000 7f051f7ff640 1 -- 172.21.15.194:0/2660015814 learned_addr learned my addr 172.21.15.194:0/2660015814 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:18.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.347+0000 7f051f7ff640 1 -- 172.21.15.194:0/2660015814 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c4dd56660 con 0x564c4dd55d00 2024-09-13T06:10:18.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.347+0000 7f051f7ff640 1 --2- 172.21.15.194:0/2660015814 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564c4dd55d00 0x564c4dd56120 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f0510005790 tx=0x7f05100c6f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:18.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.347+0000 7f0409602640 1 -- 172.21.15.194:0/2660015814 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05100e9070 con 0x564c4dd55d00 2024-09-13T06:10:18.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.347+0000 7f0409602640 1 -- 172.21.15.194:0/2660015814 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05100cf6a0 con 0x564c4dd55d00 2024-09-13T06:10:18.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.347+0000 7f0521cef980 1 -- 172.21.15.194:0/2660015814 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564c4dd568f0 con 0x564c4dd55d00 2024-09-13T06:10:18.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.347+0000 7f0409602640 1 -- 172.21.15.194:0/2660015814 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05100e1410 con 0x564c4dd55d00 2024-09-13T06:10:18.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.347+0000 7f0521cef980 1 -- 172.21.15.194:0/2660015814 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c4dd59570 con 0x564c4dd55d00 2024-09-13T06:10:18.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.347+0000 7f0409602640 1 -- 172.21.15.194:0/2660015814 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f05100ec070 con 0x564c4dd55d00 2024-09-13T06:10:18.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.347+0000 7f0409602640 1 --2- 172.21.15.194:0/2660015814 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f03f8034650 0x7f03f8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:18.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.347+0000 7f0409602640 1 -- 172.21.15.194:0/2660015814 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f05100de070 con 0x564c4dd55d00 2024-09-13T06:10:18.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.351+0000 7f051effe640 1 --2- 172.21.15.194:0/2660015814 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f03f8034650 0x7f03f8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:18.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.351+0000 7f0521cef980 1 Processor -- start 2024-09-13T06:10:18.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.351+0000 7f0521cef980 1 -- start start 2024-09-13T06:10:18.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.351+0000 7f051effe640 1 --2- 172.21.15.194:0/2660015814 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f03f8034650 0x7f03f8036b10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x564c4dd3fdd0 tx=0x7f050800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:18.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.351+0000 7f0521cef980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564c4dd626c0 0x564c4dd62ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:18.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.351+0000 7f0521cef980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x564c4dd31460 con 0x564c4dd626c0 2024-09-13T06:10:18.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.351+0000 7f051f7ff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564c4dd626c0 0x564c4dd62ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:18.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.351+0000 7f051f7ff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564c4dd626c0 0x564c4dd62ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:50552/0 (socket says 172.21.15.194:50552) 2024-09-13T06:10:18.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.351+0000 7f051f7ff640 1 -- 172.21.15.194:0/2344340094 learned_addr learned my addr 172.21.15.194:0/2344340094 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:18.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.351+0000 7f051f7ff640 1 -- 172.21.15.194:0/2344340094 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c4dd63090 con 0x564c4dd626c0 2024-09-13T06:10:18.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.351+0000 7f051f7ff640 1 --2- 172.21.15.194:0/2344340094 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564c4dd626c0 0x564c4dd62ac0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f05100a9b80 tx=0x7f05100a9fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=683012b6b77e168 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:18.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.351+0000 7f0402ffd640 1 -- 172.21.15.194:0/2344340094 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05100bd530 con 0x564c4dd626c0 2024-09-13T06:10:18.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.351+0000 7f0402ffd640 1 -- 172.21.15.194:0/2344340094 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0510100070 con 0x564c4dd626c0 2024-09-13T06:10:18.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.351+0000 7f0402ffd640 1 -- 172.21.15.194:0/2344340094 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05100e1a10 con 0x564c4dd626c0 2024-09-13T06:10:18.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.351+0000 7f0521cef980 1 -- 172.21.15.194:0/2344340094 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564c4dd626c0 msgr2=0x564c4dd62ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:18.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.351+0000 7f0521cef980 1 --2- 172.21.15.194:0/2344340094 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564c4dd626c0 0x564c4dd62ac0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f05100a9b80 tx=0x7f05100a9fb0 comp rx=0 tx=0).stop 2024-09-13T06:10:18.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.351+0000 7f0521cef980 1 -- 172.21.15.194:0/2344340094 shutdown_connections 2024-09-13T06:10:18.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.351+0000 7f0521cef980 1 --2- 172.21.15.194:0/2344340094 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564c4dd626c0 0x564c4dd62ac0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:18.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.351+0000 7f0521cef980 1 -- 172.21.15.194:0/2344340094 >> 172.21.15.194:0/2344340094 conn(0x564c4dd5ea40 msgr2=0x564c4dd5cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:18.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.351+0000 7f0521cef980 1 -- 172.21.15.194:0/2344340094 shutdown_connections 2024-09-13T06:10:18.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.351+0000 7f0521cef980 1 -- 172.21.15.194:0/2344340094 wait complete. 2024-09-13T06:10:18.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.351+0000 7f0521cef980 1 Processor -- start 2024-09-13T06:10:18.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.351+0000 7f0521cef980 1 -- start start 2024-09-13T06:10:18.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.351+0000 7f0521cef980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564c4dd626c0 0x564c4dd697f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:18.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.351+0000 7f0521cef980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x564c4dd63450 con 0x564c4dd626c0 2024-09-13T06:10:18.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.351+0000 7f051f7ff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564c4dd626c0 0x564c4dd697f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:18.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.351+0000 7f051f7ff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564c4dd626c0 0x564c4dd697f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:50558/0 (socket says 172.21.15.194:50558) 2024-09-13T06:10:18.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.351+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 learned_addr learned my addr 172.21.15.194:0/3180362193 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:18.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.355+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c4dd69d30 con 0x564c4dd626c0 2024-09-13T06:10:18.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.355+0000 7f051f7ff640 1 --2- 172.21.15.194:0/3180362193 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564c4dd626c0 0x564c4dd697f0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f05100c8b30 tx=0x7f05100d6f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:18.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.355+0000 7f04017fa640 1 -- 172.21.15.194:0/3180362193 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05100d79f0 con 0x564c4dd626c0 2024-09-13T06:10:18.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.355+0000 7f04017fa640 1 -- 172.21.15.194:0/3180362193 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05100d7b90 con 0x564c4dd626c0 2024-09-13T06:10:18.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.355+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564c4dd69d30 con 0x564c4dd626c0 2024-09-13T06:10:18.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.355+0000 7f04017fa640 1 -- 172.21.15.194:0/3180362193 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05100d17a0 con 0x564c4dd626c0 2024-09-13T06:10:18.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.355+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c4dd69d30 con 0x564c4dd626c0 2024-09-13T06:10:18.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.355+0000 7f0521cef980 20 rados->read ofs=0 len=0 2024-09-13T06:10:18.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.355+0000 7f04017fa640 1 -- 172.21.15.194:0/3180362193 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f05100fa070 con 0x564c4dd626c0 2024-09-13T06:10:18.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.355+0000 7f04017fa640 1 --2- 172.21.15.194:0/3180362193 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f03e8034650 0x7f03e8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:18.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.355+0000 7f04017fa640 1 -- 172.21.15.194:0/3180362193 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f05100d6040 con 0x564c4dd626c0 2024-09-13T06:10:18.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.355+0000 7f051effe640 1 --2- 172.21.15.194:0/3180362193 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f03e8034650 0x7f03e8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:18.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.355+0000 7f0521cef980 1 --2- 172.21.15.194:0/3180362193 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x564c4dd74900 0x564c4dd76da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:18.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.355+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd774f0 con 0x564c4dd74900 2024-09-13T06:10:18.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.355+0000 7f0520000640 1 --2- 172.21.15.194:0/3180362193 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x564c4dd74900 0x564c4dd76da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:18.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.355+0000 7f051effe640 1 --2- 172.21.15.194:0/3180362193 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f03e8034650 0x7f03e8036b10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f050800c010 tx=0x7f0508010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:18.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.355+0000 7f0520000640 1 --2- 172.21.15.194:0/3180362193 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x564c4dd74900 0x564c4dd76da0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:18.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.355+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f05180083f0 con 0x564c4dd74900 2024-09-13T06:10:18.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.355+0000 7f0521cef980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:18.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.355+0000 7f0521cef980 20 realm 2024-09-13T06:10:18.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.355+0000 7f0521cef980 20 rados->read ofs=0 len=0 2024-09-13T06:10:18.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.355+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd77950 con 0x564c4dd74900 2024-09-13T06:10:18.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.355+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f05180083f0 con 0x564c4dd74900 2024-09-13T06:10:18.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.355+0000 7f0521cef980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:18.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.355+0000 7f0521cef980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:10:18.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.355+0000 7f0521cef980 20 rados->read ofs=0 len=0 2024-09-13T06:10:18.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.355+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd781f0 con 0x564c4dd74900 2024-09-13T06:10:18.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.359+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f05180083f0 con 0x564c4dd74900 2024-09-13T06:10:18.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.359+0000 7f0521cef980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:18.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.359+0000 7f0521cef980 20 rados->read ofs=0 len=0 2024-09-13T06:10:18.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.359+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd78590 con 0x564c4dd74900 2024-09-13T06:10:18.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.359+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f05180083f0 con 0x564c4dd74900 2024-09-13T06:10:18.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.359+0000 7f0521cef980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:10:18.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.359+0000 7f0521cef980 20 rados->read ofs=0 len=0 2024-09-13T06:10:18.365 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.359+0000 7f0521cef980 1 --2- 172.21.15.194:0/3180362193 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x564c4dd792f0 0x564c4dd7b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:18.365 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.359+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd7bc20 con 0x564c4dd792f0 2024-09-13T06:10:18.365 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.359+0000 7f051f7ff640 1 --2- 172.21.15.194:0/3180362193 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x564c4dd792f0 0x564c4dd7b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:18.365 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.359+0000 7f051f7ff640 1 --2- 172.21.15.194:0/3180362193 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x564c4dd792f0 0x564c4dd7b6e0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:18.365 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.359+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f05100f9030 con 0x564c4dd792f0 2024-09-13T06:10:18.365 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.359+0000 7f0521cef980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:10:18.365 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.359+0000 7f0521cef980 20 searching for the correct realm 2024-09-13T06:10:18.365 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.359+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd7d4c0 con 0x564c4dd792f0 2024-09-13T06:10:18.365 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.359+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05100f9030 con 0x564c4dd792f0 2024-09-13T06:10:18.365 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.359+0000 7f051f7ff640 1 --2- 172.21.15.194:0/3180362193 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f05100ee060 0x7f05100fb840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:18.365 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.359+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd7d4c0 con 0x7f05100ee060 2024-09-13T06:10:18.365 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.359+0000 7f051effe640 1 --2- 172.21.15.194:0/3180362193 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f05100ee060 0x7f05100fb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:18.366 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.359+0000 7f051effe640 1 --2- 172.21.15.194:0/3180362193 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f05100ee060 0x7f05100fb840 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:18.366 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.359+0000 7f051effe640 1 -- 172.21.15.194:0/3180362193 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0508037040 con 0x7f05100ee060 2024-09-13T06:10:18.366 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.359+0000 7f051effe640 1 --2- 172.21.15.194:0/3180362193 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f050801fbe0 0x7f050803a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:18.366 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.359+0000 7f051effe640 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd7d4c0 con 0x7f050801fbe0 2024-09-13T06:10:18.366 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.359+0000 7f0520000640 1 --2- 172.21.15.194:0/3180362193 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f050801fbe0 0x7f050803a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:18.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.359+0000 7f0520000640 1 --2- 172.21.15.194:0/3180362193 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f050801fbe0 0x7f050803a3c0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:18.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.363+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05180083f0 con 0x7f050801fbe0 2024-09-13T06:10:18.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.363+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd78590 con 0x564c4dd74900 2024-09-13T06:10:18.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.363+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05180083f0 con 0x564c4dd74900 2024-09-13T06:10:18.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.363+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd78590 con 0x564c4dd74900 2024-09-13T06:10:18.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.363+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05180083f0 con 0x564c4dd74900 2024-09-13T06:10:18.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.363+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd78590 con 0x7f050801fbe0 2024-09-13T06:10:18.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.363+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05180083f0 con 0x7f050801fbe0 2024-09-13T06:10:18.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.363+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd78590 con 0x7f050801fbe0 2024-09-13T06:10:18.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.363+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05180083f0 con 0x7f050801fbe0 2024-09-13T06:10:18.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.363+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd78590 con 0x7f05100ee060 2024-09-13T06:10:18.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.363+0000 7f051effe640 1 -- 172.21.15.194:0/3180362193 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0508037040 con 0x7f05100ee060 2024-09-13T06:10:18.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.363+0000 7f051effe640 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd78590 con 0x564c4dd792f0 2024-09-13T06:10:18.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.363+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05100f9030 con 0x564c4dd792f0 2024-09-13T06:10:18.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.363+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd78590 con 0x564c4dd74900 2024-09-13T06:10:18.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.363+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05180083f0 con 0x564c4dd74900 2024-09-13T06:10:18.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.363+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd78590 con 0x7f050801fbe0 2024-09-13T06:10:18.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.363+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05180083f0 con 0x7f050801fbe0 2024-09-13T06:10:18.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.363+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd78590 con 0x564c4dd74900 2024-09-13T06:10:18.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.367+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05180083f0 con 0x564c4dd74900 2024-09-13T06:10:18.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.367+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd78590 con 0x7f05100ee060 2024-09-13T06:10:18.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.367+0000 7f051effe640 1 -- 172.21.15.194:0/3180362193 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0508037040 con 0x7f05100ee060 2024-09-13T06:10:18.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.367+0000 7f051effe640 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd78590 con 0x564c4dd792f0 2024-09-13T06:10:18.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.367+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05100f9030 con 0x564c4dd792f0 2024-09-13T06:10:18.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.367+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd78590 con 0x564c4dd792f0 2024-09-13T06:10:18.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.367+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05100f9030 con 0x564c4dd792f0 2024-09-13T06:10:18.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.367+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd78590 con 0x7f050801fbe0 2024-09-13T06:10:18.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.367+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05180083f0 con 0x7f050801fbe0 2024-09-13T06:10:18.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.367+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd78590 con 0x564c4dd792f0 2024-09-13T06:10:18.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.367+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05100f9030 con 0x564c4dd792f0 2024-09-13T06:10:18.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.367+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd78590 con 0x564c4dd792f0 2024-09-13T06:10:18.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.367+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05100f9030 con 0x564c4dd792f0 2024-09-13T06:10:18.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.367+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd78590 con 0x564c4dd74900 2024-09-13T06:10:18.373 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.367+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05180083f0 con 0x564c4dd74900 2024-09-13T06:10:18.373 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.367+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd78590 con 0x564c4dd74900 2024-09-13T06:10:18.373 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.367+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f05180083f0 con 0x564c4dd74900 2024-09-13T06:10:18.373 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.367+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd78590 con 0x7f05100ee060 2024-09-13T06:10:18.373 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.367+0000 7f051effe640 1 -- 172.21.15.194:0/3180362193 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0508037040 con 0x7f05100ee060 2024-09-13T06:10:18.373 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.367+0000 7f051effe640 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd78590 con 0x564c4dd792f0 2024-09-13T06:10:18.373 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.367+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05100f9030 con 0x564c4dd792f0 2024-09-13T06:10:18.373 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.367+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd78590 con 0x7f05100ee060 2024-09-13T06:10:18.373 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.367+0000 7f051effe640 1 -- 172.21.15.194:0/3180362193 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0508037040 con 0x7f05100ee060 2024-09-13T06:10:18.373 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.367+0000 7f051effe640 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd78590 con 0x564c4dd74900 2024-09-13T06:10:18.373 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.371+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05180083f0 con 0x564c4dd74900 2024-09-13T06:10:18.373 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.371+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd78590 con 0x7f050801fbe0 2024-09-13T06:10:18.377 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.371+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05180083f0 con 0x7f050801fbe0 2024-09-13T06:10:18.377 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.371+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd78590 con 0x564c4dd792f0 2024-09-13T06:10:18.377 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.371+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f05100f9030 con 0x564c4dd792f0 2024-09-13T06:10:18.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.371+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd78590 con 0x7f05100ee060 2024-09-13T06:10:18.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.371+0000 7f051effe640 1 -- 172.21.15.194:0/3180362193 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0508037040 con 0x7f05100ee060 2024-09-13T06:10:18.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.371+0000 7f051effe640 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd78590 con 0x7f05100ee060 2024-09-13T06:10:18.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.371+0000 7f051effe640 1 -- 172.21.15.194:0/3180362193 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f050804a040 con 0x7f05100ee060 2024-09-13T06:10:18.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.371+0000 7f051effe640 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd78590 con 0x564c4dd792f0 2024-09-13T06:10:18.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.371+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05100f9030 con 0x564c4dd792f0 2024-09-13T06:10:18.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.371+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd78590 con 0x7f050801fbe0 2024-09-13T06:10:18.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.371+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05180083f0 con 0x7f050801fbe0 2024-09-13T06:10:18.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.371+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd78590 con 0x564c4dd74900 2024-09-13T06:10:18.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.371+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f05180083f0 con 0x564c4dd74900 2024-09-13T06:10:18.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.371+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd78590 con 0x7f05100ee060 2024-09-13T06:10:18.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.371+0000 7f051effe640 1 -- 172.21.15.194:0/3180362193 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f050804a040 con 0x7f05100ee060 2024-09-13T06:10:18.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.371+0000 7f0521cef980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:10:18.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.371+0000 7f0521cef980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:10:18.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.371+0000 7f0521cef980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:10:18.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.371+0000 7f0521cef980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:10:18.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.371+0000 7f0521cef980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:10:18.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.371+0000 7f0521cef980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:10:18.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.371+0000 7f0521cef980 20 rados->read ofs=0 len=0 2024-09-13T06:10:18.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.371+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd7c470 con 0x564c4dd74900 2024-09-13T06:10:18.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.371+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f05180083f0 con 0x564c4dd74900 2024-09-13T06:10:18.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.371+0000 7f0521cef980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:18.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.371+0000 7f0521cef980 20 rados->read ofs=0 len=0 2024-09-13T06:10:18.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.371+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd7c860 con 0x564c4dd74900 2024-09-13T06:10:18.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.371+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f05180083f0 con 0x564c4dd74900 2024-09-13T06:10:18.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.371+0000 7f0521cef980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:10:18.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.371+0000 7f0521cef980 20 rados->read ofs=0 len=0 2024-09-13T06:10:18.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.371+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd7c860 con 0x7f05100ee060 2024-09-13T06:10:18.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.375+0000 7f051effe640 1 -- 172.21.15.194:0/3180362193 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f050804a040 con 0x7f05100ee060 2024-09-13T06:10:18.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.375+0000 7f0521cef980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:10:18.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.375+0000 7f0521cef980 20 zone default found 2024-09-13T06:10:18.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.375+0000 7f0521cef980 4 Realm: () 2024-09-13T06:10:18.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.375+0000 7f0521cef980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:10:18.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.375+0000 7f0521cef980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:10:18.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.375+0000 7f0521cef980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:10:18.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.375+0000 7f0521cef980 20 zonegroup default 2024-09-13T06:10:18.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.375+0000 7f0521cef980 20 rados->read ofs=0 len=0 2024-09-13T06:10:18.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.375+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd7d990 con 0x7f050801fbe0 2024-09-13T06:10:18.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.375+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f05180083f0 con 0x7f050801fbe0 2024-09-13T06:10:18.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.375+0000 7f0521cef980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:18.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.375+0000 7f0521cef980 20 rados->read ofs=0 len=0 2024-09-13T06:10:18.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.375+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd7f370 con 0x564c4dd792f0 2024-09-13T06:10:18.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.375+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f05100f9030 con 0x564c4dd792f0 2024-09-13T06:10:18.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.375+0000 7f0521cef980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:18.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.375+0000 7f0521cef980 20 rados->read ofs=0 len=0 2024-09-13T06:10:18.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.375+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd7f710 con 0x564c4dd792f0 2024-09-13T06:10:18.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.375+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f05100f9030 con 0x564c4dd792f0 2024-09-13T06:10:18.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.375+0000 7f0521cef980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:18.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.375+0000 7f0521cef980 20 started sync module instance, tier type = 2024-09-13T06:10:18.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.375+0000 7f0521cef980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:10:18.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.375+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd7e810 con 0x7f05100ee060 2024-09-13T06:10:18.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.375+0000 7f051effe640 1 -- 172.21.15.194:0/3180362193 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(44 notify.0 [create] v35'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f050804a040 con 0x7f05100ee060 2024-09-13T06:10:18.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.375+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94885723499568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd7ffb0 con 0x7f05100ee060 2024-09-13T06:10:18.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.375+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd80800 con 0x564c4dd74900 2024-09-13T06:10:18.383 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.379+0000 7f051effe640 1 -- 172.21.15.194:0/3180362193 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94885723499568] v35'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f050804a040 con 0x7f05100ee060 2024-09-13T06:10:18.383 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.379+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v35'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05180083f0 con 0x564c4dd74900 2024-09-13T06:10:18.383 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.379+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94885723503360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd80800 con 0x564c4dd74900 2024-09-13T06:10:18.383 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.379+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd812a0 con 0x564c4dd792f0 2024-09-13T06:10:18.383 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.379+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94885723503360] v35'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05180083f0 con 0x564c4dd74900 2024-09-13T06:10:18.383 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.379+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v35'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05100f9030 con 0x564c4dd792f0 2024-09-13T06:10:18.383 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.379+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94885723508080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd80800 con 0x564c4dd792f0 2024-09-13T06:10:18.383 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.379+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd81cb0 con 0x7f05100ee060 2024-09-13T06:10:18.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.383+0000 7f051effe640 1 -- 172.21.15.194:0/3180362193 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(50 notify.3 [create] v35'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f050804a040 con 0x7f05100ee060 2024-09-13T06:10:18.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.383+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94885723510784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd82550 con 0x7f05100ee060 2024-09-13T06:10:18.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.383+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd82f50 con 0x564c4dd74900 2024-09-13T06:10:18.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.383+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94885723508080] v35'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05100f9030 con 0x564c4dd792f0 2024-09-13T06:10:18.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.383+0000 7f051effe640 1 -- 172.21.15.194:0/3180362193 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94885723510784] v35'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f050804a040 con 0x7f05100ee060 2024-09-13T06:10:18.385 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.383+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v35'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05180083f0 con 0x564c4dd74900 2024-09-13T06:10:18.385 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.383+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94885723512992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd82a60 con 0x564c4dd74900 2024-09-13T06:10:18.385 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.383+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd837f0 con 0x7f050801fbe0 2024-09-13T06:10:18.387 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.387+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94885723512992] v35'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05180083f0 con 0x564c4dd74900 2024-09-13T06:10:18.387 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.387+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(54 notify.5 [create] v35'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05180083f0 con 0x7f050801fbe0 2024-09-13T06:10:18.387 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.387+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94885723505488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd83750 con 0x7f050801fbe0 2024-09-13T06:10:18.388 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.387+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd84020 con 0x7f050801fbe0 2024-09-13T06:10:18.389 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.387+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94885723505488] v35'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05180083f0 con 0x7f050801fbe0 2024-09-13T06:10:18.390 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.391+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(56 notify.6 [create] v35'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05180083f0 con 0x7f050801fbe0 2024-09-13T06:10:18.390 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.391+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94885723517600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd84130 con 0x7f050801fbe0 2024-09-13T06:10:18.390 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.391+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd84980 con 0x7f050801fbe0 2024-09-13T06:10:18.392 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.391+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94885723517600] v35'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05180083f0 con 0x7f050801fbe0 2024-09-13T06:10:18.392 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.391+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(58 notify.7 [create] v35'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05180083f0 con 0x7f050801fbe0 2024-09-13T06:10:18.392 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.391+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94885723521328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd84a00 con 0x7f050801fbe0 2024-09-13T06:10:18.393 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.391+0000 7f0521cef980 20 add_watcher() i=0 2024-09-13T06:10:18.393 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.391+0000 7f0521cef980 20 add_watcher() i=1 2024-09-13T06:10:18.393 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.391+0000 7f0521cef980 20 add_watcher() i=2 2024-09-13T06:10:18.393 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.391+0000 7f0521cef980 20 add_watcher() i=3 2024-09-13T06:10:18.393 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.391+0000 7f0521cef980 20 add_watcher() i=4 2024-09-13T06:10:18.393 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.391+0000 7f0521cef980 20 add_watcher() i=5 2024-09-13T06:10:18.393 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.391+0000 7f0521cef980 20 add_watcher() i=6 2024-09-13T06:10:18.395 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.395+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94885723521328] v35'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05180083f0 con 0x7f050801fbe0 2024-09-13T06:10:18.395 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.395+0000 7f0521cef980 20 add_watcher() i=7 2024-09-13T06:10:18.395 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.395+0000 7f0521cef980 2 all 8 watchers are set, enabling cache 2024-09-13T06:10:18.395 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.395+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd87d30 con 0x564c4dd74900 2024-09-13T06:10:18.395 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.395+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f05180083f0 con 0x564c4dd74900 2024-09-13T06:10:18.395 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.395+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94885723535136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd84b70 con 0x564c4dd74900 2024-09-13T06:10:18.397 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.395+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94885723535136] v35'168 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f05180083f0 con 0x564c4dd74900 2024-09-13T06:10:18.397 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.395+0000 7f03d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:10:18.397 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.395+0000 7f0521cef980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:10:18.397 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.395+0000 7f0521cef980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:10:18.397 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.395+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd86f10 con 0x564c4dd74900 2024-09-13T06:10:18.399 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.399+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v35'29 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f05180083f0 con 0x564c4dd74900 2024-09-13T06:10:18.399 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.399+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd90df0 con 0x7f050801fbe0 2024-09-13T06:10:18.401 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.399+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v35'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f05180083f0 con 0x7f050801fbe0 2024-09-13T06:10:18.401 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.399+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd912a0 con 0x564c4dd792f0 2024-09-13T06:10:18.402 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.403+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v35'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f05100f9030 con 0x564c4dd792f0 2024-09-13T06:10:18.402 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.403+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd912a0 con 0x564c4dd74900 2024-09-13T06:10:18.403 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.403+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v35'169 uv164 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f05180083f0 con 0x564c4dd74900 2024-09-13T06:10:18.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.403+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd91470 con 0x7f05100ee060 2024-09-13T06:10:18.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.403+0000 7f051effe640 1 -- 172.21.15.194:0/3180362193 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v35'56 uv53 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f050804a040 con 0x7f05100ee060 2024-09-13T06:10:18.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.403+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd919e0 con 0x564c4dd792f0 2024-09-13T06:10:18.406 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.407+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 <== osd.3 v2:172.21.15.194:6816/96632515 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v35'38 uv37 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f05100f9030 con 0x564c4dd792f0 2024-09-13T06:10:18.406 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.407+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd919e0 con 0x564c4dd74900 2024-09-13T06:10:18.408 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.407+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v35'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f05180083f0 con 0x564c4dd74900 2024-09-13T06:10:18.408 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.407+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd91a70 con 0x7f050801fbe0 2024-09-13T06:10:18.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.411+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v35'37 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f05180083f0 con 0x7f050801fbe0 2024-09-13T06:10:18.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.411+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd91b00 con 0x7f05100ee060 2024-09-13T06:10:18.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.411+0000 7f051effe640 1 -- 172.21.15.194:0/3180362193 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v35'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f050804a040 con 0x7f05100ee060 2024-09-13T06:10:18.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.411+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd92090 con 0x564c4dd792f0 2024-09-13T06:10:18.414 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.411+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 <== osd.3 v2:172.21.15.194:6816/96632515 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v35'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f05100f9030 con 0x564c4dd792f0 2024-09-13T06:10:18.414 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.411+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd92090 con 0x7f05100ee060 2024-09-13T06:10:18.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.415+0000 7f051effe640 1 -- 172.21.15.194:0/3180362193 <== osd.2 v2:172.21.15.194:6800/815615585 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v35'57 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f050804a040 con 0x7f05100ee060 2024-09-13T06:10:18.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.415+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd92540 con 0x7f050801fbe0 2024-09-13T06:10:18.417 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.415+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v35'25 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05180083f0 con 0x7f050801fbe0 2024-09-13T06:10:18.417 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.415+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd92540 con 0x7f05100ee060 2024-09-13T06:10:18.418 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.419+0000 7f051effe640 1 -- 172.21.15.194:0/3180362193 <== osd.2 v2:172.21.15.194:6800/815615585 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v35'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f050804a040 con 0x7f05100ee060 2024-09-13T06:10:18.418 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.419+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd92540 con 0x7f050801fbe0 2024-09-13T06:10:18.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.419+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v35'43 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05180083f0 con 0x7f050801fbe0 2024-09-13T06:10:18.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.419+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd92540 con 0x564c4dd74900 2024-09-13T06:10:18.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.423+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v35'170 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05180083f0 con 0x564c4dd74900 2024-09-13T06:10:18.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.423+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd92540 con 0x564c4dd792f0 2024-09-13T06:10:18.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.423+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 <== osd.3 v2:172.21.15.194:6816/96632515 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v35'50 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05100f9030 con 0x564c4dd792f0 2024-09-13T06:10:18.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.423+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd92540 con 0x7f05100ee060 2024-09-13T06:10:18.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.423+0000 7f051effe640 1 -- 172.21.15.194:0/3180362193 <== osd.2 v2:172.21.15.194:6800/815615585 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v35'58 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f050804a040 con 0x7f05100ee060 2024-09-13T06:10:18.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.423+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd925d0 con 0x564c4dd792f0 2024-09-13T06:10:18.427 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.427+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 <== osd.3 v2:172.21.15.194:6816/96632515 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v35'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05100f9030 con 0x564c4dd792f0 2024-09-13T06:10:18.427 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.427+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd925d0 con 0x564c4dd74900 2024-09-13T06:10:18.429 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.427+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.1 v2:172.21.15.194:6808/3135444559 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v35'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05180083f0 con 0x564c4dd74900 2024-09-13T06:10:18.429 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.427+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd925d0 con 0x564c4dd74900 2024-09-13T06:10:18.430 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.431+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.1 v2:172.21.15.194:6808/3135444559 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v35'171 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05180083f0 con 0x564c4dd74900 2024-09-13T06:10:18.430 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.431+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd92630 con 0x564c4dd792f0 2024-09-13T06:10:18.432 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.431+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 <== osd.3 v2:172.21.15.194:6816/96632515 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v35'51 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05100f9030 con 0x564c4dd792f0 2024-09-13T06:10:18.432 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.431+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd92630 con 0x7f05100ee060 2024-09-13T06:10:18.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.431+0000 7f051effe640 1 -- 172.21.15.194:0/3180362193 <== osd.2 v2:172.21.15.194:6800/815615585 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v35'32 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f050804a040 con 0x7f05100ee060 2024-09-13T06:10:18.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.431+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd925d0 con 0x564c4dd792f0 2024-09-13T06:10:18.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.435+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 <== osd.3 v2:172.21.15.194:6816/96632515 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v35'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05100f9030 con 0x564c4dd792f0 2024-09-13T06:10:18.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.435+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd92600 con 0x564c4dd792f0 2024-09-13T06:10:18.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.435+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 <== osd.3 v2:172.21.15.194:6816/96632515 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v35'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05100f9030 con 0x564c4dd792f0 2024-09-13T06:10:18.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.435+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd92600 con 0x564c4dd792f0 2024-09-13T06:10:18.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.435+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 <== osd.3 v2:172.21.15.194:6816/96632515 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v35'18 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05100f9030 con 0x564c4dd792f0 2024-09-13T06:10:18.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.435+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd925d0 con 0x564c4dd792f0 2024-09-13T06:10:18.439 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.439+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 <== osd.3 v2:172.21.15.194:6816/96632515 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v35'39 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05100f9030 con 0x564c4dd792f0 2024-09-13T06:10:18.439 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.439+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd925f0 con 0x7f050801fbe0 2024-09-13T06:10:18.441 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.439+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v35'26 uv25 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05180083f0 con 0x7f050801fbe0 2024-09-13T06:10:18.441 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.439+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd925f0 con 0x564c4dd792f0 2024-09-13T06:10:18.442 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.443+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 <== osd.3 v2:172.21.15.194:6816/96632515 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v35'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05100f9030 con 0x564c4dd792f0 2024-09-13T06:10:18.442 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.443+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd925f0 con 0x7f050801fbe0 2024-09-13T06:10:18.445 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.443+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.0 v2:172.21.15.120:6800/1923744619 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v35'38 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05180083f0 con 0x7f050801fbe0 2024-09-13T06:10:18.445 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.443+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd925f0 con 0x564c4dd792f0 2024-09-13T06:10:18.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.447+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 <== osd.3 v2:172.21.15.194:6816/96632515 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v35'52 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05100f9030 con 0x564c4dd792f0 2024-09-13T06:10:18.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.447+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd925f0 con 0x7f050801fbe0 2024-09-13T06:10:18.450 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.447+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.0 v2:172.21.15.120:6800/1923744619 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v35'44 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f05180083f0 con 0x7f050801fbe0 2024-09-13T06:10:18.450 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.447+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd925f0 con 0x7f05100ee060 2024-09-13T06:10:18.452 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.451+0000 7f051effe640 1 -- 172.21.15.194:0/3180362193 <== osd.2 v2:172.21.15.194:6800/815615585 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v35'29 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f050804a040 con 0x7f05100ee060 2024-09-13T06:10:18.452 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.451+0000 7f03d4fe1640 20 reqs_thread_entry: start 2024-09-13T06:10:18.453 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.451+0000 7f0521cef980 20 init_complete bucket index max shards: 11 2024-09-13T06:10:18.453 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.451+0000 7f0521cef980 20 Filter name: none 2024-09-13T06:10:18.453 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.451+0000 7f034e7fc640 20 reqs_thread_entry: start 2024-09-13T06:10:18.453 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.451+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4ddae570 con 0x564c4dd74900 2024-09-13T06:10:18.454 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.451+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.1 v2:172.21.15.194:6808/3135444559 27 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv28 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f05180083f0 con 0x564c4dd74900 2024-09-13T06:10:18.454 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.451+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd8f060 con 0x564c4dd74900 2024-09-13T06:10:18.454 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.451+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.1 v2:172.21.15.194:6808/3135444559 28 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv28 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f05180083f0 con 0x564c4dd74900 2024-09-13T06:10:18.454 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.451+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd8f060 con 0x564c4dd74900 2024-09-13T06:10:18.454 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.451+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.1 v2:172.21.15.194:6808/3135444559 29 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv28 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f05180083f0 con 0x564c4dd74900 2024-09-13T06:10:18.454 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.451+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd8f060 con 0x7f050801fbe0 2024-09-13T06:10:18.455 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.455+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.0 v2:172.21.15.120:6800/1923744619 22 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f05180083f0 con 0x7f050801fbe0 2024-09-13T06:10:18.455 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.455+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd8f060 con 0x7f050801fbe0 2024-09-13T06:10:18.456 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.455+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.0 v2:172.21.15.120:6800/1923744619 23 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f05180083f0 con 0x7f050801fbe0 2024-09-13T06:10:18.456 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.455+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd8f060 con 0x7f050801fbe0 2024-09-13T06:10:18.457 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.455+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.0 v2:172.21.15.120:6800/1923744619 24 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f05180083f0 con 0x7f050801fbe0 2024-09-13T06:10:18.457 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.455+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd8f060 con 0x564c4dd792f0 2024-09-13T06:10:18.457 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.455+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 <== osd.3 v2:172.21.15.194:6816/96632515 27 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f05100f9030 con 0x564c4dd792f0 2024-09-13T06:10:18.457 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.455+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd8f060 con 0x564c4dd792f0 2024-09-13T06:10:18.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.455+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 <== osd.3 v2:172.21.15.194:6816/96632515 28 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f05100f9030 con 0x564c4dd792f0 2024-09-13T06:10:18.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.455+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd8f060 con 0x564c4dd792f0 2024-09-13T06:10:18.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.459+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 <== osd.3 v2:172.21.15.194:6816/96632515 29 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f05100f9030 con 0x564c4dd792f0 2024-09-13T06:10:18.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.459+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd8f060 con 0x564c4dd74900 2024-09-13T06:10:18.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.459+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.1 v2:172.21.15.194:6808/3135444559 30 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv164 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f05180083f0 con 0x564c4dd74900 2024-09-13T06:10:18.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.459+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd8f060 con 0x564c4dd74900 2024-09-13T06:10:18.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.459+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.1 v2:172.21.15.194:6808/3135444559 31 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv164 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f05180083f0 con 0x564c4dd74900 2024-09-13T06:10:18.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.459+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd8f060 con 0x564c4dd74900 2024-09-13T06:10:18.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.459+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.1 v2:172.21.15.194:6808/3135444559 32 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv164 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f05180083f0 con 0x564c4dd74900 2024-09-13T06:10:18.460 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.459+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd8f060 con 0x7f05100ee060 2024-09-13T06:10:18.460 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.459+0000 7f051effe640 1 -- 172.21.15.194:0/3180362193 <== osd.2 v2:172.21.15.194:6800/815615585 21 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv53 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f050804a040 con 0x7f05100ee060 2024-09-13T06:10:18.460 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.459+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd8f060 con 0x7f05100ee060 2024-09-13T06:10:18.460 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.459+0000 7f051effe640 1 -- 172.21.15.194:0/3180362193 <== osd.2 v2:172.21.15.194:6800/815615585 22 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv53 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f050804a040 con 0x7f05100ee060 2024-09-13T06:10:18.460 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.459+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd8f060 con 0x7f05100ee060 2024-09-13T06:10:18.461 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.459+0000 7f051effe640 1 -- 172.21.15.194:0/3180362193 <== osd.2 v2:172.21.15.194:6800/815615585 23 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv53 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f050804a040 con 0x7f05100ee060 2024-09-13T06:10:18.461 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.459+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd8f060 con 0x564c4dd792f0 2024-09-13T06:10:18.463 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.459+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 <== osd.3 v2:172.21.15.194:6816/96632515 30 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv37 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f05100f9030 con 0x564c4dd792f0 2024-09-13T06:10:18.463 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.459+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd8f060 con 0x564c4dd792f0 2024-09-13T06:10:18.463 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.459+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 <== osd.3 v2:172.21.15.194:6816/96632515 31 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv37 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f05100f9030 con 0x564c4dd792f0 2024-09-13T06:10:18.463 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.459+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd8f060 con 0x564c4dd792f0 2024-09-13T06:10:18.463 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.459+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 <== osd.3 v2:172.21.15.194:6816/96632515 32 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv37 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f05100f9030 con 0x564c4dd792f0 2024-09-13T06:10:18.463 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.459+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd8f060 con 0x564c4dd74900 2024-09-13T06:10:18.463 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.459+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.1 v2:172.21.15.194:6808/3135444559 33 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f05180083f0 con 0x564c4dd74900 2024-09-13T06:10:18.463 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.459+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd8f060 con 0x564c4dd74900 2024-09-13T06:10:18.463 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.463+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.1 v2:172.21.15.194:6808/3135444559 34 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv23 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f05180083f0 con 0x564c4dd74900 2024-09-13T06:10:18.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.463+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd8f060 con 0x564c4dd74900 2024-09-13T06:10:18.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.463+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.1 v2:172.21.15.194:6808/3135444559 35 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f05180083f0 con 0x564c4dd74900 2024-09-13T06:10:18.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.463+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd8f060 con 0x7f050801fbe0 2024-09-13T06:10:18.465 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.463+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.0 v2:172.21.15.120:6800/1923744619 25 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f05180083f0 con 0x7f050801fbe0 2024-09-13T06:10:18.465 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.463+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd8f060 con 0x7f050801fbe0 2024-09-13T06:10:18.465 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.463+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.0 v2:172.21.15.120:6800/1923744619 26 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv36 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f05180083f0 con 0x7f050801fbe0 2024-09-13T06:10:18.465 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.463+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd8f060 con 0x7f050801fbe0 2024-09-13T06:10:18.466 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.463+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.0 v2:172.21.15.120:6800/1923744619 27 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f05180083f0 con 0x7f050801fbe0 2024-09-13T06:10:18.467 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.463+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd8f060 con 0x7f05100ee060 2024-09-13T06:10:18.467 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.467+0000 7f051effe640 1 -- 172.21.15.194:0/3180362193 <== osd.2 v2:172.21.15.194:6800/815615585 24 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f050804a040 con 0x7f05100ee060 2024-09-13T06:10:18.467 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.467+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd8f060 con 0x7f05100ee060 2024-09-13T06:10:18.467 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.467+0000 7f051effe640 1 -- 172.21.15.194:0/3180362193 <== osd.2 v2:172.21.15.194:6800/815615585 25 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f050804a040 con 0x7f05100ee060 2024-09-13T06:10:18.467 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.467+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd8f060 con 0x7f05100ee060 2024-09-13T06:10:18.471 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.467+0000 7f051effe640 1 -- 172.21.15.194:0/3180362193 <== osd.2 v2:172.21.15.194:6800/815615585 26 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f050804a040 con 0x7f05100ee060 2024-09-13T06:10:18.471 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.467+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd8f060 con 0x564c4dd792f0 2024-09-13T06:10:18.471 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.467+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 <== osd.3 v2:172.21.15.194:6816/96632515 33 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f05100f9030 con 0x564c4dd792f0 2024-09-13T06:10:18.471 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.467+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd8f060 con 0x564c4dd792f0 2024-09-13T06:10:18.471 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.467+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 <== osd.3 v2:172.21.15.194:6816/96632515 34 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f05100f9030 con 0x564c4dd792f0 2024-09-13T06:10:18.471 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.467+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd8f060 con 0x564c4dd792f0 2024-09-13T06:10:18.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.467+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 <== osd.3 v2:172.21.15.194:6816/96632515 35 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f05100f9030 con 0x564c4dd792f0 2024-09-13T06:10:18.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.467+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd8f060 con 0x7f05100ee060 2024-09-13T06:10:18.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.467+0000 7f051effe640 1 -- 172.21.15.194:0/3180362193 <== osd.2 v2:172.21.15.194:6800/815615585 27 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f050804a040 con 0x7f05100ee060 2024-09-13T06:10:18.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.467+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd8f060 con 0x7f05100ee060 2024-09-13T06:10:18.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.467+0000 7f051effe640 1 -- 172.21.15.194:0/3180362193 <== osd.2 v2:172.21.15.194:6800/815615585 28 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv55 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f050804a040 con 0x7f05100ee060 2024-09-13T06:10:18.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.467+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd8f060 con 0x7f05100ee060 2024-09-13T06:10:18.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.467+0000 7f051effe640 1 -- 172.21.15.194:0/3180362193 <== osd.2 v2:172.21.15.194:6800/815615585 29 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f050804a040 con 0x7f05100ee060 2024-09-13T06:10:18.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.467+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd8f060 con 0x7f050801fbe0 2024-09-13T06:10:18.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.471+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.0 v2:172.21.15.120:6800/1923744619 28 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f05180083f0 con 0x7f050801fbe0 2024-09-13T06:10:18.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.471+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd8f060 con 0x7f050801fbe0 2024-09-13T06:10:18.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.471+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.0 v2:172.21.15.120:6800/1923744619 29 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv24 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f05180083f0 con 0x7f050801fbe0 2024-09-13T06:10:18.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.471+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4ddae570 con 0x7f050801fbe0 2024-09-13T06:10:18.475 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.471+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.0 v2:172.21.15.120:6800/1923744619 30 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f05180083f0 con 0x7f050801fbe0 2024-09-13T06:10:18.475 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.471+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4ddae570 con 0x7f05100ee060 2024-09-13T06:10:18.475 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.471+0000 7f051effe640 1 -- 172.21.15.194:0/3180362193 <== osd.2 v2:172.21.15.194:6800/815615585 30 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f050804a040 con 0x7f05100ee060 2024-09-13T06:10:18.475 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.471+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd8f060 con 0x7f05100ee060 2024-09-13T06:10:18.475 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.471+0000 7f051effe640 1 -- 172.21.15.194:0/3180362193 <== osd.2 v2:172.21.15.194:6800/815615585 31 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f050804a040 con 0x7f05100ee060 2024-09-13T06:10:18.475 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.471+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4ddae570 con 0x7f05100ee060 2024-09-13T06:10:18.475 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.471+0000 7f051effe640 1 -- 172.21.15.194:0/3180362193 <== osd.2 v2:172.21.15.194:6800/815615585 32 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f050804a040 con 0x7f05100ee060 2024-09-13T06:10:18.475 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.471+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4ddae570 con 0x7f050801fbe0 2024-09-13T06:10:18.475 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.471+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.0 v2:172.21.15.120:6800/1923744619 31 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f05180083f0 con 0x7f050801fbe0 2024-09-13T06:10:18.475 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.471+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd8f060 con 0x7f050801fbe0 2024-09-13T06:10:18.475 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.475+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.0 v2:172.21.15.120:6800/1923744619 32 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f05180083f0 con 0x7f050801fbe0 2024-09-13T06:10:18.475 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.475+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4ddae570 con 0x7f050801fbe0 2024-09-13T06:10:18.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.475+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.0 v2:172.21.15.120:6800/1923744619 33 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f05180083f0 con 0x7f050801fbe0 2024-09-13T06:10:18.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.475+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4ddae570 con 0x564c4dd74900 2024-09-13T06:10:18.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.475+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.1 v2:172.21.15.194:6808/3135444559 36 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv166 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f05180083f0 con 0x564c4dd74900 2024-09-13T06:10:18.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.475+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd8f060 con 0x564c4dd74900 2024-09-13T06:10:18.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.475+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.1 v2:172.21.15.194:6808/3135444559 37 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv166 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f05180083f0 con 0x564c4dd74900 2024-09-13T06:10:18.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.475+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4ddae570 con 0x564c4dd74900 2024-09-13T06:10:18.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.475+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.1 v2:172.21.15.194:6808/3135444559 38 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv166 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f05180083f0 con 0x564c4dd74900 2024-09-13T06:10:18.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.475+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4ddae570 con 0x564c4dd792f0 2024-09-13T06:10:18.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.475+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 <== osd.3 v2:172.21.15.194:6816/96632515 36 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f05100f9030 con 0x564c4dd792f0 2024-09-13T06:10:18.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.475+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd8f060 con 0x564c4dd792f0 2024-09-13T06:10:18.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.475+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 <== osd.3 v2:172.21.15.194:6816/96632515 37 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv49 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f05100f9030 con 0x564c4dd792f0 2024-09-13T06:10:18.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.475+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4ddae570 con 0x564c4dd792f0 2024-09-13T06:10:18.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.475+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 <== osd.3 v2:172.21.15.194:6816/96632515 38 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f05100f9030 con 0x564c4dd792f0 2024-09-13T06:10:18.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.475+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4ddae570 con 0x7f05100ee060 2024-09-13T06:10:18.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.479+0000 7f051effe640 1 -- 172.21.15.194:0/3180362193 <== osd.2 v2:172.21.15.194:6800/815615585 33 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f050804a040 con 0x7f05100ee060 2024-09-13T06:10:18.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.479+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd8f060 con 0x7f05100ee060 2024-09-13T06:10:18.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.479+0000 7f051effe640 1 -- 172.21.15.194:0/3180362193 <== osd.2 v2:172.21.15.194:6800/815615585 34 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv51 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f050804a040 con 0x7f05100ee060 2024-09-13T06:10:18.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.479+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4ddae570 con 0x7f05100ee060 2024-09-13T06:10:18.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.479+0000 7f051effe640 1 -- 172.21.15.194:0/3180362193 <== osd.2 v2:172.21.15.194:6800/815615585 35 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f050804a040 con 0x7f05100ee060 2024-09-13T06:10:18.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.479+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4ddae570 con 0x564c4dd792f0 2024-09-13T06:10:18.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.479+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 <== osd.3 v2:172.21.15.194:6816/96632515 39 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f05100f9030 con 0x564c4dd792f0 2024-09-13T06:10:18.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.479+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd8f060 con 0x564c4dd792f0 2024-09-13T06:10:18.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.479+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 <== osd.3 v2:172.21.15.194:6816/96632515 40 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f05100f9030 con 0x564c4dd792f0 2024-09-13T06:10:18.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.479+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd8f060 con 0x564c4dd792f0 2024-09-13T06:10:18.482 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.479+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 <== osd.3 v2:172.21.15.194:6816/96632515 41 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f05100f9030 con 0x564c4dd792f0 2024-09-13T06:10:18.482 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.479+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd8f060 con 0x564c4dd74900 2024-09-13T06:10:18.482 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.479+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.1 v2:172.21.15.194:6808/3135444559 39 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f05180083f0 con 0x564c4dd74900 2024-09-13T06:10:18.482 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.479+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd8f060 con 0x564c4dd74900 2024-09-13T06:10:18.482 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.479+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.1 v2:172.21.15.194:6808/3135444559 40 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f05180083f0 con 0x564c4dd74900 2024-09-13T06:10:18.482 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.479+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd8f060 con 0x564c4dd74900 2024-09-13T06:10:18.482 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.479+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.1 v2:172.21.15.194:6808/3135444559 41 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f05180083f0 con 0x564c4dd74900 2024-09-13T06:10:18.483 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.479+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd8f060 con 0x564c4dd74900 2024-09-13T06:10:18.483 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.479+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.1 v2:172.21.15.194:6808/3135444559 42 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv162 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f05180083f0 con 0x564c4dd74900 2024-09-13T06:10:18.483 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.479+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd8f060 con 0x564c4dd74900 2024-09-13T06:10:18.483 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.483+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.1 v2:172.21.15.194:6808/3135444559 43 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv162 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f05180083f0 con 0x564c4dd74900 2024-09-13T06:10:18.483 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.483+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd8f060 con 0x564c4dd74900 2024-09-13T06:10:18.487 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.483+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.1 v2:172.21.15.194:6808/3135444559 44 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv162 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f05180083f0 con 0x564c4dd74900 2024-09-13T06:10:18.487 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.483+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd8f060 con 0x564c4dd792f0 2024-09-13T06:10:18.487 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.483+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 <== osd.3 v2:172.21.15.194:6816/96632515 42 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f05100f9030 con 0x564c4dd792f0 2024-09-13T06:10:18.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.483+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd8f060 con 0x564c4dd792f0 2024-09-13T06:10:18.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.483+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 <== osd.3 v2:172.21.15.194:6816/96632515 43 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv45 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f05100f9030 con 0x564c4dd792f0 2024-09-13T06:10:18.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.483+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4ddae570 con 0x564c4dd792f0 2024-09-13T06:10:18.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.483+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 <== osd.3 v2:172.21.15.194:6816/96632515 44 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f05100f9030 con 0x564c4dd792f0 2024-09-13T06:10:18.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.483+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4ddae570 con 0x7f05100ee060 2024-09-13T06:10:18.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.483+0000 7f051effe640 1 -- 172.21.15.194:0/3180362193 <== osd.2 v2:172.21.15.194:6800/815615585 36 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f050804a040 con 0x7f05100ee060 2024-09-13T06:10:18.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.483+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd8f060 con 0x7f05100ee060 2024-09-13T06:10:18.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.483+0000 7f051effe640 1 -- 172.21.15.194:0/3180362193 <== osd.2 v2:172.21.15.194:6800/815615585 37 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv31 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f050804a040 con 0x7f05100ee060 2024-09-13T06:10:18.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.483+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4ddae570 con 0x7f05100ee060 2024-09-13T06:10:18.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.483+0000 7f051effe640 1 -- 172.21.15.194:0/3180362193 <== osd.2 v2:172.21.15.194:6800/815615585 38 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f050804a040 con 0x7f05100ee060 2024-09-13T06:10:18.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.483+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4ddae570 con 0x564c4dd792f0 2024-09-13T06:10:18.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.483+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 <== osd.3 v2:172.21.15.194:6816/96632515 45 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f05100f9030 con 0x564c4dd792f0 2024-09-13T06:10:18.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.483+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd8f060 con 0x564c4dd792f0 2024-09-13T06:10:18.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.483+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 <== osd.3 v2:172.21.15.194:6816/96632515 46 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f05100f9030 con 0x564c4dd792f0 2024-09-13T06:10:18.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.483+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4ddae570 con 0x564c4dd792f0 2024-09-13T06:10:18.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.483+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 <== osd.3 v2:172.21.15.194:6816/96632515 47 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f05100f9030 con 0x564c4dd792f0 2024-09-13T06:10:18.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.483+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4ddae570 con 0x564c4dd792f0 2024-09-13T06:10:18.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.483+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 <== osd.3 v2:172.21.15.194:6816/96632515 48 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f05100f9030 con 0x564c4dd792f0 2024-09-13T06:10:18.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.483+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd8f060 con 0x564c4dd792f0 2024-09-13T06:10:18.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.487+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 <== osd.3 v2:172.21.15.194:6816/96632515 49 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f05100f9030 con 0x564c4dd792f0 2024-09-13T06:10:18.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.487+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4ddae570 con 0x564c4dd792f0 2024-09-13T06:10:18.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.487+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 <== osd.3 v2:172.21.15.194:6816/96632515 50 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f05100f9030 con 0x564c4dd792f0 2024-09-13T06:10:18.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.487+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4ddae570 con 0x564c4dd792f0 2024-09-13T06:10:18.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.487+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 <== osd.3 v2:172.21.15.194:6816/96632515 51 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f05100f9030 con 0x564c4dd792f0 2024-09-13T06:10:18.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.487+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd8f060 con 0x564c4dd792f0 2024-09-13T06:10:18.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.487+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 <== osd.3 v2:172.21.15.194:6816/96632515 52 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv17 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f05100f9030 con 0x564c4dd792f0 2024-09-13T06:10:18.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.487+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4ddae570 con 0x564c4dd792f0 2024-09-13T06:10:18.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.487+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 <== osd.3 v2:172.21.15.194:6816/96632515 53 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f05100f9030 con 0x564c4dd792f0 2024-09-13T06:10:18.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.487+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4ddae570 con 0x564c4dd792f0 2024-09-13T06:10:18.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.487+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 <== osd.3 v2:172.21.15.194:6816/96632515 54 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f05100f9030 con 0x564c4dd792f0 2024-09-13T06:10:18.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.487+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd8f060 con 0x564c4dd792f0 2024-09-13T06:10:18.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.487+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 <== osd.3 v2:172.21.15.194:6816/96632515 55 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv35 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f05100f9030 con 0x564c4dd792f0 2024-09-13T06:10:18.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.487+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4ddae570 con 0x564c4dd792f0 2024-09-13T06:10:18.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.487+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 <== osd.3 v2:172.21.15.194:6816/96632515 56 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f05100f9030 con 0x564c4dd792f0 2024-09-13T06:10:18.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.487+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4ddae570 con 0x7f050801fbe0 2024-09-13T06:10:18.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.487+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.0 v2:172.21.15.120:6800/1923744619 34 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv25 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f05180083f0 con 0x7f050801fbe0 2024-09-13T06:10:18.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.487+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd8f060 con 0x7f050801fbe0 2024-09-13T06:10:18.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.491+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.0 v2:172.21.15.120:6800/1923744619 35 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv25 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f05180083f0 con 0x7f050801fbe0 2024-09-13T06:10:18.494 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.491+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4ddae570 con 0x7f050801fbe0 2024-09-13T06:10:18.494 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.491+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.0 v2:172.21.15.120:6800/1923744619 36 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv25 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f05180083f0 con 0x7f050801fbe0 2024-09-13T06:10:18.494 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.491+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4ddae570 con 0x564c4dd792f0 2024-09-13T06:10:18.494 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.491+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 <== osd.3 v2:172.21.15.194:6816/96632515 57 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f05100f9030 con 0x564c4dd792f0 2024-09-13T06:10:18.494 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.491+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd8f060 con 0x564c4dd792f0 2024-09-13T06:10:18.496 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.491+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 <== osd.3 v2:172.21.15.194:6816/96632515 58 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f05100f9030 con 0x564c4dd792f0 2024-09-13T06:10:18.496 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.491+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4ddae570 con 0x564c4dd792f0 2024-09-13T06:10:18.496 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.491+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 <== osd.3 v2:172.21.15.194:6816/96632515 59 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f05100f9030 con 0x564c4dd792f0 2024-09-13T06:10:18.496 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.491+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4ddae570 con 0x7f050801fbe0 2024-09-13T06:10:18.496 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.491+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.0 v2:172.21.15.120:6800/1923744619 37 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f05180083f0 con 0x7f050801fbe0 2024-09-13T06:10:18.496 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.491+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd8f060 con 0x7f050801fbe0 2024-09-13T06:10:18.496 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.495+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.0 v2:172.21.15.120:6800/1923744619 38 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f05180083f0 con 0x7f050801fbe0 2024-09-13T06:10:18.496 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.495+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4ddae570 con 0x7f050801fbe0 2024-09-13T06:10:18.496 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.495+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.0 v2:172.21.15.120:6800/1923744619 39 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f05180083f0 con 0x7f050801fbe0 2024-09-13T06:10:18.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.495+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4ddae570 con 0x564c4dd792f0 2024-09-13T06:10:18.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.495+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 <== osd.3 v2:172.21.15.194:6816/96632515 60 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f05100f9030 con 0x564c4dd792f0 2024-09-13T06:10:18.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.495+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd8f060 con 0x564c4dd792f0 2024-09-13T06:10:18.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.495+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 <== osd.3 v2:172.21.15.194:6816/96632515 61 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv47 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f05100f9030 con 0x564c4dd792f0 2024-09-13T06:10:18.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.495+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4ddae570 con 0x564c4dd792f0 2024-09-13T06:10:18.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.495+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 <== osd.3 v2:172.21.15.194:6816/96632515 62 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f05100f9030 con 0x564c4dd792f0 2024-09-13T06:10:18.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.495+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4ddae570 con 0x7f050801fbe0 2024-09-13T06:10:18.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.499+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.0 v2:172.21.15.120:6800/1923744619 40 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f05180083f0 con 0x7f050801fbe0 2024-09-13T06:10:18.499 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.499+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd8f060 con 0x7f050801fbe0 2024-09-13T06:10:18.499 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.499+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.0 v2:172.21.15.120:6800/1923744619 41 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f05180083f0 con 0x7f050801fbe0 2024-09-13T06:10:18.500 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.499+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4ddae570 con 0x7f050801fbe0 2024-09-13T06:10:18.500 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.499+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.0 v2:172.21.15.120:6800/1923744619 42 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f05180083f0 con 0x7f050801fbe0 2024-09-13T06:10:18.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.499+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4ddae570 con 0x7f05100ee060 2024-09-13T06:10:18.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.499+0000 7f051effe640 1 -- 172.21.15.194:0/3180362193 <== osd.2 v2:172.21.15.194:6800/815615585 39 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f050804a040 con 0x7f05100ee060 2024-09-13T06:10:18.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.499+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd8f060 con 0x7f05100ee060 2024-09-13T06:10:18.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.503+0000 7f051effe640 1 -- 172.21.15.194:0/3180362193 <== osd.2 v2:172.21.15.194:6800/815615585 40 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f050804a040 con 0x7f05100ee060 2024-09-13T06:10:18.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.503+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564c4ddae570 con 0x7f05100ee060 2024-09-13T06:10:18.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.503+0000 7f051effe640 1 -- 172.21.15.194:0/3180362193 <== osd.2 v2:172.21.15.194:6800/815615585 41 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0508057040 con 0x7f05100ee060 2024-09-13T06:10:18.504 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.503+0000 7f03d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:10:18.504 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.503+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94885723535136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd8f060 con 0x564c4dd74900 2024-09-13T06:10:18.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.507+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.1 v2:172.21.15.194:6808/3135444559 45 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94885723535136] v35'172 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f05180083f0 con 0x564c4dd74900 2024-09-13T06:10:18.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.507+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94885723499568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd87720 con 0x7f05100ee060 2024-09-13T06:10:18.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.507+0000 7f051effe640 1 -- 172.21.15.194:0/3180362193 <== osd.2 v2:172.21.15.194:6800/815615585 42 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94885723499568] v35'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0508057040 con 0x7f05100ee060 2024-09-13T06:10:18.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.507+0000 7f0521cef980 20 remove_watcher() i=0 2024-09-13T06:10:18.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.507+0000 7f0521cef980 2 removed watcher, disabling cache 2024-09-13T06:10:18.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.507+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94885723503360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd7ec30 con 0x564c4dd74900 2024-09-13T06:10:18.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.511+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.1 v2:172.21.15.194:6808/3135444559 46 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94885723503360] v35'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05180083f0 con 0x564c4dd74900 2024-09-13T06:10:18.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.511+0000 7f0521cef980 20 remove_watcher() i=1 2024-09-13T06:10:18.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.511+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94885723508080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd7ec30 con 0x564c4dd792f0 2024-09-13T06:10:18.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.511+0000 7f051f7ff640 1 -- 172.21.15.194:0/3180362193 <== osd.3 v2:172.21.15.194:6816/96632515 63 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94885723508080] v35'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05100f9030 con 0x564c4dd792f0 2024-09-13T06:10:18.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.511+0000 7f0521cef980 20 remove_watcher() i=2 2024-09-13T06:10:18.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.511+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94885723510784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd7ec30 con 0x7f05100ee060 2024-09-13T06:10:18.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.515+0000 7f051effe640 1 -- 172.21.15.194:0/3180362193 <== osd.2 v2:172.21.15.194:6800/815615585 43 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94885723510784] v35'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0508057040 con 0x7f05100ee060 2024-09-13T06:10:18.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.515+0000 7f0521cef980 20 remove_watcher() i=3 2024-09-13T06:10:18.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.515+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94885723512992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd7ec30 con 0x564c4dd74900 2024-09-13T06:10:18.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.515+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.1 v2:172.21.15.194:6808/3135444559 47 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94885723512992] v35'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05180083f0 con 0x564c4dd74900 2024-09-13T06:10:18.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.515+0000 7f0521cef980 20 remove_watcher() i=4 2024-09-13T06:10:18.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.515+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94885723505488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd820a0 con 0x7f050801fbe0 2024-09-13T06:10:18.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.519+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.0 v2:172.21.15.120:6800/1923744619 43 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94885723505488] v35'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05180083f0 con 0x7f050801fbe0 2024-09-13T06:10:18.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.519+0000 7f0521cef980 20 remove_watcher() i=5 2024-09-13T06:10:18.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.519+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94885723517600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd7ec30 con 0x7f050801fbe0 2024-09-13T06:10:18.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.523+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.0 v2:172.21.15.120:6800/1923744619 44 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94885723517600] v35'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05180083f0 con 0x7f050801fbe0 2024-09-13T06:10:18.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.523+0000 7f0521cef980 20 remove_watcher() i=6 2024-09-13T06:10:18.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.523+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94885723521328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564c4dd832a0 con 0x7f050801fbe0 2024-09-13T06:10:18.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.523+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 <== osd.0 v2:172.21.15.120:6800/1923744619 45 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94885723521328] v35'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05180083f0 con 0x7f050801fbe0 2024-09-13T06:10:18.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.523+0000 7f0521cef980 20 remove_watcher() i=7 2024-09-13T06:10:18.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.523+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f050801fbe0 msgr2=0x7f050803a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:18.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.523+0000 7f0521cef980 1 --2- 172.21.15.194:0/3180362193 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f050801fbe0 0x7f050803a3c0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:18.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.523+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x564c4dd74900 msgr2=0x564c4dd76da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:18.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.523+0000 7f0521cef980 1 --2- 172.21.15.194:0/3180362193 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x564c4dd74900 0x564c4dd76da0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:18.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.523+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f05100ee060 msgr2=0x7f05100fb840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:18.530 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.523+0000 7f0521cef980 1 --2- 172.21.15.194:0/3180362193 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f05100ee060 0x7f05100fb840 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:18.530 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.523+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x564c4dd792f0 msgr2=0x564c4dd7b6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:18.530 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.523+0000 7f0521cef980 1 --2- 172.21.15.194:0/3180362193 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x564c4dd792f0 0x564c4dd7b6e0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:18.530 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.523+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f03e8034650 msgr2=0x7f03e8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:18.530 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.523+0000 7f0521cef980 1 --2- 172.21.15.194:0/3180362193 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f03e8034650 0x7f03e8036b10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f050800c010 tx=0x7f0508010000 comp rx=0 tx=0).stop 2024-09-13T06:10:18.530 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.523+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564c4dd626c0 msgr2=0x564c4dd697f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:18.530 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.523+0000 7f0520000640 1 -- 172.21.15.194:0/3180362193 reap_dead start 2024-09-13T06:10:18.530 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.523+0000 7f0521cef980 1 --2- 172.21.15.194:0/3180362193 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564c4dd626c0 0x564c4dd697f0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f05100c8b30 tx=0x7f05100d6f20 comp rx=0 tx=0).stop 2024-09-13T06:10:18.530 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.523+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 shutdown_connections 2024-09-13T06:10:18.531 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.523+0000 7f0521cef980 1 --2- 172.21.15.194:0/3180362193 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564c4dd626c0 0x564c4dd697f0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:18.531 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.523+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 >> 172.21.15.194:0/3180362193 conn(0x564c4dd5ea40 msgr2=0x564c4dd5cb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:18.531 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.523+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 shutdown_connections 2024-09-13T06:10:18.531 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.527+0000 7f0521cef980 1 -- 172.21.15.194:0/3180362193 wait complete. 2024-09-13T06:10:18.531 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.527+0000 7f0521cef980 1 -- 172.21.15.194:0/2660015814 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f03f8034650 msgr2=0x7f03f8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:18.531 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.527+0000 7f0521cef980 1 --2- 172.21.15.194:0/2660015814 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f03f8034650 0x7f03f8036b10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x564c4dd3fdd0 tx=0x7f050800f000 comp rx=0 tx=0).stop 2024-09-13T06:10:18.531 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.527+0000 7f0521cef980 1 -- 172.21.15.194:0/2660015814 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564c4dd55d00 msgr2=0x564c4dd56120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:18.531 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.527+0000 7f0521cef980 1 --2- 172.21.15.194:0/2660015814 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564c4dd55d00 0x564c4dd56120 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f0510005790 tx=0x7f05100c6f50 comp rx=0 tx=0).stop 2024-09-13T06:10:18.531 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.527+0000 7f0521cef980 1 -- 172.21.15.194:0/2660015814 shutdown_connections 2024-09-13T06:10:18.531 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.527+0000 7f0521cef980 1 --2- 172.21.15.194:0/2660015814 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f03f8034650 0x7f03f8036b10 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:18.531 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.527+0000 7f0521cef980 1 --2- 172.21.15.194:0/2660015814 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564c4dd55d00 0x564c4dd56120 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:18.531 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.527+0000 7f0521cef980 1 -- 172.21.15.194:0/2660015814 >> 172.21.15.194:0/2660015814 conn(0x564c4dd4ae50 msgr2=0x564c4dd4d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:18.531 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.527+0000 7f0521cef980 1 -- 172.21.15.194:0/2660015814 shutdown_connections 2024-09-13T06:10:18.532 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.527+0000 7f0521cef980 1 -- 172.21.15.194:0/2660015814 wait complete. 2024-09-13T06:10:18.532 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.527+0000 7f0521cef980 1 -- 172.21.15.194:0/1409738553 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x564c4dc46230 msgr2=0x564c4dd3ef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:18.532 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.527+0000 7f0521cef980 1 --2- 172.21.15.194:0/1409738553 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x564c4dc46230 0x564c4dd3ef40 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:18.532 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.527+0000 7f0521cef980 1 -- 172.21.15.194:0/1409738553 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x564c4dd45740 msgr2=0x564c4dd47b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:18.532 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.527+0000 7f0521cef980 1 --2- 172.21.15.194:0/1409738553 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x564c4dd45740 0x564c4dd47b30 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:18.532 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.527+0000 7f0521cef980 1 -- 172.21.15.194:0/1409738553 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x564c4dd41820 msgr2=0x564c4dd43c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:18.532 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.527+0000 7f0521cef980 1 --2- 172.21.15.194:0/1409738553 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x564c4dd41820 0x564c4dd43c10 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:18.532 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.527+0000 7f0521cef980 1 -- 172.21.15.194:0/1409738553 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0404034650 msgr2=0x7f0404036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:18.532 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.527+0000 7f0521cef980 1 --2- 172.21.15.194:0/1409738553 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0404034650 0x7f0404036b10 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0508000f70 tx=0x7f0508001380 comp rx=0 tx=0).stop 2024-09-13T06:10:18.532 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.527+0000 7f0521cef980 1 -- 172.21.15.194:0/1409738553 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564c4dc458e0 msgr2=0x564c4dd37e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:18.532 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.527+0000 7f0521cef980 1 --2- 172.21.15.194:0/1409738553 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564c4dc458e0 0x564c4dd37e40 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f051001aec0 tx=0x7f0510017e30 comp rx=0 tx=0).stop 2024-09-13T06:10:18.532 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.527+0000 7f0520000640 1 -- 172.21.15.194:0/1409738553 reap_dead start 2024-09-13T06:10:18.532 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.527+0000 7f0521cef980 1 -- 172.21.15.194:0/1409738553 shutdown_connections 2024-09-13T06:10:18.533 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.527+0000 7f0521cef980 1 -- 172.21.15.194:0/1409738553 >> 172.21.15.194:0/1409738553 conn(0x564c4dbb9230 msgr2=0x564c4dd2b380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:18.533 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.527+0000 7f0521cef980 1 -- 172.21.15.194:0/1409738553 shutdown_connections 2024-09-13T06:10:18.533 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.527+0000 7f0521cef980 1 -- 172.21.15.194:0/1409738553 wait complete. 2024-09-13T06:10:18.544 INFO:teuthology.orchestra.run.smithi194.stdout:[] 2024-09-13T06:10:18.545 DEBUG:tasks.util.rgw: json result: [] 2024-09-13T06:10:18.545 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-13T06:10:18.545 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-13T06:10:18.546 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-13T06:10:18.627 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:10:18.628 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:10:18.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.627+0000 7f0ff1960980 1 Processor -- start 2024-09-13T06:10:18.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.627+0000 7f0ff1960980 1 -- start start 2024-09-13T06:10:18.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.627+0000 7f0ff1960980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x56512dd45870 0x56512dd47c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:18.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.627+0000 7f0ff1960980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56512dbcbae0 con 0x56512dcb82d0 2024-09-13T06:10:18.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.627+0000 7f0ff1960980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x56512dbefe30 con 0x56512dd45870 2024-09-13T06:10:18.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.627+0000 7f0feec6f640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x56512dd45870 0x56512dd47c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:18.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.627+0000 7f0feec6f640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x56512dd45870 0x56512dd47c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:50570/0 (socket says 172.21.15.194:50570) 2024-09-13T06:10:18.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.627+0000 7f0feec6f640 1 -- 172.21.15.194:0/3384957326 learned_addr learned my addr 172.21.15.194:0/3384957326 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:18.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.627+0000 7f0fef470640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x56512dcb82d0 0x56512dd44150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:59064/0 (socket says 172.21.15.194:59064) 2024-09-13T06:10:18.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.627+0000 7f0feec6f640 1 -- 172.21.15.194:0/3384957326 >> v1:172.21.15.120:6789/0 conn(0x56512dcb82d0 legacy=0x56512dd44150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:18.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.627+0000 7f0feec6f640 1 -- 172.21.15.194:0/3384957326 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56512dd481d0 con 0x56512dd45870 2024-09-13T06:10:18.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.631+0000 7f0feec6f640 1 --2- 172.21.15.194:0/3384957326 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56512dd45870 0x56512dd47c90 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f0fd800a5c0 tx=0x7f0fd801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=243defc02b9735f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:18.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.631+0000 7f0fee46e640 1 -- 172.21.15.194:0/3384957326 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fd80af070 con 0x56512dd45870 2024-09-13T06:10:18.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.631+0000 7f0fee46e640 1 -- 172.21.15.194:0/3384957326 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fd80aa530 con 0x56512dd45870 2024-09-13T06:10:18.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.631+0000 7f0fee46e640 1 -- 172.21.15.194:0/3384957326 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fd80aa830 con 0x56512dd45870 2024-09-13T06:10:18.633 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.631+0000 7f0ff1960980 1 -- 172.21.15.194:0/3384957326 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56512dd45870 msgr2=0x56512dd47c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:18.633 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.631+0000 7f0ff1960980 1 --2- 172.21.15.194:0/3384957326 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56512dd45870 0x56512dd47c90 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f0fd800a5c0 tx=0x7f0fd801b340 comp rx=0 tx=0).stop 2024-09-13T06:10:18.633 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.631+0000 7f0ff1960980 1 -- 172.21.15.194:0/3384957326 shutdown_connections 2024-09-13T06:10:18.633 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.631+0000 7f0ff1960980 1 --2- 172.21.15.194:0/3384957326 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56512dd45870 0x56512dd47c90 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:18.634 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.631+0000 7f0ff1960980 1 -- 172.21.15.194:0/3384957326 >> 172.21.15.194:0/3384957326 conn(0x56512dd3e090 msgr2=0x56512dd404b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:18.634 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.631+0000 7f0ff1960980 1 -- 172.21.15.194:0/3384957326 shutdown_connections 2024-09-13T06:10:18.634 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.631+0000 7f0ff1960980 1 -- 172.21.15.194:0/3384957326 wait complete. 2024-09-13T06:10:18.649 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.647+0000 7f0ff1960980 1 Processor -- start 2024-09-13T06:10:18.649 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.647+0000 7f0ff1960980 1 -- start start 2024-09-13T06:10:18.649 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.647+0000 7f0ff1960980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56512dcb82d0 0x56512de353f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:18.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.647+0000 7f0ff1960980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x56512dbf1200 con 0x56512dcb82d0 2024-09-13T06:10:18.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.647+0000 7f0fef470640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56512dcb82d0 0x56512de353f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:18.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.647+0000 7f0fef470640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56512dcb82d0 0x56512de353f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:50578/0 (socket says 172.21.15.194:50578) 2024-09-13T06:10:18.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.647+0000 7f0fef470640 1 -- 172.21.15.194:0/848333759 learned_addr learned my addr 172.21.15.194:0/848333759 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:18.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.651+0000 7f0fef470640 1 -- 172.21.15.194:0/848333759 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56512de359c0 con 0x56512dcb82d0 2024-09-13T06:10:18.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.651+0000 7f0fef470640 1 --2- 172.21.15.194:0/848333759 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56512dcb82d0 0x56512de353f0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f0fe80015f0 tx=0x7f0fe8001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c0fe1251ccf5ee8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:18.652 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.651+0000 7f0edd60a640 1 -- 172.21.15.194:0/848333759 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fe8013420 con 0x56512dcb82d0 2024-09-13T06:10:18.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.651+0000 7f0edd60a640 1 -- 172.21.15.194:0/848333759 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fe80135e0 con 0x56512dcb82d0 2024-09-13T06:10:18.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.651+0000 7f0edd60a640 1 -- 172.21.15.194:0/848333759 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fe8013940 con 0x56512dcb82d0 2024-09-13T06:10:18.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.651+0000 7f0ff1960980 1 -- 172.21.15.194:0/848333759 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56512dcb82d0 msgr2=0x56512de353f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:18.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.651+0000 7f0ff1960980 1 --2- 172.21.15.194:0/848333759 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56512dcb82d0 0x56512de353f0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f0fe80015f0 tx=0x7f0fe8001ab0 comp rx=0 tx=0).stop 2024-09-13T06:10:18.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.651+0000 7f0ff1960980 1 -- 172.21.15.194:0/848333759 shutdown_connections 2024-09-13T06:10:18.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.651+0000 7f0ff1960980 1 --2- 172.21.15.194:0/848333759 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56512dcb82d0 0x56512de353f0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:18.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.651+0000 7f0ff1960980 1 -- 172.21.15.194:0/848333759 >> 172.21.15.194:0/848333759 conn(0x56512dd3e090 msgr2=0x56512de31020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:18.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.651+0000 7f0ff1960980 1 -- 172.21.15.194:0/848333759 shutdown_connections 2024-09-13T06:10:18.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.651+0000 7f0ff1960980 1 -- 172.21.15.194:0/848333759 wait complete. 2024-09-13T06:10:18.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.651+0000 7f0ff1960980 1 Processor -- start 2024-09-13T06:10:18.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.651+0000 7f0ff1960980 1 -- start start 2024-09-13T06:10:18.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.651+0000 7f0ff1960980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56512dcb82d0 0x56512de3c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:18.654 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.651+0000 7f0ff1960980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x56512dd53a00 con 0x56512dcb82d0 2024-09-13T06:10:18.654 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.651+0000 7f0fef470640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56512dcb82d0 0x56512de3c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:18.654 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.651+0000 7f0fef470640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56512dcb82d0 0x56512de3c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:50584/0 (socket says 172.21.15.194:50584) 2024-09-13T06:10:18.654 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.651+0000 7f0fef470640 1 -- 172.21.15.194:0/3312522189 learned_addr learned my addr 172.21.15.194:0/3312522189 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:18.656 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.651+0000 7f0fef470640 1 -- 172.21.15.194:0/3312522189 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56512de3cca0 con 0x56512dcb82d0 2024-09-13T06:10:18.656 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.651+0000 7f0fef470640 1 --2- 172.21.15.194:0/3312522189 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56512dcb82d0 0x56512de3c760 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f0fe8006640 tx=0x7f0fe8000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:18.656 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.651+0000 7f0edbe07640 1 -- 172.21.15.194:0/3312522189 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fe8022020 con 0x56512dcb82d0 2024-09-13T06:10:18.656 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.651+0000 7f0ff1960980 1 -- 172.21.15.194:0/3312522189 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56512de3cf30 con 0x56512dcb82d0 2024-09-13T06:10:18.656 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.651+0000 7f0edbe07640 1 -- 172.21.15.194:0/3312522189 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fe8006320 con 0x56512dcb82d0 2024-09-13T06:10:18.656 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.651+0000 7f0edbe07640 1 -- 172.21.15.194:0/3312522189 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fe8004af0 con 0x56512dcb82d0 2024-09-13T06:10:18.656 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.651+0000 7f0ff1960980 1 -- 172.21.15.194:0/3312522189 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56512de3fc10 con 0x56512dcb82d0 2024-09-13T06:10:18.656 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.655+0000 7f0edbe07640 1 -- 172.21.15.194:0/3312522189 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0fe8025020 con 0x56512dcb82d0 2024-09-13T06:10:18.656 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.655+0000 7f0edbe07640 1 --2- 172.21.15.194:0/3312522189 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0ed40346a0 0x7f0ed4036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:18.656 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.655+0000 7f0edbe07640 1 -- 172.21.15.194:0/3312522189 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f0fe8018030 con 0x56512dcb82d0 2024-09-13T06:10:18.656 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.655+0000 7f0feec6f640 1 --2- 172.21.15.194:0/3312522189 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0ed40346a0 0x7f0ed4036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:18.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.655+0000 7f0ff1960980 1 --2- 172.21.15.194:0/3312522189 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x56512dd45870 0x56512de43730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:18.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.655+0000 7f0ff1960980 1 -- 172.21.15.194:0/3312522189 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56512de43d70 con 0x56512dd45870 2024-09-13T06:10:18.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.655+0000 7f0fefc71640 1 --2- 172.21.15.194:0/3312522189 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x56512dd45870 0x56512de43730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:18.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.655+0000 7f0feec6f640 1 --2- 172.21.15.194:0/3312522189 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0ed40346a0 0x7f0ed4036b60 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0fd80ac000 tx=0x7f0fd80a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:18.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.655+0000 7f0fefc71640 1 --2- 172.21.15.194:0/3312522189 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x56512dd45870 0x56512de43730 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:18.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.655+0000 7f0fefc71640 1 -- 172.21.15.194:0/3312522189 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0fe00083f0 con 0x56512dd45870 2024-09-13T06:10:18.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.655+0000 7f0ff1960980 1 -- 172.21.15.194:0/3312522189 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56512de40e30 con 0x56512dd45870 2024-09-13T06:10:18.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.655+0000 7f0fefc71640 1 -- 172.21.15.194:0/3312522189 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0fe00083f0 con 0x56512dd45870 2024-09-13T06:10:18.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.655+0000 7f0ff1960980 1 --2- 172.21.15.194:0/3312522189 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x56512de460c0 0x56512de484b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:18.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.655+0000 7f0ff1960980 1 -- 172.21.15.194:0/3312522189 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56512de48b80 con 0x56512de460c0 2024-09-13T06:10:18.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.655+0000 7f0fef470640 1 --2- 172.21.15.194:0/3312522189 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x56512de460c0 0x56512de484b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:18.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.655+0000 7f0fef470640 1 --2- 172.21.15.194:0/3312522189 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x56512de460c0 0x56512de484b0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:18.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.655+0000 7f0fef470640 1 -- 172.21.15.194:0/3312522189 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0fe801b070 con 0x56512de460c0 2024-09-13T06:10:18.660 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.655+0000 7f0ff1960980 1 -- 172.21.15.194:0/3312522189 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56512de44f60 con 0x56512dd45870 2024-09-13T06:10:18.660 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.659+0000 7f0fefc71640 1 -- 172.21.15.194:0/3312522189 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0fe00083f0 con 0x56512dd45870 2024-09-13T06:10:18.660 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.659+0000 7f0ff1960980 1 --2- 172.21.15.194:0/3312522189 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x56512de49fc0 0x56512de4c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:18.660 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.659+0000 7f0ff1960980 1 -- 172.21.15.194:0/3312522189 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56512de4cb40 con 0x56512de49fc0 2024-09-13T06:10:18.660 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.659+0000 7f0feec6f640 1 --2- 172.21.15.194:0/3312522189 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x56512de49fc0 0x56512de4c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:18.660 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.659+0000 7f0feec6f640 1 --2- 172.21.15.194:0/3312522189 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x56512de49fc0 0x56512de4c3b0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:18.660 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.659+0000 7f0feec6f640 1 -- 172.21.15.194:0/3312522189 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0fd80b2040 con 0x56512de49fc0 2024-09-13T06:10:18.662 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.659+0000 7f0ff1960980 1 Processor -- start 2024-09-13T06:10:18.662 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.659+0000 7f0ff1960980 1 -- start start 2024-09-13T06:10:18.662 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.659+0000 7f0ff1960980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56512de5a5d0 0x56512de5a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:18.662 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.659+0000 7f0ff1960980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x56512dc4a800 con 0x56512de5a5d0 2024-09-13T06:10:18.662 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.659+0000 7f0fef470640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56512de5a5d0 0x56512de5a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:18.662 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.659+0000 7f0fef470640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56512de5a5d0 0x56512de5a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:50596/0 (socket says 172.21.15.194:50596) 2024-09-13T06:10:18.662 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.659+0000 7f0fef470640 1 -- 172.21.15.194:0/2977123394 learned_addr learned my addr 172.21.15.194:0/2977123394 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:18.662 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.659+0000 7f0fef470640 1 -- 172.21.15.194:0/2977123394 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56512de5af30 con 0x56512de5a5d0 2024-09-13T06:10:18.662 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.659+0000 7f0fef470640 1 --2- 172.21.15.194:0/2977123394 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56512de5a5d0 0x56512de5a9f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f0fe8048500 tx=0x7f0fe801ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:18.662 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.659+0000 7f0ed9602640 1 -- 172.21.15.194:0/2977123394 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fe801dd50 con 0x56512de5a5d0 2024-09-13T06:10:18.663 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.659+0000 7f0ed9602640 1 -- 172.21.15.194:0/2977123394 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fe801e3f0 con 0x56512de5a5d0 2024-09-13T06:10:18.663 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.659+0000 7f0ff1960980 1 -- 172.21.15.194:0/2977123394 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56512de5b1c0 con 0x56512de5a5d0 2024-09-13T06:10:18.663 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.659+0000 7f0ed9602640 1 -- 172.21.15.194:0/2977123394 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fe801e6d0 con 0x56512de5a5d0 2024-09-13T06:10:18.663 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.659+0000 7f0ff1960980 1 -- 172.21.15.194:0/2977123394 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56512de5de40 con 0x56512de5a5d0 2024-09-13T06:10:18.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.663+0000 7f0ed9602640 1 -- 172.21.15.194:0/2977123394 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0fe8046040 con 0x56512de5a5d0 2024-09-13T06:10:18.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.663+0000 7f0ed9602640 1 --2- 172.21.15.194:0/2977123394 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0ec8034650 0x7f0ec8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:18.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.663+0000 7f0ed9602640 1 -- 172.21.15.194:0/2977123394 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f0fe804ed10 con 0x56512de5a5d0 2024-09-13T06:10:18.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.663+0000 7f0feec6f640 1 --2- 172.21.15.194:0/2977123394 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0ec8034650 0x7f0ec8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:18.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.663+0000 7f0ff1960980 1 Processor -- start 2024-09-13T06:10:18.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.663+0000 7f0ff1960980 1 -- start start 2024-09-13T06:10:18.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.663+0000 7f0ff1960980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56512de66f40 0x56512de67320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:18.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.663+0000 7f0ff1960980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x56512de35d40 con 0x56512de66f40 2024-09-13T06:10:18.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.663+0000 7f0feec6f640 1 --2- 172.21.15.194:0/2977123394 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0ec8034650 0x7f0ec8036b10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0fd8000c10 tx=0x7f0fd8005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:18.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.663+0000 7f0fef470640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56512de66f40 0x56512de67320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:18.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.663+0000 7f0fef470640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56512de66f40 0x56512de67320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:50608/0 (socket says 172.21.15.194:50608) 2024-09-13T06:10:18.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.663+0000 7f0fef470640 1 -- 172.21.15.194:0/1630512065 learned_addr learned my addr 172.21.15.194:0/1630512065 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:18.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.663+0000 7f0fef470640 1 -- 172.21.15.194:0/1630512065 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56512de678f0 con 0x56512de66f40 2024-09-13T06:10:18.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.663+0000 7f0fef470640 1 --2- 172.21.15.194:0/1630512065 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56512de66f40 0x56512de67320 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f0fe8005380 tx=0x7f0fe80056b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c36961ec69956b26 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:18.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.663+0000 7f0ed2ffd640 1 -- 172.21.15.194:0/1630512065 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fe805d020 con 0x56512de66f40 2024-09-13T06:10:18.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.663+0000 7f0ed2ffd640 1 -- 172.21.15.194:0/1630512065 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fe8041db0 con 0x56512de66f40 2024-09-13T06:10:18.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.663+0000 7f0ed2ffd640 1 -- 172.21.15.194:0/1630512065 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fe804fbb0 con 0x56512de66f40 2024-09-13T06:10:18.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.663+0000 7f0ff1960980 1 -- 172.21.15.194:0/1630512065 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56512de66f40 msgr2=0x56512de67320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:18.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.663+0000 7f0ff1960980 1 --2- 172.21.15.194:0/1630512065 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56512de66f40 0x56512de67320 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f0fe8005380 tx=0x7f0fe80056b0 comp rx=0 tx=0).stop 2024-09-13T06:10:18.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.663+0000 7f0ff1960980 1 -- 172.21.15.194:0/1630512065 shutdown_connections 2024-09-13T06:10:18.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.663+0000 7f0ff1960980 1 --2- 172.21.15.194:0/1630512065 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56512de66f40 0x56512de67320 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:18.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.663+0000 7f0ff1960980 1 -- 172.21.15.194:0/1630512065 >> 172.21.15.194:0/1630512065 conn(0x56512de63320 msgr2=0x56512de61420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:18.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.663+0000 7f0ff1960980 1 -- 172.21.15.194:0/1630512065 shutdown_connections 2024-09-13T06:10:18.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.663+0000 7f0ff1960980 1 -- 172.21.15.194:0/1630512065 wait complete. 2024-09-13T06:10:18.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.663+0000 7f0ff1960980 1 Processor -- start 2024-09-13T06:10:18.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.667+0000 7f0ff1960980 1 -- start start 2024-09-13T06:10:18.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.667+0000 7f0ff1960980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56512de66f40 0x56512de6e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:18.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.667+0000 7f0ff1960980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x56512de67d90 con 0x56512de66f40 2024-09-13T06:10:18.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.667+0000 7f0fef470640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56512de66f40 0x56512de6e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:18.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.667+0000 7f0fef470640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56512de66f40 0x56512de6e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:50622/0 (socket says 172.21.15.194:50622) 2024-09-13T06:10:18.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.667+0000 7f0fef470640 1 -- 172.21.15.194:0/1896516101 learned_addr learned my addr 172.21.15.194:0/1896516101 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:18.670 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.667+0000 7f0fef470640 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56512de6e5e0 con 0x56512de66f40 2024-09-13T06:10:18.670 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.667+0000 7f0fef470640 1 --2- 172.21.15.194:0/1896516101 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56512de66f40 0x56512de6e0a0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f0fe80472c0 tx=0x7f0fe804af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:18.670 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.667+0000 7f0ed17fa640 1 -- 172.21.15.194:0/1896516101 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fe8072070 con 0x56512de66f40 2024-09-13T06:10:18.670 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.667+0000 7f0ed17fa640 1 -- 172.21.15.194:0/1896516101 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fe803d840 con 0x56512de66f40 2024-09-13T06:10:18.670 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.667+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56512de6e5e0 con 0x56512de66f40 2024-09-13T06:10:18.670 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.667+0000 7f0ed17fa640 1 -- 172.21.15.194:0/1896516101 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fe803db40 con 0x56512de66f40 2024-09-13T06:10:18.670 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.667+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56512de6e5e0 con 0x56512de66f40 2024-09-13T06:10:18.675 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.667+0000 7f0ed17fa640 1 -- 172.21.15.194:0/1896516101 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0fe8075070 con 0x56512de66f40 2024-09-13T06:10:18.675 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.667+0000 7f0ed17fa640 1 --2- 172.21.15.194:0/1896516101 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0eb8034650 0x7f0eb8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:18.675 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.667+0000 7f0ed17fa640 1 -- 172.21.15.194:0/1896516101 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f0fe806a070 con 0x56512de66f40 2024-09-13T06:10:18.675 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.667+0000 7f0feec6f640 1 --2- 172.21.15.194:0/1896516101 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0eb8034650 0x7f0eb8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:18.675 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.667+0000 7f0ff1960980 20 rados->read ofs=0 len=0 2024-09-13T06:10:18.676 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.667+0000 7f0ff1960980 1 --2- 172.21.15.194:0/1896516101 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x56512de791e0 0x56512de7b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:18.676 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.667+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56512de7bdf0 con 0x56512de791e0 2024-09-13T06:10:18.676 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.667+0000 7f0fefc71640 1 --2- 172.21.15.194:0/1896516101 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x56512de791e0 0x56512de7b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:18.676 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.671+0000 7f0feec6f640 1 --2- 172.21.15.194:0/1896516101 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0eb8034650 0x7f0eb8036b10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0fd80aafd0 tx=0x7f0fd80b8040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:18.676 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.671+0000 7f0fefc71640 1 --2- 172.21.15.194:0/1896516101 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x56512de791e0 0x56512de7b6a0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:18.676 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.671+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0fe00083f0 con 0x56512de791e0 2024-09-13T06:10:18.676 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.671+0000 7f0ff1960980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:18.676 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.671+0000 7f0ff1960980 20 realm 2024-09-13T06:10:18.676 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.671+0000 7f0ff1960980 20 rados->read ofs=0 len=0 2024-09-13T06:10:18.676 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.671+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56512de7c200 con 0x56512de791e0 2024-09-13T06:10:18.676 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.671+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0fe00083f0 con 0x56512de791e0 2024-09-13T06:10:18.676 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.671+0000 7f0ff1960980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:18.677 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.671+0000 7f0ff1960980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:10:18.677 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.671+0000 7f0ff1960980 20 rados->read ofs=0 len=0 2024-09-13T06:10:18.677 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.671+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56512de7cad0 con 0x56512de791e0 2024-09-13T06:10:18.677 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.671+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0fe00083f0 con 0x56512de791e0 2024-09-13T06:10:18.677 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.671+0000 7f0ff1960980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:18.677 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.671+0000 7f0ff1960980 20 rados->read ofs=0 len=0 2024-09-13T06:10:18.677 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.671+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56512de7ce70 con 0x56512de791e0 2024-09-13T06:10:18.677 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.671+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0fe00083f0 con 0x56512de791e0 2024-09-13T06:10:18.677 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.671+0000 7f0ff1960980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:10:18.677 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.671+0000 7f0ff1960980 20 rados->read ofs=0 len=0 2024-09-13T06:10:18.677 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.671+0000 7f0ff1960980 1 --2- 172.21.15.194:0/1896516101 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x56512de7dbd0 0x56512de7ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:18.677 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.671+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56512de805d0 con 0x56512de7dbd0 2024-09-13T06:10:18.678 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.671+0000 7f0fef470640 1 --2- 172.21.15.194:0/1896516101 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x56512de7dbd0 0x56512de7ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:18.678 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.671+0000 7f0fef470640 1 --2- 172.21.15.194:0/1896516101 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x56512de7dbd0 0x56512de7ffc0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:18.678 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.671+0000 7f0fef470640 1 -- 172.21.15.194:0/1896516101 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0fe8074030 con 0x56512de7dbd0 2024-09-13T06:10:18.678 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.671+0000 7f0ff1960980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:10:18.678 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.671+0000 7f0ff1960980 20 searching for the correct realm 2024-09-13T06:10:18.678 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.671+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56512de81ea0 con 0x56512de7dbd0 2024-09-13T06:10:18.678 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.671+0000 7f0fef470640 1 -- 172.21.15.194:0/1896516101 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fe8074030 con 0x56512de7dbd0 2024-09-13T06:10:18.678 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.671+0000 7f0fef470640 1 --2- 172.21.15.194:0/1896516101 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f0fe8077060 0x7f0fe8048580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:18.678 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.671+0000 7f0fef470640 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56512de81ea0 con 0x7f0fe8077060 2024-09-13T06:10:18.678 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.671+0000 7f0feec6f640 1 --2- 172.21.15.194:0/1896516101 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f0fe8077060 0x7f0fe8048580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:18.678 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.671+0000 7f0feec6f640 1 --2- 172.21.15.194:0/1896516101 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f0fe8077060 0x7f0fe8048580 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:18.678 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.671+0000 7f0feec6f640 1 -- 172.21.15.194:0/1896516101 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0fd80d7070 con 0x7f0fe8077060 2024-09-13T06:10:18.678 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.671+0000 7f0feec6f640 1 --2- 172.21.15.194:0/1896516101 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f0fd80cc040 0x7f0fd80d9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:18.679 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.671+0000 7f0feec6f640 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56512de81ea0 con 0x7f0fd80cc040 2024-09-13T06:10:18.679 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.671+0000 7f0fefc71640 1 --2- 172.21.15.194:0/1896516101 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f0fd80cc040 0x7f0fd80d9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:18.679 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.675+0000 7f0fefc71640 1 --2- 172.21.15.194:0/1896516101 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f0fd80cc040 0x7f0fd80d9410 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:18.683 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.675+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fe00083f0 con 0x7f0fd80cc040 2024-09-13T06:10:18.683 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.675+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56512de7ce70 con 0x56512de791e0 2024-09-13T06:10:18.683 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.675+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fe00083f0 con 0x56512de791e0 2024-09-13T06:10:18.683 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.675+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56512de7ce70 con 0x56512de791e0 2024-09-13T06:10:18.683 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.675+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fe00083f0 con 0x56512de791e0 2024-09-13T06:10:18.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.675+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56512de7ce70 con 0x7f0fd80cc040 2024-09-13T06:10:18.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.675+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fe00083f0 con 0x7f0fd80cc040 2024-09-13T06:10:18.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.675+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56512de7ce70 con 0x7f0fd80cc040 2024-09-13T06:10:18.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.675+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fe00083f0 con 0x7f0fd80cc040 2024-09-13T06:10:18.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.675+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56512de7ce70 con 0x7f0fe8077060 2024-09-13T06:10:18.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.675+0000 7f0feec6f640 1 -- 172.21.15.194:0/1896516101 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fd80e3040 con 0x7f0fe8077060 2024-09-13T06:10:18.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.675+0000 7f0feec6f640 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56512de7ce70 con 0x56512de7dbd0 2024-09-13T06:10:18.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.675+0000 7f0fef470640 1 -- 172.21.15.194:0/1896516101 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fe8074030 con 0x56512de7dbd0 2024-09-13T06:10:18.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.675+0000 7f0fef470640 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56512de7ce70 con 0x56512de791e0 2024-09-13T06:10:18.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.675+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fe00083f0 con 0x56512de791e0 2024-09-13T06:10:18.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.675+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56512de7ce70 con 0x7f0fd80cc040 2024-09-13T06:10:18.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.679+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fe00083f0 con 0x7f0fd80cc040 2024-09-13T06:10:18.685 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.679+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56512de7ce70 con 0x56512de791e0 2024-09-13T06:10:18.685 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.679+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fe00083f0 con 0x56512de791e0 2024-09-13T06:10:18.685 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.679+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56512de7ce70 con 0x7f0fe8077060 2024-09-13T06:10:18.685 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.679+0000 7f0feec6f640 1 -- 172.21.15.194:0/1896516101 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0fd80e3040 con 0x7f0fe8077060 2024-09-13T06:10:18.685 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.679+0000 7f0feec6f640 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56512de7ce70 con 0x56512de7dbd0 2024-09-13T06:10:18.685 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.679+0000 7f0fef470640 1 -- 172.21.15.194:0/1896516101 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fe8074030 con 0x56512de7dbd0 2024-09-13T06:10:18.685 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.679+0000 7f0fef470640 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56512de7ce70 con 0x56512de7dbd0 2024-09-13T06:10:18.685 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.679+0000 7f0fef470640 1 -- 172.21.15.194:0/1896516101 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fe8074030 con 0x56512de7dbd0 2024-09-13T06:10:18.685 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.679+0000 7f0fef470640 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56512de7ce70 con 0x7f0fd80cc040 2024-09-13T06:10:18.685 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.679+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fe00083f0 con 0x7f0fd80cc040 2024-09-13T06:10:18.685 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.679+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56512de7ce70 con 0x56512de7dbd0 2024-09-13T06:10:18.685 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.679+0000 7f0fef470640 1 -- 172.21.15.194:0/1896516101 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fe8074030 con 0x56512de7dbd0 2024-09-13T06:10:18.686 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.679+0000 7f0fef470640 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56512de7ce70 con 0x56512de7dbd0 2024-09-13T06:10:18.686 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.679+0000 7f0fef470640 1 -- 172.21.15.194:0/1896516101 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fe8074030 con 0x56512de7dbd0 2024-09-13T06:10:18.686 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.679+0000 7f0fef470640 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56512de7ce70 con 0x56512de791e0 2024-09-13T06:10:18.686 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.679+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fe00083f0 con 0x56512de791e0 2024-09-13T06:10:18.686 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.679+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56512de7ce70 con 0x56512de791e0 2024-09-13T06:10:18.686 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.679+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0fe00083f0 con 0x56512de791e0 2024-09-13T06:10:18.686 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.679+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56512de7ce70 con 0x7f0fe8077060 2024-09-13T06:10:18.686 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.683+0000 7f0feec6f640 1 -- 172.21.15.194:0/1896516101 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fd80e3040 con 0x7f0fe8077060 2024-09-13T06:10:18.686 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.683+0000 7f0feec6f640 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56512de7ce70 con 0x56512de7dbd0 2024-09-13T06:10:18.686 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.683+0000 7f0fef470640 1 -- 172.21.15.194:0/1896516101 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fe8074030 con 0x56512de7dbd0 2024-09-13T06:10:18.686 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.683+0000 7f0fef470640 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56512de7ce70 con 0x7f0fe8077060 2024-09-13T06:10:18.686 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.683+0000 7f0feec6f640 1 -- 172.21.15.194:0/1896516101 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fd80e3040 con 0x7f0fe8077060 2024-09-13T06:10:18.687 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.683+0000 7f0feec6f640 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56512de7ce70 con 0x56512de791e0 2024-09-13T06:10:18.687 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.683+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fe00083f0 con 0x56512de791e0 2024-09-13T06:10:18.687 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.683+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56512de7ce70 con 0x7f0fd80cc040 2024-09-13T06:10:18.691 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.683+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fe00083f0 con 0x7f0fd80cc040 2024-09-13T06:10:18.691 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.683+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56512de7ce70 con 0x56512de7dbd0 2024-09-13T06:10:18.692 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.683+0000 7f0fef470640 1 -- 172.21.15.194:0/1896516101 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0fe8074030 con 0x56512de7dbd0 2024-09-13T06:10:18.692 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.683+0000 7f0fef470640 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56512de7ce70 con 0x7f0fe8077060 2024-09-13T06:10:18.692 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.683+0000 7f0feec6f640 1 -- 172.21.15.194:0/1896516101 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fd80e3040 con 0x7f0fe8077060 2024-09-13T06:10:18.692 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.683+0000 7f0feec6f640 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56512de7ce70 con 0x7f0fe8077060 2024-09-13T06:10:18.692 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.683+0000 7f0feec6f640 1 -- 172.21.15.194:0/1896516101 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fd80e3040 con 0x7f0fe8077060 2024-09-13T06:10:18.692 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.683+0000 7f0feec6f640 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56512de7ce70 con 0x56512de7dbd0 2024-09-13T06:10:18.692 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.683+0000 7f0fef470640 1 -- 172.21.15.194:0/1896516101 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fe8074030 con 0x56512de7dbd0 2024-09-13T06:10:18.692 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.683+0000 7f0fef470640 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56512de7ce70 con 0x7f0fd80cc040 2024-09-13T06:10:18.692 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.683+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fe00083f0 con 0x7f0fd80cc040 2024-09-13T06:10:18.692 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.683+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56512de7ce70 con 0x56512de791e0 2024-09-13T06:10:18.692 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.687+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0fe00083f0 con 0x56512de791e0 2024-09-13T06:10:18.692 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.687+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56512de7ce70 con 0x7f0fe8077060 2024-09-13T06:10:18.693 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.687+0000 7f0feec6f640 1 -- 172.21.15.194:0/1896516101 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0fd80e3040 con 0x7f0fe8077060 2024-09-13T06:10:18.693 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.687+0000 7f0ff1960980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:10:18.693 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.687+0000 7f0ff1960980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:10:18.693 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.687+0000 7f0ff1960980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:10:18.693 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.687+0000 7f0ff1960980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:10:18.693 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.687+0000 7f0ff1960980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:10:18.693 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.687+0000 7f0ff1960980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:10:18.693 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.687+0000 7f0ff1960980 20 rados->read ofs=0 len=0 2024-09-13T06:10:18.693 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.687+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56512de80fc0 con 0x56512de791e0 2024-09-13T06:10:18.693 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.687+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0fe00083f0 con 0x56512de791e0 2024-09-13T06:10:18.693 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.687+0000 7f0ff1960980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:18.693 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.687+0000 7f0ff1960980 20 rados->read ofs=0 len=0 2024-09-13T06:10:18.694 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.687+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56512de80c00 con 0x56512de791e0 2024-09-13T06:10:18.694 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.687+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0fe00083f0 con 0x56512de791e0 2024-09-13T06:10:18.694 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.687+0000 7f0ff1960980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:10:18.694 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.687+0000 7f0ff1960980 20 rados->read ofs=0 len=0 2024-09-13T06:10:18.694 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.687+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56512de818e0 con 0x7f0fe8077060 2024-09-13T06:10:18.694 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.687+0000 7f0feec6f640 1 -- 172.21.15.194:0/1896516101 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0fd80e3040 con 0x7f0fe8077060 2024-09-13T06:10:18.694 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.687+0000 7f0ff1960980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:10:18.694 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.687+0000 7f0ff1960980 20 zone default found 2024-09-13T06:10:18.694 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.687+0000 7f0ff1960980 4 Realm: () 2024-09-13T06:10:18.694 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.687+0000 7f0ff1960980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:10:18.694 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.687+0000 7f0ff1960980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:10:18.694 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.687+0000 7f0ff1960980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:10:18.694 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.687+0000 7f0ff1960980 20 zonegroup default 2024-09-13T06:10:18.695 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.687+0000 7f0ff1960980 20 rados->read ofs=0 len=0 2024-09-13T06:10:18.695 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.687+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56512de822d0 con 0x7f0fd80cc040 2024-09-13T06:10:18.695 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.687+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0fe00083f0 con 0x7f0fd80cc040 2024-09-13T06:10:18.695 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.687+0000 7f0ff1960980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:18.695 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.687+0000 7f0ff1960980 20 rados->read ofs=0 len=0 2024-09-13T06:10:18.695 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.687+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56512de83cb0 con 0x56512de7dbd0 2024-09-13T06:10:18.695 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.687+0000 7f0fef470640 1 -- 172.21.15.194:0/1896516101 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0fe8074030 con 0x56512de7dbd0 2024-09-13T06:10:18.695 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.687+0000 7f0ff1960980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:18.695 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.687+0000 7f0ff1960980 20 rados->read ofs=0 len=0 2024-09-13T06:10:18.695 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.687+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56512de840d0 con 0x56512de7dbd0 2024-09-13T06:10:18.695 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.687+0000 7f0fef470640 1 -- 172.21.15.194:0/1896516101 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0fe8074030 con 0x56512de7dbd0 2024-09-13T06:10:18.695 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.687+0000 7f0ff1960980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:18.695 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.687+0000 7f0ff1960980 20 started sync module instance, tier type = 2024-09-13T06:10:18.696 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.687+0000 7f0ff1960980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:10:18.696 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.687+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56512de81db0 con 0x7f0fe8077060 2024-09-13T06:10:18.696 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.691+0000 7f0feec6f640 1 -- 172.21.15.194:0/1896516101 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(44 notify.0 [create] v35'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fd80e3040 con 0x7f0fe8077060 2024-09-13T06:10:18.696 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.691+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94906662531584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56512de84530 con 0x7f0fe8077060 2024-09-13T06:10:18.696 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.691+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56512de84fa0 con 0x56512de791e0 2024-09-13T06:10:18.696 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.691+0000 7f0feec6f640 1 -- 172.21.15.194:0/1896516101 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94906662531584] v35'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fd80e3040 con 0x7f0fe8077060 2024-09-13T06:10:18.697 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.691+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v35'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fe00083f0 con 0x56512de791e0 2024-09-13T06:10:18.698 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.691+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94906662537872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56512de85390 con 0x56512de791e0 2024-09-13T06:10:18.698 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.691+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56512de85d50 con 0x56512de7dbd0 2024-09-13T06:10:18.698 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.695+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94906662537872] v35'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fe00083f0 con 0x56512de791e0 2024-09-13T06:10:18.698 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.695+0000 7f0fef470640 1 -- 172.21.15.194:0/1896516101 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v35'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fe8074030 con 0x56512de7dbd0 2024-09-13T06:10:18.698 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.695+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94906662541472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56512de86140 con 0x56512de7dbd0 2024-09-13T06:10:18.698 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.695+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56512de86b00 con 0x7f0fe8077060 2024-09-13T06:10:18.698 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.695+0000 7f0feec6f640 1 -- 172.21.15.194:0/1896516101 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(50 notify.3 [create] v35'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fd80e3040 con 0x7f0fe8077060 2024-09-13T06:10:18.698 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.695+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94906662544976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56512de87350 con 0x7f0fe8077060 2024-09-13T06:10:18.699 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.695+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56512de87d50 con 0x56512de791e0 2024-09-13T06:10:18.699 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.695+0000 7f0fef470640 1 -- 172.21.15.194:0/1896516101 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94906662541472] v35'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fe8074030 con 0x56512de7dbd0 2024-09-13T06:10:18.699 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.695+0000 7f0feec6f640 1 -- 172.21.15.194:0/1896516101 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94906662544976] v35'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fd80e3040 con 0x7f0fe8077060 2024-09-13T06:10:18.699 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.699+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v35'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fe00083f0 con 0x56512de791e0 2024-09-13T06:10:18.699 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.699+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94906662532832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56512de86ea0 con 0x56512de791e0 2024-09-13T06:10:18.699 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.699+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56512de885f0 con 0x7f0fd80cc040 2024-09-13T06:10:18.700 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.699+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(54 notify.5 [create] v35'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fe00083f0 con 0x7f0fd80cc040 2024-09-13T06:10:18.701 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.699+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94906662551440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56512de88860 con 0x7f0fd80cc040 2024-09-13T06:10:18.701 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.699+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56512de890b0 con 0x7f0fd80cc040 2024-09-13T06:10:18.701 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.699+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94906662532832] v35'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fe00083f0 con 0x56512de791e0 2024-09-13T06:10:18.702 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.703+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94906662551440] v35'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fe00083f0 con 0x7f0fd80cc040 2024-09-13T06:10:18.703 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.703+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(56 notify.6 [create] v35'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fe00083f0 con 0x7f0fd80cc040 2024-09-13T06:10:18.703 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.703+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94906662552496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56512de88c80 con 0x7f0fd80cc040 2024-09-13T06:10:18.703 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.703+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56512de894d0 con 0x7f0fd80cc040 2024-09-13T06:10:18.705 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.703+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(58 notify.7 [create] v35'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fe00083f0 con 0x7f0fd80cc040 2024-09-13T06:10:18.705 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.703+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94906662555232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56512de898d0 con 0x7f0fd80cc040 2024-09-13T06:10:18.705 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.703+0000 7f0ff1960980 20 add_watcher() i=0 2024-09-13T06:10:18.705 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.703+0000 7f0ff1960980 20 add_watcher() i=1 2024-09-13T06:10:18.705 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.703+0000 7f0ff1960980 20 add_watcher() i=2 2024-09-13T06:10:18.705 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.703+0000 7f0ff1960980 20 add_watcher() i=3 2024-09-13T06:10:18.705 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.703+0000 7f0ff1960980 20 add_watcher() i=4 2024-09-13T06:10:18.705 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.703+0000 7f0ff1960980 20 add_watcher() i=5 2024-09-13T06:10:18.705 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.703+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94906662552496] v35'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fe00083f0 con 0x7f0fd80cc040 2024-09-13T06:10:18.705 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.703+0000 7f0ff1960980 20 add_watcher() i=6 2024-09-13T06:10:18.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.707+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94906662555232] v35'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fe00083f0 con 0x7f0fd80cc040 2024-09-13T06:10:18.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.707+0000 7f0ff1960980 20 add_watcher() i=7 2024-09-13T06:10:18.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.707+0000 7f0ff1960980 2 all 8 watchers are set, enabling cache 2024-09-13T06:10:18.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.707+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56512de887d0 con 0x56512de791e0 2024-09-13T06:10:18.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.707+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0fe00083f0 con 0x56512de791e0 2024-09-13T06:10:18.708 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.707+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94906662553552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56512de89e10 con 0x56512de791e0 2024-09-13T06:10:18.708 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.707+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94906662553552] v35'173 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0fe00083f0 con 0x56512de791e0 2024-09-13T06:10:18.708 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.707+0000 7f0ea5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:10:18.709 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.707+0000 7f0ff1960980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:10:18.709 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.707+0000 7f0ff1960980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:10:18.709 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.707+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56512de95250 con 0x56512de791e0 2024-09-13T06:10:18.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.711+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v35'30 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0fe00083f0 con 0x56512de791e0 2024-09-13T06:10:18.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.711+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56512de95920 con 0x7f0fd80cc040 2024-09-13T06:10:18.713 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.711+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v35'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0fe00083f0 con 0x7f0fd80cc040 2024-09-13T06:10:18.713 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.711+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56512de95d40 con 0x56512de7dbd0 2024-09-13T06:10:18.714 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.715+0000 7f0fef470640 1 -- 172.21.15.194:0/1896516101 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v35'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0fe8074030 con 0x56512de7dbd0 2024-09-13T06:10:18.714 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.715+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56512de95d10 con 0x56512de791e0 2024-09-13T06:10:18.716 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.715+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v35'174 uv164 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0fe00083f0 con 0x56512de791e0 2024-09-13T06:10:18.716 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.715+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56512de962a0 con 0x7f0fe8077060 2024-09-13T06:10:18.717 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.715+0000 7f0feec6f640 1 -- 172.21.15.194:0/1896516101 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v35'59 uv53 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0fd80e3040 con 0x7f0fe8077060 2024-09-13T06:10:18.717 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.715+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56512de96810 con 0x56512de7dbd0 2024-09-13T06:10:18.718 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.719+0000 7f0fef470640 1 -- 172.21.15.194:0/1896516101 <== osd.3 v2:172.21.15.194:6816/96632515 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v35'40 uv37 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0fe8074030 con 0x56512de7dbd0 2024-09-13T06:10:18.718 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.719+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56512de96bf0 con 0x56512de791e0 2024-09-13T06:10:18.721 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.719+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v35'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0fe00083f0 con 0x56512de791e0 2024-09-13T06:10:18.721 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.719+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56512de96bf0 con 0x7f0fd80cc040 2024-09-13T06:10:18.723 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.723+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v35'39 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0fe00083f0 con 0x7f0fd80cc040 2024-09-13T06:10:18.723 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.723+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56512de96bf0 con 0x7f0fe8077060 2024-09-13T06:10:18.725 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.723+0000 7f0feec6f640 1 -- 172.21.15.194:0/1896516101 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v35'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0fd80e3040 con 0x7f0fe8077060 2024-09-13T06:10:18.725 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.723+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56512de970a0 con 0x56512de7dbd0 2024-09-13T06:10:18.726 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.727+0000 7f0fef470640 1 -- 172.21.15.194:0/1896516101 <== osd.3 v2:172.21.15.194:6816/96632515 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v35'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0fe8074030 con 0x56512de7dbd0 2024-09-13T06:10:18.727 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.727+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56512de970a0 con 0x7f0fe8077060 2024-09-13T06:10:18.728 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.727+0000 7f0feec6f640 1 -- 172.21.15.194:0/1896516101 <== osd.2 v2:172.21.15.194:6800/815615585 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v35'60 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0fd80e3040 con 0x7f0fe8077060 2024-09-13T06:10:18.728 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.727+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56512de93090 con 0x7f0fd80cc040 2024-09-13T06:10:18.730 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.727+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v35'26 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0fe00083f0 con 0x7f0fd80cc040 2024-09-13T06:10:18.730 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.731+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56512de93090 con 0x7f0fe8077060 2024-09-13T06:10:18.731 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.731+0000 7f0feec6f640 1 -- 172.21.15.194:0/1896516101 <== osd.2 v2:172.21.15.194:6800/815615585 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v35'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0fd80e3040 con 0x7f0fe8077060 2024-09-13T06:10:18.731 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.731+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56512de93090 con 0x7f0fd80cc040 2024-09-13T06:10:18.733 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.731+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v35'45 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0fe00083f0 con 0x7f0fd80cc040 2024-09-13T06:10:18.733 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.731+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56512de92ec0 con 0x56512de791e0 2024-09-13T06:10:18.735 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.735+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v35'175 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0fe00083f0 con 0x56512de791e0 2024-09-13T06:10:18.735 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.735+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56512de92ec0 con 0x56512de7dbd0 2024-09-13T06:10:18.737 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.735+0000 7f0fef470640 1 -- 172.21.15.194:0/1896516101 <== osd.3 v2:172.21.15.194:6816/96632515 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v35'53 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0fe8074030 con 0x56512de7dbd0 2024-09-13T06:10:18.737 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.735+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56512de92ec0 con 0x7f0fe8077060 2024-09-13T06:10:18.738 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.739+0000 7f0feec6f640 1 -- 172.21.15.194:0/1896516101 <== osd.2 v2:172.21.15.194:6800/815615585 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v35'61 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0fd80e3040 con 0x7f0fe8077060 2024-09-13T06:10:18.738 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.739+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56512de92ec0 con 0x56512de7dbd0 2024-09-13T06:10:18.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.739+0000 7f0fef470640 1 -- 172.21.15.194:0/1896516101 <== osd.3 v2:172.21.15.194:6816/96632515 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v35'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0fe8074030 con 0x56512de7dbd0 2024-09-13T06:10:18.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.739+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56512de92ec0 con 0x56512de791e0 2024-09-13T06:10:18.741 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.739+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 <== osd.1 v2:172.21.15.194:6808/3135444559 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v35'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0fe00083f0 con 0x56512de791e0 2024-09-13T06:10:18.741 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.739+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56512de92ec0 con 0x56512de791e0 2024-09-13T06:10:18.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.743+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 <== osd.1 v2:172.21.15.194:6808/3135444559 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v35'176 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0fe00083f0 con 0x56512de791e0 2024-09-13T06:10:18.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.743+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56512de92ec0 con 0x56512de7dbd0 2024-09-13T06:10:18.745 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.743+0000 7f0fef470640 1 -- 172.21.15.194:0/1896516101 <== osd.3 v2:172.21.15.194:6816/96632515 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v35'54 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0fe8074030 con 0x56512de7dbd0 2024-09-13T06:10:18.745 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.743+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56512de92ec0 con 0x7f0fe8077060 2024-09-13T06:10:18.746 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.747+0000 7f0feec6f640 1 -- 172.21.15.194:0/1896516101 <== osd.2 v2:172.21.15.194:6800/815615585 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v35'33 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0fd80e3040 con 0x7f0fe8077060 2024-09-13T06:10:18.746 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.747+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56512de92ec0 con 0x56512de7dbd0 2024-09-13T06:10:18.747 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.747+0000 7f0fef470640 1 -- 172.21.15.194:0/1896516101 <== osd.3 v2:172.21.15.194:6816/96632515 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v35'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0fe8074030 con 0x56512de7dbd0 2024-09-13T06:10:18.747 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.747+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56512de92ec0 con 0x56512de7dbd0 2024-09-13T06:10:18.749 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.747+0000 7f0fef470640 1 -- 172.21.15.194:0/1896516101 <== osd.3 v2:172.21.15.194:6816/96632515 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v35'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0fe8074030 con 0x56512de7dbd0 2024-09-13T06:10:18.749 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.747+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56512de92ec0 con 0x56512de7dbd0 2024-09-13T06:10:18.750 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.747+0000 7f0fef470640 1 -- 172.21.15.194:0/1896516101 <== osd.3 v2:172.21.15.194:6816/96632515 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v35'19 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0fe8074030 con 0x56512de7dbd0 2024-09-13T06:10:18.750 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.747+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56512de92ec0 con 0x56512de7dbd0 2024-09-13T06:10:18.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.751+0000 7f0fef470640 1 -- 172.21.15.194:0/1896516101 <== osd.3 v2:172.21.15.194:6816/96632515 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v35'41 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0fe8074030 con 0x56512de7dbd0 2024-09-13T06:10:18.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.751+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56512de92ec0 con 0x7f0fd80cc040 2024-09-13T06:10:18.753 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.751+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v35'27 uv25 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0fe00083f0 con 0x7f0fd80cc040 2024-09-13T06:10:18.754 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.751+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56512de92ec0 con 0x56512de7dbd0 2024-09-13T06:10:18.755 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.755+0000 7f0fef470640 1 -- 172.21.15.194:0/1896516101 <== osd.3 v2:172.21.15.194:6816/96632515 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v35'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0fe8074030 con 0x56512de7dbd0 2024-09-13T06:10:18.755 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.755+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56512de92ec0 con 0x7f0fd80cc040 2024-09-13T06:10:18.758 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.755+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 <== osd.0 v2:172.21.15.120:6800/1923744619 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v35'40 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0fe00083f0 con 0x7f0fd80cc040 2024-09-13T06:10:18.758 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.755+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56512de92ec0 con 0x56512de7dbd0 2024-09-13T06:10:18.760 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.759+0000 7f0fef470640 1 -- 172.21.15.194:0/1896516101 <== osd.3 v2:172.21.15.194:6816/96632515 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v35'55 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0fe8074030 con 0x56512de7dbd0 2024-09-13T06:10:18.760 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.759+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56512de92ec0 con 0x7f0fd80cc040 2024-09-13T06:10:18.763 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.763+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 <== osd.0 v2:172.21.15.120:6800/1923744619 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v35'46 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0fe00083f0 con 0x7f0fd80cc040 2024-09-13T06:10:18.763 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.763+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56512de92ec0 con 0x7f0fe8077060 2024-09-13T06:10:18.765 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.763+0000 7f0feec6f640 1 -- 172.21.15.194:0/1896516101 <== osd.2 v2:172.21.15.194:6800/815615585 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v35'30 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0fd80e3040 con 0x7f0fe8077060 2024-09-13T06:10:18.766 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.763+0000 7f0ea4fe1640 20 reqs_thread_entry: start 2024-09-13T06:10:18.766 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.763+0000 7f0ff1960980 20 init_complete bucket index max shards: 11 2024-09-13T06:10:18.766 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.763+0000 7f0ff1960980 20 Filter name: none 2024-09-13T06:10:18.766 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.763+0000 7f0e1e7fc640 20 reqs_thread_entry: start 2024-09-13T06:10:18.766 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.763+0000 7f0ff1960980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T06:10:18.766 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.763+0000 7f0ff1960980 20 rados->read ofs=0 len=0 2024-09-13T06:10:18.766 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.767+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56512de92ef0 con 0x56512de791e0 2024-09-13T06:10:18.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.767+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 <== osd.1 v2:172.21.15.194:6808/3135444559 27 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv20 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f0fe00083f0 con 0x56512de791e0 2024-09-13T06:10:18.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.767+0000 7f0ff1960980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T06:10:18.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.767+0000 7f0ff1960980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T06:10:18.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.767+0000 7f0ff1960980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:10:18.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.767+0000 7f0ff1960980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:10:18.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.767+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56512deb51d0 con 0x7f0fe8077060 2024-09-13T06:10:18.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.767+0000 7f0feec6f640 1 -- 172.21.15.194:0/1896516101 <== osd.2 v2:172.21.15.194:6800/815615585 21 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f0fd80e3040 con 0x7f0fe8077060 2024-09-13T06:10:18.768 INFO:teuthology.orchestra.run.smithi194.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-13T06:10:18.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.767+0000 7f0ea5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:10:18.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.767+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94906662553552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56512de8ee80 con 0x56512de791e0 2024-09-13T06:10:18.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.767+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 <== osd.1 v2:172.21.15.194:6808/3135444559 28 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94906662553552] v35'177 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0fe00083f0 con 0x56512de791e0 2024-09-13T06:10:18.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.767+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94906662531584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56512de887d0 con 0x7f0fe8077060 2024-09-13T06:10:18.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.771+0000 7f0feec6f640 1 -- 172.21.15.194:0/1896516101 <== osd.2 v2:172.21.15.194:6800/815615585 22 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94906662531584] v35'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fd80e3040 con 0x7f0fe8077060 2024-09-13T06:10:18.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.771+0000 7f0ff1960980 20 remove_watcher() i=0 2024-09-13T06:10:18.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.771+0000 7f0ff1960980 2 removed watcher, disabling cache 2024-09-13T06:10:18.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.771+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94906662537872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56512de83200 con 0x56512de791e0 2024-09-13T06:10:18.773 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.771+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 <== osd.1 v2:172.21.15.194:6808/3135444559 29 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94906662537872] v35'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fe00083f0 con 0x56512de791e0 2024-09-13T06:10:18.773 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.771+0000 7f0ff1960980 20 remove_watcher() i=1 2024-09-13T06:10:18.774 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.771+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94906662541472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56512de83200 con 0x56512de7dbd0 2024-09-13T06:10:18.776 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.775+0000 7f0fef470640 1 -- 172.21.15.194:0/1896516101 <== osd.3 v2:172.21.15.194:6816/96632515 27 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94906662541472] v35'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fe8074030 con 0x56512de7dbd0 2024-09-13T06:10:18.776 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.775+0000 7f0ff1960980 20 remove_watcher() i=2 2024-09-13T06:10:18.776 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.775+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94906662544976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56512de858a0 con 0x7f0fe8077060 2024-09-13T06:10:18.777 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.775+0000 7f0feec6f640 1 -- 172.21.15.194:0/1896516101 <== osd.2 v2:172.21.15.194:6800/815615585 23 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94906662544976] v35'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fd80e3040 con 0x7f0fe8077060 2024-09-13T06:10:18.777 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.775+0000 7f0ff1960980 20 remove_watcher() i=3 2024-09-13T06:10:18.777 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.775+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94906662532832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56512de83200 con 0x56512de791e0 2024-09-13T06:10:18.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.779+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 <== osd.1 v2:172.21.15.194:6808/3135444559 30 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94906662532832] v35'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fe00083f0 con 0x56512de791e0 2024-09-13T06:10:18.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.779+0000 7f0ff1960980 20 remove_watcher() i=4 2024-09-13T06:10:18.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.779+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94906662551440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56512de86650 con 0x7f0fd80cc040 2024-09-13T06:10:18.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.779+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 <== osd.0 v2:172.21.15.120:6800/1923744619 22 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94906662551440] v35'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fe00083f0 con 0x7f0fd80cc040 2024-09-13T06:10:18.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.779+0000 7f0ff1960980 20 remove_watcher() i=5 2024-09-13T06:10:18.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.779+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94906662552496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56512de83200 con 0x7f0fd80cc040 2024-09-13T06:10:18.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.783+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 <== osd.0 v2:172.21.15.120:6800/1923744619 23 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94906662552496] v35'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fe00083f0 con 0x7f0fd80cc040 2024-09-13T06:10:18.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.783+0000 7f0ff1960980 20 remove_watcher() i=6 2024-09-13T06:10:18.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.783+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94906662555232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56512de86650 con 0x7f0fd80cc040 2024-09-13T06:10:18.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.783+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 <== osd.0 v2:172.21.15.120:6800/1923744619 24 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94906662555232] v35'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0fe00083f0 con 0x7f0fd80cc040 2024-09-13T06:10:18.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.783+0000 7f0ff1960980 20 remove_watcher() i=7 2024-09-13T06:10:18.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.787+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f0fd80cc040 msgr2=0x7f0fd80d9410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:18.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.787+0000 7f0ff1960980 1 --2- 172.21.15.194:0/1896516101 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f0fd80cc040 0x7f0fd80d9410 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:18.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.787+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x56512de791e0 msgr2=0x56512de7b6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:18.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.787+0000 7f0ff1960980 1 --2- 172.21.15.194:0/1896516101 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x56512de791e0 0x56512de7b6a0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:18.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.787+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f0fe8077060 msgr2=0x7f0fe8048580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:18.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.787+0000 7f0ff1960980 1 --2- 172.21.15.194:0/1896516101 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f0fe8077060 0x7f0fe8048580 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:18.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.787+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x56512de7dbd0 msgr2=0x56512de7ffc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:18.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.787+0000 7f0ff1960980 1 --2- 172.21.15.194:0/1896516101 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x56512de7dbd0 0x56512de7ffc0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:18.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.787+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0eb8034650 msgr2=0x7f0eb8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:18.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.787+0000 7f0ff1960980 1 --2- 172.21.15.194:0/1896516101 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0eb8034650 0x7f0eb8036b10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0fd80aafd0 tx=0x7f0fd80b8040 comp rx=0 tx=0).stop 2024-09-13T06:10:18.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.787+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56512de66f40 msgr2=0x56512de6e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:18.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.787+0000 7f0fefc71640 1 -- 172.21.15.194:0/1896516101 reap_dead start 2024-09-13T06:10:18.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.787+0000 7f0ff1960980 1 --2- 172.21.15.194:0/1896516101 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56512de66f40 0x56512de6e0a0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f0fe80472c0 tx=0x7f0fe804af40 comp rx=0 tx=0).stop 2024-09-13T06:10:18.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.787+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 shutdown_connections 2024-09-13T06:10:18.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.787+0000 7f0ff1960980 1 --2- 172.21.15.194:0/1896516101 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56512de66f40 0x56512de6e0a0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:18.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.787+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 >> 172.21.15.194:0/1896516101 conn(0x56512de63320 msgr2=0x56512de613f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:18.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.787+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 shutdown_connections 2024-09-13T06:10:18.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.787+0000 7f0ff1960980 1 -- 172.21.15.194:0/1896516101 wait complete. 2024-09-13T06:10:18.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.787+0000 7f0ff1960980 1 -- 172.21.15.194:0/2977123394 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0ec8034650 msgr2=0x7f0ec8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:18.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.787+0000 7f0ff1960980 1 --2- 172.21.15.194:0/2977123394 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0ec8034650 0x7f0ec8036b10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0fd8000c10 tx=0x7f0fd8005ad0 comp rx=0 tx=0).stop 2024-09-13T06:10:18.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.787+0000 7f0ff1960980 1 -- 172.21.15.194:0/2977123394 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56512de5a5d0 msgr2=0x56512de5a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:18.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.787+0000 7f0ff1960980 1 --2- 172.21.15.194:0/2977123394 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56512de5a5d0 0x56512de5a9f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f0fe8048500 tx=0x7f0fe801ee40 comp rx=0 tx=0).stop 2024-09-13T06:10:18.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.787+0000 7f0ff1960980 1 -- 172.21.15.194:0/2977123394 shutdown_connections 2024-09-13T06:10:18.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.787+0000 7f0ff1960980 1 --2- 172.21.15.194:0/2977123394 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0ec8034650 0x7f0ec8036b10 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:18.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.787+0000 7f0ff1960980 1 --2- 172.21.15.194:0/2977123394 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56512de5a5d0 0x56512de5a9f0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:18.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.787+0000 7f0ff1960980 1 -- 172.21.15.194:0/2977123394 >> 172.21.15.194:0/2977123394 conn(0x56512de4f720 msgr2=0x56512de521a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:18.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.787+0000 7f0ff1960980 1 -- 172.21.15.194:0/2977123394 shutdown_connections 2024-09-13T06:10:18.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.787+0000 7f0ff1960980 1 -- 172.21.15.194:0/2977123394 wait complete. 2024-09-13T06:10:18.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.787+0000 7f0ff1960980 1 -- 172.21.15.194:0/3312522189 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x56512dd45870 msgr2=0x56512de43730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:18.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.787+0000 7f0ff1960980 1 --2- 172.21.15.194:0/3312522189 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x56512dd45870 0x56512de43730 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:18.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.787+0000 7f0ff1960980 1 -- 172.21.15.194:0/3312522189 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x56512de49fc0 msgr2=0x56512de4c3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:18.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.787+0000 7f0ff1960980 1 --2- 172.21.15.194:0/3312522189 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x56512de49fc0 0x56512de4c3b0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:18.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.787+0000 7f0ff1960980 1 -- 172.21.15.194:0/3312522189 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x56512de460c0 msgr2=0x56512de484b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:18.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.787+0000 7f0ff1960980 1 --2- 172.21.15.194:0/3312522189 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x56512de460c0 0x56512de484b0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:18.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.787+0000 7f0ff1960980 1 -- 172.21.15.194:0/3312522189 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0ed40346a0 msgr2=0x7f0ed4036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:18.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.787+0000 7f0ff1960980 1 --2- 172.21.15.194:0/3312522189 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0ed40346a0 0x7f0ed4036b60 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0fd80ac000 tx=0x7f0fd80a5000 comp rx=0 tx=0).stop 2024-09-13T06:10:18.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.787+0000 7f0ff1960980 1 -- 172.21.15.194:0/3312522189 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56512dcb82d0 msgr2=0x56512de3c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:18.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.787+0000 7f0ff1960980 1 --2- 172.21.15.194:0/3312522189 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56512dcb82d0 0x56512de3c760 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f0fe8006640 tx=0x7f0fe8000f50 comp rx=0 tx=0).stop 2024-09-13T06:10:18.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.787+0000 7f0fefc71640 1 -- 172.21.15.194:0/3312522189 reap_dead start 2024-09-13T06:10:18.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.787+0000 7f0ff1960980 1 -- 172.21.15.194:0/3312522189 shutdown_connections 2024-09-13T06:10:18.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.787+0000 7f0ff1960980 1 -- 172.21.15.194:0/3312522189 >> 172.21.15.194:0/3312522189 conn(0x56512dd3e090 msgr2=0x56512de2fba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:18.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.787+0000 7f0ff1960980 1 -- 172.21.15.194:0/3312522189 shutdown_connections 2024-09-13T06:10:18.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.787+0000 7f0ff1960980 1 -- 172.21.15.194:0/3312522189 wait complete. 2024-09-13T06:10:18.800 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-13T06:10:18.811 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=236 failed=True 2024-09-13T06:10:18.818 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T06:10:18.860 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T06:10:18.879 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T06:10:18.921 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-09-13T06:10:18.932 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T06:10:18.933 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-13T06:10:18.933 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-13T06:10:18.933 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-09-13T06:10:18.972 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:10:18.972 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:10:18.973 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.971+0000 7f5726155980 1 Processor -- start 2024-09-13T06:10:18.973 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.971+0000 7f5726155980 1 -- start start 2024-09-13T06:10:18.973 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.971+0000 7f5726155980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55ee8fb7f550 0x55ee8fb7f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:18.973 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.971+0000 7f5726155980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ee8fa08ae0 con 0x55ee8fb7fea0 2024-09-13T06:10:18.973 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.971+0000 7f5726155980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x55ee8fa2ce30 con 0x55ee8fb7f550 2024-09-13T06:10:18.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.971+0000 7f5723c65640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55ee8fb7f550 0x55ee8fb7f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:18.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.971+0000 7f5723464640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x55ee8fb7fea0 0x55ee8fb84920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:59066/0 (socket says 172.21.15.194:59066) 2024-09-13T06:10:18.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.971+0000 7f5723464640 1 -- 172.21.15.194:0/3184325350 learned_addr learned my addr 172.21.15.194:0/3184325350 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-09-13T06:10:18.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.971+0000 7f5723c65640 1 -- 172.21.15.194:0/3184325350 >> v1:172.21.15.120:6789/0 conn(0x55ee8fb7fea0 legacy=0x55ee8fb84920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:18.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.975+0000 7f5723c65640 1 -- 172.21.15.194:0/3184325350 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee8fb87170 con 0x55ee8fb7f550 2024-09-13T06:10:18.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.975+0000 7f5723c65640 1 --2- 172.21.15.194:0/3184325350 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee8fb7f550 0x55ee8fb7f930 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f571400a480 tx=0x7f571401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80909ec12b0cf635 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:18.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.975+0000 7f5722c63640 1 -- 172.21.15.194:0/3184325350 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57140b0070 con 0x55ee8fb7f550 2024-09-13T06:10:18.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.975+0000 7f5722c63640 1 -- 172.21.15.194:0/3184325350 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57140ab540 con 0x55ee8fb7f550 2024-09-13T06:10:18.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.975+0000 7f5722c63640 1 -- 172.21.15.194:0/3184325350 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57140ab840 con 0x55ee8fb7f550 2024-09-13T06:10:18.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.979+0000 7f5726155980 1 -- 172.21.15.194:0/3184325350 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee8fb7f550 msgr2=0x55ee8fb7f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:18.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.979+0000 7f5726155980 1 --2- 172.21.15.194:0/3184325350 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee8fb7f550 0x55ee8fb7f930 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f571400a480 tx=0x7f571401b280 comp rx=0 tx=0).stop 2024-09-13T06:10:18.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.979+0000 7f5726155980 1 -- 172.21.15.194:0/3184325350 shutdown_connections 2024-09-13T06:10:18.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.979+0000 7f5726155980 1 --2- 172.21.15.194:0/3184325350 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee8fb7f550 0x55ee8fb7f930 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:18.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.979+0000 7f5726155980 1 -- 172.21.15.194:0/3184325350 >> 172.21.15.194:0/3184325350 conn(0x55ee8fb7b070 msgr2=0x55ee8fb7d490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:18.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.979+0000 7f5726155980 1 -- 172.21.15.194:0/3184325350 shutdown_connections 2024-09-13T06:10:18.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.979+0000 7f5726155980 1 -- 172.21.15.194:0/3184325350 wait complete. 2024-09-13T06:10:18.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.995+0000 7f5726155980 1 Processor -- start 2024-09-13T06:10:18.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.995+0000 7f5726155980 1 -- start start 2024-09-13T06:10:18.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.995+0000 7f5726155980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee8fb7f550 0x55ee8faf43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:18.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.995+0000 7f5726155980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55ee8fa2e200 con 0x55ee8fb7f550 2024-09-13T06:10:18.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.995+0000 7f5723c65640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee8fb7f550 0x55ee8faf43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:18.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.995+0000 7f5723c65640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee8fb7f550 0x55ee8faf43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:50640/0 (socket says 172.21.15.194:50640) 2024-09-13T06:10:18.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.995+0000 7f5723c65640 1 -- 172.21.15.194:0/1560108474 learned_addr learned my addr 172.21.15.194:0/1560108474 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:18.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.995+0000 7f5723c65640 1 -- 172.21.15.194:0/1560108474 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee8faf49c0 con 0x55ee8fb7f550 2024-09-13T06:10:18.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.995+0000 7f5723c65640 1 --2- 172.21.15.194:0/1560108474 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee8fb7f550 0x55ee8faf43f0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f57140ae040 tx=0x7f5714003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2af0e3c4ae3013a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:18.997 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.995+0000 7f5611e0b640 1 -- 172.21.15.194:0/1560108474 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57140b0040 con 0x55ee8fb7f550 2024-09-13T06:10:18.997 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.995+0000 7f5611e0b640 1 -- 172.21.15.194:0/1560108474 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57140ab9b0 con 0x55ee8fb7f550 2024-09-13T06:10:18.997 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.995+0000 7f5611e0b640 1 -- 172.21.15.194:0/1560108474 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57140abc90 con 0x55ee8fb7f550 2024-09-13T06:10:18.999 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.995+0000 7f5726155980 1 -- 172.21.15.194:0/1560108474 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee8fb7f550 msgr2=0x55ee8faf43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:18.999 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.995+0000 7f5726155980 1 --2- 172.21.15.194:0/1560108474 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee8fb7f550 0x55ee8faf43f0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f57140ae040 tx=0x7f5714003030 comp rx=0 tx=0).stop 2024-09-13T06:10:18.999 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.995+0000 7f5726155980 1 -- 172.21.15.194:0/1560108474 shutdown_connections 2024-09-13T06:10:18.999 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.995+0000 7f5726155980 1 --2- 172.21.15.194:0/1560108474 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee8fb7f550 0x55ee8faf43f0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:18.999 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.995+0000 7f5726155980 1 -- 172.21.15.194:0/1560108474 >> 172.21.15.194:0/1560108474 conn(0x55ee8fb7b070 msgr2=0x55ee8fc66620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:18.999 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.995+0000 7f5726155980 1 -- 172.21.15.194:0/1560108474 shutdown_connections 2024-09-13T06:10:18.999 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.995+0000 7f5726155980 1 -- 172.21.15.194:0/1560108474 wait complete. 2024-09-13T06:10:18.999 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.995+0000 7f5726155980 1 Processor -- start 2024-09-13T06:10:18.999 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.995+0000 7f5726155980 1 -- start start 2024-09-13T06:10:19.000 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.995+0000 7f5726155980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee8fb7f550 0x55ee8fc72ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.000 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.995+0000 7f5726155980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55ee8fb86bb0 con 0x55ee8fb7f550 2024-09-13T06:10:19.000 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.999+0000 7f5723c65640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee8fb7f550 0x55ee8fc72ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.000 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.999+0000 7f5723c65640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee8fb7f550 0x55ee8fc72ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:50652/0 (socket says 172.21.15.194:50652) 2024-09-13T06:10:19.000 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.999+0000 7f5723c65640 1 -- 172.21.15.194:0/2064569085 learned_addr learned my addr 172.21.15.194:0/2064569085 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:19.000 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.999+0000 7f5723c65640 1 -- 172.21.15.194:0/2064569085 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee8fc73220 con 0x55ee8fb7f550 2024-09-13T06:10:19.000 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.999+0000 7f5723c65640 1 --2- 172.21.15.194:0/2064569085 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee8fb7f550 0x55ee8fc72ce0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f57140030b0 tx=0x7f5714018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.999+0000 7f560bfff640 1 -- 172.21.15.194:0/2064569085 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57140c5070 con 0x55ee8fb7f550 2024-09-13T06:10:19.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.999+0000 7f560bfff640 1 -- 172.21.15.194:0/2064569085 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57140b6970 con 0x55ee8fb7f550 2024-09-13T06:10:19.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.999+0000 7f5726155980 1 -- 172.21.15.194:0/2064569085 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ee8fc734b0 con 0x55ee8fb7f550 2024-09-13T06:10:19.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.999+0000 7f560bfff640 1 -- 172.21.15.194:0/2064569085 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57140b0050 con 0x55ee8fb7f550 2024-09-13T06:10:19.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.999+0000 7f5726155980 1 -- 172.21.15.194:0/2064569085 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee8fc76190 con 0x55ee8fb7f550 2024-09-13T06:10:19.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.999+0000 7f560bfff640 1 -- 172.21.15.194:0/2064569085 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f57140c8070 con 0x55ee8fb7f550 2024-09-13T06:10:19.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.999+0000 7f560bfff640 1 --2- 172.21.15.194:0/2064569085 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f560c034650 0x7f560c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.999+0000 7f560bfff640 1 -- 172.21.15.194:0/2064569085 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f57140bc070 con 0x55ee8fb7f550 2024-09-13T06:10:19.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.999+0000 7f5723464640 1 --2- 172.21.15.194:0/2064569085 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f560c034650 0x7f560c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.999+0000 7f5726155980 1 --2- 172.21.15.194:0/2064569085 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ee8fb7fea0 0x55ee8fc79c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.999+0000 7f5726155980 1 -- 172.21.15.194:0/2064569085 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fc7a300 con 0x55ee8fb7fea0 2024-09-13T06:10:19.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.999+0000 7f5724466640 1 --2- 172.21.15.194:0/2064569085 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ee8fb7fea0 0x55ee8fc79c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.999+0000 7f5723464640 1 --2- 172.21.15.194:0/2064569085 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f560c034650 0x7f560c036b10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5718000f70 tx=0x7f57180012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:18.999+0000 7f5724466640 1 --2- 172.21.15.194:0/2064569085 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ee8fb7fea0 0x55ee8fc79c90 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.003+0000 7f5724466640 1 -- 172.21.15.194:0/2064569085 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f571c00a4d0 con 0x55ee8fb7fea0 2024-09-13T06:10:19.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.003+0000 7f5726155980 1 -- 172.21.15.194:0/2064569085 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fc773b0 con 0x55ee8fb7fea0 2024-09-13T06:10:19.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.003+0000 7f5724466640 1 -- 172.21.15.194:0/2064569085 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f571c00a4d0 con 0x55ee8fb7fea0 2024-09-13T06:10:19.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.003+0000 7f5726155980 1 --2- 172.21.15.194:0/2064569085 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ee8fc7c6a0 0x55ee8fc7ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.003+0000 7f5726155980 1 -- 172.21.15.194:0/2064569085 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fc7f180 con 0x55ee8fc7c6a0 2024-09-13T06:10:19.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.003+0000 7f5723c65640 1 --2- 172.21.15.194:0/2064569085 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ee8fc7c6a0 0x55ee8fc7ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.003+0000 7f5723c65640 1 --2- 172.21.15.194:0/2064569085 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ee8fc7c6a0 0x55ee8fc7ea90 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.003+0000 7f5723c65640 1 -- 172.21.15.194:0/2064569085 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f57140c7030 con 0x55ee8fc7c6a0 2024-09-13T06:10:19.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.003+0000 7f5726155980 1 -- 172.21.15.194:0/2064569085 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fc7b540 con 0x55ee8fb7fea0 2024-09-13T06:10:19.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.003+0000 7f5724466640 1 -- 172.21.15.194:0/2064569085 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f571c00a4d0 con 0x55ee8fb7fea0 2024-09-13T06:10:19.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.003+0000 7f5726155980 1 --2- 172.21.15.194:0/2064569085 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55ee8fc805e0 0x55ee8fc829d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.003+0000 7f5726155980 1 -- 172.21.15.194:0/2064569085 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fc83110 con 0x55ee8fc805e0 2024-09-13T06:10:19.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.003+0000 7f5723464640 1 --2- 172.21.15.194:0/2064569085 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55ee8fc805e0 0x55ee8fc829d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.003+0000 7f5723464640 1 --2- 172.21.15.194:0/2064569085 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55ee8fc805e0 0x55ee8fc829d0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.003+0000 7f5723464640 1 -- 172.21.15.194:0/2064569085 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f571800e620 con 0x55ee8fc805e0 2024-09-13T06:10:19.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.003+0000 7f5726155980 1 Processor -- start 2024-09-13T06:10:19.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.003+0000 7f5726155980 1 -- start start 2024-09-13T06:10:19.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.003+0000 7f5726155980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee8fc90be0 0x55ee8fc91020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.003+0000 7f5726155980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55ee8fa87800 con 0x55ee8fc90be0 2024-09-13T06:10:19.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.003+0000 7f5723c65640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee8fc90be0 0x55ee8fc91020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.003+0000 7f5723c65640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee8fc90be0 0x55ee8fc91020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:50664/0 (socket says 172.21.15.194:50664) 2024-09-13T06:10:19.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.003+0000 7f5723c65640 1 -- 172.21.15.194:0/807652899 learned_addr learned my addr 172.21.15.194:0/807652899 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:19.017 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.007+0000 7f5723c65640 1 -- 172.21.15.194:0/807652899 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee8fc91560 con 0x55ee8fc90be0 2024-09-13T06:10:19.017 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.007+0000 7f5723c65640 1 --2- 172.21.15.194:0/807652899 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee8fc90be0 0x55ee8fc91020 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f57140e1f50 tx=0x7f57140aafa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.017 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.007+0000 7f56097fa640 1 -- 172.21.15.194:0/807652899 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57140e33a0 con 0x55ee8fc90be0 2024-09-13T06:10:19.017 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.007+0000 7f5726155980 1 -- 172.21.15.194:0/807652899 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ee8fc94190 con 0x55ee8fc90be0 2024-09-13T06:10:19.017 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.007+0000 7f56097fa640 1 -- 172.21.15.194:0/807652899 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57140e3540 con 0x55ee8fc90be0 2024-09-13T06:10:19.017 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.007+0000 7f56097fa640 1 -- 172.21.15.194:0/807652899 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57140e3820 con 0x55ee8fc90be0 2024-09-13T06:10:19.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.007+0000 7f5726155980 1 -- 172.21.15.194:0/807652899 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee8fc94540 con 0x55ee8fc90be0 2024-09-13T06:10:19.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.007+0000 7f56097fa640 1 -- 172.21.15.194:0/807652899 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f57140aa3b0 con 0x55ee8fc90be0 2024-09-13T06:10:19.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.007+0000 7f56097fa640 1 --2- 172.21.15.194:0/807652899 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f55fc034650 0x7f55fc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.007+0000 7f56097fa640 1 -- 172.21.15.194:0/807652899 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f57140df030 con 0x55ee8fc90be0 2024-09-13T06:10:19.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.007+0000 7f5723464640 1 --2- 172.21.15.194:0/807652899 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f55fc034650 0x7f55fc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.007+0000 7f5726155980 1 Processor -- start 2024-09-13T06:10:19.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.007+0000 7f5726155980 1 -- start start 2024-09-13T06:10:19.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.007+0000 7f5726155980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee8fc9d4d0 0x55ee8fc9d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.007+0000 7f5723464640 1 --2- 172.21.15.194:0/807652899 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f55fc034650 0x7f55fc036b10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f571800bf60 tx=0x7f571800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.007+0000 7f5726155980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55ee8faf4c80 con 0x55ee8fc9d4d0 2024-09-13T06:10:19.020 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.007+0000 7f5723c65640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee8fc9d4d0 0x55ee8fc9d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.020 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.007+0000 7f5723c65640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee8fc9d4d0 0x55ee8fc9d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:50670/0 (socket says 172.21.15.194:50670) 2024-09-13T06:10:19.020 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.007+0000 7f5723c65640 1 -- 172.21.15.194:0/3085967723 learned_addr learned my addr 172.21.15.194:0/3085967723 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:19.020 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.011+0000 7f5723c65640 1 -- 172.21.15.194:0/3085967723 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee8fc9de80 con 0x55ee8fc9d4d0 2024-09-13T06:10:19.020 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.011+0000 7f5723c65640 1 --2- 172.21.15.194:0/3085967723 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee8fc9d4d0 0x55ee8fc9d8b0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f57140ee030 tx=0x7f57140cb820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a5114fa392db390 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.021 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.011+0000 7f5602ffd640 1 -- 172.21.15.194:0/3085967723 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57140e50c0 con 0x55ee8fc9d4d0 2024-09-13T06:10:19.021 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.011+0000 7f5602ffd640 1 -- 172.21.15.194:0/3085967723 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57140fc070 con 0x55ee8fc9d4d0 2024-09-13T06:10:19.021 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.011+0000 7f5602ffd640 1 -- 172.21.15.194:0/3085967723 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57140ecde0 con 0x55ee8fc9d4d0 2024-09-13T06:10:19.021 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.011+0000 7f5726155980 1 -- 172.21.15.194:0/3085967723 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee8fc9d4d0 msgr2=0x55ee8fc9d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:19.021 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.011+0000 7f5726155980 1 --2- 172.21.15.194:0/3085967723 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee8fc9d4d0 0x55ee8fc9d8b0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f57140ee030 tx=0x7f57140cb820 comp rx=0 tx=0).stop 2024-09-13T06:10:19.021 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.011+0000 7f5726155980 1 -- 172.21.15.194:0/3085967723 shutdown_connections 2024-09-13T06:10:19.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.011+0000 7f5726155980 1 --2- 172.21.15.194:0/3085967723 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee8fc9d4d0 0x55ee8fc9d8b0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:19.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.011+0000 7f5726155980 1 -- 172.21.15.194:0/3085967723 >> 172.21.15.194:0/3085967723 conn(0x55ee8fc998b0 msgr2=0x55ee8fc979b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:19.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.011+0000 7f5726155980 1 -- 172.21.15.194:0/3085967723 shutdown_connections 2024-09-13T06:10:19.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.011+0000 7f5726155980 1 -- 172.21.15.194:0/3085967723 wait complete. 2024-09-13T06:10:19.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.011+0000 7f5726155980 1 Processor -- start 2024-09-13T06:10:19.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.011+0000 7f5726155980 1 -- start start 2024-09-13T06:10:19.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.011+0000 7f5726155980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee8fc9d4d0 0x55ee8fca4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.011+0000 7f5726155980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55ee8fc9e320 con 0x55ee8fc9d4d0 2024-09-13T06:10:19.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.011+0000 7f5723c65640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee8fc9d4d0 0x55ee8fca4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.011+0000 7f5723c65640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee8fc9d4d0 0x55ee8fca4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:50682/0 (socket says 172.21.15.194:50682) 2024-09-13T06:10:19.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.011+0000 7f5723c65640 1 -- 172.21.15.194:0/2763399614 learned_addr learned my addr 172.21.15.194:0/2763399614 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:19.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.011+0000 7f5723c65640 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee8fca4b50 con 0x55ee8fc9d4d0 2024-09-13T06:10:19.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.011+0000 7f5723c65640 1 --2- 172.21.15.194:0/2763399614 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee8fc9d4d0 0x55ee8fca4610 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f57140eebc0 tx=0x7f57140cbfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.011+0000 7f56017fa640 1 -- 172.21.15.194:0/2763399614 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57140c9a50 con 0x55ee8fc9d4d0 2024-09-13T06:10:19.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.011+0000 7f56017fa640 1 -- 172.21.15.194:0/2763399614 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f571410e070 con 0x55ee8fc9d4d0 2024-09-13T06:10:19.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.011+0000 7f5726155980 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ee8fca4b50 con 0x55ee8fc9d4d0 2024-09-13T06:10:19.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.011+0000 7f56017fa640 1 -- 172.21.15.194:0/2763399614 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57140aa6a0 con 0x55ee8fc9d4d0 2024-09-13T06:10:19.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.011+0000 7f5726155980 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee8fca4b50 con 0x55ee8fc9d4d0 2024-09-13T06:10:19.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.015+0000 7f56017fa640 1 -- 172.21.15.194:0/2763399614 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f57140aa840 con 0x55ee8fc9d4d0 2024-09-13T06:10:19.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.015+0000 7f56017fa640 1 --2- 172.21.15.194:0/2763399614 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f55ec034650 0x7f55ec036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.015+0000 7f56017fa640 1 -- 172.21.15.194:0/2763399614 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f57140d5040 con 0x55ee8fc9d4d0 2024-09-13T06:10:19.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.015+0000 7f5723464640 1 --2- 172.21.15.194:0/2763399614 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f55ec034650 0x7f55ec036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.015+0000 7f5726155980 20 rados->read ofs=0 len=0 2024-09-13T06:10:19.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.015+0000 7f5726155980 1 --2- 172.21.15.194:0/2763399614 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ee8fcaf700 0x55ee8fcb1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.015+0000 7f5726155980 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcb2310 con 0x55ee8fcaf700 2024-09-13T06:10:19.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.015+0000 7f5724466640 1 --2- 172.21.15.194:0/2763399614 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ee8fcaf700 0x55ee8fcb1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.015+0000 7f5723464640 1 --2- 172.21.15.194:0/2763399614 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f55ec034650 0x7f55ec036b10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x55ee8fc7a820 tx=0x7f5718010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.015+0000 7f5724466640 1 --2- 172.21.15.194:0/2763399614 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ee8fcaf700 0x55ee8fcb1bc0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.015+0000 7f5724466640 1 -- 172.21.15.194:0/2763399614 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f571c00a4d0 con 0x55ee8fcaf700 2024-09-13T06:10:19.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.015+0000 7f5726155980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:19.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.015+0000 7f5726155980 20 realm 2024-09-13T06:10:19.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.015+0000 7f5726155980 20 rados->read ofs=0 len=0 2024-09-13T06:10:19.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.015+0000 7f5726155980 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcb2720 con 0x55ee8fcaf700 2024-09-13T06:10:19.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.015+0000 7f5724466640 1 -- 172.21.15.194:0/2763399614 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f571c00a4d0 con 0x55ee8fcaf700 2024-09-13T06:10:19.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.015+0000 7f5726155980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:19.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.015+0000 7f5726155980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:10:19.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.015+0000 7f5726155980 20 rados->read ofs=0 len=0 2024-09-13T06:10:19.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.015+0000 7f5726155980 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcb2ff0 con 0x55ee8fcaf700 2024-09-13T06:10:19.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.015+0000 7f5724466640 1 -- 172.21.15.194:0/2763399614 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f571c00a4d0 con 0x55ee8fcaf700 2024-09-13T06:10:19.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.015+0000 7f5726155980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:19.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.015+0000 7f5726155980 20 rados->read ofs=0 len=0 2024-09-13T06:10:19.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.015+0000 7f5726155980 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcb3390 con 0x55ee8fcaf700 2024-09-13T06:10:19.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.015+0000 7f5724466640 1 -- 172.21.15.194:0/2763399614 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f571c00a4d0 con 0x55ee8fcaf700 2024-09-13T06:10:19.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.015+0000 7f5726155980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:10:19.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.015+0000 7f5726155980 20 rados->read ofs=0 len=0 2024-09-13T06:10:19.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.015+0000 7f5726155980 1 --2- 172.21.15.194:0/2763399614 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ee8fcb40f0 0x55ee8fcb64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.015+0000 7f5726155980 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcb6af0 con 0x55ee8fcb40f0 2024-09-13T06:10:19.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.015+0000 7f5723c65640 1 --2- 172.21.15.194:0/2763399614 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ee8fcb40f0 0x55ee8fcb64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.015+0000 7f5723c65640 1 --2- 172.21.15.194:0/2763399614 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ee8fcb40f0 0x55ee8fcb64e0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.019+0000 7f5723c65640 1 -- 172.21.15.194:0/2763399614 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f57140c7030 con 0x55ee8fcb40f0 2024-09-13T06:10:19.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.019+0000 7f5726155980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:10:19.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.019+0000 7f5726155980 20 searching for the correct realm 2024-09-13T06:10:19.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.019+0000 7f5726155980 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcb83c0 con 0x55ee8fcb40f0 2024-09-13T06:10:19.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.019+0000 7f5723c65640 1 -- 172.21.15.194:0/2763399614 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57140c7030 con 0x55ee8fcb40f0 2024-09-13T06:10:19.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.019+0000 7f5723c65640 1 --2- 172.21.15.194:0/2763399614 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f57140ca060 0x7f57140f8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.019+0000 7f5723c65640 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcb83c0 con 0x7f57140ca060 2024-09-13T06:10:19.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.019+0000 7f5723464640 1 --2- 172.21.15.194:0/2763399614 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f57140ca060 0x7f57140f8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.019+0000 7f5723464640 1 --2- 172.21.15.194:0/2763399614 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f57140ca060 0x7f57140f8810 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.019+0000 7f5723464640 1 -- 172.21.15.194:0/2763399614 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f571800e620 con 0x7f57140ca060 2024-09-13T06:10:19.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.019+0000 7f5723464640 1 --2- 172.21.15.194:0/2763399614 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f5718037040 0x7f5718036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.019+0000 7f5723464640 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcb83c0 con 0x7f5718037040 2024-09-13T06:10:19.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.019+0000 7f5724466640 1 --2- 172.21.15.194:0/2763399614 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f5718037040 0x7f5718036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.019+0000 7f5724466640 1 --2- 172.21.15.194:0/2763399614 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f5718037040 0x7f5718036410 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.057 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.019+0000 7f5724466640 1 -- 172.21.15.194:0/2763399614 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f571c00a4d0 con 0x7f5718037040 2024-09-13T06:10:19.057 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.019+0000 7f5724466640 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcb3390 con 0x55ee8fcaf700 2024-09-13T06:10:19.057 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.019+0000 7f5724466640 1 -- 172.21.15.194:0/2763399614 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f571c00a4d0 con 0x55ee8fcaf700 2024-09-13T06:10:19.057 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.019+0000 7f5724466640 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcb3390 con 0x55ee8fcaf700 2024-09-13T06:10:19.057 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.019+0000 7f5724466640 1 -- 172.21.15.194:0/2763399614 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f571c00a4d0 con 0x55ee8fcaf700 2024-09-13T06:10:19.057 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.019+0000 7f5724466640 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcb3390 con 0x7f5718037040 2024-09-13T06:10:19.057 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.023+0000 7f5724466640 1 -- 172.21.15.194:0/2763399614 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f571c00a4d0 con 0x7f5718037040 2024-09-13T06:10:19.057 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.023+0000 7f5724466640 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcb3390 con 0x7f5718037040 2024-09-13T06:10:19.057 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.023+0000 7f5724466640 1 -- 172.21.15.194:0/2763399614 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f571c00a4d0 con 0x7f5718037040 2024-09-13T06:10:19.057 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.023+0000 7f5724466640 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcb3390 con 0x7f57140ca060 2024-09-13T06:10:19.057 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.023+0000 7f5723464640 1 -- 172.21.15.194:0/2763399614 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f571800e620 con 0x7f57140ca060 2024-09-13T06:10:19.058 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.023+0000 7f5723464640 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcb3390 con 0x55ee8fcb40f0 2024-09-13T06:10:19.058 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.023+0000 7f5723c65640 1 -- 172.21.15.194:0/2763399614 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57140c7030 con 0x55ee8fcb40f0 2024-09-13T06:10:19.058 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.023+0000 7f5723c65640 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcb3390 con 0x55ee8fcaf700 2024-09-13T06:10:19.058 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.023+0000 7f5724466640 1 -- 172.21.15.194:0/2763399614 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f571c00a4d0 con 0x55ee8fcaf700 2024-09-13T06:10:19.058 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.023+0000 7f5724466640 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcb3390 con 0x7f5718037040 2024-09-13T06:10:19.058 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.023+0000 7f5724466640 1 -- 172.21.15.194:0/2763399614 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f571c00a4d0 con 0x7f5718037040 2024-09-13T06:10:19.058 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.023+0000 7f5724466640 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcb3390 con 0x55ee8fcaf700 2024-09-13T06:10:19.058 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.023+0000 7f5724466640 1 -- 172.21.15.194:0/2763399614 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f571c00a4d0 con 0x55ee8fcaf700 2024-09-13T06:10:19.058 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.023+0000 7f5724466640 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcb3390 con 0x7f57140ca060 2024-09-13T06:10:19.058 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.023+0000 7f5723464640 1 -- 172.21.15.194:0/2763399614 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f571800e620 con 0x7f57140ca060 2024-09-13T06:10:19.058 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.023+0000 7f5723464640 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcb3390 con 0x55ee8fcb40f0 2024-09-13T06:10:19.058 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.023+0000 7f5723c65640 1 -- 172.21.15.194:0/2763399614 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57140c7030 con 0x55ee8fcb40f0 2024-09-13T06:10:19.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.023+0000 7f5723c65640 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcb3390 con 0x55ee8fcb40f0 2024-09-13T06:10:19.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.023+0000 7f5723c65640 1 -- 172.21.15.194:0/2763399614 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57140c7030 con 0x55ee8fcb40f0 2024-09-13T06:10:19.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.023+0000 7f5723c65640 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcb3390 con 0x7f5718037040 2024-09-13T06:10:19.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.027+0000 7f5724466640 1 -- 172.21.15.194:0/2763399614 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f571c00a4d0 con 0x7f5718037040 2024-09-13T06:10:19.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.027+0000 7f5724466640 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcb3390 con 0x55ee8fcb40f0 2024-09-13T06:10:19.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.027+0000 7f5723c65640 1 -- 172.21.15.194:0/2763399614 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57140c7030 con 0x55ee8fcb40f0 2024-09-13T06:10:19.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.027+0000 7f5723c65640 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcb3390 con 0x55ee8fcb40f0 2024-09-13T06:10:19.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.027+0000 7f5723c65640 1 -- 172.21.15.194:0/2763399614 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57140c7030 con 0x55ee8fcb40f0 2024-09-13T06:10:19.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.027+0000 7f5723c65640 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcb3390 con 0x55ee8fcaf700 2024-09-13T06:10:19.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.027+0000 7f5724466640 1 -- 172.21.15.194:0/2763399614 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f571c00a4d0 con 0x55ee8fcaf700 2024-09-13T06:10:19.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.027+0000 7f5724466640 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcb3390 con 0x55ee8fcaf700 2024-09-13T06:10:19.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.027+0000 7f5724466640 1 -- 172.21.15.194:0/2763399614 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f571c00a4d0 con 0x55ee8fcaf700 2024-09-13T06:10:19.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.027+0000 7f5724466640 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcb3390 con 0x7f57140ca060 2024-09-13T06:10:19.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.027+0000 7f5723464640 1 -- 172.21.15.194:0/2763399614 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f571800e620 con 0x7f57140ca060 2024-09-13T06:10:19.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.027+0000 7f5723464640 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcb3390 con 0x55ee8fcb40f0 2024-09-13T06:10:19.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.027+0000 7f5723c65640 1 -- 172.21.15.194:0/2763399614 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57140c7030 con 0x55ee8fcb40f0 2024-09-13T06:10:19.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.027+0000 7f5723c65640 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcb3390 con 0x7f57140ca060 2024-09-13T06:10:19.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.027+0000 7f5723464640 1 -- 172.21.15.194:0/2763399614 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f571800e620 con 0x7f57140ca060 2024-09-13T06:10:19.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.027+0000 7f5723464640 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcb3390 con 0x55ee8fcaf700 2024-09-13T06:10:19.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.027+0000 7f5724466640 1 -- 172.21.15.194:0/2763399614 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f571c00a4d0 con 0x55ee8fcaf700 2024-09-13T06:10:19.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.027+0000 7f5724466640 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcb3390 con 0x7f5718037040 2024-09-13T06:10:19.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.027+0000 7f5724466640 1 -- 172.21.15.194:0/2763399614 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f571c00a4d0 con 0x7f5718037040 2024-09-13T06:10:19.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.027+0000 7f5724466640 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcb3390 con 0x55ee8fcb40f0 2024-09-13T06:10:19.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.027+0000 7f5723c65640 1 -- 172.21.15.194:0/2763399614 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f57140c7030 con 0x55ee8fcb40f0 2024-09-13T06:10:19.061 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.031+0000 7f5723c65640 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcb3390 con 0x7f57140ca060 2024-09-13T06:10:19.061 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.031+0000 7f5723464640 1 -- 172.21.15.194:0/2763399614 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f571800e620 con 0x7f57140ca060 2024-09-13T06:10:19.061 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.031+0000 7f5723464640 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcb3390 con 0x7f57140ca060 2024-09-13T06:10:19.061 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.031+0000 7f5723464640 1 -- 172.21.15.194:0/2763399614 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f571800e620 con 0x7f57140ca060 2024-09-13T06:10:19.061 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.031+0000 7f5723464640 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcb3390 con 0x55ee8fcb40f0 2024-09-13T06:10:19.061 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.031+0000 7f5723c65640 1 -- 172.21.15.194:0/2763399614 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57140c7030 con 0x55ee8fcb40f0 2024-09-13T06:10:19.061 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.031+0000 7f5723c65640 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcb3390 con 0x7f5718037040 2024-09-13T06:10:19.061 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.031+0000 7f5724466640 1 -- 172.21.15.194:0/2763399614 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f571c00a4d0 con 0x7f5718037040 2024-09-13T06:10:19.061 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.031+0000 7f5724466640 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcb3390 con 0x55ee8fcaf700 2024-09-13T06:10:19.061 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.031+0000 7f5724466640 1 -- 172.21.15.194:0/2763399614 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f571c00a4d0 con 0x55ee8fcaf700 2024-09-13T06:10:19.061 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.031+0000 7f5724466640 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcb3390 con 0x7f57140ca060 2024-09-13T06:10:19.061 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.031+0000 7f5723464640 1 -- 172.21.15.194:0/2763399614 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f571800e620 con 0x7f57140ca060 2024-09-13T06:10:19.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.031+0000 7f5726155980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:10:19.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.031+0000 7f5726155980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:10:19.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.031+0000 7f5726155980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:10:19.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.031+0000 7f5726155980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:10:19.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.031+0000 7f5726155980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:10:19.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.031+0000 7f5726155980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:10:19.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.031+0000 7f5726155980 20 rados->read ofs=0 len=0 2024-09-13T06:10:19.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.031+0000 7f5726155980 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcb74e0 con 0x55ee8fcaf700 2024-09-13T06:10:19.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.031+0000 7f5724466640 1 -- 172.21.15.194:0/2763399614 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f571c00a4d0 con 0x55ee8fcaf700 2024-09-13T06:10:19.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.031+0000 7f5726155980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:19.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.031+0000 7f5726155980 20 rados->read ofs=0 len=0 2024-09-13T06:10:19.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.031+0000 7f5726155980 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcb7120 con 0x55ee8fcaf700 2024-09-13T06:10:19.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.031+0000 7f5724466640 1 -- 172.21.15.194:0/2763399614 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f571c00a4d0 con 0x55ee8fcaf700 2024-09-13T06:10:19.063 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.031+0000 7f5726155980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:10:19.063 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.031+0000 7f5726155980 20 rados->read ofs=0 len=0 2024-09-13T06:10:19.063 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.031+0000 7f5726155980 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcb7e00 con 0x7f57140ca060 2024-09-13T06:10:19.063 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.031+0000 7f5723464640 1 -- 172.21.15.194:0/2763399614 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f571800e620 con 0x7f57140ca060 2024-09-13T06:10:19.063 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.031+0000 7f5726155980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:10:19.063 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.031+0000 7f5726155980 20 zone default found 2024-09-13T06:10:19.063 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.031+0000 7f5726155980 4 Realm: () 2024-09-13T06:10:19.064 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.031+0000 7f5726155980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:10:19.064 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.031+0000 7f5726155980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:10:19.064 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.031+0000 7f5726155980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:10:19.064 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.031+0000 7f5726155980 20 zonegroup default 2024-09-13T06:10:19.064 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.031+0000 7f5726155980 20 rados->read ofs=0 len=0 2024-09-13T06:10:19.064 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.031+0000 7f5726155980 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcb87f0 con 0x7f5718037040 2024-09-13T06:10:19.064 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.035+0000 7f5724466640 1 -- 172.21.15.194:0/2763399614 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f571c00a4d0 con 0x7f5718037040 2024-09-13T06:10:19.064 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.035+0000 7f5726155980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:19.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.035+0000 7f5726155980 20 rados->read ofs=0 len=0 2024-09-13T06:10:19.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.035+0000 7f5726155980 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcba1d0 con 0x55ee8fcb40f0 2024-09-13T06:10:19.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.035+0000 7f5723c65640 1 -- 172.21.15.194:0/2763399614 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f57140c7030 con 0x55ee8fcb40f0 2024-09-13T06:10:19.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.035+0000 7f5726155980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:19.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.035+0000 7f5726155980 20 rados->read ofs=0 len=0 2024-09-13T06:10:19.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.035+0000 7f5726155980 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcba740 con 0x55ee8fcb40f0 2024-09-13T06:10:19.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.035+0000 7f5723c65640 1 -- 172.21.15.194:0/2763399614 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f57140c7030 con 0x55ee8fcb40f0 2024-09-13T06:10:19.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.035+0000 7f5726155980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:19.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.035+0000 7f5726155980 20 started sync module instance, tier type = 2024-09-13T06:10:19.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.035+0000 7f5726155980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:10:19.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.035+0000 7f5726155980 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcb9670 con 0x7f57140ca060 2024-09-13T06:10:19.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.035+0000 7f5723464640 1 -- 172.21.15.194:0/2763399614 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(44 notify.0 [create] v35'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f571800e620 con 0x7f57140ca060 2024-09-13T06:10:19.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.035+0000 7f5726155980 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94483103062624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcb92d0 con 0x7f57140ca060 2024-09-13T06:10:19.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.035+0000 7f5726155980 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcbb580 con 0x55ee8fcaf700 2024-09-13T06:10:19.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.035+0000 7f5723464640 1 -- 172.21.15.194:0/2763399614 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94483103062624] v35'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f571800e620 con 0x7f57140ca060 2024-09-13T06:10:19.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.039+0000 7f5724466640 1 -- 172.21.15.194:0/2763399614 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v35'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f571c00a4d0 con 0x55ee8fcaf700 2024-09-13T06:10:19.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.039+0000 7f5726155980 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94483103067040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcbb970 con 0x55ee8fcaf700 2024-09-13T06:10:19.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.039+0000 7f5726155980 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcbc330 con 0x55ee8fcb40f0 2024-09-13T06:10:19.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.039+0000 7f5723c65640 1 -- 172.21.15.194:0/2763399614 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v35'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57140c7030 con 0x55ee8fcb40f0 2024-09-13T06:10:19.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.039+0000 7f5726155980 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94483103071872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcbcbd0 con 0x55ee8fcb40f0 2024-09-13T06:10:19.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.039+0000 7f5726155980 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcbd5d0 con 0x7f57140ca060 2024-09-13T06:10:19.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.039+0000 7f5724466640 1 -- 172.21.15.194:0/2763399614 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94483103067040] v35'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f571c00a4d0 con 0x55ee8fcaf700 2024-09-13T06:10:19.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.043+0000 7f5723464640 1 -- 172.21.15.194:0/2763399614 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(50 notify.3 [create] v35'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f571800e620 con 0x7f57140ca060 2024-09-13T06:10:19.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.043+0000 7f5726155980 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94483103068096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcbd9c0 con 0x7f57140ca060 2024-09-13T06:10:19.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.043+0000 7f5726155980 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcbe380 con 0x55ee8fcaf700 2024-09-13T06:10:19.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.043+0000 7f5723c65640 1 -- 172.21.15.194:0/2763399614 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94483103071872] v35'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57140c7030 con 0x55ee8fcb40f0 2024-09-13T06:10:19.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.043+0000 7f5723464640 1 -- 172.21.15.194:0/2763399614 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94483103068096] v35'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f571800e620 con 0x7f57140ca060 2024-09-13T06:10:19.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.043+0000 7f5724466640 1 -- 172.21.15.194:0/2763399614 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v35'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f571c00a4d0 con 0x55ee8fcaf700 2024-09-13T06:10:19.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.043+0000 7f5726155980 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94483103076576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcbded0 con 0x55ee8fcaf700 2024-09-13T06:10:19.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.043+0000 7f5726155980 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcbe720 con 0x7f5718037040 2024-09-13T06:10:19.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.047+0000 7f5724466640 1 -- 172.21.15.194:0/2763399614 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94483103076576] v35'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f571c00a4d0 con 0x55ee8fcaf700 2024-09-13T06:10:19.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.047+0000 7f5724466640 1 -- 172.21.15.194:0/2763399614 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(54 notify.5 [create] v35'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f571c00a4d0 con 0x7f5718037040 2024-09-13T06:10:19.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.047+0000 7f5726155980 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94483103080144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcbc830 con 0x7f5718037040 2024-09-13T06:10:19.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.047+0000 7f5726155980 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcbf040 con 0x7f5718037040 2024-09-13T06:10:19.068 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.047+0000 7f5724466640 1 -- 172.21.15.194:0/2763399614 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(56 notify.6 [create] v35'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f571c00a4d0 con 0x7f5718037040 2024-09-13T06:10:19.068 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.047+0000 7f5726155980 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94483103083280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcbf4b0 con 0x7f5718037040 2024-09-13T06:10:19.068 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.047+0000 7f5726155980 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcbff90 con 0x7f5718037040 2024-09-13T06:10:19.068 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.047+0000 7f5724466640 1 -- 172.21.15.194:0/2763399614 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94483103080144] v35'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f571c00a4d0 con 0x7f5718037040 2024-09-13T06:10:19.068 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.051+0000 7f5724466640 1 -- 172.21.15.194:0/2763399614 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94483103083280] v35'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f571c00a4d0 con 0x7f5718037040 2024-09-13T06:10:19.068 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.051+0000 7f5724466640 1 -- 172.21.15.194:0/2763399614 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(58 notify.7 [create] v35'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f571c00a4d0 con 0x7f5718037040 2024-09-13T06:10:19.068 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.051+0000 7f5726155980 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94483103087264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcbf000 con 0x7f5718037040 2024-09-13T06:10:19.068 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.051+0000 7f5726155980 20 add_watcher() i=0 2024-09-13T06:10:19.068 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.051+0000 7f5726155980 20 add_watcher() i=1 2024-09-13T06:10:19.068 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.051+0000 7f5726155980 20 add_watcher() i=2 2024-09-13T06:10:19.068 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.051+0000 7f5726155980 20 add_watcher() i=3 2024-09-13T06:10:19.069 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.051+0000 7f5726155980 20 add_watcher() i=4 2024-09-13T06:10:19.069 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.051+0000 7f5726155980 20 add_watcher() i=5 2024-09-13T06:10:19.069 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.051+0000 7f5726155980 20 add_watcher() i=6 2024-09-13T06:10:19.069 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.051+0000 7f5724466640 1 -- 172.21.15.194:0/2763399614 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94483103087264] v35'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f571c00a4d0 con 0x7f5718037040 2024-09-13T06:10:19.069 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.051+0000 7f5726155980 20 add_watcher() i=7 2024-09-13T06:10:19.069 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.051+0000 7f5726155980 2 all 8 watchers are set, enabling cache 2024-09-13T06:10:19.069 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.051+0000 7f5726155980 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcc3090 con 0x55ee8fcaf700 2024-09-13T06:10:19.069 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.051+0000 7f5724466640 1 -- 172.21.15.194:0/2763399614 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f571c00a4d0 con 0x55ee8fcaf700 2024-09-13T06:10:19.069 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.051+0000 7f5726155980 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94483103081200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcc0510 con 0x55ee8fcaf700 2024-09-13T06:10:19.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.055+0000 7f5724466640 1 -- 172.21.15.194:0/2763399614 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94483103081200] v35'178 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f571c00a4d0 con 0x55ee8fcaf700 2024-09-13T06:10:19.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.055+0000 7f55d9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:10:19.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.055+0000 7f5726155980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:10:19.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.055+0000 7f5726155980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:10:19.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.055+0000 7f5726155980 5 note: GC not initialized 2024-09-13T06:10:19.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.055+0000 7f55d8fe1640 20 reqs_thread_entry: start 2024-09-13T06:10:19.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.055+0000 7f5726155980 20 init_complete bucket index max shards: 11 2024-09-13T06:10:19.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.055+0000 7f5726155980 20 Filter name: none 2024-09-13T06:10:19.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.055+0000 7f55527fc640 20 reqs_thread_entry: start 2024-09-13T06:10:19.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.055+0000 7f5726155980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T06:10:19.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.055+0000 7f5726155980 20 rados->read ofs=0 len=0 2024-09-13T06:10:19.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.055+0000 7f5726155980 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fce6ac0 con 0x7f57140ca060 2024-09-13T06:10:19.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.055+0000 7f5723464640 1 -- 172.21.15.194:0/2763399614 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f571800e620 con 0x7f57140ca060 2024-09-13T06:10:19.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.055+0000 7f5726155980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T06:10:19.079 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.055+0000 7f5726155980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T06:10:19.079 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.055+0000 7f5726155980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T06:10:19.079 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.055+0000 7f5726155980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5 : miss 2024-09-13T06:10:19.079 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.055+0000 7f5726155980 20 rados->read ofs=0 len=0 2024-09-13T06:10:19.079 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.055+0000 7f5726155980 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:63 8.19 8:9bd960cc:root::.bucket.meta.myfoo%3a52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fce85a0 con 0x55ee8fcaf700 2024-09-13T06:10:19.079 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.055+0000 7f5724466640 1 -- 172.21.15.194:0/2763399614 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(63 .bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f571c00a4d0 con 0x55ee8fcaf700 2024-09-13T06:10:19.079 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.055+0000 7f5726155980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T06:10:19.079 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.055+0000 7f5726155980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5 info.flags=0x17 2024-09-13T06:10:19.079 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.055+0000 7f5726155980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5 to cache LRU end 2024-09-13T06:10:19.079 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.055+0000 7f5726155980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:10:19.079 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.055+0000 7f5726155980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T06:10:19.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.055+0000 7f5726155980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5 2024-09-13T06:10:19.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.055+0000 7f5726155980 20 get_obj_state: octx=0x7f571802d040 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55ee8fceac68 s->prefetch_data=0 2024-09-13T06:10:19.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.055+0000 7f5726155980 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:64 3.39s0 3:9fd74620:::52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcebb90 con 0x55ee8fcb40f0 2024-09-13T06:10:19.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.055+0000 7f5723c65640 1 -- 172.21.15.194:0/2763399614 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(64 52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=847b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 262+0+863 (crc 0 0 0) 0x7f57140c7030 con 0x55ee8fcb40f0 2024-09-13T06:10:19.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.055+0000 7f5726155980 10 manifest: total_size = 5 2024-09-13T06:10:19.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.055+0000 7f5726155980 20 get_obj_state: setting s->obj_tag to _dPn-JzIdyuIHqDf6qLNqfrnNnurDGnX 2024-09-13T06:10:19.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.059+0000 7f55d9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:10:19.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.059+0000 7f5726155980 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94483103081200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcebb90 con 0x55ee8fcaf700 2024-09-13T06:10:19.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.059+0000 7f5724466640 1 -- 172.21.15.194:0/2763399614 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94483103081200] v35'179 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f571c00a4d0 con 0x55ee8fcaf700 2024-09-13T06:10:19.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.059+0000 7f5726155980 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94483103062624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcebb90 con 0x7f57140ca060 2024-09-13T06:10:19.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.059+0000 7f5723464640 1 -- 172.21.15.194:0/2763399614 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94483103062624] v35'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f571800e620 con 0x7f57140ca060 2024-09-13T06:10:19.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.059+0000 7f5726155980 20 remove_watcher() i=0 2024-09-13T06:10:19.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.059+0000 7f5726155980 2 removed watcher, disabling cache 2024-09-13T06:10:19.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.059+0000 7f5726155980 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94483103067040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcebb90 con 0x55ee8fcaf700 2024-09-13T06:10:19.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.063+0000 7f5724466640 1 -- 172.21.15.194:0/2763399614 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94483103067040] v35'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f571c00a4d0 con 0x55ee8fcaf700 2024-09-13T06:10:19.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.063+0000 7f5726155980 20 remove_watcher() i=1 2024-09-13T06:10:19.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.063+0000 7f5726155980 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94483103071872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcebb90 con 0x55ee8fcb40f0 2024-09-13T06:10:19.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.063+0000 7f5723c65640 1 -- 172.21.15.194:0/2763399614 <== osd.3 v2:172.21.15.194:6816/96632515 16 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94483103071872] v35'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57140c7030 con 0x55ee8fcb40f0 2024-09-13T06:10:19.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.063+0000 7f5726155980 20 remove_watcher() i=2 2024-09-13T06:10:19.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.063+0000 7f5726155980 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94483103068096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcebb90 con 0x7f57140ca060 2024-09-13T06:10:19.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.067+0000 7f5723464640 1 -- 172.21.15.194:0/2763399614 <== osd.2 v2:172.21.15.194:6800/815615585 16 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94483103068096] v35'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f571800e620 con 0x7f57140ca060 2024-09-13T06:10:19.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.067+0000 7f5726155980 20 remove_watcher() i=3 2024-09-13T06:10:19.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.067+0000 7f5726155980 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94483103076576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcebb90 con 0x55ee8fcaf700 2024-09-13T06:10:19.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.067+0000 7f5724466640 1 -- 172.21.15.194:0/2763399614 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94483103076576] v35'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f571c00a4d0 con 0x55ee8fcaf700 2024-09-13T06:10:19.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.067+0000 7f5726155980 20 remove_watcher() i=4 2024-09-13T06:10:19.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.067+0000 7f5726155980 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94483103080144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcebb90 con 0x7f5718037040 2024-09-13T06:10:19.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.071+0000 7f5724466640 1 -- 172.21.15.194:0/2763399614 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94483103080144] v35'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f571c00a4d0 con 0x7f5718037040 2024-09-13T06:10:19.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.071+0000 7f5726155980 20 remove_watcher() i=5 2024-09-13T06:10:19.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.071+0000 7f5726155980 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94483103083280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcebb90 con 0x7f5718037040 2024-09-13T06:10:19.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.071+0000 7f5724466640 1 -- 172.21.15.194:0/2763399614 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94483103083280] v35'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f571c00a4d0 con 0x7f5718037040 2024-09-13T06:10:19.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.071+0000 7f5726155980 20 remove_watcher() i=6 2024-09-13T06:10:19.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.071+0000 7f5726155980 1 -- 172.21.15.194:0/2763399614 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94483103087264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee8fcebb90 con 0x7f5718037040 2024-09-13T06:10:19.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.075+0000 7f5724466640 1 -- 172.21.15.194:0/2763399614 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94483103087264] v35'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f571c00a4d0 con 0x7f5718037040 2024-09-13T06:10:19.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.075+0000 7f5726155980 20 remove_watcher() i=7 2024-09-13T06:10:19.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.075+0000 7f5726155980 1 -- 172.21.15.194:0/2763399614 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f5718037040 msgr2=0x7f5718036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:19.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.075+0000 7f5726155980 1 --2- 172.21.15.194:0/2763399614 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f5718037040 0x7f5718036410 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:19.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.075+0000 7f5726155980 1 -- 172.21.15.194:0/2763399614 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ee8fcaf700 msgr2=0x55ee8fcb1bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:19.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.075+0000 7f5726155980 1 --2- 172.21.15.194:0/2763399614 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ee8fcaf700 0x55ee8fcb1bc0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:19.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.075+0000 7f5726155980 1 -- 172.21.15.194:0/2763399614 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f57140ca060 msgr2=0x7f57140f8810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:19.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.075+0000 7f5726155980 1 --2- 172.21.15.194:0/2763399614 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f57140ca060 0x7f57140f8810 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:19.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.075+0000 7f5726155980 1 -- 172.21.15.194:0/2763399614 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ee8fcb40f0 msgr2=0x55ee8fcb64e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:19.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.075+0000 7f5726155980 1 --2- 172.21.15.194:0/2763399614 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ee8fcb40f0 0x55ee8fcb64e0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:19.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.075+0000 7f5726155980 1 -- 172.21.15.194:0/2763399614 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f55ec034650 msgr2=0x7f55ec036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:19.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.075+0000 7f5726155980 1 --2- 172.21.15.194:0/2763399614 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f55ec034650 0x7f55ec036b10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x55ee8fc7a820 tx=0x7f5718010000 comp rx=0 tx=0).stop 2024-09-13T06:10:19.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.075+0000 7f5726155980 1 -- 172.21.15.194:0/2763399614 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee8fc9d4d0 msgr2=0x55ee8fca4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:19.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.075+0000 7f5726155980 1 --2- 172.21.15.194:0/2763399614 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee8fc9d4d0 0x55ee8fca4610 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f57140eebc0 tx=0x7f57140cbfa0 comp rx=0 tx=0).stop 2024-09-13T06:10:19.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.075+0000 7f5724466640 1 -- 172.21.15.194:0/2763399614 reap_dead start 2024-09-13T06:10:19.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.075+0000 7f5724466640 1 -- 172.21.15.194:0/2763399614 reap_dead start 2024-09-13T06:10:19.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.075+0000 7f5726155980 1 -- 172.21.15.194:0/2763399614 shutdown_connections 2024-09-13T06:10:19.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.075+0000 7f5726155980 1 -- 172.21.15.194:0/2763399614 >> 172.21.15.194:0/2763399614 conn(0x55ee8fc998b0 msgr2=0x55ee8fc97980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:19.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.075+0000 7f5726155980 1 -- 172.21.15.194:0/2763399614 shutdown_connections 2024-09-13T06:10:19.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.075+0000 7f5726155980 1 -- 172.21.15.194:0/2763399614 wait complete. 2024-09-13T06:10:19.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.075+0000 7f5726155980 1 -- 172.21.15.194:0/807652899 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f55fc034650 msgr2=0x7f55fc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:19.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.075+0000 7f5726155980 1 --2- 172.21.15.194:0/807652899 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f55fc034650 0x7f55fc036b10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f571800bf60 tx=0x7f571800f000 comp rx=0 tx=0).stop 2024-09-13T06:10:19.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.075+0000 7f5726155980 1 -- 172.21.15.194:0/807652899 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee8fc90be0 msgr2=0x55ee8fc91020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:19.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.075+0000 7f5726155980 1 --2- 172.21.15.194:0/807652899 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee8fc90be0 0x55ee8fc91020 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f57140e1f50 tx=0x7f57140aafa0 comp rx=0 tx=0).stop 2024-09-13T06:10:19.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.075+0000 7f5726155980 1 -- 172.21.15.194:0/807652899 shutdown_connections 2024-09-13T06:10:19.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.075+0000 7f5726155980 1 --2- 172.21.15.194:0/807652899 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f55fc034650 0x7f55fc036b10 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:19.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.075+0000 7f5726155980 1 --2- 172.21.15.194:0/807652899 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee8fc90be0 0x55ee8fc91020 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:19.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.075+0000 7f5726155980 1 -- 172.21.15.194:0/807652899 >> 172.21.15.194:0/807652899 conn(0x55ee8fc85d30 msgr2=0x55ee8fc887b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:19.086 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.075+0000 7f5726155980 1 -- 172.21.15.194:0/807652899 shutdown_connections 2024-09-13T06:10:19.086 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.075+0000 7f5726155980 1 -- 172.21.15.194:0/807652899 wait complete. 2024-09-13T06:10:19.086 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.075+0000 7f5726155980 1 -- 172.21.15.194:0/2064569085 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ee8fb7fea0 msgr2=0x55ee8fc79c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:19.086 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.075+0000 7f5726155980 1 --2- 172.21.15.194:0/2064569085 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ee8fb7fea0 0x55ee8fc79c90 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:19.086 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.075+0000 7f5726155980 1 -- 172.21.15.194:0/2064569085 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55ee8fc805e0 msgr2=0x55ee8fc829d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:19.086 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.075+0000 7f5726155980 1 --2- 172.21.15.194:0/2064569085 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55ee8fc805e0 0x55ee8fc829d0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:19.086 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.075+0000 7f5726155980 1 -- 172.21.15.194:0/2064569085 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ee8fc7c6a0 msgr2=0x55ee8fc7ea90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:19.086 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.075+0000 7f5726155980 1 --2- 172.21.15.194:0/2064569085 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ee8fc7c6a0 0x55ee8fc7ea90 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:19.086 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.075+0000 7f5726155980 1 -- 172.21.15.194:0/2064569085 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f560c034650 msgr2=0x7f560c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:19.086 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.075+0000 7f5726155980 1 --2- 172.21.15.194:0/2064569085 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f560c034650 0x7f560c036b10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5718000f70 tx=0x7f57180012c0 comp rx=0 tx=0).stop 2024-09-13T06:10:19.086 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.075+0000 7f5726155980 1 -- 172.21.15.194:0/2064569085 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee8fb7f550 msgr2=0x55ee8fc72ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:19.086 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.075+0000 7f5726155980 1 --2- 172.21.15.194:0/2064569085 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ee8fb7f550 0x55ee8fc72ce0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f57140030b0 tx=0x7f5714018020 comp rx=0 tx=0).stop 2024-09-13T06:10:19.087 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.075+0000 7f5724466640 1 -- 172.21.15.194:0/2064569085 reap_dead start 2024-09-13T06:10:19.087 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.075+0000 7f5726155980 1 -- 172.21.15.194:0/2064569085 shutdown_connections 2024-09-13T06:10:19.087 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.075+0000 7f5726155980 1 -- 172.21.15.194:0/2064569085 >> 172.21.15.194:0/2064569085 conn(0x55ee8fb7b070 msgr2=0x55ee8fc651a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:19.087 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.075+0000 7f5726155980 1 -- 172.21.15.194:0/2064569085 shutdown_connections 2024-09-13T06:10:19.087 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.075+0000 7f5726155980 1 -- 172.21.15.194:0/2064569085 wait complete. 2024-09-13T06:10:19.088 INFO:teuthology.orchestra.run.smithi194.stdout:fooFoofooFooFULL_CONTROL 2024-09-13T06:10:19.089 DEBUG:tasks.util.rgw: raw result: fooFoofooFooFULL_CONTROL 2024-09-13T06:10:19.092 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=417 failed=False 2024-09-13T06:10:19.098 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T06:10:19.098 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-13T06:10:19.098 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-13T06:10:19.098 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-09-13T06:10:19.166 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:10:19.166 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:10:19.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.167+0000 7f353f6cb980 1 Processor -- start 2024-09-13T06:10:19.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.167+0000 7f353f6cb980 1 -- start start 2024-09-13T06:10:19.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.167+0000 7f353f6cb980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55ddbda027d0 0x55ddbda01290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.167+0000 7f353f6cb980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ddbd913ae0 con 0x55ddbda023c0 2024-09-13T06:10:19.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.167+0000 7f353f6cb980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x55ddbd937e30 con 0x55ddbda027d0 2024-09-13T06:10:19.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.167+0000 7f353c9da640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55ddbda027d0 0x55ddbda01290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.167+0000 7f353c9da640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55ddbda027d0 0x55ddbda01290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:50688/0 (socket says 172.21.15.194:50688) 2024-09-13T06:10:19.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.167+0000 7f353c9da640 1 -- 172.21.15.194:0/1587752960 learned_addr learned my addr 172.21.15.194:0/1587752960 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:19.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.167+0000 7f353c9da640 1 -- 172.21.15.194:0/1587752960 >> v1:172.21.15.120:6789/0 conn(0x55ddbda023c0 legacy=0x55ddbda00b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:19.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.167+0000 7f353c9da640 1 -- 172.21.15.194:0/1587752960 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddbda018f0 con 0x55ddbda027d0 2024-09-13T06:10:19.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.171+0000 7f353c9da640 1 --2- 172.21.15.194:0/1587752960 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ddbda027d0 0x55ddbda01290 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f353000a5c0 tx=0x7f353001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bc3c1b392b62cb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.171+0000 7f352ffff640 1 -- 172.21.15.194:0/1587752960 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35300a6070 con 0x55ddbda027d0 2024-09-13T06:10:19.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.171+0000 7f352ffff640 1 -- 172.21.15.194:0/1587752960 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35300af070 con 0x55ddbda027d0 2024-09-13T06:10:19.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.171+0000 7f352ffff640 1 -- 172.21.15.194:0/1587752960 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35300aa5c0 con 0x55ddbda027d0 2024-09-13T06:10:19.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.171+0000 7f353f6cb980 1 -- 172.21.15.194:0/1587752960 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ddbda027d0 msgr2=0x55ddbda01290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:19.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.171+0000 7f353f6cb980 1 --2- 172.21.15.194:0/1587752960 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ddbda027d0 0x55ddbda01290 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f353000a5c0 tx=0x7f353001b340 comp rx=0 tx=0).stop 2024-09-13T06:10:19.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.171+0000 7f353f6cb980 1 -- 172.21.15.194:0/1587752960 shutdown_connections 2024-09-13T06:10:19.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.171+0000 7f353f6cb980 1 --2- 172.21.15.194:0/1587752960 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ddbda027d0 0x55ddbda01290 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:19.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.171+0000 7f353f6cb980 1 -- 172.21.15.194:0/1587752960 >> 172.21.15.194:0/1587752960 conn(0x55ddbda871c0 msgr2=0x55ddbda895e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:19.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.171+0000 7f353f6cb980 1 -- 172.21.15.194:0/1587752960 shutdown_connections 2024-09-13T06:10:19.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.171+0000 7f353f6cb980 1 -- 172.21.15.194:0/1587752960 wait complete. 2024-09-13T06:10:19.188 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.187+0000 7f353f6cb980 1 Processor -- start 2024-09-13T06:10:19.188 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.187+0000 7f353f6cb980 1 -- start start 2024-09-13T06:10:19.188 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.187+0000 7f353f6cb980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ddbda023c0 0x55ddbdb78c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.188 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.187+0000 7f353f6cb980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55ddbd939200 con 0x55ddbda023c0 2024-09-13T06:10:19.188 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.187+0000 7f353d1db640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ddbda023c0 0x55ddbdb78c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.189 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.187+0000 7f353d1db640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ddbda023c0 0x55ddbdb78c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:50698/0 (socket says 172.21.15.194:50698) 2024-09-13T06:10:19.189 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.187+0000 7f353d1db640 1 -- 172.21.15.194:0/2949108751 learned_addr learned my addr 172.21.15.194:0/2949108751 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:19.189 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.187+0000 7f353d1db640 1 -- 172.21.15.194:0/2949108751 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddbdb791e0 con 0x55ddbda023c0 2024-09-13T06:10:19.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.187+0000 7f353d1db640 1 --2- 172.21.15.194:0/2949108751 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ddbda023c0 0x55ddbdb78c10 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f353400b1f0 tx=0x7f353400b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caa1d7ce643a6d88 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.187+0000 7f342b606640 1 -- 172.21.15.194:0/2949108751 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f353400a040 con 0x55ddbda023c0 2024-09-13T06:10:19.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.187+0000 7f342b606640 1 -- 172.21.15.194:0/2949108751 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f353400f750 con 0x55ddbda023c0 2024-09-13T06:10:19.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.187+0000 7f342b606640 1 -- 172.21.15.194:0/2949108751 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f353400fa70 con 0x55ddbda023c0 2024-09-13T06:10:19.191 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.191+0000 7f353f6cb980 1 -- 172.21.15.194:0/2949108751 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ddbda023c0 msgr2=0x55ddbdb78c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:19.191 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.191+0000 7f353f6cb980 1 --2- 172.21.15.194:0/2949108751 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ddbda023c0 0x55ddbdb78c10 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f353400b1f0 tx=0x7f353400b6b0 comp rx=0 tx=0).stop 2024-09-13T06:10:19.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.191+0000 7f353f6cb980 1 -- 172.21.15.194:0/2949108751 shutdown_connections 2024-09-13T06:10:19.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.191+0000 7f353f6cb980 1 --2- 172.21.15.194:0/2949108751 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ddbda023c0 0x55ddbdb78c10 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:19.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.191+0000 7f353f6cb980 1 -- 172.21.15.194:0/2949108751 >> 172.21.15.194:0/2949108751 conn(0x55ddbda871c0 msgr2=0x55ddbdb74840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:19.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.191+0000 7f353f6cb980 1 -- 172.21.15.194:0/2949108751 shutdown_connections 2024-09-13T06:10:19.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.191+0000 7f353f6cb980 1 -- 172.21.15.194:0/2949108751 wait complete. 2024-09-13T06:10:19.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.191+0000 7f353f6cb980 1 Processor -- start 2024-09-13T06:10:19.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.191+0000 7f353f6cb980 1 -- start start 2024-09-13T06:10:19.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.191+0000 7f353f6cb980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ddbda023c0 0x55ddbdb7ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.191+0000 7f353f6cb980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55ddbda97210 con 0x55ddbda023c0 2024-09-13T06:10:19.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.191+0000 7f353d1db640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ddbda023c0 0x55ddbdb7ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.191+0000 7f353d1db640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ddbda023c0 0x55ddbdb7ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:50700/0 (socket says 172.21.15.194:50700) 2024-09-13T06:10:19.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.191+0000 7f353d1db640 1 -- 172.21.15.194:0/4075627324 learned_addr learned my addr 172.21.15.194:0/4075627324 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:19.193 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.191+0000 7f353d1db640 1 -- 172.21.15.194:0/4075627324 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddbdb804e0 con 0x55ddbda023c0 2024-09-13T06:10:19.194 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.191+0000 7f353d1db640 1 --2- 172.21.15.194:0/4075627324 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ddbda023c0 0x55ddbdb7ffa0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f353400b6f0 tx=0x7f3534000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.194 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.191+0000 7f3429e03640 1 -- 172.21.15.194:0/4075627324 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3534001300 con 0x55ddbda023c0 2024-09-13T06:10:19.194 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.191+0000 7f353f6cb980 1 -- 172.21.15.194:0/4075627324 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ddbdb80770 con 0x55ddbda023c0 2024-09-13T06:10:19.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.191+0000 7f3429e03640 1 -- 172.21.15.194:0/4075627324 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f353401c9c0 con 0x55ddbda023c0 2024-09-13T06:10:19.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.191+0000 7f3429e03640 1 -- 172.21.15.194:0/4075627324 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f353401cca0 con 0x55ddbda023c0 2024-09-13T06:10:19.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.191+0000 7f353f6cb980 1 -- 172.21.15.194:0/4075627324 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ddbdb83450 con 0x55ddbda023c0 2024-09-13T06:10:19.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.191+0000 7f3429e03640 1 -- 172.21.15.194:0/4075627324 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3534017050 con 0x55ddbda023c0 2024-09-13T06:10:19.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.191+0000 7f3429e03640 1 --2- 172.21.15.194:0/4075627324 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3424034650 0x7f3424036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.191+0000 7f3429e03640 1 -- 172.21.15.194:0/4075627324 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f3534015020 con 0x55ddbda023c0 2024-09-13T06:10:19.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.191+0000 7f353c9da640 1 --2- 172.21.15.194:0/4075627324 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3424034650 0x7f3424036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.195+0000 7f353f6cb980 1 --2- 172.21.15.194:0/4075627324 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ddbda027d0 0x55ddbdb870a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.195+0000 7f353f6cb980 1 -- 172.21.15.194:0/4075627324 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdb87620 con 0x55ddbda027d0 2024-09-13T06:10:19.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.195+0000 7f353d9dc640 1 --2- 172.21.15.194:0/4075627324 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ddbda027d0 0x55ddbdb870a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.195+0000 7f353c9da640 1 --2- 172.21.15.194:0/4075627324 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3424034650 0x7f3424036b10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f35300ae000 tx=0x7f35300a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.195+0000 7f353d9dc640 1 --2- 172.21.15.194:0/4075627324 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ddbda027d0 0x55ddbdb870a0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.197 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.195+0000 7f353d9dc640 1 -- 172.21.15.194:0/4075627324 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f353800a4d0 con 0x55ddbda027d0 2024-09-13T06:10:19.197 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.195+0000 7f353f6cb980 1 -- 172.21.15.194:0/4075627324 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdb84670 con 0x55ddbda027d0 2024-09-13T06:10:19.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.195+0000 7f353d9dc640 1 -- 172.21.15.194:0/4075627324 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f353800a4d0 con 0x55ddbda027d0 2024-09-13T06:10:19.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.195+0000 7f353f6cb980 1 --2- 172.21.15.194:0/4075627324 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ddbdb89930 0x55ddbdb8bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.195+0000 7f353f6cb980 1 -- 172.21.15.194:0/4075627324 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdb8c410 con 0x55ddbdb89930 2024-09-13T06:10:19.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.195+0000 7f353d1db640 1 --2- 172.21.15.194:0/4075627324 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ddbdb89930 0x55ddbdb8bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.195+0000 7f353d1db640 1 --2- 172.21.15.194:0/4075627324 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ddbdb89930 0x55ddbdb8bd20 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.195+0000 7f353d1db640 1 -- 172.21.15.194:0/4075627324 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f353402e070 con 0x55ddbdb89930 2024-09-13T06:10:19.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.195+0000 7f353f6cb980 1 -- 172.21.15.194:0/4075627324 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdb887d0 con 0x55ddbda027d0 2024-09-13T06:10:19.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.195+0000 7f353d9dc640 1 -- 172.21.15.194:0/4075627324 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f353800a4d0 con 0x55ddbda027d0 2024-09-13T06:10:19.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.195+0000 7f353f6cb980 1 --2- 172.21.15.194:0/4075627324 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55ddbdb8d870 0x55ddbdb8fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.195+0000 7f353f6cb980 1 -- 172.21.15.194:0/4075627324 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdb903a0 con 0x55ddbdb8d870 2024-09-13T06:10:19.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.195+0000 7f353c9da640 1 --2- 172.21.15.194:0/4075627324 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55ddbdb8d870 0x55ddbdb8fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.195+0000 7f353c9da640 1 --2- 172.21.15.194:0/4075627324 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55ddbdb8d870 0x55ddbdb8fc60 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.195+0000 7f353c9da640 1 -- 172.21.15.194:0/4075627324 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f35300aab30 con 0x55ddbdb8d870 2024-09-13T06:10:19.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.195+0000 7f353f6cb980 1 Processor -- start 2024-09-13T06:10:19.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.199+0000 7f353f6cb980 1 -- start start 2024-09-13T06:10:19.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.199+0000 7f353f6cb980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ddbdb9de70 0x55ddbdb9e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.199+0000 7f353f6cb980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55ddbd992800 con 0x55ddbdb9de70 2024-09-13T06:10:19.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.199+0000 7f353d1db640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ddbdb9de70 0x55ddbdb9e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.199+0000 7f353d1db640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ddbdb9de70 0x55ddbdb9e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:50712/0 (socket says 172.21.15.194:50712) 2024-09-13T06:10:19.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.199+0000 7f353d1db640 1 -- 172.21.15.194:0/18605430 learned_addr learned my addr 172.21.15.194:0/18605430 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:19.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.199+0000 7f353d1db640 1 -- 172.21.15.194:0/18605430 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddbdb9e7d0 con 0x55ddbdb9de70 2024-09-13T06:10:19.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.199+0000 7f353d1db640 1 --2- 172.21.15.194:0/18605430 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ddbdb9de70 0x55ddbdb9e290 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f3534001bc0 tx=0x7f353400e900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.199+0000 7f3422ffd640 1 -- 172.21.15.194:0/18605430 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f353402fb70 con 0x55ddbdb9de70 2024-09-13T06:10:19.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.199+0000 7f3422ffd640 1 -- 172.21.15.194:0/18605430 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f353402fd10 con 0x55ddbdb9de70 2024-09-13T06:10:19.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.199+0000 7f353f6cb980 1 -- 172.21.15.194:0/18605430 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ddbdb9ea60 con 0x55ddbdb9de70 2024-09-13T06:10:19.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.199+0000 7f3422ffd640 1 -- 172.21.15.194:0/18605430 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f353401a5b0 con 0x55ddbdb9de70 2024-09-13T06:10:19.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.199+0000 7f353f6cb980 1 -- 172.21.15.194:0/18605430 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ddbdba16e0 con 0x55ddbdb9de70 2024-09-13T06:10:19.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.199+0000 7f3422ffd640 1 -- 172.21.15.194:0/18605430 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f353401a750 con 0x55ddbdb9de70 2024-09-13T06:10:19.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.199+0000 7f3422ffd640 1 --2- 172.21.15.194:0/18605430 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f34140346a0 0x7f3414036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.199+0000 7f3422ffd640 1 -- 172.21.15.194:0/18605430 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f353403ed30 con 0x55ddbdb9de70 2024-09-13T06:10:19.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.199+0000 7f353c9da640 1 --2- 172.21.15.194:0/18605430 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f34140346a0 0x7f3414036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.199+0000 7f353f6cb980 1 Processor -- start 2024-09-13T06:10:19.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.199+0000 7f353f6cb980 1 -- start start 2024-09-13T06:10:19.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.199+0000 7f353f6cb980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ddbdbaa7a0 0x55ddbdbaaba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.199+0000 7f353f6cb980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55ddbdb79560 con 0x55ddbdbaa7a0 2024-09-13T06:10:19.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.203+0000 7f353c9da640 1 --2- 172.21.15.194:0/18605430 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f34140346a0 0x7f3414036b60 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x55ddbdb87ab0 tx=0x7f3530005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.203+0000 7f353d1db640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ddbdbaa7a0 0x55ddbdbaaba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.203+0000 7f353d1db640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ddbdbaa7a0 0x55ddbdbaaba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:50716/0 (socket says 172.21.15.194:50716) 2024-09-13T06:10:19.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.203+0000 7f353d1db640 1 -- 172.21.15.194:0/229475699 learned_addr learned my addr 172.21.15.194:0/229475699 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:19.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.203+0000 7f353d1db640 1 -- 172.21.15.194:0/229475699 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddbdbab170 con 0x55ddbdbaa7a0 2024-09-13T06:10:19.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.203+0000 7f353d1db640 1 --2- 172.21.15.194:0/229475699 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ddbdbaa7a0 0x55ddbdbaaba0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f353400ea50 tx=0x7f3534019960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78bdda970dbe38be server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.206 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.203+0000 7f3420ff9640 1 -- 172.21.15.194:0/229475699 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35340424a0 con 0x55ddbdbaa7a0 2024-09-13T06:10:19.206 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.203+0000 7f3420ff9640 1 -- 172.21.15.194:0/229475699 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f353405e070 con 0x55ddbdbaa7a0 2024-09-13T06:10:19.206 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.203+0000 7f3420ff9640 1 -- 172.21.15.194:0/229475699 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35340351f0 con 0x55ddbdbaa7a0 2024-09-13T06:10:19.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.203+0000 7f353f6cb980 1 -- 172.21.15.194:0/229475699 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ddbdbaa7a0 msgr2=0x55ddbdbaaba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:19.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.203+0000 7f353f6cb980 1 --2- 172.21.15.194:0/229475699 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ddbdbaa7a0 0x55ddbdbaaba0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f353400ea50 tx=0x7f3534019960 comp rx=0 tx=0).stop 2024-09-13T06:10:19.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.203+0000 7f353f6cb980 1 -- 172.21.15.194:0/229475699 shutdown_connections 2024-09-13T06:10:19.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.203+0000 7f353f6cb980 1 --2- 172.21.15.194:0/229475699 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ddbdbaa7a0 0x55ddbdbaaba0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:19.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.203+0000 7f353f6cb980 1 -- 172.21.15.194:0/229475699 >> 172.21.15.194:0/229475699 conn(0x55ddbdba6b80 msgr2=0x55ddbdba4c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:19.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.203+0000 7f353f6cb980 1 -- 172.21.15.194:0/229475699 shutdown_connections 2024-09-13T06:10:19.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.203+0000 7f353f6cb980 1 -- 172.21.15.194:0/229475699 wait complete. 2024-09-13T06:10:19.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.203+0000 7f353f6cb980 1 Processor -- start 2024-09-13T06:10:19.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.203+0000 7f353f6cb980 1 -- start start 2024-09-13T06:10:19.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.203+0000 7f353f6cb980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ddbdbaa7a0 0x55ddbdbb1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.203+0000 7f353f6cb980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55ddbdbab170 con 0x55ddbdbaa7a0 2024-09-13T06:10:19.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.203+0000 7f353d1db640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ddbdbaa7a0 0x55ddbdbb1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.203+0000 7f353d1db640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ddbdbaa7a0 0x55ddbdbb1860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:50722/0 (socket says 172.21.15.194:50722) 2024-09-13T06:10:19.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.203+0000 7f353d1db640 1 -- 172.21.15.194:0/2077937017 learned_addr learned my addr 172.21.15.194:0/2077937017 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:19.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.203+0000 7f353d1db640 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddbdbb1da0 con 0x55ddbdbaa7a0 2024-09-13T06:10:19.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.203+0000 7f353d1db640 1 --2- 172.21.15.194:0/2077937017 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ddbdbaa7a0 0x55ddbdbb1860 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f3534042c50 tx=0x7f3534033f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.207+0000 7f3412ffd640 1 -- 172.21.15.194:0/2077937017 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f353406c070 con 0x55ddbdbaa7a0 2024-09-13T06:10:19.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.207+0000 7f3412ffd640 1 -- 172.21.15.194:0/2077937017 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f353404a550 con 0x55ddbdbaa7a0 2024-09-13T06:10:19.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.207+0000 7f3412ffd640 1 -- 172.21.15.194:0/2077937017 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35340424a0 con 0x55ddbdbaa7a0 2024-09-13T06:10:19.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.207+0000 7f353f6cb980 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ddbdbb1da0 con 0x55ddbdbaa7a0 2024-09-13T06:10:19.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.207+0000 7f353f6cb980 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ddbdbb1da0 con 0x55ddbdbaa7a0 2024-09-13T06:10:19.212 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.207+0000 7f353f6cb980 20 rados->read ofs=0 len=0 2024-09-13T06:10:19.212 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.207+0000 7f3412ffd640 1 -- 172.21.15.194:0/2077937017 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f353406f070 con 0x55ddbdbaa7a0 2024-09-13T06:10:19.213 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.207+0000 7f3412ffd640 1 --2- 172.21.15.194:0/2077937017 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3408034650 0x7f3408036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.213 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.207+0000 7f3412ffd640 1 -- 172.21.15.194:0/2077937017 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f3534072d60 con 0x55ddbdbaa7a0 2024-09-13T06:10:19.213 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.207+0000 7f353c9da640 1 --2- 172.21.15.194:0/2077937017 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3408034650 0x7f3408036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.213 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.207+0000 7f353f6cb980 1 --2- 172.21.15.194:0/2077937017 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ddbdbbc750 0x55ddbdbbebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.213 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.207+0000 7f353f6cb980 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbbf330 con 0x55ddbdbbc750 2024-09-13T06:10:19.213 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.207+0000 7f353d9dc640 1 --2- 172.21.15.194:0/2077937017 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ddbdbbc750 0x55ddbdbbebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.213 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.207+0000 7f353c9da640 1 --2- 172.21.15.194:0/2077937017 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3408034650 0x7f3408036b10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f353001b380 tx=0x7f35300c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.213 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.207+0000 7f353d9dc640 1 --2- 172.21.15.194:0/2077937017 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ddbdbbc750 0x55ddbdbbebe0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.213 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.207+0000 7f353d9dc640 1 -- 172.21.15.194:0/2077937017 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f353800a4d0 con 0x55ddbdbbc750 2024-09-13T06:10:19.213 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.207+0000 7f353f6cb980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:19.213 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.207+0000 7f353f6cb980 20 realm 2024-09-13T06:10:19.213 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.207+0000 7f353f6cb980 20 rados->read ofs=0 len=0 2024-09-13T06:10:19.214 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.207+0000 7f353f6cb980 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbbf740 con 0x55ddbdbbc750 2024-09-13T06:10:19.214 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.207+0000 7f353d9dc640 1 -- 172.21.15.194:0/2077937017 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f353800a4d0 con 0x55ddbdbbc750 2024-09-13T06:10:19.214 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.207+0000 7f353f6cb980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:19.214 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.207+0000 7f353f6cb980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:10:19.214 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.207+0000 7f353f6cb980 20 rados->read ofs=0 len=0 2024-09-13T06:10:19.214 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.207+0000 7f353f6cb980 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbbffe0 con 0x55ddbdbbc750 2024-09-13T06:10:19.214 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.207+0000 7f353d9dc640 1 -- 172.21.15.194:0/2077937017 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f353800a4d0 con 0x55ddbdbbc750 2024-09-13T06:10:19.214 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.207+0000 7f353f6cb980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:19.214 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.207+0000 7f353f6cb980 20 rados->read ofs=0 len=0 2024-09-13T06:10:19.214 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.207+0000 7f353f6cb980 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbc0380 con 0x55ddbdbbc750 2024-09-13T06:10:19.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.211+0000 7f353d9dc640 1 -- 172.21.15.194:0/2077937017 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f353800a4d0 con 0x55ddbdbbc750 2024-09-13T06:10:19.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.211+0000 7f353f6cb980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:10:19.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.211+0000 7f353f6cb980 20 rados->read ofs=0 len=0 2024-09-13T06:10:19.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.211+0000 7f353f6cb980 1 --2- 172.21.15.194:0/2077937017 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ddbdbc10e0 0x55ddbdbc34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.211+0000 7f353f6cb980 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbc3b70 con 0x55ddbdbc10e0 2024-09-13T06:10:19.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.211+0000 7f353d1db640 1 --2- 172.21.15.194:0/2077937017 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ddbdbc10e0 0x55ddbdbc34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.211+0000 7f353d1db640 1 --2- 172.21.15.194:0/2077937017 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ddbdbc10e0 0x55ddbdbc34d0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.211+0000 7f353d1db640 1 -- 172.21.15.194:0/2077937017 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3534078070 con 0x55ddbdbc10e0 2024-09-13T06:10:19.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.211+0000 7f353f6cb980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:10:19.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.211+0000 7f353f6cb980 20 searching for the correct realm 2024-09-13T06:10:19.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.211+0000 7f353f6cb980 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbc53d0 con 0x55ddbdbc10e0 2024-09-13T06:10:19.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.211+0000 7f353d1db640 1 -- 172.21.15.194:0/2077937017 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3534078070 con 0x55ddbdbc10e0 2024-09-13T06:10:19.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.211+0000 7f353d1db640 1 --2- 172.21.15.194:0/2077937017 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f3534071070 0x7f35340277f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.211+0000 7f353d1db640 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbc53d0 con 0x7f3534071070 2024-09-13T06:10:19.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.211+0000 7f353c9da640 1 --2- 172.21.15.194:0/2077937017 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f3534071070 0x7f35340277f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.211+0000 7f353c9da640 1 --2- 172.21.15.194:0/2077937017 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f3534071070 0x7f35340277f0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.211+0000 7f353c9da640 1 -- 172.21.15.194:0/2077937017 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f35300aab30 con 0x7f3534071070 2024-09-13T06:10:19.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.211+0000 7f353c9da640 1 --2- 172.21.15.194:0/2077937017 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f35300e0040 0x7f35300e0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.211+0000 7f353c9da640 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbc53d0 con 0x7f35300e0040 2024-09-13T06:10:19.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.211+0000 7f353d9dc640 1 --2- 172.21.15.194:0/2077937017 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f35300e0040 0x7f35300e0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.211+0000 7f353d9dc640 1 --2- 172.21.15.194:0/2077937017 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f35300e0040 0x7f35300e0930 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.211+0000 7f353d9dc640 1 -- 172.21.15.194:0/2077937017 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f353800a4d0 con 0x7f35300e0040 2024-09-13T06:10:19.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.211+0000 7f353d9dc640 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbc0380 con 0x55ddbdbbc750 2024-09-13T06:10:19.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.215+0000 7f353d9dc640 1 -- 172.21.15.194:0/2077937017 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f353800a4d0 con 0x55ddbdbbc750 2024-09-13T06:10:19.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.215+0000 7f353d9dc640 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbc0380 con 0x55ddbdbbc750 2024-09-13T06:10:19.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.215+0000 7f353d9dc640 1 -- 172.21.15.194:0/2077937017 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f353800a4d0 con 0x55ddbdbbc750 2024-09-13T06:10:19.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.215+0000 7f353d9dc640 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbc0380 con 0x7f35300e0040 2024-09-13T06:10:19.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.215+0000 7f353d9dc640 1 -- 172.21.15.194:0/2077937017 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f353800a4d0 con 0x7f35300e0040 2024-09-13T06:10:19.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.215+0000 7f353d9dc640 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbc0380 con 0x7f35300e0040 2024-09-13T06:10:19.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.215+0000 7f353d9dc640 1 -- 172.21.15.194:0/2077937017 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f353800a4d0 con 0x7f35300e0040 2024-09-13T06:10:19.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.215+0000 7f353d9dc640 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbc0380 con 0x7f3534071070 2024-09-13T06:10:19.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.215+0000 7f353c9da640 1 -- 172.21.15.194:0/2077937017 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35300aab30 con 0x7f3534071070 2024-09-13T06:10:19.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.215+0000 7f353c9da640 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbc0380 con 0x55ddbdbc10e0 2024-09-13T06:10:19.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.215+0000 7f353d1db640 1 -- 172.21.15.194:0/2077937017 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3534078070 con 0x55ddbdbc10e0 2024-09-13T06:10:19.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.215+0000 7f353d1db640 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbc0380 con 0x55ddbdbbc750 2024-09-13T06:10:19.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.215+0000 7f353d9dc640 1 -- 172.21.15.194:0/2077937017 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f353800a4d0 con 0x55ddbdbbc750 2024-09-13T06:10:19.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.215+0000 7f353d9dc640 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbc0380 con 0x7f35300e0040 2024-09-13T06:10:19.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.215+0000 7f353d9dc640 1 -- 172.21.15.194:0/2077937017 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f353800a4d0 con 0x7f35300e0040 2024-09-13T06:10:19.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.215+0000 7f353d9dc640 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbc0380 con 0x55ddbdbbc750 2024-09-13T06:10:19.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.215+0000 7f353d9dc640 1 -- 172.21.15.194:0/2077937017 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f353800a4d0 con 0x55ddbdbbc750 2024-09-13T06:10:19.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.215+0000 7f353d9dc640 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbc0380 con 0x7f3534071070 2024-09-13T06:10:19.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.215+0000 7f353c9da640 1 -- 172.21.15.194:0/2077937017 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f35300aab30 con 0x7f3534071070 2024-09-13T06:10:19.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.215+0000 7f353c9da640 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbc0380 con 0x55ddbdbc10e0 2024-09-13T06:10:19.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.219+0000 7f353d1db640 1 -- 172.21.15.194:0/2077937017 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3534078070 con 0x55ddbdbc10e0 2024-09-13T06:10:19.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.219+0000 7f353d1db640 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbc0380 con 0x55ddbdbc10e0 2024-09-13T06:10:19.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.219+0000 7f353d1db640 1 -- 172.21.15.194:0/2077937017 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3534078070 con 0x55ddbdbc10e0 2024-09-13T06:10:19.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.219+0000 7f353d1db640 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbc0380 con 0x7f35300e0040 2024-09-13T06:10:19.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.219+0000 7f353d9dc640 1 -- 172.21.15.194:0/2077937017 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f353800a4d0 con 0x7f35300e0040 2024-09-13T06:10:19.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.219+0000 7f353d9dc640 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbc0380 con 0x55ddbdbc10e0 2024-09-13T06:10:19.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.219+0000 7f353d1db640 1 -- 172.21.15.194:0/2077937017 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3534078070 con 0x55ddbdbc10e0 2024-09-13T06:10:19.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.219+0000 7f353d1db640 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbc0380 con 0x55ddbdbc10e0 2024-09-13T06:10:19.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.219+0000 7f353d1db640 1 -- 172.21.15.194:0/2077937017 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3534078070 con 0x55ddbdbc10e0 2024-09-13T06:10:19.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.219+0000 7f353d1db640 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbc0380 con 0x55ddbdbbc750 2024-09-13T06:10:19.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.219+0000 7f353d9dc640 1 -- 172.21.15.194:0/2077937017 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f353800a4d0 con 0x55ddbdbbc750 2024-09-13T06:10:19.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.219+0000 7f353d9dc640 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbc0380 con 0x55ddbdbbc750 2024-09-13T06:10:19.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.219+0000 7f353d9dc640 1 -- 172.21.15.194:0/2077937017 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f353800a4d0 con 0x55ddbdbbc750 2024-09-13T06:10:19.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.219+0000 7f353d9dc640 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbc0380 con 0x7f3534071070 2024-09-13T06:10:19.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.219+0000 7f353c9da640 1 -- 172.21.15.194:0/2077937017 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35300aab30 con 0x7f3534071070 2024-09-13T06:10:19.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.219+0000 7f353c9da640 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbc0380 con 0x55ddbdbc10e0 2024-09-13T06:10:19.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.219+0000 7f353d1db640 1 -- 172.21.15.194:0/2077937017 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3534078070 con 0x55ddbdbc10e0 2024-09-13T06:10:19.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.219+0000 7f353d1db640 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbc0380 con 0x7f3534071070 2024-09-13T06:10:19.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.219+0000 7f353c9da640 1 -- 172.21.15.194:0/2077937017 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35300aab30 con 0x7f3534071070 2024-09-13T06:10:19.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.219+0000 7f353c9da640 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbc0380 con 0x55ddbdbbc750 2024-09-13T06:10:19.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.219+0000 7f353d9dc640 1 -- 172.21.15.194:0/2077937017 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f353800a4d0 con 0x55ddbdbbc750 2024-09-13T06:10:19.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.219+0000 7f353d9dc640 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbc0380 con 0x7f35300e0040 2024-09-13T06:10:19.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.223+0000 7f353d9dc640 1 -- 172.21.15.194:0/2077937017 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f353800a4d0 con 0x7f35300e0040 2024-09-13T06:10:19.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.223+0000 7f353d9dc640 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbc0380 con 0x55ddbdbc10e0 2024-09-13T06:10:19.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.223+0000 7f353d1db640 1 -- 172.21.15.194:0/2077937017 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3534078070 con 0x55ddbdbc10e0 2024-09-13T06:10:19.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.223+0000 7f353d1db640 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbc0380 con 0x7f3534071070 2024-09-13T06:10:19.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.223+0000 7f353c9da640 1 -- 172.21.15.194:0/2077937017 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35300aab30 con 0x7f3534071070 2024-09-13T06:10:19.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.223+0000 7f353c9da640 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbc0380 con 0x7f3534071070 2024-09-13T06:10:19.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.223+0000 7f353c9da640 1 -- 172.21.15.194:0/2077937017 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35300aab30 con 0x7f3534071070 2024-09-13T06:10:19.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.223+0000 7f353c9da640 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbc0380 con 0x55ddbdbc10e0 2024-09-13T06:10:19.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.223+0000 7f353d1db640 1 -- 172.21.15.194:0/2077937017 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3534078070 con 0x55ddbdbc10e0 2024-09-13T06:10:19.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.223+0000 7f353d1db640 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbc0380 con 0x7f35300e0040 2024-09-13T06:10:19.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.223+0000 7f353d9dc640 1 -- 172.21.15.194:0/2077937017 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f353800a4d0 con 0x7f35300e0040 2024-09-13T06:10:19.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.223+0000 7f353d9dc640 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbc0380 con 0x55ddbdbbc750 2024-09-13T06:10:19.232 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.223+0000 7f353d9dc640 1 -- 172.21.15.194:0/2077937017 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f353800a4d0 con 0x55ddbdbbc750 2024-09-13T06:10:19.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.223+0000 7f353d9dc640 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbc0380 con 0x7f3534071070 2024-09-13T06:10:19.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.223+0000 7f353c9da640 1 -- 172.21.15.194:0/2077937017 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35300aab30 con 0x7f3534071070 2024-09-13T06:10:19.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.223+0000 7f353f6cb980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:10:19.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.223+0000 7f353f6cb980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:10:19.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.223+0000 7f353f6cb980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:10:19.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.223+0000 7f353f6cb980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:10:19.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.223+0000 7f353f6cb980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:10:19.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.223+0000 7f353f6cb980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:10:19.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.223+0000 7f353f6cb980 20 rados->read ofs=0 len=0 2024-09-13T06:10:19.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.223+0000 7f353f6cb980 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbc44f0 con 0x55ddbdbbc750 2024-09-13T06:10:19.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.223+0000 7f353d9dc640 1 -- 172.21.15.194:0/2077937017 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f353800a4d0 con 0x55ddbdbbc750 2024-09-13T06:10:19.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.223+0000 7f353f6cb980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:19.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.223+0000 7f353f6cb980 20 rados->read ofs=0 len=0 2024-09-13T06:10:19.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.223+0000 7f353f6cb980 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbc4d40 con 0x55ddbdbbc750 2024-09-13T06:10:19.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.223+0000 7f353d9dc640 1 -- 172.21.15.194:0/2077937017 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f353800a4d0 con 0x55ddbdbbc750 2024-09-13T06:10:19.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.223+0000 7f353f6cb980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:10:19.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.223+0000 7f353f6cb980 20 rados->read ofs=0 len=0 2024-09-13T06:10:19.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.223+0000 7f353f6cb980 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbc4150 con 0x7f3534071070 2024-09-13T06:10:19.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.223+0000 7f353c9da640 1 -- 172.21.15.194:0/2077937017 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f35300aab30 con 0x7f3534071070 2024-09-13T06:10:19.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.223+0000 7f353f6cb980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:10:19.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.223+0000 7f353f6cb980 20 zone default found 2024-09-13T06:10:19.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.223+0000 7f353f6cb980 4 Realm: () 2024-09-13T06:10:19.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.223+0000 7f353f6cb980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:10:19.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.223+0000 7f353f6cb980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:10:19.235 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.223+0000 7f353f6cb980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:10:19.235 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.223+0000 7f353f6cb980 20 zonegroup default 2024-09-13T06:10:19.235 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.223+0000 7f353f6cb980 20 rados->read ofs=0 len=0 2024-09-13T06:10:19.235 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.223+0000 7f353f6cb980 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbc5800 con 0x7f35300e0040 2024-09-13T06:10:19.235 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.227+0000 7f353d9dc640 1 -- 172.21.15.194:0/2077937017 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f353800a4d0 con 0x7f35300e0040 2024-09-13T06:10:19.235 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.227+0000 7f353f6cb980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:19.235 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.227+0000 7f353f6cb980 20 rados->read ofs=0 len=0 2024-09-13T06:10:19.235 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.227+0000 7f353f6cb980 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbc7210 con 0x55ddbdbc10e0 2024-09-13T06:10:19.235 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.227+0000 7f353d1db640 1 -- 172.21.15.194:0/2077937017 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3534078070 con 0x55ddbdbc10e0 2024-09-13T06:10:19.235 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.227+0000 7f353f6cb980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:19.235 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.227+0000 7f353f6cb980 20 rados->read ofs=0 len=0 2024-09-13T06:10:19.236 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.227+0000 7f353f6cb980 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbc76c0 con 0x55ddbdbc10e0 2024-09-13T06:10:19.236 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.227+0000 7f353d1db640 1 -- 172.21.15.194:0/2077937017 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3534078070 con 0x55ddbdbc10e0 2024-09-13T06:10:19.236 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.227+0000 7f353f6cb980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:19.236 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.227+0000 7f353f6cb980 20 started sync module instance, tier type = 2024-09-13T06:10:19.236 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.227+0000 7f353f6cb980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:10:19.236 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.227+0000 7f353f6cb980 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbc6680 con 0x7f3534071070 2024-09-13T06:10:19.236 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.227+0000 7f353c9da640 1 -- 172.21.15.194:0/2077937017 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(44 notify.0 [create] v35'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35300aab30 con 0x7f3534071070 2024-09-13T06:10:19.236 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.227+0000 7f353f6cb980 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94410859375216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbc7fd0 con 0x7f3534071070 2024-09-13T06:10:19.236 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.227+0000 7f353f6cb980 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbc8820 con 0x55ddbdbbc750 2024-09-13T06:10:19.236 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.227+0000 7f353c9da640 1 -- 172.21.15.194:0/2077937017 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94410859375216] v35'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35300aab30 con 0x7f3534071070 2024-09-13T06:10:19.236 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.231+0000 7f353d9dc640 1 -- 172.21.15.194:0/2077937017 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v35'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f353800a4d0 con 0x55ddbdbbc750 2024-09-13T06:10:19.236 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.231+0000 7f353f6cb980 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94410859379488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbc8820 con 0x55ddbdbbc750 2024-09-13T06:10:19.236 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.231+0000 7f353f6cb980 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbc92c0 con 0x55ddbdbc10e0 2024-09-13T06:10:19.238 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.231+0000 7f353d1db640 1 -- 172.21.15.194:0/2077937017 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v35'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3534078070 con 0x55ddbdbc10e0 2024-09-13T06:10:19.238 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.231+0000 7f353f6cb980 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94410859384208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbc9b60 con 0x55ddbdbc10e0 2024-09-13T06:10:19.238 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.231+0000 7f353f6cb980 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbca580 con 0x7f3534071070 2024-09-13T06:10:19.238 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.231+0000 7f353d9dc640 1 -- 172.21.15.194:0/2077937017 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94410859379488] v35'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f353800a4d0 con 0x55ddbdbbc750 2024-09-13T06:10:19.238 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.235+0000 7f353c9da640 1 -- 172.21.15.194:0/2077937017 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(50 notify.3 [create] v35'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35300aab30 con 0x7f3534071070 2024-09-13T06:10:19.238 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.235+0000 7f353f6cb980 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94410859389040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbca970 con 0x7f3534071070 2024-09-13T06:10:19.238 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.235+0000 7f353f6cb980 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbcb330 con 0x55ddbdbbc750 2024-09-13T06:10:19.239 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.235+0000 7f353d1db640 1 -- 172.21.15.194:0/2077937017 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94410859384208] v35'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3534078070 con 0x55ddbdbc10e0 2024-09-13T06:10:19.239 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.235+0000 7f353c9da640 1 -- 172.21.15.194:0/2077937017 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94410859389040] v35'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35300aab30 con 0x7f3534071070 2024-09-13T06:10:19.239 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.235+0000 7f353d9dc640 1 -- 172.21.15.194:0/2077937017 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v35'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f353800a4d0 con 0x55ddbdbbc750 2024-09-13T06:10:19.239 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.235+0000 7f353f6cb980 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94410859381616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbcae80 con 0x55ddbdbbc750 2024-09-13T06:10:19.239 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.235+0000 7f353f6cb980 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbcb6d0 con 0x7f35300e0040 2024-09-13T06:10:19.239 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.239+0000 7f353d9dc640 1 -- 172.21.15.194:0/2077937017 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94410859381616] v35'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f353800a4d0 con 0x55ddbdbbc750 2024-09-13T06:10:19.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.239+0000 7f353d9dc640 1 -- 172.21.15.194:0/2077937017 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(54 notify.5 [create] v35'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f353800a4d0 con 0x7f35300e0040 2024-09-13T06:10:19.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.239+0000 7f353f6cb980 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94410859392640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbc97c0 con 0x7f35300e0040 2024-09-13T06:10:19.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.239+0000 7f353f6cb980 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbcbfd0 con 0x7f35300e0040 2024-09-13T06:10:19.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.239+0000 7f353d9dc640 1 -- 172.21.15.194:0/2077937017 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94410859392640] v35'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f353800a4d0 con 0x7f35300e0040 2024-09-13T06:10:19.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.239+0000 7f353d9dc640 1 -- 172.21.15.194:0/2077937017 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(56 notify.6 [create] v35'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f353800a4d0 con 0x7f35300e0040 2024-09-13T06:10:19.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.239+0000 7f353f6cb980 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94410859393696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbcbf90 con 0x7f35300e0040 2024-09-13T06:10:19.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.239+0000 7f353f6cb980 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbcc9b0 con 0x7f35300e0040 2024-09-13T06:10:19.243 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.243+0000 7f353d9dc640 1 -- 172.21.15.194:0/2077937017 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(58 notify.7 [create] v35'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f353800a4d0 con 0x7f35300e0040 2024-09-13T06:10:19.243 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.243+0000 7f353d9dc640 1 -- 172.21.15.194:0/2077937017 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94410859393696] v35'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f353800a4d0 con 0x7f35300e0040 2024-09-13T06:10:19.243 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.243+0000 7f353f6cb980 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94410859395696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbcc970 con 0x7f35300e0040 2024-09-13T06:10:19.243 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.243+0000 7f353f6cb980 20 add_watcher() i=0 2024-09-13T06:10:19.243 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.243+0000 7f353f6cb980 20 add_watcher() i=1 2024-09-13T06:10:19.243 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.243+0000 7f353f6cb980 20 add_watcher() i=2 2024-09-13T06:10:19.244 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.243+0000 7f353f6cb980 20 add_watcher() i=3 2024-09-13T06:10:19.244 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.243+0000 7f353f6cb980 20 add_watcher() i=4 2024-09-13T06:10:19.244 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.243+0000 7f353f6cb980 20 add_watcher() i=5 2024-09-13T06:10:19.244 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.243+0000 7f353f6cb980 20 add_watcher() i=6 2024-09-13T06:10:19.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.243+0000 7f353d9dc640 1 -- 172.21.15.194:0/2077937017 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94410859395696] v35'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f353800a4d0 con 0x7f35300e0040 2024-09-13T06:10:19.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.243+0000 7f353f6cb980 20 add_watcher() i=7 2024-09-13T06:10:19.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.243+0000 7f353f6cb980 2 all 8 watchers are set, enabling cache 2024-09-13T06:10:19.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.243+0000 7f353f6cb980 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbcfe00 con 0x55ddbdbbc750 2024-09-13T06:10:19.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.243+0000 7f353d9dc640 1 -- 172.21.15.194:0/2077937017 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f353800a4d0 con 0x55ddbdbbc750 2024-09-13T06:10:19.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.243+0000 7f353f6cb980 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94410859398304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbcd350 con 0x55ddbdbbc750 2024-09-13T06:10:19.247 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.247+0000 7f353d9dc640 1 -- 172.21.15.194:0/2077937017 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94410859398304] v35'180 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f353800a4d0 con 0x55ddbdbbc750 2024-09-13T06:10:19.248 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.247+0000 7f33f37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:10:19.248 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.247+0000 7f353f6cb980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:10:19.248 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.247+0000 7f353f6cb980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:10:19.248 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.247+0000 7f353f6cb980 5 note: GC not initialized 2024-09-13T06:10:19.248 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.247+0000 7f33f27e4640 20 reqs_thread_entry: start 2024-09-13T06:10:19.248 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.247+0000 7f353f6cb980 20 init_complete bucket index max shards: 11 2024-09-13T06:10:19.248 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.247+0000 7f353f6cb980 20 Filter name: none 2024-09-13T06:10:19.248 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.247+0000 7f3363fff640 20 reqs_thread_entry: start 2024-09-13T06:10:19.248 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.247+0000 7f353f6cb980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T06:10:19.248 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.247+0000 7f353f6cb980 20 rados->read ofs=0 len=0 2024-09-13T06:10:19.248 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.247+0000 7f353f6cb980 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbf3a70 con 0x7f3534071070 2024-09-13T06:10:19.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.247+0000 7f353c9da640 1 -- 172.21.15.194:0/2077937017 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f35300aab30 con 0x7f3534071070 2024-09-13T06:10:19.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.247+0000 7f353f6cb980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T06:10:19.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.247+0000 7f353f6cb980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T06:10:19.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.247+0000 7f353f6cb980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T06:10:19.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.247+0000 7f353f6cb980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5 : miss 2024-09-13T06:10:19.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.247+0000 7f353f6cb980 20 rados->read ofs=0 len=0 2024-09-13T06:10:19.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.247+0000 7f353f6cb980 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:63 8.19 8:9bd960cc:root::.bucket.meta.myfoo%3a52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbf5550 con 0x55ddbdbbc750 2024-09-13T06:10:19.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.247+0000 7f353d9dc640 1 -- 172.21.15.194:0/2077937017 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(63 .bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f353800a4d0 con 0x55ddbdbbc750 2024-09-13T06:10:19.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.247+0000 7f353f6cb980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T06:10:19.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.247+0000 7f353f6cb980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5 info.flags=0x17 2024-09-13T06:10:19.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.247+0000 7f353f6cb980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5 to cache LRU end 2024-09-13T06:10:19.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.247+0000 7f353f6cb980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:10:19.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.247+0000 7f353f6cb980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T06:10:19.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.247+0000 7f353f6cb980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5 2024-09-13T06:10:19.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.247+0000 7f353f6cb980 20 get_obj_state: octx=0x7f35300c8a00 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55ddbdbf7c18 s->prefetch_data=0 2024-09-13T06:10:19.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.247+0000 7f353f6cb980 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:64 3.39s0 3:9fd74620:::52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbf8b40 con 0x55ddbdbc10e0 2024-09-13T06:10:19.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.247+0000 7f353d1db640 1 -- 172.21.15.194:0/2077937017 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(64 52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=909b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+925 (crc 0 0 0) 0x7f3534078070 con 0x55ddbdbc10e0 2024-09-13T06:10:19.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.247+0000 7f353f6cb980 10 manifest: total_size = 5 2024-09-13T06:10:19.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.247+0000 7f353f6cb980 20 get_obj_state: setting s->obj_tag to _ExoIeJmILmFhb0GYW8_14tN80Lu_t8M 2024-09-13T06:10:19.252 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.251+0000 7f33f37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:10:19.252 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.251+0000 7f353f6cb980 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94410859398304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbf8b40 con 0x55ddbdbbc750 2024-09-13T06:10:19.252 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.251+0000 7f353d9dc640 1 -- 172.21.15.194:0/2077937017 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94410859398304] v35'181 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f353800a4d0 con 0x55ddbdbbc750 2024-09-13T06:10:19.252 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.251+0000 7f353f6cb980 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94410859375216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbf8b40 con 0x7f3534071070 2024-09-13T06:10:19.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.251+0000 7f353c9da640 1 -- 172.21.15.194:0/2077937017 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94410859375216] v35'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35300aab30 con 0x7f3534071070 2024-09-13T06:10:19.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.251+0000 7f353f6cb980 20 remove_watcher() i=0 2024-09-13T06:10:19.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.251+0000 7f353f6cb980 2 removed watcher, disabling cache 2024-09-13T06:10:19.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.251+0000 7f353f6cb980 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94410859379488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbf8b40 con 0x55ddbdbbc750 2024-09-13T06:10:19.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.255+0000 7f353d9dc640 1 -- 172.21.15.194:0/2077937017 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94410859379488] v35'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f353800a4d0 con 0x55ddbdbbc750 2024-09-13T06:10:19.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.255+0000 7f353f6cb980 20 remove_watcher() i=1 2024-09-13T06:10:19.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.255+0000 7f353f6cb980 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94410859384208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbf8b40 con 0x55ddbdbc10e0 2024-09-13T06:10:19.257 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.255+0000 7f353d1db640 1 -- 172.21.15.194:0/2077937017 <== osd.3 v2:172.21.15.194:6816/96632515 16 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94410859384208] v35'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3534078070 con 0x55ddbdbc10e0 2024-09-13T06:10:19.257 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.255+0000 7f353f6cb980 20 remove_watcher() i=2 2024-09-13T06:10:19.257 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.255+0000 7f353f6cb980 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94410859389040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbf8b40 con 0x7f3534071070 2024-09-13T06:10:19.258 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.255+0000 7f353c9da640 1 -- 172.21.15.194:0/2077937017 <== osd.2 v2:172.21.15.194:6800/815615585 16 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94410859389040] v35'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35300aab30 con 0x7f3534071070 2024-09-13T06:10:19.258 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.255+0000 7f353f6cb980 20 remove_watcher() i=3 2024-09-13T06:10:19.258 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.255+0000 7f353f6cb980 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94410859381616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbf8b40 con 0x55ddbdbbc750 2024-09-13T06:10:19.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.259+0000 7f353d9dc640 1 -- 172.21.15.194:0/2077937017 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94410859381616] v35'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f353800a4d0 con 0x55ddbdbbc750 2024-09-13T06:10:19.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.259+0000 7f353f6cb980 20 remove_watcher() i=4 2024-09-13T06:10:19.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.259+0000 7f353f6cb980 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94410859392640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbf8b40 con 0x7f35300e0040 2024-09-13T06:10:19.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.263+0000 7f353d9dc640 1 -- 172.21.15.194:0/2077937017 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94410859392640] v35'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f353800a4d0 con 0x7f35300e0040 2024-09-13T06:10:19.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.263+0000 7f353f6cb980 20 remove_watcher() i=5 2024-09-13T06:10:19.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.263+0000 7f353f6cb980 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94410859393696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbf8b40 con 0x7f35300e0040 2024-09-13T06:10:19.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.263+0000 7f353d9dc640 1 -- 172.21.15.194:0/2077937017 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94410859393696] v35'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f353800a4d0 con 0x7f35300e0040 2024-09-13T06:10:19.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.263+0000 7f353f6cb980 20 remove_watcher() i=6 2024-09-13T06:10:19.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.263+0000 7f353f6cb980 1 -- 172.21.15.194:0/2077937017 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94410859395696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ddbdbf8b40 con 0x7f35300e0040 2024-09-13T06:10:19.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.267+0000 7f353d9dc640 1 -- 172.21.15.194:0/2077937017 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94410859395696] v35'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f353800a4d0 con 0x7f35300e0040 2024-09-13T06:10:19.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.267+0000 7f353f6cb980 20 remove_watcher() i=7 2024-09-13T06:10:19.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.267+0000 7f353f6cb980 1 -- 172.21.15.194:0/2077937017 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f35300e0040 msgr2=0x7f35300e0930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:19.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.267+0000 7f353f6cb980 1 --2- 172.21.15.194:0/2077937017 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f35300e0040 0x7f35300e0930 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:19.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.267+0000 7f353f6cb980 1 -- 172.21.15.194:0/2077937017 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ddbdbbc750 msgr2=0x55ddbdbbebe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:19.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.267+0000 7f353f6cb980 1 --2- 172.21.15.194:0/2077937017 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ddbdbbc750 0x55ddbdbbebe0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:19.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.267+0000 7f353f6cb980 1 -- 172.21.15.194:0/2077937017 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f3534071070 msgr2=0x7f35340277f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:19.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.267+0000 7f353f6cb980 1 --2- 172.21.15.194:0/2077937017 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f3534071070 0x7f35340277f0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:19.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.267+0000 7f353f6cb980 1 -- 172.21.15.194:0/2077937017 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ddbdbc10e0 msgr2=0x55ddbdbc34d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:19.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.267+0000 7f353f6cb980 1 --2- 172.21.15.194:0/2077937017 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ddbdbc10e0 0x55ddbdbc34d0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:19.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.267+0000 7f353f6cb980 1 -- 172.21.15.194:0/2077937017 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3408034650 msgr2=0x7f3408036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:19.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.267+0000 7f353f6cb980 1 --2- 172.21.15.194:0/2077937017 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3408034650 0x7f3408036b10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f353001b380 tx=0x7f35300c1040 comp rx=0 tx=0).stop 2024-09-13T06:10:19.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.267+0000 7f353f6cb980 1 -- 172.21.15.194:0/2077937017 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ddbdbaa7a0 msgr2=0x55ddbdbb1860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:19.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.267+0000 7f353f6cb980 1 --2- 172.21.15.194:0/2077937017 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ddbdbaa7a0 0x55ddbdbb1860 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f3534042c50 tx=0x7f3534033f10 comp rx=0 tx=0).stop 2024-09-13T06:10:19.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.267+0000 7f353d9dc640 1 -- 172.21.15.194:0/2077937017 reap_dead start 2024-09-13T06:10:19.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.267+0000 7f353f6cb980 1 -- 172.21.15.194:0/2077937017 shutdown_connections 2024-09-13T06:10:19.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.267+0000 7f353f6cb980 1 --2- 172.21.15.194:0/2077937017 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ddbdbaa7a0 0x55ddbdbb1860 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:19.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.267+0000 7f353f6cb980 1 -- 172.21.15.194:0/2077937017 >> 172.21.15.194:0/2077937017 conn(0x55ddbdba6b80 msgr2=0x55ddbdba4c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:19.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.267+0000 7f353f6cb980 1 -- 172.21.15.194:0/2077937017 shutdown_connections 2024-09-13T06:10:19.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.267+0000 7f353f6cb980 1 -- 172.21.15.194:0/2077937017 wait complete. 2024-09-13T06:10:19.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.267+0000 7f353f6cb980 1 -- 172.21.15.194:0/18605430 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f34140346a0 msgr2=0x7f3414036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:19.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.267+0000 7f353f6cb980 1 --2- 172.21.15.194:0/18605430 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f34140346a0 0x7f3414036b60 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x55ddbdb87ab0 tx=0x7f3530005ad0 comp rx=0 tx=0).stop 2024-09-13T06:10:19.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.267+0000 7f353f6cb980 1 -- 172.21.15.194:0/18605430 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ddbdb9de70 msgr2=0x55ddbdb9e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:19.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.267+0000 7f353f6cb980 1 --2- 172.21.15.194:0/18605430 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ddbdb9de70 0x55ddbdb9e290 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f3534001bc0 tx=0x7f353400e900 comp rx=0 tx=0).stop 2024-09-13T06:10:19.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.267+0000 7f353f6cb980 1 -- 172.21.15.194:0/18605430 shutdown_connections 2024-09-13T06:10:19.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.267+0000 7f353f6cb980 1 --2- 172.21.15.194:0/18605430 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f34140346a0 0x7f3414036b60 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:19.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.267+0000 7f353f6cb980 1 --2- 172.21.15.194:0/18605430 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ddbdb9de70 0x55ddbdb9e290 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:19.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.267+0000 7f353f6cb980 1 -- 172.21.15.194:0/18605430 >> 172.21.15.194:0/18605430 conn(0x55ddbdb92fc0 msgr2=0x55ddbdb95a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:19.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.267+0000 7f353f6cb980 1 -- 172.21.15.194:0/18605430 shutdown_connections 2024-09-13T06:10:19.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.267+0000 7f353f6cb980 1 -- 172.21.15.194:0/18605430 wait complete. 2024-09-13T06:10:19.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.267+0000 7f353f6cb980 1 -- 172.21.15.194:0/4075627324 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ddbda027d0 msgr2=0x55ddbdb870a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:19.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.267+0000 7f353f6cb980 1 --2- 172.21.15.194:0/4075627324 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ddbda027d0 0x55ddbdb870a0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:19.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.267+0000 7f353f6cb980 1 -- 172.21.15.194:0/4075627324 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55ddbdb8d870 msgr2=0x55ddbdb8fc60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:19.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.267+0000 7f353f6cb980 1 --2- 172.21.15.194:0/4075627324 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55ddbdb8d870 0x55ddbdb8fc60 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:19.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.267+0000 7f353f6cb980 1 -- 172.21.15.194:0/4075627324 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ddbdb89930 msgr2=0x55ddbdb8bd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:19.272 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.267+0000 7f353f6cb980 1 --2- 172.21.15.194:0/4075627324 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ddbdb89930 0x55ddbdb8bd20 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:19.272 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.267+0000 7f353f6cb980 1 -- 172.21.15.194:0/4075627324 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3424034650 msgr2=0x7f3424036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:19.272 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.267+0000 7f353f6cb980 1 --2- 172.21.15.194:0/4075627324 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3424034650 0x7f3424036b10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f35300ae000 tx=0x7f35300a6000 comp rx=0 tx=0).stop 2024-09-13T06:10:19.272 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.267+0000 7f353f6cb980 1 -- 172.21.15.194:0/4075627324 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ddbda023c0 msgr2=0x55ddbdb7ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:19.272 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.267+0000 7f353f6cb980 1 --2- 172.21.15.194:0/4075627324 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ddbda023c0 0x55ddbdb7ffa0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f353400b6f0 tx=0x7f3534000ee0 comp rx=0 tx=0).stop 2024-09-13T06:10:19.272 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.267+0000 7f353d9dc640 1 -- 172.21.15.194:0/4075627324 reap_dead start 2024-09-13T06:10:19.272 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.267+0000 7f353f6cb980 1 -- 172.21.15.194:0/4075627324 shutdown_connections 2024-09-13T06:10:19.272 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.267+0000 7f353f6cb980 1 -- 172.21.15.194:0/4075627324 >> 172.21.15.194:0/4075627324 conn(0x55ddbda871c0 msgr2=0x55ddbdb733c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:19.272 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.267+0000 7f353f6cb980 1 -- 172.21.15.194:0/4075627324 shutdown_connections 2024-09-13T06:10:19.272 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.267+0000 7f353f6cb980 1 -- 172.21.15.194:0/4075627324 wait complete. 2024-09-13T06:10:19.279 INFO:teuthology.orchestra.run.smithi194.stdout:fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-09-13T06:10:19.280 DEBUG:tasks.util.rgw: raw result: fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-09-13T06:10:19.282 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=609 failed=False 2024-09-13T06:10:19.311 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T06:10:19.417 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-09-13T06:10:19.418 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-09-13T06:10:19.418 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-13T06:10:19.418 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-09-13T06:10:19.418 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-09-13T06:10:19.418 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-09-13T06:10:19.418 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket rm --bucket myfoo --purge-objects 2024-09-13T06:10:19.458 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:10:19.458 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:10:19.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.459+0000 7f8ceda3e980 1 Processor -- start 2024-09-13T06:10:19.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.459+0000 7f8ceda3e980 1 -- start start 2024-09-13T06:10:19.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.459+0000 7f8ceda3e980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x561a413f2ad0 0x561a41481380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.459+0000 7f8ceda3e980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561a41306ae0 con 0x561a414818c0 2024-09-13T06:10:19.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.459+0000 7f8ceda3e980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x561a4132ae30 con 0x561a413f2ad0 2024-09-13T06:10:19.460 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.459+0000 7f8ceb54e640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x561a413f2ad0 0x561a41481380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.460 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.459+0000 7f8ceb54e640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x561a413f2ad0 0x561a41481380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:50736/0 (socket says 172.21.15.194:50736) 2024-09-13T06:10:19.460 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.459+0000 7f8ceb54e640 1 -- 172.21.15.194:0/1924922320 learned_addr learned my addr 172.21.15.194:0/1924922320 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:19.460 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.459+0000 7f8ceb54e640 1 -- 172.21.15.194:0/1924922320 >> v1:172.21.15.120:6789/0 conn(0x561a414818c0 legacy=0x561a41483cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:19.460 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.459+0000 7f8ceb54e640 1 -- 172.21.15.194:0/1924922320 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a414863e0 con 0x561a413f2ad0 2024-09-13T06:10:19.462 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.463+0000 7f8ceb54e640 1 --2- 172.21.15.194:0/1924922320 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561a413f2ad0 0x561a41481380 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc00a5c0 tx=0x7f8cdc01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74955c7aa1812abd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.463 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.463+0000 7f8cea54c640 1 -- 172.21.15.194:0/1924922320 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cdc0a6070 con 0x561a413f2ad0 2024-09-13T06:10:19.463 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.463+0000 7f8cea54c640 1 -- 172.21.15.194:0/1924922320 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cdc0af070 con 0x561a413f2ad0 2024-09-13T06:10:19.463 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.463+0000 7f8cea54c640 1 -- 172.21.15.194:0/1924922320 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cdc0aa5c0 con 0x561a413f2ad0 2024-09-13T06:10:19.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.463+0000 7f8ceda3e980 1 -- 172.21.15.194:0/1924922320 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561a413f2ad0 msgr2=0x561a41481380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:19.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.463+0000 7f8ceda3e980 1 --2- 172.21.15.194:0/1924922320 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561a413f2ad0 0x561a41481380 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc00a5c0 tx=0x7f8cdc01b340 comp rx=0 tx=0).stop 2024-09-13T06:10:19.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.463+0000 7f8ceda3e980 1 -- 172.21.15.194:0/1924922320 shutdown_connections 2024-09-13T06:10:19.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.463+0000 7f8ceda3e980 1 --2- 172.21.15.194:0/1924922320 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561a413f2ad0 0x561a41481380 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:19.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.463+0000 7f8ceda3e980 1 -- 172.21.15.194:0/1924922320 >> 172.21.15.194:0/1924922320 conn(0x561a41479070 msgr2=0x561a4147b490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:19.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.463+0000 7f8ceda3e980 1 -- 172.21.15.194:0/1924922320 shutdown_connections 2024-09-13T06:10:19.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.463+0000 7f8ceda3e980 1 -- 172.21.15.194:0/1924922320 wait complete. 2024-09-13T06:10:19.479 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.479+0000 7f8ceda3e980 1 Processor -- start 2024-09-13T06:10:19.479 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.479+0000 7f8ceda3e980 1 -- start start 2024-09-13T06:10:19.479 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.479+0000 7f8ceda3e980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561a413f2ad0 0x561a41569a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.479 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.479+0000 7f8ceda3e980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x561a4132c200 con 0x561a413f2ad0 2024-09-13T06:10:19.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.479+0000 7f8ceb54e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561a413f2ad0 0x561a41569a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.479+0000 7f8ceb54e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561a413f2ad0 0x561a41569a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:50746/0 (socket says 172.21.15.194:50746) 2024-09-13T06:10:19.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.479+0000 7f8ceb54e640 1 -- 172.21.15.194:0/2631819267 learned_addr learned my addr 172.21.15.194:0/2631819267 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:19.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.479+0000 7f8ceb54e640 1 -- 172.21.15.194:0/2631819267 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a4156a030 con 0x561a413f2ad0 2024-09-13T06:10:19.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.479+0000 7f8ceb54e640 1 --2- 172.21.15.194:0/2631819267 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561a413f2ad0 0x561a41569a60 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc00a5c0 tx=0x7f8cdc003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5e79e231ae266e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.479+0000 7f8bd960a640 1 -- 172.21.15.194:0/2631819267 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cdc0aa9b0 con 0x561a413f2ad0 2024-09-13T06:10:19.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.479+0000 7f8bd960a640 1 -- 172.21.15.194:0/2631819267 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cdc0aab50 con 0x561a413f2ad0 2024-09-13T06:10:19.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.479+0000 7f8bd960a640 1 -- 172.21.15.194:0/2631819267 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cdc0aae50 con 0x561a413f2ad0 2024-09-13T06:10:19.482 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.479+0000 7f8ceda3e980 1 -- 172.21.15.194:0/2631819267 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561a413f2ad0 msgr2=0x561a41569a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:19.482 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.479+0000 7f8ceda3e980 1 --2- 172.21.15.194:0/2631819267 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561a413f2ad0 0x561a41569a60 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc00a5c0 tx=0x7f8cdc003030 comp rx=0 tx=0).stop 2024-09-13T06:10:19.482 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.479+0000 7f8ceda3e980 1 -- 172.21.15.194:0/2631819267 shutdown_connections 2024-09-13T06:10:19.482 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.479+0000 7f8ceda3e980 1 --2- 172.21.15.194:0/2631819267 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561a413f2ad0 0x561a41569a60 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:19.483 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.479+0000 7f8ceda3e980 1 -- 172.21.15.194:0/2631819267 >> 172.21.15.194:0/2631819267 conn(0x561a41479070 msgr2=0x561a41565690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:19.483 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.483+0000 7f8ceda3e980 1 -- 172.21.15.194:0/2631819267 shutdown_connections 2024-09-13T06:10:19.483 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.483+0000 7f8ceda3e980 1 -- 172.21.15.194:0/2631819267 wait complete. 2024-09-13T06:10:19.483 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.483+0000 7f8ceda3e980 1 Processor -- start 2024-09-13T06:10:19.483 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.483+0000 7f8ceda3e980 1 -- start start 2024-09-13T06:10:19.484 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.483+0000 7f8ceda3e980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561a413f2ad0 0x561a41570d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.484 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.483+0000 7f8ceda3e980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x561a41485e20 con 0x561a413f2ad0 2024-09-13T06:10:19.484 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.483+0000 7f8ceb54e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561a413f2ad0 0x561a41570d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.485 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.483+0000 7f8ceb54e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561a413f2ad0 0x561a41570d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:50756/0 (socket says 172.21.15.194:50756) 2024-09-13T06:10:19.485 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.483+0000 7f8ceb54e640 1 -- 172.21.15.194:0/4008388495 learned_addr learned my addr 172.21.15.194:0/4008388495 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:19.485 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.483+0000 7f8ceb54e640 1 -- 172.21.15.194:0/4008388495 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a41571250 con 0x561a413f2ad0 2024-09-13T06:10:19.485 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.483+0000 7f8ceb54e640 1 --2- 172.21.15.194:0/4008388495 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561a413f2ad0 0x561a41570d10 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc00a5c0 tx=0x7f8cdc0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.485 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.483+0000 7f8bd7e07640 1 -- 172.21.15.194:0/4008388495 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cdc0cb020 con 0x561a413f2ad0 2024-09-13T06:10:19.485 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.483+0000 7f8bd7e07640 1 -- 172.21.15.194:0/4008388495 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cdc0c6710 con 0x561a413f2ad0 2024-09-13T06:10:19.485 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.483+0000 7f8ceda3e980 1 -- 172.21.15.194:0/4008388495 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561a415714e0 con 0x561a413f2ad0 2024-09-13T06:10:19.485 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.483+0000 7f8bd7e07640 1 -- 172.21.15.194:0/4008388495 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cdc0c69f0 con 0x561a413f2ad0 2024-09-13T06:10:19.485 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.483+0000 7f8ceda3e980 1 -- 172.21.15.194:0/4008388495 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a415741c0 con 0x561a413f2ad0 2024-09-13T06:10:19.486 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.483+0000 7f8bd7e07640 1 -- 172.21.15.194:0/4008388495 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8cdc0ce020 con 0x561a413f2ad0 2024-09-13T06:10:19.486 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.483+0000 7f8bd7e07640 1 --2- 172.21.15.194:0/4008388495 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8bd0034650 0x7f8bd0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.486 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.483+0000 7f8bd7e07640 1 -- 172.21.15.194:0/4008388495 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f8cdc0e55a0 con 0x561a413f2ad0 2024-09-13T06:10:19.487 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.483+0000 7f8cead4d640 1 --2- 172.21.15.194:0/4008388495 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8bd0034650 0x7f8bd0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.487 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.483+0000 7f8ceda3e980 1 --2- 172.21.15.194:0/4008388495 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x561a414818c0 0x561a41577ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.487 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.483+0000 7f8ceda3e980 1 -- 172.21.15.194:0/4008388495 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a41578350 con 0x561a414818c0 2024-09-13T06:10:19.487 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.487+0000 7f8cebd4f640 1 --2- 172.21.15.194:0/4008388495 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x561a414818c0 0x561a41577ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.487 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.487+0000 7f8cead4d640 1 --2- 172.21.15.194:0/4008388495 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8bd0034650 0x7f8bd0036b10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8cd4001e20 tx=0x7f8cd40013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.487 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.487+0000 7f8cebd4f640 1 --2- 172.21.15.194:0/4008388495 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x561a414818c0 0x561a41577ce0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.487+0000 7f8cebd4f640 1 -- 172.21.15.194:0/4008388495 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8ce400a4d0 con 0x561a414818c0 2024-09-13T06:10:19.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.487+0000 7f8ceda3e980 1 -- 172.21.15.194:0/4008388495 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a41578c10 con 0x561a414818c0 2024-09-13T06:10:19.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.487+0000 7f8cebd4f640 1 -- 172.21.15.194:0/4008388495 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8ce400a4d0 con 0x561a414818c0 2024-09-13T06:10:19.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.487+0000 7f8ceda3e980 1 --2- 172.21.15.194:0/4008388495 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x561a4157a520 0x561a4157c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.487+0000 7f8ceda3e980 1 -- 172.21.15.194:0/4008388495 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a4157d170 con 0x561a4157a520 2024-09-13T06:10:19.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.487+0000 7f8ceb54e640 1 --2- 172.21.15.194:0/4008388495 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x561a4157a520 0x561a4157c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.487+0000 7f8ceb54e640 1 --2- 172.21.15.194:0/4008388495 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x561a4157a520 0x561a4157c9e0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.487+0000 7f8ceb54e640 1 -- 172.21.15.194:0/4008388495 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8cdc0bd8c0 con 0x561a4157a520 2024-09-13T06:10:19.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.487+0000 7f8ceda3e980 1 -- 172.21.15.194:0/4008388495 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a41579460 con 0x561a414818c0 2024-09-13T06:10:19.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.487+0000 7f8cebd4f640 1 -- 172.21.15.194:0/4008388495 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8ce400a4d0 con 0x561a414818c0 2024-09-13T06:10:19.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.487+0000 7f8ceda3e980 1 --2- 172.21.15.194:0/4008388495 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x561a4157e5d0 0x561a415809c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.487+0000 7f8ceda3e980 1 -- 172.21.15.194:0/4008388495 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a415810b0 con 0x561a4157e5d0 2024-09-13T06:10:19.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.487+0000 7f8cead4d640 1 --2- 172.21.15.194:0/4008388495 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x561a4157e5d0 0x561a415809c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.487+0000 7f8cead4d640 1 --2- 172.21.15.194:0/4008388495 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x561a4157e5d0 0x561a415809c0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.491 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.487+0000 7f8cead4d640 1 -- 172.21.15.194:0/4008388495 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8cd400d040 con 0x561a4157e5d0 2024-09-13T06:10:19.491 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.487+0000 7f8ceda3e980 1 Processor -- start 2024-09-13T06:10:19.491 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.487+0000 7f8ceda3e980 1 -- start start 2024-09-13T06:10:19.491 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.491+0000 7f8ceda3e980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561a4158eb80 0x561a4158efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.491 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.491+0000 7f8ceda3e980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x561a41385800 con 0x561a4158eb80 2024-09-13T06:10:19.491 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.491+0000 7f8ceb54e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561a4158eb80 0x561a4158efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.491 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.491+0000 7f8ceb54e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561a4158eb80 0x561a4158efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:50772/0 (socket says 172.21.15.194:50772) 2024-09-13T06:10:19.491 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.491+0000 7f8ceb54e640 1 -- 172.21.15.194:0/767877801 learned_addr learned my addr 172.21.15.194:0/767877801 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:19.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.491+0000 7f8ceb54e640 1 -- 172.21.15.194:0/767877801 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a4158f4e0 con 0x561a4158eb80 2024-09-13T06:10:19.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.491+0000 7f8ceb54e640 1 --2- 172.21.15.194:0/767877801 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561a4158eb80 0x561a4158efa0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc0b3fd0 tx=0x7f8cdc0b3e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.491+0000 7f8bd5602640 1 -- 172.21.15.194:0/767877801 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cdc0c7d40 con 0x561a4158eb80 2024-09-13T06:10:19.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.491+0000 7f8bd5602640 1 -- 172.21.15.194:0/767877801 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cdc0cf730 con 0x561a4158eb80 2024-09-13T06:10:19.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.491+0000 7f8bd5602640 1 -- 172.21.15.194:0/767877801 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cdc0cfa30 con 0x561a4158eb80 2024-09-13T06:10:19.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.491+0000 7f8ceda3e980 1 -- 172.21.15.194:0/767877801 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561a4158f770 con 0x561a4158eb80 2024-09-13T06:10:19.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.491+0000 7f8ceda3e980 1 -- 172.21.15.194:0/767877801 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a415923f0 con 0x561a4158eb80 2024-09-13T06:10:19.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.491+0000 7f8bd5602640 1 -- 172.21.15.194:0/767877801 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8cdc0e50b0 con 0x561a4158eb80 2024-09-13T06:10:19.494 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.491+0000 7f8bd5602640 1 --2- 172.21.15.194:0/767877801 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8bc4034650 0x7f8bc4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.494 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.491+0000 7f8bd5602640 1 -- 172.21.15.194:0/767877801 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f8cdc0eed00 con 0x561a4158eb80 2024-09-13T06:10:19.494 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.491+0000 7f8cead4d640 1 --2- 172.21.15.194:0/767877801 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8bc4034650 0x7f8bc4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.494 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.491+0000 7f8ceda3e980 1 Processor -- start 2024-09-13T06:10:19.494 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.491+0000 7f8ceda3e980 1 -- start start 2024-09-13T06:10:19.495 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.491+0000 7f8ceda3e980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561a4147e5d0 0x561a4147e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.495 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.495+0000 7f8ceda3e980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x561a4156a2f0 con 0x561a4147e5d0 2024-09-13T06:10:19.495 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.495+0000 7f8cead4d640 1 --2- 172.21.15.194:0/767877801 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8bc4034650 0x7f8bc4036b10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x561a41575420 tx=0x7f8cd4006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.495 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.495+0000 7f8ceb54e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561a4147e5d0 0x561a4147e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.495 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.495+0000 7f8ceb54e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561a4147e5d0 0x561a4147e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:50778/0 (socket says 172.21.15.194:50778) 2024-09-13T06:10:19.495 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.495+0000 7f8ceb54e640 1 -- 172.21.15.194:0/3693259485 learned_addr learned my addr 172.21.15.194:0/3693259485 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:19.495 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.495+0000 7f8ceb54e640 1 -- 172.21.15.194:0/3693259485 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a4147ef80 con 0x561a4147e5d0 2024-09-13T06:10:19.495 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.495+0000 7f8ceb54e640 1 --2- 172.21.15.194:0/3693259485 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561a4147e5d0 0x561a4147e9b0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc0c9fd0 tx=0x7f8cdc0dcf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d353e40783f329ed server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.495+0000 7f8bceffd640 1 -- 172.21.15.194:0/3693259485 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cdc0f2030 con 0x561a4147e5d0 2024-09-13T06:10:19.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.495+0000 7f8bceffd640 1 -- 172.21.15.194:0/3693259485 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cdc0b5cd0 con 0x561a4147e5d0 2024-09-13T06:10:19.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.495+0000 7f8bceffd640 1 -- 172.21.15.194:0/3693259485 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cdc0b3520 con 0x561a4147e5d0 2024-09-13T06:10:19.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.495+0000 7f8ceda3e980 1 -- 172.21.15.194:0/3693259485 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561a4147e5d0 msgr2=0x561a4147e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:19.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.495+0000 7f8ceda3e980 1 --2- 172.21.15.194:0/3693259485 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561a4147e5d0 0x561a4147e9b0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc0c9fd0 tx=0x7f8cdc0dcf20 comp rx=0 tx=0).stop 2024-09-13T06:10:19.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.495+0000 7f8ceda3e980 1 -- 172.21.15.194:0/3693259485 shutdown_connections 2024-09-13T06:10:19.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.495+0000 7f8ceda3e980 1 --2- 172.21.15.194:0/3693259485 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561a4147e5d0 0x561a4147e9b0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:19.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.495+0000 7f8ceda3e980 1 -- 172.21.15.194:0/3693259485 >> 172.21.15.194:0/3693259485 conn(0x561a41597830 msgr2=0x561a41595930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:19.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.495+0000 7f8ceda3e980 1 -- 172.21.15.194:0/3693259485 shutdown_connections 2024-09-13T06:10:19.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.495+0000 7f8ceda3e980 1 -- 172.21.15.194:0/3693259485 wait complete. 2024-09-13T06:10:19.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.495+0000 7f8ceda3e980 1 Processor -- start 2024-09-13T06:10:19.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.495+0000 7f8ceda3e980 1 -- start start 2024-09-13T06:10:19.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.495+0000 7f8ceda3e980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561a4147e5d0 0x561a415a47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.495+0000 7f8ceda3e980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x561a4147d160 con 0x561a4147e5d0 2024-09-13T06:10:19.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.495+0000 7f8ceb54e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561a4147e5d0 0x561a415a47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.495+0000 7f8ceb54e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561a4147e5d0 0x561a415a47e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:50786/0 (socket says 172.21.15.194:50786) 2024-09-13T06:10:19.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.495+0000 7f8ceb54e640 1 -- 172.21.15.194:0/146984335 learned_addr learned my addr 172.21.15.194:0/146984335 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:19.499 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.495+0000 7f8ceb54e640 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a415a4d20 con 0x561a4147e5d0 2024-09-13T06:10:19.499 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.499+0000 7f8ceb54e640 1 --2- 172.21.15.194:0/146984335 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561a4147e5d0 0x561a415a47e0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc0ef000 tx=0x7f8cdc0e2ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.499 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.499+0000 7f8bcd7fa640 1 -- 172.21.15.194:0/146984335 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cdc0c5750 con 0x561a4147e5d0 2024-09-13T06:10:19.499 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.499+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561a415a4d20 con 0x561a4147e5d0 2024-09-13T06:10:19.500 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.499+0000 7f8bcd7fa640 1 -- 172.21.15.194:0/146984335 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cdc10b070 con 0x561a4147e5d0 2024-09-13T06:10:19.500 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.499+0000 7f8bcd7fa640 1 -- 172.21.15.194:0/146984335 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cdc0c5a60 con 0x561a4147e5d0 2024-09-13T06:10:19.500 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.499+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a415a5190 con 0x561a4147e5d0 2024-09-13T06:10:19.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.499+0000 7f8bcd7fa640 1 -- 172.21.15.194:0/146984335 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8cdc0dc430 con 0x561a4147e5d0 2024-09-13T06:10:19.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.499+0000 7f8bcd7fa640 1 --2- 172.21.15.194:0/146984335 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8bb4034650 0x7f8bb4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.499+0000 7f8bcd7fa640 1 -- 172.21.15.194:0/146984335 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f8cdc0c11c0 con 0x561a4147e5d0 2024-09-13T06:10:19.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.499+0000 7f8cead4d640 1 --2- 172.21.15.194:0/146984335 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8bb4034650 0x7f8bb4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.499+0000 7f8ceda3e980 20 rados->read ofs=0 len=0 2024-09-13T06:10:19.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.499+0000 7f8ceda3e980 1 --2- 172.21.15.194:0/146984335 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x561a415af770 0x561a415b1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.499+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a415b2380 con 0x561a415af770 2024-09-13T06:10:19.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.499+0000 7f8cebd4f640 1 --2- 172.21.15.194:0/146984335 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x561a415af770 0x561a415b1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.499+0000 7f8cead4d640 1 --2- 172.21.15.194:0/146984335 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8bb4034650 0x7f8bb4036b10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x561a415814b0 tx=0x7f8cd4011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.499+0000 7f8cebd4f640 1 --2- 172.21.15.194:0/146984335 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x561a415af770 0x561a415b1c30 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.499+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8ce400a4d0 con 0x561a415af770 2024-09-13T06:10:19.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.499+0000 7f8ceda3e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:19.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.499+0000 7f8ceda3e980 20 realm 2024-09-13T06:10:19.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.499+0000 7f8ceda3e980 20 rados->read ofs=0 len=0 2024-09-13T06:10:19.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.499+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a415b2790 con 0x561a415af770 2024-09-13T06:10:19.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.499+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8ce400a4d0 con 0x561a415af770 2024-09-13T06:10:19.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.499+0000 7f8ceda3e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:19.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.499+0000 7f8ceda3e980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:10:19.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.499+0000 7f8ceda3e980 20 rados->read ofs=0 len=0 2024-09-13T06:10:19.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.499+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a415b3060 con 0x561a415af770 2024-09-13T06:10:19.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.499+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8ce400a4d0 con 0x561a415af770 2024-09-13T06:10:19.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.499+0000 7f8ceda3e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:19.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.503+0000 7f8ceda3e980 20 rados->read ofs=0 len=0 2024-09-13T06:10:19.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.503+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a415b3400 con 0x561a415af770 2024-09-13T06:10:19.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.503+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8ce400a4d0 con 0x561a415af770 2024-09-13T06:10:19.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.503+0000 7f8ceda3e980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:10:19.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.503+0000 7f8ceda3e980 20 rados->read ofs=0 len=0 2024-09-13T06:10:19.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.503+0000 7f8ceda3e980 1 --2- 172.21.15.194:0/146984335 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x561a415b4160 0x561a415b6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.503+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a415b6b60 con 0x561a415b4160 2024-09-13T06:10:19.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.503+0000 7f8ceb54e640 1 --2- 172.21.15.194:0/146984335 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x561a415b4160 0x561a415b6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.507 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.503+0000 7f8ceb54e640 1 --2- 172.21.15.194:0/146984335 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x561a415b4160 0x561a415b6550 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.507 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.503+0000 7f8ceb54e640 1 -- 172.21.15.194:0/146984335 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8cdc0f4070 con 0x561a415b4160 2024-09-13T06:10:19.507 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.503+0000 7f8ceda3e980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:10:19.507 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.503+0000 7f8ceda3e980 20 searching for the correct realm 2024-09-13T06:10:19.507 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.503+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a415b8430 con 0x561a415b4160 2024-09-13T06:10:19.507 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.503+0000 7f8ceb54e640 1 -- 172.21.15.194:0/146984335 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cdc0f4070 con 0x561a415b4160 2024-09-13T06:10:19.507 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.503+0000 7f8ceb54e640 1 --2- 172.21.15.194:0/146984335 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f8cdc0db040 0x7f8cdc110470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.507 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.503+0000 7f8ceb54e640 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a415b8430 con 0x7f8cdc0db040 2024-09-13T06:10:19.507 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.503+0000 7f8cead4d640 1 --2- 172.21.15.194:0/146984335 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f8cdc0db040 0x7f8cdc110470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.507 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.503+0000 7f8cead4d640 1 --2- 172.21.15.194:0/146984335 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f8cdc0db040 0x7f8cdc110470 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.507 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.503+0000 7f8cead4d640 1 -- 172.21.15.194:0/146984335 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8cd4036040 con 0x7f8cdc0db040 2024-09-13T06:10:19.507 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.503+0000 7f8cead4d640 1 --2- 172.21.15.194:0/146984335 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f8cd400f3d0 0x7f8cd400f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.507 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.503+0000 7f8cead4d640 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a415b8430 con 0x7f8cd400f3d0 2024-09-13T06:10:19.508 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.503+0000 7f8cebd4f640 1 --2- 172.21.15.194:0/146984335 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f8cd400f3d0 0x7f8cd400f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.510 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.503+0000 7f8cebd4f640 1 --2- 172.21.15.194:0/146984335 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f8cd400f3d0 0x7f8cd400f7f0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.510 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.507+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ce400a4d0 con 0x7f8cd400f3d0 2024-09-13T06:10:19.510 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.507+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a415b3400 con 0x561a415af770 2024-09-13T06:10:19.510 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.507+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ce400a4d0 con 0x561a415af770 2024-09-13T06:10:19.510 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.507+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a415b3400 con 0x561a415af770 2024-09-13T06:10:19.510 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.507+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ce400a4d0 con 0x561a415af770 2024-09-13T06:10:19.510 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.507+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a415b3400 con 0x7f8cd400f3d0 2024-09-13T06:10:19.510 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.507+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ce400a4d0 con 0x7f8cd400f3d0 2024-09-13T06:10:19.510 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.507+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a415b3400 con 0x7f8cd400f3d0 2024-09-13T06:10:19.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.507+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ce400a4d0 con 0x7f8cd400f3d0 2024-09-13T06:10:19.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.507+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a415b3400 con 0x7f8cdc0db040 2024-09-13T06:10:19.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.507+0000 7f8cead4d640 1 -- 172.21.15.194:0/146984335 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cd4036040 con 0x7f8cdc0db040 2024-09-13T06:10:19.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.507+0000 7f8cead4d640 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a415b3400 con 0x561a415b4160 2024-09-13T06:10:19.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.507+0000 7f8ceb54e640 1 -- 172.21.15.194:0/146984335 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cdc0f4070 con 0x561a415b4160 2024-09-13T06:10:19.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.507+0000 7f8ceb54e640 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a415b3400 con 0x561a415af770 2024-09-13T06:10:19.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.507+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ce400a4d0 con 0x561a415af770 2024-09-13T06:10:19.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.507+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a415b3400 con 0x7f8cd400f3d0 2024-09-13T06:10:19.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.507+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ce400a4d0 con 0x7f8cd400f3d0 2024-09-13T06:10:19.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.507+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a415b3400 con 0x561a415af770 2024-09-13T06:10:19.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.511+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ce400a4d0 con 0x561a415af770 2024-09-13T06:10:19.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.511+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a415b3400 con 0x7f8cdc0db040 2024-09-13T06:10:19.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.511+0000 7f8cead4d640 1 -- 172.21.15.194:0/146984335 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8cd4036040 con 0x7f8cdc0db040 2024-09-13T06:10:19.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.511+0000 7f8cead4d640 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a415b3400 con 0x561a415b4160 2024-09-13T06:10:19.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.511+0000 7f8ceb54e640 1 -- 172.21.15.194:0/146984335 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cdc0f4070 con 0x561a415b4160 2024-09-13T06:10:19.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.511+0000 7f8ceb54e640 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a415b3400 con 0x561a415b4160 2024-09-13T06:10:19.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.511+0000 7f8ceb54e640 1 -- 172.21.15.194:0/146984335 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cdc0f4070 con 0x561a415b4160 2024-09-13T06:10:19.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.511+0000 7f8ceb54e640 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a415b3400 con 0x7f8cd400f3d0 2024-09-13T06:10:19.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.511+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ce400a4d0 con 0x7f8cd400f3d0 2024-09-13T06:10:19.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.511+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a415b3400 con 0x561a415b4160 2024-09-13T06:10:19.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.511+0000 7f8ceb54e640 1 -- 172.21.15.194:0/146984335 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cdc0f4070 con 0x561a415b4160 2024-09-13T06:10:19.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.511+0000 7f8ceb54e640 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a415b3400 con 0x561a415b4160 2024-09-13T06:10:19.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.511+0000 7f8ceb54e640 1 -- 172.21.15.194:0/146984335 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cdc0f4070 con 0x561a415b4160 2024-09-13T06:10:19.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.511+0000 7f8ceb54e640 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a415b3400 con 0x561a415af770 2024-09-13T06:10:19.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.511+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ce400a4d0 con 0x561a415af770 2024-09-13T06:10:19.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.511+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a415b3400 con 0x561a415af770 2024-09-13T06:10:19.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.511+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8ce400a4d0 con 0x561a415af770 2024-09-13T06:10:19.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.511+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a415b3400 con 0x7f8cdc0db040 2024-09-13T06:10:19.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.511+0000 7f8cead4d640 1 -- 172.21.15.194:0/146984335 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cd4036040 con 0x7f8cdc0db040 2024-09-13T06:10:19.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.511+0000 7f8cead4d640 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a415b3400 con 0x561a415b4160 2024-09-13T06:10:19.516 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.511+0000 7f8ceb54e640 1 -- 172.21.15.194:0/146984335 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cdc0f4070 con 0x561a415b4160 2024-09-13T06:10:19.516 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.511+0000 7f8ceb54e640 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a415b3400 con 0x7f8cdc0db040 2024-09-13T06:10:19.516 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.511+0000 7f8cead4d640 1 -- 172.21.15.194:0/146984335 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cd4036040 con 0x7f8cdc0db040 2024-09-13T06:10:19.516 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.511+0000 7f8cead4d640 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a415b3400 con 0x561a415af770 2024-09-13T06:10:19.516 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.515+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ce400a4d0 con 0x561a415af770 2024-09-13T06:10:19.516 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.515+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a415b3400 con 0x7f8cd400f3d0 2024-09-13T06:10:19.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.515+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ce400a4d0 con 0x7f8cd400f3d0 2024-09-13T06:10:19.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.515+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a415b3400 con 0x561a415b4160 2024-09-13T06:10:19.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.515+0000 7f8ceb54e640 1 -- 172.21.15.194:0/146984335 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8cdc0f4070 con 0x561a415b4160 2024-09-13T06:10:19.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.515+0000 7f8ceb54e640 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a415b3400 con 0x7f8cdc0db040 2024-09-13T06:10:19.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.515+0000 7f8cead4d640 1 -- 172.21.15.194:0/146984335 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cd4036040 con 0x7f8cdc0db040 2024-09-13T06:10:19.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.515+0000 7f8cead4d640 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a415b3400 con 0x7f8cdc0db040 2024-09-13T06:10:19.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.515+0000 7f8cead4d640 1 -- 172.21.15.194:0/146984335 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cd4049040 con 0x7f8cdc0db040 2024-09-13T06:10:19.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.515+0000 7f8cead4d640 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a415b3400 con 0x561a415b4160 2024-09-13T06:10:19.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.515+0000 7f8ceb54e640 1 -- 172.21.15.194:0/146984335 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cdc0f4070 con 0x561a415b4160 2024-09-13T06:10:19.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.515+0000 7f8ceb54e640 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a415b3400 con 0x7f8cd400f3d0 2024-09-13T06:10:19.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.515+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ce400a4d0 con 0x7f8cd400f3d0 2024-09-13T06:10:19.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.515+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a415b3400 con 0x561a415af770 2024-09-13T06:10:19.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.515+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8ce400a4d0 con 0x561a415af770 2024-09-13T06:10:19.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.515+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a415b3400 con 0x7f8cdc0db040 2024-09-13T06:10:19.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.515+0000 7f8cead4d640 1 -- 172.21.15.194:0/146984335 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8cd4049040 con 0x7f8cdc0db040 2024-09-13T06:10:19.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.515+0000 7f8ceda3e980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:10:19.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.515+0000 7f8ceda3e980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:10:19.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.515+0000 7f8ceda3e980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:10:19.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.515+0000 7f8ceda3e980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:10:19.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.515+0000 7f8ceda3e980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:10:19.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.515+0000 7f8ceda3e980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:10:19.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.515+0000 7f8ceda3e980 20 rados->read ofs=0 len=0 2024-09-13T06:10:19.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.515+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a415b7550 con 0x561a415af770 2024-09-13T06:10:19.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.515+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8ce400a4d0 con 0x561a415af770 2024-09-13T06:10:19.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.515+0000 7f8ceda3e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:19.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.515+0000 7f8ceda3e980 20 rados->read ofs=0 len=0 2024-09-13T06:10:19.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.515+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a415b7190 con 0x561a415af770 2024-09-13T06:10:19.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.519+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8ce400a4d0 con 0x561a415af770 2024-09-13T06:10:19.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.519+0000 7f8ceda3e980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:10:19.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.519+0000 7f8ceda3e980 20 rados->read ofs=0 len=0 2024-09-13T06:10:19.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.519+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a415b7e70 con 0x7f8cdc0db040 2024-09-13T06:10:19.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.519+0000 7f8cead4d640 1 -- 172.21.15.194:0/146984335 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8cd4049040 con 0x7f8cdc0db040 2024-09-13T06:10:19.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.519+0000 7f8ceda3e980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:10:19.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.519+0000 7f8ceda3e980 20 zone default found 2024-09-13T06:10:19.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.519+0000 7f8ceda3e980 4 Realm: () 2024-09-13T06:10:19.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.519+0000 7f8ceda3e980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:10:19.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.519+0000 7f8ceda3e980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:10:19.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.519+0000 7f8ceda3e980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:10:19.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.519+0000 7f8ceda3e980 20 zonegroup default 2024-09-13T06:10:19.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.519+0000 7f8ceda3e980 20 rados->read ofs=0 len=0 2024-09-13T06:10:19.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.519+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a415b8860 con 0x7f8cd400f3d0 2024-09-13T06:10:19.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.519+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8ce400a4d0 con 0x7f8cd400f3d0 2024-09-13T06:10:19.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.519+0000 7f8ceda3e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:19.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.519+0000 7f8ceda3e980 20 rados->read ofs=0 len=0 2024-09-13T06:10:19.524 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.519+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a415ba270 con 0x561a415b4160 2024-09-13T06:10:19.524 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.519+0000 7f8ceb54e640 1 -- 172.21.15.194:0/146984335 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8cdc0f4070 con 0x561a415b4160 2024-09-13T06:10:19.524 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.519+0000 7f8ceda3e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:19.524 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.519+0000 7f8ceda3e980 20 rados->read ofs=0 len=0 2024-09-13T06:10:19.524 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.519+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a415ba760 con 0x561a415b4160 2024-09-13T06:10:19.524 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.519+0000 7f8ceb54e640 1 -- 172.21.15.194:0/146984335 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8cdc0f4070 con 0x561a415b4160 2024-09-13T06:10:19.524 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.519+0000 7f8ceda3e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:19.524 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.519+0000 7f8ceda3e980 20 started sync module instance, tier type = 2024-09-13T06:10:19.524 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.519+0000 7f8ceda3e980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:10:19.524 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.519+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415b96e0 con 0x7f8cdc0db040 2024-09-13T06:10:19.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.519+0000 7f8cead4d640 1 -- 172.21.15.194:0/146984335 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(44 notify.0 [create] v35'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cd4049040 con 0x7f8cdc0db040 2024-09-13T06:10:19.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.519+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94670765660880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415b9340 con 0x7f8cdc0db040 2024-09-13T06:10:19.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.519+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415bb5a0 con 0x561a415af770 2024-09-13T06:10:19.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.523+0000 7f8cead4d640 1 -- 172.21.15.194:0/146984335 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94670765660880] v35'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cd4049040 con 0x7f8cdc0db040 2024-09-13T06:10:19.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.523+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v35'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ce400a4d0 con 0x561a415af770 2024-09-13T06:10:19.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.523+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94670765665216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415bb990 con 0x561a415af770 2024-09-13T06:10:19.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.523+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415bc350 con 0x561a415b4160 2024-09-13T06:10:19.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.523+0000 7f8ceb54e640 1 -- 172.21.15.194:0/146984335 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v35'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cdc0f4070 con 0x561a415b4160 2024-09-13T06:10:19.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.523+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94670765665216] v35'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ce400a4d0 con 0x561a415af770 2024-09-13T06:10:19.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.523+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94670765666272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415bc740 con 0x561a415b4160 2024-09-13T06:10:19.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.523+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415bd100 con 0x7f8cdc0db040 2024-09-13T06:10:19.527 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.527+0000 7f8cead4d640 1 -- 172.21.15.194:0/146984335 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(50 notify.3 [create] v35'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cd4049040 con 0x7f8cdc0db040 2024-09-13T06:10:19.527 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.527+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94670765673824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415bd810 con 0x7f8cdc0db040 2024-09-13T06:10:19.527 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.527+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415be330 con 0x561a415af770 2024-09-13T06:10:19.528 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.527+0000 7f8ceb54e640 1 -- 172.21.15.194:0/146984335 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94670765666272] v35'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cdc0f4070 con 0x561a415b4160 2024-09-13T06:10:19.528 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.527+0000 7f8cead4d640 1 -- 172.21.15.194:0/146984335 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94670765673824] v35'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cd4049040 con 0x7f8cdc0db040 2024-09-13T06:10:19.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.527+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v35'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ce400a4d0 con 0x561a415af770 2024-09-13T06:10:19.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.527+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94670765678080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415be2f0 con 0x561a415af770 2024-09-13T06:10:19.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.527+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415bebd0 con 0x7f8cd400f3d0 2024-09-13T06:10:19.531 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.531+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94670765678080] v35'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ce400a4d0 con 0x561a415af770 2024-09-13T06:10:19.531 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.531+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(54 notify.5 [create] v35'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ce400a4d0 con 0x7f8cd400f3d0 2024-09-13T06:10:19.532 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.531+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94670765670048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415be7a0 con 0x7f8cd400f3d0 2024-09-13T06:10:19.532 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.531+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415bf090 con 0x7f8cd400f3d0 2024-09-13T06:10:19.533 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.531+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(56 notify.6 [create] v35'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ce400a4d0 con 0x7f8cd400f3d0 2024-09-13T06:10:19.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.531+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94670765680544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415bf740 con 0x7f8cd400f3d0 2024-09-13T06:10:19.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.531+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415bfff0 con 0x7f8cd400f3d0 2024-09-13T06:10:19.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.531+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94670765670048] v35'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ce400a4d0 con 0x7f8cd400f3d0 2024-09-13T06:10:19.535 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.535+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94670765680544] v35'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ce400a4d0 con 0x7f8cd400f3d0 2024-09-13T06:10:19.536 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.535+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(58 notify.7 [create] v35'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ce400a4d0 con 0x7f8cd400f3d0 2024-09-13T06:10:19.536 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.535+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94670765679344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415bf740 con 0x7f8cd400f3d0 2024-09-13T06:10:19.536 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.535+0000 7f8ceda3e980 20 add_watcher() i=0 2024-09-13T06:10:19.536 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.535+0000 7f8ceda3e980 20 add_watcher() i=1 2024-09-13T06:10:19.536 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.535+0000 7f8ceda3e980 20 add_watcher() i=2 2024-09-13T06:10:19.536 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.535+0000 7f8ceda3e980 20 add_watcher() i=3 2024-09-13T06:10:19.537 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.535+0000 7f8ceda3e980 20 add_watcher() i=4 2024-09-13T06:10:19.537 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.535+0000 7f8ceda3e980 20 add_watcher() i=5 2024-09-13T06:10:19.537 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.535+0000 7f8ceda3e980 20 add_watcher() i=6 2024-09-13T06:10:19.538 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.539+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94670765679344] v35'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ce400a4d0 con 0x7f8cd400f3d0 2024-09-13T06:10:19.538 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.539+0000 7f8ceda3e980 20 add_watcher() i=7 2024-09-13T06:10:19.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.539+0000 7f8ceda3e980 2 all 8 watchers are set, enabling cache 2024-09-13T06:10:19.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.539+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a415c30f0 con 0x561a415af770 2024-09-13T06:10:19.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.539+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8ce400a4d0 con 0x561a415af770 2024-09-13T06:10:19.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.539+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94670765683344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415c0570 con 0x561a415af770 2024-09-13T06:10:19.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.539+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94670765683344] v35'182 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8ce400a4d0 con 0x561a415af770 2024-09-13T06:10:19.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.539+0000 7f8ba1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:10:19.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.539+0000 7f8ceda3e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:10:19.541 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.539+0000 7f8ceda3e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:10:19.541 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.539+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415cb820 con 0x561a415af770 2024-09-13T06:10:19.543 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.543+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v35'31 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8ce400a4d0 con 0x561a415af770 2024-09-13T06:10:19.543 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.543+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415cbe70 con 0x7f8cd400f3d0 2024-09-13T06:10:19.545 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.543+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v35'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8ce400a4d0 con 0x7f8cd400f3d0 2024-09-13T06:10:19.545 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.543+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415cc2d0 con 0x561a415b4160 2024-09-13T06:10:19.546 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.547+0000 7f8ceb54e640 1 -- 172.21.15.194:0/146984335 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v35'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8cdc0f4070 con 0x561a415b4160 2024-09-13T06:10:19.546 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.547+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415cc210 con 0x561a415af770 2024-09-13T06:10:19.547 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.547+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v35'183 uv164 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8ce400a4d0 con 0x561a415af770 2024-09-13T06:10:19.547 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.547+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415cc800 con 0x7f8cdc0db040 2024-09-13T06:10:19.549 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.547+0000 7f8cead4d640 1 -- 172.21.15.194:0/146984335 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v35'62 uv53 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8cd4049040 con 0x7f8cdc0db040 2024-09-13T06:10:19.549 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.547+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415cccb0 con 0x561a415b4160 2024-09-13T06:10:19.550 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.551+0000 7f8ceb54e640 1 -- 172.21.15.194:0/146984335 <== osd.3 v2:172.21.15.194:6816/96632515 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v35'42 uv37 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8cdc0f4070 con 0x561a415b4160 2024-09-13T06:10:19.550 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.551+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415cccb0 con 0x561a415af770 2024-09-13T06:10:19.552 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.551+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v35'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8ce400a4d0 con 0x561a415af770 2024-09-13T06:10:19.552 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.551+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415cccb0 con 0x7f8cd400f3d0 2024-09-13T06:10:19.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.555+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v35'41 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8ce400a4d0 con 0x7f8cd400f3d0 2024-09-13T06:10:19.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.555+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415cccb0 con 0x7f8cdc0db040 2024-09-13T06:10:19.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.555+0000 7f8cead4d640 1 -- 172.21.15.194:0/146984335 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v35'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8cd4049040 con 0x7f8cdc0db040 2024-09-13T06:10:19.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.555+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415cd320 con 0x561a415b4160 2024-09-13T06:10:19.558 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.555+0000 7f8ceb54e640 1 -- 172.21.15.194:0/146984335 <== osd.3 v2:172.21.15.194:6816/96632515 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v35'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8cdc0f4070 con 0x561a415b4160 2024-09-13T06:10:19.558 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.555+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415cd320 con 0x7f8cdc0db040 2024-09-13T06:10:19.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.559+0000 7f8cead4d640 1 -- 172.21.15.194:0/146984335 <== osd.2 v2:172.21.15.194:6800/815615585 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v35'63 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8cd4049040 con 0x7f8cdc0db040 2024-09-13T06:10:19.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.559+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415cd890 con 0x7f8cd400f3d0 2024-09-13T06:10:19.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.559+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v35'27 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8ce400a4d0 con 0x7f8cd400f3d0 2024-09-13T06:10:19.562 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.559+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415cd920 con 0x7f8cdc0db040 2024-09-13T06:10:19.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.563+0000 7f8cead4d640 1 -- 172.21.15.194:0/146984335 <== osd.2 v2:172.21.15.194:6800/815615585 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v35'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8cd4049040 con 0x7f8cdc0db040 2024-09-13T06:10:19.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.563+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415cd9b0 con 0x7f8cd400f3d0 2024-09-13T06:10:19.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.563+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v35'47 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8ce400a4d0 con 0x7f8cd400f3d0 2024-09-13T06:10:19.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.563+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415cd9b0 con 0x561a415af770 2024-09-13T06:10:19.566 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.567+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v35'184 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8ce400a4d0 con 0x561a415af770 2024-09-13T06:10:19.566 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.567+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415cd9b0 con 0x561a415b4160 2024-09-13T06:10:19.569 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.567+0000 7f8ceb54e640 1 -- 172.21.15.194:0/146984335 <== osd.3 v2:172.21.15.194:6816/96632515 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v35'56 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8cdc0f4070 con 0x561a415b4160 2024-09-13T06:10:19.569 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.567+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415cd9b0 con 0x7f8cdc0db040 2024-09-13T06:10:19.570 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.567+0000 7f8cead4d640 1 -- 172.21.15.194:0/146984335 <== osd.2 v2:172.21.15.194:6800/815615585 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v35'64 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8cd4049040 con 0x7f8cdc0db040 2024-09-13T06:10:19.570 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.567+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415cd9b0 con 0x561a415b4160 2024-09-13T06:10:19.571 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.571+0000 7f8ceb54e640 1 -- 172.21.15.194:0/146984335 <== osd.3 v2:172.21.15.194:6816/96632515 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v35'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8cdc0f4070 con 0x561a415b4160 2024-09-13T06:10:19.571 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.571+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415cd9b0 con 0x561a415af770 2024-09-13T06:10:19.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.571+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.1 v2:172.21.15.194:6808/3135444559 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v35'32 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8ce400a4d0 con 0x561a415af770 2024-09-13T06:10:19.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.571+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415cd920 con 0x561a415af770 2024-09-13T06:10:19.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.575+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.1 v2:172.21.15.194:6808/3135444559 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v35'185 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8ce400a4d0 con 0x561a415af770 2024-09-13T06:10:19.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.575+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415cd920 con 0x561a415b4160 2024-09-13T06:10:19.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.575+0000 7f8ceb54e640 1 -- 172.21.15.194:0/146984335 <== osd.3 v2:172.21.15.194:6816/96632515 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v35'57 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8cdc0f4070 con 0x561a415b4160 2024-09-13T06:10:19.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.575+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415cd920 con 0x7f8cdc0db040 2024-09-13T06:10:19.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.579+0000 7f8cead4d640 1 -- 172.21.15.194:0/146984335 <== osd.2 v2:172.21.15.194:6800/815615585 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v35'34 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8cd4049040 con 0x7f8cdc0db040 2024-09-13T06:10:19.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.579+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415cdfa0 con 0x561a415b4160 2024-09-13T06:10:19.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.579+0000 7f8ceb54e640 1 -- 172.21.15.194:0/146984335 <== osd.3 v2:172.21.15.194:6816/96632515 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v35'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8cdc0f4070 con 0x561a415b4160 2024-09-13T06:10:19.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.579+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415cdfa0 con 0x561a415b4160 2024-09-13T06:10:19.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.579+0000 7f8ceb54e640 1 -- 172.21.15.194:0/146984335 <== osd.3 v2:172.21.15.194:6816/96632515 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v35'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8cdc0f4070 con 0x561a415b4160 2024-09-13T06:10:19.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.579+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415cdfa0 con 0x561a415b4160 2024-09-13T06:10:19.583 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.583+0000 7f8ceb54e640 1 -- 172.21.15.194:0/146984335 <== osd.3 v2:172.21.15.194:6816/96632515 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v35'20 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8cdc0f4070 con 0x561a415b4160 2024-09-13T06:10:19.583 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.583+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415cdfa0 con 0x561a415b4160 2024-09-13T06:10:19.584 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.583+0000 7f8ceb54e640 1 -- 172.21.15.194:0/146984335 <== osd.3 v2:172.21.15.194:6816/96632515 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v35'43 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8cdc0f4070 con 0x561a415b4160 2024-09-13T06:10:19.584 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.583+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415cdfa0 con 0x7f8cd400f3d0 2024-09-13T06:10:19.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.587+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v35'28 uv25 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8ce400a4d0 con 0x7f8cd400f3d0 2024-09-13T06:10:19.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.587+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415cdfa0 con 0x561a415b4160 2024-09-13T06:10:19.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.587+0000 7f8ceb54e640 1 -- 172.21.15.194:0/146984335 <== osd.3 v2:172.21.15.194:6816/96632515 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v35'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8cdc0f4070 con 0x561a415b4160 2024-09-13T06:10:19.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.587+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415cdfa0 con 0x7f8cd400f3d0 2024-09-13T06:10:19.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.591+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.0 v2:172.21.15.120:6800/1923744619 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v35'42 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8ce400a4d0 con 0x7f8cd400f3d0 2024-09-13T06:10:19.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.591+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415cdfa0 con 0x561a415b4160 2024-09-13T06:10:19.592 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.591+0000 7f8ceb54e640 1 -- 172.21.15.194:0/146984335 <== osd.3 v2:172.21.15.194:6816/96632515 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v35'58 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8cdc0f4070 con 0x561a415b4160 2024-09-13T06:10:19.592 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.591+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415cdfa0 con 0x7f8cd400f3d0 2024-09-13T06:10:19.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.595+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.0 v2:172.21.15.120:6800/1923744619 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v35'48 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8ce400a4d0 con 0x7f8cd400f3d0 2024-09-13T06:10:19.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.595+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415cdfa0 con 0x7f8cdc0db040 2024-09-13T06:10:19.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.595+0000 7f8cead4d640 1 -- 172.21.15.194:0/146984335 <== osd.2 v2:172.21.15.194:6800/815615585 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v35'31 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8cd4049040 con 0x7f8cdc0db040 2024-09-13T06:10:19.598 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.595+0000 7f8ba0fe1640 20 reqs_thread_entry: start 2024-09-13T06:10:19.598 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.595+0000 7f8ceda3e980 20 init_complete bucket index max shards: 11 2024-09-13T06:10:19.598 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.595+0000 7f8ceda3e980 20 Filter name: none 2024-09-13T06:10:19.598 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.595+0000 7f8b1a7fc640 20 reqs_thread_entry: start 2024-09-13T06:10:19.598 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.595+0000 7f8ceda3e980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T06:10:19.598 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.595+0000 7f8ceda3e980 20 rados->read ofs=0 len=0 2024-09-13T06:10:19.598 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.595+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a415e8fd0 con 0x7f8cdc0db040 2024-09-13T06:10:19.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.599+0000 7f8cead4d640 1 -- 172.21.15.194:0/146984335 <== osd.2 v2:172.21.15.194:6800/815615585 21 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f8cd4049040 con 0x7f8cdc0db040 2024-09-13T06:10:19.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.599+0000 7f8ceda3e980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T06:10:19.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.599+0000 7f8ceda3e980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T06:10:19.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.599+0000 7f8ceda3e980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T06:10:19.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.599+0000 7f8ceda3e980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5 : miss 2024-09-13T06:10:19.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.599+0000 7f8ceda3e980 20 rados->read ofs=0 len=0 2024-09-13T06:10:19.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.599+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:95 8.19 8:9bd960cc:root::.bucket.meta.myfoo%3a52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a415ea7f0 con 0x561a415af770 2024-09-13T06:10:19.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.599+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.1 v2:172.21.15.194:6808/3135444559 27 ==== osd_op_reply(95 .bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f8ce400a4d0 con 0x561a415af770 2024-09-13T06:10:19.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.599+0000 7f8ceda3e980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T06:10:19.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.599+0000 7f8ceda3e980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5 info.flags=0x17 2024-09-13T06:10:19.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.599+0000 7f8ceda3e980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5 to cache LRU end 2024-09-13T06:10:19.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.599+0000 7f8ceda3e980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:10:19.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.599+0000 7f8ceda3e980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T06:10:19.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.599+0000 7f8ceda3e980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5 2024-09-13T06:10:19.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.599+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:96 4.11 4:8a3e4813:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a41667c90 con 0x7f8cd400f3d0 2024-09-13T06:10:19.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.599+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.0 v2:172.21.15.120:6800/1923744619 22 ==== osd_op_reply(96 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8ce400a4d0 con 0x7f8cd400f3d0 2024-09-13T06:10:19.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.599+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:97 4.20 4:06583eea:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a41667cd0 con 0x561a415af770 2024-09-13T06:10:19.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.599+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.1 v2:172.21.15.194:6808/3135444559 28 ==== osd_op_reply(97 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.1 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8ce400a4d0 con 0x561a415af770 2024-09-13T06:10:19.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.599+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:98 4.1d 4:bafcf12c:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a41667cd0 con 0x561a415b4160 2024-09-13T06:10:19.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.599+0000 7f8ceb54e640 1 -- 172.21.15.194:0/146984335 <== osd.3 v2:172.21.15.194:6816/96632515 27 ==== osd_op_reply(98 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.2 [call out=426b] v0'0 uv5 ondisk = 0) ==== 194+0+426 (crc 0 0 0) 0x7f8cdc0f4070 con 0x561a415b4160 2024-09-13T06:10:19.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.599+0000 7f8ceda3e980 10 cls_bucket_list_unordered: got 9c8454ddf7aa50116496bac348d7550d 2024-09-13T06:10:19.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.599+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:99 4.3b 4:df668498:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a41667d10 con 0x561a415b4160 2024-09-13T06:10:19.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.603+0000 7f8ceb54e640 1 -- 172.21.15.194:0/146984335 <== osd.3 v2:172.21.15.194:6816/96632515 28 ==== osd_op_reply(99 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8cdc0f4070 con 0x561a415b4160 2024-09-13T06:10:19.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.603+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:100 4.38 4:1f4de9b6:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a41667d10 con 0x561a415af770 2024-09-13T06:10:19.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.603+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.1 v2:172.21.15.194:6808/3135444559 29 ==== osd_op_reply(100 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8ce400a4d0 con 0x561a415af770 2024-09-13T06:10:19.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.603+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:101 4.33 4:ce9bf92f:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a41667d10 con 0x7f8cd400f3d0 2024-09-13T06:10:19.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.603+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.0 v2:172.21.15.120:6800/1923744619 23 ==== osd_op_reply(101 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8ce400a4d0 con 0x7f8cd400f3d0 2024-09-13T06:10:19.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.603+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:102 4.23 4:c484c9d6:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a41667d10 con 0x7f8cd400f3d0 2024-09-13T06:10:19.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.603+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.0 v2:172.21.15.120:6800/1923744619 24 ==== osd_op_reply(102 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.6 [call out=425b] v0'0 uv7 ondisk = 0) ==== 194+0+425 (crc 0 0 0) 0x7f8ce400a4d0 con 0x7f8cd400f3d0 2024-09-13T06:10:19.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.603+0000 7f8ceda3e980 10 cls_bucket_list_unordered: got b1b9a972ccd8c962a473909b97007eb4 2024-09-13T06:10:19.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.603+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:103 4.35 4:ad9c7c1e:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a41667cd0 con 0x561a415af770 2024-09-13T06:10:19.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.603+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.1 v2:172.21.15.194:6808/3135444559 30 ==== osd_op_reply(103 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8ce403d060 con 0x561a415af770 2024-09-13T06:10:19.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.603+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:104 4.11 4:8af5775c:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a41667cd0 con 0x7f8cd400f3d0 2024-09-13T06:10:19.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.607+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.0 v2:172.21.15.120:6800/1923744619 25 ==== osd_op_reply(104 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.8 [call out=425b] v0'0 uv6 ondisk = 0) ==== 194+0+425 (crc 0 0 0) 0x7f8ce403d060 con 0x7f8cd400f3d0 2024-09-13T06:10:19.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.607+0000 7f8ceda3e980 10 cls_bucket_list_unordered: got c785e1ed2950e3e36b1e2ca01f299a54 2024-09-13T06:10:19.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.607+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:105 4.35 4:af6f7aeb:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a41667cd0 con 0x561a415af770 2024-09-13T06:10:19.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.607+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.1 v2:172.21.15.194:6808/3135444559 31 ==== osd_op_reply(105 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.9 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8ce403d060 con 0x561a415af770 2024-09-13T06:10:19.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.607+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:106 4.31 4:8ee99d93:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a41667cd0 con 0x561a415af770 2024-09-13T06:10:19.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.607+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.1 v2:172.21.15.194:6808/3135444559 32 ==== osd_op_reply(106 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.10 [call out=697b] v0'0 uv9 ondisk = 0) ==== 195+0+697 (crc 0 0 0) 0x7f8ce403d060 con 0x561a415af770 2024-09-13T06:10:19.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.607+0000 7f8ceda3e980 10 cls_bucket_list_unordered: got 24d27c169c2c881eb09a065116f2aa5c 2024-09-13T06:10:19.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.607+0000 7f8ceda3e980 10 cls_bucket_list_unordered: got bb3aec0fdcdbc2974890f805c585d432 2024-09-13T06:10:19.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.607+0000 7f8ceda3e980 20 get_obj_state: octx=0x7f8cd40208f0 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x561a41667168 s->prefetch_data=0 2024-09-13T06:10:19.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.607+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:107 3.13s0 3:ca918481:::52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5_9c8454ddf7aa50116496bac348d7550d:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a41665660 con 0x561a415b4160 2024-09-13T06:10:19.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.607+0000 7f8ceb54e640 1 -- 172.21.15.194:0/146984335 <== osd.3 v2:172.21.15.194:6816/96632515 29 ==== osd_op_reply(107 52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5_9c8454ddf7aa50116496bac348d7550d [getxattrs out=879b,stat out=16b] v0'0 uv5 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7f8cdc0f4070 con 0x561a415b4160 2024-09-13T06:10:19.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.607+0000 7f8ceda3e980 10 manifest: total_size = 6 2024-09-13T06:10:19.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.607+0000 7f8ceda3e980 20 get_obj_state: setting s->obj_tag to 52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.16021957760769819049 2024-09-13T06:10:19.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.607+0000 7f8ceda3e980 20 get_obj_state: octx=0x7f8cd40208f0 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x561a41667168 s->prefetch_data=0 2024-09-13T06:10:19.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.607+0000 7f8ceda3e980 20 prepare_atomic_modification: state is not atomic. state=0x561a41667168 2024-09-13T06:10:19.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.607+0000 7f8ceda3e980 20 bucket index object: :.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.2 2024-09-13T06:10:19.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.607+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:108 4.1d 4:bafcf12c:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415ef8b0 con 0x561a415b4160 2024-09-13T06:10:19.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.607+0000 7f8ceb54e640 1 -- 172.21.15.194:0/146984335 <== osd.3 v2:172.21.15.194:6816/96632515 30 ==== osd_op_reply(108 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.2 [stat,call,call] v35'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f8cdc0f4070 con 0x561a415b4160 2024-09-13T06:10:19.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.607+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:109 3.13s0 3:ca918481:::52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5_9c8454ddf7aa50116496bac348d7550d:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415ef8b0 con 0x561a415b4160 2024-09-13T06:10:19.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.611+0000 7f8ceb54e640 1 -- 172.21.15.194:0/146984335 <== osd.3 v2:172.21.15.194:6816/96632515 31 ==== osd_op_reply(109 52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5_9c8454ddf7aa50116496bac348d7550d [call] v35'6 uv6 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f8cdc0f4070 con 0x561a415b4160 2024-09-13T06:10:19.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.611+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:110 4.1d 4:bafcf12c:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415f0340 con 0x561a415b4160 2024-09-13T06:10:19.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.611+0000 7f8ceda3e980 20 get_obj_state: octx=0x7f8cd40208f0 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x561a41667168 s->prefetch_data=0 2024-09-13T06:10:19.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.611+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:111 3.1cs0 3:3ba1b4be:::52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5_b1b9a972ccd8c962a473909b97007eb4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a415f0340 con 0x561a415af770 2024-09-13T06:10:19.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.611+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.1 v2:172.21.15.194:6808/3135444559 33 ==== osd_op_reply(111 52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5_b1b9a972ccd8c962a473909b97007eb4 [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7f8ce403d060 con 0x561a415af770 2024-09-13T06:10:19.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.611+0000 7f8ceda3e980 10 manifest: total_size = 3 2024-09-13T06:10:19.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.611+0000 7f8ceda3e980 20 get_obj_state: setting s->obj_tag to 52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.8087189436595649873 2024-09-13T06:10:19.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.611+0000 7f8ceda3e980 20 get_obj_state: octx=0x7f8cd40208f0 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x561a41667168 s->prefetch_data=0 2024-09-13T06:10:19.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.611+0000 7f8ceda3e980 20 prepare_atomic_modification: state is not atomic. state=0x561a41667168 2024-09-13T06:10:19.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.611+0000 7f8ceda3e980 20 bucket index object: :.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.6 2024-09-13T06:10:19.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.611+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:112 4.23 4:c484c9d6:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415f4fb0 con 0x7f8cd400f3d0 2024-09-13T06:10:19.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.611+0000 7f8ceb54e640 1 -- 172.21.15.194:0/146984335 <== osd.3 v2:172.21.15.194:6816/96632515 32 ==== osd_op_reply(110 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.2 [stat,call,call] v35'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f8cdc0f4070 con 0x561a415b4160 2024-09-13T06:10:19.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.611+0000 7f8bceffd640 20 handle_completion(): completion ok for obj=9c8454ddf7aa50116496bac348d7550d 2024-09-13T06:10:19.614 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.615+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.0 v2:172.21.15.120:6800/1923744619 26 ==== osd_op_reply(112 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.6 [stat,call,call] v35'8 uv8 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f8ce403d060 con 0x7f8cd400f3d0 2024-09-13T06:10:19.614 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.615+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:113 3.1cs0 3:3ba1b4be:::52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5_b1b9a972ccd8c962a473909b97007eb4:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415eb0d0 con 0x561a415af770 2024-09-13T06:10:19.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.615+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.1 v2:172.21.15.194:6808/3135444559 34 ==== osd_op_reply(113 52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5_b1b9a972ccd8c962a473909b97007eb4 [call] v35'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f8ce403d060 con 0x561a415af770 2024-09-13T06:10:19.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.615+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:114 4.23 4:c484c9d6:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415f0f70 con 0x7f8cd400f3d0 2024-09-13T06:10:19.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.615+0000 7f8ceda3e980 20 get_obj_state: octx=0x7f8cd40208f0 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x561a41667168 s->prefetch_data=0 2024-09-13T06:10:19.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.615+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:115 3.8s0 3:116fedc6:::52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5_c785e1ed2950e3e36b1e2ca01f299a54:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a415f0f70 con 0x561a415b4160 2024-09-13T06:10:19.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.615+0000 7f8ceb54e640 1 -- 172.21.15.194:0/146984335 <== osd.3 v2:172.21.15.194:6816/96632515 33 ==== osd_op_reply(115 52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5_c785e1ed2950e3e36b1e2ca01f299a54 [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7f8cdc0f4070 con 0x561a415b4160 2024-09-13T06:10:19.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.615+0000 7f8ceda3e980 10 manifest: total_size = 4 2024-09-13T06:10:19.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.615+0000 7f8ceda3e980 20 get_obj_state: setting s->obj_tag to 52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.2660902368546479866 2024-09-13T06:10:19.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.615+0000 7f8ceda3e980 20 get_obj_state: octx=0x7f8cd40208f0 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x561a41667168 s->prefetch_data=0 2024-09-13T06:10:19.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.615+0000 7f8ceda3e980 20 prepare_atomic_modification: state is not atomic. state=0x561a41667168 2024-09-13T06:10:19.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.615+0000 7f8ceda3e980 20 bucket index object: :.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.8 2024-09-13T06:10:19.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.615+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:116 4.11 4:8af5775c:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415f0f70 con 0x7f8cd400f3d0 2024-09-13T06:10:19.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.619+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.0 v2:172.21.15.120:6800/1923744619 27 ==== osd_op_reply(114 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.6 [stat,call,call] v35'9 uv9 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f8ce403d060 con 0x7f8cd400f3d0 2024-09-13T06:10:19.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.619+0000 7f8bce7fc640 20 handle_completion(): completion ok for obj=b1b9a972ccd8c962a473909b97007eb4 2024-09-13T06:10:19.620 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.619+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.0 v2:172.21.15.120:6800/1923744619 28 ==== osd_op_reply(116 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.8 [stat,call,call] v35'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f8ce403d060 con 0x7f8cd400f3d0 2024-09-13T06:10:19.620 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.619+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:117 3.8s0 3:116fedc6:::52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5_c785e1ed2950e3e36b1e2ca01f299a54:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415f0ac0 con 0x561a415b4160 2024-09-13T06:10:19.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.623+0000 7f8ceb54e640 1 -- 172.21.15.194:0/146984335 <== osd.3 v2:172.21.15.194:6816/96632515 34 ==== osd_op_reply(117 52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5_c785e1ed2950e3e36b1e2ca01f299a54 [call] v35'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f8cdc0f4070 con 0x561a415b4160 2024-09-13T06:10:19.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.623+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:118 4.11 4:8af5775c:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415f0ac0 con 0x7f8cd400f3d0 2024-09-13T06:10:19.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.623+0000 7f8ceda3e980 20 get_obj_state: octx=0x7f8cd40208f0 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x561a41667168 s->prefetch_data=0 2024-09-13T06:10:19.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.623+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:119 3.22s0 3:46066911:::52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5_24d27c169c2c881eb09a065116f2aa5c:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a415f0ac0 con 0x561a415b4160 2024-09-13T06:10:19.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.623+0000 7f8ceb54e640 1 -- 172.21.15.194:0/146984335 <== osd.3 v2:172.21.15.194:6816/96632515 35 ==== osd_op_reply(119 52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5_24d27c169c2c881eb09a065116f2aa5c [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7f8cdc0f4070 con 0x561a415b4160 2024-09-13T06:10:19.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.623+0000 7f8ceda3e980 10 manifest: total_size = 5 2024-09-13T06:10:19.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.623+0000 7f8ceda3e980 20 get_obj_state: setting s->obj_tag to 52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9428737979785488063 2024-09-13T06:10:19.624 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.623+0000 7f8ceda3e980 20 get_obj_state: octx=0x7f8cd40208f0 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x561a41667168 s->prefetch_data=0 2024-09-13T06:10:19.624 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.623+0000 7f8ceda3e980 20 prepare_atomic_modification: state is not atomic. state=0x561a41667168 2024-09-13T06:10:19.624 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.623+0000 7f8ceda3e980 20 bucket index object: :.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.10 2024-09-13T06:10:19.624 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.623+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:120 4.31 4:8ee99d93:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415f0ac0 con 0x561a415af770 2024-09-13T06:10:19.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.623+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.1 v2:172.21.15.194:6808/3135444559 35 ==== osd_op_reply(120 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.10 [stat,call,call] v35'10 uv10 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f8ce403d060 con 0x561a415af770 2024-09-13T06:10:19.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.623+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:121 3.22s0 3:46066911:::52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5_24d27c169c2c881eb09a065116f2aa5c:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415f0ac0 con 0x561a415b4160 2024-09-13T06:10:19.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.623+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.0 v2:172.21.15.120:6800/1923744619 29 ==== osd_op_reply(118 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.8 [stat,call,call] v35'8 uv8 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f8ce403d060 con 0x7f8cd400f3d0 2024-09-13T06:10:19.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.623+0000 7f8bceffd640 20 handle_completion(): completion ok for obj=c785e1ed2950e3e36b1e2ca01f299a54 2024-09-13T06:10:19.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.627+0000 7f8ceb54e640 1 -- 172.21.15.194:0/146984335 <== osd.3 v2:172.21.15.194:6816/96632515 36 ==== osd_op_reply(121 52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5_24d27c169c2c881eb09a065116f2aa5c [call] v35'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f8cdc0f4070 con 0x561a415b4160 2024-09-13T06:10:19.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.627+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:122 4.31 4:8ee99d93:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415ec0e0 con 0x561a415af770 2024-09-13T06:10:19.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.627+0000 7f8ceda3e980 20 get_obj_state: octx=0x7f8cd40208f0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x561a41667168 s->prefetch_data=0 2024-09-13T06:10:19.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.627+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:123 3.39s0 3:9fd74620:::52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a415ecd40 con 0x561a415b4160 2024-09-13T06:10:19.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.627+0000 7f8ceb54e640 1 -- 172.21.15.194:0/146984335 <== osd.3 v2:172.21.15.194:6816/96632515 37 ==== osd_op_reply(123 52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=909b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+925 (crc 0 0 0) 0x7f8cdc0f4070 con 0x561a415b4160 2024-09-13T06:10:19.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.627+0000 7f8ceda3e980 10 manifest: total_size = 5 2024-09-13T06:10:19.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.627+0000 7f8ceda3e980 20 get_obj_state: setting s->obj_tag to _ExoIeJmILmFhb0GYW8_14tN80Lu_t8M 2024-09-13T06:10:19.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.627+0000 7f8ceda3e980 20 get_obj_state: octx=0x7f8cd40208f0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x561a41667168 s->prefetch_data=0 2024-09-13T06:10:19.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.627+0000 7f8ceda3e980 20 prepare_atomic_modification: state is not atomic. state=0x561a41667168 2024-09-13T06:10:19.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.627+0000 7f8ceda3e980 20 bucket index object: :.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.10 2024-09-13T06:10:19.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.627+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:124 4.31 4:8ee99d93:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415ec0e0 con 0x561a415af770 2024-09-13T06:10:19.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.627+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.1 v2:172.21.15.194:6808/3135444559 36 ==== osd_op_reply(122 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.10 [stat,call,call] v35'11 uv11 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f8ce403d060 con 0x561a415af770 2024-09-13T06:10:19.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.627+0000 7f8bce7fc640 20 handle_completion(): completion ok for obj=24d27c169c2c881eb09a065116f2aa5c 2024-09-13T06:10:19.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.627+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.1 v2:172.21.15.194:6808/3135444559 37 ==== osd_op_reply(124 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.10 [stat,call,call] v35'12 uv12 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f8ce403d060 con 0x561a415af770 2024-09-13T06:10:19.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.627+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:125 3.39s0 3:9fd74620:::52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5_bb3aec0fdcdbc2974890f805c585d432:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415ec0e0 con 0x561a415b4160 2024-09-13T06:10:19.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.631+0000 7f8ceb54e640 1 -- 172.21.15.194:0/146984335 <== osd.3 v2:172.21.15.194:6816/96632515 38 ==== osd_op_reply(125 52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5_bb3aec0fdcdbc2974890f805c585d432 [call] v35'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f8cdc0f4070 con 0x561a415b4160 2024-09-13T06:10:19.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.631+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:126 4.31 4:8ee99d93:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415ec0e0 con 0x561a415af770 2024-09-13T06:10:19.633 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.631+0000 7f8ceda3e980 20 list_objects_ordered: starting attempt 1 2024-09-13T06:10:19.633 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.631+0000 7f8ceda3e980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-13T06:10:19.633 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.631+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:127 4.11 4:8a3e4813:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a415ec0e0 con 0x7f8cd400f3d0 2024-09-13T06:10:19.633 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.631+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:128 4.20 4:06583eea:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a41666f80 con 0x561a415af770 2024-09-13T06:10:19.636 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.631+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:129 4.1d 4:bafcf12c:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a415f9590 con 0x561a415b4160 2024-09-13T06:10:19.636 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.631+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:130 4.3b 4:df668498:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a415fbfb0 con 0x561a415b4160 2024-09-13T06:10:19.637 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.631+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:131 4.38 4:1f4de9b6:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a415fec90 con 0x561a415af770 2024-09-13T06:10:19.637 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.631+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:132 4.33 4:ce9bf92f:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a41601640 con 0x7f8cd400f3d0 2024-09-13T06:10:19.637 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.631+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:133 4.23 4:c484c9d6:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a41604030 con 0x7f8cd400f3d0 2024-09-13T06:10:19.637 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.631+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:134 4.35 4:ad9c7c1e:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a41606a20 con 0x561a415af770 2024-09-13T06:10:19.637 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.631+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:135 4.11 4:8af5775c:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a41604030 con 0x7f8cd400f3d0 2024-09-13T06:10:19.637 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.631+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:136 4.35 4:af6f7aeb:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a4160bd40 con 0x561a415af770 2024-09-13T06:10:19.637 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.631+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:137 4.31 4:8ee99d93:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a4160ebc0 con 0x561a415af770 2024-09-13T06:10:19.637 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.631+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.1 v2:172.21.15.194:6808/3135444559 38 ==== osd_op_reply(128 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.1 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8ce403d060 con 0x561a415af770 2024-09-13T06:10:19.637 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.631+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.1 v2:172.21.15.194:6808/3135444559 39 ==== osd_op_reply(134 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8ce403d060 con 0x561a415af770 2024-09-13T06:10:19.637 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.631+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.0 v2:172.21.15.120:6800/1923744619 30 ==== osd_op_reply(127 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8ce403d060 con 0x7f8cd400f3d0 2024-09-13T06:10:19.637 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.631+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.0 v2:172.21.15.120:6800/1923744619 31 ==== osd_op_reply(133 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.6 [call out=124b] v0'0 uv9 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f8ce403d060 con 0x7f8cd400f3d0 2024-09-13T06:10:19.637 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.631+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.0 v2:172.21.15.120:6800/1923744619 32 ==== osd_op_reply(132 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8ce403d060 con 0x7f8cd400f3d0 2024-09-13T06:10:19.638 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.631+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.1 v2:172.21.15.194:6808/3135444559 40 ==== osd_op_reply(131 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8ce403d060 con 0x561a415af770 2024-09-13T06:10:19.638 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.631+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.1 v2:172.21.15.194:6808/3135444559 41 ==== osd_op_reply(136 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.9 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8ce403d060 con 0x561a415af770 2024-09-13T06:10:19.638 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.631+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.0 v2:172.21.15.120:6800/1923744619 33 ==== osd_op_reply(135 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.8 [call out=124b] v0'0 uv8 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f8ce403d060 con 0x7f8cd400f3d0 2024-09-13T06:10:19.638 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.631+0000 7f8ceb54e640 1 -- 172.21.15.194:0/146984335 <== osd.3 v2:172.21.15.194:6816/96632515 39 ==== osd_op_reply(129 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.2 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f8cdc0f4070 con 0x561a415b4160 2024-09-13T06:10:19.638 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.631+0000 7f8ceb54e640 1 -- 172.21.15.194:0/146984335 <== osd.3 v2:172.21.15.194:6816/96632515 40 ==== osd_op_reply(130 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8cdc0f4070 con 0x561a415b4160 2024-09-13T06:10:19.638 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.635+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.1 v2:172.21.15.194:6808/3135444559 42 ==== osd_op_reply(126 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.10 [stat,call,call] v35'13 uv13 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f8ce403d060 con 0x561a415af770 2024-09-13T06:10:19.638 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.635+0000 7f8bceffd640 20 handle_completion(): completion ok for obj=bb3aec0fdcdbc2974890f805c585d432 2024-09-13T06:10:19.638 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.635+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.1 v2:172.21.15.194:6808/3135444559 43 ==== osd_op_reply(137 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.10 [call out=124b] v0'0 uv13 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7f8ce403d060 con 0x561a415af770 2024-09-13T06:10:19.638 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.635+0000 7f8ceda3e980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-13T06:10:19.638 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.635+0000 7f8ceda3e980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-13T06:10:19.638 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.635+0000 7f8ceda3e980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-13T06:10:19.638 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.635+0000 7f8ceda3e980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-13T06:10:19.638 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.635+0000 7f8ceda3e980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5])"; uploads.size()=0; is_truncated=0 2024-09-13T06:10:19.639 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.635+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:138 4.11 4:8a3e4813:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a4160ebc0 con 0x7f8cd400f3d0 2024-09-13T06:10:19.639 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.635+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:139 4.20 4:06583eea:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a41667400 con 0x561a415af770 2024-09-13T06:10:19.639 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.635+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:140 4.1d 4:bafcf12c:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a4160e430 con 0x561a415b4160 2024-09-13T06:10:19.639 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.635+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:141 4.3b 4:df668498:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a4160cbb0 con 0x561a415b4160 2024-09-13T06:10:19.639 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.635+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:142 4.38 4:1f4de9b6:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a4160ebc0 con 0x561a415af770 2024-09-13T06:10:19.639 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.635+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:143 4.33 4:ce9bf92f:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a415f0f70 con 0x7f8cd400f3d0 2024-09-13T06:10:19.639 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.635+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:144 4.23 4:c484c9d6:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a4160e430 con 0x7f8cd400f3d0 2024-09-13T06:10:19.639 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.635+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:145 4.35 4:ad9c7c1e:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a41667400 con 0x561a415af770 2024-09-13T06:10:19.639 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.635+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:146 4.11 4:8af5775c:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a4160cbb0 con 0x7f8cd400f3d0 2024-09-13T06:10:19.639 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.635+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:147 4.35 4:af6f7aeb:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a4160ebc0 con 0x561a415af770 2024-09-13T06:10:19.639 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.635+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:148 4.31 4:8ee99d93:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a41608ef0 con 0x561a415af770 2024-09-13T06:10:19.639 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.635+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.1 v2:172.21.15.194:6808/3135444559 44 ==== osd_op_reply(139 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.1 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8ce403d060 con 0x561a415af770 2024-09-13T06:10:19.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.635+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.1 v2:172.21.15.194:6808/3135444559 45 ==== osd_op_reply(142 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8ce403d060 con 0x561a415af770 2024-09-13T06:10:19.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.635+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.1 v2:172.21.15.194:6808/3135444559 46 ==== osd_op_reply(145 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8ce403d060 con 0x561a415af770 2024-09-13T06:10:19.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.635+0000 7f8ceb54e640 1 -- 172.21.15.194:0/146984335 <== osd.3 v2:172.21.15.194:6816/96632515 41 ==== osd_op_reply(140 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.2 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f8cdc0f4070 con 0x561a415b4160 2024-09-13T06:10:19.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.635+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.1 v2:172.21.15.194:6808/3135444559 47 ==== osd_op_reply(148 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.10 [call out=124b] v0'0 uv13 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7f8ce403d060 con 0x561a415af770 2024-09-13T06:10:19.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.635+0000 7f8ceb54e640 1 -- 172.21.15.194:0/146984335 <== osd.3 v2:172.21.15.194:6816/96632515 42 ==== osd_op_reply(141 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8cdc0f4070 con 0x561a415b4160 2024-09-13T06:10:19.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.635+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.0 v2:172.21.15.120:6800/1923744619 34 ==== osd_op_reply(138 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8ce403d060 con 0x7f8cd400f3d0 2024-09-13T06:10:19.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.635+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.1 v2:172.21.15.194:6808/3135444559 48 ==== osd_op_reply(147 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.9 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8ce403d060 con 0x561a415af770 2024-09-13T06:10:19.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.635+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.0 v2:172.21.15.120:6800/1923744619 35 ==== osd_op_reply(143 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8ce403d060 con 0x7f8cd400f3d0 2024-09-13T06:10:19.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.635+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.0 v2:172.21.15.120:6800/1923744619 36 ==== osd_op_reply(144 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.6 [call out=124b] v0'0 uv9 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f8ce403d060 con 0x7f8cd400f3d0 2024-09-13T06:10:19.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.635+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.0 v2:172.21.15.120:6800/1923744619 37 ==== osd_op_reply(146 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.8 [call out=124b] v0'0 uv8 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f8ce403d060 con 0x7f8cd400f3d0 2024-09-13T06:10:19.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.635+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:149 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415f0f70 con 0x7f8cdc0db040 2024-09-13T06:10:19.642 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.635+0000 7f8cead4d640 1 -- 172.21.15.194:0/146984335 <== osd.2 v2:172.21.15.194:6800/815615585 22 ==== osd_op_reply(149 foo.buckets [call] v35'37 uv37 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f8cd4049040 con 0x7f8cdc0db040 2024-09-13T06:10:19.642 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.635+0000 7f8ceda3e980 10 cache get: name=default.rgw.meta+root+myfoo : hit (requested=0x11, cached=0x11) 2024-09-13T06:10:19.642 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.639+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:150 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415f0f70 con 0x7f8cdc0db040 2024-09-13T06:10:19.642 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.639+0000 7f8cead4d640 1 -- 172.21.15.194:0/146984335 <== osd.2 v2:172.21.15.194:6800/815615585 23 ==== osd_op_reply(150 myfoo [call,call,delete] v35'38 uv38 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7f8cd4049040 con 0x7f8cdc0db040 2024-09-13T06:10:19.642 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.639+0000 7f8ceda3e980 10 removing default.rgw.meta+root+myfoo from cache 2024-09-13T06:10:19.642 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.639+0000 7f8ceda3e980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-13T06:10:19.642 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.639+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:151 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94670766009280 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a415f0f70 con 0x7f8cd400f3d0 2024-09-13T06:10:19.643 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.639+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.0 v2:172.21.15.120:6800/1923744619 38 ==== watch-notify(notify (1) cookie 94670765680544 notify 150323855385 ret 0) ==== 191+0+0 (crc 0 0 0) 0x561a415e9fe0 con 0x7f8cd400f3d0 2024-09-13T06:10:19.643 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.639+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.0 v2:172.21.15.120:6800/1923744619 39 ==== osd_op_reply(151 notify.6 [notify cookie 94670766009280 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8ce403d060 con 0x7f8cd400f3d0 2024-09-13T06:10:19.643 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.639+0000 7f8bceffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855385 cookie 94670765680544 notifier 4647 bl.length()=149 2024-09-13T06:10:19.643 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.639+0000 7f8bceffd640 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:152 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f8bb0003d70 con 0x7f8cd400f3d0 2024-09-13T06:10:19.643 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.639+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.0 v2:172.21.15.120:6800/1923744619 40 ==== osd_op_reply(152 notify.6 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ce403d060 con 0x7f8cd400f3d0 2024-09-13T06:10:19.643 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.639+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.0 v2:172.21.15.120:6800/1923744619 41 ==== watch-notify(notify_complete (2) cookie 94670766009280 notify 150323855385 ret 0) ==== 42+0+48 (crc 0 0 0) 0x561a415cb9f0 con 0x7f8cd400f3d0 2024-09-13T06:10:19.643 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.639+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:153 8.19 8:9bd960cc:root::.bucket.meta.myfoo%3a52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a4160ebc0 con 0x561a415af770 2024-09-13T06:10:19.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.643+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.1 v2:172.21.15.194:6808/3135444559 49 ==== osd_op_reply(153 .bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5 [call,call,delete] v35'4 uv4 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7f8ce403d060 con 0x561a415af770 2024-09-13T06:10:19.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.643+0000 7f8ceda3e980 10 removing default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5 from cache 2024-09-13T06:10:19.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.643+0000 7f8ceda3e980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5, ofs0, ns] 2024-09-13T06:10:19.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.643+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:154 7.9 7:93e5b521:::notify.7:head [notify cookie 94670766372304 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a4160ebc0 con 0x7f8cd400f3d0 2024-09-13T06:10:19.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.643+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.0 v2:172.21.15.120:6800/1923744619 42 ==== watch-notify(notify (1) cookie 94670765679344 notify 150323855386 ret 0) ==== 248+0+0 (crc 0 0 0) 0x561a415cb9f0 con 0x7f8cd400f3d0 2024-09-13T06:10:19.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.643+0000 7f8bceffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855386 cookie 94670765679344 notifier 4647 bl.length()=206 2024-09-13T06:10:19.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.643+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.0 v2:172.21.15.120:6800/1923744619 43 ==== osd_op_reply(154 notify.7 [notify cookie 94670766372304 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8ce403d060 con 0x7f8cd400f3d0 2024-09-13T06:10:19.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.643+0000 7f8bceffd640 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:155 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f8bb0003d70 con 0x7f8cd400f3d0 2024-09-13T06:10:19.645 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.643+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.0 v2:172.21.15.120:6800/1923744619 44 ==== watch-notify(notify_complete (2) cookie 94670766372304 notify 150323855386 ret 0) ==== 42+0+48 (crc 0 0 0) 0x561a415cb7e0 con 0x7f8cd400f3d0 2024-09-13T06:10:19.645 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.643+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.0 v2:172.21.15.120:6800/1923744619 45 ==== osd_op_reply(155 notify.7 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ce403d060 con 0x7f8cd400f3d0 2024-09-13T06:10:19.646 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.643+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:156 4.11 4:8a3e4813:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a4160ebc0 con 0x7f8cd400f3d0 2024-09-13T06:10:19.646 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.643+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:157 4.20 4:06583eea:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415ea760 con 0x561a415af770 2024-09-13T06:10:19.646 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.643+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:158 4.1d 4:bafcf12c:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a41665920 con 0x561a415b4160 2024-09-13T06:10:19.646 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.643+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:159 4.3b 4:df668498:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a4160ebc0 con 0x561a415b4160 2024-09-13T06:10:19.646 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.643+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:160 4.38 4:1f4de9b6:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415ea760 con 0x561a415af770 2024-09-13T06:10:19.646 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.643+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:161 4.33 4:ce9bf92f:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a41665920 con 0x7f8cd400f3d0 2024-09-13T06:10:19.646 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.643+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:162 4.23 4:c484c9d6:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a4160ebc0 con 0x7f8cd400f3d0 2024-09-13T06:10:19.646 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.643+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:163 4.35 4:ad9c7c1e:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415ea760 con 0x561a415af770 2024-09-13T06:10:19.646 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.643+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:164 4.11 4:8af5775c:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415eb0d0 con 0x7f8cd400f3d0 2024-09-13T06:10:19.646 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.643+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:165 4.35 4:af6f7aeb:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a41665920 con 0x561a415af770 2024-09-13T06:10:19.646 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.643+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:166 4.31 4:8ee99d93:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415ebe90 con 0x561a415af770 2024-09-13T06:10:19.647 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.647+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.1 v2:172.21.15.194:6808/3135444559 50 ==== osd_op_reply(166 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.10 [delete] v35'14 uv14 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f8ce403d060 con 0x561a415af770 2024-09-13T06:10:19.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.647+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.1 v2:172.21.15.194:6808/3135444559 51 ==== osd_op_reply(160 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.4 [delete] v35'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f8ce403d060 con 0x561a415af770 2024-09-13T06:10:19.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.647+0000 7f8ceb54e640 1 -- 172.21.15.194:0/146984335 <== osd.3 v2:172.21.15.194:6816/96632515 43 ==== osd_op_reply(158 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.2 [delete] v35'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f8cdc0f4070 con 0x561a415b4160 2024-09-13T06:10:19.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.647+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.0 v2:172.21.15.120:6800/1923744619 46 ==== osd_op_reply(156 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.0 [delete] v35'9 uv9 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f8ce403d060 con 0x7f8cd400f3d0 2024-09-13T06:10:19.649 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.647+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.0 v2:172.21.15.120:6800/1923744619 47 ==== osd_op_reply(161 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.5 [delete] v35'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f8ce403d060 con 0x7f8cd400f3d0 2024-09-13T06:10:19.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.647+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.0 v2:172.21.15.120:6800/1923744619 48 ==== osd_op_reply(162 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.6 [delete] v35'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f8ce403d060 con 0x7f8cd400f3d0 2024-09-13T06:10:19.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.647+0000 7f8ceb54e640 1 -- 172.21.15.194:0/146984335 <== osd.3 v2:172.21.15.194:6816/96632515 44 ==== osd_op_reply(159 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.3 [delete] v35'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f8cdc0f4070 con 0x561a415b4160 2024-09-13T06:10:19.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.647+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.0 v2:172.21.15.120:6800/1923744619 49 ==== osd_op_reply(164 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.8 [delete] v35'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f8ce403d060 con 0x7f8cd400f3d0 2024-09-13T06:10:19.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.647+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.1 v2:172.21.15.194:6808/3135444559 52 ==== osd_op_reply(157 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.1 [delete] v35'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f8ce403d060 con 0x561a415af770 2024-09-13T06:10:19.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.647+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.1 v2:172.21.15.194:6808/3135444559 53 ==== osd_op_reply(163 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.7 [delete] v35'7 uv7 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f8ce403d060 con 0x561a415af770 2024-09-13T06:10:19.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.647+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.1 v2:172.21.15.194:6808/3135444559 54 ==== osd_op_reply(165 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5.9 [delete] v35'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f8ce403d060 con 0x561a415af770 2024-09-13T06:10:19.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.647+0000 7f8ceda3e980 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5 : miss 2024-09-13T06:10:19.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.647+0000 7f8ceda3e980 20 rados->read ofs=0 len=0 2024-09-13T06:10:19.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.647+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:167 6.13 6:cd5db552:::pubsub..bucket.myfoo%2f52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a4160ebc0 con 0x7f8cd400f3d0 2024-09-13T06:10:19.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.647+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.0 v2:172.21.15.120:6800/1923744619 50 ==== osd_op_reply(167 pubsub..bucket.myfoo/52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f8ce403d060 con 0x7f8cd400f3d0 2024-09-13T06:10:19.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.647+0000 7f8ceda3e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:19.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.647+0000 7f8ceda3e980 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5 info.flags=0x0 2024-09-13T06:10:19.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.647+0000 7f8ceda3e980 10 adding default.rgw.log++pubsub..bucket.myfoo/52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5 to cache LRU end 2024-09-13T06:10:19.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.647+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:168 6.13 6:cd5db552:::pubsub..bucket.myfoo%2f52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415ea760 con 0x7f8cd400f3d0 2024-09-13T06:10:19.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.651+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.0 v2:172.21.15.120:6800/1923744619 51 ==== osd_op_reply(168 pubsub..bucket.myfoo/52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5 [delete] v35'28 uv24 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f8ce403d060 con 0x7f8cd400f3d0 2024-09-13T06:10:19.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.651+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:169 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415ea760 con 0x7f8cdc0db040 2024-09-13T06:10:19.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.651+0000 7f8cead4d640 1 -- 172.21.15.194:0/146984335 <== osd.2 v2:172.21.15.194:6800/815615585 24 ==== osd_op_reply(169 foo.buckets [call] v35'39 uv39 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f8cd4049040 con 0x7f8cdc0db040 2024-09-13T06:10:19.654 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.655+0000 7f8ba1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:10:19.654 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.655+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:170 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94670765683344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415ea760 con 0x561a415af770 2024-09-13T06:10:19.656 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.655+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.1 v2:172.21.15.194:6808/3135444559 55 ==== osd_op_reply(170 data_loggenerations_metadata [watch unwatch cookie 94670765683344] v35'186 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8ce403d060 con 0x561a415af770 2024-09-13T06:10:19.656 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.655+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:171 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94670765660880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415ea760 con 0x7f8cdc0db040 2024-09-13T06:10:19.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.655+0000 7f8cead4d640 1 -- 172.21.15.194:0/146984335 <== osd.2 v2:172.21.15.194:6800/815615585 25 ==== osd_op_reply(171 notify.0 [watch unwatch cookie 94670765660880] v35'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cd4049040 con 0x7f8cdc0db040 2024-09-13T06:10:19.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.655+0000 7f8ceda3e980 20 remove_watcher() i=0 2024-09-13T06:10:19.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.655+0000 7f8ceda3e980 2 removed watcher, disabling cache 2024-09-13T06:10:19.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.655+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:172 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94670765665216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415ea760 con 0x561a415af770 2024-09-13T06:10:19.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.659+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.1 v2:172.21.15.194:6808/3135444559 56 ==== osd_op_reply(172 notify.1 [watch unwatch cookie 94670765665216] v35'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ce403d060 con 0x561a415af770 2024-09-13T06:10:19.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.659+0000 7f8ceda3e980 20 remove_watcher() i=1 2024-09-13T06:10:19.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.659+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:173 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94670765666272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415ea760 con 0x561a415b4160 2024-09-13T06:10:19.661 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.659+0000 7f8ceb54e640 1 -- 172.21.15.194:0/146984335 <== osd.3 v2:172.21.15.194:6816/96632515 45 ==== osd_op_reply(173 notify.2 [watch unwatch cookie 94670765666272] v35'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cdc0f4070 con 0x561a415b4160 2024-09-13T06:10:19.661 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.659+0000 7f8ceda3e980 20 remove_watcher() i=2 2024-09-13T06:10:19.661 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.659+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:174 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94670765673824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415ea760 con 0x7f8cdc0db040 2024-09-13T06:10:19.662 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.663+0000 7f8cead4d640 1 -- 172.21.15.194:0/146984335 <== osd.2 v2:172.21.15.194:6800/815615585 26 ==== osd_op_reply(174 notify.3 [watch unwatch cookie 94670765673824] v35'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8cd4049040 con 0x7f8cdc0db040 2024-09-13T06:10:19.663 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.663+0000 7f8ceda3e980 20 remove_watcher() i=3 2024-09-13T06:10:19.663 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.663+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:175 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94670765678080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415ea760 con 0x561a415af770 2024-09-13T06:10:19.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.663+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.1 v2:172.21.15.194:6808/3135444559 57 ==== osd_op_reply(175 notify.4 [watch unwatch cookie 94670765678080] v35'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ce403d060 con 0x561a415af770 2024-09-13T06:10:19.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.663+0000 7f8ceda3e980 20 remove_watcher() i=4 2024-09-13T06:10:19.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.663+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:176 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94670765670048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415ea760 con 0x7f8cd400f3d0 2024-09-13T06:10:19.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.667+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.0 v2:172.21.15.120:6800/1923744619 52 ==== osd_op_reply(176 notify.5 [watch unwatch cookie 94670765670048] v35'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ce403d060 con 0x7f8cd400f3d0 2024-09-13T06:10:19.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.667+0000 7f8ceda3e980 20 remove_watcher() i=5 2024-09-13T06:10:19.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.667+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:177 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94670765680544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415ea760 con 0x7f8cd400f3d0 2024-09-13T06:10:19.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.667+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.0 v2:172.21.15.120:6800/1923744619 53 ==== osd_op_reply(177 notify.6 [watch unwatch cookie 94670765680544] v35'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ce403d060 con 0x7f8cd400f3d0 2024-09-13T06:10:19.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.667+0000 7f8ceda3e980 20 remove_watcher() i=6 2024-09-13T06:10:19.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.667+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:178 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94670765679344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a415ea760 con 0x7f8cd400f3d0 2024-09-13T06:10:19.672 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.671+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 <== osd.0 v2:172.21.15.120:6800/1923744619 54 ==== osd_op_reply(178 notify.7 [watch unwatch cookie 94670765679344] v35'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ce403d060 con 0x7f8cd400f3d0 2024-09-13T06:10:19.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.671+0000 7f8ceda3e980 20 remove_watcher() i=7 2024-09-13T06:10:19.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.671+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f8cd400f3d0 msgr2=0x7f8cd400f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:19.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.671+0000 7f8ceda3e980 1 --2- 172.21.15.194:0/146984335 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f8cd400f3d0 0x7f8cd400f7f0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:19.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.671+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x561a415af770 msgr2=0x561a415b1c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:19.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.671+0000 7f8ceda3e980 1 --2- 172.21.15.194:0/146984335 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x561a415af770 0x561a415b1c30 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:19.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.671+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f8cdc0db040 msgr2=0x7f8cdc110470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:19.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.671+0000 7f8ceda3e980 1 --2- 172.21.15.194:0/146984335 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f8cdc0db040 0x7f8cdc110470 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:19.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.671+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x561a415b4160 msgr2=0x561a415b6550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:19.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.671+0000 7f8ceda3e980 1 --2- 172.21.15.194:0/146984335 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x561a415b4160 0x561a415b6550 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:19.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.671+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8bb4034650 msgr2=0x7f8bb4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:19.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.671+0000 7f8ceda3e980 1 --2- 172.21.15.194:0/146984335 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8bb4034650 0x7f8bb4036b10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x561a415814b0 tx=0x7f8cd4011000 comp rx=0 tx=0).stop 2024-09-13T06:10:19.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.671+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561a4147e5d0 msgr2=0x561a415a47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:19.674 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.671+0000 7f8ceda3e980 1 --2- 172.21.15.194:0/146984335 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561a4147e5d0 0x561a415a47e0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc0ef000 tx=0x7f8cdc0e2ea0 comp rx=0 tx=0).stop 2024-09-13T06:10:19.674 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.671+0000 7f8cebd4f640 1 -- 172.21.15.194:0/146984335 reap_dead start 2024-09-13T06:10:19.674 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.671+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 shutdown_connections 2024-09-13T06:10:19.674 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.671+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 >> 172.21.15.194:0/146984335 conn(0x561a41597830 msgr2=0x561a41595900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:19.674 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.671+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 shutdown_connections 2024-09-13T06:10:19.674 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.671+0000 7f8ceda3e980 1 -- 172.21.15.194:0/146984335 wait complete. 2024-09-13T06:10:19.674 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.671+0000 7f8ceda3e980 1 -- 172.21.15.194:0/767877801 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8bc4034650 msgr2=0x7f8bc4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:19.674 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.671+0000 7f8ceda3e980 1 --2- 172.21.15.194:0/767877801 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8bc4034650 0x7f8bc4036b10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x561a41575420 tx=0x7f8cd4006000 comp rx=0 tx=0).stop 2024-09-13T06:10:19.674 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.671+0000 7f8ceda3e980 1 -- 172.21.15.194:0/767877801 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561a4158eb80 msgr2=0x561a4158efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:19.674 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.671+0000 7f8ceda3e980 1 --2- 172.21.15.194:0/767877801 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561a4158eb80 0x561a4158efa0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc0b3fd0 tx=0x7f8cdc0b3e40 comp rx=0 tx=0).stop 2024-09-13T06:10:19.674 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.671+0000 7f8ceda3e980 1 -- 172.21.15.194:0/767877801 shutdown_connections 2024-09-13T06:10:19.674 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.671+0000 7f8ceda3e980 1 --2- 172.21.15.194:0/767877801 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8bc4034650 0x7f8bc4036b10 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:19.674 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.671+0000 7f8ceda3e980 1 --2- 172.21.15.194:0/767877801 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561a4158eb80 0x561a4158efa0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:19.675 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.671+0000 7f8ceda3e980 1 -- 172.21.15.194:0/767877801 >> 172.21.15.194:0/767877801 conn(0x561a41583cd0 msgr2=0x561a41586750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:19.675 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.671+0000 7f8ceda3e980 1 -- 172.21.15.194:0/767877801 shutdown_connections 2024-09-13T06:10:19.675 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.671+0000 7f8ceda3e980 1 -- 172.21.15.194:0/767877801 wait complete. 2024-09-13T06:10:19.676 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.671+0000 7f8ceda3e980 1 -- 172.21.15.194:0/4008388495 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x561a414818c0 msgr2=0x561a41577ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:19.676 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.671+0000 7f8ceda3e980 1 --2- 172.21.15.194:0/4008388495 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x561a414818c0 0x561a41577ce0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:19.676 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.671+0000 7f8ceda3e980 1 -- 172.21.15.194:0/4008388495 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x561a4157e5d0 msgr2=0x561a415809c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:19.676 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.671+0000 7f8ceda3e980 1 --2- 172.21.15.194:0/4008388495 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x561a4157e5d0 0x561a415809c0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:19.676 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.671+0000 7f8ceda3e980 1 -- 172.21.15.194:0/4008388495 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x561a4157a520 msgr2=0x561a4157c9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:19.676 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.671+0000 7f8ceda3e980 1 --2- 172.21.15.194:0/4008388495 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x561a4157a520 0x561a4157c9e0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:19.676 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.671+0000 7f8ceda3e980 1 -- 172.21.15.194:0/4008388495 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8bd0034650 msgr2=0x7f8bd0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:19.676 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.671+0000 7f8ceda3e980 1 --2- 172.21.15.194:0/4008388495 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8bd0034650 0x7f8bd0036b10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8cd4001e20 tx=0x7f8cd40013a0 comp rx=0 tx=0).stop 2024-09-13T06:10:19.676 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.671+0000 7f8ceda3e980 1 -- 172.21.15.194:0/4008388495 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561a413f2ad0 msgr2=0x561a41570d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:19.676 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.671+0000 7f8ceda3e980 1 --2- 172.21.15.194:0/4008388495 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561a413f2ad0 0x561a41570d10 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc00a5c0 tx=0x7f8cdc0180e0 comp rx=0 tx=0).stop 2024-09-13T06:10:19.677 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.671+0000 7f8cebd4f640 1 -- 172.21.15.194:0/4008388495 reap_dead start 2024-09-13T06:10:19.677 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.671+0000 7f8ceda3e980 1 -- 172.21.15.194:0/4008388495 shutdown_connections 2024-09-13T06:10:19.677 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.671+0000 7f8ceda3e980 1 -- 172.21.15.194:0/4008388495 >> 172.21.15.194:0/4008388495 conn(0x561a41479070 msgr2=0x561a41564210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:19.677 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.671+0000 7f8ceda3e980 1 -- 172.21.15.194:0/4008388495 shutdown_connections 2024-09-13T06:10:19.677 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.671+0000 7f8ceda3e980 1 -- 172.21.15.194:0/4008388495 wait complete. 2024-09-13T06:10:19.684 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-09-13T06:10:19.684 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-09-13T06:10:19.685 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid foo --caps user=read 2024-09-13T06:10:19.764 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:10:19.765 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:10:19.766 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.763+0000 7f696fad7980 1 Processor -- start 2024-09-13T06:10:19.766 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.763+0000 7f696fad7980 1 -- start start 2024-09-13T06:10:19.766 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.763+0000 7f696fad7980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x5655371f6ea0 0x5655371f9290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.766 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.763+0000 7f696fad7980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x565537078ae0 con 0x565537164ad0 2024-09-13T06:10:19.766 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.763+0000 7f696fad7980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x56553709ce30 con 0x5655371f6ea0 2024-09-13T06:10:19.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.767+0000 7f696cde6640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x5655371f6ea0 0x5655371f9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.767+0000 7f696cde6640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x5655371f6ea0 0x5655371f9290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:50802/0 (socket says 172.21.15.194:50802) 2024-09-13T06:10:19.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.767+0000 7f696d5e7640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x565537164ad0 0x5655371f5780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:59092/0 (socket says 172.21.15.194:59092) 2024-09-13T06:10:19.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.767+0000 7f696cde6640 1 -- 172.21.15.194:0/1437429963 learned_addr learned my addr 172.21.15.194:0/1437429963 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:19.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.767+0000 7f696cde6640 1 -- 172.21.15.194:0/1437429963 >> v1:172.21.15.120:6789/0 conn(0x565537164ad0 legacy=0x5655371f5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:19.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.767+0000 7f696cde6640 1 -- 172.21.15.194:0/1437429963 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x565537164eb0 con 0x5655371f6ea0 2024-09-13T06:10:19.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.767+0000 7f696cde6640 1 --2- 172.21.15.194:0/1437429963 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5655371f6ea0 0x5655371f9290 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f695800a5c0 tx=0x7f695801b1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eee774b7ffa5ac61 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.767+0000 7f6967fff640 1 -- 172.21.15.194:0/1437429963 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69580af070 con 0x5655371f6ea0 2024-09-13T06:10:19.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.767+0000 7f6967fff640 1 -- 172.21.15.194:0/1437429963 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69580aa530 con 0x5655371f6ea0 2024-09-13T06:10:19.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.767+0000 7f6967fff640 1 -- 172.21.15.194:0/1437429963 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69580aa830 con 0x5655371f6ea0 2024-09-13T06:10:19.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.771+0000 7f696fad7980 1 -- 172.21.15.194:0/1437429963 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5655371f6ea0 msgr2=0x5655371f9290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:19.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.771+0000 7f696fad7980 1 --2- 172.21.15.194:0/1437429963 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5655371f6ea0 0x5655371f9290 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f695800a5c0 tx=0x7f695801b1d0 comp rx=0 tx=0).stop 2024-09-13T06:10:19.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.771+0000 7f696fad7980 1 -- 172.21.15.194:0/1437429963 shutdown_connections 2024-09-13T06:10:19.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.771+0000 7f696fad7980 1 --2- 172.21.15.194:0/1437429963 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5655371f6ea0 0x5655371f9290 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:19.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.771+0000 7f696fad7980 1 -- 172.21.15.194:0/1437429963 >> 172.21.15.194:0/1437429963 conn(0x5655371eb070 msgr2=0x5655371ed490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:19.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.771+0000 7f696fad7980 1 -- 172.21.15.194:0/1437429963 shutdown_connections 2024-09-13T06:10:19.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.771+0000 7f696fad7980 1 -- 172.21.15.194:0/1437429963 wait complete. 2024-09-13T06:10:19.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.783+0000 7f696fad7980 1 Processor -- start 2024-09-13T06:10:19.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.783+0000 7f696fad7980 1 -- start start 2024-09-13T06:10:19.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.787+0000 7f696fad7980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x565537164ad0 0x5655372ddcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.787+0000 7f696fad7980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x56553709e200 con 0x565537164ad0 2024-09-13T06:10:19.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.787+0000 7f696d5e7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x565537164ad0 0x5655372ddcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.787+0000 7f696d5e7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x565537164ad0 0x5655372ddcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:50808/0 (socket says 172.21.15.194:50808) 2024-09-13T06:10:19.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.787+0000 7f696d5e7640 1 -- 172.21.15.194:0/2177014024 learned_addr learned my addr 172.21.15.194:0/2177014024 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:19.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.787+0000 7f696d5e7640 1 -- 172.21.15.194:0/2177014024 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5655372de2a0 con 0x565537164ad0 2024-09-13T06:10:19.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.787+0000 7f696d5e7640 1 --2- 172.21.15.194:0/2177014024 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x565537164ad0 0x5655372ddcd0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f6960006600 tx=0x7f6960006ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36420ba9fb101818 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.787+0000 7f685b606640 1 -- 172.21.15.194:0/2177014024 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6960003460 con 0x565537164ad0 2024-09-13T06:10:19.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.787+0000 7f685b606640 1 -- 172.21.15.194:0/2177014024 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6960003600 con 0x565537164ad0 2024-09-13T06:10:19.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.787+0000 7f685b606640 1 -- 172.21.15.194:0/2177014024 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6960003920 con 0x565537164ad0 2024-09-13T06:10:19.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.787+0000 7f696fad7980 1 -- 172.21.15.194:0/2177014024 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x565537164ad0 msgr2=0x5655372ddcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:19.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.787+0000 7f696fad7980 1 --2- 172.21.15.194:0/2177014024 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x565537164ad0 0x5655372ddcd0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f6960006600 tx=0x7f6960006ac0 comp rx=0 tx=0).stop 2024-09-13T06:10:19.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.787+0000 7f696fad7980 1 -- 172.21.15.194:0/2177014024 shutdown_connections 2024-09-13T06:10:19.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.787+0000 7f696fad7980 1 --2- 172.21.15.194:0/2177014024 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x565537164ad0 0x5655372ddcd0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:19.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.787+0000 7f696fad7980 1 -- 172.21.15.194:0/2177014024 >> 172.21.15.194:0/2177014024 conn(0x5655371eb070 msgr2=0x5655372d9900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:19.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.787+0000 7f696fad7980 1 -- 172.21.15.194:0/2177014024 shutdown_connections 2024-09-13T06:10:19.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.787+0000 7f696fad7980 1 -- 172.21.15.194:0/2177014024 wait complete. 2024-09-13T06:10:19.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.787+0000 7f696fad7980 1 Processor -- start 2024-09-13T06:10:19.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.787+0000 7f696fad7980 1 -- start start 2024-09-13T06:10:19.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.787+0000 7f696fad7980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x565537164ad0 0x5655372e50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.787+0000 7f696fad7980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5655371fc260 con 0x565537164ad0 2024-09-13T06:10:19.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.787+0000 7f696d5e7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x565537164ad0 0x5655372e50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.787+0000 7f696d5e7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x565537164ad0 0x5655372e50f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:50820/0 (socket says 172.21.15.194:50820) 2024-09-13T06:10:19.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.787+0000 7f696d5e7640 1 -- 172.21.15.194:0/2968941895 learned_addr learned my addr 172.21.15.194:0/2968941895 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:19.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.791+0000 7f696d5e7640 1 -- 172.21.15.194:0/2968941895 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5655372e5630 con 0x565537164ad0 2024-09-13T06:10:19.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.791+0000 7f696d5e7640 1 --2- 172.21.15.194:0/2968941895 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x565537164ad0 0x5655372e50f0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f6960000f90 tx=0x7f6960001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.791+0000 7f6859e03640 1 -- 172.21.15.194:0/2968941895 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6960013630 con 0x565537164ad0 2024-09-13T06:10:19.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.791+0000 7f696fad7980 1 -- 172.21.15.194:0/2968941895 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5655372e58c0 con 0x565537164ad0 2024-09-13T06:10:19.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.791+0000 7f6859e03640 1 -- 172.21.15.194:0/2968941895 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6960023070 con 0x565537164ad0 2024-09-13T06:10:19.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.791+0000 7f6859e03640 1 -- 172.21.15.194:0/2968941895 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6960013940 con 0x565537164ad0 2024-09-13T06:10:19.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.791+0000 7f696fad7980 1 -- 172.21.15.194:0/2968941895 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5655372e85a0 con 0x565537164ad0 2024-09-13T06:10:19.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.791+0000 7f6859e03640 1 -- 172.21.15.194:0/2968941895 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6960010070 con 0x565537164ad0 2024-09-13T06:10:19.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.791+0000 7f6859e03640 1 --2- 172.21.15.194:0/2968941895 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6854034650 0x7f6854036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.791+0000 7f6859e03640 1 -- 172.21.15.194:0/2968941895 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f6960049df0 con 0x565537164ad0 2024-09-13T06:10:19.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.791+0000 7f696cde6640 1 --2- 172.21.15.194:0/2968941895 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6854034650 0x7f6854036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.791+0000 7f696fad7980 1 --2- 172.21.15.194:0/2968941895 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5655371f6ea0 0x5655372ec0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.791+0000 7f696fad7980 1 -- 172.21.15.194:0/2968941895 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5655372ec730 con 0x5655371f6ea0 2024-09-13T06:10:19.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.791+0000 7f696dde8640 1 --2- 172.21.15.194:0/2968941895 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5655371f6ea0 0x5655372ec0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.794 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.791+0000 7f696cde6640 1 --2- 172.21.15.194:0/2968941895 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6854034650 0x7f6854036b10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f69580ac000 tx=0x7f69580a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.794 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.791+0000 7f696dde8640 1 --2- 172.21.15.194:0/2968941895 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5655371f6ea0 0x5655372ec0c0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.791+0000 7f696dde8640 1 -- 172.21.15.194:0/2968941895 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f69680083f0 con 0x5655371f6ea0 2024-09-13T06:10:19.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.791+0000 7f696fad7980 1 -- 172.21.15.194:0/2968941895 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5655372e97c0 con 0x5655371f6ea0 2024-09-13T06:10:19.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.791+0000 7f696dde8640 1 -- 172.21.15.194:0/2968941895 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f69680083f0 con 0x5655371f6ea0 2024-09-13T06:10:19.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.791+0000 7f696fad7980 1 --2- 172.21.15.194:0/2968941895 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5655372eea60 0x5655372f0e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.791+0000 7f696fad7980 1 -- 172.21.15.194:0/2968941895 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5655372f1520 con 0x5655372eea60 2024-09-13T06:10:19.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.795+0000 7f696d5e7640 1 --2- 172.21.15.194:0/2968941895 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5655372eea60 0x5655372f0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.795+0000 7f696d5e7640 1 --2- 172.21.15.194:0/2968941895 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5655372eea60 0x5655372f0e50 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.795+0000 7f696d5e7640 1 -- 172.21.15.194:0/2968941895 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f696000f030 con 0x5655372eea60 2024-09-13T06:10:19.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.795+0000 7f696fad7980 1 -- 172.21.15.194:0/2968941895 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5655372ed900 con 0x5655371f6ea0 2024-09-13T06:10:19.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.795+0000 7f696dde8640 1 -- 172.21.15.194:0/2968941895 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f69680083f0 con 0x5655371f6ea0 2024-09-13T06:10:19.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.795+0000 7f696fad7980 1 --2- 172.21.15.194:0/2968941895 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5655372f2980 0x5655372f4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.795+0000 7f696fad7980 1 -- 172.21.15.194:0/2968941895 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5655372f5470 con 0x5655372f2980 2024-09-13T06:10:19.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.795+0000 7f696cde6640 1 --2- 172.21.15.194:0/2968941895 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5655372f2980 0x5655372f4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.795+0000 7f696cde6640 1 --2- 172.21.15.194:0/2968941895 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5655372f2980 0x5655372f4d70 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.795+0000 7f696cde6640 1 -- 172.21.15.194:0/2968941895 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f69580b2040 con 0x5655372f2980 2024-09-13T06:10:19.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.795+0000 7f696fad7980 1 Processor -- start 2024-09-13T06:10:19.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.795+0000 7f696fad7980 1 -- start start 2024-09-13T06:10:19.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.795+0000 7f696fad7980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x565537302f40 0x565537303360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.795+0000 7f696fad7980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5655370f7800 con 0x565537302f40 2024-09-13T06:10:19.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.795+0000 7f696d5e7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x565537302f40 0x565537303360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.795+0000 7f696d5e7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x565537302f40 0x565537303360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:50832/0 (socket says 172.21.15.194:50832) 2024-09-13T06:10:19.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.795+0000 7f696d5e7640 1 -- 172.21.15.194:0/3947394857 learned_addr learned my addr 172.21.15.194:0/3947394857 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:19.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.795+0000 7f696d5e7640 1 -- 172.21.15.194:0/3947394857 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5655373038a0 con 0x565537302f40 2024-09-13T06:10:19.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.799+0000 7f696d5e7640 1 --2- 172.21.15.194:0/3947394857 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x565537302f40 0x565537303360 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f6960028b90 tx=0x7f6960007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.799+0000 7f6852ffd640 1 -- 172.21.15.194:0/3947394857 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6960013d10 con 0x565537302f40 2024-09-13T06:10:19.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.799+0000 7f6852ffd640 1 -- 172.21.15.194:0/3947394857 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6960019040 con 0x565537302f40 2024-09-13T06:10:19.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.799+0000 7f696fad7980 1 -- 172.21.15.194:0/3947394857 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x565537303b30 con 0x565537302f40 2024-09-13T06:10:19.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.799+0000 7f6852ffd640 1 -- 172.21.15.194:0/3947394857 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6960041440 con 0x565537302f40 2024-09-13T06:10:19.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.799+0000 7f696fad7980 1 -- 172.21.15.194:0/3947394857 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5655373067b0 con 0x565537302f40 2024-09-13T06:10:19.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.803+0000 7f6852ffd640 1 -- 172.21.15.194:0/3947394857 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f696004d020 con 0x565537302f40 2024-09-13T06:10:19.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.803+0000 7f6852ffd640 1 --2- 172.21.15.194:0/3947394857 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6844034650 0x7f6844036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.803+0000 7f6852ffd640 1 -- 172.21.15.194:0/3947394857 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f696004b020 con 0x565537302f40 2024-09-13T06:10:19.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.803+0000 7f696cde6640 1 --2- 172.21.15.194:0/3947394857 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6844034650 0x7f6844036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.803+0000 7f696fad7980 1 Processor -- start 2024-09-13T06:10:19.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.803+0000 7f696fad7980 1 -- start start 2024-09-13T06:10:19.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.803+0000 7f696fad7980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56553730fa60 0x56553730fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.803+0000 7f696fad7980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5655372de620 con 0x56553730fa60 2024-09-13T06:10:19.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.803+0000 7f696cde6640 1 --2- 172.21.15.194:0/3947394857 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6844034650 0x7f6844036b10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x5655372ed010 tx=0x7f6958005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.803+0000 7f696d5e7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56553730fa60 0x56553730fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.803+0000 7f696d5e7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56553730fa60 0x56553730fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:50842/0 (socket says 172.21.15.194:50842) 2024-09-13T06:10:19.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.803+0000 7f696d5e7640 1 -- 172.21.15.194:0/378016405 learned_addr learned my addr 172.21.15.194:0/378016405 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:19.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.803+0000 7f696d5e7640 1 -- 172.21.15.194:0/378016405 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565537310410 con 0x56553730fa60 2024-09-13T06:10:19.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.803+0000 7f696d5e7640 1 --2- 172.21.15.194:0/378016405 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56553730fa60 0x56553730fe40 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f69600416d0 tx=0x7f696000f540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dcb41e57f8765 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.803+0000 7f6850ff9640 1 -- 172.21.15.194:0/378016405 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6960052100 con 0x56553730fa60 2024-09-13T06:10:19.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.803+0000 7f6850ff9640 1 -- 172.21.15.194:0/378016405 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f696005f030 con 0x56553730fa60 2024-09-13T06:10:19.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.803+0000 7f6850ff9640 1 -- 172.21.15.194:0/378016405 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f696000bd10 con 0x56553730fa60 2024-09-13T06:10:19.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.803+0000 7f696fad7980 1 -- 172.21.15.194:0/378016405 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56553730fa60 msgr2=0x56553730fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:19.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.803+0000 7f696fad7980 1 --2- 172.21.15.194:0/378016405 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56553730fa60 0x56553730fe40 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f69600416d0 tx=0x7f696000f540 comp rx=0 tx=0).stop 2024-09-13T06:10:19.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.803+0000 7f696fad7980 1 -- 172.21.15.194:0/378016405 shutdown_connections 2024-09-13T06:10:19.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.803+0000 7f696fad7980 1 --2- 172.21.15.194:0/378016405 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56553730fa60 0x56553730fe40 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:19.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.803+0000 7f696fad7980 1 -- 172.21.15.194:0/378016405 >> 172.21.15.194:0/378016405 conn(0x56553730be40 msgr2=0x565537309f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:19.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.803+0000 7f696fad7980 1 -- 172.21.15.194:0/378016405 shutdown_connections 2024-09-13T06:10:19.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.803+0000 7f696fad7980 1 -- 172.21.15.194:0/378016405 wait complete. 2024-09-13T06:10:19.808 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.807+0000 7f696fad7980 1 Processor -- start 2024-09-13T06:10:19.808 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.807+0000 7f696fad7980 1 -- start start 2024-09-13T06:10:19.808 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.807+0000 7f696fad7980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56553730fa60 0x565537316c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.808 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.807+0000 7f696fad7980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5655373108b0 con 0x56553730fa60 2024-09-13T06:10:19.808 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.807+0000 7f696d5e7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56553730fa60 0x565537316c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.807+0000 7f696d5e7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56553730fa60 0x565537316c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:50846/0 (socket says 172.21.15.194:50846) 2024-09-13T06:10:19.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.807+0000 7f696d5e7640 1 -- 172.21.15.194:0/2016444085 learned_addr learned my addr 172.21.15.194:0/2016444085 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:19.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.807+0000 7f696d5e7640 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5655373171d0 con 0x56553730fa60 2024-09-13T06:10:19.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.807+0000 7f696d5e7640 1 --2- 172.21.15.194:0/2016444085 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56553730fa60 0x565537316c90 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f69600416d0 tx=0x7f696002eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.807+0000 7f6842ffd640 1 -- 172.21.15.194:0/2016444085 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f696004fce0 con 0x56553730fa60 2024-09-13T06:10:19.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.807+0000 7f696fad7980 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5655373171d0 con 0x56553730fa60 2024-09-13T06:10:19.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.807+0000 7f696fad7980 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5655373171d0 con 0x56553730fa60 2024-09-13T06:10:19.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.807+0000 7f6842ffd640 1 -- 172.21.15.194:0/2016444085 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f696000bd10 con 0x56553730fa60 2024-09-13T06:10:19.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.807+0000 7f6842ffd640 1 -- 172.21.15.194:0/2016444085 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6960049b30 con 0x56553730fa60 2024-09-13T06:10:19.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.807+0000 7f6842ffd640 1 -- 172.21.15.194:0/2016444085 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6960006fc0 con 0x56553730fa60 2024-09-13T06:10:19.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.807+0000 7f6842ffd640 1 --2- 172.21.15.194:0/2016444085 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6838034650 0x7f6838036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.807+0000 7f6842ffd640 1 -- 172.21.15.194:0/2016444085 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f696006b070 con 0x56553730fa60 2024-09-13T06:10:19.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.807+0000 7f696cde6640 1 --2- 172.21.15.194:0/2016444085 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6838034650 0x7f6838036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.807+0000 7f696fad7980 20 rados->read ofs=0 len=0 2024-09-13T06:10:19.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.807+0000 7f696fad7980 1 --2- 172.21.15.194:0/2016444085 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x565537321cb0 0x565537324170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.807+0000 7f696fad7980 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5655373248c0 con 0x565537321cb0 2024-09-13T06:10:19.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.807+0000 7f696dde8640 1 --2- 172.21.15.194:0/2016444085 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x565537321cb0 0x565537324170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.811+0000 7f696cde6640 1 --2- 172.21.15.194:0/2016444085 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6838034650 0x7f6838036b10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6958000c10 tx=0x7f69580b8040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.811+0000 7f696dde8640 1 --2- 172.21.15.194:0/2016444085 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x565537321cb0 0x565537324170 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.811+0000 7f696dde8640 1 -- 172.21.15.194:0/2016444085 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f69680083f0 con 0x565537321cb0 2024-09-13T06:10:19.814 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.811+0000 7f696fad7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:19.814 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.811+0000 7f696fad7980 20 realm 2024-09-13T06:10:19.814 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.811+0000 7f696fad7980 20 rados->read ofs=0 len=0 2024-09-13T06:10:19.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.811+0000 7f696fad7980 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565537324cd0 con 0x565537321cb0 2024-09-13T06:10:19.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.811+0000 7f696dde8640 1 -- 172.21.15.194:0/2016444085 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f69680083f0 con 0x565537321cb0 2024-09-13T06:10:19.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.811+0000 7f696fad7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:19.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.811+0000 7f696fad7980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:10:19.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.811+0000 7f696fad7980 20 rados->read ofs=0 len=0 2024-09-13T06:10:19.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.811+0000 7f696fad7980 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5655373255a0 con 0x565537321cb0 2024-09-13T06:10:19.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.811+0000 7f696dde8640 1 -- 172.21.15.194:0/2016444085 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f69680083f0 con 0x565537321cb0 2024-09-13T06:10:19.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.811+0000 7f696fad7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:19.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.811+0000 7f696fad7980 20 rados->read ofs=0 len=0 2024-09-13T06:10:19.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.811+0000 7f696fad7980 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565537325940 con 0x565537321cb0 2024-09-13T06:10:19.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.811+0000 7f696dde8640 1 -- 172.21.15.194:0/2016444085 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f69680083f0 con 0x565537321cb0 2024-09-13T06:10:19.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.811+0000 7f696fad7980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:10:19.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.811+0000 7f696fad7980 20 rados->read ofs=0 len=0 2024-09-13T06:10:19.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.811+0000 7f696fad7980 1 --2- 172.21.15.194:0/2016444085 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5655373266a0 0x565537328a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.811+0000 7f696fad7980 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5655373290a0 con 0x5655373266a0 2024-09-13T06:10:19.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.811+0000 7f696d5e7640 1 --2- 172.21.15.194:0/2016444085 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5655373266a0 0x565537328a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.811+0000 7f696d5e7640 1 --2- 172.21.15.194:0/2016444085 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5655373266a0 0x565537328a90 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.811+0000 7f696d5e7640 1 -- 172.21.15.194:0/2016444085 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6960075020 con 0x5655373266a0 2024-09-13T06:10:19.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.811+0000 7f696fad7980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:10:19.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.811+0000 7f696fad7980 20 searching for the correct realm 2024-09-13T06:10:19.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.811+0000 7f696fad7980 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56553732a970 con 0x5655373266a0 2024-09-13T06:10:19.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.811+0000 7f696d5e7640 1 -- 172.21.15.194:0/2016444085 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6960075020 con 0x5655373266a0 2024-09-13T06:10:19.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.811+0000 7f696d5e7640 1 --2- 172.21.15.194:0/2016444085 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f6960064880 0x7f6960084770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.811+0000 7f696d5e7640 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56553732a970 con 0x7f6960064880 2024-09-13T06:10:19.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.811+0000 7f696cde6640 1 --2- 172.21.15.194:0/2016444085 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f6960064880 0x7f6960084770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.811+0000 7f696cde6640 1 --2- 172.21.15.194:0/2016444085 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f6960064880 0x7f6960084770 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.811+0000 7f696cde6640 1 -- 172.21.15.194:0/2016444085 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f69580d7070 con 0x7f6960064880 2024-09-13T06:10:19.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.811+0000 7f696cde6640 1 --2- 172.21.15.194:0/2016444085 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f69580cc040 0x7f69580d9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.811+0000 7f696cde6640 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56553732a970 con 0x7f69580cc040 2024-09-13T06:10:19.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.815+0000 7f696dde8640 1 --2- 172.21.15.194:0/2016444085 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f69580cc040 0x7f69580d9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.815+0000 7f696dde8640 1 --2- 172.21.15.194:0/2016444085 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f69580cc040 0x7f69580d9410 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.815+0000 7f696dde8640 1 -- 172.21.15.194:0/2016444085 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69680083f0 con 0x7f69580cc040 2024-09-13T06:10:19.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.815+0000 7f696dde8640 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565537325940 con 0x565537321cb0 2024-09-13T06:10:19.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.815+0000 7f696dde8640 1 -- 172.21.15.194:0/2016444085 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69680083f0 con 0x565537321cb0 2024-09-13T06:10:19.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.815+0000 7f696dde8640 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565537325940 con 0x565537321cb0 2024-09-13T06:10:19.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.815+0000 7f696dde8640 1 -- 172.21.15.194:0/2016444085 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69680083f0 con 0x565537321cb0 2024-09-13T06:10:19.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.815+0000 7f696dde8640 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565537325940 con 0x7f69580cc040 2024-09-13T06:10:19.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.815+0000 7f696dde8640 1 -- 172.21.15.194:0/2016444085 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69680083f0 con 0x7f69580cc040 2024-09-13T06:10:19.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.815+0000 7f696dde8640 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565537325940 con 0x7f69580cc040 2024-09-13T06:10:19.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.815+0000 7f696dde8640 1 -- 172.21.15.194:0/2016444085 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69680083f0 con 0x7f69580cc040 2024-09-13T06:10:19.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.815+0000 7f696dde8640 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565537325940 con 0x7f6960064880 2024-09-13T06:10:19.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.819+0000 7f696cde6640 1 -- 172.21.15.194:0/2016444085 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69580e3040 con 0x7f6960064880 2024-09-13T06:10:19.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.819+0000 7f696cde6640 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565537325940 con 0x5655373266a0 2024-09-13T06:10:19.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.819+0000 7f696d5e7640 1 -- 172.21.15.194:0/2016444085 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6960075020 con 0x5655373266a0 2024-09-13T06:10:19.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.819+0000 7f696d5e7640 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565537325940 con 0x565537321cb0 2024-09-13T06:10:19.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.819+0000 7f696dde8640 1 -- 172.21.15.194:0/2016444085 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69680083f0 con 0x565537321cb0 2024-09-13T06:10:19.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.819+0000 7f696dde8640 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565537325940 con 0x7f69580cc040 2024-09-13T06:10:19.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.819+0000 7f696dde8640 1 -- 172.21.15.194:0/2016444085 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69680083f0 con 0x7f69580cc040 2024-09-13T06:10:19.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.819+0000 7f696dde8640 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565537325940 con 0x565537321cb0 2024-09-13T06:10:19.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.819+0000 7f696dde8640 1 -- 172.21.15.194:0/2016444085 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69680083f0 con 0x565537321cb0 2024-09-13T06:10:19.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.819+0000 7f696dde8640 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565537325940 con 0x7f6960064880 2024-09-13T06:10:19.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.819+0000 7f696cde6640 1 -- 172.21.15.194:0/2016444085 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f69580e3040 con 0x7f6960064880 2024-09-13T06:10:19.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.819+0000 7f696cde6640 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565537325940 con 0x5655373266a0 2024-09-13T06:10:19.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.819+0000 7f696d5e7640 1 -- 172.21.15.194:0/2016444085 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6960075020 con 0x5655373266a0 2024-09-13T06:10:19.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.819+0000 7f696d5e7640 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565537325940 con 0x5655373266a0 2024-09-13T06:10:19.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.819+0000 7f696d5e7640 1 -- 172.21.15.194:0/2016444085 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6960075020 con 0x5655373266a0 2024-09-13T06:10:19.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.819+0000 7f696d5e7640 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565537325940 con 0x7f69580cc040 2024-09-13T06:10:19.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.819+0000 7f696dde8640 1 -- 172.21.15.194:0/2016444085 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69680083f0 con 0x7f69580cc040 2024-09-13T06:10:19.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.819+0000 7f696dde8640 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565537325940 con 0x5655373266a0 2024-09-13T06:10:19.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.819+0000 7f696d5e7640 1 -- 172.21.15.194:0/2016444085 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6960075020 con 0x5655373266a0 2024-09-13T06:10:19.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.819+0000 7f696d5e7640 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565537325940 con 0x5655373266a0 2024-09-13T06:10:19.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.819+0000 7f696d5e7640 1 -- 172.21.15.194:0/2016444085 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6960075020 con 0x5655373266a0 2024-09-13T06:10:19.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.823+0000 7f696d5e7640 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565537325940 con 0x565537321cb0 2024-09-13T06:10:19.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.823+0000 7f696dde8640 1 -- 172.21.15.194:0/2016444085 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69680083f0 con 0x565537321cb0 2024-09-13T06:10:19.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.823+0000 7f696dde8640 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565537325940 con 0x565537321cb0 2024-09-13T06:10:19.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.823+0000 7f696dde8640 1 -- 172.21.15.194:0/2016444085 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f69680083f0 con 0x565537321cb0 2024-09-13T06:10:19.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.823+0000 7f696dde8640 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565537325940 con 0x7f6960064880 2024-09-13T06:10:19.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.823+0000 7f696cde6640 1 -- 172.21.15.194:0/2016444085 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69580e3040 con 0x7f6960064880 2024-09-13T06:10:19.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.823+0000 7f696cde6640 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565537325940 con 0x5655373266a0 2024-09-13T06:10:19.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.823+0000 7f696d5e7640 1 -- 172.21.15.194:0/2016444085 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6960075020 con 0x5655373266a0 2024-09-13T06:10:19.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.823+0000 7f696d5e7640 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565537325940 con 0x7f6960064880 2024-09-13T06:10:19.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.823+0000 7f696cde6640 1 -- 172.21.15.194:0/2016444085 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69580e3040 con 0x7f6960064880 2024-09-13T06:10:19.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.823+0000 7f696cde6640 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565537325940 con 0x565537321cb0 2024-09-13T06:10:19.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.823+0000 7f696dde8640 1 -- 172.21.15.194:0/2016444085 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69680083f0 con 0x565537321cb0 2024-09-13T06:10:19.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.823+0000 7f696dde8640 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565537325940 con 0x7f69580cc040 2024-09-13T06:10:19.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.823+0000 7f696dde8640 1 -- 172.21.15.194:0/2016444085 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69680083f0 con 0x7f69580cc040 2024-09-13T06:10:19.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.823+0000 7f696dde8640 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565537325940 con 0x5655373266a0 2024-09-13T06:10:19.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.823+0000 7f696d5e7640 1 -- 172.21.15.194:0/2016444085 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6960075020 con 0x5655373266a0 2024-09-13T06:10:19.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.823+0000 7f696d5e7640 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565537325940 con 0x7f6960064880 2024-09-13T06:10:19.830 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.823+0000 7f696cde6640 1 -- 172.21.15.194:0/2016444085 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69580e3040 con 0x7f6960064880 2024-09-13T06:10:19.830 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.823+0000 7f696cde6640 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565537325940 con 0x7f6960064880 2024-09-13T06:10:19.830 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.823+0000 7f696cde6640 1 -- 172.21.15.194:0/2016444085 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69580e3040 con 0x7f6960064880 2024-09-13T06:10:19.830 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.823+0000 7f696cde6640 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565537325940 con 0x5655373266a0 2024-09-13T06:10:19.830 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.823+0000 7f696d5e7640 1 -- 172.21.15.194:0/2016444085 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6960092040 con 0x5655373266a0 2024-09-13T06:10:19.830 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.823+0000 7f696d5e7640 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565537325940 con 0x7f69580cc040 2024-09-13T06:10:19.830 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.827+0000 7f696dde8640 1 -- 172.21.15.194:0/2016444085 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69680083f0 con 0x7f69580cc040 2024-09-13T06:10:19.830 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.827+0000 7f696dde8640 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565537325940 con 0x565537321cb0 2024-09-13T06:10:19.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.827+0000 7f696dde8640 1 -- 172.21.15.194:0/2016444085 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f69680083f0 con 0x565537321cb0 2024-09-13T06:10:19.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.827+0000 7f696dde8640 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x565537325940 con 0x7f6960064880 2024-09-13T06:10:19.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.827+0000 7f696cde6640 1 -- 172.21.15.194:0/2016444085 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69580e3040 con 0x7f6960064880 2024-09-13T06:10:19.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.827+0000 7f696fad7980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:10:19.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.827+0000 7f696fad7980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:10:19.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.827+0000 7f696fad7980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:10:19.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.827+0000 7f696fad7980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:10:19.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.827+0000 7f696fad7980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:10:19.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.827+0000 7f696fad7980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:10:19.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.827+0000 7f696fad7980 20 rados->read ofs=0 len=0 2024-09-13T06:10:19.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.827+0000 7f696fad7980 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565537329a60 con 0x565537321cb0 2024-09-13T06:10:19.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.827+0000 7f696dde8640 1 -- 172.21.15.194:0/2016444085 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f69680083f0 con 0x565537321cb0 2024-09-13T06:10:19.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.827+0000 7f696fad7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:19.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.827+0000 7f696fad7980 20 rados->read ofs=0 len=0 2024-09-13T06:10:19.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.827+0000 7f696fad7980 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5655373296a0 con 0x565537321cb0 2024-09-13T06:10:19.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.827+0000 7f696dde8640 1 -- 172.21.15.194:0/2016444085 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f69680083f0 con 0x565537321cb0 2024-09-13T06:10:19.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.827+0000 7f696fad7980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:10:19.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.827+0000 7f696fad7980 20 rados->read ofs=0 len=0 2024-09-13T06:10:19.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.827+0000 7f696fad7980 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56553732a380 con 0x7f6960064880 2024-09-13T06:10:19.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.827+0000 7f696cde6640 1 -- 172.21.15.194:0/2016444085 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f69580e3040 con 0x7f6960064880 2024-09-13T06:10:19.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.827+0000 7f696fad7980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:10:19.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.827+0000 7f696fad7980 20 zone default found 2024-09-13T06:10:19.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.827+0000 7f696fad7980 4 Realm: () 2024-09-13T06:10:19.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.827+0000 7f696fad7980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:10:19.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.827+0000 7f696fad7980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:10:19.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.827+0000 7f696fad7980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:10:19.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.827+0000 7f696fad7980 20 zonegroup default 2024-09-13T06:10:19.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.827+0000 7f696fad7980 20 rados->read ofs=0 len=0 2024-09-13T06:10:19.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.827+0000 7f696fad7980 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56553732ada0 con 0x7f69580cc040 2024-09-13T06:10:19.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.827+0000 7f696dde8640 1 -- 172.21.15.194:0/2016444085 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f69680083f0 con 0x7f69580cc040 2024-09-13T06:10:19.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.827+0000 7f696fad7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:19.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.827+0000 7f696fad7980 20 rados->read ofs=0 len=0 2024-09-13T06:10:19.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.827+0000 7f696fad7980 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56553732c780 con 0x5655373266a0 2024-09-13T06:10:19.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.827+0000 7f696d5e7640 1 -- 172.21.15.194:0/2016444085 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6960092040 con 0x5655373266a0 2024-09-13T06:10:19.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.827+0000 7f696fad7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:19.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.827+0000 7f696fad7980 20 rados->read ofs=0 len=0 2024-09-13T06:10:19.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.827+0000 7f696fad7980 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56553732cb70 con 0x5655373266a0 2024-09-13T06:10:19.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.827+0000 7f696d5e7640 1 -- 172.21.15.194:0/2016444085 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6960092040 con 0x5655373266a0 2024-09-13T06:10:19.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.827+0000 7f696fad7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:19.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.827+0000 7f696fad7980 20 started sync module instance, tier type = 2024-09-13T06:10:19.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.827+0000 7f696fad7980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:10:19.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.827+0000 7f696fad7980 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56553732bc20 con 0x7f6960064880 2024-09-13T06:10:19.835 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.831+0000 7f696cde6640 1 -- 172.21.15.194:0/2016444085 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(44 notify.0 [create] v35'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69580e3040 con 0x7f6960064880 2024-09-13T06:10:19.835 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.831+0000 7f696fad7980 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94923998279536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56553732cfd0 con 0x7f6960064880 2024-09-13T06:10:19.835 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.831+0000 7f696fad7980 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56553732d820 con 0x565537321cb0 2024-09-13T06:10:19.835 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.831+0000 7f696cde6640 1 -- 172.21.15.194:0/2016444085 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94923998279536] v35'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69580e3040 con 0x7f6960064880 2024-09-13T06:10:19.835 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.831+0000 7f696dde8640 1 -- 172.21.15.194:0/2016444085 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v35'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69680083f0 con 0x565537321cb0 2024-09-13T06:10:19.835 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.831+0000 7f696fad7980 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94923998281744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56553732d880 con 0x565537321cb0 2024-09-13T06:10:19.835 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.831+0000 7f696fad7980 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56553732e370 con 0x5655373266a0 2024-09-13T06:10:19.836 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.835+0000 7f696d5e7640 1 -- 172.21.15.194:0/2016444085 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v35'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6960092040 con 0x5655373266a0 2024-09-13T06:10:19.836 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.835+0000 7f696fad7980 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94923998289472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56553732e330 con 0x5655373266a0 2024-09-13T06:10:19.836 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.835+0000 7f696fad7980 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56553732f2a0 con 0x7f6960064880 2024-09-13T06:10:19.836 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.835+0000 7f696dde8640 1 -- 172.21.15.194:0/2016444085 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94923998281744] v35'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69680083f0 con 0x565537321cb0 2024-09-13T06:10:19.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.835+0000 7f696cde6640 1 -- 172.21.15.194:0/2016444085 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(50 notify.3 [create] v35'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69580e3040 con 0x7f6960064880 2024-09-13T06:10:19.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.835+0000 7f696fad7980 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94923998286704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56553732f690 con 0x7f6960064880 2024-09-13T06:10:19.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.835+0000 7f696fad7980 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565537330050 con 0x565537321cb0 2024-09-13T06:10:19.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.835+0000 7f696d5e7640 1 -- 172.21.15.194:0/2016444085 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94923998289472] v35'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6960092040 con 0x5655373266a0 2024-09-13T06:10:19.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.839+0000 7f696cde6640 1 -- 172.21.15.194:0/2016444085 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94923998286704] v35'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69580e3040 con 0x7f6960064880 2024-09-13T06:10:19.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.839+0000 7f696dde8640 1 -- 172.21.15.194:0/2016444085 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v35'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69680083f0 con 0x565537321cb0 2024-09-13T06:10:19.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.839+0000 7f696fad7980 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94923998293424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56553732fba0 con 0x565537321cb0 2024-09-13T06:10:19.840 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.839+0000 7f696fad7980 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565537330430 con 0x7f69580cc040 2024-09-13T06:10:19.842 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.839+0000 7f696dde8640 1 -- 172.21.15.194:0/2016444085 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94923998293424] v35'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69680083f0 con 0x565537321cb0 2024-09-13T06:10:19.842 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.839+0000 7f696dde8640 1 -- 172.21.15.194:0/2016444085 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(54 notify.5 [create] v35'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69680083f0 con 0x7f69580cc040 2024-09-13T06:10:19.842 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.839+0000 7f696fad7980 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94923998291856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565537330050 con 0x7f69580cc040 2024-09-13T06:10:19.842 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.839+0000 7f696fad7980 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565537330d40 con 0x7f69580cc040 2024-09-13T06:10:19.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.843+0000 7f696dde8640 1 -- 172.21.15.194:0/2016444085 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(56 notify.6 [create] v35'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69680083f0 con 0x7f69580cc040 2024-09-13T06:10:19.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.843+0000 7f696dde8640 1 -- 172.21.15.194:0/2016444085 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94923998291856] v35'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69680083f0 con 0x7f69580cc040 2024-09-13T06:10:19.845 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.843+0000 7f696fad7980 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94923998300160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565537331150 con 0x7f69580cc040 2024-09-13T06:10:19.845 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.843+0000 7f696fad7980 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56553732fbe0 con 0x7f69580cc040 2024-09-13T06:10:19.846 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.843+0000 7f696dde8640 1 -- 172.21.15.194:0/2016444085 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94923998300160] v35'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69680083f0 con 0x7f69580cc040 2024-09-13T06:10:19.846 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.847+0000 7f696dde8640 1 -- 172.21.15.194:0/2016444085 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(58 notify.7 [create] v35'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69680083f0 con 0x7f69580cc040 2024-09-13T06:10:19.847 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.847+0000 7f696fad7980 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94923998296992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565537331740 con 0x7f69580cc040 2024-09-13T06:10:19.847 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.847+0000 7f696fad7980 20 add_watcher() i=0 2024-09-13T06:10:19.847 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.847+0000 7f696fad7980 20 add_watcher() i=1 2024-09-13T06:10:19.847 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.847+0000 7f696fad7980 20 add_watcher() i=2 2024-09-13T06:10:19.847 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.847+0000 7f696fad7980 20 add_watcher() i=3 2024-09-13T06:10:19.847 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.847+0000 7f696fad7980 20 add_watcher() i=4 2024-09-13T06:10:19.847 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.847+0000 7f696fad7980 20 add_watcher() i=5 2024-09-13T06:10:19.847 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.847+0000 7f696fad7980 20 add_watcher() i=6 2024-09-13T06:10:19.849 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.847+0000 7f696dde8640 1 -- 172.21.15.194:0/2016444085 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94923998296992] v35'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69680083f0 con 0x7f69580cc040 2024-09-13T06:10:19.849 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.847+0000 7f696fad7980 20 add_watcher() i=7 2024-09-13T06:10:19.849 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.847+0000 7f696fad7980 2 all 8 watchers are set, enabling cache 2024-09-13T06:10:19.849 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.847+0000 7f696fad7980 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565537334b40 con 0x565537321cb0 2024-09-13T06:10:19.849 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.847+0000 7f696dde8640 1 -- 172.21.15.194:0/2016444085 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f69680083f0 con 0x565537321cb0 2024-09-13T06:10:19.850 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.847+0000 7f696fad7980 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94923998301216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565537332060 con 0x565537321cb0 2024-09-13T06:10:19.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.851+0000 7f696dde8640 1 -- 172.21.15.194:0/2016444085 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94923998301216] v35'187 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f69680083f0 con 0x565537321cb0 2024-09-13T06:10:19.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.851+0000 7f6823fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:10:19.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.851+0000 7f696fad7980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:10:19.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.851+0000 7f696fad7980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:10:19.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.851+0000 7f696fad7980 5 note: GC not initialized 2024-09-13T06:10:19.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.851+0000 7f6822fe5640 20 reqs_thread_entry: start 2024-09-13T06:10:19.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.851+0000 7f696fad7980 20 init_complete bucket index max shards: 11 2024-09-13T06:10:19.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.851+0000 7f696fad7980 20 Filter name: none 2024-09-13T06:10:19.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.851+0000 7f6820fe1640 20 reqs_thread_entry: start 2024-09-13T06:10:19.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.851+0000 7f696fad7980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T06:10:19.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.851+0000 7f696fad7980 20 rados->read ofs=0 len=0 2024-09-13T06:10:19.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.851+0000 7f696fad7980 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565537358230 con 0x565537321cb0 2024-09-13T06:10:19.853 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.851+0000 7f696dde8640 1 -- 172.21.15.194:0/2016444085 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv20 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f69680083f0 con 0x565537321cb0 2024-09-13T06:10:19.853 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.851+0000 7f696fad7980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T06:10:19.853 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.851+0000 7f696fad7980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T06:10:19.853 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.851+0000 7f696fad7980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:10:19.853 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.851+0000 7f696fad7980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:10:19.854 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.851+0000 7f696fad7980 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~403 in=403b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56553735e370 con 0x565537321cb0 2024-09-13T06:10:19.854 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.851+0000 7f696dde8640 1 -- 172.21.15.194:0/2016444085 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~403] v35'22 uv22 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f69680083f0 con 0x565537321cb0 2024-09-13T06:10:19.854 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.851+0000 7f696fad7980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T06:10:19.854 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.851+0000 7f696fad7980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:10:19.854 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.851+0000 7f696fad7980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T06:10:19.854 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.851+0000 7f696fad7980 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94923998486048 in=591b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565537359cb0 con 0x565537321cb0 2024-09-13T06:10:19.855 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.851+0000 7f696dde8640 1 -- 172.21.15.194:0/2016444085 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== watch-notify(notify (1) cookie 94923998293424 notify 150323855376 ret 0) ==== 621+0+0 (crc 0 0 0) 0x7f6968010040 con 0x565537321cb0 2024-09-13T06:10:19.855 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.851+0000 7f6850ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855376 cookie 94923998293424 notifier 4654 bl.length()=579 2024-09-13T06:10:19.855 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.851+0000 7f6850ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T06:10:19.855 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.851+0000 7f6850ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:10:19.855 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.851+0000 7f696dde8640 1 -- 172.21.15.194:0/2016444085 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(64 notify.4 [notify cookie 94923998486048 out=8b] v0'0 uv180 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f69680083f0 con 0x565537321cb0 2024-09-13T06:10:19.855 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.851+0000 7f6850ff9640 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f6830003eb0 con 0x565537321cb0 2024-09-13T06:10:19.855 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.851+0000 7f696dde8640 1 -- 172.21.15.194:0/2016444085 <== osd.1 v2:172.21.15.194:6808/3135444559 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69680083f0 con 0x565537321cb0 2024-09-13T06:10:19.855 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.855+0000 7f696dde8640 1 -- 172.21.15.194:0/2016444085 <== osd.1 v2:172.21.15.194:6808/3135444559 26 ==== watch-notify(notify_complete (2) cookie 94923998486048 notify 150323855376 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f696800bc50 con 0x565537321cb0 2024-09-13T06:10:19.855 INFO:teuthology.orchestra.run.smithi194.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T06:09:53.191222Z"}],"swift_keys":[],"caps":[{"type":"user","perm":"read"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:09:53.191207Z","tags":[],"group_ids":[]} 2024-09-13T06:10:19.856 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.855+0000 7f6823fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:10:19.856 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.855+0000 7f696fad7980 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94923998301216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565537356060 con 0x565537321cb0 2024-09-13T06:10:19.856 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.855+0000 7f696dde8640 1 -- 172.21.15.194:0/2016444085 <== osd.1 v2:172.21.15.194:6808/3135444559 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94923998301216] v35'188 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f69680083f0 con 0x565537321cb0 2024-09-13T06:10:19.857 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.855+0000 7f696fad7980 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94923998279536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565537356060 con 0x7f6960064880 2024-09-13T06:10:19.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.855+0000 7f696cde6640 1 -- 172.21.15.194:0/2016444085 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94923998279536] v35'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69580e3040 con 0x7f6960064880 2024-09-13T06:10:19.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.855+0000 7f696fad7980 20 remove_watcher() i=0 2024-09-13T06:10:19.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.855+0000 7f696fad7980 2 removed watcher, disabling cache 2024-09-13T06:10:19.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.855+0000 7f696fad7980 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94923998281744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x565537356060 con 0x565537321cb0 2024-09-13T06:10:19.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.859+0000 7f696dde8640 1 -- 172.21.15.194:0/2016444085 <== osd.1 v2:172.21.15.194:6808/3135444559 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94923998281744] v35'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69680083f0 con 0x565537321cb0 2024-09-13T06:10:19.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.859+0000 7f696fad7980 20 remove_watcher() i=1 2024-09-13T06:10:19.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.859+0000 7f696fad7980 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94923998289472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56553732c010 con 0x5655373266a0 2024-09-13T06:10:19.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.859+0000 7f696d5e7640 1 -- 172.21.15.194:0/2016444085 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94923998289472] v35'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6960092040 con 0x5655373266a0 2024-09-13T06:10:19.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.859+0000 7f696fad7980 20 remove_watcher() i=2 2024-09-13T06:10:19.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.859+0000 7f696fad7980 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94923998286704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56553732c010 con 0x7f6960064880 2024-09-13T06:10:19.863 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.863+0000 7f696cde6640 1 -- 172.21.15.194:0/2016444085 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94923998286704] v35'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69580e3040 con 0x7f6960064880 2024-09-13T06:10:19.863 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.863+0000 7f696fad7980 20 remove_watcher() i=3 2024-09-13T06:10:19.863 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.863+0000 7f696fad7980 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94923998293424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56553732d370 con 0x565537321cb0 2024-09-13T06:10:19.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.863+0000 7f696dde8640 1 -- 172.21.15.194:0/2016444085 <== osd.1 v2:172.21.15.194:6808/3135444559 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94923998293424] v35'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69680083f0 con 0x565537321cb0 2024-09-13T06:10:19.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.863+0000 7f696fad7980 20 remove_watcher() i=4 2024-09-13T06:10:19.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.863+0000 7f696fad7980 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94923998291856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56553732edb0 con 0x7f69580cc040 2024-09-13T06:10:19.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.867+0000 7f696dde8640 1 -- 172.21.15.194:0/2016444085 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94923998291856] v35'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69680083f0 con 0x7f69580cc040 2024-09-13T06:10:19.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.867+0000 7f696fad7980 20 remove_watcher() i=5 2024-09-13T06:10:19.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.867+0000 7f696fad7980 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94923998300160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56553732d370 con 0x7f69580cc040 2024-09-13T06:10:19.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.867+0000 7f696dde8640 1 -- 172.21.15.194:0/2016444085 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94923998300160] v35'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69680083f0 con 0x7f69580cc040 2024-09-13T06:10:19.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.867+0000 7f696fad7980 20 remove_watcher() i=6 2024-09-13T06:10:19.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.867+0000 7f696fad7980 1 -- 172.21.15.194:0/2016444085 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94923998296992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56553732edb0 con 0x7f69580cc040 2024-09-13T06:10:19.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.871+0000 7f696dde8640 1 -- 172.21.15.194:0/2016444085 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94923998296992] v35'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69680083f0 con 0x7f69580cc040 2024-09-13T06:10:19.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.871+0000 7f696fad7980 20 remove_watcher() i=7 2024-09-13T06:10:19.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.871+0000 7f696fad7980 1 -- 172.21.15.194:0/2016444085 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f69580cc040 msgr2=0x7f69580d9410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:19.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.871+0000 7f696fad7980 1 --2- 172.21.15.194:0/2016444085 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f69580cc040 0x7f69580d9410 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:19.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.871+0000 7f696fad7980 1 -- 172.21.15.194:0/2016444085 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x565537321cb0 msgr2=0x565537324170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:19.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.871+0000 7f696fad7980 1 --2- 172.21.15.194:0/2016444085 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x565537321cb0 0x565537324170 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:19.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.871+0000 7f696fad7980 1 -- 172.21.15.194:0/2016444085 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f6960064880 msgr2=0x7f6960084770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:19.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.871+0000 7f696fad7980 1 --2- 172.21.15.194:0/2016444085 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f6960064880 0x7f6960084770 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:19.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.871+0000 7f696fad7980 1 -- 172.21.15.194:0/2016444085 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5655373266a0 msgr2=0x565537328a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:19.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.871+0000 7f696fad7980 1 --2- 172.21.15.194:0/2016444085 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5655373266a0 0x565537328a90 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:19.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.871+0000 7f696fad7980 1 -- 172.21.15.194:0/2016444085 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6838034650 msgr2=0x7f6838036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:19.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.871+0000 7f696fad7980 1 --2- 172.21.15.194:0/2016444085 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6838034650 0x7f6838036b10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6958000c10 tx=0x7f69580b8040 comp rx=0 tx=0).stop 2024-09-13T06:10:19.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.871+0000 7f696fad7980 1 -- 172.21.15.194:0/2016444085 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56553730fa60 msgr2=0x565537316c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:19.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.871+0000 7f696fad7980 1 --2- 172.21.15.194:0/2016444085 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56553730fa60 0x565537316c90 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f69600416d0 tx=0x7f696002eeb0 comp rx=0 tx=0).stop 2024-09-13T06:10:19.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.871+0000 7f696dde8640 1 -- 172.21.15.194:0/2016444085 reap_dead start 2024-09-13T06:10:19.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.871+0000 7f696fad7980 1 -- 172.21.15.194:0/2016444085 shutdown_connections 2024-09-13T06:10:19.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.871+0000 7f696fad7980 1 --2- 172.21.15.194:0/2016444085 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56553730fa60 0x565537316c90 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:19.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.871+0000 7f696fad7980 1 -- 172.21.15.194:0/2016444085 >> 172.21.15.194:0/2016444085 conn(0x56553730be40 msgr2=0x565537309f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:19.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.871+0000 7f696fad7980 1 -- 172.21.15.194:0/2016444085 shutdown_connections 2024-09-13T06:10:19.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.871+0000 7f696fad7980 1 -- 172.21.15.194:0/2016444085 wait complete. 2024-09-13T06:10:19.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.871+0000 7f696fad7980 1 -- 172.21.15.194:0/3947394857 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6844034650 msgr2=0x7f6844036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:19.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.871+0000 7f696fad7980 1 --2- 172.21.15.194:0/3947394857 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6844034650 0x7f6844036b10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x5655372ed010 tx=0x7f6958005ad0 comp rx=0 tx=0).stop 2024-09-13T06:10:19.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.871+0000 7f696fad7980 1 -- 172.21.15.194:0/3947394857 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x565537302f40 msgr2=0x565537303360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:19.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.871+0000 7f696fad7980 1 --2- 172.21.15.194:0/3947394857 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x565537302f40 0x565537303360 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f6960028b90 tx=0x7f6960007de0 comp rx=0 tx=0).stop 2024-09-13T06:10:19.876 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.871+0000 7f696fad7980 1 -- 172.21.15.194:0/3947394857 shutdown_connections 2024-09-13T06:10:19.876 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.871+0000 7f696fad7980 1 --2- 172.21.15.194:0/3947394857 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6844034650 0x7f6844036b10 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:19.876 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.871+0000 7f696fad7980 1 --2- 172.21.15.194:0/3947394857 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x565537302f40 0x565537303360 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:19.876 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.871+0000 7f696fad7980 1 -- 172.21.15.194:0/3947394857 >> 172.21.15.194:0/3947394857 conn(0x5655372f8090 msgr2=0x5655372fab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:19.876 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.871+0000 7f696fad7980 1 -- 172.21.15.194:0/3947394857 shutdown_connections 2024-09-13T06:10:19.876 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.871+0000 7f696fad7980 1 -- 172.21.15.194:0/3947394857 wait complete. 2024-09-13T06:10:19.876 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.871+0000 7f696fad7980 1 -- 172.21.15.194:0/2968941895 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5655371f6ea0 msgr2=0x5655372ec0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:19.876 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.871+0000 7f696fad7980 1 --2- 172.21.15.194:0/2968941895 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5655371f6ea0 0x5655372ec0c0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:19.876 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.871+0000 7f696fad7980 1 -- 172.21.15.194:0/2968941895 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5655372f2980 msgr2=0x5655372f4d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:19.876 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.871+0000 7f696fad7980 1 --2- 172.21.15.194:0/2968941895 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5655372f2980 0x5655372f4d70 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:19.876 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.871+0000 7f696fad7980 1 -- 172.21.15.194:0/2968941895 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5655372eea60 msgr2=0x5655372f0e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:19.876 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.871+0000 7f696fad7980 1 --2- 172.21.15.194:0/2968941895 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5655372eea60 0x5655372f0e50 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:19.876 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.871+0000 7f696fad7980 1 -- 172.21.15.194:0/2968941895 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6854034650 msgr2=0x7f6854036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:19.877 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.871+0000 7f696fad7980 1 --2- 172.21.15.194:0/2968941895 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6854034650 0x7f6854036b10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f69580ac000 tx=0x7f69580a5000 comp rx=0 tx=0).stop 2024-09-13T06:10:19.877 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.871+0000 7f696fad7980 1 -- 172.21.15.194:0/2968941895 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x565537164ad0 msgr2=0x5655372e50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:19.877 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.871+0000 7f696fad7980 1 --2- 172.21.15.194:0/2968941895 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x565537164ad0 0x5655372e50f0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f6960000f90 tx=0x7f6960001260 comp rx=0 tx=0).stop 2024-09-13T06:10:19.877 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.871+0000 7f696dde8640 1 -- 172.21.15.194:0/2968941895 reap_dead start 2024-09-13T06:10:19.877 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.871+0000 7f696fad7980 1 -- 172.21.15.194:0/2968941895 shutdown_connections 2024-09-13T06:10:19.877 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.871+0000 7f696fad7980 1 -- 172.21.15.194:0/2968941895 >> 172.21.15.194:0/2968941895 conn(0x5655371eb070 msgr2=0x5655372d8480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:19.877 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.871+0000 7f696fad7980 1 -- 172.21.15.194:0/2968941895 shutdown_connections 2024-09-13T06:10:19.877 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.871+0000 7f696fad7980 1 -- 172.21.15.194:0/2968941895 wait complete. 2024-09-13T06:10:19.884 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T06:09:53.191222Z'}], 'swift_keys': [], 'caps': [{'type': 'user', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:09:53.191207Z', 'tags': [], 'group_ids': []} 2024-09-13T06:10:19.885 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-09-13T06:10:19.885 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-09-13T06:10:19.885 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid foo --caps user=read 2024-09-13T06:10:19.960 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:10:19.960 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:10:19.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.959+0000 7f082aa18980 1 Processor -- start 2024-09-13T06:10:19.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.959+0000 7f082aa18980 1 -- start start 2024-09-13T06:10:19.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.959+0000 7f082aa18980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55e3859fbea0 0x55e3859fe290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.959+0000 7f082aa18980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e38587dae0 con 0x55e385969ad0 2024-09-13T06:10:19.962 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.959+0000 7f082aa18980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x55e3858a1e30 con 0x55e3859fbea0 2024-09-13T06:10:19.962 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.959+0000 7f0827d27640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55e3859fbea0 0x55e3859fe290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.962 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.959+0000 7f0827d27640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55e3859fbea0 0x55e3859fe290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:50862/0 (socket says 172.21.15.194:50862) 2024-09-13T06:10:19.962 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.959+0000 7f0827d27640 1 -- 172.21.15.194:0/3556251338 learned_addr learned my addr 172.21.15.194:0/3556251338 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:19.962 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.959+0000 7f0828528640 1 --1- 172.21.15.194:0/3556251338 >> v1:172.21.15.120:6789/0 conn(0x55e385969ad0 0x55e3859fa780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:59098/0 (socket says 172.21.15.194:59098) 2024-09-13T06:10:19.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.963+0000 7f0827d27640 1 -- 172.21.15.194:0/3556251338 >> v1:172.21.15.120:6789/0 conn(0x55e385969ad0 legacy=0x55e3859fa780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:19.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.963+0000 7f0827d27640 1 -- 172.21.15.194:0/3556251338 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e385969eb0 con 0x55e3859fbea0 2024-09-13T06:10:19.965 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.963+0000 7f0827d27640 1 --2- 172.21.15.194:0/3556251338 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e3859fbea0 0x55e3859fe290 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f081000a5c0 tx=0x7f081001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9a33a212ff1c463 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.965 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.963+0000 7f0827526640 1 -- 172.21.15.194:0/3556251338 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08100a6070 con 0x55e3859fbea0 2024-09-13T06:10:19.965 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.963+0000 7f0827526640 1 -- 172.21.15.194:0/3556251338 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08100af070 con 0x55e3859fbea0 2024-09-13T06:10:19.965 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.963+0000 7f0827526640 1 -- 172.21.15.194:0/3556251338 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08100aa5c0 con 0x55e3859fbea0 2024-09-13T06:10:19.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.963+0000 7f082aa18980 1 -- 172.21.15.194:0/3556251338 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e3859fbea0 msgr2=0x55e3859fe290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:19.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.963+0000 7f082aa18980 1 --2- 172.21.15.194:0/3556251338 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e3859fbea0 0x55e3859fe290 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f081000a5c0 tx=0x7f081001b340 comp rx=0 tx=0).stop 2024-09-13T06:10:19.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.963+0000 7f082aa18980 1 -- 172.21.15.194:0/3556251338 shutdown_connections 2024-09-13T06:10:19.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.963+0000 7f082aa18980 1 --2- 172.21.15.194:0/3556251338 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e3859fbea0 0x55e3859fe290 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:19.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.963+0000 7f082aa18980 1 -- 172.21.15.194:0/3556251338 >> 172.21.15.194:0/3556251338 conn(0x55e3859f0070 msgr2=0x55e3859f2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:19.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.963+0000 7f082aa18980 1 -- 172.21.15.194:0/3556251338 shutdown_connections 2024-09-13T06:10:19.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.963+0000 7f082aa18980 1 -- 172.21.15.194:0/3556251338 wait complete. 2024-09-13T06:10:19.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.979+0000 7f082aa18980 1 Processor -- start 2024-09-13T06:10:19.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.979+0000 7f082aa18980 1 -- start start 2024-09-13T06:10:19.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.979+0000 7f082aa18980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e385969ad0 0x55e385ae2c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.979+0000 7f082aa18980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55e3858a3200 con 0x55e385969ad0 2024-09-13T06:10:19.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.983+0000 7f0828528640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e385969ad0 0x55e385ae2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.983+0000 7f0828528640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e385969ad0 0x55e385ae2c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:50872/0 (socket says 172.21.15.194:50872) 2024-09-13T06:10:19.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.983+0000 7f0828528640 1 -- 172.21.15.194:0/1646627669 learned_addr learned my addr 172.21.15.194:0/1646627669 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:19.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.983+0000 7f0828528640 1 -- 172.21.15.194:0/1646627669 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e385ae3230 con 0x55e385969ad0 2024-09-13T06:10:19.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.983+0000 7f0828528640 1 --2- 172.21.15.194:0/1646627669 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e385969ad0 0x55e385ae2c60 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f0820001690 tx=0x7f0820001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5300f4a57b78c414 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.983+0000 7f071660c640 1 -- 172.21.15.194:0/1646627669 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0820003460 con 0x55e385969ad0 2024-09-13T06:10:19.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.983+0000 7f071660c640 1 -- 172.21.15.194:0/1646627669 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0820003600 con 0x55e385969ad0 2024-09-13T06:10:19.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.983+0000 7f071660c640 1 -- 172.21.15.194:0/1646627669 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0820003920 con 0x55e385969ad0 2024-09-13T06:10:19.985 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.983+0000 7f082aa18980 1 -- 172.21.15.194:0/1646627669 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e385969ad0 msgr2=0x55e385ae2c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:19.985 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.983+0000 7f082aa18980 1 --2- 172.21.15.194:0/1646627669 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e385969ad0 0x55e385ae2c60 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f0820001690 tx=0x7f0820001b50 comp rx=0 tx=0).stop 2024-09-13T06:10:19.985 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.983+0000 7f082aa18980 1 -- 172.21.15.194:0/1646627669 shutdown_connections 2024-09-13T06:10:19.985 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.983+0000 7f082aa18980 1 --2- 172.21.15.194:0/1646627669 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e385969ad0 0x55e385ae2c60 secure :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f0820001690 tx=0x7f0820001b50 comp rx=0 tx=0).stop 2024-09-13T06:10:19.985 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.983+0000 7f082aa18980 1 -- 172.21.15.194:0/1646627669 >> 172.21.15.194:0/1646627669 conn(0x55e3859f0070 msgr2=0x55e385ade890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:19.985 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.983+0000 7f082aa18980 1 -- 172.21.15.194:0/1646627669 shutdown_connections 2024-09-13T06:10:19.985 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.983+0000 7f082aa18980 1 -- 172.21.15.194:0/1646627669 wait complete. 2024-09-13T06:10:19.985 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.983+0000 7f082aa18980 1 Processor -- start 2024-09-13T06:10:19.985 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.983+0000 7f082aa18980 1 -- start start 2024-09-13T06:10:19.985 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.983+0000 7f082aa18980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e3859fbea0 0x55e385aea1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.986 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.983+0000 7f082aa18980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55e385a01260 con 0x55e3859fbea0 2024-09-13T06:10:19.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.983+0000 7f0828528640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e3859fbea0 0x55e385aea1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.983+0000 7f0828528640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e3859fbea0 0x55e385aea1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:50880/0 (socket says 172.21.15.194:50880) 2024-09-13T06:10:19.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.983+0000 7f0828528640 1 -- 172.21.15.194:0/1747940680 learned_addr learned my addr 172.21.15.194:0/1747940680 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:19.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.983+0000 7f0828528640 1 -- 172.21.15.194:0/1747940680 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e385aea710 con 0x55e3859fbea0 2024-09-13T06:10:19.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.987+0000 7f0828528640 1 --2- 172.21.15.194:0/1747940680 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e3859fbea0 0x55e385aea1d0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f0820000f90 tx=0x7f0820001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.987+0000 7f0714e09640 1 -- 172.21.15.194:0/1747940680 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0820021020 con 0x55e3859fbea0 2024-09-13T06:10:19.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.987+0000 7f0714e09640 1 -- 172.21.15.194:0/1747940680 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f082001d680 con 0x55e3859fbea0 2024-09-13T06:10:19.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.987+0000 7f0714e09640 1 -- 172.21.15.194:0/1747940680 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f082001d8b0 con 0x55e3859fbea0 2024-09-13T06:10:19.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.987+0000 7f082aa18980 1 -- 172.21.15.194:0/1747940680 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e385aea9a0 con 0x55e3859fbea0 2024-09-13T06:10:19.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.987+0000 7f082aa18980 1 -- 172.21.15.194:0/1747940680 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e385aed680 con 0x55e3859fbea0 2024-09-13T06:10:19.988 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.987+0000 7f0714e09640 1 -- 172.21.15.194:0/1747940680 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0820024020 con 0x55e3859fbea0 2024-09-13T06:10:19.988 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.987+0000 7f0714e09640 1 --2- 172.21.15.194:0/1747940680 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f07100346a0 0x7f0710036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.989 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.987+0000 7f0714e09640 1 -- 172.21.15.194:0/1747940680 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f0820018040 con 0x55e3859fbea0 2024-09-13T06:10:19.989 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.987+0000 7f0827d27640 1 --2- 172.21.15.194:0/1747940680 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f07100346a0 0x7f0710036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.989 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.987+0000 7f082aa18980 1 --2- 172.21.15.194:0/1747940680 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55e385aef2c0 0x55e385af16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.989 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.987+0000 7f082aa18980 1 -- 172.21.15.194:0/1747940680 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e385af1bf0 con 0x55e385aef2c0 2024-09-13T06:10:19.989 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.987+0000 7f0828d29640 1 --2- 172.21.15.194:0/1747940680 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55e385aef2c0 0x55e385af16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.989 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.987+0000 7f0827d27640 1 --2- 172.21.15.194:0/1747940680 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f07100346a0 0x7f0710036b60 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f08100ae000 tx=0x7f08100a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.990 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.987+0000 7f0828d29640 1 --2- 172.21.15.194:0/1747940680 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55e385aef2c0 0x55e385af16b0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.990 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.987+0000 7f0828d29640 1 -- 172.21.15.194:0/1747940680 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f08180083f0 con 0x55e385aef2c0 2024-09-13T06:10:19.990 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.987+0000 7f082aa18980 1 -- 172.21.15.194:0/1747940680 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e385aee8a0 con 0x55e385aef2c0 2024-09-13T06:10:19.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.987+0000 7f0828d29640 1 -- 172.21.15.194:0/1747940680 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f08180083f0 con 0x55e385aef2c0 2024-09-13T06:10:19.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.987+0000 7f082aa18980 1 --2- 172.21.15.194:0/1747940680 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55e385af3f00 0x55e385af62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.987+0000 7f082aa18980 1 -- 172.21.15.194:0/1747940680 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e385af69e0 con 0x55e385af3f00 2024-09-13T06:10:19.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.987+0000 7f0828528640 1 --2- 172.21.15.194:0/1747940680 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55e385af3f00 0x55e385af62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.991+0000 7f0828528640 1 --2- 172.21.15.194:0/1747940680 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55e385af3f00 0x55e385af62f0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.991+0000 7f0828528640 1 -- 172.21.15.194:0/1747940680 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f082000f070 con 0x55e385af3f00 2024-09-13T06:10:19.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.991+0000 7f082aa18980 1 -- 172.21.15.194:0/1747940680 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e385af2da0 con 0x55e385aef2c0 2024-09-13T06:10:19.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.991+0000 7f0828d29640 1 -- 172.21.15.194:0/1747940680 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f08180083f0 con 0x55e385aef2c0 2024-09-13T06:10:19.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.991+0000 7f082aa18980 1 --2- 172.21.15.194:0/1747940680 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55e385af7e40 0x55e385afa230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.991+0000 7f082aa18980 1 -- 172.21.15.194:0/1747940680 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e385afa970 con 0x55e385af7e40 2024-09-13T06:10:19.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.991+0000 7f0827d27640 1 --2- 172.21.15.194:0/1747940680 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55e385af7e40 0x55e385afa230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.991+0000 7f0827d27640 1 --2- 172.21.15.194:0/1747940680 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55e385af7e40 0x55e385afa230 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.991+0000 7f0827d27640 1 -- 172.21.15.194:0/1747940680 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f08100aaad0 con 0x55e385af7e40 2024-09-13T06:10:19.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.991+0000 7f082aa18980 1 Processor -- start 2024-09-13T06:10:19.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.991+0000 7f082aa18980 1 -- start start 2024-09-13T06:10:19.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.991+0000 7f082aa18980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e385b08440 0x55e385b08860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.991+0000 7f082aa18980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55e3858fc800 con 0x55e385b08440 2024-09-13T06:10:19.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.991+0000 7f0828528640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e385b08440 0x55e385b08860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.991+0000 7f0828528640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e385b08440 0x55e385b08860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:50890/0 (socket says 172.21.15.194:50890) 2024-09-13T06:10:19.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.991+0000 7f0828528640 1 -- 172.21.15.194:0/858925205 learned_addr learned my addr 172.21.15.194:0/858925205 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:19.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.991+0000 7f0828528640 1 -- 172.21.15.194:0/858925205 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e385b08da0 con 0x55e385b08440 2024-09-13T06:10:19.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.991+0000 7f0828528640 1 --2- 172.21.15.194:0/858925205 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e385b08440 0x55e385b08860 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f0820047f70 tx=0x7f082001df20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.995+0000 7f070dffb640 1 -- 172.21.15.194:0/858925205 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0820040070 con 0x55e385b08440 2024-09-13T06:10:19.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.995+0000 7f082aa18980 1 -- 172.21.15.194:0/858925205 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e385b09030 con 0x55e385b08440 2024-09-13T06:10:19.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.995+0000 7f070dffb640 1 -- 172.21.15.194:0/858925205 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0820041700 con 0x55e385b08440 2024-09-13T06:10:19.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.995+0000 7f082aa18980 1 -- 172.21.15.194:0/858925205 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e385b0bcb0 con 0x55e385b08440 2024-09-13T06:10:19.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.995+0000 7f070dffb640 1 -- 172.21.15.194:0/858925205 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0820041390 con 0x55e385b08440 2024-09-13T06:10:19.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.995+0000 7f070dffb640 1 -- 172.21.15.194:0/858925205 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f082001b040 con 0x55e385b08440 2024-09-13T06:10:19.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.995+0000 7f070dffb640 1 --2- 172.21.15.194:0/858925205 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0700034650 0x7f0700036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.995+0000 7f070dffb640 1 -- 172.21.15.194:0/858925205 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f08200486f0 con 0x55e385b08440 2024-09-13T06:10:19.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.995+0000 7f0827d27640 1 --2- 172.21.15.194:0/858925205 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0700034650 0x7f0700036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.997 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.995+0000 7f082aa18980 1 Processor -- start 2024-09-13T06:10:19.997 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.995+0000 7f082aa18980 1 -- start start 2024-09-13T06:10:19.997 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.995+0000 7f0827d27640 1 --2- 172.21.15.194:0/858925205 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0700034650 0x7f0700036b10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x55e385af2080 tx=0x7f0810005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.997 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.995+0000 7f082aa18980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e385b14d40 0x55e385b15120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:19.997 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.995+0000 7f082aa18980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55e385ae3550 con 0x55e385b14d40 2024-09-13T06:10:19.997 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.995+0000 7f0828528640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e385b14d40 0x55e385b15120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:19.997 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.995+0000 7f0828528640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e385b14d40 0x55e385b15120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:50892/0 (socket says 172.21.15.194:50892) 2024-09-13T06:10:19.997 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.995+0000 7f0828528640 1 -- 172.21.15.194:0/1094904517 learned_addr learned my addr 172.21.15.194:0/1094904517 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:19.998 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.995+0000 7f0828528640 1 -- 172.21.15.194:0/1094904517 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e385b156f0 con 0x55e385b14d40 2024-09-13T06:10:19.998 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.995+0000 7f0828528640 1 --2- 172.21.15.194:0/1094904517 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e385b14d40 0x55e385b15120 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f082002fb80 tx=0x7f0820049220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8895e5722fed646 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:19.998 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.995+0000 7f07077fe640 1 -- 172.21.15.194:0/1094904517 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0820062070 con 0x55e385b14d40 2024-09-13T06:10:19.998 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.995+0000 7f07077fe640 1 -- 172.21.15.194:0/1094904517 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f082001ba80 con 0x55e385b14d40 2024-09-13T06:10:19.998 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.995+0000 7f07077fe640 1 -- 172.21.15.194:0/1094904517 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0820048080 con 0x55e385b14d40 2024-09-13T06:10:20.000 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.999+0000 7f082aa18980 1 -- 172.21.15.194:0/1094904517 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e385b14d40 msgr2=0x55e385b15120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:20.000 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.999+0000 7f082aa18980 1 --2- 172.21.15.194:0/1094904517 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e385b14d40 0x55e385b15120 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f082002fb80 tx=0x7f0820049220 comp rx=0 tx=0).stop 2024-09-13T06:10:20.000 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.999+0000 7f082aa18980 1 -- 172.21.15.194:0/1094904517 shutdown_connections 2024-09-13T06:10:20.000 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.999+0000 7f082aa18980 1 --2- 172.21.15.194:0/1094904517 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e385b14d40 0x55e385b15120 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:20.000 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.999+0000 7f082aa18980 1 -- 172.21.15.194:0/1094904517 >> 172.21.15.194:0/1094904517 conn(0x55e385b11120 msgr2=0x55e385b0f220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:20.000 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.999+0000 7f082aa18980 1 -- 172.21.15.194:0/1094904517 shutdown_connections 2024-09-13T06:10:20.000 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.999+0000 7f082aa18980 1 -- 172.21.15.194:0/1094904517 wait complete. 2024-09-13T06:10:20.000 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.999+0000 7f082aa18980 1 Processor -- start 2024-09-13T06:10:20.000 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.999+0000 7f082aa18980 1 -- start start 2024-09-13T06:10:20.001 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.999+0000 7f082aa18980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e385b14d40 0x55e385b1bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:20.001 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.999+0000 7f082aa18980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55e385b15b90 con 0x55e385b14d40 2024-09-13T06:10:20.001 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.999+0000 7f0828528640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e385b14d40 0x55e385b1bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:20.001 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.999+0000 7f0828528640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e385b14d40 0x55e385b1bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:50902/0 (socket says 172.21.15.194:50902) 2024-09-13T06:10:20.001 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.999+0000 7f0828528640 1 -- 172.21.15.194:0/3832246882 learned_addr learned my addr 172.21.15.194:0/3832246882 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:20.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.999+0000 7f0828528640 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e385b1c480 con 0x55e385b14d40 2024-09-13T06:10:20.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.999+0000 7f0828528640 1 --2- 172.21.15.194:0/3832246882 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e385b14d40 0x55e385b1bf40 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f0820014ed0 tx=0x7f0820048360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:20.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.999+0000 7f0705ffb640 1 -- 172.21.15.194:0/3832246882 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f082006d070 con 0x55e385b14d40 2024-09-13T06:10:20.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.999+0000 7f082aa18980 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e385b1c480 con 0x55e385b14d40 2024-09-13T06:10:20.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.999+0000 7f0705ffb640 1 -- 172.21.15.194:0/3832246882 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f082001b560 con 0x55e385b14d40 2024-09-13T06:10:20.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.999+0000 7f0705ffb640 1 -- 172.21.15.194:0/3832246882 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0820062040 con 0x55e385b14d40 2024-09-13T06:10:20.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:19.999+0000 7f082aa18980 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e385b1c8f0 con 0x55e385b14d40 2024-09-13T06:10:20.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.003+0000 7f0705ffb640 1 -- 172.21.15.194:0/3832246882 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0820070070 con 0x55e385b14d40 2024-09-13T06:10:20.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.003+0000 7f0705ffb640 1 --2- 172.21.15.194:0/3832246882 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f06f80345b0 0x7f06f8036a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:20.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.003+0000 7f0705ffb640 1 -- 172.21.15.194:0/3832246882 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f082005a070 con 0x55e385b14d40 2024-09-13T06:10:20.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.003+0000 7f0827d27640 1 --2- 172.21.15.194:0/3832246882 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f06f80345b0 0x7f06f8036a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:20.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.003+0000 7f082aa18980 20 rados->read ofs=0 len=0 2024-09-13T06:10:20.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.003+0000 7f082aa18980 1 --2- 172.21.15.194:0/3832246882 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55e385b26f70 0x55e385b29430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:20.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.003+0000 7f082aa18980 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e385b29b80 con 0x55e385b26f70 2024-09-13T06:10:20.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.003+0000 7f0828d29640 1 --2- 172.21.15.194:0/3832246882 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55e385b26f70 0x55e385b29430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:20.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.003+0000 7f0827d27640 1 --2- 172.21.15.194:0/3832246882 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f06f80345b0 0x7f06f8036a70 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0810000c10 tx=0x7f08100c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:20.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.003+0000 7f0828d29640 1 --2- 172.21.15.194:0/3832246882 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55e385b26f70 0x55e385b29430 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:20.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.003+0000 7f0828d29640 1 -- 172.21.15.194:0/3832246882 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f08180083f0 con 0x55e385b26f70 2024-09-13T06:10:20.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.003+0000 7f082aa18980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:20.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.003+0000 7f082aa18980 20 realm 2024-09-13T06:10:20.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.003+0000 7f082aa18980 20 rados->read ofs=0 len=0 2024-09-13T06:10:20.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.003+0000 7f082aa18980 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e385b29f90 con 0x55e385b26f70 2024-09-13T06:10:20.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.003+0000 7f0828d29640 1 -- 172.21.15.194:0/3832246882 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f08180083f0 con 0x55e385b26f70 2024-09-13T06:10:20.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.003+0000 7f082aa18980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:20.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.003+0000 7f082aa18980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:10:20.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.003+0000 7f082aa18980 20 rados->read ofs=0 len=0 2024-09-13T06:10:20.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.003+0000 7f082aa18980 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e385b2a860 con 0x55e385b26f70 2024-09-13T06:10:20.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.003+0000 7f0828d29640 1 -- 172.21.15.194:0/3832246882 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f08180083f0 con 0x55e385b26f70 2024-09-13T06:10:20.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.003+0000 7f082aa18980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:20.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.003+0000 7f082aa18980 20 rados->read ofs=0 len=0 2024-09-13T06:10:20.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.003+0000 7f082aa18980 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e385b2ac00 con 0x55e385b26f70 2024-09-13T06:10:20.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.003+0000 7f0828d29640 1 -- 172.21.15.194:0/3832246882 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f08180083f0 con 0x55e385b26f70 2024-09-13T06:10:20.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.003+0000 7f082aa18980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:10:20.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.003+0000 7f082aa18980 20 rados->read ofs=0 len=0 2024-09-13T06:10:20.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.003+0000 7f082aa18980 1 --2- 172.21.15.194:0/3832246882 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55e385b2b960 0x55e385b2dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:20.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.003+0000 7f082aa18980 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e385b2e320 con 0x55e385b2b960 2024-09-13T06:10:20.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.003+0000 7f0828528640 1 --2- 172.21.15.194:0/3832246882 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55e385b2b960 0x55e385b2dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:20.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.003+0000 7f0828528640 1 --2- 172.21.15.194:0/3832246882 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55e385b2b960 0x55e385b2dd50 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:20.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.003+0000 7f0828528640 1 -- 172.21.15.194:0/3832246882 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0820079070 con 0x55e385b2b960 2024-09-13T06:10:20.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.003+0000 7f082aa18980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:10:20.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.003+0000 7f082aa18980 20 searching for the correct realm 2024-09-13T06:10:20.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.003+0000 7f082aa18980 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e385b2fbf0 con 0x55e385b2b960 2024-09-13T06:10:20.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.007+0000 7f0828528640 1 -- 172.21.15.194:0/3832246882 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0820079070 con 0x55e385b2b960 2024-09-13T06:10:20.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.007+0000 7f0828528640 1 --2- 172.21.15.194:0/3832246882 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f0820072070 0x7f0820053790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:20.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.007+0000 7f0828528640 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e385b2fbf0 con 0x7f0820072070 2024-09-13T06:10:20.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.007+0000 7f0827d27640 1 --2- 172.21.15.194:0/3832246882 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f0820072070 0x7f0820053790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:20.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.007+0000 7f0827d27640 1 --2- 172.21.15.194:0/3832246882 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f0820072070 0x7f0820053790 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:20.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.007+0000 7f0827d27640 1 -- 172.21.15.194:0/3832246882 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f08100aaad0 con 0x7f0820072070 2024-09-13T06:10:20.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.007+0000 7f0827d27640 1 --2- 172.21.15.194:0/3832246882 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f08100e0040 0x7f08100e0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:20.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.007+0000 7f0827d27640 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e385b2fbf0 con 0x7f08100e0040 2024-09-13T06:10:20.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.007+0000 7f0828d29640 1 --2- 172.21.15.194:0/3832246882 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f08100e0040 0x7f08100e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:20.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.007+0000 7f0828d29640 1 --2- 172.21.15.194:0/3832246882 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f08100e0040 0x7f08100e0420 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:20.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.007+0000 7f0828d29640 1 -- 172.21.15.194:0/3832246882 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08180083f0 con 0x7f08100e0040 2024-09-13T06:10:20.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.007+0000 7f0828d29640 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e385b2ac00 con 0x55e385b26f70 2024-09-13T06:10:20.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.007+0000 7f0828d29640 1 -- 172.21.15.194:0/3832246882 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08180083f0 con 0x55e385b26f70 2024-09-13T06:10:20.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.007+0000 7f0828d29640 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e385b2ac00 con 0x55e385b26f70 2024-09-13T06:10:20.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.007+0000 7f0828d29640 1 -- 172.21.15.194:0/3832246882 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08180083f0 con 0x55e385b26f70 2024-09-13T06:10:20.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.007+0000 7f0828d29640 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e385b2ac00 con 0x7f08100e0040 2024-09-13T06:10:20.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.011+0000 7f0828d29640 1 -- 172.21.15.194:0/3832246882 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08180083f0 con 0x7f08100e0040 2024-09-13T06:10:20.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.011+0000 7f0828d29640 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e385b2ac00 con 0x7f08100e0040 2024-09-13T06:10:20.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.011+0000 7f0828d29640 1 -- 172.21.15.194:0/3832246882 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08180083f0 con 0x7f08100e0040 2024-09-13T06:10:20.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.011+0000 7f0828d29640 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e385b2ac00 con 0x7f0820072070 2024-09-13T06:10:20.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.011+0000 7f0827d27640 1 -- 172.21.15.194:0/3832246882 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08100aaad0 con 0x7f0820072070 2024-09-13T06:10:20.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.011+0000 7f0827d27640 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e385b2ac00 con 0x55e385b2b960 2024-09-13T06:10:20.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.011+0000 7f0828528640 1 -- 172.21.15.194:0/3832246882 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0820079070 con 0x55e385b2b960 2024-09-13T06:10:20.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.011+0000 7f0828528640 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e385b2ac00 con 0x55e385b26f70 2024-09-13T06:10:20.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.011+0000 7f0828d29640 1 -- 172.21.15.194:0/3832246882 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08180083f0 con 0x55e385b26f70 2024-09-13T06:10:20.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.011+0000 7f0828d29640 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e385b2ac00 con 0x7f08100e0040 2024-09-13T06:10:20.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.011+0000 7f0828d29640 1 -- 172.21.15.194:0/3832246882 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08180083f0 con 0x7f08100e0040 2024-09-13T06:10:20.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.011+0000 7f0828d29640 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e385b2ac00 con 0x55e385b26f70 2024-09-13T06:10:20.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.011+0000 7f0828d29640 1 -- 172.21.15.194:0/3832246882 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08180083f0 con 0x55e385b26f70 2024-09-13T06:10:20.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.011+0000 7f0828d29640 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e385b2ac00 con 0x7f0820072070 2024-09-13T06:10:20.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.011+0000 7f0827d27640 1 -- 172.21.15.194:0/3832246882 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f08100aaad0 con 0x7f0820072070 2024-09-13T06:10:20.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.011+0000 7f0827d27640 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e385b2ac00 con 0x55e385b2b960 2024-09-13T06:10:20.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.011+0000 7f0828528640 1 -- 172.21.15.194:0/3832246882 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0820079070 con 0x55e385b2b960 2024-09-13T06:10:20.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.011+0000 7f0828528640 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e385b2ac00 con 0x55e385b2b960 2024-09-13T06:10:20.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.011+0000 7f0828528640 1 -- 172.21.15.194:0/3832246882 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0820079070 con 0x55e385b2b960 2024-09-13T06:10:20.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.011+0000 7f0828528640 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e385b2ac00 con 0x7f08100e0040 2024-09-13T06:10:20.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.011+0000 7f0828d29640 1 -- 172.21.15.194:0/3832246882 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08180083f0 con 0x7f08100e0040 2024-09-13T06:10:20.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.011+0000 7f0828d29640 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e385b2ac00 con 0x55e385b2b960 2024-09-13T06:10:20.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.015+0000 7f0828528640 1 -- 172.21.15.194:0/3832246882 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0820079070 con 0x55e385b2b960 2024-09-13T06:10:20.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.015+0000 7f0828528640 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e385b2ac00 con 0x55e385b2b960 2024-09-13T06:10:20.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.015+0000 7f0828528640 1 -- 172.21.15.194:0/3832246882 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0820079070 con 0x55e385b2b960 2024-09-13T06:10:20.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.015+0000 7f0828528640 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e385b2ac00 con 0x55e385b26f70 2024-09-13T06:10:20.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.015+0000 7f0828d29640 1 -- 172.21.15.194:0/3832246882 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08180083f0 con 0x55e385b26f70 2024-09-13T06:10:20.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.015+0000 7f0828d29640 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e385b2ac00 con 0x55e385b26f70 2024-09-13T06:10:20.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.015+0000 7f0828d29640 1 -- 172.21.15.194:0/3832246882 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f08180083f0 con 0x55e385b26f70 2024-09-13T06:10:20.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.015+0000 7f0828d29640 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e385b2ac00 con 0x7f0820072070 2024-09-13T06:10:20.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.015+0000 7f0827d27640 1 -- 172.21.15.194:0/3832246882 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08100aaad0 con 0x7f0820072070 2024-09-13T06:10:20.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.015+0000 7f0827d27640 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e385b2ac00 con 0x55e385b2b960 2024-09-13T06:10:20.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.015+0000 7f0828528640 1 -- 172.21.15.194:0/3832246882 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0820079070 con 0x55e385b2b960 2024-09-13T06:10:20.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.015+0000 7f0828528640 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e385b2ac00 con 0x7f0820072070 2024-09-13T06:10:20.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.015+0000 7f0827d27640 1 -- 172.21.15.194:0/3832246882 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08100aaad0 con 0x7f0820072070 2024-09-13T06:10:20.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.015+0000 7f0827d27640 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e385b2ac00 con 0x55e385b26f70 2024-09-13T06:10:20.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.015+0000 7f0828d29640 1 -- 172.21.15.194:0/3832246882 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08180083f0 con 0x55e385b26f70 2024-09-13T06:10:20.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.015+0000 7f0828d29640 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e385b2ac00 con 0x7f08100e0040 2024-09-13T06:10:20.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.015+0000 7f0828d29640 1 -- 172.21.15.194:0/3832246882 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08180083f0 con 0x7f08100e0040 2024-09-13T06:10:20.020 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.015+0000 7f0828d29640 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e385b2ac00 con 0x55e385b2b960 2024-09-13T06:10:20.020 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.015+0000 7f0828528640 1 -- 172.21.15.194:0/3832246882 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0820079070 con 0x55e385b2b960 2024-09-13T06:10:20.020 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.015+0000 7f0828528640 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e385b2ac00 con 0x7f0820072070 2024-09-13T06:10:20.020 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.015+0000 7f0827d27640 1 -- 172.21.15.194:0/3832246882 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08100aaad0 con 0x7f0820072070 2024-09-13T06:10:20.020 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.015+0000 7f0827d27640 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e385b2ac00 con 0x7f0820072070 2024-09-13T06:10:20.020 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.015+0000 7f0827d27640 1 -- 172.21.15.194:0/3832246882 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08100aaad0 con 0x7f0820072070 2024-09-13T06:10:20.020 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.015+0000 7f0827d27640 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e385b2ac00 con 0x55e385b2b960 2024-09-13T06:10:20.020 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.015+0000 7f0828528640 1 -- 172.21.15.194:0/3832246882 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0820079070 con 0x55e385b2b960 2024-09-13T06:10:20.020 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.019+0000 7f0828528640 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e385b2ac00 con 0x7f08100e0040 2024-09-13T06:10:20.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.019+0000 7f0828d29640 1 -- 172.21.15.194:0/3832246882 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08180083f0 con 0x7f08100e0040 2024-09-13T06:10:20.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.019+0000 7f0828d29640 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e385b2ac00 con 0x55e385b26f70 2024-09-13T06:10:20.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.019+0000 7f0828d29640 1 -- 172.21.15.194:0/3832246882 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f08180083f0 con 0x55e385b26f70 2024-09-13T06:10:20.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.019+0000 7f0828d29640 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e385b2ac00 con 0x7f0820072070 2024-09-13T06:10:20.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.019+0000 7f0827d27640 1 -- 172.21.15.194:0/3832246882 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08100aaad0 con 0x7f0820072070 2024-09-13T06:10:20.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.019+0000 7f082aa18980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:10:20.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.019+0000 7f082aa18980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:10:20.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.019+0000 7f082aa18980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:10:20.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.019+0000 7f082aa18980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:10:20.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.019+0000 7f082aa18980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:10:20.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.019+0000 7f082aa18980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:10:20.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.019+0000 7f082aa18980 20 rados->read ofs=0 len=0 2024-09-13T06:10:20.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.019+0000 7f082aa18980 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e385b2ece0 con 0x55e385b26f70 2024-09-13T06:10:20.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.019+0000 7f0828d29640 1 -- 172.21.15.194:0/3832246882 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f08180083f0 con 0x55e385b26f70 2024-09-13T06:10:20.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.019+0000 7f082aa18980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:20.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.019+0000 7f082aa18980 20 rados->read ofs=0 len=0 2024-09-13T06:10:20.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.019+0000 7f082aa18980 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e385b2f580 con 0x55e385b26f70 2024-09-13T06:10:20.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.019+0000 7f0828d29640 1 -- 172.21.15.194:0/3832246882 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f08180083f0 con 0x55e385b26f70 2024-09-13T06:10:20.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.019+0000 7f082aa18980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:10:20.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.019+0000 7f082aa18980 20 rados->read ofs=0 len=0 2024-09-13T06:10:20.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.019+0000 7f082aa18980 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e385b2e920 con 0x7f0820072070 2024-09-13T06:10:20.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.019+0000 7f0827d27640 1 -- 172.21.15.194:0/3832246882 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f08100aaad0 con 0x7f0820072070 2024-09-13T06:10:20.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.019+0000 7f082aa18980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:10:20.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.019+0000 7f082aa18980 20 zone default found 2024-09-13T06:10:20.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.019+0000 7f082aa18980 4 Realm: () 2024-09-13T06:10:20.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.019+0000 7f082aa18980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:10:20.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.019+0000 7f082aa18980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:10:20.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.019+0000 7f082aa18980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:10:20.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.019+0000 7f082aa18980 20 zonegroup default 2024-09-13T06:10:20.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.019+0000 7f082aa18980 20 rados->read ofs=0 len=0 2024-09-13T06:10:20.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.019+0000 7f082aa18980 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e385b30020 con 0x7f08100e0040 2024-09-13T06:10:20.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.019+0000 7f0828d29640 1 -- 172.21.15.194:0/3832246882 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f08180083f0 con 0x7f08100e0040 2024-09-13T06:10:20.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.019+0000 7f082aa18980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:20.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.019+0000 7f082aa18980 20 rados->read ofs=0 len=0 2024-09-13T06:10:20.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.019+0000 7f082aa18980 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e385b31a00 con 0x55e385b2b960 2024-09-13T06:10:20.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.019+0000 7f0828528640 1 -- 172.21.15.194:0/3832246882 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0820079070 con 0x55e385b2b960 2024-09-13T06:10:20.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.019+0000 7f082aa18980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:20.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.019+0000 7f082aa18980 20 rados->read ofs=0 len=0 2024-09-13T06:10:20.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.019+0000 7f082aa18980 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e385b31f80 con 0x55e385b2b960 2024-09-13T06:10:20.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.019+0000 7f0828528640 1 -- 172.21.15.194:0/3832246882 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0820079070 con 0x55e385b2b960 2024-09-13T06:10:20.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.019+0000 7f082aa18980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:20.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.019+0000 7f082aa18980 20 started sync module instance, tier type = 2024-09-13T06:10:20.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.019+0000 7f082aa18980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:10:20.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.019+0000 7f082aa18980 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e385b30ea0 con 0x7f0820072070 2024-09-13T06:10:20.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.023+0000 7f0827d27640 1 -- 172.21.15.194:0/3832246882 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(44 notify.0 [create] v35'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08100aaad0 con 0x7f0820072070 2024-09-13T06:10:20.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.023+0000 7f082aa18980 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94435689042576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e385b30b00 con 0x7f0820072070 2024-09-13T06:10:20.028 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.023+0000 7f082aa18980 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e385b32d40 con 0x55e385b26f70 2024-09-13T06:10:20.029 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.023+0000 7f0827d27640 1 -- 172.21.15.194:0/3832246882 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94435689042576] v35'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08100aaad0 con 0x7f0820072070 2024-09-13T06:10:20.029 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.023+0000 7f0828d29640 1 -- 172.21.15.194:0/3832246882 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v35'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08180083f0 con 0x55e385b26f70 2024-09-13T06:10:20.029 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.023+0000 7f082aa18980 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94435689047280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e385b33130 con 0x55e385b26f70 2024-09-13T06:10:20.029 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.023+0000 7f082aa18980 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e385b33af0 con 0x55e385b2b960 2024-09-13T06:10:20.029 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.027+0000 7f0828528640 1 -- 172.21.15.194:0/3832246882 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v35'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0820079070 con 0x55e385b2b960 2024-09-13T06:10:20.029 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.027+0000 7f082aa18980 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94435689051712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e385b34340 con 0x55e385b2b960 2024-09-13T06:10:20.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.027+0000 7f082aa18980 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e385b34d60 con 0x7f0820072070 2024-09-13T06:10:20.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.027+0000 7f0828d29640 1 -- 172.21.15.194:0/3832246882 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94435689047280] v35'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08180083f0 con 0x55e385b26f70 2024-09-13T06:10:20.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.027+0000 7f0827d27640 1 -- 172.21.15.194:0/3832246882 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(50 notify.3 [create] v35'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08100aaad0 con 0x7f0820072070 2024-09-13T06:10:20.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.027+0000 7f082aa18980 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94435689048464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e385b35600 con 0x7f0820072070 2024-09-13T06:10:20.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.027+0000 7f082aa18980 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e385b35e50 con 0x55e385b26f70 2024-09-13T06:10:20.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.027+0000 7f0828528640 1 -- 172.21.15.194:0/3832246882 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94435689051712] v35'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0820079070 con 0x55e385b2b960 2024-09-13T06:10:20.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.031+0000 7f0827d27640 1 -- 172.21.15.194:0/3832246882 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94435689048464] v35'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08100aaad0 con 0x7f0820072070 2024-09-13T06:10:20.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.031+0000 7f0828d29640 1 -- 172.21.15.194:0/3832246882 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v35'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08180083f0 con 0x55e385b26f70 2024-09-13T06:10:20.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.031+0000 7f082aa18980 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94435689058640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e385b35a20 con 0x55e385b26f70 2024-09-13T06:10:20.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.031+0000 7f082aa18980 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e385b366f0 con 0x7f08100e0040 2024-09-13T06:10:20.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.031+0000 7f0828d29640 1 -- 172.21.15.194:0/3832246882 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(54 notify.5 [create] v35'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08180083f0 con 0x7f08100e0040 2024-09-13T06:10:20.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.031+0000 7f082aa18980 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94435689062624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e385b35a20 con 0x7f08100e0040 2024-09-13T06:10:20.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.031+0000 7f0828d29640 1 -- 172.21.15.194:0/3832246882 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94435689058640] v35'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08180083f0 con 0x55e385b26f70 2024-09-13T06:10:20.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.031+0000 7f082aa18980 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e385b355b0 con 0x7f08100e0040 2024-09-13T06:10:20.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.035+0000 7f0828d29640 1 -- 172.21.15.194:0/3832246882 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94435689062624] v35'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08180083f0 con 0x7f08100e0040 2024-09-13T06:10:20.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.035+0000 7f0828d29640 1 -- 172.21.15.194:0/3832246882 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(56 notify.6 [create] v35'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08180083f0 con 0x7f08100e0040 2024-09-13T06:10:20.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.035+0000 7f082aa18980 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94435689059760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e385b359d0 con 0x7f08100e0040 2024-09-13T06:10:20.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.035+0000 7f082aa18980 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e385b37540 con 0x7f08100e0040 2024-09-13T06:10:20.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.035+0000 7f0828d29640 1 -- 172.21.15.194:0/3832246882 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94435689059760] v35'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08180083f0 con 0x7f08100e0040 2024-09-13T06:10:20.037 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.035+0000 7f0828d29640 1 -- 172.21.15.194:0/3832246882 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(58 notify.7 [create] v35'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08180083f0 con 0x7f08100e0040 2024-09-13T06:10:20.037 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.035+0000 7f082aa18980 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94435689065376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e385b37470 con 0x7f08100e0040 2024-09-13T06:10:20.037 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.035+0000 7f082aa18980 20 add_watcher() i=0 2024-09-13T06:10:20.037 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.035+0000 7f082aa18980 20 add_watcher() i=1 2024-09-13T06:10:20.037 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.035+0000 7f082aa18980 20 add_watcher() i=2 2024-09-13T06:10:20.037 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.035+0000 7f082aa18980 20 add_watcher() i=3 2024-09-13T06:10:20.037 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.035+0000 7f082aa18980 20 add_watcher() i=4 2024-09-13T06:10:20.037 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.035+0000 7f082aa18980 20 add_watcher() i=5 2024-09-13T06:10:20.037 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.035+0000 7f082aa18980 20 add_watcher() i=6 2024-09-13T06:10:20.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.039+0000 7f0828d29640 1 -- 172.21.15.194:0/3832246882 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94435689065376] v35'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08180083f0 con 0x7f08100e0040 2024-09-13T06:10:20.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.039+0000 7f082aa18980 20 add_watcher() i=7 2024-09-13T06:10:20.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.039+0000 7f082aa18980 2 all 8 watchers are set, enabling cache 2024-09-13T06:10:20.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.039+0000 7f082aa18980 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e385b3a980 con 0x55e385b26f70 2024-09-13T06:10:20.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.039+0000 7f0828d29640 1 -- 172.21.15.194:0/3832246882 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f08180083f0 con 0x55e385b26f70 2024-09-13T06:10:20.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.039+0000 7f082aa18980 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94435689066896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e385b37e40 con 0x55e385b26f70 2024-09-13T06:10:20.041 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.039+0000 7f0828d29640 1 -- 172.21.15.194:0/3832246882 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94435689066896] v35'189 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f08180083f0 con 0x55e385b26f70 2024-09-13T06:10:20.041 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.039+0000 7f06de7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:10:20.041 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.039+0000 7f082aa18980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:10:20.041 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.039+0000 7f082aa18980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:10:20.041 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.039+0000 7f082aa18980 5 note: GC not initialized 2024-09-13T06:10:20.041 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.039+0000 7f06dd7e2640 20 reqs_thread_entry: start 2024-09-13T06:10:20.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.039+0000 7f082aa18980 20 init_complete bucket index max shards: 11 2024-09-13T06:10:20.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.039+0000 7f082aa18980 20 Filter name: none 2024-09-13T06:10:20.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.039+0000 7f064effd640 20 reqs_thread_entry: start 2024-09-13T06:10:20.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.039+0000 7f082aa18980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T06:10:20.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.039+0000 7f082aa18980 20 rados->read ofs=0 len=0 2024-09-13T06:10:20.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.039+0000 7f082aa18980 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e385b5e010 con 0x55e385b26f70 2024-09-13T06:10:20.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.039+0000 7f0828d29640 1 -- 172.21.15.194:0/3832246882 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(62 foo [call out=48b,read 0~403 out=403b,getxattrs out=75b] v0'0 uv22 ondisk = 0) ==== 231+0+526 (crc 0 0 0) 0x7f08180083f0 con 0x55e385b26f70 2024-09-13T06:10:20.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.039+0000 7f082aa18980 20 rados_obj.operate() r=0 bl.length=403 2024-09-13T06:10:20.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.039+0000 7f082aa18980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T06:10:20.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.039+0000 7f082aa18980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:10:20.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.039+0000 7f082aa18980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:10:20.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.039+0000 7f082aa18980 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e385b64220 con 0x55e385b26f70 2024-09-13T06:10:20.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.043+0000 7f0828d29640 1 -- 172.21.15.194:0/3832246882 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v35'23 uv23 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f08180083f0 con 0x55e385b26f70 2024-09-13T06:10:20.044 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.043+0000 7f082aa18980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T06:10:20.044 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.043+0000 7f082aa18980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:10:20.044 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.043+0000 7f082aa18980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T06:10:20.044 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.043+0000 7f082aa18980 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94435689249936 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e385b62d70 con 0x55e385b26f70 2024-09-13T06:10:20.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.043+0000 7f0828d29640 1 -- 172.21.15.194:0/3832246882 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== watch-notify(notify (1) cookie 94435689058640 notify 150323855377 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f0818010040 con 0x55e385b26f70 2024-09-13T06:10:20.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.043+0000 7f07077fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855377 cookie 94435689058640 notifier 4661 bl.length()=567 2024-09-13T06:10:20.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.043+0000 7f07077fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T06:10:20.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.043+0000 7f07077fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:10:20.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.043+0000 7f07077fe640 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f06ec003eb0 con 0x55e385b26f70 2024-09-13T06:10:20.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.043+0000 7f0828d29640 1 -- 172.21.15.194:0/3832246882 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(64 notify.4 [notify cookie 94435689249936 out=8b] v0'0 uv183 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f08180083f0 con 0x55e385b26f70 2024-09-13T06:10:20.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.043+0000 7f0828d29640 1 -- 172.21.15.194:0/3832246882 <== osd.1 v2:172.21.15.194:6808/3135444559 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08180083f0 con 0x55e385b26f70 2024-09-13T06:10:20.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.043+0000 7f0828d29640 1 -- 172.21.15.194:0/3832246882 <== osd.1 v2:172.21.15.194:6808/3135444559 26 ==== watch-notify(notify_complete (2) cookie 94435689249936 notify 150323855377 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f081800bc30 con 0x55e385b26f70 2024-09-13T06:10:20.045 INFO:teuthology.orchestra.run.smithi194.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T06:09:53.191222Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:09:53.191207Z","tags":[],"group_ids":[]} 2024-09-13T06:10:20.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.043+0000 7f06de7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:10:20.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.043+0000 7f082aa18980 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94435689066896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e385b5be40 con 0x55e385b26f70 2024-09-13T06:10:20.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.047+0000 7f0828d29640 1 -- 172.21.15.194:0/3832246882 <== osd.1 v2:172.21.15.194:6808/3135444559 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94435689066896] v35'190 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f08180083f0 con 0x55e385b26f70 2024-09-13T06:10:20.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.047+0000 7f082aa18980 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94435689042576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e385b5be40 con 0x7f0820072070 2024-09-13T06:10:20.047 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.047+0000 7f0827d27640 1 -- 172.21.15.194:0/3832246882 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94435689042576] v35'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08100aaad0 con 0x7f0820072070 2024-09-13T06:10:20.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.047+0000 7f082aa18980 20 remove_watcher() i=0 2024-09-13T06:10:20.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.047+0000 7f082aa18980 2 removed watcher, disabling cache 2024-09-13T06:10:20.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.047+0000 7f082aa18980 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94435689047280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e385b5be40 con 0x55e385b26f70 2024-09-13T06:10:20.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.047+0000 7f0828d29640 1 -- 172.21.15.194:0/3832246882 <== osd.1 v2:172.21.15.194:6808/3135444559 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94435689047280] v35'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08180083f0 con 0x55e385b26f70 2024-09-13T06:10:20.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.047+0000 7f082aa18980 20 remove_watcher() i=1 2024-09-13T06:10:20.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.047+0000 7f082aa18980 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94435689051712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e385b5be40 con 0x55e385b2b960 2024-09-13T06:10:20.052 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.051+0000 7f0828528640 1 -- 172.21.15.194:0/3832246882 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94435689051712] v35'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0820079070 con 0x55e385b2b960 2024-09-13T06:10:20.052 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.051+0000 7f082aa18980 20 remove_watcher() i=2 2024-09-13T06:10:20.052 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.051+0000 7f082aa18980 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94435689048464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e385b5be40 con 0x7f0820072070 2024-09-13T06:10:20.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.051+0000 7f0827d27640 1 -- 172.21.15.194:0/3832246882 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94435689048464] v35'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08100aaad0 con 0x7f0820072070 2024-09-13T06:10:20.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.051+0000 7f082aa18980 20 remove_watcher() i=3 2024-09-13T06:10:20.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.051+0000 7f082aa18980 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94435689058640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e385b5be40 con 0x55e385b26f70 2024-09-13T06:10:20.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.055+0000 7f0828d29640 1 -- 172.21.15.194:0/3832246882 <== osd.1 v2:172.21.15.194:6808/3135444559 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94435689058640] v35'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08180083f0 con 0x55e385b26f70 2024-09-13T06:10:20.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.055+0000 7f082aa18980 20 remove_watcher() i=4 2024-09-13T06:10:20.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.055+0000 7f082aa18980 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94435689062624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e385b35150 con 0x7f08100e0040 2024-09-13T06:10:20.058 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.055+0000 7f0828d29640 1 -- 172.21.15.194:0/3832246882 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94435689062624] v35'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08180083f0 con 0x7f08100e0040 2024-09-13T06:10:20.058 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.055+0000 7f082aa18980 20 remove_watcher() i=5 2024-09-13T06:10:20.058 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.055+0000 7f082aa18980 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94435689059760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e385b5be40 con 0x7f08100e0040 2024-09-13T06:10:20.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.059+0000 7f0828d29640 1 -- 172.21.15.194:0/3832246882 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94435689059760] v35'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08180083f0 con 0x7f08100e0040 2024-09-13T06:10:20.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.059+0000 7f082aa18980 20 remove_watcher() i=6 2024-09-13T06:10:20.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.059+0000 7f082aa18980 1 -- 172.21.15.194:0/3832246882 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94435689065376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e385b5be40 con 0x7f08100e0040 2024-09-13T06:10:20.063 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.059+0000 7f0828d29640 1 -- 172.21.15.194:0/3832246882 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94435689065376] v35'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08180083f0 con 0x7f08100e0040 2024-09-13T06:10:20.063 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.063+0000 7f082aa18980 20 remove_watcher() i=7 2024-09-13T06:10:20.063 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.063+0000 7f082aa18980 1 -- 172.21.15.194:0/3832246882 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f08100e0040 msgr2=0x7f08100e0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:20.063 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.063+0000 7f082aa18980 1 --2- 172.21.15.194:0/3832246882 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f08100e0040 0x7f08100e0420 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:20.064 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.063+0000 7f082aa18980 1 -- 172.21.15.194:0/3832246882 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55e385b26f70 msgr2=0x55e385b29430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:20.064 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.063+0000 7f082aa18980 1 --2- 172.21.15.194:0/3832246882 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55e385b26f70 0x55e385b29430 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:20.064 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.063+0000 7f082aa18980 1 -- 172.21.15.194:0/3832246882 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f0820072070 msgr2=0x7f0820053790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:20.064 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.063+0000 7f082aa18980 1 --2- 172.21.15.194:0/3832246882 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f0820072070 0x7f0820053790 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:20.064 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.063+0000 7f082aa18980 1 -- 172.21.15.194:0/3832246882 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55e385b2b960 msgr2=0x55e385b2dd50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:20.064 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.063+0000 7f082aa18980 1 --2- 172.21.15.194:0/3832246882 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55e385b2b960 0x55e385b2dd50 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:20.064 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.063+0000 7f082aa18980 1 -- 172.21.15.194:0/3832246882 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f06f80345b0 msgr2=0x7f06f8036a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:20.064 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.063+0000 7f082aa18980 1 --2- 172.21.15.194:0/3832246882 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f06f80345b0 0x7f06f8036a70 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0810000c10 tx=0x7f08100c1040 comp rx=0 tx=0).stop 2024-09-13T06:10:20.064 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.063+0000 7f082aa18980 1 -- 172.21.15.194:0/3832246882 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e385b14d40 msgr2=0x55e385b1bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:20.064 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.063+0000 7f082aa18980 1 --2- 172.21.15.194:0/3832246882 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e385b14d40 0x55e385b1bf40 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f0820014ed0 tx=0x7f0820048360 comp rx=0 tx=0).stop 2024-09-13T06:10:20.064 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.063+0000 7f0828d29640 1 -- 172.21.15.194:0/3832246882 reap_dead start 2024-09-13T06:10:20.064 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.063+0000 7f0828d29640 1 -- 172.21.15.194:0/3832246882 reap_dead start 2024-09-13T06:10:20.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.063+0000 7f082aa18980 1 -- 172.21.15.194:0/3832246882 shutdown_connections 2024-09-13T06:10:20.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.063+0000 7f082aa18980 1 -- 172.21.15.194:0/3832246882 >> 172.21.15.194:0/3832246882 conn(0x55e385b11120 msgr2=0x55e385b0f1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:20.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.063+0000 7f082aa18980 1 -- 172.21.15.194:0/3832246882 shutdown_connections 2024-09-13T06:10:20.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.063+0000 7f082aa18980 1 -- 172.21.15.194:0/3832246882 wait complete. 2024-09-13T06:10:20.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.063+0000 7f082aa18980 1 -- 172.21.15.194:0/858925205 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0700034650 msgr2=0x7f0700036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:20.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.063+0000 7f082aa18980 1 --2- 172.21.15.194:0/858925205 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0700034650 0x7f0700036b10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x55e385af2080 tx=0x7f0810005ad0 comp rx=0 tx=0).stop 2024-09-13T06:10:20.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.063+0000 7f082aa18980 1 -- 172.21.15.194:0/858925205 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e385b08440 msgr2=0x55e385b08860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:20.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.063+0000 7f082aa18980 1 --2- 172.21.15.194:0/858925205 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e385b08440 0x55e385b08860 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f0820047f70 tx=0x7f082001df20 comp rx=0 tx=0).stop 2024-09-13T06:10:20.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.063+0000 7f082aa18980 1 -- 172.21.15.194:0/858925205 shutdown_connections 2024-09-13T06:10:20.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.063+0000 7f082aa18980 1 --2- 172.21.15.194:0/858925205 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0700034650 0x7f0700036b10 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:20.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.063+0000 7f082aa18980 1 --2- 172.21.15.194:0/858925205 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e385b08440 0x55e385b08860 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:20.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.063+0000 7f082aa18980 1 -- 172.21.15.194:0/858925205 >> 172.21.15.194:0/858925205 conn(0x55e385afd590 msgr2=0x55e385b00010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:20.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.063+0000 7f082aa18980 1 -- 172.21.15.194:0/858925205 shutdown_connections 2024-09-13T06:10:20.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.063+0000 7f082aa18980 1 -- 172.21.15.194:0/858925205 wait complete. 2024-09-13T06:10:20.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.063+0000 7f082aa18980 1 -- 172.21.15.194:0/1747940680 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55e385aef2c0 msgr2=0x55e385af16b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:20.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.063+0000 7f082aa18980 1 --2- 172.21.15.194:0/1747940680 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55e385aef2c0 0x55e385af16b0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:20.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.063+0000 7f082aa18980 1 -- 172.21.15.194:0/1747940680 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55e385af7e40 msgr2=0x55e385afa230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:20.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.063+0000 7f082aa18980 1 --2- 172.21.15.194:0/1747940680 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55e385af7e40 0x55e385afa230 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:20.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.063+0000 7f082aa18980 1 -- 172.21.15.194:0/1747940680 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55e385af3f00 msgr2=0x55e385af62f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:20.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.063+0000 7f082aa18980 1 --2- 172.21.15.194:0/1747940680 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55e385af3f00 0x55e385af62f0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:20.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.063+0000 7f082aa18980 1 -- 172.21.15.194:0/1747940680 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f07100346a0 msgr2=0x7f0710036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:20.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.063+0000 7f082aa18980 1 --2- 172.21.15.194:0/1747940680 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f07100346a0 0x7f0710036b60 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f08100ae000 tx=0x7f08100a6000 comp rx=0 tx=0).stop 2024-09-13T06:10:20.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.063+0000 7f082aa18980 1 -- 172.21.15.194:0/1747940680 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e3859fbea0 msgr2=0x55e385aea1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:20.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.063+0000 7f082aa18980 1 --2- 172.21.15.194:0/1747940680 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e3859fbea0 0x55e385aea1d0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f0820000f90 tx=0x7f0820001260 comp rx=0 tx=0).stop 2024-09-13T06:10:20.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.063+0000 7f0828d29640 1 -- 172.21.15.194:0/1747940680 reap_dead start 2024-09-13T06:10:20.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.063+0000 7f082aa18980 1 -- 172.21.15.194:0/1747940680 shutdown_connections 2024-09-13T06:10:20.068 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.063+0000 7f082aa18980 1 -- 172.21.15.194:0/1747940680 >> 172.21.15.194:0/1747940680 conn(0x55e3859f0070 msgr2=0x55e385add410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:20.068 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.063+0000 7f082aa18980 1 -- 172.21.15.194:0/1747940680 shutdown_connections 2024-09-13T06:10:20.068 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.063+0000 7f082aa18980 1 -- 172.21.15.194:0/1747940680 wait complete. 2024-09-13T06:10:20.075 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T06:09:53.191222Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:09:53.191207Z', 'tags': [], 'group_ids': []} 2024-09-13T06:10:20.097 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T06:10:20.098 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-13T06:10:20.098 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-13T06:10:20.098 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-13T06:10:20.156 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:10:20.156 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:10:20.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.155+0000 7f36ca069980 1 Processor -- start 2024-09-13T06:10:20.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.155+0000 7f36ca069980 1 -- start start 2024-09-13T06:10:20.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.155+0000 7f36ca069980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x562e1ea0e7c0 0x562e1ea0d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:20.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.155+0000 7f36ca069980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562e1e91fae0 con 0x562e1ea0e3b0 2024-09-13T06:10:20.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.155+0000 7f36ca069980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x562e1e943e30 con 0x562e1ea0e7c0 2024-09-13T06:10:20.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.155+0000 7f36c7378640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x562e1ea0e7c0 0x562e1ea0d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:20.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.155+0000 7f36c7b79640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x562e1ea0e3b0 0x562e1ea0cb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:59106/0 (socket says 172.21.15.194:59106) 2024-09-13T06:10:20.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.155+0000 7f36c7378640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x562e1ea0e7c0 0x562e1ea0d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:50912/0 (socket says 172.21.15.194:50912) 2024-09-13T06:10:20.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.155+0000 7f36c7b79640 1 -- 172.21.15.194:0/901234834 learned_addr learned my addr 172.21.15.194:0/901234834 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-09-13T06:10:20.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.159+0000 7f36c7378640 1 -- 172.21.15.194:0/901234834 >> v1:172.21.15.120:6789/0 conn(0x562e1ea0e3b0 legacy=0x562e1ea0cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:20.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.159+0000 7f36c7378640 1 -- 172.21.15.194:0/901234834 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e1ea0d8e0 con 0x562e1ea0e7c0 2024-09-13T06:10:20.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.159+0000 7f36c6b77640 1 -- 172.21.15.194:0/901234834 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1946176028 0 0) 0x562e1e91fae0 con 0x562e1ea0e3b0 2024-09-13T06:10:20.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.159+0000 7f36c7378640 1 --2- 172.21.15.194:0/901234834 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562e1ea0e7c0 0x562e1ea0d280 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f36bc00a480 tx=0x7f36bc01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb637e7df480ce02 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:20.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.159+0000 7f36c6b77640 1 -- 172.21.15.194:0/901234834 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36bc0b0070 con 0x562e1ea0e7c0 2024-09-13T06:10:20.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.159+0000 7f36c6b77640 1 -- 172.21.15.194:0/901234834 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36bc0ab540 con 0x562e1ea0e7c0 2024-09-13T06:10:20.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.159+0000 7f36c6b77640 1 -- 172.21.15.194:0/901234834 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36bc0ab840 con 0x562e1ea0e7c0 2024-09-13T06:10:20.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.159+0000 7f36ca069980 1 -- 172.21.15.194:0/901234834 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562e1ea0e7c0 msgr2=0x562e1ea0d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:20.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.159+0000 7f36ca069980 1 --2- 172.21.15.194:0/901234834 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562e1ea0e7c0 0x562e1ea0d280 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f36bc00a480 tx=0x7f36bc01b280 comp rx=0 tx=0).stop 2024-09-13T06:10:20.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.159+0000 7f36ca069980 1 -- 172.21.15.194:0/901234834 shutdown_connections 2024-09-13T06:10:20.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.159+0000 7f36ca069980 1 --2- 172.21.15.194:0/901234834 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562e1ea0e7c0 0x562e1ea0d280 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:20.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.159+0000 7f36ca069980 1 -- 172.21.15.194:0/901234834 >> 172.21.15.194:0/901234834 conn(0x562e1ea931b0 msgr2=0x562e1ea955d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:20.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.159+0000 7f36ca069980 1 -- 172.21.15.194:0/901234834 shutdown_connections 2024-09-13T06:10:20.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.159+0000 7f36ca069980 1 -- 172.21.15.194:0/901234834 wait complete. 2024-09-13T06:10:20.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.175+0000 7f36ca069980 1 Processor -- start 2024-09-13T06:10:20.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.175+0000 7f36ca069980 1 -- start start 2024-09-13T06:10:20.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.175+0000 7f36ca069980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562e1ea0e3b0 0x562e1eb849f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:20.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.175+0000 7f36ca069980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x562e1e945200 con 0x562e1ea0e3b0 2024-09-13T06:10:20.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.175+0000 7f36c7b79640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562e1ea0e3b0 0x562e1eb849f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:20.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.175+0000 7f36c7b79640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562e1ea0e3b0 0x562e1eb849f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:50928/0 (socket says 172.21.15.194:50928) 2024-09-13T06:10:20.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.175+0000 7f36c7b79640 1 -- 172.21.15.194:0/2781180523 learned_addr learned my addr 172.21.15.194:0/2781180523 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:20.179 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.179+0000 7f36c7b79640 1 -- 172.21.15.194:0/2781180523 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e1eb84fc0 con 0x562e1ea0e3b0 2024-09-13T06:10:20.179 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.179+0000 7f36c7b79640 1 --2- 172.21.15.194:0/2781180523 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562e1ea0e3b0 0x562e1eb849f0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f36b800b250 tx=0x7f36b800b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=833ac63d8271186e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:20.179 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.179+0000 7f35b5e0b640 1 -- 172.21.15.194:0/2781180523 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36b800d640 con 0x562e1ea0e3b0 2024-09-13T06:10:20.179 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.179+0000 7f35b5e0b640 1 -- 172.21.15.194:0/2781180523 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36b8008070 con 0x562e1ea0e3b0 2024-09-13T06:10:20.179 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.179+0000 7f35b5e0b640 1 -- 172.21.15.194:0/2781180523 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36b800d990 con 0x562e1ea0e3b0 2024-09-13T06:10:20.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.179+0000 7f36ca069980 1 -- 172.21.15.194:0/2781180523 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562e1ea0e3b0 msgr2=0x562e1eb849f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:20.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.179+0000 7f36ca069980 1 --2- 172.21.15.194:0/2781180523 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562e1ea0e3b0 0x562e1eb849f0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f36b800b250 tx=0x7f36b800b710 comp rx=0 tx=0).stop 2024-09-13T06:10:20.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.179+0000 7f36ca069980 1 -- 172.21.15.194:0/2781180523 shutdown_connections 2024-09-13T06:10:20.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.179+0000 7f36ca069980 1 --2- 172.21.15.194:0/2781180523 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562e1ea0e3b0 0x562e1eb849f0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:20.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.179+0000 7f36ca069980 1 -- 172.21.15.194:0/2781180523 >> 172.21.15.194:0/2781180523 conn(0x562e1ea931b0 msgr2=0x562e1eb80620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:20.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.179+0000 7f36ca069980 1 -- 172.21.15.194:0/2781180523 shutdown_connections 2024-09-13T06:10:20.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.179+0000 7f36ca069980 1 -- 172.21.15.194:0/2781180523 wait complete. 2024-09-13T06:10:20.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.179+0000 7f36ca069980 1 Processor -- start 2024-09-13T06:10:20.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.179+0000 7f36ca069980 1 -- start start 2024-09-13T06:10:20.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.179+0000 7f36ca069980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562e1ea0e3b0 0x562e1eb8bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:20.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.179+0000 7f36ca069980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x562e1eaa3200 con 0x562e1ea0e3b0 2024-09-13T06:10:20.182 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.179+0000 7f36c7b79640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562e1ea0e3b0 0x562e1eb8bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:20.182 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.179+0000 7f36c7b79640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562e1ea0e3b0 0x562e1eb8bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:50934/0 (socket says 172.21.15.194:50934) 2024-09-13T06:10:20.182 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.179+0000 7f36c7b79640 1 -- 172.21.15.194:0/207666300 learned_addr learned my addr 172.21.15.194:0/207666300 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:20.182 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.179+0000 7f36c7b79640 1 -- 172.21.15.194:0/207666300 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e1eb8c320 con 0x562e1ea0e3b0 2024-09-13T06:10:20.183 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.179+0000 7f36c7b79640 1 --2- 172.21.15.194:0/207666300 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562e1ea0e3b0 0x562e1eb8bde0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x562e1eb85bd0 tx=0x7f36b8000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:20.183 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.183+0000 7f35affff640 1 -- 172.21.15.194:0/207666300 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36b801a690 con 0x562e1ea0e3b0 2024-09-13T06:10:20.183 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.183+0000 7f36ca069980 1 -- 172.21.15.194:0/207666300 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562e1eb8c5b0 con 0x562e1ea0e3b0 2024-09-13T06:10:20.183 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.183+0000 7f35affff640 1 -- 172.21.15.194:0/207666300 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36b801a830 con 0x562e1ea0e3b0 2024-09-13T06:10:20.183 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.183+0000 7f35affff640 1 -- 172.21.15.194:0/207666300 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36b801ab50 con 0x562e1ea0e3b0 2024-09-13T06:10:20.183 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.183+0000 7f36ca069980 1 -- 172.21.15.194:0/207666300 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e1eb8f290 con 0x562e1ea0e3b0 2024-09-13T06:10:20.184 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.183+0000 7f35affff640 1 -- 172.21.15.194:0/207666300 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f36b8017070 con 0x562e1ea0e3b0 2024-09-13T06:10:20.184 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.183+0000 7f35affff640 1 --2- 172.21.15.194:0/207666300 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f35b0034630 0x7f35b0036af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:20.184 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.183+0000 7f35affff640 1 -- 172.21.15.194:0/207666300 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f36b8015020 con 0x562e1ea0e3b0 2024-09-13T06:10:20.185 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.183+0000 7f36c7378640 1 --2- 172.21.15.194:0/207666300 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f35b0034630 0x7f35b0036af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:20.185 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.183+0000 7f36ca069980 1 --2- 172.21.15.194:0/207666300 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x562e1ea0e7c0 0x562e1eb92dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:20.185 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.183+0000 7f36ca069980 1 -- 172.21.15.194:0/207666300 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562e1eb93410 con 0x562e1ea0e7c0 2024-09-13T06:10:20.185 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.183+0000 7f36c837a640 1 --2- 172.21.15.194:0/207666300 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x562e1ea0e7c0 0x562e1eb92dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:20.185 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.183+0000 7f36c7378640 1 --2- 172.21.15.194:0/207666300 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f35b0034630 0x7f35b0036af0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f36bc0ad000 tx=0x7f36bc0a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:20.186 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.183+0000 7f36c837a640 1 --2- 172.21.15.194:0/207666300 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x562e1ea0e7c0 0x562e1eb92dd0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:20.186 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.183+0000 7f36c837a640 1 -- 172.21.15.194:0/207666300 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f36c000a4d0 con 0x562e1ea0e7c0 2024-09-13T06:10:20.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.183+0000 7f36ca069980 1 -- 172.21.15.194:0/207666300 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562e1eb904b0 con 0x562e1ea0e7c0 2024-09-13T06:10:20.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.183+0000 7f36c837a640 1 -- 172.21.15.194:0/207666300 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f36c000a4d0 con 0x562e1ea0e7c0 2024-09-13T06:10:20.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.183+0000 7f36ca069980 1 --2- 172.21.15.194:0/207666300 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x562e1eb95740 0x562e1eb97b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:20.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.183+0000 7f36ca069980 1 -- 172.21.15.194:0/207666300 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562e1eb98200 con 0x562e1eb95740 2024-09-13T06:10:20.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.183+0000 7f36c7b79640 1 --2- 172.21.15.194:0/207666300 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x562e1eb95740 0x562e1eb97b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:20.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.183+0000 7f36c7b79640 1 --2- 172.21.15.194:0/207666300 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x562e1eb95740 0x562e1eb97b30 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:20.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.187+0000 7f36c7b79640 1 -- 172.21.15.194:0/207666300 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f36b802e070 con 0x562e1eb95740 2024-09-13T06:10:20.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.187+0000 7f36ca069980 1 -- 172.21.15.194:0/207666300 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562e1eb945e0 con 0x562e1ea0e7c0 2024-09-13T06:10:20.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.187+0000 7f36c837a640 1 -- 172.21.15.194:0/207666300 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f36c000a4d0 con 0x562e1ea0e7c0 2024-09-13T06:10:20.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.187+0000 7f36ca069980 1 --2- 172.21.15.194:0/207666300 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x562e1eb99640 0x562e1eb9ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:20.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.187+0000 7f36ca069980 1 -- 172.21.15.194:0/207666300 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562e1eb9c1c0 con 0x562e1eb99640 2024-09-13T06:10:20.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.187+0000 7f36c7378640 1 --2- 172.21.15.194:0/207666300 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x562e1eb99640 0x562e1eb9ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:20.188 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.187+0000 7f36c7378640 1 --2- 172.21.15.194:0/207666300 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x562e1eb99640 0x562e1eb9ba30 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:20.188 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.187+0000 7f36c7378640 1 -- 172.21.15.194:0/207666300 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f36bc0b3040 con 0x562e1eb99640 2024-09-13T06:10:20.188 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.187+0000 7f36ca069980 1 Processor -- start 2024-09-13T06:10:20.189 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.187+0000 7f36ca069980 1 -- start start 2024-09-13T06:10:20.189 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.187+0000 7f36ca069980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562e1eba9c50 0x562e1ebaa070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:20.189 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.187+0000 7f36ca069980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x562e1e99e800 con 0x562e1eba9c50 2024-09-13T06:10:20.189 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.187+0000 7f36c7b79640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562e1eba9c50 0x562e1ebaa070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:20.189 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.187+0000 7f36c7b79640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562e1eba9c50 0x562e1ebaa070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:50948/0 (socket says 172.21.15.194:50948) 2024-09-13T06:10:20.189 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.187+0000 7f36c7b79640 1 -- 172.21.15.194:0/3693892064 learned_addr learned my addr 172.21.15.194:0/3693892064 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:20.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.187+0000 7f36c7b79640 1 -- 172.21.15.194:0/3693892064 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e1ebaa5b0 con 0x562e1eba9c50 2024-09-13T06:10:20.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.187+0000 7f36c7b79640 1 --2- 172.21.15.194:0/3693892064 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562e1eba9c50 0x562e1ebaa070 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f36b8048ce0 tx=0x7f36b801b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:20.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.187+0000 7f35ad7fa640 1 -- 172.21.15.194:0/3693892064 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36b8042440 con 0x562e1eba9c50 2024-09-13T06:10:20.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.187+0000 7f35ad7fa640 1 -- 172.21.15.194:0/3693892064 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36b80425e0 con 0x562e1eba9c50 2024-09-13T06:10:20.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.187+0000 7f36ca069980 1 -- 172.21.15.194:0/3693892064 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562e1ebaa840 con 0x562e1eba9c50 2024-09-13T06:10:20.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.187+0000 7f35ad7fa640 1 -- 172.21.15.194:0/3693892064 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36b804a0b0 con 0x562e1eba9c50 2024-09-13T06:10:20.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.187+0000 7f36ca069980 1 -- 172.21.15.194:0/3693892064 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e1ebad4c0 con 0x562e1eba9c50 2024-09-13T06:10:20.191 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.191+0000 7f35ad7fa640 1 -- 172.21.15.194:0/3693892064 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f36b804a250 con 0x562e1eba9c50 2024-09-13T06:10:20.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.191+0000 7f35ad7fa640 1 --2- 172.21.15.194:0/3693892064 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f35a00346a0 0x7f35a0036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:20.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.191+0000 7f35ad7fa640 1 -- 172.21.15.194:0/3693892064 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f36b8010070 con 0x562e1eba9c50 2024-09-13T06:10:20.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.191+0000 7f36c7378640 1 --2- 172.21.15.194:0/3693892064 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f35a00346a0 0x7f35a0036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:20.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.191+0000 7f36ca069980 1 Processor -- start 2024-09-13T06:10:20.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.191+0000 7f36ca069980 1 -- start start 2024-09-13T06:10:20.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.191+0000 7f36c7378640 1 --2- 172.21.15.194:0/3693892064 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f35a00346a0 0x7f35a0036b60 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f36bc000c10 tx=0x7f36bc005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:20.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.191+0000 7f36ca069980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562e1ebb65f0 0x562e1ebb69d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:20.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.191+0000 7f36ca069980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x562e1eb85340 con 0x562e1ebb65f0 2024-09-13T06:10:20.193 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.191+0000 7f36c7b79640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562e1ebb65f0 0x562e1ebb69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:20.193 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.191+0000 7f36c7b79640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562e1ebb65f0 0x562e1ebb69d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:50956/0 (socket says 172.21.15.194:50956) 2024-09-13T06:10:20.193 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.191+0000 7f36c7b79640 1 -- 172.21.15.194:0/1984448039 learned_addr learned my addr 172.21.15.194:0/1984448039 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:20.194 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.191+0000 7f36c7b79640 1 -- 172.21.15.194:0/1984448039 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e1ebb6fa0 con 0x562e1ebb65f0 2024-09-13T06:10:20.194 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.191+0000 7f36c7b79640 1 --2- 172.21.15.194:0/1984448039 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562e1ebb65f0 0x562e1ebb69d0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f36b8020000 tx=0x7f36b8031f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aa52318b4b24d36 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:20.194 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.191+0000 7f35a6ffd640 1 -- 172.21.15.194:0/1984448039 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36b800f400 con 0x562e1ebb65f0 2024-09-13T06:10:20.194 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.191+0000 7f35a6ffd640 1 -- 172.21.15.194:0/1984448039 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36b800f920 con 0x562e1ebb65f0 2024-09-13T06:10:20.194 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.191+0000 7f35a6ffd640 1 -- 172.21.15.194:0/1984448039 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36b800f5a0 con 0x562e1ebb65f0 2024-09-13T06:10:20.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.191+0000 7f36ca069980 1 -- 172.21.15.194:0/1984448039 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562e1ebb65f0 msgr2=0x562e1ebb69d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:20.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.191+0000 7f36ca069980 1 --2- 172.21.15.194:0/1984448039 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562e1ebb65f0 0x562e1ebb69d0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f36b8020000 tx=0x7f36b8031f30 comp rx=0 tx=0).stop 2024-09-13T06:10:20.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.191+0000 7f36ca069980 1 -- 172.21.15.194:0/1984448039 shutdown_connections 2024-09-13T06:10:20.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.191+0000 7f36ca069980 1 --2- 172.21.15.194:0/1984448039 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562e1ebb65f0 0x562e1ebb69d0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:20.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.191+0000 7f36ca069980 1 -- 172.21.15.194:0/1984448039 >> 172.21.15.194:0/1984448039 conn(0x562e1ebb29d0 msgr2=0x562e1ebb0ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:20.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.191+0000 7f36ca069980 1 -- 172.21.15.194:0/1984448039 shutdown_connections 2024-09-13T06:10:20.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.191+0000 7f36ca069980 1 -- 172.21.15.194:0/1984448039 wait complete. 2024-09-13T06:10:20.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.195+0000 7f36ca069980 1 Processor -- start 2024-09-13T06:10:20.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.195+0000 7f36ca069980 1 -- start start 2024-09-13T06:10:20.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.195+0000 7f36ca069980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562e1ebb65f0 0x562e1ebbd770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:20.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.195+0000 7f36ca069980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x562e1ebb7440 con 0x562e1ebb65f0 2024-09-13T06:10:20.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.195+0000 7f36c7b79640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562e1ebb65f0 0x562e1ebbd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:20.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.195+0000 7f36c7b79640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562e1ebb65f0 0x562e1ebbd770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:50960/0 (socket says 172.21.15.194:50960) 2024-09-13T06:10:20.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.195+0000 7f36c7b79640 1 -- 172.21.15.194:0/3136383053 learned_addr learned my addr 172.21.15.194:0/3136383053 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:20.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.195+0000 7f36c7b79640 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e1ebbdcb0 con 0x562e1ebb65f0 2024-09-13T06:10:20.197 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.195+0000 7f36c7b79640 1 --2- 172.21.15.194:0/3136383053 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562e1ebb65f0 0x562e1ebbd770 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f36b800bc60 tx=0x7f36b8033f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:20.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.195+0000 7f35a57fa640 1 -- 172.21.15.194:0/3136383053 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36b806e070 con 0x562e1ebb65f0 2024-09-13T06:10:20.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.195+0000 7f35a57fa640 1 -- 172.21.15.194:0/3136383053 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36b800fad0 con 0x562e1ebb65f0 2024-09-13T06:10:20.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.195+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562e1ebbdcb0 con 0x562e1ebb65f0 2024-09-13T06:10:20.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.195+0000 7f35a57fa640 1 -- 172.21.15.194:0/3136383053 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36b8027430 con 0x562e1ebb65f0 2024-09-13T06:10:20.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.195+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e1ebbdcb0 con 0x562e1ebb65f0 2024-09-13T06:10:20.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.195+0000 7f35a57fa640 1 -- 172.21.15.194:0/3136383053 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f36b8071070 con 0x562e1ebb65f0 2024-09-13T06:10:20.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.195+0000 7f35a57fa640 1 --2- 172.21.15.194:0/3136383053 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3590034600 0x7f3590036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:20.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.195+0000 7f35a57fa640 1 -- 172.21.15.194:0/3136383053 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f36b8064070 con 0x562e1ebb65f0 2024-09-13T06:10:20.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.195+0000 7f36c7378640 1 --2- 172.21.15.194:0/3136383053 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3590034600 0x7f3590036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:20.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.195+0000 7f36ca069980 20 rados->read ofs=0 len=0 2024-09-13T06:10:20.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.195+0000 7f36ca069980 1 --2- 172.21.15.194:0/3136383053 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x562e1ebc8830 0x562e1ebcacf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:20.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.199+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebcb440 con 0x562e1ebc8830 2024-09-13T06:10:20.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.199+0000 7f36c837a640 1 --2- 172.21.15.194:0/3136383053 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x562e1ebc8830 0x562e1ebcacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:20.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.199+0000 7f36c7378640 1 --2- 172.21.15.194:0/3136383053 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3590034600 0x7f3590036ac0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f36bc0ab510 tx=0x7f36bc0b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:20.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.199+0000 7f36c837a640 1 --2- 172.21.15.194:0/3136383053 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x562e1ebc8830 0x562e1ebcacf0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:20.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.199+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f36c000a4d0 con 0x562e1ebc8830 2024-09-13T06:10:20.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.199+0000 7f36ca069980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:20.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.199+0000 7f36ca069980 20 realm 2024-09-13T06:10:20.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.199+0000 7f36ca069980 20 rados->read ofs=0 len=0 2024-09-13T06:10:20.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.199+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebcb850 con 0x562e1ebc8830 2024-09-13T06:10:20.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.199+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f36c000a4d0 con 0x562e1ebc8830 2024-09-13T06:10:20.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.199+0000 7f36ca069980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:20.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.199+0000 7f36ca069980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:10:20.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.199+0000 7f36ca069980 20 rados->read ofs=0 len=0 2024-09-13T06:10:20.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.199+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebcc120 con 0x562e1ebc8830 2024-09-13T06:10:20.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.199+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f36c000a4d0 con 0x562e1ebc8830 2024-09-13T06:10:20.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.199+0000 7f36ca069980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:20.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.199+0000 7f36ca069980 20 rados->read ofs=0 len=0 2024-09-13T06:10:20.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.199+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebcc4c0 con 0x562e1ebc8830 2024-09-13T06:10:20.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.199+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f36c000a4d0 con 0x562e1ebc8830 2024-09-13T06:10:20.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.199+0000 7f36ca069980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:10:20.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.199+0000 7f36ca069980 20 rados->read ofs=0 len=0 2024-09-13T06:10:20.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.199+0000 7f36ca069980 1 --2- 172.21.15.194:0/3136383053 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x562e1ebcd220 0x562e1ebcf610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:20.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.199+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebcfbe0 con 0x562e1ebcd220 2024-09-13T06:10:20.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.199+0000 7f36c7b79640 1 --2- 172.21.15.194:0/3136383053 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x562e1ebcd220 0x562e1ebcf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:20.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.199+0000 7f36c7b79640 1 --2- 172.21.15.194:0/3136383053 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x562e1ebcd220 0x562e1ebcf610 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:20.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.199+0000 7f36c7b79640 1 -- 172.21.15.194:0/3136383053 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f36b8070030 con 0x562e1ebcd220 2024-09-13T06:10:20.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.199+0000 7f36ca069980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:10:20.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.199+0000 7f36ca069980 20 searching for the correct realm 2024-09-13T06:10:20.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.199+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebd14b0 con 0x562e1ebcd220 2024-09-13T06:10:20.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.199+0000 7f36c7b79640 1 -- 172.21.15.194:0/3136383053 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36b8070030 con 0x562e1ebcd220 2024-09-13T06:10:20.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.199+0000 7f36c7b79640 1 --2- 172.21.15.194:0/3136383053 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f36b8073070 0x7f36b806f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:20.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.199+0000 7f36c7b79640 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebd14b0 con 0x7f36b8073070 2024-09-13T06:10:20.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.199+0000 7f36c7378640 1 --2- 172.21.15.194:0/3136383053 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f36b8073070 0x7f36b806f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:20.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.199+0000 7f36c7378640 1 --2- 172.21.15.194:0/3136383053 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f36b8073070 0x7f36b806f260 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:20.205 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.199+0000 7f36c7378640 1 -- 172.21.15.194:0/3136383053 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f36bc0c9030 con 0x7f36b8073070 2024-09-13T06:10:20.205 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.199+0000 7f36c7378640 1 --2- 172.21.15.194:0/3136383053 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f36bc0dc040 0x7f36bc0dd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:20.205 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.199+0000 7f36c7378640 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebd14b0 con 0x7f36bc0dc040 2024-09-13T06:10:20.205 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.203+0000 7f36c837a640 1 --2- 172.21.15.194:0/3136383053 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f36bc0dc040 0x7f36bc0dd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:20.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.203+0000 7f36c837a640 1 --2- 172.21.15.194:0/3136383053 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f36bc0dc040 0x7f36bc0dd430 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:20.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.203+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36c000a4d0 con 0x7f36bc0dc040 2024-09-13T06:10:20.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.203+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebcc4c0 con 0x562e1ebc8830 2024-09-13T06:10:20.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.203+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36c000a4d0 con 0x562e1ebc8830 2024-09-13T06:10:20.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.203+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebcc4c0 con 0x562e1ebc8830 2024-09-13T06:10:20.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.203+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36c000a4d0 con 0x562e1ebc8830 2024-09-13T06:10:20.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.203+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebcc4c0 con 0x7f36bc0dc040 2024-09-13T06:10:20.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.203+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36c000a4d0 con 0x7f36bc0dc040 2024-09-13T06:10:20.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.203+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebcc4c0 con 0x7f36bc0dc040 2024-09-13T06:10:20.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.203+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36c000a4d0 con 0x7f36bc0dc040 2024-09-13T06:10:20.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.203+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebcc4c0 con 0x7f36b8073070 2024-09-13T06:10:20.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.203+0000 7f36c7378640 1 -- 172.21.15.194:0/3136383053 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36bc0c9030 con 0x7f36b8073070 2024-09-13T06:10:20.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.203+0000 7f36c7378640 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebcc4c0 con 0x562e1ebcd220 2024-09-13T06:10:20.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.203+0000 7f36c7b79640 1 -- 172.21.15.194:0/3136383053 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36b8070030 con 0x562e1ebcd220 2024-09-13T06:10:20.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.203+0000 7f36c7b79640 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebcc4c0 con 0x562e1ebc8830 2024-09-13T06:10:20.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.203+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36c000a4d0 con 0x562e1ebc8830 2024-09-13T06:10:20.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.203+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebcc4c0 con 0x7f36bc0dc040 2024-09-13T06:10:20.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.207+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36c000a4d0 con 0x7f36bc0dc040 2024-09-13T06:10:20.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.207+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebcc4c0 con 0x562e1ebc8830 2024-09-13T06:10:20.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.207+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36c000a4d0 con 0x562e1ebc8830 2024-09-13T06:10:20.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.207+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebcc4c0 con 0x7f36b8073070 2024-09-13T06:10:20.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.207+0000 7f36c7378640 1 -- 172.21.15.194:0/3136383053 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f36bc0c9030 con 0x7f36b8073070 2024-09-13T06:10:20.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.207+0000 7f36c7378640 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebcc4c0 con 0x562e1ebcd220 2024-09-13T06:10:20.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.207+0000 7f36c7b79640 1 -- 172.21.15.194:0/3136383053 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36b8070030 con 0x562e1ebcd220 2024-09-13T06:10:20.212 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.207+0000 7f36c7b79640 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebcc4c0 con 0x562e1ebcd220 2024-09-13T06:10:20.212 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.207+0000 7f36c7b79640 1 -- 172.21.15.194:0/3136383053 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36b8070030 con 0x562e1ebcd220 2024-09-13T06:10:20.212 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.207+0000 7f36c7b79640 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebcc4c0 con 0x7f36bc0dc040 2024-09-13T06:10:20.212 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.207+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36c000a4d0 con 0x7f36bc0dc040 2024-09-13T06:10:20.212 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.207+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebcc4c0 con 0x562e1ebcd220 2024-09-13T06:10:20.212 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.207+0000 7f36c7b79640 1 -- 172.21.15.194:0/3136383053 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36b8070030 con 0x562e1ebcd220 2024-09-13T06:10:20.212 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.207+0000 7f36c7b79640 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebcc4c0 con 0x562e1ebcd220 2024-09-13T06:10:20.212 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.207+0000 7f36c7b79640 1 -- 172.21.15.194:0/3136383053 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36b8070030 con 0x562e1ebcd220 2024-09-13T06:10:20.213 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.207+0000 7f36c7b79640 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebcc4c0 con 0x562e1ebc8830 2024-09-13T06:10:20.213 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.207+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36c000a4d0 con 0x562e1ebc8830 2024-09-13T06:10:20.213 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.207+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebcc4c0 con 0x562e1ebc8830 2024-09-13T06:10:20.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.207+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f36c000a4d0 con 0x562e1ebc8830 2024-09-13T06:10:20.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.207+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebcc4c0 con 0x7f36b8073070 2024-09-13T06:10:20.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.207+0000 7f36c7378640 1 -- 172.21.15.194:0/3136383053 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36bc0c9030 con 0x7f36b8073070 2024-09-13T06:10:20.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.207+0000 7f36c7378640 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebcc4c0 con 0x562e1ebcd220 2024-09-13T06:10:20.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.211+0000 7f36c7b79640 1 -- 172.21.15.194:0/3136383053 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36b8070030 con 0x562e1ebcd220 2024-09-13T06:10:20.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.211+0000 7f36c7b79640 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebcc4c0 con 0x7f36b8073070 2024-09-13T06:10:20.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.211+0000 7f36c7378640 1 -- 172.21.15.194:0/3136383053 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36bc0c9030 con 0x7f36b8073070 2024-09-13T06:10:20.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.211+0000 7f36c7378640 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebcc4c0 con 0x562e1ebc8830 2024-09-13T06:10:20.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.211+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36c000a4d0 con 0x562e1ebc8830 2024-09-13T06:10:20.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.211+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebcc4c0 con 0x7f36bc0dc040 2024-09-13T06:10:20.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.211+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36c000a4d0 con 0x7f36bc0dc040 2024-09-13T06:10:20.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.211+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebcc4c0 con 0x562e1ebcd220 2024-09-13T06:10:20.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.211+0000 7f36c7b79640 1 -- 172.21.15.194:0/3136383053 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f36b8070030 con 0x562e1ebcd220 2024-09-13T06:10:20.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.211+0000 7f36c7b79640 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebcc4c0 con 0x7f36b8073070 2024-09-13T06:10:20.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.211+0000 7f36c7378640 1 -- 172.21.15.194:0/3136383053 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36bc0c9030 con 0x7f36b8073070 2024-09-13T06:10:20.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.211+0000 7f36c7378640 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebcc4c0 con 0x7f36b8073070 2024-09-13T06:10:20.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.211+0000 7f36c7378640 1 -- 172.21.15.194:0/3136383053 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36bc0c9030 con 0x7f36b8073070 2024-09-13T06:10:20.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.211+0000 7f36c7378640 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebcc4c0 con 0x562e1ebcd220 2024-09-13T06:10:20.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.211+0000 7f36c7b79640 1 -- 172.21.15.194:0/3136383053 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36b8070030 con 0x562e1ebcd220 2024-09-13T06:10:20.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.211+0000 7f36c7b79640 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebcc4c0 con 0x7f36bc0dc040 2024-09-13T06:10:20.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.211+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36c000a4d0 con 0x7f36bc0dc040 2024-09-13T06:10:20.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.211+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebcc4c0 con 0x562e1ebc8830 2024-09-13T06:10:20.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.211+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f36c000a4d0 con 0x562e1ebc8830 2024-09-13T06:10:20.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.211+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebcc4c0 con 0x7f36b8073070 2024-09-13T06:10:20.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.211+0000 7f36c7378640 1 -- 172.21.15.194:0/3136383053 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36bc0c9030 con 0x7f36b8073070 2024-09-13T06:10:20.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.211+0000 7f36ca069980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:10:20.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.211+0000 7f36ca069980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:10:20.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.211+0000 7f36ca069980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:10:20.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.211+0000 7f36ca069980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:10:20.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.211+0000 7f36ca069980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:10:20.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.211+0000 7f36ca069980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:10:20.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.211+0000 7f36ca069980 20 rados->read ofs=0 len=0 2024-09-13T06:10:20.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.211+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebd0600 con 0x562e1ebc8830 2024-09-13T06:10:20.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.215+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f36c000a4d0 con 0x562e1ebc8830 2024-09-13T06:10:20.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.215+0000 7f36ca069980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:20.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.215+0000 7f36ca069980 20 rados->read ofs=0 len=0 2024-09-13T06:10:20.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.215+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebd0ea0 con 0x562e1ebc8830 2024-09-13T06:10:20.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.215+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f36c000a4d0 con 0x562e1ebc8830 2024-09-13T06:10:20.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.215+0000 7f36ca069980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:10:20.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.215+0000 7f36ca069980 20 rados->read ofs=0 len=0 2024-09-13T06:10:20.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.215+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebd09f0 con 0x7f36b8073070 2024-09-13T06:10:20.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.215+0000 7f36c7378640 1 -- 172.21.15.194:0/3136383053 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f36bc0c9030 con 0x7f36b8073070 2024-09-13T06:10:20.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.215+0000 7f36ca069980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:10:20.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.215+0000 7f36ca069980 20 zone default found 2024-09-13T06:10:20.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.215+0000 7f36ca069980 4 Realm: () 2024-09-13T06:10:20.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.215+0000 7f36ca069980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:10:20.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.215+0000 7f36ca069980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:10:20.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.215+0000 7f36ca069980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:10:20.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.215+0000 7f36ca069980 20 zonegroup default 2024-09-13T06:10:20.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.215+0000 7f36ca069980 20 rados->read ofs=0 len=0 2024-09-13T06:10:20.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.215+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebd18e0 con 0x7f36bc0dc040 2024-09-13T06:10:20.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.215+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f36c000a4d0 con 0x7f36bc0dc040 2024-09-13T06:10:20.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.215+0000 7f36ca069980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:20.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.215+0000 7f36ca069980 20 rados->read ofs=0 len=0 2024-09-13T06:10:20.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.215+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebd32f0 con 0x562e1ebcd220 2024-09-13T06:10:20.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.215+0000 7f36c7b79640 1 -- 172.21.15.194:0/3136383053 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f36b8070030 con 0x562e1ebcd220 2024-09-13T06:10:20.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.215+0000 7f36ca069980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:20.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.215+0000 7f36ca069980 20 rados->read ofs=0 len=0 2024-09-13T06:10:20.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.215+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebd3800 con 0x562e1ebcd220 2024-09-13T06:10:20.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.215+0000 7f36c7b79640 1 -- 172.21.15.194:0/3136383053 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f36b8070030 con 0x562e1ebcd220 2024-09-13T06:10:20.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.215+0000 7f36ca069980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:20.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.215+0000 7f36ca069980 20 started sync module instance, tier type = 2024-09-13T06:10:20.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.215+0000 7f36ca069980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:10:20.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.215+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebd2760 con 0x7f36b8073070 2024-09-13T06:10:20.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.215+0000 7f36c7378640 1 -- 172.21.15.194:0/3136383053 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(44 notify.0 [create] v35'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36bc0c9030 con 0x7f36b8073070 2024-09-13T06:10:20.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.215+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94756084198224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebd4110 con 0x7f36b8073070 2024-09-13T06:10:20.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.215+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebd4960 con 0x562e1ebc8830 2024-09-13T06:10:20.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.219+0000 7f36c7378640 1 -- 172.21.15.194:0/3136383053 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94756084198224] v35'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36bc0c9030 con 0x7f36b8073070 2024-09-13T06:10:20.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.219+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v35'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36c000a4d0 con 0x562e1ebc8830 2024-09-13T06:10:20.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.219+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94756084202592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebd4960 con 0x562e1ebc8830 2024-09-13T06:10:20.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.219+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebd53d0 con 0x562e1ebcd220 2024-09-13T06:10:20.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.219+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94756084202592] v35'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36c000a4d0 con 0x562e1ebc8830 2024-09-13T06:10:20.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.223+0000 7f36c7b79640 1 -- 172.21.15.194:0/3136383053 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v35'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36b8070030 con 0x562e1ebcd220 2024-09-13T06:10:20.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.223+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94756084207264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebd5770 con 0x562e1ebcd220 2024-09-13T06:10:20.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.223+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebd6170 con 0x7f36b8073070 2024-09-13T06:10:20.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.223+0000 7f36c7378640 1 -- 172.21.15.194:0/3136383053 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(50 notify.3 [create] v35'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36bc0c9030 con 0x7f36b8073070 2024-09-13T06:10:20.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.223+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94756084210816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebd6a10 con 0x7f36b8073070 2024-09-13T06:10:20.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.223+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebd7450 con 0x562e1ebc8830 2024-09-13T06:10:20.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.223+0000 7f36c7b79640 1 -- 172.21.15.194:0/3136383053 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94756084207264] v35'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36b8070030 con 0x562e1ebcd220 2024-09-13T06:10:20.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.223+0000 7f36c7378640 1 -- 172.21.15.194:0/3136383053 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94756084210816] v35'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36bc0c9030 con 0x7f36b8073070 2024-09-13T06:10:20.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.223+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v35'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36c000a4d0 con 0x562e1ebc8830 2024-09-13T06:10:20.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.223+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94756084215584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebd6560 con 0x562e1ebc8830 2024-09-13T06:10:20.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.223+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebd7cf0 con 0x7f36bc0dc040 2024-09-13T06:10:20.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.227+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94756084215584] v35'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36c000a4d0 con 0x562e1ebc8830 2024-09-13T06:10:20.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.227+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(54 notify.5 [create] v35'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36c000a4d0 con 0x7f36bc0dc040 2024-09-13T06:10:20.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.227+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94756084204720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebd6560 con 0x7f36bc0dc040 2024-09-13T06:10:20.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.227+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebd8160 con 0x7f36bc0dc040 2024-09-13T06:10:20.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.227+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94756084204720] v35'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36c000a4d0 con 0x7f36bc0dc040 2024-09-13T06:10:20.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.227+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(56 notify.6 [create] v35'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36c000a4d0 con 0x7f36bc0dc040 2024-09-13T06:10:20.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.227+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94756084217488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebd8160 con 0x7f36bc0dc040 2024-09-13T06:10:20.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.227+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebd8b60 con 0x7f36bc0dc040 2024-09-13T06:10:20.232 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.231+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94756084217488] v35'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36c000a4d0 con 0x7f36bc0dc040 2024-09-13T06:10:20.232 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.231+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(58 notify.7 [create] v35'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36c000a4d0 con 0x7f36bc0dc040 2024-09-13T06:10:20.232 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.231+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94756084221552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebd8d40 con 0x7f36bc0dc040 2024-09-13T06:10:20.232 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.231+0000 7f36ca069980 20 add_watcher() i=0 2024-09-13T06:10:20.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.231+0000 7f36ca069980 20 add_watcher() i=1 2024-09-13T06:10:20.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.231+0000 7f36ca069980 20 add_watcher() i=2 2024-09-13T06:10:20.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.231+0000 7f36ca069980 20 add_watcher() i=3 2024-09-13T06:10:20.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.231+0000 7f36ca069980 20 add_watcher() i=4 2024-09-13T06:10:20.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.231+0000 7f36ca069980 20 add_watcher() i=5 2024-09-13T06:10:20.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.231+0000 7f36ca069980 20 add_watcher() i=6 2024-09-13T06:10:20.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.231+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94756084221552] v35'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36c000a4d0 con 0x7f36bc0dc040 2024-09-13T06:10:20.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.231+0000 7f36ca069980 20 add_watcher() i=7 2024-09-13T06:10:20.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.231+0000 7f36ca069980 2 all 8 watchers are set, enabling cache 2024-09-13T06:10:20.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.231+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebdc110 con 0x562e1ebc8830 2024-09-13T06:10:20.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.235+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f36c000a4d0 con 0x562e1ebc8830 2024-09-13T06:10:20.235 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.235+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94756084223024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebd9500 con 0x562e1ebc8830 2024-09-13T06:10:20.236 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.235+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94756084223024] v35'191 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f36c000a4d0 con 0x562e1ebc8830 2024-09-13T06:10:20.236 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.235+0000 7f357dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:10:20.236 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.235+0000 7f36ca069980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:10:20.236 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.235+0000 7f36ca069980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:10:20.236 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.235+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebe48a0 con 0x562e1ebc8830 2024-09-13T06:10:20.238 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.235+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v35'32 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f36c000a4d0 con 0x562e1ebc8830 2024-09-13T06:10:20.238 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.239+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebe4ef0 con 0x7f36bc0dc040 2024-09-13T06:10:20.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.239+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v35'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f36c000a4d0 con 0x7f36bc0dc040 2024-09-13T06:10:20.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.239+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebe5350 con 0x562e1ebcd220 2024-09-13T06:10:20.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.239+0000 7f36c7b79640 1 -- 172.21.15.194:0/3136383053 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v35'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f36b8070030 con 0x562e1ebcd220 2024-09-13T06:10:20.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.239+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebe5290 con 0x562e1ebc8830 2024-09-13T06:10:20.242 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.243+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v35'192 uv164 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f36c000a4d0 con 0x562e1ebc8830 2024-09-13T06:10:20.242 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.243+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebe5840 con 0x7f36b8073070 2024-09-13T06:10:20.243 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.243+0000 7f36c7378640 1 -- 172.21.15.194:0/3136383053 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v35'65 uv53 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f36bc0c9030 con 0x7f36b8073070 2024-09-13T06:10:20.244 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.243+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebe5cf0 con 0x562e1ebcd220 2024-09-13T06:10:20.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.243+0000 7f36c7b79640 1 -- 172.21.15.194:0/3136383053 <== osd.3 v2:172.21.15.194:6816/96632515 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v35'44 uv37 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f36b8070030 con 0x562e1ebcd220 2024-09-13T06:10:20.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.243+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebe5cf0 con 0x562e1ebc8830 2024-09-13T06:10:20.247 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.247+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v35'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f36c000a4d0 con 0x562e1ebc8830 2024-09-13T06:10:20.247 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.247+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebe5cf0 con 0x7f36bc0dc040 2024-09-13T06:10:20.249 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.247+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v35'43 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f36c000a4d0 con 0x7f36bc0dc040 2024-09-13T06:10:20.249 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.247+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebe5cf0 con 0x7f36b8073070 2024-09-13T06:10:20.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.251+0000 7f36c7378640 1 -- 172.21.15.194:0/3136383053 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v35'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f36bc0c9030 con 0x7f36b8073070 2024-09-13T06:10:20.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.251+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebe62e0 con 0x562e1ebcd220 2024-09-13T06:10:20.252 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.251+0000 7f36c7b79640 1 -- 172.21.15.194:0/3136383053 <== osd.3 v2:172.21.15.194:6816/96632515 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v35'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f36b8070030 con 0x562e1ebcd220 2024-09-13T06:10:20.252 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.251+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebe62e0 con 0x7f36b8073070 2024-09-13T06:10:20.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.251+0000 7f36c7378640 1 -- 172.21.15.194:0/3136383053 <== osd.2 v2:172.21.15.194:6800/815615585 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v35'66 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f36bc0c9030 con 0x7f36b8073070 2024-09-13T06:10:20.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.251+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebe6850 con 0x7f36bc0dc040 2024-09-13T06:10:20.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.255+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v35'29 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f36c000a4d0 con 0x7f36bc0dc040 2024-09-13T06:10:20.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.255+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebe6850 con 0x7f36b8073070 2024-09-13T06:10:20.256 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.255+0000 7f36c7378640 1 -- 172.21.15.194:0/3136383053 <== osd.2 v2:172.21.15.194:6800/815615585 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v35'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f36bc0c9030 con 0x7f36b8073070 2024-09-13T06:10:20.257 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.255+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebe6ab0 con 0x7f36bc0dc040 2024-09-13T06:10:20.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.259+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v35'49 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f36c000a4d0 con 0x7f36bc0dc040 2024-09-13T06:10:20.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.259+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebe6a80 con 0x562e1ebc8830 2024-09-13T06:10:20.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.259+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v35'193 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f36c000a4d0 con 0x562e1ebc8830 2024-09-13T06:10:20.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.259+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebe6a80 con 0x562e1ebcd220 2024-09-13T06:10:20.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.259+0000 7f36c7b79640 1 -- 172.21.15.194:0/3136383053 <== osd.3 v2:172.21.15.194:6816/96632515 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v35'59 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f36b8070030 con 0x562e1ebcd220 2024-09-13T06:10:20.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.259+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebe6a80 con 0x7f36b8073070 2024-09-13T06:10:20.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.263+0000 7f36c7378640 1 -- 172.21.15.194:0/3136383053 <== osd.2 v2:172.21.15.194:6800/815615585 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v35'67 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f36bc0c9030 con 0x7f36b8073070 2024-09-13T06:10:20.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.263+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebe6a80 con 0x562e1ebcd220 2024-09-13T06:10:20.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.263+0000 7f36c7b79640 1 -- 172.21.15.194:0/3136383053 <== osd.3 v2:172.21.15.194:6816/96632515 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v35'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f36b8070030 con 0x562e1ebcd220 2024-09-13T06:10:20.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.263+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebe6a80 con 0x562e1ebc8830 2024-09-13T06:10:20.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.267+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 <== osd.1 v2:172.21.15.194:6808/3135444559 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v35'33 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f36c000a4d0 con 0x562e1ebc8830 2024-09-13T06:10:20.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.267+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebe6a80 con 0x562e1ebc8830 2024-09-13T06:10:20.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.267+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 <== osd.1 v2:172.21.15.194:6808/3135444559 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v35'194 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f36c000a4d0 con 0x562e1ebc8830 2024-09-13T06:10:20.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.267+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebe6a80 con 0x562e1ebcd220 2024-09-13T06:10:20.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.267+0000 7f36c7b79640 1 -- 172.21.15.194:0/3136383053 <== osd.3 v2:172.21.15.194:6816/96632515 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v35'60 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f36b8070030 con 0x562e1ebcd220 2024-09-13T06:10:20.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.267+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebe6a80 con 0x7f36b8073070 2024-09-13T06:10:20.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.271+0000 7f36c7378640 1 -- 172.21.15.194:0/3136383053 <== osd.2 v2:172.21.15.194:6800/815615585 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v35'35 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f36bc0c9030 con 0x7f36b8073070 2024-09-13T06:10:20.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.271+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebe6a80 con 0x562e1ebcd220 2024-09-13T06:10:20.272 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.271+0000 7f36c7b79640 1 -- 172.21.15.194:0/3136383053 <== osd.3 v2:172.21.15.194:6816/96632515 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v35'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f36b8070030 con 0x562e1ebcd220 2024-09-13T06:10:20.272 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.271+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebe6a80 con 0x562e1ebcd220 2024-09-13T06:10:20.273 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.271+0000 7f36c7b79640 1 -- 172.21.15.194:0/3136383053 <== osd.3 v2:172.21.15.194:6816/96632515 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v35'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f36b8070030 con 0x562e1ebcd220 2024-09-13T06:10:20.273 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.271+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebe6a80 con 0x562e1ebcd220 2024-09-13T06:10:20.274 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.275+0000 7f36c7b79640 1 -- 172.21.15.194:0/3136383053 <== osd.3 v2:172.21.15.194:6816/96632515 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v35'21 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f36b8070030 con 0x562e1ebcd220 2024-09-13T06:10:20.274 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.275+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebe6a80 con 0x562e1ebcd220 2024-09-13T06:10:20.276 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.275+0000 7f36c7b79640 1 -- 172.21.15.194:0/3136383053 <== osd.3 v2:172.21.15.194:6816/96632515 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v35'45 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f36b8070030 con 0x562e1ebcd220 2024-09-13T06:10:20.276 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.275+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebe6a80 con 0x7f36bc0dc040 2024-09-13T06:10:20.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.275+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v35'29 uv25 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f36c000a4d0 con 0x7f36bc0dc040 2024-09-13T06:10:20.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.279+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebe6a80 con 0x562e1ebcd220 2024-09-13T06:10:20.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.279+0000 7f36c7b79640 1 -- 172.21.15.194:0/3136383053 <== osd.3 v2:172.21.15.194:6816/96632515 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v35'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f36b8070030 con 0x562e1ebcd220 2024-09-13T06:10:20.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.279+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebe6a80 con 0x7f36bc0dc040 2024-09-13T06:10:20.281 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.279+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 <== osd.0 v2:172.21.15.120:6800/1923744619 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v35'44 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f36c000a4d0 con 0x7f36bc0dc040 2024-09-13T06:10:20.281 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.279+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebe6a80 con 0x562e1ebcd220 2024-09-13T06:10:20.283 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.283+0000 7f36c7b79640 1 -- 172.21.15.194:0/3136383053 <== osd.3 v2:172.21.15.194:6816/96632515 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v35'61 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f36b8070030 con 0x562e1ebcd220 2024-09-13T06:10:20.284 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.283+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebe6a80 con 0x7f36bc0dc040 2024-09-13T06:10:20.286 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.283+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 <== osd.0 v2:172.21.15.120:6800/1923744619 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v35'50 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f36c000a4d0 con 0x7f36bc0dc040 2024-09-13T06:10:20.286 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.283+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebe6a80 con 0x7f36b8073070 2024-09-13T06:10:20.288 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.287+0000 7f36c7378640 1 -- 172.21.15.194:0/3136383053 <== osd.2 v2:172.21.15.194:6800/815615585 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v35'32 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f36bc0c9030 con 0x7f36b8073070 2024-09-13T06:10:20.289 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.287+0000 7f357cfe1640 20 reqs_thread_entry: start 2024-09-13T06:10:20.290 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.287+0000 7f36ca069980 20 init_complete bucket index max shards: 11 2024-09-13T06:10:20.290 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.287+0000 7f36ca069980 20 Filter name: none 2024-09-13T06:10:20.290 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.287+0000 7f34f67fc640 20 reqs_thread_entry: start 2024-09-13T06:10:20.290 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.287+0000 7f36ca069980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T06:10:20.290 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.287+0000 7f36ca069980 20 rados->read ofs=0 len=0 2024-09-13T06:10:20.290 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.287+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebe2c90 con 0x562e1ebc8830 2024-09-13T06:10:20.290 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.287+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 <== osd.1 v2:172.21.15.194:6808/3135444559 27 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv23 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f36c000a4d0 con 0x562e1ebc8830 2024-09-13T06:10:20.290 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.287+0000 7f36ca069980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T06:10:20.290 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.287+0000 7f36ca069980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T06:10:20.290 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.287+0000 7f36ca069980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:10:20.290 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.287+0000 7f36ca069980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:10:20.290 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.287+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebe2720 con 0x7f36b8073070 2024-09-13T06:10:20.291 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.287+0000 7f36c7378640 1 -- 172.21.15.194:0/3136383053 <== osd.2 v2:172.21.15.194:6800/815615585 21 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv41 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f36bc0c9030 con 0x7f36b8073070 2024-09-13T06:10:20.291 INFO:teuthology.orchestra.run.smithi194.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-13T06:10:20.291 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.291+0000 7f357dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:10:20.291 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.291+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94756084223024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebde540 con 0x562e1ebc8830 2024-09-13T06:10:20.292 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.291+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 <== osd.1 v2:172.21.15.194:6808/3135444559 28 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94756084223024] v35'195 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f36c000a4d0 con 0x562e1ebc8830 2024-09-13T06:10:20.292 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.291+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94756084198224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebd8c30 con 0x7f36b8073070 2024-09-13T06:10:20.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.291+0000 7f36c7378640 1 -- 172.21.15.194:0/3136383053 <== osd.2 v2:172.21.15.194:6800/815615585 22 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94756084198224] v35'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36bc0c9030 con 0x7f36b8073070 2024-09-13T06:10:20.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.291+0000 7f36ca069980 20 remove_watcher() i=0 2024-09-13T06:10:20.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.291+0000 7f36ca069980 2 removed watcher, disabling cache 2024-09-13T06:10:20.294 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.291+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94756084202592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebd8c30 con 0x562e1ebc8830 2024-09-13T06:10:20.295 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.295+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 <== osd.1 v2:172.21.15.194:6808/3135444559 29 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94756084202592] v35'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36c000a4d0 con 0x562e1ebc8830 2024-09-13T06:10:20.295 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.295+0000 7f36ca069980 20 remove_watcher() i=1 2024-09-13T06:10:20.295 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.295+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94756084207264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebd8c30 con 0x562e1ebcd220 2024-09-13T06:10:20.297 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.295+0000 7f36c7b79640 1 -- 172.21.15.194:0/3136383053 <== osd.3 v2:172.21.15.194:6816/96632515 27 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94756084207264] v35'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36b8070030 con 0x562e1ebcd220 2024-09-13T06:10:20.298 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.295+0000 7f36ca069980 20 remove_watcher() i=2 2024-09-13T06:10:20.298 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.295+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94756084210816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebd8c30 con 0x7f36b8073070 2024-09-13T06:10:20.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.299+0000 7f36c7378640 1 -- 172.21.15.194:0/3136383053 <== osd.2 v2:172.21.15.194:6800/815615585 23 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94756084210816] v35'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36bc0c9030 con 0x7f36b8073070 2024-09-13T06:10:20.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.299+0000 7f36ca069980 20 remove_watcher() i=3 2024-09-13T06:10:20.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.299+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94756084215584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebd8c30 con 0x562e1ebc8830 2024-09-13T06:10:20.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.299+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 <== osd.1 v2:172.21.15.194:6808/3135444559 30 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94756084215584] v35'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36c000a4d0 con 0x562e1ebc8830 2024-09-13T06:10:20.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.299+0000 7f36ca069980 20 remove_watcher() i=4 2024-09-13T06:10:20.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.299+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94756084204720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebd8c30 con 0x7f36bc0dc040 2024-09-13T06:10:20.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.303+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 <== osd.0 v2:172.21.15.120:6800/1923744619 22 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94756084204720] v35'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36c000a4d0 con 0x7f36bc0dc040 2024-09-13T06:10:20.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.303+0000 7f36ca069980 20 remove_watcher() i=5 2024-09-13T06:10:20.303 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.303+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94756084217488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebd44b0 con 0x7f36bc0dc040 2024-09-13T06:10:20.304 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.303+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 <== osd.0 v2:172.21.15.120:6800/1923744619 23 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94756084217488] v35'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36c000a4d0 con 0x7f36bc0dc040 2024-09-13T06:10:20.304 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.303+0000 7f36ca069980 20 remove_watcher() i=6 2024-09-13T06:10:20.304 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.303+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94756084221552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562e1ebd8c30 con 0x7f36bc0dc040 2024-09-13T06:10:20.308 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.307+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 <== osd.0 v2:172.21.15.120:6800/1923744619 24 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94756084221552] v35'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36c000a4d0 con 0x7f36bc0dc040 2024-09-13T06:10:20.309 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.307+0000 7f36ca069980 20 remove_watcher() i=7 2024-09-13T06:10:20.309 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.307+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f36bc0dc040 msgr2=0x7f36bc0dd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:20.309 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.307+0000 7f36ca069980 1 --2- 172.21.15.194:0/3136383053 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f36bc0dc040 0x7f36bc0dd430 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:20.309 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.307+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x562e1ebc8830 msgr2=0x562e1ebcacf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:20.309 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.307+0000 7f36ca069980 1 --2- 172.21.15.194:0/3136383053 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x562e1ebc8830 0x562e1ebcacf0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:20.309 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.307+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f36b8073070 msgr2=0x7f36b806f260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:20.309 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.307+0000 7f36ca069980 1 --2- 172.21.15.194:0/3136383053 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f36b8073070 0x7f36b806f260 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:20.309 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.307+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x562e1ebcd220 msgr2=0x562e1ebcf610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:20.309 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.307+0000 7f36ca069980 1 --2- 172.21.15.194:0/3136383053 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x562e1ebcd220 0x562e1ebcf610 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:20.309 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.307+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3590034600 msgr2=0x7f3590036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:20.309 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.307+0000 7f36ca069980 1 --2- 172.21.15.194:0/3136383053 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3590034600 0x7f3590036ac0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f36bc0ab510 tx=0x7f36bc0b9040 comp rx=0 tx=0).stop 2024-09-13T06:10:20.309 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.307+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562e1ebb65f0 msgr2=0x562e1ebbd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:20.310 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.307+0000 7f36c837a640 1 -- 172.21.15.194:0/3136383053 reap_dead start 2024-09-13T06:10:20.310 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.307+0000 7f36ca069980 1 --2- 172.21.15.194:0/3136383053 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562e1ebb65f0 0x562e1ebbd770 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f36b800bc60 tx=0x7f36b8033f10 comp rx=0 tx=0).stop 2024-09-13T06:10:20.310 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.307+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 shutdown_connections 2024-09-13T06:10:20.310 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.307+0000 7f36ca069980 1 --2- 172.21.15.194:0/3136383053 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562e1ebb65f0 0x562e1ebbd770 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:20.310 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.307+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 >> 172.21.15.194:0/3136383053 conn(0x562e1ebb29d0 msgr2=0x562e1ebb0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:20.310 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.307+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 shutdown_connections 2024-09-13T06:10:20.310 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.307+0000 7f36ca069980 1 -- 172.21.15.194:0/3136383053 wait complete. 2024-09-13T06:10:20.310 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.307+0000 7f36ca069980 1 -- 172.21.15.194:0/3693892064 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f35a00346a0 msgr2=0x7f35a0036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:20.310 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.307+0000 7f36ca069980 1 --2- 172.21.15.194:0/3693892064 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f35a00346a0 0x7f35a0036b60 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f36bc000c10 tx=0x7f36bc005a10 comp rx=0 tx=0).stop 2024-09-13T06:10:20.310 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.307+0000 7f36ca069980 1 -- 172.21.15.194:0/3693892064 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562e1eba9c50 msgr2=0x562e1ebaa070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:20.310 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.307+0000 7f36ca069980 1 --2- 172.21.15.194:0/3693892064 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562e1eba9c50 0x562e1ebaa070 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f36b8048ce0 tx=0x7f36b801b810 comp rx=0 tx=0).stop 2024-09-13T06:10:20.310 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.307+0000 7f36ca069980 1 -- 172.21.15.194:0/3693892064 shutdown_connections 2024-09-13T06:10:20.311 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.307+0000 7f36ca069980 1 --2- 172.21.15.194:0/3693892064 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f35a00346a0 0x7f35a0036b60 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:20.311 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.307+0000 7f36ca069980 1 --2- 172.21.15.194:0/3693892064 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562e1eba9c50 0x562e1ebaa070 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:20.311 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.307+0000 7f36ca069980 1 -- 172.21.15.194:0/3693892064 >> 172.21.15.194:0/3693892064 conn(0x562e1eb9eda0 msgr2=0x562e1eba1820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:20.311 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.307+0000 7f36ca069980 1 -- 172.21.15.194:0/3693892064 shutdown_connections 2024-09-13T06:10:20.311 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.307+0000 7f36ca069980 1 -- 172.21.15.194:0/3693892064 wait complete. 2024-09-13T06:10:20.311 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.307+0000 7f36ca069980 1 -- 172.21.15.194:0/207666300 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x562e1ea0e7c0 msgr2=0x562e1eb92dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:20.311 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.307+0000 7f36ca069980 1 --2- 172.21.15.194:0/207666300 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x562e1ea0e7c0 0x562e1eb92dd0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:20.311 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.307+0000 7f36ca069980 1 -- 172.21.15.194:0/207666300 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x562e1eb99640 msgr2=0x562e1eb9ba30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:20.311 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.307+0000 7f36ca069980 1 --2- 172.21.15.194:0/207666300 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x562e1eb99640 0x562e1eb9ba30 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:20.311 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.307+0000 7f36ca069980 1 -- 172.21.15.194:0/207666300 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x562e1eb95740 msgr2=0x562e1eb97b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:20.311 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.307+0000 7f36ca069980 1 --2- 172.21.15.194:0/207666300 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x562e1eb95740 0x562e1eb97b30 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:20.311 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.307+0000 7f36ca069980 1 -- 172.21.15.194:0/207666300 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f35b0034630 msgr2=0x7f35b0036af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:20.311 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.307+0000 7f36ca069980 1 --2- 172.21.15.194:0/207666300 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f35b0034630 0x7f35b0036af0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f36bc0ad000 tx=0x7f36bc0a5040 comp rx=0 tx=0).stop 2024-09-13T06:10:20.312 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.307+0000 7f36ca069980 1 -- 172.21.15.194:0/207666300 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562e1ea0e3b0 msgr2=0x562e1eb8bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:20.312 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.307+0000 7f36ca069980 1 --2- 172.21.15.194:0/207666300 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562e1ea0e3b0 0x562e1eb8bde0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x562e1eb85bd0 tx=0x7f36b8000ee0 comp rx=0 tx=0).stop 2024-09-13T06:10:20.312 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.307+0000 7f36c837a640 1 -- 172.21.15.194:0/207666300 reap_dead start 2024-09-13T06:10:20.312 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.307+0000 7f36ca069980 1 -- 172.21.15.194:0/207666300 shutdown_connections 2024-09-13T06:10:20.312 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.307+0000 7f36ca069980 1 -- 172.21.15.194:0/207666300 >> 172.21.15.194:0/207666300 conn(0x562e1ea931b0 msgr2=0x562e1eb7f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:20.312 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.307+0000 7f36ca069980 1 -- 172.21.15.194:0/207666300 shutdown_connections 2024-09-13T06:10:20.312 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:20.307+0000 7f36ca069980 1 -- 172.21.15.194:0/207666300 wait complete. 2024-09-13T06:10:20.319 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-13T06:10:20.344 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T06:10:20.350 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-09-13T06:10:55.351 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--categories', 'delete_obj'] 2024-09-13T06:10:55.352 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--categories', 'delete_obj'] 2024-09-13T06:10:55.352 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --categories delete_obj 2024-09-13T06:10:55.392 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:10:55.392 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:10:55.393 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.389+0000 7fbf1e7df980 1 Processor -- start 2024-09-13T06:10:55.393 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.389+0000 7fbf1e7df980 1 -- start start 2024-09-13T06:10:55.393 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.389+0000 7fbf1e7df980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x555f9a623b90 0x555f9a622350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:55.393 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.389+0000 7fbf1e7df980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555f9a535ae0 con 0x555f9a623fa0 2024-09-13T06:10:55.393 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.389+0000 7fbf1e7df980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x555f9a559e30 con 0x555f9a623b90 2024-09-13T06:10:55.394 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.389+0000 7fbf1c2ef640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x555f9a623b90 0x555f9a622350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:55.394 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.389+0000 7fbf1baee640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x555f9a623fa0 0x555f9a622890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:34366/0 (socket says 172.21.15.194:34366) 2024-09-13T06:10:55.395 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.389+0000 7fbf1baee640 1 -- 172.21.15.194:0/2740516516 learned_addr learned my addr 172.21.15.194:0/2740516516 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-09-13T06:10:55.395 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.389+0000 7fbf1b2ed640 1 -- 172.21.15.194:0/2740516516 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1014720711 0 0) 0x555f9a535ae0 con 0x555f9a623fa0 2024-09-13T06:10:55.395 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.389+0000 7fbf1b2ed640 1 -- 172.21.15.194:0/2740516516 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf04001e20 con 0x555f9a623fa0 2024-09-13T06:10:55.395 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.389+0000 7fbf1c2ef640 1 -- 172.21.15.194:0/2740516516 >> v1:172.21.15.120:6789/0 conn(0x555f9a623fa0 legacy=0x555f9a622890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:55.395 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.389+0000 7fbf1c2ef640 1 -- 172.21.15.194:0/2740516516 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f9a6230c0 con 0x555f9a623b90 2024-09-13T06:10:55.397 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.393+0000 7fbf1c2ef640 1 --2- 172.21.15.194:0/2740516516 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555f9a623b90 0x555f9a622350 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c00a480 tx=0x7fbf0c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c57840901dcfb4ab server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:55.398 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.393+0000 7fbf1b2ed640 1 -- 172.21.15.194:0/2740516516 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf0c0b0070 con 0x555f9a623b90 2024-09-13T06:10:55.398 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.393+0000 7fbf1b2ed640 1 -- 172.21.15.194:0/2740516516 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf0c0ab540 con 0x555f9a623b90 2024-09-13T06:10:55.398 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.393+0000 7fbf1b2ed640 1 -- 172.21.15.194:0/2740516516 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf0c0ab820 con 0x555f9a623b90 2024-09-13T06:10:55.399 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.393+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2740516516 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555f9a623b90 msgr2=0x555f9a622350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:55.399 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.393+0000 7fbf1e7df980 1 --2- 172.21.15.194:0/2740516516 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555f9a623b90 0x555f9a622350 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c00a480 tx=0x7fbf0c01b280 comp rx=0 tx=0).stop 2024-09-13T06:10:55.399 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.393+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2740516516 shutdown_connections 2024-09-13T06:10:55.399 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.393+0000 7fbf1e7df980 1 --2- 172.21.15.194:0/2740516516 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555f9a623b90 0x555f9a622350 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:55.399 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.393+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2740516516 >> 172.21.15.194:0/2740516516 conn(0x555f9a6a9170 msgr2=0x555f9a6ab590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:55.399 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.393+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2740516516 shutdown_connections 2024-09-13T06:10:55.399 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.393+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2740516516 wait complete. 2024-09-13T06:10:55.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.409+0000 7fbf1e7df980 1 Processor -- start 2024-09-13T06:10:55.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.409+0000 7fbf1e7df980 1 -- start start 2024-09-13T06:10:55.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.409+0000 7fbf1e7df980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555f9a623b90 0x555f9a79aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:55.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.409+0000 7fbf1e7df980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x555f9a55b200 con 0x555f9a623b90 2024-09-13T06:10:55.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.409+0000 7fbf1c2ef640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555f9a623b90 0x555f9a79aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:55.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.413+0000 7fbf1c2ef640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555f9a623b90 0x555f9a79aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:38414/0 (socket says 172.21.15.194:38414) 2024-09-13T06:10:55.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.413+0000 7fbf1c2ef640 1 -- 172.21.15.194:0/247260031 learned_addr learned my addr 172.21.15.194:0/247260031 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:55.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.413+0000 7fbf1c2ef640 1 -- 172.21.15.194:0/247260031 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f9a79afe0 con 0x555f9a623b90 2024-09-13T06:10:55.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.413+0000 7fbf1c2ef640 1 --2- 172.21.15.194:0/247260031 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555f9a623b90 0x555f9a79aa10 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c018eb0 tx=0x7fbf0c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67ac37ae1847d4e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:55.418 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.413+0000 7fbe0a60c640 1 -- 172.21.15.194:0/247260031 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf0c0b0070 con 0x555f9a623b90 2024-09-13T06:10:55.418 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.413+0000 7fbe0a60c640 1 -- 172.21.15.194:0/247260031 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf0c0b1040 con 0x555f9a623b90 2024-09-13T06:10:55.418 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.413+0000 7fbe0a60c640 1 -- 172.21.15.194:0/247260031 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf0c0abc70 con 0x555f9a623b90 2024-09-13T06:10:55.418 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.413+0000 7fbf1e7df980 1 -- 172.21.15.194:0/247260031 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555f9a623b90 msgr2=0x555f9a79aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:55.418 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.413+0000 7fbf1e7df980 1 --2- 172.21.15.194:0/247260031 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555f9a623b90 0x555f9a79aa10 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c018eb0 tx=0x7fbf0c003030 comp rx=0 tx=0).stop 2024-09-13T06:10:55.418 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.413+0000 7fbf1e7df980 1 -- 172.21.15.194:0/247260031 shutdown_connections 2024-09-13T06:10:55.418 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.413+0000 7fbf1e7df980 1 --2- 172.21.15.194:0/247260031 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555f9a623b90 0x555f9a79aa10 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:55.418 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.413+0000 7fbf1e7df980 1 -- 172.21.15.194:0/247260031 >> 172.21.15.194:0/247260031 conn(0x555f9a6a9170 msgr2=0x555f9a796640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:55.418 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.413+0000 7fbf1e7df980 1 -- 172.21.15.194:0/247260031 shutdown_connections 2024-09-13T06:10:55.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.413+0000 7fbf1e7df980 1 -- 172.21.15.194:0/247260031 wait complete. 2024-09-13T06:10:55.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.413+0000 7fbf1e7df980 1 Processor -- start 2024-09-13T06:10:55.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.413+0000 7fbf1e7df980 1 -- start start 2024-09-13T06:10:55.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.413+0000 7fbf1e7df980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555f9a623b90 0x555f9a7a1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:55.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.413+0000 7fbf1e7df980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x555f9a6b91c0 con 0x555f9a623b90 2024-09-13T06:10:55.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.413+0000 7fbf1c2ef640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555f9a623b90 0x555f9a7a1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:55.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.413+0000 7fbf1c2ef640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555f9a623b90 0x555f9a7a1c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:38426/0 (socket says 172.21.15.194:38426) 2024-09-13T06:10:55.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.413+0000 7fbf1c2ef640 1 -- 172.21.15.194:0/3509210722 learned_addr learned my addr 172.21.15.194:0/3509210722 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:55.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.413+0000 7fbf1c2ef640 1 -- 172.21.15.194:0/3509210722 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f9a7a21c0 con 0x555f9a623b90 2024-09-13T06:10:55.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.417+0000 7fbf1c2ef640 1 --2- 172.21.15.194:0/3509210722 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555f9a623b90 0x555f9a7a1c80 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c018eb0 tx=0x7fbf0c018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:55.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.417+0000 7fbe08e09640 1 -- 172.21.15.194:0/3509210722 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf0c0c6070 con 0x555f9a623b90 2024-09-13T06:10:55.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.417+0000 7fbf1e7df980 1 -- 172.21.15.194:0/3509210722 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555f9a7a2450 con 0x555f9a623b90 2024-09-13T06:10:55.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.417+0000 7fbe08e09640 1 -- 172.21.15.194:0/3509210722 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf0c0c27c0 con 0x555f9a623b90 2024-09-13T06:10:55.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.417+0000 7fbf1e7df980 1 -- 172.21.15.194:0/3509210722 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f9a7a5130 con 0x555f9a623b90 2024-09-13T06:10:55.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.417+0000 7fbe08e09640 1 -- 172.21.15.194:0/3509210722 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf0c0d0060 con 0x555f9a623b90 2024-09-13T06:10:55.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.417+0000 7fbe08e09640 1 -- 172.21.15.194:0/3509210722 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fbf0c0c9070 con 0x555f9a623b90 2024-09-13T06:10:55.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.417+0000 7fbe08e09640 1 --2- 172.21.15.194:0/3509210722 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fbe040346a0 0x7fbe04036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:55.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.417+0000 7fbe08e09640 1 -- 172.21.15.194:0/3509210722 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fbf0c0bc070 con 0x555f9a623b90 2024-09-13T06:10:55.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.417+0000 7fbf1e7df980 1 --2- 172.21.15.194:0/3509210722 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x555f9a623fa0 0x555f9a7a8d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:55.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.417+0000 7fbf1e7df980 1 -- 172.21.15.194:0/3509210722 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7a9300 con 0x555f9a623fa0 2024-09-13T06:10:55.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.417+0000 7fbf1baee640 1 --2- 172.21.15.194:0/3509210722 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fbe040346a0 0x7fbe04036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:55.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.417+0000 7fbf1caf0640 1 --2- 172.21.15.194:0/3509210722 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x555f9a623fa0 0x555f9a7a8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:55.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.417+0000 7fbf1baee640 1 --2- 172.21.15.194:0/3509210722 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fbe040346a0 0x7fbe04036b60 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fbf10000f70 tx=0x7fbf100010b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:55.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.417+0000 7fbf1caf0640 1 --2- 172.21.15.194:0/3509210722 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x555f9a623fa0 0x555f9a7a8d80 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:55.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.417+0000 7fbf1caf0640 1 -- 172.21.15.194:0/3509210722 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbf1400a4d0 con 0x555f9a623fa0 2024-09-13T06:10:55.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.417+0000 7fbf1e7df980 1 -- 172.21.15.194:0/3509210722 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7a6330 con 0x555f9a623fa0 2024-09-13T06:10:55.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.417+0000 7fbf1caf0640 1 -- 172.21.15.194:0/3509210722 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbf1400a4d0 con 0x555f9a623fa0 2024-09-13T06:10:55.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.417+0000 7fbf1e7df980 1 --2- 172.21.15.194:0/3509210722 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x555f9a7ab630 0x555f9a7ada20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:55.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.417+0000 7fbf1e7df980 1 -- 172.21.15.194:0/3509210722 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7ae110 con 0x555f9a7ab630 2024-09-13T06:10:55.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.417+0000 7fbf1c2ef640 1 --2- 172.21.15.194:0/3509210722 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x555f9a7ab630 0x555f9a7ada20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:55.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.421+0000 7fbf1c2ef640 1 --2- 172.21.15.194:0/3509210722 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x555f9a7ab630 0x555f9a7ada20 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:55.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.421+0000 7fbf1c2ef640 1 -- 172.21.15.194:0/3509210722 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbf0c0d2070 con 0x555f9a7ab630 2024-09-13T06:10:55.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.421+0000 7fbf1e7df980 1 -- 172.21.15.194:0/3509210722 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7aa4d0 con 0x555f9a623fa0 2024-09-13T06:10:55.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.421+0000 7fbf1caf0640 1 -- 172.21.15.194:0/3509210722 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbf1400a4d0 con 0x555f9a623fa0 2024-09-13T06:10:55.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.421+0000 7fbf1e7df980 1 --2- 172.21.15.194:0/3509210722 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x555f9a7af570 0x555f9a7b1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:55.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.421+0000 7fbf1e7df980 1 -- 172.21.15.194:0/3509210722 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7b20a0 con 0x555f9a7af570 2024-09-13T06:10:55.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.421+0000 7fbf1baee640 1 --2- 172.21.15.194:0/3509210722 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x555f9a7af570 0x555f9a7b1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:55.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.421+0000 7fbf1baee640 1 --2- 172.21.15.194:0/3509210722 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x555f9a7af570 0x555f9a7b1960 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:55.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.421+0000 7fbf1baee640 1 -- 172.21.15.194:0/3509210722 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbf1000e6c0 con 0x555f9a7af570 2024-09-13T06:10:55.427 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.421+0000 7fbf1e7df980 1 Processor -- start 2024-09-13T06:10:55.428 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.421+0000 7fbf1e7df980 1 -- start start 2024-09-13T06:10:55.428 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.421+0000 7fbf1e7df980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555f9a7bfb70 0x555f9a7bff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:55.428 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.421+0000 7fbf1e7df980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x555f9a5b4800 con 0x555f9a7bfb70 2024-09-13T06:10:55.428 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.421+0000 7fbf1c2ef640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555f9a7bfb70 0x555f9a7bff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:55.428 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.421+0000 7fbf1c2ef640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555f9a7bfb70 0x555f9a7bff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:38430/0 (socket says 172.21.15.194:38430) 2024-09-13T06:10:55.428 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.421+0000 7fbf1c2ef640 1 -- 172.21.15.194:0/4252574272 learned_addr learned my addr 172.21.15.194:0/4252574272 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:55.428 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.421+0000 7fbf1c2ef640 1 -- 172.21.15.194:0/4252574272 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f9a7c04d0 con 0x555f9a7bfb70 2024-09-13T06:10:55.428 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.421+0000 7fbf1c2ef640 1 --2- 172.21.15.194:0/4252574272 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555f9a7bfb70 0x555f9a7bff90 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c0030b0 tx=0x7fbf0c0aa9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:55.428 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.425+0000 7fbe01ffb640 1 -- 172.21.15.194:0/4252574272 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf0c0de410 con 0x555f9a7bfb70 2024-09-13T06:10:55.428 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.425+0000 7fbe01ffb640 1 -- 172.21.15.194:0/4252574272 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf0c0de820 con 0x555f9a7bfb70 2024-09-13T06:10:55.428 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.425+0000 7fbe01ffb640 1 -- 172.21.15.194:0/4252574272 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf0c0deb00 con 0x555f9a7bfb70 2024-09-13T06:10:55.428 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.425+0000 7fbf1e7df980 1 -- 172.21.15.194:0/4252574272 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555f9a7c0760 con 0x555f9a7bfb70 2024-09-13T06:10:55.429 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.425+0000 7fbf1e7df980 1 -- 172.21.15.194:0/4252574272 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f9a7c0760 con 0x555f9a7bfb70 2024-09-13T06:10:55.430 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.425+0000 7fbe01ffb640 1 -- 172.21.15.194:0/4252574272 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fbf0c0deca0 con 0x555f9a7bfb70 2024-09-13T06:10:55.430 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.425+0000 7fbe01ffb640 1 --2- 172.21.15.194:0/4252574272 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fbdf40346a0 0x7fbdf4036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:55.430 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.425+0000 7fbe01ffb640 1 -- 172.21.15.194:0/4252574272 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fbf0c0a8070 con 0x555f9a7bfb70 2024-09-13T06:10:55.430 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.425+0000 7fbf1baee640 1 --2- 172.21.15.194:0/4252574272 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fbdf40346a0 0x7fbdf4036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:55.430 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.425+0000 7fbf1e7df980 1 Processor -- start 2024-09-13T06:10:55.431 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.425+0000 7fbf1e7df980 1 -- start start 2024-09-13T06:10:55.431 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.425+0000 7fbf1baee640 1 --2- 172.21.15.194:0/4252574272 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fbdf40346a0 0x7fbdf4036b60 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbf1000c010 tx=0x7fbf1000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:55.431 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.425+0000 7fbf1e7df980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555f9a7cc280 0x555f9a7cc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:55.431 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.425+0000 7fbf1e7df980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x555f9a79b300 con 0x555f9a7cc280 2024-09-13T06:10:55.431 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.425+0000 7fbf1c2ef640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555f9a7cc280 0x555f9a7cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:55.431 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.425+0000 7fbf1c2ef640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555f9a7cc280 0x555f9a7cc660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:38442/0 (socket says 172.21.15.194:38442) 2024-09-13T06:10:55.431 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.425+0000 7fbf1c2ef640 1 -- 172.21.15.194:0/397724669 learned_addr learned my addr 172.21.15.194:0/397724669 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:55.431 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.425+0000 7fbf1c2ef640 1 -- 172.21.15.194:0/397724669 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f9a7ccc30 con 0x555f9a7cc280 2024-09-13T06:10:55.433 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.425+0000 7fbf1c2ef640 1 --2- 172.21.15.194:0/397724669 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555f9a7cc280 0x555f9a7cc660 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c0a4470 tx=0x7fbf0c0d5dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39934804026d9b83 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:55.433 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.425+0000 7fbdf37fe640 1 -- 172.21.15.194:0/397724669 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf0c0ef0c0 con 0x555f9a7cc280 2024-09-13T06:10:55.433 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.425+0000 7fbdf37fe640 1 -- 172.21.15.194:0/397724669 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf0c0e6b90 con 0x555f9a7cc280 2024-09-13T06:10:55.433 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.425+0000 7fbdf37fe640 1 -- 172.21.15.194:0/397724669 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf0c0ef260 con 0x555f9a7cc280 2024-09-13T06:10:55.433 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.429+0000 7fbf1e7df980 1 -- 172.21.15.194:0/397724669 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555f9a7cc280 msgr2=0x555f9a7cc660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:55.433 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.429+0000 7fbf1e7df980 1 --2- 172.21.15.194:0/397724669 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555f9a7cc280 0x555f9a7cc660 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c0a4470 tx=0x7fbf0c0d5dd0 comp rx=0 tx=0).stop 2024-09-13T06:10:55.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.429+0000 7fbf1e7df980 1 -- 172.21.15.194:0/397724669 shutdown_connections 2024-09-13T06:10:55.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.429+0000 7fbf1e7df980 1 --2- 172.21.15.194:0/397724669 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555f9a7cc280 0x555f9a7cc660 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:55.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.429+0000 7fbf1e7df980 1 -- 172.21.15.194:0/397724669 >> 172.21.15.194:0/397724669 conn(0x555f9a7c8660 msgr2=0x555f9a7c6760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:55.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.429+0000 7fbf1e7df980 1 -- 172.21.15.194:0/397724669 shutdown_connections 2024-09-13T06:10:55.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.429+0000 7fbf1e7df980 1 -- 172.21.15.194:0/397724669 wait complete. 2024-09-13T06:10:55.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.429+0000 7fbf1e7df980 1 Processor -- start 2024-09-13T06:10:55.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.429+0000 7fbf1e7df980 1 -- start start 2024-09-13T06:10:55.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.429+0000 7fbf1e7df980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555f9a7cc280 0x555f9a7d3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:55.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.429+0000 7fbf1e7df980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x555f9a7cd0d0 con 0x555f9a7cc280 2024-09-13T06:10:55.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.429+0000 7fbf1c2ef640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555f9a7cc280 0x555f9a7d3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:55.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.429+0000 7fbf1c2ef640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555f9a7cc280 0x555f9a7d3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:38444/0 (socket says 172.21.15.194:38444) 2024-09-13T06:10:55.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.429+0000 7fbf1c2ef640 1 -- 172.21.15.194:0/2332561175 learned_addr learned my addr 172.21.15.194:0/2332561175 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:55.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.429+0000 7fbf1c2ef640 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f9a7d39c0 con 0x555f9a7cc280 2024-09-13T06:10:55.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.429+0000 7fbf1c2ef640 1 --2- 172.21.15.194:0/2332561175 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555f9a7cc280 0x555f9a7d3480 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c0a4470 tx=0x7fbf0c0e6f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:55.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.429+0000 7fbdf1ffb640 1 -- 172.21.15.194:0/2332561175 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf0c110020 con 0x555f9a7cc280 2024-09-13T06:10:55.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.429+0000 7fbdf1ffb640 1 -- 172.21.15.194:0/2332561175 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf0c0d5660 con 0x555f9a7cc280 2024-09-13T06:10:55.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.429+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555f9a7d39c0 con 0x555f9a7cc280 2024-09-13T06:10:55.437 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.429+0000 7fbdf1ffb640 1 -- 172.21.15.194:0/2332561175 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf0c0d5980 con 0x555f9a7cc280 2024-09-13T06:10:55.437 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.429+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f9a7d3e90 con 0x555f9a7cc280 2024-09-13T06:10:55.437 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.433+0000 7fbf1e7df980 20 rados->read ofs=0 len=0 2024-09-13T06:10:55.437 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.433+0000 7fbdf1ffb640 1 -- 172.21.15.194:0/2332561175 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fbf0c113020 con 0x555f9a7cc280 2024-09-13T06:10:55.437 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.433+0000 7fbdf1ffb640 1 --2- 172.21.15.194:0/2332561175 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fbde4034650 0x7fbde4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:55.437 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.433+0000 7fbdf1ffb640 1 -- 172.21.15.194:0/2332561175 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fbf0c106030 con 0x555f9a7cc280 2024-09-13T06:10:55.437 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.433+0000 7fbf1baee640 1 --2- 172.21.15.194:0/2332561175 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fbde4034650 0x7fbde4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:55.437 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.433+0000 7fbf1e7df980 1 --2- 172.21.15.194:0/2332561175 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x555f9a7de4c0 0x555f9a7e0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:55.437 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.433+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7e10b0 con 0x555f9a7de4c0 2024-09-13T06:10:55.437 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.433+0000 7fbf1caf0640 1 --2- 172.21.15.194:0/2332561175 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x555f9a7de4c0 0x555f9a7e0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:55.437 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.433+0000 7fbf1baee640 1 --2- 172.21.15.194:0/2332561175 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fbde4034650 0x7fbde4036b10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x555f9a7a97d0 tx=0x7fbf10010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:55.437 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.433+0000 7fbf1caf0640 1 --2- 172.21.15.194:0/2332561175 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x555f9a7de4c0 0x555f9a7e0960 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:55.440 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.433+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbf1400a4d0 con 0x555f9a7de4c0 2024-09-13T06:10:55.440 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.433+0000 7fbf1e7df980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:55.441 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.433+0000 7fbf1e7df980 20 realm 2024-09-13T06:10:55.441 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.433+0000 7fbf1e7df980 20 rados->read ofs=0 len=0 2024-09-13T06:10:55.441 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.433+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7e14c0 con 0x555f9a7de4c0 2024-09-13T06:10:55.441 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.433+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbf1400a4d0 con 0x555f9a7de4c0 2024-09-13T06:10:55.441 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.433+0000 7fbf1e7df980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:55.441 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.433+0000 7fbf1e7df980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:10:55.441 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.433+0000 7fbf1e7df980 20 rados->read ofs=0 len=0 2024-09-13T06:10:55.441 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.433+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7e1d60 con 0x555f9a7de4c0 2024-09-13T06:10:55.441 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.433+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbf1400a4d0 con 0x555f9a7de4c0 2024-09-13T06:10:55.441 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.433+0000 7fbf1e7df980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:55.441 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.433+0000 7fbf1e7df980 20 rados->read ofs=0 len=0 2024-09-13T06:10:55.441 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.433+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7e2100 con 0x555f9a7de4c0 2024-09-13T06:10:55.442 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.433+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbf1400a4d0 con 0x555f9a7de4c0 2024-09-13T06:10:55.442 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.433+0000 7fbf1e7df980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:10:55.442 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.433+0000 7fbf1e7df980 20 rados->read ofs=0 len=0 2024-09-13T06:10:55.442 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.433+0000 7fbf1e7df980 1 --2- 172.21.15.194:0/2332561175 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x555f9a7e2e60 0x555f9a7e5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:55.442 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.433+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7e57d0 con 0x555f9a7e2e60 2024-09-13T06:10:55.442 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.433+0000 7fbf1c2ef640 1 --2- 172.21.15.194:0/2332561175 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x555f9a7e2e60 0x555f9a7e5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:55.442 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.433+0000 7fbf1c2ef640 1 --2- 172.21.15.194:0/2332561175 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x555f9a7e2e60 0x555f9a7e5250 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:55.442 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.433+0000 7fbf1c2ef640 1 -- 172.21.15.194:0/2332561175 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbf0c109070 con 0x555f9a7e2e60 2024-09-13T06:10:55.442 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.433+0000 7fbf1e7df980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:10:55.442 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.433+0000 7fbf1e7df980 20 searching for the correct realm 2024-09-13T06:10:55.442 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.433+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7e7070 con 0x555f9a7e2e60 2024-09-13T06:10:55.442 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.433+0000 7fbf1c2ef640 1 -- 172.21.15.194:0/2332561175 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf0c109070 con 0x555f9a7e2e60 2024-09-13T06:10:55.443 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.433+0000 7fbf1c2ef640 1 --2- 172.21.15.194:0/2332561175 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fbf0c115020 0x7fbf0c0e60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:55.443 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.433+0000 7fbf1c2ef640 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7e7070 con 0x7fbf0c115020 2024-09-13T06:10:55.443 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.433+0000 7fbf1baee640 1 --2- 172.21.15.194:0/2332561175 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fbf0c115020 0x7fbf0c0e60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:55.443 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.437+0000 7fbf1baee640 1 --2- 172.21.15.194:0/2332561175 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fbf0c115020 0x7fbf0c0e60f0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:55.443 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.437+0000 7fbf1baee640 1 -- 172.21.15.194:0/2332561175 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fbf1000e6c0 con 0x7fbf0c115020 2024-09-13T06:10:55.443 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.437+0000 7fbf1baee640 1 --2- 172.21.15.194:0/2332561175 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fbf10037040 0x7fbf10036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:55.443 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.437+0000 7fbf1baee640 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7e7070 con 0x7fbf10037040 2024-09-13T06:10:55.443 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.437+0000 7fbf1caf0640 1 --2- 172.21.15.194:0/2332561175 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fbf10037040 0x7fbf10036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:55.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.437+0000 7fbf1caf0640 1 --2- 172.21.15.194:0/2332561175 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fbf10037040 0x7fbf10036410 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:55.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.437+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf1400a4d0 con 0x7fbf10037040 2024-09-13T06:10:55.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.437+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7e2100 con 0x555f9a7de4c0 2024-09-13T06:10:55.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.437+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf1400a4d0 con 0x555f9a7de4c0 2024-09-13T06:10:55.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.437+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7e2100 con 0x555f9a7de4c0 2024-09-13T06:10:55.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.437+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf1400a4d0 con 0x555f9a7de4c0 2024-09-13T06:10:55.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.437+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7e2100 con 0x7fbf10037040 2024-09-13T06:10:55.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.437+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf1400a4d0 con 0x7fbf10037040 2024-09-13T06:10:55.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.437+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7e2100 con 0x7fbf10037040 2024-09-13T06:10:55.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.441+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf1400a4d0 con 0x7fbf10037040 2024-09-13T06:10:55.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.441+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7e2100 con 0x7fbf0c115020 2024-09-13T06:10:55.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.441+0000 7fbf1baee640 1 -- 172.21.15.194:0/2332561175 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf1000e6c0 con 0x7fbf0c115020 2024-09-13T06:10:55.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.441+0000 7fbf1baee640 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7e2100 con 0x555f9a7e2e60 2024-09-13T06:10:55.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.441+0000 7fbf1c2ef640 1 -- 172.21.15.194:0/2332561175 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf0c109070 con 0x555f9a7e2e60 2024-09-13T06:10:55.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.441+0000 7fbf1c2ef640 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7e2100 con 0x555f9a7de4c0 2024-09-13T06:10:55.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.441+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf1400a4d0 con 0x555f9a7de4c0 2024-09-13T06:10:55.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.441+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7e2100 con 0x7fbf10037040 2024-09-13T06:10:55.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.441+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf1400a4d0 con 0x7fbf10037040 2024-09-13T06:10:55.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.441+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7e2100 con 0x555f9a7de4c0 2024-09-13T06:10:55.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.441+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf1400a4d0 con 0x555f9a7de4c0 2024-09-13T06:10:55.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.441+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7e2100 con 0x7fbf0c115020 2024-09-13T06:10:55.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.441+0000 7fbf1baee640 1 -- 172.21.15.194:0/2332561175 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbf1000e6c0 con 0x7fbf0c115020 2024-09-13T06:10:55.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.441+0000 7fbf1baee640 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7e2100 con 0x555f9a7e2e60 2024-09-13T06:10:55.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.441+0000 7fbf1c2ef640 1 -- 172.21.15.194:0/2332561175 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf0c109070 con 0x555f9a7e2e60 2024-09-13T06:10:55.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.441+0000 7fbf1c2ef640 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7e2100 con 0x555f9a7e2e60 2024-09-13T06:10:55.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.441+0000 7fbf1c2ef640 1 -- 172.21.15.194:0/2332561175 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf0c109070 con 0x555f9a7e2e60 2024-09-13T06:10:55.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.441+0000 7fbf1c2ef640 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7e2100 con 0x7fbf10037040 2024-09-13T06:10:55.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.441+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf1400a4d0 con 0x7fbf10037040 2024-09-13T06:10:55.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.441+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7e2100 con 0x555f9a7e2e60 2024-09-13T06:10:55.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.441+0000 7fbf1c2ef640 1 -- 172.21.15.194:0/2332561175 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf0c109070 con 0x555f9a7e2e60 2024-09-13T06:10:55.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.441+0000 7fbf1c2ef640 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7e2100 con 0x555f9a7e2e60 2024-09-13T06:10:55.452 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.445+0000 7fbf1c2ef640 1 -- 172.21.15.194:0/2332561175 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf0c109070 con 0x555f9a7e2e60 2024-09-13T06:10:55.452 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.445+0000 7fbf1c2ef640 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7e2100 con 0x555f9a7de4c0 2024-09-13T06:10:55.452 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.445+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf1400a4d0 con 0x555f9a7de4c0 2024-09-13T06:10:55.452 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.445+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7e2100 con 0x555f9a7de4c0 2024-09-13T06:10:55.453 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.445+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbf1400a4d0 con 0x555f9a7de4c0 2024-09-13T06:10:55.453 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.445+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7e2100 con 0x7fbf0c115020 2024-09-13T06:10:55.453 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.445+0000 7fbf1baee640 1 -- 172.21.15.194:0/2332561175 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf1000e6c0 con 0x7fbf0c115020 2024-09-13T06:10:55.453 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.445+0000 7fbf1baee640 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7e2100 con 0x555f9a7e2e60 2024-09-13T06:10:55.453 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.445+0000 7fbf1c2ef640 1 -- 172.21.15.194:0/2332561175 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf0c109070 con 0x555f9a7e2e60 2024-09-13T06:10:55.453 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.445+0000 7fbf1c2ef640 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7e2100 con 0x7fbf0c115020 2024-09-13T06:10:55.453 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.445+0000 7fbf1baee640 1 -- 172.21.15.194:0/2332561175 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf1000e6c0 con 0x7fbf0c115020 2024-09-13T06:10:55.453 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.445+0000 7fbf1baee640 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7e2100 con 0x555f9a7de4c0 2024-09-13T06:10:55.453 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.445+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf1400a4d0 con 0x555f9a7de4c0 2024-09-13T06:10:55.453 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.445+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7e2100 con 0x7fbf10037040 2024-09-13T06:10:55.453 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.445+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf1400a4d0 con 0x7fbf10037040 2024-09-13T06:10:55.454 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.445+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7e2100 con 0x555f9a7e2e60 2024-09-13T06:10:55.454 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.445+0000 7fbf1c2ef640 1 -- 172.21.15.194:0/2332561175 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbf0c109070 con 0x555f9a7e2e60 2024-09-13T06:10:55.454 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.445+0000 7fbf1c2ef640 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7e2100 con 0x7fbf0c115020 2024-09-13T06:10:55.454 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.445+0000 7fbf1baee640 1 -- 172.21.15.194:0/2332561175 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf1000e6c0 con 0x7fbf0c115020 2024-09-13T06:10:55.454 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.445+0000 7fbf1baee640 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7e2100 con 0x7fbf0c115020 2024-09-13T06:10:55.454 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.445+0000 7fbf1baee640 1 -- 172.21.15.194:0/2332561175 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf1000e6c0 con 0x7fbf0c115020 2024-09-13T06:10:55.454 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.445+0000 7fbf1baee640 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7e2100 con 0x555f9a7e2e60 2024-09-13T06:10:55.454 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.445+0000 7fbf1c2ef640 1 -- 172.21.15.194:0/2332561175 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf0c109070 con 0x555f9a7e2e60 2024-09-13T06:10:55.454 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.445+0000 7fbf1c2ef640 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7e2100 con 0x7fbf10037040 2024-09-13T06:10:55.454 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.449+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf1400a4d0 con 0x7fbf10037040 2024-09-13T06:10:55.454 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.449+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7e2100 con 0x555f9a7de4c0 2024-09-13T06:10:55.454 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.449+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbf1400a4d0 con 0x555f9a7de4c0 2024-09-13T06:10:55.454 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.449+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7e2100 con 0x7fbf0c115020 2024-09-13T06:10:55.457 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.449+0000 7fbf1baee640 1 -- 172.21.15.194:0/2332561175 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf1000e6c0 con 0x7fbf0c115020 2024-09-13T06:10:55.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.449+0000 7fbf1e7df980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:10:55.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.449+0000 7fbf1e7df980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:10:55.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.449+0000 7fbf1e7df980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:10:55.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.449+0000 7fbf1e7df980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:10:55.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.449+0000 7fbf1e7df980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:10:55.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.449+0000 7fbf1e7df980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:10:55.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.449+0000 7fbf1e7df980 20 rados->read ofs=0 len=0 2024-09-13T06:10:55.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.449+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7e6020 con 0x555f9a7de4c0 2024-09-13T06:10:55.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.449+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbf1400a4d0 con 0x555f9a7de4c0 2024-09-13T06:10:55.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.449+0000 7fbf1e7df980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:55.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.449+0000 7fbf1e7df980 20 rados->read ofs=0 len=0 2024-09-13T06:10:55.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.449+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7e6410 con 0x555f9a7de4c0 2024-09-13T06:10:55.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.449+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbf1400a4d0 con 0x555f9a7de4c0 2024-09-13T06:10:55.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.449+0000 7fbf1e7df980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:10:55.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.449+0000 7fbf1e7df980 20 rados->read ofs=0 len=0 2024-09-13T06:10:55.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.449+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7e6410 con 0x7fbf0c115020 2024-09-13T06:10:55.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.449+0000 7fbf1baee640 1 -- 172.21.15.194:0/2332561175 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbf1000e6c0 con 0x7fbf0c115020 2024-09-13T06:10:55.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.449+0000 7fbf1e7df980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:10:55.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.449+0000 7fbf1e7df980 20 zone default found 2024-09-13T06:10:55.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.449+0000 7fbf1e7df980 4 Realm: () 2024-09-13T06:10:55.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.449+0000 7fbf1e7df980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:10:55.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.449+0000 7fbf1e7df980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:10:55.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.449+0000 7fbf1e7df980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:10:55.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.449+0000 7fbf1e7df980 20 zonegroup default 2024-09-13T06:10:55.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.449+0000 7fbf1e7df980 20 rados->read ofs=0 len=0 2024-09-13T06:10:55.460 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.449+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7e7540 con 0x7fbf10037040 2024-09-13T06:10:55.460 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.449+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbf1400a4d0 con 0x7fbf10037040 2024-09-13T06:10:55.460 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.449+0000 7fbf1e7df980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:55.460 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.449+0000 7fbf1e7df980 20 rados->read ofs=0 len=0 2024-09-13T06:10:55.460 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.449+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7e8f20 con 0x555f9a7e2e60 2024-09-13T06:10:55.460 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.449+0000 7fbf1c2ef640 1 -- 172.21.15.194:0/2332561175 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbf0c109070 con 0x555f9a7e2e60 2024-09-13T06:10:55.460 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.449+0000 7fbf1e7df980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:55.460 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.449+0000 7fbf1e7df980 20 rados->read ofs=0 len=0 2024-09-13T06:10:55.460 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.449+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7e92c0 con 0x555f9a7e2e60 2024-09-13T06:10:55.460 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.453+0000 7fbf1c2ef640 1 -- 172.21.15.194:0/2332561175 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbf0c109070 con 0x555f9a7e2e60 2024-09-13T06:10:55.460 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.453+0000 7fbf1e7df980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:55.460 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.453+0000 7fbf1e7df980 20 started sync module instance, tier type = 2024-09-13T06:10:55.460 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.453+0000 7fbf1e7df980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:10:55.461 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.453+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7e83c0 con 0x7fbf0c115020 2024-09-13T06:10:55.461 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.453+0000 7fbf1baee640 1 -- 172.21.15.194:0/2332561175 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(44 notify.0 [create] v35'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf1000e6c0 con 0x7fbf0c115020 2024-09-13T06:10:55.461 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.453+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93869102237664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7e9b60 con 0x7fbf0c115020 2024-09-13T06:10:55.461 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.453+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7ea3b0 con 0x555f9a7de4c0 2024-09-13T06:10:55.462 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.453+0000 7fbf1baee640 1 -- 172.21.15.194:0/2332561175 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 93869102237664] v35'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf1000e6c0 con 0x7fbf0c115020 2024-09-13T06:10:55.462 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.453+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v35'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf1400a4d0 con 0x555f9a7de4c0 2024-09-13T06:10:55.462 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.453+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93869102241456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7ea3b0 con 0x555f9a7de4c0 2024-09-13T06:10:55.462 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.453+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7eaeb0 con 0x555f9a7e2e60 2024-09-13T06:10:55.462 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.457+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93869102241456] v35'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf1400a4d0 con 0x555f9a7de4c0 2024-09-13T06:10:55.462 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.457+0000 7fbf1c2ef640 1 -- 172.21.15.194:0/2332561175 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v35'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf0c109070 con 0x555f9a7e2e60 2024-09-13T06:10:55.462 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.457+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93869102246304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7ea3b0 con 0x555f9a7e2e60 2024-09-13T06:10:55.463 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.457+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7eb8c0 con 0x7fbf0c115020 2024-09-13T06:10:55.463 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.457+0000 7fbf1baee640 1 -- 172.21.15.194:0/2332561175 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(50 notify.3 [create] v35'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf1000e6c0 con 0x7fbf0c115020 2024-09-13T06:10:55.463 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.457+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93869102248976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7ec160 con 0x7fbf0c115020 2024-09-13T06:10:55.463 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.457+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7ecb80 con 0x555f9a7de4c0 2024-09-13T06:10:55.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.461+0000 7fbf1c2ef640 1 -- 172.21.15.194:0/2332561175 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93869102246304] v35'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf0c109070 con 0x555f9a7e2e60 2024-09-13T06:10:55.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.461+0000 7fbf1baee640 1 -- 172.21.15.194:0/2332561175 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 93869102248976] v35'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf1000e6c0 con 0x7fbf0c115020 2024-09-13T06:10:55.465 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.461+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v35'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf1400a4d0 con 0x555f9a7de4c0 2024-09-13T06:10:55.465 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.461+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93869102253680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7ebcb0 con 0x555f9a7de4c0 2024-09-13T06:10:55.465 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.461+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7ed420 con 0x7fbf10037040 2024-09-13T06:10:55.467 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.461+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93869102253680] v35'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf1400a4d0 con 0x555f9a7de4c0 2024-09-13T06:10:55.467 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.461+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(54 notify.5 [create] v35'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf1400a4d0 con 0x7fbf10037040 2024-09-13T06:10:55.467 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.461+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93869102243584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7ebcb0 con 0x7fbf10037040 2024-09-13T06:10:55.467 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.461+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7ed8a0 con 0x7fbf10037040 2024-09-13T06:10:55.469 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.465+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 93869102243584] v35'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf1400a4d0 con 0x7fbf10037040 2024-09-13T06:10:55.469 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.465+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(56 notify.6 [create] v35'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf1400a4d0 con 0x7fbf10037040 2024-09-13T06:10:55.470 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.465+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93869102257072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7ed8a0 con 0x7fbf10037040 2024-09-13T06:10:55.470 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.465+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7ee2e0 con 0x7fbf10037040 2024-09-13T06:10:55.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.469+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 93869102257072] v35'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf1400a4d0 con 0x7fbf10037040 2024-09-13T06:10:55.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.469+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(58 notify.7 [create] v35'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf1400a4d0 con 0x7fbf10037040 2024-09-13T06:10:55.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.469+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93869102255376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7ee2e0 con 0x7fbf10037040 2024-09-13T06:10:55.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.469+0000 7fbf1e7df980 20 add_watcher() i=0 2024-09-13T06:10:55.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.469+0000 7fbf1e7df980 20 add_watcher() i=1 2024-09-13T06:10:55.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.469+0000 7fbf1e7df980 20 add_watcher() i=2 2024-09-13T06:10:55.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.469+0000 7fbf1e7df980 20 add_watcher() i=3 2024-09-13T06:10:55.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.469+0000 7fbf1e7df980 20 add_watcher() i=4 2024-09-13T06:10:55.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.469+0000 7fbf1e7df980 20 add_watcher() i=5 2024-09-13T06:10:55.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.469+0000 7fbf1e7df980 20 add_watcher() i=6 2024-09-13T06:10:55.474 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.469+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 93869102255376] v35'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf1400a4d0 con 0x7fbf10037040 2024-09-13T06:10:55.474 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.469+0000 7fbf1e7df980 20 add_watcher() i=7 2024-09-13T06:10:55.474 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.469+0000 7fbf1e7df980 2 all 8 watchers are set, enabling cache 2024-09-13T06:10:55.474 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.469+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7f1660 con 0x555f9a7de4c0 2024-09-13T06:10:55.474 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.469+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbf1400a4d0 con 0x555f9a7de4c0 2024-09-13T06:10:55.475 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.469+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93869102272576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7ee450 con 0x555f9a7de4c0 2024-09-13T06:10:55.476 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.473+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93869102272576] v35'196 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbf1400a4d0 con 0x555f9a7de4c0 2024-09-13T06:10:55.476 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.473+0000 7fbdd27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:10:55.476 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.473+0000 7fbf1e7df980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:10:55.476 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.473+0000 7fbf1e7df980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:10:55.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.473+0000 7fbf1e7df980 5 note: GC not initialized 2024-09-13T06:10:55.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.473+0000 7fbdd17e2640 20 reqs_thread_entry: start 2024-09-13T06:10:55.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.473+0000 7fbf1e7df980 20 init_complete bucket index max shards: 11 2024-09-13T06:10:55.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.473+0000 7fbf1e7df980 20 Filter name: none 2024-09-13T06:10:55.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.473+0000 7fbd42ffd640 20 reqs_thread_entry: start 2024-09-13T06:10:55.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.473+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555f9a815320 con 0x555f9a7de4c0 2024-09-13T06:10:55.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.473+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fbf1400a4d0 con 0x555f9a7de4c0 2024-09-13T06:10:55.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.473+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555f9a815320 con 0x7fbf0c115020 2024-09-13T06:10:55.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.473+0000 7fbf1baee640 1 -- 172.21.15.194:0/2332561175 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fbf1000e6c0 con 0x7fbf0c115020 2024-09-13T06:10:55.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.473+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555f9a815320 con 0x555f9a7de4c0 2024-09-13T06:10:55.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.473+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fbf1400a4d0 con 0x555f9a7de4c0 2024-09-13T06:10:55.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.473+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555f9a8152e0 con 0x555f9a7e2e60 2024-09-13T06:10:55.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.473+0000 7fbf1c2ef640 1 -- 172.21.15.194:0/2332561175 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fbf0c109070 con 0x555f9a7e2e60 2024-09-13T06:10:55.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.473+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555f9a8152e0 con 0x555f9a7e2e60 2024-09-13T06:10:55.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.473+0000 7fbf1c2ef640 1 -- 172.21.15.194:0/2332561175 <== osd.3 v2:172.21.15.194:6816/96632515 16 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fbf0c109070 con 0x555f9a7e2e60 2024-09-13T06:10:55.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.473+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555f9a8152e0 con 0x555f9a7e2e60 2024-09-13T06:10:55.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.473+0000 7fbf1c2ef640 1 -- 172.21.15.194:0/2332561175 <== osd.3 v2:172.21.15.194:6816/96632515 17 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fbf0c109070 con 0x555f9a7e2e60 2024-09-13T06:10:55.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.473+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555f9a8152e0 con 0x555f9a7de4c0 2024-09-13T06:10:55.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.473+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fbf1400a4d0 con 0x555f9a7de4c0 2024-09-13T06:10:55.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.473+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555f9a8152e0 con 0x555f9a7de4c0 2024-09-13T06:10:55.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.473+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fbf1400a4d0 con 0x555f9a7de4c0 2024-09-13T06:10:55.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.473+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555f9a8152e0 con 0x555f9a7e2e60 2024-09-13T06:10:55.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.473+0000 7fbf1c2ef640 1 -- 172.21.15.194:0/2332561175 <== osd.3 v2:172.21.15.194:6816/96632515 18 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fbf0c109070 con 0x555f9a7e2e60 2024-09-13T06:10:55.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.473+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555f9a8152e0 con 0x555f9a7e2e60 2024-09-13T06:10:55.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.477+0000 7fbf1c2ef640 1 -- 172.21.15.194:0/2332561175 <== osd.3 v2:172.21.15.194:6816/96632515 19 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fbf0c109070 con 0x555f9a7e2e60 2024-09-13T06:10:55.482 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.477+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555f9a8152e0 con 0x7fbf10037040 2024-09-13T06:10:55.483 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.477+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(72 usage.10 [call out=1268b] v0'0 uv30 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7fbf1400a4d0 con 0x7fbf10037040 2024-09-13T06:10:55.483 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.477+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555f9a817050 con 0x555f9a7de4c0 2024-09-13T06:10:55.483 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.477+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 <== osd.1 v2:172.21.15.194:6808/3135444559 25 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fbf1400a4d0 con 0x555f9a7de4c0 2024-09-13T06:10:55.483 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.477+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555f9a817050 con 0x7fbf0c115020 2024-09-13T06:10:55.484 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.477+0000 7fbf1baee640 1 -- 172.21.15.194:0/2332561175 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fbf1000e6c0 con 0x7fbf0c115020 2024-09-13T06:10:55.484 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.477+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555f9a817050 con 0x555f9a7e2e60 2024-09-13T06:10:55.484 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.477+0000 7fbf1c2ef640 1 -- 172.21.15.194:0/2332561175 <== osd.3 v2:172.21.15.194:6816/96632515 20 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fbf0c109070 con 0x555f9a7e2e60 2024-09-13T06:10:55.484 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.477+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555f9a817050 con 0x7fbf10037040 2024-09-13T06:10:55.484 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.477+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fbf1400a4d0 con 0x7fbf10037040 2024-09-13T06:10:55.484 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.477+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555f9a817050 con 0x7fbf10037040 2024-09-13T06:10:55.484 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.477+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fbf1400a4d0 con 0x7fbf10037040 2024-09-13T06:10:55.484 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.477+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555f9a817050 con 0x555f9a7e2e60 2024-09-13T06:10:55.484 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.477+0000 7fbf1c2ef640 1 -- 172.21.15.194:0/2332561175 <== osd.3 v2:172.21.15.194:6816/96632515 21 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fbf0c109070 con 0x555f9a7e2e60 2024-09-13T06:10:55.484 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.477+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555f9a817050 con 0x7fbf10037040 2024-09-13T06:10:55.486 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.481+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(79 usage.17 [call out=163b] v0'0 uv5 ondisk = 0) ==== 152+0+163 (crc 0 0 0) 0x7fbf1400a4d0 con 0x7fbf10037040 2024-09-13T06:10:55.486 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.481+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555f9a817050 con 0x555f9a7de4c0 2024-09-13T06:10:55.486 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.481+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 <== osd.1 v2:172.21.15.194:6808/3135444559 26 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fbf1400a4d0 con 0x555f9a7de4c0 2024-09-13T06:10:55.486 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.481+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555f9a817050 con 0x555f9a7e2e60 2024-09-13T06:10:55.486 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.481+0000 7fbf1c2ef640 1 -- 172.21.15.194:0/2332561175 <== osd.3 v2:172.21.15.194:6816/96632515 22 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fbf0c109070 con 0x555f9a7e2e60 2024-09-13T06:10:55.486 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.481+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555f9a817050 con 0x7fbf10037040 2024-09-13T06:10:55.486 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.481+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fbf1400a4d0 con 0x7fbf10037040 2024-09-13T06:10:55.486 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.481+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555f9a817050 con 0x7fbf0c115020 2024-09-13T06:10:55.486 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.481+0000 7fbf1baee640 1 -- 172.21.15.194:0/2332561175 <== osd.2 v2:172.21.15.194:6800/815615585 16 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fbf1000e6c0 con 0x7fbf0c115020 2024-09-13T06:10:55.486 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.481+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555f9a817050 con 0x7fbf10037040 2024-09-13T06:10:55.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.481+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 <== osd.0 v2:172.21.15.120:6800/1923744619 20 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fbf1400a4d0 con 0x7fbf10037040 2024-09-13T06:10:55.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.481+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555f9a817050 con 0x555f9a7de4c0 2024-09-13T06:10:55.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.481+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 <== osd.1 v2:172.21.15.194:6808/3135444559 27 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fbf1400a4d0 con 0x555f9a7de4c0 2024-09-13T06:10:55.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.481+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555f9a817050 con 0x555f9a7de4c0 2024-09-13T06:10:55.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.481+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 <== osd.1 v2:172.21.15.194:6808/3135444559 28 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fbf1400a4d0 con 0x555f9a7de4c0 2024-09-13T06:10:55.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.481+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555f9a817050 con 0x555f9a7e2e60 2024-09-13T06:10:55.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.481+0000 7fbf1c2ef640 1 -- 172.21.15.194:0/2332561175 <== osd.3 v2:172.21.15.194:6816/96632515 23 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fbf0c109070 con 0x555f9a7e2e60 2024-09-13T06:10:55.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.485+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555f9a817050 con 0x555f9a7de4c0 2024-09-13T06:10:55.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.485+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 <== osd.1 v2:172.21.15.194:6808/3135444559 29 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fbf1400a4d0 con 0x555f9a7de4c0 2024-09-13T06:10:55.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.485+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555f9a817050 con 0x555f9a7de4c0 2024-09-13T06:10:55.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.485+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 <== osd.1 v2:172.21.15.194:6808/3135444559 30 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fbf1400a4d0 con 0x555f9a7de4c0 2024-09-13T06:10:55.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.485+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555f9a817050 con 0x555f9a7e2e60 2024-09-13T06:10:55.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.485+0000 7fbf1c2ef640 1 -- 172.21.15.194:0/2332561175 <== osd.3 v2:172.21.15.194:6816/96632515 24 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fbf0c109070 con 0x555f9a7e2e60 2024-09-13T06:10:55.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.485+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555f9a817050 con 0x555f9a7e2e60 2024-09-13T06:10:55.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.485+0000 7fbf1c2ef640 1 -- 172.21.15.194:0/2332561175 <== osd.3 v2:172.21.15.194:6816/96632515 25 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fbf0c109070 con 0x555f9a7e2e60 2024-09-13T06:10:55.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.485+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555f9a817050 con 0x555f9a7e2e60 2024-09-13T06:10:55.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.485+0000 7fbf1c2ef640 1 -- 172.21.15.194:0/2332561175 <== osd.3 v2:172.21.15.194:6816/96632515 26 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fbf0c109070 con 0x555f9a7e2e60 2024-09-13T06:10:55.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.485+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555f9a817050 con 0x7fbf10037040 2024-09-13T06:10:55.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.485+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 <== osd.0 v2:172.21.15.120:6800/1923744619 21 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fbf1400a4d0 con 0x7fbf10037040 2024-09-13T06:10:55.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.485+0000 7fbdd27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:10:55.491 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.485+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93869102272576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555f9a812750 con 0x555f9a7de4c0 2024-09-13T06:10:55.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.489+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 <== osd.1 v2:172.21.15.194:6808/3135444559 31 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 93869102272576] v35'197 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbf1400a4d0 con 0x555f9a7de4c0 2024-09-13T06:10:55.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.489+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93869102237664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555f9a812750 con 0x7fbf0c115020 2024-09-13T06:10:55.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.489+0000 7fbf1baee640 1 -- 172.21.15.194:0/2332561175 <== osd.2 v2:172.21.15.194:6800/815615585 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 93869102237664] v35'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf1000e6c0 con 0x7fbf0c115020 2024-09-13T06:10:55.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.489+0000 7fbf1e7df980 20 remove_watcher() i=0 2024-09-13T06:10:55.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.489+0000 7fbf1e7df980 2 removed watcher, disabling cache 2024-09-13T06:10:55.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.489+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93869102241456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7e87e0 con 0x555f9a7de4c0 2024-09-13T06:10:55.495 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.493+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 <== osd.1 v2:172.21.15.194:6808/3135444559 32 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 93869102241456] v35'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf1400a4d0 con 0x555f9a7de4c0 2024-09-13T06:10:55.495 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.493+0000 7fbf1e7df980 20 remove_watcher() i=1 2024-09-13T06:10:55.495 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.493+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93869102246304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555f9a812750 con 0x555f9a7e2e60 2024-09-13T06:10:55.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.493+0000 7fbf1c2ef640 1 -- 172.21.15.194:0/2332561175 <== osd.3 v2:172.21.15.194:6816/96632515 27 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 93869102246304] v35'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf0c109070 con 0x555f9a7e2e60 2024-09-13T06:10:55.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.493+0000 7fbf1e7df980 20 remove_watcher() i=2 2024-09-13T06:10:55.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.493+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93869102248976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7e96b0 con 0x7fbf0c115020 2024-09-13T06:10:55.499 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.493+0000 7fbf1baee640 1 -- 172.21.15.194:0/2332561175 <== osd.2 v2:172.21.15.194:6800/815615585 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 93869102248976] v35'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf1000e6c0 con 0x7fbf0c115020 2024-09-13T06:10:55.499 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.493+0000 7fbf1e7df980 20 remove_watcher() i=3 2024-09-13T06:10:55.499 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.493+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93869102253680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7ea9a0 con 0x555f9a7de4c0 2024-09-13T06:10:55.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.497+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 <== osd.1 v2:172.21.15.194:6808/3135444559 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 93869102253680] v35'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf1400a4d0 con 0x555f9a7de4c0 2024-09-13T06:10:55.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.497+0000 7fbf1e7df980 20 remove_watcher() i=4 2024-09-13T06:10:55.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.497+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93869102243584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555f9a812750 con 0x7fbf10037040 2024-09-13T06:10:55.504 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.501+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 <== osd.0 v2:172.21.15.120:6800/1923744619 22 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 93869102243584] v35'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf1400a4d0 con 0x7fbf10037040 2024-09-13T06:10:55.504 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.501+0000 7fbf1e7df980 20 remove_watcher() i=5 2024-09-13T06:10:55.504 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.501+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93869102257072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7eb410 con 0x7fbf10037040 2024-09-13T06:10:55.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.501+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 <== osd.0 v2:172.21.15.120:6800/1923744619 23 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 93869102257072] v35'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf1400a4d0 con 0x7fbf10037040 2024-09-13T06:10:55.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.501+0000 7fbf1e7df980 20 remove_watcher() i=6 2024-09-13T06:10:55.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.501+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93869102255376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555f9a7e96b0 con 0x7fbf10037040 2024-09-13T06:10:55.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.505+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 <== osd.0 v2:172.21.15.120:6800/1923744619 24 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 93869102255376] v35'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf1400a4d0 con 0x7fbf10037040 2024-09-13T06:10:55.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.505+0000 7fbf1e7df980 20 remove_watcher() i=7 2024-09-13T06:10:55.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.505+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fbf10037040 msgr2=0x7fbf10036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:55.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.505+0000 7fbf1e7df980 1 --2- 172.21.15.194:0/2332561175 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fbf10037040 0x7fbf10036410 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:55.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.505+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x555f9a7de4c0 msgr2=0x555f9a7e0960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:55.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.505+0000 7fbf1e7df980 1 --2- 172.21.15.194:0/2332561175 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x555f9a7de4c0 0x555f9a7e0960 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:55.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.505+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fbf0c115020 msgr2=0x7fbf0c0e60f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:55.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.505+0000 7fbf1e7df980 1 --2- 172.21.15.194:0/2332561175 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fbf0c115020 0x7fbf0c0e60f0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:55.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.505+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x555f9a7e2e60 msgr2=0x555f9a7e5250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:55.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.505+0000 7fbf1e7df980 1 --2- 172.21.15.194:0/2332561175 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x555f9a7e2e60 0x555f9a7e5250 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:55.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.505+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fbde4034650 msgr2=0x7fbde4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:55.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.505+0000 7fbf1e7df980 1 --2- 172.21.15.194:0/2332561175 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fbde4034650 0x7fbde4036b10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x555f9a7a97d0 tx=0x7fbf10010000 comp rx=0 tx=0).stop 2024-09-13T06:10:55.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.505+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555f9a7cc280 msgr2=0x555f9a7d3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:55.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.505+0000 7fbf1e7df980 1 --2- 172.21.15.194:0/2332561175 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555f9a7cc280 0x555f9a7d3480 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c0a4470 tx=0x7fbf0c0e6f30 comp rx=0 tx=0).stop 2024-09-13T06:10:55.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.505+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 reap_dead start 2024-09-13T06:10:55.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.505+0000 7fbf1caf0640 1 -- 172.21.15.194:0/2332561175 reap_dead start 2024-09-13T06:10:55.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.505+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 shutdown_connections 2024-09-13T06:10:55.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.505+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 >> 172.21.15.194:0/2332561175 conn(0x555f9a7c8660 msgr2=0x555f9a7c6730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:55.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.505+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 shutdown_connections 2024-09-13T06:10:55.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.505+0000 7fbf1e7df980 1 -- 172.21.15.194:0/2332561175 wait complete. 2024-09-13T06:10:55.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.505+0000 7fbf1e7df980 1 -- 172.21.15.194:0/4252574272 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fbdf40346a0 msgr2=0x7fbdf4036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:55.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.505+0000 7fbf1e7df980 1 --2- 172.21.15.194:0/4252574272 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fbdf40346a0 0x7fbdf4036b60 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbf1000c010 tx=0x7fbf1000f000 comp rx=0 tx=0).stop 2024-09-13T06:10:55.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.505+0000 7fbf1e7df980 1 -- 172.21.15.194:0/4252574272 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555f9a7bfb70 msgr2=0x555f9a7bff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:55.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.505+0000 7fbf1e7df980 1 --2- 172.21.15.194:0/4252574272 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555f9a7bfb70 0x555f9a7bff90 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c0030b0 tx=0x7fbf0c0aa9a0 comp rx=0 tx=0).stop 2024-09-13T06:10:55.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.505+0000 7fbf1e7df980 1 -- 172.21.15.194:0/4252574272 shutdown_connections 2024-09-13T06:10:55.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.505+0000 7fbf1e7df980 1 --2- 172.21.15.194:0/4252574272 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fbdf40346a0 0x7fbdf4036b60 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:55.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.505+0000 7fbf1e7df980 1 --2- 172.21.15.194:0/4252574272 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555f9a7bfb70 0x555f9a7bff90 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:55.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.505+0000 7fbf1e7df980 1 -- 172.21.15.194:0/4252574272 >> 172.21.15.194:0/4252574272 conn(0x555f9a7b4cc0 msgr2=0x555f9a7b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:55.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.505+0000 7fbf1e7df980 1 -- 172.21.15.194:0/4252574272 shutdown_connections 2024-09-13T06:10:55.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.505+0000 7fbf1e7df980 1 -- 172.21.15.194:0/4252574272 wait complete. 2024-09-13T06:10:55.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.505+0000 7fbf1e7df980 1 -- 172.21.15.194:0/3509210722 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x555f9a623fa0 msgr2=0x555f9a7a8d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:55.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.505+0000 7fbf1e7df980 1 --2- 172.21.15.194:0/3509210722 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x555f9a623fa0 0x555f9a7a8d80 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:55.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.505+0000 7fbf1e7df980 1 -- 172.21.15.194:0/3509210722 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x555f9a7af570 msgr2=0x555f9a7b1960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:55.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.505+0000 7fbf1e7df980 1 --2- 172.21.15.194:0/3509210722 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x555f9a7af570 0x555f9a7b1960 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:55.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.505+0000 7fbf1e7df980 1 -- 172.21.15.194:0/3509210722 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x555f9a7ab630 msgr2=0x555f9a7ada20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:55.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.505+0000 7fbf1e7df980 1 --2- 172.21.15.194:0/3509210722 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x555f9a7ab630 0x555f9a7ada20 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:55.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.505+0000 7fbf1e7df980 1 -- 172.21.15.194:0/3509210722 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fbe040346a0 msgr2=0x7fbe04036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:55.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.505+0000 7fbf1e7df980 1 --2- 172.21.15.194:0/3509210722 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fbe040346a0 0x7fbe04036b60 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fbf10000f70 tx=0x7fbf100010b0 comp rx=0 tx=0).stop 2024-09-13T06:10:55.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.505+0000 7fbf1e7df980 1 -- 172.21.15.194:0/3509210722 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555f9a623b90 msgr2=0x555f9a7a1c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:55.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.505+0000 7fbf1e7df980 1 --2- 172.21.15.194:0/3509210722 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555f9a623b90 0x555f9a7a1c80 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c018eb0 tx=0x7fbf0c018020 comp rx=0 tx=0).stop 2024-09-13T06:10:55.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.505+0000 7fbf1caf0640 1 -- 172.21.15.194:0/3509210722 reap_dead start 2024-09-13T06:10:55.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.505+0000 7fbf1e7df980 1 -- 172.21.15.194:0/3509210722 shutdown_connections 2024-09-13T06:10:55.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.505+0000 7fbf1e7df980 1 -- 172.21.15.194:0/3509210722 >> 172.21.15.194:0/3509210722 conn(0x555f9a6a9170 msgr2=0x555f9a7951c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:55.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.505+0000 7fbf1e7df980 1 -- 172.21.15.194:0/3509210722 shutdown_connections 2024-09-13T06:10:55.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.505+0000 7fbf1e7df980 1 -- 172.21.15.194:0/3509210722 wait complete. 2024-09-13T06:10:55.521 INFO:teuthology.orchestra.run.smithi194.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"anonymous","categories":[]}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}]},{"bucket":"myfoo2","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[]}]}],"summary":[{"user":"anonymous","categories":[],"total":{"bytes_sent":0,"bytes_received":0,"ops":0,"successful_ops":0}},{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}}]} 2024-09-13T06:10:55.522 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'anonymous', 'categories': []}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}]}, {'bucket': 'myfoo2', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}]} 2024-09-13T06:10:55.522 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-09-13T06:10:55.522 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-09-13T06:10:55.522 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-09-13T06:10:55.601 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:10:55.601 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:10:55.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.597+0000 7f4dcd75e980 1 Processor -- start 2024-09-13T06:10:55.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.597+0000 7f4dcd75e980 1 -- start start 2024-09-13T06:10:55.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.597+0000 7f4dcd75e980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55c4628f1c50 0x55c4628f4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:55.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.597+0000 7f4dcd75e980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c462773ae0 con 0x55c4628ed8d0 2024-09-13T06:10:55.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.597+0000 7f4dcd75e980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x55c462797e30 con 0x55c4628f1c50 2024-09-13T06:10:55.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.597+0000 7f4dcaa6d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55c4628f1c50 0x55c4628f4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:55.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.597+0000 7f4dcaa6d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55c4628f1c50 0x55c4628f4040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:38458/0 (socket says 172.21.15.194:38458) 2024-09-13T06:10:55.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.597+0000 7f4dcaa6d640 1 -- 172.21.15.194:0/2768980917 learned_addr learned my addr 172.21.15.194:0/2768980917 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:55.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.597+0000 7f4dcb26e640 1 --1- 172.21.15.194:0/2768980917 >> v1:172.21.15.120:6789/0 conn(0x55c4628ed8d0 0x55c4628edcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:34372/0 (socket says 172.21.15.194:34372) 2024-09-13T06:10:55.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.601+0000 7f4dcaa6d640 1 -- 172.21.15.194:0/2768980917 >> v1:172.21.15.120:6789/0 conn(0x55c4628ed8d0 legacy=0x55c4628edcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:55.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.601+0000 7f4dcaa6d640 1 -- 172.21.15.194:0/2768980917 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4628f5590 con 0x55c4628f1c50 2024-09-13T06:10:55.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.601+0000 7f4dcaa6d640 1 --2- 172.21.15.194:0/2768980917 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c4628f1c50 0x55c4628f4040 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc00a4e0 tx=0x7f4dbc01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa9e89a172442963 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:55.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.601+0000 7f4dca26c640 1 -- 172.21.15.194:0/2768980917 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4dbc0aa540 con 0x55c4628f1c50 2024-09-13T06:10:55.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.601+0000 7f4dca26c640 1 -- 172.21.15.194:0/2768980917 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dbc0aa6e0 con 0x55c4628f1c50 2024-09-13T06:10:55.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.601+0000 7f4dca26c640 1 -- 172.21.15.194:0/2768980917 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4dbc0aaa40 con 0x55c4628f1c50 2024-09-13T06:10:55.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.605+0000 7f4dcd75e980 1 -- 172.21.15.194:0/2768980917 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c4628f1c50 msgr2=0x55c4628f4040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:55.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.605+0000 7f4dcd75e980 1 --2- 172.21.15.194:0/2768980917 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c4628f1c50 0x55c4628f4040 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc00a4e0 tx=0x7f4dbc01b090 comp rx=0 tx=0).stop 2024-09-13T06:10:55.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.605+0000 7f4dcd75e980 1 -- 172.21.15.194:0/2768980917 shutdown_connections 2024-09-13T06:10:55.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.605+0000 7f4dcd75e980 1 --2- 172.21.15.194:0/2768980917 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c4628f1c50 0x55c4628f4040 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:55.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.605+0000 7f4dcd75e980 1 -- 172.21.15.194:0/2768980917 >> 172.21.15.194:0/2768980917 conn(0x55c462861220 msgr2=0x55c462861630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:55.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.605+0000 7f4dcd75e980 1 -- 172.21.15.194:0/2768980917 shutdown_connections 2024-09-13T06:10:55.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.605+0000 7f4dcd75e980 1 -- 172.21.15.194:0/2768980917 wait complete. 2024-09-13T06:10:55.624 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.621+0000 7f4dcd75e980 1 Processor -- start 2024-09-13T06:10:55.624 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.621+0000 7f4dcd75e980 1 -- start start 2024-09-13T06:10:55.624 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.621+0000 7f4dcd75e980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c4628ed8d0 0x55c4629d8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:55.624 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.621+0000 7f4dcd75e980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55c462799200 con 0x55c4628ed8d0 2024-09-13T06:10:55.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.621+0000 7f4dcb26e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c4628ed8d0 0x55c4629d8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:55.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.621+0000 7f4dcb26e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c4628ed8d0 0x55c4629d8d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:38466/0 (socket says 172.21.15.194:38466) 2024-09-13T06:10:55.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.621+0000 7f4dcb26e640 1 -- 172.21.15.194:0/828134852 learned_addr learned my addr 172.21.15.194:0/828134852 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:55.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.621+0000 7f4dcb26e640 1 -- 172.21.15.194:0/828134852 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4629d9360 con 0x55c4628ed8d0 2024-09-13T06:10:55.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.621+0000 7f4dcb26e640 1 --2- 172.21.15.194:0/828134852 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c4628ed8d0 0x55c4629d8d90 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f4db4001e50 tx=0x7f4db4001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffb4206c96acfeef server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:55.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.621+0000 7f4cb960a640 1 -- 172.21.15.194:0/828134852 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4db400e5d0 con 0x55c4628ed8d0 2024-09-13T06:10:55.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.621+0000 7f4cb960a640 1 -- 172.21.15.194:0/828134852 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4db400e770 con 0x55c4628ed8d0 2024-09-13T06:10:55.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.621+0000 7f4cb960a640 1 -- 172.21.15.194:0/828134852 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4db400eab0 con 0x55c4628ed8d0 2024-09-13T06:10:55.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.621+0000 7f4dcd75e980 1 -- 172.21.15.194:0/828134852 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c4628ed8d0 msgr2=0x55c4629d8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:55.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.621+0000 7f4dcd75e980 1 --2- 172.21.15.194:0/828134852 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c4628ed8d0 0x55c4629d8d90 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f4db4001e50 tx=0x7f4db4001e80 comp rx=0 tx=0).stop 2024-09-13T06:10:55.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.621+0000 7f4dcd75e980 1 -- 172.21.15.194:0/828134852 shutdown_connections 2024-09-13T06:10:55.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.621+0000 7f4dcd75e980 1 --2- 172.21.15.194:0/828134852 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c4628ed8d0 0x55c4629d8d90 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:55.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.621+0000 7f4dcd75e980 1 -- 172.21.15.194:0/828134852 >> 172.21.15.194:0/828134852 conn(0x55c462861220 msgr2=0x55c4629d4920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:55.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.621+0000 7f4dcd75e980 1 -- 172.21.15.194:0/828134852 shutdown_connections 2024-09-13T06:10:55.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.621+0000 7f4dcd75e980 1 -- 172.21.15.194:0/828134852 wait complete. 2024-09-13T06:10:55.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.625+0000 7f4dcd75e980 1 Processor -- start 2024-09-13T06:10:55.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.625+0000 7f4dcd75e980 1 -- start start 2024-09-13T06:10:55.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.625+0000 7f4dcd75e980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c4628ed8d0 0x55c4629e0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:55.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.625+0000 7f4dcd75e980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55c4628f5090 con 0x55c4628ed8d0 2024-09-13T06:10:55.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.625+0000 7f4dcb26e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c4628ed8d0 0x55c4629e0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:55.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.625+0000 7f4dcb26e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c4628ed8d0 0x55c4629e0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:38472/0 (socket says 172.21.15.194:38472) 2024-09-13T06:10:55.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.625+0000 7f4dcb26e640 1 -- 172.21.15.194:0/954204322 learned_addr learned my addr 172.21.15.194:0/954204322 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:55.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.625+0000 7f4dcb26e640 1 -- 172.21.15.194:0/954204322 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4629e0640 con 0x55c4628ed8d0 2024-09-13T06:10:55.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.625+0000 7f4dcb26e640 1 --2- 172.21.15.194:0/954204322 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c4628ed8d0 0x55c4629e0100 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x55c4629d9f70 tx=0x7f4db4000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:55.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.625+0000 7f4cb7e07640 1 -- 172.21.15.194:0/954204322 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4db4001260 con 0x55c4628ed8d0 2024-09-13T06:10:55.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.625+0000 7f4dcd75e980 1 -- 172.21.15.194:0/954204322 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c4629e08d0 con 0x55c4628ed8d0 2024-09-13T06:10:55.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.625+0000 7f4cb7e07640 1 -- 172.21.15.194:0/954204322 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4db400fa40 con 0x55c4628ed8d0 2024-09-13T06:10:55.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.625+0000 7f4cb7e07640 1 -- 172.21.15.194:0/954204322 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4db400fd80 con 0x55c4628ed8d0 2024-09-13T06:10:55.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.625+0000 7f4dcd75e980 1 -- 172.21.15.194:0/954204322 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4629e35b0 con 0x55c4628ed8d0 2024-09-13T06:10:55.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.625+0000 7f4cb7e07640 1 -- 172.21.15.194:0/954204322 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4db4017070 con 0x55c4628ed8d0 2024-09-13T06:10:55.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.625+0000 7f4cb7e07640 1 --2- 172.21.15.194:0/954204322 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4cb0034650 0x7f4cb0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:55.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.625+0000 7f4cb7e07640 1 -- 172.21.15.194:0/954204322 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f4db4015020 con 0x55c4628ed8d0 2024-09-13T06:10:55.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.625+0000 7f4dcaa6d640 1 --2- 172.21.15.194:0/954204322 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4cb0034650 0x7f4cb0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:55.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.625+0000 7f4dcd75e980 1 --2- 172.21.15.194:0/954204322 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55c4629e51f0 0x55c4629e75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:55.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.625+0000 7f4dcd75e980 1 -- 172.21.15.194:0/954204322 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c4629e7b60 con 0x55c4629e51f0 2024-09-13T06:10:55.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.629+0000 7f4dcba6f640 1 --2- 172.21.15.194:0/954204322 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55c4629e51f0 0x55c4629e75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:55.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.629+0000 7f4dcaa6d640 1 --2- 172.21.15.194:0/954204322 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4cb0034650 0x7f4cb0036b10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc0ab000 tx=0x7f4dbc0a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:55.633 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.629+0000 7f4dcba6f640 1 --2- 172.21.15.194:0/954204322 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55c4629e51f0 0x55c4629e75e0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:55.633 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.629+0000 7f4dcba6f640 1 -- 172.21.15.194:0/954204322 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4dc40083f0 con 0x55c4629e51f0 2024-09-13T06:10:55.633 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.629+0000 7f4dcd75e980 1 -- 172.21.15.194:0/954204322 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c4629e47d0 con 0x55c4629e51f0 2024-09-13T06:10:55.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.629+0000 7f4dcba6f640 1 -- 172.21.15.194:0/954204322 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4dc40083f0 con 0x55c4629e51f0 2024-09-13T06:10:55.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.629+0000 7f4dcd75e980 1 --2- 172.21.15.194:0/954204322 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55c4629e9e70 0x55c4629ec260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:55.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.629+0000 7f4dcd75e980 1 -- 172.21.15.194:0/954204322 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c4629ec950 con 0x55c4629e9e70 2024-09-13T06:10:55.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.629+0000 7f4dcb26e640 1 --2- 172.21.15.194:0/954204322 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55c4629e9e70 0x55c4629ec260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:55.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.629+0000 7f4dcb26e640 1 --2- 172.21.15.194:0/954204322 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55c4629e9e70 0x55c4629ec260 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:55.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.629+0000 7f4dcb26e640 1 -- 172.21.15.194:0/954204322 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4db402e070 con 0x55c4629e9e70 2024-09-13T06:10:55.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.629+0000 7f4dcd75e980 1 -- 172.21.15.194:0/954204322 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c4629e8d10 con 0x55c4629e51f0 2024-09-13T06:10:55.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.629+0000 7f4dcba6f640 1 -- 172.21.15.194:0/954204322 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4dc40083f0 con 0x55c4629e51f0 2024-09-13T06:10:55.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.629+0000 7f4dcd75e980 1 --2- 172.21.15.194:0/954204322 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55c4629eddb0 0x55c4629f01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:55.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.629+0000 7f4dcd75e980 1 -- 172.21.15.194:0/954204322 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c4629f08e0 con 0x55c4629eddb0 2024-09-13T06:10:55.636 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.629+0000 7f4dcaa6d640 1 --2- 172.21.15.194:0/954204322 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55c4629eddb0 0x55c4629f01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:55.636 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.629+0000 7f4dcaa6d640 1 --2- 172.21.15.194:0/954204322 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55c4629eddb0 0x55c4629f01a0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:55.636 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.629+0000 7f4dcaa6d640 1 -- 172.21.15.194:0/954204322 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4dbc0bc040 con 0x55c4629eddb0 2024-09-13T06:10:55.636 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.629+0000 7f4dcd75e980 1 Processor -- start 2024-09-13T06:10:55.636 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.629+0000 7f4dcd75e980 1 -- start start 2024-09-13T06:10:55.636 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.629+0000 7f4dcd75e980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c4629fe380 0x55c4629fe7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:55.636 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.629+0000 7f4dcd75e980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55c4627f2800 con 0x55c4629fe380 2024-09-13T06:10:55.637 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.633+0000 7f4dcb26e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c4629fe380 0x55c4629fe7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:55.637 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.633+0000 7f4dcb26e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c4629fe380 0x55c4629fe7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:38480/0 (socket says 172.21.15.194:38480) 2024-09-13T06:10:55.637 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.633+0000 7f4dcb26e640 1 -- 172.21.15.194:0/2929716023 learned_addr learned my addr 172.21.15.194:0/2929716023 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:55.637 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.633+0000 7f4dcb26e640 1 -- 172.21.15.194:0/2929716023 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4629fece0 con 0x55c4629fe380 2024-09-13T06:10:55.638 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.633+0000 7f4dcb26e640 1 --2- 172.21.15.194:0/2929716023 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c4629fe380 0x55c4629fe7a0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f4db4024000 tx=0x7f4db4027800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:55.638 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.633+0000 7f4cb5602640 1 -- 172.21.15.194:0/2929716023 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4db404a7d0 con 0x55c4629fe380 2024-09-13T06:10:55.638 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.633+0000 7f4cb5602640 1 -- 172.21.15.194:0/2929716023 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4db4017980 con 0x55c4629fe380 2024-09-13T06:10:55.638 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.633+0000 7f4dcd75e980 1 -- 172.21.15.194:0/2929716023 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c4629fef70 con 0x55c4629fe380 2024-09-13T06:10:55.638 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.633+0000 7f4cb5602640 1 -- 172.21.15.194:0/2929716023 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4db4017c60 con 0x55c4629fe380 2024-09-13T06:10:55.638 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.633+0000 7f4dcd75e980 1 -- 172.21.15.194:0/2929716023 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4629fef70 con 0x55c4629fe380 2024-09-13T06:10:55.639 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.633+0000 7f4cb5602640 1 -- 172.21.15.194:0/2929716023 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4db401a480 con 0x55c4629fe380 2024-09-13T06:10:55.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.633+0000 7f4cb5602640 1 --2- 172.21.15.194:0/2929716023 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4ca4034650 0x7f4ca4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:55.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.633+0000 7f4cb5602640 1 -- 172.21.15.194:0/2929716023 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f4db403dd10 con 0x55c4629fe380 2024-09-13T06:10:55.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.633+0000 7f4dcaa6d640 1 --2- 172.21.15.194:0/2929716023 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4ca4034650 0x7f4ca4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:55.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.633+0000 7f4dcd75e980 1 Processor -- start 2024-09-13T06:10:55.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.633+0000 7f4dcd75e980 1 -- start start 2024-09-13T06:10:55.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.633+0000 7f4dcd75e980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c462a0ab60 0x55c462a0af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:55.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.633+0000 7f4dcd75e980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55c4629d96e0 con 0x55c462a0ab60 2024-09-13T06:10:55.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.633+0000 7f4dcaa6d640 1 --2- 172.21.15.194:0/2929716023 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4ca4034650 0x7f4ca4036b10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc0aa6b0 tx=0x7f4dbc005e50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:55.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.633+0000 7f4dcb26e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c462a0ab60 0x55c462a0af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:55.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.633+0000 7f4dcb26e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c462a0ab60 0x55c462a0af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:38486/0 (socket says 172.21.15.194:38486) 2024-09-13T06:10:55.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.633+0000 7f4dcb26e640 1 -- 172.21.15.194:0/2313582869 learned_addr learned my addr 172.21.15.194:0/2313582869 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:55.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.637+0000 7f4dcb26e640 1 -- 172.21.15.194:0/2313582869 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c462a0b510 con 0x55c462a0ab60 2024-09-13T06:10:55.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.637+0000 7f4dcb26e640 1 --2- 172.21.15.194:0/2313582869 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c462a0ab60 0x55c462a0af40 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f4db40199a0 tx=0x7f4db4042aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17ebb0d5059e76c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:55.643 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.637+0000 7f4caeffd640 1 -- 172.21.15.194:0/2313582869 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4db4023a90 con 0x55c462a0ab60 2024-09-13T06:10:55.643 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.637+0000 7f4caeffd640 1 -- 172.21.15.194:0/2313582869 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4db401dc70 con 0x55c462a0ab60 2024-09-13T06:10:55.643 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.637+0000 7f4caeffd640 1 -- 172.21.15.194:0/2313582869 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4db4044050 con 0x55c462a0ab60 2024-09-13T06:10:55.643 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.637+0000 7f4dcd75e980 1 -- 172.21.15.194:0/2313582869 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c462a0ab60 msgr2=0x55c462a0af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:55.643 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.637+0000 7f4dcd75e980 1 --2- 172.21.15.194:0/2313582869 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c462a0ab60 0x55c462a0af40 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f4db40199a0 tx=0x7f4db4042aa0 comp rx=0 tx=0).stop 2024-09-13T06:10:55.643 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.637+0000 7f4dcd75e980 1 -- 172.21.15.194:0/2313582869 shutdown_connections 2024-09-13T06:10:55.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.637+0000 7f4dcd75e980 1 --2- 172.21.15.194:0/2313582869 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c462a0ab60 0x55c462a0af40 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:55.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.637+0000 7f4dcd75e980 1 -- 172.21.15.194:0/2313582869 >> 172.21.15.194:0/2313582869 conn(0x55c462a06e90 msgr2=0x55c462a04f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:55.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.637+0000 7f4dcd75e980 1 -- 172.21.15.194:0/2313582869 shutdown_connections 2024-09-13T06:10:55.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.637+0000 7f4dcd75e980 1 -- 172.21.15.194:0/2313582869 wait complete. 2024-09-13T06:10:55.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.637+0000 7f4dcd75e980 1 Processor -- start 2024-09-13T06:10:55.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.637+0000 7f4dcd75e980 1 -- start start 2024-09-13T06:10:55.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.637+0000 7f4dcd75e980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c462a0ab60 0x55c462a11cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:55.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.637+0000 7f4dcd75e980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55c462a0ba20 con 0x55c462a0ab60 2024-09-13T06:10:55.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.637+0000 7f4dcb26e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c462a0ab60 0x55c462a11cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:55.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.637+0000 7f4dcb26e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c462a0ab60 0x55c462a11cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:38488/0 (socket says 172.21.15.194:38488) 2024-09-13T06:10:55.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.637+0000 7f4dcb26e640 1 -- 172.21.15.194:0/3483266634 learned_addr learned my addr 172.21.15.194:0/3483266634 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:55.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.637+0000 7f4dcb26e640 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c462a12210 con 0x55c462a0ab60 2024-09-13T06:10:55.645 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.637+0000 7f4dcb26e640 1 --2- 172.21.15.194:0/3483266634 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c462a0ab60 0x55c462a11cd0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f4db401de20 tx=0x7f4db4038f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:55.645 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.637+0000 7f4cad7fa640 1 -- 172.21.15.194:0/3483266634 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4db4023c70 con 0x55c462a0ab60 2024-09-13T06:10:55.645 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.637+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c462a12210 con 0x55c462a0ab60 2024-09-13T06:10:55.645 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.637+0000 7f4cad7fa640 1 -- 172.21.15.194:0/3483266634 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4db4031450 con 0x55c462a0ab60 2024-09-13T06:10:55.645 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.637+0000 7f4cad7fa640 1 -- 172.21.15.194:0/3483266634 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4db4023a90 con 0x55c462a0ab60 2024-09-13T06:10:55.645 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.637+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c462a12210 con 0x55c462a0ab60 2024-09-13T06:10:55.649 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.641+0000 7f4cad7fa640 1 -- 172.21.15.194:0/3483266634 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4db403a300 con 0x55c462a0ab60 2024-09-13T06:10:55.649 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.641+0000 7f4cad7fa640 1 --2- 172.21.15.194:0/3483266634 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4c94034650 0x7f4c94036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:55.649 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.641+0000 7f4cad7fa640 1 -- 172.21.15.194:0/3483266634 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f4db406ad40 con 0x55c462a0ab60 2024-09-13T06:10:55.649 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.641+0000 7f4dcd75e980 20 rados->read ofs=0 len=0 2024-09-13T06:10:55.649 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.641+0000 7f4dcaa6d640 1 --2- 172.21.15.194:0/3483266634 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4c94034650 0x7f4c94036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:55.649 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.641+0000 7f4dcd75e980 1 --2- 172.21.15.194:0/3483266634 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55c462a1cd70 0x55c462a1f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:55.649 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.641+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c462a1f980 con 0x55c462a1cd70 2024-09-13T06:10:55.649 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.641+0000 7f4dcba6f640 1 --2- 172.21.15.194:0/3483266634 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55c462a1cd70 0x55c462a1f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:55.649 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.641+0000 7f4dcaa6d640 1 --2- 172.21.15.194:0/3483266634 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4c94034650 0x7f4c94036b10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc00a190 tx=0x7f4dbc0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:55.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.641+0000 7f4dcba6f640 1 --2- 172.21.15.194:0/3483266634 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55c462a1cd70 0x55c462a1f230 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:55.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.641+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4dc40083f0 con 0x55c462a1cd70 2024-09-13T06:10:55.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.641+0000 7f4dcd75e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:55.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.641+0000 7f4dcd75e980 20 realm 2024-09-13T06:10:55.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.641+0000 7f4dcd75e980 20 rados->read ofs=0 len=0 2024-09-13T06:10:55.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.641+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c462a1fd90 con 0x55c462a1cd70 2024-09-13T06:10:55.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.641+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4dc40083f0 con 0x55c462a1cd70 2024-09-13T06:10:55.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.641+0000 7f4dcd75e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:55.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.641+0000 7f4dcd75e980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:10:55.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.641+0000 7f4dcd75e980 20 rados->read ofs=0 len=0 2024-09-13T06:10:55.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.641+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c462a20630 con 0x55c462a1cd70 2024-09-13T06:10:55.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.641+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4dc40083f0 con 0x55c462a1cd70 2024-09-13T06:10:55.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.641+0000 7f4dcd75e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:55.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.641+0000 7f4dcd75e980 20 rados->read ofs=0 len=0 2024-09-13T06:10:55.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.641+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c462a209d0 con 0x55c462a1cd70 2024-09-13T06:10:55.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.641+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4dc40083f0 con 0x55c462a1cd70 2024-09-13T06:10:55.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.641+0000 7f4dcd75e980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:10:55.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.641+0000 7f4dcd75e980 20 rados->read ofs=0 len=0 2024-09-13T06:10:55.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.641+0000 7f4dcd75e980 1 --2- 172.21.15.194:0/3483266634 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55c462a21730 0x55c462a23b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:55.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.641+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c462a240a0 con 0x55c462a21730 2024-09-13T06:10:55.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.641+0000 7f4dcb26e640 1 --2- 172.21.15.194:0/3483266634 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55c462a21730 0x55c462a23b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:55.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.641+0000 7f4dcb26e640 1 --2- 172.21.15.194:0/3483266634 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55c462a21730 0x55c462a23b20 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:55.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.641+0000 7f4dcb26e640 1 -- 172.21.15.194:0/3483266634 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4db406f020 con 0x55c462a21730 2024-09-13T06:10:55.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.641+0000 7f4dcd75e980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:10:55.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.641+0000 7f4dcd75e980 20 searching for the correct realm 2024-09-13T06:10:55.652 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.641+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c462a25900 con 0x55c462a21730 2024-09-13T06:10:55.652 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.645+0000 7f4dcb26e640 1 -- 172.21.15.194:0/3483266634 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4db406f020 con 0x55c462a21730 2024-09-13T06:10:55.652 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.645+0000 7f4dcb26e640 1 --2- 172.21.15.194:0/3483266634 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f4db4060040 0x7f4db404d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:55.652 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.645+0000 7f4dcb26e640 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c462a25900 con 0x7f4db4060040 2024-09-13T06:10:55.652 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.645+0000 7f4dcaa6d640 1 --2- 172.21.15.194:0/3483266634 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f4db4060040 0x7f4db404d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:55.652 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.645+0000 7f4dcaa6d640 1 --2- 172.21.15.194:0/3483266634 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f4db4060040 0x7f4db404d350 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:55.652 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.645+0000 7f4dcaa6d640 1 -- 172.21.15.194:0/3483266634 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4dbc0ca070 con 0x7f4db4060040 2024-09-13T06:10:55.652 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.645+0000 7f4dcaa6d640 1 --2- 172.21.15.194:0/3483266634 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f4dbc0dc040 0x7f4dbc0cd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:55.652 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.645+0000 7f4dcaa6d640 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c462a25900 con 0x7f4dbc0dc040 2024-09-13T06:10:55.652 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.645+0000 7f4dcba6f640 1 --2- 172.21.15.194:0/3483266634 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f4dbc0dc040 0x7f4dbc0cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:55.656 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.645+0000 7f4dcba6f640 1 --2- 172.21.15.194:0/3483266634 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f4dbc0dc040 0x7f4dbc0cd430 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:55.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.645+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dc40083f0 con 0x7f4dbc0dc040 2024-09-13T06:10:55.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.645+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c462a209d0 con 0x55c462a1cd70 2024-09-13T06:10:55.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.645+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dc40083f0 con 0x55c462a1cd70 2024-09-13T06:10:55.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.645+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c462a209d0 con 0x55c462a1cd70 2024-09-13T06:10:55.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.645+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dc40083f0 con 0x55c462a1cd70 2024-09-13T06:10:55.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.645+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c462a209d0 con 0x7f4dbc0dc040 2024-09-13T06:10:55.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.645+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dc40083f0 con 0x7f4dbc0dc040 2024-09-13T06:10:55.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.645+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c462a209d0 con 0x7f4dbc0dc040 2024-09-13T06:10:55.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.649+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dc40083f0 con 0x7f4dbc0dc040 2024-09-13T06:10:55.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.649+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c462a209d0 con 0x7f4db4060040 2024-09-13T06:10:55.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.649+0000 7f4dcaa6d640 1 -- 172.21.15.194:0/3483266634 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dbc0ca070 con 0x7f4db4060040 2024-09-13T06:10:55.658 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.649+0000 7f4dcaa6d640 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c462a209d0 con 0x55c462a21730 2024-09-13T06:10:55.658 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.649+0000 7f4dcb26e640 1 -- 172.21.15.194:0/3483266634 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4db406f020 con 0x55c462a21730 2024-09-13T06:10:55.658 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.649+0000 7f4dcb26e640 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c462a209d0 con 0x55c462a1cd70 2024-09-13T06:10:55.658 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.649+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dc40083f0 con 0x55c462a1cd70 2024-09-13T06:10:55.658 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.649+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c462a209d0 con 0x7f4dbc0dc040 2024-09-13T06:10:55.658 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.649+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dc40083f0 con 0x7f4dbc0dc040 2024-09-13T06:10:55.658 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.649+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c462a209d0 con 0x55c462a1cd70 2024-09-13T06:10:55.658 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.649+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dc40083f0 con 0x55c462a1cd70 2024-09-13T06:10:55.658 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.649+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c462a209d0 con 0x7f4db4060040 2024-09-13T06:10:55.658 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.649+0000 7f4dcaa6d640 1 -- 172.21.15.194:0/3483266634 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4dbc0ca070 con 0x7f4db4060040 2024-09-13T06:10:55.658 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.649+0000 7f4dcaa6d640 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c462a209d0 con 0x55c462a21730 2024-09-13T06:10:55.658 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.649+0000 7f4dcb26e640 1 -- 172.21.15.194:0/3483266634 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4db406f020 con 0x55c462a21730 2024-09-13T06:10:55.658 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.649+0000 7f4dcb26e640 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c462a209d0 con 0x55c462a21730 2024-09-13T06:10:55.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.649+0000 7f4dcb26e640 1 -- 172.21.15.194:0/3483266634 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4db406f020 con 0x55c462a21730 2024-09-13T06:10:55.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.649+0000 7f4dcb26e640 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c462a209d0 con 0x7f4dbc0dc040 2024-09-13T06:10:55.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.649+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dc40083f0 con 0x7f4dbc0dc040 2024-09-13T06:10:55.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.649+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c462a209d0 con 0x55c462a21730 2024-09-13T06:10:55.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.653+0000 7f4dcb26e640 1 -- 172.21.15.194:0/3483266634 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4db406f020 con 0x55c462a21730 2024-09-13T06:10:55.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.653+0000 7f4dcb26e640 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c462a209d0 con 0x55c462a21730 2024-09-13T06:10:55.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.653+0000 7f4dcb26e640 1 -- 172.21.15.194:0/3483266634 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4db406f020 con 0x55c462a21730 2024-09-13T06:10:55.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.653+0000 7f4dcb26e640 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c462a209d0 con 0x55c462a1cd70 2024-09-13T06:10:55.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.653+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dc40083f0 con 0x55c462a1cd70 2024-09-13T06:10:55.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.653+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c462a209d0 con 0x55c462a1cd70 2024-09-13T06:10:55.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.653+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4dc40083f0 con 0x55c462a1cd70 2024-09-13T06:10:55.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.653+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c462a209d0 con 0x7f4db4060040 2024-09-13T06:10:55.660 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.653+0000 7f4dcaa6d640 1 -- 172.21.15.194:0/3483266634 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dbc0ca070 con 0x7f4db4060040 2024-09-13T06:10:55.660 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.653+0000 7f4dcaa6d640 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c462a209d0 con 0x55c462a21730 2024-09-13T06:10:55.660 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.653+0000 7f4dcb26e640 1 -- 172.21.15.194:0/3483266634 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4db406f020 con 0x55c462a21730 2024-09-13T06:10:55.660 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.653+0000 7f4dcb26e640 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c462a209d0 con 0x7f4db4060040 2024-09-13T06:10:55.664 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.653+0000 7f4dcaa6d640 1 -- 172.21.15.194:0/3483266634 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dbc0ca070 con 0x7f4db4060040 2024-09-13T06:10:55.664 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.653+0000 7f4dcaa6d640 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c462a209d0 con 0x55c462a1cd70 2024-09-13T06:10:55.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.653+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dc40083f0 con 0x55c462a1cd70 2024-09-13T06:10:55.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.653+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c462a209d0 con 0x7f4dbc0dc040 2024-09-13T06:10:55.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.653+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dc40083f0 con 0x7f4dbc0dc040 2024-09-13T06:10:55.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.653+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c462a209d0 con 0x55c462a21730 2024-09-13T06:10:55.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.653+0000 7f4dcb26e640 1 -- 172.21.15.194:0/3483266634 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4db406f020 con 0x55c462a21730 2024-09-13T06:10:55.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.653+0000 7f4dcb26e640 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c462a209d0 con 0x7f4db4060040 2024-09-13T06:10:55.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.653+0000 7f4dcaa6d640 1 -- 172.21.15.194:0/3483266634 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dbc0ca070 con 0x7f4db4060040 2024-09-13T06:10:55.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.653+0000 7f4dcaa6d640 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c462a209d0 con 0x7f4db4060040 2024-09-13T06:10:55.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.653+0000 7f4dcaa6d640 1 -- 172.21.15.194:0/3483266634 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dbc0ca070 con 0x7f4db4060040 2024-09-13T06:10:55.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.653+0000 7f4dcaa6d640 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c462a209d0 con 0x55c462a21730 2024-09-13T06:10:55.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.657+0000 7f4dcb26e640 1 -- 172.21.15.194:0/3483266634 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4db406f020 con 0x55c462a21730 2024-09-13T06:10:55.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.657+0000 7f4dcb26e640 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c462a209d0 con 0x7f4dbc0dc040 2024-09-13T06:10:55.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.657+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dc40083f0 con 0x7f4dbc0dc040 2024-09-13T06:10:55.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.657+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c462a209d0 con 0x55c462a1cd70 2024-09-13T06:10:55.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.657+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4dc40083f0 con 0x55c462a1cd70 2024-09-13T06:10:55.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.657+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c462a209d0 con 0x7f4db4060040 2024-09-13T06:10:55.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.657+0000 7f4dcaa6d640 1 -- 172.21.15.194:0/3483266634 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dbc0ca070 con 0x7f4db4060040 2024-09-13T06:10:55.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.657+0000 7f4dcd75e980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:10:55.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.657+0000 7f4dcd75e980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:10:55.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.657+0000 7f4dcd75e980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:10:55.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.657+0000 7f4dcd75e980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:10:55.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.657+0000 7f4dcd75e980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:10:55.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.657+0000 7f4dcd75e980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:10:55.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.657+0000 7f4dcd75e980 20 rados->read ofs=0 len=0 2024-09-13T06:10:55.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.657+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c462a24a20 con 0x55c462a1cd70 2024-09-13T06:10:55.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.657+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4dc40083f0 con 0x55c462a1cd70 2024-09-13T06:10:55.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.657+0000 7f4dcd75e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:55.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.657+0000 7f4dcd75e980 20 rados->read ofs=0 len=0 2024-09-13T06:10:55.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.657+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c462a252c0 con 0x55c462a1cd70 2024-09-13T06:10:55.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.657+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4dc40083f0 con 0x55c462a1cd70 2024-09-13T06:10:55.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.657+0000 7f4dcd75e980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:10:55.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.657+0000 7f4dcd75e980 20 rados->read ofs=0 len=0 2024-09-13T06:10:55.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.657+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c462a24660 con 0x7f4db4060040 2024-09-13T06:10:55.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.657+0000 7f4dcaa6d640 1 -- 172.21.15.194:0/3483266634 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4dbc0ca070 con 0x7f4db4060040 2024-09-13T06:10:55.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.657+0000 7f4dcd75e980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:10:55.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.657+0000 7f4dcd75e980 20 zone default found 2024-09-13T06:10:55.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.657+0000 7f4dcd75e980 4 Realm: () 2024-09-13T06:10:55.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.657+0000 7f4dcd75e980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:10:55.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.657+0000 7f4dcd75e980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:10:55.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.657+0000 7f4dcd75e980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:10:55.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.657+0000 7f4dcd75e980 20 zonegroup default 2024-09-13T06:10:55.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.657+0000 7f4dcd75e980 20 rados->read ofs=0 len=0 2024-09-13T06:10:55.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.657+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c462a252c0 con 0x7f4dbc0dc040 2024-09-13T06:10:55.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.657+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4dc40083f0 con 0x7f4dbc0dc040 2024-09-13T06:10:55.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.657+0000 7f4dcd75e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:55.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.657+0000 7f4dcd75e980 20 rados->read ofs=0 len=0 2024-09-13T06:10:55.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.657+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c462a277b0 con 0x55c462a21730 2024-09-13T06:10:55.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.657+0000 7f4dcb26e640 1 -- 172.21.15.194:0/3483266634 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4db406f020 con 0x55c462a21730 2024-09-13T06:10:55.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.657+0000 7f4dcd75e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:55.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.657+0000 7f4dcd75e980 20 rados->read ofs=0 len=0 2024-09-13T06:10:55.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.657+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c462a27b50 con 0x55c462a21730 2024-09-13T06:10:55.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.657+0000 7f4dcb26e640 1 -- 172.21.15.194:0/3483266634 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4db406f020 con 0x55c462a21730 2024-09-13T06:10:55.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.657+0000 7f4dcd75e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:55.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.657+0000 7f4dcd75e980 20 started sync module instance, tier type = 2024-09-13T06:10:55.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.657+0000 7f4dcd75e980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:10:55.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.657+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c462a26c50 con 0x7f4db4060040 2024-09-13T06:10:55.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.661+0000 7f4dcaa6d640 1 -- 172.21.15.194:0/3483266634 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(44 notify.0 [create] v35'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dbc0ca070 con 0x7f4db4060040 2024-09-13T06:10:55.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.661+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94301956763712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c462a268b0 con 0x7f4db4060040 2024-09-13T06:10:55.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.661+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c462a28a30 con 0x55c462a1cd70 2024-09-13T06:10:55.671 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.661+0000 7f4dcaa6d640 1 -- 172.21.15.194:0/3483266634 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94301956763712] v35'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dbc0ca070 con 0x7f4db4060040 2024-09-13T06:10:55.671 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.661+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v35'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dc40083f0 con 0x55c462a1cd70 2024-09-13T06:10:55.671 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.661+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94301956769152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c462a289a0 con 0x55c462a1cd70 2024-09-13T06:10:55.671 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.661+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c462a29800 con 0x55c462a21730 2024-09-13T06:10:55.671 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.665+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94301956769152] v35'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dc40083f0 con 0x55c462a1cd70 2024-09-13T06:10:55.671 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.665+0000 7f4dcb26e640 1 -- 172.21.15.194:0/3483266634 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v35'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4db406f020 con 0x55c462a21730 2024-09-13T06:10:55.671 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.665+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94301956771360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c462a29bf0 con 0x55c462a21730 2024-09-13T06:10:55.671 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.665+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c462a2a5b0 con 0x7f4db4060040 2024-09-13T06:10:55.671 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.665+0000 7f4dcaa6d640 1 -- 172.21.15.194:0/3483266634 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(50 notify.3 [create] v35'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dbc0ca070 con 0x7f4db4060040 2024-09-13T06:10:55.671 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.665+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94301956778400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c462a2b270 con 0x7f4db4060040 2024-09-13T06:10:55.671 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.665+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c462a2bc30 con 0x55c462a1cd70 2024-09-13T06:10:55.672 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.669+0000 7f4dcb26e640 1 -- 172.21.15.194:0/3483266634 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94301956771360] v35'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4db406f020 con 0x55c462a21730 2024-09-13T06:10:55.672 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.669+0000 7f4dcaa6d640 1 -- 172.21.15.194:0/3483266634 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94301956778400] v35'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dbc0ca070 con 0x7f4db4060040 2024-09-13T06:10:55.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.669+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v35'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dc40083f0 con 0x55c462a1cd70 2024-09-13T06:10:55.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.669+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94301956772416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c462a2aed0 con 0x55c462a1cd70 2024-09-13T06:10:55.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.669+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c462a2bc30 con 0x7f4dbc0dc040 2024-09-13T06:10:55.675 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.669+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(54 notify.5 [create] v35'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dc40083f0 con 0x7f4dbc0dc040 2024-09-13T06:10:55.675 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.669+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94301956784704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c462a2bc30 con 0x7f4dbc0dc040 2024-09-13T06:10:55.675 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.669+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c462a2d270 con 0x7f4dbc0dc040 2024-09-13T06:10:55.675 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.669+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94301956772416] v35'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dc40083f0 con 0x55c462a1cd70 2024-09-13T06:10:55.677 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.673+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94301956784704] v35'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dc40083f0 con 0x7f4dbc0dc040 2024-09-13T06:10:55.677 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.673+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(56 notify.6 [create] v35'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dc40083f0 con 0x7f4dbc0dc040 2024-09-13T06:10:55.677 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.673+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94301956781952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c462a2bba0 con 0x7f4dbc0dc040 2024-09-13T06:10:55.677 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.673+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c462a2d720 con 0x7f4dbc0dc040 2024-09-13T06:10:55.678 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.673+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94301956781952] v35'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dc40083f0 con 0x7f4dbc0dc040 2024-09-13T06:10:55.679 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.673+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(58 notify.7 [create] v35'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dc40083f0 con 0x7f4dbc0dc040 2024-09-13T06:10:55.679 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.673+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94301956787648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c462a2d690 con 0x7f4dbc0dc040 2024-09-13T06:10:55.679 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.673+0000 7f4dcd75e980 20 add_watcher() i=0 2024-09-13T06:10:55.679 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.673+0000 7f4dcd75e980 20 add_watcher() i=1 2024-09-13T06:10:55.680 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.673+0000 7f4dcd75e980 20 add_watcher() i=2 2024-09-13T06:10:55.680 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.673+0000 7f4dcd75e980 20 add_watcher() i=3 2024-09-13T06:10:55.680 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.673+0000 7f4dcd75e980 20 add_watcher() i=4 2024-09-13T06:10:55.680 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.673+0000 7f4dcd75e980 20 add_watcher() i=5 2024-09-13T06:10:55.680 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.673+0000 7f4dcd75e980 20 add_watcher() i=6 2024-09-13T06:10:55.681 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.677+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94301956787648] v35'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dc40083f0 con 0x7f4dbc0dc040 2024-09-13T06:10:55.681 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.677+0000 7f4dcd75e980 20 add_watcher() i=7 2024-09-13T06:10:55.681 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.677+0000 7f4dcd75e980 2 all 8 watchers are set, enabling cache 2024-09-13T06:10:55.681 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.677+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c462a30ac0 con 0x55c462a1cd70 2024-09-13T06:10:55.682 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.677+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4dc40083f0 con 0x55c462a1cd70 2024-09-13T06:10:55.682 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.677+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94301956789168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c462a2dfe0 con 0x55c462a1cd70 2024-09-13T06:10:55.683 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.677+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94301956789168] v35'198 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4dc40083f0 con 0x55c462a1cd70 2024-09-13T06:10:55.683 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.677+0000 7f4c81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:10:55.683 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.677+0000 7f4dcd75e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:10:55.683 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.677+0000 7f4dcd75e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:10:55.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.677+0000 7f4dcd75e980 5 note: GC not initialized 2024-09-13T06:10:55.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.677+0000 7f4c80fe1640 20 reqs_thread_entry: start 2024-09-13T06:10:55.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.681+0000 7f4dcd75e980 20 init_complete bucket index max shards: 11 2024-09-13T06:10:55.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.681+0000 7f4dcd75e980 20 Filter name: none 2024-09-13T06:10:55.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.681+0000 7f4bfa7fc640 20 reqs_thread_entry: start 2024-09-13T06:10:55.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.681+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c462a546d0 con 0x55c462a1cd70 2024-09-13T06:10:55.686 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.681+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f4dc40083f0 con 0x55c462a1cd70 2024-09-13T06:10:55.686 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.681+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c462a546d0 con 0x7f4db4060040 2024-09-13T06:10:55.686 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.681+0000 7f4dcaa6d640 1 -- 172.21.15.194:0/3483266634 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f4dbc0ca070 con 0x7f4db4060040 2024-09-13T06:10:55.686 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.681+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c462a54690 con 0x55c462a1cd70 2024-09-13T06:10:55.686 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.681+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f4dc40083f0 con 0x55c462a1cd70 2024-09-13T06:10:55.686 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.681+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c462a54690 con 0x55c462a21730 2024-09-13T06:10:55.687 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.681+0000 7f4dcb26e640 1 -- 172.21.15.194:0/3483266634 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f4db406f020 con 0x55c462a21730 2024-09-13T06:10:55.687 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.681+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c462a54bf0 con 0x55c462a21730 2024-09-13T06:10:55.687 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.681+0000 7f4dcb26e640 1 -- 172.21.15.194:0/3483266634 <== osd.3 v2:172.21.15.194:6816/96632515 16 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f4db406f020 con 0x55c462a21730 2024-09-13T06:10:55.687 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.681+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c462a54bf0 con 0x55c462a21730 2024-09-13T06:10:55.687 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.681+0000 7f4dcb26e640 1 -- 172.21.15.194:0/3483266634 <== osd.3 v2:172.21.15.194:6816/96632515 17 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f4db406f020 con 0x55c462a21730 2024-09-13T06:10:55.687 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.681+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c462a54bf0 con 0x55c462a1cd70 2024-09-13T06:10:55.687 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.681+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f4dc40083f0 con 0x55c462a1cd70 2024-09-13T06:10:55.687 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.681+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c462a54bf0 con 0x55c462a1cd70 2024-09-13T06:10:55.687 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.681+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f4dc40083f0 con 0x55c462a1cd70 2024-09-13T06:10:55.687 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.681+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c462a54b70 con 0x55c462a21730 2024-09-13T06:10:55.687 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.681+0000 7f4dcb26e640 1 -- 172.21.15.194:0/3483266634 <== osd.3 v2:172.21.15.194:6816/96632515 18 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f4db406f020 con 0x55c462a21730 2024-09-13T06:10:55.687 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.681+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c462a54b70 con 0x55c462a21730 2024-09-13T06:10:55.687 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.681+0000 7f4dcb26e640 1 -- 172.21.15.194:0/3483266634 <== osd.3 v2:172.21.15.194:6816/96632515 19 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f4db406f020 con 0x55c462a21730 2024-09-13T06:10:55.688 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.681+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c462a54b70 con 0x7f4dbc0dc040 2024-09-13T06:10:55.689 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.685+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(72 usage.10 [call out=1268b] v0'0 uv30 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f4dc40083f0 con 0x7f4dbc0dc040 2024-09-13T06:10:55.689 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.685+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c462a56720 con 0x55c462a1cd70 2024-09-13T06:10:55.689 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.685+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 <== osd.1 v2:172.21.15.194:6808/3135444559 25 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4dc40083f0 con 0x55c462a1cd70 2024-09-13T06:10:55.689 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.685+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c462a56720 con 0x7f4db4060040 2024-09-13T06:10:55.689 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.685+0000 7f4dcaa6d640 1 -- 172.21.15.194:0/3483266634 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4dbc0ca070 con 0x7f4db4060040 2024-09-13T06:10:55.689 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.685+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c462a56720 con 0x55c462a21730 2024-09-13T06:10:55.689 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.685+0000 7f4dcb26e640 1 -- 172.21.15.194:0/3483266634 <== osd.3 v2:172.21.15.194:6816/96632515 20 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4db406f020 con 0x55c462a21730 2024-09-13T06:10:55.689 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.685+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c462a56720 con 0x7f4dbc0dc040 2024-09-13T06:10:55.690 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.685+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4dc40083f0 con 0x7f4dbc0dc040 2024-09-13T06:10:55.690 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.685+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c462a56720 con 0x7f4dbc0dc040 2024-09-13T06:10:55.690 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.685+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4dc40083f0 con 0x7f4dbc0dc040 2024-09-13T06:10:55.690 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.685+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c462a56720 con 0x55c462a21730 2024-09-13T06:10:55.691 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.685+0000 7f4dcb26e640 1 -- 172.21.15.194:0/3483266634 <== osd.3 v2:172.21.15.194:6816/96632515 21 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4db406f020 con 0x55c462a21730 2024-09-13T06:10:55.691 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.685+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c462a56720 con 0x7f4dbc0dc040 2024-09-13T06:10:55.692 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.685+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(79 usage.17 [call out=163b] v0'0 uv5 ondisk = 0) ==== 152+0+163 (crc 0 0 0) 0x7f4dc40083f0 con 0x7f4dbc0dc040 2024-09-13T06:10:55.692 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.685+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c462a56720 con 0x55c462a1cd70 2024-09-13T06:10:55.692 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.689+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 <== osd.1 v2:172.21.15.194:6808/3135444559 26 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4dc40083f0 con 0x55c462a1cd70 2024-09-13T06:10:55.692 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.689+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c462a56720 con 0x55c462a21730 2024-09-13T06:10:55.692 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.689+0000 7f4dcb26e640 1 -- 172.21.15.194:0/3483266634 <== osd.3 v2:172.21.15.194:6816/96632515 22 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4db406f020 con 0x55c462a21730 2024-09-13T06:10:55.692 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.689+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c462a56720 con 0x7f4dbc0dc040 2024-09-13T06:10:55.693 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.689+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4dc40083f0 con 0x7f4dbc0dc040 2024-09-13T06:10:55.693 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.689+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c462a56720 con 0x7f4db4060040 2024-09-13T06:10:55.693 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.689+0000 7f4dcaa6d640 1 -- 172.21.15.194:0/3483266634 <== osd.2 v2:172.21.15.194:6800/815615585 16 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4dbc0ca070 con 0x7f4db4060040 2024-09-13T06:10:55.693 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.689+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c462a56720 con 0x7f4dbc0dc040 2024-09-13T06:10:55.695 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.689+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 <== osd.0 v2:172.21.15.120:6800/1923744619 20 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4dc40083f0 con 0x7f4dbc0dc040 2024-09-13T06:10:55.695 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.689+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c462a56720 con 0x55c462a1cd70 2024-09-13T06:10:55.695 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.689+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 <== osd.1 v2:172.21.15.194:6808/3135444559 27 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4dc40083f0 con 0x55c462a1cd70 2024-09-13T06:10:55.695 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.689+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c462a56720 con 0x55c462a1cd70 2024-09-13T06:10:55.695 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.689+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 <== osd.1 v2:172.21.15.194:6808/3135444559 28 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4dc40083f0 con 0x55c462a1cd70 2024-09-13T06:10:55.695 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.689+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c462a56720 con 0x55c462a21730 2024-09-13T06:10:55.695 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.689+0000 7f4dcb26e640 1 -- 172.21.15.194:0/3483266634 <== osd.3 v2:172.21.15.194:6816/96632515 23 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4db406f020 con 0x55c462a21730 2024-09-13T06:10:55.695 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.689+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c462a56720 con 0x55c462a1cd70 2024-09-13T06:10:55.695 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.689+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 <== osd.1 v2:172.21.15.194:6808/3135444559 29 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4dc40083f0 con 0x55c462a1cd70 2024-09-13T06:10:55.695 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.689+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c462a56720 con 0x55c462a1cd70 2024-09-13T06:10:55.695 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.689+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 <== osd.1 v2:172.21.15.194:6808/3135444559 30 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4dc40083f0 con 0x55c462a1cd70 2024-09-13T06:10:55.695 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.689+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c462a56720 con 0x55c462a21730 2024-09-13T06:10:55.696 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.689+0000 7f4dcb26e640 1 -- 172.21.15.194:0/3483266634 <== osd.3 v2:172.21.15.194:6816/96632515 24 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4db406f020 con 0x55c462a21730 2024-09-13T06:10:55.696 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.689+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c462a56720 con 0x55c462a21730 2024-09-13T06:10:55.696 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.689+0000 7f4dcb26e640 1 -- 172.21.15.194:0/3483266634 <== osd.3 v2:172.21.15.194:6816/96632515 25 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4db406f020 con 0x55c462a21730 2024-09-13T06:10:55.697 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.689+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c462a56720 con 0x55c462a21730 2024-09-13T06:10:55.697 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.693+0000 7f4dcb26e640 1 -- 172.21.15.194:0/3483266634 <== osd.3 v2:172.21.15.194:6816/96632515 26 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4db406f020 con 0x55c462a21730 2024-09-13T06:10:55.697 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.693+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c462a56720 con 0x7f4dbc0dc040 2024-09-13T06:10:55.697 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.693+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 <== osd.0 v2:172.21.15.120:6800/1923744619 21 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4dc40083f0 con 0x7f4dbc0dc040 2024-09-13T06:10:55.697 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.693+0000 7f4c81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:10:55.697 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.693+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94301956789168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c462a524c0 con 0x55c462a1cd70 2024-09-13T06:10:55.698 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.693+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 <== osd.1 v2:172.21.15.194:6808/3135444559 31 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94301956789168] v35'199 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4dc40083f0 con 0x55c462a1cd70 2024-09-13T06:10:55.698 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.693+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94301956763712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c462a2d380 con 0x7f4db4060040 2024-09-13T06:10:55.700 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.697+0000 7f4dcaa6d640 1 -- 172.21.15.194:0/3483266634 <== osd.2 v2:172.21.15.194:6800/815615585 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94301956763712] v35'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dbc0ca070 con 0x7f4db4060040 2024-09-13T06:10:55.700 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.697+0000 7f4dcd75e980 20 remove_watcher() i=0 2024-09-13T06:10:55.700 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.697+0000 7f4dcd75e980 2 removed watcher, disabling cache 2024-09-13T06:10:55.700 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.697+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94301956769152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c462a27040 con 0x55c462a1cd70 2024-09-13T06:10:55.702 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.697+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 <== osd.1 v2:172.21.15.194:6808/3135444559 32 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94301956769152] v35'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dc40083f0 con 0x55c462a1cd70 2024-09-13T06:10:55.702 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.697+0000 7f4dcd75e980 20 remove_watcher() i=1 2024-09-13T06:10:55.702 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.697+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94301956771360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c462a27040 con 0x55c462a21730 2024-09-13T06:10:55.704 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.701+0000 7f4dcb26e640 1 -- 172.21.15.194:0/3483266634 <== osd.3 v2:172.21.15.194:6816/96632515 27 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94301956771360] v35'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4db406f020 con 0x55c462a21730 2024-09-13T06:10:55.704 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.701+0000 7f4dcd75e980 20 remove_watcher() i=2 2024-09-13T06:10:55.704 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.701+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94301956778400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c462a28e20 con 0x7f4db4060040 2024-09-13T06:10:55.705 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.701+0000 7f4dcaa6d640 1 -- 172.21.15.194:0/3483266634 <== osd.2 v2:172.21.15.194:6800/815615585 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94301956778400] v35'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dbc0ca070 con 0x7f4db4060040 2024-09-13T06:10:55.705 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.701+0000 7f4dcd75e980 20 remove_watcher() i=3 2024-09-13T06:10:55.705 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.701+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94301956772416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c462a27040 con 0x55c462a1cd70 2024-09-13T06:10:55.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.701+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 <== osd.1 v2:172.21.15.194:6808/3135444559 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94301956772416] v35'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dc40083f0 con 0x55c462a1cd70 2024-09-13T06:10:55.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.701+0000 7f4dcd75e980 20 remove_watcher() i=4 2024-09-13T06:10:55.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.701+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94301956784704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c462a2a9a0 con 0x7f4dbc0dc040 2024-09-13T06:10:55.709 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.705+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 <== osd.0 v2:172.21.15.120:6800/1923744619 22 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94301956784704] v35'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dc40083f0 con 0x7f4dbc0dc040 2024-09-13T06:10:55.709 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.705+0000 7f4dcd75e980 20 remove_watcher() i=5 2024-09-13T06:10:55.709 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.705+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94301956781952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c462a27040 con 0x7f4dbc0dc040 2024-09-13T06:10:55.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.705+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 <== osd.0 v2:172.21.15.120:6800/1923744619 23 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94301956781952] v35'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dc40083f0 con 0x7f4dbc0dc040 2024-09-13T06:10:55.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.705+0000 7f4dcd75e980 20 remove_watcher() i=6 2024-09-13T06:10:55.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.705+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94301956787648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c462a2c240 con 0x7f4dbc0dc040 2024-09-13T06:10:55.715 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.709+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 <== osd.0 v2:172.21.15.120:6800/1923744619 24 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94301956787648] v35'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dc40083f0 con 0x7f4dbc0dc040 2024-09-13T06:10:55.715 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.709+0000 7f4dcd75e980 20 remove_watcher() i=7 2024-09-13T06:10:55.715 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.709+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f4dbc0dc040 msgr2=0x7f4dbc0cd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:55.715 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.709+0000 7f4dcd75e980 1 --2- 172.21.15.194:0/3483266634 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f4dbc0dc040 0x7f4dbc0cd430 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:55.715 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.709+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55c462a1cd70 msgr2=0x55c462a1f230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:55.716 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.709+0000 7f4dcd75e980 1 --2- 172.21.15.194:0/3483266634 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55c462a1cd70 0x55c462a1f230 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:55.716 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.709+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f4db4060040 msgr2=0x7f4db404d350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:55.716 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.709+0000 7f4dcd75e980 1 --2- 172.21.15.194:0/3483266634 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f4db4060040 0x7f4db404d350 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:55.716 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.709+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55c462a21730 msgr2=0x55c462a23b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:55.716 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.709+0000 7f4dcd75e980 1 --2- 172.21.15.194:0/3483266634 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55c462a21730 0x55c462a23b20 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:55.716 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.709+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4c94034650 msgr2=0x7f4c94036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:55.716 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.709+0000 7f4dcd75e980 1 --2- 172.21.15.194:0/3483266634 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4c94034650 0x7f4c94036b10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc00a190 tx=0x7f4dbc0a6000 comp rx=0 tx=0).stop 2024-09-13T06:10:55.716 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.709+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c462a0ab60 msgr2=0x55c462a11cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:55.716 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.709+0000 7f4dcba6f640 1 -- 172.21.15.194:0/3483266634 reap_dead start 2024-09-13T06:10:55.716 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.709+0000 7f4dcd75e980 1 --2- 172.21.15.194:0/3483266634 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c462a0ab60 0x55c462a11cd0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f4db401de20 tx=0x7f4db4038f00 comp rx=0 tx=0).stop 2024-09-13T06:10:55.716 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.709+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 shutdown_connections 2024-09-13T06:10:55.717 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.709+0000 7f4dcd75e980 1 --2- 172.21.15.194:0/3483266634 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c462a0ab60 0x55c462a11cd0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:55.717 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.709+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 >> 172.21.15.194:0/3483266634 conn(0x55c462a06e90 msgr2=0x55c462a04f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:55.717 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.709+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 shutdown_connections 2024-09-13T06:10:55.717 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.709+0000 7f4dcd75e980 1 -- 172.21.15.194:0/3483266634 wait complete. 2024-09-13T06:10:55.717 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.709+0000 7f4dcd75e980 1 -- 172.21.15.194:0/2929716023 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4ca4034650 msgr2=0x7f4ca4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:55.717 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.709+0000 7f4dcd75e980 1 --2- 172.21.15.194:0/2929716023 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4ca4034650 0x7f4ca4036b10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc0aa6b0 tx=0x7f4dbc005e50 comp rx=0 tx=0).stop 2024-09-13T06:10:55.717 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.709+0000 7f4dcd75e980 1 -- 172.21.15.194:0/2929716023 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c4629fe380 msgr2=0x55c4629fe7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:55.717 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.709+0000 7f4dcd75e980 1 --2- 172.21.15.194:0/2929716023 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c4629fe380 0x55c4629fe7a0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f4db4024000 tx=0x7f4db4027800 comp rx=0 tx=0).stop 2024-09-13T06:10:55.717 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.709+0000 7f4dcd75e980 1 -- 172.21.15.194:0/2929716023 shutdown_connections 2024-09-13T06:10:55.717 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.709+0000 7f4dcd75e980 1 --2- 172.21.15.194:0/2929716023 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4ca4034650 0x7f4ca4036b10 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:55.717 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.709+0000 7f4dcd75e980 1 --2- 172.21.15.194:0/2929716023 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c4629fe380 0x55c4629fe7a0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:55.717 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.709+0000 7f4dcd75e980 1 -- 172.21.15.194:0/2929716023 >> 172.21.15.194:0/2929716023 conn(0x55c4629f34d0 msgr2=0x55c4629f5f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:55.718 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.709+0000 7f4dcd75e980 1 -- 172.21.15.194:0/2929716023 shutdown_connections 2024-09-13T06:10:55.718 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.709+0000 7f4dcd75e980 1 -- 172.21.15.194:0/2929716023 wait complete. 2024-09-13T06:10:55.718 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.709+0000 7f4dcd75e980 1 -- 172.21.15.194:0/954204322 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55c4629e51f0 msgr2=0x55c4629e75e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:55.718 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.709+0000 7f4dcd75e980 1 --2- 172.21.15.194:0/954204322 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55c4629e51f0 0x55c4629e75e0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:55.718 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.709+0000 7f4dcd75e980 1 -- 172.21.15.194:0/954204322 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55c4629eddb0 msgr2=0x55c4629f01a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:55.718 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.709+0000 7f4dcd75e980 1 --2- 172.21.15.194:0/954204322 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55c4629eddb0 0x55c4629f01a0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:55.718 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.709+0000 7f4dcd75e980 1 -- 172.21.15.194:0/954204322 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55c4629e9e70 msgr2=0x55c4629ec260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:55.718 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.709+0000 7f4dcd75e980 1 --2- 172.21.15.194:0/954204322 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55c4629e9e70 0x55c4629ec260 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:55.718 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.709+0000 7f4dcd75e980 1 -- 172.21.15.194:0/954204322 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4cb0034650 msgr2=0x7f4cb0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:55.718 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.709+0000 7f4dcd75e980 1 --2- 172.21.15.194:0/954204322 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4cb0034650 0x7f4cb0036b10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc0ab000 tx=0x7f4dbc0a5000 comp rx=0 tx=0).stop 2024-09-13T06:10:55.718 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.709+0000 7f4dcd75e980 1 -- 172.21.15.194:0/954204322 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c4628ed8d0 msgr2=0x55c4629e0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:55.719 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.709+0000 7f4dcd75e980 1 --2- 172.21.15.194:0/954204322 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c4628ed8d0 0x55c4629e0100 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x55c4629d9f70 tx=0x7f4db4000bd0 comp rx=0 tx=0).stop 2024-09-13T06:10:55.719 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.709+0000 7f4dcba6f640 1 -- 172.21.15.194:0/954204322 reap_dead start 2024-09-13T06:10:55.719 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.709+0000 7f4dcd75e980 1 -- 172.21.15.194:0/954204322 shutdown_connections 2024-09-13T06:10:55.719 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.709+0000 7f4dcd75e980 1 -- 172.21.15.194:0/954204322 >> 172.21.15.194:0/954204322 conn(0x55c462861220 msgr2=0x55c4629d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:55.719 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.709+0000 7f4dcd75e980 1 -- 172.21.15.194:0/954204322 shutdown_connections 2024-09-13T06:10:55.719 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.709+0000 7f4dcd75e980 1 -- 172.21.15.194:0/954204322 wait complete. 2024-09-13T06:10:55.725 INFO:teuthology.orchestra.run.smithi194.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}]}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}],"total":{"bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}},{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34}}]} 2024-09-13T06:10:55.726 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34}}]} 2024-09-13T06:10:55.726 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-09-13T06:10:55.726 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-09-13T06:10:55.726 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-09-13T06:10:55.803 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:10:55.804 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:10:55.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.801+0000 7ff85a281980 1 Processor -- start 2024-09-13T06:10:55.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.801+0000 7ff85a281980 1 -- start start 2024-09-13T06:10:55.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.801+0000 7ff85a281980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55d25dc848f0 0x55d25dc86ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:55.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.801+0000 7ff85a281980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d25db09ae0 con 0x55d25dc80570 2024-09-13T06:10:55.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.801+0000 7ff85a281980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x55d25db2de30 con 0x55d25dc848f0 2024-09-13T06:10:55.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.801+0000 7ff857d91640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x55d25dc80570 0x55d25dc80950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:34378/0 (socket says 172.21.15.194:34378) 2024-09-13T06:10:55.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.801+0000 7ff857590640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55d25dc848f0 0x55d25dc86ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:55.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.801+0000 7ff857d91640 1 -- 172.21.15.194:0/1635406458 learned_addr learned my addr 172.21.15.194:0/1635406458 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-09-13T06:10:55.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.801+0000 7ff857590640 1 -- 172.21.15.194:0/1635406458 >> v1:172.21.15.120:6789/0 conn(0x55d25dc80570 legacy=0x55d25dc80950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:55.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.801+0000 7ff857590640 1 -- 172.21.15.194:0/1635406458 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d25dc88230 con 0x55d25dc848f0 2024-09-13T06:10:55.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.805+0000 7ff857590640 1 --2- 172.21.15.194:0/1635406458 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d25dc848f0 0x55d25dc86ce0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7ff84c00a480 tx=0x7ff84c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f01b0e26c013d4b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:55.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.805+0000 7ff856d8f640 1 -- 172.21.15.194:0/1635406458 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff84c0b0070 con 0x55d25dc848f0 2024-09-13T06:10:55.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.805+0000 7ff856d8f640 1 -- 172.21.15.194:0/1635406458 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff84c0ab540 con 0x55d25dc848f0 2024-09-13T06:10:55.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.805+0000 7ff856d8f640 1 -- 172.21.15.194:0/1635406458 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff84c0ab840 con 0x55d25dc848f0 2024-09-13T06:10:55.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.805+0000 7ff85a281980 1 -- 172.21.15.194:0/1635406458 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d25dc848f0 msgr2=0x55d25dc86ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:55.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.805+0000 7ff85a281980 1 --2- 172.21.15.194:0/1635406458 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d25dc848f0 0x55d25dc86ce0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7ff84c00a480 tx=0x7ff84c01b280 comp rx=0 tx=0).stop 2024-09-13T06:10:55.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.805+0000 7ff85a281980 1 -- 172.21.15.194:0/1635406458 shutdown_connections 2024-09-13T06:10:55.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.805+0000 7ff85a281980 1 --2- 172.21.15.194:0/1635406458 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d25dc848f0 0x55d25dc86ce0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:55.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.805+0000 7ff85a281980 1 -- 172.21.15.194:0/1635406458 >> 172.21.15.194:0/1635406458 conn(0x55d25dc7c090 msgr2=0x55d25dc7e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:55.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.805+0000 7ff85a281980 1 -- 172.21.15.194:0/1635406458 shutdown_connections 2024-09-13T06:10:55.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.805+0000 7ff85a281980 1 -- 172.21.15.194:0/1635406458 wait complete. 2024-09-13T06:10:55.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.821+0000 7ff85a281980 1 Processor -- start 2024-09-13T06:10:55.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.821+0000 7ff85a281980 1 -- start start 2024-09-13T06:10:55.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.821+0000 7ff85a281980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d25dc80570 0x55d25dbf5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:55.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.821+0000 7ff85a281980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55d25db2f200 con 0x55d25dc80570 2024-09-13T06:10:55.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.821+0000 7ff857d91640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d25dc80570 0x55d25dbf5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:55.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.821+0000 7ff857d91640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d25dc80570 0x55d25dbf5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:38500/0 (socket says 172.21.15.194:38500) 2024-09-13T06:10:55.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.821+0000 7ff857d91640 1 -- 172.21.15.194:0/607411985 learned_addr learned my addr 172.21.15.194:0/607411985 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:55.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.821+0000 7ff857d91640 1 -- 172.21.15.194:0/607411985 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d25dbf61d0 con 0x55d25dc80570 2024-09-13T06:10:55.829 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.821+0000 7ff857d91640 1 --2- 172.21.15.194:0/607411985 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d25dc80570 0x55d25dbf5c00 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7ff8500017b0 tx=0x7ff850001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df8ed83237efcbe7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:55.829 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.821+0000 7ff745e0b640 1 -- 172.21.15.194:0/607411985 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff850016070 con 0x55d25dc80570 2024-09-13T06:10:55.829 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.825+0000 7ff745e0b640 1 -- 172.21.15.194:0/607411985 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff850004530 con 0x55d25dc80570 2024-09-13T06:10:55.829 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.825+0000 7ff745e0b640 1 -- 172.21.15.194:0/607411985 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff850004870 con 0x55d25dc80570 2024-09-13T06:10:55.829 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.825+0000 7ff85a281980 1 -- 172.21.15.194:0/607411985 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d25dc80570 msgr2=0x55d25dbf5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:55.829 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.825+0000 7ff85a281980 1 --2- 172.21.15.194:0/607411985 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d25dc80570 0x55d25dbf5c00 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7ff8500017b0 tx=0x7ff850001c70 comp rx=0 tx=0).stop 2024-09-13T06:10:55.829 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.825+0000 7ff85a281980 1 -- 172.21.15.194:0/607411985 shutdown_connections 2024-09-13T06:10:55.829 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.825+0000 7ff85a281980 1 --2- 172.21.15.194:0/607411985 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d25dc80570 0x55d25dbf5c00 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:55.830 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.825+0000 7ff85a281980 1 -- 172.21.15.194:0/607411985 >> 172.21.15.194:0/607411985 conn(0x55d25dc7c090 msgr2=0x55d25dd675a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:55.830 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.825+0000 7ff85a281980 1 -- 172.21.15.194:0/607411985 shutdown_connections 2024-09-13T06:10:55.830 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.825+0000 7ff85a281980 1 -- 172.21.15.194:0/607411985 wait complete. 2024-09-13T06:10:55.830 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.825+0000 7ff85a281980 1 Processor -- start 2024-09-13T06:10:55.830 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.825+0000 7ff85a281980 1 -- start start 2024-09-13T06:10:55.830 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.825+0000 7ff85a281980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d25dc848f0 0x55d25dd6d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:55.830 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.825+0000 7ff85a281980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55d25dc87d30 con 0x55d25dc848f0 2024-09-13T06:10:55.830 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.825+0000 7ff857d91640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d25dc848f0 0x55d25dd6d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:55.830 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.825+0000 7ff857d91640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d25dc848f0 0x55d25dd6d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:38512/0 (socket says 172.21.15.194:38512) 2024-09-13T06:10:55.830 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.825+0000 7ff857d91640 1 -- 172.21.15.194:0/161053690 learned_addr learned my addr 172.21.15.194:0/161053690 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:55.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.825+0000 7ff857d91640 1 -- 172.21.15.194:0/161053690 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d25dd6d650 con 0x55d25dc848f0 2024-09-13T06:10:55.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.825+0000 7ff857d91640 1 --2- 172.21.15.194:0/161053690 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d25dc848f0 0x55d25dd6d110 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7ff850000f90 tx=0x7ff850001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:55.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.825+0000 7ff73ffff640 1 -- 172.21.15.194:0/161053690 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff850020020 con 0x55d25dc848f0 2024-09-13T06:10:55.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.825+0000 7ff85a281980 1 -- 172.21.15.194:0/161053690 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d25dd6b830 con 0x55d25dc848f0 2024-09-13T06:10:55.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.825+0000 7ff85a281980 1 -- 172.21.15.194:0/161053690 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d25dd6bd80 con 0x55d25dc848f0 2024-09-13T06:10:55.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.825+0000 7ff73ffff640 1 -- 172.21.15.194:0/161053690 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff850017040 con 0x55d25dc848f0 2024-09-13T06:10:55.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.825+0000 7ff73ffff640 1 -- 172.21.15.194:0/161053690 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff850016070 con 0x55d25dc848f0 2024-09-13T06:10:55.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.829+0000 7ff73ffff640 1 -- 172.21.15.194:0/161053690 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff850023020 con 0x55d25dc848f0 2024-09-13T06:10:55.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.829+0000 7ff73ffff640 1 --2- 172.21.15.194:0/161053690 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff7400346a0 0x7ff740036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:55.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.829+0000 7ff73ffff640 1 -- 172.21.15.194:0/161053690 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7ff850048ba0 con 0x55d25dc848f0 2024-09-13T06:10:55.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.829+0000 7ff857590640 1 --2- 172.21.15.194:0/161053690 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff7400346a0 0x7ff740036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:55.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.829+0000 7ff85a281980 1 --2- 172.21.15.194:0/161053690 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55d25dd7b450 0x55d25dd7d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:55.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.829+0000 7ff85a281980 1 -- 172.21.15.194:0/161053690 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d25dd7dd80 con 0x55d25dd7b450 2024-09-13T06:10:55.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.829+0000 7ff858592640 1 --2- 172.21.15.194:0/161053690 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55d25dd7b450 0x55d25dd7d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:55.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.829+0000 7ff857590640 1 --2- 172.21.15.194:0/161053690 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff7400346a0 0x7ff740036b60 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff84c0ad000 tx=0x7ff84c0a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:55.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.829+0000 7ff858592640 1 --2- 172.21.15.194:0/161053690 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55d25dd7b450 0x55d25dd7d840 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:55.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.829+0000 7ff858592640 1 -- 172.21.15.194:0/161053690 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff8480083f0 con 0x55d25dd7b450 2024-09-13T06:10:55.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.829+0000 7ff85a281980 1 -- 172.21.15.194:0/161053690 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d25dd7e120 con 0x55d25dd7b450 2024-09-13T06:10:55.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.829+0000 7ff858592640 1 -- 172.21.15.194:0/161053690 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff8480083f0 con 0x55d25dd7b450 2024-09-13T06:10:55.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.829+0000 7ff85a281980 1 --2- 172.21.15.194:0/161053690 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55d25dd7fe90 0x55d25dd82280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:55.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.829+0000 7ff85a281980 1 -- 172.21.15.194:0/161053690 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d25dd828e0 con 0x55d25dd7fe90 2024-09-13T06:10:55.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.829+0000 7ff857d91640 1 --2- 172.21.15.194:0/161053690 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55d25dd7fe90 0x55d25dd82280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:55.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.829+0000 7ff857d91640 1 --2- 172.21.15.194:0/161053690 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55d25dd7fe90 0x55d25dd82280 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:55.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.829+0000 7ff857d91640 1 -- 172.21.15.194:0/161053690 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff85000f070 con 0x55d25dd7fe90 2024-09-13T06:10:55.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.829+0000 7ff85a281980 1 -- 172.21.15.194:0/161053690 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d25dd7ed30 con 0x55d25dd7b450 2024-09-13T06:10:55.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.829+0000 7ff858592640 1 -- 172.21.15.194:0/161053690 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff8480083f0 con 0x55d25dd7b450 2024-09-13T06:10:55.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.829+0000 7ff85a281980 1 --2- 172.21.15.194:0/161053690 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55d25dd83d40 0x55d25dd86130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:55.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.829+0000 7ff85a281980 1 -- 172.21.15.194:0/161053690 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d25dd86830 con 0x55d25dd83d40 2024-09-13T06:10:55.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.829+0000 7ff857590640 1 --2- 172.21.15.194:0/161053690 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55d25dd83d40 0x55d25dd86130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:55.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.829+0000 7ff857590640 1 --2- 172.21.15.194:0/161053690 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55d25dd83d40 0x55d25dd86130 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:55.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.833+0000 7ff857590640 1 -- 172.21.15.194:0/161053690 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff84c0b3040 con 0x55d25dd83d40 2024-09-13T06:10:55.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.833+0000 7ff85a281980 1 Processor -- start 2024-09-13T06:10:55.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.833+0000 7ff85a281980 1 -- start start 2024-09-13T06:10:55.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.833+0000 7ff85a281980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d25dd94300 0x55d25dd94720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:55.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.833+0000 7ff85a281980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55d25db88800 con 0x55d25dd94300 2024-09-13T06:10:55.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.833+0000 7ff857d91640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d25dd94300 0x55d25dd94720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:55.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.833+0000 7ff857d91640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d25dd94300 0x55d25dd94720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:38518/0 (socket says 172.21.15.194:38518) 2024-09-13T06:10:55.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.833+0000 7ff857d91640 1 -- 172.21.15.194:0/925139034 learned_addr learned my addr 172.21.15.194:0/925139034 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:55.840 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.833+0000 7ff857d91640 1 -- 172.21.15.194:0/925139034 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d25dd94c60 con 0x55d25dd94300 2024-09-13T06:10:55.840 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.833+0000 7ff857d91640 1 --2- 172.21.15.194:0/925139034 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d25dd94300 0x55d25dd94720 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7ff850026ff0 tx=0x7ff850025670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:55.840 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.833+0000 7ff73d7fa640 1 -- 172.21.15.194:0/925139034 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff850024ba0 con 0x55d25dd94300 2024-09-13T06:10:55.840 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.833+0000 7ff73d7fa640 1 -- 172.21.15.194:0/925139034 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff850024d40 con 0x55d25dd94300 2024-09-13T06:10:55.840 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.833+0000 7ff85a281980 1 -- 172.21.15.194:0/925139034 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d25dd94ef0 con 0x55d25dd94300 2024-09-13T06:10:55.840 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.833+0000 7ff73d7fa640 1 -- 172.21.15.194:0/925139034 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff85002e930 con 0x55d25dd94300 2024-09-13T06:10:55.840 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.833+0000 7ff85a281980 1 -- 172.21.15.194:0/925139034 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d25dd97b70 con 0x55d25dd94300 2024-09-13T06:10:55.845 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.833+0000 7ff73d7fa640 1 -- 172.21.15.194:0/925139034 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff85002ead0 con 0x55d25dd94300 2024-09-13T06:10:55.845 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.833+0000 7ff73d7fa640 1 --2- 172.21.15.194:0/925139034 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff730034650 0x7ff730036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:55.846 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.833+0000 7ff73d7fa640 1 -- 172.21.15.194:0/925139034 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7ff850034050 con 0x55d25dd94300 2024-09-13T06:10:55.846 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.833+0000 7ff857590640 1 --2- 172.21.15.194:0/925139034 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff730034650 0x7ff730036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:55.846 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.833+0000 7ff85a281980 1 Processor -- start 2024-09-13T06:10:55.846 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.837+0000 7ff85a281980 1 -- start start 2024-09-13T06:10:55.846 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.837+0000 7ff857590640 1 --2- 172.21.15.194:0/925139034 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff730034650 0x7ff730036b10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x55d25dd6c7b0 tx=0x7ff84c005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:55.846 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.837+0000 7ff85a281980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d25dda0c40 0x55d25dda1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:55.846 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.837+0000 7ff85a281980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55d25dbf6550 con 0x55d25dda0c40 2024-09-13T06:10:55.846 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.837+0000 7ff857d91640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d25dda0c40 0x55d25dda1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:55.846 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.837+0000 7ff857d91640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d25dda0c40 0x55d25dda1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:38524/0 (socket says 172.21.15.194:38524) 2024-09-13T06:10:55.847 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.837+0000 7ff857d91640 1 -- 172.21.15.194:0/654378176 learned_addr learned my addr 172.21.15.194:0/654378176 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:55.847 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.837+0000 7ff857d91640 1 -- 172.21.15.194:0/654378176 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d25dda15f0 con 0x55d25dda0c40 2024-09-13T06:10:55.847 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.837+0000 7ff857d91640 1 --2- 172.21.15.194:0/654378176 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d25dda0c40 0x55d25dda1020 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7ff850027040 tx=0x7ff850037ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c36f2cce622cd81 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:55.847 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.837+0000 7ff736ffd640 1 -- 172.21.15.194:0/654378176 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff850058070 con 0x55d25dda0c40 2024-09-13T06:10:55.847 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.837+0000 7ff736ffd640 1 -- 172.21.15.194:0/654378176 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff850045a30 con 0x55d25dda0c40 2024-09-13T06:10:55.847 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.837+0000 7ff736ffd640 1 -- 172.21.15.194:0/654378176 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff850010910 con 0x55d25dda0c40 2024-09-13T06:10:55.847 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.837+0000 7ff85a281980 1 -- 172.21.15.194:0/654378176 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d25dda0c40 msgr2=0x55d25dda1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:55.847 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.837+0000 7ff85a281980 1 --2- 172.21.15.194:0/654378176 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d25dda0c40 0x55d25dda1020 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7ff850027040 tx=0x7ff850037ac0 comp rx=0 tx=0).stop 2024-09-13T06:10:55.847 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.837+0000 7ff85a281980 1 -- 172.21.15.194:0/654378176 shutdown_connections 2024-09-13T06:10:55.847 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.837+0000 7ff85a281980 1 --2- 172.21.15.194:0/654378176 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d25dda0c40 0x55d25dda1020 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:55.847 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.837+0000 7ff85a281980 1 -- 172.21.15.194:0/654378176 >> 172.21.15.194:0/654378176 conn(0x55d25dd9d020 msgr2=0x55d25dd9b120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:55.847 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.837+0000 7ff85a281980 1 -- 172.21.15.194:0/654378176 shutdown_connections 2024-09-13T06:10:55.848 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.837+0000 7ff85a281980 1 -- 172.21.15.194:0/654378176 wait complete. 2024-09-13T06:10:55.848 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.837+0000 7ff85a281980 1 Processor -- start 2024-09-13T06:10:55.848 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.837+0000 7ff85a281980 1 -- start start 2024-09-13T06:10:55.848 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.837+0000 7ff85a281980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d25dda0c40 0x55d25dda7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:55.848 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.837+0000 7ff85a281980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55d25dda1a90 con 0x55d25dda0c40 2024-09-13T06:10:55.848 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.837+0000 7ff857d91640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d25dda0c40 0x55d25dda7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:55.848 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.837+0000 7ff857d91640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d25dda0c40 0x55d25dda7da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:38534/0 (socket says 172.21.15.194:38534) 2024-09-13T06:10:55.848 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.837+0000 7ff857d91640 1 -- 172.21.15.194:0/1083552288 learned_addr learned my addr 172.21.15.194:0/1083552288 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:55.848 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.837+0000 7ff857d91640 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d25dda82e0 con 0x55d25dda0c40 2024-09-13T06:10:55.848 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.837+0000 7ff857d91640 1 --2- 172.21.15.194:0/1083552288 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d25dda0c40 0x55d25dda7da0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7ff850048480 tx=0x7ff850024f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:55.848 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.841+0000 7ff7357fa640 1 -- 172.21.15.194:0/1083552288 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff850012b50 con 0x55d25dda0c40 2024-09-13T06:10:55.848 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.841+0000 7ff7357fa640 1 -- 172.21.15.194:0/1083552288 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff850012cf0 con 0x55d25dda0c40 2024-09-13T06:10:55.849 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.841+0000 7ff85a281980 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d25dda82e0 con 0x55d25dda0c40 2024-09-13T06:10:55.849 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.841+0000 7ff7357fa640 1 -- 172.21.15.194:0/1083552288 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8500484f0 con 0x55d25dda0c40 2024-09-13T06:10:55.849 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.841+0000 7ff85a281980 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d25dda82e0 con 0x55d25dda0c40 2024-09-13T06:10:55.849 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.841+0000 7ff7357fa640 1 -- 172.21.15.194:0/1083552288 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff85006d020 con 0x55d25dda0c40 2024-09-13T06:10:55.849 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.841+0000 7ff85a281980 20 rados->read ofs=0 len=0 2024-09-13T06:10:55.849 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.841+0000 7ff7357fa640 1 --2- 172.21.15.194:0/1083552288 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff720034650 0x7ff720036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:55.849 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.841+0000 7ff7357fa640 1 -- 172.21.15.194:0/1083552288 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7ff85006b020 con 0x55d25dda0c40 2024-09-13T06:10:55.849 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.841+0000 7ff857590640 1 --2- 172.21.15.194:0/1083552288 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff720034650 0x7ff720036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:55.849 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.841+0000 7ff85a281980 1 --2- 172.21.15.194:0/1083552288 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55d25ddb2ec0 0x55d25ddb5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:55.849 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.841+0000 7ff85a281980 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddb5ab0 con 0x55d25ddb2ec0 2024-09-13T06:10:55.849 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.841+0000 7ff858592640 1 --2- 172.21.15.194:0/1083552288 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55d25ddb2ec0 0x55d25ddb5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:55.849 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.841+0000 7ff857590640 1 --2- 172.21.15.194:0/1083552288 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff720034650 0x7ff720036b10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff84c000c10 tx=0x7ff84c0b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:55.850 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.841+0000 7ff858592640 1 --2- 172.21.15.194:0/1083552288 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55d25ddb2ec0 0x55d25ddb5360 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:55.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.841+0000 7ff858592640 1 -- 172.21.15.194:0/1083552288 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff8480083f0 con 0x55d25ddb2ec0 2024-09-13T06:10:55.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.841+0000 7ff85a281980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:55.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.841+0000 7ff85a281980 20 realm 2024-09-13T06:10:55.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.841+0000 7ff85a281980 20 rados->read ofs=0 len=0 2024-09-13T06:10:55.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.841+0000 7ff85a281980 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddb5ec0 con 0x55d25ddb2ec0 2024-09-13T06:10:55.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.841+0000 7ff858592640 1 -- 172.21.15.194:0/1083552288 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff8480083f0 con 0x55d25ddb2ec0 2024-09-13T06:10:55.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.841+0000 7ff85a281980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:55.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.841+0000 7ff85a281980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:10:55.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.841+0000 7ff85a281980 20 rados->read ofs=0 len=0 2024-09-13T06:10:55.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.841+0000 7ff85a281980 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddb6760 con 0x55d25ddb2ec0 2024-09-13T06:10:55.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.841+0000 7ff858592640 1 -- 172.21.15.194:0/1083552288 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff8480083f0 con 0x55d25ddb2ec0 2024-09-13T06:10:55.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.841+0000 7ff85a281980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:55.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.841+0000 7ff85a281980 20 rados->read ofs=0 len=0 2024-09-13T06:10:55.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.841+0000 7ff85a281980 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddb6b00 con 0x55d25ddb2ec0 2024-09-13T06:10:55.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.841+0000 7ff858592640 1 -- 172.21.15.194:0/1083552288 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff8480083f0 con 0x55d25ddb2ec0 2024-09-13T06:10:55.861 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.841+0000 7ff85a281980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:10:55.861 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.841+0000 7ff85a281980 20 rados->read ofs=0 len=0 2024-09-13T06:10:55.861 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.841+0000 7ff85a281980 1 --2- 172.21.15.194:0/1083552288 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55d25ddb7860 0x55d25ddb9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:55.861 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.841+0000 7ff85a281980 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddba190 con 0x55d25ddb7860 2024-09-13T06:10:55.861 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.841+0000 7ff857d91640 1 --2- 172.21.15.194:0/1083552288 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55d25ddb7860 0x55d25ddb9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:55.861 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.845+0000 7ff857d91640 1 --2- 172.21.15.194:0/1083552288 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55d25ddb7860 0x55d25ddb9c50 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:55.861 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.845+0000 7ff857d91640 1 -- 172.21.15.194:0/1083552288 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff850062030 con 0x55d25ddb7860 2024-09-13T06:10:55.861 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.845+0000 7ff85a281980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:10:55.861 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.845+0000 7ff85a281980 20 searching for the correct realm 2024-09-13T06:10:55.861 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.845+0000 7ff85a281980 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddbba30 con 0x55d25ddb7860 2024-09-13T06:10:55.861 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.845+0000 7ff857d91640 1 -- 172.21.15.194:0/1083552288 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff850062030 con 0x55d25ddb7860 2024-09-13T06:10:55.861 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.845+0000 7ff857d91640 1 --2- 172.21.15.194:0/1083552288 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7ff85005c020 0x7ff85005c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:55.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.845+0000 7ff857d91640 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddbba30 con 0x7ff85005c020 2024-09-13T06:10:55.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.845+0000 7ff857590640 1 --2- 172.21.15.194:0/1083552288 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7ff85005c020 0x7ff85005c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:55.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.845+0000 7ff857590640 1 --2- 172.21.15.194:0/1083552288 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7ff85005c020 0x7ff85005c820 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:55.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.845+0000 7ff857590640 1 -- 172.21.15.194:0/1083552288 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff84c0c9030 con 0x7ff85005c020 2024-09-13T06:10:55.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.845+0000 7ff857590640 1 --2- 172.21.15.194:0/1083552288 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7ff84c0dc040 0x7ff84c0dd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:55.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.845+0000 7ff857590640 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddbba30 con 0x7ff84c0dc040 2024-09-13T06:10:55.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.845+0000 7ff858592640 1 --2- 172.21.15.194:0/1083552288 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7ff84c0dc040 0x7ff84c0dd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:55.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.845+0000 7ff858592640 1 --2- 172.21.15.194:0/1083552288 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7ff84c0dc040 0x7ff84c0dd430 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:55.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.845+0000 7ff858592640 1 -- 172.21.15.194:0/1083552288 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8480083f0 con 0x7ff84c0dc040 2024-09-13T06:10:55.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.845+0000 7ff858592640 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddb6b00 con 0x55d25ddb2ec0 2024-09-13T06:10:55.863 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.845+0000 7ff858592640 1 -- 172.21.15.194:0/1083552288 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8480083f0 con 0x55d25ddb2ec0 2024-09-13T06:10:55.863 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.845+0000 7ff858592640 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddb6b00 con 0x55d25ddb2ec0 2024-09-13T06:10:55.863 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.845+0000 7ff858592640 1 -- 172.21.15.194:0/1083552288 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8480083f0 con 0x55d25ddb2ec0 2024-09-13T06:10:55.863 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.845+0000 7ff858592640 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddb6b00 con 0x7ff84c0dc040 2024-09-13T06:10:55.863 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.849+0000 7ff858592640 1 -- 172.21.15.194:0/1083552288 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8480083f0 con 0x7ff84c0dc040 2024-09-13T06:10:55.863 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.849+0000 7ff858592640 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddb6b00 con 0x7ff84c0dc040 2024-09-13T06:10:55.863 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.849+0000 7ff858592640 1 -- 172.21.15.194:0/1083552288 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8480083f0 con 0x7ff84c0dc040 2024-09-13T06:10:55.863 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.849+0000 7ff858592640 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddb6b00 con 0x7ff85005c020 2024-09-13T06:10:55.863 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.849+0000 7ff857590640 1 -- 172.21.15.194:0/1083552288 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff84c0c9030 con 0x7ff85005c020 2024-09-13T06:10:55.863 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.849+0000 7ff857590640 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddb6b00 con 0x55d25ddb7860 2024-09-13T06:10:55.863 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.849+0000 7ff857d91640 1 -- 172.21.15.194:0/1083552288 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff850062030 con 0x55d25ddb7860 2024-09-13T06:10:55.863 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.849+0000 7ff857d91640 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddb6b00 con 0x55d25ddb2ec0 2024-09-13T06:10:55.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.849+0000 7ff858592640 1 -- 172.21.15.194:0/1083552288 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8480083f0 con 0x55d25ddb2ec0 2024-09-13T06:10:55.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.849+0000 7ff858592640 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddb6b00 con 0x7ff84c0dc040 2024-09-13T06:10:55.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.849+0000 7ff858592640 1 -- 172.21.15.194:0/1083552288 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8480083f0 con 0x7ff84c0dc040 2024-09-13T06:10:55.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.849+0000 7ff858592640 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddb6b00 con 0x55d25ddb2ec0 2024-09-13T06:10:55.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.849+0000 7ff858592640 1 -- 172.21.15.194:0/1083552288 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8480083f0 con 0x55d25ddb2ec0 2024-09-13T06:10:55.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.849+0000 7ff858592640 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddb6b00 con 0x7ff85005c020 2024-09-13T06:10:55.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.849+0000 7ff857590640 1 -- 172.21.15.194:0/1083552288 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff84c0c9030 con 0x7ff85005c020 2024-09-13T06:10:55.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.849+0000 7ff857590640 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddb6b00 con 0x55d25ddb7860 2024-09-13T06:10:55.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.849+0000 7ff857d91640 1 -- 172.21.15.194:0/1083552288 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff850062030 con 0x55d25ddb7860 2024-09-13T06:10:55.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.849+0000 7ff857d91640 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddb6b00 con 0x55d25ddb7860 2024-09-13T06:10:55.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.849+0000 7ff857d91640 1 -- 172.21.15.194:0/1083552288 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff850062030 con 0x55d25ddb7860 2024-09-13T06:10:55.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.849+0000 7ff857d91640 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddb6b00 con 0x7ff84c0dc040 2024-09-13T06:10:55.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.849+0000 7ff858592640 1 -- 172.21.15.194:0/1083552288 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8480083f0 con 0x7ff84c0dc040 2024-09-13T06:10:55.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.849+0000 7ff858592640 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddb6b00 con 0x55d25ddb7860 2024-09-13T06:10:55.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.853+0000 7ff857d91640 1 -- 172.21.15.194:0/1083552288 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff850062030 con 0x55d25ddb7860 2024-09-13T06:10:55.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.853+0000 7ff857d91640 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddb6b00 con 0x55d25ddb7860 2024-09-13T06:10:55.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.853+0000 7ff857d91640 1 -- 172.21.15.194:0/1083552288 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff850062030 con 0x55d25ddb7860 2024-09-13T06:10:55.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.853+0000 7ff857d91640 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddb6b00 con 0x55d25ddb2ec0 2024-09-13T06:10:55.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.853+0000 7ff858592640 1 -- 172.21.15.194:0/1083552288 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8480083f0 con 0x55d25ddb2ec0 2024-09-13T06:10:55.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.853+0000 7ff858592640 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddb6b00 con 0x55d25ddb2ec0 2024-09-13T06:10:55.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.853+0000 7ff858592640 1 -- 172.21.15.194:0/1083552288 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff8480083f0 con 0x55d25ddb2ec0 2024-09-13T06:10:55.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.853+0000 7ff858592640 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddb6b00 con 0x7ff85005c020 2024-09-13T06:10:55.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.853+0000 7ff857590640 1 -- 172.21.15.194:0/1083552288 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff84c0c9030 con 0x7ff85005c020 2024-09-13T06:10:55.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.853+0000 7ff857590640 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddb6b00 con 0x55d25ddb7860 2024-09-13T06:10:55.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.853+0000 7ff857d91640 1 -- 172.21.15.194:0/1083552288 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff850062030 con 0x55d25ddb7860 2024-09-13T06:10:55.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.853+0000 7ff857d91640 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddb6b00 con 0x7ff85005c020 2024-09-13T06:10:55.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.853+0000 7ff857590640 1 -- 172.21.15.194:0/1083552288 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff84c0c9030 con 0x7ff85005c020 2024-09-13T06:10:55.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.853+0000 7ff857590640 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddb6b00 con 0x55d25ddb2ec0 2024-09-13T06:10:55.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.853+0000 7ff858592640 1 -- 172.21.15.194:0/1083552288 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8480083f0 con 0x55d25ddb2ec0 2024-09-13T06:10:55.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.853+0000 7ff858592640 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddb6b00 con 0x7ff84c0dc040 2024-09-13T06:10:55.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.853+0000 7ff858592640 1 -- 172.21.15.194:0/1083552288 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8480083f0 con 0x7ff84c0dc040 2024-09-13T06:10:55.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.853+0000 7ff858592640 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddb6b00 con 0x55d25ddb7860 2024-09-13T06:10:55.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.853+0000 7ff857d91640 1 -- 172.21.15.194:0/1083552288 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff850062030 con 0x55d25ddb7860 2024-09-13T06:10:55.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.853+0000 7ff857d91640 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddb6b00 con 0x7ff85005c020 2024-09-13T06:10:55.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.853+0000 7ff857590640 1 -- 172.21.15.194:0/1083552288 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff84c0c9030 con 0x7ff85005c020 2024-09-13T06:10:55.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.853+0000 7ff857590640 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddb6b00 con 0x7ff85005c020 2024-09-13T06:10:55.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.853+0000 7ff857590640 1 -- 172.21.15.194:0/1083552288 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff84c0c9030 con 0x7ff85005c020 2024-09-13T06:10:55.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.853+0000 7ff857590640 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddb6b00 con 0x55d25ddb7860 2024-09-13T06:10:55.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.853+0000 7ff857d91640 1 -- 172.21.15.194:0/1083552288 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff850062030 con 0x55d25ddb7860 2024-09-13T06:10:55.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.853+0000 7ff857d91640 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddb6b00 con 0x7ff84c0dc040 2024-09-13T06:10:55.872 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.857+0000 7ff858592640 1 -- 172.21.15.194:0/1083552288 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8480083f0 con 0x7ff84c0dc040 2024-09-13T06:10:55.872 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.857+0000 7ff858592640 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddb6b00 con 0x55d25ddb2ec0 2024-09-13T06:10:55.872 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.857+0000 7ff858592640 1 -- 172.21.15.194:0/1083552288 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff8480083f0 con 0x55d25ddb2ec0 2024-09-13T06:10:55.872 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.857+0000 7ff858592640 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddb6b00 con 0x7ff85005c020 2024-09-13T06:10:55.872 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.857+0000 7ff857590640 1 -- 172.21.15.194:0/1083552288 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff84c0c9030 con 0x7ff85005c020 2024-09-13T06:10:55.872 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.857+0000 7ff85a281980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:10:55.872 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.857+0000 7ff85a281980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:10:55.872 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.857+0000 7ff85a281980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:10:55.872 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.857+0000 7ff85a281980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:10:55.872 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.857+0000 7ff85a281980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:10:55.872 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.857+0000 7ff85a281980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:10:55.872 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.857+0000 7ff85a281980 20 rados->read ofs=0 len=0 2024-09-13T06:10:55.873 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.857+0000 7ff85a281980 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddba9e0 con 0x55d25ddb2ec0 2024-09-13T06:10:55.873 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.857+0000 7ff858592640 1 -- 172.21.15.194:0/1083552288 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff8480083f0 con 0x55d25ddb2ec0 2024-09-13T06:10:55.873 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.857+0000 7ff85a281980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:55.873 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.857+0000 7ff85a281980 20 rados->read ofs=0 len=0 2024-09-13T06:10:55.873 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.857+0000 7ff85a281980 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddbadd0 con 0x55d25ddb2ec0 2024-09-13T06:10:55.873 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.857+0000 7ff858592640 1 -- 172.21.15.194:0/1083552288 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff8480083f0 con 0x55d25ddb2ec0 2024-09-13T06:10:55.873 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.857+0000 7ff85a281980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:10:55.873 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.857+0000 7ff85a281980 20 rados->read ofs=0 len=0 2024-09-13T06:10:55.873 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.857+0000 7ff85a281980 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddbadd0 con 0x7ff85005c020 2024-09-13T06:10:55.873 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.857+0000 7ff857590640 1 -- 172.21.15.194:0/1083552288 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff84c0c9030 con 0x7ff85005c020 2024-09-13T06:10:55.873 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.857+0000 7ff85a281980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:10:55.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.857+0000 7ff85a281980 20 zone default found 2024-09-13T06:10:55.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.857+0000 7ff85a281980 4 Realm: () 2024-09-13T06:10:55.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.857+0000 7ff85a281980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:10:55.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.857+0000 7ff85a281980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:10:55.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.857+0000 7ff85a281980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:10:55.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.857+0000 7ff85a281980 20 zonegroup default 2024-09-13T06:10:55.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.857+0000 7ff85a281980 20 rados->read ofs=0 len=0 2024-09-13T06:10:55.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.857+0000 7ff85a281980 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddbbf00 con 0x7ff84c0dc040 2024-09-13T06:10:55.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.857+0000 7ff858592640 1 -- 172.21.15.194:0/1083552288 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff8480083f0 con 0x7ff84c0dc040 2024-09-13T06:10:55.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.857+0000 7ff85a281980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:55.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.857+0000 7ff85a281980 20 rados->read ofs=0 len=0 2024-09-13T06:10:55.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.857+0000 7ff85a281980 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddbd8e0 con 0x55d25ddb7860 2024-09-13T06:10:55.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.857+0000 7ff857d91640 1 -- 172.21.15.194:0/1083552288 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff850062030 con 0x55d25ddb7860 2024-09-13T06:10:55.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.857+0000 7ff85a281980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:55.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.857+0000 7ff85a281980 20 rados->read ofs=0 len=0 2024-09-13T06:10:55.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.857+0000 7ff85a281980 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddbdc80 con 0x55d25ddb7860 2024-09-13T06:10:55.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.857+0000 7ff857d91640 1 -- 172.21.15.194:0/1083552288 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff850062030 con 0x55d25ddb7860 2024-09-13T06:10:55.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.857+0000 7ff85a281980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:55.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.857+0000 7ff85a281980 20 started sync module instance, tier type = 2024-09-13T06:10:55.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.857+0000 7ff85a281980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:10:55.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.857+0000 7ff85a281980 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddbcd80 con 0x7ff85005c020 2024-09-13T06:10:55.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.861+0000 7ff857590640 1 -- 172.21.15.194:0/1083552288 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(44 notify.0 [create] v35'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff84c0c9030 con 0x7ff85005c020 2024-09-13T06:10:55.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.861+0000 7ff85a281980 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94362006180256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddbe4d0 con 0x7ff85005c020 2024-09-13T06:10:55.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.861+0000 7ff85a281980 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddbed20 con 0x55d25ddb2ec0 2024-09-13T06:10:55.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.861+0000 7ff857590640 1 -- 172.21.15.194:0/1083552288 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94362006180256] v35'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff84c0c9030 con 0x7ff85005c020 2024-09-13T06:10:55.876 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.861+0000 7ff858592640 1 -- 172.21.15.194:0/1083552288 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v35'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8480083f0 con 0x55d25ddb2ec0 2024-09-13T06:10:55.876 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.861+0000 7ff85a281980 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94362006183968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddbed20 con 0x55d25ddb2ec0 2024-09-13T06:10:55.876 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.861+0000 7ff85a281980 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddbf800 con 0x55d25ddb7860 2024-09-13T06:10:55.876 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.865+0000 7ff857d91640 1 -- 172.21.15.194:0/1083552288 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v35'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff850062030 con 0x55d25ddb7860 2024-09-13T06:10:55.876 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.865+0000 7ff85a281980 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94362006188816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddc00a0 con 0x55d25ddb7860 2024-09-13T06:10:55.876 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.865+0000 7ff85a281980 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddc0ac0 con 0x7ff85005c020 2024-09-13T06:10:55.876 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.865+0000 7ff858592640 1 -- 172.21.15.194:0/1083552288 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94362006183968] v35'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8480083f0 con 0x55d25ddb2ec0 2024-09-13T06:10:55.876 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.865+0000 7ff857590640 1 -- 172.21.15.194:0/1083552288 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(50 notify.3 [create] v35'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff84c0c9030 con 0x7ff85005c020 2024-09-13T06:10:55.876 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.865+0000 7ff85a281980 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94362006186096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddc1360 con 0x7ff85005c020 2024-09-13T06:10:55.876 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.865+0000 7ff85a281980 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddc1bb0 con 0x55d25ddb2ec0 2024-09-13T06:10:55.876 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.865+0000 7ff857d91640 1 -- 172.21.15.194:0/1083552288 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94362006188816] v35'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff850062030 con 0x55d25ddb7860 2024-09-13T06:10:55.876 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.865+0000 7ff857590640 1 -- 172.21.15.194:0/1083552288 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94362006186096] v35'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff84c0c9030 con 0x7ff85005c020 2024-09-13T06:10:55.876 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.865+0000 7ff858592640 1 -- 172.21.15.194:0/1083552288 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v35'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8480083f0 con 0x55d25ddb2ec0 2024-09-13T06:10:55.876 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.865+0000 7ff85a281980 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94362006195888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddc1780 con 0x55d25ddb2ec0 2024-09-13T06:10:55.877 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.865+0000 7ff85a281980 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddc2450 con 0x7ff84c0dc040 2024-09-13T06:10:55.878 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.869+0000 7ff858592640 1 -- 172.21.15.194:0/1083552288 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94362006195888] v35'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8480083f0 con 0x55d25ddb2ec0 2024-09-13T06:10:55.878 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.869+0000 7ff858592640 1 -- 172.21.15.194:0/1083552288 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(54 notify.5 [create] v35'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8480083f0 con 0x7ff84c0dc040 2024-09-13T06:10:55.878 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.869+0000 7ff85a281980 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94362006196944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddc16f0 con 0x7ff84c0dc040 2024-09-13T06:10:55.878 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.869+0000 7ff85a281980 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddc2910 con 0x7ff84c0dc040 2024-09-13T06:10:55.879 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.869+0000 7ff858592640 1 -- 172.21.15.194:0/1083552288 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94362006196944] v35'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8480083f0 con 0x7ff84c0dc040 2024-09-13T06:10:55.879 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.873+0000 7ff858592640 1 -- 172.21.15.194:0/1083552288 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(56 notify.6 [create] v35'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8480083f0 con 0x7ff84c0dc040 2024-09-13T06:10:55.879 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.873+0000 7ff85a281980 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94362006199872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddc2910 con 0x7ff84c0dc040 2024-09-13T06:10:55.879 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.873+0000 7ff85a281980 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddc32d0 con 0x7ff84c0dc040 2024-09-13T06:10:55.879 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.873+0000 7ff858592640 1 -- 172.21.15.194:0/1083552288 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(58 notify.7 [create] v35'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8480083f0 con 0x7ff84c0dc040 2024-09-13T06:10:55.879 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.873+0000 7ff85a281980 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94362006203936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddc36f0 con 0x7ff84c0dc040 2024-09-13T06:10:55.879 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.873+0000 7ff85a281980 20 add_watcher() i=0 2024-09-13T06:10:55.879 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.873+0000 7ff85a281980 20 add_watcher() i=1 2024-09-13T06:10:55.879 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.873+0000 7ff85a281980 20 add_watcher() i=2 2024-09-13T06:10:55.879 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.873+0000 7ff85a281980 20 add_watcher() i=3 2024-09-13T06:10:55.879 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.873+0000 7ff85a281980 20 add_watcher() i=4 2024-09-13T06:10:55.880 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.873+0000 7ff85a281980 20 add_watcher() i=5 2024-09-13T06:10:55.880 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.873+0000 7ff858592640 1 -- 172.21.15.194:0/1083552288 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94362006199872] v35'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8480083f0 con 0x7ff84c0dc040 2024-09-13T06:10:55.880 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.873+0000 7ff85a281980 20 add_watcher() i=6 2024-09-13T06:10:55.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.877+0000 7ff858592640 1 -- 172.21.15.194:0/1083552288 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94362006203936] v35'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8480083f0 con 0x7ff84c0dc040 2024-09-13T06:10:55.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.877+0000 7ff85a281980 20 add_watcher() i=7 2024-09-13T06:10:55.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.877+0000 7ff85a281980 2 all 8 watchers are set, enabling cache 2024-09-13T06:10:55.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.877+0000 7ff85a281980 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddc2460 con 0x55d25ddb2ec0 2024-09-13T06:10:55.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.877+0000 7ff858592640 1 -- 172.21.15.194:0/1083552288 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff8480083f0 con 0x55d25ddb2ec0 2024-09-13T06:10:55.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.877+0000 7ff85a281980 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94362006201440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddc3c30 con 0x55d25ddb2ec0 2024-09-13T06:10:55.883 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.877+0000 7ff858592640 1 -- 172.21.15.194:0/1083552288 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94362006201440] v35'200 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff8480083f0 con 0x55d25ddb2ec0 2024-09-13T06:10:55.883 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.877+0000 7ff70dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:10:55.883 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.877+0000 7ff85a281980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:10:55.883 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.877+0000 7ff85a281980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:10:55.883 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.877+0000 7ff85a281980 5 note: GC not initialized 2024-09-13T06:10:55.883 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.877+0000 7ff70cfe1640 20 reqs_thread_entry: start 2024-09-13T06:10:55.883 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.877+0000 7ff85a281980 20 init_complete bucket index max shards: 11 2024-09-13T06:10:55.883 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.877+0000 7ff85a281980 20 Filter name: none 2024-09-13T06:10:55.883 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.877+0000 7ff6867fc640 20 reqs_thread_entry: start 2024-09-13T06:10:55.883 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.877+0000 7ff85a281980 20 rados->read ofs=0 len=0 2024-09-13T06:10:55.883 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.877+0000 7ff85a281980 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d25dde98d0 con 0x55d25ddb2ec0 2024-09-13T06:10:55.883 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.877+0000 7ff858592640 1 -- 172.21.15.194:0/1083552288 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv23 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7ff8480083f0 con 0x55d25ddb2ec0 2024-09-13T06:10:55.884 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.877+0000 7ff85a281980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T06:10:55.884 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.877+0000 7ff85a281980 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddeae20 con 0x7ff84c0dc040 2024-09-13T06:10:55.884 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.877+0000 7ff858592640 1 -- 172.21.15.194:0/1083552288 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv30 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7ff8480083f0 con 0x7ff84c0dc040 2024-09-13T06:10:55.884 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.881+0000 7ff70dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:10:55.885 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.881+0000 7ff85a281980 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94362006201440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddc8810 con 0x55d25ddb2ec0 2024-09-13T06:10:55.885 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.881+0000 7ff858592640 1 -- 172.21.15.194:0/1083552288 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94362006201440] v35'201 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff8480083f0 con 0x55d25ddb2ec0 2024-09-13T06:10:55.885 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.881+0000 7ff85a281980 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94362006180256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddc2460 con 0x7ff85005c020 2024-09-13T06:10:55.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.881+0000 7ff857590640 1 -- 172.21.15.194:0/1083552288 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94362006180256] v35'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff84c0c9030 con 0x7ff85005c020 2024-09-13T06:10:55.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.881+0000 7ff85a281980 20 remove_watcher() i=0 2024-09-13T06:10:55.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.881+0000 7ff85a281980 2 removed watcher, disabling cache 2024-09-13T06:10:55.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.881+0000 7ff85a281980 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94362006183968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddbd1a0 con 0x55d25ddb2ec0 2024-09-13T06:10:55.888 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.885+0000 7ff858592640 1 -- 172.21.15.194:0/1083552288 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94362006183968] v35'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8480083f0 con 0x55d25ddb2ec0 2024-09-13T06:10:55.888 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.885+0000 7ff85a281980 20 remove_watcher() i=1 2024-09-13T06:10:55.888 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.885+0000 7ff85a281980 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94362006188816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddbe020 con 0x55d25ddb7860 2024-09-13T06:10:55.890 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.885+0000 7ff857d91640 1 -- 172.21.15.194:0/1083552288 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94362006188816] v35'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff850062030 con 0x55d25ddb7860 2024-09-13T06:10:55.890 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.885+0000 7ff85a281980 20 remove_watcher() i=2 2024-09-13T06:10:55.890 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.885+0000 7ff85a281980 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94362006186096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddbf310 con 0x7ff85005c020 2024-09-13T06:10:55.891 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.885+0000 7ff857590640 1 -- 172.21.15.194:0/1083552288 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94362006186096] v35'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff84c0c9030 con 0x7ff85005c020 2024-09-13T06:10:55.891 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.885+0000 7ff85a281980 20 remove_watcher() i=3 2024-09-13T06:10:55.891 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.885+0000 7ff85a281980 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94362006195888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddbf310 con 0x55d25ddb2ec0 2024-09-13T06:10:55.893 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.889+0000 7ff858592640 1 -- 172.21.15.194:0/1083552288 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94362006195888] v35'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8480083f0 con 0x55d25ddb2ec0 2024-09-13T06:10:55.893 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.889+0000 7ff85a281980 20 remove_watcher() i=4 2024-09-13T06:10:55.893 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.889+0000 7ff85a281980 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94362006196944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddbf310 con 0x7ff84c0dc040 2024-09-13T06:10:55.895 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.889+0000 7ff858592640 1 -- 172.21.15.194:0/1083552288 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94362006196944] v35'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8480083f0 con 0x7ff84c0dc040 2024-09-13T06:10:55.895 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.889+0000 7ff85a281980 20 remove_watcher() i=5 2024-09-13T06:10:55.895 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.889+0000 7ff85a281980 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94362006199872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddbf310 con 0x7ff84c0dc040 2024-09-13T06:10:55.897 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.893+0000 7ff858592640 1 -- 172.21.15.194:0/1083552288 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94362006199872] v35'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8480083f0 con 0x7ff84c0dc040 2024-09-13T06:10:55.897 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.893+0000 7ff85a281980 20 remove_watcher() i=6 2024-09-13T06:10:55.897 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.893+0000 7ff85a281980 1 -- 172.21.15.194:0/1083552288 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94362006203936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d25ddbf310 con 0x7ff84c0dc040 2024-09-13T06:10:55.902 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.897+0000 7ff858592640 1 -- 172.21.15.194:0/1083552288 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94362006203936] v35'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff8480083f0 con 0x7ff84c0dc040 2024-09-13T06:10:55.902 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.897+0000 7ff85a281980 20 remove_watcher() i=7 2024-09-13T06:10:55.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.897+0000 7ff85a281980 1 -- 172.21.15.194:0/1083552288 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7ff84c0dc040 msgr2=0x7ff84c0dd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:55.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.897+0000 7ff85a281980 1 --2- 172.21.15.194:0/1083552288 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7ff84c0dc040 0x7ff84c0dd430 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:55.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.897+0000 7ff85a281980 1 -- 172.21.15.194:0/1083552288 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55d25ddb2ec0 msgr2=0x55d25ddb5360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:55.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.897+0000 7ff85a281980 1 --2- 172.21.15.194:0/1083552288 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55d25ddb2ec0 0x55d25ddb5360 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:55.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.897+0000 7ff85a281980 1 -- 172.21.15.194:0/1083552288 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7ff85005c020 msgr2=0x7ff85005c820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:55.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.897+0000 7ff85a281980 1 --2- 172.21.15.194:0/1083552288 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7ff85005c020 0x7ff85005c820 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:55.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.897+0000 7ff85a281980 1 -- 172.21.15.194:0/1083552288 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55d25ddb7860 msgr2=0x55d25ddb9c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:55.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.897+0000 7ff85a281980 1 --2- 172.21.15.194:0/1083552288 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55d25ddb7860 0x55d25ddb9c50 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:55.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.897+0000 7ff85a281980 1 -- 172.21.15.194:0/1083552288 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff720034650 msgr2=0x7ff720036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:55.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.897+0000 7ff85a281980 1 --2- 172.21.15.194:0/1083552288 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff720034650 0x7ff720036b10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff84c000c10 tx=0x7ff84c0b9040 comp rx=0 tx=0).stop 2024-09-13T06:10:55.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.897+0000 7ff85a281980 1 -- 172.21.15.194:0/1083552288 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d25dda0c40 msgr2=0x55d25dda7da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:55.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.897+0000 7ff85a281980 1 --2- 172.21.15.194:0/1083552288 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d25dda0c40 0x55d25dda7da0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7ff850048480 tx=0x7ff850024f70 comp rx=0 tx=0).stop 2024-09-13T06:10:55.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.897+0000 7ff858592640 1 -- 172.21.15.194:0/1083552288 reap_dead start 2024-09-13T06:10:55.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.897+0000 7ff858592640 1 -- 172.21.15.194:0/1083552288 reap_dead start 2024-09-13T06:10:55.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.897+0000 7ff85a281980 1 -- 172.21.15.194:0/1083552288 shutdown_connections 2024-09-13T06:10:55.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.897+0000 7ff85a281980 1 -- 172.21.15.194:0/1083552288 >> 172.21.15.194:0/1083552288 conn(0x55d25dd9d020 msgr2=0x55d25dd9b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:55.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.897+0000 7ff85a281980 1 -- 172.21.15.194:0/1083552288 shutdown_connections 2024-09-13T06:10:55.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.897+0000 7ff85a281980 1 -- 172.21.15.194:0/1083552288 wait complete. 2024-09-13T06:10:55.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.897+0000 7ff85a281980 1 -- 172.21.15.194:0/925139034 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff730034650 msgr2=0x7ff730036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:55.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.897+0000 7ff85a281980 1 --2- 172.21.15.194:0/925139034 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff730034650 0x7ff730036b10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x55d25dd6c7b0 tx=0x7ff84c005a10 comp rx=0 tx=0).stop 2024-09-13T06:10:55.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.897+0000 7ff85a281980 1 -- 172.21.15.194:0/925139034 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d25dd94300 msgr2=0x55d25dd94720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:55.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.897+0000 7ff85a281980 1 --2- 172.21.15.194:0/925139034 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d25dd94300 0x55d25dd94720 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7ff850026ff0 tx=0x7ff850025670 comp rx=0 tx=0).stop 2024-09-13T06:10:55.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.897+0000 7ff85a281980 1 -- 172.21.15.194:0/925139034 shutdown_connections 2024-09-13T06:10:55.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.897+0000 7ff85a281980 1 --2- 172.21.15.194:0/925139034 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff730034650 0x7ff730036b10 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:55.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.897+0000 7ff85a281980 1 --2- 172.21.15.194:0/925139034 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d25dd94300 0x55d25dd94720 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:55.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.897+0000 7ff85a281980 1 -- 172.21.15.194:0/925139034 >> 172.21.15.194:0/925139034 conn(0x55d25dd89450 msgr2=0x55d25dd8bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:55.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.897+0000 7ff85a281980 1 -- 172.21.15.194:0/925139034 shutdown_connections 2024-09-13T06:10:55.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.897+0000 7ff85a281980 1 -- 172.21.15.194:0/925139034 wait complete. 2024-09-13T06:10:55.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.897+0000 7ff85a281980 1 -- 172.21.15.194:0/161053690 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55d25dd7b450 msgr2=0x55d25dd7d840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:55.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.897+0000 7ff85a281980 1 --2- 172.21.15.194:0/161053690 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55d25dd7b450 0x55d25dd7d840 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:55.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.897+0000 7ff85a281980 1 -- 172.21.15.194:0/161053690 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55d25dd83d40 msgr2=0x55d25dd86130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:55.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.897+0000 7ff85a281980 1 --2- 172.21.15.194:0/161053690 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55d25dd83d40 0x55d25dd86130 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:55.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.897+0000 7ff85a281980 1 -- 172.21.15.194:0/161053690 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55d25dd7fe90 msgr2=0x55d25dd82280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:55.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.897+0000 7ff85a281980 1 --2- 172.21.15.194:0/161053690 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55d25dd7fe90 0x55d25dd82280 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:55.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.897+0000 7ff85a281980 1 -- 172.21.15.194:0/161053690 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff7400346a0 msgr2=0x7ff740036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:55.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.897+0000 7ff85a281980 1 --2- 172.21.15.194:0/161053690 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff7400346a0 0x7ff740036b60 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff84c0ad000 tx=0x7ff84c0a5040 comp rx=0 tx=0).stop 2024-09-13T06:10:55.906 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.897+0000 7ff85a281980 1 -- 172.21.15.194:0/161053690 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d25dc848f0 msgr2=0x55d25dd6d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:55.906 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.897+0000 7ff85a281980 1 --2- 172.21.15.194:0/161053690 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d25dc848f0 0x55d25dd6d110 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7ff850000f90 tx=0x7ff850001260 comp rx=0 tx=0).stop 2024-09-13T06:10:55.906 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.897+0000 7ff858592640 1 -- 172.21.15.194:0/161053690 reap_dead start 2024-09-13T06:10:55.906 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.897+0000 7ff85a281980 1 -- 172.21.15.194:0/161053690 shutdown_connections 2024-09-13T06:10:55.906 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.897+0000 7ff85a281980 1 -- 172.21.15.194:0/161053690 >> 172.21.15.194:0/161053690 conn(0x55d25dc7c090 msgr2=0x55d25dd66120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:55.906 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.897+0000 7ff85a281980 1 -- 172.21.15.194:0/161053690 shutdown_connections 2024-09-13T06:10:55.906 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.897+0000 7ff85a281980 1 -- 172.21.15.194:0/161053690 wait complete. 2024-09-13T06:10:55.910 INFO:teuthology.orchestra.run.smithi194.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34}}]} 2024-09-13T06:10:55.910 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34}}]} 2024-09-13T06:10:55.911 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-09-13T06:10:55.911 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-09-13T06:10:55.911 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories create_bucket 2024-09-13T06:10:55.987 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:10:55.987 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:10:55.988 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.985+0000 7f00b18d3980 1 Processor -- start 2024-09-13T06:10:55.988 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.985+0000 7f00b18d3980 1 -- start start 2024-09-13T06:10:55.988 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.985+0000 7f00b18d3980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55744834ec70 0x557448351060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:55.988 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.985+0000 7f00b18d3980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5574481d0ae0 con 0x55744834a8f0 2024-09-13T06:10:55.988 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.985+0000 7f00b18d3980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x5574481f4e30 con 0x55744834ec70 2024-09-13T06:10:55.989 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.985+0000 7f00aebe2640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55744834ec70 0x557448351060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:55.989 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.985+0000 7f00af3e3640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x55744834a8f0 0x55744834acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:34392/0 (socket says 172.21.15.194:34392) 2024-09-13T06:10:55.989 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.985+0000 7f00af3e3640 1 -- 172.21.15.194:0/3871531864 learned_addr learned my addr 172.21.15.194:0/3871531864 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-09-13T06:10:55.989 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.985+0000 7f00aebe2640 1 -- 172.21.15.194:0/3871531864 >> v1:172.21.15.120:6789/0 conn(0x55744834a8f0 legacy=0x55744834acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:55.989 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.985+0000 7f00aebe2640 1 -- 172.21.15.194:0/3871531864 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574483525b0 con 0x55744834ec70 2024-09-13T06:10:55.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.989+0000 7f00aebe2640 1 --2- 172.21.15.194:0/3871531864 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55744834ec70 0x557448351060 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f009800a480 tx=0x7f009801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef1e9d31c94e0f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:55.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.989+0000 7f00ae3e1640 1 -- 172.21.15.194:0/3871531864 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00980b0070 con 0x55744834ec70 2024-09-13T06:10:55.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.989+0000 7f00ae3e1640 1 -- 172.21.15.194:0/3871531864 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00980ab540 con 0x55744834ec70 2024-09-13T06:10:55.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.989+0000 7f00ae3e1640 1 -- 172.21.15.194:0/3871531864 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00980ab840 con 0x55744834ec70 2024-09-13T06:10:55.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.989+0000 7f00b18d3980 1 -- 172.21.15.194:0/3871531864 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55744834ec70 msgr2=0x557448351060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:55.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.989+0000 7f00b18d3980 1 --2- 172.21.15.194:0/3871531864 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55744834ec70 0x557448351060 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f009800a480 tx=0x7f009801b280 comp rx=0 tx=0).stop 2024-09-13T06:10:55.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.989+0000 7f00b18d3980 1 -- 172.21.15.194:0/3871531864 shutdown_connections 2024-09-13T06:10:55.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.989+0000 7f00b18d3980 1 --2- 172.21.15.194:0/3871531864 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55744834ec70 0x557448351060 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:55.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.989+0000 7f00b18d3980 1 -- 172.21.15.194:0/3871531864 >> 172.21.15.194:0/3871531864 conn(0x5574482be240 msgr2=0x5574482be650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:55.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.989+0000 7f00b18d3980 1 -- 172.21.15.194:0/3871531864 shutdown_connections 2024-09-13T06:10:55.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:55.989+0000 7f00b18d3980 1 -- 172.21.15.194:0/3871531864 wait complete. 2024-09-13T06:10:56.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.001+0000 7f00b18d3980 1 Processor -- start 2024-09-13T06:10:56.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.001+0000 7f00b18d3980 1 -- start start 2024-09-13T06:10:56.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.001+0000 7f00b18d3980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55744834a8f0 0x557448435ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.001+0000 7f00b18d3980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5574481f6200 con 0x55744834a8f0 2024-09-13T06:10:56.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.005+0000 7f00af3e3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55744834a8f0 0x557448435ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.005+0000 7f00af3e3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55744834a8f0 0x557448435ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:38546/0 (socket says 172.21.15.194:38546) 2024-09-13T06:10:56.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.005+0000 7f00af3e3640 1 -- 172.21.15.194:0/326369701 learned_addr learned my addr 172.21.15.194:0/326369701 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:56.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.005+0000 7f00af3e3640 1 -- 172.21.15.194:0/326369701 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557448436270 con 0x55744834a8f0 2024-09-13T06:10:56.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.005+0000 7f00af3e3640 1 --2- 172.21.15.194:0/326369701 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55744834a8f0 0x557448435ca0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f00a00017b0 tx=0x7f00a0001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f48786d40934a4e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.005+0000 7eff9d60a640 1 -- 172.21.15.194:0/326369701 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00a0016070 con 0x55744834a8f0 2024-09-13T06:10:56.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.005+0000 7eff9d60a640 1 -- 172.21.15.194:0/326369701 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00a0004530 con 0x55744834a8f0 2024-09-13T06:10:56.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.005+0000 7eff9d60a640 1 -- 172.21.15.194:0/326369701 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00a0004870 con 0x55744834a8f0 2024-09-13T06:10:56.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.005+0000 7f00b18d3980 1 -- 172.21.15.194:0/326369701 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55744834a8f0 msgr2=0x557448435ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.005+0000 7f00b18d3980 1 --2- 172.21.15.194:0/326369701 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55744834a8f0 0x557448435ca0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f00a00017b0 tx=0x7f00a0001c70 comp rx=0 tx=0).stop 2024-09-13T06:10:56.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.005+0000 7f00b18d3980 1 -- 172.21.15.194:0/326369701 shutdown_connections 2024-09-13T06:10:56.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.005+0000 7f00b18d3980 1 --2- 172.21.15.194:0/326369701 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55744834a8f0 0x557448435ca0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.005+0000 7f00b18d3980 1 -- 172.21.15.194:0/326369701 >> 172.21.15.194:0/326369701 conn(0x5574482be240 msgr2=0x5574484318d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:56.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.005+0000 7f00b18d3980 1 -- 172.21.15.194:0/326369701 shutdown_connections 2024-09-13T06:10:56.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.005+0000 7f00b18d3980 1 -- 172.21.15.194:0/326369701 wait complete. 2024-09-13T06:10:56.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.005+0000 7f00b18d3980 1 Processor -- start 2024-09-13T06:10:56.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.005+0000 7f00b18d3980 1 -- start start 2024-09-13T06:10:56.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.005+0000 7f00b18d3980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55744834ec70 0x55744843d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.005+0000 7f00b18d3980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5574483520b0 con 0x55744834ec70 2024-09-13T06:10:56.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.005+0000 7f00af3e3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55744834ec70 0x55744843d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.005+0000 7f00af3e3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55744834ec70 0x55744843d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:38558/0 (socket says 172.21.15.194:38558) 2024-09-13T06:10:56.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.005+0000 7f00af3e3640 1 -- 172.21.15.194:0/1074444377 learned_addr learned my addr 172.21.15.194:0/1074444377 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:56.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.009+0000 7f00af3e3640 1 -- 172.21.15.194:0/1074444377 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55744843d7d0 con 0x55744834ec70 2024-09-13T06:10:56.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.009+0000 7f00af3e3640 1 --2- 172.21.15.194:0/1074444377 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55744834ec70 0x55744843d290 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f00a0000f90 tx=0x7f00a0001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.009+0000 7eff9be07640 1 -- 172.21.15.194:0/1074444377 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00a0020020 con 0x55744834ec70 2024-09-13T06:10:56.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.009+0000 7f00b18d3980 1 -- 172.21.15.194:0/1074444377 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55744843da60 con 0x55744834ec70 2024-09-13T06:10:56.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.009+0000 7eff9be07640 1 -- 172.21.15.194:0/1074444377 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00a0017040 con 0x55744834ec70 2024-09-13T06:10:56.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.009+0000 7eff9be07640 1 -- 172.21.15.194:0/1074444377 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00a0016070 con 0x55744834ec70 2024-09-13T06:10:56.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.009+0000 7f00b18d3980 1 -- 172.21.15.194:0/1074444377 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557448440740 con 0x55744834ec70 2024-09-13T06:10:56.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.009+0000 7eff9be07640 1 -- 172.21.15.194:0/1074444377 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f00a0023020 con 0x55744834ec70 2024-09-13T06:10:56.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.009+0000 7eff9be07640 1 --2- 172.21.15.194:0/1074444377 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7eff94034650 0x7eff94036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.009+0000 7eff9be07640 1 -- 172.21.15.194:0/1074444377 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f00a0048f50 con 0x55744834ec70 2024-09-13T06:10:56.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.009+0000 7f00aebe2640 1 --2- 172.21.15.194:0/1074444377 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7eff94034650 0x7eff94036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.017 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.009+0000 7f00b18d3980 1 --2- 172.21.15.194:0/1074444377 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x557448442380 0x557448444770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.017 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.009+0000 7f00b18d3980 1 -- 172.21.15.194:0/1074444377 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557448444cb0 con 0x557448442380 2024-09-13T06:10:56.017 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.009+0000 7f00afbe4640 1 --2- 172.21.15.194:0/1074444377 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x557448442380 0x557448444770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.017 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.009+0000 7f00aebe2640 1 --2- 172.21.15.194:0/1074444377 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7eff94034650 0x7eff94036b10 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f00980ad000 tx=0x7f00980a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.017 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.009+0000 7f00afbe4640 1 --2- 172.21.15.194:0/1074444377 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x557448442380 0x557448444770 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.017 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.009+0000 7f00afbe4640 1 -- 172.21.15.194:0/1074444377 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f00a80083f0 con 0x557448442380 2024-09-13T06:10:56.017 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.009+0000 7f00b18d3980 1 -- 172.21.15.194:0/1074444377 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5574484450d0 con 0x557448442380 2024-09-13T06:10:56.017 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.009+0000 7f00afbe4640 1 -- 172.21.15.194:0/1074444377 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f00a80083f0 con 0x557448442380 2024-09-13T06:10:56.017 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.009+0000 7f00b18d3980 1 --2- 172.21.15.194:0/1074444377 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x557448446ee0 0x5574484492d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.017 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.009+0000 7f00b18d3980 1 -- 172.21.15.194:0/1074444377 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557448449970 con 0x557448446ee0 2024-09-13T06:10:56.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.009+0000 7f00af3e3640 1 --2- 172.21.15.194:0/1074444377 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x557448446ee0 0x5574484492d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.013+0000 7f00af3e3640 1 --2- 172.21.15.194:0/1074444377 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x557448446ee0 0x5574484492d0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.013+0000 7f00af3e3640 1 -- 172.21.15.194:0/1074444377 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f00a000f070 con 0x557448446ee0 2024-09-13T06:10:56.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.013+0000 7f00b18d3980 1 -- 172.21.15.194:0/1074444377 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557448445d50 con 0x557448442380 2024-09-13T06:10:56.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.013+0000 7f00afbe4640 1 -- 172.21.15.194:0/1074444377 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f00a80083f0 con 0x557448442380 2024-09-13T06:10:56.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.013+0000 7f00b18d3980 1 --2- 172.21.15.194:0/1074444377 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55744844add0 0x55744844d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.013+0000 7f00b18d3980 1 -- 172.21.15.194:0/1074444377 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55744844d8c0 con 0x55744844add0 2024-09-13T06:10:56.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.013+0000 7f00aebe2640 1 --2- 172.21.15.194:0/1074444377 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55744844add0 0x55744844d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.013+0000 7f00aebe2640 1 --2- 172.21.15.194:0/1074444377 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55744844add0 0x55744844d1c0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.021 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.013+0000 7f00aebe2640 1 -- 172.21.15.194:0/1074444377 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f00980b3040 con 0x55744844add0 2024-09-13T06:10:56.021 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.013+0000 7f00b18d3980 1 Processor -- start 2024-09-13T06:10:56.021 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.013+0000 7f00b18d3980 1 -- start start 2024-09-13T06:10:56.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.013+0000 7f00b18d3980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55744845b390 0x55744845b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.013+0000 7f00b18d3980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55744824f800 con 0x55744845b390 2024-09-13T06:10:56.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.013+0000 7f00af3e3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55744845b390 0x55744845b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.013+0000 7f00af3e3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55744845b390 0x55744845b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:38574/0 (socket says 172.21.15.194:38574) 2024-09-13T06:10:56.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.013+0000 7f00af3e3640 1 -- 172.21.15.194:0/231227146 learned_addr learned my addr 172.21.15.194:0/231227146 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:56.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.013+0000 7f00af3e3640 1 -- 172.21.15.194:0/231227146 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55744845bcf0 con 0x55744845b390 2024-09-13T06:10:56.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.013+0000 7f00af3e3640 1 --2- 172.21.15.194:0/231227146 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55744845b390 0x55744845b7b0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f00a00472c0 tx=0x7f00a001beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.013+0000 7eff99602640 1 -- 172.21.15.194:0/231227146 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00a002cb20 con 0x55744845b390 2024-09-13T06:10:56.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.013+0000 7eff99602640 1 -- 172.21.15.194:0/231227146 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00a002ccc0 con 0x55744845b390 2024-09-13T06:10:56.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.013+0000 7f00b18d3980 1 -- 172.21.15.194:0/231227146 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55744845bf80 con 0x55744845b390 2024-09-13T06:10:56.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.013+0000 7eff99602640 1 -- 172.21.15.194:0/231227146 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00a0024a70 con 0x55744845b390 2024-09-13T06:10:56.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.013+0000 7f00b18d3980 1 -- 172.21.15.194:0/231227146 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55744845ec00 con 0x55744845b390 2024-09-13T06:10:56.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.017+0000 7eff99602640 1 -- 172.21.15.194:0/231227146 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f00a0024c10 con 0x55744845b390 2024-09-13T06:10:56.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.017+0000 7eff99602640 1 --2- 172.21.15.194:0/231227146 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7eff88034650 0x7eff88036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.017+0000 7eff99602640 1 -- 172.21.15.194:0/231227146 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f00a0037070 con 0x55744845b390 2024-09-13T06:10:56.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.017+0000 7f00aebe2640 1 --2- 172.21.15.194:0/231227146 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7eff88034650 0x7eff88036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.017+0000 7f00b18d3980 1 Processor -- start 2024-09-13T06:10:56.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.017+0000 7f00b18d3980 1 -- start start 2024-09-13T06:10:56.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.017+0000 7f00aebe2640 1 --2- 172.21.15.194:0/231227146 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7eff88034650 0x7eff88036b10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x5574484418b0 tx=0x7f0098005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.017+0000 7f00b18d3980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557448467d80 0x557448468180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.017+0000 7f00b18d3980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5574484365f0 con 0x557448467d80 2024-09-13T06:10:56.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.017+0000 7f00af3e3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557448467d80 0x557448468180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.017+0000 7f00af3e3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557448467d80 0x557448468180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:38586/0 (socket says 172.21.15.194:38586) 2024-09-13T06:10:56.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.017+0000 7f00af3e3640 1 -- 172.21.15.194:0/2905803273 learned_addr learned my addr 172.21.15.194:0/2905803273 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:56.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.017+0000 7f00af3e3640 1 -- 172.21.15.194:0/2905803273 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557448468750 con 0x557448467d80 2024-09-13T06:10:56.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.017+0000 7f00af3e3640 1 --2- 172.21.15.194:0/2905803273 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557448467d80 0x557448468180 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f00a002ffd0 tx=0x7f00a002eae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=792107196a2fde5d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.017+0000 7eff92ffd640 1 -- 172.21.15.194:0/2905803273 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00a0040e40 con 0x557448467d80 2024-09-13T06:10:56.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.017+0000 7eff92ffd640 1 -- 172.21.15.194:0/2905803273 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00a005a070 con 0x557448467d80 2024-09-13T06:10:56.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.017+0000 7eff92ffd640 1 -- 172.21.15.194:0/2905803273 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00a0012db0 con 0x557448467d80 2024-09-13T06:10:56.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.017+0000 7f00b18d3980 1 -- 172.21.15.194:0/2905803273 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557448467d80 msgr2=0x557448468180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.017+0000 7f00b18d3980 1 --2- 172.21.15.194:0/2905803273 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557448467d80 0x557448468180 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f00a002ffd0 tx=0x7f00a002eae0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.017+0000 7f00b18d3980 1 -- 172.21.15.194:0/2905803273 shutdown_connections 2024-09-13T06:10:56.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.017+0000 7f00b18d3980 1 --2- 172.21.15.194:0/2905803273 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557448467d80 0x557448468180 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.017+0000 7f00b18d3980 1 -- 172.21.15.194:0/2905803273 >> 172.21.15.194:0/2905803273 conn(0x5574484640b0 msgr2=0x5574484621b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:56.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.017+0000 7f00b18d3980 1 -- 172.21.15.194:0/2905803273 shutdown_connections 2024-09-13T06:10:56.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.017+0000 7f00b18d3980 1 -- 172.21.15.194:0/2905803273 wait complete. 2024-09-13T06:10:56.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.021+0000 7f00b18d3980 1 Processor -- start 2024-09-13T06:10:56.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.021+0000 7f00b18d3980 1 -- start start 2024-09-13T06:10:56.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.021+0000 7f00b18d3980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557448467d80 0x55744846eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.021+0000 7f00b18d3980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x557448468c40 con 0x557448467d80 2024-09-13T06:10:56.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.021+0000 7f00af3e3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557448467d80 0x55744846eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.021+0000 7f00af3e3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557448467d80 0x55744846eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:38590/0 (socket says 172.21.15.194:38590) 2024-09-13T06:10:56.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.021+0000 7f00af3e3640 1 -- 172.21.15.194:0/3810696583 learned_addr learned my addr 172.21.15.194:0/3810696583 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:56.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.021+0000 7f00af3e3640 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55744846f3f0 con 0x557448467d80 2024-09-13T06:10:56.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.021+0000 7f00af3e3640 1 --2- 172.21.15.194:0/3810696583 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557448467d80 0x55744846eeb0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f00a0046110 tx=0x7f00a00263b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.021+0000 7eff917fa640 1 -- 172.21.15.194:0/3810696583 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00a0026020 con 0x557448467d80 2024-09-13T06:10:56.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.021+0000 7f00b18d3980 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55744846f3f0 con 0x557448467d80 2024-09-13T06:10:56.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.021+0000 7eff917fa640 1 -- 172.21.15.194:0/3810696583 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00a00261c0 con 0x557448467d80 2024-09-13T06:10:56.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.021+0000 7eff917fa640 1 -- 172.21.15.194:0/3810696583 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00a00405c0 con 0x557448467d80 2024-09-13T06:10:56.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.021+0000 7f00b18d3980 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55744846f3f0 con 0x557448467d80 2024-09-13T06:10:56.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.021+0000 7f00b18d3980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.021+0000 7eff917fa640 1 -- 172.21.15.194:0/3810696583 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f00a0054070 con 0x557448467d80 2024-09-13T06:10:56.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.021+0000 7eff917fa640 1 --2- 172.21.15.194:0/3810696583 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7eff78034650 0x7eff78036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.021+0000 7eff917fa640 1 -- 172.21.15.194:0/3810696583 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f00a0051030 con 0x557448467d80 2024-09-13T06:10:56.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.021+0000 7f00aebe2640 1 --2- 172.21.15.194:0/3810696583 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7eff78034650 0x7eff78036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.034 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.021+0000 7f00b18d3980 1 --2- 172.21.15.194:0/3810696583 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x557448479e60 0x55744847c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.034 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.021+0000 7f00b18d3980 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55744847ca70 con 0x557448479e60 2024-09-13T06:10:56.034 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.021+0000 7f00afbe4640 1 --2- 172.21.15.194:0/3810696583 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x557448479e60 0x55744847c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.034 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.021+0000 7f00aebe2640 1 --2- 172.21.15.194:0/3810696583 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7eff78034650 0x7eff78036b10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0098000c10 tx=0x7f00980b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.034 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.021+0000 7f00afbe4640 1 --2- 172.21.15.194:0/3810696583 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x557448479e60 0x55744847c320 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.034 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.025+0000 7f00afbe4640 1 -- 172.21.15.194:0/3810696583 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f00a80083f0 con 0x557448479e60 2024-09-13T06:10:56.034 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.025+0000 7f00b18d3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:56.034 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.025+0000 7f00b18d3980 20 realm 2024-09-13T06:10:56.034 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.025+0000 7f00b18d3980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.034 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.025+0000 7f00b18d3980 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55744847ce80 con 0x557448479e60 2024-09-13T06:10:56.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.025+0000 7f00afbe4640 1 -- 172.21.15.194:0/3810696583 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f00a80083f0 con 0x557448479e60 2024-09-13T06:10:56.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.025+0000 7f00b18d3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:56.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.025+0000 7f00b18d3980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:10:56.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.025+0000 7f00b18d3980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.025+0000 7f00b18d3980 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55744847d720 con 0x557448479e60 2024-09-13T06:10:56.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.025+0000 7f00afbe4640 1 -- 172.21.15.194:0/3810696583 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f00a80083f0 con 0x557448479e60 2024-09-13T06:10:56.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.025+0000 7f00b18d3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:56.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.025+0000 7f00b18d3980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.025+0000 7f00b18d3980 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55744847dac0 con 0x557448479e60 2024-09-13T06:10:56.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.025+0000 7f00afbe4640 1 -- 172.21.15.194:0/3810696583 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f00a80083f0 con 0x557448479e60 2024-09-13T06:10:56.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.025+0000 7f00b18d3980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:10:56.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.025+0000 7f00b18d3980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.025+0000 7f00b18d3980 1 --2- 172.21.15.194:0/3810696583 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55744847e820 0x557448480c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.025+0000 7f00b18d3980 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557448481190 con 0x55744847e820 2024-09-13T06:10:56.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.025+0000 7f00af3e3640 1 --2- 172.21.15.194:0/3810696583 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55744847e820 0x557448480c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.025+0000 7f00af3e3640 1 --2- 172.21.15.194:0/3810696583 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55744847e820 0x557448480c10 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.025+0000 7f00af3e3640 1 -- 172.21.15.194:0/3810696583 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f00a0070020 con 0x55744847e820 2024-09-13T06:10:56.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.025+0000 7f00b18d3980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:10:56.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.025+0000 7f00b18d3980 20 searching for the correct realm 2024-09-13T06:10:56.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.025+0000 7f00b18d3980 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557448482a10 con 0x55744847e820 2024-09-13T06:10:56.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.025+0000 7f00af3e3640 1 -- 172.21.15.194:0/3810696583 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00a0070020 con 0x55744847e820 2024-09-13T06:10:56.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.025+0000 7f00af3e3640 1 --2- 172.21.15.194:0/3810696583 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f00a003a030 0x7f00a0030490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.037 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.025+0000 7f00af3e3640 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557448482a10 con 0x7f00a003a030 2024-09-13T06:10:56.037 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.025+0000 7f00aebe2640 1 --2- 172.21.15.194:0/3810696583 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f00a003a030 0x7f00a0030490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.037 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.025+0000 7f00aebe2640 1 --2- 172.21.15.194:0/3810696583 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f00a003a030 0x7f00a0030490 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.037 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.025+0000 7f00aebe2640 1 -- 172.21.15.194:0/3810696583 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f00980c9030 con 0x7f00a003a030 2024-09-13T06:10:56.037 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.025+0000 7f00aebe2640 1 --2- 172.21.15.194:0/3810696583 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f00980dc040 0x7f00980dd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.037 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.025+0000 7f00aebe2640 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557448482a10 con 0x7f00980dc040 2024-09-13T06:10:56.037 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.025+0000 7f00afbe4640 1 --2- 172.21.15.194:0/3810696583 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f00980dc040 0x7f00980dd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.037 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.025+0000 7f00afbe4640 1 --2- 172.21.15.194:0/3810696583 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f00980dc040 0x7f00980dd430 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.047 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.029+0000 7f00afbe4640 1 -- 172.21.15.194:0/3810696583 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00a80083f0 con 0x7f00980dc040 2024-09-13T06:10:56.047 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.029+0000 7f00afbe4640 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55744847dac0 con 0x557448479e60 2024-09-13T06:10:56.047 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.029+0000 7f00afbe4640 1 -- 172.21.15.194:0/3810696583 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00a80083f0 con 0x557448479e60 2024-09-13T06:10:56.047 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.029+0000 7f00afbe4640 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55744847dac0 con 0x557448479e60 2024-09-13T06:10:56.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.029+0000 7f00afbe4640 1 -- 172.21.15.194:0/3810696583 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00a80083f0 con 0x557448479e60 2024-09-13T06:10:56.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.029+0000 7f00afbe4640 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55744847dac0 con 0x7f00980dc040 2024-09-13T06:10:56.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.029+0000 7f00afbe4640 1 -- 172.21.15.194:0/3810696583 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00a80083f0 con 0x7f00980dc040 2024-09-13T06:10:56.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.029+0000 7f00afbe4640 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55744847dac0 con 0x7f00980dc040 2024-09-13T06:10:56.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.029+0000 7f00afbe4640 1 -- 172.21.15.194:0/3810696583 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00a80083f0 con 0x7f00980dc040 2024-09-13T06:10:56.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.029+0000 7f00afbe4640 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55744847dac0 con 0x7f00a003a030 2024-09-13T06:10:56.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.029+0000 7f00aebe2640 1 -- 172.21.15.194:0/3810696583 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00980c9030 con 0x7f00a003a030 2024-09-13T06:10:56.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.029+0000 7f00aebe2640 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55744847dac0 con 0x55744847e820 2024-09-13T06:10:56.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.029+0000 7f00af3e3640 1 -- 172.21.15.194:0/3810696583 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00a0070020 con 0x55744847e820 2024-09-13T06:10:56.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.029+0000 7f00af3e3640 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55744847dac0 con 0x557448479e60 2024-09-13T06:10:56.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.029+0000 7f00afbe4640 1 -- 172.21.15.194:0/3810696583 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00a80083f0 con 0x557448479e60 2024-09-13T06:10:56.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.029+0000 7f00afbe4640 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55744847dac0 con 0x7f00980dc040 2024-09-13T06:10:56.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.029+0000 7f00afbe4640 1 -- 172.21.15.194:0/3810696583 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00a80083f0 con 0x7f00980dc040 2024-09-13T06:10:56.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.029+0000 7f00afbe4640 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55744847dac0 con 0x557448479e60 2024-09-13T06:10:56.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.029+0000 7f00afbe4640 1 -- 172.21.15.194:0/3810696583 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00a80083f0 con 0x557448479e60 2024-09-13T06:10:56.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.029+0000 7f00afbe4640 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55744847dac0 con 0x7f00a003a030 2024-09-13T06:10:56.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.033+0000 7f00aebe2640 1 -- 172.21.15.194:0/3810696583 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f00980c9030 con 0x7f00a003a030 2024-09-13T06:10:56.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.033+0000 7f00aebe2640 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55744847dac0 con 0x55744847e820 2024-09-13T06:10:56.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.033+0000 7f00af3e3640 1 -- 172.21.15.194:0/3810696583 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00a0070020 con 0x55744847e820 2024-09-13T06:10:56.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.033+0000 7f00af3e3640 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55744847dac0 con 0x55744847e820 2024-09-13T06:10:56.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.033+0000 7f00af3e3640 1 -- 172.21.15.194:0/3810696583 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00a0070020 con 0x55744847e820 2024-09-13T06:10:56.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.033+0000 7f00af3e3640 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55744847dac0 con 0x7f00980dc040 2024-09-13T06:10:56.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.033+0000 7f00afbe4640 1 -- 172.21.15.194:0/3810696583 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00a80083f0 con 0x7f00980dc040 2024-09-13T06:10:56.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.033+0000 7f00afbe4640 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55744847dac0 con 0x55744847e820 2024-09-13T06:10:56.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.033+0000 7f00af3e3640 1 -- 172.21.15.194:0/3810696583 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00a0070020 con 0x55744847e820 2024-09-13T06:10:56.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.033+0000 7f00af3e3640 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55744847dac0 con 0x55744847e820 2024-09-13T06:10:56.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.033+0000 7f00af3e3640 1 -- 172.21.15.194:0/3810696583 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00a0070020 con 0x55744847e820 2024-09-13T06:10:56.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.033+0000 7f00af3e3640 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55744847dac0 con 0x557448479e60 2024-09-13T06:10:56.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.033+0000 7f00afbe4640 1 -- 172.21.15.194:0/3810696583 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00a80083f0 con 0x557448479e60 2024-09-13T06:10:56.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.033+0000 7f00afbe4640 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55744847dac0 con 0x557448479e60 2024-09-13T06:10:56.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.033+0000 7f00afbe4640 1 -- 172.21.15.194:0/3810696583 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f00a80083f0 con 0x557448479e60 2024-09-13T06:10:56.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.033+0000 7f00afbe4640 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55744847dac0 con 0x7f00a003a030 2024-09-13T06:10:56.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.033+0000 7f00aebe2640 1 -- 172.21.15.194:0/3810696583 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00980c9030 con 0x7f00a003a030 2024-09-13T06:10:56.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.033+0000 7f00aebe2640 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55744847dac0 con 0x55744847e820 2024-09-13T06:10:56.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.033+0000 7f00af3e3640 1 -- 172.21.15.194:0/3810696583 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00a0070020 con 0x55744847e820 2024-09-13T06:10:56.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.033+0000 7f00af3e3640 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55744847dac0 con 0x7f00a003a030 2024-09-13T06:10:56.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.033+0000 7f00aebe2640 1 -- 172.21.15.194:0/3810696583 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00980c9030 con 0x7f00a003a030 2024-09-13T06:10:56.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.033+0000 7f00aebe2640 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55744847dac0 con 0x557448479e60 2024-09-13T06:10:56.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.033+0000 7f00afbe4640 1 -- 172.21.15.194:0/3810696583 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00a80083f0 con 0x557448479e60 2024-09-13T06:10:56.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.033+0000 7f00afbe4640 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55744847dac0 con 0x7f00980dc040 2024-09-13T06:10:56.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.037+0000 7f00afbe4640 1 -- 172.21.15.194:0/3810696583 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00a80083f0 con 0x7f00980dc040 2024-09-13T06:10:56.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.037+0000 7f00afbe4640 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55744847dac0 con 0x55744847e820 2024-09-13T06:10:56.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.037+0000 7f00af3e3640 1 -- 172.21.15.194:0/3810696583 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f00a0070020 con 0x55744847e820 2024-09-13T06:10:56.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.037+0000 7f00af3e3640 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55744847dac0 con 0x7f00a003a030 2024-09-13T06:10:56.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.037+0000 7f00aebe2640 1 -- 172.21.15.194:0/3810696583 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00980c9030 con 0x7f00a003a030 2024-09-13T06:10:56.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.037+0000 7f00aebe2640 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55744847dac0 con 0x7f00a003a030 2024-09-13T06:10:56.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.037+0000 7f00aebe2640 1 -- 172.21.15.194:0/3810696583 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00980c9030 con 0x7f00a003a030 2024-09-13T06:10:56.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.037+0000 7f00aebe2640 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55744847dac0 con 0x55744847e820 2024-09-13T06:10:56.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.037+0000 7f00af3e3640 1 -- 172.21.15.194:0/3810696583 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00a0070020 con 0x55744847e820 2024-09-13T06:10:56.052 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.037+0000 7f00af3e3640 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55744847dac0 con 0x7f00980dc040 2024-09-13T06:10:56.052 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.037+0000 7f00afbe4640 1 -- 172.21.15.194:0/3810696583 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00a80083f0 con 0x7f00980dc040 2024-09-13T06:10:56.052 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.037+0000 7f00afbe4640 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55744847dac0 con 0x557448479e60 2024-09-13T06:10:56.052 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.037+0000 7f00afbe4640 1 -- 172.21.15.194:0/3810696583 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f00a80083f0 con 0x557448479e60 2024-09-13T06:10:56.052 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.037+0000 7f00afbe4640 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55744847dac0 con 0x7f00a003a030 2024-09-13T06:10:56.052 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.037+0000 7f00aebe2640 1 -- 172.21.15.194:0/3810696583 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00980c9030 con 0x7f00a003a030 2024-09-13T06:10:56.052 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.037+0000 7f00b18d3980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:10:56.052 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.037+0000 7f00b18d3980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:10:56.052 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.037+0000 7f00b18d3980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:10:56.052 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.037+0000 7f00b18d3980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:10:56.052 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.037+0000 7f00b18d3980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:10:56.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.037+0000 7f00b18d3980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:10:56.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.037+0000 7f00b18d3980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.037+0000 7f00b18d3980 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5574484819e0 con 0x557448479e60 2024-09-13T06:10:56.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.037+0000 7f00afbe4640 1 -- 172.21.15.194:0/3810696583 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f00a80083f0 con 0x557448479e60 2024-09-13T06:10:56.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.037+0000 7f00b18d3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:56.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.037+0000 7f00b18d3980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.037+0000 7f00b18d3980 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557448481dd0 con 0x557448479e60 2024-09-13T06:10:56.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.037+0000 7f00afbe4640 1 -- 172.21.15.194:0/3810696583 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f00a80083f0 con 0x557448479e60 2024-09-13T06:10:56.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.037+0000 7f00b18d3980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:10:56.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.037+0000 7f00b18d3980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.037+0000 7f00b18d3980 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557448481dd0 con 0x7f00a003a030 2024-09-13T06:10:56.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.037+0000 7f00aebe2640 1 -- 172.21.15.194:0/3810696583 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f00980c9030 con 0x7f00a003a030 2024-09-13T06:10:56.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.037+0000 7f00b18d3980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:10:56.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.037+0000 7f00b18d3980 20 zone default found 2024-09-13T06:10:56.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.037+0000 7f00b18d3980 4 Realm: () 2024-09-13T06:10:56.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.037+0000 7f00b18d3980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:10:56.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.037+0000 7f00b18d3980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:10:56.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.037+0000 7f00b18d3980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:10:56.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.037+0000 7f00b18d3980 20 zonegroup default 2024-09-13T06:10:56.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.037+0000 7f00b18d3980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.037+0000 7f00b18d3980 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557448482ee0 con 0x7f00980dc040 2024-09-13T06:10:56.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.037+0000 7f00afbe4640 1 -- 172.21.15.194:0/3810696583 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f00a80083f0 con 0x7f00980dc040 2024-09-13T06:10:56.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.037+0000 7f00b18d3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:56.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.037+0000 7f00b18d3980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.037+0000 7f00b18d3980 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5574484848c0 con 0x55744847e820 2024-09-13T06:10:56.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.041+0000 7f00af3e3640 1 -- 172.21.15.194:0/3810696583 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f00a0070020 con 0x55744847e820 2024-09-13T06:10:56.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.041+0000 7f00b18d3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:56.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.041+0000 7f00b18d3980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.041+0000 7f00b18d3980 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557448484c60 con 0x55744847e820 2024-09-13T06:10:56.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.041+0000 7f00af3e3640 1 -- 172.21.15.194:0/3810696583 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f00a0070020 con 0x55744847e820 2024-09-13T06:10:56.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.041+0000 7f00b18d3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:56.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.041+0000 7f00b18d3980 20 started sync module instance, tier type = 2024-09-13T06:10:56.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.041+0000 7f00b18d3980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:10:56.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.041+0000 7f00b18d3980 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557448483d60 con 0x7f00a003a030 2024-09-13T06:10:56.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.041+0000 7f00aebe2640 1 -- 172.21.15.194:0/3810696583 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(44 notify.0 [create] v35'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00980c9030 con 0x7f00a003a030 2024-09-13T06:10:56.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.041+0000 7f00b18d3980 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93957917262208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574484839c0 con 0x7f00a003a030 2024-09-13T06:10:56.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.041+0000 7f00b18d3980 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557448485ad0 con 0x557448479e60 2024-09-13T06:10:56.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.041+0000 7f00aebe2640 1 -- 172.21.15.194:0/3810696583 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 93957917262208] v35'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00980c9030 con 0x7f00a003a030 2024-09-13T06:10:56.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.041+0000 7f00afbe4640 1 -- 172.21.15.194:0/3810696583 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v35'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00a80083f0 con 0x557448479e60 2024-09-13T06:10:56.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.041+0000 7f00b18d3980 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93957917267488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557448485ef0 con 0x557448479e60 2024-09-13T06:10:56.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.041+0000 7f00b18d3980 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574484867c0 con 0x55744847e820 2024-09-13T06:10:56.058 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.045+0000 7f00afbe4640 1 -- 172.21.15.194:0/3810696583 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93957917267488] v35'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00a80083f0 con 0x557448479e60 2024-09-13T06:10:56.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.045+0000 7f00af3e3640 1 -- 172.21.15.194:0/3810696583 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v35'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00a0070020 con 0x55744847e820 2024-09-13T06:10:56.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.045+0000 7f00b18d3980 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93957917268816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557448486bb0 con 0x55744847e820 2024-09-13T06:10:56.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.045+0000 7f00b18d3980 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557448487570 con 0x7f00a003a030 2024-09-13T06:10:56.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.045+0000 7f00aebe2640 1 -- 172.21.15.194:0/3810696583 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(50 notify.3 [create] v35'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00980c9030 con 0x7f00a003a030 2024-09-13T06:10:56.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.045+0000 7f00b18d3980 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93957917276432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574484881e0 con 0x7f00a003a030 2024-09-13T06:10:56.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.045+0000 7f00b18d3980 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557448488ba0 con 0x557448479e60 2024-09-13T06:10:56.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.045+0000 7f00af3e3640 1 -- 172.21.15.194:0/3810696583 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93957917268816] v35'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00a0070020 con 0x55744847e820 2024-09-13T06:10:56.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.049+0000 7f00aebe2640 1 -- 172.21.15.194:0/3810696583 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 93957917276432] v35'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00980c9030 con 0x7f00a003a030 2024-09-13T06:10:56.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.049+0000 7f00afbe4640 1 -- 172.21.15.194:0/3810696583 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v35'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00a80083f0 con 0x557448479e60 2024-09-13T06:10:56.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.049+0000 7f00b18d3980 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93957917279984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574484881e0 con 0x557448479e60 2024-09-13T06:10:56.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.049+0000 7f00b18d3980 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557448488b10 con 0x7f00980dc040 2024-09-13T06:10:56.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.049+0000 7f00afbe4640 1 -- 172.21.15.194:0/3810696583 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(54 notify.5 [create] v35'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00a80083f0 con 0x7f00980dc040 2024-09-13T06:10:56.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.049+0000 7f00b18d3980 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93957917282048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557448488b10 con 0x7f00980dc040 2024-09-13T06:10:56.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.049+0000 7f00b18d3980 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557448489e30 con 0x7f00980dc040 2024-09-13T06:10:56.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.053+0000 7f00afbe4640 1 -- 172.21.15.194:0/3810696583 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93957917279984] v35'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00a80083f0 con 0x557448479e60 2024-09-13T06:10:56.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.053+0000 7f00afbe4640 1 -- 172.21.15.194:0/3810696583 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 93957917282048] v35'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00a80083f0 con 0x7f00980dc040 2024-09-13T06:10:56.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.053+0000 7f00afbe4640 1 -- 172.21.15.194:0/3810696583 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(56 notify.6 [create] v35'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00a80083f0 con 0x7f00980dc040 2024-09-13T06:10:56.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.053+0000 7f00b18d3980 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93957917283104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557448489940 con 0x7f00980dc040 2024-09-13T06:10:56.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.053+0000 7f00b18d3980 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55744848a300 con 0x7f00980dc040 2024-09-13T06:10:56.061 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.053+0000 7f00afbe4640 1 -- 172.21.15.194:0/3810696583 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(58 notify.7 [create] v35'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00a80083f0 con 0x7f00980dc040 2024-09-13T06:10:56.061 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.053+0000 7f00b18d3980 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93957917285968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55744848a720 con 0x7f00980dc040 2024-09-13T06:10:56.061 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.053+0000 7f00b18d3980 20 add_watcher() i=0 2024-09-13T06:10:56.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.053+0000 7f00b18d3980 20 add_watcher() i=1 2024-09-13T06:10:56.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.053+0000 7f00b18d3980 20 add_watcher() i=2 2024-09-13T06:10:56.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.053+0000 7f00b18d3980 20 add_watcher() i=3 2024-09-13T06:10:56.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.053+0000 7f00b18d3980 20 add_watcher() i=4 2024-09-13T06:10:56.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.053+0000 7f00b18d3980 20 add_watcher() i=5 2024-09-13T06:10:56.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.057+0000 7f00afbe4640 1 -- 172.21.15.194:0/3810696583 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93957917283104] v35'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00a80083f0 con 0x7f00980dc040 2024-09-13T06:10:56.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.057+0000 7f00b18d3980 20 add_watcher() i=6 2024-09-13T06:10:56.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.057+0000 7f00afbe4640 1 -- 172.21.15.194:0/3810696583 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 93957917285968] v35'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00a80083f0 con 0x7f00980dc040 2024-09-13T06:10:56.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.057+0000 7f00b18d3980 20 add_watcher() i=7 2024-09-13T06:10:56.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.057+0000 7f00b18d3980 2 all 8 watchers are set, enabling cache 2024-09-13T06:10:56.063 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.057+0000 7f00b18d3980 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55744848a720 con 0x557448479e60 2024-09-13T06:10:56.063 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.057+0000 7f00afbe4640 1 -- 172.21.15.194:0/3810696583 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f00a80083f0 con 0x557448479e60 2024-09-13T06:10:56.063 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.057+0000 7f00b18d3980 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93957917287024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55744848a690 con 0x557448479e60 2024-09-13T06:10:56.064 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.057+0000 7f00afbe4640 1 -- 172.21.15.194:0/3810696583 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93957917287024] v35'202 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f00a80083f0 con 0x557448479e60 2024-09-13T06:10:56.064 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.057+0000 7eff65fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:10:56.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.057+0000 7f00b18d3980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:10:56.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.057+0000 7f00b18d3980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:10:56.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.057+0000 7f00b18d3980 5 note: GC not initialized 2024-09-13T06:10:56.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.057+0000 7eff64fe1640 20 reqs_thread_entry: start 2024-09-13T06:10:56.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.057+0000 7f00b18d3980 20 init_complete bucket index max shards: 11 2024-09-13T06:10:56.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.057+0000 7f00b18d3980 20 Filter name: none 2024-09-13T06:10:56.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.057+0000 7efede7fc640 20 reqs_thread_entry: start 2024-09-13T06:10:56.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.057+0000 7f00b18d3980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.057+0000 7f00b18d3980 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5574484b0850 con 0x557448479e60 2024-09-13T06:10:56.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.061+0000 7f00afbe4640 1 -- 172.21.15.194:0/3810696583 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv23 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f00a80083f0 con 0x557448479e60 2024-09-13T06:10:56.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.061+0000 7f00b18d3980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T06:10:56.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.061+0000 7f00b18d3980 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5574484b1da0 con 0x7f00980dc040 2024-09-13T06:10:56.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.061+0000 7f00afbe4640 1 -- 172.21.15.194:0/3810696583 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv30 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f00a80083f0 con 0x7f00980dc040 2024-09-13T06:10:56.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.061+0000 7eff65fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:10:56.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.061+0000 7f00b18d3980 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93957917287024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574484aefb0 con 0x557448479e60 2024-09-13T06:10:56.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.061+0000 7f00afbe4640 1 -- 172.21.15.194:0/3810696583 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 93957917287024] v35'203 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f00a80083f0 con 0x557448479e60 2024-09-13T06:10:56.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.061+0000 7f00b18d3980 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93957917262208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55744848a270 con 0x7f00a003a030 2024-09-13T06:10:56.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.065+0000 7f00aebe2640 1 -- 172.21.15.194:0/3810696583 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 93957917262208] v35'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00980c9030 con 0x7f00a003a030 2024-09-13T06:10:56.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.065+0000 7f00b18d3980 20 remove_watcher() i=0 2024-09-13T06:10:56.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.065+0000 7f00b18d3980 2 removed watcher, disabling cache 2024-09-13T06:10:56.068 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.065+0000 7f00b18d3980 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93957917267488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55744848a270 con 0x557448479e60 2024-09-13T06:10:56.069 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.065+0000 7f00afbe4640 1 -- 172.21.15.194:0/3810696583 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 93957917267488] v35'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00a80083f0 con 0x557448479e60 2024-09-13T06:10:56.069 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.065+0000 7f00b18d3980 20 remove_watcher() i=1 2024-09-13T06:10:56.070 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.065+0000 7f00b18d3980 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93957917268816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55744848a270 con 0x55744847e820 2024-09-13T06:10:56.071 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.069+0000 7f00af3e3640 1 -- 172.21.15.194:0/3810696583 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 93957917268816] v35'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00a0070020 con 0x55744847e820 2024-09-13T06:10:56.071 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.069+0000 7f00b18d3980 20 remove_watcher() i=2 2024-09-13T06:10:56.072 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.069+0000 7f00b18d3980 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93957917276432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557448485b50 con 0x7f00a003a030 2024-09-13T06:10:56.073 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.069+0000 7f00aebe2640 1 -- 172.21.15.194:0/3810696583 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 93957917276432] v35'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00980c9030 con 0x7f00a003a030 2024-09-13T06:10:56.073 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.069+0000 7f00b18d3980 20 remove_watcher() i=3 2024-09-13T06:10:56.073 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.069+0000 7f00b18d3980 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93957917279984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557448487910 con 0x557448479e60 2024-09-13T06:10:56.075 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.069+0000 7f00afbe4640 1 -- 172.21.15.194:0/3810696583 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 93957917279984] v35'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00a80083f0 con 0x557448479e60 2024-09-13T06:10:56.075 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.069+0000 7f00b18d3980 20 remove_watcher() i=4 2024-09-13T06:10:56.075 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.069+0000 7f00b18d3980 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93957917282048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574484886f0 con 0x7f00980dc040 2024-09-13T06:10:56.076 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.073+0000 7f00afbe4640 1 -- 172.21.15.194:0/3810696583 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 93957917282048] v35'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00a80083f0 con 0x7f00980dc040 2024-09-13T06:10:56.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.073+0000 7f00b18d3980 20 remove_watcher() i=5 2024-09-13T06:10:56.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.073+0000 7f00b18d3980 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93957917283104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557448487910 con 0x7f00980dc040 2024-09-13T06:10:56.079 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.073+0000 7f00afbe4640 1 -- 172.21.15.194:0/3810696583 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 93957917283104] v35'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00a80083f0 con 0x7f00980dc040 2024-09-13T06:10:56.079 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.073+0000 7f00b18d3980 20 remove_watcher() i=6 2024-09-13T06:10:56.079 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.073+0000 7f00b18d3980 1 -- 172.21.15.194:0/3810696583 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93957917285968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557448487910 con 0x7f00980dc040 2024-09-13T06:10:56.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.077+0000 7f00afbe4640 1 -- 172.21.15.194:0/3810696583 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 93957917285968] v35'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00a80083f0 con 0x7f00980dc040 2024-09-13T06:10:56.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.077+0000 7f00b18d3980 20 remove_watcher() i=7 2024-09-13T06:10:56.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.077+0000 7f00b18d3980 1 -- 172.21.15.194:0/3810696583 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f00980dc040 msgr2=0x7f00980dd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.077+0000 7f00b18d3980 1 --2- 172.21.15.194:0/3810696583 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f00980dc040 0x7f00980dd430 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.077+0000 7f00b18d3980 1 -- 172.21.15.194:0/3810696583 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x557448479e60 msgr2=0x55744847c320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.077+0000 7f00b18d3980 1 --2- 172.21.15.194:0/3810696583 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x557448479e60 0x55744847c320 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.077+0000 7f00b18d3980 1 -- 172.21.15.194:0/3810696583 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f00a003a030 msgr2=0x7f00a0030490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.077+0000 7f00b18d3980 1 --2- 172.21.15.194:0/3810696583 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f00a003a030 0x7f00a0030490 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.077+0000 7f00b18d3980 1 -- 172.21.15.194:0/3810696583 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55744847e820 msgr2=0x557448480c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.077+0000 7f00b18d3980 1 --2- 172.21.15.194:0/3810696583 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55744847e820 0x557448480c10 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.077+0000 7f00b18d3980 1 -- 172.21.15.194:0/3810696583 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7eff78034650 msgr2=0x7eff78036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.077+0000 7f00b18d3980 1 --2- 172.21.15.194:0/3810696583 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7eff78034650 0x7eff78036b10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0098000c10 tx=0x7f00980b9040 comp rx=0 tx=0).stop 2024-09-13T06:10:56.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.077+0000 7f00b18d3980 1 -- 172.21.15.194:0/3810696583 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557448467d80 msgr2=0x55744846eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.077+0000 7f00afbe4640 1 -- 172.21.15.194:0/3810696583 reap_dead start 2024-09-13T06:10:56.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.077+0000 7f00b18d3980 1 --2- 172.21.15.194:0/3810696583 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557448467d80 0x55744846eeb0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f00a0046110 tx=0x7f00a00263b0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.077+0000 7f00b18d3980 1 -- 172.21.15.194:0/3810696583 shutdown_connections 2024-09-13T06:10:56.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.077+0000 7f00b18d3980 1 --2- 172.21.15.194:0/3810696583 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x557448467d80 0x55744846eeb0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.077+0000 7f00b18d3980 1 -- 172.21.15.194:0/3810696583 >> 172.21.15.194:0/3810696583 conn(0x5574484640b0 msgr2=0x557448462180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:56.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.077+0000 7f00b18d3980 1 -- 172.21.15.194:0/3810696583 shutdown_connections 2024-09-13T06:10:56.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.077+0000 7f00b18d3980 1 -- 172.21.15.194:0/3810696583 wait complete. 2024-09-13T06:10:56.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.077+0000 7f00b18d3980 1 -- 172.21.15.194:0/231227146 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7eff88034650 msgr2=0x7eff88036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.077+0000 7f00b18d3980 1 --2- 172.21.15.194:0/231227146 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7eff88034650 0x7eff88036b10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x5574484418b0 tx=0x7f0098005a10 comp rx=0 tx=0).stop 2024-09-13T06:10:56.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.077+0000 7f00b18d3980 1 -- 172.21.15.194:0/231227146 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55744845b390 msgr2=0x55744845b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.077+0000 7f00b18d3980 1 --2- 172.21.15.194:0/231227146 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55744845b390 0x55744845b7b0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f00a00472c0 tx=0x7f00a001beb0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.086 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.077+0000 7f00b18d3980 1 -- 172.21.15.194:0/231227146 shutdown_connections 2024-09-13T06:10:56.086 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.077+0000 7f00b18d3980 1 --2- 172.21.15.194:0/231227146 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7eff88034650 0x7eff88036b10 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.086 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.077+0000 7f00b18d3980 1 --2- 172.21.15.194:0/231227146 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55744845b390 0x55744845b7b0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.086 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.077+0000 7f00b18d3980 1 -- 172.21.15.194:0/231227146 >> 172.21.15.194:0/231227146 conn(0x5574484504e0 msgr2=0x557448452f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:56.086 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.077+0000 7f00b18d3980 1 -- 172.21.15.194:0/231227146 shutdown_connections 2024-09-13T06:10:56.086 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.077+0000 7f00b18d3980 1 -- 172.21.15.194:0/231227146 wait complete. 2024-09-13T06:10:56.086 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.077+0000 7f00b18d3980 1 -- 172.21.15.194:0/1074444377 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x557448442380 msgr2=0x557448444770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.086 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.077+0000 7f00b18d3980 1 --2- 172.21.15.194:0/1074444377 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x557448442380 0x557448444770 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.086 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.077+0000 7f00b18d3980 1 -- 172.21.15.194:0/1074444377 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55744844add0 msgr2=0x55744844d1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.086 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.077+0000 7f00b18d3980 1 --2- 172.21.15.194:0/1074444377 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55744844add0 0x55744844d1c0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.086 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.077+0000 7f00b18d3980 1 -- 172.21.15.194:0/1074444377 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x557448446ee0 msgr2=0x5574484492d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.086 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.077+0000 7f00b18d3980 1 --2- 172.21.15.194:0/1074444377 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x557448446ee0 0x5574484492d0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.086 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.077+0000 7f00b18d3980 1 -- 172.21.15.194:0/1074444377 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7eff94034650 msgr2=0x7eff94036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.087 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.077+0000 7f00b18d3980 1 --2- 172.21.15.194:0/1074444377 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7eff94034650 0x7eff94036b10 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f00980ad000 tx=0x7f00980a5040 comp rx=0 tx=0).stop 2024-09-13T06:10:56.087 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.077+0000 7f00b18d3980 1 -- 172.21.15.194:0/1074444377 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55744834ec70 msgr2=0x55744843d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.087 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.077+0000 7f00b18d3980 1 --2- 172.21.15.194:0/1074444377 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55744834ec70 0x55744843d290 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f00a0000f90 tx=0x7f00a0001260 comp rx=0 tx=0).stop 2024-09-13T06:10:56.087 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.077+0000 7f00afbe4640 1 -- 172.21.15.194:0/1074444377 reap_dead start 2024-09-13T06:10:56.087 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.077+0000 7f00b18d3980 1 -- 172.21.15.194:0/1074444377 shutdown_connections 2024-09-13T06:10:56.087 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.077+0000 7f00b18d3980 1 -- 172.21.15.194:0/1074444377 >> 172.21.15.194:0/1074444377 conn(0x5574482be240 msgr2=0x557448430450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:56.087 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.077+0000 7f00b18d3980 1 -- 172.21.15.194:0/1074444377 shutdown_connections 2024-09-13T06:10:56.087 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.077+0000 7f00b18d3980 1 -- 172.21.15.194:0/1074444377 wait complete. 2024-09-13T06:10:56.092 INFO:teuthology.orchestra.run.smithi194.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5}]},{"bucket":"myfoo2","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}],"total":{"bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}}]} 2024-09-13T06:10:56.092 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}]}, {'bucket': 'myfoo2', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}}]} 2024-09-13T06:10:56.092 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-09-13T06:10:56.092 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-09-13T06:10:56.093 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories put_obj 2024-09-13T06:10:56.172 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:10:56.172 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:10:56.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.169+0000 7f8dd3d5a980 1 Processor -- start 2024-09-13T06:10:56.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.169+0000 7f8dd3d5a980 1 -- start start 2024-09-13T06:10:56.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.169+0000 7f8dd3d5a980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x555686a71ad0 0x555686b02780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.169+0000 7f8dd3d5a980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555686985ae0 con 0x555686b02cc0 2024-09-13T06:10:56.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.169+0000 7f8dd3d5a980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x5556869a9e30 con 0x555686a71ad0 2024-09-13T06:10:56.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.169+0000 7f8dd186a640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x555686a71ad0 0x555686b02780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.169+0000 7f8dd1069640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x555686b02cc0 0x555686b050b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:34394/0 (socket says 172.21.15.194:34394) 2024-09-13T06:10:56.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.169+0000 7f8dd186a640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x555686a71ad0 0x555686b02780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:38592/0 (socket says 172.21.15.194:38592) 2024-09-13T06:10:56.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.169+0000 7f8dd1069640 1 -- 172.21.15.194:0/2649437295 learned_addr learned my addr 172.21.15.194:0/2649437295 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-09-13T06:10:56.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.169+0000 7f8dd186a640 1 -- 172.21.15.194:0/2649437295 >> v1:172.21.15.120:6789/0 conn(0x555686b02cc0 legacy=0x555686b050b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.175 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.169+0000 7f8dd186a640 1 -- 172.21.15.194:0/2649437295 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555686a71eb0 con 0x555686a71ad0 2024-09-13T06:10:56.176 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.173+0000 7f8dd186a640 1 --2- 172.21.15.194:0/2649437295 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555686a71ad0 0x555686b02780 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f8dc400a420 tx=0x7f8dc401afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=775d3cc3b70d9f57 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.173+0000 7f8dd0868640 1 -- 172.21.15.194:0/2649437295 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8dc40af070 con 0x555686a71ad0 2024-09-13T06:10:56.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.173+0000 7f8dd0868640 1 -- 172.21.15.194:0/2649437295 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dc40aa530 con 0x555686a71ad0 2024-09-13T06:10:56.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.173+0000 7f8dd0868640 1 -- 172.21.15.194:0/2649437295 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8dc40aa850 con 0x555686a71ad0 2024-09-13T06:10:56.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.173+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/2649437295 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555686a71ad0 msgr2=0x555686b02780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.173+0000 7f8dd3d5a980 1 --2- 172.21.15.194:0/2649437295 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555686a71ad0 0x555686b02780 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f8dc400a420 tx=0x7f8dc401afd0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.173+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/2649437295 shutdown_connections 2024-09-13T06:10:56.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.173+0000 7f8dd3d5a980 1 --2- 172.21.15.194:0/2649437295 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555686a71ad0 0x555686b02780 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.173+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/2649437295 >> 172.21.15.194:0/2649437295 conn(0x555686af8070 msgr2=0x555686afa490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:56.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.173+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/2649437295 shutdown_connections 2024-09-13T06:10:56.179 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.173+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/2649437295 wait complete. 2024-09-13T06:10:56.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.185+0000 7f8dd3d5a980 1 Processor -- start 2024-09-13T06:10:56.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.189+0000 7f8dd3d5a980 1 -- start start 2024-09-13T06:10:56.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.189+0000 7f8dd3d5a980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555686a71ad0 0x555686beac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.189+0000 7f8dd3d5a980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5556869ab200 con 0x555686a71ad0 2024-09-13T06:10:56.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.189+0000 7f8dd186a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555686a71ad0 0x555686beac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.189+0000 7f8dd186a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555686a71ad0 0x555686beac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:38600/0 (socket says 172.21.15.194:38600) 2024-09-13T06:10:56.193 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.189+0000 7f8dd186a640 1 -- 172.21.15.194:0/3462503330 learned_addr learned my addr 172.21.15.194:0/3462503330 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:56.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.189+0000 7f8dd186a640 1 -- 172.21.15.194:0/3462503330 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555686beb250 con 0x555686a71ad0 2024-09-13T06:10:56.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.189+0000 7f8dd186a640 1 --2- 172.21.15.194:0/3462503330 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555686a71ad0 0x555686beac80 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f8dc400a420 tx=0x7f8dc40033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3624dbe8835a959 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.189+0000 7f8cbfe07640 1 -- 172.21.15.194:0/3462503330 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8dc40af040 con 0x555686a71ad0 2024-09-13T06:10:56.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.189+0000 7f8cbfe07640 1 -- 172.21.15.194:0/3462503330 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dc40aab30 con 0x555686a71ad0 2024-09-13T06:10:56.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.189+0000 7f8cbfe07640 1 -- 172.21.15.194:0/3462503330 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8dc40aae10 con 0x555686a71ad0 2024-09-13T06:10:56.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.189+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/3462503330 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555686a71ad0 msgr2=0x555686beac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.189+0000 7f8dd3d5a980 1 --2- 172.21.15.194:0/3462503330 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555686a71ad0 0x555686beac80 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f8dc400a420 tx=0x7f8dc40033b0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.189+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/3462503330 shutdown_connections 2024-09-13T06:10:56.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.189+0000 7f8dd3d5a980 1 --2- 172.21.15.194:0/3462503330 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555686a71ad0 0x555686beac80 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.189+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/3462503330 >> 172.21.15.194:0/3462503330 conn(0x555686af8070 msgr2=0x555686be68b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:56.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.189+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/3462503330 shutdown_connections 2024-09-13T06:10:56.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.189+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/3462503330 wait complete. 2024-09-13T06:10:56.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.189+0000 7f8dd3d5a980 1 Processor -- start 2024-09-13T06:10:56.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.189+0000 7f8dd3d5a980 1 -- start start 2024-09-13T06:10:56.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.189+0000 7f8dd3d5a980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555686a71ad0 0x555686bf1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.189+0000 7f8dd3d5a980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x555686b09260 con 0x555686a71ad0 2024-09-13T06:10:56.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.189+0000 7f8dd186a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555686a71ad0 0x555686bf1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.189+0000 7f8dd186a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555686a71ad0 0x555686bf1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:38610/0 (socket says 172.21.15.194:38610) 2024-09-13T06:10:56.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.189+0000 7f8dd186a640 1 -- 172.21.15.194:0/1423841690 learned_addr learned my addr 172.21.15.194:0/1423841690 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:56.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.193+0000 7f8dd186a640 1 -- 172.21.15.194:0/1423841690 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555686bf2400 con 0x555686a71ad0 2024-09-13T06:10:56.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.193+0000 7f8dd186a640 1 --2- 172.21.15.194:0/1423841690 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555686a71ad0 0x555686bf1ec0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f8dc401b870 tx=0x7f8dc4017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.193+0000 7f8cbe604640 1 -- 172.21.15.194:0/1423841690 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8dc40c5070 con 0x555686a71ad0 2024-09-13T06:10:56.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.193+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/1423841690 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555686bf2690 con 0x555686a71ad0 2024-09-13T06:10:56.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.193+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/1423841690 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555686bf5370 con 0x555686a71ad0 2024-09-13T06:10:56.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.193+0000 7f8cbe604640 1 -- 172.21.15.194:0/1423841690 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dc40b58f0 con 0x555686a71ad0 2024-09-13T06:10:56.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.193+0000 7f8cbe604640 1 -- 172.21.15.194:0/1423841690 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8dc40ce060 con 0x555686a71ad0 2024-09-13T06:10:56.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.193+0000 7f8cbe604640 1 -- 172.21.15.194:0/1423841690 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8dc40b5bd0 con 0x555686a71ad0 2024-09-13T06:10:56.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.193+0000 7f8cbe604640 1 --2- 172.21.15.194:0/1423841690 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8cb80346a0 0x7f8cb8036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.193+0000 7f8cbe604640 1 -- 172.21.15.194:0/1423841690 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f8dc40bb070 con 0x555686a71ad0 2024-09-13T06:10:56.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.193+0000 7f8dd1069640 1 --2- 172.21.15.194:0/1423841690 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8cb80346a0 0x7f8cb8036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.193+0000 7f8dd3d5a980 1 --2- 172.21.15.194:0/1423841690 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x555686b02cc0 0x555686bf8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.193+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/1423841690 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555686bf9500 con 0x555686b02cc0 2024-09-13T06:10:56.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.193+0000 7f8dd206b640 1 --2- 172.21.15.194:0/1423841690 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x555686b02cc0 0x555686bf8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.193+0000 7f8dd1069640 1 --2- 172.21.15.194:0/1423841690 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8cb80346a0 0x7f8cb8036b60 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc000f70 tx=0x7f8dbc0012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.193+0000 7f8dd206b640 1 --2- 172.21.15.194:0/1423841690 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x555686b02cc0 0x555686bf8fc0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.193+0000 7f8dd206b640 1 -- 172.21.15.194:0/1423841690 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8dcc0083f0 con 0x555686b02cc0 2024-09-13T06:10:56.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.193+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/1423841690 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555686bf6570 con 0x555686b02cc0 2024-09-13T06:10:56.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.193+0000 7f8dd206b640 1 -- 172.21.15.194:0/1423841690 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8dcc0083f0 con 0x555686b02cc0 2024-09-13T06:10:56.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.193+0000 7f8dd3d5a980 1 --2- 172.21.15.194:0/1423841690 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x555686bfb7f0 0x555686bfdbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.193+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/1423841690 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555686bfe2d0 con 0x555686bfb7f0 2024-09-13T06:10:56.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.193+0000 7f8dd186a640 1 --2- 172.21.15.194:0/1423841690 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x555686bfb7f0 0x555686bfdbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.193+0000 7f8dd186a640 1 --2- 172.21.15.194:0/1423841690 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x555686bfb7f0 0x555686bfdbe0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.197+0000 7f8dd186a640 1 -- 172.21.15.194:0/1423841690 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8dc40b2040 con 0x555686bfb7f0 2024-09-13T06:10:56.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.197+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/1423841690 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555686bfa690 con 0x555686b02cc0 2024-09-13T06:10:56.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.197+0000 7f8dd206b640 1 -- 172.21.15.194:0/1423841690 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8dcc0083f0 con 0x555686b02cc0 2024-09-13T06:10:56.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.197+0000 7f8dd3d5a980 1 --2- 172.21.15.194:0/1423841690 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x555686bff730 0x555686c01b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.197+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/1423841690 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555686c02260 con 0x555686bff730 2024-09-13T06:10:56.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.197+0000 7f8dd1069640 1 --2- 172.21.15.194:0/1423841690 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x555686bff730 0x555686c01b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.197+0000 7f8dd1069640 1 --2- 172.21.15.194:0/1423841690 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x555686bff730 0x555686c01b20 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.197+0000 7f8dd1069640 1 -- 172.21.15.194:0/1423841690 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8dbc00e620 con 0x555686bff730 2024-09-13T06:10:56.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.197+0000 7f8dd3d5a980 1 Processor -- start 2024-09-13T06:10:56.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.197+0000 7f8dd3d5a980 1 -- start start 2024-09-13T06:10:56.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.197+0000 7f8dd3d5a980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555686c0fd30 0x555686c10150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.197+0000 7f8dd3d5a980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x555686a04800 con 0x555686c0fd30 2024-09-13T06:10:56.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.197+0000 7f8dd186a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555686c0fd30 0x555686c10150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.197+0000 7f8dd186a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555686c0fd30 0x555686c10150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:38626/0 (socket says 172.21.15.194:38626) 2024-09-13T06:10:56.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.197+0000 7f8dd186a640 1 -- 172.21.15.194:0/3421136425 learned_addr learned my addr 172.21.15.194:0/3421136425 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:56.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.197+0000 7f8dd186a640 1 -- 172.21.15.194:0/3421136425 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555686c10690 con 0x555686c0fd30 2024-09-13T06:10:56.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.197+0000 7f8dd186a640 1 --2- 172.21.15.194:0/3421136425 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555686c0fd30 0x555686c10150 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f8dc40e3510 tx=0x7f8dc40d2ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.197+0000 7f8cb77fe640 1 -- 172.21.15.194:0/3421136425 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8dc40bfcc0 con 0x555686c0fd30 2024-09-13T06:10:56.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.197+0000 7f8cb77fe640 1 -- 172.21.15.194:0/3421136425 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dc40c0ac0 con 0x555686c0fd30 2024-09-13T06:10:56.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.197+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/3421136425 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555686c108c0 con 0x555686c0fd30 2024-09-13T06:10:56.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.197+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/3421136425 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555686c108c0 con 0x555686c0fd30 2024-09-13T06:10:56.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.197+0000 7f8cb77fe640 1 -- 172.21.15.194:0/3421136425 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8dc40c0c70 con 0x555686c0fd30 2024-09-13T06:10:56.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.201+0000 7f8cb77fe640 1 -- 172.21.15.194:0/3421136425 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8dc40d2730 con 0x555686c0fd30 2024-09-13T06:10:56.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.201+0000 7f8cb77fe640 1 --2- 172.21.15.194:0/3421136425 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8cac034650 0x7f8cac036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.201+0000 7f8cb77fe640 1 -- 172.21.15.194:0/3421136425 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f8dc40df050 con 0x555686c0fd30 2024-09-13T06:10:56.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.201+0000 7f8dd1069640 1 --2- 172.21.15.194:0/3421136425 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8cac034650 0x7f8cac036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.201+0000 7f8dd3d5a980 1 Processor -- start 2024-09-13T06:10:56.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.201+0000 7f8dd3d5a980 1 -- start start 2024-09-13T06:10:56.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.201+0000 7f8dd1069640 1 --2- 172.21.15.194:0/3421136425 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8cac034650 0x7f8cac036b10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc00bf60 tx=0x7f8dbc00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.201+0000 7f8dd3d5a980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555686c1c2b0 0x555686c1c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.201+0000 7f8dd3d5a980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x555686beb510 con 0x555686c1c2b0 2024-09-13T06:10:56.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.201+0000 7f8dd186a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555686c1c2b0 0x555686c1c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.201+0000 7f8dd186a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555686c1c2b0 0x555686c1c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:38628/0 (socket says 172.21.15.194:38628) 2024-09-13T06:10:56.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.201+0000 7f8dd186a640 1 -- 172.21.15.194:0/1327199145 learned_addr learned my addr 172.21.15.194:0/1327199145 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:56.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.201+0000 7f8dd186a640 1 -- 172.21.15.194:0/1327199145 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555686c1cc80 con 0x555686c1c2b0 2024-09-13T06:10:56.212 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.201+0000 7f8dd186a640 1 --2- 172.21.15.194:0/1327199145 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555686c1c2b0 0x555686c1c6b0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f8dc40e9040 tx=0x7f8dc40e74b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2df0abe9ef8b2210 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.212 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.201+0000 7f8cb57fa640 1 -- 172.21.15.194:0/1327199145 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8dc40d2a20 con 0x555686c1c2b0 2024-09-13T06:10:56.212 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.201+0000 7f8cb57fa640 1 -- 172.21.15.194:0/1327199145 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dc40e3c60 con 0x555686c1c2b0 2024-09-13T06:10:56.212 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.201+0000 7f8cb57fa640 1 -- 172.21.15.194:0/1327199145 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8dc40c1920 con 0x555686c1c2b0 2024-09-13T06:10:56.212 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.201+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/1327199145 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555686c1c2b0 msgr2=0x555686c1c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.212 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.201+0000 7f8dd3d5a980 1 --2- 172.21.15.194:0/1327199145 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555686c1c2b0 0x555686c1c6b0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f8dc40e9040 tx=0x7f8dc40e74b0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.212 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.201+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/1327199145 shutdown_connections 2024-09-13T06:10:56.212 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.201+0000 7f8dd3d5a980 1 --2- 172.21.15.194:0/1327199145 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555686c1c2b0 0x555686c1c6b0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.212 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.201+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/1327199145 >> 172.21.15.194:0/1327199145 conn(0x555686c18720 msgr2=0x555686c16820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:56.212 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.201+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/1327199145 shutdown_connections 2024-09-13T06:10:56.213 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.201+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/1327199145 wait complete. 2024-09-13T06:10:56.213 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.201+0000 7f8dd3d5a980 1 Processor -- start 2024-09-13T06:10:56.213 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.201+0000 7f8dd3d5a980 1 -- start start 2024-09-13T06:10:56.213 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.201+0000 7f8dd3d5a980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555686c1c2b0 0x555686c23580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.213 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.201+0000 7f8dd3d5a980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x555686c1d190 con 0x555686c1c2b0 2024-09-13T06:10:56.213 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.205+0000 7f8dd186a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555686c1c2b0 0x555686c23580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.213 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.205+0000 7f8dd186a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555686c1c2b0 0x555686c23580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:38642/0 (socket says 172.21.15.194:38642) 2024-09-13T06:10:56.213 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.205+0000 7f8dd186a640 1 -- 172.21.15.194:0/2808654471 learned_addr learned my addr 172.21.15.194:0/2808654471 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:56.213 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.205+0000 7f8dd186a640 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555686c23ac0 con 0x555686c1c2b0 2024-09-13T06:10:56.213 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.205+0000 7f8dd186a640 1 --2- 172.21.15.194:0/2808654471 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555686c1c2b0 0x555686c23580 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f8dc40e2360 tx=0x7f8dc40b2f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.213 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.205+0000 7f8ca37fe640 1 -- 172.21.15.194:0/2808654471 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8dc410d070 con 0x555686c1c2b0 2024-09-13T06:10:56.214 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.205+0000 7f8ca37fe640 1 -- 172.21.15.194:0/2808654471 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dc4007970 con 0x555686c1c2b0 2024-09-13T06:10:56.214 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.205+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555686c23ac0 con 0x555686c1c2b0 2024-09-13T06:10:56.214 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.205+0000 7f8ca37fe640 1 -- 172.21.15.194:0/2808654471 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8dc4007c50 con 0x555686c1c2b0 2024-09-13T06:10:56.214 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.205+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555686c23ac0 con 0x555686c1c2b0 2024-09-13T06:10:56.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.205+0000 7f8dd3d5a980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.205+0000 7f8ca37fe640 1 -- 172.21.15.194:0/2808654471 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8dc4118060 con 0x555686c1c2b0 2024-09-13T06:10:56.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.205+0000 7f8ca37fe640 1 --2- 172.21.15.194:0/2808654471 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8c9c034650 0x7f8c9c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.205+0000 7f8ca37fe640 1 -- 172.21.15.194:0/2808654471 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f8dc411bd10 con 0x555686c1c2b0 2024-09-13T06:10:56.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.205+0000 7f8dd1069640 1 --2- 172.21.15.194:0/2808654471 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8c9c034650 0x7f8c9c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.205+0000 7f8dd3d5a980 1 --2- 172.21.15.194:0/2808654471 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x555686c2e620 0x555686c30ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.205+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555686c31230 con 0x555686c2e620 2024-09-13T06:10:56.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.205+0000 7f8dd206b640 1 --2- 172.21.15.194:0/2808654471 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x555686c2e620 0x555686c30ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.205+0000 7f8dd1069640 1 --2- 172.21.15.194:0/2808654471 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8c9c034650 0x7f8c9c036b10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x555686bf9990 tx=0x7f8dbc010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.205+0000 7f8dd206b640 1 --2- 172.21.15.194:0/2808654471 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x555686c2e620 0x555686c30ae0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.205+0000 7f8dd206b640 1 -- 172.21.15.194:0/2808654471 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8dcc0083f0 con 0x555686c2e620 2024-09-13T06:10:56.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.205+0000 7f8dd3d5a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:56.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.205+0000 7f8dd3d5a980 20 realm 2024-09-13T06:10:56.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.205+0000 7f8dd3d5a980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.205+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555686c31640 con 0x555686c2e620 2024-09-13T06:10:56.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.209+0000 7f8dd206b640 1 -- 172.21.15.194:0/2808654471 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8dcc0083f0 con 0x555686c2e620 2024-09-13T06:10:56.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.209+0000 7f8dd3d5a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:56.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.209+0000 7f8dd3d5a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:10:56.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.209+0000 7f8dd3d5a980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.209+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555686c31ee0 con 0x555686c2e620 2024-09-13T06:10:56.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.209+0000 7f8dd206b640 1 -- 172.21.15.194:0/2808654471 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8dcc0083f0 con 0x555686c2e620 2024-09-13T06:10:56.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.209+0000 7f8dd3d5a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:56.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.209+0000 7f8dd3d5a980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.209+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555686c32280 con 0x555686c2e620 2024-09-13T06:10:56.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.209+0000 7f8dd206b640 1 -- 172.21.15.194:0/2808654471 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8dcc0083f0 con 0x555686c2e620 2024-09-13T06:10:56.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.209+0000 7f8dd3d5a980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:10:56.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.209+0000 7f8dd3d5a980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.209+0000 7f8dd3d5a980 1 --2- 172.21.15.194:0/2808654471 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x555686c32fe0 0x555686c353d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.209+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555686c35910 con 0x555686c32fe0 2024-09-13T06:10:56.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.209+0000 7f8dd186a640 1 --2- 172.21.15.194:0/2808654471 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x555686c32fe0 0x555686c353d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.209+0000 7f8dd186a640 1 --2- 172.21.15.194:0/2808654471 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x555686c32fe0 0x555686c353d0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.209+0000 7f8dd186a640 1 -- 172.21.15.194:0/2808654471 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8dc40fc070 con 0x555686c32fe0 2024-09-13T06:10:56.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.209+0000 7f8dd3d5a980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:10:56.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.209+0000 7f8dd3d5a980 20 searching for the correct realm 2024-09-13T06:10:56.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.209+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555686c37190 con 0x555686c32fe0 2024-09-13T06:10:56.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.209+0000 7f8dd186a640 1 -- 172.21.15.194:0/2808654471 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dc40fc070 con 0x555686c32fe0 2024-09-13T06:10:56.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.209+0000 7f8dd186a640 1 --2- 172.21.15.194:0/2808654471 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f8dc4111020 0x7f8dc40f9a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.209+0000 7f8dd186a640 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555686c37190 con 0x7f8dc4111020 2024-09-13T06:10:56.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.209+0000 7f8dd1069640 1 --2- 172.21.15.194:0/2808654471 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f8dc4111020 0x7f8dc40f9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.209+0000 7f8dd1069640 1 --2- 172.21.15.194:0/2808654471 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f8dc4111020 0x7f8dc40f9a20 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.231 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.209+0000 7f8dd1069640 1 -- 172.21.15.194:0/2808654471 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8dbc00e620 con 0x7f8dc4111020 2024-09-13T06:10:56.231 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.209+0000 7f8dd1069640 1 --2- 172.21.15.194:0/2808654471 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f8dbc037040 0x7f8dbc036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.231 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.209+0000 7f8dd1069640 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555686c37190 con 0x7f8dbc037040 2024-09-13T06:10:56.231 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.209+0000 7f8dd206b640 1 --2- 172.21.15.194:0/2808654471 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f8dbc037040 0x7f8dbc036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.231 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.209+0000 7f8dd206b640 1 --2- 172.21.15.194:0/2808654471 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f8dbc037040 0x7f8dbc036410 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.231 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.209+0000 7f8dd206b640 1 -- 172.21.15.194:0/2808654471 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dcc0083f0 con 0x7f8dbc037040 2024-09-13T06:10:56.231 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.209+0000 7f8dd206b640 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555686c32280 con 0x555686c2e620 2024-09-13T06:10:56.231 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.213+0000 7f8dd206b640 1 -- 172.21.15.194:0/2808654471 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dcc0083f0 con 0x555686c2e620 2024-09-13T06:10:56.231 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.213+0000 7f8dd206b640 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555686c32280 con 0x555686c2e620 2024-09-13T06:10:56.231 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.213+0000 7f8dd206b640 1 -- 172.21.15.194:0/2808654471 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dcc0083f0 con 0x555686c2e620 2024-09-13T06:10:56.231 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.213+0000 7f8dd206b640 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555686c32280 con 0x7f8dbc037040 2024-09-13T06:10:56.232 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.213+0000 7f8dd206b640 1 -- 172.21.15.194:0/2808654471 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dcc0083f0 con 0x7f8dbc037040 2024-09-13T06:10:56.232 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.213+0000 7f8dd206b640 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555686c32280 con 0x7f8dbc037040 2024-09-13T06:10:56.232 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.213+0000 7f8dd206b640 1 -- 172.21.15.194:0/2808654471 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dcc0083f0 con 0x7f8dbc037040 2024-09-13T06:10:56.232 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.213+0000 7f8dd206b640 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555686c32280 con 0x7f8dc4111020 2024-09-13T06:10:56.232 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.213+0000 7f8dd1069640 1 -- 172.21.15.194:0/2808654471 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dbc00e620 con 0x7f8dc4111020 2024-09-13T06:10:56.232 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.213+0000 7f8dd1069640 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555686c32280 con 0x555686c32fe0 2024-09-13T06:10:56.232 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.213+0000 7f8dd186a640 1 -- 172.21.15.194:0/2808654471 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dc40fc070 con 0x555686c32fe0 2024-09-13T06:10:56.232 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.213+0000 7f8dd186a640 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555686c32280 con 0x555686c2e620 2024-09-13T06:10:56.232 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.213+0000 7f8dd206b640 1 -- 172.21.15.194:0/2808654471 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dcc0083f0 con 0x555686c2e620 2024-09-13T06:10:56.232 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.213+0000 7f8dd206b640 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555686c32280 con 0x7f8dbc037040 2024-09-13T06:10:56.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.213+0000 7f8dd206b640 1 -- 172.21.15.194:0/2808654471 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dcc0083f0 con 0x7f8dbc037040 2024-09-13T06:10:56.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.213+0000 7f8dd206b640 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555686c32280 con 0x555686c2e620 2024-09-13T06:10:56.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.213+0000 7f8dd206b640 1 -- 172.21.15.194:0/2808654471 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dcc0083f0 con 0x555686c2e620 2024-09-13T06:10:56.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.213+0000 7f8dd206b640 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555686c32280 con 0x7f8dc4111020 2024-09-13T06:10:56.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.213+0000 7f8dd1069640 1 -- 172.21.15.194:0/2808654471 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8dbc00e620 con 0x7f8dc4111020 2024-09-13T06:10:56.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.213+0000 7f8dd1069640 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555686c32280 con 0x555686c32fe0 2024-09-13T06:10:56.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.213+0000 7f8dd186a640 1 -- 172.21.15.194:0/2808654471 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dc40fc070 con 0x555686c32fe0 2024-09-13T06:10:56.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.213+0000 7f8dd186a640 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555686c32280 con 0x555686c32fe0 2024-09-13T06:10:56.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.213+0000 7f8dd186a640 1 -- 172.21.15.194:0/2808654471 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dc40fc070 con 0x555686c32fe0 2024-09-13T06:10:56.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.213+0000 7f8dd186a640 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555686c32280 con 0x7f8dbc037040 2024-09-13T06:10:56.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.217+0000 7f8dd206b640 1 -- 172.21.15.194:0/2808654471 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dcc0083f0 con 0x7f8dbc037040 2024-09-13T06:10:56.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.217+0000 7f8dd206b640 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555686c32280 con 0x555686c32fe0 2024-09-13T06:10:56.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.217+0000 7f8dd186a640 1 -- 172.21.15.194:0/2808654471 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dc40fc070 con 0x555686c32fe0 2024-09-13T06:10:56.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.217+0000 7f8dd186a640 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555686c32280 con 0x555686c32fe0 2024-09-13T06:10:56.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.217+0000 7f8dd186a640 1 -- 172.21.15.194:0/2808654471 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dc40fc070 con 0x555686c32fe0 2024-09-13T06:10:56.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.217+0000 7f8dd186a640 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555686c32280 con 0x555686c2e620 2024-09-13T06:10:56.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.217+0000 7f8dd206b640 1 -- 172.21.15.194:0/2808654471 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dcc0083f0 con 0x555686c2e620 2024-09-13T06:10:56.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.217+0000 7f8dd206b640 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555686c32280 con 0x555686c2e620 2024-09-13T06:10:56.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.217+0000 7f8dd206b640 1 -- 172.21.15.194:0/2808654471 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8dcc0083f0 con 0x555686c2e620 2024-09-13T06:10:56.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.217+0000 7f8dd206b640 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555686c32280 con 0x7f8dc4111020 2024-09-13T06:10:56.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.217+0000 7f8dd1069640 1 -- 172.21.15.194:0/2808654471 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dbc00e620 con 0x7f8dc4111020 2024-09-13T06:10:56.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.217+0000 7f8dd1069640 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555686c32280 con 0x555686c32fe0 2024-09-13T06:10:56.235 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.217+0000 7f8dd186a640 1 -- 172.21.15.194:0/2808654471 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dc40fc070 con 0x555686c32fe0 2024-09-13T06:10:56.235 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.217+0000 7f8dd186a640 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555686c32280 con 0x7f8dc4111020 2024-09-13T06:10:56.235 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.217+0000 7f8dd1069640 1 -- 172.21.15.194:0/2808654471 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dbc00e620 con 0x7f8dc4111020 2024-09-13T06:10:56.235 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.217+0000 7f8dd1069640 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555686c32280 con 0x555686c2e620 2024-09-13T06:10:56.235 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.217+0000 7f8dd206b640 1 -- 172.21.15.194:0/2808654471 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dcc0083f0 con 0x555686c2e620 2024-09-13T06:10:56.235 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.217+0000 7f8dd206b640 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555686c32280 con 0x7f8dbc037040 2024-09-13T06:10:56.235 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.217+0000 7f8dd206b640 1 -- 172.21.15.194:0/2808654471 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dcc0083f0 con 0x7f8dbc037040 2024-09-13T06:10:56.235 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.217+0000 7f8dd206b640 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555686c32280 con 0x555686c32fe0 2024-09-13T06:10:56.235 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.217+0000 7f8dd186a640 1 -- 172.21.15.194:0/2808654471 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8dc40fc070 con 0x555686c32fe0 2024-09-13T06:10:56.235 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.217+0000 7f8dd186a640 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555686c32280 con 0x7f8dc4111020 2024-09-13T06:10:56.235 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.217+0000 7f8dd1069640 1 -- 172.21.15.194:0/2808654471 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dbc00e620 con 0x7f8dc4111020 2024-09-13T06:10:56.236 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.217+0000 7f8dd1069640 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555686c32280 con 0x7f8dc4111020 2024-09-13T06:10:56.236 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.217+0000 7f8dd1069640 1 -- 172.21.15.194:0/2808654471 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dbc00e620 con 0x7f8dc4111020 2024-09-13T06:10:56.236 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.217+0000 7f8dd1069640 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555686c32280 con 0x555686c32fe0 2024-09-13T06:10:56.236 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.221+0000 7f8dd186a640 1 -- 172.21.15.194:0/2808654471 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dc40fc070 con 0x555686c32fe0 2024-09-13T06:10:56.236 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.221+0000 7f8dd186a640 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555686c32280 con 0x7f8dbc037040 2024-09-13T06:10:56.236 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.221+0000 7f8dd206b640 1 -- 172.21.15.194:0/2808654471 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dcc0083f0 con 0x7f8dbc037040 2024-09-13T06:10:56.236 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.221+0000 7f8dd206b640 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555686c32280 con 0x555686c2e620 2024-09-13T06:10:56.236 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.221+0000 7f8dd206b640 1 -- 172.21.15.194:0/2808654471 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8dcc0083f0 con 0x555686c2e620 2024-09-13T06:10:56.236 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.221+0000 7f8dd206b640 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555686c32280 con 0x7f8dc4111020 2024-09-13T06:10:56.236 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.221+0000 7f8dd1069640 1 -- 172.21.15.194:0/2808654471 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dbc00e620 con 0x7f8dc4111020 2024-09-13T06:10:56.236 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.221+0000 7f8dd3d5a980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:10:56.237 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.221+0000 7f8dd3d5a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:10:56.237 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.221+0000 7f8dd3d5a980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:10:56.237 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.221+0000 7f8dd3d5a980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:10:56.237 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.221+0000 7f8dd3d5a980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:10:56.237 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.221+0000 7f8dd3d5a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:10:56.237 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.221+0000 7f8dd3d5a980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.237 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.221+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555686c36160 con 0x555686c2e620 2024-09-13T06:10:56.237 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.221+0000 7f8dd206b640 1 -- 172.21.15.194:0/2808654471 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8dcc0083f0 con 0x555686c2e620 2024-09-13T06:10:56.237 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.221+0000 7f8dd3d5a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:56.237 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.221+0000 7f8dd3d5a980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.237 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.221+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555686c36550 con 0x555686c2e620 2024-09-13T06:10:56.237 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.221+0000 7f8dd206b640 1 -- 172.21.15.194:0/2808654471 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8dcc0083f0 con 0x555686c2e620 2024-09-13T06:10:56.238 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.221+0000 7f8dd3d5a980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:10:56.238 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.221+0000 7f8dd3d5a980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.238 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.221+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555686c36550 con 0x7f8dc4111020 2024-09-13T06:10:56.238 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.221+0000 7f8dd1069640 1 -- 172.21.15.194:0/2808654471 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8dbc00e620 con 0x7f8dc4111020 2024-09-13T06:10:56.238 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.221+0000 7f8dd3d5a980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:10:56.238 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.221+0000 7f8dd3d5a980 20 zone default found 2024-09-13T06:10:56.238 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.221+0000 7f8dd3d5a980 4 Realm: () 2024-09-13T06:10:56.238 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.221+0000 7f8dd3d5a980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:10:56.238 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.221+0000 7f8dd3d5a980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:10:56.238 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.221+0000 7f8dd3d5a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:10:56.238 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.221+0000 7f8dd3d5a980 20 zonegroup default 2024-09-13T06:10:56.238 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.221+0000 7f8dd3d5a980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.239 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.221+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555686c37660 con 0x7f8dbc037040 2024-09-13T06:10:56.239 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.221+0000 7f8dd206b640 1 -- 172.21.15.194:0/2808654471 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8dcc0083f0 con 0x7f8dbc037040 2024-09-13T06:10:56.239 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.221+0000 7f8dd3d5a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:56.239 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.221+0000 7f8dd3d5a980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.239 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.221+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555686c39040 con 0x555686c32fe0 2024-09-13T06:10:56.239 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.221+0000 7f8dd186a640 1 -- 172.21.15.194:0/2808654471 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8dc40fc070 con 0x555686c32fe0 2024-09-13T06:10:56.239 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.221+0000 7f8dd3d5a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:56.239 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.221+0000 7f8dd3d5a980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.239 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.221+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555686c393e0 con 0x555686c32fe0 2024-09-13T06:10:56.239 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.221+0000 7f8dd186a640 1 -- 172.21.15.194:0/2808654471 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8dc40fc070 con 0x555686c32fe0 2024-09-13T06:10:56.239 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.221+0000 7f8dd3d5a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:56.239 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.221+0000 7f8dd3d5a980 20 started sync module instance, tier type = 2024-09-13T06:10:56.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.221+0000 7f8dd3d5a980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:10:56.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.221+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555686c384e0 con 0x7f8dc4111020 2024-09-13T06:10:56.243 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.225+0000 7f8dd1069640 1 -- 172.21.15.194:0/2808654471 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(44 notify.0 [create] v35'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8dbc00e620 con 0x7f8dc4111020 2024-09-13T06:10:56.243 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.225+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93830116509904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555686c38140 con 0x7f8dc4111020 2024-09-13T06:10:56.243 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.225+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555686c3a250 con 0x555686c2e620 2024-09-13T06:10:56.243 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.225+0000 7f8dd1069640 1 -- 172.21.15.194:0/2808654471 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 93830116509904] v35'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8dbc00e620 con 0x7f8dc4111020 2024-09-13T06:10:56.243 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.225+0000 7f8dd206b640 1 -- 172.21.15.194:0/2808654471 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v35'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8dcc0083f0 con 0x555686c2e620 2024-09-13T06:10:56.244 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.225+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93830116515232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555686c3a1c0 con 0x555686c2e620 2024-09-13T06:10:56.244 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.225+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555686c3b020 con 0x555686c32fe0 2024-09-13T06:10:56.244 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.229+0000 7f8dd206b640 1 -- 172.21.15.194:0/2808654471 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93830116515232] v35'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8dcc0083f0 con 0x555686c2e620 2024-09-13T06:10:56.244 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.229+0000 7f8dd186a640 1 -- 172.21.15.194:0/2808654471 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v35'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8dc40fc070 con 0x555686c32fe0 2024-09-13T06:10:56.244 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.229+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93830116517440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555686c3b410 con 0x555686c32fe0 2024-09-13T06:10:56.244 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.229+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555686c3bdd0 con 0x7f8dc4111020 2024-09-13T06:10:56.244 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.229+0000 7f8dd1069640 1 -- 172.21.15.194:0/2808654471 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(50 notify.3 [create] v35'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8dbc00e620 con 0x7f8dc4111020 2024-09-13T06:10:56.244 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.229+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93830116522272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555686c3c620 con 0x7f8dc4111020 2024-09-13T06:10:56.244 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.229+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555686c3d020 con 0x555686c2e620 2024-09-13T06:10:56.244 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.229+0000 7f8dd186a640 1 -- 172.21.15.194:0/2808654471 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93830116517440] v35'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8dc40fc070 con 0x555686c32fe0 2024-09-13T06:10:56.244 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.229+0000 7f8dd1069640 1 -- 172.21.15.194:0/2808654471 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 93830116522272] v35'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8dbc00e620 con 0x7f8dc4111020 2024-09-13T06:10:56.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.229+0000 7f8dd206b640 1 -- 172.21.15.194:0/2808654471 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v35'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8dcc0083f0 con 0x555686c2e620 2024-09-13T06:10:56.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.233+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93830116518496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555686c3c170 con 0x555686c2e620 2024-09-13T06:10:56.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.233+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555686c3d8c0 con 0x7f8dbc037040 2024-09-13T06:10:56.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.233+0000 7f8dd206b640 1 -- 172.21.15.194:0/2808654471 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(54 notify.5 [create] v35'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8dcc0083f0 con 0x7f8dbc037040 2024-09-13T06:10:56.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.233+0000 7f8dd206b640 1 -- 172.21.15.194:0/2808654471 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93830116518496] v35'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8dcc0083f0 con 0x555686c2e620 2024-09-13T06:10:56.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.233+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93830116528736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555686c3c170 con 0x7f8dbc037040 2024-09-13T06:10:56.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.233+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555686c3dd50 con 0x7f8dbc037040 2024-09-13T06:10:56.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.233+0000 7f8dd206b640 1 -- 172.21.15.194:0/2808654471 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 93830116528736] v35'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8dcc0083f0 con 0x7f8dbc037040 2024-09-13T06:10:56.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.237+0000 7f8dd206b640 1 -- 172.21.15.194:0/2808654471 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(56 notify.6 [create] v35'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8dcc0083f0 con 0x7f8dbc037040 2024-09-13T06:10:56.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.237+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93830116526896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555686c3dd50 con 0x7f8dbc037040 2024-09-13T06:10:56.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.237+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555686c3e750 con 0x7f8dbc037040 2024-09-13T06:10:56.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.237+0000 7f8dd206b640 1 -- 172.21.15.194:0/2808654471 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(58 notify.7 [create] v35'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8dcc0083f0 con 0x7f8dbc037040 2024-09-13T06:10:56.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.237+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93830116532832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555686c3eb70 con 0x7f8dbc037040 2024-09-13T06:10:56.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.237+0000 7f8dd3d5a980 20 add_watcher() i=0 2024-09-13T06:10:56.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.237+0000 7f8dd3d5a980 20 add_watcher() i=1 2024-09-13T06:10:56.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.237+0000 7f8dd3d5a980 20 add_watcher() i=2 2024-09-13T06:10:56.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.237+0000 7f8dd3d5a980 20 add_watcher() i=3 2024-09-13T06:10:56.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.237+0000 7f8dd3d5a980 20 add_watcher() i=4 2024-09-13T06:10:56.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.237+0000 7f8dd3d5a980 20 add_watcher() i=5 2024-09-13T06:10:56.247 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.237+0000 7f8dd206b640 1 -- 172.21.15.194:0/2808654471 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93830116526896] v35'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8dcc0083f0 con 0x7f8dbc037040 2024-09-13T06:10:56.247 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.237+0000 7f8dd3d5a980 20 add_watcher() i=6 2024-09-13T06:10:56.249 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.241+0000 7f8dd206b640 1 -- 172.21.15.194:0/2808654471 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 93830116532832] v35'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8dcc0083f0 con 0x7f8dbc037040 2024-09-13T06:10:56.249 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.241+0000 7f8dd3d5a980 20 add_watcher() i=7 2024-09-13T06:10:56.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.241+0000 7f8dd3d5a980 2 all 8 watchers are set, enabling cache 2024-09-13T06:10:56.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.241+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555686c3d8a0 con 0x555686c2e620 2024-09-13T06:10:56.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.241+0000 7f8dd206b640 1 -- 172.21.15.194:0/2808654471 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8dcc0083f0 con 0x555686c2e620 2024-09-13T06:10:56.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.241+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93830116530336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555686c3f0b0 con 0x555686c2e620 2024-09-13T06:10:56.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.241+0000 7f8dd206b640 1 -- 172.21.15.194:0/2808654471 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93830116530336] v35'204 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8dcc0083f0 con 0x555686c2e620 2024-09-13T06:10:56.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.241+0000 7f8c837fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:10:56.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.241+0000 7f8dd3d5a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:10:56.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.241+0000 7f8dd3d5a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:10:56.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.241+0000 7f8dd3d5a980 5 note: GC not initialized 2024-09-13T06:10:56.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.241+0000 7f8c827fc640 20 reqs_thread_entry: start 2024-09-13T06:10:56.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.241+0000 7f8dd3d5a980 20 init_complete bucket index max shards: 11 2024-09-13T06:10:56.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.241+0000 7f8dd3d5a980 20 Filter name: none 2024-09-13T06:10:56.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.241+0000 7f8bf3fff640 20 reqs_thread_entry: start 2024-09-13T06:10:56.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.241+0000 7f8dd3d5a980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.241+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555686c64d50 con 0x555686c2e620 2024-09-13T06:10:56.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.241+0000 7f8dd206b640 1 -- 172.21.15.194:0/2808654471 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv23 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f8dcc0083f0 con 0x555686c2e620 2024-09-13T06:10:56.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.241+0000 7f8dd3d5a980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T06:10:56.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.241+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555686c662a0 con 0x7f8dbc037040 2024-09-13T06:10:56.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.245+0000 7f8dd206b640 1 -- 172.21.15.194:0/2808654471 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv30 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f8dcc0083f0 con 0x7f8dbc037040 2024-09-13T06:10:56.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.245+0000 7f8c837fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:10:56.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.245+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93830116530336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555686c440c0 con 0x555686c2e620 2024-09-13T06:10:56.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.245+0000 7f8dd206b640 1 -- 172.21.15.194:0/2808654471 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 93830116530336] v35'205 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8dcc0083f0 con 0x555686c2e620 2024-09-13T06:10:56.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.245+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93830116509904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555686c3d8a0 con 0x7f8dc4111020 2024-09-13T06:10:56.252 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.245+0000 7f8dd1069640 1 -- 172.21.15.194:0/2808654471 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 93830116509904] v35'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8dbc00e620 con 0x7f8dc4111020 2024-09-13T06:10:56.252 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.245+0000 7f8dd3d5a980 20 remove_watcher() i=0 2024-09-13T06:10:56.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.245+0000 7f8dd3d5a980 2 removed watcher, disabling cache 2024-09-13T06:10:56.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.245+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93830116515232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555686c388d0 con 0x555686c2e620 2024-09-13T06:10:56.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.249+0000 7f8dd206b640 1 -- 172.21.15.194:0/2808654471 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 93830116515232] v35'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8dcc0083f0 con 0x555686c2e620 2024-09-13T06:10:56.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.249+0000 7f8dd3d5a980 20 remove_watcher() i=1 2024-09-13T06:10:56.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.249+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93830116517440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555686c388d0 con 0x555686c32fe0 2024-09-13T06:10:56.254 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.249+0000 7f8dd186a640 1 -- 172.21.15.194:0/2808654471 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 93830116517440] v35'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8dc40fc070 con 0x555686c32fe0 2024-09-13T06:10:56.254 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.249+0000 7f8dd3d5a980 20 remove_watcher() i=2 2024-09-13T06:10:56.254 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.249+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93830116522272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555686c3a640 con 0x7f8dc4111020 2024-09-13T06:10:56.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.253+0000 7f8dd1069640 1 -- 172.21.15.194:0/2808654471 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 93830116522272] v35'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8dbc00e620 con 0x7f8dc4111020 2024-09-13T06:10:56.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.253+0000 7f8dd3d5a980 20 remove_watcher() i=3 2024-09-13T06:10:56.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.253+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93830116518496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555686c388d0 con 0x555686c2e620 2024-09-13T06:10:56.257 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.253+0000 7f8dd206b640 1 -- 172.21.15.194:0/2808654471 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 93830116518496] v35'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8dcc0083f0 con 0x555686c2e620 2024-09-13T06:10:56.257 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.253+0000 7f8dd3d5a980 20 remove_watcher() i=4 2024-09-13T06:10:56.257 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.253+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93830116528736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555686c3b920 con 0x7f8dbc037040 2024-09-13T06:10:56.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.253+0000 7f8dd206b640 1 -- 172.21.15.194:0/2808654471 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 93830116528736] v35'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8dcc0083f0 con 0x7f8dbc037040 2024-09-13T06:10:56.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.253+0000 7f8dd3d5a980 20 remove_watcher() i=5 2024-09-13T06:10:56.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.253+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93830116526896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555686c3b920 con 0x7f8dbc037040 2024-09-13T06:10:56.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.257+0000 7f8dd206b640 1 -- 172.21.15.194:0/2808654471 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 93830116526896] v35'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8dcc0083f0 con 0x7f8dbc037040 2024-09-13T06:10:56.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.257+0000 7f8dd3d5a980 20 remove_watcher() i=6 2024-09-13T06:10:56.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.257+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/2808654471 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93830116532832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555686c3b920 con 0x7f8dbc037040 2024-09-13T06:10:56.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.261+0000 7f8dd206b640 1 -- 172.21.15.194:0/2808654471 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 93830116532832] v35'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8dcc0083f0 con 0x7f8dbc037040 2024-09-13T06:10:56.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.261+0000 7f8dd3d5a980 20 remove_watcher() i=7 2024-09-13T06:10:56.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.261+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/2808654471 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f8dbc037040 msgr2=0x7f8dbc036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.261+0000 7f8dd3d5a980 1 --2- 172.21.15.194:0/2808654471 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f8dbc037040 0x7f8dbc036410 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.261+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/2808654471 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x555686c2e620 msgr2=0x555686c30ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.261+0000 7f8dd3d5a980 1 --2- 172.21.15.194:0/2808654471 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x555686c2e620 0x555686c30ae0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.261+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/2808654471 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f8dc4111020 msgr2=0x7f8dc40f9a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.261+0000 7f8dd3d5a980 1 --2- 172.21.15.194:0/2808654471 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f8dc4111020 0x7f8dc40f9a20 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.261+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/2808654471 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x555686c32fe0 msgr2=0x555686c353d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.261+0000 7f8dd3d5a980 1 --2- 172.21.15.194:0/2808654471 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x555686c32fe0 0x555686c353d0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.261+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/2808654471 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8c9c034650 msgr2=0x7f8c9c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.261+0000 7f8dd3d5a980 1 --2- 172.21.15.194:0/2808654471 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8c9c034650 0x7f8c9c036b10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x555686bf9990 tx=0x7f8dbc010000 comp rx=0 tx=0).stop 2024-09-13T06:10:56.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.261+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/2808654471 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555686c1c2b0 msgr2=0x555686c23580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.261+0000 7f8dd3d5a980 1 --2- 172.21.15.194:0/2808654471 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555686c1c2b0 0x555686c23580 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f8dc40e2360 tx=0x7f8dc40b2f90 comp rx=0 tx=0).stop 2024-09-13T06:10:56.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.261+0000 7f8dd206b640 1 -- 172.21.15.194:0/2808654471 reap_dead start 2024-09-13T06:10:56.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.261+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/2808654471 shutdown_connections 2024-09-13T06:10:56.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.261+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/2808654471 >> 172.21.15.194:0/2808654471 conn(0x555686c18720 msgr2=0x555686c167f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:56.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.261+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/2808654471 shutdown_connections 2024-09-13T06:10:56.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.261+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/2808654471 wait complete. 2024-09-13T06:10:56.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.261+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/3421136425 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8cac034650 msgr2=0x7f8cac036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.261+0000 7f8dd3d5a980 1 --2- 172.21.15.194:0/3421136425 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8cac034650 0x7f8cac036b10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc00bf60 tx=0x7f8dbc00f000 comp rx=0 tx=0).stop 2024-09-13T06:10:56.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.261+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/3421136425 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555686c0fd30 msgr2=0x555686c10150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.261+0000 7f8dd3d5a980 1 --2- 172.21.15.194:0/3421136425 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555686c0fd30 0x555686c10150 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f8dc40e3510 tx=0x7f8dc40d2ef0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.261+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/3421136425 shutdown_connections 2024-09-13T06:10:56.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.261+0000 7f8dd3d5a980 1 --2- 172.21.15.194:0/3421136425 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8cac034650 0x7f8cac036b10 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.261+0000 7f8dd3d5a980 1 --2- 172.21.15.194:0/3421136425 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555686c0fd30 0x555686c10150 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.261+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/3421136425 >> 172.21.15.194:0/3421136425 conn(0x555686c04e80 msgr2=0x555686c07900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:56.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.261+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/3421136425 shutdown_connections 2024-09-13T06:10:56.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.261+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/3421136425 wait complete. 2024-09-13T06:10:56.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.261+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/1423841690 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x555686b02cc0 msgr2=0x555686bf8fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.261+0000 7f8dd3d5a980 1 --2- 172.21.15.194:0/1423841690 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x555686b02cc0 0x555686bf8fc0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.261+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/1423841690 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x555686bff730 msgr2=0x555686c01b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.261+0000 7f8dd3d5a980 1 --2- 172.21.15.194:0/1423841690 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x555686bff730 0x555686c01b20 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.261+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/1423841690 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x555686bfb7f0 msgr2=0x555686bfdbe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.261+0000 7f8dd3d5a980 1 --2- 172.21.15.194:0/1423841690 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x555686bfb7f0 0x555686bfdbe0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.261+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/1423841690 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8cb80346a0 msgr2=0x7f8cb8036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.261+0000 7f8dd3d5a980 1 --2- 172.21.15.194:0/1423841690 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8cb80346a0 0x7f8cb8036b60 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc000f70 tx=0x7f8dbc0012c0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.261+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/1423841690 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555686a71ad0 msgr2=0x555686bf1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.261+0000 7f8dd3d5a980 1 --2- 172.21.15.194:0/1423841690 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555686a71ad0 0x555686bf1ec0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f8dc401b870 tx=0x7f8dc4017d70 comp rx=0 tx=0).stop 2024-09-13T06:10:56.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.261+0000 7f8dd206b640 1 -- 172.21.15.194:0/1423841690 reap_dead start 2024-09-13T06:10:56.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.261+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/1423841690 shutdown_connections 2024-09-13T06:10:56.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.261+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/1423841690 >> 172.21.15.194:0/1423841690 conn(0x555686af8070 msgr2=0x555686be5430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:56.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.261+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/1423841690 shutdown_connections 2024-09-13T06:10:56.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.261+0000 7f8dd3d5a980 1 -- 172.21.15.194:0/1423841690 wait complete. 2024-09-13T06:10:56.274 INFO:teuthology.orchestra.run.smithi194.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[]}]}],"summary":[{"user":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}}]} 2024-09-13T06:10:56.274 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}}]} 2024-09-13T06:10:56.275 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-09-13T06:10:56.275 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-09-13T06:10:56.275 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_obj 2024-09-13T06:10:56.345 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:10:56.345 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:10:56.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.341+0000 7fae4d472980 1 Processor -- start 2024-09-13T06:10:56.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.341+0000 7fae4d472980 1 -- start start 2024-09-13T06:10:56.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.341+0000 7fae4d472980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55d5922c2a20 0x55d5922c4e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.341+0000 7fae4d472980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d592146ae0 con 0x55d5922be6a0 2024-09-13T06:10:56.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.341+0000 7fae4d472980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x55d59216ae30 con 0x55d5922c2a20 2024-09-13T06:10:56.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.341+0000 7fae4a781640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55d5922c2a20 0x55d5922c4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.341+0000 7fae4af82640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x55d5922be6a0 0x55d5922bea80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:34402/0 (socket says 172.21.15.194:34402) 2024-09-13T06:10:56.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.341+0000 7fae4af82640 1 -- 172.21.15.194:0/4202244074 learned_addr learned my addr 172.21.15.194:0/4202244074 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-09-13T06:10:56.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.341+0000 7fae4a781640 1 -- 172.21.15.194:0/4202244074 >> v1:172.21.15.120:6789/0 conn(0x55d5922be6a0 legacy=0x55d5922bea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.341+0000 7fae4a781640 1 -- 172.21.15.194:0/4202244074 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5922c6360 con 0x55d5922c2a20 2024-09-13T06:10:56.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.345+0000 7fae4a781640 1 --2- 172.21.15.194:0/4202244074 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d5922c2a20 0x55d5922c4e10 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fae4000a480 tx=0x7fae4001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=def287c10d96b79d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.345+0000 7fae49f80640 1 -- 172.21.15.194:0/4202244074 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae400b0070 con 0x55d5922c2a20 2024-09-13T06:10:56.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.345+0000 7fae49f80640 1 -- 172.21.15.194:0/4202244074 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae400ab540 con 0x55d5922c2a20 2024-09-13T06:10:56.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.345+0000 7fae49f80640 1 -- 172.21.15.194:0/4202244074 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae400ab840 con 0x55d5922c2a20 2024-09-13T06:10:56.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.345+0000 7fae4d472980 1 -- 172.21.15.194:0/4202244074 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d5922c2a20 msgr2=0x55d5922c4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.345+0000 7fae4d472980 1 --2- 172.21.15.194:0/4202244074 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d5922c2a20 0x55d5922c4e10 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fae4000a480 tx=0x7fae4001b280 comp rx=0 tx=0).stop 2024-09-13T06:10:56.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.345+0000 7fae4d472980 1 -- 172.21.15.194:0/4202244074 shutdown_connections 2024-09-13T06:10:56.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.345+0000 7fae4d472980 1 --2- 172.21.15.194:0/4202244074 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d5922c2a20 0x55d5922c4e10 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.345+0000 7fae4d472980 1 -- 172.21.15.194:0/4202244074 >> 172.21.15.194:0/4202244074 conn(0x55d5922ba1c0 msgr2=0x55d5922bc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:56.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.345+0000 7fae4d472980 1 -- 172.21.15.194:0/4202244074 shutdown_connections 2024-09-13T06:10:56.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.345+0000 7fae4d472980 1 -- 172.21.15.194:0/4202244074 wait complete. 2024-09-13T06:10:56.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.357+0000 7fae4d472980 1 Processor -- start 2024-09-13T06:10:56.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.357+0000 7fae4d472980 1 -- start start 2024-09-13T06:10:56.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.357+0000 7fae4d472980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d5922be6a0 0x55d5923a9a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.357+0000 7fae4d472980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55d59216c200 con 0x55d5922be6a0 2024-09-13T06:10:56.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.361+0000 7fae4af82640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d5922be6a0 0x55d5923a9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.361+0000 7fae4af82640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d5922be6a0 0x55d5923a9a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:38660/0 (socket says 172.21.15.194:38660) 2024-09-13T06:10:56.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.361+0000 7fae4af82640 1 -- 172.21.15.194:0/3027254414 learned_addr learned my addr 172.21.15.194:0/3027254414 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:56.365 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.361+0000 7fae4af82640 1 -- 172.21.15.194:0/3027254414 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5923aa050 con 0x55d5922be6a0 2024-09-13T06:10:56.365 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.361+0000 7fae4af82640 1 --2- 172.21.15.194:0/3027254414 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d5922be6a0 0x55d5923a9a80 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fae44001d90 tx=0x7fae44001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2567bacb64928958 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.365 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.361+0000 7fad38e09640 1 -- 172.21.15.194:0/3027254414 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae44013030 con 0x55d5922be6a0 2024-09-13T06:10:56.365 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.361+0000 7fad38e09640 1 -- 172.21.15.194:0/3027254414 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae4400e690 con 0x55d5922be6a0 2024-09-13T06:10:56.365 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.361+0000 7fad38e09640 1 -- 172.21.15.194:0/3027254414 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae4400ea10 con 0x55d5922be6a0 2024-09-13T06:10:56.366 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.361+0000 7fae4d472980 1 -- 172.21.15.194:0/3027254414 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d5922be6a0 msgr2=0x55d5923a9a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.361+0000 7fae4d472980 1 --2- 172.21.15.194:0/3027254414 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d5922be6a0 0x55d5923a9a80 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fae44001d90 tx=0x7fae44001e80 comp rx=0 tx=0).stop 2024-09-13T06:10:56.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.361+0000 7fae4d472980 1 -- 172.21.15.194:0/3027254414 shutdown_connections 2024-09-13T06:10:56.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.361+0000 7fae4d472980 1 --2- 172.21.15.194:0/3027254414 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d5922be6a0 0x55d5923a9a80 secure :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fae44001d90 tx=0x7fae44001e80 comp rx=0 tx=0).stop 2024-09-13T06:10:56.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.361+0000 7fae4d472980 1 -- 172.21.15.194:0/3027254414 >> 172.21.15.194:0/3027254414 conn(0x55d5922ba1c0 msgr2=0x55d5923a56b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:56.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.361+0000 7fae4d472980 1 -- 172.21.15.194:0/3027254414 shutdown_connections 2024-09-13T06:10:56.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.361+0000 7fae4d472980 1 -- 172.21.15.194:0/3027254414 wait complete. 2024-09-13T06:10:56.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.361+0000 7fae4d472980 1 Processor -- start 2024-09-13T06:10:56.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.361+0000 7fae4d472980 1 -- start start 2024-09-13T06:10:56.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.361+0000 7fae4d472980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d5922c2a20 0x55d592235500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.361+0000 7fae4d472980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55d5922c5e60 con 0x55d5922c2a20 2024-09-13T06:10:56.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.361+0000 7fae4af82640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d5922c2a20 0x55d592235500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.361+0000 7fae4af82640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d5922c2a20 0x55d592235500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:38668/0 (socket says 172.21.15.194:38668) 2024-09-13T06:10:56.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.361+0000 7fae4af82640 1 -- 172.21.15.194:0/3366329343 learned_addr learned my addr 172.21.15.194:0/3366329343 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:56.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.361+0000 7fae4af82640 1 -- 172.21.15.194:0/3366329343 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d592235a40 con 0x55d5922c2a20 2024-09-13T06:10:56.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.361+0000 7fae4af82640 1 --2- 172.21.15.194:0/3366329343 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d5922c2a20 0x55d592235500 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fae44004000 tx=0x7fae44000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.365+0000 7fad37606640 1 -- 172.21.15.194:0/3366329343 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae44027070 con 0x55d5922c2a20 2024-09-13T06:10:56.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.365+0000 7fae4d472980 1 -- 172.21.15.194:0/3366329343 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d592233c20 con 0x55d5922c2a20 2024-09-13T06:10:56.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.365+0000 7fae4d472980 1 -- 172.21.15.194:0/3366329343 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d592234110 con 0x55d5922c2a20 2024-09-13T06:10:56.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.365+0000 7fad37606640 1 -- 172.21.15.194:0/3366329343 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae440198b0 con 0x55d5922c2a20 2024-09-13T06:10:56.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.365+0000 7fad37606640 1 -- 172.21.15.194:0/3366329343 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae44019bd0 con 0x55d5922c2a20 2024-09-13T06:10:56.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.365+0000 7fad37606640 1 -- 172.21.15.194:0/3366329343 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fae4402a070 con 0x55d5922c2a20 2024-09-13T06:10:56.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.365+0000 7fad37606640 1 --2- 172.21.15.194:0/3366329343 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fad30034650 0x7fad30036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.365+0000 7fad37606640 1 -- 172.21.15.194:0/3366329343 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fae4401f070 con 0x55d5922c2a20 2024-09-13T06:10:56.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.365+0000 7fae4a781640 1 --2- 172.21.15.194:0/3366329343 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fad30034650 0x7fad30036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.365+0000 7fae4d472980 1 --2- 172.21.15.194:0/3366329343 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55d5923b8470 0x55d5923ba860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.365+0000 7fae4d472980 1 -- 172.21.15.194:0/3366329343 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d5923bada0 con 0x55d5923b8470 2024-09-13T06:10:56.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.365+0000 7fae4b783640 1 --2- 172.21.15.194:0/3366329343 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55d5923b8470 0x55d5923ba860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.365+0000 7fae4a781640 1 --2- 172.21.15.194:0/3366329343 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fad30034650 0x7fad30036b10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fae400ad000 tx=0x7fae400a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.365+0000 7fae4b783640 1 --2- 172.21.15.194:0/3366329343 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55d5923b8470 0x55d5923ba860 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.365+0000 7fae4b783640 1 -- 172.21.15.194:0/3366329343 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fae3c00a4d0 con 0x55d5923b8470 2024-09-13T06:10:56.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.365+0000 7fae4d472980 1 -- 172.21.15.194:0/3366329343 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d5923bb140 con 0x55d5923b8470 2024-09-13T06:10:56.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.365+0000 7fae4b783640 1 -- 172.21.15.194:0/3366329343 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fae3c00a4d0 con 0x55d5923b8470 2024-09-13T06:10:56.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.365+0000 7fae4d472980 1 --2- 172.21.15.194:0/3366329343 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55d5923bcf30 0x55d5923bf320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.365+0000 7fae4d472980 1 -- 172.21.15.194:0/3366329343 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d5923bfa10 con 0x55d5923bcf30 2024-09-13T06:10:56.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.365+0000 7fae4af82640 1 --2- 172.21.15.194:0/3366329343 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55d5923bcf30 0x55d5923bf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.365+0000 7fae4af82640 1 --2- 172.21.15.194:0/3366329343 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55d5923bcf30 0x55d5923bf320 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.365+0000 7fae4af82640 1 -- 172.21.15.194:0/3366329343 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fae44029030 con 0x55d5923bcf30 2024-09-13T06:10:56.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.365+0000 7fae4d472980 1 -- 172.21.15.194:0/3366329343 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d5923bbdd0 con 0x55d5923b8470 2024-09-13T06:10:56.374 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.369+0000 7fae4b783640 1 -- 172.21.15.194:0/3366329343 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fae3c00a4d0 con 0x55d5923b8470 2024-09-13T06:10:56.374 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.369+0000 7fae4d472980 1 --2- 172.21.15.194:0/3366329343 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55d5923c0e70 0x55d5923c3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.374 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.369+0000 7fae4d472980 1 -- 172.21.15.194:0/3366329343 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d5923c39a0 con 0x55d5923c0e70 2024-09-13T06:10:56.374 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.369+0000 7fae4a781640 1 --2- 172.21.15.194:0/3366329343 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55d5923c0e70 0x55d5923c3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.374 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.369+0000 7fae4a781640 1 --2- 172.21.15.194:0/3366329343 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55d5923c0e70 0x55d5923c3260 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.374 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.369+0000 7fae4a781640 1 -- 172.21.15.194:0/3366329343 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fae400b3040 con 0x55d5923c0e70 2024-09-13T06:10:56.374 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.369+0000 7fae4d472980 1 Processor -- start 2024-09-13T06:10:56.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.369+0000 7fae4d472980 1 -- start start 2024-09-13T06:10:56.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.369+0000 7fae4d472980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d5923d1490 0x55d5923d18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.369+0000 7fae4d472980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55d5921c5800 con 0x55d5923d1490 2024-09-13T06:10:56.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.369+0000 7fae4af82640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d5923d1490 0x55d5923d18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.369+0000 7fae4af82640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d5923d1490 0x55d5923d18b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:38684/0 (socket says 172.21.15.194:38684) 2024-09-13T06:10:56.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.369+0000 7fae4af82640 1 -- 172.21.15.194:0/1642493547 learned_addr learned my addr 172.21.15.194:0/1642493547 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:56.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.369+0000 7fae4af82640 1 -- 172.21.15.194:0/1642493547 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5923d1df0 con 0x55d5923d1490 2024-09-13T06:10:56.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.369+0000 7fae4af82640 1 --2- 172.21.15.194:0/1642493547 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d5923d1490 0x55d5923d18b0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fae44048240 tx=0x7fae4402aab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.369+0000 7fad34e01640 1 -- 172.21.15.194:0/1642493547 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae4402bde0 con 0x55d5923d1490 2024-09-13T06:10:56.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.369+0000 7fae4d472980 1 -- 172.21.15.194:0/1642493547 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d5923d2080 con 0x55d5923d1490 2024-09-13T06:10:56.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.369+0000 7fad34e01640 1 -- 172.21.15.194:0/1642493547 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae440410c0 con 0x55d5923d1490 2024-09-13T06:10:56.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.369+0000 7fad34e01640 1 -- 172.21.15.194:0/1642493547 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae440413a0 con 0x55d5923d1490 2024-09-13T06:10:56.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.369+0000 7fae4d472980 1 -- 172.21.15.194:0/1642493547 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5923d4d00 con 0x55d5923d1490 2024-09-13T06:10:56.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.369+0000 7fad34e01640 1 -- 172.21.15.194:0/1642493547 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fae44016070 con 0x55d5923d1490 2024-09-13T06:10:56.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.369+0000 7fad34e01640 1 --2- 172.21.15.194:0/1642493547 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fad24034650 0x7fad24036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.373+0000 7fad34e01640 1 -- 172.21.15.194:0/1642493547 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fae4403b070 con 0x55d5923d1490 2024-09-13T06:10:56.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.373+0000 7fae4a781640 1 --2- 172.21.15.194:0/1642493547 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fad24034650 0x7fad24036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.373+0000 7fae4d472980 1 Processor -- start 2024-09-13T06:10:56.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.373+0000 7fae4d472980 1 -- start start 2024-09-13T06:10:56.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.373+0000 7fae4a781640 1 --2- 172.21.15.194:0/1642493547 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fad24034650 0x7fad24036b10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x55d592234430 tx=0x7fae40005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.373+0000 7fae4d472980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d5923dde20 0x55d5923de220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.373+0000 7fae4d472980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55d5923aa3d0 con 0x55d5923dde20 2024-09-13T06:10:56.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.373+0000 7fae4af82640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d5923dde20 0x55d5923de220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.373+0000 7fae4af82640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d5923dde20 0x55d5923de220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:38694/0 (socket says 172.21.15.194:38694) 2024-09-13T06:10:56.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.373+0000 7fae4af82640 1 -- 172.21.15.194:0/489937085 learned_addr learned my addr 172.21.15.194:0/489937085 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:56.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.373+0000 7fae4af82640 1 -- 172.21.15.194:0/489937085 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5923de7f0 con 0x55d5923dde20 2024-09-13T06:10:56.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.373+0000 7fae4af82640 1 --2- 172.21.15.194:0/489937085 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d5923dde20 0x55d5923de220 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fae4404eef0 tx=0x7fae44040e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1ba79af6c2f10ca server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.373+0000 7fad2e7fc640 1 -- 172.21.15.194:0/489937085 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae440173d0 con 0x55d5923dde20 2024-09-13T06:10:56.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.373+0000 7fad2e7fc640 1 -- 172.21.15.194:0/489937085 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae44061070 con 0x55d5923dde20 2024-09-13T06:10:56.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.373+0000 7fad2e7fc640 1 -- 172.21.15.194:0/489937085 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae44041670 con 0x55d5923dde20 2024-09-13T06:10:56.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.373+0000 7fae4d472980 1 -- 172.21.15.194:0/489937085 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d5923dde20 msgr2=0x55d5923de220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.373+0000 7fae4d472980 1 --2- 172.21.15.194:0/489937085 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d5923dde20 0x55d5923de220 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fae4404eef0 tx=0x7fae44040e40 comp rx=0 tx=0).stop 2024-09-13T06:10:56.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.373+0000 7fae4d472980 1 -- 172.21.15.194:0/489937085 shutdown_connections 2024-09-13T06:10:56.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.373+0000 7fae4d472980 1 --2- 172.21.15.194:0/489937085 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d5923dde20 0x55d5923de220 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.373+0000 7fae4d472980 1 -- 172.21.15.194:0/489937085 >> 172.21.15.194:0/489937085 conn(0x55d5923da200 msgr2=0x55d5923d8300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:56.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.373+0000 7fae4d472980 1 -- 172.21.15.194:0/489937085 shutdown_connections 2024-09-13T06:10:56.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.373+0000 7fae4d472980 1 -- 172.21.15.194:0/489937085 wait complete. 2024-09-13T06:10:56.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.373+0000 7fae4d472980 1 Processor -- start 2024-09-13T06:10:56.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.373+0000 7fae4d472980 1 -- start start 2024-09-13T06:10:56.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.373+0000 7fae4d472980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d5923dde20 0x55d5923e4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.373+0000 7fae4d472980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55d5923dec70 con 0x55d5923dde20 2024-09-13T06:10:56.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.373+0000 7fae4af82640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d5923dde20 0x55d5923e4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.373+0000 7fae4af82640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d5923dde20 0x55d5923e4fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:38696/0 (socket says 172.21.15.194:38696) 2024-09-13T06:10:56.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.373+0000 7fae4af82640 1 -- 172.21.15.194:0/4195214022 learned_addr learned my addr 172.21.15.194:0/4195214022 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:56.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.373+0000 7fae4af82640 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5923e5520 con 0x55d5923dde20 2024-09-13T06:10:56.385 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.373+0000 7fae4af82640 1 --2- 172.21.15.194:0/4195214022 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d5923dde20 0x55d5923e4fe0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fae44043010 tx=0x7fae4404ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.385 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.373+0000 7fad2cff9640 1 -- 172.21.15.194:0/4195214022 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae44017750 con 0x55d5923dde20 2024-09-13T06:10:56.386 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.377+0000 7fae4d472980 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d5923e5520 con 0x55d5923dde20 2024-09-13T06:10:56.386 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.377+0000 7fad2cff9640 1 -- 172.21.15.194:0/4195214022 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae4404d070 con 0x55d5923dde20 2024-09-13T06:10:56.386 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.377+0000 7fad2cff9640 1 -- 172.21.15.194:0/4195214022 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae44052450 con 0x55d5923dde20 2024-09-13T06:10:56.386 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.377+0000 7fae4d472980 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5923e5520 con 0x55d5923dde20 2024-09-13T06:10:56.386 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.377+0000 7fae4d472980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.386 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.377+0000 7fad2cff9640 1 -- 172.21.15.194:0/4195214022 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fae44077060 con 0x55d5923dde20 2024-09-13T06:10:56.386 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.377+0000 7fad2cff9640 1 --2- 172.21.15.194:0/4195214022 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fad14034650 0x7fad14036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.386 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.377+0000 7fad2cff9640 1 -- 172.21.15.194:0/4195214022 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fae44014070 con 0x55d5923dde20 2024-09-13T06:10:56.388 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.377+0000 7fae4a781640 1 --2- 172.21.15.194:0/4195214022 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fad14034650 0x7fad14036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.388 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.377+0000 7fae4d472980 1 --2- 172.21.15.194:0/4195214022 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55d5923f0050 0x55d5923f2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.388 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.377+0000 7fae4d472980 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d5923f2c60 con 0x55d5923f0050 2024-09-13T06:10:56.388 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.377+0000 7fae4b783640 1 --2- 172.21.15.194:0/4195214022 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55d5923f0050 0x55d5923f2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.388 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.377+0000 7fae4a781640 1 --2- 172.21.15.194:0/4195214022 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fad14034650 0x7fad14036b10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fae40018eb0 tx=0x7fae400b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.388 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.377+0000 7fae4b783640 1 --2- 172.21.15.194:0/4195214022 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55d5923f0050 0x55d5923f2510 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.388 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.377+0000 7fae4b783640 1 -- 172.21.15.194:0/4195214022 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fae3c00a4d0 con 0x55d5923f0050 2024-09-13T06:10:56.389 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.377+0000 7fae4d472980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:56.389 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.377+0000 7fae4d472980 20 realm 2024-09-13T06:10:56.389 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.377+0000 7fae4d472980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.389 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.377+0000 7fae4d472980 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d5923f3070 con 0x55d5923f0050 2024-09-13T06:10:56.389 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.377+0000 7fae4b783640 1 -- 172.21.15.194:0/4195214022 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fae3c00a4d0 con 0x55d5923f0050 2024-09-13T06:10:56.389 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.377+0000 7fae4d472980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:56.389 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.377+0000 7fae4d472980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:10:56.389 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.377+0000 7fae4d472980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.389 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.377+0000 7fae4d472980 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d5923f3910 con 0x55d5923f0050 2024-09-13T06:10:56.389 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.377+0000 7fae4b783640 1 -- 172.21.15.194:0/4195214022 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fae3c00a4d0 con 0x55d5923f0050 2024-09-13T06:10:56.389 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.377+0000 7fae4d472980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:56.389 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.377+0000 7fae4d472980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.390 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.377+0000 7fae4d472980 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d5923f3cb0 con 0x55d5923f0050 2024-09-13T06:10:56.390 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.377+0000 7fae4b783640 1 -- 172.21.15.194:0/4195214022 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fae3c00a4d0 con 0x55d5923f0050 2024-09-13T06:10:56.390 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.377+0000 7fae4d472980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:10:56.390 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.377+0000 7fae4d472980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.390 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.377+0000 7fae4d472980 1 --2- 172.21.15.194:0/4195214022 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55d5923f4a10 0x55d5923f6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.390 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.377+0000 7fae4d472980 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d5923f7380 con 0x55d5923f4a10 2024-09-13T06:10:56.390 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.377+0000 7fae4af82640 1 --2- 172.21.15.194:0/4195214022 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55d5923f4a10 0x55d5923f6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.390 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.377+0000 7fae4af82640 1 --2- 172.21.15.194:0/4195214022 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55d5923f4a10 0x55d5923f6e00 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.390 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.377+0000 7fae4af82640 1 -- 172.21.15.194:0/4195214022 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fae44029030 con 0x55d5923f4a10 2024-09-13T06:10:56.390 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.377+0000 7fae4d472980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:10:56.390 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.377+0000 7fae4d472980 20 searching for the correct realm 2024-09-13T06:10:56.390 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.377+0000 7fae4d472980 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5923f8be0 con 0x55d5923f4a10 2024-09-13T06:10:56.390 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.377+0000 7fae4af82640 1 -- 172.21.15.194:0/4195214022 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae44029030 con 0x55d5923f4a10 2024-09-13T06:10:56.391 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.377+0000 7fae4af82640 1 --2- 172.21.15.194:0/4195214022 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fae44052070 0x7fae44013790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.391 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.377+0000 7fae4af82640 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5923f8be0 con 0x7fae44052070 2024-09-13T06:10:56.391 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.381+0000 7fae4a781640 1 --2- 172.21.15.194:0/4195214022 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fae44052070 0x7fae44013790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.391 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.381+0000 7fae4a781640 1 --2- 172.21.15.194:0/4195214022 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fae44052070 0x7fae44013790 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.391 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.381+0000 7fae4a781640 1 -- 172.21.15.194:0/4195214022 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fae400c9030 con 0x7fae44052070 2024-09-13T06:10:56.391 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.381+0000 7fae4a781640 1 --2- 172.21.15.194:0/4195214022 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fae400dc040 0x7fae400dd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.391 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.381+0000 7fae4a781640 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5923f8be0 con 0x7fae400dc040 2024-09-13T06:10:56.391 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.381+0000 7fae4b783640 1 --2- 172.21.15.194:0/4195214022 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fae400dc040 0x7fae400dd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.391 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.381+0000 7fae4b783640 1 --2- 172.21.15.194:0/4195214022 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fae400dc040 0x7fae400dd430 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.391 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.381+0000 7fae4b783640 1 -- 172.21.15.194:0/4195214022 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae3c00a4d0 con 0x7fae400dc040 2024-09-13T06:10:56.391 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.381+0000 7fae4b783640 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5923f3cb0 con 0x55d5923f0050 2024-09-13T06:10:56.391 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.381+0000 7fae4b783640 1 -- 172.21.15.194:0/4195214022 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae3c00a4d0 con 0x55d5923f0050 2024-09-13T06:10:56.392 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.381+0000 7fae4b783640 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5923f3cb0 con 0x55d5923f0050 2024-09-13T06:10:56.392 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.381+0000 7fae4b783640 1 -- 172.21.15.194:0/4195214022 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae3c00a4d0 con 0x55d5923f0050 2024-09-13T06:10:56.392 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.381+0000 7fae4b783640 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5923f3cb0 con 0x7fae400dc040 2024-09-13T06:10:56.399 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.381+0000 7fae4b783640 1 -- 172.21.15.194:0/4195214022 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae3c00a4d0 con 0x7fae400dc040 2024-09-13T06:10:56.399 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.381+0000 7fae4b783640 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5923f3cb0 con 0x7fae400dc040 2024-09-13T06:10:56.399 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.381+0000 7fae4b783640 1 -- 172.21.15.194:0/4195214022 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae3c00a4d0 con 0x7fae400dc040 2024-09-13T06:10:56.399 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.381+0000 7fae4b783640 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5923f3cb0 con 0x7fae44052070 2024-09-13T06:10:56.399 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.381+0000 7fae4a781640 1 -- 172.21.15.194:0/4195214022 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae400c9030 con 0x7fae44052070 2024-09-13T06:10:56.399 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.381+0000 7fae4a781640 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5923f3cb0 con 0x55d5923f4a10 2024-09-13T06:10:56.399 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.381+0000 7fae4af82640 1 -- 172.21.15.194:0/4195214022 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae44029030 con 0x55d5923f4a10 2024-09-13T06:10:56.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.381+0000 7fae4af82640 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5923f3cb0 con 0x55d5923f0050 2024-09-13T06:10:56.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.385+0000 7fae4b783640 1 -- 172.21.15.194:0/4195214022 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae3c00a4d0 con 0x55d5923f0050 2024-09-13T06:10:56.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.385+0000 7fae4b783640 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5923f3cb0 con 0x7fae400dc040 2024-09-13T06:10:56.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.385+0000 7fae4b783640 1 -- 172.21.15.194:0/4195214022 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae3c00a4d0 con 0x7fae400dc040 2024-09-13T06:10:56.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.385+0000 7fae4b783640 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5923f3cb0 con 0x55d5923f0050 2024-09-13T06:10:56.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.385+0000 7fae4b783640 1 -- 172.21.15.194:0/4195214022 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae3c00a4d0 con 0x55d5923f0050 2024-09-13T06:10:56.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.385+0000 7fae4b783640 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5923f3cb0 con 0x7fae44052070 2024-09-13T06:10:56.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.385+0000 7fae4a781640 1 -- 172.21.15.194:0/4195214022 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fae400c9030 con 0x7fae44052070 2024-09-13T06:10:56.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.385+0000 7fae4a781640 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5923f3cb0 con 0x55d5923f4a10 2024-09-13T06:10:56.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.385+0000 7fae4af82640 1 -- 172.21.15.194:0/4195214022 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae44029030 con 0x55d5923f4a10 2024-09-13T06:10:56.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.385+0000 7fae4af82640 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5923f3cb0 con 0x55d5923f4a10 2024-09-13T06:10:56.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.385+0000 7fae4af82640 1 -- 172.21.15.194:0/4195214022 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae44029030 con 0x55d5923f4a10 2024-09-13T06:10:56.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.385+0000 7fae4af82640 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5923f3cb0 con 0x7fae400dc040 2024-09-13T06:10:56.401 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.385+0000 7fae4b783640 1 -- 172.21.15.194:0/4195214022 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae3c00a4d0 con 0x7fae400dc040 2024-09-13T06:10:56.401 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.385+0000 7fae4b783640 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5923f3cb0 con 0x55d5923f4a10 2024-09-13T06:10:56.401 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.385+0000 7fae4af82640 1 -- 172.21.15.194:0/4195214022 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae44029030 con 0x55d5923f4a10 2024-09-13T06:10:56.401 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.385+0000 7fae4af82640 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5923f3cb0 con 0x55d5923f4a10 2024-09-13T06:10:56.401 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.385+0000 7fae4af82640 1 -- 172.21.15.194:0/4195214022 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae44029030 con 0x55d5923f4a10 2024-09-13T06:10:56.401 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.385+0000 7fae4af82640 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5923f3cb0 con 0x55d5923f0050 2024-09-13T06:10:56.401 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.385+0000 7fae4b783640 1 -- 172.21.15.194:0/4195214022 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae3c00a4d0 con 0x55d5923f0050 2024-09-13T06:10:56.401 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.385+0000 7fae4b783640 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5923f3cb0 con 0x55d5923f0050 2024-09-13T06:10:56.401 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.385+0000 7fae4b783640 1 -- 172.21.15.194:0/4195214022 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fae3c00a4d0 con 0x55d5923f0050 2024-09-13T06:10:56.401 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.385+0000 7fae4b783640 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5923f3cb0 con 0x7fae44052070 2024-09-13T06:10:56.401 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.385+0000 7fae4a781640 1 -- 172.21.15.194:0/4195214022 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae400c9030 con 0x7fae44052070 2024-09-13T06:10:56.401 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.385+0000 7fae4a781640 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5923f3cb0 con 0x55d5923f4a10 2024-09-13T06:10:56.402 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.385+0000 7fae4af82640 1 -- 172.21.15.194:0/4195214022 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae44029030 con 0x55d5923f4a10 2024-09-13T06:10:56.402 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.385+0000 7fae4af82640 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5923f3cb0 con 0x7fae44052070 2024-09-13T06:10:56.402 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.389+0000 7fae4a781640 1 -- 172.21.15.194:0/4195214022 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae400c9030 con 0x7fae44052070 2024-09-13T06:10:56.402 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.389+0000 7fae4a781640 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5923f3cb0 con 0x55d5923f0050 2024-09-13T06:10:56.402 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.389+0000 7fae4b783640 1 -- 172.21.15.194:0/4195214022 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae3c00a4d0 con 0x55d5923f0050 2024-09-13T06:10:56.402 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.389+0000 7fae4b783640 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5923f3cb0 con 0x7fae400dc040 2024-09-13T06:10:56.402 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.389+0000 7fae4b783640 1 -- 172.21.15.194:0/4195214022 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae3c00a4d0 con 0x7fae400dc040 2024-09-13T06:10:56.402 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.389+0000 7fae4b783640 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5923f3cb0 con 0x55d5923f4a10 2024-09-13T06:10:56.402 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.389+0000 7fae4af82640 1 -- 172.21.15.194:0/4195214022 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fae44029030 con 0x55d5923f4a10 2024-09-13T06:10:56.402 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.389+0000 7fae4af82640 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5923f3cb0 con 0x7fae44052070 2024-09-13T06:10:56.402 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.389+0000 7fae4a781640 1 -- 172.21.15.194:0/4195214022 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae400c9030 con 0x7fae44052070 2024-09-13T06:10:56.402 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.389+0000 7fae4a781640 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5923f3cb0 con 0x7fae44052070 2024-09-13T06:10:56.403 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.389+0000 7fae4a781640 1 -- 172.21.15.194:0/4195214022 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae400c9030 con 0x7fae44052070 2024-09-13T06:10:56.403 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.389+0000 7fae4a781640 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5923f3cb0 con 0x55d5923f4a10 2024-09-13T06:10:56.403 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.389+0000 7fae4af82640 1 -- 172.21.15.194:0/4195214022 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae44029030 con 0x55d5923f4a10 2024-09-13T06:10:56.403 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.389+0000 7fae4af82640 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5923f3cb0 con 0x7fae400dc040 2024-09-13T06:10:56.403 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.389+0000 7fae4b783640 1 -- 172.21.15.194:0/4195214022 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae3c00a4d0 con 0x7fae400dc040 2024-09-13T06:10:56.403 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.389+0000 7fae4b783640 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5923f3cb0 con 0x55d5923f0050 2024-09-13T06:10:56.403 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.389+0000 7fae4b783640 1 -- 172.21.15.194:0/4195214022 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fae3c00a4d0 con 0x55d5923f0050 2024-09-13T06:10:56.403 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.389+0000 7fae4b783640 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5923f3cb0 con 0x7fae44052070 2024-09-13T06:10:56.403 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.389+0000 7fae4a781640 1 -- 172.21.15.194:0/4195214022 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae400c9030 con 0x7fae44052070 2024-09-13T06:10:56.403 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.389+0000 7fae4d472980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:10:56.403 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.389+0000 7fae4d472980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:10:56.403 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.389+0000 7fae4d472980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:10:56.403 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.389+0000 7fae4d472980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:10:56.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.389+0000 7fae4d472980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:10:56.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.389+0000 7fae4d472980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:10:56.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.389+0000 7fae4d472980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.389+0000 7fae4d472980 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d5923f7cd0 con 0x55d5923f0050 2024-09-13T06:10:56.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.389+0000 7fae4b783640 1 -- 172.21.15.194:0/4195214022 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fae3c00a4d0 con 0x55d5923f0050 2024-09-13T06:10:56.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.389+0000 7fae4d472980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:56.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.389+0000 7fae4d472980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.389+0000 7fae4d472980 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d5923f7910 con 0x55d5923f0050 2024-09-13T06:10:56.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.389+0000 7fae4b783640 1 -- 172.21.15.194:0/4195214022 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fae3c00a4d0 con 0x55d5923f0050 2024-09-13T06:10:56.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.389+0000 7fae4d472980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:10:56.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.389+0000 7fae4d472980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.389+0000 7fae4d472980 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d5923f78e0 con 0x7fae44052070 2024-09-13T06:10:56.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.389+0000 7fae4a781640 1 -- 172.21.15.194:0/4195214022 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fae400c9030 con 0x7fae44052070 2024-09-13T06:10:56.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.389+0000 7fae4d472980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:10:56.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.393+0000 7fae4d472980 20 zone default found 2024-09-13T06:10:56.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.393+0000 7fae4d472980 4 Realm: () 2024-09-13T06:10:56.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.393+0000 7fae4d472980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:10:56.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.393+0000 7fae4d472980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:10:56.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.393+0000 7fae4d472980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:10:56.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.393+0000 7fae4d472980 20 zonegroup default 2024-09-13T06:10:56.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.393+0000 7fae4d472980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.393+0000 7fae4d472980 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d5923f8af0 con 0x7fae400dc040 2024-09-13T06:10:56.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.393+0000 7fae4b783640 1 -- 172.21.15.194:0/4195214022 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fae3c00a4d0 con 0x7fae400dc040 2024-09-13T06:10:56.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.393+0000 7fae4d472980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:56.406 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.393+0000 7fae4d472980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.406 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.393+0000 7fae4d472980 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d5923faa90 con 0x55d5923f4a10 2024-09-13T06:10:56.406 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.393+0000 7fae4af82640 1 -- 172.21.15.194:0/4195214022 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fae44029030 con 0x55d5923f4a10 2024-09-13T06:10:56.406 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.393+0000 7fae4d472980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:56.406 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.393+0000 7fae4d472980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.406 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.393+0000 7fae4d472980 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d5923fae30 con 0x55d5923f4a10 2024-09-13T06:10:56.406 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.393+0000 7fae4af82640 1 -- 172.21.15.194:0/4195214022 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fae44029030 con 0x55d5923f4a10 2024-09-13T06:10:56.406 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.393+0000 7fae4d472980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:56.406 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.393+0000 7fae4d472980 20 started sync module instance, tier type = 2024-09-13T06:10:56.406 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.393+0000 7fae4d472980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:10:56.406 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.393+0000 7fae4d472980 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5923f9f30 con 0x7fae44052070 2024-09-13T06:10:56.406 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.393+0000 7fae4a781640 1 -- 172.21.15.194:0/4195214022 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(44 notify.0 [create] v35'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae400c9030 con 0x7fae44052070 2024-09-13T06:10:56.406 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.393+0000 7fae4d472980 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94375770039120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5923fb680 con 0x7fae44052070 2024-09-13T06:10:56.407 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.393+0000 7fae4d472980 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5923fbed0 con 0x55d5923f0050 2024-09-13T06:10:56.407 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.393+0000 7fae4a781640 1 -- 172.21.15.194:0/4195214022 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94375770039120] v35'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae400c9030 con 0x7fae44052070 2024-09-13T06:10:56.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.397+0000 7fae4b783640 1 -- 172.21.15.194:0/4195214022 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v35'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae3c00a4d0 con 0x55d5923f0050 2024-09-13T06:10:56.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.397+0000 7fae4d472980 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94375770042832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5923fbed0 con 0x55d5923f0050 2024-09-13T06:10:56.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.397+0000 7fae4d472980 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5923fc9b0 con 0x55d5923f4a10 2024-09-13T06:10:56.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.397+0000 7fae4b783640 1 -- 172.21.15.194:0/4195214022 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94375770042832] v35'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae3c00a4d0 con 0x55d5923f0050 2024-09-13T06:10:56.410 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.397+0000 7fae4af82640 1 -- 172.21.15.194:0/4195214022 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v35'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae44029030 con 0x55d5923f4a10 2024-09-13T06:10:56.410 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.397+0000 7fae4d472980 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94375770047680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5923fbed0 con 0x55d5923f4a10 2024-09-13T06:10:56.410 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.397+0000 7fae4d472980 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5923fd3c0 con 0x7fae44052070 2024-09-13T06:10:56.410 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.397+0000 7fae4a781640 1 -- 172.21.15.194:0/4195214022 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(50 notify.3 [create] v35'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae400c9030 con 0x7fae44052070 2024-09-13T06:10:56.410 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.397+0000 7fae4d472980 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94375770050320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5923fdc10 con 0x7fae44052070 2024-09-13T06:10:56.410 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.397+0000 7fae4d472980 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5923fe640 con 0x55d5923f0050 2024-09-13T06:10:56.410 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.401+0000 7fae4a781640 1 -- 172.21.15.194:0/4195214022 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94375770050320] v35'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae400c9030 con 0x7fae44052070 2024-09-13T06:10:56.410 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.401+0000 7fae4af82640 1 -- 172.21.15.194:0/4195214022 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94375770047680] v35'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae44029030 con 0x55d5923f4a10 2024-09-13T06:10:56.410 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.401+0000 7fae4b783640 1 -- 172.21.15.194:0/4195214022 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v35'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae3c00a4d0 con 0x55d5923f0050 2024-09-13T06:10:56.410 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.401+0000 7fae4d472980 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94375770054992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5923fd760 con 0x55d5923f0050 2024-09-13T06:10:56.410 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.401+0000 7fae4d472980 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5923feaf0 con 0x7fae400dc040 2024-09-13T06:10:56.410 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.401+0000 7fae4b783640 1 -- 172.21.15.194:0/4195214022 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(54 notify.5 [create] v35'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae3c00a4d0 con 0x7fae400dc040 2024-09-13T06:10:56.410 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.401+0000 7fae4d472980 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94375770056256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5923fea60 con 0x7fae400dc040 2024-09-13T06:10:56.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.401+0000 7fae4d472980 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5923ff9b0 con 0x7fae400dc040 2024-09-13T06:10:56.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.401+0000 7fae4b783640 1 -- 172.21.15.194:0/4195214022 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94375770054992] v35'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae3c00a4d0 con 0x55d5923f0050 2024-09-13T06:10:56.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.405+0000 7fae4b783640 1 -- 172.21.15.194:0/4195214022 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94375770056256] v35'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae3c00a4d0 con 0x7fae400dc040 2024-09-13T06:10:56.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.405+0000 7fae4b783640 1 -- 172.21.15.194:0/4195214022 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(56 notify.6 [create] v35'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae3c00a4d0 con 0x7fae400dc040 2024-09-13T06:10:56.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.405+0000 7fae4d472980 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94375770044960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5923ff500 con 0x7fae400dc040 2024-09-13T06:10:56.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.405+0000 7fae4d472980 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5923ffec0 con 0x7fae400dc040 2024-09-13T06:10:56.412 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.405+0000 7fae4b783640 1 -- 172.21.15.194:0/4195214022 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(58 notify.7 [create] v35'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae3c00a4d0 con 0x7fae400dc040 2024-09-13T06:10:56.412 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.405+0000 7fae4d472980 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94375770061328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5924002e0 con 0x7fae400dc040 2024-09-13T06:10:56.412 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.405+0000 7fae4d472980 20 add_watcher() i=0 2024-09-13T06:10:56.412 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.405+0000 7fae4d472980 20 add_watcher() i=1 2024-09-13T06:10:56.412 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.405+0000 7fae4d472980 20 add_watcher() i=2 2024-09-13T06:10:56.412 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.405+0000 7fae4d472980 20 add_watcher() i=3 2024-09-13T06:10:56.412 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.405+0000 7fae4d472980 20 add_watcher() i=4 2024-09-13T06:10:56.412 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.405+0000 7fae4d472980 20 add_watcher() i=5 2024-09-13T06:10:56.412 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.405+0000 7fae4b783640 1 -- 172.21.15.194:0/4195214022 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94375770044960] v35'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae3c00a4d0 con 0x7fae400dc040 2024-09-13T06:10:56.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.405+0000 7fae4d472980 20 add_watcher() i=6 2024-09-13T06:10:56.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.409+0000 7fae4b783640 1 -- 172.21.15.194:0/4195214022 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94375770061328] v35'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae3c00a4d0 con 0x7fae400dc040 2024-09-13T06:10:56.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.409+0000 7fae4d472980 20 add_watcher() i=7 2024-09-13T06:10:56.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.409+0000 7fae4d472980 2 all 8 watchers are set, enabling cache 2024-09-13T06:10:56.414 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.409+0000 7fae4d472980 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d5924002e0 con 0x55d5923f0050 2024-09-13T06:10:56.414 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.409+0000 7fae4b783640 1 -- 172.21.15.194:0/4195214022 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fae3c00a4d0 con 0x55d5923f0050 2024-09-13T06:10:56.414 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.409+0000 7fae4d472980 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94375770062384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d592400250 con 0x55d5923f0050 2024-09-13T06:10:56.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.409+0000 7fae4b783640 1 -- 172.21.15.194:0/4195214022 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94375770062384] v35'206 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fae3c00a4d0 con 0x55d5923f0050 2024-09-13T06:10:56.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.409+0000 7fad017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:10:56.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.409+0000 7fae4d472980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:10:56.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.409+0000 7fae4d472980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:10:56.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.409+0000 7fae4d472980 5 note: GC not initialized 2024-09-13T06:10:56.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.409+0000 7fac7bfff640 20 reqs_thread_entry: start 2024-09-13T06:10:56.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.409+0000 7fae4d472980 20 init_complete bucket index max shards: 11 2024-09-13T06:10:56.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.409+0000 7fae4d472980 20 Filter name: none 2024-09-13T06:10:56.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.409+0000 7fac79ffb640 20 reqs_thread_entry: start 2024-09-13T06:10:56.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.409+0000 7fae4d472980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.409+0000 7fae4d472980 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d592426440 con 0x55d5923f0050 2024-09-13T06:10:56.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.409+0000 7fae4b783640 1 -- 172.21.15.194:0/4195214022 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv23 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fae3c00a4d0 con 0x55d5923f0050 2024-09-13T06:10:56.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.409+0000 7fae4d472980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T06:10:56.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.409+0000 7fae4d472980 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d592427990 con 0x7fae400dc040 2024-09-13T06:10:56.417 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.413+0000 7fae4b783640 1 -- 172.21.15.194:0/4195214022 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv30 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7fae3c00a4d0 con 0x7fae400dc040 2024-09-13T06:10:56.417 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.413+0000 7fad017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:10:56.417 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.413+0000 7fae4d472980 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94375770062384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5924057f0 con 0x55d5923f0050 2024-09-13T06:10:56.418 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.413+0000 7fae4b783640 1 -- 172.21.15.194:0/4195214022 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94375770062384] v35'207 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fae3c00a4d0 con 0x55d5923f0050 2024-09-13T06:10:56.418 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.413+0000 7fae4d472980 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94375770039120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5923ffe30 con 0x7fae44052070 2024-09-13T06:10:56.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.413+0000 7fae4a781640 1 -- 172.21.15.194:0/4195214022 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94375770039120] v35'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae400c9030 con 0x7fae44052070 2024-09-13T06:10:56.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.413+0000 7fae4d472980 20 remove_watcher() i=0 2024-09-13T06:10:56.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.413+0000 7fae4d472980 2 removed watcher, disabling cache 2024-09-13T06:10:56.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.413+0000 7fae4d472980 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94375770042832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5923ffe30 con 0x55d5923f0050 2024-09-13T06:10:56.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.417+0000 7fae4b783640 1 -- 172.21.15.194:0/4195214022 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94375770042832] v35'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae3c00a4d0 con 0x55d5923f0050 2024-09-13T06:10:56.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.417+0000 7fae4d472980 20 remove_watcher() i=1 2024-09-13T06:10:56.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.417+0000 7fae4d472980 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94375770047680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5923ffe30 con 0x55d5923f4a10 2024-09-13T06:10:56.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.417+0000 7fae4af82640 1 -- 172.21.15.194:0/4195214022 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94375770047680] v35'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae44029030 con 0x55d5923f4a10 2024-09-13T06:10:56.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.417+0000 7fae4d472980 20 remove_watcher() i=2 2024-09-13T06:10:56.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.417+0000 7fae4d472980 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94375770050320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5923ffe30 con 0x7fae44052070 2024-09-13T06:10:56.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.421+0000 7fae4a781640 1 -- 172.21.15.194:0/4195214022 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94375770050320] v35'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae400c9030 con 0x7fae44052070 2024-09-13T06:10:56.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.421+0000 7fae4d472980 20 remove_watcher() i=3 2024-09-13T06:10:56.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.421+0000 7fae4d472980 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94375770054992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5923ffe30 con 0x55d5923f0050 2024-09-13T06:10:56.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.421+0000 7fae4b783640 1 -- 172.21.15.194:0/4195214022 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94375770054992] v35'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae3c00a4d0 con 0x55d5923f0050 2024-09-13T06:10:56.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.421+0000 7fae4d472980 20 remove_watcher() i=4 2024-09-13T06:10:56.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.421+0000 7fae4d472980 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94375770056256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5923ffe30 con 0x7fae400dc040 2024-09-13T06:10:56.428 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.425+0000 7fae4b783640 1 -- 172.21.15.194:0/4195214022 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94375770056256] v35'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae3c00a4d0 con 0x7fae400dc040 2024-09-13T06:10:56.428 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.425+0000 7fae4d472980 20 remove_watcher() i=5 2024-09-13T06:10:56.428 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.425+0000 7fae4d472980 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94375770044960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5923fe640 con 0x7fae400dc040 2024-09-13T06:10:56.430 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.425+0000 7fae4b783640 1 -- 172.21.15.194:0/4195214022 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94375770044960] v35'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae3c00a4d0 con 0x7fae400dc040 2024-09-13T06:10:56.430 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.425+0000 7fae4d472980 20 remove_watcher() i=6 2024-09-13T06:10:56.430 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.425+0000 7fae4d472980 1 -- 172.21.15.194:0/4195214022 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94375770061328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5923ffe30 con 0x7fae400dc040 2024-09-13T06:10:56.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.429+0000 7fae4b783640 1 -- 172.21.15.194:0/4195214022 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94375770061328] v35'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae3c00a4d0 con 0x7fae400dc040 2024-09-13T06:10:56.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.429+0000 7fae4d472980 20 remove_watcher() i=7 2024-09-13T06:10:56.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.429+0000 7fae4d472980 1 -- 172.21.15.194:0/4195214022 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fae400dc040 msgr2=0x7fae400dd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.429+0000 7fae4d472980 1 --2- 172.21.15.194:0/4195214022 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fae400dc040 0x7fae400dd430 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.429+0000 7fae4d472980 1 -- 172.21.15.194:0/4195214022 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55d5923f0050 msgr2=0x55d5923f2510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.429+0000 7fae4d472980 1 --2- 172.21.15.194:0/4195214022 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55d5923f0050 0x55d5923f2510 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.429+0000 7fae4d472980 1 -- 172.21.15.194:0/4195214022 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fae44052070 msgr2=0x7fae44013790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.429+0000 7fae4d472980 1 --2- 172.21.15.194:0/4195214022 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fae44052070 0x7fae44013790 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.429+0000 7fae4d472980 1 -- 172.21.15.194:0/4195214022 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55d5923f4a10 msgr2=0x55d5923f6e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.429+0000 7fae4d472980 1 --2- 172.21.15.194:0/4195214022 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55d5923f4a10 0x55d5923f6e00 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.429+0000 7fae4d472980 1 -- 172.21.15.194:0/4195214022 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fad14034650 msgr2=0x7fad14036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.429+0000 7fae4d472980 1 --2- 172.21.15.194:0/4195214022 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fad14034650 0x7fad14036b10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fae40018eb0 tx=0x7fae400b9040 comp rx=0 tx=0).stop 2024-09-13T06:10:56.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.429+0000 7fae4d472980 1 -- 172.21.15.194:0/4195214022 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d5923dde20 msgr2=0x55d5923e4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.429+0000 7fae4d472980 1 --2- 172.21.15.194:0/4195214022 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d5923dde20 0x55d5923e4fe0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fae44043010 tx=0x7fae4404ee80 comp rx=0 tx=0).stop 2024-09-13T06:10:56.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.429+0000 7fae4b783640 1 -- 172.21.15.194:0/4195214022 reap_dead start 2024-09-13T06:10:56.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.429+0000 7fae4d472980 1 -- 172.21.15.194:0/4195214022 shutdown_connections 2024-09-13T06:10:56.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.429+0000 7fae4d472980 1 --2- 172.21.15.194:0/4195214022 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d5923dde20 0x55d5923e4fe0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.429+0000 7fae4d472980 1 -- 172.21.15.194:0/4195214022 >> 172.21.15.194:0/4195214022 conn(0x55d5923da200 msgr2=0x55d5923d82d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:56.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.429+0000 7fae4d472980 1 -- 172.21.15.194:0/4195214022 shutdown_connections 2024-09-13T06:10:56.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.429+0000 7fae4d472980 1 -- 172.21.15.194:0/4195214022 wait complete. 2024-09-13T06:10:56.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.429+0000 7fae4d472980 1 -- 172.21.15.194:0/1642493547 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fad24034650 msgr2=0x7fad24036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.429+0000 7fae4d472980 1 --2- 172.21.15.194:0/1642493547 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fad24034650 0x7fad24036b10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x55d592234430 tx=0x7fae40005a10 comp rx=0 tx=0).stop 2024-09-13T06:10:56.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.429+0000 7fae4d472980 1 -- 172.21.15.194:0/1642493547 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d5923d1490 msgr2=0x55d5923d18b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.429+0000 7fae4d472980 1 --2- 172.21.15.194:0/1642493547 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d5923d1490 0x55d5923d18b0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fae44048240 tx=0x7fae4402aab0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.429+0000 7fae4d472980 1 -- 172.21.15.194:0/1642493547 shutdown_connections 2024-09-13T06:10:56.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.429+0000 7fae4d472980 1 --2- 172.21.15.194:0/1642493547 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fad24034650 0x7fad24036b10 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.429+0000 7fae4d472980 1 --2- 172.21.15.194:0/1642493547 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d5923d1490 0x55d5923d18b0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.429+0000 7fae4d472980 1 -- 172.21.15.194:0/1642493547 >> 172.21.15.194:0/1642493547 conn(0x55d5923c65e0 msgr2=0x55d5923c9060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:56.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.429+0000 7fae4d472980 1 -- 172.21.15.194:0/1642493547 shutdown_connections 2024-09-13T06:10:56.437 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.429+0000 7fae4d472980 1 -- 172.21.15.194:0/1642493547 wait complete. 2024-09-13T06:10:56.437 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.429+0000 7fae4d472980 1 -- 172.21.15.194:0/3366329343 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55d5923b8470 msgr2=0x55d5923ba860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.437 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.429+0000 7fae4d472980 1 --2- 172.21.15.194:0/3366329343 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55d5923b8470 0x55d5923ba860 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.437 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.429+0000 7fae4d472980 1 -- 172.21.15.194:0/3366329343 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55d5923c0e70 msgr2=0x55d5923c3260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.437 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.429+0000 7fae4d472980 1 --2- 172.21.15.194:0/3366329343 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55d5923c0e70 0x55d5923c3260 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.437 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.429+0000 7fae4d472980 1 -- 172.21.15.194:0/3366329343 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55d5923bcf30 msgr2=0x55d5923bf320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.437 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.429+0000 7fae4d472980 1 --2- 172.21.15.194:0/3366329343 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55d5923bcf30 0x55d5923bf320 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.437 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.429+0000 7fae4d472980 1 -- 172.21.15.194:0/3366329343 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fad30034650 msgr2=0x7fad30036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.437 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.429+0000 7fae4d472980 1 --2- 172.21.15.194:0/3366329343 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fad30034650 0x7fad30036b10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fae400ad000 tx=0x7fae400a5040 comp rx=0 tx=0).stop 2024-09-13T06:10:56.437 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.429+0000 7fae4d472980 1 -- 172.21.15.194:0/3366329343 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d5922c2a20 msgr2=0x55d592235500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.437 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.429+0000 7fae4d472980 1 --2- 172.21.15.194:0/3366329343 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d5922c2a20 0x55d592235500 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fae44004000 tx=0x7fae44000bd0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.437 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.429+0000 7fae4b783640 1 -- 172.21.15.194:0/3366329343 reap_dead start 2024-09-13T06:10:56.437 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.429+0000 7fae4d472980 1 -- 172.21.15.194:0/3366329343 shutdown_connections 2024-09-13T06:10:56.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.429+0000 7fae4d472980 1 -- 172.21.15.194:0/3366329343 >> 172.21.15.194:0/3366329343 conn(0x55d5922ba1c0 msgr2=0x55d5923a4230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:56.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.429+0000 7fae4d472980 1 -- 172.21.15.194:0/3366329343 shutdown_connections 2024-09-13T06:10:56.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.429+0000 7fae4d472980 1 -- 172.21.15.194:0/3366329343 wait complete. 2024-09-13T06:10:56.443 INFO:teuthology.orchestra.run.smithi194.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}]},{"bucket":"myfoo2","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[]}]}],"summary":[{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}}]} 2024-09-13T06:10:56.443 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}]}, {'bucket': 'myfoo2', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}]} 2024-09-13T06:10:56.443 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-09-13T06:10:56.443 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-09-13T06:10:56.444 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_bucket 2024-09-13T06:10:56.523 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:10:56.523 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:10:56.524 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.521+0000 7ff54cedc980 1 Processor -- start 2024-09-13T06:10:56.524 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.521+0000 7ff54cedc980 1 -- start start 2024-09-13T06:10:56.524 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.521+0000 7ff54cedc980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55e2b5071a90 0x55e2b5073e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.524 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.521+0000 7ff54cedc980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e2b4ef5ae0 con 0x55e2b4fe22e0 2024-09-13T06:10:56.524 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.521+0000 7ff54cedc980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x55e2b4f19e30 con 0x55e2b5071a90 2024-09-13T06:10:56.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.521+0000 7ff54a1eb640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55e2b5071a90 0x55e2b5073e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.521+0000 7ff54a9ec640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x55e2b4fe22e0 0x55e2b5070370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:34410/0 (socket says 172.21.15.194:34410) 2024-09-13T06:10:56.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.521+0000 7ff54a9ec640 1 -- 172.21.15.194:0/1592988067 learned_addr learned my addr 172.21.15.194:0/1592988067 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-09-13T06:10:56.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.521+0000 7ff54a1eb640 1 -- 172.21.15.194:0/1592988067 >> v1:172.21.15.120:6789/0 conn(0x55e2b4fe22e0 legacy=0x55e2b5070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.521+0000 7ff54a1eb640 1 -- 172.21.15.194:0/1592988067 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2b50753d0 con 0x55e2b5071a90 2024-09-13T06:10:56.527 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.525+0000 7ff54a1eb640 1 --2- 172.21.15.194:0/1592988067 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e2b5071a90 0x55e2b5073e80 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7ff54000a480 tx=0x7ff54001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4df53e6f07d82fa6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.528 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.525+0000 7ff5499ea640 1 -- 172.21.15.194:0/1592988067 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5400b0070 con 0x55e2b5071a90 2024-09-13T06:10:56.528 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.525+0000 7ff5499ea640 1 -- 172.21.15.194:0/1592988067 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5400ab540 con 0x55e2b5071a90 2024-09-13T06:10:56.528 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.525+0000 7ff5499ea640 1 -- 172.21.15.194:0/1592988067 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5400ab840 con 0x55e2b5071a90 2024-09-13T06:10:56.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.525+0000 7ff54cedc980 1 -- 172.21.15.194:0/1592988067 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e2b5071a90 msgr2=0x55e2b5073e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.525+0000 7ff54cedc980 1 --2- 172.21.15.194:0/1592988067 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e2b5071a90 0x55e2b5073e80 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7ff54000a480 tx=0x7ff54001b280 comp rx=0 tx=0).stop 2024-09-13T06:10:56.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.525+0000 7ff54cedc980 1 -- 172.21.15.194:0/1592988067 shutdown_connections 2024-09-13T06:10:56.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.525+0000 7ff54cedc980 1 --2- 172.21.15.194:0/1592988067 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e2b5071a90 0x55e2b5073e80 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.525+0000 7ff54cedc980 1 -- 172.21.15.194:0/1592988067 >> 172.21.15.194:0/1592988067 conn(0x55e2b50680a0 msgr2=0x55e2b506a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:56.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.525+0000 7ff54cedc980 1 -- 172.21.15.194:0/1592988067 shutdown_connections 2024-09-13T06:10:56.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.525+0000 7ff54cedc980 1 -- 172.21.15.194:0/1592988067 wait complete. 2024-09-13T06:10:56.541 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.537+0000 7ff54cedc980 1 Processor -- start 2024-09-13T06:10:56.542 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.537+0000 7ff54cedc980 1 -- start start 2024-09-13T06:10:56.542 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.537+0000 7ff54cedc980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e2b4fe22e0 0x55e2b5158a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.542 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.537+0000 7ff54cedc980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55e2b4f1b200 con 0x55e2b4fe22e0 2024-09-13T06:10:56.542 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.537+0000 7ff54a9ec640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e2b4fe22e0 0x55e2b5158a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.542 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.537+0000 7ff54a9ec640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e2b4fe22e0 0x55e2b5158a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:38714/0 (socket says 172.21.15.194:38714) 2024-09-13T06:10:56.542 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.537+0000 7ff54a9ec640 1 -- 172.21.15.194:0/2635821880 learned_addr learned my addr 172.21.15.194:0/2635821880 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:56.543 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.537+0000 7ff54a9ec640 1 -- 172.21.15.194:0/2635821880 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2b5159020 con 0x55e2b4fe22e0 2024-09-13T06:10:56.543 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.537+0000 7ff54a9ec640 1 --2- 172.21.15.194:0/2635821880 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e2b4fe22e0 0x55e2b5158a50 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7ff53c001d90 tx=0x7ff53c001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3af907807b09450 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.543 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.537+0000 7ff438e09640 1 -- 172.21.15.194:0/2635821880 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff53c013030 con 0x55e2b4fe22e0 2024-09-13T06:10:56.543 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.541+0000 7ff438e09640 1 -- 172.21.15.194:0/2635821880 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff53c00e690 con 0x55e2b4fe22e0 2024-09-13T06:10:56.543 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.541+0000 7ff438e09640 1 -- 172.21.15.194:0/2635821880 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff53c00ea10 con 0x55e2b4fe22e0 2024-09-13T06:10:56.545 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.541+0000 7ff54cedc980 1 -- 172.21.15.194:0/2635821880 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e2b4fe22e0 msgr2=0x55e2b5158a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.545 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.541+0000 7ff54cedc980 1 --2- 172.21.15.194:0/2635821880 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e2b4fe22e0 0x55e2b5158a50 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7ff53c001d90 tx=0x7ff53c001e80 comp rx=0 tx=0).stop 2024-09-13T06:10:56.545 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.541+0000 7ff54cedc980 1 -- 172.21.15.194:0/2635821880 shutdown_connections 2024-09-13T06:10:56.545 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.541+0000 7ff54cedc980 1 --2- 172.21.15.194:0/2635821880 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e2b4fe22e0 0x55e2b5158a50 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.545 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.541+0000 7ff54cedc980 1 -- 172.21.15.194:0/2635821880 >> 172.21.15.194:0/2635821880 conn(0x55e2b50680a0 msgr2=0x55e2b5154680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:56.545 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.541+0000 7ff54cedc980 1 -- 172.21.15.194:0/2635821880 shutdown_connections 2024-09-13T06:10:56.545 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.541+0000 7ff54cedc980 1 -- 172.21.15.194:0/2635821880 wait complete. 2024-09-13T06:10:56.545 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.541+0000 7ff54cedc980 1 Processor -- start 2024-09-13T06:10:56.545 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.541+0000 7ff54cedc980 1 -- start start 2024-09-13T06:10:56.546 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.541+0000 7ff54cedc980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e2b5071a90 0x55e2b506dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.546 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.541+0000 7ff54cedc980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55e2b5074e40 con 0x55e2b5071a90 2024-09-13T06:10:56.546 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.541+0000 7ff54a9ec640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e2b5071a90 0x55e2b506dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.546 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.541+0000 7ff54a9ec640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e2b5071a90 0x55e2b506dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:38726/0 (socket says 172.21.15.194:38726) 2024-09-13T06:10:56.546 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.541+0000 7ff54a9ec640 1 -- 172.21.15.194:0/1233642743 learned_addr learned my addr 172.21.15.194:0/1233642743 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:56.547 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.541+0000 7ff54a9ec640 1 -- 172.21.15.194:0/1233642743 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2b506e190 con 0x55e2b5071a90 2024-09-13T06:10:56.547 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.541+0000 7ff54a9ec640 1 --2- 172.21.15.194:0/1233642743 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e2b5071a90 0x55e2b506dc50 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7ff53c004000 tx=0x7ff53c000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.547 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.541+0000 7ff437606640 1 -- 172.21.15.194:0/1233642743 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff53c027070 con 0x55e2b5071a90 2024-09-13T06:10:56.547 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.541+0000 7ff54cedc980 1 -- 172.21.15.194:0/1233642743 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e2b506c370 con 0x55e2b5071a90 2024-09-13T06:10:56.547 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.541+0000 7ff54cedc980 1 -- 172.21.15.194:0/1233642743 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2b506c860 con 0x55e2b5071a90 2024-09-13T06:10:56.547 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.541+0000 7ff437606640 1 -- 172.21.15.194:0/1233642743 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff53c0198b0 con 0x55e2b5071a90 2024-09-13T06:10:56.547 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.541+0000 7ff437606640 1 -- 172.21.15.194:0/1233642743 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff53c019bd0 con 0x55e2b5071a90 2024-09-13T06:10:56.549 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.545+0000 7ff437606640 1 -- 172.21.15.194:0/1233642743 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff53c02a070 con 0x55e2b5071a90 2024-09-13T06:10:56.549 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.545+0000 7ff437606640 1 --2- 172.21.15.194:0/1233642743 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff430034650 0x7ff430036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.549 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.545+0000 7ff437606640 1 -- 172.21.15.194:0/1233642743 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7ff53c01f070 con 0x55e2b5071a90 2024-09-13T06:10:56.549 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.545+0000 7ff54a1eb640 1 --2- 172.21.15.194:0/1233642743 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff430034650 0x7ff430036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.549 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.545+0000 7ff54cedc980 1 --2- 172.21.15.194:0/1233642743 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55e2b5167440 0x55e2b5169830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.550 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.545+0000 7ff54cedc980 1 -- 172.21.15.194:0/1233642743 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e2b5169d70 con 0x55e2b5167440 2024-09-13T06:10:56.550 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.545+0000 7ff54b1ed640 1 --2- 172.21.15.194:0/1233642743 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55e2b5167440 0x55e2b5169830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.550 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.545+0000 7ff54a1eb640 1 --2- 172.21.15.194:0/1233642743 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff430034650 0x7ff430036b10 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff5400ad000 tx=0x7ff5400a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.550 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.545+0000 7ff54b1ed640 1 --2- 172.21.15.194:0/1233642743 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55e2b5167440 0x55e2b5169830 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.550 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.545+0000 7ff54b1ed640 1 -- 172.21.15.194:0/1233642743 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff54400a4d0 con 0x55e2b5167440 2024-09-13T06:10:56.550 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.545+0000 7ff54cedc980 1 -- 172.21.15.194:0/1233642743 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e2b516a110 con 0x55e2b5167440 2024-09-13T06:10:56.550 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.545+0000 7ff54b1ed640 1 -- 172.21.15.194:0/1233642743 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff54400a4d0 con 0x55e2b5167440 2024-09-13T06:10:56.550 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.545+0000 7ff54cedc980 1 --2- 172.21.15.194:0/1233642743 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55e2b516bf00 0x55e2b516e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.550 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.545+0000 7ff54cedc980 1 -- 172.21.15.194:0/1233642743 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e2b516e9e0 con 0x55e2b516bf00 2024-09-13T06:10:56.550 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.545+0000 7ff54a9ec640 1 --2- 172.21.15.194:0/1233642743 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55e2b516bf00 0x55e2b516e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.550 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.545+0000 7ff54a9ec640 1 --2- 172.21.15.194:0/1233642743 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55e2b516bf00 0x55e2b516e2f0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.552 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.545+0000 7ff54a9ec640 1 -- 172.21.15.194:0/1233642743 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff53c029030 con 0x55e2b516bf00 2024-09-13T06:10:56.553 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.545+0000 7ff54cedc980 1 -- 172.21.15.194:0/1233642743 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e2b516ada0 con 0x55e2b5167440 2024-09-13T06:10:56.553 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.545+0000 7ff54b1ed640 1 -- 172.21.15.194:0/1233642743 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff54400a4d0 con 0x55e2b5167440 2024-09-13T06:10:56.553 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.545+0000 7ff54cedc980 1 --2- 172.21.15.194:0/1233642743 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55e2b516fe40 0x55e2b5172230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.553 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.545+0000 7ff54cedc980 1 -- 172.21.15.194:0/1233642743 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e2b5172970 con 0x55e2b516fe40 2024-09-13T06:10:56.553 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.545+0000 7ff54a1eb640 1 --2- 172.21.15.194:0/1233642743 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55e2b516fe40 0x55e2b5172230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.553 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.545+0000 7ff54a1eb640 1 --2- 172.21.15.194:0/1233642743 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55e2b516fe40 0x55e2b5172230 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.553 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.545+0000 7ff54a1eb640 1 -- 172.21.15.194:0/1233642743 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff5400b3040 con 0x55e2b516fe40 2024-09-13T06:10:56.553 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.545+0000 7ff54cedc980 1 Processor -- start 2024-09-13T06:10:56.553 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.545+0000 7ff54cedc980 1 -- start start 2024-09-13T06:10:56.553 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.549+0000 7ff54cedc980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e2b5180460 0x55e2b5180880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.553 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.549+0000 7ff54cedc980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55e2b4f74800 con 0x55e2b5180460 2024-09-13T06:10:56.553 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.549+0000 7ff54a9ec640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e2b5180460 0x55e2b5180880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.549+0000 7ff54a9ec640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e2b5180460 0x55e2b5180880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:38734/0 (socket says 172.21.15.194:38734) 2024-09-13T06:10:56.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.549+0000 7ff54a9ec640 1 -- 172.21.15.194:0/1593489461 learned_addr learned my addr 172.21.15.194:0/1593489461 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:56.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.549+0000 7ff54a9ec640 1 -- 172.21.15.194:0/1593489461 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2b5180dc0 con 0x55e2b5180460 2024-09-13T06:10:56.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.549+0000 7ff54a9ec640 1 --2- 172.21.15.194:0/1593489461 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e2b5180460 0x55e2b5180880 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7ff53c048240 tx=0x7ff53c02aab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.549+0000 7ff434e01640 1 -- 172.21.15.194:0/1593489461 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff53c02bde0 con 0x55e2b5180460 2024-09-13T06:10:56.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.549+0000 7ff54cedc980 1 -- 172.21.15.194:0/1593489461 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e2b5181050 con 0x55e2b5180460 2024-09-13T06:10:56.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.549+0000 7ff434e01640 1 -- 172.21.15.194:0/1593489461 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff53c0410c0 con 0x55e2b5180460 2024-09-13T06:10:56.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.549+0000 7ff434e01640 1 -- 172.21.15.194:0/1593489461 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff53c0413e0 con 0x55e2b5180460 2024-09-13T06:10:56.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.549+0000 7ff54cedc980 1 -- 172.21.15.194:0/1593489461 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2b5183cd0 con 0x55e2b5180460 2024-09-13T06:10:56.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.549+0000 7ff434e01640 1 -- 172.21.15.194:0/1593489461 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff53c016070 con 0x55e2b5180460 2024-09-13T06:10:56.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.549+0000 7ff434e01640 1 --2- 172.21.15.194:0/1593489461 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff424034650 0x7ff424036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.549+0000 7ff434e01640 1 -- 172.21.15.194:0/1593489461 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7ff53c03b070 con 0x55e2b5180460 2024-09-13T06:10:56.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.549+0000 7ff54a1eb640 1 --2- 172.21.15.194:0/1593489461 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff424034650 0x7ff424036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.549+0000 7ff54cedc980 1 Processor -- start 2024-09-13T06:10:56.558 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.549+0000 7ff54cedc980 1 -- start start 2024-09-13T06:10:56.558 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.549+0000 7ff54a1eb640 1 --2- 172.21.15.194:0/1593489461 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff424034650 0x7ff424036b10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x55e2b506cb80 tx=0x7ff540005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.558 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.549+0000 7ff54cedc980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e2b518cda0 0x55e2b518d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.558 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.549+0000 7ff54cedc980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55e2b51593a0 con 0x55e2b518cda0 2024-09-13T06:10:56.558 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.549+0000 7ff54a9ec640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e2b518cda0 0x55e2b518d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.558 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.549+0000 7ff54a9ec640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e2b518cda0 0x55e2b518d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:38736/0 (socket says 172.21.15.194:38736) 2024-09-13T06:10:56.558 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.549+0000 7ff54a9ec640 1 -- 172.21.15.194:0/2227459414 learned_addr learned my addr 172.21.15.194:0/2227459414 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:56.558 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.553+0000 7ff54a9ec640 1 -- 172.21.15.194:0/2227459414 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2b518d750 con 0x55e2b518cda0 2024-09-13T06:10:56.558 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.553+0000 7ff54a9ec640 1 --2- 172.21.15.194:0/2227459414 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e2b518cda0 0x55e2b518d180 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7ff53c043010 tx=0x7ff53c02df80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53a841da48573512 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.558 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.553+0000 7ff42e7fc640 1 -- 172.21.15.194:0/2227459414 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff53c017500 con 0x55e2b518cda0 2024-09-13T06:10:56.558 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.553+0000 7ff42e7fc640 1 -- 172.21.15.194:0/2227459414 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff53c05a070 con 0x55e2b518cda0 2024-09-13T06:10:56.558 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.553+0000 7ff42e7fc640 1 -- 172.21.15.194:0/2227459414 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff53c02b4e0 con 0x55e2b518cda0 2024-09-13T06:10:56.558 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.553+0000 7ff54cedc980 1 -- 172.21.15.194:0/2227459414 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e2b518cda0 msgr2=0x55e2b518d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.553+0000 7ff54cedc980 1 --2- 172.21.15.194:0/2227459414 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e2b518cda0 0x55e2b518d180 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7ff53c043010 tx=0x7ff53c02df80 comp rx=0 tx=0).stop 2024-09-13T06:10:56.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.553+0000 7ff54cedc980 1 -- 172.21.15.194:0/2227459414 shutdown_connections 2024-09-13T06:10:56.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.553+0000 7ff54cedc980 1 --2- 172.21.15.194:0/2227459414 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e2b518cda0 0x55e2b518d180 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.553+0000 7ff54cedc980 1 -- 172.21.15.194:0/2227459414 >> 172.21.15.194:0/2227459414 conn(0x55e2b5189180 msgr2=0x55e2b5187280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:56.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.553+0000 7ff54cedc980 1 -- 172.21.15.194:0/2227459414 shutdown_connections 2024-09-13T06:10:56.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.553+0000 7ff54cedc980 1 -- 172.21.15.194:0/2227459414 wait complete. 2024-09-13T06:10:56.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.553+0000 7ff54cedc980 1 Processor -- start 2024-09-13T06:10:56.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.553+0000 7ff54cedc980 1 -- start start 2024-09-13T06:10:56.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.553+0000 7ff54cedc980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e2b518cda0 0x55e2b5193ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.553+0000 7ff54cedc980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55e2b518dbf0 con 0x55e2b518cda0 2024-09-13T06:10:56.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.553+0000 7ff54a9ec640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e2b518cda0 0x55e2b5193ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.553+0000 7ff54a9ec640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e2b518cda0 0x55e2b5193ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:38746/0 (socket says 172.21.15.194:38746) 2024-09-13T06:10:56.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.553+0000 7ff54a9ec640 1 -- 172.21.15.194:0/2116920676 learned_addr learned my addr 172.21.15.194:0/2116920676 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:56.564 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.553+0000 7ff54a9ec640 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2b5194400 con 0x55e2b518cda0 2024-09-13T06:10:56.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.553+0000 7ff54a9ec640 1 --2- 172.21.15.194:0/2116920676 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e2b518cda0 0x55e2b5193ec0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7ff53c034ce0 tx=0x7ff53c032e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.553+0000 7ff42cff9640 1 -- 172.21.15.194:0/2116920676 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff53c051840 con 0x55e2b518cda0 2024-09-13T06:10:56.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.553+0000 7ff42cff9640 1 -- 172.21.15.194:0/2116920676 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff53c04d070 con 0x55e2b518cda0 2024-09-13T06:10:56.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.553+0000 7ff54cedc980 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e2b5194400 con 0x55e2b518cda0 2024-09-13T06:10:56.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.553+0000 7ff42cff9640 1 -- 172.21.15.194:0/2116920676 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff53c051b10 con 0x55e2b518cda0 2024-09-13T06:10:56.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.553+0000 7ff54cedc980 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2b5194400 con 0x55e2b518cda0 2024-09-13T06:10:56.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.557+0000 7ff54cedc980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.557+0000 7ff42cff9640 1 -- 172.21.15.194:0/2116920676 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff53c009070 con 0x55e2b518cda0 2024-09-13T06:10:56.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.557+0000 7ff42cff9640 1 --2- 172.21.15.194:0/2116920676 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff414034650 0x7ff414036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.557+0000 7ff42cff9640 1 -- 172.21.15.194:0/2116920676 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7ff53c014070 con 0x55e2b518cda0 2024-09-13T06:10:56.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.557+0000 7ff54a1eb640 1 --2- 172.21.15.194:0/2116920676 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff414034650 0x7ff414036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.557+0000 7ff54cedc980 1 --2- 172.21.15.194:0/2116920676 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55e2b519ef10 0x55e2b51a13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.566 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.557+0000 7ff54cedc980 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51a1b00 con 0x55e2b519ef10 2024-09-13T06:10:56.566 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.557+0000 7ff54b1ed640 1 --2- 172.21.15.194:0/2116920676 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55e2b519ef10 0x55e2b51a13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.566 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.557+0000 7ff54a1eb640 1 --2- 172.21.15.194:0/2116920676 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff414034650 0x7ff414036b10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff540018eb0 tx=0x7ff5400b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.566 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.557+0000 7ff54b1ed640 1 --2- 172.21.15.194:0/2116920676 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55e2b519ef10 0x55e2b51a13b0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.566 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.557+0000 7ff54b1ed640 1 -- 172.21.15.194:0/2116920676 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff54400a4d0 con 0x55e2b519ef10 2024-09-13T06:10:56.566 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.557+0000 7ff54cedc980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:56.566 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.557+0000 7ff54cedc980 20 realm 2024-09-13T06:10:56.566 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.557+0000 7ff54cedc980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.566 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.557+0000 7ff54cedc980 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51a1f10 con 0x55e2b519ef10 2024-09-13T06:10:56.566 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.557+0000 7ff54b1ed640 1 -- 172.21.15.194:0/2116920676 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff54400a4d0 con 0x55e2b519ef10 2024-09-13T06:10:56.566 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.557+0000 7ff54cedc980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:56.566 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.557+0000 7ff54cedc980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:10:56.566 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.557+0000 7ff54cedc980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.557+0000 7ff54cedc980 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51a27b0 con 0x55e2b519ef10 2024-09-13T06:10:56.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.557+0000 7ff54b1ed640 1 -- 172.21.15.194:0/2116920676 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff54400a4d0 con 0x55e2b519ef10 2024-09-13T06:10:56.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.557+0000 7ff54cedc980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:56.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.557+0000 7ff54cedc980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.557+0000 7ff54cedc980 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51a2b50 con 0x55e2b519ef10 2024-09-13T06:10:56.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.557+0000 7ff54b1ed640 1 -- 172.21.15.194:0/2116920676 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff54400a4d0 con 0x55e2b519ef10 2024-09-13T06:10:56.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.557+0000 7ff54cedc980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:10:56.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.557+0000 7ff54cedc980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.557+0000 7ff54cedc980 1 --2- 172.21.15.194:0/2116920676 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55e2b51a38b0 0x55e2b51a5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.557+0000 7ff54cedc980 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51a6220 con 0x55e2b51a38b0 2024-09-13T06:10:56.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.557+0000 7ff54a9ec640 1 --2- 172.21.15.194:0/2116920676 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55e2b51a38b0 0x55e2b51a5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.557+0000 7ff54a9ec640 1 --2- 172.21.15.194:0/2116920676 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55e2b51a38b0 0x55e2b51a5ca0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.557+0000 7ff54a9ec640 1 -- 172.21.15.194:0/2116920676 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff53c068070 con 0x55e2b51a38b0 2024-09-13T06:10:56.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.557+0000 7ff54cedc980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:10:56.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.557+0000 7ff54cedc980 20 searching for the correct realm 2024-09-13T06:10:56.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.557+0000 7ff54cedc980 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51a7a80 con 0x55e2b51a38b0 2024-09-13T06:10:56.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.557+0000 7ff54a9ec640 1 -- 172.21.15.194:0/2116920676 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff53c068070 con 0x55e2b51a38b0 2024-09-13T06:10:56.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.557+0000 7ff54a9ec640 1 --2- 172.21.15.194:0/2116920676 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7ff53c02c060 0x7ff53c010850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.557+0000 7ff54a9ec640 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51a7a80 con 0x7ff53c02c060 2024-09-13T06:10:56.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.557+0000 7ff54a1eb640 1 --2- 172.21.15.194:0/2116920676 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7ff53c02c060 0x7ff53c010850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.557+0000 7ff54a1eb640 1 --2- 172.21.15.194:0/2116920676 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7ff53c02c060 0x7ff53c010850 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.557+0000 7ff54a1eb640 1 -- 172.21.15.194:0/2116920676 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff5400c9030 con 0x7ff53c02c060 2024-09-13T06:10:56.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.557+0000 7ff54a1eb640 1 --2- 172.21.15.194:0/2116920676 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7ff5400dc040 0x7ff5400dd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.557+0000 7ff54a1eb640 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51a7a80 con 0x7ff5400dc040 2024-09-13T06:10:56.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.557+0000 7ff54b1ed640 1 --2- 172.21.15.194:0/2116920676 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7ff5400dc040 0x7ff5400dd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.569 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.561+0000 7ff54b1ed640 1 --2- 172.21.15.194:0/2116920676 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7ff5400dc040 0x7ff5400dd430 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.569 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.561+0000 7ff54b1ed640 1 -- 172.21.15.194:0/2116920676 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff54400a4d0 con 0x7ff5400dc040 2024-09-13T06:10:56.569 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.561+0000 7ff54b1ed640 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51a2b50 con 0x55e2b519ef10 2024-09-13T06:10:56.569 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.561+0000 7ff54b1ed640 1 -- 172.21.15.194:0/2116920676 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff54400a4d0 con 0x55e2b519ef10 2024-09-13T06:10:56.569 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.561+0000 7ff54b1ed640 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51a2b50 con 0x55e2b519ef10 2024-09-13T06:10:56.569 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.561+0000 7ff54b1ed640 1 -- 172.21.15.194:0/2116920676 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff54400a4d0 con 0x55e2b519ef10 2024-09-13T06:10:56.569 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.561+0000 7ff54b1ed640 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51a2b50 con 0x7ff5400dc040 2024-09-13T06:10:56.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.561+0000 7ff54b1ed640 1 -- 172.21.15.194:0/2116920676 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff54400a4d0 con 0x7ff5400dc040 2024-09-13T06:10:56.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.561+0000 7ff54b1ed640 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51a2b50 con 0x7ff5400dc040 2024-09-13T06:10:56.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.561+0000 7ff54b1ed640 1 -- 172.21.15.194:0/2116920676 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff54400a4d0 con 0x7ff5400dc040 2024-09-13T06:10:56.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.561+0000 7ff54b1ed640 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51a2b50 con 0x7ff53c02c060 2024-09-13T06:10:56.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.561+0000 7ff54a1eb640 1 -- 172.21.15.194:0/2116920676 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5400c9030 con 0x7ff53c02c060 2024-09-13T06:10:56.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.561+0000 7ff54a1eb640 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51a2b50 con 0x55e2b51a38b0 2024-09-13T06:10:56.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.561+0000 7ff54a9ec640 1 -- 172.21.15.194:0/2116920676 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff53c068070 con 0x55e2b51a38b0 2024-09-13T06:10:56.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.561+0000 7ff54a9ec640 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51a2b50 con 0x55e2b519ef10 2024-09-13T06:10:56.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.561+0000 7ff54b1ed640 1 -- 172.21.15.194:0/2116920676 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff54400a4d0 con 0x55e2b519ef10 2024-09-13T06:10:56.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.561+0000 7ff54b1ed640 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51a2b50 con 0x7ff5400dc040 2024-09-13T06:10:56.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.561+0000 7ff54b1ed640 1 -- 172.21.15.194:0/2116920676 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff54400a4d0 con 0x7ff5400dc040 2024-09-13T06:10:56.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.561+0000 7ff54b1ed640 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51a2b50 con 0x55e2b519ef10 2024-09-13T06:10:56.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.565+0000 7ff54b1ed640 1 -- 172.21.15.194:0/2116920676 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff54400a4d0 con 0x55e2b519ef10 2024-09-13T06:10:56.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.565+0000 7ff54b1ed640 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51a2b50 con 0x7ff53c02c060 2024-09-13T06:10:56.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.565+0000 7ff54a1eb640 1 -- 172.21.15.194:0/2116920676 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff5400c9030 con 0x7ff53c02c060 2024-09-13T06:10:56.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.565+0000 7ff54a1eb640 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51a2b50 con 0x55e2b51a38b0 2024-09-13T06:10:56.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.565+0000 7ff54a9ec640 1 -- 172.21.15.194:0/2116920676 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff53c068070 con 0x55e2b51a38b0 2024-09-13T06:10:56.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.565+0000 7ff54a9ec640 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51a2b50 con 0x55e2b51a38b0 2024-09-13T06:10:56.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.565+0000 7ff54a9ec640 1 -- 172.21.15.194:0/2116920676 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff53c068070 con 0x55e2b51a38b0 2024-09-13T06:10:56.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.565+0000 7ff54a9ec640 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51a2b50 con 0x7ff5400dc040 2024-09-13T06:10:56.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.565+0000 7ff54b1ed640 1 -- 172.21.15.194:0/2116920676 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff54400a4d0 con 0x7ff5400dc040 2024-09-13T06:10:56.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.565+0000 7ff54b1ed640 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51a2b50 con 0x55e2b51a38b0 2024-09-13T06:10:56.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.565+0000 7ff54a9ec640 1 -- 172.21.15.194:0/2116920676 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff53c068070 con 0x55e2b51a38b0 2024-09-13T06:10:56.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.565+0000 7ff54a9ec640 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51a2b50 con 0x55e2b51a38b0 2024-09-13T06:10:56.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.565+0000 7ff54a9ec640 1 -- 172.21.15.194:0/2116920676 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff53c068070 con 0x55e2b51a38b0 2024-09-13T06:10:56.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.565+0000 7ff54a9ec640 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51a2b50 con 0x55e2b519ef10 2024-09-13T06:10:56.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.565+0000 7ff54b1ed640 1 -- 172.21.15.194:0/2116920676 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff54400a4d0 con 0x55e2b519ef10 2024-09-13T06:10:56.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.565+0000 7ff54b1ed640 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51a2b50 con 0x55e2b519ef10 2024-09-13T06:10:56.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.565+0000 7ff54b1ed640 1 -- 172.21.15.194:0/2116920676 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff54400a4d0 con 0x55e2b519ef10 2024-09-13T06:10:56.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.565+0000 7ff54b1ed640 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51a2b50 con 0x7ff53c02c060 2024-09-13T06:10:56.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.565+0000 7ff54a1eb640 1 -- 172.21.15.194:0/2116920676 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5400c9030 con 0x7ff53c02c060 2024-09-13T06:10:56.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.565+0000 7ff54a1eb640 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51a2b50 con 0x55e2b51a38b0 2024-09-13T06:10:56.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.565+0000 7ff54a9ec640 1 -- 172.21.15.194:0/2116920676 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff53c068070 con 0x55e2b51a38b0 2024-09-13T06:10:56.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.565+0000 7ff54a9ec640 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51a2b50 con 0x7ff53c02c060 2024-09-13T06:10:56.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.565+0000 7ff54a1eb640 1 -- 172.21.15.194:0/2116920676 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5400c9030 con 0x7ff53c02c060 2024-09-13T06:10:56.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.565+0000 7ff54a1eb640 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51a2b50 con 0x55e2b519ef10 2024-09-13T06:10:56.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.565+0000 7ff54b1ed640 1 -- 172.21.15.194:0/2116920676 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff54400a4d0 con 0x55e2b519ef10 2024-09-13T06:10:56.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.565+0000 7ff54b1ed640 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51a2b50 con 0x7ff5400dc040 2024-09-13T06:10:56.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.565+0000 7ff54b1ed640 1 -- 172.21.15.194:0/2116920676 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff54400a4d0 con 0x7ff5400dc040 2024-09-13T06:10:56.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.565+0000 7ff54b1ed640 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51a2b50 con 0x55e2b51a38b0 2024-09-13T06:10:56.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.565+0000 7ff54a9ec640 1 -- 172.21.15.194:0/2116920676 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff53c068070 con 0x55e2b51a38b0 2024-09-13T06:10:56.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.565+0000 7ff54a9ec640 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51a2b50 con 0x7ff53c02c060 2024-09-13T06:10:56.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.569+0000 7ff54a1eb640 1 -- 172.21.15.194:0/2116920676 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5400c9030 con 0x7ff53c02c060 2024-09-13T06:10:56.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.569+0000 7ff54a1eb640 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51a2b50 con 0x7ff53c02c060 2024-09-13T06:10:56.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.569+0000 7ff54a1eb640 1 -- 172.21.15.194:0/2116920676 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5400c9030 con 0x7ff53c02c060 2024-09-13T06:10:56.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.569+0000 7ff54a1eb640 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51a2b50 con 0x55e2b51a38b0 2024-09-13T06:10:56.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.569+0000 7ff54a9ec640 1 -- 172.21.15.194:0/2116920676 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff53c068070 con 0x55e2b51a38b0 2024-09-13T06:10:56.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.569+0000 7ff54a9ec640 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51a2b50 con 0x7ff5400dc040 2024-09-13T06:10:56.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.569+0000 7ff54b1ed640 1 -- 172.21.15.194:0/2116920676 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff54400a4d0 con 0x7ff5400dc040 2024-09-13T06:10:56.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.569+0000 7ff54b1ed640 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51a2b50 con 0x55e2b519ef10 2024-09-13T06:10:56.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.569+0000 7ff54b1ed640 1 -- 172.21.15.194:0/2116920676 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff54400a4d0 con 0x55e2b519ef10 2024-09-13T06:10:56.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.569+0000 7ff54b1ed640 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51a2b50 con 0x7ff53c02c060 2024-09-13T06:10:56.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.569+0000 7ff54a1eb640 1 -- 172.21.15.194:0/2116920676 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5400c9030 con 0x7ff53c02c060 2024-09-13T06:10:56.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.569+0000 7ff54cedc980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:10:56.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.569+0000 7ff54cedc980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:10:56.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.569+0000 7ff54cedc980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:10:56.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.569+0000 7ff54cedc980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:10:56.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.569+0000 7ff54cedc980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:10:56.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.569+0000 7ff54cedc980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:10:56.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.569+0000 7ff54cedc980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.569+0000 7ff54cedc980 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51a6b70 con 0x55e2b519ef10 2024-09-13T06:10:56.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.569+0000 7ff54b1ed640 1 -- 172.21.15.194:0/2116920676 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff54400a4d0 con 0x55e2b519ef10 2024-09-13T06:10:56.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.569+0000 7ff54cedc980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:56.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.569+0000 7ff54cedc980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.569+0000 7ff54cedc980 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51a7410 con 0x55e2b519ef10 2024-09-13T06:10:56.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.569+0000 7ff54b1ed640 1 -- 172.21.15.194:0/2116920676 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff54400a4d0 con 0x55e2b519ef10 2024-09-13T06:10:56.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.569+0000 7ff54cedc980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:10:56.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.569+0000 7ff54cedc980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.569+0000 7ff54cedc980 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51a67b0 con 0x7ff53c02c060 2024-09-13T06:10:56.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.569+0000 7ff54a1eb640 1 -- 172.21.15.194:0/2116920676 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff5400c9030 con 0x7ff53c02c060 2024-09-13T06:10:56.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.569+0000 7ff54cedc980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:10:56.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.569+0000 7ff54cedc980 20 zone default found 2024-09-13T06:10:56.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.569+0000 7ff54cedc980 4 Realm: () 2024-09-13T06:10:56.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.569+0000 7ff54cedc980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:10:56.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.569+0000 7ff54cedc980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:10:56.583 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.569+0000 7ff54cedc980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:10:56.583 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.569+0000 7ff54cedc980 20 zonegroup default 2024-09-13T06:10:56.583 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.569+0000 7ff54cedc980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.583 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.569+0000 7ff54cedc980 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51a7410 con 0x7ff5400dc040 2024-09-13T06:10:56.583 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.569+0000 7ff54b1ed640 1 -- 172.21.15.194:0/2116920676 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff54400a4d0 con 0x7ff5400dc040 2024-09-13T06:10:56.583 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.569+0000 7ff54cedc980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:56.583 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.569+0000 7ff54cedc980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.583 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.569+0000 7ff54cedc980 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51a9930 con 0x55e2b51a38b0 2024-09-13T06:10:56.583 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.569+0000 7ff54a9ec640 1 -- 172.21.15.194:0/2116920676 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff53c068070 con 0x55e2b51a38b0 2024-09-13T06:10:56.583 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.569+0000 7ff54cedc980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:56.583 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.569+0000 7ff54cedc980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.583 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.569+0000 7ff54cedc980 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51a9cd0 con 0x55e2b51a38b0 2024-09-13T06:10:56.583 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.569+0000 7ff54a9ec640 1 -- 172.21.15.194:0/2116920676 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff53c068070 con 0x55e2b51a38b0 2024-09-13T06:10:56.584 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.569+0000 7ff54cedc980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:56.584 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.569+0000 7ff54cedc980 20 started sync module instance, tier type = 2024-09-13T06:10:56.584 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.569+0000 7ff54cedc980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:10:56.584 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.569+0000 7ff54cedc980 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51a8dd0 con 0x7ff53c02c060 2024-09-13T06:10:56.584 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.573+0000 7ff54a1eb640 1 -- 172.21.15.194:0/2116920676 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(44 notify.0 [create] v35'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5400c9030 con 0x7ff53c02c060 2024-09-13T06:10:56.584 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.573+0000 7ff54cedc980 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94432189387248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51aa180 con 0x7ff53c02c060 2024-09-13T06:10:56.584 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.573+0000 7ff54cedc980 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51aa9d0 con 0x55e2b519ef10 2024-09-13T06:10:56.586 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.573+0000 7ff54a1eb640 1 -- 172.21.15.194:0/2116920676 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94432189387248] v35'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5400c9030 con 0x7ff53c02c060 2024-09-13T06:10:56.586 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.573+0000 7ff54b1ed640 1 -- 172.21.15.194:0/2116920676 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v35'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff54400a4d0 con 0x55e2b519ef10 2024-09-13T06:10:56.586 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.573+0000 7ff54cedc980 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94432189390032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51aa9d0 con 0x55e2b519ef10 2024-09-13T06:10:56.586 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.573+0000 7ff54cedc980 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51ab470 con 0x55e2b51a38b0 2024-09-13T06:10:56.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.577+0000 7ff54b1ed640 1 -- 172.21.15.194:0/2116920676 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94432189390032] v35'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff54400a4d0 con 0x55e2b519ef10 2024-09-13T06:10:56.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.577+0000 7ff54a9ec640 1 -- 172.21.15.194:0/2116920676 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v35'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff53c068070 con 0x55e2b51a38b0 2024-09-13T06:10:56.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.577+0000 7ff54cedc980 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94432189394752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51aa9d0 con 0x55e2b51a38b0 2024-09-13T06:10:56.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.577+0000 7ff54cedc980 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51abe80 con 0x7ff53c02c060 2024-09-13T06:10:56.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.577+0000 7ff54a1eb640 1 -- 172.21.15.194:0/2116920676 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(50 notify.3 [create] v35'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5400c9030 con 0x7ff53c02c060 2024-09-13T06:10:56.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.577+0000 7ff54cedc980 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94432189397456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51ac720 con 0x7ff53c02c060 2024-09-13T06:10:56.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.577+0000 7ff54cedc980 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51ad140 con 0x55e2b519ef10 2024-09-13T06:10:56.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.577+0000 7ff54a9ec640 1 -- 172.21.15.194:0/2116920676 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94432189394752] v35'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff53c068070 con 0x55e2b51a38b0 2024-09-13T06:10:56.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.577+0000 7ff54a1eb640 1 -- 172.21.15.194:0/2116920676 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94432189397456] v35'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5400c9030 con 0x7ff53c02c060 2024-09-13T06:10:56.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.581+0000 7ff54b1ed640 1 -- 172.21.15.194:0/2116920676 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v35'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff54400a4d0 con 0x55e2b519ef10 2024-09-13T06:10:56.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.581+0000 7ff54cedc980 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94432189402160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51ac270 con 0x55e2b519ef10 2024-09-13T06:10:56.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.581+0000 7ff54cedc980 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51ad9e0 con 0x7ff5400dc040 2024-09-13T06:10:56.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.581+0000 7ff54b1ed640 1 -- 172.21.15.194:0/2116920676 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94432189402160] v35'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff54400a4d0 con 0x55e2b519ef10 2024-09-13T06:10:56.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.581+0000 7ff54b1ed640 1 -- 172.21.15.194:0/2116920676 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(54 notify.5 [create] v35'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff54400a4d0 con 0x7ff5400dc040 2024-09-13T06:10:56.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.581+0000 7ff54cedc980 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94432189392160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51ac270 con 0x7ff5400dc040 2024-09-13T06:10:56.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.581+0000 7ff54cedc980 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51ade90 con 0x7ff5400dc040 2024-09-13T06:10:56.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.585+0000 7ff54b1ed640 1 -- 172.21.15.194:0/2116920676 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(56 notify.6 [create] v35'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff54400a4d0 con 0x7ff5400dc040 2024-09-13T06:10:56.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.585+0000 7ff54cedc980 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94432189405600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51ae2b0 con 0x7ff5400dc040 2024-09-13T06:10:56.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.585+0000 7ff54cedc980 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51aedc0 con 0x7ff5400dc040 2024-09-13T06:10:56.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.585+0000 7ff54b1ed640 1 -- 172.21.15.194:0/2116920676 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94432189392160] v35'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff54400a4d0 con 0x7ff5400dc040 2024-09-13T06:10:56.594 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.585+0000 7ff54b1ed640 1 -- 172.21.15.194:0/2116920676 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94432189405600] v35'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff54400a4d0 con 0x7ff5400dc040 2024-09-13T06:10:56.594 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.585+0000 7ff54b1ed640 1 -- 172.21.15.194:0/2116920676 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(58 notify.7 [create] v35'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff54400a4d0 con 0x7ff5400dc040 2024-09-13T06:10:56.594 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.585+0000 7ff54cedc980 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94432189409392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51ad330 con 0x7ff5400dc040 2024-09-13T06:10:56.594 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.585+0000 7ff54cedc980 20 add_watcher() i=0 2024-09-13T06:10:56.594 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.585+0000 7ff54cedc980 20 add_watcher() i=1 2024-09-13T06:10:56.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.585+0000 7ff54cedc980 20 add_watcher() i=2 2024-09-13T06:10:56.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.585+0000 7ff54cedc980 20 add_watcher() i=3 2024-09-13T06:10:56.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.585+0000 7ff54cedc980 20 add_watcher() i=4 2024-09-13T06:10:56.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.585+0000 7ff54cedc980 20 add_watcher() i=5 2024-09-13T06:10:56.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.585+0000 7ff54cedc980 20 add_watcher() i=6 2024-09-13T06:10:56.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.589+0000 7ff54b1ed640 1 -- 172.21.15.194:0/2116920676 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94432189409392] v35'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff54400a4d0 con 0x7ff5400dc040 2024-09-13T06:10:56.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.589+0000 7ff54cedc980 20 add_watcher() i=7 2024-09-13T06:10:56.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.589+0000 7ff54cedc980 2 all 8 watchers are set, enabling cache 2024-09-13T06:10:56.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.589+0000 7ff54cedc980 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51b1db0 con 0x55e2b519ef10 2024-09-13T06:10:56.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.589+0000 7ff54b1ed640 1 -- 172.21.15.194:0/2116920676 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff54400a4d0 con 0x55e2b519ef10 2024-09-13T06:10:56.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.589+0000 7ff54cedc980 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94432189406656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51af230 con 0x55e2b519ef10 2024-09-13T06:10:56.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.589+0000 7ff54b1ed640 1 -- 172.21.15.194:0/2116920676 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94432189406656] v35'208 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff54400a4d0 con 0x55e2b519ef10 2024-09-13T06:10:56.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.589+0000 7ff4017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:10:56.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.589+0000 7ff54cedc980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:10:56.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.589+0000 7ff54cedc980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:10:56.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.589+0000 7ff54cedc980 5 note: GC not initialized 2024-09-13T06:10:56.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.589+0000 7ff37bfff640 20 reqs_thread_entry: start 2024-09-13T06:10:56.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.589+0000 7ff54cedc980 20 init_complete bucket index max shards: 11 2024-09-13T06:10:56.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.589+0000 7ff54cedc980 20 Filter name: none 2024-09-13T06:10:56.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.589+0000 7ff379ffb640 20 reqs_thread_entry: start 2024-09-13T06:10:56.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.589+0000 7ff54cedc980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.589+0000 7ff54cedc980 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51d4e20 con 0x55e2b519ef10 2024-09-13T06:10:56.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.589+0000 7ff54b1ed640 1 -- 172.21.15.194:0/2116920676 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv23 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7ff54400a4d0 con 0x55e2b519ef10 2024-09-13T06:10:56.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.589+0000 7ff54cedc980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T06:10:56.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.589+0000 7ff54cedc980 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51d6370 con 0x7ff5400dc040 2024-09-13T06:10:56.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.593+0000 7ff54b1ed640 1 -- 172.21.15.194:0/2116920676 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv30 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7ff54400a4d0 con 0x7ff5400dc040 2024-09-13T06:10:56.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.593+0000 7ff4017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:10:56.598 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.593+0000 7ff54cedc980 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94432189406656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51b41d0 con 0x55e2b519ef10 2024-09-13T06:10:56.598 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.593+0000 7ff54b1ed640 1 -- 172.21.15.194:0/2116920676 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94432189406656] v35'209 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff54400a4d0 con 0x55e2b519ef10 2024-09-13T06:10:56.598 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.593+0000 7ff54cedc980 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94432189387248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51addc0 con 0x7ff53c02c060 2024-09-13T06:10:56.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.593+0000 7ff54a1eb640 1 -- 172.21.15.194:0/2116920676 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94432189387248] v35'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5400c9030 con 0x7ff53c02c060 2024-09-13T06:10:56.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.593+0000 7ff54cedc980 20 remove_watcher() i=0 2024-09-13T06:10:56.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.593+0000 7ff54cedc980 2 removed watcher, disabling cache 2024-09-13T06:10:56.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.593+0000 7ff54cedc980 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94432189390032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51a91f0 con 0x55e2b519ef10 2024-09-13T06:10:56.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.597+0000 7ff54b1ed640 1 -- 172.21.15.194:0/2116920676 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94432189390032] v35'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff54400a4d0 con 0x55e2b519ef10 2024-09-13T06:10:56.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.597+0000 7ff54cedc980 20 remove_watcher() i=1 2024-09-13T06:10:56.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.597+0000 7ff54cedc980 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94432189394752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51a9cd0 con 0x55e2b51a38b0 2024-09-13T06:10:56.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.597+0000 7ff54a9ec640 1 -- 172.21.15.194:0/2116920676 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94432189394752] v35'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff53c068070 con 0x55e2b51a38b0 2024-09-13T06:10:56.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.597+0000 7ff54cedc980 20 remove_watcher() i=2 2024-09-13T06:10:56.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.597+0000 7ff54cedc980 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94432189397456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51aaf40 con 0x7ff53c02c060 2024-09-13T06:10:56.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.601+0000 7ff54a1eb640 1 -- 172.21.15.194:0/2116920676 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94432189397456] v35'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5400c9030 con 0x7ff53c02c060 2024-09-13T06:10:56.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.601+0000 7ff54cedc980 20 remove_watcher() i=3 2024-09-13T06:10:56.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.601+0000 7ff54cedc980 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94432189402160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51ab9d0 con 0x55e2b519ef10 2024-09-13T06:10:56.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.601+0000 7ff54b1ed640 1 -- 172.21.15.194:0/2116920676 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94432189402160] v35'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff54400a4d0 con 0x55e2b519ef10 2024-09-13T06:10:56.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.601+0000 7ff54cedc980 20 remove_watcher() i=4 2024-09-13T06:10:56.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.601+0000 7ff54cedc980 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94432189392160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51ab9d0 con 0x7ff5400dc040 2024-09-13T06:10:56.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.605+0000 7ff54b1ed640 1 -- 172.21.15.194:0/2116920676 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94432189392160] v35'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff54400a4d0 con 0x7ff5400dc040 2024-09-13T06:10:56.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.605+0000 7ff54cedc980 20 remove_watcher() i=5 2024-09-13T06:10:56.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.605+0000 7ff54cedc980 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94432189405600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51ab9d0 con 0x7ff5400dc040 2024-09-13T06:10:56.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.605+0000 7ff54b1ed640 1 -- 172.21.15.194:0/2116920676 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94432189405600] v35'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff54400a4d0 con 0x7ff5400dc040 2024-09-13T06:10:56.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.605+0000 7ff54cedc980 20 remove_watcher() i=6 2024-09-13T06:10:56.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.605+0000 7ff54cedc980 1 -- 172.21.15.194:0/2116920676 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94432189409392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e2b51ade50 con 0x7ff5400dc040 2024-09-13T06:10:56.614 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.609+0000 7ff54b1ed640 1 -- 172.21.15.194:0/2116920676 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94432189409392] v35'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff54400a4d0 con 0x7ff5400dc040 2024-09-13T06:10:56.614 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.609+0000 7ff54cedc980 20 remove_watcher() i=7 2024-09-13T06:10:56.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.609+0000 7ff54cedc980 1 -- 172.21.15.194:0/2116920676 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7ff5400dc040 msgr2=0x7ff5400dd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.609+0000 7ff54cedc980 1 --2- 172.21.15.194:0/2116920676 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7ff5400dc040 0x7ff5400dd430 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.609+0000 7ff54cedc980 1 -- 172.21.15.194:0/2116920676 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55e2b519ef10 msgr2=0x55e2b51a13b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.609+0000 7ff54cedc980 1 --2- 172.21.15.194:0/2116920676 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55e2b519ef10 0x55e2b51a13b0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.609+0000 7ff54cedc980 1 -- 172.21.15.194:0/2116920676 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7ff53c02c060 msgr2=0x7ff53c010850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.609+0000 7ff54cedc980 1 --2- 172.21.15.194:0/2116920676 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7ff53c02c060 0x7ff53c010850 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.609+0000 7ff54cedc980 1 -- 172.21.15.194:0/2116920676 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55e2b51a38b0 msgr2=0x55e2b51a5ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.609+0000 7ff54cedc980 1 --2- 172.21.15.194:0/2116920676 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55e2b51a38b0 0x55e2b51a5ca0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.609+0000 7ff54cedc980 1 -- 172.21.15.194:0/2116920676 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff414034650 msgr2=0x7ff414036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.609+0000 7ff54cedc980 1 --2- 172.21.15.194:0/2116920676 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff414034650 0x7ff414036b10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff540018eb0 tx=0x7ff5400b9040 comp rx=0 tx=0).stop 2024-09-13T06:10:56.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.609+0000 7ff54cedc980 1 -- 172.21.15.194:0/2116920676 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e2b518cda0 msgr2=0x55e2b5193ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.609+0000 7ff54b1ed640 1 -- 172.21.15.194:0/2116920676 reap_dead start 2024-09-13T06:10:56.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.609+0000 7ff54cedc980 1 --2- 172.21.15.194:0/2116920676 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e2b518cda0 0x55e2b5193ec0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7ff53c034ce0 tx=0x7ff53c032e90 comp rx=0 tx=0).stop 2024-09-13T06:10:56.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.609+0000 7ff54cedc980 1 -- 172.21.15.194:0/2116920676 shutdown_connections 2024-09-13T06:10:56.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.609+0000 7ff54cedc980 1 --2- 172.21.15.194:0/2116920676 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e2b518cda0 0x55e2b5193ec0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.609+0000 7ff54cedc980 1 -- 172.21.15.194:0/2116920676 >> 172.21.15.194:0/2116920676 conn(0x55e2b5189180 msgr2=0x55e2b5187250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:56.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.609+0000 7ff54cedc980 1 -- 172.21.15.194:0/2116920676 shutdown_connections 2024-09-13T06:10:56.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.609+0000 7ff54cedc980 1 -- 172.21.15.194:0/2116920676 wait complete. 2024-09-13T06:10:56.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.609+0000 7ff54cedc980 1 -- 172.21.15.194:0/1593489461 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff424034650 msgr2=0x7ff424036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.609+0000 7ff54cedc980 1 --2- 172.21.15.194:0/1593489461 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff424034650 0x7ff424036b10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x55e2b506cb80 tx=0x7ff540005a10 comp rx=0 tx=0).stop 2024-09-13T06:10:56.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.609+0000 7ff54cedc980 1 -- 172.21.15.194:0/1593489461 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e2b5180460 msgr2=0x55e2b5180880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.609+0000 7ff54cedc980 1 --2- 172.21.15.194:0/1593489461 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e2b5180460 0x55e2b5180880 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7ff53c048240 tx=0x7ff53c02aab0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.609+0000 7ff54cedc980 1 -- 172.21.15.194:0/1593489461 shutdown_connections 2024-09-13T06:10:56.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.609+0000 7ff54cedc980 1 --2- 172.21.15.194:0/1593489461 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff424034650 0x7ff424036b10 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.609+0000 7ff54cedc980 1 --2- 172.21.15.194:0/1593489461 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e2b5180460 0x55e2b5180880 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.609+0000 7ff54cedc980 1 -- 172.21.15.194:0/1593489461 >> 172.21.15.194:0/1593489461 conn(0x55e2b51755b0 msgr2=0x55e2b5178030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:56.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.609+0000 7ff54cedc980 1 -- 172.21.15.194:0/1593489461 shutdown_connections 2024-09-13T06:10:56.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.609+0000 7ff54cedc980 1 -- 172.21.15.194:0/1593489461 wait complete. 2024-09-13T06:10:56.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.609+0000 7ff54cedc980 1 -- 172.21.15.194:0/1233642743 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55e2b5167440 msgr2=0x55e2b5169830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.609+0000 7ff54cedc980 1 --2- 172.21.15.194:0/1233642743 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55e2b5167440 0x55e2b5169830 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.609+0000 7ff54cedc980 1 -- 172.21.15.194:0/1233642743 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55e2b516fe40 msgr2=0x55e2b5172230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.609+0000 7ff54cedc980 1 --2- 172.21.15.194:0/1233642743 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55e2b516fe40 0x55e2b5172230 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.609+0000 7ff54cedc980 1 -- 172.21.15.194:0/1233642743 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55e2b516bf00 msgr2=0x55e2b516e2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.609+0000 7ff54cedc980 1 --2- 172.21.15.194:0/1233642743 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55e2b516bf00 0x55e2b516e2f0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.609+0000 7ff54cedc980 1 -- 172.21.15.194:0/1233642743 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff430034650 msgr2=0x7ff430036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.609+0000 7ff54cedc980 1 --2- 172.21.15.194:0/1233642743 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff430034650 0x7ff430036b10 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff5400ad000 tx=0x7ff5400a5040 comp rx=0 tx=0).stop 2024-09-13T06:10:56.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.609+0000 7ff54cedc980 1 -- 172.21.15.194:0/1233642743 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e2b5071a90 msgr2=0x55e2b506dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.609+0000 7ff54cedc980 1 --2- 172.21.15.194:0/1233642743 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e2b5071a90 0x55e2b506dc50 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7ff53c004000 tx=0x7ff53c000bd0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.609+0000 7ff54b1ed640 1 -- 172.21.15.194:0/1233642743 reap_dead start 2024-09-13T06:10:56.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.609+0000 7ff54cedc980 1 -- 172.21.15.194:0/1233642743 shutdown_connections 2024-09-13T06:10:56.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.609+0000 7ff54cedc980 1 -- 172.21.15.194:0/1233642743 >> 172.21.15.194:0/1233642743 conn(0x55e2b50680a0 msgr2=0x55e2b5153200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:56.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.609+0000 7ff54cedc980 1 -- 172.21.15.194:0/1233642743 shutdown_connections 2024-09-13T06:10:56.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.609+0000 7ff54cedc980 1 -- 172.21.15.194:0/1233642743 wait complete. 2024-09-13T06:10:56.623 INFO:teuthology.orchestra.run.smithi194.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1}]},{"bucket":"myfoo2","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-09-13T06:00:00.000000Z","epoch":1726207200,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}],"total":{"bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}}]} 2024-09-13T06:10:56.623 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}]}, {'bucket': 'myfoo2', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}], 'total': {'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}}]} 2024-09-13T06:10:56.623 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-09-13T06:10:56.624 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-09-13T06:10:56.624 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid bar --display-name Bar --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --max-buckets 4 2024-09-13T06:10:56.701 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:10:56.702 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:10:56.703 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.697+0000 7fc4c4862980 1 Processor -- start 2024-09-13T06:10:56.703 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.697+0000 7fc4c4862980 1 -- start start 2024-09-13T06:10:56.703 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.697+0000 7fc4c4862980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x559d04c8db00 0x559d04c8fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.703 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.697+0000 7fc4c4862980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559d04b11ae0 con 0x559d04bfe2d0 2024-09-13T06:10:56.704 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.697+0000 7fc4c4862980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x559d04b35e30 con 0x559d04c8db00 2024-09-13T06:10:56.704 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.697+0000 7fc4c1b71640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x559d04c8db00 0x559d04c8fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.704 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.697+0000 7fc4c1b71640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x559d04c8db00 0x559d04c8fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:38756/0 (socket says 172.21.15.194:38756) 2024-09-13T06:10:56.704 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.697+0000 7fc4c2372640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x559d04bfe2d0 0x559d04c8c3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:34414/0 (socket says 172.21.15.194:34414) 2024-09-13T06:10:56.704 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.697+0000 7fc4c1b71640 1 -- 172.21.15.194:0/412081321 learned_addr learned my addr 172.21.15.194:0/412081321 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:56.704 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.701+0000 7fc4c1b71640 1 -- 172.21.15.194:0/412081321 >> v1:172.21.15.120:6789/0 conn(0x559d04bfe2d0 legacy=0x559d04c8c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.705 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.701+0000 7fc4c1b71640 1 -- 172.21.15.194:0/412081321 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d04bfe860 con 0x559d04c8db00 2024-09-13T06:10:56.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.701+0000 7fc4c1b71640 1 --2- 172.21.15.194:0/412081321 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559d04c8db00 0x559d04c8fef0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fc4b800a5c0 tx=0x7fc4b801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd03ef7826b0b168 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.701+0000 7fc4c1370640 1 -- 172.21.15.194:0/412081321 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4b80a6070 con 0x559d04c8db00 2024-09-13T06:10:56.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.701+0000 7fc4c1370640 1 -- 172.21.15.194:0/412081321 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4b80af070 con 0x559d04c8db00 2024-09-13T06:10:56.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.701+0000 7fc4c1370640 1 -- 172.21.15.194:0/412081321 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4b80aa5c0 con 0x559d04c8db00 2024-09-13T06:10:56.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.701+0000 7fc4c4862980 1 -- 172.21.15.194:0/412081321 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559d04c8db00 msgr2=0x559d04c8fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.701+0000 7fc4c4862980 1 --2- 172.21.15.194:0/412081321 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559d04c8db00 0x559d04c8fef0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fc4b800a5c0 tx=0x7fc4b801b340 comp rx=0 tx=0).stop 2024-09-13T06:10:56.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.701+0000 7fc4c4862980 1 -- 172.21.15.194:0/412081321 shutdown_connections 2024-09-13T06:10:56.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.701+0000 7fc4c4862980 1 --2- 172.21.15.194:0/412081321 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559d04c8db00 0x559d04c8fef0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.708 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.701+0000 7fc4c4862980 1 -- 172.21.15.194:0/412081321 >> 172.21.15.194:0/412081321 conn(0x559d04c840d0 msgr2=0x559d04c864f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:56.708 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.701+0000 7fc4c4862980 1 -- 172.21.15.194:0/412081321 shutdown_connections 2024-09-13T06:10:56.708 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.701+0000 7fc4c4862980 1 -- 172.21.15.194:0/412081321 wait complete. 2024-09-13T06:10:56.720 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.717+0000 7fc4c4862980 1 Processor -- start 2024-09-13T06:10:56.720 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.717+0000 7fc4c4862980 1 -- start start 2024-09-13T06:10:56.720 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.717+0000 7fc4c4862980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559d04bfe2d0 0x559d04d74b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.720 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.717+0000 7fc4c4862980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x559d04b37200 con 0x559d04bfe2d0 2024-09-13T06:10:56.720 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.717+0000 7fc4c2372640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559d04bfe2d0 0x559d04d74b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.721 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.717+0000 7fc4c2372640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559d04bfe2d0 0x559d04d74b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:38772/0 (socket says 172.21.15.194:38772) 2024-09-13T06:10:56.721 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.717+0000 7fc4c2372640 1 -- 172.21.15.194:0/2271917333 learned_addr learned my addr 172.21.15.194:0/2271917333 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:56.721 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.717+0000 7fc4c2372640 1 -- 172.21.15.194:0/2271917333 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d04d750d0 con 0x559d04bfe2d0 2024-09-13T06:10:56.722 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.717+0000 7fc4c2372640 1 --2- 172.21.15.194:0/2271917333 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559d04bfe2d0 0x559d04d74b00 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc001e50 tx=0x7fc4bc001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9191d875b61aab9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.723 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.717+0000 7fc3b0608640 1 -- 172.21.15.194:0/2271917333 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4bc00e5d0 con 0x559d04bfe2d0 2024-09-13T06:10:56.723 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.717+0000 7fc3b0608640 1 -- 172.21.15.194:0/2271917333 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4bc00e770 con 0x559d04bfe2d0 2024-09-13T06:10:56.723 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.717+0000 7fc3b0608640 1 -- 172.21.15.194:0/2271917333 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4bc00eab0 con 0x559d04bfe2d0 2024-09-13T06:10:56.723 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.717+0000 7fc4c4862980 1 -- 172.21.15.194:0/2271917333 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559d04bfe2d0 msgr2=0x559d04d74b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.723 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.717+0000 7fc4c4862980 1 --2- 172.21.15.194:0/2271917333 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559d04bfe2d0 0x559d04d74b00 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc001e50 tx=0x7fc4bc001e80 comp rx=0 tx=0).stop 2024-09-13T06:10:56.723 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.717+0000 7fc4c4862980 1 -- 172.21.15.194:0/2271917333 shutdown_connections 2024-09-13T06:10:56.723 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.717+0000 7fc4c4862980 1 --2- 172.21.15.194:0/2271917333 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559d04bfe2d0 0x559d04d74b00 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.723 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.717+0000 7fc4c4862980 1 -- 172.21.15.194:0/2271917333 >> 172.21.15.194:0/2271917333 conn(0x559d04c840d0 msgr2=0x559d04d70730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:56.724 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.717+0000 7fc4c4862980 1 -- 172.21.15.194:0/2271917333 shutdown_connections 2024-09-13T06:10:56.724 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.717+0000 7fc4c4862980 1 -- 172.21.15.194:0/2271917333 wait complete. 2024-09-13T06:10:56.724 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.717+0000 7fc4c4862980 1 Processor -- start 2024-09-13T06:10:56.724 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.717+0000 7fc4c4862980 1 -- start start 2024-09-13T06:10:56.724 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.717+0000 7fc4c4862980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559d04bfe2d0 0x559d04c89cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.724 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.717+0000 7fc4c4862980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x559d04c90f40 con 0x559d04bfe2d0 2024-09-13T06:10:56.724 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.717+0000 7fc4c2372640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559d04bfe2d0 0x559d04c89cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.724 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.717+0000 7fc4c2372640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559d04bfe2d0 0x559d04c89cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:38776/0 (socket says 172.21.15.194:38776) 2024-09-13T06:10:56.724 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.717+0000 7fc4c2372640 1 -- 172.21.15.194:0/193889980 learned_addr learned my addr 172.21.15.194:0/193889980 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:56.726 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.721+0000 7fc4c2372640 1 -- 172.21.15.194:0/193889980 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d04c8a200 con 0x559d04bfe2d0 2024-09-13T06:10:56.726 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.721+0000 7fc4c2372640 1 --2- 172.21.15.194:0/193889980 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559d04bfe2d0 0x559d04c89cc0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x559d04d75ce0 tx=0x7fc4bc000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.726 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.721+0000 7fc3aee05640 1 -- 172.21.15.194:0/193889980 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4bc001260 con 0x559d04bfe2d0 2024-09-13T06:10:56.726 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.721+0000 7fc4c4862980 1 -- 172.21.15.194:0/193889980 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559d04c883e0 con 0x559d04bfe2d0 2024-09-13T06:10:56.726 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.721+0000 7fc3aee05640 1 -- 172.21.15.194:0/193889980 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4bc00fa40 con 0x559d04bfe2d0 2024-09-13T06:10:56.727 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.721+0000 7fc4c4862980 1 -- 172.21.15.194:0/193889980 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d04c888d0 con 0x559d04bfe2d0 2024-09-13T06:10:56.727 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.721+0000 7fc3aee05640 1 -- 172.21.15.194:0/193889980 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4bc02c060 con 0x559d04bfe2d0 2024-09-13T06:10:56.727 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.721+0000 7fc3aee05640 1 -- 172.21.15.194:0/193889980 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc4bc017070 con 0x559d04bfe2d0 2024-09-13T06:10:56.727 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.721+0000 7fc3aee05640 1 --2- 172.21.15.194:0/193889980 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fc3a8034650 0x7fc3a8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.727 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.721+0000 7fc3aee05640 1 -- 172.21.15.194:0/193889980 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fc4bc015020 con 0x559d04bfe2d0 2024-09-13T06:10:56.727 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.721+0000 7fc4c1b71640 1 --2- 172.21.15.194:0/193889980 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fc3a8034650 0x7fc3a8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.727 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.721+0000 7fc4c4862980 1 --2- 172.21.15.194:0/193889980 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x559d04c8db00 0x559d04d85290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.727 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.721+0000 7fc4c4862980 1 -- 172.21.15.194:0/193889980 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559d04d857d0 con 0x559d04c8db00 2024-09-13T06:10:56.727 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.721+0000 7fc4c2b73640 1 --2- 172.21.15.194:0/193889980 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x559d04c8db00 0x559d04d85290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.727 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.721+0000 7fc4c1b71640 1 --2- 172.21.15.194:0/193889980 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fc3a8034650 0x7fc3a8036b10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc4b80ae000 tx=0x7fc4b80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.728 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.721+0000 7fc4c2b73640 1 --2- 172.21.15.194:0/193889980 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x559d04c8db00 0x559d04d85290 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.728 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.721+0000 7fc4c2b73640 1 -- 172.21.15.194:0/193889980 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc4b400a4d0 con 0x559d04c8db00 2024-09-13T06:10:56.728 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.721+0000 7fc4c4862980 1 -- 172.21.15.194:0/193889980 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559d04d85bf0 con 0x559d04c8db00 2024-09-13T06:10:56.730 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.721+0000 7fc4c2b73640 1 -- 172.21.15.194:0/193889980 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc4b400a4d0 con 0x559d04c8db00 2024-09-13T06:10:56.730 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.721+0000 7fc4c4862980 1 --2- 172.21.15.194:0/193889980 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x559d04d87a00 0x559d04d89df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.730 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.721+0000 7fc4c4862980 1 -- 172.21.15.194:0/193889980 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559d04d8a4c0 con 0x559d04d87a00 2024-09-13T06:10:56.730 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.721+0000 7fc4c2372640 1 --2- 172.21.15.194:0/193889980 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x559d04d87a00 0x559d04d89df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.731 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.721+0000 7fc4c2372640 1 --2- 172.21.15.194:0/193889980 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x559d04d87a00 0x559d04d89df0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.731 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.725+0000 7fc4c2372640 1 -- 172.21.15.194:0/193889980 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc4bc02e070 con 0x559d04d87a00 2024-09-13T06:10:56.731 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.725+0000 7fc4c4862980 1 -- 172.21.15.194:0/193889980 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559d04d868a0 con 0x559d04c8db00 2024-09-13T06:10:56.731 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.725+0000 7fc4c2b73640 1 -- 172.21.15.194:0/193889980 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc4b400a4d0 con 0x559d04c8db00 2024-09-13T06:10:56.731 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.725+0000 7fc4c4862980 1 --2- 172.21.15.194:0/193889980 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x559d04d8b900 0x559d04d8dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.731 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.725+0000 7fc4c4862980 1 -- 172.21.15.194:0/193889980 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559d04d8e430 con 0x559d04d8b900 2024-09-13T06:10:56.731 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.725+0000 7fc4c1b71640 1 --2- 172.21.15.194:0/193889980 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x559d04d8b900 0x559d04d8dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.731 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.725+0000 7fc4c1b71640 1 --2- 172.21.15.194:0/193889980 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x559d04d8b900 0x559d04d8dcf0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.731 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.725+0000 7fc4c1b71640 1 -- 172.21.15.194:0/193889980 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc4b80aaae0 con 0x559d04d8b900 2024-09-13T06:10:56.731 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.725+0000 7fc4c4862980 1 Processor -- start 2024-09-13T06:10:56.731 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.725+0000 7fc4c4862980 1 -- start start 2024-09-13T06:10:56.731 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.725+0000 7fc4c4862980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559d04d9bec0 0x559d04d9c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.725+0000 7fc4c4862980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x559d04b90800 con 0x559d04d9bec0 2024-09-13T06:10:56.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.725+0000 7fc4c2372640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559d04d9bec0 0x559d04d9c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.725+0000 7fc4c2372640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559d04d9bec0 0x559d04d9c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:38790/0 (socket says 172.21.15.194:38790) 2024-09-13T06:10:56.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.725+0000 7fc4c2372640 1 -- 172.21.15.194:0/2641005542 learned_addr learned my addr 172.21.15.194:0/2641005542 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:56.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.725+0000 7fc4c2372640 1 -- 172.21.15.194:0/2641005542 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d04d9c820 con 0x559d04d9bec0 2024-09-13T06:10:56.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.725+0000 7fc4c2372640 1 --2- 172.21.15.194:0/2641005542 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559d04d9bec0 0x559d04d9c2e0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc04a010 tx=0x7fc4bc019970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.725+0000 7fc3a7fff640 1 -- 172.21.15.194:0/2641005542 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4bc01a480 con 0x559d04d9bec0 2024-09-13T06:10:56.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.725+0000 7fc4c4862980 1 -- 172.21.15.194:0/2641005542 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559d04d9cab0 con 0x559d04d9bec0 2024-09-13T06:10:56.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.725+0000 7fc3a7fff640 1 -- 172.21.15.194:0/2641005542 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4bc01a620 con 0x559d04d9bec0 2024-09-13T06:10:56.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.725+0000 7fc4c4862980 1 -- 172.21.15.194:0/2641005542 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d04d9f730 con 0x559d04d9bec0 2024-09-13T06:10:56.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.725+0000 7fc3a7fff640 1 -- 172.21.15.194:0/2641005542 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4bc04f060 con 0x559d04d9bec0 2024-09-13T06:10:56.735 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.729+0000 7fc3a7fff640 1 -- 172.21.15.194:0/2641005542 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc4bc0424f0 con 0x559d04d9bec0 2024-09-13T06:10:56.735 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.729+0000 7fc3a7fff640 1 --2- 172.21.15.194:0/2641005542 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fc39c034650 0x7fc39c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.735 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.729+0000 7fc3a7fff640 1 -- 172.21.15.194:0/2641005542 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fc4bc03d070 con 0x559d04d9bec0 2024-09-13T06:10:56.735 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.729+0000 7fc4c1b71640 1 --2- 172.21.15.194:0/2641005542 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fc39c034650 0x7fc39c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.735 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.729+0000 7fc4c4862980 1 Processor -- start 2024-09-13T06:10:56.736 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.729+0000 7fc4c4862980 1 -- start start 2024-09-13T06:10:56.736 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.729+0000 7fc4c4862980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559d04da86b0 0x559d04da8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.736 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.729+0000 7fc4c4862980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x559d04d75450 con 0x559d04da86b0 2024-09-13T06:10:56.736 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.729+0000 7fc4c1b71640 1 --2- 172.21.15.194:0/2641005542 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fc39c034650 0x7fc39c036b10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc4b8000c10 tx=0x7fc4b8005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.736 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.729+0000 7fc4c2372640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559d04da86b0 0x559d04da8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.736 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.729+0000 7fc4c2372640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559d04da86b0 0x559d04da8ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:38804/0 (socket says 172.21.15.194:38804) 2024-09-13T06:10:56.736 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.729+0000 7fc4c2372640 1 -- 172.21.15.194:0/2560962519 learned_addr learned my addr 172.21.15.194:0/2560962519 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:56.736 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.729+0000 7fc4c2372640 1 -- 172.21.15.194:0/2560962519 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d04da9080 con 0x559d04da86b0 2024-09-13T06:10:56.736 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.729+0000 7fc4c2372640 1 --2- 172.21.15.194:0/2560962519 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559d04da86b0 0x559d04da8ab0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc027820 tx=0x7fc4bc03c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41ea294ae0d2593e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.736 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.729+0000 7fc3a5ffb640 1 -- 172.21.15.194:0/2560962519 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4bc046d30 con 0x559d04da86b0 2024-09-13T06:10:56.736 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.729+0000 7fc3a5ffb640 1 -- 172.21.15.194:0/2560962519 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4bc047980 con 0x559d04da86b0 2024-09-13T06:10:56.736 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.729+0000 7fc3a5ffb640 1 -- 172.21.15.194:0/2560962519 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4bc0279c0 con 0x559d04da86b0 2024-09-13T06:10:56.737 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.729+0000 7fc4c4862980 1 -- 172.21.15.194:0/2560962519 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559d04da86b0 msgr2=0x559d04da8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.737 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.729+0000 7fc4c4862980 1 --2- 172.21.15.194:0/2560962519 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559d04da86b0 0x559d04da8ab0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc027820 tx=0x7fc4bc03c700 comp rx=0 tx=0).stop 2024-09-13T06:10:56.737 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.729+0000 7fc4c4862980 1 -- 172.21.15.194:0/2560962519 shutdown_connections 2024-09-13T06:10:56.737 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.729+0000 7fc4c4862980 1 --2- 172.21.15.194:0/2560962519 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559d04da86b0 0x559d04da8ab0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.737 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.729+0000 7fc4c4862980 1 -- 172.21.15.194:0/2560962519 >> 172.21.15.194:0/2560962519 conn(0x559d04da4a90 msgr2=0x559d04da2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:56.737 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.729+0000 7fc4c4862980 1 -- 172.21.15.194:0/2560962519 shutdown_connections 2024-09-13T06:10:56.737 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.729+0000 7fc4c4862980 1 -- 172.21.15.194:0/2560962519 wait complete. 2024-09-13T06:10:56.737 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.729+0000 7fc4c4862980 1 Processor -- start 2024-09-13T06:10:56.737 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.729+0000 7fc4c4862980 1 -- start start 2024-09-13T06:10:56.737 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.729+0000 7fc4c4862980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559d04da86b0 0x559d04daf850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.737 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.729+0000 7fc4c4862980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x559d04da9500 con 0x559d04da86b0 2024-09-13T06:10:56.737 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.729+0000 7fc4c2372640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559d04da86b0 0x559d04daf850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.737 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.729+0000 7fc4c2372640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559d04da86b0 0x559d04daf850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:38808/0 (socket says 172.21.15.194:38808) 2024-09-13T06:10:56.738 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.729+0000 7fc4c2372640 1 -- 172.21.15.194:0/2215307497 learned_addr learned my addr 172.21.15.194:0/2215307497 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:56.738 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.729+0000 7fc4c2372640 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d04dafd90 con 0x559d04da86b0 2024-09-13T06:10:56.738 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.733+0000 7fc4c2372640 1 --2- 172.21.15.194:0/2215307497 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559d04da86b0 0x559d04daf850 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc027820 tx=0x7fc4bc04def0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.733+0000 7fc393fff640 1 -- 172.21.15.194:0/2215307497 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4bc06d070 con 0x559d04da86b0 2024-09-13T06:10:56.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.733+0000 7fc393fff640 1 -- 172.21.15.194:0/2215307497 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4bc04c080 con 0x559d04da86b0 2024-09-13T06:10:56.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.733+0000 7fc4c4862980 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559d04dafd90 con 0x559d04da86b0 2024-09-13T06:10:56.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.733+0000 7fc393fff640 1 -- 172.21.15.194:0/2215307497 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4bc04c3a0 con 0x559d04da86b0 2024-09-13T06:10:56.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.733+0000 7fc4c4862980 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d04dafd90 con 0x559d04da86b0 2024-09-13T06:10:56.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.733+0000 7fc393fff640 1 -- 172.21.15.194:0/2215307497 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc4bc066040 con 0x559d04da86b0 2024-09-13T06:10:56.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.733+0000 7fc393fff640 1 --2- 172.21.15.194:0/2215307497 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fc38c034650 0x7fc38c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.733+0000 7fc393fff640 1 -- 172.21.15.194:0/2215307497 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fc4bc0071a0 con 0x559d04da86b0 2024-09-13T06:10:56.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.733+0000 7fc4c4862980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.733+0000 7fc4c1b71640 1 --2- 172.21.15.194:0/2215307497 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fc38c034650 0x7fc38c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.733+0000 7fc4c4862980 1 --2- 172.21.15.194:0/2215307497 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x559d04dba910 0x559d04dbcdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.744 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.733+0000 7fc4c4862980 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559d04dbd520 con 0x559d04dba910 2024-09-13T06:10:56.744 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.733+0000 7fc4c2b73640 1 --2- 172.21.15.194:0/2215307497 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x559d04dba910 0x559d04dbcdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.744 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.733+0000 7fc4c1b71640 1 --2- 172.21.15.194:0/2215307497 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fc38c034650 0x7fc38c036b10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc4b80aa910 tx=0x7fc4b80c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.744 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.733+0000 7fc4c2b73640 1 --2- 172.21.15.194:0/2215307497 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x559d04dba910 0x559d04dbcdd0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.744 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.733+0000 7fc4c2b73640 1 -- 172.21.15.194:0/2215307497 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc4b400a4d0 con 0x559d04dba910 2024-09-13T06:10:56.744 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.733+0000 7fc4c4862980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:56.744 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.733+0000 7fc4c4862980 20 realm 2024-09-13T06:10:56.744 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.733+0000 7fc4c4862980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.744 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.733+0000 7fc4c4862980 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559d04dbd980 con 0x559d04dba910 2024-09-13T06:10:56.744 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.733+0000 7fc4c2b73640 1 -- 172.21.15.194:0/2215307497 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc4b400a4d0 con 0x559d04dba910 2024-09-13T06:10:56.744 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.733+0000 7fc4c4862980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:56.744 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.733+0000 7fc4c4862980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:10:56.744 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.733+0000 7fc4c4862980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.745 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.733+0000 7fc4c4862980 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559d04dbe220 con 0x559d04dba910 2024-09-13T06:10:56.745 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.733+0000 7fc4c2b73640 1 -- 172.21.15.194:0/2215307497 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc4b400a4d0 con 0x559d04dba910 2024-09-13T06:10:56.745 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.733+0000 7fc4c4862980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:56.745 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.733+0000 7fc4c4862980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.745 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.733+0000 7fc4c4862980 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559d04dbe5c0 con 0x559d04dba910 2024-09-13T06:10:56.745 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.733+0000 7fc4c2b73640 1 -- 172.21.15.194:0/2215307497 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc4b400a4d0 con 0x559d04dba910 2024-09-13T06:10:56.745 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.733+0000 7fc4c4862980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:10:56.745 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.733+0000 7fc4c4862980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.745 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.733+0000 7fc4c4862980 1 --2- 172.21.15.194:0/2215307497 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x559d04dbf320 0x559d04dc1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.745 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.733+0000 7fc4c4862980 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559d04dc1db0 con 0x559d04dbf320 2024-09-13T06:10:56.745 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.733+0000 7fc4c2372640 1 --2- 172.21.15.194:0/2215307497 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x559d04dbf320 0x559d04dc1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.745 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.737+0000 7fc4c2372640 1 --2- 172.21.15.194:0/2215307497 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x559d04dbf320 0x559d04dc1710 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.745 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.737+0000 7fc4c2372640 1 -- 172.21.15.194:0/2215307497 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc4bc02e070 con 0x559d04dbf320 2024-09-13T06:10:56.746 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.737+0000 7fc4c4862980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:10:56.746 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.737+0000 7fc4c4862980 20 searching for the correct realm 2024-09-13T06:10:56.746 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.737+0000 7fc4c4862980 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559d04dc3610 con 0x559d04dbf320 2024-09-13T06:10:56.746 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.737+0000 7fc4c2372640 1 -- 172.21.15.194:0/2215307497 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4bc02e070 con 0x559d04dbf320 2024-09-13T06:10:56.746 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.737+0000 7fc4c2372640 1 --2- 172.21.15.194:0/2215307497 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fc4bc069040 0x7fc4bc072640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.746 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.737+0000 7fc4c2372640 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559d04dc3610 con 0x7fc4bc069040 2024-09-13T06:10:56.746 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.737+0000 7fc4c1b71640 1 --2- 172.21.15.194:0/2215307497 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fc4bc069040 0x7fc4bc072640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.746 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.737+0000 7fc4c1b71640 1 --2- 172.21.15.194:0/2215307497 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fc4bc069040 0x7fc4bc072640 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.746 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.737+0000 7fc4c1b71640 1 -- 172.21.15.194:0/2215307497 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc4b80aaae0 con 0x7fc4bc069040 2024-09-13T06:10:56.746 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.737+0000 7fc4c1b71640 1 --2- 172.21.15.194:0/2215307497 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fc4b80e0040 0x7fc4b80e0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.746 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.737+0000 7fc4c1b71640 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559d04dc3610 con 0x7fc4b80e0040 2024-09-13T06:10:56.746 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.737+0000 7fc4c2b73640 1 --2- 172.21.15.194:0/2215307497 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fc4b80e0040 0x7fc4b80e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.746 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.737+0000 7fc4c2b73640 1 --2- 172.21.15.194:0/2215307497 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fc4b80e0040 0x7fc4b80e0420 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.747 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.737+0000 7fc4c2b73640 1 -- 172.21.15.194:0/2215307497 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4b400a4d0 con 0x7fc4b80e0040 2024-09-13T06:10:56.747 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.737+0000 7fc4c2b73640 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559d04dbe5c0 con 0x559d04dba910 2024-09-13T06:10:56.747 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.737+0000 7fc4c2b73640 1 -- 172.21.15.194:0/2215307497 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4b400a4d0 con 0x559d04dba910 2024-09-13T06:10:56.747 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.737+0000 7fc4c2b73640 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559d04dbe5c0 con 0x559d04dba910 2024-09-13T06:10:56.747 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.737+0000 7fc4c2b73640 1 -- 172.21.15.194:0/2215307497 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4b400a4d0 con 0x559d04dba910 2024-09-13T06:10:56.747 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.737+0000 7fc4c2b73640 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559d04dbe5c0 con 0x7fc4b80e0040 2024-09-13T06:10:56.747 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.737+0000 7fc4c2b73640 1 -- 172.21.15.194:0/2215307497 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4b400a4d0 con 0x7fc4b80e0040 2024-09-13T06:10:56.747 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.737+0000 7fc4c2b73640 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559d04dbe5c0 con 0x7fc4b80e0040 2024-09-13T06:10:56.755 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.741+0000 7fc4c2b73640 1 -- 172.21.15.194:0/2215307497 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4b400a4d0 con 0x7fc4b80e0040 2024-09-13T06:10:56.755 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.741+0000 7fc4c2b73640 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559d04dbe5c0 con 0x7fc4bc069040 2024-09-13T06:10:56.755 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.741+0000 7fc4c1b71640 1 -- 172.21.15.194:0/2215307497 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4b80aaae0 con 0x7fc4bc069040 2024-09-13T06:10:56.755 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.741+0000 7fc4c1b71640 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559d04dbe5c0 con 0x559d04dbf320 2024-09-13T06:10:56.755 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.741+0000 7fc4c2372640 1 -- 172.21.15.194:0/2215307497 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4bc02e070 con 0x559d04dbf320 2024-09-13T06:10:56.755 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.741+0000 7fc4c2372640 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559d04dbe5c0 con 0x559d04dba910 2024-09-13T06:10:56.755 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.741+0000 7fc4c2b73640 1 -- 172.21.15.194:0/2215307497 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4b400a4d0 con 0x559d04dba910 2024-09-13T06:10:56.755 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.741+0000 7fc4c2b73640 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559d04dbe5c0 con 0x7fc4b80e0040 2024-09-13T06:10:56.755 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.741+0000 7fc4c2b73640 1 -- 172.21.15.194:0/2215307497 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4b400a4d0 con 0x7fc4b80e0040 2024-09-13T06:10:56.756 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.741+0000 7fc4c2b73640 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559d04dbe5c0 con 0x559d04dba910 2024-09-13T06:10:56.756 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.741+0000 7fc4c2b73640 1 -- 172.21.15.194:0/2215307497 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4b400a4d0 con 0x559d04dba910 2024-09-13T06:10:56.756 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.741+0000 7fc4c2b73640 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559d04dbe5c0 con 0x7fc4bc069040 2024-09-13T06:10:56.756 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.741+0000 7fc4c1b71640 1 -- 172.21.15.194:0/2215307497 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc4b80aaae0 con 0x7fc4bc069040 2024-09-13T06:10:56.756 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.741+0000 7fc4c1b71640 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559d04dbe5c0 con 0x559d04dbf320 2024-09-13T06:10:56.756 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.741+0000 7fc4c2372640 1 -- 172.21.15.194:0/2215307497 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4bc02e070 con 0x559d04dbf320 2024-09-13T06:10:56.756 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.741+0000 7fc4c2372640 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559d04dbe5c0 con 0x559d04dbf320 2024-09-13T06:10:56.756 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.741+0000 7fc4c2372640 1 -- 172.21.15.194:0/2215307497 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4bc02e070 con 0x559d04dbf320 2024-09-13T06:10:56.756 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.741+0000 7fc4c2372640 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559d04dbe5c0 con 0x7fc4b80e0040 2024-09-13T06:10:56.756 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.741+0000 7fc4c2b73640 1 -- 172.21.15.194:0/2215307497 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4b400a4d0 con 0x7fc4b80e0040 2024-09-13T06:10:56.756 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.741+0000 7fc4c2b73640 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559d04dbe5c0 con 0x559d04dbf320 2024-09-13T06:10:56.757 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.741+0000 7fc4c2372640 1 -- 172.21.15.194:0/2215307497 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4bc02e070 con 0x559d04dbf320 2024-09-13T06:10:56.757 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.741+0000 7fc4c2372640 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559d04dbe5c0 con 0x559d04dbf320 2024-09-13T06:10:56.757 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.741+0000 7fc4c2372640 1 -- 172.21.15.194:0/2215307497 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4bc02e070 con 0x559d04dbf320 2024-09-13T06:10:56.757 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.741+0000 7fc4c2372640 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559d04dbe5c0 con 0x559d04dba910 2024-09-13T06:10:56.757 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.741+0000 7fc4c2b73640 1 -- 172.21.15.194:0/2215307497 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4b400a4d0 con 0x559d04dba910 2024-09-13T06:10:56.757 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.741+0000 7fc4c2b73640 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559d04dbe5c0 con 0x559d04dba910 2024-09-13T06:10:56.757 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.741+0000 7fc4c2b73640 1 -- 172.21.15.194:0/2215307497 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc4b400a4d0 con 0x559d04dba910 2024-09-13T06:10:56.757 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.741+0000 7fc4c2b73640 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559d04dbe5c0 con 0x7fc4bc069040 2024-09-13T06:10:56.757 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.745+0000 7fc4c1b71640 1 -- 172.21.15.194:0/2215307497 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4b80aaae0 con 0x7fc4bc069040 2024-09-13T06:10:56.757 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.745+0000 7fc4c1b71640 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559d04dbe5c0 con 0x559d04dbf320 2024-09-13T06:10:56.757 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.745+0000 7fc4c2372640 1 -- 172.21.15.194:0/2215307497 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4bc02e070 con 0x559d04dbf320 2024-09-13T06:10:56.757 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.745+0000 7fc4c2372640 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559d04dbe5c0 con 0x7fc4bc069040 2024-09-13T06:10:56.758 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.745+0000 7fc4c1b71640 1 -- 172.21.15.194:0/2215307497 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4b80aaae0 con 0x7fc4bc069040 2024-09-13T06:10:56.758 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.745+0000 7fc4c1b71640 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559d04dbe5c0 con 0x559d04dba910 2024-09-13T06:10:56.758 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.745+0000 7fc4c2b73640 1 -- 172.21.15.194:0/2215307497 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4b400a4d0 con 0x559d04dba910 2024-09-13T06:10:56.758 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.745+0000 7fc4c2b73640 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559d04dbe5c0 con 0x7fc4b80e0040 2024-09-13T06:10:56.758 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.745+0000 7fc4c2b73640 1 -- 172.21.15.194:0/2215307497 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4b400a4d0 con 0x7fc4b80e0040 2024-09-13T06:10:56.758 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.745+0000 7fc4c2b73640 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559d04dbe5c0 con 0x559d04dbf320 2024-09-13T06:10:56.758 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.745+0000 7fc4c2372640 1 -- 172.21.15.194:0/2215307497 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc4bc02e070 con 0x559d04dbf320 2024-09-13T06:10:56.758 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.745+0000 7fc4c2372640 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559d04dbe5c0 con 0x7fc4bc069040 2024-09-13T06:10:56.758 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.745+0000 7fc4c1b71640 1 -- 172.21.15.194:0/2215307497 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4b80aaae0 con 0x7fc4bc069040 2024-09-13T06:10:56.758 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.745+0000 7fc4c1b71640 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559d04dbe5c0 con 0x7fc4bc069040 2024-09-13T06:10:56.758 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.745+0000 7fc4c1b71640 1 -- 172.21.15.194:0/2215307497 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4b80aaae0 con 0x7fc4bc069040 2024-09-13T06:10:56.758 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.745+0000 7fc4c1b71640 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559d04dbe5c0 con 0x559d04dbf320 2024-09-13T06:10:56.759 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.745+0000 7fc4c2372640 1 -- 172.21.15.194:0/2215307497 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4bc02e070 con 0x559d04dbf320 2024-09-13T06:10:56.759 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.745+0000 7fc4c2372640 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559d04dbe5c0 con 0x7fc4b80e0040 2024-09-13T06:10:56.759 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.745+0000 7fc4c2b73640 1 -- 172.21.15.194:0/2215307497 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4b400a4d0 con 0x7fc4b80e0040 2024-09-13T06:10:56.759 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.745+0000 7fc4c2b73640 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559d04dbe5c0 con 0x559d04dba910 2024-09-13T06:10:56.759 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.745+0000 7fc4c2b73640 1 -- 172.21.15.194:0/2215307497 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc4b400a4d0 con 0x559d04dba910 2024-09-13T06:10:56.759 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.745+0000 7fc4c2b73640 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559d04dbe5c0 con 0x7fc4bc069040 2024-09-13T06:10:56.759 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.745+0000 7fc4c1b71640 1 -- 172.21.15.194:0/2215307497 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4b80aaae0 con 0x7fc4bc069040 2024-09-13T06:10:56.759 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.745+0000 7fc4c4862980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:10:56.759 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.745+0000 7fc4c4862980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:10:56.759 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.745+0000 7fc4c4862980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:10:56.759 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.745+0000 7fc4c4862980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:10:56.759 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.745+0000 7fc4c4862980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:10:56.759 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.745+0000 7fc4c4862980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:10:56.760 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.745+0000 7fc4c4862980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.760 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.745+0000 7fc4c4862980 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559d04dc26c0 con 0x559d04dba910 2024-09-13T06:10:56.760 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.745+0000 7fc4c2b73640 1 -- 172.21.15.194:0/2215307497 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc4b400a4d0 con 0x559d04dba910 2024-09-13T06:10:56.760 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.745+0000 7fc4c4862980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:56.760 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.745+0000 7fc4c4862980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.760 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.745+0000 7fc4c4862980 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559d04dc2f10 con 0x559d04dba910 2024-09-13T06:10:56.760 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.749+0000 7fc4c2b73640 1 -- 172.21.15.194:0/2215307497 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc4b400a4d0 con 0x559d04dba910 2024-09-13T06:10:56.760 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.749+0000 7fc4c4862980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:10:56.760 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.749+0000 7fc4c4862980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.760 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.749+0000 7fc4c4862980 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559d04dc2a60 con 0x7fc4bc069040 2024-09-13T06:10:56.760 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.749+0000 7fc4c1b71640 1 -- 172.21.15.194:0/2215307497 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc4b80aaae0 con 0x7fc4bc069040 2024-09-13T06:10:56.760 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.749+0000 7fc4c4862980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:10:56.760 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.749+0000 7fc4c4862980 20 zone default found 2024-09-13T06:10:56.761 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.749+0000 7fc4c4862980 4 Realm: () 2024-09-13T06:10:56.761 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.749+0000 7fc4c4862980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:10:56.761 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.749+0000 7fc4c4862980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:10:56.761 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.749+0000 7fc4c4862980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:10:56.761 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.749+0000 7fc4c4862980 20 zonegroup default 2024-09-13T06:10:56.761 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.749+0000 7fc4c4862980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.761 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.749+0000 7fc4c4862980 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559d04dc3a40 con 0x7fc4b80e0040 2024-09-13T06:10:56.761 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.749+0000 7fc4c2b73640 1 -- 172.21.15.194:0/2215307497 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc4b400a4d0 con 0x7fc4b80e0040 2024-09-13T06:10:56.761 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.749+0000 7fc4c4862980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:56.761 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.749+0000 7fc4c4862980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.761 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.749+0000 7fc4c4862980 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559d04dc5420 con 0x559d04dbf320 2024-09-13T06:10:56.761 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.749+0000 7fc4c2372640 1 -- 172.21.15.194:0/2215307497 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc4bc02e070 con 0x559d04dbf320 2024-09-13T06:10:56.761 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.749+0000 7fc4c4862980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:56.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.749+0000 7fc4c4862980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.749+0000 7fc4c4862980 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559d04dc5930 con 0x559d04dbf320 2024-09-13T06:10:56.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.749+0000 7fc4c2372640 1 -- 172.21.15.194:0/2215307497 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc4bc02e070 con 0x559d04dbf320 2024-09-13T06:10:56.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.749+0000 7fc4c4862980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:56.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.749+0000 7fc4c4862980 20 started sync module instance, tier type = 2024-09-13T06:10:56.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.749+0000 7fc4c4862980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:10:56.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.749+0000 7fc4c4862980 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559d04dc33f0 con 0x7fc4bc069040 2024-09-13T06:10:56.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.749+0000 7fc4c1b71640 1 -- 172.21.15.194:0/2215307497 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(44 notify.0 [create] v35'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4b80aaae0 con 0x7fc4bc069040 2024-09-13T06:10:56.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.749+0000 7fc4c4862980 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94132879772016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559d04dc5d90 con 0x7fc4bc069040 2024-09-13T06:10:56.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.749+0000 7fc4c4862980 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559d04dc67b0 con 0x559d04dba910 2024-09-13T06:10:56.764 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.753+0000 7fc4c2b73640 1 -- 172.21.15.194:0/2215307497 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v35'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4b400a4d0 con 0x559d04dba910 2024-09-13T06:10:56.765 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.753+0000 7fc4c4862980 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94132879778464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559d04dc7050 con 0x559d04dba910 2024-09-13T06:10:56.765 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.753+0000 7fc4c4862980 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559d04dc7a90 con 0x559d04dbf320 2024-09-13T06:10:56.765 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.753+0000 7fc4c1b71640 1 -- 172.21.15.194:0/2215307497 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94132879772016] v35'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4b80aaae0 con 0x7fc4bc069040 2024-09-13T06:10:56.765 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.753+0000 7fc4c2372640 1 -- 172.21.15.194:0/2215307497 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v35'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4bc02e070 con 0x559d04dbf320 2024-09-13T06:10:56.765 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.753+0000 7fc4c4862980 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94132879783264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559d04dc7e80 con 0x559d04dbf320 2024-09-13T06:10:56.765 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.753+0000 7fc4c4862980 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559d04dc8840 con 0x7fc4bc069040 2024-09-13T06:10:56.765 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.753+0000 7fc4c2b73640 1 -- 172.21.15.194:0/2215307497 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94132879778464] v35'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4b400a4d0 con 0x559d04dba910 2024-09-13T06:10:56.765 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.757+0000 7fc4c1b71640 1 -- 172.21.15.194:0/2215307497 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(50 notify.3 [create] v35'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4b80aaae0 con 0x7fc4bc069040 2024-09-13T06:10:56.765 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.757+0000 7fc4c4862980 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94132879786896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559d04dc8c30 con 0x7fc4bc069040 2024-09-13T06:10:56.765 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.757+0000 7fc4c4862980 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559d04dc95f0 con 0x559d04dba910 2024-09-13T06:10:56.765 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.757+0000 7fc4c2372640 1 -- 172.21.15.194:0/2215307497 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94132879783264] v35'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4bc02e070 con 0x559d04dbf320 2024-09-13T06:10:56.765 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.757+0000 7fc4c1b71640 1 -- 172.21.15.194:0/2215307497 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94132879786896] v35'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4b80aaae0 con 0x7fc4bc069040 2024-09-13T06:10:56.766 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.757+0000 7fc4c2b73640 1 -- 172.21.15.194:0/2215307497 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v35'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4b400a4d0 con 0x559d04dba910 2024-09-13T06:10:56.766 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.757+0000 7fc4c4862980 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94132879780768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559d04dc9140 con 0x559d04dba910 2024-09-13T06:10:56.766 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.757+0000 7fc4c4862980 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559d04dc99d0 con 0x7fc4b80e0040 2024-09-13T06:10:56.766 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.757+0000 7fc4c2b73640 1 -- 172.21.15.194:0/2215307497 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94132879780768] v35'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4b400a4d0 con 0x559d04dba910 2024-09-13T06:10:56.766 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.761+0000 7fc4c2b73640 1 -- 172.21.15.194:0/2215307497 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(54 notify.5 [create] v35'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4b400a4d0 con 0x7fc4b80e0040 2024-09-13T06:10:56.766 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.761+0000 7fc4c4862980 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94132879773136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559d04dc95f0 con 0x7fc4b80e0040 2024-09-13T06:10:56.766 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.761+0000 7fc4c4862980 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559d04dca2b0 con 0x7fc4b80e0040 2024-09-13T06:10:56.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.761+0000 7fc4c2b73640 1 -- 172.21.15.194:0/2215307497 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(56 notify.6 [create] v35'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4b400a4d0 con 0x7fc4b80e0040 2024-09-13T06:10:56.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.761+0000 7fc4c4862980 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94132879793600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559d04dca6d0 con 0x7fc4b80e0040 2024-09-13T06:10:56.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.761+0000 7fc4c4862980 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559d04dcb1c0 con 0x7fc4b80e0040 2024-09-13T06:10:56.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.761+0000 7fc4c2b73640 1 -- 172.21.15.194:0/2215307497 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94132879773136] v35'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4b400a4d0 con 0x7fc4b80e0040 2024-09-13T06:10:56.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.761+0000 7fc4c2b73640 1 -- 172.21.15.194:0/2215307497 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94132879793600] v35'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4b400a4d0 con 0x7fc4b80e0040 2024-09-13T06:10:56.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.765+0000 7fc4c2b73640 1 -- 172.21.15.194:0/2215307497 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(58 notify.7 [create] v35'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4b400a4d0 con 0x7fc4b80e0040 2024-09-13T06:10:56.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.765+0000 7fc4c4862980 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94132879797392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559d04dca1e0 con 0x7fc4b80e0040 2024-09-13T06:10:56.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.765+0000 7fc4c4862980 20 add_watcher() i=0 2024-09-13T06:10:56.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.765+0000 7fc4c4862980 20 add_watcher() i=1 2024-09-13T06:10:56.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.765+0000 7fc4c4862980 20 add_watcher() i=2 2024-09-13T06:10:56.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.765+0000 7fc4c4862980 20 add_watcher() i=3 2024-09-13T06:10:56.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.765+0000 7fc4c4862980 20 add_watcher() i=4 2024-09-13T06:10:56.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.765+0000 7fc4c4862980 20 add_watcher() i=5 2024-09-13T06:10:56.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.765+0000 7fc4c4862980 20 add_watcher() i=6 2024-09-13T06:10:56.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.765+0000 7fc4c2b73640 1 -- 172.21.15.194:0/2215307497 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94132879797392] v35'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4b400a4d0 con 0x7fc4b80e0040 2024-09-13T06:10:56.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.765+0000 7fc4c4862980 20 add_watcher() i=7 2024-09-13T06:10:56.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.765+0000 7fc4c4862980 2 all 8 watchers are set, enabling cache 2024-09-13T06:10:56.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.765+0000 7fc4c4862980 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559d04dce1b0 con 0x559d04dba910 2024-09-13T06:10:56.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.765+0000 7fc4c2b73640 1 -- 172.21.15.194:0/2215307497 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc4b400a4d0 con 0x559d04dba910 2024-09-13T06:10:56.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.765+0000 7fc4c4862980 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94132879790400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559d04dcb630 con 0x559d04dba910 2024-09-13T06:10:56.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.765+0000 7fc4c2b73640 1 -- 172.21.15.194:0/2215307497 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94132879790400] v35'210 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc4b400a4d0 con 0x559d04dba910 2024-09-13T06:10:56.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.765+0000 7fc378fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:10:56.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.765+0000 7fc4c4862980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:10:56.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.765+0000 7fc4c4862980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:10:56.772 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.765+0000 7fc4c4862980 5 note: GC not initialized 2024-09-13T06:10:56.772 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.765+0000 7fc2f37fe640 20 reqs_thread_entry: start 2024-09-13T06:10:56.772 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.769+0000 7fc4c4862980 20 init_complete bucket index max shards: 11 2024-09-13T06:10:56.772 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.769+0000 7fc4c4862980 20 Filter name: none 2024-09-13T06:10:56.772 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.769+0000 7fc2f17fa640 20 reqs_thread_entry: start 2024-09-13T06:10:56.772 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.769+0000 7fc4c4862980 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-13T06:10:56.772 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.769+0000 7fc4c4862980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.772 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.769+0000 7fc4c4862980 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559d04df1770 con 0x7fc4b80e0040 2024-09-13T06:10:56.773 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.769+0000 7fc4c2b73640 1 -- 172.21.15.194:0/2215307497 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(62 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fc4b400a4d0 con 0x7fc4b80e0040 2024-09-13T06:10:56.773 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.769+0000 7fc4c4862980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:56.773 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.769+0000 7fc4c4862980 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-09-13T06:10:56.774 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.769+0000 7fc4c4862980 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-13T06:10:56.774 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.769+0000 7fc4c4862980 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-13T06:10:56.774 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.769+0000 7fc4c4862980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.774 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.769+0000 7fc4c4862980 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:63 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559d04deff10 con 0x559d04dba910 2024-09-13T06:10:56.774 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.769+0000 7fc4c2b73640 1 -- 172.21.15.194:0/2215307497 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(63 NX5QOQKC6BH2IDN8HC7A [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fc4b400a4d0 con 0x559d04dba910 2024-09-13T06:10:56.774 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.769+0000 7fc4c4862980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:56.774 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.769+0000 7fc4c4862980 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-09-13T06:10:56.774 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.769+0000 7fc4c4862980 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-13T06:10:56.774 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.769+0000 7fc4c4862980 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-13T06:10:56.774 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.769+0000 7fc4c4862980 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-13T06:10:56.774 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.769+0000 7fc4c4862980 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:64 8.e 8:718f6a54:users.uid::bar:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559d04df07e0 con 0x7fc4b80e0040 2024-09-13T06:10:56.775 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.769+0000 7fc4c2b73640 1 -- 172.21.15.194:0/2215307497 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(64 bar [delete,create,call,writefull 0~380] v35'5 uv5 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fc4b400a4d0 con 0x7fc4b80e0040 2024-09-13T06:10:56.775 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.769+0000 7fc4c4862980 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-09-13T06:10:56.775 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.769+0000 7fc4c4862980 10 moving default.rgw.meta+users.uid+bar to cache LRU end 2024-09-13T06:10:56.775 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.769+0000 7fc4c4862980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-09-13T06:10:56.776 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.769+0000 7fc4c4862980 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:65 7.9 7:93e5b521:::notify.7:head [notify cookie 94132879950640 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559d04df5210 con 0x7fc4b80e0040 2024-09-13T06:10:56.776 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.769+0000 7fc4c2b73640 1 -- 172.21.15.194:0/2215307497 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== watch-notify(notify (1) cookie 94132879797392 notify 150323855391 ret 0) ==== 598+0+0 (crc 0 0 0) 0x559d04df0b80 con 0x7fc4b80e0040 2024-09-13T06:10:56.776 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.769+0000 7fc3a5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855391 cookie 94132879797392 notifier 4724 bl.length()=556 2024-09-13T06:10:56.776 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.769+0000 7fc3a5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-09-13T06:10:56.776 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.769+0000 7fc3a5ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar to cache LRU end 2024-09-13T06:10:56.776 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.769+0000 7fc4c2b73640 1 -- 172.21.15.194:0/2215307497 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(65 notify.7 [notify cookie 94132879950640 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc4b400a4d0 con 0x7fc4b80e0040 2024-09-13T06:10:56.776 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.769+0000 7fc3a5ffb640 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:66 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fc388003eb0 con 0x7fc4b80e0040 2024-09-13T06:10:56.777 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.773+0000 7fc4c2b73640 1 -- 172.21.15.194:0/2215307497 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(66 notify.7 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4b400a4d0 con 0x7fc4b80e0040 2024-09-13T06:10:56.777 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.773+0000 7fc4c2b73640 1 -- 172.21.15.194:0/2215307497 <== osd.0 v2:172.21.15.120:6800/1923744619 20 ==== watch-notify(notify_complete (2) cookie 94132879950640 notify 150323855391 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559d04df11c0 con 0x7fc4b80e0040 2024-09-13T06:10:56.777 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.773+0000 7fc4c4862980 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:67 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559d04df2d40 con 0x559d04dba910 2024-09-13T06:10:56.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.773+0000 7fc4c2b73640 1 -- 172.21.15.194:0/2215307497 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(67 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v35'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fc4b400a4d0 con 0x559d04dba910 2024-09-13T06:10:56.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.773+0000 7fc4c4862980 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-13T06:10:56.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.773+0000 7fc4c4862980 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-13T06:10:56.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.773+0000 7fc4c4862980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-13T06:10:56.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.773+0000 7fc4c4862980 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94132879950512 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559d04df5210 con 0x7fc4b80e0040 2024-09-13T06:10:56.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.773+0000 7fc4c2b73640 1 -- 172.21.15.194:0/2215307497 <== osd.0 v2:172.21.15.120:6800/1923744619 21 ==== watch-notify(notify (1) cookie 94132879773136 notify 150323855392 ret 0) ==== 219+0+0 (crc 0 0 0) 0x559d04df11c0 con 0x7fc4b80e0040 2024-09-13T06:10:56.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.773+0000 7fc3a5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855392 cookie 94132879773136 notifier 4724 bl.length()=177 2024-09-13T06:10:56.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.773+0000 7fc3a5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-13T06:10:56.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.773+0000 7fc3a5ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-13T06:10:56.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.773+0000 7fc4c2b73640 1 -- 172.21.15.194:0/2215307497 <== osd.0 v2:172.21.15.120:6800/1923744619 22 ==== osd_op_reply(68 notify.5 [notify cookie 94132879950512 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc4b400a4d0 con 0x7fc4b80e0040 2024-09-13T06:10:56.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.773+0000 7fc3a5ffb640 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fc388003eb0 con 0x7fc4b80e0040 2024-09-13T06:10:56.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.773+0000 7fc4c2b73640 1 -- 172.21.15.194:0/2215307497 <== osd.0 v2:172.21.15.120:6800/1923744619 23 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4b400a4d0 con 0x7fc4b80e0040 2024-09-13T06:10:56.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.773+0000 7fc4c2b73640 1 -- 172.21.15.194:0/2215307497 <== osd.0 v2:172.21.15.120:6800/1923744619 24 ==== watch-notify(notify_complete (2) cookie 94132879950512 notify 150323855392 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fc4b402d040 con 0x7fc4b80e0040 2024-09-13T06:10:56.779 INFO:teuthology.orchestra.run.smithi194.stdout:{"user_id":"bar","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bar","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-09-13T06:10:56.773999Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:10:56.773988Z","tags":[],"group_ids":[]} 2024-09-13T06:10:56.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.777+0000 7fc378fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:10:56.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.777+0000 7fc4c4862980 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94132879790400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559d04def540 con 0x559d04dba910 2024-09-13T06:10:56.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.777+0000 7fc4c2b73640 1 -- 172.21.15.194:0/2215307497 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94132879790400] v35'211 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc4b400a4d0 con 0x559d04dba910 2024-09-13T06:10:56.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.777+0000 7fc4c4862980 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94132879772016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559d04def540 con 0x7fc4bc069040 2024-09-13T06:10:56.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.777+0000 7fc4c1b71640 1 -- 172.21.15.194:0/2215307497 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94132879772016] v35'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4b80aaae0 con 0x7fc4bc069040 2024-09-13T06:10:56.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.777+0000 7fc4c4862980 20 remove_watcher() i=0 2024-09-13T06:10:56.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.777+0000 7fc4c4862980 2 removed watcher, disabling cache 2024-09-13T06:10:56.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.777+0000 7fc4c4862980 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94132879778464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559d04def540 con 0x559d04dba910 2024-09-13T06:10:56.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.781+0000 7fc4c2b73640 1 -- 172.21.15.194:0/2215307497 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94132879778464] v35'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4b400a4d0 con 0x559d04dba910 2024-09-13T06:10:56.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.781+0000 7fc4c4862980 20 remove_watcher() i=1 2024-09-13T06:10:56.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.781+0000 7fc4c4862980 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94132879783264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559d04def540 con 0x559d04dbf320 2024-09-13T06:10:56.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.781+0000 7fc4c2372640 1 -- 172.21.15.194:0/2215307497 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94132879783264] v35'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4bc02e070 con 0x559d04dbf320 2024-09-13T06:10:56.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.781+0000 7fc4c4862980 20 remove_watcher() i=2 2024-09-13T06:10:56.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.781+0000 7fc4c4862980 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94132879786896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559d04def540 con 0x7fc4bc069040 2024-09-13T06:10:56.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.785+0000 7fc4c1b71640 1 -- 172.21.15.194:0/2215307497 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94132879786896] v35'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4b80aaae0 con 0x7fc4bc069040 2024-09-13T06:10:56.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.785+0000 7fc4c4862980 20 remove_watcher() i=3 2024-09-13T06:10:56.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.785+0000 7fc4c4862980 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94132879780768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559d04def540 con 0x559d04dba910 2024-09-13T06:10:56.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.785+0000 7fc4c2b73640 1 -- 172.21.15.194:0/2215307497 <== osd.1 v2:172.21.15.194:6808/3135444559 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94132879780768] v35'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4b400a4d0 con 0x559d04dba910 2024-09-13T06:10:56.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.785+0000 7fc4c4862980 20 remove_watcher() i=4 2024-09-13T06:10:56.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.785+0000 7fc4c4862980 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94132879773136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559d04def540 con 0x7fc4b80e0040 2024-09-13T06:10:56.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.785+0000 7fc4c2b73640 1 -- 172.21.15.194:0/2215307497 <== osd.0 v2:172.21.15.120:6800/1923744619 25 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94132879773136] v35'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4b400a4d0 con 0x7fc4b80e0040 2024-09-13T06:10:56.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.785+0000 7fc4c4862980 20 remove_watcher() i=5 2024-09-13T06:10:56.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.785+0000 7fc4c4862980 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94132879793600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559d04def540 con 0x7fc4b80e0040 2024-09-13T06:10:56.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.789+0000 7fc4c2b73640 1 -- 172.21.15.194:0/2215307497 <== osd.0 v2:172.21.15.120:6800/1923744619 26 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94132879793600] v35'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4b400a4d0 con 0x7fc4b80e0040 2024-09-13T06:10:56.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.789+0000 7fc4c4862980 20 remove_watcher() i=6 2024-09-13T06:10:56.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.789+0000 7fc4c4862980 1 -- 172.21.15.194:0/2215307497 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94132879797392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559d04def540 con 0x7fc4b80e0040 2024-09-13T06:10:56.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.793+0000 7fc4c2b73640 1 -- 172.21.15.194:0/2215307497 <== osd.0 v2:172.21.15.120:6800/1923744619 27 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94132879797392] v35'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4b400a4d0 con 0x7fc4b80e0040 2024-09-13T06:10:56.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.793+0000 7fc4c4862980 20 remove_watcher() i=7 2024-09-13T06:10:56.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.793+0000 7fc4c4862980 1 -- 172.21.15.194:0/2215307497 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fc4b80e0040 msgr2=0x7fc4b80e0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.793+0000 7fc4c4862980 1 --2- 172.21.15.194:0/2215307497 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fc4b80e0040 0x7fc4b80e0420 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.793+0000 7fc4c4862980 1 -- 172.21.15.194:0/2215307497 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x559d04dba910 msgr2=0x559d04dbcdd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.793+0000 7fc4c4862980 1 --2- 172.21.15.194:0/2215307497 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x559d04dba910 0x559d04dbcdd0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.793+0000 7fc4c4862980 1 -- 172.21.15.194:0/2215307497 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fc4bc069040 msgr2=0x7fc4bc072640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.793+0000 7fc4c4862980 1 --2- 172.21.15.194:0/2215307497 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fc4bc069040 0x7fc4bc072640 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.793+0000 7fc4c4862980 1 -- 172.21.15.194:0/2215307497 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x559d04dbf320 msgr2=0x559d04dc1710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.793+0000 7fc4c4862980 1 --2- 172.21.15.194:0/2215307497 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x559d04dbf320 0x559d04dc1710 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.793+0000 7fc4c4862980 1 -- 172.21.15.194:0/2215307497 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fc38c034650 msgr2=0x7fc38c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.793+0000 7fc4c4862980 1 --2- 172.21.15.194:0/2215307497 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fc38c034650 0x7fc38c036b10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc4b80aa910 tx=0x7fc4b80c1040 comp rx=0 tx=0).stop 2024-09-13T06:10:56.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.793+0000 7fc4c2b73640 1 -- 172.21.15.194:0/2215307497 reap_dead start 2024-09-13T06:10:56.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.793+0000 7fc4c4862980 1 -- 172.21.15.194:0/2215307497 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559d04da86b0 msgr2=0x559d04daf850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.793+0000 7fc4c4862980 1 --2- 172.21.15.194:0/2215307497 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559d04da86b0 0x559d04daf850 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc027820 tx=0x7fc4bc04def0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.793+0000 7fc4c4862980 1 -- 172.21.15.194:0/2215307497 shutdown_connections 2024-09-13T06:10:56.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.793+0000 7fc4c4862980 1 --2- 172.21.15.194:0/2215307497 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559d04da86b0 0x559d04daf850 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.793+0000 7fc4c4862980 1 -- 172.21.15.194:0/2215307497 >> 172.21.15.194:0/2215307497 conn(0x559d04da4a90 msgr2=0x559d04da2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:56.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.793+0000 7fc4c4862980 1 -- 172.21.15.194:0/2215307497 shutdown_connections 2024-09-13T06:10:56.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.793+0000 7fc4c4862980 1 -- 172.21.15.194:0/2215307497 wait complete. 2024-09-13T06:10:56.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.793+0000 7fc4c4862980 1 -- 172.21.15.194:0/2641005542 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fc39c034650 msgr2=0x7fc39c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.793+0000 7fc4c4862980 1 --2- 172.21.15.194:0/2641005542 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fc39c034650 0x7fc39c036b10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc4b8000c10 tx=0x7fc4b8005ad0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.793+0000 7fc4c4862980 1 -- 172.21.15.194:0/2641005542 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559d04d9bec0 msgr2=0x559d04d9c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.793+0000 7fc4c4862980 1 --2- 172.21.15.194:0/2641005542 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559d04d9bec0 0x559d04d9c2e0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc04a010 tx=0x7fc4bc019970 comp rx=0 tx=0).stop 2024-09-13T06:10:56.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.793+0000 7fc4c4862980 1 -- 172.21.15.194:0/2641005542 shutdown_connections 2024-09-13T06:10:56.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.793+0000 7fc4c4862980 1 --2- 172.21.15.194:0/2641005542 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fc39c034650 0x7fc39c036b10 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.793+0000 7fc4c4862980 1 --2- 172.21.15.194:0/2641005542 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559d04d9bec0 0x559d04d9c2e0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.793+0000 7fc4c4862980 1 -- 172.21.15.194:0/2641005542 >> 172.21.15.194:0/2641005542 conn(0x559d04d91010 msgr2=0x559d04d93a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:56.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.793+0000 7fc4c4862980 1 -- 172.21.15.194:0/2641005542 shutdown_connections 2024-09-13T06:10:56.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.793+0000 7fc4c4862980 1 -- 172.21.15.194:0/2641005542 wait complete. 2024-09-13T06:10:56.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.793+0000 7fc4c4862980 1 -- 172.21.15.194:0/193889980 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x559d04c8db00 msgr2=0x559d04d85290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.793+0000 7fc4c4862980 1 --2- 172.21.15.194:0/193889980 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x559d04c8db00 0x559d04d85290 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.793+0000 7fc4c4862980 1 -- 172.21.15.194:0/193889980 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x559d04d8b900 msgr2=0x559d04d8dcf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.793+0000 7fc4c4862980 1 --2- 172.21.15.194:0/193889980 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x559d04d8b900 0x559d04d8dcf0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.793+0000 7fc4c4862980 1 -- 172.21.15.194:0/193889980 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x559d04d87a00 msgr2=0x559d04d89df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.793+0000 7fc4c4862980 1 --2- 172.21.15.194:0/193889980 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x559d04d87a00 0x559d04d89df0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.793+0000 7fc4c4862980 1 -- 172.21.15.194:0/193889980 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fc3a8034650 msgr2=0x7fc3a8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.793+0000 7fc4c4862980 1 --2- 172.21.15.194:0/193889980 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fc3a8034650 0x7fc3a8036b10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc4b80ae000 tx=0x7fc4b80a6000 comp rx=0 tx=0).stop 2024-09-13T06:10:56.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.793+0000 7fc4c4862980 1 -- 172.21.15.194:0/193889980 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559d04bfe2d0 msgr2=0x559d04c89cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.793+0000 7fc4c4862980 1 --2- 172.21.15.194:0/193889980 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559d04bfe2d0 0x559d04c89cc0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x559d04d75ce0 tx=0x7fc4bc000bd0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.793+0000 7fc4c2b73640 1 -- 172.21.15.194:0/193889980 reap_dead start 2024-09-13T06:10:56.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.793+0000 7fc4c4862980 1 -- 172.21.15.194:0/193889980 shutdown_connections 2024-09-13T06:10:56.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.793+0000 7fc4c4862980 1 -- 172.21.15.194:0/193889980 >> 172.21.15.194:0/193889980 conn(0x559d04c840d0 msgr2=0x559d04d6f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:56.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.793+0000 7fc4c4862980 1 -- 172.21.15.194:0/193889980 shutdown_connections 2024-09-13T06:10:56.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.793+0000 7fc4c4862980 1 -- 172.21.15.194:0/193889980 wait complete. 2024-09-13T06:10:56.806 DEBUG:tasks.util.rgw: json result: {'user_id': 'bar', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bar', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-09-13T06:10:56.773999Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:10:56.773988Z', 'tags': [], 'group_ids': []} 2024-09-13T06:10:56.830 INFO:tasks.radosgw_admin:RL: create_bucket myfoo6 bar bytes_out=0 bytes_in=0 failed=False 2024-09-13T06:10:56.837 INFO:tasks.radosgw_admin:RL: put_obj myfoo6 bar bytes_out=8 bytes_in=0 failed=False 2024-09-13T06:10:56.838 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-09-13T06:10:56.838 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-09-13T06:10:56.838 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bar --new-uid bud 2024-09-13T06:10:56.877 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:10:56.878 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:10:56.878 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.873+0000 7fa674ec6980 1 Processor -- start 2024-09-13T06:10:56.879 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.873+0000 7fa674ec6980 1 -- start start 2024-09-13T06:10:56.879 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.873+0000 7fa674ec6980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55d88e844ad0 0x55d88e8d3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.879 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.873+0000 7fa674ec6980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d88e758ae0 con 0x55d88e8d38c0 2024-09-13T06:10:56.879 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.873+0000 7fa674ec6980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x55d88e77ce30 con 0x55d88e844ad0 2024-09-13T06:10:56.879 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.873+0000 7fa6729d6640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55d88e844ad0 0x55d88e8d3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.880 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.873+0000 7fa6721d5640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x55d88e8d38c0 0x55d88e8d5cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:34424/0 (socket says 172.21.15.194:34424) 2024-09-13T06:10:56.880 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.873+0000 7fa6721d5640 1 -- 172.21.15.194:0/800124138 learned_addr learned my addr 172.21.15.194:0/800124138 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-09-13T06:10:56.880 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.877+0000 7fa6729d6640 1 -- 172.21.15.194:0/800124138 >> v1:172.21.15.120:6789/0 conn(0x55d88e8d38c0 legacy=0x55d88e8d5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.880 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.877+0000 7fa6729d6640 1 -- 172.21.15.194:0/800124138 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d88e8d83e0 con 0x55d88e844ad0 2024-09-13T06:10:56.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.877+0000 7fa6729d6640 1 --2- 172.21.15.194:0/800124138 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d88e844ad0 0x55d88e8d3380 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fa66c00a420 tx=0x7fa66c01afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66671901db9ab037 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.877+0000 7fa6719d4640 1 -- 172.21.15.194:0/800124138 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa66c0af070 con 0x55d88e844ad0 2024-09-13T06:10:56.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.877+0000 7fa6719d4640 1 -- 172.21.15.194:0/800124138 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa66c0aa530 con 0x55d88e844ad0 2024-09-13T06:10:56.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.877+0000 7fa6719d4640 1 -- 172.21.15.194:0/800124138 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa66c0aa850 con 0x55d88e844ad0 2024-09-13T06:10:56.883 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.877+0000 7fa674ec6980 1 -- 172.21.15.194:0/800124138 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d88e844ad0 msgr2=0x55d88e8d3380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.883 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.877+0000 7fa674ec6980 1 --2- 172.21.15.194:0/800124138 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d88e844ad0 0x55d88e8d3380 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fa66c00a420 tx=0x7fa66c01afd0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.883 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.877+0000 7fa674ec6980 1 -- 172.21.15.194:0/800124138 shutdown_connections 2024-09-13T06:10:56.884 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.877+0000 7fa674ec6980 1 --2- 172.21.15.194:0/800124138 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d88e844ad0 0x55d88e8d3380 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.884 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.877+0000 7fa674ec6980 1 -- 172.21.15.194:0/800124138 >> 172.21.15.194:0/800124138 conn(0x55d88e8cb070 msgr2=0x55d88e8cd490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:56.884 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.877+0000 7fa674ec6980 1 -- 172.21.15.194:0/800124138 shutdown_connections 2024-09-13T06:10:56.884 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.877+0000 7fa674ec6980 1 -- 172.21.15.194:0/800124138 wait complete. 2024-09-13T06:10:56.896 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.893+0000 7fa674ec6980 1 Processor -- start 2024-09-13T06:10:56.896 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.893+0000 7fa674ec6980 1 -- start start 2024-09-13T06:10:56.896 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.893+0000 7fa674ec6980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d88e844ad0 0x55d88e9bba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.896 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.893+0000 7fa674ec6980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55d88e77e200 con 0x55d88e844ad0 2024-09-13T06:10:56.897 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.893+0000 7fa6729d6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d88e844ad0 0x55d88e9bba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.897 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.893+0000 7fa6729d6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d88e844ad0 0x55d88e9bba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:38840/0 (socket says 172.21.15.194:38840) 2024-09-13T06:10:56.897 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.893+0000 7fa6729d6640 1 -- 172.21.15.194:0/3341229646 learned_addr learned my addr 172.21.15.194:0/3341229646 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:56.897 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.893+0000 7fa6729d6640 1 -- 172.21.15.194:0/3341229646 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d88e9bc030 con 0x55d88e844ad0 2024-09-13T06:10:56.898 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.893+0000 7fa6729d6640 1 --2- 172.21.15.194:0/3341229646 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d88e844ad0 0x55d88e9bba60 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fa66c00a420 tx=0x7fa66c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8447730cccc57f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.898 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.893+0000 7fa560e09640 1 -- 172.21.15.194:0/3341229646 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa66c0af050 con 0x55d88e844ad0 2024-09-13T06:10:56.898 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.893+0000 7fa560e09640 1 -- 172.21.15.194:0/3341229646 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa66c0b0040 con 0x55d88e844ad0 2024-09-13T06:10:56.898 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.893+0000 7fa560e09640 1 -- 172.21.15.194:0/3341229646 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa66c0aac60 con 0x55d88e844ad0 2024-09-13T06:10:56.899 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.893+0000 7fa674ec6980 1 -- 172.21.15.194:0/3341229646 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d88e844ad0 msgr2=0x55d88e9bba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.899 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.893+0000 7fa674ec6980 1 --2- 172.21.15.194:0/3341229646 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d88e844ad0 0x55d88e9bba60 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fa66c00a420 tx=0x7fa66c0033b0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.899 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.893+0000 7fa674ec6980 1 -- 172.21.15.194:0/3341229646 shutdown_connections 2024-09-13T06:10:56.899 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.893+0000 7fa674ec6980 1 --2- 172.21.15.194:0/3341229646 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d88e844ad0 0x55d88e9bba60 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.900 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.893+0000 7fa674ec6980 1 -- 172.21.15.194:0/3341229646 >> 172.21.15.194:0/3341229646 conn(0x55d88e8cb070 msgr2=0x55d88e9b7690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:56.900 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.893+0000 7fa674ec6980 1 -- 172.21.15.194:0/3341229646 shutdown_connections 2024-09-13T06:10:56.900 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.893+0000 7fa674ec6980 1 -- 172.21.15.194:0/3341229646 wait complete. 2024-09-13T06:10:56.900 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.893+0000 7fa674ec6980 1 Processor -- start 2024-09-13T06:10:56.900 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.893+0000 7fa674ec6980 1 -- start start 2024-09-13T06:10:56.900 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.893+0000 7fa674ec6980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d88e844ad0 0x55d88e8d0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.900 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.893+0000 7fa674ec6980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55d88e8d7e20 con 0x55d88e844ad0 2024-09-13T06:10:56.900 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.893+0000 7fa6729d6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d88e844ad0 0x55d88e8d0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.900 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.893+0000 7fa6729d6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d88e844ad0 0x55d88e8d0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:38846/0 (socket says 172.21.15.194:38846) 2024-09-13T06:10:56.900 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.893+0000 7fa6729d6640 1 -- 172.21.15.194:0/4089215951 learned_addr learned my addr 172.21.15.194:0/4089215951 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:56.900 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.897+0000 7fa6729d6640 1 -- 172.21.15.194:0/4089215951 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d88e8cf3a0 con 0x55d88e844ad0 2024-09-13T06:10:56.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.897+0000 7fa6729d6640 1 --2- 172.21.15.194:0/4089215951 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d88e844ad0 0x55d88e8d0c80 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fa66c01b870 tx=0x7fa66c019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.897+0000 7fa55f606640 1 -- 172.21.15.194:0/4089215951 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa66c0c5020 con 0x55d88e844ad0 2024-09-13T06:10:56.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.897+0000 7fa674ec6980 1 -- 172.21.15.194:0/4089215951 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d88e8cf630 con 0x55d88e844ad0 2024-09-13T06:10:56.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.897+0000 7fa674ec6980 1 -- 172.21.15.194:0/4089215951 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d88e8cfb80 con 0x55d88e844ad0 2024-09-13T06:10:56.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.897+0000 7fa55f606640 1 -- 172.21.15.194:0/4089215951 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa66c0c1480 con 0x55d88e844ad0 2024-09-13T06:10:56.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.897+0000 7fa55f606640 1 -- 172.21.15.194:0/4089215951 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa66c0c1760 con 0x55d88e844ad0 2024-09-13T06:10:56.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.897+0000 7fa55f606640 1 -- 172.21.15.194:0/4089215951 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa66c0ca440 con 0x55d88e844ad0 2024-09-13T06:10:56.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.897+0000 7fa55f606640 1 --2- 172.21.15.194:0/4089215951 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa558034650 0x7fa558036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.897+0000 7fa55f606640 1 -- 172.21.15.194:0/4089215951 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fa66c0bb070 con 0x55d88e844ad0 2024-09-13T06:10:56.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.897+0000 7fa6721d5640 1 --2- 172.21.15.194:0/4089215951 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa558034650 0x7fa558036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.897+0000 7fa674ec6980 1 --2- 172.21.15.194:0/4089215951 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55d88e8d38c0 0x55d88e9cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.897+0000 7fa674ec6980 1 -- 172.21.15.194:0/4089215951 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d88e9cc610 con 0x55d88e8d38c0 2024-09-13T06:10:56.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.897+0000 7fa6731d7640 1 --2- 172.21.15.194:0/4089215951 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55d88e8d38c0 0x55d88e9cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.897+0000 7fa6721d5640 1 --2- 172.21.15.194:0/4089215951 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa558034650 0x7fa558036b10 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa668000f70 tx=0x7fa6680012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.897+0000 7fa6731d7640 1 --2- 172.21.15.194:0/4089215951 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55d88e8d38c0 0x55d88e9cc0d0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.897+0000 7fa6731d7640 1 -- 172.21.15.194:0/4089215951 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa6640083f0 con 0x55d88e8d38c0 2024-09-13T06:10:56.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.897+0000 7fa674ec6980 1 -- 172.21.15.194:0/4089215951 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d88e9cca60 con 0x55d88e8d38c0 2024-09-13T06:10:56.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.897+0000 7fa6731d7640 1 -- 172.21.15.194:0/4089215951 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa6640083f0 con 0x55d88e8d38c0 2024-09-13T06:10:56.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.897+0000 7fa674ec6980 1 --2- 172.21.15.194:0/4089215951 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55d88e9ce870 0x55d88e9d0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.897+0000 7fa674ec6980 1 -- 172.21.15.194:0/4089215951 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d88e9d1350 con 0x55d88e9ce870 2024-09-13T06:10:56.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.897+0000 7fa6729d6640 1 --2- 172.21.15.194:0/4089215951 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55d88e9ce870 0x55d88e9d0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.901+0000 7fa6729d6640 1 --2- 172.21.15.194:0/4089215951 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55d88e9ce870 0x55d88e9d0c60 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.909 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.901+0000 7fa6729d6640 1 -- 172.21.15.194:0/4089215951 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa66c0c7070 con 0x55d88e9ce870 2024-09-13T06:10:56.909 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.901+0000 7fa674ec6980 1 -- 172.21.15.194:0/4089215951 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d88e9cd710 con 0x55d88e8d38c0 2024-09-13T06:10:56.909 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.901+0000 7fa6731d7640 1 -- 172.21.15.194:0/4089215951 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa6640083f0 con 0x55d88e8d38c0 2024-09-13T06:10:56.909 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.901+0000 7fa674ec6980 1 --2- 172.21.15.194:0/4089215951 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55d88e9d27b0 0x55d88e9d4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.909 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.901+0000 7fa674ec6980 1 -- 172.21.15.194:0/4089215951 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d88e9d52e0 con 0x55d88e9d27b0 2024-09-13T06:10:56.909 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.901+0000 7fa6721d5640 1 --2- 172.21.15.194:0/4089215951 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55d88e9d27b0 0x55d88e9d4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.909 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.901+0000 7fa6721d5640 1 --2- 172.21.15.194:0/4089215951 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55d88e9d27b0 0x55d88e9d4ba0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.909 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.901+0000 7fa6721d5640 1 -- 172.21.15.194:0/4089215951 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa66800e620 con 0x55d88e9d27b0 2024-09-13T06:10:56.909 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.901+0000 7fa674ec6980 1 Processor -- start 2024-09-13T06:10:56.910 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.901+0000 7fa674ec6980 1 -- start start 2024-09-13T06:10:56.910 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.901+0000 7fa674ec6980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d88e9e2db0 0x55d88e9e31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.910 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.901+0000 7fa674ec6980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55d88e7d7800 con 0x55d88e9e2db0 2024-09-13T06:10:56.910 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.901+0000 7fa6729d6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d88e9e2db0 0x55d88e9e31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.910 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.901+0000 7fa6729d6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d88e9e2db0 0x55d88e9e31d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:38852/0 (socket says 172.21.15.194:38852) 2024-09-13T06:10:56.910 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.901+0000 7fa6729d6640 1 -- 172.21.15.194:0/194860629 learned_addr learned my addr 172.21.15.194:0/194860629 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:56.910 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.901+0000 7fa6729d6640 1 -- 172.21.15.194:0/194860629 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d88e9e3710 con 0x55d88e9e2db0 2024-09-13T06:10:56.910 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.901+0000 7fa6729d6640 1 --2- 172.21.15.194:0/194860629 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d88e9e2db0 0x55d88e9e31d0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fa66c0e3050 tx=0x7fa66c0b48c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.910 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.901+0000 7fa55ce01640 1 -- 172.21.15.194:0/194860629 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa66c0caa90 con 0x55d88e9e2db0 2024-09-13T06:10:56.910 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.901+0000 7fa674ec6980 1 -- 172.21.15.194:0/194860629 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d88e9e39a0 con 0x55d88e9e2db0 2024-09-13T06:10:56.911 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.901+0000 7fa55ce01640 1 -- 172.21.15.194:0/194860629 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa66c0cac30 con 0x55d88e9e2db0 2024-09-13T06:10:56.911 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.901+0000 7fa674ec6980 1 -- 172.21.15.194:0/194860629 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d88e9e6620 con 0x55d88e9e2db0 2024-09-13T06:10:56.911 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.901+0000 7fa55ce01640 1 -- 172.21.15.194:0/194860629 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa66c0dc3a0 con 0x55d88e9e2db0 2024-09-13T06:10:56.911 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.905+0000 7fa55ce01640 1 -- 172.21.15.194:0/194860629 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa66c0c1900 con 0x55d88e9e2db0 2024-09-13T06:10:56.911 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.905+0000 7fa55ce01640 1 --2- 172.21.15.194:0/194860629 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa54c034650 0x7fa54c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.911 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.905+0000 7fa55ce01640 1 -- 172.21.15.194:0/194860629 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fa66c0d0040 con 0x55d88e9e2db0 2024-09-13T06:10:56.911 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.905+0000 7fa6721d5640 1 --2- 172.21.15.194:0/194860629 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa54c034650 0x7fa54c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.911 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.905+0000 7fa674ec6980 1 Processor -- start 2024-09-13T06:10:56.911 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.905+0000 7fa674ec6980 1 -- start start 2024-09-13T06:10:56.911 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.905+0000 7fa674ec6980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d88e9ef6e0 0x55d88e9efac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.911 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.905+0000 7fa674ec6980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55d88e9bc2f0 con 0x55d88e9ef6e0 2024-09-13T06:10:56.911 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.905+0000 7fa6721d5640 1 --2- 172.21.15.194:0/194860629 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa54c034650 0x7fa54c036b10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa66800bf60 tx=0x7fa66800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.912 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.905+0000 7fa6729d6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d88e9ef6e0 0x55d88e9efac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.912 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.905+0000 7fa6729d6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d88e9ef6e0 0x55d88e9efac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:38868/0 (socket says 172.21.15.194:38868) 2024-09-13T06:10:56.912 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.905+0000 7fa6729d6640 1 -- 172.21.15.194:0/1819909056 learned_addr learned my addr 172.21.15.194:0/1819909056 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:56.918 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.905+0000 7fa6729d6640 1 -- 172.21.15.194:0/1819909056 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d88e9f0090 con 0x55d88e9ef6e0 2024-09-13T06:10:56.919 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.905+0000 7fa6729d6640 1 --2- 172.21.15.194:0/1819909056 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d88e9ef6e0 0x55d88e9efac0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fa66c0a9ba0 tx=0x7fa66c0dccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87069fe56bbefee3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.919 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.905+0000 7fa5567fc640 1 -- 172.21.15.194:0/1819909056 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa66c0d4810 con 0x55d88e9ef6e0 2024-09-13T06:10:56.919 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.905+0000 7fa5567fc640 1 -- 172.21.15.194:0/1819909056 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa66c0c9a60 con 0x55d88e9ef6e0 2024-09-13T06:10:56.919 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.905+0000 7fa5567fc640 1 -- 172.21.15.194:0/1819909056 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa66c0e41a0 con 0x55d88e9ef6e0 2024-09-13T06:10:56.919 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.905+0000 7fa674ec6980 1 -- 172.21.15.194:0/1819909056 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d88e9ef6e0 msgr2=0x55d88e9efac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:56.919 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.905+0000 7fa674ec6980 1 --2- 172.21.15.194:0/1819909056 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d88e9ef6e0 0x55d88e9efac0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fa66c0a9ba0 tx=0x7fa66c0dccb0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.919 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.905+0000 7fa674ec6980 1 -- 172.21.15.194:0/1819909056 shutdown_connections 2024-09-13T06:10:56.919 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.905+0000 7fa674ec6980 1 --2- 172.21.15.194:0/1819909056 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d88e9ef6e0 0x55d88e9efac0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:56.919 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.905+0000 7fa674ec6980 1 -- 172.21.15.194:0/1819909056 >> 172.21.15.194:0/1819909056 conn(0x55d88e9ebac0 msgr2=0x55d88e9e9bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:56.919 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.905+0000 7fa674ec6980 1 -- 172.21.15.194:0/1819909056 shutdown_connections 2024-09-13T06:10:56.919 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.905+0000 7fa674ec6980 1 -- 172.21.15.194:0/1819909056 wait complete. 2024-09-13T06:10:56.920 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.905+0000 7fa674ec6980 1 Processor -- start 2024-09-13T06:10:56.920 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.905+0000 7fa674ec6980 1 -- start start 2024-09-13T06:10:56.920 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.905+0000 7fa674ec6980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d88e9ef6e0 0x55d88e9f6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.920 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.905+0000 7fa674ec6980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55d88e9f0530 con 0x55d88e9ef6e0 2024-09-13T06:10:56.920 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.909+0000 7fa6729d6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d88e9ef6e0 0x55d88e9f6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.920 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.909+0000 7fa6729d6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d88e9ef6e0 0x55d88e9f6820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:38872/0 (socket says 172.21.15.194:38872) 2024-09-13T06:10:56.920 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.909+0000 7fa6729d6640 1 -- 172.21.15.194:0/720054522 learned_addr learned my addr 172.21.15.194:0/720054522 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:10:56.920 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.909+0000 7fa6729d6640 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d88e9f6d60 con 0x55d88e9ef6e0 2024-09-13T06:10:56.920 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.909+0000 7fa6729d6640 1 --2- 172.21.15.194:0/720054522 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d88e9ef6e0 0x55d88e9f6820 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fa66c0d4be0 tx=0x7fa66c0c4eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.920 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.909+0000 7fa554ff9640 1 -- 172.21.15.194:0/720054522 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa66c108070 con 0x55d88e9ef6e0 2024-09-13T06:10:56.920 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.909+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d88e9f6d60 con 0x55d88e9ef6e0 2024-09-13T06:10:56.921 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.909+0000 7fa554ff9640 1 -- 172.21.15.194:0/720054522 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa66c0d4810 con 0x55d88e9ef6e0 2024-09-13T06:10:56.921 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.909+0000 7fa554ff9640 1 -- 172.21.15.194:0/720054522 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa66c0c1c40 con 0x55d88e9ef6e0 2024-09-13T06:10:56.921 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.909+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d88e9f7230 con 0x55d88e9ef6e0 2024-09-13T06:10:56.921 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.909+0000 7fa554ff9640 1 -- 172.21.15.194:0/720054522 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa66c10b070 con 0x55d88e9ef6e0 2024-09-13T06:10:56.921 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.909+0000 7fa554ff9640 1 --2- 172.21.15.194:0/720054522 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa53c034650 0x7fa53c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.921 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.909+0000 7fa674ec6980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.921 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.909+0000 7fa554ff9640 1 -- 172.21.15.194:0/720054522 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fa66c0fe070 con 0x55d88e9ef6e0 2024-09-13T06:10:56.921 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.909+0000 7fa6721d5640 1 --2- 172.21.15.194:0/720054522 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa53c034650 0x7fa53c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.921 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.909+0000 7fa674ec6980 1 --2- 172.21.15.194:0/720054522 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55d88ea01990 0x55d88ea03e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.921 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.909+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea04570 con 0x55d88ea01990 2024-09-13T06:10:56.922 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.909+0000 7fa6731d7640 1 --2- 172.21.15.194:0/720054522 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55d88ea01990 0x55d88ea03e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.922 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.909+0000 7fa6721d5640 1 --2- 172.21.15.194:0/720054522 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa53c034650 0x7fa53c036b10 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x55d88e8cfea0 tx=0x7fa668010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.922 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.909+0000 7fa6731d7640 1 --2- 172.21.15.194:0/720054522 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55d88ea01990 0x55d88ea03e20 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.922 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.909+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa6640083f0 con 0x55d88ea01990 2024-09-13T06:10:56.922 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.909+0000 7fa674ec6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:56.922 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.909+0000 7fa674ec6980 20 realm 2024-09-13T06:10:56.922 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.909+0000 7fa674ec6980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.922 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.909+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea04980 con 0x55d88ea01990 2024-09-13T06:10:56.922 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.909+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa6640083f0 con 0x55d88ea01990 2024-09-13T06:10:56.922 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.909+0000 7fa674ec6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:56.923 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.909+0000 7fa674ec6980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:10:56.923 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.909+0000 7fa674ec6980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.923 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.909+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea05220 con 0x55d88ea01990 2024-09-13T06:10:56.923 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.909+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa6640083f0 con 0x55d88ea01990 2024-09-13T06:10:56.923 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.909+0000 7fa674ec6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:56.923 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.909+0000 7fa674ec6980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.924 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.913+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea055c0 con 0x55d88ea01990 2024-09-13T06:10:56.924 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.913+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa6640083f0 con 0x55d88ea01990 2024-09-13T06:10:56.924 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.913+0000 7fa674ec6980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:10:56.924 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.913+0000 7fa674ec6980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.924 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.913+0000 7fa674ec6980 1 --2- 172.21.15.194:0/720054522 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55d88ea06320 0x55d88ea08710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.924 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.913+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea08d60 con 0x55d88ea06320 2024-09-13T06:10:56.924 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.913+0000 7fa6729d6640 1 --2- 172.21.15.194:0/720054522 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55d88ea06320 0x55d88ea08710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.924 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.913+0000 7fa6729d6640 1 --2- 172.21.15.194:0/720054522 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55d88ea06320 0x55d88ea08710 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.924 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.913+0000 7fa6729d6640 1 -- 172.21.15.194:0/720054522 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa66c10a030 con 0x55d88ea06320 2024-09-13T06:10:56.924 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.913+0000 7fa674ec6980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:10:56.925 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.913+0000 7fa674ec6980 20 searching for the correct realm 2024-09-13T06:10:56.925 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.913+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea0a5c0 con 0x55d88ea06320 2024-09-13T06:10:56.925 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.913+0000 7fa6729d6640 1 -- 172.21.15.194:0/720054522 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa66c10a030 con 0x55d88ea06320 2024-09-13T06:10:56.925 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.913+0000 7fa6729d6640 1 --2- 172.21.15.194:0/720054522 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fa66c10d070 0x7fa66c1048a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.925 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.913+0000 7fa6729d6640 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea0a5c0 con 0x7fa66c10d070 2024-09-13T06:10:56.925 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.913+0000 7fa6721d5640 1 --2- 172.21.15.194:0/720054522 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fa66c10d070 0x7fa66c1048a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.925 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.913+0000 7fa6721d5640 1 --2- 172.21.15.194:0/720054522 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fa66c10d070 0x7fa66c1048a0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.925 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.913+0000 7fa6721d5640 1 -- 172.21.15.194:0/720054522 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa66800e620 con 0x7fa66c10d070 2024-09-13T06:10:56.925 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.913+0000 7fa6721d5640 1 --2- 172.21.15.194:0/720054522 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fa668037040 0x7fa668036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:10:56.925 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.913+0000 7fa6721d5640 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea0a5c0 con 0x7fa668037040 2024-09-13T06:10:56.926 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.913+0000 7fa6731d7640 1 --2- 172.21.15.194:0/720054522 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fa668037040 0x7fa668036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:10:56.926 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.913+0000 7fa6731d7640 1 --2- 172.21.15.194:0/720054522 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fa668037040 0x7fa668036410 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:10:56.926 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.913+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6640083f0 con 0x7fa668037040 2024-09-13T06:10:56.926 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.913+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea055c0 con 0x55d88ea01990 2024-09-13T06:10:56.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.913+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6640083f0 con 0x55d88ea01990 2024-09-13T06:10:56.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.913+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea055c0 con 0x55d88ea01990 2024-09-13T06:10:56.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.917+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6640083f0 con 0x55d88ea01990 2024-09-13T06:10:56.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.917+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea055c0 con 0x7fa668037040 2024-09-13T06:10:56.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.917+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6640083f0 con 0x7fa668037040 2024-09-13T06:10:56.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.917+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea055c0 con 0x7fa668037040 2024-09-13T06:10:56.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.917+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6640083f0 con 0x7fa668037040 2024-09-13T06:10:56.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.917+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea055c0 con 0x7fa66c10d070 2024-09-13T06:10:56.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.917+0000 7fa6721d5640 1 -- 172.21.15.194:0/720054522 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa66800e620 con 0x7fa66c10d070 2024-09-13T06:10:56.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.917+0000 7fa6721d5640 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea055c0 con 0x55d88ea06320 2024-09-13T06:10:56.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.917+0000 7fa6729d6640 1 -- 172.21.15.194:0/720054522 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa66c10a030 con 0x55d88ea06320 2024-09-13T06:10:56.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.917+0000 7fa6729d6640 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea055c0 con 0x55d88ea01990 2024-09-13T06:10:56.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.917+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6640083f0 con 0x55d88ea01990 2024-09-13T06:10:56.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.917+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea055c0 con 0x7fa668037040 2024-09-13T06:10:56.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.917+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6640083f0 con 0x7fa668037040 2024-09-13T06:10:56.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.917+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea055c0 con 0x55d88ea01990 2024-09-13T06:10:56.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.917+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6640083f0 con 0x55d88ea01990 2024-09-13T06:10:56.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.917+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea055c0 con 0x7fa66c10d070 2024-09-13T06:10:56.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.917+0000 7fa6721d5640 1 -- 172.21.15.194:0/720054522 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa66800e620 con 0x7fa66c10d070 2024-09-13T06:10:56.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.917+0000 7fa6721d5640 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea055c0 con 0x55d88ea06320 2024-09-13T06:10:56.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.917+0000 7fa6729d6640 1 -- 172.21.15.194:0/720054522 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa66c10a030 con 0x55d88ea06320 2024-09-13T06:10:56.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.917+0000 7fa6729d6640 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea055c0 con 0x55d88ea06320 2024-09-13T06:10:56.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.917+0000 7fa6729d6640 1 -- 172.21.15.194:0/720054522 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa66c10a030 con 0x55d88ea06320 2024-09-13T06:10:56.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.917+0000 7fa6729d6640 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea055c0 con 0x7fa668037040 2024-09-13T06:10:56.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.921+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6640083f0 con 0x7fa668037040 2024-09-13T06:10:56.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.921+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea055c0 con 0x55d88ea06320 2024-09-13T06:10:56.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.921+0000 7fa6729d6640 1 -- 172.21.15.194:0/720054522 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa66c10a030 con 0x55d88ea06320 2024-09-13T06:10:56.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.921+0000 7fa6729d6640 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea055c0 con 0x55d88ea06320 2024-09-13T06:10:56.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.921+0000 7fa6729d6640 1 -- 172.21.15.194:0/720054522 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa66c10a030 con 0x55d88ea06320 2024-09-13T06:10:56.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.921+0000 7fa6729d6640 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea055c0 con 0x55d88ea01990 2024-09-13T06:10:56.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.921+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6640083f0 con 0x55d88ea01990 2024-09-13T06:10:56.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.921+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea055c0 con 0x55d88ea01990 2024-09-13T06:10:56.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.921+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa6640083f0 con 0x55d88ea01990 2024-09-13T06:10:56.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.921+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea055c0 con 0x7fa66c10d070 2024-09-13T06:10:56.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.921+0000 7fa6721d5640 1 -- 172.21.15.194:0/720054522 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa66800e620 con 0x7fa66c10d070 2024-09-13T06:10:56.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.921+0000 7fa6721d5640 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea055c0 con 0x55d88ea06320 2024-09-13T06:10:56.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.921+0000 7fa6729d6640 1 -- 172.21.15.194:0/720054522 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa66c10a030 con 0x55d88ea06320 2024-09-13T06:10:56.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.921+0000 7fa6729d6640 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea055c0 con 0x7fa66c10d070 2024-09-13T06:10:56.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.921+0000 7fa6721d5640 1 -- 172.21.15.194:0/720054522 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa66800e620 con 0x7fa66c10d070 2024-09-13T06:10:56.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.921+0000 7fa6721d5640 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea055c0 con 0x55d88ea01990 2024-09-13T06:10:56.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.921+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6640083f0 con 0x55d88ea01990 2024-09-13T06:10:56.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.921+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea055c0 con 0x7fa668037040 2024-09-13T06:10:56.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.921+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6640083f0 con 0x7fa668037040 2024-09-13T06:10:56.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.921+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea055c0 con 0x55d88ea06320 2024-09-13T06:10:56.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.921+0000 7fa6729d6640 1 -- 172.21.15.194:0/720054522 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa66c10a030 con 0x55d88ea06320 2024-09-13T06:10:56.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.921+0000 7fa6729d6640 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea055c0 con 0x7fa66c10d070 2024-09-13T06:10:56.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.921+0000 7fa6721d5640 1 -- 172.21.15.194:0/720054522 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa66800e620 con 0x7fa66c10d070 2024-09-13T06:10:56.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.921+0000 7fa6721d5640 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea055c0 con 0x7fa66c10d070 2024-09-13T06:10:56.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.925+0000 7fa6721d5640 1 -- 172.21.15.194:0/720054522 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa66800e620 con 0x7fa66c10d070 2024-09-13T06:10:56.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.925+0000 7fa6721d5640 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea055c0 con 0x55d88ea06320 2024-09-13T06:10:56.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.925+0000 7fa6729d6640 1 -- 172.21.15.194:0/720054522 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa66c10a030 con 0x55d88ea06320 2024-09-13T06:10:56.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.925+0000 7fa6729d6640 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea055c0 con 0x7fa668037040 2024-09-13T06:10:56.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.925+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6640083f0 con 0x7fa668037040 2024-09-13T06:10:56.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.925+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea055c0 con 0x55d88ea01990 2024-09-13T06:10:56.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.925+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa6640083f0 con 0x55d88ea01990 2024-09-13T06:10:56.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.925+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea055c0 con 0x7fa66c10d070 2024-09-13T06:10:56.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.925+0000 7fa6721d5640 1 -- 172.21.15.194:0/720054522 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa66800e620 con 0x7fa66c10d070 2024-09-13T06:10:56.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.925+0000 7fa674ec6980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:10:56.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.925+0000 7fa674ec6980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:10:56.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.925+0000 7fa674ec6980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:10:56.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.925+0000 7fa674ec6980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:10:56.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.925+0000 7fa674ec6980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:10:56.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.925+0000 7fa674ec6980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:10:56.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.925+0000 7fa674ec6980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.925+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea096e0 con 0x55d88ea01990 2024-09-13T06:10:56.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.925+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa6640083f0 con 0x55d88ea01990 2024-09-13T06:10:56.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.925+0000 7fa674ec6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:56.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.925+0000 7fa674ec6980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.925+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea09f30 con 0x55d88ea01990 2024-09-13T06:10:56.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.925+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa6640083f0 con 0x55d88ea01990 2024-09-13T06:10:56.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.925+0000 7fa674ec6980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:10:56.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.925+0000 7fa674ec6980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.925+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea09340 con 0x7fa66c10d070 2024-09-13T06:10:56.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.925+0000 7fa6721d5640 1 -- 172.21.15.194:0/720054522 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa66800e620 con 0x7fa66c10d070 2024-09-13T06:10:56.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.925+0000 7fa674ec6980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:10:56.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.925+0000 7fa674ec6980 20 zone default found 2024-09-13T06:10:56.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.925+0000 7fa674ec6980 4 Realm: () 2024-09-13T06:10:56.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.925+0000 7fa674ec6980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:10:56.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.925+0000 7fa674ec6980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:10:56.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.925+0000 7fa674ec6980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:10:56.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.925+0000 7fa674ec6980 20 zonegroup default 2024-09-13T06:10:56.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.925+0000 7fa674ec6980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.925+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea0a9f0 con 0x7fa668037040 2024-09-13T06:10:56.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.925+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa6640083f0 con 0x7fa668037040 2024-09-13T06:10:56.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.925+0000 7fa674ec6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:56.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.925+0000 7fa674ec6980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.925+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea09bf0 con 0x55d88ea06320 2024-09-13T06:10:56.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.925+0000 7fa6729d6640 1 -- 172.21.15.194:0/720054522 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa66c10a030 con 0x55d88ea06320 2024-09-13T06:10:56.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.925+0000 7fa674ec6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:56.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.925+0000 7fa674ec6980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.925+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea0c940 con 0x55d88ea06320 2024-09-13T06:10:56.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.925+0000 7fa6729d6640 1 -- 172.21.15.194:0/720054522 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa66c10a030 con 0x55d88ea06320 2024-09-13T06:10:56.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.925+0000 7fa674ec6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:10:56.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.925+0000 7fa674ec6980 20 started sync module instance, tier type = 2024-09-13T06:10:56.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.925+0000 7fa674ec6980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:10:56.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.925+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea0bd10 con 0x7fa66c10d070 2024-09-13T06:10:56.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.929+0000 7fa6721d5640 1 -- 172.21.15.194:0/720054522 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(44 notify.0 [create] v35'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa66800e620 con 0x7fa66c10d070 2024-09-13T06:10:56.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.929+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94388594196736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea0b970 con 0x7fa66c10d070 2024-09-13T06:10:56.944 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.929+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea0d870 con 0x55d88ea01990 2024-09-13T06:10:56.944 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.929+0000 7fa6721d5640 1 -- 172.21.15.194:0/720054522 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94388594196736] v35'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa66800e620 con 0x7fa66c10d070 2024-09-13T06:10:56.944 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.929+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v35'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6640083f0 con 0x55d88ea01990 2024-09-13T06:10:56.944 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.929+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94388594201536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea0dc90 con 0x55d88ea01990 2024-09-13T06:10:56.944 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.929+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea0e520 con 0x55d88ea06320 2024-09-13T06:10:56.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.933+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94388594201536] v35'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6640083f0 con 0x55d88ea01990 2024-09-13T06:10:56.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.933+0000 7fa6729d6640 1 -- 172.21.15.194:0/720054522 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v35'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa66c10a030 con 0x55d88ea06320 2024-09-13T06:10:56.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.933+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94388594202864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea0e910 con 0x55d88ea06320 2024-09-13T06:10:56.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.933+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea0f2d0 con 0x7fa66c10d070 2024-09-13T06:10:56.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.933+0000 7fa6721d5640 1 -- 172.21.15.194:0/720054522 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(50 notify.3 [create] v35'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa66800e620 con 0x7fa66c10d070 2024-09-13T06:10:56.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.933+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94388594208288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea0fb70 con 0x7fa66c10d070 2024-09-13T06:10:56.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.933+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea10570 con 0x55d88ea01990 2024-09-13T06:10:56.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.933+0000 7fa6729d6640 1 -- 172.21.15.194:0/720054522 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94388594202864] v35'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa66c10a030 con 0x55d88ea06320 2024-09-13T06:10:56.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.933+0000 7fa6721d5640 1 -- 172.21.15.194:0/720054522 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94388594208288] v35'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa66800e620 con 0x7fa66c10d070 2024-09-13T06:10:56.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.937+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v35'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6640083f0 con 0x55d88ea01990 2024-09-13T06:10:56.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.937+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94388594204112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea0f6c0 con 0x55d88ea01990 2024-09-13T06:10:56.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.937+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea10e40 con 0x7fa668037040 2024-09-13T06:10:56.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.937+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94388594204112] v35'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6640083f0 con 0x55d88ea01990 2024-09-13T06:10:56.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.937+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(54 notify.5 [create] v35'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6640083f0 con 0x7fa668037040 2024-09-13T06:10:56.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.937+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94388594212992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea0f6c0 con 0x7fa668037040 2024-09-13T06:10:56.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.937+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea112e0 con 0x7fa668037040 2024-09-13T06:10:56.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.941+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(56 notify.6 [create] v35'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6640083f0 con 0x7fa668037040 2024-09-13T06:10:56.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.941+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94388594216432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea11720 con 0x7fa668037040 2024-09-13T06:10:56.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.941+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea12230 con 0x7fa668037040 2024-09-13T06:10:56.949 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.941+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94388594212992] v35'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6640083f0 con 0x7fa668037040 2024-09-13T06:10:56.949 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.941+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94388594216432] v35'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6640083f0 con 0x7fa668037040 2024-09-13T06:10:56.949 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.941+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(58 notify.7 [create] v35'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6640083f0 con 0x7fa668037040 2024-09-13T06:10:56.949 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.941+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94388594217488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea10780 con 0x7fa668037040 2024-09-13T06:10:56.949 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.941+0000 7fa674ec6980 20 add_watcher() i=0 2024-09-13T06:10:56.949 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.941+0000 7fa674ec6980 20 add_watcher() i=1 2024-09-13T06:10:56.949 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.941+0000 7fa674ec6980 20 add_watcher() i=2 2024-09-13T06:10:56.949 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.941+0000 7fa674ec6980 20 add_watcher() i=3 2024-09-13T06:10:56.949 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.941+0000 7fa674ec6980 20 add_watcher() i=4 2024-09-13T06:10:56.949 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.941+0000 7fa674ec6980 20 add_watcher() i=5 2024-09-13T06:10:56.949 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.941+0000 7fa674ec6980 20 add_watcher() i=6 2024-09-13T06:10:56.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.945+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94388594217488] v35'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6640083f0 con 0x7fa668037040 2024-09-13T06:10:56.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.945+0000 7fa674ec6980 20 add_watcher() i=7 2024-09-13T06:10:56.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.945+0000 7fa674ec6980 2 all 8 watchers are set, enabling cache 2024-09-13T06:10:56.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.945+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea15220 con 0x55d88ea01990 2024-09-13T06:10:56.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.945+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa6640083f0 con 0x55d88ea01990 2024-09-13T06:10:56.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.945+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94388594220256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea126a0 con 0x55d88ea01990 2024-09-13T06:10:56.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.945+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94388594220256] v35'212 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa6640083f0 con 0x55d88ea01990 2024-09-13T06:10:56.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.945+0000 7fa5297e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:10:56.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.945+0000 7fa674ec6980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:10:56.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.945+0000 7fa674ec6980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:10:56.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.945+0000 7fa674ec6980 5 note: GC not initialized 2024-09-13T06:10:56.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.945+0000 7fa4a3fff640 20 reqs_thread_entry: start 2024-09-13T06:10:56.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.945+0000 7fa674ec6980 20 init_complete bucket index max shards: 11 2024-09-13T06:10:56.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.945+0000 7fa674ec6980 20 Filter name: none 2024-09-13T06:10:56.953 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.945+0000 7fa4a1ffb640 20 reqs_thread_entry: start 2024-09-13T06:10:56.953 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.945+0000 7fa674ec6980 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-13T06:10:56.953 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.945+0000 7fa674ec6980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.953 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.945+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea38760 con 0x7fa668037040 2024-09-13T06:10:56.955 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.949+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(62 bar [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fa6640083f0 con 0x7fa668037040 2024-09-13T06:10:56.955 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.949+0000 7fa674ec6980 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T06:10:56.956 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.949+0000 7fa674ec6980 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x13 2024-09-13T06:10:56.956 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.949+0000 7fa674ec6980 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-13T06:10:56.956 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.949+0000 7fa674ec6980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:10:56.956 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.949+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:63 8.4 8:267425a8:users.uid::bud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea3c920 con 0x7fa66c10d070 2024-09-13T06:10:56.956 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.949+0000 7fa6721d5640 1 -- 172.21.15.194:0/720054522 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(63 bud [create,call,writefull 0~206] v35'1 uv1 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fa66800e620 con 0x7fa66c10d070 2024-09-13T06:10:56.956 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.949+0000 7fa674ec6980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-13T06:10:56.956 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.949+0000 7fa674ec6980 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-13T06:10:56.956 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.949+0000 7fa674ec6980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-13T06:10:56.956 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.949+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:64 7.3 7:c609908c:::notify.5:head [notify cookie 94388594390768 in=394b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea3d5d0 con 0x7fa668037040 2024-09-13T06:10:56.956 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.949+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== watch-notify(notify (1) cookie 94388594212992 notify 150323855393 ret 0) ==== 424+0+0 (crc 0 0 0) 0x7fa664010040 con 0x7fa668037040 2024-09-13T06:10:56.956 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.949+0000 7fa5567fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855393 cookie 94388594212992 notifier 4731 bl.length()=382 2024-09-13T06:10:56.956 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.949+0000 7fa5567fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-13T06:10:56.956 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.949+0000 7fa5567fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-13T06:10:56.957 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.949+0000 7fa5567fc640 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fa538003eb0 con 0x7fa668037040 2024-09-13T06:10:56.957 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.949+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(64 notify.5 [notify cookie 94388594390768 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa6640083f0 con 0x7fa668037040 2024-09-13T06:10:56.957 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.949+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(65 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6640083f0 con 0x7fa668037040 2024-09-13T06:10:56.957 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.949+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== watch-notify(notify_complete (2) cookie 94388594390768 notify 150323855393 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fa66400bde0 con 0x7fa668037040 2024-09-13T06:10:56.957 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.949+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:66 8.5 8:a00000ee:users.uid::bar.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea3d4b0 con 0x55d88ea01990 2024-09-13T06:10:56.957 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.953+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(66 bar.buckets [call out=184b] v0'0 uv3 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7fa6640083f0 con 0x55d88ea01990 2024-09-13T06:10:56.957 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.953+0000 7fa674ec6980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9 : miss 2024-09-13T06:10:56.957 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.953+0000 7fa674ec6980 20 rados->read ofs=0 len=0 2024-09-13T06:10:56.957 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.953+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:67 8.17 8:ec7c4770:root::.bucket.meta.myfoo6%3a52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea3ae60 con 0x55d88ea01990 2024-09-13T06:10:56.960 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.953+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(67 .bucket.meta.myfoo6:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9 [call out=48b,stat out=16b,read 0~380 out=380b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 333+0+662 (crc 0 0 0) 0x7fa6640083f0 con 0x55d88ea01990 2024-09-13T06:10:56.960 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.953+0000 7fa674ec6980 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T06:10:56.960 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.953+0000 7fa674ec6980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9 info.flags=0x17 2024-09-13T06:10:56.960 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.953+0000 7fa674ec6980 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9 to cache LRU end 2024-09-13T06:10:56.960 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.953+0000 7fa674ec6980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:10:56.960 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.953+0000 7fa674ec6980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T06:10:56.960 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.953+0000 7fa674ec6980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9 2024-09-13T06:10:56.960 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.953+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:68 8.17 8:ec7c4770:root::.bucket.meta.myfoo6%3a52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~380 in=380b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea44710 con 0x55d88ea01990 2024-09-13T06:10:56.960 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.953+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(68 .bucket.meta.myfoo6:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9 [delete,create,call,call,writefull 0~380,setxattr (117)] v35'2 uv2 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7fa6640083f0 con 0x55d88ea01990 2024-09-13T06:10:56.960 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.953+0000 7fa674ec6980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9 info.flags=0x17 2024-09-13T06:10:56.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.953+0000 7fa674ec6980 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9 to cache LRU end 2024-09-13T06:10:56.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.953+0000 7fa674ec6980 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-13T06:10:56.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.953+0000 7fa674ec6980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9, ofs0, ns] 2024-09-13T06:10:56.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.953+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify cookie 94388594388080 in=760b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea43380 con 0x55d88ea06320 2024-09-13T06:10:56.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.953+0000 7fa6729d6640 1 -- 172.21.15.194:0/720054522 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== watch-notify(notify (1) cookie 94388594202864 notify 150323855373 ret 0) ==== 790+0+0 (crc 0 0 0) 0x55d88e9e39a0 con 0x55d88ea06320 2024-09-13T06:10:56.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.953+0000 7fa555ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855373 cookie 94388594202864 notifier 4731 bl.length()=748 2024-09-13T06:10:56.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.953+0000 7fa555ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9 info.flags=0x17 2024-09-13T06:10:56.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.953+0000 7fa555ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9 to cache LRU end 2024-09-13T06:10:56.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.953+0000 7fa6729d6640 1 -- 172.21.15.194:0/720054522 <== osd.3 v2:172.21.15.194:6816/96632515 16 ==== osd_op_reply(69 notify.2 [notify cookie 94388594388080 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa66c10a030 con 0x55d88ea06320 2024-09-13T06:10:56.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.953+0000 7fa555ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-09-13T06:10:56.962 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.953+0000 7fa555ffb640 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fa4a8003540 con 0x55d88ea06320 2024-09-13T06:10:56.962 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.953+0000 7fa6729d6640 1 -- 172.21.15.194:0/720054522 <== osd.3 v2:172.21.15.194:6816/96632515 17 ==== osd_op_reply(70 notify.2 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa66c10a030 con 0x55d88ea06320 2024-09-13T06:10:56.962 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.953+0000 7fa6729d6640 1 -- 172.21.15.194:0/720054522 <== osd.3 v2:172.21.15.194:6816/96632515 18 ==== watch-notify(notify_complete (2) cookie 94388594388080 notify 150323855373 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d88e9e3710 con 0x55d88ea06320 2024-09-13T06:10:56.962 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.953+0000 7fa674ec6980 20 handle_bi_update(): bucket=:myfoo6[52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9]): orig_sources= new_sources= 2024-09-13T06:10:56.962 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.953+0000 7fa674ec6980 20 handle_bi_update(): bucket=:myfoo6[52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9]): potential sources added=[] removed=[] 2024-09-13T06:10:56.962 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.953+0000 7fa674ec6980 20 handle_bi_update(): bucket=:myfoo6[52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9]): orig_dests= new_dests= 2024-09-13T06:10:56.962 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.953+0000 7fa674ec6980 20 handle_bi_update(): bucket=:myfoo6[52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9]): potential dests added=[] removed=[] 2024-09-13T06:10:56.962 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.953+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:71 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea42ed0 con 0x55d88ea01990 2024-09-13T06:10:56.962 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.953+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(71 bud.buckets [call] v35'5 uv0 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fa6640083f0 con 0x55d88ea01990 2024-09-13T06:10:56.962 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.953+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:72 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea42ed0 con 0x55d88ea01990 2024-09-13T06:10:56.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.957+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.1 v2:172.21.15.194:6808/3135444559 25 ==== osd_op_reply(72 bud.buckets [call] v35'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fa6640083f0 con 0x55d88ea01990 2024-09-13T06:10:56.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.957+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:73 8.18 8:1944a257:root::myfoo6:head [delete,create,call version.inc in=38b,writefull 0~166 in=166b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea43ee0 con 0x55d88ea01990 2024-09-13T06:10:56.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.957+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.1 v2:172.21.15.194:6808/3135444559 26 ==== osd_op_reply(73 myfoo6 [delete,create,call,writefull 0~166] v35'25 uv25 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7fa6640083f0 con 0x55d88ea01990 2024-09-13T06:10:56.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.957+0000 7fa674ec6980 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-09-13T06:10:56.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.957+0000 7fa674ec6980 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-13T06:10:56.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.957+0000 7fa674ec6980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-09-13T06:10:56.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.957+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [notify cookie 94388594388080 in=328b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea43ee0 con 0x7fa66c10d070 2024-09-13T06:10:56.968 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.957+0000 7fa6721d5640 1 -- 172.21.15.194:0/720054522 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== watch-notify(notify (1) cookie 94388594208288 notify 150323855375 ret 0) ==== 358+0+0 (crc 0 0 0) 0x7fa668038870 con 0x7fa66c10d070 2024-09-13T06:10:56.968 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.957+0000 7fa555ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855375 cookie 94388594208288 notifier 4731 bl.length()=316 2024-09-13T06:10:56.968 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.957+0000 7fa555ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-09-13T06:10:56.968 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.957+0000 7fa555ffb640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-13T06:10:56.968 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.957+0000 7fa555ffb640 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:75 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fa4a8003570 con 0x7fa66c10d070 2024-09-13T06:10:56.968 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.957+0000 7fa6721d5640 1 -- 172.21.15.194:0/720054522 <== osd.2 v2:172.21.15.194:6800/815615585 16 ==== osd_op_reply(74 notify.3 [notify cookie 94388594388080 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa66800e620 con 0x7fa66c10d070 2024-09-13T06:10:56.968 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.957+0000 7fa6721d5640 1 -- 172.21.15.194:0/720054522 <== osd.2 v2:172.21.15.194:6800/815615585 17 ==== osd_op_reply(75 notify.3 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa66800e620 con 0x7fa66c10d070 2024-09-13T06:10:56.968 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.957+0000 7fa6721d5640 1 -- 172.21.15.194:0/720054522 <== osd.2 v2:172.21.15.194:6800/815615585 18 ==== watch-notify(notify_complete (2) cookie 94388594388080 notify 150323855375 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fa668036950 con 0x7fa66c10d070 2024-09-13T06:10:56.968 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.957+0000 7fa674ec6980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9 : hit (requested=0x17, cached=0x17) 2024-09-13T06:10:56.968 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.957+0000 7fa674ec6980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9 2024-09-13T06:10:56.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.957+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:76 8.17 8:ec7c4770:root::.bucket.meta.myfoo6%3a52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~380 in=380b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea41110 con 0x55d88ea01990 2024-09-13T06:10:56.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.957+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.1 v2:172.21.15.194:6808/3135444559 27 ==== osd_op_reply(76 .bucket.meta.myfoo6:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9 [delete,create,call,call,writefull 0~380,setxattr (117)] v35'3 uv3 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7fa6640083f0 con 0x55d88ea01990 2024-09-13T06:10:56.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.957+0000 7fa674ec6980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9 info.flags=0x17 2024-09-13T06:10:56.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.957+0000 7fa674ec6980 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9 to cache LRU end 2024-09-13T06:10:56.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.957+0000 7fa674ec6980 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-13T06:10:56.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.957+0000 7fa674ec6980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9, ofs0, ns] 2024-09-13T06:10:56.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.957+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:77 7.15 7:a93a5511:::notify.2:head [notify cookie 94388594413696 in=760b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea3da00 con 0x55d88ea06320 2024-09-13T06:10:56.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.961+0000 7fa6729d6640 1 -- 172.21.15.194:0/720054522 <== osd.3 v2:172.21.15.194:6816/96632515 19 ==== watch-notify(notify (1) cookie 94388594202864 notify 150323855374 ret 0) ==== 790+0+0 (crc 0 0 0) 0x55d88e9e3710 con 0x55d88ea06320 2024-09-13T06:10:56.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.961+0000 7fa5567fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855374 cookie 94388594202864 notifier 4731 bl.length()=748 2024-09-13T06:10:56.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.961+0000 7fa5567fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9 info.flags=0x17 2024-09-13T06:10:56.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.961+0000 7fa5567fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9 to cache LRU end 2024-09-13T06:10:56.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.961+0000 7fa5567fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-09-13T06:10:56.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.961+0000 7fa6729d6640 1 -- 172.21.15.194:0/720054522 <== osd.3 v2:172.21.15.194:6816/96632515 20 ==== osd_op_reply(77 notify.2 [notify cookie 94388594413696 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa66c10a030 con 0x55d88ea06320 2024-09-13T06:10:56.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.961+0000 7fa5567fc640 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:78 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fa538003eb0 con 0x55d88ea06320 2024-09-13T06:10:56.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.961+0000 7fa6729d6640 1 -- 172.21.15.194:0/720054522 <== osd.3 v2:172.21.15.194:6816/96632515 21 ==== watch-notify(notify_complete (2) cookie 94388594413696 notify 150323855374 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d88e8cfb80 con 0x55d88ea06320 2024-09-13T06:10:56.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.961+0000 7fa6729d6640 1 -- 172.21.15.194:0/720054522 <== osd.3 v2:172.21.15.194:6816/96632515 22 ==== osd_op_reply(78 notify.2 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa66c10a030 con 0x55d88ea06320 2024-09-13T06:10:56.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.961+0000 7fa674ec6980 20 handle_bi_update(): bucket=:myfoo6[52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9]): orig_sources= new_sources= 2024-09-13T06:10:56.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.961+0000 7fa674ec6980 20 handle_bi_update(): bucket=:myfoo6[52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9]): potential sources added=[] removed=[] 2024-09-13T06:10:56.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.961+0000 7fa674ec6980 20 handle_bi_update(): bucket=:myfoo6[52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9]): orig_dests= new_dests= 2024-09-13T06:10:56.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.961+0000 7fa674ec6980 20 handle_bi_update(): bucket=:myfoo6[52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9]): potential dests added=[] removed=[] 2024-09-13T06:10:56.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.961+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:79 4.2e 4:75804730:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea41080 con 0x55d88ea06320 2024-09-13T06:10:56.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.961+0000 7fa6729d6640 1 -- 172.21.15.194:0/720054522 <== osd.3 v2:172.21.15.194:6816/96632515 23 ==== osd_op_reply(79 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa66c10a030 con 0x55d88ea06320 2024-09-13T06:10:56.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.961+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:80 4.15 4:ab610e56:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea41080 con 0x55d88ea06320 2024-09-13T06:10:56.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.961+0000 7fa6729d6640 1 -- 172.21.15.194:0/720054522 <== osd.3 v2:172.21.15.194:6816/96632515 24 ==== osd_op_reply(80 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.1 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa66c10a030 con 0x55d88ea06320 2024-09-13T06:10:56.971 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.961+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:81 4.c 4:30a9cee7:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea41080 con 0x55d88ea01990 2024-09-13T06:10:56.971 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.961+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.1 v2:172.21.15.194:6808/3135444559 28 ==== osd_op_reply(81 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.2 [call out=85b] v0'0 uv8 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa6640083f0 con 0x55d88ea01990 2024-09-13T06:10:56.971 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.961+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:82 4.7 4:e101f005:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea41080 con 0x7fa668037040 2024-09-13T06:10:56.971 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.961+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.0 v2:172.21.15.120:6800/1923744619 20 ==== osd_op_reply(82 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.3 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa6640083f0 con 0x7fa668037040 2024-09-13T06:10:56.971 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.961+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:83 4.25 4:a556f372:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea41030 con 0x55d88ea06320 2024-09-13T06:10:56.971 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.961+0000 7fa6729d6640 1 -- 172.21.15.194:0/720054522 <== osd.3 v2:172.21.15.194:6816/96632515 25 ==== osd_op_reply(83 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.4 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa66c10a030 con 0x55d88ea06320 2024-09-13T06:10:56.971 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.961+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:84 4.2e 4:761e8ed3:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea41030 con 0x55d88ea06320 2024-09-13T06:10:56.971 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.961+0000 7fa6729d6640 1 -- 172.21.15.194:0/720054522 <== osd.3 v2:172.21.15.194:6816/96632515 26 ==== osd_op_reply(84 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.5 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa66c10a030 con 0x55d88ea06320 2024-09-13T06:10:56.971 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.961+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:85 4.2a 4:552f7067:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea41030 con 0x55d88ea01990 2024-09-13T06:10:56.971 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.961+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.1 v2:172.21.15.194:6808/3135444559 29 ==== osd_op_reply(85 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.6 [call out=85b] v0'0 uv8 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa6640083f0 con 0x55d88ea01990 2024-09-13T06:10:56.971 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.961+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:86 4.b 4:d2d4b7d4:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea41030 con 0x7fa66c10d070 2024-09-13T06:10:56.971 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.961+0000 7fa6721d5640 1 -- 172.21.15.194:0/720054522 <== osd.2 v2:172.21.15.194:6800/815615585 19 ==== osd_op_reply(86 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa66800e620 con 0x7fa66c10d070 2024-09-13T06:10:56.972 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.961+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:87 4.28 4:15c9a3e4:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea41030 con 0x55d88ea01990 2024-09-13T06:10:56.972 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.965+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.1 v2:172.21.15.194:6808/3135444559 30 ==== osd_op_reply(87 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.8 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa664045040 con 0x55d88ea01990 2024-09-13T06:10:56.972 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.965+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:88 4.1e 4:78fdad3c:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea41030 con 0x7fa668037040 2024-09-13T06:10:56.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.965+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.0 v2:172.21.15.120:6800/1923744619 21 ==== osd_op_reply(88 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.9 [call out=377b] v0'0 uv3 ondisk = 0) ==== 194+0+377 (crc 0 0 0) 0x7fa664045040 con 0x7fa668037040 2024-09-13T06:10:56.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.965+0000 7fa674ec6980 10 cls_bucket_list_unordered: got thirteen 2024-09-13T06:10:56.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.965+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:89 4.12 4:48ab5582:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea41030 con 0x55d88ea01990 2024-09-13T06:10:56.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.965+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.1 v2:172.21.15.194:6808/3135444559 31 ==== osd_op_reply(89 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.10 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa664045040 con 0x55d88ea01990 2024-09-13T06:10:56.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.965+0000 7fa674ec6980 20 get_obj_state: octx=0x7fa66802d040 obj=myfoo6:thirteen state=0x55d88ea430b8 s->prefetch_data=0 2024-09-13T06:10:56.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.965+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:90 3.8s0 3:100047b6:::52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea40fb0 con 0x55d88ea06320 2024-09-13T06:10:56.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.965+0000 7fa6729d6640 1 -- 172.21.15.194:0/720054522 <== osd.3 v2:172.21.15.194:6816/96632515 27 ==== osd_op_reply(90 52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9_thirteen [getxattrs out=854b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 238+0+870 (crc 0 0 0) 0x7fa66c10a030 con 0x55d88ea06320 2024-09-13T06:10:56.975 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.965+0000 7fa674ec6980 10 manifest: total_size = 8 2024-09-13T06:10:56.975 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.965+0000 7fa674ec6980 20 get_obj_state: setting s->obj_tag to 52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.6200637952620427363 2024-09-13T06:10:56.975 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.965+0000 7fa674ec6980 20 Read xattr rgw_rados: user.rgw.acl 2024-09-13T06:10:56.975 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.965+0000 7fa674ec6980 20 Read xattr rgw_rados: user.rgw.content_type 2024-09-13T06:10:56.975 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.965+0000 7fa674ec6980 20 Read xattr rgw_rados: user.rgw.etag 2024-09-13T06:10:56.975 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.965+0000 7fa674ec6980 20 Read xattr rgw_rados: user.rgw.idtag 2024-09-13T06:10:56.975 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.965+0000 7fa674ec6980 20 Read xattr rgw_rados: user.rgw.manifest 2024-09-13T06:10:56.975 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.965+0000 7fa674ec6980 20 Read xattr rgw_rados: user.rgw.pg_ver 2024-09-13T06:10:56.975 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.965+0000 7fa674ec6980 20 Read xattr rgw_rados: user.rgw.source_zone 2024-09-13T06:10:56.975 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.965+0000 7fa674ec6980 20 Read xattr rgw_rados: user.rgw.tail_tag 2024-09-13T06:10:56.975 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.965+0000 7fa674ec6980 20 get_obj_state: octx=0x7fa66802d040 obj=myfoo6:thirteen state=0x55d88ea430b8 s->prefetch_data=0 2024-09-13T06:10:56.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.965+0000 7fa674ec6980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9 : hit (requested=0x17, cached=0x17) 2024-09-13T06:10:56.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.965+0000 7fa674ec6980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9 2024-09-13T06:10:56.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.965+0000 7fa674ec6980 20 bucket index object: :.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.9 2024-09-13T06:10:56.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.965+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:91 4.1e 4:78fdad3c:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea39f20 con 0x7fa668037040 2024-09-13T06:10:56.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.969+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.0 v2:172.21.15.120:6800/1923744619 22 ==== osd_op_reply(91 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.9 [stat,call,call] v35'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fa664045040 con 0x7fa668037040 2024-09-13T06:10:56.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.969+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:92 3.8s0 3:100047b6:::52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9_thirteen:head [cmpxattr user.rgw.idtag (62) op 1 mode 1 in=76b,setxattr user.rgw.acl (117) in=129b,setxattr user.rgw.idtag (33) in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea45e80 con 0x55d88ea06320 2024-09-13T06:10:56.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.969+0000 7fa6729d6640 1 -- 172.21.15.194:0/720054522 <== osd.3 v2:172.21.15.194:6816/96632515 28 ==== osd_op_reply(92 52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9_thirteen [cmpxattr (62) op 1 mode 1,setxattr (117),setxattr (33)] v35'4 uv4 ondisk = 0) ==== 280+0+0 (crc 0 0 0) 0x7fa66c10a030 con 0x55d88ea06320 2024-09-13T06:10:56.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.969+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:93 4.1e 4:78fdad3c:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=323b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea473b0 con 0x7fa668037040 2024-09-13T06:10:56.976 INFO:teuthology.orchestra.run.smithi194.stderr:1 objects processed in :myfoo6[52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9]). Next marker thirteen 2024-09-13T06:10:56.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.969+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea473b0 con 0x7fa66c10d070 2024-09-13T06:10:56.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.973+0000 7fa6721d5640 1 -- 172.21.15.194:0/720054522 <== osd.2 v2:172.21.15.194:6800/815615585 20 ==== osd_op_reply(94 bud [delete,create,call,writefull 0~380] v35'2 uv2 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fa66800e620 con 0x7fa66c10d070 2024-09-13T06:10:56.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.973+0000 7fa674ec6980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-13T06:10:56.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.973+0000 7fa674ec6980 10 moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-13T06:10:56.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.973+0000 7fa674ec6980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-13T06:10:56.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.973+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [notify cookie 94388594381888 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea473b0 con 0x7fa668037040 2024-09-13T06:10:56.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.973+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.0 v2:172.21.15.120:6800/1923744619 23 ==== osd_op_reply(93 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.9 [stat,call,call] v35'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fa664045040 con 0x7fa668037040 2024-09-13T06:10:56.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.973+0000 7fa555ffb640 20 handle_completion(): completion ok for obj=thirteen 2024-09-13T06:10:56.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.973+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.0 v2:172.21.15.120:6800/1923744619 24 ==== watch-notify(notify (1) cookie 94388594212992 notify 150323855394 ret 0) ==== 598+0+0 (crc 0 0 0) 0x55d88ea3b250 con 0x7fa668037040 2024-09-13T06:10:56.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.973+0000 7fa5567fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855394 cookie 94388594212992 notifier 4731 bl.length()=556 2024-09-13T06:10:56.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.973+0000 7fa5567fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-13T06:10:56.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.973+0000 7fa5567fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-13T06:10:56.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.973+0000 7fa5567fc640 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:96 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fa538003eb0 con 0x7fa668037040 2024-09-13T06:10:56.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.973+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.0 v2:172.21.15.120:6800/1923744619 25 ==== osd_op_reply(95 notify.5 [notify cookie 94388594381888 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa664045040 con 0x7fa668037040 2024-09-13T06:10:56.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.973+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.0 v2:172.21.15.120:6800/1923744619 26 ==== osd_op_reply(96 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa664045040 con 0x7fa668037040 2024-09-13T06:10:56.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.973+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.0 v2:172.21.15.120:6800/1923744619 27 ==== watch-notify(notify_complete (2) cookie 94388594381888 notify 150323855394 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d88ea41a40 con 0x7fa668037040 2024-09-13T06:10:56.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.973+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:97 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea473b0 con 0x55d88ea01990 2024-09-13T06:10:56.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.973+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.1 v2:172.21.15.194:6808/3135444559 32 ==== osd_op_reply(97 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v35'2 uv2 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fa664045040 con 0x55d88ea01990 2024-09-13T06:10:56.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.973+0000 7fa674ec6980 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-13T06:10:56.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.973+0000 7fa674ec6980 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-13T06:10:56.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.973+0000 7fa674ec6980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-13T06:10:56.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.973+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify cookie 94388594381888 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea473b0 con 0x7fa668037040 2024-09-13T06:10:56.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.973+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.0 v2:172.21.15.120:6800/1923744619 28 ==== watch-notify(notify (1) cookie 94388594212992 notify 150323855395 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55d88ea41a40 con 0x7fa668037040 2024-09-13T06:10:56.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.973+0000 7fa555ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855395 cookie 94388594212992 notifier 4731 bl.length()=177 2024-09-13T06:10:56.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.973+0000 7fa555ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-13T06:10:56.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.973+0000 7fa555ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-13T06:10:56.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.973+0000 7fa555ffb640 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:99 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fa4a8003570 con 0x7fa668037040 2024-09-13T06:10:56.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.973+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.0 v2:172.21.15.120:6800/1923744619 29 ==== osd_op_reply(98 notify.5 [notify cookie 94388594381888 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa664045040 con 0x7fa668037040 2024-09-13T06:10:56.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.977+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.0 v2:172.21.15.120:6800/1923744619 30 ==== osd_op_reply(99 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa664045040 con 0x7fa668037040 2024-09-13T06:10:56.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.977+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.0 v2:172.21.15.120:6800/1923744619 31 ==== watch-notify(notify_complete (2) cookie 94388594381888 notify 150323855395 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d88ea3a6b0 con 0x7fa668037040 2024-09-13T06:10:56.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.977+0000 7fa674ec6980 10 removing user index: bar 2024-09-13T06:10:56.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.977+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:100 8.e 8:718f6a54:users.uid::bar:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea473b0 con 0x7fa668037040 2024-09-13T06:10:56.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.977+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.0 v2:172.21.15.120:6800/1923744619 32 ==== osd_op_reply(100 bar [delete] v35'6 uv6 ondisk = 0) ==== 147+0+0 (crc 0 0 0) 0x7fa664045040 con 0x7fa668037040 2024-09-13T06:10:56.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.977+0000 7fa674ec6980 10 removing default.rgw.meta+users.uid+bar from cache 2024-09-13T06:10:56.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.977+0000 7fa674ec6980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-09-13T06:10:56.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.977+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:101 7.9 7:93e5b521:::notify.7:head [notify cookie 94388594381888 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea473b0 con 0x7fa668037040 2024-09-13T06:10:56.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.977+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.0 v2:172.21.15.120:6800/1923744619 33 ==== watch-notify(notify (1) cookie 94388594217488 notify 150323855396 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55d88ea3a6b0 con 0x7fa668037040 2024-09-13T06:10:56.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.977+0000 7fa5567fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855396 cookie 94388594217488 notifier 4731 bl.length()=152 2024-09-13T06:10:56.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.977+0000 7fa5567fc640 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fa538003eb0 con 0x7fa668037040 2024-09-13T06:10:56.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.977+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.0 v2:172.21.15.120:6800/1923744619 34 ==== osd_op_reply(101 notify.7 [notify cookie 94388594381888 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa664045040 con 0x7fa668037040 2024-09-13T06:10:56.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.977+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.0 v2:172.21.15.120:6800/1923744619 35 ==== osd_op_reply(102 notify.7 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa664045040 con 0x7fa668037040 2024-09-13T06:10:56.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.981+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.0 v2:172.21.15.120:6800/1923744619 36 ==== watch-notify(notify_complete (2) cookie 94388594381888 notify 150323855396 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fa66400bde0 con 0x7fa668037040 2024-09-13T06:10:56.984 INFO:teuthology.orchestra.run.smithi194.stdout:{"user_id":"bud","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bud","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-09-13T06:10:56.773999Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:10:56.773988Z","tags":[],"group_ids":[]} 2024-09-13T06:10:56.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.981+0000 7fa5297e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:10:56.985 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.981+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94388594220256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea473b0 con 0x55d88ea01990 2024-09-13T06:10:56.985 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.981+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.1 v2:172.21.15.194:6808/3135444559 33 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94388594220256] v35'213 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa664045040 con 0x55d88ea01990 2024-09-13T06:10:56.985 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.981+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94388594196736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea473b0 con 0x7fa66c10d070 2024-09-13T06:10:56.986 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.981+0000 7fa6721d5640 1 -- 172.21.15.194:0/720054522 <== osd.2 v2:172.21.15.194:6800/815615585 21 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94388594196736] v35'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa66800e620 con 0x7fa66c10d070 2024-09-13T06:10:56.986 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.981+0000 7fa674ec6980 20 remove_watcher() i=0 2024-09-13T06:10:56.986 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.981+0000 7fa674ec6980 2 removed watcher, disabling cache 2024-09-13T06:10:56.986 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.981+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94388594201536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea473b0 con 0x55d88ea01990 2024-09-13T06:10:56.988 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.985+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.1 v2:172.21.15.194:6808/3135444559 34 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94388594201536] v35'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa664045040 con 0x55d88ea01990 2024-09-13T06:10:56.988 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.985+0000 7fa674ec6980 20 remove_watcher() i=1 2024-09-13T06:10:56.988 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.985+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94388594202864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea473b0 con 0x55d88ea06320 2024-09-13T06:10:56.990 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.985+0000 7fa6729d6640 1 -- 172.21.15.194:0/720054522 <== osd.3 v2:172.21.15.194:6816/96632515 29 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94388594202864] v35'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa66c10a030 con 0x55d88ea06320 2024-09-13T06:10:56.990 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.985+0000 7fa674ec6980 20 remove_watcher() i=2 2024-09-13T06:10:56.990 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.985+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94388594208288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea473b0 con 0x7fa66c10d070 2024-09-13T06:10:56.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.989+0000 7fa6721d5640 1 -- 172.21.15.194:0/720054522 <== osd.2 v2:172.21.15.194:6800/815615585 22 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94388594208288] v35'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa66800e620 con 0x7fa66c10d070 2024-09-13T06:10:56.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.989+0000 7fa674ec6980 20 remove_watcher() i=3 2024-09-13T06:10:56.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.989+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94388594204112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea473b0 con 0x55d88ea01990 2024-09-13T06:10:56.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.989+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.1 v2:172.21.15.194:6808/3135444559 35 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94388594204112] v35'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa664045040 con 0x55d88ea01990 2024-09-13T06:10:56.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.989+0000 7fa674ec6980 20 remove_watcher() i=4 2024-09-13T06:10:56.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.989+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94388594212992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea473b0 con 0x7fa668037040 2024-09-13T06:10:56.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.993+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.0 v2:172.21.15.120:6800/1923744619 37 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94388594212992] v35'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa664045040 con 0x7fa668037040 2024-09-13T06:10:56.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.993+0000 7fa674ec6980 20 remove_watcher() i=5 2024-09-13T06:10:56.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.993+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94388594216432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea473b0 con 0x7fa668037040 2024-09-13T06:10:56.997 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.993+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.0 v2:172.21.15.120:6800/1923744619 38 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94388594216432] v35'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa664045040 con 0x7fa668037040 2024-09-13T06:10:56.997 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.993+0000 7fa674ec6980 20 remove_watcher() i=6 2024-09-13T06:10:56.998 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.993+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94388594217488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d88ea473b0 con 0x7fa668037040 2024-09-13T06:10:57.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.997+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 <== osd.0 v2:172.21.15.120:6800/1923744619 39 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94388594217488] v35'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa664045040 con 0x7fa668037040 2024-09-13T06:10:57.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.997+0000 7fa674ec6980 20 remove_watcher() i=7 2024-09-13T06:10:57.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.997+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fa668037040 msgr2=0x7fa668036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:57.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.997+0000 7fa674ec6980 1 --2- 172.21.15.194:0/720054522 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fa668037040 0x7fa668036410 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:57.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.997+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55d88ea01990 msgr2=0x55d88ea03e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:57.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.997+0000 7fa674ec6980 1 --2- 172.21.15.194:0/720054522 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55d88ea01990 0x55d88ea03e20 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:57.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.997+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fa66c10d070 msgr2=0x7fa66c1048a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:57.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.997+0000 7fa674ec6980 1 --2- 172.21.15.194:0/720054522 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fa66c10d070 0x7fa66c1048a0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:57.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.997+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55d88ea06320 msgr2=0x55d88ea08710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:57.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.997+0000 7fa674ec6980 1 --2- 172.21.15.194:0/720054522 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55d88ea06320 0x55d88ea08710 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:57.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.997+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa53c034650 msgr2=0x7fa53c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:57.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.997+0000 7fa674ec6980 1 --2- 172.21.15.194:0/720054522 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa53c034650 0x7fa53c036b10 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x55d88e8cfea0 tx=0x7fa668010000 comp rx=0 tx=0).stop 2024-09-13T06:10:57.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.997+0000 7fa6731d7640 1 -- 172.21.15.194:0/720054522 reap_dead start 2024-09-13T06:10:57.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.997+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d88e9ef6e0 msgr2=0x55d88e9f6820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:57.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.997+0000 7fa674ec6980 1 --2- 172.21.15.194:0/720054522 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d88e9ef6e0 0x55d88e9f6820 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fa66c0d4be0 tx=0x7fa66c0c4eb0 comp rx=0 tx=0).stop 2024-09-13T06:10:57.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.997+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 shutdown_connections 2024-09-13T06:10:57.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.997+0000 7fa674ec6980 1 --2- 172.21.15.194:0/720054522 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d88e9ef6e0 0x55d88e9f6820 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:57.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.997+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 >> 172.21.15.194:0/720054522 conn(0x55d88e9ebac0 msgr2=0x55d88e9e9b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:57.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.997+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 shutdown_connections 2024-09-13T06:10:57.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.997+0000 7fa674ec6980 1 -- 172.21.15.194:0/720054522 wait complete. 2024-09-13T06:10:57.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.997+0000 7fa674ec6980 1 -- 172.21.15.194:0/194860629 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa54c034650 msgr2=0x7fa54c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:57.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.997+0000 7fa674ec6980 1 --2- 172.21.15.194:0/194860629 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa54c034650 0x7fa54c036b10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa66800bf60 tx=0x7fa66800f000 comp rx=0 tx=0).stop 2024-09-13T06:10:57.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.997+0000 7fa674ec6980 1 -- 172.21.15.194:0/194860629 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d88e9e2db0 msgr2=0x55d88e9e31d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:57.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.997+0000 7fa674ec6980 1 --2- 172.21.15.194:0/194860629 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d88e9e2db0 0x55d88e9e31d0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fa66c0e3050 tx=0x7fa66c0b48c0 comp rx=0 tx=0).stop 2024-09-13T06:10:57.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.997+0000 7fa674ec6980 1 -- 172.21.15.194:0/194860629 shutdown_connections 2024-09-13T06:10:57.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.997+0000 7fa674ec6980 1 --2- 172.21.15.194:0/194860629 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa54c034650 0x7fa54c036b10 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:57.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.997+0000 7fa674ec6980 1 --2- 172.21.15.194:0/194860629 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d88e9e2db0 0x55d88e9e31d0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:57.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.997+0000 7fa674ec6980 1 -- 172.21.15.194:0/194860629 >> 172.21.15.194:0/194860629 conn(0x55d88e9d7f00 msgr2=0x55d88e9da980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:57.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.997+0000 7fa674ec6980 1 -- 172.21.15.194:0/194860629 shutdown_connections 2024-09-13T06:10:57.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.997+0000 7fa674ec6980 1 -- 172.21.15.194:0/194860629 wait complete. 2024-09-13T06:10:57.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.997+0000 7fa674ec6980 1 -- 172.21.15.194:0/4089215951 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55d88e8d38c0 msgr2=0x55d88e9cc0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:57.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.997+0000 7fa674ec6980 1 --2- 172.21.15.194:0/4089215951 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55d88e8d38c0 0x55d88e9cc0d0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:57.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.997+0000 7fa674ec6980 1 -- 172.21.15.194:0/4089215951 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55d88e9d27b0 msgr2=0x55d88e9d4ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:57.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.997+0000 7fa674ec6980 1 --2- 172.21.15.194:0/4089215951 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55d88e9d27b0 0x55d88e9d4ba0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:57.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.997+0000 7fa674ec6980 1 -- 172.21.15.194:0/4089215951 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55d88e9ce870 msgr2=0x55d88e9d0c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:57.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.997+0000 7fa674ec6980 1 --2- 172.21.15.194:0/4089215951 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55d88e9ce870 0x55d88e9d0c60 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:10:57.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.997+0000 7fa674ec6980 1 -- 172.21.15.194:0/4089215951 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa558034650 msgr2=0x7fa558036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:57.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.997+0000 7fa674ec6980 1 --2- 172.21.15.194:0/4089215951 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa558034650 0x7fa558036b10 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa668000f70 tx=0x7fa6680012c0 comp rx=0 tx=0).stop 2024-09-13T06:10:57.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.997+0000 7fa674ec6980 1 -- 172.21.15.194:0/4089215951 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d88e844ad0 msgr2=0x55d88e8d0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:10:57.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.997+0000 7fa674ec6980 1 --2- 172.21.15.194:0/4089215951 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d88e844ad0 0x55d88e8d0c80 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fa66c01b870 tx=0x7fa66c019810 comp rx=0 tx=0).stop 2024-09-13T06:10:57.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.997+0000 7fa6731d7640 1 -- 172.21.15.194:0/4089215951 reap_dead start 2024-09-13T06:10:57.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.997+0000 7fa674ec6980 1 -- 172.21.15.194:0/4089215951 shutdown_connections 2024-09-13T06:10:57.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.997+0000 7fa674ec6980 1 -- 172.21.15.194:0/4089215951 >> 172.21.15.194:0/4089215951 conn(0x55d88e8cb070 msgr2=0x55d88e9b6210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:10:57.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.997+0000 7fa674ec6980 1 -- 172.21.15.194:0/4089215951 shutdown_connections 2024-09-13T06:10:57.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:10:56.997+0000 7fa674ec6980 1 -- 172.21.15.194:0/4089215951 wait complete. 2024-09-13T06:10:57.010 DEBUG:tasks.util.rgw: json result: {'user_id': 'bud', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bud', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-09-13T06:10:56.773999Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:10:56.773988Z', 'tags': [], 'group_ids': []} 2024-09-13T06:11:02.022 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-09-13T06:11:02.022 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-09-13T06:11:02.022 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-09-13T06:11:02.022 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-09-13T06:11:02.022 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 4 2024-09-13T06:11:02.071 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:11:02.071 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:11:02.073 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.069+0000 7f46c4c25980 1 Processor -- start 2024-09-13T06:11:02.073 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.069+0000 7f46c4c25980 1 -- start start 2024-09-13T06:11:02.073 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.069+0000 7f46c4c25980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55f39150fad0 0x55f391511ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:02.073 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.069+0000 7f46c4c25980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f391393ae0 con 0x55f39147fb00 2024-09-13T06:11:02.073 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.069+0000 7f46c4c25980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x55f3913b7e30 con 0x55f39150fad0 2024-09-13T06:11:02.074 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.069+0000 7f46c1f34640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55f39150fad0 0x55f391511ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:02.074 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.069+0000 7f46c2735640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x55f39147fb00 0x55f39150e3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:34426/0 (socket says 172.21.15.194:34426) 2024-09-13T06:11:02.074 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.069+0000 7f46c2735640 1 -- 172.21.15.194:0/3714178307 learned_addr learned my addr 172.21.15.194:0/3714178307 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-09-13T06:11:02.074 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.069+0000 7f46c1f34640 1 -- 172.21.15.194:0/3714178307 >> v1:172.21.15.120:6789/0 conn(0x55f39147fb00 legacy=0x55f39150e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:02.074 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.069+0000 7f46c1f34640 1 -- 172.21.15.194:0/3714178307 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f391513410 con 0x55f39150fad0 2024-09-13T06:11:02.076 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.073+0000 7f46c1f34640 1 --2- 172.21.15.194:0/3714178307 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f39150fad0 0x55f391511ec0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f46b800a480 tx=0x7f46b801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22899c90e6e5d9fe server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:02.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.073+0000 7f46c1733640 1 -- 172.21.15.194:0/3714178307 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46b80b0070 con 0x55f39150fad0 2024-09-13T06:11:02.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.073+0000 7f46c1733640 1 -- 172.21.15.194:0/3714178307 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46b80ab540 con 0x55f39150fad0 2024-09-13T06:11:02.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.073+0000 7f46c1733640 1 -- 172.21.15.194:0/3714178307 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46b80ab840 con 0x55f39150fad0 2024-09-13T06:11:02.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.073+0000 7f46c4c25980 1 -- 172.21.15.194:0/3714178307 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f39150fad0 msgr2=0x55f391511ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:02.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.073+0000 7f46c4c25980 1 --2- 172.21.15.194:0/3714178307 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f39150fad0 0x55f391511ec0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f46b800a480 tx=0x7f46b801b280 comp rx=0 tx=0).stop 2024-09-13T06:11:02.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.073+0000 7f46c4c25980 1 -- 172.21.15.194:0/3714178307 shutdown_connections 2024-09-13T06:11:02.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.073+0000 7f46c4c25980 1 --2- 172.21.15.194:0/3714178307 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f39150fad0 0x55f391511ec0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:02.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.073+0000 7f46c4c25980 1 -- 172.21.15.194:0/3714178307 >> 172.21.15.194:0/3714178307 conn(0x55f3915060a0 msgr2=0x55f3915084c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:02.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.073+0000 7f46c4c25980 1 -- 172.21.15.194:0/3714178307 shutdown_connections 2024-09-13T06:11:02.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.073+0000 7f46c4c25980 1 -- 172.21.15.194:0/3714178307 wait complete. 2024-09-13T06:11:02.093 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.089+0000 7f46c4c25980 1 Processor -- start 2024-09-13T06:11:02.093 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.089+0000 7f46c4c25980 1 -- start start 2024-09-13T06:11:02.093 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.089+0000 7f46c4c25980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f39147fb00 0x55f3915f49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:02.093 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.089+0000 7f46c4c25980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55f3913b9200 con 0x55f39147fb00 2024-09-13T06:11:02.094 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.089+0000 7f46c2735640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f39147fb00 0x55f3915f49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:02.094 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.089+0000 7f46c2735640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f39147fb00 0x55f3915f49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:38880/0 (socket says 172.21.15.194:38880) 2024-09-13T06:11:02.094 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.089+0000 7f46c2735640 1 -- 172.21.15.194:0/656476007 learned_addr learned my addr 172.21.15.194:0/656476007 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:02.094 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.089+0000 7f46c2735640 1 -- 172.21.15.194:0/656476007 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3915f4fa0 con 0x55f39147fb00 2024-09-13T06:11:02.095 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.089+0000 7f46c2735640 1 --2- 172.21.15.194:0/656476007 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f39147fb00 0x55f3915f49d0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f46b4001e20 tx=0x7f46b400b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12f7efa8db4f16f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:02.095 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.089+0000 7f45b0608640 1 -- 172.21.15.194:0/656476007 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46b4012020 con 0x55f39147fb00 2024-09-13T06:11:02.095 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.089+0000 7f45b0608640 1 -- 172.21.15.194:0/656476007 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46b400e7c0 con 0x55f39147fb00 2024-09-13T06:11:02.095 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.089+0000 7f45b0608640 1 -- 172.21.15.194:0/656476007 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46b400eb00 con 0x55f39147fb00 2024-09-13T06:11:02.096 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.093+0000 7f46c4c25980 1 -- 172.21.15.194:0/656476007 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f39147fb00 msgr2=0x55f3915f49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:02.097 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.093+0000 7f46c4c25980 1 --2- 172.21.15.194:0/656476007 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f39147fb00 0x55f3915f49d0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f46b4001e20 tx=0x7f46b400b790 comp rx=0 tx=0).stop 2024-09-13T06:11:02.097 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.093+0000 7f46c4c25980 1 -- 172.21.15.194:0/656476007 shutdown_connections 2024-09-13T06:11:02.097 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.093+0000 7f46c4c25980 1 --2- 172.21.15.194:0/656476007 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f39147fb00 0x55f3915f49d0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:02.097 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.093+0000 7f46c4c25980 1 -- 172.21.15.194:0/656476007 >> 172.21.15.194:0/656476007 conn(0x55f3915060a0 msgr2=0x55f3915f0600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:02.097 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.093+0000 7f46c4c25980 1 -- 172.21.15.194:0/656476007 shutdown_connections 2024-09-13T06:11:02.097 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.093+0000 7f46c4c25980 1 -- 172.21.15.194:0/656476007 wait complete. 2024-09-13T06:11:02.097 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.093+0000 7f46c4c25980 1 Processor -- start 2024-09-13T06:11:02.097 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.093+0000 7f46c4c25980 1 -- start start 2024-09-13T06:11:02.097 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.093+0000 7f46c4c25980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f39147fb00 0x55f3915fbd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:02.097 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.093+0000 7f46c4c25980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55f391512e50 con 0x55f39147fb00 2024-09-13T06:11:02.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.093+0000 7f46c2735640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f39147fb00 0x55f3915fbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:02.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.093+0000 7f46c2735640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f39147fb00 0x55f3915fbd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:38892/0 (socket says 172.21.15.194:38892) 2024-09-13T06:11:02.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.093+0000 7f46c2735640 1 -- 172.21.15.194:0/2633868652 learned_addr learned my addr 172.21.15.194:0/2633868652 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:02.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.093+0000 7f46c2735640 1 -- 172.21.15.194:0/2633868652 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3915fc280 con 0x55f39147fb00 2024-09-13T06:11:02.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.093+0000 7f46c2735640 1 --2- 172.21.15.194:0/2633868652 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f39147fb00 0x55f3915fbd40 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f46b4001e20 tx=0x7f46b4000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:02.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.093+0000 7f45aee05640 1 -- 172.21.15.194:0/2633868652 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46b4012030 con 0x55f39147fb00 2024-09-13T06:11:02.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.093+0000 7f45aee05640 1 -- 172.21.15.194:0/2633868652 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46b4001480 con 0x55f39147fb00 2024-09-13T06:11:02.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.093+0000 7f45aee05640 1 -- 172.21.15.194:0/2633868652 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46b401a940 con 0x55f39147fb00 2024-09-13T06:11:02.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.093+0000 7f46c4c25980 1 -- 172.21.15.194:0/2633868652 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f3915fc510 con 0x55f39147fb00 2024-09-13T06:11:02.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.093+0000 7f46c4c25980 1 -- 172.21.15.194:0/2633868652 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3915ff1f0 con 0x55f39147fb00 2024-09-13T06:11:02.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.097+0000 7f45aee05640 1 -- 172.21.15.194:0/2633868652 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f46b4015020 con 0x55f39147fb00 2024-09-13T06:11:02.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.097+0000 7f45aee05640 1 --2- 172.21.15.194:0/2633868652 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f45a8034650 0x7f45a8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:02.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.097+0000 7f45aee05640 1 -- 172.21.15.194:0/2633868652 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f46b4020030 con 0x55f39147fb00 2024-09-13T06:11:02.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.097+0000 7f46c1f34640 1 --2- 172.21.15.194:0/2633868652 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f45a8034650 0x7f45a8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:02.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.097+0000 7f46c4c25980 1 --2- 172.21.15.194:0/2633868652 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55f39150fad0 0x55f391602d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:02.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.097+0000 7f46c4c25980 1 -- 172.21.15.194:0/2633868652 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f391603370 con 0x55f39150fad0 2024-09-13T06:11:02.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.097+0000 7f46c2f36640 1 --2- 172.21.15.194:0/2633868652 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55f39150fad0 0x55f391602d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:02.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.097+0000 7f46c1f34640 1 --2- 172.21.15.194:0/2633868652 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f45a8034650 0x7f45a8036b10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f46b80ad000 tx=0x7f46b80a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:02.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.097+0000 7f46c2f36640 1 --2- 172.21.15.194:0/2633868652 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55f39150fad0 0x55f391602d50 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:02.104 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.097+0000 7f46c2f36640 1 -- 172.21.15.194:0/2633868652 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f46bc00a4d0 con 0x55f39150fad0 2024-09-13T06:11:02.104 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.097+0000 7f46c4c25980 1 -- 172.21.15.194:0/2633868652 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f3916003f0 con 0x55f39150fad0 2024-09-13T06:11:02.104 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.097+0000 7f46c2f36640 1 -- 172.21.15.194:0/2633868652 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f46bc00a4d0 con 0x55f39150fad0 2024-09-13T06:11:02.104 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.097+0000 7f46c4c25980 1 --2- 172.21.15.194:0/2633868652 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55f3916056a0 0x55f391607a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:02.104 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.097+0000 7f46c4c25980 1 -- 172.21.15.194:0/2633868652 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f391608160 con 0x55f3916056a0 2024-09-13T06:11:02.104 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.097+0000 7f46c2735640 1 --2- 172.21.15.194:0/2633868652 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55f3916056a0 0x55f391607a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:02.104 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.097+0000 7f46c2735640 1 --2- 172.21.15.194:0/2633868652 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55f3916056a0 0x55f391607a90 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:02.104 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.097+0000 7f46c2735640 1 -- 172.21.15.194:0/2633868652 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f46b4008030 con 0x55f3916056a0 2024-09-13T06:11:02.105 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.097+0000 7f46c4c25980 1 -- 172.21.15.194:0/2633868652 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f391604540 con 0x55f39150fad0 2024-09-13T06:11:02.105 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.101+0000 7f46c2f36640 1 -- 172.21.15.194:0/2633868652 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f46bc00a4d0 con 0x55f39150fad0 2024-09-13T06:11:02.105 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.101+0000 7f46c4c25980 1 --2- 172.21.15.194:0/2633868652 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55f3916095c0 0x55f39160b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:02.105 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.101+0000 7f46c4c25980 1 -- 172.21.15.194:0/2633868652 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f39160c0b0 con 0x55f3916095c0 2024-09-13T06:11:02.105 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.101+0000 7f46c1f34640 1 --2- 172.21.15.194:0/2633868652 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55f3916095c0 0x55f39160b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:02.105 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.101+0000 7f46c1f34640 1 --2- 172.21.15.194:0/2633868652 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55f3916095c0 0x55f39160b9b0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:02.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.101+0000 7f46c1f34640 1 -- 172.21.15.194:0/2633868652 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f46b80b3040 con 0x55f3916095c0 2024-09-13T06:11:02.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.101+0000 7f46c4c25980 1 Processor -- start 2024-09-13T06:11:02.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.101+0000 7f46c4c25980 1 -- start start 2024-09-13T06:11:02.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.101+0000 7f46c4c25980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f391619b80 0x55f391619fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:02.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.101+0000 7f46c4c25980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55f391412800 con 0x55f391619b80 2024-09-13T06:11:02.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.101+0000 7f46c2735640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f391619b80 0x55f391619fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:02.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.101+0000 7f46c2735640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f391619b80 0x55f391619fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:38894/0 (socket says 172.21.15.194:38894) 2024-09-13T06:11:02.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.101+0000 7f46c2735640 1 -- 172.21.15.194:0/3939027039 learned_addr learned my addr 172.21.15.194:0/3939027039 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:02.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.101+0000 7f46c2735640 1 -- 172.21.15.194:0/3939027039 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f39161a4e0 con 0x55f391619b80 2024-09-13T06:11:02.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.101+0000 7f46c2735640 1 --2- 172.21.15.194:0/3939027039 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f391619b80 0x55f391619fa0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f46b402ded0 tx=0x7f46b4017c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:02.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.101+0000 7f45a7fff640 1 -- 172.21.15.194:0/3939027039 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46b4041ef0 con 0x55f391619b80 2024-09-13T06:11:02.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.101+0000 7f46c4c25980 1 -- 172.21.15.194:0/3939027039 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f39161a770 con 0x55f391619b80 2024-09-13T06:11:02.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.101+0000 7f45a7fff640 1 -- 172.21.15.194:0/3939027039 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46b4042090 con 0x55f391619b80 2024-09-13T06:11:02.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.101+0000 7f45a7fff640 1 -- 172.21.15.194:0/3939027039 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46b4041520 con 0x55f391619b80 2024-09-13T06:11:02.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.101+0000 7f46c4c25980 1 -- 172.21.15.194:0/3939027039 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f39161d3f0 con 0x55f391619b80 2024-09-13T06:11:02.111 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.105+0000 7f45a7fff640 1 -- 172.21.15.194:0/3939027039 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f46b4009070 con 0x55f391619b80 2024-09-13T06:11:02.112 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.105+0000 7f45a7fff640 1 --2- 172.21.15.194:0/3939027039 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f459c034650 0x7f459c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:02.112 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.105+0000 7f45a7fff640 1 -- 172.21.15.194:0/3939027039 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f46b4005050 con 0x55f391619b80 2024-09-13T06:11:02.112 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.105+0000 7f46c1f34640 1 --2- 172.21.15.194:0/3939027039 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f459c034650 0x7f459c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:02.112 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.105+0000 7f46c4c25980 1 Processor -- start 2024-09-13T06:11:02.112 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.105+0000 7f46c4c25980 1 -- start start 2024-09-13T06:11:02.112 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.105+0000 7f46c1f34640 1 --2- 172.21.15.194:0/3939027039 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f459c034650 0x7f459c036b10 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x55f391603c50 tx=0x7f46b8005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:02.112 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.105+0000 7f46c4c25980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f391626270 0x55f391626650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:02.112 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.105+0000 7f46c4c25980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55f3915f5320 con 0x55f391626270 2024-09-13T06:11:02.112 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.105+0000 7f46c2735640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f391626270 0x55f391626650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:02.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.105+0000 7f46c2735640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f391626270 0x55f391626650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:38908/0 (socket says 172.21.15.194:38908) 2024-09-13T06:11:02.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.105+0000 7f46c2735640 1 -- 172.21.15.194:0/1442522207 learned_addr learned my addr 172.21.15.194:0/1442522207 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:02.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.105+0000 7f46c2735640 1 -- 172.21.15.194:0/1442522207 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f391626c20 con 0x55f391626270 2024-09-13T06:11:02.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.105+0000 7f46c2735640 1 --2- 172.21.15.194:0/1442522207 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f391626270 0x55f391626650 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f46b4038460 tx=0x7f46b4038890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e150557ebcfc2b51 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:02.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.105+0000 7f45a5ffb640 1 -- 172.21.15.194:0/1442522207 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46b4016ae0 con 0x55f391626270 2024-09-13T06:11:02.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.105+0000 7f45a5ffb640 1 -- 172.21.15.194:0/1442522207 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46b40165c0 con 0x55f391626270 2024-09-13T06:11:02.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.105+0000 7f45a5ffb640 1 -- 172.21.15.194:0/1442522207 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46b4038bd0 con 0x55f391626270 2024-09-13T06:11:02.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.105+0000 7f46c4c25980 1 -- 172.21.15.194:0/1442522207 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f391626270 msgr2=0x55f391626650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:02.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.105+0000 7f46c4c25980 1 --2- 172.21.15.194:0/1442522207 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f391626270 0x55f391626650 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f46b4038460 tx=0x7f46b4038890 comp rx=0 tx=0).stop 2024-09-13T06:11:02.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.105+0000 7f46c4c25980 1 -- 172.21.15.194:0/1442522207 shutdown_connections 2024-09-13T06:11:02.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.105+0000 7f46c4c25980 1 --2- 172.21.15.194:0/1442522207 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f391626270 0x55f391626650 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:02.114 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.105+0000 7f46c4c25980 1 -- 172.21.15.194:0/1442522207 >> 172.21.15.194:0/1442522207 conn(0x55f391622650 msgr2=0x55f391620750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:02.114 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.105+0000 7f46c4c25980 1 -- 172.21.15.194:0/1442522207 shutdown_connections 2024-09-13T06:11:02.114 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.105+0000 7f46c4c25980 1 -- 172.21.15.194:0/1442522207 wait complete. 2024-09-13T06:11:02.114 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.105+0000 7f46c4c25980 1 Processor -- start 2024-09-13T06:11:02.114 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.109+0000 7f46c4c25980 1 -- start start 2024-09-13T06:11:02.114 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.109+0000 7f46c4c25980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f391626270 0x55f39162d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:02.114 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.109+0000 7f46c4c25980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55f3916270c0 con 0x55f391626270 2024-09-13T06:11:02.119 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.109+0000 7f46c2735640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f391626270 0x55f39162d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:02.120 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.109+0000 7f46c2735640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f391626270 0x55f39162d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:38910/0 (socket says 172.21.15.194:38910) 2024-09-13T06:11:02.120 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.109+0000 7f46c2735640 1 -- 172.21.15.194:0/3708509816 learned_addr learned my addr 172.21.15.194:0/3708509816 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:02.120 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.109+0000 7f46c2735640 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f39162d930 con 0x55f391626270 2024-09-13T06:11:02.120 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.109+0000 7f46c2735640 1 --2- 172.21.15.194:0/3708509816 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f391626270 0x55f39162d3f0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f46b4038b60 tx=0x7f46b4010f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:02.120 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.109+0000 7f4593fff640 1 -- 172.21.15.194:0/3708509816 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46b406b020 con 0x55f391626270 2024-09-13T06:11:02.120 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.109+0000 7f4593fff640 1 -- 172.21.15.194:0/3708509816 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46b4039b60 con 0x55f391626270 2024-09-13T06:11:02.120 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.109+0000 7f46c4c25980 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f39162d930 con 0x55f391626270 2024-09-13T06:11:02.120 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.109+0000 7f4593fff640 1 -- 172.21.15.194:0/3708509816 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46b4039e60 con 0x55f391626270 2024-09-13T06:11:02.120 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.109+0000 7f46c4c25980 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f39162d930 con 0x55f391626270 2024-09-13T06:11:02.120 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.109+0000 7f4593fff640 1 -- 172.21.15.194:0/3708509816 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f46b406e020 con 0x55f391626270 2024-09-13T06:11:02.120 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.109+0000 7f4593fff640 1 --2- 172.21.15.194:0/3708509816 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f458c034650 0x7f458c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:02.121 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.109+0000 7f4593fff640 1 -- 172.21.15.194:0/3708509816 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f46b4062070 con 0x55f391626270 2024-09-13T06:11:02.121 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.109+0000 7f46c1f34640 1 --2- 172.21.15.194:0/3708509816 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f458c034650 0x7f458c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:02.121 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.109+0000 7f46c4c25980 20 rados->read ofs=0 len=0 2024-09-13T06:11:02.121 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.109+0000 7f46c4c25980 1 --2- 172.21.15.194:0/3708509816 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55f391638560 0x55f39163aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:02.121 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.109+0000 7f46c4c25980 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f39163b170 con 0x55f391638560 2024-09-13T06:11:02.121 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.113+0000 7f46c2f36640 1 --2- 172.21.15.194:0/3708509816 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55f391638560 0x55f39163aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:02.121 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.113+0000 7f46c1f34640 1 --2- 172.21.15.194:0/3708509816 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f458c034650 0x7f458c036b10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f46b8000c10 tx=0x7f46b80b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:02.121 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.113+0000 7f46c2f36640 1 --2- 172.21.15.194:0/3708509816 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55f391638560 0x55f39163aa20 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:02.121 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.113+0000 7f46c2f36640 1 -- 172.21.15.194:0/3708509816 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f46bc00a4d0 con 0x55f391638560 2024-09-13T06:11:02.121 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.113+0000 7f46c4c25980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:02.122 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.113+0000 7f46c4c25980 20 realm 2024-09-13T06:11:02.122 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.113+0000 7f46c4c25980 20 rados->read ofs=0 len=0 2024-09-13T06:11:02.122 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.113+0000 7f46c4c25980 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f39163b580 con 0x55f391638560 2024-09-13T06:11:02.122 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.113+0000 7f46c2f36640 1 -- 172.21.15.194:0/3708509816 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f46bc00a4d0 con 0x55f391638560 2024-09-13T06:11:02.122 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.113+0000 7f46c4c25980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:02.122 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.113+0000 7f46c4c25980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:11:02.122 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.113+0000 7f46c4c25980 20 rados->read ofs=0 len=0 2024-09-13T06:11:02.122 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.113+0000 7f46c4c25980 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f39163be50 con 0x55f391638560 2024-09-13T06:11:02.122 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.113+0000 7f46c2f36640 1 -- 172.21.15.194:0/3708509816 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f46bc00a4d0 con 0x55f391638560 2024-09-13T06:11:02.122 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.113+0000 7f46c4c25980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:02.122 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.113+0000 7f46c4c25980 20 rados->read ofs=0 len=0 2024-09-13T06:11:02.122 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.113+0000 7f46c4c25980 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f39163c1f0 con 0x55f391638560 2024-09-13T06:11:02.123 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.113+0000 7f46c2f36640 1 -- 172.21.15.194:0/3708509816 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f46bc00a4d0 con 0x55f391638560 2024-09-13T06:11:02.123 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.113+0000 7f46c4c25980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:11:02.123 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.113+0000 7f46c4c25980 20 rados->read ofs=0 len=0 2024-09-13T06:11:02.123 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.113+0000 7f46c4c25980 1 --2- 172.21.15.194:0/3708509816 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55f39163cf50 0x55f39163f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:02.123 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.113+0000 7f46c4c25980 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f39163f950 con 0x55f39163cf50 2024-09-13T06:11:02.123 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.113+0000 7f46c2735640 1 --2- 172.21.15.194:0/3708509816 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55f39163cf50 0x55f39163f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:02.123 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.113+0000 7f46c2735640 1 --2- 172.21.15.194:0/3708509816 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55f39163cf50 0x55f39163f340 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:02.123 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.113+0000 7f46c2735640 1 -- 172.21.15.194:0/3708509816 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f46b403f070 con 0x55f39163cf50 2024-09-13T06:11:02.123 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.113+0000 7f46c4c25980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:11:02.123 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.113+0000 7f46c4c25980 20 searching for the correct realm 2024-09-13T06:11:02.123 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.113+0000 7f46c4c25980 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f391641220 con 0x55f39163cf50 2024-09-13T06:11:02.124 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.113+0000 7f46c2735640 1 -- 172.21.15.194:0/3708509816 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46b403f070 con 0x55f39163cf50 2024-09-13T06:11:02.124 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.113+0000 7f46c2735640 1 --2- 172.21.15.194:0/3708509816 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f46b4070020 0x7f46b400c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:02.124 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.113+0000 7f46c2735640 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f391641220 con 0x7f46b4070020 2024-09-13T06:11:02.124 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.113+0000 7f46c1f34640 1 --2- 172.21.15.194:0/3708509816 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f46b4070020 0x7f46b400c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:02.124 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.113+0000 7f46c1f34640 1 --2- 172.21.15.194:0/3708509816 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f46b4070020 0x7f46b400c370 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:02.124 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.117+0000 7f46c1f34640 1 -- 172.21.15.194:0/3708509816 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f46b80c9030 con 0x7f46b4070020 2024-09-13T06:11:02.124 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.117+0000 7f46c1f34640 1 --2- 172.21.15.194:0/3708509816 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f46b80dc040 0x7f46b80dd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:02.124 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.117+0000 7f46c1f34640 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f391641220 con 0x7f46b80dc040 2024-09-13T06:11:02.130 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.117+0000 7f46c2f36640 1 --2- 172.21.15.194:0/3708509816 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f46b80dc040 0x7f46b80dd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:02.130 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.117+0000 7f46c2f36640 1 --2- 172.21.15.194:0/3708509816 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f46b80dc040 0x7f46b80dd430 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:02.130 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.117+0000 7f46c2f36640 1 -- 172.21.15.194:0/3708509816 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46bc00a4d0 con 0x7f46b80dc040 2024-09-13T06:11:02.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.117+0000 7f46c2f36640 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f39163c1f0 con 0x55f391638560 2024-09-13T06:11:02.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.117+0000 7f46c2f36640 1 -- 172.21.15.194:0/3708509816 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46bc00a4d0 con 0x55f391638560 2024-09-13T06:11:02.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.117+0000 7f46c2f36640 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f39163c1f0 con 0x55f391638560 2024-09-13T06:11:02.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.117+0000 7f46c2f36640 1 -- 172.21.15.194:0/3708509816 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46bc00a4d0 con 0x55f391638560 2024-09-13T06:11:02.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.117+0000 7f46c2f36640 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f39163c1f0 con 0x7f46b80dc040 2024-09-13T06:11:02.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.117+0000 7f46c2f36640 1 -- 172.21.15.194:0/3708509816 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46bc00a4d0 con 0x7f46b80dc040 2024-09-13T06:11:02.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.117+0000 7f46c2f36640 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f39163c1f0 con 0x7f46b80dc040 2024-09-13T06:11:02.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.117+0000 7f46c2f36640 1 -- 172.21.15.194:0/3708509816 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46bc00a4d0 con 0x7f46b80dc040 2024-09-13T06:11:02.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.117+0000 7f46c2f36640 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f39163c1f0 con 0x7f46b4070020 2024-09-13T06:11:02.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.117+0000 7f46c1f34640 1 -- 172.21.15.194:0/3708509816 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46b80c9030 con 0x7f46b4070020 2024-09-13T06:11:02.132 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.117+0000 7f46c1f34640 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f39163c1f0 con 0x55f39163cf50 2024-09-13T06:11:02.132 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.121+0000 7f46c2735640 1 -- 172.21.15.194:0/3708509816 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46b403f070 con 0x55f39163cf50 2024-09-13T06:11:02.132 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.121+0000 7f46c2735640 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f39163c1f0 con 0x55f391638560 2024-09-13T06:11:02.132 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.121+0000 7f46c2f36640 1 -- 172.21.15.194:0/3708509816 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46bc00a4d0 con 0x55f391638560 2024-09-13T06:11:02.132 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.121+0000 7f46c2f36640 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f39163c1f0 con 0x7f46b80dc040 2024-09-13T06:11:02.132 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.121+0000 7f46c2f36640 1 -- 172.21.15.194:0/3708509816 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46bc00a4d0 con 0x7f46b80dc040 2024-09-13T06:11:02.132 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.121+0000 7f46c2f36640 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f39163c1f0 con 0x55f391638560 2024-09-13T06:11:02.132 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.121+0000 7f46c2f36640 1 -- 172.21.15.194:0/3708509816 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46bc00a4d0 con 0x55f391638560 2024-09-13T06:11:02.132 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.121+0000 7f46c2f36640 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f39163c1f0 con 0x7f46b4070020 2024-09-13T06:11:02.132 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.121+0000 7f46c1f34640 1 -- 172.21.15.194:0/3708509816 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f46b80c9030 con 0x7f46b4070020 2024-09-13T06:11:02.133 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.121+0000 7f46c1f34640 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f39163c1f0 con 0x55f39163cf50 2024-09-13T06:11:02.133 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.121+0000 7f46c2735640 1 -- 172.21.15.194:0/3708509816 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46b403f070 con 0x55f39163cf50 2024-09-13T06:11:02.133 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.121+0000 7f46c2735640 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f39163c1f0 con 0x55f39163cf50 2024-09-13T06:11:02.133 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.121+0000 7f46c2735640 1 -- 172.21.15.194:0/3708509816 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46b403f070 con 0x55f39163cf50 2024-09-13T06:11:02.133 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.121+0000 7f46c2735640 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f39163c1f0 con 0x7f46b80dc040 2024-09-13T06:11:02.133 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.121+0000 7f46c2f36640 1 -- 172.21.15.194:0/3708509816 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46bc00a4d0 con 0x7f46b80dc040 2024-09-13T06:11:02.133 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.121+0000 7f46c2f36640 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f39163c1f0 con 0x55f39163cf50 2024-09-13T06:11:02.133 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.121+0000 7f46c2735640 1 -- 172.21.15.194:0/3708509816 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46b403f070 con 0x55f39163cf50 2024-09-13T06:11:02.133 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.121+0000 7f46c2735640 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f39163c1f0 con 0x55f39163cf50 2024-09-13T06:11:02.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.121+0000 7f46c2735640 1 -- 172.21.15.194:0/3708509816 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46b403f070 con 0x55f39163cf50 2024-09-13T06:11:02.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.121+0000 7f46c2735640 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f39163c1f0 con 0x55f391638560 2024-09-13T06:11:02.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.121+0000 7f46c2f36640 1 -- 172.21.15.194:0/3708509816 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46bc00a4d0 con 0x55f391638560 2024-09-13T06:11:02.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.121+0000 7f46c2f36640 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f39163c1f0 con 0x55f391638560 2024-09-13T06:11:02.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.125+0000 7f46c2f36640 1 -- 172.21.15.194:0/3708509816 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f46bc00a4d0 con 0x55f391638560 2024-09-13T06:11:02.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.125+0000 7f46c2f36640 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f39163c1f0 con 0x7f46b4070020 2024-09-13T06:11:02.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.125+0000 7f46c1f34640 1 -- 172.21.15.194:0/3708509816 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46b80c9030 con 0x7f46b4070020 2024-09-13T06:11:02.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.125+0000 7f46c1f34640 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f39163c1f0 con 0x55f39163cf50 2024-09-13T06:11:02.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.125+0000 7f46c2735640 1 -- 172.21.15.194:0/3708509816 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46b403f070 con 0x55f39163cf50 2024-09-13T06:11:02.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.125+0000 7f46c2735640 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f39163c1f0 con 0x7f46b4070020 2024-09-13T06:11:02.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.125+0000 7f46c1f34640 1 -- 172.21.15.194:0/3708509816 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46b80c9030 con 0x7f46b4070020 2024-09-13T06:11:02.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.125+0000 7f46c1f34640 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f39163c1f0 con 0x55f391638560 2024-09-13T06:11:02.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.125+0000 7f46c2f36640 1 -- 172.21.15.194:0/3708509816 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46bc00a4d0 con 0x55f391638560 2024-09-13T06:11:02.135 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.125+0000 7f46c2f36640 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f39163c1f0 con 0x7f46b80dc040 2024-09-13T06:11:02.135 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.125+0000 7f46c2f36640 1 -- 172.21.15.194:0/3708509816 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46bc00a4d0 con 0x7f46b80dc040 2024-09-13T06:11:02.135 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.125+0000 7f46c2f36640 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f39163c1f0 con 0x55f39163cf50 2024-09-13T06:11:02.135 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.125+0000 7f46c2735640 1 -- 172.21.15.194:0/3708509816 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f46b403f070 con 0x55f39163cf50 2024-09-13T06:11:02.135 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.125+0000 7f46c2735640 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f39163c1f0 con 0x7f46b4070020 2024-09-13T06:11:02.135 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.125+0000 7f46c1f34640 1 -- 172.21.15.194:0/3708509816 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46b80c9030 con 0x7f46b4070020 2024-09-13T06:11:02.135 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.125+0000 7f46c1f34640 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f39163c1f0 con 0x7f46b4070020 2024-09-13T06:11:02.135 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.125+0000 7f46c1f34640 1 -- 172.21.15.194:0/3708509816 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46b80c9030 con 0x7f46b4070020 2024-09-13T06:11:02.135 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.125+0000 7f46c1f34640 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f39163c1f0 con 0x55f39163cf50 2024-09-13T06:11:02.135 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.125+0000 7f46c2735640 1 -- 172.21.15.194:0/3708509816 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46b403f070 con 0x55f39163cf50 2024-09-13T06:11:02.136 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.125+0000 7f46c2735640 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f39163c1f0 con 0x7f46b80dc040 2024-09-13T06:11:02.140 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.125+0000 7f46c2f36640 1 -- 172.21.15.194:0/3708509816 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46bc00a4d0 con 0x7f46b80dc040 2024-09-13T06:11:02.140 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.125+0000 7f46c2f36640 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f39163c1f0 con 0x55f391638560 2024-09-13T06:11:02.140 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.125+0000 7f46c2f36640 1 -- 172.21.15.194:0/3708509816 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f46bc00a4d0 con 0x55f391638560 2024-09-13T06:11:02.140 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.125+0000 7f46c2f36640 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f39163c1f0 con 0x7f46b4070020 2024-09-13T06:11:02.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.129+0000 7f46c1f34640 1 -- 172.21.15.194:0/3708509816 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46b80c9030 con 0x7f46b4070020 2024-09-13T06:11:02.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.129+0000 7f46c4c25980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:11:02.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.129+0000 7f46c4c25980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:11:02.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.129+0000 7f46c4c25980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:11:02.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.129+0000 7f46c4c25980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:11:02.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.129+0000 7f46c4c25980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:11:02.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.129+0000 7f46c4c25980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:11:02.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.129+0000 7f46c4c25980 20 rados->read ofs=0 len=0 2024-09-13T06:11:02.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.129+0000 7f46c4c25980 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f391640310 con 0x55f391638560 2024-09-13T06:11:02.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.129+0000 7f46c2f36640 1 -- 172.21.15.194:0/3708509816 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f46bc00a4d0 con 0x55f391638560 2024-09-13T06:11:02.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.129+0000 7f46c4c25980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:02.142 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.129+0000 7f46c4c25980 20 rados->read ofs=0 len=0 2024-09-13T06:11:02.142 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.129+0000 7f46c4c25980 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f39163ff50 con 0x55f391638560 2024-09-13T06:11:02.142 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.129+0000 7f46c2f36640 1 -- 172.21.15.194:0/3708509816 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f46bc00a4d0 con 0x55f391638560 2024-09-13T06:11:02.142 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.129+0000 7f46c4c25980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:11:02.142 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.129+0000 7f46c4c25980 20 rados->read ofs=0 len=0 2024-09-13T06:11:02.142 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.129+0000 7f46c4c25980 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f391640c30 con 0x7f46b4070020 2024-09-13T06:11:02.142 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.129+0000 7f46c1f34640 1 -- 172.21.15.194:0/3708509816 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f46b80c9030 con 0x7f46b4070020 2024-09-13T06:11:02.142 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.129+0000 7f46c4c25980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:11:02.142 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.129+0000 7f46c4c25980 20 zone default found 2024-09-13T06:11:02.142 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.129+0000 7f46c4c25980 4 Realm: () 2024-09-13T06:11:02.143 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.129+0000 7f46c4c25980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:11:02.143 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.129+0000 7f46c4c25980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:11:02.143 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.129+0000 7f46c4c25980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:11:02.143 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.129+0000 7f46c4c25980 20 zonegroup default 2024-09-13T06:11:02.143 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.129+0000 7f46c4c25980 20 rados->read ofs=0 len=0 2024-09-13T06:11:02.143 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.129+0000 7f46c4c25980 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f391641650 con 0x7f46b80dc040 2024-09-13T06:11:02.143 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.129+0000 7f46c2f36640 1 -- 172.21.15.194:0/3708509816 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f46bc00a4d0 con 0x7f46b80dc040 2024-09-13T06:11:02.143 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.129+0000 7f46c4c25980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:02.143 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.129+0000 7f46c4c25980 20 rados->read ofs=0 len=0 2024-09-13T06:11:02.143 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.129+0000 7f46c4c25980 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f391643030 con 0x55f39163cf50 2024-09-13T06:11:02.143 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.129+0000 7f46c2735640 1 -- 172.21.15.194:0/3708509816 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f46b403f070 con 0x55f39163cf50 2024-09-13T06:11:02.143 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.129+0000 7f46c4c25980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:02.143 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.129+0000 7f46c4c25980 20 rados->read ofs=0 len=0 2024-09-13T06:11:02.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.129+0000 7f46c4c25980 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f391643500 con 0x55f39163cf50 2024-09-13T06:11:02.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.129+0000 7f46c2735640 1 -- 172.21.15.194:0/3708509816 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f46b403f070 con 0x55f39163cf50 2024-09-13T06:11:02.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.129+0000 7f46c4c25980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:02.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.129+0000 7f46c4c25980 20 started sync module instance, tier type = 2024-09-13T06:11:02.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.129+0000 7f46c4c25980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:11:02.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.129+0000 7f46c4c25980 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f3916424d0 con 0x7f46b4070020 2024-09-13T06:11:02.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.129+0000 7f46c1f34640 1 -- 172.21.15.194:0/3708509816 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(44 notify.0 [create] v35'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46b80c9030 con 0x7f46b4070020 2024-09-13T06:11:02.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.133+0000 7f46c4c25980 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94504604674240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f391642130 con 0x7f46b4070020 2024-09-13T06:11:02.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.133+0000 7f46c4c25980 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f391644340 con 0x55f391638560 2024-09-13T06:11:02.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.133+0000 7f46c1f34640 1 -- 172.21.15.194:0/3708509816 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94504604674240] v35'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46b80c9030 con 0x7f46b4070020 2024-09-13T06:11:02.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.133+0000 7f46c2f36640 1 -- 172.21.15.194:0/3708509816 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v35'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46bc00a4d0 con 0x55f391638560 2024-09-13T06:11:02.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.133+0000 7f46c4c25980 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94504604678496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f391644730 con 0x55f391638560 2024-09-13T06:11:02.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.133+0000 7f46c4c25980 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f3916450f0 con 0x55f39163cf50 2024-09-13T06:11:02.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.137+0000 7f46c2735640 1 -- 172.21.15.194:0/3708509816 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v35'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46b403f070 con 0x55f39163cf50 2024-09-13T06:11:02.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.137+0000 7f46c4c25980 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94504604683328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f391645990 con 0x55f39163cf50 2024-09-13T06:11:02.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.137+0000 7f46c4c25980 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f391646390 con 0x7f46b4070020 2024-09-13T06:11:02.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.137+0000 7f46c2f36640 1 -- 172.21.15.194:0/3708509816 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94504604678496] v35'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46bc00a4d0 con 0x55f391638560 2024-09-13T06:11:02.146 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.137+0000 7f46c1f34640 1 -- 172.21.15.194:0/3708509816 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(50 notify.3 [create] v35'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46b80c9030 con 0x7f46b4070020 2024-09-13T06:11:02.146 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.137+0000 7f46c4c25980 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94504604679552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f391646c30 con 0x7f46b4070020 2024-09-13T06:11:02.146 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.137+0000 7f46c4c25980 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f391647480 con 0x55f391638560 2024-09-13T06:11:02.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.137+0000 7f46c2735640 1 -- 172.21.15.194:0/3708509816 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94504604683328] v35'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46b403f070 con 0x55f39163cf50 2024-09-13T06:11:02.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.137+0000 7f46c1f34640 1 -- 172.21.15.194:0/3708509816 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94504604679552] v35'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46b80c9030 con 0x7f46b4070020 2024-09-13T06:11:02.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.137+0000 7f46c2f36640 1 -- 172.21.15.194:0/3708509816 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v35'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46bc00a4d0 con 0x55f391638560 2024-09-13T06:11:02.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.137+0000 7f46c4c25980 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94504604690304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f391647050 con 0x55f391638560 2024-09-13T06:11:02.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.137+0000 7f46c4c25980 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f391647d20 con 0x7f46b80dc040 2024-09-13T06:11:02.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.141+0000 7f46c2f36640 1 -- 172.21.15.194:0/3708509816 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(54 notify.5 [create] v35'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46bc00a4d0 con 0x7f46b80dc040 2024-09-13T06:11:02.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.141+0000 7f46c4c25980 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94504604694288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f391647fe0 con 0x7f46b80dc040 2024-09-13T06:11:02.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.141+0000 7f46c4c25980 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f391648830 con 0x7f46b80dc040 2024-09-13T06:11:02.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.141+0000 7f46c2f36640 1 -- 172.21.15.194:0/3708509816 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94504604690304] v35'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46bc00a4d0 con 0x55f391638560 2024-09-13T06:11:02.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.141+0000 7f46c2f36640 1 -- 172.21.15.194:0/3708509816 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94504604694288] v35'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46bc00a4d0 con 0x7f46b80dc040 2024-09-13T06:11:02.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.145+0000 7f46c2f36640 1 -- 172.21.15.194:0/3708509816 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(56 notify.6 [create] v35'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46bc00a4d0 con 0x7f46b80dc040 2024-09-13T06:11:02.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.145+0000 7f46c4c25980 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94504604695344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f391648400 con 0x7f46b80dc040 2024-09-13T06:11:02.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.145+0000 7f46c4c25980 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f391648c50 con 0x7f46b80dc040 2024-09-13T06:11:02.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.145+0000 7f46c2f36640 1 -- 172.21.15.194:0/3708509816 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94504604695344] v35'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46bc00a4d0 con 0x7f46b80dc040 2024-09-13T06:11:02.150 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.145+0000 7f46c2f36640 1 -- 172.21.15.194:0/3708509816 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(58 notify.7 [create] v35'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46bc00a4d0 con 0x7f46b80dc040 2024-09-13T06:11:02.150 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.145+0000 7f46c4c25980 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94504604696672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f391648a50 con 0x7f46b80dc040 2024-09-13T06:11:02.150 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.145+0000 7f46c4c25980 20 add_watcher() i=0 2024-09-13T06:11:02.150 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.145+0000 7f46c4c25980 20 add_watcher() i=1 2024-09-13T06:11:02.150 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.145+0000 7f46c4c25980 20 add_watcher() i=2 2024-09-13T06:11:02.150 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.145+0000 7f46c4c25980 20 add_watcher() i=3 2024-09-13T06:11:02.150 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.145+0000 7f46c4c25980 20 add_watcher() i=4 2024-09-13T06:11:02.150 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.145+0000 7f46c4c25980 20 add_watcher() i=5 2024-09-13T06:11:02.150 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.145+0000 7f46c4c25980 20 add_watcher() i=6 2024-09-13T06:11:02.151 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.149+0000 7f46c2f36640 1 -- 172.21.15.194:0/3708509816 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94504604696672] v35'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46bc00a4d0 con 0x7f46b80dc040 2024-09-13T06:11:02.152 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.149+0000 7f46c4c25980 20 add_watcher() i=7 2024-09-13T06:11:02.152 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.149+0000 7f46c4c25980 2 all 8 watchers are set, enabling cache 2024-09-13T06:11:02.152 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.149+0000 7f46c4c25980 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f39164bf90 con 0x55f391638560 2024-09-13T06:11:02.152 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.149+0000 7f46c2f36640 1 -- 172.21.15.194:0/3708509816 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f46bc00a4d0 con 0x55f391638560 2024-09-13T06:11:02.153 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.149+0000 7f46c4c25980 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94504604697856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f391649480 con 0x55f391638560 2024-09-13T06:11:02.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.149+0000 7f46c2f36640 1 -- 172.21.15.194:0/3708509816 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94504604697856] v35'214 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f46bc00a4d0 con 0x55f391638560 2024-09-13T06:11:02.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.149+0000 7f4578fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:11:02.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.149+0000 7f46c4c25980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:11:02.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.149+0000 7f46c4c25980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:11:02.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.149+0000 7f46c4c25980 5 note: GC not initialized 2024-09-13T06:11:02.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.149+0000 7f44f37fe640 20 reqs_thread_entry: start 2024-09-13T06:11:02.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.149+0000 7f46c4c25980 20 init_complete bucket index max shards: 11 2024-09-13T06:11:02.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.149+0000 7f46c4c25980 20 Filter name: none 2024-09-13T06:11:02.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.149+0000 7f44f17fa640 20 reqs_thread_entry: start 2024-09-13T06:11:02.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.149+0000 7f46c4c25980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T06:11:02.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.149+0000 7f46c4c25980 20 rados->read ofs=0 len=0 2024-09-13T06:11:02.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.149+0000 7f46c4c25980 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f39166f6d0 con 0x7f46b80dc040 2024-09-13T06:11:02.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.149+0000 7f46c2f36640 1 -- 172.21.15.194:0/3708509816 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f46bc00a4d0 con 0x7f46b80dc040 2024-09-13T06:11:02.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.149+0000 7f46c4c25980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:02.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.149+0000 7f46c4c25980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-13T06:11:02.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.149+0000 7f46c4c25980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T06:11:02.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.149+0000 7f46c4c25980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-13T06:11:02.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.149+0000 7f46c4c25980 20 rados->read ofs=0 len=0 2024-09-13T06:11:02.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.149+0000 7f46c4c25980 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f39166de70 con 0x7f46b80dc040 2024-09-13T06:11:02.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.153+0000 7f46c2f36640 1 -- 172.21.15.194:0/3708509816 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f46bc00a4d0 con 0x7f46b80dc040 2024-09-13T06:11:02.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.153+0000 7f46c4c25980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:02.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.153+0000 7f46c4c25980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-13T06:11:02.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.153+0000 7f46c4c25980 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T06:11:02.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.153+0000 7f46c4c25980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-13T06:11:02.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.153+0000 7f46c4c25980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-13T06:11:02.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.153+0000 7f46c4c25980 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f39166e740 con 0x7f46b80dc040 2024-09-13T06:11:02.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.153+0000 7f46c2f36640 1 -- 172.21.15.194:0/3708509816 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v35'7 uv7 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f46bc00a4d0 con 0x7f46b80dc040 2024-09-13T06:11:02.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.153+0000 7f46c4c25980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-13T06:11:02.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.153+0000 7f46c4c25980 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T06:11:02.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.153+0000 7f46c4c25980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-13T06:11:02.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.153+0000 7f46c4c25980 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94504604852880 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f391673170 con 0x7f46b80dc040 2024-09-13T06:11:02.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.153+0000 7f46c2f36640 1 -- 172.21.15.194:0/3708509816 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== watch-notify(notify (1) cookie 94504604694288 notify 150323855397 ret 0) ==== 598+0+0 (crc 0 0 0) 0x55f39166eae0 con 0x7f46b80dc040 2024-09-13T06:11:02.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.153+0000 7f45a5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855397 cookie 94504604694288 notifier 4738 bl.length()=556 2024-09-13T06:11:02.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.153+0000 7f45a5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-13T06:11:02.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.153+0000 7f45a5ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T06:11:02.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.153+0000 7f45a5ffb640 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f4588003eb0 con 0x7f46b80dc040 2024-09-13T06:11:02.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.153+0000 7f46c2f36640 1 -- 172.21.15.194:0/3708509816 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(65 notify.5 [notify cookie 94504604852880 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f46bc00a4d0 con 0x7f46b80dc040 2024-09-13T06:11:02.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.153+0000 7f46c2f36640 1 -- 172.21.15.194:0/3708509816 <== osd.0 v2:172.21.15.120:6800/1923744619 20 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46bc00a4d0 con 0x7f46b80dc040 2024-09-13T06:11:02.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.157+0000 7f46c2f36640 1 -- 172.21.15.194:0/3708509816 <== osd.0 v2:172.21.15.120:6800/1923744619 21 ==== watch-notify(notify_complete (2) cookie 94504604852880 notify 150323855397 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f39166f120 con 0x7f46b80dc040 2024-09-13T06:11:02.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.157+0000 7f46c4c25980 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f391670ca0 con 0x7f46b80dc040 2024-09-13T06:11:02.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.157+0000 7f46c2f36640 1 -- 172.21.15.194:0/3708509816 <== osd.0 v2:172.21.15.120:6800/1923744619 22 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v35'9 uv9 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f46bc00a4d0 con 0x7f46b80dc040 2024-09-13T06:11:02.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.157+0000 7f46c4c25980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-13T06:11:02.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.157+0000 7f46c4c25980 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T06:11:02.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.157+0000 7f46c4c25980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-13T06:11:02.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.157+0000 7f46c4c25980 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94504604852800 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f391673170 con 0x55f39163cf50 2024-09-13T06:11:02.163 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.157+0000 7f46c2735640 1 -- 172.21.15.194:0/3708509816 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== watch-notify(notify (1) cookie 94504604683328 notify 150323855375 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55f39161a4e0 con 0x55f39163cf50 2024-09-13T06:11:02.163 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.157+0000 7f45a57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855375 cookie 94504604683328 notifier 4738 bl.length()=177 2024-09-13T06:11:02.163 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.157+0000 7f46c2735640 1 -- 172.21.15.194:0/3708509816 <== osd.3 v2:172.21.15.194:6816/96632515 16 ==== osd_op_reply(68 notify.2 [notify cookie 94504604852800 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f46b403f070 con 0x55f39163cf50 2024-09-13T06:11:02.163 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.157+0000 7f45a57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-13T06:11:02.163 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.157+0000 7f45a57fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T06:11:02.163 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.157+0000 7f45a57fa640 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f44f8003410 con 0x55f39163cf50 2024-09-13T06:11:02.163 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.157+0000 7f46c2735640 1 -- 172.21.15.194:0/3708509816 <== osd.3 v2:172.21.15.194:6816/96632515 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46b403f070 con 0x55f39163cf50 2024-09-13T06:11:02.164 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.157+0000 7f46c2735640 1 -- 172.21.15.194:0/3708509816 <== osd.3 v2:172.21.15.194:6816/96632515 18 ==== watch-notify(notify_complete (2) cookie 94504604852800 notify 150323855375 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f46b4033070 con 0x55f39163cf50 2024-09-13T06:11:02.164 INFO:teuthology.orchestra.run.smithi194.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-13T06:11:02.157415Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:11:02.157394Z","tags":[],"group_ids":[]} 2024-09-13T06:11:02.164 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.161+0000 7f4578fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:11:02.164 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.161+0000 7f46c4c25980 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94504604697856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f39166d470 con 0x55f391638560 2024-09-13T06:11:02.165 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.161+0000 7f46c2f36640 1 -- 172.21.15.194:0/3708509816 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94504604697856] v35'215 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f46bc00a4d0 con 0x55f391638560 2024-09-13T06:11:02.165 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.161+0000 7f46c4c25980 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94504604674240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f39166d470 con 0x7f46b4070020 2024-09-13T06:11:02.166 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.161+0000 7f46c1f34640 1 -- 172.21.15.194:0/3708509816 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94504604674240] v35'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46b80c9030 con 0x7f46b4070020 2024-09-13T06:11:02.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.161+0000 7f46c4c25980 20 remove_watcher() i=0 2024-09-13T06:11:02.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.161+0000 7f46c4c25980 2 removed watcher, disabling cache 2024-09-13T06:11:02.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.161+0000 7f46c4c25980 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94504604678496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f39166d470 con 0x55f391638560 2024-09-13T06:11:02.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.165+0000 7f46c2f36640 1 -- 172.21.15.194:0/3708509816 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94504604678496] v35'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46bc00a4d0 con 0x55f391638560 2024-09-13T06:11:02.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.165+0000 7f46c4c25980 20 remove_watcher() i=1 2024-09-13T06:11:02.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.165+0000 7f46c4c25980 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94504604683328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f391643960 con 0x55f39163cf50 2024-09-13T06:11:02.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.165+0000 7f46c2735640 1 -- 172.21.15.194:0/3708509816 <== osd.3 v2:172.21.15.194:6816/96632515 19 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94504604683328] v35'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46b403f070 con 0x55f39163cf50 2024-09-13T06:11:02.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.165+0000 7f46c4c25980 20 remove_watcher() i=2 2024-09-13T06:11:02.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.165+0000 7f46c4c25980 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94504604679552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f39166d470 con 0x7f46b4070020 2024-09-13T06:11:02.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.169+0000 7f46c1f34640 1 -- 172.21.15.194:0/3708509816 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94504604679552] v35'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46b80c9030 con 0x7f46b4070020 2024-09-13T06:11:02.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.169+0000 7f46c4c25980 20 remove_watcher() i=3 2024-09-13T06:11:02.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.169+0000 7f46c4c25980 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94504604690304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f391644c40 con 0x55f391638560 2024-09-13T06:11:02.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.169+0000 7f46c2f36640 1 -- 172.21.15.194:0/3708509816 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94504604690304] v35'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46bc00a4d0 con 0x55f391638560 2024-09-13T06:11:02.175 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.169+0000 7f46c4c25980 20 remove_watcher() i=4 2024-09-13T06:11:02.175 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.169+0000 7f46c4c25980 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94504604694288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f39166d470 con 0x7f46b80dc040 2024-09-13T06:11:02.176 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.173+0000 7f46c2f36640 1 -- 172.21.15.194:0/3708509816 <== osd.0 v2:172.21.15.120:6800/1923744619 23 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94504604694288] v35'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46bc00a4d0 con 0x7f46b80dc040 2024-09-13T06:11:02.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.173+0000 7f46c4c25980 20 remove_watcher() i=5 2024-09-13T06:11:02.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.173+0000 7f46c4c25980 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94504604695344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f391646780 con 0x7f46b80dc040 2024-09-13T06:11:02.179 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.173+0000 7f46c2f36640 1 -- 172.21.15.194:0/3708509816 <== osd.0 v2:172.21.15.120:6800/1923744619 24 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94504604695344] v35'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46bc00a4d0 con 0x7f46b80dc040 2024-09-13T06:11:02.179 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.173+0000 7f46c4c25980 20 remove_watcher() i=6 2024-09-13T06:11:02.179 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.173+0000 7f46c4c25980 1 -- 172.21.15.194:0/3708509816 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94504604696672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f391644c40 con 0x7f46b80dc040 2024-09-13T06:11:02.183 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.177+0000 7f46c2f36640 1 -- 172.21.15.194:0/3708509816 <== osd.0 v2:172.21.15.120:6800/1923744619 25 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94504604696672] v35'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46bc00a4d0 con 0x7f46b80dc040 2024-09-13T06:11:02.183 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.177+0000 7f46c4c25980 20 remove_watcher() i=7 2024-09-13T06:11:02.183 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.177+0000 7f46c4c25980 1 -- 172.21.15.194:0/3708509816 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f46b80dc040 msgr2=0x7f46b80dd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:02.184 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.177+0000 7f46c4c25980 1 --2- 172.21.15.194:0/3708509816 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f46b80dc040 0x7f46b80dd430 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:02.184 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.177+0000 7f46c4c25980 1 -- 172.21.15.194:0/3708509816 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55f391638560 msgr2=0x55f39163aa20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:02.184 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.177+0000 7f46c4c25980 1 --2- 172.21.15.194:0/3708509816 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55f391638560 0x55f39163aa20 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:02.184 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.177+0000 7f46c4c25980 1 -- 172.21.15.194:0/3708509816 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f46b4070020 msgr2=0x7f46b400c370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:02.184 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.177+0000 7f46c4c25980 1 --2- 172.21.15.194:0/3708509816 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f46b4070020 0x7f46b400c370 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:02.184 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.177+0000 7f46c4c25980 1 -- 172.21.15.194:0/3708509816 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55f39163cf50 msgr2=0x55f39163f340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:02.184 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.177+0000 7f46c4c25980 1 --2- 172.21.15.194:0/3708509816 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55f39163cf50 0x55f39163f340 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:02.184 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.177+0000 7f46c4c25980 1 -- 172.21.15.194:0/3708509816 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f458c034650 msgr2=0x7f458c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:02.184 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.177+0000 7f46c4c25980 1 --2- 172.21.15.194:0/3708509816 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f458c034650 0x7f458c036b10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f46b8000c10 tx=0x7f46b80b9040 comp rx=0 tx=0).stop 2024-09-13T06:11:02.184 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.177+0000 7f46c2f36640 1 -- 172.21.15.194:0/3708509816 reap_dead start 2024-09-13T06:11:02.184 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.177+0000 7f46c4c25980 1 -- 172.21.15.194:0/3708509816 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f391626270 msgr2=0x55f39162d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:02.184 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.177+0000 7f46c4c25980 1 --2- 172.21.15.194:0/3708509816 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f391626270 0x55f39162d3f0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f46b4038b60 tx=0x7f46b4010f90 comp rx=0 tx=0).stop 2024-09-13T06:11:02.185 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.177+0000 7f46c4c25980 1 -- 172.21.15.194:0/3708509816 shutdown_connections 2024-09-13T06:11:02.185 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.177+0000 7f46c4c25980 1 --2- 172.21.15.194:0/3708509816 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f391626270 0x55f39162d3f0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:02.185 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.177+0000 7f46c4c25980 1 -- 172.21.15.194:0/3708509816 >> 172.21.15.194:0/3708509816 conn(0x55f391622650 msgr2=0x55f391620720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:02.185 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.177+0000 7f46c4c25980 1 -- 172.21.15.194:0/3708509816 shutdown_connections 2024-09-13T06:11:02.185 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.177+0000 7f46c4c25980 1 -- 172.21.15.194:0/3708509816 wait complete. 2024-09-13T06:11:02.185 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.177+0000 7f46c4c25980 1 -- 172.21.15.194:0/3939027039 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f459c034650 msgr2=0x7f459c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:02.185 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.177+0000 7f46c4c25980 1 --2- 172.21.15.194:0/3939027039 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f459c034650 0x7f459c036b10 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x55f391603c50 tx=0x7f46b8005a10 comp rx=0 tx=0).stop 2024-09-13T06:11:02.185 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.177+0000 7f46c4c25980 1 -- 172.21.15.194:0/3939027039 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f391619b80 msgr2=0x55f391619fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:02.186 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.177+0000 7f46c4c25980 1 --2- 172.21.15.194:0/3939027039 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f391619b80 0x55f391619fa0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f46b402ded0 tx=0x7f46b4017c50 comp rx=0 tx=0).stop 2024-09-13T06:11:02.186 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.177+0000 7f46c4c25980 1 -- 172.21.15.194:0/3939027039 shutdown_connections 2024-09-13T06:11:02.186 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.177+0000 7f46c4c25980 1 --2- 172.21.15.194:0/3939027039 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f459c034650 0x7f459c036b10 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:02.186 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.177+0000 7f46c4c25980 1 --2- 172.21.15.194:0/3939027039 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f391619b80 0x55f391619fa0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:02.186 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.177+0000 7f46c4c25980 1 -- 172.21.15.194:0/3939027039 >> 172.21.15.194:0/3939027039 conn(0x55f39160ecd0 msgr2=0x55f391611750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:02.186 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.177+0000 7f46c4c25980 1 -- 172.21.15.194:0/3939027039 shutdown_connections 2024-09-13T06:11:02.186 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.177+0000 7f46c4c25980 1 -- 172.21.15.194:0/3939027039 wait complete. 2024-09-13T06:11:02.186 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.177+0000 7f46c4c25980 1 -- 172.21.15.194:0/2633868652 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55f39150fad0 msgr2=0x55f391602d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:02.186 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.177+0000 7f46c4c25980 1 --2- 172.21.15.194:0/2633868652 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55f39150fad0 0x55f391602d50 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:02.186 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.177+0000 7f46c4c25980 1 -- 172.21.15.194:0/2633868652 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55f3916095c0 msgr2=0x55f39160b9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:02.186 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.177+0000 7f46c4c25980 1 --2- 172.21.15.194:0/2633868652 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55f3916095c0 0x55f39160b9b0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:02.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.177+0000 7f46c4c25980 1 -- 172.21.15.194:0/2633868652 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55f3916056a0 msgr2=0x55f391607a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:02.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.177+0000 7f46c4c25980 1 --2- 172.21.15.194:0/2633868652 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55f3916056a0 0x55f391607a90 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:02.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.177+0000 7f46c4c25980 1 -- 172.21.15.194:0/2633868652 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f45a8034650 msgr2=0x7f45a8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:02.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.177+0000 7f46c4c25980 1 --2- 172.21.15.194:0/2633868652 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f45a8034650 0x7f45a8036b10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f46b80ad000 tx=0x7f46b80a5040 comp rx=0 tx=0).stop 2024-09-13T06:11:02.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.177+0000 7f46c4c25980 1 -- 172.21.15.194:0/2633868652 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f39147fb00 msgr2=0x55f3915fbd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:02.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.177+0000 7f46c4c25980 1 --2- 172.21.15.194:0/2633868652 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f39147fb00 0x55f3915fbd40 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f46b4001e20 tx=0x7f46b4000ee0 comp rx=0 tx=0).stop 2024-09-13T06:11:02.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.177+0000 7f46c2f36640 1 -- 172.21.15.194:0/2633868652 reap_dead start 2024-09-13T06:11:02.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.177+0000 7f46c4c25980 1 -- 172.21.15.194:0/2633868652 shutdown_connections 2024-09-13T06:11:02.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.177+0000 7f46c4c25980 1 -- 172.21.15.194:0/2633868652 >> 172.21.15.194:0/2633868652 conn(0x55f3915060a0 msgr2=0x55f3915ef180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:02.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.177+0000 7f46c4c25980 1 -- 172.21.15.194:0/2633868652 shutdown_connections 2024-09-13T06:11:02.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.177+0000 7f46c4c25980 1 -- 172.21.15.194:0/2633868652 wait complete. 2024-09-13T06:11:02.193 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-13T06:11:02.157415Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:11:02.157394Z', 'tags': [], 'group_ids': []} 2024-09-13T06:11:02.221 INFO:tasks.radosgw_admin:RL: create_bucket myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-09-13T06:11:02.229 INFO:tasks.radosgw_admin:RL: put_obj myfoo7 fud bytes_out=8 bytes_in=0 failed=False 2024-09-13T06:11:02.229 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-09-13T06:11:02.229 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-09-13T06:11:02.229 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bud --new-uid fud 2024-09-13T06:11:02.262 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:11:02.262 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:11:02.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.261+0000 7f35fd368980 1 Processor -- start 2024-09-13T06:11:02.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.261+0000 7f35fd368980 1 -- start start 2024-09-13T06:11:02.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.261+0000 7f35fd368980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x5598712cea60 0x5598712d0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:02.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.261+0000 7f35fd368980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559871152ae0 con 0x55987123eb10 2024-09-13T06:11:02.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.261+0000 7f35fd368980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x559871176e30 con 0x5598712cea60 2024-09-13T06:11:02.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.261+0000 7f35fa677640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x5598712cea60 0x5598712d0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:02.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.261+0000 7f35fae78640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x55987123eb10 0x5598712cd340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:34432/0 (socket says 172.21.15.194:34432) 2024-09-13T06:11:02.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.261+0000 7f35fae78640 1 -- 172.21.15.194:0/3720402071 learned_addr learned my addr 172.21.15.194:0/3720402071 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-09-13T06:11:02.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.261+0000 7f35fa677640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x5598712cea60 0x5598712d0e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:38918/0 (socket says 172.21.15.194:38918) 2024-09-13T06:11:02.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.261+0000 7f35fa677640 1 -- 172.21.15.194:0/3720402071 >> v1:172.21.15.120:6789/0 conn(0x55987123eb10 legacy=0x5598712cd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:02.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.261+0000 7f35fa677640 1 -- 172.21.15.194:0/3720402071 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598712d23a0 con 0x5598712cea60 2024-09-13T06:11:02.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.261+0000 7f35fa677640 1 --2- 172.21.15.194:0/3720402071 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5598712cea60 0x5598712d0e50 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f35e400a480 tx=0x7f35e401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aaaf4af70a148b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:02.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.265+0000 7f35f9e76640 1 -- 172.21.15.194:0/3720402071 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35e40b0070 con 0x5598712cea60 2024-09-13T06:11:02.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.265+0000 7f35f9e76640 1 -- 172.21.15.194:0/3720402071 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35e40ab540 con 0x5598712cea60 2024-09-13T06:11:02.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.265+0000 7f35f9e76640 1 -- 172.21.15.194:0/3720402071 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35e40ab840 con 0x5598712cea60 2024-09-13T06:11:02.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.265+0000 7f35fd368980 1 -- 172.21.15.194:0/3720402071 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5598712cea60 msgr2=0x5598712d0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:02.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.265+0000 7f35fd368980 1 --2- 172.21.15.194:0/3720402071 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5598712cea60 0x5598712d0e50 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f35e400a480 tx=0x7f35e401b280 comp rx=0 tx=0).stop 2024-09-13T06:11:02.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.265+0000 7f35fd368980 1 -- 172.21.15.194:0/3720402071 shutdown_connections 2024-09-13T06:11:02.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.265+0000 7f35fd368980 1 --2- 172.21.15.194:0/3720402071 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5598712cea60 0x5598712d0e50 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:02.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.265+0000 7f35fd368980 1 -- 172.21.15.194:0/3720402071 >> 172.21.15.194:0/3720402071 conn(0x5598712c5070 msgr2=0x5598712c7490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:02.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.265+0000 7f35fd368980 1 -- 172.21.15.194:0/3720402071 shutdown_connections 2024-09-13T06:11:02.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.265+0000 7f35fd368980 1 -- 172.21.15.194:0/3720402071 wait complete. 2024-09-13T06:11:02.284 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.281+0000 7f35fd368980 1 Processor -- start 2024-09-13T06:11:02.285 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.281+0000 7f35fd368980 1 -- start start 2024-09-13T06:11:02.285 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.281+0000 7f35fd368980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55987123eb10 0x5598712caaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:02.285 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.281+0000 7f35fd368980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x559871178200 con 0x55987123eb10 2024-09-13T06:11:02.285 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.281+0000 7f35fae78640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55987123eb10 0x5598712caaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:02.285 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.281+0000 7f35fae78640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55987123eb10 0x5598712caaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:38934/0 (socket says 172.21.15.194:38934) 2024-09-13T06:11:02.285 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.281+0000 7f35fae78640 1 -- 172.21.15.194:0/3286944056 learned_addr learned my addr 172.21.15.194:0/3286944056 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:02.285 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.281+0000 7f35fae78640 1 -- 172.21.15.194:0/3286944056 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598712cb070 con 0x55987123eb10 2024-09-13T06:11:02.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.281+0000 7f35fae78640 1 --2- 172.21.15.194:0/3286944056 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55987123eb10 0x5598712caaa0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f35ec001e20 tx=0x7f35ec00b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af22ef9a80b812ff server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:02.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.281+0000 7f34e8e09640 1 -- 172.21.15.194:0/3286944056 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35ec012020 con 0x55987123eb10 2024-09-13T06:11:02.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.281+0000 7f34e8e09640 1 -- 172.21.15.194:0/3286944056 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35ec00e7c0 con 0x55987123eb10 2024-09-13T06:11:02.288 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.281+0000 7f34e8e09640 1 -- 172.21.15.194:0/3286944056 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35ec00eb00 con 0x55987123eb10 2024-09-13T06:11:02.288 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.281+0000 7f35fd368980 1 -- 172.21.15.194:0/3286944056 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55987123eb10 msgr2=0x5598712caaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:02.288 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.281+0000 7f35fd368980 1 --2- 172.21.15.194:0/3286944056 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55987123eb10 0x5598712caaa0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f35ec001e20 tx=0x7f35ec00b790 comp rx=0 tx=0).stop 2024-09-13T06:11:02.288 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.281+0000 7f35fd368980 1 -- 172.21.15.194:0/3286944056 shutdown_connections 2024-09-13T06:11:02.288 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.281+0000 7f35fd368980 1 --2- 172.21.15.194:0/3286944056 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55987123eb10 0x5598712caaa0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:02.288 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.281+0000 7f35fd368980 1 -- 172.21.15.194:0/3286944056 >> 172.21.15.194:0/3286944056 conn(0x5598712c5070 msgr2=0x5598713b16e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:02.288 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.281+0000 7f35fd368980 1 -- 172.21.15.194:0/3286944056 shutdown_connections 2024-09-13T06:11:02.288 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.281+0000 7f35fd368980 1 -- 172.21.15.194:0/3286944056 wait complete. 2024-09-13T06:11:02.288 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.281+0000 7f35fd368980 1 Processor -- start 2024-09-13T06:11:02.288 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.281+0000 7f35fd368980 1 -- start start 2024-09-13T06:11:02.288 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.281+0000 7f35fd368980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55987123eb10 0x5598713bf080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:02.289 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.281+0000 7f35fd368980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5598712d1e40 con 0x55987123eb10 2024-09-13T06:11:02.289 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.281+0000 7f35fae78640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55987123eb10 0x5598713bf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:02.289 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.281+0000 7f35fae78640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55987123eb10 0x5598713bf080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:38940/0 (socket says 172.21.15.194:38940) 2024-09-13T06:11:02.289 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.281+0000 7f35fae78640 1 -- 172.21.15.194:0/3014348651 learned_addr learned my addr 172.21.15.194:0/3014348651 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:02.292 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.285+0000 7f35fae78640 1 -- 172.21.15.194:0/3014348651 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598713bf5c0 con 0x55987123eb10 2024-09-13T06:11:02.292 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.285+0000 7f35fae78640 1 --2- 172.21.15.194:0/3014348651 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55987123eb10 0x5598713bf080 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f35ec001e20 tx=0x7f35ec000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:02.292 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.285+0000 7f34e7606640 1 -- 172.21.15.194:0/3014348651 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35ec012030 con 0x55987123eb10 2024-09-13T06:11:02.292 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.285+0000 7f34e7606640 1 -- 172.21.15.194:0/3014348651 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35ec001480 con 0x55987123eb10 2024-09-13T06:11:02.292 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.285+0000 7f34e7606640 1 -- 172.21.15.194:0/3014348651 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35ec01a940 con 0x55987123eb10 2024-09-13T06:11:02.292 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.285+0000 7f35fd368980 1 -- 172.21.15.194:0/3014348651 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5598713bf850 con 0x55987123eb10 2024-09-13T06:11:02.292 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.285+0000 7f35fd368980 1 -- 172.21.15.194:0/3014348651 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598713c2530 con 0x55987123eb10 2024-09-13T06:11:02.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.285+0000 7f34e7606640 1 -- 172.21.15.194:0/3014348651 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f35ec015020 con 0x55987123eb10 2024-09-13T06:11:02.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.285+0000 7f34e7606640 1 --2- 172.21.15.194:0/3014348651 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f34e0034650 0x7f34e0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:02.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.285+0000 7f34e7606640 1 -- 172.21.15.194:0/3014348651 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f35ec020030 con 0x55987123eb10 2024-09-13T06:11:02.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.285+0000 7f35fa677640 1 --2- 172.21.15.194:0/3014348651 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f34e0034650 0x7f34e0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:02.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.285+0000 7f35fd368980 1 --2- 172.21.15.194:0/3014348651 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5598712cea60 0x5598713c6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:02.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.285+0000 7f35fd368980 1 -- 172.21.15.194:0/3014348651 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5598713c66c0 con 0x5598712cea60 2024-09-13T06:11:02.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.285+0000 7f35fb679640 1 --2- 172.21.15.194:0/3014348651 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5598712cea60 0x5598713c6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:02.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.285+0000 7f35fa677640 1 --2- 172.21.15.194:0/3014348651 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f34e0034650 0x7f34e0036b10 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f35e40ad000 tx=0x7f35e40a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:02.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.285+0000 7f35fb679640 1 --2- 172.21.15.194:0/3014348651 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5598712cea60 0x5598713c6050 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:02.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.285+0000 7f35fb679640 1 -- 172.21.15.194:0/3014348651 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f35f400a4d0 con 0x5598712cea60 2024-09-13T06:11:02.294 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.285+0000 7f35fd368980 1 -- 172.21.15.194:0/3014348651 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5598713c3750 con 0x5598712cea60 2024-09-13T06:11:02.294 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.289+0000 7f35fb679640 1 -- 172.21.15.194:0/3014348651 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f35f400a4d0 con 0x5598712cea60 2024-09-13T06:11:02.294 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.289+0000 7f35fd368980 1 --2- 172.21.15.194:0/3014348651 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5598713c89f0 0x5598713cade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:02.294 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.289+0000 7f35fd368980 1 -- 172.21.15.194:0/3014348651 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5598713cb4b0 con 0x5598713c89f0 2024-09-13T06:11:02.294 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.289+0000 7f35fae78640 1 --2- 172.21.15.194:0/3014348651 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5598713c89f0 0x5598713cade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:02.294 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.289+0000 7f35fae78640 1 --2- 172.21.15.194:0/3014348651 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5598713c89f0 0x5598713cade0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:02.296 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.289+0000 7f35fae78640 1 -- 172.21.15.194:0/3014348651 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f35ec008030 con 0x5598713c89f0 2024-09-13T06:11:02.297 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.289+0000 7f35fd368980 1 -- 172.21.15.194:0/3014348651 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5598713c7890 con 0x5598712cea60 2024-09-13T06:11:02.297 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.289+0000 7f35fb679640 1 -- 172.21.15.194:0/3014348651 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f35f400a4d0 con 0x5598712cea60 2024-09-13T06:11:02.297 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.289+0000 7f35fd368980 1 --2- 172.21.15.194:0/3014348651 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5598713cc910 0x5598713ced00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:02.297 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.289+0000 7f35fd368980 1 -- 172.21.15.194:0/3014348651 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5598713cf400 con 0x5598713cc910 2024-09-13T06:11:02.297 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.289+0000 7f35fa677640 1 --2- 172.21.15.194:0/3014348651 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5598713cc910 0x5598713ced00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:02.297 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.289+0000 7f35fa677640 1 --2- 172.21.15.194:0/3014348651 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5598713cc910 0x5598713ced00 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:02.297 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.289+0000 7f35fa677640 1 -- 172.21.15.194:0/3014348651 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f35e40b3040 con 0x5598713cc910 2024-09-13T06:11:02.297 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.289+0000 7f35fd368980 1 Processor -- start 2024-09-13T06:11:02.297 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.289+0000 7f35fd368980 1 -- start start 2024-09-13T06:11:02.297 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.289+0000 7f35fd368980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5598713dced0 0x5598713dd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:02.298 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.289+0000 7f35fd368980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5598711d1800 con 0x5598713dced0 2024-09-13T06:11:02.298 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.289+0000 7f35fae78640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5598713dced0 0x5598713dd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:02.298 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.289+0000 7f35fae78640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5598713dced0 0x5598713dd2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:54666/0 (socket says 172.21.15.194:54666) 2024-09-13T06:11:02.298 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.289+0000 7f35fae78640 1 -- 172.21.15.194:0/2963962959 learned_addr learned my addr 172.21.15.194:0/2963962959 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:02.298 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.289+0000 7f35fae78640 1 -- 172.21.15.194:0/2963962959 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598713dd830 con 0x5598713dced0 2024-09-13T06:11:02.298 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.293+0000 7f35fae78640 1 --2- 172.21.15.194:0/2963962959 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5598713dced0 0x5598713dd2f0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f35ec00d010 tx=0x7f35ec016b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:02.298 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.293+0000 7f34e4e01640 1 -- 172.21.15.194:0/2963962959 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35ec03e070 con 0x5598713dced0 2024-09-13T06:11:02.298 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.293+0000 7f34e4e01640 1 -- 172.21.15.194:0/2963962959 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35ec042130 con 0x5598713dced0 2024-09-13T06:11:02.298 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.293+0000 7f35fd368980 1 -- 172.21.15.194:0/2963962959 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5598713dda60 con 0x5598713dced0 2024-09-13T06:11:02.298 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.293+0000 7f34e4e01640 1 -- 172.21.15.194:0/2963962959 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35ec00c6d0 con 0x5598713dced0 2024-09-13T06:11:02.298 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.293+0000 7f35fd368980 1 -- 172.21.15.194:0/2963962959 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598713e0680 con 0x5598713dced0 2024-09-13T06:11:02.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.293+0000 7f34e4e01640 1 -- 172.21.15.194:0/2963962959 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f35ec041070 con 0x5598713dced0 2024-09-13T06:11:02.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.293+0000 7f34e4e01640 1 --2- 172.21.15.194:0/2963962959 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f34d4034650 0x7f34d4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:02.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.293+0000 7f34e4e01640 1 -- 172.21.15.194:0/2963962959 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f35ec005050 con 0x5598713dced0 2024-09-13T06:11:02.303 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.293+0000 7f35fa677640 1 --2- 172.21.15.194:0/2963962959 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f34d4034650 0x7f34d4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:02.303 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.293+0000 7f35fd368980 1 Processor -- start 2024-09-13T06:11:02.303 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.293+0000 7f35fd368980 1 -- start start 2024-09-13T06:11:02.303 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.293+0000 7f35fa677640 1 --2- 172.21.15.194:0/2963962959 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f34d4034650 0x7f34d4036b10 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x5598713c6fa0 tx=0x7f35e4005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:02.303 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.293+0000 7f35fd368980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5598713e9860 0x5598713e9c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:02.303 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.293+0000 7f35fd368980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5598712c9290 con 0x5598713e9860 2024-09-13T06:11:02.303 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.293+0000 7f35fae78640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5598713e9860 0x5598713e9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:02.303 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.293+0000 7f35fae78640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5598713e9860 0x5598713e9c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:54670/0 (socket says 172.21.15.194:54670) 2024-09-13T06:11:02.303 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.293+0000 7f35fae78640 1 -- 172.21.15.194:0/591114693 learned_addr learned my addr 172.21.15.194:0/591114693 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:02.304 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.293+0000 7f35fae78640 1 -- 172.21.15.194:0/591114693 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598713ea230 con 0x5598713e9860 2024-09-13T06:11:02.304 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.293+0000 7f35fae78640 1 --2- 172.21.15.194:0/591114693 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5598713e9860 0x5598713e9c60 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f35ec047350 tx=0x7f35ec024c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e5d157448e52ec0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:02.304 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.293+0000 7f34de7fc640 1 -- 172.21.15.194:0/591114693 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35ec05a070 con 0x5598713e9860 2024-09-13T06:11:02.304 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.293+0000 7f34de7fc640 1 -- 172.21.15.194:0/591114693 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35ec00fdc0 con 0x5598713e9860 2024-09-13T06:11:02.304 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.293+0000 7f34de7fc640 1 -- 172.21.15.194:0/591114693 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35ec02da00 con 0x5598713e9860 2024-09-13T06:11:02.304 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.297+0000 7f35fd368980 1 -- 172.21.15.194:0/591114693 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5598713e9860 msgr2=0x5598713e9c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:02.304 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.297+0000 7f35fd368980 1 --2- 172.21.15.194:0/591114693 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5598713e9860 0x5598713e9c60 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f35ec047350 tx=0x7f35ec024c40 comp rx=0 tx=0).stop 2024-09-13T06:11:02.304 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.297+0000 7f35fd368980 1 -- 172.21.15.194:0/591114693 shutdown_connections 2024-09-13T06:11:02.304 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.297+0000 7f35fd368980 1 --2- 172.21.15.194:0/591114693 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5598713e9860 0x5598713e9c60 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:02.304 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.297+0000 7f35fd368980 1 -- 172.21.15.194:0/591114693 >> 172.21.15.194:0/591114693 conn(0x5598713e5b90 msgr2=0x5598713e3c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:02.304 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.297+0000 7f35fd368980 1 -- 172.21.15.194:0/591114693 shutdown_connections 2024-09-13T06:11:02.305 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.297+0000 7f35fd368980 1 -- 172.21.15.194:0/591114693 wait complete. 2024-09-13T06:11:02.305 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.297+0000 7f35fd368980 1 Processor -- start 2024-09-13T06:11:02.305 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.297+0000 7f35fd368980 1 -- start start 2024-09-13T06:11:02.305 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.297+0000 7f35fd368980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5598713e9860 0x5598713f09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:02.305 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.297+0000 7f35fd368980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5598713ea720 con 0x5598713e9860 2024-09-13T06:11:02.305 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.297+0000 7f35fae78640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5598713e9860 0x5598713f09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:02.305 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.297+0000 7f35fae78640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5598713e9860 0x5598713f09b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:54676/0 (socket says 172.21.15.194:54676) 2024-09-13T06:11:02.305 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.297+0000 7f35fae78640 1 -- 172.21.15.194:0/3274593060 learned_addr learned my addr 172.21.15.194:0/3274593060 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:02.305 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.297+0000 7f35fae78640 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598713f0ef0 con 0x5598713e9860 2024-09-13T06:11:02.305 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.297+0000 7f35fae78640 1 --2- 172.21.15.194:0/3274593060 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5598713e9860 0x5598713f09b0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f35ec01a740 tx=0x7f35ec04dfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:02.306 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.297+0000 7f34dcff9640 1 -- 172.21.15.194:0/3274593060 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35ec06f070 con 0x5598713e9860 2024-09-13T06:11:02.306 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.297+0000 7f35fd368980 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5598713f0ef0 con 0x5598713e9860 2024-09-13T06:11:02.306 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.297+0000 7f34dcff9640 1 -- 172.21.15.194:0/3274593060 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35ec0414d0 con 0x5598713e9860 2024-09-13T06:11:02.306 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.297+0000 7f34dcff9640 1 -- 172.21.15.194:0/3274593060 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35ec00c9c0 con 0x5598713e9860 2024-09-13T06:11:02.306 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.297+0000 7f35fd368980 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598713f0ef0 con 0x5598713e9860 2024-09-13T06:11:02.311 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.301+0000 7f34dcff9640 1 -- 172.21.15.194:0/3274593060 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f35ec072070 con 0x5598713e9860 2024-09-13T06:11:02.311 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.301+0000 7f34dcff9640 1 --2- 172.21.15.194:0/3274593060 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f34c40346a0 0x7f34c4036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:02.311 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.301+0000 7f34dcff9640 1 -- 172.21.15.194:0/3274593060 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f35ec065030 con 0x5598713e9860 2024-09-13T06:11:02.311 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.301+0000 7f35fa677640 1 --2- 172.21.15.194:0/3274593060 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f34c40346a0 0x7f34c4036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:02.311 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.301+0000 7f35fd368980 20 rados->read ofs=0 len=0 2024-09-13T06:11:02.311 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.301+0000 7f35fd368980 1 --2- 172.21.15.194:0/3274593060 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5598713fbab0 0x5598713fdf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:02.311 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.301+0000 7f35fd368980 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5598713fe6c0 con 0x5598713fbab0 2024-09-13T06:11:02.311 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.301+0000 7f35fb679640 1 --2- 172.21.15.194:0/3274593060 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5598713fbab0 0x5598713fdf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:02.312 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.301+0000 7f35fa677640 1 --2- 172.21.15.194:0/3274593060 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f34c40346a0 0x7f34c4036b60 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f35e4000c10 tx=0x7f35e40b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:02.312 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.301+0000 7f35fb679640 1 --2- 172.21.15.194:0/3274593060 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5598713fbab0 0x5598713fdf70 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:02.312 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.301+0000 7f35fb679640 1 -- 172.21.15.194:0/3274593060 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f35f400a4d0 con 0x5598713fbab0 2024-09-13T06:11:02.312 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.301+0000 7f35fd368980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:02.312 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.301+0000 7f35fd368980 20 realm 2024-09-13T06:11:02.312 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.301+0000 7f35fd368980 20 rados->read ofs=0 len=0 2024-09-13T06:11:02.312 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.301+0000 7f35fd368980 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5598713fead0 con 0x5598713fbab0 2024-09-13T06:11:02.312 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.301+0000 7f35fb679640 1 -- 172.21.15.194:0/3274593060 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f35f400a4d0 con 0x5598713fbab0 2024-09-13T06:11:02.312 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.301+0000 7f35fd368980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:02.312 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.301+0000 7f35fd368980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:11:02.312 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.301+0000 7f35fd368980 20 rados->read ofs=0 len=0 2024-09-13T06:11:02.313 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.301+0000 7f35fd368980 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5598713ff3a0 con 0x5598713fbab0 2024-09-13T06:11:02.313 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.301+0000 7f35fb679640 1 -- 172.21.15.194:0/3274593060 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f35f400a4d0 con 0x5598713fbab0 2024-09-13T06:11:02.313 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.301+0000 7f35fd368980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:02.313 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.301+0000 7f35fd368980 20 rados->read ofs=0 len=0 2024-09-13T06:11:02.313 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.301+0000 7f35fd368980 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5598713ff740 con 0x5598713fbab0 2024-09-13T06:11:02.313 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.301+0000 7f35fb679640 1 -- 172.21.15.194:0/3274593060 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f35f400a4d0 con 0x5598713fbab0 2024-09-13T06:11:02.313 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.301+0000 7f35fd368980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:11:02.313 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.301+0000 7f35fd368980 20 rados->read ofs=0 len=0 2024-09-13T06:11:02.313 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.301+0000 7f35fd368980 1 --2- 172.21.15.194:0/3274593060 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5598714004a0 0x559871402890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:02.313 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.301+0000 7f35fd368980 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559871402ea0 con 0x5598714004a0 2024-09-13T06:11:02.314 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.301+0000 7f35fae78640 1 --2- 172.21.15.194:0/3274593060 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5598714004a0 0x559871402890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:02.314 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.301+0000 7f35fae78640 1 --2- 172.21.15.194:0/3274593060 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5598714004a0 0x559871402890 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:02.314 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.301+0000 7f35fae78640 1 -- 172.21.15.194:0/3274593060 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f35ec071030 con 0x5598714004a0 2024-09-13T06:11:02.314 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.301+0000 7f35fd368980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:11:02.314 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.301+0000 7f35fd368980 20 searching for the correct realm 2024-09-13T06:11:02.314 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.301+0000 7f35fd368980 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559871404770 con 0x5598714004a0 2024-09-13T06:11:02.314 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.301+0000 7f35fae78640 1 -- 172.21.15.194:0/3274593060 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35ec071030 con 0x5598714004a0 2024-09-13T06:11:02.314 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.301+0000 7f35fae78640 1 --2- 172.21.15.194:0/3274593060 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f35ec074060 0x7f35ec0062f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:02.314 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.301+0000 7f35fae78640 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559871404770 con 0x7f35ec074060 2024-09-13T06:11:02.314 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.301+0000 7f35fa677640 1 --2- 172.21.15.194:0/3274593060 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f35ec074060 0x7f35ec0062f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:02.315 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.305+0000 7f35fa677640 1 --2- 172.21.15.194:0/3274593060 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f35ec074060 0x7f35ec0062f0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:02.315 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.305+0000 7f35fa677640 1 -- 172.21.15.194:0/3274593060 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f35e40c9030 con 0x7f35ec074060 2024-09-13T06:11:02.315 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.305+0000 7f35fa677640 1 --2- 172.21.15.194:0/3274593060 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f35e40dc040 0x7f35e40dd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:02.315 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.305+0000 7f35fa677640 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559871404770 con 0x7f35e40dc040 2024-09-13T06:11:02.315 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.305+0000 7f35fb679640 1 --2- 172.21.15.194:0/3274593060 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f35e40dc040 0x7f35e40dd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:02.315 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.305+0000 7f35fb679640 1 --2- 172.21.15.194:0/3274593060 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f35e40dc040 0x7f35e40dd430 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:02.315 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.305+0000 7f35fb679640 1 -- 172.21.15.194:0/3274593060 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35f400a4d0 con 0x7f35e40dc040 2024-09-13T06:11:02.315 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.305+0000 7f35fb679640 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5598713ff740 con 0x5598713fbab0 2024-09-13T06:11:02.315 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.305+0000 7f35fb679640 1 -- 172.21.15.194:0/3274593060 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35f400a4d0 con 0x5598713fbab0 2024-09-13T06:11:02.315 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.305+0000 7f35fb679640 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5598713ff740 con 0x5598713fbab0 2024-09-13T06:11:02.316 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.305+0000 7f35fb679640 1 -- 172.21.15.194:0/3274593060 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35f400a4d0 con 0x5598713fbab0 2024-09-13T06:11:02.316 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.305+0000 7f35fb679640 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5598713ff740 con 0x7f35e40dc040 2024-09-13T06:11:02.316 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.305+0000 7f35fb679640 1 -- 172.21.15.194:0/3274593060 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35f400a4d0 con 0x7f35e40dc040 2024-09-13T06:11:02.316 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.305+0000 7f35fb679640 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5598713ff740 con 0x7f35e40dc040 2024-09-13T06:11:02.325 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.309+0000 7f35fb679640 1 -- 172.21.15.194:0/3274593060 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35f400a4d0 con 0x7f35e40dc040 2024-09-13T06:11:02.325 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.309+0000 7f35fb679640 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5598713ff740 con 0x7f35ec074060 2024-09-13T06:11:02.325 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.309+0000 7f35fa677640 1 -- 172.21.15.194:0/3274593060 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35e40c9030 con 0x7f35ec074060 2024-09-13T06:11:02.325 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.309+0000 7f35fa677640 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5598713ff740 con 0x5598714004a0 2024-09-13T06:11:02.325 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.309+0000 7f35fae78640 1 -- 172.21.15.194:0/3274593060 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35ec071030 con 0x5598714004a0 2024-09-13T06:11:02.325 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.309+0000 7f35fae78640 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5598713ff740 con 0x5598713fbab0 2024-09-13T06:11:02.325 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.309+0000 7f35fb679640 1 -- 172.21.15.194:0/3274593060 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35f400a4d0 con 0x5598713fbab0 2024-09-13T06:11:02.326 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.309+0000 7f35fb679640 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5598713ff740 con 0x7f35e40dc040 2024-09-13T06:11:02.326 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.309+0000 7f35fb679640 1 -- 172.21.15.194:0/3274593060 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35f400a4d0 con 0x7f35e40dc040 2024-09-13T06:11:02.326 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.309+0000 7f35fb679640 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5598713ff740 con 0x5598713fbab0 2024-09-13T06:11:02.326 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.309+0000 7f35fb679640 1 -- 172.21.15.194:0/3274593060 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35f400a4d0 con 0x5598713fbab0 2024-09-13T06:11:02.326 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.309+0000 7f35fb679640 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5598713ff740 con 0x7f35ec074060 2024-09-13T06:11:02.326 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.309+0000 7f35fa677640 1 -- 172.21.15.194:0/3274593060 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f35e40c9030 con 0x7f35ec074060 2024-09-13T06:11:02.326 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.309+0000 7f35fa677640 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5598713ff740 con 0x5598714004a0 2024-09-13T06:11:02.326 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.309+0000 7f35fae78640 1 -- 172.21.15.194:0/3274593060 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35ec071030 con 0x5598714004a0 2024-09-13T06:11:02.326 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.309+0000 7f35fae78640 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5598713ff740 con 0x5598714004a0 2024-09-13T06:11:02.327 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.309+0000 7f35fae78640 1 -- 172.21.15.194:0/3274593060 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35ec071030 con 0x5598714004a0 2024-09-13T06:11:02.327 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.309+0000 7f35fae78640 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5598713ff740 con 0x7f35e40dc040 2024-09-13T06:11:02.327 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.309+0000 7f35fb679640 1 -- 172.21.15.194:0/3274593060 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35f400a4d0 con 0x7f35e40dc040 2024-09-13T06:11:02.327 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.309+0000 7f35fb679640 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5598713ff740 con 0x5598714004a0 2024-09-13T06:11:02.327 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.309+0000 7f35fae78640 1 -- 172.21.15.194:0/3274593060 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35ec071030 con 0x5598714004a0 2024-09-13T06:11:02.327 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.309+0000 7f35fae78640 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5598713ff740 con 0x5598714004a0 2024-09-13T06:11:02.327 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.313+0000 7f35fae78640 1 -- 172.21.15.194:0/3274593060 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35ec071030 con 0x5598714004a0 2024-09-13T06:11:02.327 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.313+0000 7f35fae78640 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5598713ff740 con 0x5598713fbab0 2024-09-13T06:11:02.327 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.313+0000 7f35fb679640 1 -- 172.21.15.194:0/3274593060 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35f400a4d0 con 0x5598713fbab0 2024-09-13T06:11:02.327 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.313+0000 7f35fb679640 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5598713ff740 con 0x5598713fbab0 2024-09-13T06:11:02.327 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.313+0000 7f35fb679640 1 -- 172.21.15.194:0/3274593060 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f35f400a4d0 con 0x5598713fbab0 2024-09-13T06:11:02.328 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.313+0000 7f35fb679640 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5598713ff740 con 0x7f35ec074060 2024-09-13T06:11:02.328 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.313+0000 7f35fa677640 1 -- 172.21.15.194:0/3274593060 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35e40c9030 con 0x7f35ec074060 2024-09-13T06:11:02.328 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.313+0000 7f35fa677640 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5598713ff740 con 0x5598714004a0 2024-09-13T06:11:02.328 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.313+0000 7f35fae78640 1 -- 172.21.15.194:0/3274593060 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35ec071030 con 0x5598714004a0 2024-09-13T06:11:02.328 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.313+0000 7f35fae78640 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5598713ff740 con 0x7f35ec074060 2024-09-13T06:11:02.328 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.313+0000 7f35fa677640 1 -- 172.21.15.194:0/3274593060 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35e40c9030 con 0x7f35ec074060 2024-09-13T06:11:02.328 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.313+0000 7f35fa677640 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5598713ff740 con 0x5598713fbab0 2024-09-13T06:11:02.328 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.313+0000 7f35fb679640 1 -- 172.21.15.194:0/3274593060 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35f400a4d0 con 0x5598713fbab0 2024-09-13T06:11:02.328 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.313+0000 7f35fb679640 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5598713ff740 con 0x7f35e40dc040 2024-09-13T06:11:02.328 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.313+0000 7f35fb679640 1 -- 172.21.15.194:0/3274593060 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35f400a4d0 con 0x7f35e40dc040 2024-09-13T06:11:02.328 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.313+0000 7f35fb679640 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5598713ff740 con 0x5598714004a0 2024-09-13T06:11:02.328 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.313+0000 7f35fae78640 1 -- 172.21.15.194:0/3274593060 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f35ec071030 con 0x5598714004a0 2024-09-13T06:11:02.329 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.313+0000 7f35fae78640 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5598713ff740 con 0x7f35ec074060 2024-09-13T06:11:02.329 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.313+0000 7f35fa677640 1 -- 172.21.15.194:0/3274593060 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35e40c9030 con 0x7f35ec074060 2024-09-13T06:11:02.329 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.313+0000 7f35fa677640 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5598713ff740 con 0x7f35ec074060 2024-09-13T06:11:02.329 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.313+0000 7f35fa677640 1 -- 172.21.15.194:0/3274593060 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35e40c9030 con 0x7f35ec074060 2024-09-13T06:11:02.329 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.313+0000 7f35fa677640 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5598713ff740 con 0x5598714004a0 2024-09-13T06:11:02.329 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.313+0000 7f35fae78640 1 -- 172.21.15.194:0/3274593060 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35ec071030 con 0x5598714004a0 2024-09-13T06:11:02.329 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.313+0000 7f35fae78640 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5598713ff740 con 0x7f35e40dc040 2024-09-13T06:11:02.329 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.317+0000 7f35fb679640 1 -- 172.21.15.194:0/3274593060 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35f400a4d0 con 0x7f35e40dc040 2024-09-13T06:11:02.329 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.317+0000 7f35fb679640 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5598713ff740 con 0x5598713fbab0 2024-09-13T06:11:02.329 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.317+0000 7f35fb679640 1 -- 172.21.15.194:0/3274593060 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f35f400a4d0 con 0x5598713fbab0 2024-09-13T06:11:02.330 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.317+0000 7f35fb679640 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5598713ff740 con 0x7f35ec074060 2024-09-13T06:11:02.330 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.317+0000 7f35fa677640 1 -- 172.21.15.194:0/3274593060 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35e40c9030 con 0x7f35ec074060 2024-09-13T06:11:02.330 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.317+0000 7f35fd368980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:11:02.330 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.317+0000 7f35fd368980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:11:02.330 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.317+0000 7f35fd368980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:11:02.330 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.317+0000 7f35fd368980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:11:02.330 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.317+0000 7f35fd368980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:11:02.330 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.317+0000 7f35fd368980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:11:02.330 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.317+0000 7f35fd368980 20 rados->read ofs=0 len=0 2024-09-13T06:11:02.330 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.317+0000 7f35fd368980 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559871403860 con 0x5598713fbab0 2024-09-13T06:11:02.330 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.317+0000 7f35fb679640 1 -- 172.21.15.194:0/3274593060 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f35f400a4d0 con 0x5598713fbab0 2024-09-13T06:11:02.331 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.317+0000 7f35fd368980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:02.331 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.317+0000 7f35fd368980 20 rados->read ofs=0 len=0 2024-09-13T06:11:02.331 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.317+0000 7f35fd368980 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5598714034a0 con 0x5598713fbab0 2024-09-13T06:11:02.331 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.317+0000 7f35fb679640 1 -- 172.21.15.194:0/3274593060 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f35f400a4d0 con 0x5598713fbab0 2024-09-13T06:11:02.331 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.317+0000 7f35fd368980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:11:02.331 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.317+0000 7f35fd368980 20 rados->read ofs=0 len=0 2024-09-13T06:11:02.331 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.317+0000 7f35fd368980 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559871404180 con 0x7f35ec074060 2024-09-13T06:11:02.331 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.317+0000 7f35fa677640 1 -- 172.21.15.194:0/3274593060 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f35e40c9030 con 0x7f35ec074060 2024-09-13T06:11:02.331 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.317+0000 7f35fd368980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:11:02.331 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.317+0000 7f35fd368980 20 zone default found 2024-09-13T06:11:02.331 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.317+0000 7f35fd368980 4 Realm: () 2024-09-13T06:11:02.331 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.317+0000 7f35fd368980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:11:02.332 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.317+0000 7f35fd368980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:11:02.332 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.317+0000 7f35fd368980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:11:02.332 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.317+0000 7f35fd368980 20 zonegroup default 2024-09-13T06:11:02.332 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.317+0000 7f35fd368980 20 rados->read ofs=0 len=0 2024-09-13T06:11:02.332 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.317+0000 7f35fd368980 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559871404ba0 con 0x7f35e40dc040 2024-09-13T06:11:02.332 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.317+0000 7f35fb679640 1 -- 172.21.15.194:0/3274593060 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f35f400a4d0 con 0x7f35e40dc040 2024-09-13T06:11:02.332 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.317+0000 7f35fd368980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:02.332 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.317+0000 7f35fd368980 20 rados->read ofs=0 len=0 2024-09-13T06:11:02.332 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.317+0000 7f35fd368980 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559871406580 con 0x5598714004a0 2024-09-13T06:11:02.333 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.317+0000 7f35fae78640 1 -- 172.21.15.194:0/3274593060 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f35ec071030 con 0x5598714004a0 2024-09-13T06:11:02.333 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.317+0000 7f35fd368980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:02.333 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.317+0000 7f35fd368980 20 rados->read ofs=0 len=0 2024-09-13T06:11:02.333 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.317+0000 7f35fd368980 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5598714069e0 con 0x5598714004a0 2024-09-13T06:11:02.333 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.317+0000 7f35fae78640 1 -- 172.21.15.194:0/3274593060 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f35ec071030 con 0x5598714004a0 2024-09-13T06:11:02.333 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.317+0000 7f35fd368980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:02.333 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.317+0000 7f35fd368980 20 started sync module instance, tier type = 2024-09-13T06:11:02.333 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.317+0000 7f35fd368980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:11:02.333 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.317+0000 7f35fd368980 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559871405a20 con 0x7f35ec074060 2024-09-13T06:11:02.333 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.321+0000 7f35fa677640 1 -- 172.21.15.194:0/3274593060 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(44 notify.0 [create] v35'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35e40c9030 con 0x7f35ec074060 2024-09-13T06:11:02.333 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.321+0000 7f35fd368980 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94113223433744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5598714072f0 con 0x7f35ec074060 2024-09-13T06:11:02.333 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.321+0000 7f35fd368980 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559871407b40 con 0x5598713fbab0 2024-09-13T06:11:02.336 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.321+0000 7f35fa677640 1 -- 172.21.15.194:0/3274593060 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94113223433744] v35'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35e40c9030 con 0x7f35ec074060 2024-09-13T06:11:02.336 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.321+0000 7f35fb679640 1 -- 172.21.15.194:0/3274593060 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v35'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35f400a4d0 con 0x5598713fbab0 2024-09-13T06:11:02.336 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.321+0000 7f35fd368980 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94113223437888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559871407b40 con 0x5598713fbab0 2024-09-13T06:11:02.336 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.321+0000 7f35fd368980 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559871408620 con 0x5598714004a0 2024-09-13T06:11:02.336 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.325+0000 7f35fb679640 1 -- 172.21.15.194:0/3274593060 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94113223437888] v35'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35f400a4d0 con 0x5598713fbab0 2024-09-13T06:11:02.336 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.325+0000 7f35fae78640 1 -- 172.21.15.194:0/3274593060 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v35'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35ec071030 con 0x5598714004a0 2024-09-13T06:11:02.336 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.325+0000 7f35fd368980 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94113223442736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559871407b40 con 0x5598714004a0 2024-09-13T06:11:02.336 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.325+0000 7f35fd368980 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559871409030 con 0x7f35ec074060 2024-09-13T06:11:02.336 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.325+0000 7f35fa677640 1 -- 172.21.15.194:0/3274593060 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(50 notify.3 [create] v35'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35e40c9030 con 0x7f35ec074060 2024-09-13T06:11:02.336 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.325+0000 7f35fd368980 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94113223445376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559871409880 con 0x7f35ec074060 2024-09-13T06:11:02.336 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.325+0000 7f35fd368980 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55987140a2a0 con 0x5598713fbab0 2024-09-13T06:11:02.337 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.329+0000 7f35fae78640 1 -- 172.21.15.194:0/3274593060 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94113223442736] v35'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35ec071030 con 0x5598714004a0 2024-09-13T06:11:02.337 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.329+0000 7f35fa677640 1 -- 172.21.15.194:0/3274593060 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94113223445376] v35'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35e40c9030 con 0x7f35ec074060 2024-09-13T06:11:02.337 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.329+0000 7f35fb679640 1 -- 172.21.15.194:0/3274593060 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v35'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35f400a4d0 con 0x5598713fbab0 2024-09-13T06:11:02.337 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.329+0000 7f35fd368980 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94113223450000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5598714093d0 con 0x5598713fbab0 2024-09-13T06:11:02.337 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.329+0000 7f35fd368980 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55987140ab40 con 0x7f35e40dc040 2024-09-13T06:11:02.337 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.329+0000 7f35fb679640 1 -- 172.21.15.194:0/3274593060 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(54 notify.5 [create] v35'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35f400a4d0 con 0x7f35e40dc040 2024-09-13T06:11:02.337 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.329+0000 7f35fd368980 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94113223451840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55987140ad90 con 0x7f35e40dc040 2024-09-13T06:11:02.337 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.329+0000 7f35fd368980 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55987140b5e0 con 0x7f35e40dc040 2024-09-13T06:11:02.337 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.329+0000 7f35fb679640 1 -- 172.21.15.194:0/3274593060 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94113223450000] v35'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35f400a4d0 con 0x5598713fbab0 2024-09-13T06:11:02.338 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.333+0000 7f35fb679640 1 -- 172.21.15.194:0/3274593060 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94113223451840] v35'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35f400a4d0 con 0x7f35e40dc040 2024-09-13T06:11:02.338 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.333+0000 7f35fb679640 1 -- 172.21.15.194:0/3274593060 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(56 notify.6 [create] v35'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35f400a4d0 con 0x7f35e40dc040 2024-09-13T06:11:02.338 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.333+0000 7f35fd368980 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94113223452896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55987140b1b0 con 0x7f35e40dc040 2024-09-13T06:11:02.338 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.333+0000 7f35fd368980 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55987140ba00 con 0x7f35e40dc040 2024-09-13T06:11:02.340 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.337+0000 7f35fb679640 1 -- 172.21.15.194:0/3274593060 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94113223452896] v35'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35f400a4d0 con 0x7f35e40dc040 2024-09-13T06:11:02.340 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.337+0000 7f35fb679640 1 -- 172.21.15.194:0/3274593060 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(58 notify.7 [create] v35'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35f400a4d0 con 0x7f35e40dc040 2024-09-13T06:11:02.340 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.337+0000 7f35fd368980 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94113223454224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55987140b840 con 0x7f35e40dc040 2024-09-13T06:11:02.340 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.337+0000 7f35fd368980 20 add_watcher() i=0 2024-09-13T06:11:02.340 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.337+0000 7f35fd368980 20 add_watcher() i=1 2024-09-13T06:11:02.340 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.337+0000 7f35fd368980 20 add_watcher() i=2 2024-09-13T06:11:02.341 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.337+0000 7f35fd368980 20 add_watcher() i=3 2024-09-13T06:11:02.341 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.337+0000 7f35fd368980 20 add_watcher() i=4 2024-09-13T06:11:02.341 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.337+0000 7f35fd368980 20 add_watcher() i=5 2024-09-13T06:11:02.341 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.337+0000 7f35fd368980 20 add_watcher() i=6 2024-09-13T06:11:02.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.337+0000 7f35fb679640 1 -- 172.21.15.194:0/3274593060 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94113223454224] v35'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35f400a4d0 con 0x7f35e40dc040 2024-09-13T06:11:02.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.337+0000 7f35fd368980 20 add_watcher() i=7 2024-09-13T06:11:02.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.337+0000 7f35fd368980 2 all 8 watchers are set, enabling cache 2024-09-13T06:11:02.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.337+0000 7f35fd368980 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55987140ed80 con 0x5598713fbab0 2024-09-13T06:11:02.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.337+0000 7f35fb679640 1 -- 172.21.15.194:0/3274593060 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f35f400a4d0 con 0x5598713fbab0 2024-09-13T06:11:02.343 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.337+0000 7f35fd368980 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94113223455440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55987140c240 con 0x5598713fbab0 2024-09-13T06:11:02.344 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.341+0000 7f35fb679640 1 -- 172.21.15.194:0/3274593060 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94113223455440] v35'216 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f35f400a4d0 con 0x5598713fbab0 2024-09-13T06:11:02.344 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.341+0000 7f34b17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:11:02.345 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.341+0000 7f35fd368980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:11:02.345 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.341+0000 7f35fd368980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:11:02.345 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.341+0000 7f35fd368980 5 note: GC not initialized 2024-09-13T06:11:02.345 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.341+0000 7f342bfff640 20 reqs_thread_entry: start 2024-09-13T06:11:02.345 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.341+0000 7f35fd368980 20 init_complete bucket index max shards: 11 2024-09-13T06:11:02.345 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.341+0000 7f35fd368980 20 Filter name: none 2024-09-13T06:11:02.345 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.341+0000 7f3429ffb640 20 reqs_thread_entry: start 2024-09-13T06:11:02.345 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.341+0000 7f35fd368980 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-13T06:11:02.345 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.341+0000 7f35fd368980 20 rados->read ofs=0 len=0 2024-09-13T06:11:02.345 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.341+0000 7f35fd368980 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:62 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5598714324a0 con 0x7f35ec074060 2024-09-13T06:11:02.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.341+0000 7f35fa677640 1 -- 172.21.15.194:0/3274593060 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(62 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f35e40c9030 con 0x7f35ec074060 2024-09-13T06:11:02.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.341+0000 7f35fd368980 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T06:11:02.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.341+0000 7f35fd368980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-09-13T06:11:02.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.341+0000 7f35fd368980 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-13T06:11:02.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.341+0000 7f35fd368980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:11:02.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.341+0000 7f35fd368980 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:63 8.e 8:75f48285:users.uid::fud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559871436620 con 0x7f35e40dc040 2024-09-13T06:11:02.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.341+0000 7f35fb679640 1 -- 172.21.15.194:0/3274593060 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(63 fud [create,call,writefull 0~206] v35'8 uv7 ondisk = -17 ((17) File exists)) ==== 231+0+0 (crc 0 0 0) 0x7f35f400a4d0 con 0x7f35e40dc040 2024-09-13T06:11:02.347 INFO:teuthology.orchestra.run.smithi194.stderr:could not rename user: unable to rename user, user name given by --new-uid already exists. to overwrite this user, add --yes-i-really-mean-it 2024-09-13T06:11:02.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.345+0000 7f34b17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:11:02.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.345+0000 7f35fd368980 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94113223455440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5598714302d0 con 0x5598713fbab0 2024-09-13T06:11:02.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.345+0000 7f35fb679640 1 -- 172.21.15.194:0/3274593060 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94113223455440] v35'217 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f35f400a4d0 con 0x5598713fbab0 2024-09-13T06:11:02.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.345+0000 7f35fd368980 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94113223433744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5598714302d0 con 0x7f35ec074060 2024-09-13T06:11:02.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.345+0000 7f35fa677640 1 -- 172.21.15.194:0/3274593060 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94113223433744] v35'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35e40c9030 con 0x7f35ec074060 2024-09-13T06:11:02.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.345+0000 7f35fd368980 20 remove_watcher() i=0 2024-09-13T06:11:02.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.345+0000 7f35fd368980 2 removed watcher, disabling cache 2024-09-13T06:11:02.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.345+0000 7f35fd368980 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94113223437888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5598714302d0 con 0x5598713fbab0 2024-09-13T06:11:02.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.349+0000 7f35fb679640 1 -- 172.21.15.194:0/3274593060 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94113223437888] v35'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35f400a4d0 con 0x5598713fbab0 2024-09-13T06:11:02.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.349+0000 7f35fd368980 20 remove_watcher() i=1 2024-09-13T06:11:02.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.349+0000 7f35fd368980 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94113223442736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559871406e40 con 0x5598714004a0 2024-09-13T06:11:02.355 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.349+0000 7f35fae78640 1 -- 172.21.15.194:0/3274593060 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94113223442736] v35'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35ec071030 con 0x5598714004a0 2024-09-13T06:11:02.355 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.349+0000 7f35fd368980 20 remove_watcher() i=2 2024-09-13T06:11:02.355 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.349+0000 7f35fd368980 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94113223445376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5598714302d0 con 0x7f35ec074060 2024-09-13T06:11:02.356 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.353+0000 7f35fa677640 1 -- 172.21.15.194:0/3274593060 <== osd.2 v2:172.21.15.194:6800/815615585 16 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94113223445376] v35'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35e40c9030 con 0x7f35ec074060 2024-09-13T06:11:02.356 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.353+0000 7f35fd368980 20 remove_watcher() i=3 2024-09-13T06:11:02.357 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.353+0000 7f35fd368980 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94113223450000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559871406e40 con 0x5598713fbab0 2024-09-13T06:11:02.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.353+0000 7f35fb679640 1 -- 172.21.15.194:0/3274593060 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94113223450000] v35'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35f400a4d0 con 0x5598713fbab0 2024-09-13T06:11:02.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.353+0000 7f35fd368980 20 remove_watcher() i=4 2024-09-13T06:11:02.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.353+0000 7f35fd368980 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94113223451840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5598714302d0 con 0x7f35e40dc040 2024-09-13T06:11:02.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.357+0000 7f35fb679640 1 -- 172.21.15.194:0/3274593060 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94113223451840] v35'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35f400a4d0 con 0x7f35e40dc040 2024-09-13T06:11:02.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.357+0000 7f35fd368980 20 remove_watcher() i=5 2024-09-13T06:11:02.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.357+0000 7f35fd368980 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94113223452896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559871406e40 con 0x7f35e40dc040 2024-09-13T06:11:02.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.357+0000 7f35fb679640 1 -- 172.21.15.194:0/3274593060 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94113223452896] v35'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35f400a4d0 con 0x7f35e40dc040 2024-09-13T06:11:02.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.357+0000 7f35fd368980 20 remove_watcher() i=6 2024-09-13T06:11:02.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.357+0000 7f35fd368980 1 -- 172.21.15.194:0/3274593060 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94113223454224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5598714302d0 con 0x7f35e40dc040 2024-09-13T06:11:02.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.361+0000 7f35fb679640 1 -- 172.21.15.194:0/3274593060 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94113223454224] v35'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35f400a4d0 con 0x7f35e40dc040 2024-09-13T06:11:02.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.361+0000 7f35fd368980 20 remove_watcher() i=7 2024-09-13T06:11:02.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.361+0000 7f35fd368980 1 -- 172.21.15.194:0/3274593060 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f35e40dc040 msgr2=0x7f35e40dd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:02.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.361+0000 7f35fd368980 1 --2- 172.21.15.194:0/3274593060 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f35e40dc040 0x7f35e40dd430 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:02.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.361+0000 7f35fd368980 1 -- 172.21.15.194:0/3274593060 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5598713fbab0 msgr2=0x5598713fdf70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:02.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.361+0000 7f35fd368980 1 --2- 172.21.15.194:0/3274593060 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5598713fbab0 0x5598713fdf70 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:02.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.361+0000 7f35fd368980 1 -- 172.21.15.194:0/3274593060 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f35ec074060 msgr2=0x7f35ec0062f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:02.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.361+0000 7f35fd368980 1 --2- 172.21.15.194:0/3274593060 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f35ec074060 0x7f35ec0062f0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:02.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.361+0000 7f35fd368980 1 -- 172.21.15.194:0/3274593060 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5598714004a0 msgr2=0x559871402890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:02.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.361+0000 7f35fd368980 1 --2- 172.21.15.194:0/3274593060 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5598714004a0 0x559871402890 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:02.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.361+0000 7f35fd368980 1 -- 172.21.15.194:0/3274593060 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f34c40346a0 msgr2=0x7f34c4036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:02.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.361+0000 7f35fd368980 1 --2- 172.21.15.194:0/3274593060 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f34c40346a0 0x7f34c4036b60 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f35e4000c10 tx=0x7f35e40b9040 comp rx=0 tx=0).stop 2024-09-13T06:11:02.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.361+0000 7f35fd368980 1 -- 172.21.15.194:0/3274593060 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5598713e9860 msgr2=0x5598713f09b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:02.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.361+0000 7f35fb679640 1 -- 172.21.15.194:0/3274593060 reap_dead start 2024-09-13T06:11:02.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.361+0000 7f35fd368980 1 --2- 172.21.15.194:0/3274593060 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5598713e9860 0x5598713f09b0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f35ec01a740 tx=0x7f35ec04dfa0 comp rx=0 tx=0).stop 2024-09-13T06:11:02.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.361+0000 7f35fd368980 1 -- 172.21.15.194:0/3274593060 shutdown_connections 2024-09-13T06:11:02.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.361+0000 7f35fd368980 1 --2- 172.21.15.194:0/3274593060 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5598713e9860 0x5598713f09b0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:02.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.361+0000 7f35fd368980 1 -- 172.21.15.194:0/3274593060 >> 172.21.15.194:0/3274593060 conn(0x5598713e5b90 msgr2=0x5598713e3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:02.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.361+0000 7f35fd368980 1 -- 172.21.15.194:0/3274593060 shutdown_connections 2024-09-13T06:11:02.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.361+0000 7f35fd368980 1 -- 172.21.15.194:0/3274593060 wait complete. 2024-09-13T06:11:02.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.361+0000 7f35fd368980 1 -- 172.21.15.194:0/2963962959 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f34d4034650 msgr2=0x7f34d4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:02.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.361+0000 7f35fd368980 1 --2- 172.21.15.194:0/2963962959 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f34d4034650 0x7f34d4036b10 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x5598713c6fa0 tx=0x7f35e4005a10 comp rx=0 tx=0).stop 2024-09-13T06:11:02.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.361+0000 7f35fd368980 1 -- 172.21.15.194:0/2963962959 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5598713dced0 msgr2=0x5598713dd2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:02.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.361+0000 7f35fd368980 1 --2- 172.21.15.194:0/2963962959 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5598713dced0 0x5598713dd2f0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f35ec00d010 tx=0x7f35ec016b00 comp rx=0 tx=0).stop 2024-09-13T06:11:02.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.361+0000 7f35fd368980 1 -- 172.21.15.194:0/2963962959 shutdown_connections 2024-09-13T06:11:02.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.361+0000 7f35fd368980 1 --2- 172.21.15.194:0/2963962959 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f34d4034650 0x7f34d4036b10 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:02.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.361+0000 7f35fd368980 1 --2- 172.21.15.194:0/2963962959 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5598713dced0 0x5598713dd2f0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:02.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.361+0000 7f35fd368980 1 -- 172.21.15.194:0/2963962959 >> 172.21.15.194:0/2963962959 conn(0x5598713d2020 msgr2=0x5598713d4aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:02.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.361+0000 7f35fd368980 1 -- 172.21.15.194:0/2963962959 shutdown_connections 2024-09-13T06:11:02.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.361+0000 7f35fd368980 1 -- 172.21.15.194:0/2963962959 wait complete. 2024-09-13T06:11:02.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.361+0000 7f35fd368980 1 -- 172.21.15.194:0/3014348651 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5598712cea60 msgr2=0x5598713c6050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:02.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.361+0000 7f35fd368980 1 --2- 172.21.15.194:0/3014348651 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5598712cea60 0x5598713c6050 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:02.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.361+0000 7f35fd368980 1 -- 172.21.15.194:0/3014348651 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5598713cc910 msgr2=0x5598713ced00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:02.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.361+0000 7f35fd368980 1 --2- 172.21.15.194:0/3014348651 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5598713cc910 0x5598713ced00 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:02.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.361+0000 7f35fd368980 1 -- 172.21.15.194:0/3014348651 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5598713c89f0 msgr2=0x5598713cade0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:02.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.361+0000 7f35fd368980 1 --2- 172.21.15.194:0/3014348651 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5598713c89f0 0x5598713cade0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:02.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.361+0000 7f35fd368980 1 -- 172.21.15.194:0/3014348651 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f34e0034650 msgr2=0x7f34e0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:02.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.361+0000 7f35fd368980 1 --2- 172.21.15.194:0/3014348651 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f34e0034650 0x7f34e0036b10 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f35e40ad000 tx=0x7f35e40a5040 comp rx=0 tx=0).stop 2024-09-13T06:11:02.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.361+0000 7f35fd368980 1 -- 172.21.15.194:0/3014348651 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55987123eb10 msgr2=0x5598713bf080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:02.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.361+0000 7f35fd368980 1 --2- 172.21.15.194:0/3014348651 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55987123eb10 0x5598713bf080 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f35ec001e20 tx=0x7f35ec000ee0 comp rx=0 tx=0).stop 2024-09-13T06:11:02.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.361+0000 7f35fb679640 1 -- 172.21.15.194:0/3014348651 reap_dead start 2024-09-13T06:11:02.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.361+0000 7f35fd368980 1 -- 172.21.15.194:0/3014348651 shutdown_connections 2024-09-13T06:11:02.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.361+0000 7f35fd368980 1 -- 172.21.15.194:0/3014348651 >> 172.21.15.194:0/3014348651 conn(0x5598712c5070 msgr2=0x5598713b1320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:02.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.361+0000 7f35fd368980 1 -- 172.21.15.194:0/3014348651 shutdown_connections 2024-09-13T06:11:02.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.361+0000 7f35fd368980 1 -- 172.21.15.194:0/3014348651 wait complete. 2024-09-13T06:11:02.376 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-13T06:11:02.382 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-09-13T06:11:02.382 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-09-13T06:11:02.390 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-09-13T06:11:02.390 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=8 failed=False 2024-09-13T06:11:02.390 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud', '--purge-data'] 2024-09-13T06:11:02.390 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud', '--purge-data'] 2024-09-13T06:11:02.390 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud --purge-data 2024-09-13T06:11:02.451 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:11:02.451 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:11:02.452 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.449+0000 7fbfbfec8980 1 Processor -- start 2024-09-13T06:11:02.452 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.449+0000 7fbfbfec8980 1 -- start start 2024-09-13T06:11:02.452 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.449+0000 7fbfbfec8980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55844c6ab9e0 0x55844c6addd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:02.452 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.449+0000 7fbfbfec8980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55844c52fae0 con 0x55844c6a7660 2024-09-13T06:11:02.452 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.449+0000 7fbfbfec8980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x55844c553e30 con 0x55844c6ab9e0 2024-09-13T06:11:02.453 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.449+0000 7fbfbd1d7640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55844c6ab9e0 0x55844c6addd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:02.453 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.449+0000 7fbfbd9d8640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x55844c6a7660 0x55844c6a7a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:46814/0 (socket says 172.21.15.194:46814) 2024-09-13T06:11:02.453 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.449+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/2060379600 learned_addr learned my addr 172.21.15.194:0/2060379600 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-09-13T06:11:02.453 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.449+0000 7fbfbd1d7640 1 -- 172.21.15.194:0/2060379600 >> v1:172.21.15.120:6789/0 conn(0x55844c6a7660 legacy=0x55844c6a7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:02.454 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.449+0000 7fbfbd1d7640 1 -- 172.21.15.194:0/2060379600 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55844c6af320 con 0x55844c6ab9e0 2024-09-13T06:11:02.456 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.453+0000 7fbfbd1d7640 1 --2- 172.21.15.194:0/2060379600 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55844c6ab9e0 0x55844c6addd0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fbfb400a480 tx=0x7fbfb401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=662a35f021cf186a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:02.456 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.453+0000 7fbfbc9d6640 1 -- 172.21.15.194:0/2060379600 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfb40b0070 con 0x55844c6ab9e0 2024-09-13T06:11:02.456 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.453+0000 7fbfbc9d6640 1 -- 172.21.15.194:0/2060379600 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfb40ab540 con 0x55844c6ab9e0 2024-09-13T06:11:02.456 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.453+0000 7fbfbc9d6640 1 -- 172.21.15.194:0/2060379600 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfb40ab840 con 0x55844c6ab9e0 2024-09-13T06:11:02.457 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.453+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2060379600 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55844c6ab9e0 msgr2=0x55844c6addd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:02.457 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.453+0000 7fbfbfec8980 1 --2- 172.21.15.194:0/2060379600 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55844c6ab9e0 0x55844c6addd0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fbfb400a480 tx=0x7fbfb401b280 comp rx=0 tx=0).stop 2024-09-13T06:11:02.457 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.453+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2060379600 shutdown_connections 2024-09-13T06:11:02.457 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.453+0000 7fbfbfec8980 1 --2- 172.21.15.194:0/2060379600 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55844c6ab9e0 0x55844c6addd0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:02.457 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.453+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2060379600 >> 172.21.15.194:0/2060379600 conn(0x55844c6a3180 msgr2=0x55844c6a55a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:02.457 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.453+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2060379600 shutdown_connections 2024-09-13T06:11:02.457 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.453+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2060379600 wait complete. 2024-09-13T06:11:02.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.469+0000 7fbfbfec8980 1 Processor -- start 2024-09-13T06:11:02.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.469+0000 7fbfbfec8980 1 -- start start 2024-09-13T06:11:02.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.469+0000 7fbfbfec8980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55844c6a7660 0x55844c792a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:02.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.469+0000 7fbfbfec8980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55844c555200 con 0x55844c6a7660 2024-09-13T06:11:02.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.469+0000 7fbfbd9d8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55844c6a7660 0x55844c792a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:02.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.469+0000 7fbfbd9d8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55844c6a7660 0x55844c792a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:54696/0 (socket says 172.21.15.194:54696) 2024-09-13T06:11:02.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.469+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/2127862185 learned_addr learned my addr 172.21.15.194:0/2127862185 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:02.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.469+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/2127862185 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55844c793000 con 0x55844c6a7660 2024-09-13T06:11:02.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.469+0000 7fbfbd9d8640 1 --2- 172.21.15.194:0/2127862185 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55844c6a7660 0x55844c792a30 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fbfb0001d90 tx=0x7fbfb0001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=399c84823f0dd39e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:02.475 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.469+0000 7fbeabe07640 1 -- 172.21.15.194:0/2127862185 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfb0013030 con 0x55844c6a7660 2024-09-13T06:11:02.475 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.469+0000 7fbeabe07640 1 -- 172.21.15.194:0/2127862185 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfb000e690 con 0x55844c6a7660 2024-09-13T06:11:02.475 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.469+0000 7fbeabe07640 1 -- 172.21.15.194:0/2127862185 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfb000ea10 con 0x55844c6a7660 2024-09-13T06:11:02.475 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.469+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2127862185 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55844c6a7660 msgr2=0x55844c792a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:02.475 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.469+0000 7fbfbfec8980 1 --2- 172.21.15.194:0/2127862185 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55844c6a7660 0x55844c792a30 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fbfb0001d90 tx=0x7fbfb0001e80 comp rx=0 tx=0).stop 2024-09-13T06:11:02.475 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.469+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2127862185 shutdown_connections 2024-09-13T06:11:02.475 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.469+0000 7fbfbfec8980 1 --2- 172.21.15.194:0/2127862185 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55844c6a7660 0x55844c792a30 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:02.475 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.469+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2127862185 >> 172.21.15.194:0/2127862185 conn(0x55844c6a3180 msgr2=0x55844c78e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:02.475 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.469+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2127862185 shutdown_connections 2024-09-13T06:11:02.475 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.469+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2127862185 wait complete. 2024-09-13T06:11:02.476 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.469+0000 7fbfbfec8980 1 Processor -- start 2024-09-13T06:11:02.476 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.469+0000 7fbfbfec8980 1 -- start start 2024-09-13T06:11:02.476 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.469+0000 7fbfbfec8980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55844c6a7660 0x55844c799dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:02.476 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.469+0000 7fbfbfec8980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55844c6aee20 con 0x55844c6a7660 2024-09-13T06:11:02.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.469+0000 7fbfbd9d8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55844c6a7660 0x55844c799dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:02.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.469+0000 7fbfbd9d8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55844c6a7660 0x55844c799dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:54700/0 (socket says 172.21.15.194:54700) 2024-09-13T06:11:02.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.469+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/939590294 learned_addr learned my addr 172.21.15.194:0/939590294 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:02.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.473+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/939590294 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55844c79a300 con 0x55844c6a7660 2024-09-13T06:11:02.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.473+0000 7fbfbd9d8640 1 --2- 172.21.15.194:0/939590294 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55844c6a7660 0x55844c799dc0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x55844c793c10 tx=0x7fbfb0000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:02.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.473+0000 7fbeaa604640 1 -- 172.21.15.194:0/939590294 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfb0027070 con 0x55844c6a7660 2024-09-13T06:11:02.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.473+0000 7fbfbfec8980 1 -- 172.21.15.194:0/939590294 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55844c79a590 con 0x55844c6a7660 2024-09-13T06:11:02.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.473+0000 7fbeaa604640 1 -- 172.21.15.194:0/939590294 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfb00198e0 con 0x55844c6a7660 2024-09-13T06:11:02.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.473+0000 7fbeaa604640 1 -- 172.21.15.194:0/939590294 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfb0019c00 con 0x55844c6a7660 2024-09-13T06:11:02.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.473+0000 7fbfbfec8980 1 -- 172.21.15.194:0/939590294 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55844c79d270 con 0x55844c6a7660 2024-09-13T06:11:02.479 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.473+0000 7fbeaa604640 1 -- 172.21.15.194:0/939590294 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fbfb002a070 con 0x55844c6a7660 2024-09-13T06:11:02.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.473+0000 7fbeaa604640 1 --2- 172.21.15.194:0/939590294 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fbea40346a0 0x7fbea4036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:02.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.473+0000 7fbeaa604640 1 -- 172.21.15.194:0/939590294 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fbfb001f070 con 0x55844c6a7660 2024-09-13T06:11:02.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.473+0000 7fbfbd1d7640 1 --2- 172.21.15.194:0/939590294 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fbea40346a0 0x7fbea4036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:02.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.473+0000 7fbfbfec8980 1 --2- 172.21.15.194:0/939590294 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55844c6ab9e0 0x55844c7a0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:02.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.473+0000 7fbfbfec8980 1 -- 172.21.15.194:0/939590294 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55844c7a1390 con 0x55844c6ab9e0 2024-09-13T06:11:02.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.473+0000 7fbfbe1d9640 1 --2- 172.21.15.194:0/939590294 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55844c6ab9e0 0x55844c7a0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:02.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.473+0000 7fbfbd1d7640 1 --2- 172.21.15.194:0/939590294 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fbea40346a0 0x7fbea4036b60 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fbfb40ad000 tx=0x7fbfb40a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:02.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.473+0000 7fbfbe1d9640 1 --2- 172.21.15.194:0/939590294 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55844c6ab9e0 0x55844c7a0d70 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:02.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.473+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/939590294 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbfb800a4d0 con 0x55844c6ab9e0 2024-09-13T06:11:02.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.473+0000 7fbfbfec8980 1 -- 172.21.15.194:0/939590294 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55844c79e490 con 0x55844c6ab9e0 2024-09-13T06:11:02.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.477+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/939590294 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbfb800a4d0 con 0x55844c6ab9e0 2024-09-13T06:11:02.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.477+0000 7fbfbfec8980 1 --2- 172.21.15.194:0/939590294 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55844c7a36e0 0x55844c7a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:02.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.477+0000 7fbfbfec8980 1 -- 172.21.15.194:0/939590294 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55844c7a61a0 con 0x55844c7a36e0 2024-09-13T06:11:02.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.477+0000 7fbfbd9d8640 1 --2- 172.21.15.194:0/939590294 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55844c7a36e0 0x55844c7a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:02.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.477+0000 7fbfbd9d8640 1 --2- 172.21.15.194:0/939590294 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55844c7a36e0 0x55844c7a5ad0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:02.483 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.477+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/939590294 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbfb0029030 con 0x55844c7a36e0 2024-09-13T06:11:02.483 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.477+0000 7fbfbfec8980 1 -- 172.21.15.194:0/939590294 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55844c7a2580 con 0x55844c6ab9e0 2024-09-13T06:11:02.483 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.477+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/939590294 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbfb800a4d0 con 0x55844c6ab9e0 2024-09-13T06:11:02.483 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.477+0000 7fbfbfec8980 1 --2- 172.21.15.194:0/939590294 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55844c7a75e0 0x55844c7a99d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:02.483 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.477+0000 7fbfbfec8980 1 -- 172.21.15.194:0/939590294 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55844c7aa160 con 0x55844c7a75e0 2024-09-13T06:11:02.483 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.477+0000 7fbfbd1d7640 1 --2- 172.21.15.194:0/939590294 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55844c7a75e0 0x55844c7a99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:02.483 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.477+0000 7fbfbd1d7640 1 --2- 172.21.15.194:0/939590294 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55844c7a75e0 0x55844c7a99d0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:02.483 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.477+0000 7fbfbd1d7640 1 -- 172.21.15.194:0/939590294 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbfb40b3040 con 0x55844c7a75e0 2024-09-13T06:11:02.484 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.477+0000 7fbfbfec8980 1 Processor -- start 2024-09-13T06:11:02.484 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.477+0000 7fbfbfec8980 1 -- start start 2024-09-13T06:11:02.484 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.477+0000 7fbfbfec8980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55844c61dd60 0x55844c61c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:02.484 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.477+0000 7fbfbfec8980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55844c5ae800 con 0x55844c61dd60 2024-09-13T06:11:02.484 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.477+0000 7fbfbd9d8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55844c61dd60 0x55844c61c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:02.484 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.477+0000 7fbfbd9d8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55844c61dd60 0x55844c61c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:54706/0 (socket says 172.21.15.194:54706) 2024-09-13T06:11:02.484 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.477+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/2685903942 learned_addr learned my addr 172.21.15.194:0/2685903942 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:02.484 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.477+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/2685903942 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55844c61e180 con 0x55844c61dd60 2024-09-13T06:11:02.484 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.477+0000 7fbfbd9d8640 1 --2- 172.21.15.194:0/2685903942 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55844c61dd60 0x55844c61c3e0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fbfb004a050 tx=0x7fbfb0041e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:02.484 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.477+0000 7fbea37fe640 1 -- 172.21.15.194:0/2685903942 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfb002c970 con 0x55844c61dd60 2024-09-13T06:11:02.486 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.477+0000 7fbea37fe640 1 -- 172.21.15.194:0/2685903942 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfb002cb10 con 0x55844c61dd60 2024-09-13T06:11:02.486 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.477+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2685903942 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55844c61c980 con 0x55844c61dd60 2024-09-13T06:11:02.486 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.481+0000 7fbea37fe640 1 -- 172.21.15.194:0/2685903942 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfb002a6f0 con 0x55844c61dd60 2024-09-13T06:11:02.486 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.481+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2685903942 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55844c61ce50 con 0x55844c61dd60 2024-09-13T06:11:02.486 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.481+0000 7fbea37fe640 1 -- 172.21.15.194:0/2685903942 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fbfb0036040 con 0x55844c61dd60 2024-09-13T06:11:02.486 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.481+0000 7fbea37fe640 1 --2- 172.21.15.194:0/2685903942 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fbe98034650 0x7fbe98036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:02.486 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.481+0000 7fbea37fe640 1 -- 172.21.15.194:0/2685903942 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fbfb0033040 con 0x55844c61dd60 2024-09-13T06:11:02.486 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.481+0000 7fbfbd1d7640 1 --2- 172.21.15.194:0/2685903942 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fbe98034650 0x7fbe98036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:02.487 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.481+0000 7fbfbfec8980 1 Processor -- start 2024-09-13T06:11:02.487 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.481+0000 7fbfbfec8980 1 -- start start 2024-09-13T06:11:02.487 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.481+0000 7fbfbd1d7640 1 --2- 172.21.15.194:0/2685903942 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fbe98034650 0x7fbe98036b10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fbfb40ae040 tx=0x7fbfb4005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:02.487 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.481+0000 7fbfbfec8980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55844c7c6720 0x55844c7c6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:02.487 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.481+0000 7fbfbfec8980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55844c793380 con 0x55844c7c6720 2024-09-13T06:11:02.487 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.481+0000 7fbfbd9d8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55844c7c6720 0x55844c7c6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:02.487 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.481+0000 7fbfbd9d8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55844c7c6720 0x55844c7c6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:54714/0 (socket says 172.21.15.194:54714) 2024-09-13T06:11:02.487 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.481+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/409272989 learned_addr learned my addr 172.21.15.194:0/409272989 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:02.487 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.481+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/409272989 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55844c7c70d0 con 0x55844c7c6720 2024-09-13T06:11:02.487 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.481+0000 7fbfbd9d8640 1 --2- 172.21.15.194:0/409272989 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55844c7c6720 0x55844c7c6b00 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fbfb003afd0 tx=0x7fbfb00373d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39015dc0ad5f9a90 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:02.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.481+0000 7fbea17fa640 1 -- 172.21.15.194:0/409272989 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfb005d020 con 0x55844c7c6720 2024-09-13T06:11:02.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.481+0000 7fbea17fa640 1 -- 172.21.15.194:0/409272989 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfb0038d50 con 0x55844c7c6720 2024-09-13T06:11:02.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.481+0000 7fbea17fa640 1 -- 172.21.15.194:0/409272989 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfb002a9c0 con 0x55844c7c6720 2024-09-13T06:11:02.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.481+0000 7fbfbfec8980 1 -- 172.21.15.194:0/409272989 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55844c7c6720 msgr2=0x55844c7c6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:02.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.481+0000 7fbfbfec8980 1 --2- 172.21.15.194:0/409272989 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55844c7c6720 0x55844c7c6b00 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fbfb003afd0 tx=0x7fbfb00373d0 comp rx=0 tx=0).stop 2024-09-13T06:11:02.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.481+0000 7fbfbfec8980 1 -- 172.21.15.194:0/409272989 shutdown_connections 2024-09-13T06:11:02.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.481+0000 7fbfbfec8980 1 --2- 172.21.15.194:0/409272989 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55844c7c6720 0x55844c7c6b00 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:02.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.481+0000 7fbfbfec8980 1 -- 172.21.15.194:0/409272989 >> 172.21.15.194:0/409272989 conn(0x55844c7c2b00 msgr2=0x55844c7c0c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:02.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.481+0000 7fbfbfec8980 1 -- 172.21.15.194:0/409272989 shutdown_connections 2024-09-13T06:11:02.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.481+0000 7fbfbfec8980 1 -- 172.21.15.194:0/409272989 wait complete. 2024-09-13T06:11:02.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.485+0000 7fbfbfec8980 1 Processor -- start 2024-09-13T06:11:02.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.485+0000 7fbfbfec8980 1 -- start start 2024-09-13T06:11:02.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.485+0000 7fbfbfec8980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55844c7c6720 0x55844c7cd860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:02.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.485+0000 7fbfbfec8980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55844c7c7570 con 0x55844c7c6720 2024-09-13T06:11:02.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.485+0000 7fbfbd9d8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55844c7c6720 0x55844c7cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:02.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.485+0000 7fbfbd9d8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55844c7c6720 0x55844c7cd860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:54722/0 (socket says 172.21.15.194:54722) 2024-09-13T06:11:02.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.485+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/2497557990 learned_addr learned my addr 172.21.15.194:0/2497557990 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:02.491 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.485+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55844c7cdda0 con 0x55844c7c6720 2024-09-13T06:11:02.491 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.485+0000 7fbfbd9d8640 1 --2- 172.21.15.194:0/2497557990 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55844c7c6720 0x55844c7cd860 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fbfb00472a0 tx=0x7fbfb0027f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:02.491 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.485+0000 7fbe8f7fe640 1 -- 172.21.15.194:0/2497557990 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfb0072070 con 0x55844c7c6720 2024-09-13T06:11:02.491 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.485+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55844c7cdda0 con 0x55844c7c6720 2024-09-13T06:11:02.491 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.485+0000 7fbe8f7fe640 1 -- 172.21.15.194:0/2497557990 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfb0041400 con 0x55844c7c6720 2024-09-13T06:11:02.491 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.485+0000 7fbe8f7fe640 1 -- 172.21.15.194:0/2497557990 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfb00416e0 con 0x55844c7c6720 2024-09-13T06:11:02.491 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.485+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55844c7cdda0 con 0x55844c7c6720 2024-09-13T06:11:02.495 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.485+0000 7fbe8f7fe640 1 -- 172.21.15.194:0/2497557990 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fbfb0075070 con 0x55844c7c6720 2024-09-13T06:11:02.495 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.485+0000 7fbe8f7fe640 1 --2- 172.21.15.194:0/2497557990 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fbe88034650 0x7fbe88036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:02.495 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.485+0000 7fbe8f7fe640 1 -- 172.21.15.194:0/2497557990 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fbfb006a070 con 0x55844c7c6720 2024-09-13T06:11:02.495 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.485+0000 7fbfbd1d7640 1 --2- 172.21.15.194:0/2497557990 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fbe88034650 0x7fbe88036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:02.495 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.485+0000 7fbfbfec8980 20 rados->read ofs=0 len=0 2024-09-13T06:11:02.495 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.485+0000 7fbfbfec8980 1 --2- 172.21.15.194:0/2497557990 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55844c7d8960 0x55844c7dae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:02.495 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.485+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55844c7db570 con 0x55844c7d8960 2024-09-13T06:11:02.495 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.485+0000 7fbfbe1d9640 1 --2- 172.21.15.194:0/2497557990 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55844c7d8960 0x55844c7dae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:02.495 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.485+0000 7fbfbd1d7640 1 --2- 172.21.15.194:0/2497557990 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fbe88034650 0x7fbe88036b10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4017e90 tx=0x7fbfb40b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:02.495 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.489+0000 7fbfbe1d9640 1 --2- 172.21.15.194:0/2497557990 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55844c7d8960 0x55844c7dae20 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:02.495 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.489+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbfb800a4d0 con 0x55844c7d8960 2024-09-13T06:11:02.496 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.489+0000 7fbfbfec8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:02.496 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.489+0000 7fbfbfec8980 20 realm 2024-09-13T06:11:02.496 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.489+0000 7fbfbfec8980 20 rados->read ofs=0 len=0 2024-09-13T06:11:02.496 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.489+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55844c7db980 con 0x55844c7d8960 2024-09-13T06:11:02.496 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.489+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbfb800a4d0 con 0x55844c7d8960 2024-09-13T06:11:02.496 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.489+0000 7fbfbfec8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:02.496 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.489+0000 7fbfbfec8980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:11:02.496 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.489+0000 7fbfbfec8980 20 rados->read ofs=0 len=0 2024-09-13T06:11:02.496 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.489+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55844c7dc250 con 0x55844c7d8960 2024-09-13T06:11:02.496 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.489+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbfb800a4d0 con 0x55844c7d8960 2024-09-13T06:11:02.496 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.489+0000 7fbfbfec8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:02.496 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.489+0000 7fbfbfec8980 20 rados->read ofs=0 len=0 2024-09-13T06:11:02.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.489+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55844c7dc5f0 con 0x55844c7d8960 2024-09-13T06:11:02.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.489+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbfb800a4d0 con 0x55844c7d8960 2024-09-13T06:11:02.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.489+0000 7fbfbfec8980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:11:02.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.489+0000 7fbfbfec8980 20 rados->read ofs=0 len=0 2024-09-13T06:11:02.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.489+0000 7fbfbfec8980 1 --2- 172.21.15.194:0/2497557990 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55844c7dd350 0x55844c7df740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:02.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.489+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55844c7dfd10 con 0x55844c7dd350 2024-09-13T06:11:02.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.489+0000 7fbfbd9d8640 1 --2- 172.21.15.194:0/2497557990 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55844c7dd350 0x55844c7df740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:02.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.489+0000 7fbfbd9d8640 1 --2- 172.21.15.194:0/2497557990 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55844c7dd350 0x55844c7df740 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:02.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.489+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/2497557990 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbfb0074030 con 0x55844c7dd350 2024-09-13T06:11:02.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.489+0000 7fbfbfec8980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:11:02.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.489+0000 7fbfbfec8980 20 searching for the correct realm 2024-09-13T06:11:02.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.489+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55844c7e15e0 con 0x55844c7dd350 2024-09-13T06:11:02.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.489+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/2497557990 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfb0074030 con 0x55844c7dd350 2024-09-13T06:11:02.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.489+0000 7fbfbd9d8640 1 --2- 172.21.15.194:0/2497557990 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fbfb0077060 0x7fbfb003e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:02.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.489+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55844c7e15e0 con 0x7fbfb0077060 2024-09-13T06:11:02.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.489+0000 7fbfbd1d7640 1 --2- 172.21.15.194:0/2497557990 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fbfb0077060 0x7fbfb003e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:02.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.489+0000 7fbfbd1d7640 1 --2- 172.21.15.194:0/2497557990 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fbfb0077060 0x7fbfb003e850 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:02.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.489+0000 7fbfbd1d7640 1 -- 172.21.15.194:0/2497557990 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fbfb40c9030 con 0x7fbfb0077060 2024-09-13T06:11:02.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.489+0000 7fbfbd1d7640 1 --2- 172.21.15.194:0/2497557990 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fbfb40dc040 0x7fbfb40dd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:02.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.489+0000 7fbfbd1d7640 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55844c7e15e0 con 0x7fbfb40dc040 2024-09-13T06:11:02.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.489+0000 7fbfbe1d9640 1 --2- 172.21.15.194:0/2497557990 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fbfb40dc040 0x7fbfb40dd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:02.500 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.493+0000 7fbfbe1d9640 1 --2- 172.21.15.194:0/2497557990 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fbfb40dc040 0x7fbfb40dd430 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:02.500 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.493+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfb800a4d0 con 0x7fbfb40dc040 2024-09-13T06:11:02.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.493+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55844c7dc5f0 con 0x55844c7d8960 2024-09-13T06:11:02.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.493+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfb800a4d0 con 0x55844c7d8960 2024-09-13T06:11:02.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.493+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55844c7dc5f0 con 0x55844c7d8960 2024-09-13T06:11:02.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.493+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfb800a4d0 con 0x55844c7d8960 2024-09-13T06:11:02.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.493+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55844c7dc5f0 con 0x7fbfb40dc040 2024-09-13T06:11:02.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.493+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfb800a4d0 con 0x7fbfb40dc040 2024-09-13T06:11:02.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.493+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55844c7dc5f0 con 0x7fbfb40dc040 2024-09-13T06:11:02.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.493+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfb800a4d0 con 0x7fbfb40dc040 2024-09-13T06:11:02.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.493+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55844c7dc5f0 con 0x7fbfb0077060 2024-09-13T06:11:02.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.493+0000 7fbfbd1d7640 1 -- 172.21.15.194:0/2497557990 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfb40c9030 con 0x7fbfb0077060 2024-09-13T06:11:02.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.493+0000 7fbfbd1d7640 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55844c7dc5f0 con 0x55844c7dd350 2024-09-13T06:11:02.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.493+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/2497557990 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfb0074030 con 0x55844c7dd350 2024-09-13T06:11:02.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.493+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55844c7dc5f0 con 0x55844c7d8960 2024-09-13T06:11:02.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.493+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfb800a4d0 con 0x55844c7d8960 2024-09-13T06:11:02.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.493+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55844c7dc5f0 con 0x7fbfb40dc040 2024-09-13T06:11:02.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.497+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfb800a4d0 con 0x7fbfb40dc040 2024-09-13T06:11:02.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.497+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55844c7dc5f0 con 0x55844c7d8960 2024-09-13T06:11:02.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.497+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfb800a4d0 con 0x55844c7d8960 2024-09-13T06:11:02.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.497+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55844c7dc5f0 con 0x7fbfb0077060 2024-09-13T06:11:02.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.497+0000 7fbfbd1d7640 1 -- 172.21.15.194:0/2497557990 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbfb40c9030 con 0x7fbfb0077060 2024-09-13T06:11:02.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.497+0000 7fbfbd1d7640 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55844c7dc5f0 con 0x55844c7dd350 2024-09-13T06:11:02.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.497+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/2497557990 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfb0074030 con 0x55844c7dd350 2024-09-13T06:11:02.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.497+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55844c7dc5f0 con 0x55844c7dd350 2024-09-13T06:11:02.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.497+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/2497557990 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfb0074030 con 0x55844c7dd350 2024-09-13T06:11:02.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.497+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55844c7dc5f0 con 0x7fbfb40dc040 2024-09-13T06:11:02.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.497+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfb800a4d0 con 0x7fbfb40dc040 2024-09-13T06:11:02.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.497+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55844c7dc5f0 con 0x55844c7dd350 2024-09-13T06:11:02.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.497+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/2497557990 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfb0074030 con 0x55844c7dd350 2024-09-13T06:11:02.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.497+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55844c7dc5f0 con 0x55844c7dd350 2024-09-13T06:11:02.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.497+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/2497557990 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfb0074030 con 0x55844c7dd350 2024-09-13T06:11:02.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.497+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55844c7dc5f0 con 0x55844c7d8960 2024-09-13T06:11:02.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.497+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfb800a4d0 con 0x55844c7d8960 2024-09-13T06:11:02.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.497+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55844c7dc5f0 con 0x55844c7d8960 2024-09-13T06:11:02.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.497+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbfb800a4d0 con 0x55844c7d8960 2024-09-13T06:11:02.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.497+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55844c7dc5f0 con 0x7fbfb0077060 2024-09-13T06:11:02.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.497+0000 7fbfbd1d7640 1 -- 172.21.15.194:0/2497557990 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfb40c9030 con 0x7fbfb0077060 2024-09-13T06:11:02.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.497+0000 7fbfbd1d7640 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55844c7dc5f0 con 0x55844c7dd350 2024-09-13T06:11:02.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.501+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/2497557990 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfb0074030 con 0x55844c7dd350 2024-09-13T06:11:02.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.501+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55844c7dc5f0 con 0x7fbfb0077060 2024-09-13T06:11:02.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.501+0000 7fbfbd1d7640 1 -- 172.21.15.194:0/2497557990 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfb40c9030 con 0x7fbfb0077060 2024-09-13T06:11:02.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.501+0000 7fbfbd1d7640 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55844c7dc5f0 con 0x55844c7d8960 2024-09-13T06:11:02.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.501+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfb800a4d0 con 0x55844c7d8960 2024-09-13T06:11:02.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.501+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55844c7dc5f0 con 0x7fbfb40dc040 2024-09-13T06:11:02.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.501+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfb800a4d0 con 0x7fbfb40dc040 2024-09-13T06:11:02.507 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.501+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55844c7dc5f0 con 0x55844c7dd350 2024-09-13T06:11:02.507 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.501+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/2497557990 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbfb0074030 con 0x55844c7dd350 2024-09-13T06:11:02.507 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.501+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55844c7dc5f0 con 0x7fbfb0077060 2024-09-13T06:11:02.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.501+0000 7fbfbd1d7640 1 -- 172.21.15.194:0/2497557990 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfb40c9030 con 0x7fbfb0077060 2024-09-13T06:11:02.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.501+0000 7fbfbd1d7640 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55844c7dc5f0 con 0x7fbfb0077060 2024-09-13T06:11:02.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.501+0000 7fbfbd1d7640 1 -- 172.21.15.194:0/2497557990 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfb40c9030 con 0x7fbfb0077060 2024-09-13T06:11:02.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.501+0000 7fbfbd1d7640 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55844c7dc5f0 con 0x55844c7dd350 2024-09-13T06:11:02.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.501+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/2497557990 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfb0074030 con 0x55844c7dd350 2024-09-13T06:11:02.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.501+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55844c7dc5f0 con 0x7fbfb40dc040 2024-09-13T06:11:02.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.501+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfb800a4d0 con 0x7fbfb40dc040 2024-09-13T06:11:02.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.501+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55844c7dc5f0 con 0x55844c7d8960 2024-09-13T06:11:02.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.501+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbfb800a4d0 con 0x55844c7d8960 2024-09-13T06:11:02.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.501+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55844c7dc5f0 con 0x7fbfb0077060 2024-09-13T06:11:02.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.501+0000 7fbfbd1d7640 1 -- 172.21.15.194:0/2497557990 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfb40c9030 con 0x7fbfb0077060 2024-09-13T06:11:02.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.501+0000 7fbfbfec8980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:11:02.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.501+0000 7fbfbfec8980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:11:02.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.501+0000 7fbfbfec8980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:11:02.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.501+0000 7fbfbfec8980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:11:02.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.501+0000 7fbfbfec8980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:11:02.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.501+0000 7fbfbfec8980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:11:02.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.501+0000 7fbfbfec8980 20 rados->read ofs=0 len=0 2024-09-13T06:11:02.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.501+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55844c7e06d0 con 0x55844c7d8960 2024-09-13T06:11:02.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.505+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbfb800a4d0 con 0x55844c7d8960 2024-09-13T06:11:02.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.505+0000 7fbfbfec8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:02.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.505+0000 7fbfbfec8980 20 rados->read ofs=0 len=0 2024-09-13T06:11:02.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.505+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55844c7e0310 con 0x55844c7d8960 2024-09-13T06:11:02.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.505+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbfb800a4d0 con 0x55844c7d8960 2024-09-13T06:11:02.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.505+0000 7fbfbfec8980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:11:02.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.505+0000 7fbfbfec8980 20 rados->read ofs=0 len=0 2024-09-13T06:11:02.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.505+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55844c7e0320 con 0x7fbfb0077060 2024-09-13T06:11:02.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.505+0000 7fbfbd1d7640 1 -- 172.21.15.194:0/2497557990 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbfb40c9030 con 0x7fbfb0077060 2024-09-13T06:11:02.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.505+0000 7fbfbfec8980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:11:02.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.505+0000 7fbfbfec8980 20 zone default found 2024-09-13T06:11:02.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.505+0000 7fbfbfec8980 4 Realm: () 2024-09-13T06:11:02.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.505+0000 7fbfbfec8980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:11:02.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.505+0000 7fbfbfec8980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:11:02.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.505+0000 7fbfbfec8980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:11:02.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.505+0000 7fbfbfec8980 20 zonegroup default 2024-09-13T06:11:02.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.505+0000 7fbfbfec8980 20 rados->read ofs=0 len=0 2024-09-13T06:11:02.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.505+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55844c7e15e0 con 0x7fbfb40dc040 2024-09-13T06:11:02.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.505+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbfb800a4d0 con 0x7fbfb40dc040 2024-09-13T06:11:02.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.505+0000 7fbfbfec8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:02.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.505+0000 7fbfbfec8980 20 rados->read ofs=0 len=0 2024-09-13T06:11:02.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.505+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55844c7e3490 con 0x55844c7dd350 2024-09-13T06:11:02.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.505+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/2497557990 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbfb0074030 con 0x55844c7dd350 2024-09-13T06:11:02.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.505+0000 7fbfbfec8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:02.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.505+0000 7fbfbfec8980 20 rados->read ofs=0 len=0 2024-09-13T06:11:02.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.505+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55844c7e3860 con 0x55844c7dd350 2024-09-13T06:11:02.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.505+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/2497557990 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbfb0074030 con 0x55844c7dd350 2024-09-13T06:11:02.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.505+0000 7fbfbfec8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:02.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.505+0000 7fbfbfec8980 20 started sync module instance, tier type = 2024-09-13T06:11:02.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.505+0000 7fbfbfec8980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:11:02.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.505+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c7e2930 con 0x7fbfb0077060 2024-09-13T06:11:02.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.505+0000 7fbfbd1d7640 1 -- 172.21.15.194:0/2497557990 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(44 notify.0 [create] v35'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfb40c9030 con 0x7fbfb0077060 2024-09-13T06:11:02.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.505+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94026707381536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c7e4170 con 0x7fbfb0077060 2024-09-13T06:11:02.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.505+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c7e49c0 con 0x55844c7d8960 2024-09-13T06:11:02.516 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.509+0000 7fbfbd1d7640 1 -- 172.21.15.194:0/2497557990 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94026707381536] v35'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfb40c9030 con 0x7fbfb0077060 2024-09-13T06:11:02.516 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.509+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v35'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfb800a4d0 con 0x55844c7d8960 2024-09-13T06:11:02.516 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.509+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94026707385536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c7e49c0 con 0x55844c7d8960 2024-09-13T06:11:02.516 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.509+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c7e5460 con 0x55844c7dd350 2024-09-13T06:11:02.516 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.509+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94026707385536] v35'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfb800a4d0 con 0x55844c7d8960 2024-09-13T06:11:02.516 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.513+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/2497557990 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v35'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfb0074030 con 0x55844c7dd350 2024-09-13T06:11:02.516 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.513+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94026707390256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c7e49c0 con 0x55844c7dd350 2024-09-13T06:11:02.516 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.513+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c7e5e70 con 0x7fbfb0077060 2024-09-13T06:11:02.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.513+0000 7fbfbd1d7640 1 -- 172.21.15.194:0/2497557990 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(50 notify.3 [create] v35'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfb40c9030 con 0x7fbfb0077060 2024-09-13T06:11:02.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.513+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94026707392960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c7e66c0 con 0x7fbfb0077060 2024-09-13T06:11:02.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.513+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c7e70c0 con 0x55844c7d8960 2024-09-13T06:11:02.518 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.513+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/2497557990 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94026707390256] v35'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfb0074030 con 0x55844c7dd350 2024-09-13T06:11:02.518 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.513+0000 7fbfbd1d7640 1 -- 172.21.15.194:0/2497557990 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94026707392960] v35'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfb40c9030 con 0x7fbfb0077060 2024-09-13T06:11:02.519 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.513+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v35'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfb800a4d0 con 0x55844c7d8960 2024-09-13T06:11:02.519 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.513+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94026707395088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c7e6bd0 con 0x55844c7d8960 2024-09-13T06:11:02.519 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.513+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c7e7960 con 0x7fbfb40dc040 2024-09-13T06:11:02.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.517+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94026707395088] v35'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfb800a4d0 con 0x55844c7d8960 2024-09-13T06:11:02.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.517+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(54 notify.5 [create] v35'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfb800a4d0 con 0x7fbfb40dc040 2024-09-13T06:11:02.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.517+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94026707387664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c7e78c0 con 0x7fbfb40dc040 2024-09-13T06:11:02.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.517+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c7e8190 con 0x7fbfb40dc040 2024-09-13T06:11:02.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.521+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94026707387664] v35'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfb800a4d0 con 0x7fbfb40dc040 2024-09-13T06:11:02.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.521+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(56 notify.6 [create] v35'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfb800a4d0 con 0x7fbfb40dc040 2024-09-13T06:11:02.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.521+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94026707399696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c7e8370 con 0x7fbfb40dc040 2024-09-13T06:11:02.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.521+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c7e8bc0 con 0x7fbfb40dc040 2024-09-13T06:11:02.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.521+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94026707399696] v35'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfb800a4d0 con 0x7fbfb40dc040 2024-09-13T06:11:02.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.521+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(58 notify.7 [create] v35'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfb800a4d0 con 0x7fbfb40dc040 2024-09-13T06:11:02.527 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.521+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94026707403632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c7e8c40 con 0x7fbfb40dc040 2024-09-13T06:11:02.527 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.521+0000 7fbfbfec8980 20 add_watcher() i=0 2024-09-13T06:11:02.527 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.521+0000 7fbfbfec8980 20 add_watcher() i=1 2024-09-13T06:11:02.527 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.521+0000 7fbfbfec8980 20 add_watcher() i=2 2024-09-13T06:11:02.527 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.521+0000 7fbfbfec8980 20 add_watcher() i=3 2024-09-13T06:11:02.527 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.521+0000 7fbfbfec8980 20 add_watcher() i=4 2024-09-13T06:11:02.527 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.521+0000 7fbfbfec8980 20 add_watcher() i=5 2024-09-13T06:11:02.527 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.521+0000 7fbfbfec8980 20 add_watcher() i=6 2024-09-13T06:11:02.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.525+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94026707403632] v35'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfb800a4d0 con 0x7fbfb40dc040 2024-09-13T06:11:02.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.525+0000 7fbfbfec8980 20 add_watcher() i=7 2024-09-13T06:11:02.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.525+0000 7fbfbfec8980 2 all 8 watchers are set, enabling cache 2024-09-13T06:11:02.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.525+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55844c7ebf70 con 0x55844c7d8960 2024-09-13T06:11:02.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.525+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbfb800a4d0 con 0x55844c7d8960 2024-09-13T06:11:02.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.525+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94026707417504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c7e8db0 con 0x55844c7d8960 2024-09-13T06:11:02.530 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.525+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94026707417504] v35'218 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbfb800a4d0 con 0x55844c7d8960 2024-09-13T06:11:02.530 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.525+0000 7fbe6f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:11:02.530 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.525+0000 7fbfbfec8980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:11:02.530 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.525+0000 7fbfbfec8980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:11:02.530 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.525+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c7eb310 con 0x55844c7d8960 2024-09-13T06:11:02.532 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.529+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v35'33 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbfb800a4d0 con 0x55844c7d8960 2024-09-13T06:11:02.532 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.529+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c7f50b0 con 0x7fbfb40dc040 2024-09-13T06:11:02.535 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.529+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v35'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbfb800a4d0 con 0x7fbfb40dc040 2024-09-13T06:11:02.535 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.529+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c7f54b0 con 0x55844c7dd350 2024-09-13T06:11:02.536 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.533+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/2497557990 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v35'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbfb0074030 con 0x55844c7dd350 2024-09-13T06:11:02.536 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.533+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c7f5480 con 0x55844c7d8960 2024-09-13T06:11:02.537 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.533+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v35'219 uv164 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbfb800a4d0 con 0x55844c7d8960 2024-09-13T06:11:02.537 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.533+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c7f5930 con 0x7fbfb0077060 2024-09-13T06:11:02.538 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.533+0000 7fbfbd1d7640 1 -- 172.21.15.194:0/2497557990 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v35'68 uv53 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbfb40c9030 con 0x7fbfb0077060 2024-09-13T06:11:02.538 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.533+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c7f46a0 con 0x55844c7dd350 2024-09-13T06:11:02.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.533+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/2497557990 <== osd.3 v2:172.21.15.194:6816/96632515 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v35'46 uv37 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbfb0074030 con 0x55844c7dd350 2024-09-13T06:11:02.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.533+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c7f46a0 con 0x55844c7d8960 2024-09-13T06:11:02.541 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.537+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v35'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbfb800a4d0 con 0x55844c7d8960 2024-09-13T06:11:02.541 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.537+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c7f46a0 con 0x7fbfb40dc040 2024-09-13T06:11:02.543 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.541+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v35'45 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbfb800a4d0 con 0x7fbfb40dc040 2024-09-13T06:11:02.543 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.541+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c7f46a0 con 0x7fbfb0077060 2024-09-13T06:11:02.545 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.541+0000 7fbfbd1d7640 1 -- 172.21.15.194:0/2497557990 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v35'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbfb40c9030 con 0x7fbfb0077060 2024-09-13T06:11:02.545 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.541+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c7f64e0 con 0x55844c7dd350 2024-09-13T06:11:02.546 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.541+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/2497557990 <== osd.3 v2:172.21.15.194:6816/96632515 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v35'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbfb0074030 con 0x55844c7dd350 2024-09-13T06:11:02.547 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.541+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c7f64e0 con 0x7fbfb0077060 2024-09-13T06:11:02.547 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.545+0000 7fbfbd1d7640 1 -- 172.21.15.194:0/2497557990 <== osd.2 v2:172.21.15.194:6800/815615585 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v35'69 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbfb40c9030 con 0x7fbfb0077060 2024-09-13T06:11:02.548 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.545+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c7f6a50 con 0x7fbfb40dc040 2024-09-13T06:11:02.550 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.545+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v35'31 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbfb800a4d0 con 0x7fbfb40dc040 2024-09-13T06:11:02.550 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.545+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c7f6a50 con 0x7fbfb0077060 2024-09-13T06:11:02.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.545+0000 7fbfbd1d7640 1 -- 172.21.15.194:0/2497557990 <== osd.2 v2:172.21.15.194:6800/815615585 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v35'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbfb40c9030 con 0x7fbfb0077060 2024-09-13T06:11:02.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.545+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c7f6d10 con 0x7fbfb40dc040 2024-09-13T06:11:02.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.549+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v35'51 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbfb800a4d0 con 0x7fbfb40dc040 2024-09-13T06:11:02.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.549+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c7f6d10 con 0x55844c7d8960 2024-09-13T06:11:02.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.549+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v35'220 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbfb800a4d0 con 0x55844c7d8960 2024-09-13T06:11:02.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.549+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c7f6d10 con 0x55844c7dd350 2024-09-13T06:11:02.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.553+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/2497557990 <== osd.3 v2:172.21.15.194:6816/96632515 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v35'62 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbfb0074030 con 0x55844c7dd350 2024-09-13T06:11:02.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.553+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c7f6d10 con 0x7fbfb0077060 2024-09-13T06:11:02.558 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.553+0000 7fbfbd1d7640 1 -- 172.21.15.194:0/2497557990 <== osd.2 v2:172.21.15.194:6800/815615585 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v35'70 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbfb40c9030 con 0x7fbfb0077060 2024-09-13T06:11:02.558 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.553+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c7f6d10 con 0x55844c7dd350 2024-09-13T06:11:02.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.553+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/2497557990 <== osd.3 v2:172.21.15.194:6816/96632515 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v35'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbfb0074030 con 0x55844c7dd350 2024-09-13T06:11:02.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.557+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c7f6d10 con 0x55844c7d8960 2024-09-13T06:11:02.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.557+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.1 v2:172.21.15.194:6808/3135444559 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v35'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbfb800a4d0 con 0x55844c7d8960 2024-09-13T06:11:02.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.557+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c7f6d10 con 0x55844c7d8960 2024-09-13T06:11:02.562 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.557+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.1 v2:172.21.15.194:6808/3135444559 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v35'221 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbfb800a4d0 con 0x55844c7d8960 2024-09-13T06:11:02.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.557+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c7f6d10 con 0x55844c7dd350 2024-09-13T06:11:02.564 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.561+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/2497557990 <== osd.3 v2:172.21.15.194:6816/96632515 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v35'63 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbfb0074030 con 0x55844c7dd350 2024-09-13T06:11:02.564 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.561+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c7f6d10 con 0x7fbfb0077060 2024-09-13T06:11:02.566 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.561+0000 7fbfbd1d7640 1 -- 172.21.15.194:0/2497557990 <== osd.2 v2:172.21.15.194:6800/815615585 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v35'36 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbfb40c9030 con 0x7fbfb0077060 2024-09-13T06:11:02.566 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.561+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c7f6d10 con 0x55844c7dd350 2024-09-13T06:11:02.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.561+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/2497557990 <== osd.3 v2:172.21.15.194:6816/96632515 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v35'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbfb0074030 con 0x55844c7dd350 2024-09-13T06:11:02.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.561+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c7f6d10 con 0x55844c7dd350 2024-09-13T06:11:02.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.565+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/2497557990 <== osd.3 v2:172.21.15.194:6816/96632515 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v35'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbfb0074030 con 0x55844c7dd350 2024-09-13T06:11:02.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.565+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c7f6d10 con 0x55844c7dd350 2024-09-13T06:11:02.569 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.565+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/2497557990 <== osd.3 v2:172.21.15.194:6816/96632515 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v35'22 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbfb0074030 con 0x55844c7dd350 2024-09-13T06:11:02.569 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.565+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c7f6d10 con 0x55844c7dd350 2024-09-13T06:11:02.571 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.565+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/2497557990 <== osd.3 v2:172.21.15.194:6816/96632515 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v35'47 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbfb0074030 con 0x55844c7dd350 2024-09-13T06:11:02.571 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.565+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c7f6d10 con 0x7fbfb40dc040 2024-09-13T06:11:02.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.569+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v35'30 uv25 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbfb800a4d0 con 0x7fbfb40dc040 2024-09-13T06:11:02.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.569+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c7f6d10 con 0x55844c7dd350 2024-09-13T06:11:02.574 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.569+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/2497557990 <== osd.3 v2:172.21.15.194:6816/96632515 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v35'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbfb0074030 con 0x55844c7dd350 2024-09-13T06:11:02.574 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.569+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c7f6d10 con 0x7fbfb40dc040 2024-09-13T06:11:02.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.573+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.0 v2:172.21.15.120:6800/1923744619 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v35'46 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbfb800a4d0 con 0x7fbfb40dc040 2024-09-13T06:11:02.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.573+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c7f6d10 con 0x55844c7dd350 2024-09-13T06:11:02.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.577+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/2497557990 <== osd.3 v2:172.21.15.194:6816/96632515 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v35'64 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbfb0074030 con 0x55844c7dd350 2024-09-13T06:11:02.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.577+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c7f6d10 con 0x7fbfb40dc040 2024-09-13T06:11:02.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.577+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.0 v2:172.21.15.120:6800/1923744619 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v35'52 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbfb800a4d0 con 0x7fbfb40dc040 2024-09-13T06:11:02.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.577+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c7f6d10 con 0x7fbfb0077060 2024-09-13T06:11:02.585 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.581+0000 7fbfbd1d7640 1 -- 172.21.15.194:0/2497557990 <== osd.2 v2:172.21.15.194:6800/815615585 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v35'33 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbfb40c9030 con 0x7fbfb0077060 2024-09-13T06:11:02.585 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.581+0000 7fbe6e7fc640 20 reqs_thread_entry: start 2024-09-13T06:11:02.585 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.581+0000 7fbfbfec8980 20 init_complete bucket index max shards: 11 2024-09-13T06:11:02.585 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.581+0000 7fbfbfec8980 20 Filter name: none 2024-09-13T06:11:02.585 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.581+0000 7fbfbfec8980 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-13T06:11:02.585 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.581+0000 7fbfbfec8980 20 rados->read ofs=0 len=0 2024-09-13T06:11:02.585 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.581+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55844c7f3a50 con 0x7fbfb0077060 2024-09-13T06:11:02.585 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.581+0000 7fbddffff640 20 reqs_thread_entry: start 2024-09-13T06:11:02.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.581+0000 7fbfbd1d7640 1 -- 172.21.15.194:0/2497557990 <== osd.2 v2:172.21.15.194:6800/815615585 21 ==== osd_op_reply(94 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fbfb40c9030 con 0x7fbfb0077060 2024-09-13T06:11:02.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.581+0000 7fbfbfec8980 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T06:11:02.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.581+0000 7fbfbfec8980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-09-13T06:11:02.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.581+0000 7fbfbfec8980 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-13T06:11:02.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.581+0000 7fbfbfec8980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:11:02.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.581+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:95 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55844c7f3560 con 0x55844c7d8960 2024-09-13T06:11:02.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.581+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.1 v2:172.21.15.194:6808/3135444559 27 ==== osd_op_reply(95 bud.buckets [call out=184b] v0'0 uv6 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7fbfb800a4d0 con 0x55844c7d8960 2024-09-13T06:11:02.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.581+0000 7fbfbfec8980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9 : miss 2024-09-13T06:11:02.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.581+0000 7fbfbfec8980 20 rados->read ofs=0 len=0 2024-09-13T06:11:02.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.581+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:96 8.17 8:ec7c4770:root::.bucket.meta.myfoo6%3a52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55844c8144a0 con 0x55844c7d8960 2024-09-13T06:11:02.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.581+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.1 v2:172.21.15.194:6808/3135444559 28 ==== osd_op_reply(96 .bucket.meta.myfoo6:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9 [call out=48b,stat out=16b,read 0~380 out=380b,getxattrs out=212b] v0'0 uv3 ondisk = 0) ==== 333+0+656 (crc 0 0 0) 0x7fbfb800a4d0 con 0x55844c7d8960 2024-09-13T06:11:02.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.581+0000 7fbfbfec8980 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T06:11:02.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.581+0000 7fbfbfec8980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9 info.flags=0x17 2024-09-13T06:11:02.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.581+0000 7fbfbfec8980 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9 to cache LRU end 2024-09-13T06:11:02.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.581+0000 7fbfbfec8980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:11:02.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.581+0000 7fbfbfec8980 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-13T06:11:02.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.581+0000 7fbfbfec8980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9 2024-09-13T06:11:02.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.581+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:97 4.2e 4:75804730:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55844c891a00 con 0x55844c7dd350 2024-09-13T06:11:02.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.581+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/2497557990 <== osd.3 v2:172.21.15.194:6816/96632515 27 ==== osd_op_reply(97 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbfb0074030 con 0x55844c7dd350 2024-09-13T06:11:02.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.581+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:98 4.15 4:ab610e56:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55844c891a00 con 0x55844c7dd350 2024-09-13T06:11:02.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.581+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/2497557990 <== osd.3 v2:172.21.15.194:6816/96632515 28 ==== osd_op_reply(98 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.1 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbfb0074030 con 0x55844c7dd350 2024-09-13T06:11:02.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.581+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:99 4.c 4:30a9cee7:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55844c891a40 con 0x55844c7d8960 2024-09-13T06:11:02.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.585+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.1 v2:172.21.15.194:6808/3135444559 29 ==== osd_op_reply(99 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.2 [call out=85b] v0'0 uv8 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbfb800a4d0 con 0x55844c7d8960 2024-09-13T06:11:02.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.585+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:100 4.7 4:e101f005:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55844c891a40 con 0x7fbfb40dc040 2024-09-13T06:11:02.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.585+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.0 v2:172.21.15.120:6800/1923744619 22 ==== osd_op_reply(100 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.3 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbfb800a4d0 con 0x7fbfb40dc040 2024-09-13T06:11:02.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.585+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:101 4.25 4:a556f372:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55844c891a40 con 0x55844c7dd350 2024-09-13T06:11:02.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.585+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/2497557990 <== osd.3 v2:172.21.15.194:6816/96632515 29 ==== osd_op_reply(101 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.4 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbfb0074030 con 0x55844c7dd350 2024-09-13T06:11:02.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.585+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:102 4.2e 4:761e8ed3:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55844c891a40 con 0x55844c7dd350 2024-09-13T06:11:02.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.585+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/2497557990 <== osd.3 v2:172.21.15.194:6816/96632515 30 ==== osd_op_reply(102 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.5 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbfb0074030 con 0x55844c7dd350 2024-09-13T06:11:02.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.585+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:103 4.2a 4:552f7067:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55844c8919c0 con 0x55844c7d8960 2024-09-13T06:11:02.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.585+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.1 v2:172.21.15.194:6808/3135444559 30 ==== osd_op_reply(103 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.6 [call out=85b] v0'0 uv8 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbfb800a4d0 con 0x55844c7d8960 2024-09-13T06:11:02.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.585+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:104 4.b 4:d2d4b7d4:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55844c8919c0 con 0x7fbfb0077060 2024-09-13T06:11:02.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.585+0000 7fbfbd1d7640 1 -- 172.21.15.194:0/2497557990 <== osd.2 v2:172.21.15.194:6800/815615585 22 ==== osd_op_reply(104 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbfb40c9030 con 0x7fbfb0077060 2024-09-13T06:11:02.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.585+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:105 4.28 4:15c9a3e4:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55844c8919c0 con 0x55844c7d8960 2024-09-13T06:11:02.592 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.585+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.1 v2:172.21.15.194:6808/3135444559 31 ==== osd_op_reply(105 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.8 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbfb800a4d0 con 0x55844c7d8960 2024-09-13T06:11:02.592 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.585+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:106 4.1e 4:78fdad3c:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55844c891980 con 0x7fbfb40dc040 2024-09-13T06:11:02.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.589+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.0 v2:172.21.15.120:6800/1923744619 23 ==== osd_op_reply(106 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.9 [call out=345b] v0'0 uv5 ondisk = 0) ==== 194+0+345 (crc 0 0 0) 0x7fbfb800a4d0 con 0x7fbfb40dc040 2024-09-13T06:11:02.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.589+0000 7fbfbfec8980 10 cls_bucket_list_unordered: got thirteen 2024-09-13T06:11:02.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.589+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:107 4.12 4:48ab5582:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55844c891980 con 0x55844c7d8960 2024-09-13T06:11:02.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.589+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.1 v2:172.21.15.194:6808/3135444559 32 ==== osd_op_reply(107 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.10 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fbfb800a4d0 con 0x55844c7d8960 2024-09-13T06:11:02.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.589+0000 7fbfbfec8980 20 get_obj_state: octx=0x7fbfb40d2040 obj=myfoo6:thirteen state=0x55844c88fa68 s->prefetch_data=0 2024-09-13T06:11:02.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.589+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:108 3.8s0 3:100047b6:::52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55844c890890 con 0x55844c7dd350 2024-09-13T06:11:02.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.589+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/2497557990 <== osd.3 v2:172.21.15.194:6816/96632515 31 ==== osd_op_reply(108 52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9_thirteen [getxattrs out=819b,stat out=16b] v0'0 uv4 ondisk = 0) ==== 238+0+835 (crc 0 0 0) 0x7fbfb0097350 con 0x55844c7dd350 2024-09-13T06:11:02.594 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.589+0000 7fbfbfec8980 10 manifest: total_size = 8 2024-09-13T06:11:02.594 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.589+0000 7fbfbfec8980 20 get_obj_state: setting s->obj_tag to _n3XyDIorjixwc1ATr315u3cZ4BfYaQ0 2024-09-13T06:11:02.594 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.589+0000 7fbfbfec8980 20 get_obj_state: octx=0x7fbfb40d2040 obj=myfoo6:thirteen state=0x55844c88fa68 s->prefetch_data=0 2024-09-13T06:11:02.594 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.589+0000 7fbfbfec8980 20 prepare_atomic_modification: state is not atomic. state=0x55844c88fa68 2024-09-13T06:11:02.594 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.589+0000 7fbfbfec8980 20 bucket index object: :.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.9 2024-09-13T06:11:02.594 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.589+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:109 4.1e 4:78fdad3c:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c891150 con 0x7fbfb40dc040 2024-09-13T06:11:02.594 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.589+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.0 v2:172.21.15.120:6800/1923744619 24 ==== osd_op_reply(109 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.9 [stat,call,call] v35'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fbfb800a4d0 con 0x7fbfb40dc040 2024-09-13T06:11:02.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.589+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:110 3.8s0 3:100047b6:::52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9_thirteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c891150 con 0x55844c7dd350 2024-09-13T06:11:02.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.593+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/2497557990 <== osd.3 v2:172.21.15.194:6816/96632515 32 ==== osd_op_reply(110 52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9_thirteen [call] v35'5 uv5 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7fbfb0097350 con 0x55844c7dd350 2024-09-13T06:11:02.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.593+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:111 4.1e 4:78fdad3c:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=264b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c8910a0 con 0x7fbfb40dc040 2024-09-13T06:11:02.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.593+0000 7fbfbfec8980 20 list_objects_ordered: starting attempt 1 2024-09-13T06:11:02.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.593+0000 7fbfbfec8980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-13T06:11:02.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.593+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:112 4.2e 4:75804730:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55844c8910a0 con 0x55844c7dd350 2024-09-13T06:11:02.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.593+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:113 4.15 4:ab610e56:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55844c81cf80 con 0x55844c7dd350 2024-09-13T06:11:02.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.593+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:114 4.c 4:30a9cee7:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55844c8910a0 con 0x55844c7d8960 2024-09-13T06:11:02.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.593+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:115 4.7 4:e101f005:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55844c8910a0 con 0x7fbfb40dc040 2024-09-13T06:11:02.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.593+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:116 4.25 4:a556f372:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55844c824230 con 0x55844c7dd350 2024-09-13T06:11:02.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.593+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:117 4.2e 4:761e8ed3:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55844c826b90 con 0x55844c7dd350 2024-09-13T06:11:02.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.593+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/2497557990 <== osd.3 v2:172.21.15.194:6816/96632515 33 ==== osd_op_reply(112 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbfb0097350 con 0x55844c7dd350 2024-09-13T06:11:02.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.593+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.1 v2:172.21.15.194:6808/3135444559 33 ==== osd_op_reply(114 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.2 [call out=85b] v0'0 uv8 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbfb800a4d0 con 0x55844c7d8960 2024-09-13T06:11:02.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.593+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:118 4.2a 4:552f7067:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55844c81d3c0 con 0x55844c7d8960 2024-09-13T06:11:02.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.593+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/2497557990 <== osd.3 v2:172.21.15.194:6816/96632515 34 ==== osd_op_reply(113 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.1 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbfb0097350 con 0x55844c7dd350 2024-09-13T06:11:02.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.593+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:119 4.b 4:d2d4b7d4:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55844c81ef30 con 0x7fbfb0077060 2024-09-13T06:11:02.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.593+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/2497557990 <== osd.3 v2:172.21.15.194:6816/96632515 35 ==== osd_op_reply(116 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.4 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbfb0097350 con 0x55844c7dd350 2024-09-13T06:11:02.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.593+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:120 4.28 4:15c9a3e4:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55844c822d70 con 0x55844c7d8960 2024-09-13T06:11:02.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.593+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:121 4.1e 4:78fdad3c:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55844c822d70 con 0x7fbfb40dc040 2024-09-13T06:11:02.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.593+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:122 4.12 4:48ab5582:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55844c81d3c0 con 0x55844c7d8960 2024-09-13T06:11:02.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.593+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/2497557990 <== osd.3 v2:172.21.15.194:6816/96632515 36 ==== osd_op_reply(117 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.5 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbfb0097350 con 0x55844c7dd350 2024-09-13T06:11:02.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.593+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.0 v2:172.21.15.120:6800/1923744619 25 ==== osd_op_reply(115 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.3 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbfb800a4d0 con 0x7fbfb40dc040 2024-09-13T06:11:02.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.593+0000 7fbfbd1d7640 1 -- 172.21.15.194:0/2497557990 <== osd.2 v2:172.21.15.194:6800/815615585 23 ==== osd_op_reply(119 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbfb40c9030 con 0x7fbfb0077060 2024-09-13T06:11:02.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.593+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.1 v2:172.21.15.194:6808/3135444559 34 ==== osd_op_reply(118 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.6 [call out=85b] v0'0 uv8 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbfb800a4d0 con 0x55844c7d8960 2024-09-13T06:11:02.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.593+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.1 v2:172.21.15.194:6808/3135444559 35 ==== osd_op_reply(120 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.8 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbfb800a4d0 con 0x55844c7d8960 2024-09-13T06:11:02.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.593+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.1 v2:172.21.15.194:6808/3135444559 36 ==== osd_op_reply(122 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.10 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fbfb800a4d0 con 0x55844c7d8960 2024-09-13T06:11:02.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.593+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.0 v2:172.21.15.120:6800/1923744619 26 ==== osd_op_reply(111 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.9 [stat,call,call] v35'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fbfb800a4d0 con 0x7fbfb40dc040 2024-09-13T06:11:02.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.593+0000 7fbea17fa640 20 handle_completion(): completion ok for obj=thirteen 2024-09-13T06:11:02.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.597+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.0 v2:172.21.15.120:6800/1923744619 27 ==== osd_op_reply(121 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.9 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fbfb800a4d0 con 0x7fbfb40dc040 2024-09-13T06:11:02.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.597+0000 7fbfbfec8980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-13T06:11:02.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.597+0000 7fbfbfec8980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-13T06:11:02.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.597+0000 7fbfbfec8980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-13T06:11:02.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.597+0000 7fbfbfec8980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-13T06:11:02.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.597+0000 7fbfbfec8980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo6[52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9])"; uploads.size()=0; is_truncated=0 2024-09-13T06:11:02.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.597+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:123 4.2e 4:75804730:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55844c81e880 con 0x55844c7dd350 2024-09-13T06:11:02.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.597+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:124 4.15 4:ab610e56:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55844c81f720 con 0x55844c7dd350 2024-09-13T06:11:02.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.597+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:125 4.c 4:30a9cee7:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55844c822020 con 0x55844c7d8960 2024-09-13T06:11:02.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.597+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:126 4.7 4:e101f005:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55844c822900 con 0x7fbfb40dc040 2024-09-13T06:11:02.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.597+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:127 4.25 4:a556f372:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55844c81f720 con 0x55844c7dd350 2024-09-13T06:11:02.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.597+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:128 4.2e 4:761e8ed3:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55844c81f720 con 0x55844c7dd350 2024-09-13T06:11:02.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.597+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:129 4.2a 4:552f7067:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55844c822900 con 0x55844c7d8960 2024-09-13T06:11:02.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.597+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:130 4.b 4:d2d4b7d4:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55844c822020 con 0x7fbfb0077060 2024-09-13T06:11:02.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.597+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:131 4.28 4:15c9a3e4:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55844c822020 con 0x55844c7d8960 2024-09-13T06:11:02.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.597+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.1 v2:172.21.15.194:6808/3135444559 37 ==== osd_op_reply(125 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.2 [call out=85b] v0'0 uv8 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbfb800a4d0 con 0x55844c7d8960 2024-09-13T06:11:02.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.597+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:132 4.1e 4:78fdad3c:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55844c81f720 con 0x7fbfb40dc040 2024-09-13T06:11:02.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.597+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:133 4.12 4:48ab5582:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55844c82ee40 con 0x55844c7d8960 2024-09-13T06:11:02.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.597+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.1 v2:172.21.15.194:6808/3135444559 38 ==== osd_op_reply(129 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.6 [call out=85b] v0'0 uv8 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbfb800a4d0 con 0x55844c7d8960 2024-09-13T06:11:02.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.597+0000 7fbfbd1d7640 1 -- 172.21.15.194:0/2497557990 <== osd.2 v2:172.21.15.194:6800/815615585 24 ==== osd_op_reply(130 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbfb40c9030 con 0x7fbfb0077060 2024-09-13T06:11:02.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.597+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.1 v2:172.21.15.194:6808/3135444559 39 ==== osd_op_reply(131 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.8 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbfb800a4d0 con 0x55844c7d8960 2024-09-13T06:11:02.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.597+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.1 v2:172.21.15.194:6808/3135444559 40 ==== osd_op_reply(133 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.10 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fbfb800a4d0 con 0x55844c7d8960 2024-09-13T06:11:02.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.597+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/2497557990 <== osd.3 v2:172.21.15.194:6816/96632515 37 ==== osd_op_reply(123 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbfb0097350 con 0x55844c7dd350 2024-09-13T06:11:02.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.597+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.0 v2:172.21.15.120:6800/1923744619 28 ==== osd_op_reply(126 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.3 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbfb800a4d0 con 0x7fbfb40dc040 2024-09-13T06:11:02.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.597+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/2497557990 <== osd.3 v2:172.21.15.194:6816/96632515 38 ==== osd_op_reply(124 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.1 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbfb0097350 con 0x55844c7dd350 2024-09-13T06:11:02.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.597+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/2497557990 <== osd.3 v2:172.21.15.194:6816/96632515 39 ==== osd_op_reply(127 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.4 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbfb0097350 con 0x55844c7dd350 2024-09-13T06:11:02.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.597+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/2497557990 <== osd.3 v2:172.21.15.194:6816/96632515 40 ==== osd_op_reply(128 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.5 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbfb0097350 con 0x55844c7dd350 2024-09-13T06:11:02.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.597+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.0 v2:172.21.15.120:6800/1923744619 29 ==== osd_op_reply(132 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.9 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fbfb800a4d0 con 0x7fbfb40dc040 2024-09-13T06:11:02.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.597+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:134 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c81e820 con 0x55844c7d8960 2024-09-13T06:11:02.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.597+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.1 v2:172.21.15.194:6808/3135444559 41 ==== osd_op_reply(134 bud.buckets [call] v35'7 uv7 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fbfb800a4d0 con 0x55844c7d8960 2024-09-13T06:11:02.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.597+0000 7fbfbfec8980 10 cache get: name=default.rgw.meta+root+myfoo6 : miss 2024-09-13T06:11:02.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.597+0000 7fbfbfec8980 20 rados->read ofs=0 len=0 2024-09-13T06:11:02.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.597+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:135 8.18 8:1944a257:root::myfoo6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55844c822220 con 0x55844c7d8960 2024-09-13T06:11:02.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.597+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.1 v2:172.21.15.194:6808/3135444559 42 ==== osd_op_reply(135 myfoo6 [call out=48b,read 0~166 out=166b] v0'0 uv25 ondisk = 0) ==== 192+0+214 (crc 0 0 0) 0x7fbfb800a4d0 con 0x55844c7d8960 2024-09-13T06:11:02.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.597+0000 7fbfbfec8980 20 rados_obj.operate() r=0 bl.length=166 2024-09-13T06:11:02.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.597+0000 7fbfbfec8980 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x11 2024-09-13T06:11:02.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.597+0000 7fbfbfec8980 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-13T06:11:02.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.597+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:136 8.18 8:1944a257:root::myfoo6:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c81e370 con 0x55844c7d8960 2024-09-13T06:11:02.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.601+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.1 v2:172.21.15.194:6808/3135444559 43 ==== osd_op_reply(136 myfoo6 [call,call,delete] v35'26 uv26 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7fbfb800a4d0 con 0x55844c7d8960 2024-09-13T06:11:02.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.601+0000 7fbfbfec8980 10 removing default.rgw.meta+root+myfoo6 from cache 2024-09-13T06:11:02.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.601+0000 7fbfbfec8980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-09-13T06:11:02.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.601+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94026707626240 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55844c824550 con 0x7fbfb0077060 2024-09-13T06:11:02.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.601+0000 7fbfbd1d7640 1 -- 172.21.15.194:0/2497557990 <== osd.2 v2:172.21.15.194:6800/815615585 25 ==== watch-notify(notify (1) cookie 94026707392960 notify 150323855377 ret 0) ==== 192+0+0 (crc 0 0 0) 0x55844c7f43c0 con 0x7fbfb0077060 2024-09-13T06:11:02.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.601+0000 7fbea0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855377 cookie 94026707392960 notifier 4752 bl.length()=150 2024-09-13T06:11:02.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.601+0000 7fbea0ff9640 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fbde80032d0 con 0x7fbfb0077060 2024-09-13T06:11:02.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.601+0000 7fbfbd1d7640 1 -- 172.21.15.194:0/2497557990 <== osd.2 v2:172.21.15.194:6800/815615585 26 ==== osd_op_reply(137 notify.3 [notify cookie 94026707626240 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbfb40c9030 con 0x7fbfb0077060 2024-09-13T06:11:02.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.601+0000 7fbfbd1d7640 1 -- 172.21.15.194:0/2497557990 <== osd.2 v2:172.21.15.194:6800/815615585 27 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfb40c9030 con 0x7fbfb0077060 2024-09-13T06:11:02.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.601+0000 7fbfbd1d7640 1 -- 172.21.15.194:0/2497557990 <== osd.2 v2:172.21.15.194:6800/815615585 28 ==== watch-notify(notify_complete (2) cookie 94026707626240 notify 150323855377 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55844c7f4020 con 0x7fbfb0077060 2024-09-13T06:11:02.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.601+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:139 8.17 8:ec7c4770:root::.bucket.meta.myfoo6%3a52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c81e900 con 0x55844c7d8960 2024-09-13T06:11:02.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.601+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.1 v2:172.21.15.194:6808/3135444559 44 ==== osd_op_reply(139 .bucket.meta.myfoo6:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9 [call,call,delete] v35'4 uv4 ondisk = 0) ==== 291+0+0 (crc 0 0 0) 0x7fbfb800a4d0 con 0x55844c7d8960 2024-09-13T06:11:02.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.601+0000 7fbfbfec8980 10 removing default.rgw.meta+root+.bucket.meta.myfoo6:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9 from cache 2024-09-13T06:11:02.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.601+0000 7fbfbfec8980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo6:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9, ofs0, ns] 2024-09-13T06:11:02.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.601+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:140 7.15 7:a93a5511:::notify.2:head [notify cookie 94026707582320 in=219b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55844c81e900 con 0x55844c7dd350 2024-09-13T06:11:02.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.601+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/2497557990 <== osd.3 v2:172.21.15.194:6816/96632515 41 ==== watch-notify(notify (1) cookie 94026707390256 notify 150323855376 ret 0) ==== 249+0+0 (crc 0 0 0) 0x55844c7f41f0 con 0x55844c7dd350 2024-09-13T06:11:02.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.601+0000 7fbea17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855376 cookie 94026707390256 notifier 4752 bl.length()=207 2024-09-13T06:11:02.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.601+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/2497557990 <== osd.3 v2:172.21.15.194:6816/96632515 42 ==== osd_op_reply(140 notify.2 [notify cookie 94026707582320 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbfb0097350 con 0x55844c7dd350 2024-09-13T06:11:02.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.601+0000 7fbea17fa640 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:141 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fbe80003d70 con 0x55844c7dd350 2024-09-13T06:11:02.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.601+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/2497557990 <== osd.3 v2:172.21.15.194:6816/96632515 43 ==== osd_op_reply(141 notify.2 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfb0097350 con 0x55844c7dd350 2024-09-13T06:11:02.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.601+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/2497557990 <== osd.3 v2:172.21.15.194:6816/96632515 44 ==== watch-notify(notify_complete (2) cookie 94026707582320 notify 150323855376 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55844c61e180 con 0x55844c7dd350 2024-09-13T06:11:02.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.601+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:142 4.2e 4:75804730:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c81e900 con 0x55844c7dd350 2024-09-13T06:11:02.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.601+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:143 4.15 4:ab610e56:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c812e80 con 0x55844c7dd350 2024-09-13T06:11:02.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.601+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:144 4.c 4:30a9cee7:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c823120 con 0x55844c7d8960 2024-09-13T06:11:02.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.601+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:145 4.7 4:e101f005:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c81e900 con 0x7fbfb40dc040 2024-09-13T06:11:02.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.601+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:146 4.25 4:a556f372:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c812e80 con 0x55844c7dd350 2024-09-13T06:11:02.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.601+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:147 4.2e 4:761e8ed3:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c823120 con 0x55844c7dd350 2024-09-13T06:11:02.614 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.601+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:148 4.2a 4:552f7067:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c812e80 con 0x55844c7d8960 2024-09-13T06:11:02.614 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.601+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:149 4.b 4:d2d4b7d4:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c81e900 con 0x7fbfb0077060 2024-09-13T06:11:02.614 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.601+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:150 4.28 4:15c9a3e4:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c823120 con 0x55844c7d8960 2024-09-13T06:11:02.614 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.605+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:151 4.1e 4:78fdad3c:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c81e900 con 0x7fbfb40dc040 2024-09-13T06:11:02.614 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.605+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:152 4.12 4:48ab5582:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c812e80 con 0x55844c7d8960 2024-09-13T06:11:02.614 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.605+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.1 v2:172.21.15.194:6808/3135444559 45 ==== osd_op_reply(144 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.2 [delete] v35'9 uv9 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fbfb800a4d0 con 0x55844c7d8960 2024-09-13T06:11:02.614 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.605+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.1 v2:172.21.15.194:6808/3135444559 46 ==== osd_op_reply(148 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.6 [delete] v35'9 uv9 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fbfb800a4d0 con 0x55844c7d8960 2024-09-13T06:11:02.614 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.605+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/2497557990 <== osd.3 v2:172.21.15.194:6816/96632515 45 ==== osd_op_reply(142 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.0 [delete] v35'3 uv3 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fbfb0097350 con 0x55844c7dd350 2024-09-13T06:11:02.614 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.605+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/2497557990 <== osd.3 v2:172.21.15.194:6816/96632515 46 ==== osd_op_reply(147 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.5 [delete] v35'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fbfb0097350 con 0x55844c7dd350 2024-09-13T06:11:02.614 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.605+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.0 v2:172.21.15.120:6800/1923744619 30 ==== osd_op_reply(145 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.3 [delete] v35'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fbfb800a4d0 con 0x7fbfb40dc040 2024-09-13T06:11:02.614 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.605+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.1 v2:172.21.15.194:6808/3135444559 47 ==== osd_op_reply(152 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.10 [delete] v35'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fbfb800a4d0 con 0x55844c7d8960 2024-09-13T06:11:02.614 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.605+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/2497557990 <== osd.3 v2:172.21.15.194:6816/96632515 47 ==== osd_op_reply(143 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.1 [delete] v35'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fbfb0097350 con 0x55844c7dd350 2024-09-13T06:11:02.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.605+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/2497557990 <== osd.3 v2:172.21.15.194:6816/96632515 48 ==== osd_op_reply(146 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.4 [delete] v35'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fbfb0097350 con 0x55844c7dd350 2024-09-13T06:11:02.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.605+0000 7fbfbd1d7640 1 -- 172.21.15.194:0/2497557990 <== osd.2 v2:172.21.15.194:6800/815615585 29 ==== osd_op_reply(149 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.7 [delete] v35'5 uv5 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fbfb40c9030 con 0x7fbfb0077060 2024-09-13T06:11:02.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.605+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.1 v2:172.21.15.194:6808/3135444559 48 ==== osd_op_reply(150 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.8 [delete] v35'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fbfb800a4d0 con 0x55844c7d8960 2024-09-13T06:11:02.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.605+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.0 v2:172.21.15.120:6800/1923744619 31 ==== osd_op_reply(151 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9.9 [delete] v35'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fbfb800a4d0 con 0x7fbfb40dc040 2024-09-13T06:11:02.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.605+0000 7fbfbfec8980 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo6/52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9 : miss 2024-09-13T06:11:02.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.605+0000 7fbfbfec8980 20 rados->read ofs=0 len=0 2024-09-13T06:11:02.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.605+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:153 6.1 6:83d098bc:::pubsub..bucket.myfoo6%2f52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55844c8129d0 con 0x55844c7d8960 2024-09-13T06:11:02.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.605+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.1 v2:172.21.15.194:6808/3135444559 49 ==== osd_op_reply(153 pubsub..bucket.myfoo6/52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7fbfb800a4d0 con 0x55844c7d8960 2024-09-13T06:11:02.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.605+0000 7fbfbfec8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:02.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.605+0000 7fbfbfec8980 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo6/52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9 info.flags=0x0 2024-09-13T06:11:02.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.605+0000 7fbfbfec8980 10 adding default.rgw.log++pubsub..bucket.myfoo6/52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9 to cache LRU end 2024-09-13T06:11:02.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.605+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:154 6.1 6:83d098bc:::pubsub..bucket.myfoo6%2f52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c8129d0 con 0x55844c7d8960 2024-09-13T06:11:02.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.609+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.1 v2:172.21.15.194:6808/3135444559 50 ==== osd_op_reply(154 pubsub..bucket.myfoo6/52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.9 [delete] v35'15 uv14 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7fbfb800a4d0 con 0x55844c7d8960 2024-09-13T06:11:02.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.609+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:155 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c81e370 con 0x55844c7d8960 2024-09-13T06:11:02.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.609+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.1 v2:172.21.15.194:6808/3135444559 51 ==== osd_op_reply(155 bud.buckets [call] v35'8 uv8 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fbfb800a4d0 con 0x55844c7d8960 2024-09-13T06:11:02.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.609+0000 7fbfbfec8980 10 removing key index: NX5QOQKC6BH2IDN8HC7A 2024-09-13T06:11:02.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.609+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:156 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c812320 con 0x55844c7d8960 2024-09-13T06:11:02.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.609+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.1 v2:172.21.15.194:6808/3135444559 52 ==== osd_op_reply(156 NX5QOQKC6BH2IDN8HC7A [delete] v35'3 uv3 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fbfb800a4d0 con 0x55844c7d8960 2024-09-13T06:11:02.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.609+0000 7fbfbfec8980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-13T06:11:02.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.609+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:157 7.3 7:c609908c:::notify.5:head [notify cookie 94026707582192 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55844c81e370 con 0x7fbfb40dc040 2024-09-13T06:11:02.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.609+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.0 v2:172.21.15.120:6800/1923744619 32 ==== watch-notify(notify (1) cookie 94026707387664 notify 150323855399 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55844c8139e0 con 0x7fbfb40dc040 2024-09-13T06:11:02.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.609+0000 7fbea17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855399 cookie 94026707387664 notifier 4752 bl.length()=170 2024-09-13T06:11:02.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.609+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.0 v2:172.21.15.120:6800/1923744619 33 ==== osd_op_reply(157 notify.5 [notify cookie 94026707582192 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbfb800a4d0 con 0x7fbfb40dc040 2024-09-13T06:11:02.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.609+0000 7fbea17fa640 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:158 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fbe80003d70 con 0x7fbfb40dc040 2024-09-13T06:11:02.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.613+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.0 v2:172.21.15.120:6800/1923744619 34 ==== osd_op_reply(158 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfb800a4d0 con 0x7fbfb40dc040 2024-09-13T06:11:02.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.613+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.0 v2:172.21.15.120:6800/1923744619 35 ==== watch-notify(notify_complete (2) cookie 94026707582192 notify 150323855399 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55844c7eb4e0 con 0x7fbfb40dc040 2024-09-13T06:11:02.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.613+0000 7fbfbfec8980 10 removing email index: 2024-09-13T06:11:02.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.613+0000 7fbfbfec8980 10 removing user buckets index 2024-09-13T06:11:02.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.613+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:159 8.19 8:99adfd5d:users.uid::bud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c812320 con 0x55844c7d8960 2024-09-13T06:11:02.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.613+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.1 v2:172.21.15.194:6808/3135444559 53 ==== osd_op_reply(159 bud.buckets [delete] v35'9 uv9 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fbfb800a4d0 con 0x55844c7d8960 2024-09-13T06:11:02.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.613+0000 7fbfbfec8980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:bud.buckets, ofs0, ns] 2024-09-13T06:11:02.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.613+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94026707582192 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55844c81e370 con 0x7fbfb40dc040 2024-09-13T06:11:02.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.613+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.0 v2:172.21.15.120:6800/1923744619 36 ==== watch-notify(notify (1) cookie 94026707399696 notify 150323855400 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55844c7eb4e0 con 0x7fbfb40dc040 2024-09-13T06:11:02.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.613+0000 7fbea17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855400 cookie 94026707399696 notifier 4752 bl.length()=160 2024-09-13T06:11:02.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.613+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.0 v2:172.21.15.120:6800/1923744619 37 ==== osd_op_reply(160 notify.6 [notify cookie 94026707582192 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbfb800a4d0 con 0x7fbfb40dc040 2024-09-13T06:11:02.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.613+0000 7fbea17fa640 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fbe80003d70 con 0x7fbfb40dc040 2024-09-13T06:11:02.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.613+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.0 v2:172.21.15.120:6800/1923744619 38 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfb800a4d0 con 0x7fbfb40dc040 2024-09-13T06:11:02.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.613+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.0 v2:172.21.15.120:6800/1923744619 39 ==== watch-notify(notify_complete (2) cookie 94026707582192 notify 150323855400 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55844c7eb2d0 con 0x7fbfb40dc040 2024-09-13T06:11:02.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.613+0000 7fbfbfec8980 10 removing user index: bud 2024-09-13T06:11:02.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.613+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:162 8.4 8:267425a8:users.uid::bud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c813330 con 0x7fbfb0077060 2024-09-13T06:11:02.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.617+0000 7fbfbd1d7640 1 -- 172.21.15.194:0/2497557990 <== osd.2 v2:172.21.15.194:6800/815615585 30 ==== osd_op_reply(162 bud [call,call,delete] v35'3 uv3 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fbfb40c9030 con 0x7fbfb0077060 2024-09-13T06:11:02.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.617+0000 7fbfbfec8980 10 removing default.rgw.meta+users.uid+bud from cache 2024-09-13T06:11:02.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.617+0000 7fbfbfec8980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-13T06:11:02.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.617+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94026707582192 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55844c813330 con 0x7fbfb40dc040 2024-09-13T06:11:02.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.617+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.0 v2:172.21.15.120:6800/1923744619 40 ==== watch-notify(notify (1) cookie 94026707387664 notify 150323855401 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55844c7eb2d0 con 0x7fbfb40dc040 2024-09-13T06:11:02.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.617+0000 7fbea17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855401 cookie 94026707387664 notifier 4752 bl.length()=152 2024-09-13T06:11:02.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.617+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.0 v2:172.21.15.120:6800/1923744619 41 ==== osd_op_reply(163 notify.5 [notify cookie 94026707582192 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbfb800a4d0 con 0x7fbfb40dc040 2024-09-13T06:11:02.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.617+0000 7fbea17fa640 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fbe80003d70 con 0x7fbfb40dc040 2024-09-13T06:11:02.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.617+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.0 v2:172.21.15.120:6800/1923744619 42 ==== watch-notify(notify_complete (2) cookie 94026707582192 notify 150323855401 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55844c7eb6b0 con 0x7fbfb40dc040 2024-09-13T06:11:02.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.617+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.0 v2:172.21.15.120:6800/1923744619 43 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfb800a4d0 con 0x7fbfb40dc040 2024-09-13T06:11:02.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.617+0000 7fbe6f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:11:02.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.617+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94026707417504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c7f5740 con 0x55844c7d8960 2024-09-13T06:11:02.624 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.621+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.1 v2:172.21.15.194:6808/3135444559 54 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94026707417504] v35'222 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbfb800a4d0 con 0x55844c7d8960 2024-09-13T06:11:02.624 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.621+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94026707381536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c7f5740 con 0x7fbfb0077060 2024-09-13T06:11:02.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.621+0000 7fbfbd1d7640 1 -- 172.21.15.194:0/2497557990 <== osd.2 v2:172.21.15.194:6800/815615585 31 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94026707381536] v35'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfb40c9030 con 0x7fbfb0077060 2024-09-13T06:11:02.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.621+0000 7fbfbfec8980 20 remove_watcher() i=0 2024-09-13T06:11:02.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.621+0000 7fbfbfec8980 2 removed watcher, disabling cache 2024-09-13T06:11:02.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.621+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94026707385536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c7f5740 con 0x55844c7d8960 2024-09-13T06:11:02.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.621+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.1 v2:172.21.15.194:6808/3135444559 55 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94026707385536] v35'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfb800a4d0 con 0x55844c7d8960 2024-09-13T06:11:02.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.621+0000 7fbfbfec8980 20 remove_watcher() i=1 2024-09-13T06:11:02.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.621+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94026707390256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c7e3cc0 con 0x55844c7dd350 2024-09-13T06:11:02.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.625+0000 7fbfbd9d8640 1 -- 172.21.15.194:0/2497557990 <== osd.3 v2:172.21.15.194:6816/96632515 49 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94026707390256] v35'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfb0097350 con 0x55844c7dd350 2024-09-13T06:11:02.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.625+0000 7fbfbfec8980 20 remove_watcher() i=2 2024-09-13T06:11:02.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.625+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94026707392960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c7f5740 con 0x7fbfb0077060 2024-09-13T06:11:02.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.625+0000 7fbfbd1d7640 1 -- 172.21.15.194:0/2497557990 <== osd.2 v2:172.21.15.194:6800/815615585 32 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94026707392960] v35'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfb40c9030 con 0x7fbfb0077060 2024-09-13T06:11:02.631 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.625+0000 7fbfbfec8980 20 remove_watcher() i=3 2024-09-13T06:11:02.631 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.625+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94026707395088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c7e4f30 con 0x55844c7d8960 2024-09-13T06:11:02.633 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.629+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.1 v2:172.21.15.194:6808/3135444559 56 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94026707395088] v35'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfb800a4d0 con 0x55844c7d8960 2024-09-13T06:11:02.633 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.629+0000 7fbfbfec8980 20 remove_watcher() i=4 2024-09-13T06:11:02.633 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.629+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94026707387664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c7f5740 con 0x7fbfb40dc040 2024-09-13T06:11:02.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.629+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.0 v2:172.21.15.120:6800/1923744619 44 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94026707387664] v35'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfb800a4d0 con 0x7fbfb40dc040 2024-09-13T06:11:02.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.629+0000 7fbfbfec8980 20 remove_watcher() i=5 2024-09-13T06:11:02.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.629+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94026707399696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c7e4f30 con 0x7fbfb40dc040 2024-09-13T06:11:02.637 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.633+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.0 v2:172.21.15.120:6800/1923744619 45 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94026707399696] v35'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfb800a4d0 con 0x7fbfb40dc040 2024-09-13T06:11:02.637 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.633+0000 7fbfbfec8980 20 remove_watcher() i=6 2024-09-13T06:11:02.637 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.633+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94026707403632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55844c7f5740 con 0x7fbfb40dc040 2024-09-13T06:11:02.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.633+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 <== osd.0 v2:172.21.15.120:6800/1923744619 46 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94026707403632] v35'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfb800a4d0 con 0x7fbfb40dc040 2024-09-13T06:11:02.642 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.633+0000 7fbfbfec8980 20 remove_watcher() i=7 2024-09-13T06:11:02.642 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.637+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fbfb40dc040 msgr2=0x7fbfb40dd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:02.642 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.637+0000 7fbfbfec8980 1 --2- 172.21.15.194:0/2497557990 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fbfb40dc040 0x7fbfb40dd430 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:02.642 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.637+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55844c7d8960 msgr2=0x55844c7dae20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:02.642 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.637+0000 7fbfbfec8980 1 --2- 172.21.15.194:0/2497557990 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55844c7d8960 0x55844c7dae20 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:02.642 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.637+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fbfb0077060 msgr2=0x7fbfb003e850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:02.642 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.637+0000 7fbfbfec8980 1 --2- 172.21.15.194:0/2497557990 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fbfb0077060 0x7fbfb003e850 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:02.642 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.637+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55844c7dd350 msgr2=0x55844c7df740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:02.642 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.637+0000 7fbfbfec8980 1 --2- 172.21.15.194:0/2497557990 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55844c7dd350 0x55844c7df740 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:02.642 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.637+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fbe88034650 msgr2=0x7fbe88036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:02.642 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.637+0000 7fbfbfec8980 1 --2- 172.21.15.194:0/2497557990 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fbe88034650 0x7fbe88036b10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4017e90 tx=0x7fbfb40b9040 comp rx=0 tx=0).stop 2024-09-13T06:11:02.642 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.637+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/2497557990 reap_dead start 2024-09-13T06:11:02.643 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.637+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55844c7c6720 msgr2=0x55844c7cd860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:02.643 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.637+0000 7fbfbfec8980 1 --2- 172.21.15.194:0/2497557990 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55844c7c6720 0x55844c7cd860 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fbfb00472a0 tx=0x7fbfb0027f60 comp rx=0 tx=0).stop 2024-09-13T06:11:02.643 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.637+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 shutdown_connections 2024-09-13T06:11:02.643 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.637+0000 7fbfbfec8980 1 --2- 172.21.15.194:0/2497557990 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55844c7c6720 0x55844c7cd860 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:02.643 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.637+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 >> 172.21.15.194:0/2497557990 conn(0x55844c7c2b00 msgr2=0x55844c7c0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:02.643 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.637+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 shutdown_connections 2024-09-13T06:11:02.643 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.637+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2497557990 wait complete. 2024-09-13T06:11:02.643 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.637+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2685903942 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fbe98034650 msgr2=0x7fbe98036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:02.643 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.637+0000 7fbfbfec8980 1 --2- 172.21.15.194:0/2685903942 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fbe98034650 0x7fbe98036b10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fbfb40ae040 tx=0x7fbfb4005a10 comp rx=0 tx=0).stop 2024-09-13T06:11:02.643 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.637+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2685903942 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55844c61dd60 msgr2=0x55844c61c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:02.643 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.637+0000 7fbfbfec8980 1 --2- 172.21.15.194:0/2685903942 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55844c61dd60 0x55844c61c3e0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fbfb004a050 tx=0x7fbfb0041e80 comp rx=0 tx=0).stop 2024-09-13T06:11:02.643 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.637+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2685903942 shutdown_connections 2024-09-13T06:11:02.643 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.637+0000 7fbfbfec8980 1 --2- 172.21.15.194:0/2685903942 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fbe98034650 0x7fbe98036b10 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:02.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.637+0000 7fbfbfec8980 1 --2- 172.21.15.194:0/2685903942 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55844c61dd60 0x55844c61c3e0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:02.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.637+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2685903942 >> 172.21.15.194:0/2685903942 conn(0x55844c7acd40 msgr2=0x55844c7af7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:02.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.637+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2685903942 shutdown_connections 2024-09-13T06:11:02.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.637+0000 7fbfbfec8980 1 -- 172.21.15.194:0/2685903942 wait complete. 2024-09-13T06:11:02.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.637+0000 7fbfbfec8980 1 -- 172.21.15.194:0/939590294 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55844c6ab9e0 msgr2=0x55844c7a0d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:02.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.637+0000 7fbfbfec8980 1 --2- 172.21.15.194:0/939590294 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55844c6ab9e0 0x55844c7a0d70 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:02.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.637+0000 7fbfbfec8980 1 -- 172.21.15.194:0/939590294 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55844c7a75e0 msgr2=0x55844c7a99d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:02.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.637+0000 7fbfbfec8980 1 --2- 172.21.15.194:0/939590294 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55844c7a75e0 0x55844c7a99d0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:02.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.637+0000 7fbfbfec8980 1 -- 172.21.15.194:0/939590294 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55844c7a36e0 msgr2=0x55844c7a5ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:02.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.637+0000 7fbfbfec8980 1 --2- 172.21.15.194:0/939590294 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55844c7a36e0 0x55844c7a5ad0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:02.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.637+0000 7fbfbfec8980 1 -- 172.21.15.194:0/939590294 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fbea40346a0 msgr2=0x7fbea4036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:02.645 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.637+0000 7fbfbfec8980 1 --2- 172.21.15.194:0/939590294 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fbea40346a0 0x7fbea4036b60 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fbfb40ad000 tx=0x7fbfb40a5040 comp rx=0 tx=0).stop 2024-09-13T06:11:02.645 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.637+0000 7fbfbfec8980 1 -- 172.21.15.194:0/939590294 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55844c6a7660 msgr2=0x55844c799dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:02.645 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.637+0000 7fbfbfec8980 1 --2- 172.21.15.194:0/939590294 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55844c6a7660 0x55844c799dc0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x55844c793c10 tx=0x7fbfb0000bd0 comp rx=0 tx=0).stop 2024-09-13T06:11:02.645 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.637+0000 7fbfbe1d9640 1 -- 172.21.15.194:0/939590294 reap_dead start 2024-09-13T06:11:02.645 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.637+0000 7fbfbfec8980 1 -- 172.21.15.194:0/939590294 shutdown_connections 2024-09-13T06:11:02.645 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.637+0000 7fbfbfec8980 1 -- 172.21.15.194:0/939590294 >> 172.21.15.194:0/939590294 conn(0x55844c6a3180 msgr2=0x55844c78d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:02.645 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.637+0000 7fbfbfec8980 1 -- 172.21.15.194:0/939590294 shutdown_connections 2024-09-13T06:11:02.645 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.637+0000 7fbfbfec8980 1 -- 172.21.15.194:0/939590294 wait complete. 2024-09-13T06:11:02.650 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud', '--purge-data'] 2024-09-13T06:11:02.650 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud', '--purge-data'] 2024-09-13T06:11:02.651 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud --purge-data 2024-09-13T06:11:02.726 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:11:02.726 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:11:02.728 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.721+0000 7fc3ca1b9980 1 Processor -- start 2024-09-13T06:11:02.729 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.721+0000 7fc3ca1b9980 1 -- start start 2024-09-13T06:11:02.729 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.721+0000 7fc3ca1b9980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x558127fc6ad0 0x558128057780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:02.729 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.721+0000 7fc3ca1b9980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558127edaae0 con 0x558128057cc0 2024-09-13T06:11:02.729 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.721+0000 7fc3ca1b9980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x558127efee30 con 0x558127fc6ad0 2024-09-13T06:11:02.729 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.725+0000 7fc3c7cc9640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x558127fc6ad0 0x558128057780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:02.729 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.725+0000 7fc3c74c8640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x558128057cc0 0x55812805a0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:46822/0 (socket says 172.21.15.194:46822) 2024-09-13T06:11:02.729 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.725+0000 7fc3c74c8640 1 -- 172.21.15.194:0/2772624901 learned_addr learned my addr 172.21.15.194:0/2772624901 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-09-13T06:11:02.729 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.725+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/2772624901 >> v1:172.21.15.120:6789/0 conn(0x558128057cc0 legacy=0x55812805a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:02.729 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.725+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/2772624901 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558127fc6eb0 con 0x558127fc6ad0 2024-09-13T06:11:02.731 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.725+0000 7fc3c7cc9640 1 --2- 172.21.15.194:0/2772624901 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558127fc6ad0 0x558128057780 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fc3b800a480 tx=0x7fc3b801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e16d071d742b9ebf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:02.731 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.725+0000 7fc3c6cc7640 1 -- 172.21.15.194:0/2772624901 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3b80b0070 con 0x558127fc6ad0 2024-09-13T06:11:02.731 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.725+0000 7fc3c6cc7640 1 -- 172.21.15.194:0/2772624901 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3b80ab540 con 0x558127fc6ad0 2024-09-13T06:11:02.731 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.725+0000 7fc3c6cc7640 1 -- 172.21.15.194:0/2772624901 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3b80ab840 con 0x558127fc6ad0 2024-09-13T06:11:02.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.729+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2772624901 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558127fc6ad0 msgr2=0x558128057780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:02.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.729+0000 7fc3ca1b9980 1 --2- 172.21.15.194:0/2772624901 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558127fc6ad0 0x558128057780 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fc3b800a480 tx=0x7fc3b801b280 comp rx=0 tx=0).stop 2024-09-13T06:11:02.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.729+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2772624901 shutdown_connections 2024-09-13T06:11:02.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.729+0000 7fc3ca1b9980 1 --2- 172.21.15.194:0/2772624901 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558127fc6ad0 0x558128057780 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:02.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.729+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2772624901 >> 172.21.15.194:0/2772624901 conn(0x55812804d070 msgr2=0x55812804f490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:02.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.729+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2772624901 shutdown_connections 2024-09-13T06:11:02.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.729+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2772624901 wait complete. 2024-09-13T06:11:02.744 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.741+0000 7fc3ca1b9980 1 Processor -- start 2024-09-13T06:11:02.745 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.741+0000 7fc3ca1b9980 1 -- start start 2024-09-13T06:11:02.745 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.741+0000 7fc3ca1b9980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558127fc6ad0 0x55812813fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:02.745 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.741+0000 7fc3ca1b9980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x558127f00200 con 0x558127fc6ad0 2024-09-13T06:11:02.745 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.741+0000 7fc3c7cc9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558127fc6ad0 0x55812813fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:02.745 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.741+0000 7fc3c7cc9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558127fc6ad0 0x55812813fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:54738/0 (socket says 172.21.15.194:54738) 2024-09-13T06:11:02.745 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.741+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/1058177590 learned_addr learned my addr 172.21.15.194:0/1058177590 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:02.746 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.741+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/1058177590 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558128140270 con 0x558127fc6ad0 2024-09-13T06:11:02.746 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.741+0000 7fc3c7cc9640 1 --2- 172.21.15.194:0/1058177590 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558127fc6ad0 0x55812813fca0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fc3b8017e90 tx=0x7fc3b8003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d76bdfe778c59ce0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:02.746 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.741+0000 7fc2b5e0b640 1 -- 172.21.15.194:0/1058177590 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3b80b0040 con 0x558127fc6ad0 2024-09-13T06:11:02.746 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.741+0000 7fc2b5e0b640 1 -- 172.21.15.194:0/1058177590 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3b80ab9d0 con 0x558127fc6ad0 2024-09-13T06:11:02.747 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.741+0000 7fc2b5e0b640 1 -- 172.21.15.194:0/1058177590 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3b80abcf0 con 0x558127fc6ad0 2024-09-13T06:11:02.748 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.741+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/1058177590 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558127fc6ad0 msgr2=0x55812813fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:02.748 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.741+0000 7fc3ca1b9980 1 --2- 172.21.15.194:0/1058177590 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558127fc6ad0 0x55812813fca0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fc3b8017e90 tx=0x7fc3b8003030 comp rx=0 tx=0).stop 2024-09-13T06:11:02.748 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.741+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/1058177590 shutdown_connections 2024-09-13T06:11:02.748 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.741+0000 7fc3ca1b9980 1 --2- 172.21.15.194:0/1058177590 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558127fc6ad0 0x55812813fca0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:02.748 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.741+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/1058177590 >> 172.21.15.194:0/1058177590 conn(0x55812804d070 msgr2=0x55812813b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:02.748 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.741+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/1058177590 shutdown_connections 2024-09-13T06:11:02.748 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.741+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/1058177590 wait complete. 2024-09-13T06:11:02.748 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.745+0000 7fc3ca1b9980 1 Processor -- start 2024-09-13T06:11:02.748 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.745+0000 7fc3ca1b9980 1 -- start start 2024-09-13T06:11:02.749 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.745+0000 7fc3ca1b9980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558127fc6ad0 0x558128146ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:02.749 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.745+0000 7fc3ca1b9980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55812805e260 con 0x558127fc6ad0 2024-09-13T06:11:02.749 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.745+0000 7fc3c7cc9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558127fc6ad0 0x558128146ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:02.749 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.745+0000 7fc3c7cc9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558127fc6ad0 0x558128146ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:54746/0 (socket says 172.21.15.194:54746) 2024-09-13T06:11:02.749 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.745+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/543397685 learned_addr learned my addr 172.21.15.194:0/543397685 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:02.750 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.745+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/543397685 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558128147420 con 0x558127fc6ad0 2024-09-13T06:11:02.750 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.745+0000 7fc3c7cc9640 1 --2- 172.21.15.194:0/543397685 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558127fc6ad0 0x558128146ee0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fc3b80ab510 tx=0x7fc3b8018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:02.750 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.745+0000 7fc2affff640 1 -- 172.21.15.194:0/543397685 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3b80b0070 con 0x558127fc6ad0 2024-09-13T06:11:02.750 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.745+0000 7fc2affff640 1 -- 172.21.15.194:0/543397685 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3b80b6d20 con 0x558127fc6ad0 2024-09-13T06:11:02.750 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.745+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/543397685 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5581281476b0 con 0x558127fc6ad0 2024-09-13T06:11:02.750 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.745+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/543397685 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55812814a390 con 0x558127fc6ad0 2024-09-13T06:11:02.750 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.745+0000 7fc2affff640 1 -- 172.21.15.194:0/543397685 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3b80c8440 con 0x558127fc6ad0 2024-09-13T06:11:02.752 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.745+0000 7fc2affff640 1 -- 172.21.15.194:0/543397685 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc3b80c85e0 con 0x558127fc6ad0 2024-09-13T06:11:02.752 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.745+0000 7fc2affff640 1 --2- 172.21.15.194:0/543397685 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fc2b0034650 0x7fc2b0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:02.752 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.745+0000 7fc2affff640 1 -- 172.21.15.194:0/543397685 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fc3b80a8070 con 0x558127fc6ad0 2024-09-13T06:11:02.752 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.745+0000 7fc3c74c8640 1 --2- 172.21.15.194:0/543397685 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fc2b0034650 0x7fc2b0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:02.752 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.745+0000 7fc3ca1b9980 1 --2- 172.21.15.194:0/543397685 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x558128057cc0 0x55812814de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:02.753 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.745+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/543397685 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55812814e440 con 0x558128057cc0 2024-09-13T06:11:02.753 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.745+0000 7fc3c84ca640 1 --2- 172.21.15.194:0/543397685 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x558128057cc0 0x55812814de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:02.753 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.745+0000 7fc3c74c8640 1 --2- 172.21.15.194:0/543397685 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fc2b0034650 0x7fc2b0036b10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc000f70 tx=0x7fc3bc0012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:02.753 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.749+0000 7fc3c84ca640 1 --2- 172.21.15.194:0/543397685 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x558128057cc0 0x55812814de70 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:02.753 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.749+0000 7fc3c84ca640 1 -- 172.21.15.194:0/543397685 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc3c000a4d0 con 0x558128057cc0 2024-09-13T06:11:02.753 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.749+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/543397685 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55812814b5b0 con 0x558128057cc0 2024-09-13T06:11:02.753 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.749+0000 7fc3c84ca640 1 -- 172.21.15.194:0/543397685 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc3c000a4d0 con 0x558128057cc0 2024-09-13T06:11:02.753 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.749+0000 7fc3ca1b9980 1 --2- 172.21.15.194:0/543397685 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x558128150790 0x558128152b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:02.753 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.749+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/543397685 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558128153250 con 0x558128150790 2024-09-13T06:11:02.753 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.749+0000 7fc3c7cc9640 1 --2- 172.21.15.194:0/543397685 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x558128150790 0x558128152b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:02.753 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.749+0000 7fc3c7cc9640 1 --2- 172.21.15.194:0/543397685 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x558128150790 0x558128152b80 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:02.756 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.749+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/543397685 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc3b80b3040 con 0x558128150790 2024-09-13T06:11:02.756 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.749+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/543397685 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55812814f630 con 0x558128057cc0 2024-09-13T06:11:02.756 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.749+0000 7fc3c84ca640 1 -- 172.21.15.194:0/543397685 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc3c000a4d0 con 0x558128057cc0 2024-09-13T06:11:02.756 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.749+0000 7fc3ca1b9980 1 --2- 172.21.15.194:0/543397685 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x558128154690 0x558128156a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:02.756 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.749+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/543397685 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558128157210 con 0x558128154690 2024-09-13T06:11:02.756 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.749+0000 7fc3c74c8640 1 --2- 172.21.15.194:0/543397685 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x558128154690 0x558128156a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:02.756 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.749+0000 7fc3c74c8640 1 --2- 172.21.15.194:0/543397685 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x558128154690 0x558128156a80 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:02.756 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.749+0000 7fc3c74c8640 1 -- 172.21.15.194:0/543397685 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc3bc00e620 con 0x558128154690 2024-09-13T06:11:02.756 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.749+0000 7fc3ca1b9980 1 Processor -- start 2024-09-13T06:11:02.756 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.749+0000 7fc3ca1b9980 1 -- start start 2024-09-13T06:11:02.756 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.749+0000 7fc3ca1b9980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558128164ca0 0x5581281650c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:02.757 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.749+0000 7fc3ca1b9980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x558127f59800 con 0x558128164ca0 2024-09-13T06:11:02.757 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.749+0000 7fc3c7cc9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558128164ca0 0x5581281650c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:02.757 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.749+0000 7fc3c7cc9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558128164ca0 0x5581281650c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:54756/0 (socket says 172.21.15.194:54756) 2024-09-13T06:11:02.757 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.749+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/67841135 learned_addr learned my addr 172.21.15.194:0/67841135 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:02.757 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.749+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/67841135 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558128165600 con 0x558128164ca0 2024-09-13T06:11:02.757 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.753+0000 7fc3c7cc9640 1 --2- 172.21.15.194:0/67841135 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558128164ca0 0x5581281650c0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fc3b80bffd0 tx=0x7fc3b80be670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:02.757 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.753+0000 7fc2ad7fa640 1 -- 172.21.15.194:0/67841135 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3b80d1aa0 con 0x558128164ca0 2024-09-13T06:11:02.757 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.753+0000 7fc2ad7fa640 1 -- 172.21.15.194:0/67841135 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3b80d1c40 con 0x558128164ca0 2024-09-13T06:11:02.757 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.753+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/67841135 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558128165890 con 0x558128164ca0 2024-09-13T06:11:02.757 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.753+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/67841135 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558128168510 con 0x558128164ca0 2024-09-13T06:11:02.757 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.753+0000 7fc2ad7fa640 1 -- 172.21.15.194:0/67841135 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3b80ef060 con 0x558128164ca0 2024-09-13T06:11:02.760 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.753+0000 7fc2ad7fa640 1 -- 172.21.15.194:0/67841135 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc3b80dd040 con 0x558128164ca0 2024-09-13T06:11:02.760 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.753+0000 7fc2ad7fa640 1 --2- 172.21.15.194:0/67841135 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fc2a0034600 0x7fc2a0036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:02.760 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.753+0000 7fc2ad7fa640 1 -- 172.21.15.194:0/67841135 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fc3b80ca1e0 con 0x558128164ca0 2024-09-13T06:11:02.761 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.753+0000 7fc3c74c8640 1 --2- 172.21.15.194:0/67841135 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fc2a0034600 0x7fc2a0036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:02.761 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.753+0000 7fc3ca1b9980 1 Processor -- start 2024-09-13T06:11:02.761 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.753+0000 7fc3ca1b9980 1 -- start start 2024-09-13T06:11:02.761 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.753+0000 7fc3c74c8640 1 --2- 172.21.15.194:0/67841135 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fc2a0034600 0x7fc2a0036ac0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc00bf60 tx=0x7fc3bc00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:02.761 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.753+0000 7fc3ca1b9980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5581281715c0 0x5581281719c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:02.761 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.753+0000 7fc3ca1b9980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x558128140530 con 0x5581281715c0 2024-09-13T06:11:02.761 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.753+0000 7fc3c7cc9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5581281715c0 0x5581281719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:02.761 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.753+0000 7fc3c7cc9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5581281715c0 0x5581281719c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:54768/0 (socket says 172.21.15.194:54768) 2024-09-13T06:11:02.761 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.753+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/244165722 learned_addr learned my addr 172.21.15.194:0/244165722 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:02.761 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.753+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/244165722 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558128171f90 con 0x5581281715c0 2024-09-13T06:11:02.761 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.753+0000 7fc3c7cc9640 1 --2- 172.21.15.194:0/244165722 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5581281715c0 0x5581281719c0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fc3b80d8010 tx=0x7fc3b80df500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ebf7d0680552aa1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:02.761 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.753+0000 7fc2a6ffd640 1 -- 172.21.15.194:0/244165722 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3b80d8af0 con 0x5581281715c0 2024-09-13T06:11:02.761 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.753+0000 7fc2a6ffd640 1 -- 172.21.15.194:0/244165722 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3b80d8c90 con 0x5581281715c0 2024-09-13T06:11:02.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.753+0000 7fc2a6ffd640 1 -- 172.21.15.194:0/244165722 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3b8006940 con 0x5581281715c0 2024-09-13T06:11:02.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.753+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/244165722 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5581281715c0 msgr2=0x5581281719c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:02.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.753+0000 7fc3ca1b9980 1 --2- 172.21.15.194:0/244165722 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5581281715c0 0x5581281719c0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fc3b80d8010 tx=0x7fc3b80df500 comp rx=0 tx=0).stop 2024-09-13T06:11:02.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.753+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/244165722 shutdown_connections 2024-09-13T06:11:02.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.753+0000 7fc3ca1b9980 1 --2- 172.21.15.194:0/244165722 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5581281715c0 0x5581281719c0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:02.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.753+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/244165722 >> 172.21.15.194:0/244165722 conn(0x55812816d9f0 msgr2=0x55812816baf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:02.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.753+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/244165722 shutdown_connections 2024-09-13T06:11:02.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.753+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/244165722 wait complete. 2024-09-13T06:11:02.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.757+0000 7fc3ca1b9980 1 Processor -- start 2024-09-13T06:11:02.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.757+0000 7fc3ca1b9980 1 -- start start 2024-09-13T06:11:02.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.757+0000 7fc3ca1b9980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5581281715c0 0x558128178650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:02.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.757+0000 7fc3ca1b9980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x558128171f90 con 0x5581281715c0 2024-09-13T06:11:02.763 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.757+0000 7fc3c7cc9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5581281715c0 0x558128178650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:02.763 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.757+0000 7fc3c7cc9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5581281715c0 0x558128178650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:54770/0 (socket says 172.21.15.194:54770) 2024-09-13T06:11:02.763 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.757+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/2394773341 learned_addr learned my addr 172.21.15.194:0/2394773341 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:02.763 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.757+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558128178b90 con 0x5581281715c0 2024-09-13T06:11:02.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.757+0000 7fc3c7cc9640 1 --2- 172.21.15.194:0/2394773341 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5581281715c0 0x558128178650 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fc3b80e5170 tx=0x7fc3b80d8f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:02.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.757+0000 7fc2a57fa640 1 -- 172.21.15.194:0/2394773341 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3b80aa6f0 con 0x5581281715c0 2024-09-13T06:11:02.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.757+0000 7fc2a57fa640 1 -- 172.21.15.194:0/2394773341 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3b810a070 con 0x5581281715c0 2024-09-13T06:11:02.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.757+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558128178b90 con 0x5581281715c0 2024-09-13T06:11:02.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.757+0000 7fc2a57fa640 1 -- 172.21.15.194:0/2394773341 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3b80aa9c0 con 0x5581281715c0 2024-09-13T06:11:02.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.757+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558128178b90 con 0x5581281715c0 2024-09-13T06:11:02.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.757+0000 7fc2a57fa640 1 -- 172.21.15.194:0/2394773341 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc3b80fe030 con 0x5581281715c0 2024-09-13T06:11:02.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.757+0000 7fc2a57fa640 1 --2- 172.21.15.194:0/2394773341 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fc290034650 0x7fc290036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:02.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.757+0000 7fc2a57fa640 1 -- 172.21.15.194:0/2394773341 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fc3b80fc070 con 0x5581281715c0 2024-09-13T06:11:02.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.757+0000 7fc3c74c8640 1 --2- 172.21.15.194:0/2394773341 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fc290034650 0x7fc290036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:02.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.757+0000 7fc3ca1b9980 20 rados->read ofs=0 len=0 2024-09-13T06:11:02.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.757+0000 7fc3ca1b9980 1 --2- 172.21.15.194:0/2394773341 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x558128183640 0x558128185b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:02.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.757+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558128186250 con 0x558128183640 2024-09-13T06:11:02.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.757+0000 7fc3c84ca640 1 --2- 172.21.15.194:0/2394773341 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x558128183640 0x558128185b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:02.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.757+0000 7fc3c74c8640 1 --2- 172.21.15.194:0/2394773341 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fc290034650 0x7fc290036b10 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x558128157610 tx=0x7fc3bc010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:02.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.757+0000 7fc3c84ca640 1 --2- 172.21.15.194:0/2394773341 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x558128183640 0x558128185b00 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:02.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.761+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc3c000a4d0 con 0x558128183640 2024-09-13T06:11:02.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.761+0000 7fc3ca1b9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:02.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.761+0000 7fc3ca1b9980 20 realm 2024-09-13T06:11:02.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.761+0000 7fc3ca1b9980 20 rados->read ofs=0 len=0 2024-09-13T06:11:02.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.761+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558128186660 con 0x558128183640 2024-09-13T06:11:02.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.761+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc3c000a4d0 con 0x558128183640 2024-09-13T06:11:02.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.761+0000 7fc3ca1b9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:02.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.761+0000 7fc3ca1b9980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:11:02.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.761+0000 7fc3ca1b9980 20 rados->read ofs=0 len=0 2024-09-13T06:11:02.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.761+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558128186f00 con 0x558128183640 2024-09-13T06:11:02.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.761+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc3c000a4d0 con 0x558128183640 2024-09-13T06:11:02.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.761+0000 7fc3ca1b9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:02.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.761+0000 7fc3ca1b9980 20 rados->read ofs=0 len=0 2024-09-13T06:11:02.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.761+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5581281872a0 con 0x558128183640 2024-09-13T06:11:02.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.761+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc3c000a4d0 con 0x558128183640 2024-09-13T06:11:02.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.761+0000 7fc3ca1b9980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:11:02.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.761+0000 7fc3ca1b9980 20 rados->read ofs=0 len=0 2024-09-13T06:11:02.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.761+0000 7fc3ca1b9980 1 --2- 172.21.15.194:0/2394773341 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x558128188000 0x55812818a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:02.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.761+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55812818aa40 con 0x558128188000 2024-09-13T06:11:02.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.761+0000 7fc3c7cc9640 1 --2- 172.21.15.194:0/2394773341 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x558128188000 0x55812818a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:02.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.761+0000 7fc3c7cc9640 1 --2- 172.21.15.194:0/2394773341 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x558128188000 0x55812818a3f0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:02.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.761+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/2394773341 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc3b80b3040 con 0x558128188000 2024-09-13T06:11:02.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.761+0000 7fc3ca1b9980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:11:02.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.761+0000 7fc3ca1b9980 20 searching for the correct realm 2024-09-13T06:11:02.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.761+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55812818c2a0 con 0x558128188000 2024-09-13T06:11:02.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.761+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/2394773341 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3b80b3040 con 0x558128188000 2024-09-13T06:11:02.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.761+0000 7fc3c7cc9640 1 --2- 172.21.15.194:0/2394773341 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fc3b80ab030 0x7fc3b80df880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:02.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.761+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55812818c2a0 con 0x7fc3b80ab030 2024-09-13T06:11:02.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.761+0000 7fc3c74c8640 1 --2- 172.21.15.194:0/2394773341 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fc3b80ab030 0x7fc3b80df880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:02.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.761+0000 7fc3c74c8640 1 --2- 172.21.15.194:0/2394773341 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fc3b80ab030 0x7fc3b80df880 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:02.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.761+0000 7fc3c74c8640 1 -- 172.21.15.194:0/2394773341 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc3bc00e620 con 0x7fc3b80ab030 2024-09-13T06:11:02.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.761+0000 7fc3c74c8640 1 --2- 172.21.15.194:0/2394773341 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fc3bc037040 0x7fc3bc036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:02.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.761+0000 7fc3c74c8640 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55812818c2a0 con 0x7fc3bc037040 2024-09-13T06:11:02.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.761+0000 7fc3c84ca640 1 --2- 172.21.15.194:0/2394773341 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fc3bc037040 0x7fc3bc036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:02.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.761+0000 7fc3c84ca640 1 --2- 172.21.15.194:0/2394773341 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fc3bc037040 0x7fc3bc036410 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:02.776 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.765+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3c000a4d0 con 0x7fc3bc037040 2024-09-13T06:11:02.776 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.765+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5581281872a0 con 0x558128183640 2024-09-13T06:11:02.776 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.765+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3c000a4d0 con 0x558128183640 2024-09-13T06:11:02.777 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.765+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5581281872a0 con 0x558128183640 2024-09-13T06:11:02.777 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.765+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3c000a4d0 con 0x558128183640 2024-09-13T06:11:02.777 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.765+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5581281872a0 con 0x7fc3bc037040 2024-09-13T06:11:02.777 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.765+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3c000a4d0 con 0x7fc3bc037040 2024-09-13T06:11:02.777 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.765+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5581281872a0 con 0x7fc3bc037040 2024-09-13T06:11:02.777 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.765+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3c000a4d0 con 0x7fc3bc037040 2024-09-13T06:11:02.777 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.765+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5581281872a0 con 0x7fc3b80ab030 2024-09-13T06:11:02.777 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.765+0000 7fc3c74c8640 1 -- 172.21.15.194:0/2394773341 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3bc00e620 con 0x7fc3b80ab030 2024-09-13T06:11:02.777 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.765+0000 7fc3c74c8640 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5581281872a0 con 0x558128188000 2024-09-13T06:11:02.777 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.765+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/2394773341 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3b80b3040 con 0x558128188000 2024-09-13T06:11:02.777 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.765+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5581281872a0 con 0x558128183640 2024-09-13T06:11:02.777 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.765+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3c000a4d0 con 0x558128183640 2024-09-13T06:11:02.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.765+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5581281872a0 con 0x7fc3bc037040 2024-09-13T06:11:02.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.765+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3c000a4d0 con 0x7fc3bc037040 2024-09-13T06:11:02.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.765+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5581281872a0 con 0x558128183640 2024-09-13T06:11:02.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.765+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3c000a4d0 con 0x558128183640 2024-09-13T06:11:02.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.765+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5581281872a0 con 0x7fc3b80ab030 2024-09-13T06:11:02.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.765+0000 7fc3c74c8640 1 -- 172.21.15.194:0/2394773341 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc3bc00e620 con 0x7fc3b80ab030 2024-09-13T06:11:02.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.765+0000 7fc3c74c8640 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5581281872a0 con 0x558128188000 2024-09-13T06:11:02.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.765+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/2394773341 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3b80b3040 con 0x558128188000 2024-09-13T06:11:02.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.765+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5581281872a0 con 0x558128188000 2024-09-13T06:11:02.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.769+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/2394773341 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3b80b3040 con 0x558128188000 2024-09-13T06:11:02.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.769+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5581281872a0 con 0x7fc3bc037040 2024-09-13T06:11:02.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.769+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3c000a4d0 con 0x7fc3bc037040 2024-09-13T06:11:02.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.769+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5581281872a0 con 0x558128188000 2024-09-13T06:11:02.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.769+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/2394773341 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3b80b3040 con 0x558128188000 2024-09-13T06:11:02.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.769+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5581281872a0 con 0x558128188000 2024-09-13T06:11:02.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.769+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/2394773341 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3b80b3040 con 0x558128188000 2024-09-13T06:11:02.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.769+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5581281872a0 con 0x558128183640 2024-09-13T06:11:02.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.769+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3c000a4d0 con 0x558128183640 2024-09-13T06:11:02.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.769+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5581281872a0 con 0x558128183640 2024-09-13T06:11:02.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.769+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc3c000a4d0 con 0x558128183640 2024-09-13T06:11:02.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.769+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5581281872a0 con 0x7fc3b80ab030 2024-09-13T06:11:02.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.769+0000 7fc3c74c8640 1 -- 172.21.15.194:0/2394773341 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3bc00e620 con 0x7fc3b80ab030 2024-09-13T06:11:02.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.769+0000 7fc3c74c8640 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5581281872a0 con 0x558128188000 2024-09-13T06:11:02.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.769+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/2394773341 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3b80b3040 con 0x558128188000 2024-09-13T06:11:02.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.769+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5581281872a0 con 0x7fc3b80ab030 2024-09-13T06:11:02.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.769+0000 7fc3c74c8640 1 -- 172.21.15.194:0/2394773341 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3bc00e620 con 0x7fc3b80ab030 2024-09-13T06:11:02.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.769+0000 7fc3c74c8640 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5581281872a0 con 0x558128183640 2024-09-13T06:11:02.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.769+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3c000a4d0 con 0x558128183640 2024-09-13T06:11:02.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.769+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5581281872a0 con 0x7fc3bc037040 2024-09-13T06:11:02.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.769+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3c000a4d0 con 0x7fc3bc037040 2024-09-13T06:11:02.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.769+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5581281872a0 con 0x558128188000 2024-09-13T06:11:02.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.769+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/2394773341 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc3b80b3040 con 0x558128188000 2024-09-13T06:11:02.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.769+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5581281872a0 con 0x7fc3b80ab030 2024-09-13T06:11:02.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.769+0000 7fc3c74c8640 1 -- 172.21.15.194:0/2394773341 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3bc00e620 con 0x7fc3b80ab030 2024-09-13T06:11:02.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.769+0000 7fc3c74c8640 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5581281872a0 con 0x7fc3b80ab030 2024-09-13T06:11:02.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.773+0000 7fc3c74c8640 1 -- 172.21.15.194:0/2394773341 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3bc00e620 con 0x7fc3b80ab030 2024-09-13T06:11:02.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.773+0000 7fc3c74c8640 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5581281872a0 con 0x558128188000 2024-09-13T06:11:02.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.773+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/2394773341 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3b80b3040 con 0x558128188000 2024-09-13T06:11:02.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.773+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5581281872a0 con 0x7fc3bc037040 2024-09-13T06:11:02.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.773+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3c000a4d0 con 0x7fc3bc037040 2024-09-13T06:11:02.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.773+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5581281872a0 con 0x558128183640 2024-09-13T06:11:02.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.773+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc3c000a4d0 con 0x558128183640 2024-09-13T06:11:02.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.773+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5581281872a0 con 0x7fc3b80ab030 2024-09-13T06:11:02.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.773+0000 7fc3c74c8640 1 -- 172.21.15.194:0/2394773341 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3bc00e620 con 0x7fc3b80ab030 2024-09-13T06:11:02.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.773+0000 7fc3ca1b9980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:11:02.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.773+0000 7fc3ca1b9980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:11:02.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.773+0000 7fc3ca1b9980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:11:02.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.773+0000 7fc3ca1b9980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:11:02.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.773+0000 7fc3ca1b9980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:11:02.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.773+0000 7fc3ca1b9980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:11:02.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.773+0000 7fc3ca1b9980 20 rados->read ofs=0 len=0 2024-09-13T06:11:02.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.773+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55812818b3c0 con 0x558128183640 2024-09-13T06:11:02.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.773+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc3c000a4d0 con 0x558128183640 2024-09-13T06:11:02.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.773+0000 7fc3ca1b9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:02.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.773+0000 7fc3ca1b9980 20 rados->read ofs=0 len=0 2024-09-13T06:11:02.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.773+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55812818bc10 con 0x558128183640 2024-09-13T06:11:02.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.773+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc3c000a4d0 con 0x558128183640 2024-09-13T06:11:02.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.773+0000 7fc3ca1b9980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:11:02.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.773+0000 7fc3ca1b9980 20 rados->read ofs=0 len=0 2024-09-13T06:11:02.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.773+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55812818b760 con 0x7fc3b80ab030 2024-09-13T06:11:02.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.773+0000 7fc3c74c8640 1 -- 172.21.15.194:0/2394773341 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc3bc00e620 con 0x7fc3b80ab030 2024-09-13T06:11:02.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.773+0000 7fc3ca1b9980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:11:02.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.773+0000 7fc3ca1b9980 20 zone default found 2024-09-13T06:11:02.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.773+0000 7fc3ca1b9980 4 Realm: () 2024-09-13T06:11:02.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.773+0000 7fc3ca1b9980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:11:02.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.773+0000 7fc3ca1b9980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:11:02.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.773+0000 7fc3ca1b9980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:11:02.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.773+0000 7fc3ca1b9980 20 zonegroup default 2024-09-13T06:11:02.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.773+0000 7fc3ca1b9980 20 rados->read ofs=0 len=0 2024-09-13T06:11:02.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.773+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55812818c6d0 con 0x7fc3bc037040 2024-09-13T06:11:02.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.773+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc3c000a4d0 con 0x7fc3bc037040 2024-09-13T06:11:02.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.773+0000 7fc3ca1b9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:02.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.773+0000 7fc3ca1b9980 20 rados->read ofs=0 len=0 2024-09-13T06:11:02.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.773+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55812818e140 con 0x558128188000 2024-09-13T06:11:02.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.773+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/2394773341 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc3b80b3040 con 0x558128188000 2024-09-13T06:11:02.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.773+0000 7fc3ca1b9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:02.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.773+0000 7fc3ca1b9980 20 rados->read ofs=0 len=0 2024-09-13T06:11:02.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.773+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55812818e5d0 con 0x558128188000 2024-09-13T06:11:02.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.773+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/2394773341 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc3b80b3040 con 0x558128188000 2024-09-13T06:11:02.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.773+0000 7fc3ca1b9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:02.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.773+0000 7fc3ca1b9980 20 started sync module instance, tier type = 2024-09-13T06:11:02.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.773+0000 7fc3ca1b9980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:11:02.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.773+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55812818d550 con 0x7fc3b80ab030 2024-09-13T06:11:02.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.777+0000 7fc3c74c8640 1 -- 172.21.15.194:0/2394773341 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(44 notify.0 [create] v35'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3bc00e620 con 0x7fc3b80ab030 2024-09-13T06:11:02.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.777+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94013211859264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55812818eee0 con 0x7fc3b80ab030 2024-09-13T06:11:02.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.777+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55812818f730 con 0x558128183640 2024-09-13T06:11:02.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.777+0000 7fc3c74c8640 1 -- 172.21.15.194:0/2394773341 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94013211859264] v35'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3bc00e620 con 0x7fc3b80ab030 2024-09-13T06:11:02.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.777+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v35'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3c000a4d0 con 0x558128183640 2024-09-13T06:11:02.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.777+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94013211863600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55812818f730 con 0x558128183640 2024-09-13T06:11:02.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.777+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558128190210 con 0x558128188000 2024-09-13T06:11:02.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.781+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/2394773341 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v35'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3b80b3040 con 0x558128188000 2024-09-13T06:11:02.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.781+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94013211868448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558128190ab0 con 0x558128188000 2024-09-13T06:11:02.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.781+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581281914d0 con 0x7fc3b80ab030 2024-09-13T06:11:02.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.781+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94013211863600] v35'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3c000a4d0 con 0x558128183640 2024-09-13T06:11:02.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.781+0000 7fc3c74c8640 1 -- 172.21.15.194:0/2394773341 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(50 notify.3 [create] v35'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3bc00e620 con 0x7fc3b80ab030 2024-09-13T06:11:02.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.781+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94013211865728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558128191d70 con 0x7fc3b80ab030 2024-09-13T06:11:02.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.781+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581281925c0 con 0x558128183640 2024-09-13T06:11:02.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.781+0000 7fc3c74c8640 1 -- 172.21.15.194:0/2394773341 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94013211865728] v35'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3bc00e620 con 0x7fc3b80ab030 2024-09-13T06:11:02.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.785+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/2394773341 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94013211868448] v35'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3b80b3040 con 0x558128188000 2024-09-13T06:11:02.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.785+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v35'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3c000a4d0 con 0x558128183640 2024-09-13T06:11:02.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.785+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94013211875520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558128192190 con 0x558128183640 2024-09-13T06:11:02.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.785+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558128192e60 con 0x7fc3bc037040 2024-09-13T06:11:02.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.785+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94013211875520] v35'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3c000a4d0 con 0x558128183640 2024-09-13T06:11:02.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.785+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(54 notify.5 [create] v35'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3c000a4d0 con 0x7fc3bc037040 2024-09-13T06:11:02.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.785+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94013211876576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558128192100 con 0x7fc3bc037040 2024-09-13T06:11:02.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.785+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558128193320 con 0x7fc3bc037040 2024-09-13T06:11:02.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.789+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94013211876576] v35'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3c000a4d0 con 0x7fc3bc037040 2024-09-13T06:11:02.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.789+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(56 notify.6 [create] v35'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3c000a4d0 con 0x7fc3bc037040 2024-09-13T06:11:02.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.789+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94013211879504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558128193320 con 0x7fc3bc037040 2024-09-13T06:11:02.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.789+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558128193ce0 con 0x7fc3bc037040 2024-09-13T06:11:02.794 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.789+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94013211879504] v35'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3c000a4d0 con 0x7fc3bc037040 2024-09-13T06:11:02.794 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.789+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(58 notify.7 [create] v35'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3c000a4d0 con 0x7fc3bc037040 2024-09-13T06:11:02.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.789+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94013211881072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558128193ec0 con 0x7fc3bc037040 2024-09-13T06:11:02.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.789+0000 7fc3ca1b9980 20 add_watcher() i=0 2024-09-13T06:11:02.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.789+0000 7fc3ca1b9980 20 add_watcher() i=1 2024-09-13T06:11:02.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.789+0000 7fc3ca1b9980 20 add_watcher() i=2 2024-09-13T06:11:02.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.789+0000 7fc3ca1b9980 20 add_watcher() i=3 2024-09-13T06:11:02.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.789+0000 7fc3ca1b9980 20 add_watcher() i=4 2024-09-13T06:11:02.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.789+0000 7fc3ca1b9980 20 add_watcher() i=5 2024-09-13T06:11:02.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.789+0000 7fc3ca1b9980 20 add_watcher() i=6 2024-09-13T06:11:02.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.793+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94013211881072] v35'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3c000a4d0 con 0x7fc3bc037040 2024-09-13T06:11:02.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.793+0000 7fc3ca1b9980 20 add_watcher() i=7 2024-09-13T06:11:02.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.793+0000 7fc3ca1b9980 2 all 8 watchers are set, enabling cache 2024-09-13T06:11:02.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.793+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558128197080 con 0x558128183640 2024-09-13T06:11:02.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.793+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc3c000a4d0 con 0x558128183640 2024-09-13T06:11:02.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.793+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94013211896400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558128193e30 con 0x558128183640 2024-09-13T06:11:02.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.793+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94013211896400] v35'223 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc3c000a4d0 con 0x558128183640 2024-09-13T06:11:02.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.793+0000 7fc27dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:11:02.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.793+0000 7fc3ca1b9980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:11:02.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.793+0000 7fc3ca1b9980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:11:02.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.793+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581281962b0 con 0x558128183640 2024-09-13T06:11:02.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.797+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v35'34 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc3c000a4d0 con 0x558128183640 2024-09-13T06:11:02.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.797+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581281a0140 con 0x7fc3bc037040 2024-09-13T06:11:02.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.797+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v35'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc3c000a4d0 con 0x7fc3bc037040 2024-09-13T06:11:02.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.797+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581281a05f0 con 0x558128188000 2024-09-13T06:11:02.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.801+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/2394773341 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v35'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc3b80b3040 con 0x558128188000 2024-09-13T06:11:02.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.801+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581281a05f0 con 0x558128183640 2024-09-13T06:11:02.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.801+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v35'224 uv164 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc3c000a4d0 con 0x558128183640 2024-09-13T06:11:02.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.801+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581281a07c0 con 0x7fc3b80ab030 2024-09-13T06:11:02.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.801+0000 7fc3c74c8640 1 -- 172.21.15.194:0/2394773341 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v35'71 uv53 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc3bc00e620 con 0x7fc3b80ab030 2024-09-13T06:11:02.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.801+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581281a0d30 con 0x558128188000 2024-09-13T06:11:02.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.801+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/2394773341 <== osd.3 v2:172.21.15.194:6816/96632515 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v35'48 uv37 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc3b80b3040 con 0x558128188000 2024-09-13T06:11:02.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.801+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581281a0dc0 con 0x558128183640 2024-09-13T06:11:02.808 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.805+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v35'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc3c000a4d0 con 0x558128183640 2024-09-13T06:11:02.808 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.805+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581281a0e50 con 0x7fc3bc037040 2024-09-13T06:11:02.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.805+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v35'47 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc3c000a4d0 con 0x7fc3bc037040 2024-09-13T06:11:02.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.805+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581281a0f60 con 0x7fc3b80ab030 2024-09-13T06:11:02.813 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.809+0000 7fc3c74c8640 1 -- 172.21.15.194:0/2394773341 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v35'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc3bc00e620 con 0x7fc3b80ab030 2024-09-13T06:11:02.813 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.809+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581281a1610 con 0x558128188000 2024-09-13T06:11:02.814 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.809+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/2394773341 <== osd.3 v2:172.21.15.194:6816/96632515 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v35'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc3b80b3040 con 0x558128188000 2024-09-13T06:11:02.814 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.809+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581281a1610 con 0x7fc3b80ab030 2024-09-13T06:11:02.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.809+0000 7fc3c74c8640 1 -- 172.21.15.194:0/2394773341 <== osd.2 v2:172.21.15.194:6800/815615585 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v35'72 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc3bc00e620 con 0x7fc3b80ab030 2024-09-13T06:11:02.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.809+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581281a1b80 con 0x7fc3bc037040 2024-09-13T06:11:02.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.813+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v35'32 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc3c000a4d0 con 0x7fc3bc037040 2024-09-13T06:11:02.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.813+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581281a1c10 con 0x7fc3b80ab030 2024-09-13T06:11:02.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.813+0000 7fc3c74c8640 1 -- 172.21.15.194:0/2394773341 <== osd.2 v2:172.21.15.194:6800/815615585 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v35'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc3bc00e620 con 0x7fc3b80ab030 2024-09-13T06:11:02.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.813+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581281a1ca0 con 0x7fc3bc037040 2024-09-13T06:11:02.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.817+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v35'53 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc3c000a4d0 con 0x7fc3bc037040 2024-09-13T06:11:02.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.817+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581281a1ca0 con 0x558128183640 2024-09-13T06:11:02.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.817+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v35'225 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc3c000a4d0 con 0x558128183640 2024-09-13T06:11:02.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.817+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581281a1ca0 con 0x558128188000 2024-09-13T06:11:02.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.821+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/2394773341 <== osd.3 v2:172.21.15.194:6816/96632515 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v35'65 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc3b80b3040 con 0x558128188000 2024-09-13T06:11:02.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.821+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581281a1ca0 con 0x7fc3b80ab030 2024-09-13T06:11:02.824 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.821+0000 7fc3c74c8640 1 -- 172.21.15.194:0/2394773341 <== osd.2 v2:172.21.15.194:6800/815615585 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v35'73 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc3bc00e620 con 0x7fc3b80ab030 2024-09-13T06:11:02.824 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.821+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581281a20e0 con 0x558128188000 2024-09-13T06:11:02.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.821+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/2394773341 <== osd.3 v2:172.21.15.194:6816/96632515 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v35'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc3b80b3040 con 0x558128188000 2024-09-13T06:11:02.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.821+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581281a1610 con 0x558128183640 2024-09-13T06:11:02.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.821+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.1 v2:172.21.15.194:6808/3135444559 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v35'35 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc3c000a4d0 con 0x558128183640 2024-09-13T06:11:02.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.825+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581281a20e0 con 0x558128183640 2024-09-13T06:11:02.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.825+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.1 v2:172.21.15.194:6808/3135444559 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v35'226 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc3c000a4d0 con 0x558128183640 2024-09-13T06:11:02.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.825+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581281a20e0 con 0x558128188000 2024-09-13T06:11:02.830 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.825+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/2394773341 <== osd.3 v2:172.21.15.194:6816/96632515 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v35'66 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc3b80b3040 con 0x558128188000 2024-09-13T06:11:02.830 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.825+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581281a20e0 con 0x7fc3b80ab030 2024-09-13T06:11:02.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.825+0000 7fc3c74c8640 1 -- 172.21.15.194:0/2394773341 <== osd.2 v2:172.21.15.194:6800/815615585 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v35'37 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc3bc00e620 con 0x7fc3b80ab030 2024-09-13T06:11:02.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.825+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581281a20e0 con 0x558128188000 2024-09-13T06:11:02.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.829+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/2394773341 <== osd.3 v2:172.21.15.194:6816/96632515 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v35'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc3b80b3040 con 0x558128188000 2024-09-13T06:11:02.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.829+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581281a20e0 con 0x558128188000 2024-09-13T06:11:02.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.829+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/2394773341 <== osd.3 v2:172.21.15.194:6816/96632515 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v35'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc3b80b3040 con 0x558128188000 2024-09-13T06:11:02.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.829+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581281a20e0 con 0x558128188000 2024-09-13T06:11:02.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.829+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/2394773341 <== osd.3 v2:172.21.15.194:6816/96632515 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v35'23 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc3b80b3040 con 0x558128188000 2024-09-13T06:11:02.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.829+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581281a20e0 con 0x558128188000 2024-09-13T06:11:02.835 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.829+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/2394773341 <== osd.3 v2:172.21.15.194:6816/96632515 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v35'49 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc3b80b3040 con 0x558128188000 2024-09-13T06:11:02.835 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.829+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581281a20e0 con 0x7fc3bc037040 2024-09-13T06:11:02.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.833+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v35'31 uv25 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc3c000a4d0 con 0x7fc3bc037040 2024-09-13T06:11:02.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.833+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581281a20e0 con 0x558128188000 2024-09-13T06:11:02.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.833+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/2394773341 <== osd.3 v2:172.21.15.194:6816/96632515 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v35'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc3b80b3040 con 0x558128188000 2024-09-13T06:11:02.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.833+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581281a20e0 con 0x7fc3bc037040 2024-09-13T06:11:02.840 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.837+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.0 v2:172.21.15.120:6800/1923744619 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v35'48 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc3c000a4d0 con 0x7fc3bc037040 2024-09-13T06:11:02.840 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.837+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581281a20e0 con 0x558128188000 2024-09-13T06:11:02.842 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.837+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/2394773341 <== osd.3 v2:172.21.15.194:6816/96632515 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v35'67 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc3b80b3040 con 0x558128188000 2024-09-13T06:11:02.843 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.837+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581281a20e0 con 0x7fc3bc037040 2024-09-13T06:11:02.845 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.841+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.0 v2:172.21.15.120:6800/1923744619 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v35'54 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc3c000a4d0 con 0x7fc3bc037040 2024-09-13T06:11:02.845 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.841+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581281a20e0 con 0x7fc3b80ab030 2024-09-13T06:11:02.847 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.841+0000 7fc3c74c8640 1 -- 172.21.15.194:0/2394773341 <== osd.2 v2:172.21.15.194:6800/815615585 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v35'34 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc3bc00e620 con 0x7fc3b80ab030 2024-09-13T06:11:02.847 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.841+0000 7fc27cfe1640 20 reqs_thread_entry: start 2024-09-13T06:11:02.847 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.841+0000 7fc3ca1b9980 20 init_complete bucket index max shards: 11 2024-09-13T06:11:02.847 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.841+0000 7fc3ca1b9980 20 Filter name: none 2024-09-13T06:11:02.847 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.841+0000 7fc1f67fc640 20 reqs_thread_entry: start 2024-09-13T06:11:02.848 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.841+0000 7fc3ca1b9980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T06:11:02.848 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.841+0000 7fc3ca1b9980 20 rados->read ofs=0 len=0 2024-09-13T06:11:02.848 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.841+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55812819eab0 con 0x7fc3bc037040 2024-09-13T06:11:02.848 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.845+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.0 v2:172.21.15.120:6800/1923744619 22 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fc3c000a4d0 con 0x7fc3bc037040 2024-09-13T06:11:02.848 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.845+0000 7fc3ca1b9980 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T06:11:02.849 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.845+0000 7fc3ca1b9980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-13T06:11:02.849 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.845+0000 7fc3ca1b9980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T06:11:02.849 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.845+0000 7fc3ca1b9980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:11:02.849 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.845+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55812819e600 con 0x7fc3bc037040 2024-09-13T06:11:02.850 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.845+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.0 v2:172.21.15.120:6800/1923744619 23 ==== osd_op_reply(95 fud.buckets [call out=186b] v0'0 uv9 ondisk = 0) ==== 155+0+186 (crc 0 0 0) 0x7fc3c000a4d0 con 0x7fc3bc037040 2024-09-13T06:11:02.850 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.845+0000 7fc3ca1b9980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo7:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10 : miss 2024-09-13T06:11:02.850 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.845+0000 7fc3ca1b9980 20 rados->read ofs=0 len=0 2024-09-13T06:11:02.850 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.845+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:96 8.2 8:42de8843:root::.bucket.meta.myfoo7%3a52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5581281bf5f0 con 0x7fc3b80ab030 2024-09-13T06:11:02.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.845+0000 7fc3c74c8640 1 -- 172.21.15.194:0/2394773341 <== osd.2 v2:172.21.15.194:6800/815615585 21 ==== osd_op_reply(96 .bucket.meta.myfoo7:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10 [call out=48b,stat out=16b,read 0~382 out=382b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 334+0+664 (crc 0 0 0) 0x7fc3bc00e620 con 0x7fc3b80ab030 2024-09-13T06:11:02.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.845+0000 7fc3ca1b9980 20 rados_obj.operate() r=0 bl.length=382 2024-09-13T06:11:02.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.845+0000 7fc3ca1b9980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo7:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10 info.flags=0x17 2024-09-13T06:11:02.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.845+0000 7fc3ca1b9980 10 adding default.rgw.meta+root+.bucket.meta.myfoo7:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10 to cache LRU end 2024-09-13T06:11:02.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.845+0000 7fc3ca1b9980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:11:02.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.845+0000 7fc3ca1b9980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T06:11:02.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.845+0000 7fc3ca1b9980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo7:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10 2024-09-13T06:11:02.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.845+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:97 4.14 4:2987e477:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55812823cac0 con 0x558128188000 2024-09-13T06:11:02.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.845+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/2394773341 <== osd.3 v2:172.21.15.194:6816/96632515 27 ==== osd_op_reply(97 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.0 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc3b80b3040 con 0x558128188000 2024-09-13T06:11:02.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.845+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:98 4.b 4:d1522d47:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55812823cac0 con 0x7fc3b80ab030 2024-09-13T06:11:02.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.845+0000 7fc3c74c8640 1 -- 172.21.15.194:0/2394773341 <== osd.2 v2:172.21.15.194:6800/815615585 22 ==== osd_op_reply(98 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.1 [call out=85b] v0'0 uv4 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc3bc00e620 con 0x7fc3b80ab030 2024-09-13T06:11:02.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.845+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:99 4.39 4:9cc04ebf:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55812823cac0 con 0x558128188000 2024-09-13T06:11:02.854 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.849+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/2394773341 <== osd.3 v2:172.21.15.194:6816/96632515 28 ==== osd_op_reply(99 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc3b80b3040 con 0x558128188000 2024-09-13T06:11:02.854 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.849+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:100 4.34 4:2c4abcba:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55812823cac0 con 0x7fc3b80ab030 2024-09-13T06:11:02.854 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.849+0000 7fc3c74c8640 1 -- 172.21.15.194:0/2394773341 <== osd.2 v2:172.21.15.194:6800/815615585 23 ==== osd_op_reply(100 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc3bc00e620 con 0x7fc3b80ab030 2024-09-13T06:11:02.854 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.849+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:101 4.2c 4:35b5ad37:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55812823cac0 con 0x558128183640 2024-09-13T06:11:02.854 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.849+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.1 v2:172.21.15.194:6808/3135444559 27 ==== osd_op_reply(101 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.4 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc3c000a4d0 con 0x558128183640 2024-09-13T06:11:02.854 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.849+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:102 4.3f 4:fc2b6f9a:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55812823cac0 con 0x7fc3b80ab030 2024-09-13T06:11:02.854 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.849+0000 7fc3c74c8640 1 -- 172.21.15.194:0/2394773341 <== osd.2 v2:172.21.15.194:6800/815615585 24 ==== osd_op_reply(102 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.5 [call out=378b] v0'0 uv5 ondisk = 0) ==== 195+0+378 (crc 0 0 0) 0x7fc3bc00e620 con 0x7fc3b80ab030 2024-09-13T06:11:02.854 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.849+0000 7fc3ca1b9980 10 cls_bucket_list_unordered: got fourteen 2024-09-13T06:11:02.854 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.849+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:103 4.10 4:0baa72fc:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55812823cac0 con 0x558128188000 2024-09-13T06:11:02.854 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.849+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/2394773341 <== osd.3 v2:172.21.15.194:6816/96632515 29 ==== osd_op_reply(103 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc3b80b3040 con 0x558128188000 2024-09-13T06:11:02.854 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.849+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:104 4.10 4:091998b3:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55812823ca80 con 0x558128188000 2024-09-13T06:11:02.855 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.849+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/2394773341 <== osd.3 v2:172.21.15.194:6816/96632515 30 ==== osd_op_reply(104 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.7 [call out=85b] v0'0 uv4 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc3b8135060 con 0x558128188000 2024-09-13T06:11:02.855 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.849+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:105 4.36 4:6cca1597:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55812823ca80 con 0x558128183640 2024-09-13T06:11:02.855 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.849+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.1 v2:172.21.15.194:6808/3135444559 28 ==== osd_op_reply(105 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc3c000a4d0 con 0x558128183640 2024-09-13T06:11:02.855 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.849+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:106 4.4 4:227edc07:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55812823ca60 con 0x7fc3bc037040 2024-09-13T06:11:02.856 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.849+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.0 v2:172.21.15.120:6800/1923744619 24 ==== osd_op_reply(106 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.9 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc3c000a4d0 con 0x7fc3bc037040 2024-09-13T06:11:02.856 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.849+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:107 4.3e 4:7fa4dae7:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55812823ca60 con 0x7fc3b80ab030 2024-09-13T06:11:02.856 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.849+0000 7fc3c74c8640 1 -- 172.21.15.194:0/2394773341 <== osd.2 v2:172.21.15.194:6800/815615585 25 ==== osd_op_reply(107 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.10 [call out=85b] v0'0 uv5 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7fc3bc00e620 con 0x7fc3b80ab030 2024-09-13T06:11:02.856 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.849+0000 7fc3ca1b9980 20 get_obj_state: octx=0x7fc3bc02d040 obj=myfoo7:fourteen state=0x55812823aba8 s->prefetch_data=0 2024-09-13T06:11:02.856 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.849+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:108 3.27s0 3:e5d14bed:::52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10_fourteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55812823b9d0 con 0x7fc3bc037040 2024-09-13T06:11:02.856 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.853+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.0 v2:172.21.15.120:6800/1923744619 25 ==== osd_op_reply(108 52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10_fourteen [getxattrs out=858b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 239+0+874 (crc 0 0 0) 0x7fc3c003c040 con 0x7fc3bc037040 2024-09-13T06:11:02.856 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.853+0000 7fc3ca1b9980 10 manifest: total_size = 8 2024-09-13T06:11:02.856 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.853+0000 7fc3ca1b9980 20 get_obj_state: setting s->obj_tag to 52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.14216404290125511141 2024-09-13T06:11:02.857 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.853+0000 7fc3ca1b9980 20 get_obj_state: octx=0x7fc3bc02d040 obj=myfoo7:fourteen state=0x55812823aba8 s->prefetch_data=0 2024-09-13T06:11:02.857 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.853+0000 7fc3ca1b9980 20 prepare_atomic_modification: state is not atomic. state=0x55812823aba8 2024-09-13T06:11:02.857 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.853+0000 7fc3ca1b9980 20 bucket index object: :.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.5 2024-09-13T06:11:02.857 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.853+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:109 4.3f 4:fc2b6f9a:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=188b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55812823c290 con 0x7fc3b80ab030 2024-09-13T06:11:02.857 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.853+0000 7fc3c74c8640 1 -- 172.21.15.194:0/2394773341 <== osd.2 v2:172.21.15.194:6800/815615585 26 ==== osd_op_reply(109 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.5 [stat,call,call] v35'6 uv6 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fc3bc00e620 con 0x7fc3b80ab030 2024-09-13T06:11:02.857 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.853+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:110 3.27s0 3:e5d14bed:::52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10_fourteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55812823c290 con 0x7fc3bc037040 2024-09-13T06:11:02.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.857+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.0 v2:172.21.15.120:6800/1923744619 26 ==== osd_op_reply(110 52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10_fourteen [call] v35'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7fc3c003c040 con 0x7fc3bc037040 2024-09-13T06:11:02.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.857+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:111 4.3f 4:fc2b6f9a:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=265b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581281c41a0 con 0x7fc3b80ab030 2024-09-13T06:11:02.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.857+0000 7fc3ca1b9980 20 list_objects_ordered: starting attempt 1 2024-09-13T06:11:02.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.857+0000 7fc3ca1b9980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-13T06:11:02.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.857+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:112 4.14 4:2987e477:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5581281c41a0 con 0x558128188000 2024-09-13T06:11:02.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.857+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:113 4.b 4:d1522d47:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5581281c8400 con 0x7fc3b80ab030 2024-09-13T06:11:02.861 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.857+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:114 4.39 4:9cc04ebf:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5581281cad60 con 0x558128188000 2024-09-13T06:11:02.861 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.857+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:115 4.34 4:2c4abcba:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5581281cd810 con 0x7fc3b80ab030 2024-09-13T06:11:02.861 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.857+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:116 4.2c 4:35b5ad37:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5581281d0100 con 0x558128183640 2024-09-13T06:11:02.863 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.857+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:117 4.3f 4:fc2b6f9a:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5581281cd810 con 0x7fc3b80ab030 2024-09-13T06:11:02.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.857+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:118 4.10 4:0baa72fc:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5581281cad60 con 0x558128188000 2024-09-13T06:11:02.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.857+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:119 4.10 4:091998b3:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5581281d7810 con 0x558128188000 2024-09-13T06:11:02.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.857+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:120 4.36 4:6cca1597:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5581281da690 con 0x558128183640 2024-09-13T06:11:02.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.857+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:121 4.4 4:227edc07:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5581281dd490 con 0x7fc3bc037040 2024-09-13T06:11:02.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.857+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:122 4.3e 4:7fa4dae7:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5581281e0310 con 0x7fc3b80ab030 2024-09-13T06:11:02.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.857+0000 7fc3c74c8640 1 -- 172.21.15.194:0/2394773341 <== osd.2 v2:172.21.15.194:6800/815615585 27 ==== osd_op_reply(113 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.1 [call out=85b] v0'0 uv4 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc3bc00e620 con 0x7fc3b80ab030 2024-09-13T06:11:02.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.857+0000 7fc3c74c8640 1 -- 172.21.15.194:0/2394773341 <== osd.2 v2:172.21.15.194:6800/815615585 28 ==== osd_op_reply(115 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc3bc00e620 con 0x7fc3b80ab030 2024-09-13T06:11:02.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.857+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.1 v2:172.21.15.194:6808/3135444559 29 ==== osd_op_reply(116 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.4 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc3c003c040 con 0x558128183640 2024-09-13T06:11:02.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.857+0000 7fc3c74c8640 1 -- 172.21.15.194:0/2394773341 <== osd.2 v2:172.21.15.194:6800/815615585 29 ==== osd_op_reply(122 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.10 [call out=85b] v0'0 uv5 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7fc3bc00e620 con 0x7fc3b80ab030 2024-09-13T06:11:02.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.857+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.1 v2:172.21.15.194:6808/3135444559 30 ==== osd_op_reply(120 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc3c003c040 con 0x558128183640 2024-09-13T06:11:02.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.857+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.0 v2:172.21.15.120:6800/1923744619 27 ==== osd_op_reply(121 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.9 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc3c003c040 con 0x7fc3bc037040 2024-09-13T06:11:02.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.857+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/2394773341 <== osd.3 v2:172.21.15.194:6816/96632515 31 ==== osd_op_reply(114 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc3b8135060 con 0x558128188000 2024-09-13T06:11:02.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.857+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/2394773341 <== osd.3 v2:172.21.15.194:6816/96632515 32 ==== osd_op_reply(112 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.0 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc3b8135060 con 0x558128188000 2024-09-13T06:11:02.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.857+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/2394773341 <== osd.3 v2:172.21.15.194:6816/96632515 33 ==== osd_op_reply(118 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc3b8135060 con 0x558128188000 2024-09-13T06:11:02.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.857+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/2394773341 <== osd.3 v2:172.21.15.194:6816/96632515 34 ==== osd_op_reply(119 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.7 [call out=85b] v0'0 uv4 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc3b8135060 con 0x558128188000 2024-09-13T06:11:02.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.857+0000 7fc3c74c8640 1 -- 172.21.15.194:0/2394773341 <== osd.2 v2:172.21.15.194:6800/815615585 30 ==== osd_op_reply(111 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.5 [stat,call,call] v35'7 uv7 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fc3bc00e620 con 0x7fc3b80ab030 2024-09-13T06:11:02.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.857+0000 7fc2a6ffd640 20 handle_completion(): completion ok for obj=fourteen 2024-09-13T06:11:02.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.857+0000 7fc3c74c8640 1 -- 172.21.15.194:0/2394773341 <== osd.2 v2:172.21.15.194:6800/815615585 31 ==== osd_op_reply(117 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.5 [call out=124b] v0'0 uv7 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7fc3bc00e620 con 0x7fc3b80ab030 2024-09-13T06:11:02.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.857+0000 7fc3ca1b9980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-13T06:11:02.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.857+0000 7fc3ca1b9980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-13T06:11:02.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.857+0000 7fc3ca1b9980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-13T06:11:02.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.857+0000 7fc3ca1b9980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-13T06:11:02.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.857+0000 7fc3ca1b9980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo7[52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10])"; uploads.size()=0; is_truncated=0 2024-09-13T06:11:02.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.857+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:123 4.14 4:2987e477:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5581281dd490 con 0x558128188000 2024-09-13T06:11:02.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.857+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:124 4.b 4:d1522d47:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5581281d7790 con 0x7fc3b80ab030 2024-09-13T06:11:02.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.857+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:125 4.39 4:9cc04ebf:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5581281dfcc0 con 0x558128188000 2024-09-13T06:11:02.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.857+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:126 4.34 4:2c4abcba:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5581281c8820 con 0x7fc3b80ab030 2024-09-13T06:11:02.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.857+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:127 4.2c 4:35b5ad37:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5581281cacd0 con 0x558128183640 2024-09-13T06:11:02.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.857+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:128 4.3f 4:fc2b6f9a:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5581281d7790 con 0x7fc3b80ab030 2024-09-13T06:11:02.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.857+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:129 4.10 4:0baa72fc:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5581281dfcc0 con 0x558128188000 2024-09-13T06:11:02.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.857+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:130 4.10 4:091998b3:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5581281d7790 con 0x558128188000 2024-09-13T06:11:02.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.857+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:131 4.36 4:6cca1597:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5581281dd490 con 0x558128183640 2024-09-13T06:11:02.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.857+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:132 4.4 4:227edc07:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5581281cacd0 con 0x7fc3bc037040 2024-09-13T06:11:02.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.857+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:133 4.3e 4:7fa4dae7:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5581281c8820 con 0x7fc3b80ab030 2024-09-13T06:11:02.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.857+0000 7fc3c74c8640 1 -- 172.21.15.194:0/2394773341 <== osd.2 v2:172.21.15.194:6800/815615585 32 ==== osd_op_reply(128 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.5 [call out=124b] v0'0 uv7 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7fc3bc00e620 con 0x7fc3b80ab030 2024-09-13T06:11:02.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.857+0000 7fc3c74c8640 1 -- 172.21.15.194:0/2394773341 <== osd.2 v2:172.21.15.194:6800/815615585 33 ==== osd_op_reply(126 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc3bc00e620 con 0x7fc3b80ab030 2024-09-13T06:11:02.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.857+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.1 v2:172.21.15.194:6808/3135444559 31 ==== osd_op_reply(127 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.4 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc3c003c040 con 0x558128183640 2024-09-13T06:11:02.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.857+0000 7fc3c74c8640 1 -- 172.21.15.194:0/2394773341 <== osd.2 v2:172.21.15.194:6800/815615585 34 ==== osd_op_reply(133 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.10 [call out=85b] v0'0 uv5 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7fc3bc00e620 con 0x7fc3b80ab030 2024-09-13T06:11:02.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.857+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/2394773341 <== osd.3 v2:172.21.15.194:6816/96632515 35 ==== osd_op_reply(123 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.0 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc3b8135060 con 0x558128188000 2024-09-13T06:11:02.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.857+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.1 v2:172.21.15.194:6808/3135444559 32 ==== osd_op_reply(131 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc3c003c040 con 0x558128183640 2024-09-13T06:11:02.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.857+0000 7fc3c74c8640 1 -- 172.21.15.194:0/2394773341 <== osd.2 v2:172.21.15.194:6800/815615585 35 ==== osd_op_reply(124 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.1 [call out=85b] v0'0 uv4 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc3bc00e620 con 0x7fc3b80ab030 2024-09-13T06:11:02.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.857+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/2394773341 <== osd.3 v2:172.21.15.194:6816/96632515 36 ==== osd_op_reply(125 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc3b8135060 con 0x558128188000 2024-09-13T06:11:02.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.857+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/2394773341 <== osd.3 v2:172.21.15.194:6816/96632515 37 ==== osd_op_reply(129 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc3b8135060 con 0x558128188000 2024-09-13T06:11:02.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.857+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.0 v2:172.21.15.120:6800/1923744619 28 ==== osd_op_reply(132 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.9 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc3c003c040 con 0x7fc3bc037040 2024-09-13T06:11:02.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.857+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/2394773341 <== osd.3 v2:172.21.15.194:6816/96632515 38 ==== osd_op_reply(130 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.7 [call out=85b] v0'0 uv4 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc3b8135060 con 0x558128188000 2024-09-13T06:11:02.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.857+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:134 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55812823b860 con 0x7fc3bc037040 2024-09-13T06:11:02.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.861+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.0 v2:172.21.15.120:6800/1923744619 29 ==== osd_op_reply(134 fud.buckets [call] v35'10 uv10 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fc3c003c040 con 0x7fc3bc037040 2024-09-13T06:11:02.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.861+0000 7fc3ca1b9980 10 cache get: name=default.rgw.meta+root+myfoo7 : miss 2024-09-13T06:11:02.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.861+0000 7fc3ca1b9980 20 rados->read ofs=0 len=0 2024-09-13T06:11:02.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.861+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:135 8.9 8:938c738d:root::myfoo7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5581281dd490 con 0x7fc3b80ab030 2024-09-13T06:11:02.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.861+0000 7fc3c74c8640 1 -- 172.21.15.194:0/2394773341 <== osd.2 v2:172.21.15.194:6800/815615585 36 ==== osd_op_reply(135 myfoo7 [call out=48b,read 0~168 out=168b] v0'0 uv44 ondisk = 0) ==== 192+0+216 (crc 0 0 0) 0x7fc3bc00e620 con 0x7fc3b80ab030 2024-09-13T06:11:02.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.861+0000 7fc3ca1b9980 20 rados_obj.operate() r=0 bl.length=168 2024-09-13T06:11:02.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.861+0000 7fc3ca1b9980 10 cache put: name=default.rgw.meta+root+myfoo7 info.flags=0x11 2024-09-13T06:11:02.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.861+0000 7fc3ca1b9980 10 adding default.rgw.meta+root+myfoo7 to cache LRU end 2024-09-13T06:11:02.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.861+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:136 8.9 8:938c738d:root::myfoo7:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581281c8780 con 0x7fc3b80ab030 2024-09-13T06:11:02.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.865+0000 7fc3c74c8640 1 -- 172.21.15.194:0/2394773341 <== osd.2 v2:172.21.15.194:6800/815615585 37 ==== osd_op_reply(136 myfoo7 [call,call,delete] v35'45 uv45 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7fc3bc00e620 con 0x7fc3b80ab030 2024-09-13T06:11:02.870 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.865+0000 7fc3ca1b9980 10 removing default.rgw.meta+root+myfoo7 from cache 2024-09-13T06:11:02.870 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.865+0000 7fc3ca1b9980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo7, ofs0, ns] 2024-09-13T06:11:02.870 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.865+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94013212100480 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5581281dccf0 con 0x7fc3b80ab030 2024-09-13T06:11:02.870 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.865+0000 7fc3c74c8640 1 -- 172.21.15.194:0/2394773341 <== osd.2 v2:172.21.15.194:6800/815615585 38 ==== watch-notify(notify (1) cookie 94013211865728 notify 150323855378 ret 0) ==== 192+0+0 (crc 0 0 0) 0x5581281beb50 con 0x7fc3b80ab030 2024-09-13T06:11:02.870 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.865+0000 7fc2a6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855378 cookie 94013211865728 notifier 4759 bl.length()=150 2024-09-13T06:11:02.870 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.865+0000 7fc3c74c8640 1 -- 172.21.15.194:0/2394773341 <== osd.2 v2:172.21.15.194:6800/815615585 39 ==== osd_op_reply(137 notify.3 [notify cookie 94013212100480 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc3bc00e620 con 0x7fc3b80ab030 2024-09-13T06:11:02.870 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.865+0000 7fc2a6ffd640 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fc28c003d70 con 0x7fc3b80ab030 2024-09-13T06:11:02.870 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.865+0000 7fc3c74c8640 1 -- 172.21.15.194:0/2394773341 <== osd.2 v2:172.21.15.194:6800/815615585 40 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3bc00e620 con 0x7fc3b80ab030 2024-09-13T06:11:02.870 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.865+0000 7fc3c74c8640 1 -- 172.21.15.194:0/2394773341 <== osd.2 v2:172.21.15.194:6800/815615585 41 ==== watch-notify(notify_complete (2) cookie 94013212100480 notify 150323855378 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5581281a0360 con 0x7fc3b80ab030 2024-09-13T06:11:02.870 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.865+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:139 8.2 8:42de8843:root::.bucket.meta.myfoo7%3a52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581281dfbb0 con 0x7fc3b80ab030 2024-09-13T06:11:02.871 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.865+0000 7fc3c74c8640 1 -- 172.21.15.194:0/2394773341 <== osd.2 v2:172.21.15.194:6800/815615585 42 ==== osd_op_reply(139 .bucket.meta.myfoo7:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10 [call,call,delete] v35'4 uv4 ondisk = 0) ==== 292+0+0 (crc 0 0 0) 0x7fc3bc00e620 con 0x7fc3b80ab030 2024-09-13T06:11:02.871 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.865+0000 7fc3ca1b9980 10 removing default.rgw.meta+root+.bucket.meta.myfoo7:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10 from cache 2024-09-13T06:11:02.872 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.865+0000 7fc3ca1b9980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo7:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10, ofs0, ns] 2024-09-13T06:11:02.872 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.865+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:140 7.9 7:93e5b521:::notify.7:head [notify cookie 94013212100480 in=220b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5581281dfbb0 con 0x7fc3bc037040 2024-09-13T06:11:02.872 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.865+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.0 v2:172.21.15.120:6800/1923744619 30 ==== watch-notify(notify (1) cookie 94013211881072 notify 150323855402 ret 0) ==== 250+0+0 (crc 0 0 0) 0x5581281a0f60 con 0x7fc3bc037040 2024-09-13T06:11:02.872 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.865+0000 7fc2a67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855402 cookie 94013211881072 notifier 4759 bl.length()=208 2024-09-13T06:11:02.872 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.865+0000 7fc2a67fc640 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:141 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fc1fc0032d0 con 0x7fc3bc037040 2024-09-13T06:11:02.872 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.865+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.0 v2:172.21.15.120:6800/1923744619 31 ==== osd_op_reply(140 notify.7 [notify cookie 94013212100480 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc3c003c040 con 0x7fc3bc037040 2024-09-13T06:11:02.872 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.869+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.0 v2:172.21.15.120:6800/1923744619 32 ==== osd_op_reply(141 notify.7 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3c003c040 con 0x7fc3bc037040 2024-09-13T06:11:02.873 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.869+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.0 v2:172.21.15.120:6800/1923744619 33 ==== watch-notify(notify_complete (2) cookie 94013212100480 notify 150323855402 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5581281963e0 con 0x7fc3bc037040 2024-09-13T06:11:02.873 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.869+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:142 4.14 4:2987e477:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581281dfbb0 con 0x558128188000 2024-09-13T06:11:02.873 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.869+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:143 4.b 4:d1522d47:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581281d71b0 con 0x7fc3b80ab030 2024-09-13T06:11:02.873 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.869+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:144 4.39 4:9cc04ebf:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581281bdb40 con 0x558128188000 2024-09-13T06:11:02.873 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.869+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:145 4.34 4:2c4abcba:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581281be410 con 0x7fc3b80ab030 2024-09-13T06:11:02.873 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.869+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:146 4.2c 4:35b5ad37:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581281daec0 con 0x558128183640 2024-09-13T06:11:02.873 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.869+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:147 4.3f 4:fc2b6f9a:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581281dfbb0 con 0x7fc3b80ab030 2024-09-13T06:11:02.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.869+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:148 4.10 4:0baa72fc:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581281d71b0 con 0x558128188000 2024-09-13T06:11:02.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.869+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:149 4.10 4:091998b3:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581281bdb40 con 0x558128188000 2024-09-13T06:11:02.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.869+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:150 4.36 4:6cca1597:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581281daec0 con 0x558128183640 2024-09-13T06:11:02.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.869+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:151 4.4 4:227edc07:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581281d71b0 con 0x7fc3bc037040 2024-09-13T06:11:02.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.869+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:152 4.3e 4:7fa4dae7:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581281dcfa0 con 0x7fc3b80ab030 2024-09-13T06:11:02.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.869+0000 7fc3c74c8640 1 -- 172.21.15.194:0/2394773341 <== osd.2 v2:172.21.15.194:6800/815615585 43 ==== osd_op_reply(143 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.1 [delete] v35'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fc3bc00e620 con 0x7fc3b80ab030 2024-09-13T06:11:02.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.869+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.1 v2:172.21.15.194:6808/3135444559 33 ==== osd_op_reply(146 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.4 [delete] v35'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fc3c003c040 con 0x558128183640 2024-09-13T06:11:02.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.869+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/2394773341 <== osd.3 v2:172.21.15.194:6816/96632515 39 ==== osd_op_reply(142 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.0 [delete] v35'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fc3b8135060 con 0x558128188000 2024-09-13T06:11:02.876 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.873+0000 7fc3c74c8640 1 -- 172.21.15.194:0/2394773341 <== osd.2 v2:172.21.15.194:6800/815615585 44 ==== osd_op_reply(152 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.10 [delete] v35'6 uv6 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7fc3bc00e620 con 0x7fc3b80ab030 2024-09-13T06:11:02.876 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.873+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/2394773341 <== osd.3 v2:172.21.15.194:6816/96632515 40 ==== osd_op_reply(148 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.6 [delete] v35'5 uv5 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fc3b8135060 con 0x558128188000 2024-09-13T06:11:02.876 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.873+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/2394773341 <== osd.3 v2:172.21.15.194:6816/96632515 41 ==== osd_op_reply(144 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.2 [delete] v35'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fc3b8135060 con 0x558128188000 2024-09-13T06:11:02.876 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.873+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.0 v2:172.21.15.120:6800/1923744619 34 ==== osd_op_reply(151 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.9 [delete] v35'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fc3c003c040 con 0x7fc3bc037040 2024-09-13T06:11:02.879 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.873+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/2394773341 <== osd.3 v2:172.21.15.194:6816/96632515 42 ==== osd_op_reply(149 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.7 [delete] v35'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fc3b8135060 con 0x558128188000 2024-09-13T06:11:02.879 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.873+0000 7fc3c74c8640 1 -- 172.21.15.194:0/2394773341 <== osd.2 v2:172.21.15.194:6800/815615585 45 ==== osd_op_reply(145 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.3 [delete] v35'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fc3bc00e620 con 0x7fc3b80ab030 2024-09-13T06:11:02.879 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.873+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.1 v2:172.21.15.194:6808/3135444559 34 ==== osd_op_reply(150 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.8 [delete] v35'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fc3c003c040 con 0x558128183640 2024-09-13T06:11:02.879 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.873+0000 7fc3c74c8640 1 -- 172.21.15.194:0/2394773341 <== osd.2 v2:172.21.15.194:6800/815615585 46 ==== osd_op_reply(147 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10.5 [delete] v35'8 uv8 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fc3bc00e620 con 0x7fc3b80ab030 2024-09-13T06:11:02.879 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.873+0000 7fc3ca1b9980 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo7/52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10 : miss 2024-09-13T06:11:02.879 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.873+0000 7fc3ca1b9980 20 rados->read ofs=0 len=0 2024-09-13T06:11:02.879 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.873+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:153 6.b 6:d12939fb:::pubsub..bucket.myfoo7%2f52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5581281dfa80 con 0x558128188000 2024-09-13T06:11:02.879 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.873+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/2394773341 <== osd.3 v2:172.21.15.194:6816/96632515 43 ==== osd_op_reply(153 pubsub..bucket.myfoo7/52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7fc3b8135060 con 0x558128188000 2024-09-13T06:11:02.879 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.873+0000 7fc3ca1b9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:02.880 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.873+0000 7fc3ca1b9980 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo7/52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10 info.flags=0x0 2024-09-13T06:11:02.880 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.873+0000 7fc3ca1b9980 10 adding default.rgw.log++pubsub..bucket.myfoo7/52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10 to cache LRU end 2024-09-13T06:11:02.880 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.873+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:154 6.b 6:d12939fb:::pubsub..bucket.myfoo7%2f52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581281c8760 con 0x558128188000 2024-09-13T06:11:02.880 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.877+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/2394773341 <== osd.3 v2:172.21.15.194:6816/96632515 44 ==== osd_op_reply(154 pubsub..bucket.myfoo7/52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.10 [delete] v35'28 uv21 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7fc3b8135060 con 0x558128188000 2024-09-13T06:11:02.880 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.877+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:155 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=147b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581281c8760 con 0x7fc3bc037040 2024-09-13T06:11:02.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.877+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.0 v2:172.21.15.120:6800/1923744619 35 ==== osd_op_reply(155 fud.buckets [call] v35'11 uv11 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fc3c003c040 con 0x7fc3bc037040 2024-09-13T06:11:02.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.877+0000 7fc3ca1b9980 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-13T06:11:02.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.877+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:156 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581281c8760 con 0x7fc3bc037040 2024-09-13T06:11:02.884 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.881+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.0 v2:172.21.15.120:6800/1923744619 36 ==== osd_op_reply(156 p5YnriCv1nAtykxBrupQ [delete] v35'10 uv10 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fc3c003c040 con 0x7fc3bc037040 2024-09-13T06:11:02.885 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.881+0000 7fc3ca1b9980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-13T06:11:02.885 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.881+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:157 7.15 7:a93a5511:::notify.2:head [notify cookie 94013212063072 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5581281dfa80 con 0x558128188000 2024-09-13T06:11:02.885 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.881+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/2394773341 <== osd.3 v2:172.21.15.194:6816/96632515 45 ==== watch-notify(notify (1) cookie 94013211868448 notify 150323855377 ret 0) ==== 212+0+0 (crc 0 0 0) 0x558128165890 con 0x558128188000 2024-09-13T06:11:02.885 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.881+0000 7fc2a6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855377 cookie 94013211868448 notifier 4759 bl.length()=170 2024-09-13T06:11:02.885 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.881+0000 7fc2a6ffd640 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:158 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fc28c003d70 con 0x558128188000 2024-09-13T06:11:02.885 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.881+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/2394773341 <== osd.3 v2:172.21.15.194:6816/96632515 46 ==== osd_op_reply(157 notify.2 [notify cookie 94013212063072 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc3b8135060 con 0x558128188000 2024-09-13T06:11:02.885 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.881+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/2394773341 <== osd.3 v2:172.21.15.194:6816/96632515 47 ==== osd_op_reply(158 notify.2 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3b8135060 con 0x558128188000 2024-09-13T06:11:02.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.881+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/2394773341 <== osd.3 v2:172.21.15.194:6816/96632515 48 ==== watch-notify(notify_complete (2) cookie 94013212063072 notify 150323855377 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558128165600 con 0x558128188000 2024-09-13T06:11:02.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.881+0000 7fc3ca1b9980 10 removing email index: 2024-09-13T06:11:02.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.881+0000 7fc3ca1b9980 10 removing user buckets index 2024-09-13T06:11:02.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.881+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:159 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581281c8760 con 0x7fc3bc037040 2024-09-13T06:11:02.887 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.885+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.0 v2:172.21.15.120:6800/1923744619 37 ==== osd_op_reply(159 fud.buckets [delete] v35'12 uv12 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fc3c003c040 con 0x7fc3bc037040 2024-09-13T06:11:02.887 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.885+0000 7fc3ca1b9980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-09-13T06:11:02.887 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.885+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94013212063072 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5581281dfa80 con 0x7fc3bc037040 2024-09-13T06:11:02.888 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.885+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.0 v2:172.21.15.120:6800/1923744619 38 ==== watch-notify(notify (1) cookie 94013211879504 notify 150323855403 ret 0) ==== 202+0+0 (crc 0 0 0) 0x5581281963e0 con 0x7fc3bc037040 2024-09-13T06:11:02.888 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.885+0000 7fc2a67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855403 cookie 94013211879504 notifier 4759 bl.length()=160 2024-09-13T06:11:02.888 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.885+0000 7fc2a67fc640 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fc1fc0032b0 con 0x7fc3bc037040 2024-09-13T06:11:02.888 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.885+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.0 v2:172.21.15.120:6800/1923744619 39 ==== osd_op_reply(160 notify.6 [notify cookie 94013212063072 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc3c003c040 con 0x7fc3bc037040 2024-09-13T06:11:02.889 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.885+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.0 v2:172.21.15.120:6800/1923744619 40 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3c003c040 con 0x7fc3bc037040 2024-09-13T06:11:02.889 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.885+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.0 v2:172.21.15.120:6800/1923744619 41 ==== watch-notify(notify_complete (2) cookie 94013212063072 notify 150323855403 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558128195d60 con 0x7fc3bc037040 2024-09-13T06:11:02.889 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.885+0000 7fc3ca1b9980 10 removing user index: fud 2024-09-13T06:11:02.889 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.885+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:162 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581281be4f0 con 0x7fc3bc037040 2024-09-13T06:11:02.891 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.889+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.0 v2:172.21.15.120:6800/1923744619 42 ==== osd_op_reply(162 fud [call,call,delete] v35'9 uv9 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fc3c003c040 con 0x7fc3bc037040 2024-09-13T06:11:02.891 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.889+0000 7fc3ca1b9980 10 removing default.rgw.meta+users.uid+fud from cache 2024-09-13T06:11:02.892 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.889+0000 7fc3ca1b9980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-13T06:11:02.892 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.889+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94013212063072 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5581281be4f0 con 0x7fc3bc037040 2024-09-13T06:11:02.893 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.889+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.0 v2:172.21.15.120:6800/1923744619 43 ==== watch-notify(notify (1) cookie 94013211876576 notify 150323855404 ret 0) ==== 194+0+0 (crc 0 0 0) 0x558128195d60 con 0x7fc3bc037040 2024-09-13T06:11:02.893 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.889+0000 7fc2a6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855404 cookie 94013211876576 notifier 4759 bl.length()=152 2024-09-13T06:11:02.893 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.889+0000 7fc2a6ffd640 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fc28c003d70 con 0x7fc3bc037040 2024-09-13T06:11:02.893 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.889+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.0 v2:172.21.15.120:6800/1923744619 44 ==== osd_op_reply(163 notify.5 [notify cookie 94013212063072 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc3c003c040 con 0x7fc3bc037040 2024-09-13T06:11:02.893 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.889+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.0 v2:172.21.15.120:6800/1923744619 45 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3c003c040 con 0x7fc3bc037040 2024-09-13T06:11:02.893 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.889+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.0 v2:172.21.15.120:6800/1923744619 46 ==== watch-notify(notify_complete (2) cookie 94013212063072 notify 150323855404 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558128196650 con 0x7fc3bc037040 2024-09-13T06:11:02.894 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.889+0000 7fc27dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:11:02.894 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.889+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94013211896400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55812819f9a0 con 0x558128183640 2024-09-13T06:11:02.895 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.893+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.1 v2:172.21.15.194:6808/3135444559 35 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94013211896400] v35'227 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc3c003c040 con 0x558128183640 2024-09-13T06:11:02.895 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.893+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94013211859264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55812819f9a0 con 0x7fc3b80ab030 2024-09-13T06:11:02.897 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.893+0000 7fc3c74c8640 1 -- 172.21.15.194:0/2394773341 <== osd.2 v2:172.21.15.194:6800/815615585 47 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94013211859264] v35'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3bc00e620 con 0x7fc3b80ab030 2024-09-13T06:11:02.897 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.893+0000 7fc3ca1b9980 20 remove_watcher() i=0 2024-09-13T06:11:02.897 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.893+0000 7fc3ca1b9980 2 removed watcher, disabling cache 2024-09-13T06:11:02.897 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.893+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94013211863600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55812819f9a0 con 0x558128183640 2024-09-13T06:11:02.899 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.893+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.1 v2:172.21.15.194:6808/3135444559 36 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94013211863600] v35'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3c003c040 con 0x558128183640 2024-09-13T06:11:02.899 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.893+0000 7fc3ca1b9980 20 remove_watcher() i=1 2024-09-13T06:11:02.899 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.893+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94013211868448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55812819f9a0 con 0x558128188000 2024-09-13T06:11:02.901 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.897+0000 7fc3c7cc9640 1 -- 172.21.15.194:0/2394773341 <== osd.3 v2:172.21.15.194:6816/96632515 49 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94013211868448] v35'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3b8135060 con 0x558128188000 2024-09-13T06:11:02.901 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.897+0000 7fc3ca1b9980 20 remove_watcher() i=2 2024-09-13T06:11:02.901 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.897+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94013211865728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55812819f9a0 con 0x7fc3b80ab030 2024-09-13T06:11:02.902 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.897+0000 7fc3c74c8640 1 -- 172.21.15.194:0/2394773341 <== osd.2 v2:172.21.15.194:6800/815615585 48 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94013211865728] v35'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3bc00e620 con 0x7fc3b80ab030 2024-09-13T06:11:02.902 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.897+0000 7fc3ca1b9980 20 remove_watcher() i=3 2024-09-13T06:11:02.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.897+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94013211875520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55812819f9a0 con 0x558128183640 2024-09-13T06:11:02.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.901+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.1 v2:172.21.15.194:6808/3135444559 37 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94013211875520] v35'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3c003c040 con 0x558128183640 2024-09-13T06:11:02.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.901+0000 7fc3ca1b9980 20 remove_watcher() i=4 2024-09-13T06:11:02.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.901+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94013211876576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55812819f9a0 con 0x7fc3bc037040 2024-09-13T06:11:02.907 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.905+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.0 v2:172.21.15.120:6800/1923744619 47 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94013211876576] v35'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3c003c040 con 0x7fc3bc037040 2024-09-13T06:11:02.907 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.905+0000 7fc3ca1b9980 20 remove_watcher() i=5 2024-09-13T06:11:02.907 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.905+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94013211879504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55812819f9a0 con 0x7fc3bc037040 2024-09-13T06:11:02.909 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.905+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.0 v2:172.21.15.120:6800/1923744619 48 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94013211879504] v35'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3c003c040 con 0x7fc3bc037040 2024-09-13T06:11:02.909 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.905+0000 7fc3ca1b9980 20 remove_watcher() i=6 2024-09-13T06:11:02.910 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.905+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94013211881072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55812819f9a0 con 0x7fc3bc037040 2024-09-13T06:11:02.912 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.909+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 <== osd.0 v2:172.21.15.120:6800/1923744619 49 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94013211881072] v35'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3c003c040 con 0x7fc3bc037040 2024-09-13T06:11:02.912 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.909+0000 7fc3ca1b9980 20 remove_watcher() i=7 2024-09-13T06:11:02.915 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.909+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fc3bc037040 msgr2=0x7fc3bc036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:02.915 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.909+0000 7fc3ca1b9980 1 --2- 172.21.15.194:0/2394773341 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fc3bc037040 0x7fc3bc036410 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:02.916 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.909+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x558128183640 msgr2=0x558128185b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:02.916 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.909+0000 7fc3ca1b9980 1 --2- 172.21.15.194:0/2394773341 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x558128183640 0x558128185b00 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:02.916 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.909+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fc3b80ab030 msgr2=0x7fc3b80df880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:02.916 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.909+0000 7fc3ca1b9980 1 --2- 172.21.15.194:0/2394773341 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fc3b80ab030 0x7fc3b80df880 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:02.916 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.909+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x558128188000 msgr2=0x55812818a3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:02.916 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.909+0000 7fc3ca1b9980 1 --2- 172.21.15.194:0/2394773341 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x558128188000 0x55812818a3f0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:02.916 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.909+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fc290034650 msgr2=0x7fc290036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:02.916 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.909+0000 7fc3ca1b9980 1 --2- 172.21.15.194:0/2394773341 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fc290034650 0x7fc290036b10 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x558128157610 tx=0x7fc3bc010000 comp rx=0 tx=0).stop 2024-09-13T06:11:02.916 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.909+0000 7fc3c84ca640 1 -- 172.21.15.194:0/2394773341 reap_dead start 2024-09-13T06:11:02.916 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.909+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5581281715c0 msgr2=0x558128178650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:02.916 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.909+0000 7fc3ca1b9980 1 --2- 172.21.15.194:0/2394773341 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5581281715c0 0x558128178650 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fc3b80e5170 tx=0x7fc3b80d8f70 comp rx=0 tx=0).stop 2024-09-13T06:11:02.916 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.909+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 shutdown_connections 2024-09-13T06:11:02.917 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.909+0000 7fc3ca1b9980 1 --2- 172.21.15.194:0/2394773341 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5581281715c0 0x558128178650 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:02.917 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.909+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 >> 172.21.15.194:0/2394773341 conn(0x55812816d9f0 msgr2=0x55812816bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:02.917 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.909+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 shutdown_connections 2024-09-13T06:11:02.917 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.909+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/2394773341 wait complete. 2024-09-13T06:11:02.917 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.909+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/67841135 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fc2a0034600 msgr2=0x7fc2a0036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:02.917 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.909+0000 7fc3ca1b9980 1 --2- 172.21.15.194:0/67841135 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fc2a0034600 0x7fc2a0036ac0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc00bf60 tx=0x7fc3bc00f000 comp rx=0 tx=0).stop 2024-09-13T06:11:02.917 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.909+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/67841135 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558128164ca0 msgr2=0x5581281650c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:02.917 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.909+0000 7fc3ca1b9980 1 --2- 172.21.15.194:0/67841135 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558128164ca0 0x5581281650c0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fc3b80bffd0 tx=0x7fc3b80be670 comp rx=0 tx=0).stop 2024-09-13T06:11:02.917 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.909+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/67841135 shutdown_connections 2024-09-13T06:11:02.917 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.909+0000 7fc3ca1b9980 1 --2- 172.21.15.194:0/67841135 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fc2a0034600 0x7fc2a0036ac0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:02.917 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.909+0000 7fc3ca1b9980 1 --2- 172.21.15.194:0/67841135 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558128164ca0 0x5581281650c0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:02.917 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.909+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/67841135 >> 172.21.15.194:0/67841135 conn(0x558128159df0 msgr2=0x55812815c870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:02.917 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.909+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/67841135 shutdown_connections 2024-09-13T06:11:02.917 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.909+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/67841135 wait complete. 2024-09-13T06:11:02.918 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.909+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/543397685 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x558128057cc0 msgr2=0x55812814de70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:02.918 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.909+0000 7fc3ca1b9980 1 --2- 172.21.15.194:0/543397685 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x558128057cc0 0x55812814de70 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:02.918 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.909+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/543397685 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x558128154690 msgr2=0x558128156a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:02.918 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.909+0000 7fc3ca1b9980 1 --2- 172.21.15.194:0/543397685 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x558128154690 0x558128156a80 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:02.918 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.909+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/543397685 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x558128150790 msgr2=0x558128152b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:02.918 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.909+0000 7fc3ca1b9980 1 --2- 172.21.15.194:0/543397685 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x558128150790 0x558128152b80 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:02.918 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.909+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/543397685 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fc2b0034650 msgr2=0x7fc2b0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:02.918 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.909+0000 7fc3ca1b9980 1 --2- 172.21.15.194:0/543397685 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fc2b0034650 0x7fc2b0036b10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc000f70 tx=0x7fc3bc0012c0 comp rx=0 tx=0).stop 2024-09-13T06:11:02.918 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.909+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/543397685 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558127fc6ad0 msgr2=0x558128146ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:02.918 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.909+0000 7fc3ca1b9980 1 --2- 172.21.15.194:0/543397685 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558127fc6ad0 0x558128146ee0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fc3b80ab510 tx=0x7fc3b8018020 comp rx=0 tx=0).stop 2024-09-13T06:11:02.918 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.909+0000 7fc3c84ca640 1 -- 172.21.15.194:0/543397685 reap_dead start 2024-09-13T06:11:02.918 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.909+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/543397685 shutdown_connections 2024-09-13T06:11:02.918 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.909+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/543397685 >> 172.21.15.194:0/543397685 conn(0x55812804d070 msgr2=0x55812813a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:02.918 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.909+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/543397685 shutdown_connections 2024-09-13T06:11:02.919 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:02.909+0000 7fc3ca1b9980 1 -- 172.21.15.194:0/543397685 wait complete. 2024-09-13T06:11:42.927 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'trim', '--uid', 'foo'] 2024-09-13T06:11:42.928 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'trim', '--uid', 'foo'] 2024-09-13T06:11:42.929 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage trim --uid foo 2024-09-13T06:11:42.969 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:11:42.969 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:11:42.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.967+0000 7f4c8ceb7980 1 Processor -- start 2024-09-13T06:11:42.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.967+0000 7f4c8ceb7980 1 -- start start 2024-09-13T06:11:42.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.967+0000 7f4c8ceb7980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55ad5d849c60 0x55ad5d84c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:42.971 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.967+0000 7f4c8ceb7980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ad5d6cbae0 con 0x55ad5d8458e0 2024-09-13T06:11:42.971 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.967+0000 7f4c8ceb7980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x55ad5d6efe30 con 0x55ad5d849c60 2024-09-13T06:11:42.971 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.967+0000 7f4c8a9c7640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x55ad5d8458e0 0x55ad5d845cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:58288/0 (socket says 172.21.15.194:58288) 2024-09-13T06:11:42.972 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.967+0000 7f4c8a9c7640 1 -- 172.21.15.194:0/4149559298 learned_addr learned my addr 172.21.15.194:0/4149559298 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-09-13T06:11:42.972 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.967+0000 7f4c8a1c6640 1 --2- 172.21.15.194:0/4149559298 >> v2:172.21.15.120:3300/0 conn(0x55ad5d849c60 0x55ad5d84c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:42.972 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.967+0000 7f4c899c5640 1 -- 172.21.15.194:0/4149559298 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4169259838 0 0) 0x55ad5d6cbae0 con 0x55ad5d8458e0 2024-09-13T06:11:42.972 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.967+0000 7f4c899c5640 1 -- 172.21.15.194:0/4149559298 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c74001e20 con 0x55ad5d8458e0 2024-09-13T06:11:42.972 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.967+0000 7f4c8a1c6640 1 -- 172.21.15.194:0/4149559298 >> v1:172.21.15.120:6789/0 conn(0x55ad5d8458e0 legacy=0x55ad5d845cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:42.972 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.967+0000 7f4c8a1c6640 1 -- 172.21.15.194:0/4149559298 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad5d84d5a0 con 0x55ad5d849c60 2024-09-13T06:11:42.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.971+0000 7f4c8a1c6640 1 --2- 172.21.15.194:0/4149559298 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad5d849c60 0x55ad5d84c050 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f4c8000a480 tx=0x7f4c8001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84b48b04bf55d077 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:42.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.971+0000 7f4c899c5640 1 -- 172.21.15.194:0/4149559298 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c800b0070 con 0x55ad5d849c60 2024-09-13T06:11:42.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.971+0000 7f4c899c5640 1 -- 172.21.15.194:0/4149559298 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c800ab540 con 0x55ad5d849c60 2024-09-13T06:11:42.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.971+0000 7f4c899c5640 1 -- 172.21.15.194:0/4149559298 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c800ab820 con 0x55ad5d849c60 2024-09-13T06:11:42.975 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.971+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/4149559298 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad5d849c60 msgr2=0x55ad5d84c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:42.975 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.971+0000 7f4c8ceb7980 1 --2- 172.21.15.194:0/4149559298 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad5d849c60 0x55ad5d84c050 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f4c8000a480 tx=0x7f4c8001b280 comp rx=0 tx=0).stop 2024-09-13T06:11:42.975 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.971+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/4149559298 shutdown_connections 2024-09-13T06:11:42.975 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.971+0000 7f4c8ceb7980 1 --2- 172.21.15.194:0/4149559298 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad5d849c60 0x55ad5d84c050 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:42.975 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.971+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/4149559298 >> 172.21.15.194:0/4149559298 conn(0x55ad5d7b9230 msgr2=0x55ad5d7b9640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:42.975 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.971+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/4149559298 shutdown_connections 2024-09-13T06:11:42.975 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.971+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/4149559298 wait complete. 2024-09-13T06:11:42.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.987+0000 7f4c8ceb7980 1 Processor -- start 2024-09-13T06:11:42.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.987+0000 7f4c8ceb7980 1 -- start start 2024-09-13T06:11:42.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.987+0000 7f4c8ceb7980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad5d8458e0 0x55ad5d930a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:42.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.987+0000 7f4c8ceb7980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55ad5d6f1200 con 0x55ad5d8458e0 2024-09-13T06:11:42.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.987+0000 7f4c8a9c7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad5d8458e0 0x55ad5d930a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:42.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.987+0000 7f4c8a9c7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad5d8458e0 0x55ad5d930a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44482/0 (socket says 172.21.15.194:44482) 2024-09-13T06:11:42.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.987+0000 7f4c8a9c7640 1 -- 172.21.15.194:0/666288180 learned_addr learned my addr 172.21.15.194:0/666288180 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:42.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.991+0000 7f4c8a9c7640 1 -- 172.21.15.194:0/666288180 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad5d930ff0 con 0x55ad5d8458e0 2024-09-13T06:11:42.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.991+0000 7f4c8a9c7640 1 --2- 172.21.15.194:0/666288180 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad5d8458e0 0x55ad5d930a20 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c001dc0 tx=0x7f4c7c00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6c3467a01863a0c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:42.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.991+0000 7f4b78e09640 1 -- 172.21.15.194:0/666288180 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c7c012020 con 0x55ad5d8458e0 2024-09-13T06:11:42.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.991+0000 7f4b78e09640 1 -- 172.21.15.194:0/666288180 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c7c00e7c0 con 0x55ad5d8458e0 2024-09-13T06:11:42.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.991+0000 7f4b78e09640 1 -- 172.21.15.194:0/666288180 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c7c00eb40 con 0x55ad5d8458e0 2024-09-13T06:11:42.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.991+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/666288180 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad5d8458e0 msgr2=0x55ad5d930a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:42.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.991+0000 7f4c8ceb7980 1 --2- 172.21.15.194:0/666288180 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad5d8458e0 0x55ad5d930a20 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c001dc0 tx=0x7f4c7c00b6d0 comp rx=0 tx=0).stop 2024-09-13T06:11:42.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.991+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/666288180 shutdown_connections 2024-09-13T06:11:42.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.991+0000 7f4c8ceb7980 1 --2- 172.21.15.194:0/666288180 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad5d8458e0 0x55ad5d930a20 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:42.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.991+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/666288180 >> 172.21.15.194:0/666288180 conn(0x55ad5d7b9230 msgr2=0x55ad5d92c650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:42.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.991+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/666288180 shutdown_connections 2024-09-13T06:11:42.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.991+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/666288180 wait complete. 2024-09-13T06:11:42.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.991+0000 7f4c8ceb7980 1 Processor -- start 2024-09-13T06:11:42.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.991+0000 7f4c8ceb7980 1 -- start start 2024-09-13T06:11:42.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.991+0000 7f4c8ceb7980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad5d849c60 0x55ad5d938000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:42.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.991+0000 7f4c8ceb7980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55ad5d84d0a0 con 0x55ad5d849c60 2024-09-13T06:11:42.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.991+0000 7f4c8a9c7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad5d849c60 0x55ad5d938000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:42.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.991+0000 7f4c8a9c7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad5d849c60 0x55ad5d938000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44486/0 (socket says 172.21.15.194:44486) 2024-09-13T06:11:42.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.991+0000 7f4c8a9c7640 1 -- 172.21.15.194:0/1362374459 learned_addr learned my addr 172.21.15.194:0/1362374459 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:42.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.991+0000 7f4c8a9c7640 1 -- 172.21.15.194:0/1362374459 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad5d938540 con 0x55ad5d849c60 2024-09-13T06:11:42.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.991+0000 7f4c8a9c7640 1 --2- 172.21.15.194:0/1362374459 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad5d849c60 0x55ad5d938000 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x55ad5d931c00 tx=0x7f4c7c000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:42.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.991+0000 7f4b77606640 1 -- 172.21.15.194:0/1362374459 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c7c012030 con 0x55ad5d849c60 2024-09-13T06:11:42.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.995+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/1362374459 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ad5d9387d0 con 0x55ad5d849c60 2024-09-13T06:11:42.997 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.995+0000 7f4b77606640 1 -- 172.21.15.194:0/1362374459 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c7c001440 con 0x55ad5d849c60 2024-09-13T06:11:42.997 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.995+0000 7f4b77606640 1 -- 172.21.15.194:0/1362374459 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c7c01aa50 con 0x55ad5d849c60 2024-09-13T06:11:42.997 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.995+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/1362374459 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad5d93b4b0 con 0x55ad5d849c60 2024-09-13T06:11:42.998 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.995+0000 7f4b77606640 1 -- 172.21.15.194:0/1362374459 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4c7c015020 con 0x55ad5d849c60 2024-09-13T06:11:42.998 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.995+0000 7f4b77606640 1 --2- 172.21.15.194:0/1362374459 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4b70034650 0x7f4b70036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:42.998 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.995+0000 7f4b77606640 1 -- 172.21.15.194:0/1362374459 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f4c7c020030 con 0x55ad5d849c60 2024-09-13T06:11:42.998 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.995+0000 7f4c8a1c6640 1 --2- 172.21.15.194:0/1362374459 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4b70034650 0x7f4b70036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:42.998 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.995+0000 7f4c8ceb7980 1 --2- 172.21.15.194:0/1362374459 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ad5d93cf80 0x55ad5d93f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:42.999 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.995+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/1362374459 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d93fa10 con 0x55ad5d93cf80 2024-09-13T06:11:42.999 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.995+0000 7f4c8b1c8640 1 --2- 172.21.15.194:0/1362374459 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ad5d93cf80 0x55ad5d93f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:42.999 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.995+0000 7f4c8a1c6640 1 --2- 172.21.15.194:0/1362374459 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4b70034650 0x7f4b70036b10 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4c800ad000 tx=0x7f4c800a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:42.999 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.995+0000 7f4c8b1c8640 1 --2- 172.21.15.194:0/1362374459 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ad5d93cf80 0x55ad5d93f3d0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:42.999 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.995+0000 7f4c8b1c8640 1 -- 172.21.15.194:0/1362374459 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c8400a4d0 con 0x55ad5d93cf80 2024-09-13T06:11:42.999 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.995+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/1362374459 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d93c6b0 con 0x55ad5d93cf80 2024-09-13T06:11:43.000 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.995+0000 7f4c8b1c8640 1 -- 172.21.15.194:0/1362374459 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4c8400a4d0 con 0x55ad5d93cf80 2024-09-13T06:11:43.000 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.995+0000 7f4c8ceb7980 1 --2- 172.21.15.194:0/1362374459 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ad5d941d40 0x55ad5d944130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.000 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.995+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/1362374459 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d944800 con 0x55ad5d941d40 2024-09-13T06:11:43.001 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.995+0000 7f4c8a9c7640 1 --2- 172.21.15.194:0/1362374459 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ad5d941d40 0x55ad5d944130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.001 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.995+0000 7f4c8a9c7640 1 --2- 172.21.15.194:0/1362374459 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ad5d941d40 0x55ad5d944130 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.001 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.995+0000 7f4c8a9c7640 1 -- 172.21.15.194:0/1362374459 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4c7c008030 con 0x55ad5d941d40 2024-09-13T06:11:43.001 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.999+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/1362374459 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d940be0 con 0x55ad5d93cf80 2024-09-13T06:11:43.001 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.999+0000 7f4c8b1c8640 1 -- 172.21.15.194:0/1362374459 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4c8400a4d0 con 0x55ad5d93cf80 2024-09-13T06:11:43.001 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.999+0000 7f4c8ceb7980 1 --2- 172.21.15.194:0/1362374459 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55ad5d945c40 0x55ad5d948030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.001 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.999+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/1362374459 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d9487c0 con 0x55ad5d945c40 2024-09-13T06:11:43.001 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.999+0000 7f4c8a1c6640 1 --2- 172.21.15.194:0/1362374459 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55ad5d945c40 0x55ad5d948030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.001 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.999+0000 7f4c8a1c6640 1 --2- 172.21.15.194:0/1362374459 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55ad5d945c40 0x55ad5d948030 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.999+0000 7f4c8a1c6640 1 -- 172.21.15.194:0/1362374459 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4c800b3040 con 0x55ad5d945c40 2024-09-13T06:11:43.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.999+0000 7f4c8ceb7980 1 Processor -- start 2024-09-13T06:11:43.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.999+0000 7f4c8ceb7980 1 -- start start 2024-09-13T06:11:43.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.999+0000 7f4c8ceb7980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad5d956220 0x55ad5d956640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.999+0000 7f4c8ceb7980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55ad5d74a800 con 0x55ad5d956220 2024-09-13T06:11:43.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.999+0000 7f4c8a9c7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad5d956220 0x55ad5d956640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.999+0000 7f4c8a9c7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad5d956220 0x55ad5d956640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44490/0 (socket says 172.21.15.194:44490) 2024-09-13T06:11:43.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.999+0000 7f4c8a9c7640 1 -- 172.21.15.194:0/2620166054 learned_addr learned my addr 172.21.15.194:0/2620166054 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:43.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.999+0000 7f4c8a9c7640 1 -- 172.21.15.194:0/2620166054 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad5d956b80 con 0x55ad5d956220 2024-09-13T06:11:43.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.999+0000 7f4c8a9c7640 1 --2- 172.21.15.194:0/2620166054 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad5d956220 0x55ad5d956640 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c0483c0 tx=0x7f4c7c025f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.999+0000 7f4b74e01640 1 -- 172.21.15.194:0/2620166054 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c7c02d3f0 con 0x55ad5d956220 2024-09-13T06:11:43.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.999+0000 7f4b74e01640 1 -- 172.21.15.194:0/2620166054 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c7c02d590 con 0x55ad5d956220 2024-09-13T06:11:43.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.999+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/2620166054 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ad5d956e10 con 0x55ad5d956220 2024-09-13T06:11:43.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.999+0000 7f4b74e01640 1 -- 172.21.15.194:0/2620166054 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c7c041a20 con 0x55ad5d956220 2024-09-13T06:11:43.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:42.999+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/2620166054 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad5d956e10 con 0x55ad5d956220 2024-09-13T06:11:43.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.003+0000 7f4b74e01640 1 -- 172.21.15.194:0/2620166054 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4c7c009070 con 0x55ad5d956220 2024-09-13T06:11:43.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.003+0000 7f4b74e01640 1 --2- 172.21.15.194:0/2620166054 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4b64034650 0x7f4b64036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.003+0000 7f4b74e01640 1 -- 172.21.15.194:0/2620166054 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f4c7c005050 con 0x55ad5d956220 2024-09-13T06:11:43.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.003+0000 7f4c8a1c6640 1 --2- 172.21.15.194:0/2620166054 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4b64034650 0x7f4b64036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.003+0000 7f4c8ceb7980 1 Processor -- start 2024-09-13T06:11:43.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.003+0000 7f4c8ceb7980 1 -- start start 2024-09-13T06:11:43.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.003+0000 7f4c8a1c6640 1 --2- 172.21.15.194:0/2620166054 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4b64034650 0x7f4b64036b10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4c8000a480 tx=0x7f4c80005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.003+0000 7f4c8ceb7980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad5d9629e0 0x55ad5d962dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.003+0000 7f4c8ceb7980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55ad5d931370 con 0x55ad5d9629e0 2024-09-13T06:11:43.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.003+0000 7f4c8a9c7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad5d9629e0 0x55ad5d962dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.003+0000 7f4c8a9c7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad5d9629e0 0x55ad5d962dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44500/0 (socket says 172.21.15.194:44500) 2024-09-13T06:11:43.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.003+0000 7f4c8a9c7640 1 -- 172.21.15.194:0/3333802771 learned_addr learned my addr 172.21.15.194:0/3333802771 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:43.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.003+0000 7f4c8a9c7640 1 -- 172.21.15.194:0/3333802771 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad5d963390 con 0x55ad5d9629e0 2024-09-13T06:11:43.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.003+0000 7f4c8a9c7640 1 --2- 172.21.15.194:0/3333802771 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad5d9629e0 0x55ad5d962dc0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c018740 tx=0x7f4c7c024420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66b3a0ff9b50f9f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.003+0000 7f4b6e7fc640 1 -- 172.21.15.194:0/3333802771 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c7c060070 con 0x55ad5d9629e0 2024-09-13T06:11:43.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.003+0000 7f4b6e7fc640 1 -- 172.21.15.194:0/3333802771 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c7c054070 con 0x55ad5d9629e0 2024-09-13T06:11:43.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.003+0000 7f4b6e7fc640 1 -- 172.21.15.194:0/3333802771 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c7c00cba0 con 0x55ad5d9629e0 2024-09-13T06:11:43.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.003+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/3333802771 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad5d9629e0 msgr2=0x55ad5d962dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.003+0000 7f4c8ceb7980 1 --2- 172.21.15.194:0/3333802771 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad5d9629e0 0x55ad5d962dc0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c018740 tx=0x7f4c7c024420 comp rx=0 tx=0).stop 2024-09-13T06:11:43.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.003+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/3333802771 shutdown_connections 2024-09-13T06:11:43.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.003+0000 7f4c8ceb7980 1 --2- 172.21.15.194:0/3333802771 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad5d9629e0 0x55ad5d962dc0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.003+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/3333802771 >> 172.21.15.194:0/3333802771 conn(0x55ad5d95edc0 msgr2=0x55ad5d95cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:43.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.003+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/3333802771 shutdown_connections 2024-09-13T06:11:43.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.003+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/3333802771 wait complete. 2024-09-13T06:11:43.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.007+0000 7f4c8ceb7980 1 Processor -- start 2024-09-13T06:11:43.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.007+0000 7f4c8ceb7980 1 -- start start 2024-09-13T06:11:43.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.007+0000 7f4c8ceb7980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad5d9629e0 0x55ad5d969c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.007+0000 7f4c8ceb7980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55ad5d963830 con 0x55ad5d9629e0 2024-09-13T06:11:43.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.007+0000 7f4c8a9c7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad5d9629e0 0x55ad5d969c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.007+0000 7f4c8a9c7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad5d9629e0 0x55ad5d969c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44504/0 (socket says 172.21.15.194:44504) 2024-09-13T06:11:43.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.007+0000 7f4c8a9c7640 1 -- 172.21.15.194:0/118180850 learned_addr learned my addr 172.21.15.194:0/118180850 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:43.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.007+0000 7f4c8a9c7640 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad5d96a140 con 0x55ad5d9629e0 2024-09-13T06:11:43.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.007+0000 7f4c8a9c7640 1 --2- 172.21.15.194:0/118180850 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad5d9629e0 0x55ad5d969c00 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c05e040 tx=0x7f4c7c037ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.007+0000 7f4b6cff9640 1 -- 172.21.15.194:0/118180850 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c7c069070 con 0x55ad5d9629e0 2024-09-13T06:11:43.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.007+0000 7f4b6cff9640 1 -- 172.21.15.194:0/118180850 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c7c037560 con 0x55ad5d9629e0 2024-09-13T06:11:43.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.007+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ad5d96a140 con 0x55ad5d9629e0 2024-09-13T06:11:43.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.007+0000 7f4b6cff9640 1 -- 172.21.15.194:0/118180850 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c7c060040 con 0x55ad5d9629e0 2024-09-13T06:11:43.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.007+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad5d96a140 con 0x55ad5d9629e0 2024-09-13T06:11:43.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.007+0000 7f4b6cff9640 1 -- 172.21.15.194:0/118180850 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4c7c06c070 con 0x55ad5d9629e0 2024-09-13T06:11:43.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.007+0000 7f4b6cff9640 1 --2- 172.21.15.194:0/118180850 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4b54034650 0x7f4b54036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.007+0000 7f4b6cff9640 1 -- 172.21.15.194:0/118180850 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f4c7c06fd60 con 0x55ad5d9629e0 2024-09-13T06:11:43.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.007+0000 7f4c8a1c6640 1 --2- 172.21.15.194:0/118180850 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4b54034650 0x7f4b54036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.007+0000 7f4c8ceb7980 20 rados->read ofs=0 len=0 2024-09-13T06:11:43.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.007+0000 7f4c8ceb7980 1 --2- 172.21.15.194:0/118180850 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ad5d974c70 0x55ad5d977130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.007+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d977880 con 0x55ad5d974c70 2024-09-13T06:11:43.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.011+0000 7f4c8a1c6640 1 --2- 172.21.15.194:0/118180850 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4b54034650 0x7f4b54036b10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4c800ab510 tx=0x7f4c800a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.011+0000 7f4c8b1c8640 1 --2- 172.21.15.194:0/118180850 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ad5d974c70 0x55ad5d977130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.011+0000 7f4c8b1c8640 1 --2- 172.21.15.194:0/118180850 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ad5d974c70 0x55ad5d977130 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.011+0000 7f4c8b1c8640 1 -- 172.21.15.194:0/118180850 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c8400a4d0 con 0x55ad5d974c70 2024-09-13T06:11:43.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.011+0000 7f4c8ceb7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:43.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.011+0000 7f4c8ceb7980 20 realm 2024-09-13T06:11:43.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.011+0000 7f4c8ceb7980 20 rados->read ofs=0 len=0 2024-09-13T06:11:43.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.011+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d977c90 con 0x55ad5d974c70 2024-09-13T06:11:43.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.011+0000 7f4c8b1c8640 1 -- 172.21.15.194:0/118180850 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c8400a4d0 con 0x55ad5d974c70 2024-09-13T06:11:43.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.011+0000 7f4c8ceb7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:43.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.011+0000 7f4c8ceb7980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:11:43.017 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.011+0000 7f4c8ceb7980 20 rados->read ofs=0 len=0 2024-09-13T06:11:43.017 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.011+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d978560 con 0x55ad5d974c70 2024-09-13T06:11:43.017 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.011+0000 7f4c8b1c8640 1 -- 172.21.15.194:0/118180850 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c8400a4d0 con 0x55ad5d974c70 2024-09-13T06:11:43.017 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.011+0000 7f4c8ceb7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:43.017 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.011+0000 7f4c8ceb7980 20 rados->read ofs=0 len=0 2024-09-13T06:11:43.017 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.011+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d978900 con 0x55ad5d974c70 2024-09-13T06:11:43.017 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.011+0000 7f4c8b1c8640 1 -- 172.21.15.194:0/118180850 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4c8400a4d0 con 0x55ad5d974c70 2024-09-13T06:11:43.017 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.011+0000 7f4c8ceb7980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:11:43.017 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.011+0000 7f4c8ceb7980 20 rados->read ofs=0 len=0 2024-09-13T06:11:43.017 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.011+0000 7f4c8ceb7980 1 --2- 172.21.15.194:0/118180850 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ad5d979660 0x55ad5d97ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.017 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.011+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d97c020 con 0x55ad5d979660 2024-09-13T06:11:43.017 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.011+0000 7f4c8a9c7640 1 --2- 172.21.15.194:0/118180850 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ad5d979660 0x55ad5d97ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.011+0000 7f4c8a9c7640 1 --2- 172.21.15.194:0/118180850 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ad5d979660 0x55ad5d97ba50 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.011+0000 7f4c8a9c7640 1 -- 172.21.15.194:0/118180850 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4c7c06b030 con 0x55ad5d979660 2024-09-13T06:11:43.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.011+0000 7f4c8ceb7980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:11:43.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.011+0000 7f4c8ceb7980 20 searching for the correct realm 2024-09-13T06:11:43.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.011+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d97d8f0 con 0x55ad5d979660 2024-09-13T06:11:43.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.011+0000 7f4c8a9c7640 1 -- 172.21.15.194:0/118180850 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c7c06b030 con 0x55ad5d979660 2024-09-13T06:11:43.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.011+0000 7f4c8a9c7640 1 --2- 172.21.15.194:0/118180850 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f4c7c06e070 0x7f4c7c04f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.011+0000 7f4c8a9c7640 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d97d8f0 con 0x7f4c7c06e070 2024-09-13T06:11:43.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.011+0000 7f4c8a1c6640 1 --2- 172.21.15.194:0/118180850 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f4c7c06e070 0x7f4c7c04f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.011+0000 7f4c8a1c6640 1 --2- 172.21.15.194:0/118180850 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f4c7c06e070 0x7f4c7c04f460 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.011+0000 7f4c8a1c6640 1 -- 172.21.15.194:0/118180850 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4c800ca030 con 0x7f4c7c06e070 2024-09-13T06:11:43.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.011+0000 7f4c8a1c6640 1 --2- 172.21.15.194:0/118180850 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f4c800dd040 0x7f4c800cf430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.011+0000 7f4c8a1c6640 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d97d8f0 con 0x7f4c800dd040 2024-09-13T06:11:43.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.015+0000 7f4c8b1c8640 1 --2- 172.21.15.194:0/118180850 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f4c800dd040 0x7f4c800cf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.015+0000 7f4c8b1c8640 1 --2- 172.21.15.194:0/118180850 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f4c800dd040 0x7f4c800cf430 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.015+0000 7f4c8b1c8640 1 -- 172.21.15.194:0/118180850 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c8400a4d0 con 0x7f4c800dd040 2024-09-13T06:11:43.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.015+0000 7f4c8b1c8640 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d978900 con 0x55ad5d974c70 2024-09-13T06:11:43.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.015+0000 7f4c8b1c8640 1 -- 172.21.15.194:0/118180850 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c8400a4d0 con 0x55ad5d974c70 2024-09-13T06:11:43.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.015+0000 7f4c8b1c8640 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d978900 con 0x55ad5d974c70 2024-09-13T06:11:43.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.015+0000 7f4c8b1c8640 1 -- 172.21.15.194:0/118180850 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c8400a4d0 con 0x55ad5d974c70 2024-09-13T06:11:43.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.015+0000 7f4c8b1c8640 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d978900 con 0x7f4c800dd040 2024-09-13T06:11:43.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.015+0000 7f4c8b1c8640 1 -- 172.21.15.194:0/118180850 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c8400a4d0 con 0x7f4c800dd040 2024-09-13T06:11:43.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.015+0000 7f4c8b1c8640 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d978900 con 0x7f4c800dd040 2024-09-13T06:11:43.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.015+0000 7f4c8b1c8640 1 -- 172.21.15.194:0/118180850 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c8400a4d0 con 0x7f4c800dd040 2024-09-13T06:11:43.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.015+0000 7f4c8b1c8640 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d978900 con 0x7f4c7c06e070 2024-09-13T06:11:43.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.015+0000 7f4c8a1c6640 1 -- 172.21.15.194:0/118180850 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c800ca030 con 0x7f4c7c06e070 2024-09-13T06:11:43.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.015+0000 7f4c8a1c6640 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d978900 con 0x55ad5d979660 2024-09-13T06:11:43.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.015+0000 7f4c8a9c7640 1 -- 172.21.15.194:0/118180850 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c7c06b030 con 0x55ad5d979660 2024-09-13T06:11:43.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.015+0000 7f4c8a9c7640 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d978900 con 0x55ad5d974c70 2024-09-13T06:11:43.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.015+0000 7f4c8b1c8640 1 -- 172.21.15.194:0/118180850 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c8400a4d0 con 0x55ad5d974c70 2024-09-13T06:11:43.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.015+0000 7f4c8b1c8640 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d978900 con 0x7f4c800dd040 2024-09-13T06:11:43.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.019+0000 7f4c8b1c8640 1 -- 172.21.15.194:0/118180850 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c8400a4d0 con 0x7f4c800dd040 2024-09-13T06:11:43.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.019+0000 7f4c8b1c8640 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d978900 con 0x55ad5d974c70 2024-09-13T06:11:43.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.019+0000 7f4c8b1c8640 1 -- 172.21.15.194:0/118180850 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c8400a4d0 con 0x55ad5d974c70 2024-09-13T06:11:43.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.019+0000 7f4c8b1c8640 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d978900 con 0x7f4c7c06e070 2024-09-13T06:11:43.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.019+0000 7f4c8a1c6640 1 -- 172.21.15.194:0/118180850 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4c800ca030 con 0x7f4c7c06e070 2024-09-13T06:11:43.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.019+0000 7f4c8a1c6640 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d978900 con 0x55ad5d979660 2024-09-13T06:11:43.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.019+0000 7f4c8a9c7640 1 -- 172.21.15.194:0/118180850 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c7c06b030 con 0x55ad5d979660 2024-09-13T06:11:43.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.019+0000 7f4c8a9c7640 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d978900 con 0x55ad5d979660 2024-09-13T06:11:43.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.019+0000 7f4c8a9c7640 1 -- 172.21.15.194:0/118180850 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c7c06b030 con 0x55ad5d979660 2024-09-13T06:11:43.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.019+0000 7f4c8a9c7640 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d978900 con 0x7f4c800dd040 2024-09-13T06:11:43.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.019+0000 7f4c8b1c8640 1 -- 172.21.15.194:0/118180850 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c8400a4d0 con 0x7f4c800dd040 2024-09-13T06:11:43.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.019+0000 7f4c8b1c8640 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d978900 con 0x55ad5d979660 2024-09-13T06:11:43.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.019+0000 7f4c8a9c7640 1 -- 172.21.15.194:0/118180850 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c7c06b030 con 0x55ad5d979660 2024-09-13T06:11:43.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.019+0000 7f4c8a9c7640 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d978900 con 0x55ad5d979660 2024-09-13T06:11:43.028 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.019+0000 7f4c8a9c7640 1 -- 172.21.15.194:0/118180850 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c7c06b030 con 0x55ad5d979660 2024-09-13T06:11:43.028 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.019+0000 7f4c8a9c7640 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d978900 con 0x55ad5d974c70 2024-09-13T06:11:43.029 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.019+0000 7f4c8b1c8640 1 -- 172.21.15.194:0/118180850 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c8400a4d0 con 0x55ad5d974c70 2024-09-13T06:11:43.029 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.019+0000 7f4c8b1c8640 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d978900 con 0x55ad5d974c70 2024-09-13T06:11:43.029 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.019+0000 7f4c8b1c8640 1 -- 172.21.15.194:0/118180850 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4c8400a4d0 con 0x55ad5d974c70 2024-09-13T06:11:43.029 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.019+0000 7f4c8b1c8640 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d978900 con 0x7f4c7c06e070 2024-09-13T06:11:43.029 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.023+0000 7f4c8a1c6640 1 -- 172.21.15.194:0/118180850 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c800ca030 con 0x7f4c7c06e070 2024-09-13T06:11:43.029 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.023+0000 7f4c8a1c6640 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d978900 con 0x55ad5d979660 2024-09-13T06:11:43.029 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.023+0000 7f4c8a9c7640 1 -- 172.21.15.194:0/118180850 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c7c06b030 con 0x55ad5d979660 2024-09-13T06:11:43.029 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.023+0000 7f4c8a9c7640 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d978900 con 0x7f4c7c06e070 2024-09-13T06:11:43.029 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.023+0000 7f4c8a1c6640 1 -- 172.21.15.194:0/118180850 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c800ca030 con 0x7f4c7c06e070 2024-09-13T06:11:43.029 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.023+0000 7f4c8a1c6640 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d978900 con 0x55ad5d974c70 2024-09-13T06:11:43.029 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.023+0000 7f4c8b1c8640 1 -- 172.21.15.194:0/118180850 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c8400a4d0 con 0x55ad5d974c70 2024-09-13T06:11:43.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.023+0000 7f4c8b1c8640 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d978900 con 0x7f4c800dd040 2024-09-13T06:11:43.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.023+0000 7f4c8b1c8640 1 -- 172.21.15.194:0/118180850 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c8400a4d0 con 0x7f4c800dd040 2024-09-13T06:11:43.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.023+0000 7f4c8b1c8640 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d978900 con 0x55ad5d979660 2024-09-13T06:11:43.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.023+0000 7f4c8a9c7640 1 -- 172.21.15.194:0/118180850 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4c7c06b030 con 0x55ad5d979660 2024-09-13T06:11:43.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.023+0000 7f4c8a9c7640 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d978900 con 0x7f4c7c06e070 2024-09-13T06:11:43.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.023+0000 7f4c8a1c6640 1 -- 172.21.15.194:0/118180850 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c800ca030 con 0x7f4c7c06e070 2024-09-13T06:11:43.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.023+0000 7f4c8a1c6640 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d978900 con 0x7f4c7c06e070 2024-09-13T06:11:43.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.023+0000 7f4c8a1c6640 1 -- 172.21.15.194:0/118180850 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c800ca030 con 0x7f4c7c06e070 2024-09-13T06:11:43.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.023+0000 7f4c8a1c6640 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d978900 con 0x55ad5d979660 2024-09-13T06:11:43.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.023+0000 7f4c8a9c7640 1 -- 172.21.15.194:0/118180850 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c7c06b030 con 0x55ad5d979660 2024-09-13T06:11:43.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.023+0000 7f4c8a9c7640 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d978900 con 0x7f4c800dd040 2024-09-13T06:11:43.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.027+0000 7f4c8b1c8640 1 -- 172.21.15.194:0/118180850 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c8400a4d0 con 0x7f4c800dd040 2024-09-13T06:11:43.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.027+0000 7f4c8b1c8640 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d978900 con 0x55ad5d974c70 2024-09-13T06:11:43.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.027+0000 7f4c8b1c8640 1 -- 172.21.15.194:0/118180850 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4c8400a4d0 con 0x55ad5d974c70 2024-09-13T06:11:43.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.027+0000 7f4c8b1c8640 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d978900 con 0x7f4c7c06e070 2024-09-13T06:11:43.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.027+0000 7f4c8a1c6640 1 -- 172.21.15.194:0/118180850 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c800ca030 con 0x7f4c7c06e070 2024-09-13T06:11:43.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.027+0000 7f4c8ceb7980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:11:43.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.027+0000 7f4c8ceb7980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:11:43.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.027+0000 7f4c8ceb7980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:11:43.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.027+0000 7f4c8ceb7980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:11:43.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.027+0000 7f4c8ceb7980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:11:43.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.027+0000 7f4c8ceb7980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:11:43.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.027+0000 7f4c8ceb7980 20 rados->read ofs=0 len=0 2024-09-13T06:11:43.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.027+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d97c9e0 con 0x55ad5d974c70 2024-09-13T06:11:43.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.027+0000 7f4c8b1c8640 1 -- 172.21.15.194:0/118180850 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c8400a4d0 con 0x55ad5d974c70 2024-09-13T06:11:43.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.027+0000 7f4c8ceb7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:43.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.027+0000 7f4c8ceb7980 20 rados->read ofs=0 len=0 2024-09-13T06:11:43.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.027+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d97d280 con 0x55ad5d974c70 2024-09-13T06:11:43.034 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.027+0000 7f4c8b1c8640 1 -- 172.21.15.194:0/118180850 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4c8400a4d0 con 0x55ad5d974c70 2024-09-13T06:11:43.034 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.027+0000 7f4c8ceb7980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:11:43.034 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.027+0000 7f4c8ceb7980 20 rados->read ofs=0 len=0 2024-09-13T06:11:43.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.027+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d97c620 con 0x7f4c7c06e070 2024-09-13T06:11:43.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.027+0000 7f4c8a1c6640 1 -- 172.21.15.194:0/118180850 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4c800ca030 con 0x7f4c7c06e070 2024-09-13T06:11:43.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.027+0000 7f4c8ceb7980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:11:43.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.027+0000 7f4c8ceb7980 20 zone default found 2024-09-13T06:11:43.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.027+0000 7f4c8ceb7980 4 Realm: () 2024-09-13T06:11:43.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.027+0000 7f4c8ceb7980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:11:43.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.027+0000 7f4c8ceb7980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:11:43.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.027+0000 7f4c8ceb7980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:11:43.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.027+0000 7f4c8ceb7980 20 zonegroup default 2024-09-13T06:11:43.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.027+0000 7f4c8ceb7980 20 rados->read ofs=0 len=0 2024-09-13T06:11:43.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.027+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d97dd20 con 0x7f4c800dd040 2024-09-13T06:11:43.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.027+0000 7f4c8b1c8640 1 -- 172.21.15.194:0/118180850 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4c8400a4d0 con 0x7f4c800dd040 2024-09-13T06:11:43.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.027+0000 7f4c8ceb7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:43.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.027+0000 7f4c8ceb7980 20 rados->read ofs=0 len=0 2024-09-13T06:11:43.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.027+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d97f700 con 0x55ad5d979660 2024-09-13T06:11:43.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.027+0000 7f4c8a9c7640 1 -- 172.21.15.194:0/118180850 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4c7c06b030 con 0x55ad5d979660 2024-09-13T06:11:43.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.027+0000 7f4c8ceb7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:43.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.027+0000 7f4c8ceb7980 20 rados->read ofs=0 len=0 2024-09-13T06:11:43.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.027+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d97fc10 con 0x55ad5d979660 2024-09-13T06:11:43.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.027+0000 7f4c8a9c7640 1 -- 172.21.15.194:0/118180850 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4c7c06b030 con 0x55ad5d979660 2024-09-13T06:11:43.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.027+0000 7f4c8ceb7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:43.037 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.027+0000 7f4c8ceb7980 20 started sync module instance, tier type = 2024-09-13T06:11:43.037 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.027+0000 7f4c8ceb7980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:11:43.037 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.027+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d97eba0 con 0x7f4c7c06e070 2024-09-13T06:11:43.037 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.031+0000 7f4c8a1c6640 1 -- 172.21.15.194:0/118180850 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(44 notify.0 [create] v35'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c800ca030 con 0x7f4c7c06e070 2024-09-13T06:11:43.037 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.031+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94203087941520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d97e800 con 0x7f4c7c06e070 2024-09-13T06:11:43.037 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.031+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d980a30 con 0x55ad5d974c70 2024-09-13T06:11:43.037 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.031+0000 7f4c8a1c6640 1 -- 172.21.15.194:0/118180850 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94203087941520] v35'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c800ca030 con 0x7f4c7c06e070 2024-09-13T06:11:43.037 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.031+0000 7f4c8b1c8640 1 -- 172.21.15.194:0/118180850 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v35'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c8400a4d0 con 0x55ad5d974c70 2024-09-13T06:11:43.037 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.031+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94203087945840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d980e20 con 0x55ad5d974c70 2024-09-13T06:11:43.037 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.031+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d9817e0 con 0x55ad5d979660 2024-09-13T06:11:43.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.035+0000 7f4c8a9c7640 1 -- 172.21.15.194:0/118180850 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v35'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c7c06b030 con 0x55ad5d979660 2024-09-13T06:11:43.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.035+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94203087950640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d982080 con 0x55ad5d979660 2024-09-13T06:11:43.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.035+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d982a80 con 0x7f4c7c06e070 2024-09-13T06:11:43.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.035+0000 7f4c8b1c8640 1 -- 172.21.15.194:0/118180850 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94203087945840] v35'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c8400a4d0 con 0x55ad5d974c70 2024-09-13T06:11:43.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.035+0000 7f4c8a1c6640 1 -- 172.21.15.194:0/118180850 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(50 notify.3 [create] v35'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c800ca030 con 0x7f4c7c06e070 2024-09-13T06:11:43.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.035+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94203087946896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d982e70 con 0x7f4c7c06e070 2024-09-13T06:11:43.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.035+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d983830 con 0x55ad5d974c70 2024-09-13T06:11:43.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.035+0000 7f4c8a9c7640 1 -- 172.21.15.194:0/118180850 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94203087950640] v35'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c7c06b030 con 0x55ad5d979660 2024-09-13T06:11:43.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.035+0000 7f4c8a1c6640 1 -- 172.21.15.194:0/118180850 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94203087946896] v35'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c800ca030 con 0x7f4c7c06e070 2024-09-13T06:11:43.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.039+0000 7f4c8b1c8640 1 -- 172.21.15.194:0/118180850 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v35'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c8400a4d0 con 0x55ad5d974c70 2024-09-13T06:11:43.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.039+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94203087955344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d983380 con 0x55ad5d974c70 2024-09-13T06:11:43.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.039+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d983c10 con 0x7f4c800dd040 2024-09-13T06:11:43.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.039+0000 7f4c8b1c8640 1 -- 172.21.15.194:0/118180850 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94203087955344] v35'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c8400a4d0 con 0x55ad5d974c70 2024-09-13T06:11:43.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.039+0000 7f4c8b1c8640 1 -- 172.21.15.194:0/118180850 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(54 notify.5 [create] v35'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c8400a4d0 con 0x7f4c800dd040 2024-09-13T06:11:43.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.039+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94203087952848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d983830 con 0x7f4c800dd040 2024-09-13T06:11:43.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.039+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d984620 con 0x7f4c800dd040 2024-09-13T06:11:43.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.043+0000 7f4c8b1c8640 1 -- 172.21.15.194:0/118180850 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94203087952848] v35'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c8400a4d0 con 0x7f4c800dd040 2024-09-13T06:11:43.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.043+0000 7f4c8b1c8640 1 -- 172.21.15.194:0/118180850 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(56 notify.6 [create] v35'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c8400a4d0 con 0x7f4c800dd040 2024-09-13T06:11:43.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.043+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94203087959184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d984620 con 0x7f4c800dd040 2024-09-13T06:11:43.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.043+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d984ed0 con 0x7f4c800dd040 2024-09-13T06:11:43.047 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.043+0000 7f4c8b1c8640 1 -- 172.21.15.194:0/118180850 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94203087959184] v35'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c8400a4d0 con 0x7f4c800dd040 2024-09-13T06:11:43.047 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.043+0000 7f4c8b1c8640 1 -- 172.21.15.194:0/118180850 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(58 notify.7 [create] v35'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c8400a4d0 con 0x7f4c800dd040 2024-09-13T06:11:43.047 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.043+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94203087962960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d984e90 con 0x7f4c800dd040 2024-09-13T06:11:43.047 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.043+0000 7f4c8ceb7980 20 add_watcher() i=0 2024-09-13T06:11:43.047 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.043+0000 7f4c8ceb7980 20 add_watcher() i=1 2024-09-13T06:11:43.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.043+0000 7f4c8ceb7980 20 add_watcher() i=2 2024-09-13T06:11:43.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.043+0000 7f4c8ceb7980 20 add_watcher() i=3 2024-09-13T06:11:43.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.043+0000 7f4c8ceb7980 20 add_watcher() i=4 2024-09-13T06:11:43.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.043+0000 7f4c8ceb7980 20 add_watcher() i=5 2024-09-13T06:11:43.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.043+0000 7f4c8ceb7980 20 add_watcher() i=6 2024-09-13T06:11:43.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.047+0000 7f4c8b1c8640 1 -- 172.21.15.194:0/118180850 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94203087962960] v35'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c8400a4d0 con 0x7f4c800dd040 2024-09-13T06:11:43.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.047+0000 7f4c8ceb7980 20 add_watcher() i=7 2024-09-13T06:11:43.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.047+0000 7f4c8ceb7980 2 all 8 watchers are set, enabling cache 2024-09-13T06:11:43.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.047+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d988320 con 0x55ad5d974c70 2024-09-13T06:11:43.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.047+0000 7f4c8b1c8640 1 -- 172.21.15.194:0/118180850 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4c8400a4d0 con 0x55ad5d974c70 2024-09-13T06:11:43.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.047+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94203087964208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d985840 con 0x55ad5d974c70 2024-09-13T06:11:43.052 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.047+0000 7f4c8b1c8640 1 -- 172.21.15.194:0/118180850 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94203087964208] v35'228 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4c8400a4d0 con 0x55ad5d974c70 2024-09-13T06:11:43.052 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.047+0000 7f4b417e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:11:43.052 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.047+0000 7f4c8ceb7980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:11:43.052 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.047+0000 7f4c8ceb7980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:11:43.052 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.047+0000 7f4c8ceb7980 5 note: GC not initialized 2024-09-13T06:11:43.052 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.051+0000 7f4abbfff640 20 reqs_thread_entry: start 2024-09-13T06:11:43.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.051+0000 7f4c8ceb7980 20 init_complete bucket index max shards: 11 2024-09-13T06:11:43.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.051+0000 7f4c8ceb7980 20 Filter name: none 2024-09-13T06:11:43.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.051+0000 7f4ab9ffb640 20 reqs_thread_entry: start 2024-09-13T06:11:43.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.051+0000 7f4c8ceb7980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T06:11:43.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.051+0000 7f4c8ceb7980 20 rados->read ofs=0 len=0 2024-09-13T06:11:43.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.051+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d9ab980 con 0x55ad5d974c70 2024-09-13T06:11:43.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.051+0000 7f4c8b1c8640 1 -- 172.21.15.194:0/118180850 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv23 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f4c8400a4d0 con 0x55ad5d974c70 2024-09-13T06:11:43.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.051+0000 7f4c8ceb7980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T06:11:43.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.051+0000 7f4c8ceb7980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T06:11:43.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.051+0000 7f4c8ceb7980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:11:43.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.051+0000 7f4c8ceb7980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:11:43.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.051+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d9ae410 con 0x7f4c800dd040 2024-09-13T06:11:43.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.055+0000 7f4c8b1c8640 1 -- 172.21.15.194:0/118180850 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(63 usage.10 [call] v35'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c8400a4d0 con 0x7f4c800dd040 2024-09-13T06:11:43.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.055+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:64 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d9ae410 con 0x7f4c800dd040 2024-09-13T06:11:43.058 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.055+0000 7f4c8b1c8640 1 -- 172.21.15.194:0/118180850 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(64 usage.10 [call] v35'34 uv33 ondisk = -61 ((61) No data available)) ==== 152+0+0 (crc 0 0 0) 0x7f4c8400a4d0 con 0x7f4c800dd040 2024-09-13T06:11:43.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.055+0000 7f4b417e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:11:43.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.055+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94203087964208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d9724a0 con 0x55ad5d974c70 2024-09-13T06:11:43.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.059+0000 7f4c8b1c8640 1 -- 172.21.15.194:0/118180850 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94203087964208] v35'229 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4c8400a4d0 con 0x55ad5d974c70 2024-09-13T06:11:43.061 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.059+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94203087941520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d9847f0 con 0x7f4c7c06e070 2024-09-13T06:11:43.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.059+0000 7f4c8a1c6640 1 -- 172.21.15.194:0/118180850 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94203087941520] v35'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c800ca030 con 0x7f4c7c06e070 2024-09-13T06:11:43.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.059+0000 7f4c8ceb7980 20 remove_watcher() i=0 2024-09-13T06:11:43.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.059+0000 7f4c8ceb7980 2 removed watcher, disabling cache 2024-09-13T06:11:43.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.059+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94203087945840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d9ab520 con 0x55ad5d974c70 2024-09-13T06:11:43.064 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.063+0000 7f4c8b1c8640 1 -- 172.21.15.194:0/118180850 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94203087945840] v35'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c8400a4d0 con 0x55ad5d974c70 2024-09-13T06:11:43.064 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.063+0000 7f4c8ceb7980 20 remove_watcher() i=1 2024-09-13T06:11:43.064 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.063+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94203087950640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d9ab520 con 0x55ad5d979660 2024-09-13T06:11:43.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.063+0000 7f4c8a9c7640 1 -- 172.21.15.194:0/118180850 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94203087950640] v35'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c7c06b030 con 0x55ad5d979660 2024-09-13T06:11:43.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.063+0000 7f4c8ceb7980 20 remove_watcher() i=2 2024-09-13T06:11:43.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.063+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94203087946896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d9ab520 con 0x7f4c7c06e070 2024-09-13T06:11:43.068 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.063+0000 7f4c8a1c6640 1 -- 172.21.15.194:0/118180850 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94203087946896] v35'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c800ca030 con 0x7f4c7c06e070 2024-09-13T06:11:43.068 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.063+0000 7f4c8ceb7980 20 remove_watcher() i=3 2024-09-13T06:11:43.068 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.063+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94203087955344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d9ab520 con 0x55ad5d974c70 2024-09-13T06:11:43.069 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.067+0000 7f4c8b1c8640 1 -- 172.21.15.194:0/118180850 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94203087955344] v35'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c8400a4d0 con 0x55ad5d974c70 2024-09-13T06:11:43.070 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.067+0000 7f4c8ceb7980 20 remove_watcher() i=4 2024-09-13T06:11:43.070 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.067+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94203087952848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d9ab520 con 0x7f4c800dd040 2024-09-13T06:11:43.072 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.071+0000 7f4c8b1c8640 1 -- 172.21.15.194:0/118180850 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94203087952848] v35'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c8400a4d0 con 0x7f4c800dd040 2024-09-13T06:11:43.072 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.071+0000 7f4c8ceb7980 20 remove_watcher() i=5 2024-09-13T06:11:43.072 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.071+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94203087959184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d9ab520 con 0x7f4c800dd040 2024-09-13T06:11:43.075 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.071+0000 7f4c8b1c8640 1 -- 172.21.15.194:0/118180850 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94203087959184] v35'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c8400a4d0 con 0x7f4c800dd040 2024-09-13T06:11:43.075 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.071+0000 7f4c8ceb7980 20 remove_watcher() i=6 2024-09-13T06:11:43.075 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.071+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/118180850 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94203087962960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ad5d9ab520 con 0x7f4c800dd040 2024-09-13T06:11:43.079 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.075+0000 7f4c8b1c8640 1 -- 172.21.15.194:0/118180850 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94203087962960] v35'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c8400a4d0 con 0x7f4c800dd040 2024-09-13T06:11:43.079 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.075+0000 7f4c8ceb7980 20 remove_watcher() i=7 2024-09-13T06:11:43.079 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.075+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/118180850 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f4c800dd040 msgr2=0x7f4c800cf430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.079 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.075+0000 7f4c8ceb7980 1 --2- 172.21.15.194:0/118180850 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f4c800dd040 0x7f4c800cf430 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.079 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.075+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/118180850 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ad5d974c70 msgr2=0x55ad5d977130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.079 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.075+0000 7f4c8ceb7980 1 --2- 172.21.15.194:0/118180850 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ad5d974c70 0x55ad5d977130 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.079 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.075+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/118180850 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f4c7c06e070 msgr2=0x7f4c7c04f460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.075+0000 7f4c8ceb7980 1 --2- 172.21.15.194:0/118180850 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f4c7c06e070 0x7f4c7c04f460 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.075+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/118180850 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ad5d979660 msgr2=0x55ad5d97ba50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.075+0000 7f4c8ceb7980 1 --2- 172.21.15.194:0/118180850 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ad5d979660 0x55ad5d97ba50 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.075+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/118180850 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4b54034650 msgr2=0x7f4b54036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.075+0000 7f4c8ceb7980 1 --2- 172.21.15.194:0/118180850 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4b54034650 0x7f4b54036b10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4c800ab510 tx=0x7f4c800a6000 comp rx=0 tx=0).stop 2024-09-13T06:11:43.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.075+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/118180850 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad5d9629e0 msgr2=0x55ad5d969c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.075+0000 7f4c8b1c8640 1 -- 172.21.15.194:0/118180850 reap_dead start 2024-09-13T06:11:43.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.075+0000 7f4c8ceb7980 1 --2- 172.21.15.194:0/118180850 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad5d9629e0 0x55ad5d969c00 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c05e040 tx=0x7f4c7c037ea0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.075+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/118180850 shutdown_connections 2024-09-13T06:11:43.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.075+0000 7f4c8ceb7980 1 --2- 172.21.15.194:0/118180850 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad5d9629e0 0x55ad5d969c00 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.075+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/118180850 >> 172.21.15.194:0/118180850 conn(0x55ad5d95edc0 msgr2=0x55ad5d95ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:43.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.075+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/118180850 shutdown_connections 2024-09-13T06:11:43.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.075+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/118180850 wait complete. 2024-09-13T06:11:43.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.075+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/2620166054 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4b64034650 msgr2=0x7f4b64036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.075+0000 7f4c8ceb7980 1 --2- 172.21.15.194:0/2620166054 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4b64034650 0x7f4b64036b10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4c8000a480 tx=0x7f4c80005a10 comp rx=0 tx=0).stop 2024-09-13T06:11:43.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.075+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/2620166054 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad5d956220 msgr2=0x55ad5d956640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.075+0000 7f4c8ceb7980 1 --2- 172.21.15.194:0/2620166054 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad5d956220 0x55ad5d956640 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c0483c0 tx=0x7f4c7c025f90 comp rx=0 tx=0).stop 2024-09-13T06:11:43.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.075+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/2620166054 shutdown_connections 2024-09-13T06:11:43.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.075+0000 7f4c8ceb7980 1 --2- 172.21.15.194:0/2620166054 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4b64034650 0x7f4b64036b10 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.075+0000 7f4c8ceb7980 1 --2- 172.21.15.194:0/2620166054 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad5d956220 0x55ad5d956640 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.075+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/2620166054 >> 172.21.15.194:0/2620166054 conn(0x55ad5d94b3a0 msgr2=0x55ad5d94de20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:43.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.075+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/2620166054 shutdown_connections 2024-09-13T06:11:43.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.075+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/2620166054 wait complete. 2024-09-13T06:11:43.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.075+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/1362374459 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ad5d93cf80 msgr2=0x55ad5d93f3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.075+0000 7f4c8ceb7980 1 --2- 172.21.15.194:0/1362374459 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ad5d93cf80 0x55ad5d93f3d0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.075+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/1362374459 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55ad5d945c40 msgr2=0x55ad5d948030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.075+0000 7f4c8ceb7980 1 --2- 172.21.15.194:0/1362374459 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55ad5d945c40 0x55ad5d948030 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.075+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/1362374459 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ad5d941d40 msgr2=0x55ad5d944130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.075+0000 7f4c8ceb7980 1 --2- 172.21.15.194:0/1362374459 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ad5d941d40 0x55ad5d944130 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.075+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/1362374459 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4b70034650 msgr2=0x7f4b70036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.075+0000 7f4c8ceb7980 1 --2- 172.21.15.194:0/1362374459 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4b70034650 0x7f4b70036b10 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4c800ad000 tx=0x7f4c800a5040 comp rx=0 tx=0).stop 2024-09-13T06:11:43.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.075+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/1362374459 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad5d849c60 msgr2=0x55ad5d938000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.075+0000 7f4c8ceb7980 1 --2- 172.21.15.194:0/1362374459 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ad5d849c60 0x55ad5d938000 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x55ad5d931c00 tx=0x7f4c7c000bd0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.075+0000 7f4c8b1c8640 1 -- 172.21.15.194:0/1362374459 reap_dead start 2024-09-13T06:11:43.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.075+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/1362374459 shutdown_connections 2024-09-13T06:11:43.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.075+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/1362374459 >> 172.21.15.194:0/1362374459 conn(0x55ad5d7b9230 msgr2=0x55ad5d92b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:43.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.075+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/1362374459 shutdown_connections 2024-09-13T06:11:43.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.075+0000 7f4c8ceb7980 1 -- 172.21.15.194:0/1362374459 wait complete. 2024-09-13T06:11:43.090 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-09-13T06:11:43.090 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-09-13T06:11:43.090 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-09-13T06:11:43.163 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:11:43.163 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:11:43.164 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.163+0000 7f4f12989980 1 Processor -- start 2024-09-13T06:11:43.164 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.163+0000 7f4f12989980 1 -- start start 2024-09-13T06:11:43.165 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.163+0000 7f4f12989980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x559c8a74e3b0 0x559c8a74cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.165 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.163+0000 7f4f12989980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559c8a65fae0 con 0x559c8a74e7c0 2024-09-13T06:11:43.165 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.163+0000 7f4f12989980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x559c8a683e30 con 0x559c8a74e3b0 2024-09-13T06:11:43.165 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.163+0000 7f4f10499640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x559c8a74e3b0 0x559c8a74cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.165 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.163+0000 7f4f10499640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x559c8a74e3b0 0x559c8a74cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44514/0 (socket says 172.21.15.194:44514) 2024-09-13T06:11:43.166 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.163+0000 7f4f07fff640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x559c8a74e7c0 0x559c8a74d0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:58292/0 (socket says 172.21.15.194:58292) 2024-09-13T06:11:43.166 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.163+0000 7f4f10499640 1 -- 172.21.15.194:0/847134481 learned_addr learned my addr 172.21.15.194:0/847134481 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:43.166 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.163+0000 7f4f10499640 1 -- 172.21.15.194:0/847134481 >> v1:172.21.15.120:6789/0 conn(0x559c8a74e7c0 legacy=0x559c8a74d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.166 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.163+0000 7f4f10499640 1 -- 172.21.15.194:0/847134481 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c8a74d8e0 con 0x559c8a74e3b0 2024-09-13T06:11:43.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.163+0000 7f4f10499640 1 --2- 172.21.15.194:0/847134481 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559c8a74e3b0 0x559c8a74cb70 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f4f0000a5c0 tx=0x7f4f0001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4da7ba80c6ed00e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.167+0000 7f4f0fc98640 1 -- 172.21.15.194:0/847134481 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f000a6070 con 0x559c8a74e3b0 2024-09-13T06:11:43.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.167+0000 7f4f0fc98640 1 -- 172.21.15.194:0/847134481 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f000af070 con 0x559c8a74e3b0 2024-09-13T06:11:43.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.167+0000 7f4f0fc98640 1 -- 172.21.15.194:0/847134481 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f000aa5c0 con 0x559c8a74e3b0 2024-09-13T06:11:43.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.167+0000 7f4f12989980 1 -- 172.21.15.194:0/847134481 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559c8a74e3b0 msgr2=0x559c8a74cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.167+0000 7f4f12989980 1 --2- 172.21.15.194:0/847134481 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559c8a74e3b0 0x559c8a74cb70 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f4f0000a5c0 tx=0x7f4f0001b340 comp rx=0 tx=0).stop 2024-09-13T06:11:43.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.167+0000 7f4f12989980 1 -- 172.21.15.194:0/847134481 shutdown_connections 2024-09-13T06:11:43.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.167+0000 7f4f12989980 1 --2- 172.21.15.194:0/847134481 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559c8a74e3b0 0x559c8a74cb70 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.167+0000 7f4f12989980 1 -- 172.21.15.194:0/847134481 >> 172.21.15.194:0/847134481 conn(0x559c8a7d31b0 msgr2=0x559c8a7d55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:43.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.167+0000 7f4f12989980 1 -- 172.21.15.194:0/847134481 shutdown_connections 2024-09-13T06:11:43.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.167+0000 7f4f12989980 1 -- 172.21.15.194:0/847134481 wait complete. 2024-09-13T06:11:43.184 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.183+0000 7f4f12989980 1 Processor -- start 2024-09-13T06:11:43.184 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.183+0000 7f4f12989980 1 -- start start 2024-09-13T06:11:43.184 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.183+0000 7f4f12989980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559c8a74e3b0 0x559c8a8c4c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.185 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.183+0000 7f4f12989980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x559c8a685200 con 0x559c8a74e3b0 2024-09-13T06:11:43.185 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.183+0000 7f4f10499640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559c8a74e3b0 0x559c8a8c4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.185 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.183+0000 7f4f10499640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559c8a74e3b0 0x559c8a8c4c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44520/0 (socket says 172.21.15.194:44520) 2024-09-13T06:11:43.186 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.183+0000 7f4f10499640 1 -- 172.21.15.194:0/4133681231 learned_addr learned my addr 172.21.15.194:0/4133681231 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:43.186 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.183+0000 7f4f10499640 1 -- 172.21.15.194:0/4133681231 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c8a8c51f0 con 0x559c8a74e3b0 2024-09-13T06:11:43.186 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.183+0000 7f4f10499640 1 --2- 172.21.15.194:0/4133681231 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559c8a74e3b0 0x559c8a8c4c20 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f4f00018f70 tx=0x7f4f00003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=146dc96e15cfda67 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.183+0000 7f4dfe60c640 1 -- 172.21.15.194:0/4133681231 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f000aa9d0 con 0x559c8a74e3b0 2024-09-13T06:11:43.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.183+0000 7f4dfe60c640 1 -- 172.21.15.194:0/4133681231 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f000aab70 con 0x559c8a74e3b0 2024-09-13T06:11:43.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.183+0000 7f4dfe60c640 1 -- 172.21.15.194:0/4133681231 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f000aae50 con 0x559c8a74e3b0 2024-09-13T06:11:43.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.183+0000 7f4f12989980 1 -- 172.21.15.194:0/4133681231 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559c8a74e3b0 msgr2=0x559c8a8c4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.183+0000 7f4f12989980 1 --2- 172.21.15.194:0/4133681231 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559c8a74e3b0 0x559c8a8c4c20 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f4f00018f70 tx=0x7f4f00003030 comp rx=0 tx=0).stop 2024-09-13T06:11:43.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.183+0000 7f4f12989980 1 -- 172.21.15.194:0/4133681231 shutdown_connections 2024-09-13T06:11:43.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.183+0000 7f4f12989980 1 --2- 172.21.15.194:0/4133681231 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559c8a74e3b0 0x559c8a8c4c20 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.191 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.183+0000 7f4f12989980 1 -- 172.21.15.194:0/4133681231 >> 172.21.15.194:0/4133681231 conn(0x559c8a7d31b0 msgr2=0x559c8a8c0850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:43.191 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.183+0000 7f4f12989980 1 -- 172.21.15.194:0/4133681231 shutdown_connections 2024-09-13T06:11:43.191 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.183+0000 7f4f12989980 1 -- 172.21.15.194:0/4133681231 wait complete. 2024-09-13T06:11:43.191 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.183+0000 7f4f12989980 1 Processor -- start 2024-09-13T06:11:43.191 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.183+0000 7f4f12989980 1 -- start start 2024-09-13T06:11:43.191 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.183+0000 7f4f12989980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559c8a74e3b0 0x559c8a8cbe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.191 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.183+0000 7f4f12989980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x559c8a7e3200 con 0x559c8a74e3b0 2024-09-13T06:11:43.191 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.187+0000 7f4f10499640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559c8a74e3b0 0x559c8a8cbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.191 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.187+0000 7f4f10499640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559c8a74e3b0 0x559c8a8cbe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44522/0 (socket says 172.21.15.194:44522) 2024-09-13T06:11:43.191 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.187+0000 7f4f10499640 1 -- 172.21.15.194:0/765522081 learned_addr learned my addr 172.21.15.194:0/765522081 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:43.191 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.187+0000 7f4f10499640 1 -- 172.21.15.194:0/765522081 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c8a8cc370 con 0x559c8a74e3b0 2024-09-13T06:11:43.191 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.187+0000 7f4f10499640 1 --2- 172.21.15.194:0/765522081 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559c8a74e3b0 0x559c8a8cbe30 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f4f000199f0 tx=0x7f4f000180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.187+0000 7f4dfce09640 1 -- 172.21.15.194:0/765522081 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f000bd8d0 con 0x559c8a74e3b0 2024-09-13T06:11:43.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.187+0000 7f4dfce09640 1 -- 172.21.15.194:0/765522081 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f000cc070 con 0x559c8a74e3b0 2024-09-13T06:11:43.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.187+0000 7f4f12989980 1 -- 172.21.15.194:0/765522081 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559c8a8cc600 con 0x559c8a74e3b0 2024-09-13T06:11:43.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.187+0000 7f4dfce09640 1 -- 172.21.15.194:0/765522081 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f000bdbc0 con 0x559c8a74e3b0 2024-09-13T06:11:43.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.187+0000 7f4f12989980 1 -- 172.21.15.194:0/765522081 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c8a8cf2e0 con 0x559c8a74e3b0 2024-09-13T06:11:43.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.187+0000 7f4dfce09640 1 -- 172.21.15.194:0/765522081 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4f000c6480 con 0x559c8a74e3b0 2024-09-13T06:11:43.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.187+0000 7f4dfce09640 1 --2- 172.21.15.194:0/765522081 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4df80346a0 0x7f4df8036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.187+0000 7f4dfce09640 1 -- 172.21.15.194:0/765522081 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f4f000e56e0 con 0x559c8a74e3b0 2024-09-13T06:11:43.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.187+0000 7f4f07fff640 1 --2- 172.21.15.194:0/765522081 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4df80346a0 0x7f4df8036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.187+0000 7f4f12989980 1 --2- 172.21.15.194:0/765522081 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x559c8a74e7c0 0x559c8a8d2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.187+0000 7f4f12989980 1 -- 172.21.15.194:0/765522081 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559c8a8d3470 con 0x559c8a74e7c0 2024-09-13T06:11:43.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.187+0000 7f4f10c9a640 1 --2- 172.21.15.194:0/765522081 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x559c8a74e7c0 0x559c8a8d2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.187+0000 7f4f07fff640 1 --2- 172.21.15.194:0/765522081 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4df80346a0 0x7f4df8036b60 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8000f70 tx=0x7f4ef8001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.187+0000 7f4f10c9a640 1 --2- 172.21.15.194:0/765522081 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x559c8a74e7c0 0x559c8a8d2f30 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.187+0000 7f4f10c9a640 1 -- 172.21.15.194:0/765522081 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4f0800a4d0 con 0x559c8a74e7c0 2024-09-13T06:11:43.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.187+0000 7f4f12989980 1 -- 172.21.15.194:0/765522081 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559c8a8d0500 con 0x559c8a74e7c0 2024-09-13T06:11:43.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.191+0000 7f4f10c9a640 1 -- 172.21.15.194:0/765522081 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4f0800a4d0 con 0x559c8a74e7c0 2024-09-13T06:11:43.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.191+0000 7f4f12989980 1 --2- 172.21.15.194:0/765522081 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x559c8a8d57f0 0x559c8a8d7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.191+0000 7f4f12989980 1 -- 172.21.15.194:0/765522081 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559c8a8d82b0 con 0x559c8a8d57f0 2024-09-13T06:11:43.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.191+0000 7f4f10499640 1 --2- 172.21.15.194:0/765522081 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x559c8a8d57f0 0x559c8a8d7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.191+0000 7f4f10499640 1 --2- 172.21.15.194:0/765522081 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x559c8a8d57f0 0x559c8a8d7be0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.191+0000 7f4f10499640 1 -- 172.21.15.194:0/765522081 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4f000c5d00 con 0x559c8a8d57f0 2024-09-13T06:11:43.197 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.191+0000 7f4f12989980 1 -- 172.21.15.194:0/765522081 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559c8a8d4690 con 0x559c8a74e7c0 2024-09-13T06:11:43.197 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.191+0000 7f4f10c9a640 1 -- 172.21.15.194:0/765522081 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4f0800a4d0 con 0x559c8a74e7c0 2024-09-13T06:11:43.197 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.191+0000 7f4f12989980 1 --2- 172.21.15.194:0/765522081 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x559c8a8d9710 0x559c8a8dbb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.197 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.191+0000 7f4f12989980 1 -- 172.21.15.194:0/765522081 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559c8a8dc200 con 0x559c8a8d9710 2024-09-13T06:11:43.197 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.191+0000 7f4f07fff640 1 --2- 172.21.15.194:0/765522081 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x559c8a8d9710 0x559c8a8dbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.197 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.191+0000 7f4f07fff640 1 --2- 172.21.15.194:0/765522081 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x559c8a8d9710 0x559c8a8dbb00 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.197 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.191+0000 7f4f07fff640 1 -- 172.21.15.194:0/765522081 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4ef800f6a0 con 0x559c8a8d9710 2024-09-13T06:11:43.197 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.191+0000 7f4f12989980 1 Processor -- start 2024-09-13T06:11:43.197 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.191+0000 7f4f12989980 1 -- start start 2024-09-13T06:11:43.197 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.191+0000 7f4f12989980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559c8a8e9cd0 0x559c8a8ea0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.197 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.191+0000 7f4f12989980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x559c8a6de800 con 0x559c8a8e9cd0 2024-09-13T06:11:43.197 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.191+0000 7f4f10499640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559c8a8e9cd0 0x559c8a8ea0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.191+0000 7f4f10499640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559c8a8e9cd0 0x559c8a8ea0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44528/0 (socket says 172.21.15.194:44528) 2024-09-13T06:11:43.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.191+0000 7f4f10499640 1 -- 172.21.15.194:0/2421900694 learned_addr learned my addr 172.21.15.194:0/2421900694 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:43.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.195+0000 7f4f10499640 1 -- 172.21.15.194:0/2421900694 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c8a8ea630 con 0x559c8a8e9cd0 2024-09-13T06:11:43.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.195+0000 7f4f10499640 1 --2- 172.21.15.194:0/2421900694 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559c8a8e9cd0 0x559c8a8ea0f0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f4f000e3a90 tx=0x7f4f000c68b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.195+0000 7f4df5ffb640 1 -- 172.21.15.194:0/2421900694 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f000e3b40 con 0x559c8a8e9cd0 2024-09-13T06:11:43.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.195+0000 7f4f12989980 1 -- 172.21.15.194:0/2421900694 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559c8a8ea8c0 con 0x559c8a8e9cd0 2024-09-13T06:11:43.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.195+0000 7f4df5ffb640 1 -- 172.21.15.194:0/2421900694 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f000e3ce0 con 0x559c8a8e9cd0 2024-09-13T06:11:43.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.195+0000 7f4df5ffb640 1 -- 172.21.15.194:0/2421900694 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f000b3ad0 con 0x559c8a8e9cd0 2024-09-13T06:11:43.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.195+0000 7f4f12989980 1 -- 172.21.15.194:0/2421900694 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c8a8ed540 con 0x559c8a8e9cd0 2024-09-13T06:11:43.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.195+0000 7f4df5ffb640 1 -- 172.21.15.194:0/2421900694 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4f000b3c70 con 0x559c8a8e9cd0 2024-09-13T06:11:43.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.195+0000 7f4df5ffb640 1 --2- 172.21.15.194:0/2421900694 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4de8034650 0x7f4de8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.195+0000 7f4df5ffb640 1 -- 172.21.15.194:0/2421900694 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f4f000eed00 con 0x559c8a8e9cd0 2024-09-13T06:11:43.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.195+0000 7f4f07fff640 1 --2- 172.21.15.194:0/2421900694 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4de8034650 0x7f4de8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.195+0000 7f4f12989980 1 Processor -- start 2024-09-13T06:11:43.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.195+0000 7f4f12989980 1 -- start start 2024-09-13T06:11:43.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.195+0000 7f4f07fff640 1 --2- 172.21.15.194:0/2421900694 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4de8034650 0x7f4de8036b10 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x559c8a8d3da0 tx=0x7f4ef800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.195+0000 7f4f12989980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559c8a8f6740 0x559c8a8f6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.195+0000 7f4f12989980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x559c8a8c54b0 con 0x559c8a8f6740 2024-09-13T06:11:43.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.195+0000 7f4f10499640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559c8a8f6740 0x559c8a8f6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.195+0000 7f4f10499640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559c8a8f6740 0x559c8a8f6b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44536/0 (socket says 172.21.15.194:44536) 2024-09-13T06:11:43.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.195+0000 7f4f10499640 1 -- 172.21.15.194:0/1413455184 learned_addr learned my addr 172.21.15.194:0/1413455184 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:43.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.195+0000 7f4f10499640 1 -- 172.21.15.194:0/1413455184 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c8a8f70f0 con 0x559c8a8f6740 2024-09-13T06:11:43.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.199+0000 7f4f10499640 1 --2- 172.21.15.194:0/1413455184 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559c8a8f6740 0x559c8a8f6b20 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f4f000d0720 tx=0x7f4f00002e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a990290d48b03fe0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.199+0000 7f4def7fe640 1 -- 172.21.15.194:0/1413455184 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f000da3d0 con 0x559c8a8f6740 2024-09-13T06:11:43.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.199+0000 7f4def7fe640 1 -- 172.21.15.194:0/1413455184 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f00002bb0 con 0x559c8a8f6740 2024-09-13T06:11:43.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.199+0000 7f4def7fe640 1 -- 172.21.15.194:0/1413455184 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f000ca120 con 0x559c8a8f6740 2024-09-13T06:11:43.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.199+0000 7f4f12989980 1 -- 172.21.15.194:0/1413455184 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559c8a8f6740 msgr2=0x559c8a8f6b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.199+0000 7f4f12989980 1 --2- 172.21.15.194:0/1413455184 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559c8a8f6740 0x559c8a8f6b20 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f4f000d0720 tx=0x7f4f00002e70 comp rx=0 tx=0).stop 2024-09-13T06:11:43.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.199+0000 7f4f12989980 1 -- 172.21.15.194:0/1413455184 shutdown_connections 2024-09-13T06:11:43.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.199+0000 7f4f12989980 1 --2- 172.21.15.194:0/1413455184 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559c8a8f6740 0x559c8a8f6b20 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.199+0000 7f4f12989980 1 -- 172.21.15.194:0/1413455184 >> 172.21.15.194:0/1413455184 conn(0x559c8a8f2a70 msgr2=0x559c8a8f0b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:43.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.199+0000 7f4f12989980 1 -- 172.21.15.194:0/1413455184 shutdown_connections 2024-09-13T06:11:43.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.199+0000 7f4f12989980 1 -- 172.21.15.194:0/1413455184 wait complete. 2024-09-13T06:11:43.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.199+0000 7f4f12989980 1 Processor -- start 2024-09-13T06:11:43.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.199+0000 7f4f12989980 1 -- start start 2024-09-13T06:11:43.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.199+0000 7f4f12989980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559c8a8f6740 0x559c8a8fd850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.199+0000 7f4f12989980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x559c8a8f7480 con 0x559c8a8f6740 2024-09-13T06:11:43.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.199+0000 7f4f10499640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559c8a8f6740 0x559c8a8fd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.199+0000 7f4f10499640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559c8a8f6740 0x559c8a8fd850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44542/0 (socket says 172.21.15.194:44542) 2024-09-13T06:11:43.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.199+0000 7f4f10499640 1 -- 172.21.15.194:0/2439724968 learned_addr learned my addr 172.21.15.194:0/2439724968 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:43.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.199+0000 7f4f10499640 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c8a8fdd90 con 0x559c8a8f6740 2024-09-13T06:11:43.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.199+0000 7f4f10499640 1 --2- 172.21.15.194:0/2439724968 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559c8a8f6740 0x559c8a8fd850 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f4f000d0720 tx=0x7f4f000c1fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.199+0000 7f4dedffb640 1 -- 172.21.15.194:0/2439724968 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f0010f020 con 0x559c8a8f6740 2024-09-13T06:11:43.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.199+0000 7f4f12989980 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559c8a8fdd90 con 0x559c8a8f6740 2024-09-13T06:11:43.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.199+0000 7f4dedffb640 1 -- 172.21.15.194:0/2439724968 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f000c0d50 con 0x559c8a8f6740 2024-09-13T06:11:43.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.199+0000 7f4dedffb640 1 -- 172.21.15.194:0/2439724968 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f000bbb90 con 0x559c8a8f6740 2024-09-13T06:11:43.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.199+0000 7f4f12989980 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c8a8fe200 con 0x559c8a8f6740 2024-09-13T06:11:43.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.203+0000 7f4dedffb640 1 -- 172.21.15.194:0/2439724968 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4f00112020 con 0x559c8a8f6740 2024-09-13T06:11:43.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.203+0000 7f4dedffb640 1 --2- 172.21.15.194:0/2439724968 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4de0034650 0x7f4de0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.203+0000 7f4dedffb640 1 -- 172.21.15.194:0/2439724968 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f4f00106050 con 0x559c8a8f6740 2024-09-13T06:11:43.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.203+0000 7f4f07fff640 1 --2- 172.21.15.194:0/2439724968 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4de0034650 0x7f4de0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.203+0000 7f4f12989980 20 rados->read ofs=0 len=0 2024-09-13T06:11:43.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.203+0000 7f4f12989980 1 --2- 172.21.15.194:0/2439724968 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x559c8a9087f0 0x559c8a90acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.203+0000 7f4f12989980 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559c8a90b400 con 0x559c8a9087f0 2024-09-13T06:11:43.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.203+0000 7f4f10c9a640 1 --2- 172.21.15.194:0/2439724968 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x559c8a9087f0 0x559c8a90acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.203+0000 7f4f10c9a640 1 --2- 172.21.15.194:0/2439724968 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x559c8a9087f0 0x559c8a90acb0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.203+0000 7f4f07fff640 1 --2- 172.21.15.194:0/2439724968 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4de0034650 0x7f4de0036b10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4ef800ffd0 tx=0x7f4ef8010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.203+0000 7f4f10c9a640 1 -- 172.21.15.194:0/2439724968 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4f0800a4d0 con 0x559c8a9087f0 2024-09-13T06:11:43.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.203+0000 7f4f12989980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:43.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.203+0000 7f4f12989980 20 realm 2024-09-13T06:11:43.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.203+0000 7f4f12989980 20 rados->read ofs=0 len=0 2024-09-13T06:11:43.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.203+0000 7f4f12989980 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559c8a90b810 con 0x559c8a9087f0 2024-09-13T06:11:43.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.203+0000 7f4f10c9a640 1 -- 172.21.15.194:0/2439724968 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4f0800a4d0 con 0x559c8a9087f0 2024-09-13T06:11:43.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.203+0000 7f4f12989980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:43.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.203+0000 7f4f12989980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:11:43.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.203+0000 7f4f12989980 20 rados->read ofs=0 len=0 2024-09-13T06:11:43.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.203+0000 7f4f12989980 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559c8a90c0e0 con 0x559c8a9087f0 2024-09-13T06:11:43.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.203+0000 7f4f10c9a640 1 -- 172.21.15.194:0/2439724968 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4f0800a4d0 con 0x559c8a9087f0 2024-09-13T06:11:43.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.203+0000 7f4f12989980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:43.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.203+0000 7f4f12989980 20 rados->read ofs=0 len=0 2024-09-13T06:11:43.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.203+0000 7f4f12989980 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559c8a90c480 con 0x559c8a9087f0 2024-09-13T06:11:43.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.203+0000 7f4f10c9a640 1 -- 172.21.15.194:0/2439724968 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4f0800a4d0 con 0x559c8a9087f0 2024-09-13T06:11:43.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.203+0000 7f4f12989980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:11:43.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.203+0000 7f4f12989980 20 rados->read ofs=0 len=0 2024-09-13T06:11:43.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.203+0000 7f4f12989980 1 --2- 172.21.15.194:0/2439724968 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x559c8a90cf70 0x559c8a90f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.203+0000 7f4f12989980 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559c8a90fac0 con 0x559c8a90cf70 2024-09-13T06:11:43.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.203+0000 7f4f10499640 1 --2- 172.21.15.194:0/2439724968 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x559c8a90cf70 0x559c8a90f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.203+0000 7f4f10499640 1 --2- 172.21.15.194:0/2439724968 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x559c8a90cf70 0x559c8a90f360 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.203+0000 7f4f10499640 1 -- 172.21.15.194:0/2439724968 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4f000f4070 con 0x559c8a90cf70 2024-09-13T06:11:43.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.203+0000 7f4f12989980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:11:43.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.203+0000 7f4f12989980 20 searching for the correct realm 2024-09-13T06:11:43.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.203+0000 7f4f12989980 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559c8a911390 con 0x559c8a90cf70 2024-09-13T06:11:43.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.203+0000 7f4f10499640 1 -- 172.21.15.194:0/2439724968 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f000f4070 con 0x559c8a90cf70 2024-09-13T06:11:43.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.203+0000 7f4f10499640 1 --2- 172.21.15.194:0/2439724968 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f4f00114020 0x7f4f000f78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.203+0000 7f4f10499640 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559c8a911390 con 0x7f4f00114020 2024-09-13T06:11:43.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.203+0000 7f4f07fff640 1 --2- 172.21.15.194:0/2439724968 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f4f00114020 0x7f4f000f78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.207+0000 7f4f07fff640 1 --2- 172.21.15.194:0/2439724968 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f4f00114020 0x7f4f000f78a0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.214 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.207+0000 7f4f07fff640 1 -- 172.21.15.194:0/2439724968 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4ef8037040 con 0x7f4f00114020 2024-09-13T06:11:43.215 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.207+0000 7f4f07fff640 1 --2- 172.21.15.194:0/2439724968 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f4ef802e910 0x7f4ef803a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.215 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.207+0000 7f4f07fff640 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559c8a911390 con 0x7f4ef802e910 2024-09-13T06:11:43.215 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.207+0000 7f4f10c9a640 1 --2- 172.21.15.194:0/2439724968 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f4ef802e910 0x7f4ef803a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.215 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.207+0000 7f4f10c9a640 1 --2- 172.21.15.194:0/2439724968 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f4ef802e910 0x7f4ef803a3c0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.215 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.207+0000 7f4f10c9a640 1 -- 172.21.15.194:0/2439724968 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f0800a4d0 con 0x7f4ef802e910 2024-09-13T06:11:43.215 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.207+0000 7f4f10c9a640 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559c8a90c480 con 0x559c8a9087f0 2024-09-13T06:11:43.215 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.207+0000 7f4f10c9a640 1 -- 172.21.15.194:0/2439724968 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f0800a4d0 con 0x559c8a9087f0 2024-09-13T06:11:43.215 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.207+0000 7f4f10c9a640 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559c8a90c480 con 0x559c8a9087f0 2024-09-13T06:11:43.215 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.207+0000 7f4f10c9a640 1 -- 172.21.15.194:0/2439724968 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f0800a4d0 con 0x559c8a9087f0 2024-09-13T06:11:43.215 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.207+0000 7f4f10c9a640 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559c8a90c480 con 0x7f4ef802e910 2024-09-13T06:11:43.215 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.207+0000 7f4f10c9a640 1 -- 172.21.15.194:0/2439724968 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f0800a4d0 con 0x7f4ef802e910 2024-09-13T06:11:43.215 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.207+0000 7f4f10c9a640 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559c8a90c480 con 0x7f4ef802e910 2024-09-13T06:11:43.215 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.211+0000 7f4f10c9a640 1 -- 172.21.15.194:0/2439724968 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f0800a4d0 con 0x7f4ef802e910 2024-09-13T06:11:43.215 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.211+0000 7f4f10c9a640 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559c8a90c480 con 0x7f4f00114020 2024-09-13T06:11:43.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.211+0000 7f4f07fff640 1 -- 172.21.15.194:0/2439724968 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ef8037040 con 0x7f4f00114020 2024-09-13T06:11:43.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.211+0000 7f4f07fff640 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559c8a90c480 con 0x559c8a90cf70 2024-09-13T06:11:43.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.211+0000 7f4f10499640 1 -- 172.21.15.194:0/2439724968 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f000f4070 con 0x559c8a90cf70 2024-09-13T06:11:43.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.211+0000 7f4f10499640 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559c8a90c480 con 0x559c8a9087f0 2024-09-13T06:11:43.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.211+0000 7f4f10c9a640 1 -- 172.21.15.194:0/2439724968 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f0800a4d0 con 0x559c8a9087f0 2024-09-13T06:11:43.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.211+0000 7f4f10c9a640 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559c8a90c480 con 0x7f4ef802e910 2024-09-13T06:11:43.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.211+0000 7f4f10c9a640 1 -- 172.21.15.194:0/2439724968 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f0800a4d0 con 0x7f4ef802e910 2024-09-13T06:11:43.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.211+0000 7f4f10c9a640 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559c8a90c480 con 0x559c8a9087f0 2024-09-13T06:11:43.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.211+0000 7f4f10c9a640 1 -- 172.21.15.194:0/2439724968 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f0800a4d0 con 0x559c8a9087f0 2024-09-13T06:11:43.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.211+0000 7f4f10c9a640 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559c8a90c480 con 0x7f4f00114020 2024-09-13T06:11:43.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.211+0000 7f4f07fff640 1 -- 172.21.15.194:0/2439724968 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4ef8037040 con 0x7f4f00114020 2024-09-13T06:11:43.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.211+0000 7f4f07fff640 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559c8a90c480 con 0x559c8a90cf70 2024-09-13T06:11:43.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.211+0000 7f4f10499640 1 -- 172.21.15.194:0/2439724968 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f000f4070 con 0x559c8a90cf70 2024-09-13T06:11:43.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.211+0000 7f4f10499640 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559c8a90c480 con 0x559c8a90cf70 2024-09-13T06:11:43.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.211+0000 7f4f10499640 1 -- 172.21.15.194:0/2439724968 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f000f4070 con 0x559c8a90cf70 2024-09-13T06:11:43.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.211+0000 7f4f10499640 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559c8a90c480 con 0x7f4ef802e910 2024-09-13T06:11:43.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.211+0000 7f4f10c9a640 1 -- 172.21.15.194:0/2439724968 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f0800a4d0 con 0x7f4ef802e910 2024-09-13T06:11:43.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.211+0000 7f4f10c9a640 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559c8a90c480 con 0x559c8a90cf70 2024-09-13T06:11:43.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.211+0000 7f4f10499640 1 -- 172.21.15.194:0/2439724968 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f000f4070 con 0x559c8a90cf70 2024-09-13T06:11:43.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.211+0000 7f4f10499640 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559c8a90c480 con 0x559c8a90cf70 2024-09-13T06:11:43.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.215+0000 7f4f10499640 1 -- 172.21.15.194:0/2439724968 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f000f4070 con 0x559c8a90cf70 2024-09-13T06:11:43.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.215+0000 7f4f10499640 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559c8a90c480 con 0x559c8a9087f0 2024-09-13T06:11:43.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.215+0000 7f4f10c9a640 1 -- 172.21.15.194:0/2439724968 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f0800a4d0 con 0x559c8a9087f0 2024-09-13T06:11:43.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.215+0000 7f4f10c9a640 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559c8a90c480 con 0x559c8a9087f0 2024-09-13T06:11:43.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.215+0000 7f4f10c9a640 1 -- 172.21.15.194:0/2439724968 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4f0800a4d0 con 0x559c8a9087f0 2024-09-13T06:11:43.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.215+0000 7f4f10c9a640 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559c8a90c480 con 0x7f4f00114020 2024-09-13T06:11:43.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.215+0000 7f4f07fff640 1 -- 172.21.15.194:0/2439724968 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ef8037040 con 0x7f4f00114020 2024-09-13T06:11:43.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.215+0000 7f4f07fff640 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559c8a90c480 con 0x559c8a90cf70 2024-09-13T06:11:43.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.215+0000 7f4f10499640 1 -- 172.21.15.194:0/2439724968 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f000f4070 con 0x559c8a90cf70 2024-09-13T06:11:43.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.215+0000 7f4f10499640 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559c8a90c480 con 0x7f4f00114020 2024-09-13T06:11:43.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.215+0000 7f4f07fff640 1 -- 172.21.15.194:0/2439724968 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ef8037040 con 0x7f4f00114020 2024-09-13T06:11:43.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.215+0000 7f4f07fff640 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559c8a90c480 con 0x559c8a9087f0 2024-09-13T06:11:43.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.215+0000 7f4f10c9a640 1 -- 172.21.15.194:0/2439724968 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f0800a4d0 con 0x559c8a9087f0 2024-09-13T06:11:43.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.215+0000 7f4f10c9a640 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559c8a90c480 con 0x7f4ef802e910 2024-09-13T06:11:43.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.215+0000 7f4f10c9a640 1 -- 172.21.15.194:0/2439724968 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f0800a4d0 con 0x7f4ef802e910 2024-09-13T06:11:43.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.215+0000 7f4f10c9a640 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559c8a90c480 con 0x559c8a90cf70 2024-09-13T06:11:43.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.215+0000 7f4f10499640 1 -- 172.21.15.194:0/2439724968 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4f000f4070 con 0x559c8a90cf70 2024-09-13T06:11:43.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.215+0000 7f4f10499640 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559c8a90c480 con 0x7f4f00114020 2024-09-13T06:11:43.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.215+0000 7f4f07fff640 1 -- 172.21.15.194:0/2439724968 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ef8037040 con 0x7f4f00114020 2024-09-13T06:11:43.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.215+0000 7f4f07fff640 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559c8a90c480 con 0x7f4f00114020 2024-09-13T06:11:43.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.215+0000 7f4f07fff640 1 -- 172.21.15.194:0/2439724968 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ef804a040 con 0x7f4f00114020 2024-09-13T06:11:43.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.215+0000 7f4f07fff640 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559c8a90c480 con 0x559c8a90cf70 2024-09-13T06:11:43.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.215+0000 7f4f10499640 1 -- 172.21.15.194:0/2439724968 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f000f4070 con 0x559c8a90cf70 2024-09-13T06:11:43.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.215+0000 7f4f10499640 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559c8a90c480 con 0x7f4ef802e910 2024-09-13T06:11:43.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.219+0000 7f4f10c9a640 1 -- 172.21.15.194:0/2439724968 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f0800a4d0 con 0x7f4ef802e910 2024-09-13T06:11:43.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.219+0000 7f4f10c9a640 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559c8a90c480 con 0x559c8a9087f0 2024-09-13T06:11:43.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.219+0000 7f4f10c9a640 1 -- 172.21.15.194:0/2439724968 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4f0800a4d0 con 0x559c8a9087f0 2024-09-13T06:11:43.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.219+0000 7f4f10c9a640 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559c8a90c480 con 0x7f4f00114020 2024-09-13T06:11:43.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.219+0000 7f4f07fff640 1 -- 172.21.15.194:0/2439724968 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ef804a040 con 0x7f4f00114020 2024-09-13T06:11:43.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.219+0000 7f4f12989980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:11:43.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.219+0000 7f4f12989980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:11:43.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.219+0000 7f4f12989980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:11:43.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.219+0000 7f4f12989980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:11:43.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.219+0000 7f4f12989980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:11:43.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.219+0000 7f4f12989980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:11:43.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.219+0000 7f4f12989980 20 rados->read ofs=0 len=0 2024-09-13T06:11:43.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.219+0000 7f4f12989980 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559c8a9104b0 con 0x559c8a9087f0 2024-09-13T06:11:43.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.219+0000 7f4f10c9a640 1 -- 172.21.15.194:0/2439724968 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4f0800a4d0 con 0x559c8a9087f0 2024-09-13T06:11:43.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.219+0000 7f4f12989980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:43.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.219+0000 7f4f12989980 20 rados->read ofs=0 len=0 2024-09-13T06:11:43.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.219+0000 7f4f12989980 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559c8a910d50 con 0x559c8a9087f0 2024-09-13T06:11:43.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.219+0000 7f4f10c9a640 1 -- 172.21.15.194:0/2439724968 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4f0800a4d0 con 0x559c8a9087f0 2024-09-13T06:11:43.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.219+0000 7f4f12989980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:11:43.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.219+0000 7f4f12989980 20 rados->read ofs=0 len=0 2024-09-13T06:11:43.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.219+0000 7f4f12989980 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559c8a9100f0 con 0x7f4f00114020 2024-09-13T06:11:43.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.219+0000 7f4f07fff640 1 -- 172.21.15.194:0/2439724968 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4ef804a040 con 0x7f4f00114020 2024-09-13T06:11:43.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.219+0000 7f4f12989980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:11:43.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.219+0000 7f4f12989980 20 zone default found 2024-09-13T06:11:43.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.219+0000 7f4f12989980 4 Realm: () 2024-09-13T06:11:43.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.219+0000 7f4f12989980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:11:43.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.219+0000 7f4f12989980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:11:43.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.219+0000 7f4f12989980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:11:43.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.219+0000 7f4f12989980 20 zonegroup default 2024-09-13T06:11:43.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.219+0000 7f4f12989980 20 rados->read ofs=0 len=0 2024-09-13T06:11:43.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.219+0000 7f4f12989980 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559c8a910d50 con 0x7f4ef802e910 2024-09-13T06:11:43.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.219+0000 7f4f10c9a640 1 -- 172.21.15.194:0/2439724968 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4f0800a4d0 con 0x7f4ef802e910 2024-09-13T06:11:43.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.219+0000 7f4f12989980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:43.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.219+0000 7f4f12989980 20 rados->read ofs=0 len=0 2024-09-13T06:11:43.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.219+0000 7f4f12989980 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559c8a913220 con 0x559c8a90cf70 2024-09-13T06:11:43.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.219+0000 7f4f10499640 1 -- 172.21.15.194:0/2439724968 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4f000f4070 con 0x559c8a90cf70 2024-09-13T06:11:43.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.219+0000 7f4f12989980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:43.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.219+0000 7f4f12989980 20 rados->read ofs=0 len=0 2024-09-13T06:11:43.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.219+0000 7f4f12989980 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559c8a9135c0 con 0x559c8a90cf70 2024-09-13T06:11:43.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.219+0000 7f4f10499640 1 -- 172.21.15.194:0/2439724968 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4f000f4070 con 0x559c8a90cf70 2024-09-13T06:11:43.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.219+0000 7f4f12989980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:43.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.219+0000 7f4f12989980 20 started sync module instance, tier type = 2024-09-13T06:11:43.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.219+0000 7f4f12989980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:11:43.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.219+0000 7f4f12989980 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559c8a9126c0 con 0x7f4f00114020 2024-09-13T06:11:43.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.223+0000 7f4f07fff640 1 -- 172.21.15.194:0/2439724968 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(44 notify.0 [create] v35'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ef804a040 con 0x7f4f00114020 2024-09-13T06:11:43.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.223+0000 7f4f12989980 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94130828028592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559c8a912320 con 0x7f4f00114020 2024-09-13T06:11:43.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.223+0000 7f4f12989980 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559c8a914480 con 0x559c8a9087f0 2024-09-13T06:11:43.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.223+0000 7f4f07fff640 1 -- 172.21.15.194:0/2439724968 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94130828028592] v35'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ef804a040 con 0x7f4f00114020 2024-09-13T06:11:43.232 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.223+0000 7f4f10c9a640 1 -- 172.21.15.194:0/2439724968 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v35'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f0800a4d0 con 0x559c8a9087f0 2024-09-13T06:11:43.232 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.223+0000 7f4f12989980 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94130828034000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559c8a9143f0 con 0x559c8a9087f0 2024-09-13T06:11:43.232 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.223+0000 7f4f12989980 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559c8a915230 con 0x559c8a90cf70 2024-09-13T06:11:43.232 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.227+0000 7f4f10c9a640 1 -- 172.21.15.194:0/2439724968 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94130828034000] v35'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f0800a4d0 con 0x559c8a9087f0 2024-09-13T06:11:43.232 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.227+0000 7f4f10499640 1 -- 172.21.15.194:0/2439724968 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v35'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f000f4070 con 0x559c8a90cf70 2024-09-13T06:11:43.232 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.227+0000 7f4f12989980 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94130828036208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559c8a915650 con 0x559c8a90cf70 2024-09-13T06:11:43.232 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.227+0000 7f4f12989980 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559c8a915f40 con 0x7f4f00114020 2024-09-13T06:11:43.232 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.227+0000 7f4f07fff640 1 -- 172.21.15.194:0/2439724968 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(50 notify.3 [create] v35'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ef804a040 con 0x7f4f00114020 2024-09-13T06:11:43.232 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.227+0000 7f4f12989980 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94130828040064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559c8a9167e0 con 0x7f4f00114020 2024-09-13T06:11:43.232 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.227+0000 7f4f12989980 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559c8a917200 con 0x559c8a9087f0 2024-09-13T06:11:43.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.227+0000 7f4f10499640 1 -- 172.21.15.194:0/2439724968 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94130828036208] v35'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f000f4070 con 0x559c8a90cf70 2024-09-13T06:11:43.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.231+0000 7f4f07fff640 1 -- 172.21.15.194:0/2439724968 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94130828040064] v35'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ef804a040 con 0x7f4f00114020 2024-09-13T06:11:43.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.231+0000 7f4f10c9a640 1 -- 172.21.15.194:0/2439724968 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v35'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f0800a4d0 con 0x559c8a9087f0 2024-09-13T06:11:43.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.231+0000 7f4f12989980 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94130828043056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559c8a914c90 con 0x559c8a9087f0 2024-09-13T06:11:43.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.231+0000 7f4f12989980 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559c8a917aa0 con 0x7f4ef802e910 2024-09-13T06:11:43.235 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.231+0000 7f4f10c9a640 1 -- 172.21.15.194:0/2439724968 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94130828043056] v35'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f0800a4d0 con 0x559c8a9087f0 2024-09-13T06:11:43.235 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.231+0000 7f4f10c9a640 1 -- 172.21.15.194:0/2439724968 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(54 notify.5 [create] v35'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f0800a4d0 con 0x7f4ef802e910 2024-09-13T06:11:43.235 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.231+0000 7f4f12989980 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94130828045552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559c8a917a20 con 0x7f4ef802e910 2024-09-13T06:11:43.235 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.231+0000 7f4f12989980 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559c8a9183e0 con 0x7f4ef802e910 2024-09-13T06:11:43.237 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.235+0000 7f4f10c9a640 1 -- 172.21.15.194:0/2439724968 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94130828045552] v35'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f0800a4d0 con 0x7f4ef802e910 2024-09-13T06:11:43.238 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.235+0000 7f4f10c9a640 1 -- 172.21.15.194:0/2439724968 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(56 notify.6 [create] v35'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f0800a4d0 con 0x7f4ef802e910 2024-09-13T06:11:43.238 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.235+0000 7f4f12989980 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94130828048000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559c8a9183e0 con 0x7f4ef802e910 2024-09-13T06:11:43.238 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.235+0000 7f4f12989980 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559c8a918da0 con 0x7f4ef802e910 2024-09-13T06:11:43.239 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.235+0000 7f4f10c9a640 1 -- 172.21.15.194:0/2439724968 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94130828048000] v35'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f0800a4d0 con 0x7f4ef802e910 2024-09-13T06:11:43.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.239+0000 7f4f10c9a640 1 -- 172.21.15.194:0/2439724968 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(58 notify.7 [create] v35'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f0800a4d0 con 0x7f4ef802e910 2024-09-13T06:11:43.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.239+0000 7f4f12989980 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94130828050496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559c8a918da0 con 0x7f4ef802e910 2024-09-13T06:11:43.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.239+0000 7f4f12989980 20 add_watcher() i=0 2024-09-13T06:11:43.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.239+0000 7f4f12989980 20 add_watcher() i=1 2024-09-13T06:11:43.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.239+0000 7f4f12989980 20 add_watcher() i=2 2024-09-13T06:11:43.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.239+0000 7f4f12989980 20 add_watcher() i=3 2024-09-13T06:11:43.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.239+0000 7f4f12989980 20 add_watcher() i=4 2024-09-13T06:11:43.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.239+0000 7f4f12989980 20 add_watcher() i=5 2024-09-13T06:11:43.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.239+0000 7f4f12989980 20 add_watcher() i=6 2024-09-13T06:11:43.242 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.239+0000 7f4f10c9a640 1 -- 172.21.15.194:0/2439724968 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94130828050496] v35'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f0800a4d0 con 0x7f4ef802e910 2024-09-13T06:11:43.242 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.239+0000 7f4f12989980 20 add_watcher() i=7 2024-09-13T06:11:43.242 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.239+0000 7f4f12989980 2 all 8 watchers are set, enabling cache 2024-09-13T06:11:43.242 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.239+0000 7f4f12989980 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559c8a91c070 con 0x559c8a9087f0 2024-09-13T06:11:43.243 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.239+0000 7f4f10c9a640 1 -- 172.21.15.194:0/2439724968 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4f0800a4d0 con 0x559c8a9087f0 2024-09-13T06:11:43.243 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.239+0000 7f4f12989980 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94130828053088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559c8a919330 con 0x559c8a9087f0 2024-09-13T06:11:43.244 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.243+0000 7f4f10c9a640 1 -- 172.21.15.194:0/2439724968 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94130828053088] v35'230 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4f0800a4d0 con 0x559c8a9087f0 2024-09-13T06:11:43.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.243+0000 7f4dc67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:11:43.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.243+0000 7f4f12989980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:11:43.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.243+0000 7f4f12989980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:11:43.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.243+0000 7f4f12989980 5 note: GC not initialized 2024-09-13T06:11:43.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.243+0000 7f4dc57e2640 20 reqs_thread_entry: start 2024-09-13T06:11:43.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.243+0000 7f4f12989980 20 init_complete bucket index max shards: 11 2024-09-13T06:11:43.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.243+0000 7f4f12989980 20 Filter name: none 2024-09-13T06:11:43.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.243+0000 7f4d36ffd640 20 reqs_thread_entry: start 2024-09-13T06:11:43.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.243+0000 7f4f12989980 20 rados->read ofs=0 len=0 2024-09-13T06:11:43.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.243+0000 7f4f12989980 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559c8a93f2b0 con 0x559c8a9087f0 2024-09-13T06:11:43.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.243+0000 7f4f10c9a640 1 -- 172.21.15.194:0/2439724968 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv23 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f4f0800a4d0 con 0x559c8a9087f0 2024-09-13T06:11:43.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.243+0000 7f4f12989980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T06:11:43.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.243+0000 7f4f12989980 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559c8a940800 con 0x7f4ef802e910 2024-09-13T06:11:43.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.243+0000 7f4f10c9a640 1 -- 172.21.15.194:0/2439724968 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(63 usage.10 [call out=15b] v0'0 uv33 ondisk = 0) ==== 152+0+15 (crc 0 0 0) 0x7f4f0800a4d0 con 0x7f4ef802e910 2024-09-13T06:11:43.247 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.243+0000 7f4dc67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:11:43.247 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.243+0000 7f4f12989980 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94130828053088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559c8a902730 con 0x559c8a9087f0 2024-09-13T06:11:43.248 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.247+0000 7f4f10c9a640 1 -- 172.21.15.194:0/2439724968 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94130828053088] v35'231 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4f0800a4d0 con 0x559c8a9087f0 2024-09-13T06:11:43.248 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.247+0000 7f4f12989980 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94130828028592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559c8a918a60 con 0x7f4f00114020 2024-09-13T06:11:43.249 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.247+0000 7f4f07fff640 1 -- 172.21.15.194:0/2439724968 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94130828028592] v35'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ef804a040 con 0x7f4f00114020 2024-09-13T06:11:43.249 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.247+0000 7f4f12989980 20 remove_watcher() i=0 2024-09-13T06:11:43.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.247+0000 7f4f12989980 2 removed watcher, disabling cache 2024-09-13T06:11:43.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.247+0000 7f4f12989980 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94130828034000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559c8a918a60 con 0x559c8a9087f0 2024-09-13T06:11:43.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.247+0000 7f4f10c9a640 1 -- 172.21.15.194:0/2439724968 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94130828034000] v35'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f0800a4d0 con 0x559c8a9087f0 2024-09-13T06:11:43.252 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.247+0000 7f4f12989980 20 remove_watcher() i=1 2024-09-13T06:11:43.252 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.247+0000 7f4f12989980 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94130828036208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559c8a913fd0 con 0x559c8a90cf70 2024-09-13T06:11:43.254 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.251+0000 7f4f10499640 1 -- 172.21.15.194:0/2439724968 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94130828036208] v35'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f000f4070 con 0x559c8a90cf70 2024-09-13T06:11:43.254 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.251+0000 7f4f12989980 20 remove_watcher() i=2 2024-09-13T06:11:43.254 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.251+0000 7f4f12989980 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94130828040064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559c8a918a60 con 0x7f4f00114020 2024-09-13T06:11:43.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.251+0000 7f4f07fff640 1 -- 172.21.15.194:0/2439724968 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94130828040064] v35'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ef804a040 con 0x7f4f00114020 2024-09-13T06:11:43.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.251+0000 7f4f12989980 20 remove_watcher() i=3 2024-09-13T06:11:43.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.251+0000 7f4f12989980 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94130828043056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559c8a914870 con 0x559c8a9087f0 2024-09-13T06:11:43.257 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.255+0000 7f4f10c9a640 1 -- 172.21.15.194:0/2439724968 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94130828043056] v35'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f0800a4d0 con 0x559c8a9087f0 2024-09-13T06:11:43.257 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.255+0000 7f4f12989980 20 remove_watcher() i=4 2024-09-13T06:11:43.258 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.255+0000 7f4f12989980 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94130828045552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559c8a913fd0 con 0x7f4ef802e910 2024-09-13T06:11:43.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.255+0000 7f4f10c9a640 1 -- 172.21.15.194:0/2439724968 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94130828045552] v35'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f0800a4d0 con 0x7f4ef802e910 2024-09-13T06:11:43.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.255+0000 7f4f12989980 20 remove_watcher() i=5 2024-09-13T06:11:43.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.255+0000 7f4f12989980 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94130828048000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559c8a918a60 con 0x7f4ef802e910 2024-09-13T06:11:43.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.259+0000 7f4f10c9a640 1 -- 172.21.15.194:0/2439724968 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94130828048000] v35'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f0800a4d0 con 0x7f4ef802e910 2024-09-13T06:11:43.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.259+0000 7f4f12989980 20 remove_watcher() i=6 2024-09-13T06:11:43.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.259+0000 7f4f12989980 1 -- 172.21.15.194:0/2439724968 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94130828050496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559c8a918a60 con 0x7f4ef802e910 2024-09-13T06:11:43.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.263+0000 7f4f10c9a640 1 -- 172.21.15.194:0/2439724968 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94130828050496] v35'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f0800a4d0 con 0x7f4ef802e910 2024-09-13T06:11:43.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.263+0000 7f4f12989980 20 remove_watcher() i=7 2024-09-13T06:11:43.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.263+0000 7f4f12989980 1 -- 172.21.15.194:0/2439724968 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f4ef802e910 msgr2=0x7f4ef803a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.263+0000 7f4f12989980 1 --2- 172.21.15.194:0/2439724968 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f4ef802e910 0x7f4ef803a3c0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.263+0000 7f4f12989980 1 -- 172.21.15.194:0/2439724968 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x559c8a9087f0 msgr2=0x559c8a90acb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.263+0000 7f4f12989980 1 --2- 172.21.15.194:0/2439724968 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x559c8a9087f0 0x559c8a90acb0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.263+0000 7f4f12989980 1 -- 172.21.15.194:0/2439724968 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f4f00114020 msgr2=0x7f4f000f78a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.263+0000 7f4f12989980 1 --2- 172.21.15.194:0/2439724968 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f4f00114020 0x7f4f000f78a0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.263+0000 7f4f12989980 1 -- 172.21.15.194:0/2439724968 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x559c8a90cf70 msgr2=0x559c8a90f360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.263+0000 7f4f12989980 1 --2- 172.21.15.194:0/2439724968 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x559c8a90cf70 0x559c8a90f360 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.263+0000 7f4f12989980 1 -- 172.21.15.194:0/2439724968 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4de0034650 msgr2=0x7f4de0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.263+0000 7f4f12989980 1 --2- 172.21.15.194:0/2439724968 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4de0034650 0x7f4de0036b10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4ef800ffd0 tx=0x7f4ef8010000 comp rx=0 tx=0).stop 2024-09-13T06:11:43.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.263+0000 7f4f10c9a640 1 -- 172.21.15.194:0/2439724968 reap_dead start 2024-09-13T06:11:43.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.263+0000 7f4f12989980 1 -- 172.21.15.194:0/2439724968 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559c8a8f6740 msgr2=0x559c8a8fd850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.263+0000 7f4f12989980 1 --2- 172.21.15.194:0/2439724968 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559c8a8f6740 0x559c8a8fd850 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f4f000d0720 tx=0x7f4f000c1fb0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.263+0000 7f4f12989980 1 -- 172.21.15.194:0/2439724968 shutdown_connections 2024-09-13T06:11:43.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.263+0000 7f4f12989980 1 --2- 172.21.15.194:0/2439724968 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559c8a8f6740 0x559c8a8fd850 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.263+0000 7f4f12989980 1 -- 172.21.15.194:0/2439724968 >> 172.21.15.194:0/2439724968 conn(0x559c8a8f2a70 msgr2=0x559c8a8f0b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:43.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.263+0000 7f4f12989980 1 -- 172.21.15.194:0/2439724968 shutdown_connections 2024-09-13T06:11:43.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.263+0000 7f4f12989980 1 -- 172.21.15.194:0/2439724968 wait complete. 2024-09-13T06:11:43.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.263+0000 7f4f12989980 1 -- 172.21.15.194:0/2421900694 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4de8034650 msgr2=0x7f4de8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.263+0000 7f4f12989980 1 --2- 172.21.15.194:0/2421900694 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4de8034650 0x7f4de8036b10 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x559c8a8d3da0 tx=0x7f4ef800f000 comp rx=0 tx=0).stop 2024-09-13T06:11:43.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.263+0000 7f4f12989980 1 -- 172.21.15.194:0/2421900694 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559c8a8e9cd0 msgr2=0x559c8a8ea0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.263+0000 7f4f12989980 1 --2- 172.21.15.194:0/2421900694 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559c8a8e9cd0 0x559c8a8ea0f0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f4f000e3a90 tx=0x7f4f000c68b0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.263+0000 7f4f12989980 1 -- 172.21.15.194:0/2421900694 shutdown_connections 2024-09-13T06:11:43.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.263+0000 7f4f12989980 1 --2- 172.21.15.194:0/2421900694 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4de8034650 0x7f4de8036b10 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.263+0000 7f4f12989980 1 --2- 172.21.15.194:0/2421900694 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559c8a8e9cd0 0x559c8a8ea0f0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.263+0000 7f4f12989980 1 -- 172.21.15.194:0/2421900694 >> 172.21.15.194:0/2421900694 conn(0x559c8a8dee20 msgr2=0x559c8a8e18a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:43.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.263+0000 7f4f12989980 1 -- 172.21.15.194:0/2421900694 shutdown_connections 2024-09-13T06:11:43.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.263+0000 7f4f12989980 1 -- 172.21.15.194:0/2421900694 wait complete. 2024-09-13T06:11:43.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.263+0000 7f4f12989980 1 -- 172.21.15.194:0/765522081 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x559c8a74e7c0 msgr2=0x559c8a8d2f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.263+0000 7f4f12989980 1 --2- 172.21.15.194:0/765522081 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x559c8a74e7c0 0x559c8a8d2f30 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.263+0000 7f4f12989980 1 -- 172.21.15.194:0/765522081 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x559c8a8d9710 msgr2=0x559c8a8dbb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.263+0000 7f4f12989980 1 --2- 172.21.15.194:0/765522081 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x559c8a8d9710 0x559c8a8dbb00 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.263+0000 7f4f12989980 1 -- 172.21.15.194:0/765522081 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x559c8a8d57f0 msgr2=0x559c8a8d7be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.263+0000 7f4f12989980 1 --2- 172.21.15.194:0/765522081 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x559c8a8d57f0 0x559c8a8d7be0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.263+0000 7f4f12989980 1 -- 172.21.15.194:0/765522081 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4df80346a0 msgr2=0x7f4df8036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.263+0000 7f4f12989980 1 --2- 172.21.15.194:0/765522081 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4df80346a0 0x7f4df8036b60 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8000f70 tx=0x7f4ef8001380 comp rx=0 tx=0).stop 2024-09-13T06:11:43.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.263+0000 7f4f12989980 1 -- 172.21.15.194:0/765522081 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559c8a74e3b0 msgr2=0x559c8a8cbe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.263+0000 7f4f12989980 1 --2- 172.21.15.194:0/765522081 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559c8a74e3b0 0x559c8a8cbe30 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f4f000199f0 tx=0x7f4f000180e0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.263+0000 7f4f10c9a640 1 -- 172.21.15.194:0/765522081 reap_dead start 2024-09-13T06:11:43.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.263+0000 7f4f12989980 1 -- 172.21.15.194:0/765522081 shutdown_connections 2024-09-13T06:11:43.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.263+0000 7f4f12989980 1 -- 172.21.15.194:0/765522081 >> 172.21.15.194:0/765522081 conn(0x559c8a7d31b0 msgr2=0x559c8a8bf3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:43.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.263+0000 7f4f12989980 1 -- 172.21.15.194:0/765522081 shutdown_connections 2024-09-13T06:11:43.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.263+0000 7f4f12989980 1 -- 172.21.15.194:0/765522081 wait complete. 2024-09-13T06:11:43.277 INFO:teuthology.orchestra.run.smithi194.stdout:{"entries":[],"summary":[]} 2024-09-13T06:11:43.277 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-09-13T06:11:43.277 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo', '--purge-data'] 2024-09-13T06:11:43.278 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo', '--purge-data'] 2024-09-13T06:11:43.278 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo --purge-data 2024-09-13T06:11:43.357 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:11:43.358 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:11:43.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.355+0000 7f58f7807980 1 Processor -- start 2024-09-13T06:11:43.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.355+0000 7f58f7807980 1 -- start start 2024-09-13T06:11:43.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.355+0000 7f58f7807980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55b2147cc900 0x55b2147cecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.355+0000 7f58f7807980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b214651ae0 con 0x55b2147c8580 2024-09-13T06:11:43.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.355+0000 7f58f7807980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x55b214675e30 con 0x55b2147cc900 2024-09-13T06:11:43.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.355+0000 7f58f4b16640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55b2147cc900 0x55b2147cecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.355+0000 7f58f4b16640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55b2147cc900 0x55b2147cecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44556/0 (socket says 172.21.15.194:44556) 2024-09-13T06:11:43.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.355+0000 7f58f4b16640 1 -- 172.21.15.194:0/2222094427 learned_addr learned my addr 172.21.15.194:0/2222094427 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:43.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.355+0000 7f58f5317640 1 --1- 172.21.15.194:0/2222094427 >> v1:172.21.15.120:6789/0 conn(0x55b2147c8580 0x55b2147c8960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:58294/0 (socket says 172.21.15.194:58294) 2024-09-13T06:11:43.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.359+0000 7f58f4b16640 1 -- 172.21.15.194:0/2222094427 >> v1:172.21.15.120:6789/0 conn(0x55b2147c8580 legacy=0x55b2147c8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.359+0000 7f58f4b16640 1 -- 172.21.15.194:0/2222094427 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2147d0240 con 0x55b2147cc900 2024-09-13T06:11:43.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.359+0000 7f58f4b16640 1 --2- 172.21.15.194:0/2222094427 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b2147cc900 0x55b2147cecf0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f58e000a5c0 tx=0x7f58e001b1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82bd904ccba52d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.359+0000 7f58effff640 1 -- 172.21.15.194:0/2222094427 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58e00af070 con 0x55b2147cc900 2024-09-13T06:11:43.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.359+0000 7f58effff640 1 -- 172.21.15.194:0/2222094427 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58e00aa530 con 0x55b2147cc900 2024-09-13T06:11:43.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.359+0000 7f58effff640 1 -- 172.21.15.194:0/2222094427 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58e00aa830 con 0x55b2147cc900 2024-09-13T06:11:43.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.359+0000 7f58f7807980 1 -- 172.21.15.194:0/2222094427 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b2147cc900 msgr2=0x55b2147cecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.359+0000 7f58f7807980 1 --2- 172.21.15.194:0/2222094427 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b2147cc900 0x55b2147cecf0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f58e000a5c0 tx=0x7f58e001b1d0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.359+0000 7f58f7807980 1 -- 172.21.15.194:0/2222094427 shutdown_connections 2024-09-13T06:11:43.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.359+0000 7f58f7807980 1 --2- 172.21.15.194:0/2222094427 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b2147cc900 0x55b2147cecf0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.359+0000 7f58f7807980 1 -- 172.21.15.194:0/2222094427 >> 172.21.15.194:0/2222094427 conn(0x55b2147c40a0 msgr2=0x55b2147c64c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:43.365 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.363+0000 7f58f7807980 1 -- 172.21.15.194:0/2222094427 shutdown_connections 2024-09-13T06:11:43.365 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.363+0000 7f58f7807980 1 -- 172.21.15.194:0/2222094427 wait complete. 2024-09-13T06:11:43.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.375+0000 7f58f7807980 1 Processor -- start 2024-09-13T06:11:43.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.379+0000 7f58f7807980 1 -- start start 2024-09-13T06:11:43.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.379+0000 7f58f7807980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b2147c8580 0x55b2148b2860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.379+0000 7f58f7807980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55b214677200 con 0x55b2147c8580 2024-09-13T06:11:43.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.379+0000 7f58f5317640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b2147c8580 0x55b2148b2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.379+0000 7f58f5317640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b2147c8580 0x55b2148b2860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44560/0 (socket says 172.21.15.194:44560) 2024-09-13T06:11:43.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.379+0000 7f58f5317640 1 -- 172.21.15.194:0/4139255001 learned_addr learned my addr 172.21.15.194:0/4139255001 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:43.382 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.379+0000 7f58f5317640 1 -- 172.21.15.194:0/4139255001 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2148b2e30 con 0x55b2147c8580 2024-09-13T06:11:43.382 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.379+0000 7f58f5317640 1 --2- 172.21.15.194:0/4139255001 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b2147c8580 0x55b2148b2860 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f58f000b3e0 tx=0x7f58f000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ca47cca93686320 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.382 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.379+0000 7f57e3606640 1 -- 172.21.15.194:0/4139255001 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58f000d700 con 0x55b2147c8580 2024-09-13T06:11:43.382 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.379+0000 7f57e3606640 1 -- 172.21.15.194:0/4139255001 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58f0008070 con 0x55b2147c8580 2024-09-13T06:11:43.382 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.379+0000 7f57e3606640 1 -- 172.21.15.194:0/4139255001 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58f000da10 con 0x55b2147c8580 2024-09-13T06:11:43.383 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.379+0000 7f58f7807980 1 -- 172.21.15.194:0/4139255001 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b2147c8580 msgr2=0x55b2148b2860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.383 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.379+0000 7f58f7807980 1 --2- 172.21.15.194:0/4139255001 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b2147c8580 0x55b2148b2860 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f58f000b3e0 tx=0x7f58f000b8a0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.383 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.379+0000 7f58f7807980 1 -- 172.21.15.194:0/4139255001 shutdown_connections 2024-09-13T06:11:43.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.379+0000 7f58f7807980 1 --2- 172.21.15.194:0/4139255001 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b2147c8580 0x55b2148b2860 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.379+0000 7f58f7807980 1 -- 172.21.15.194:0/4139255001 >> 172.21.15.194:0/4139255001 conn(0x55b2147c40a0 msgr2=0x55b2148ae490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:43.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.379+0000 7f58f7807980 1 -- 172.21.15.194:0/4139255001 shutdown_connections 2024-09-13T06:11:43.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.379+0000 7f58f7807980 1 -- 172.21.15.194:0/4139255001 wait complete. 2024-09-13T06:11:43.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.379+0000 7f58f7807980 1 Processor -- start 2024-09-13T06:11:43.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.379+0000 7f58f7807980 1 -- start start 2024-09-13T06:11:43.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.379+0000 7f58f7807980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b2147c8580 0x55b2148be050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.379+0000 7f58f7807980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55b2147cfd40 con 0x55b2147c8580 2024-09-13T06:11:43.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.379+0000 7f58f5317640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b2147c8580 0x55b2148be050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.379+0000 7f58f5317640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b2147c8580 0x55b2148be050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44568/0 (socket says 172.21.15.194:44568) 2024-09-13T06:11:43.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.379+0000 7f58f5317640 1 -- 172.21.15.194:0/786728576 learned_addr learned my addr 172.21.15.194:0/786728576 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:43.385 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.383+0000 7f58f5317640 1 -- 172.21.15.194:0/786728576 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2148be590 con 0x55b2147c8580 2024-09-13T06:11:43.385 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.383+0000 7f58f5317640 1 --2- 172.21.15.194:0/786728576 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b2147c8580 0x55b2148be050 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x55b2148b3a40 tx=0x7f58f0000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.386 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.383+0000 7f57e1e03640 1 -- 172.21.15.194:0/786728576 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58f001a7c0 con 0x55b2147c8580 2024-09-13T06:11:43.386 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.383+0000 7f57e1e03640 1 -- 172.21.15.194:0/786728576 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58f001a960 con 0x55b2147c8580 2024-09-13T06:11:43.386 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.383+0000 7f58f7807980 1 -- 172.21.15.194:0/786728576 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b2148be820 con 0x55b2147c8580 2024-09-13T06:11:43.386 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.383+0000 7f57e1e03640 1 -- 172.21.15.194:0/786728576 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58f001aca0 con 0x55b2147c8580 2024-09-13T06:11:43.386 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.383+0000 7f58f7807980 1 -- 172.21.15.194:0/786728576 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2148c1500 con 0x55b2147c8580 2024-09-13T06:11:43.387 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.383+0000 7f57e1e03640 1 -- 172.21.15.194:0/786728576 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f58f0017070 con 0x55b2147c8580 2024-09-13T06:11:43.387 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.383+0000 7f57e1e03640 1 --2- 172.21.15.194:0/786728576 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f57dc034650 0x7f57dc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.387 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.383+0000 7f57e1e03640 1 -- 172.21.15.194:0/786728576 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f58f0015020 con 0x55b2147c8580 2024-09-13T06:11:43.387 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.383+0000 7f58f4b16640 1 --2- 172.21.15.194:0/786728576 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f57dc034650 0x7f57dc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.388 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.383+0000 7f58f7807980 1 --2- 172.21.15.194:0/786728576 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55b2147cc900 0x55b2148c5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.388 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.383+0000 7f58f7807980 1 -- 172.21.15.194:0/786728576 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b2148c5690 con 0x55b2147cc900 2024-09-13T06:11:43.388 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.383+0000 7f58f5b18640 1 --2- 172.21.15.194:0/786728576 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55b2147cc900 0x55b2148c5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.388 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.383+0000 7f58f4b16640 1 --2- 172.21.15.194:0/786728576 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f57dc034650 0x7f57dc036b10 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f58e00ac000 tx=0x7f58e00a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.388 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.383+0000 7f58f5b18640 1 --2- 172.21.15.194:0/786728576 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55b2147cc900 0x55b2148c5020 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.388 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.383+0000 7f58f5b18640 1 -- 172.21.15.194:0/786728576 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f58e800a4d0 con 0x55b2147cc900 2024-09-13T06:11:43.388 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.383+0000 7f58f7807980 1 -- 172.21.15.194:0/786728576 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b2148c2700 con 0x55b2147cc900 2024-09-13T06:11:43.389 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.387+0000 7f58f5b18640 1 -- 172.21.15.194:0/786728576 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f58e800a4d0 con 0x55b2147cc900 2024-09-13T06:11:43.389 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.387+0000 7f58f7807980 1 --2- 172.21.15.194:0/786728576 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55b2148c79c0 0x55b2148c9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.390 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.387+0000 7f58f7807980 1 -- 172.21.15.194:0/786728576 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b2148ca480 con 0x55b2148c79c0 2024-09-13T06:11:43.390 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.387+0000 7f58f5317640 1 --2- 172.21.15.194:0/786728576 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55b2148c79c0 0x55b2148c9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.390 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.387+0000 7f58f5317640 1 --2- 172.21.15.194:0/786728576 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55b2148c79c0 0x55b2148c9db0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.390 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.387+0000 7f58f5317640 1 -- 172.21.15.194:0/786728576 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f58f002e070 con 0x55b2148c79c0 2024-09-13T06:11:43.390 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.387+0000 7f58f7807980 1 -- 172.21.15.194:0/786728576 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b2148c6860 con 0x55b2147cc900 2024-09-13T06:11:43.390 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.387+0000 7f58f5b18640 1 -- 172.21.15.194:0/786728576 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f58e800a4d0 con 0x55b2147cc900 2024-09-13T06:11:43.390 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.387+0000 7f58f7807980 1 --2- 172.21.15.194:0/786728576 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55b2148cb8e0 0x55b2148cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.390 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.387+0000 7f58f7807980 1 -- 172.21.15.194:0/786728576 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b2148ce3d0 con 0x55b2148cb8e0 2024-09-13T06:11:43.390 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.387+0000 7f58f4b16640 1 --2- 172.21.15.194:0/786728576 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55b2148cb8e0 0x55b2148cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.393 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.387+0000 7f58f4b16640 1 --2- 172.21.15.194:0/786728576 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55b2148cb8e0 0x55b2148cdcd0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.393 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.387+0000 7f58f4b16640 1 -- 172.21.15.194:0/786728576 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f58e00a8070 con 0x55b2148cb8e0 2024-09-13T06:11:43.393 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.387+0000 7f58f7807980 1 Processor -- start 2024-09-13T06:11:43.393 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.387+0000 7f58f7807980 1 -- start start 2024-09-13T06:11:43.393 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.387+0000 7f58f7807980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b2148dbe80 0x55b2148dc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.393 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.387+0000 7f58f7807980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55b2146d0800 con 0x55b2148dbe80 2024-09-13T06:11:43.394 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.387+0000 7f58f5317640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b2148dbe80 0x55b2148dc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.394 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.387+0000 7f58f5317640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b2148dbe80 0x55b2148dc2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44574/0 (socket says 172.21.15.194:44574) 2024-09-13T06:11:43.394 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.387+0000 7f58f5317640 1 -- 172.21.15.194:0/3467945047 learned_addr learned my addr 172.21.15.194:0/3467945047 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:43.394 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.387+0000 7f58f5317640 1 -- 172.21.15.194:0/3467945047 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2148dc7e0 con 0x55b2148dbe80 2024-09-13T06:11:43.394 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.391+0000 7f58f5317640 1 --2- 172.21.15.194:0/3467945047 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b2148dbe80 0x55b2148dc2a0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f58f001dfd0 tx=0x7f58f000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.394 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.391+0000 7f57daffd640 1 -- 172.21.15.194:0/3467945047 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58f000ee00 con 0x55b2148dbe80 2024-09-13T06:11:43.394 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.391+0000 7f57daffd640 1 -- 172.21.15.194:0/3467945047 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58f0042770 con 0x55b2148dbe80 2024-09-13T06:11:43.394 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.391+0000 7f57daffd640 1 -- 172.21.15.194:0/3467945047 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58f0042a50 con 0x55b2148dbe80 2024-09-13T06:11:43.394 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.391+0000 7f58f7807980 1 -- 172.21.15.194:0/3467945047 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b2148dca70 con 0x55b2148dbe80 2024-09-13T06:11:43.394 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.391+0000 7f58f7807980 1 -- 172.21.15.194:0/3467945047 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2148df6f0 con 0x55b2148dbe80 2024-09-13T06:11:43.396 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.391+0000 7f57daffd640 1 -- 172.21.15.194:0/3467945047 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f58f003a070 con 0x55b2148dbe80 2024-09-13T06:11:43.396 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.391+0000 7f57daffd640 1 --2- 172.21.15.194:0/3467945047 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f57cc034650 0x7f57cc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.396 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.391+0000 7f57daffd640 1 -- 172.21.15.194:0/3467945047 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f58f003c070 con 0x55b2148dbe80 2024-09-13T06:11:43.396 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.391+0000 7f58f4b16640 1 --2- 172.21.15.194:0/3467945047 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f57cc034650 0x7f57cc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.396 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.391+0000 7f58f7807980 1 Processor -- start 2024-09-13T06:11:43.396 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.391+0000 7f58f7807980 1 -- start start 2024-09-13T06:11:43.396 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.391+0000 7f58f4b16640 1 --2- 172.21.15.194:0/3467945047 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f57cc034650 0x7f57cc036b10 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x55b2148c5f70 tx=0x7f58e0005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.396 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.391+0000 7f58f7807980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b2148e8780 0x55b2148e8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.397 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.391+0000 7f58f7807980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55b2148b31b0 con 0x55b2148e8780 2024-09-13T06:11:43.397 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.391+0000 7f58f5317640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b2148e8780 0x55b2148e8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.397 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.391+0000 7f58f5317640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b2148e8780 0x55b2148e8b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44588/0 (socket says 172.21.15.194:44588) 2024-09-13T06:11:43.397 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.391+0000 7f58f5317640 1 -- 172.21.15.194:0/1177383842 learned_addr learned my addr 172.21.15.194:0/1177383842 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:43.397 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.391+0000 7f58f5317640 1 -- 172.21.15.194:0/1177383842 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2148e9150 con 0x55b2148e8780 2024-09-13T06:11:43.397 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.395+0000 7f58f5317640 1 --2- 172.21.15.194:0/1177383842 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b2148e8780 0x55b2148e8b80 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f58f000ffb0 tx=0x7f58f0047680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e09f46476f045e10 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.397 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.395+0000 7f57d8ff9640 1 -- 172.21.15.194:0/1177383842 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58f003ba00 con 0x55b2148e8780 2024-09-13T06:11:43.397 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.395+0000 7f57d8ff9640 1 -- 172.21.15.194:0/1177383842 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58f0019800 con 0x55b2148e8780 2024-09-13T06:11:43.397 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.395+0000 7f57d8ff9640 1 -- 172.21.15.194:0/1177383842 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58f000f5d0 con 0x55b2148e8780 2024-09-13T06:11:43.399 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.395+0000 7f58f7807980 1 -- 172.21.15.194:0/1177383842 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b2148e8780 msgr2=0x55b2148e8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.399 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.395+0000 7f58f7807980 1 --2- 172.21.15.194:0/1177383842 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b2148e8780 0x55b2148e8b80 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f58f000ffb0 tx=0x7f58f0047680 comp rx=0 tx=0).stop 2024-09-13T06:11:43.399 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.395+0000 7f58f7807980 1 -- 172.21.15.194:0/1177383842 shutdown_connections 2024-09-13T06:11:43.399 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.395+0000 7f58f7807980 1 --2- 172.21.15.194:0/1177383842 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b2148e8780 0x55b2148e8b80 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.399 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.395+0000 7f58f7807980 1 -- 172.21.15.194:0/1177383842 >> 172.21.15.194:0/1177383842 conn(0x55b2148e4b60 msgr2=0x55b2148e2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:43.399 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.395+0000 7f58f7807980 1 -- 172.21.15.194:0/1177383842 shutdown_connections 2024-09-13T06:11:43.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.395+0000 7f58f7807980 1 -- 172.21.15.194:0/1177383842 wait complete. 2024-09-13T06:11:43.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.395+0000 7f58f7807980 1 Processor -- start 2024-09-13T06:11:43.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.395+0000 7f58f7807980 1 -- start start 2024-09-13T06:11:43.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.395+0000 7f58f7807980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b2148e8780 0x55b2148ef9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.395+0000 7f58f7807980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55b2148e95d0 con 0x55b2148e8780 2024-09-13T06:11:43.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.395+0000 7f58f5317640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b2148e8780 0x55b2148ef9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.395+0000 7f58f5317640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b2148e8780 0x55b2148ef9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44590/0 (socket says 172.21.15.194:44590) 2024-09-13T06:11:43.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.395+0000 7f58f5317640 1 -- 172.21.15.194:0/4230494589 learned_addr learned my addr 172.21.15.194:0/4230494589 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:43.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.395+0000 7f58f5317640 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2148efee0 con 0x55b2148e8780 2024-09-13T06:11:43.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.395+0000 7f58f5317640 1 --2- 172.21.15.194:0/4230494589 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b2148e8780 0x55b2148ef9a0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f58f000ffb0 tx=0x7f58f0006f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.395+0000 7f57caffd640 1 -- 172.21.15.194:0/4230494589 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58f0035130 con 0x55b2148e8780 2024-09-13T06:11:43.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.395+0000 7f57caffd640 1 -- 172.21.15.194:0/4230494589 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58f006b070 con 0x55b2148e8780 2024-09-13T06:11:43.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.395+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b2148efee0 con 0x55b2148e8780 2024-09-13T06:11:43.401 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.395+0000 7f57caffd640 1 -- 172.21.15.194:0/4230494589 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58f0035420 con 0x55b2148e8780 2024-09-13T06:11:43.401 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.395+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2148efee0 con 0x55b2148e8780 2024-09-13T06:11:43.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.399+0000 7f57caffd640 1 -- 172.21.15.194:0/4230494589 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f58f003b400 con 0x55b2148e8780 2024-09-13T06:11:43.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.399+0000 7f57caffd640 1 --2- 172.21.15.194:0/4230494589 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f57c00346a0 0x7f57c0036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.399+0000 7f57caffd640 1 -- 172.21.15.194:0/4230494589 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f58f005c030 con 0x55b2148e8780 2024-09-13T06:11:43.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.399+0000 7f58f4b16640 1 --2- 172.21.15.194:0/4230494589 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f57c00346a0 0x7f57c0036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.399+0000 7f58f7807980 20 rados->read ofs=0 len=0 2024-09-13T06:11:43.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.399+0000 7f58f7807980 1 --2- 172.21.15.194:0/4230494589 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55b2148faa30 0x55b2148fcef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.399+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b2148fd640 con 0x55b2148faa30 2024-09-13T06:11:43.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.399+0000 7f58f5b18640 1 --2- 172.21.15.194:0/4230494589 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55b2148faa30 0x55b2148fcef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.399+0000 7f58f4b16640 1 --2- 172.21.15.194:0/4230494589 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f57c00346a0 0x7f57c0036b60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f58e001b210 tx=0x7f58e00a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.399+0000 7f58f5b18640 1 --2- 172.21.15.194:0/4230494589 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55b2148faa30 0x55b2148fcef0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.399+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f58e800a4d0 con 0x55b2148faa30 2024-09-13T06:11:43.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.399+0000 7f58f7807980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:43.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.399+0000 7f58f7807980 20 realm 2024-09-13T06:11:43.406 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.399+0000 7f58f7807980 20 rados->read ofs=0 len=0 2024-09-13T06:11:43.406 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.399+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b2148fda50 con 0x55b2148faa30 2024-09-13T06:11:43.406 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.399+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f58e800a4d0 con 0x55b2148faa30 2024-09-13T06:11:43.406 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.399+0000 7f58f7807980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:43.406 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.399+0000 7f58f7807980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:11:43.406 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.399+0000 7f58f7807980 20 rados->read ofs=0 len=0 2024-09-13T06:11:43.406 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.399+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b2148fe320 con 0x55b2148faa30 2024-09-13T06:11:43.406 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.399+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f58e800a4d0 con 0x55b2148faa30 2024-09-13T06:11:43.406 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.399+0000 7f58f7807980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:43.406 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.399+0000 7f58f7807980 20 rados->read ofs=0 len=0 2024-09-13T06:11:43.406 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.399+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b2148fe6c0 con 0x55b2148faa30 2024-09-13T06:11:43.406 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.399+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f58e800a4d0 con 0x55b2148faa30 2024-09-13T06:11:43.406 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.399+0000 7f58f7807980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:11:43.406 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.399+0000 7f58f7807980 20 rados->read ofs=0 len=0 2024-09-13T06:11:43.407 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.399+0000 7f58f7807980 1 --2- 172.21.15.194:0/4230494589 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55b2148ff420 0x55b214901810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.407 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.399+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b214901e20 con 0x55b2148ff420 2024-09-13T06:11:43.407 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.399+0000 7f58f5317640 1 --2- 172.21.15.194:0/4230494589 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55b2148ff420 0x55b214901810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.407 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.399+0000 7f58f5317640 1 --2- 172.21.15.194:0/4230494589 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55b2148ff420 0x55b214901810 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.407 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.399+0000 7f58f5317640 1 -- 172.21.15.194:0/4230494589 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f58f0051070 con 0x55b2148ff420 2024-09-13T06:11:43.407 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.399+0000 7f58f7807980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:11:43.407 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.399+0000 7f58f7807980 20 searching for the correct realm 2024-09-13T06:11:43.407 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.399+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b2149036f0 con 0x55b2148ff420 2024-09-13T06:11:43.407 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.403+0000 7f58f5317640 1 -- 172.21.15.194:0/4230494589 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58f0051070 con 0x55b2148ff420 2024-09-13T06:11:43.407 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.403+0000 7f58f5317640 1 --2- 172.21.15.194:0/4230494589 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f58f0070bc0 0x7f58f00358c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.407 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.403+0000 7f58f5317640 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b2149036f0 con 0x7f58f0070bc0 2024-09-13T06:11:43.407 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.403+0000 7f58f4b16640 1 --2- 172.21.15.194:0/4230494589 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f58f0070bc0 0x7f58f00358c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.407 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.403+0000 7f58f4b16640 1 --2- 172.21.15.194:0/4230494589 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f58f0070bc0 0x7f58f00358c0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.407 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.403+0000 7f58f4b16640 1 -- 172.21.15.194:0/4230494589 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f58e00c9030 con 0x7f58f0070bc0 2024-09-13T06:11:43.407 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.403+0000 7f58f4b16640 1 --2- 172.21.15.194:0/4230494589 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f58e00dc040 0x7f58e00ce430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.408 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.403+0000 7f58f4b16640 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b2149036f0 con 0x7f58e00dc040 2024-09-13T06:11:43.410 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.403+0000 7f58f5b18640 1 --2- 172.21.15.194:0/4230494589 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f58e00dc040 0x7f58e00ce430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.410 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.403+0000 7f58f5b18640 1 --2- 172.21.15.194:0/4230494589 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f58e00dc040 0x7f58e00ce430 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.410 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.403+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58e800a4d0 con 0x7f58e00dc040 2024-09-13T06:11:43.410 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.403+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b2148fe6c0 con 0x55b2148faa30 2024-09-13T06:11:43.410 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.403+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58e800a4d0 con 0x55b2148faa30 2024-09-13T06:11:43.410 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.403+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b2148fe6c0 con 0x55b2148faa30 2024-09-13T06:11:43.410 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.403+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58e800a4d0 con 0x55b2148faa30 2024-09-13T06:11:43.410 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.403+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b2148fe6c0 con 0x7f58e00dc040 2024-09-13T06:11:43.410 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.403+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58e800a4d0 con 0x7f58e00dc040 2024-09-13T06:11:43.410 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.403+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b2148fe6c0 con 0x7f58e00dc040 2024-09-13T06:11:43.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.407+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58e800a4d0 con 0x7f58e00dc040 2024-09-13T06:11:43.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.407+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b2148fe6c0 con 0x7f58f0070bc0 2024-09-13T06:11:43.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.407+0000 7f58f4b16640 1 -- 172.21.15.194:0/4230494589 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58e00c9030 con 0x7f58f0070bc0 2024-09-13T06:11:43.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.407+0000 7f58f4b16640 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b2148fe6c0 con 0x55b2148ff420 2024-09-13T06:11:43.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.407+0000 7f58f5317640 1 -- 172.21.15.194:0/4230494589 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58f0051070 con 0x55b2148ff420 2024-09-13T06:11:43.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.407+0000 7f58f5317640 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b2148fe6c0 con 0x55b2148faa30 2024-09-13T06:11:43.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.407+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58e800a4d0 con 0x55b2148faa30 2024-09-13T06:11:43.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.407+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b2148fe6c0 con 0x7f58e00dc040 2024-09-13T06:11:43.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.407+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58e800a4d0 con 0x7f58e00dc040 2024-09-13T06:11:43.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.407+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b2148fe6c0 con 0x55b2148faa30 2024-09-13T06:11:43.414 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.407+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58e800a4d0 con 0x55b2148faa30 2024-09-13T06:11:43.414 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.407+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b2148fe6c0 con 0x7f58f0070bc0 2024-09-13T06:11:43.414 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.407+0000 7f58f4b16640 1 -- 172.21.15.194:0/4230494589 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f58e00c9030 con 0x7f58f0070bc0 2024-09-13T06:11:43.414 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.407+0000 7f58f4b16640 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b2148fe6c0 con 0x55b2148ff420 2024-09-13T06:11:43.414 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.407+0000 7f58f5317640 1 -- 172.21.15.194:0/4230494589 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58f0051070 con 0x55b2148ff420 2024-09-13T06:11:43.414 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.407+0000 7f58f5317640 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b2148fe6c0 con 0x55b2148ff420 2024-09-13T06:11:43.414 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.407+0000 7f58f5317640 1 -- 172.21.15.194:0/4230494589 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58f0051070 con 0x55b2148ff420 2024-09-13T06:11:43.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.407+0000 7f58f5317640 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b2148fe6c0 con 0x7f58e00dc040 2024-09-13T06:11:43.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.411+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58e800a4d0 con 0x7f58e00dc040 2024-09-13T06:11:43.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.411+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b2148fe6c0 con 0x55b2148ff420 2024-09-13T06:11:43.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.411+0000 7f58f5317640 1 -- 172.21.15.194:0/4230494589 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58f0051070 con 0x55b2148ff420 2024-09-13T06:11:43.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.411+0000 7f58f5317640 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b2148fe6c0 con 0x55b2148ff420 2024-09-13T06:11:43.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.411+0000 7f58f5317640 1 -- 172.21.15.194:0/4230494589 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58f0051070 con 0x55b2148ff420 2024-09-13T06:11:43.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.411+0000 7f58f5317640 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b2148fe6c0 con 0x55b2148faa30 2024-09-13T06:11:43.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.411+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58e800a4d0 con 0x55b2148faa30 2024-09-13T06:11:43.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.411+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b2148fe6c0 con 0x55b2148faa30 2024-09-13T06:11:43.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.411+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f58e800a4d0 con 0x55b2148faa30 2024-09-13T06:11:43.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.411+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b2148fe6c0 con 0x7f58f0070bc0 2024-09-13T06:11:43.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.411+0000 7f58f4b16640 1 -- 172.21.15.194:0/4230494589 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58e00c9030 con 0x7f58f0070bc0 2024-09-13T06:11:43.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.411+0000 7f58f4b16640 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b2148fe6c0 con 0x55b2148ff420 2024-09-13T06:11:43.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.411+0000 7f58f5317640 1 -- 172.21.15.194:0/4230494589 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58f0051070 con 0x55b2148ff420 2024-09-13T06:11:43.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.411+0000 7f58f5317640 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b2148fe6c0 con 0x7f58f0070bc0 2024-09-13T06:11:43.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.411+0000 7f58f4b16640 1 -- 172.21.15.194:0/4230494589 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58e00c9030 con 0x7f58f0070bc0 2024-09-13T06:11:43.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.411+0000 7f58f4b16640 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b2148fe6c0 con 0x55b2148faa30 2024-09-13T06:11:43.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.411+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58e800a4d0 con 0x55b2148faa30 2024-09-13T06:11:43.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.411+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b2148fe6c0 con 0x7f58e00dc040 2024-09-13T06:11:43.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.411+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58e800a4d0 con 0x7f58e00dc040 2024-09-13T06:11:43.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.411+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b2148fe6c0 con 0x55b2148ff420 2024-09-13T06:11:43.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.411+0000 7f58f5317640 1 -- 172.21.15.194:0/4230494589 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f58f0051070 con 0x55b2148ff420 2024-09-13T06:11:43.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.411+0000 7f58f5317640 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b2148fe6c0 con 0x7f58f0070bc0 2024-09-13T06:11:43.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.411+0000 7f58f4b16640 1 -- 172.21.15.194:0/4230494589 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58e00c9030 con 0x7f58f0070bc0 2024-09-13T06:11:43.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.411+0000 7f58f4b16640 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b2148fe6c0 con 0x7f58f0070bc0 2024-09-13T06:11:43.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.415+0000 7f58f4b16640 1 -- 172.21.15.194:0/4230494589 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58e00c9030 con 0x7f58f0070bc0 2024-09-13T06:11:43.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.415+0000 7f58f4b16640 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b2148fe6c0 con 0x55b2148ff420 2024-09-13T06:11:43.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.415+0000 7f58f5317640 1 -- 172.21.15.194:0/4230494589 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58f0051070 con 0x55b2148ff420 2024-09-13T06:11:43.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.415+0000 7f58f5317640 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b2148fe6c0 con 0x7f58e00dc040 2024-09-13T06:11:43.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.415+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58e800a4d0 con 0x7f58e00dc040 2024-09-13T06:11:43.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.415+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b2148fe6c0 con 0x55b2148faa30 2024-09-13T06:11:43.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.415+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f58e800a4d0 con 0x55b2148faa30 2024-09-13T06:11:43.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.415+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b2148fe6c0 con 0x7f58f0070bc0 2024-09-13T06:11:43.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.415+0000 7f58f4b16640 1 -- 172.21.15.194:0/4230494589 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58e00c9030 con 0x7f58f0070bc0 2024-09-13T06:11:43.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.415+0000 7f58f7807980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:11:43.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.415+0000 7f58f7807980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:11:43.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.415+0000 7f58f7807980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:11:43.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.415+0000 7f58f7807980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:11:43.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.415+0000 7f58f7807980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:11:43.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.415+0000 7f58f7807980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:11:43.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.415+0000 7f58f7807980 20 rados->read ofs=0 len=0 2024-09-13T06:11:43.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.415+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b2149027e0 con 0x55b2148faa30 2024-09-13T06:11:43.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.415+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f58e800a4d0 con 0x55b2148faa30 2024-09-13T06:11:43.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.415+0000 7f58f7807980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:43.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.415+0000 7f58f7807980 20 rados->read ofs=0 len=0 2024-09-13T06:11:43.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.415+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b214902420 con 0x55b2148faa30 2024-09-13T06:11:43.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.415+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f58e800a4d0 con 0x55b2148faa30 2024-09-13T06:11:43.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.415+0000 7f58f7807980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:11:43.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.415+0000 7f58f7807980 20 rados->read ofs=0 len=0 2024-09-13T06:11:43.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.415+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b214903100 con 0x7f58f0070bc0 2024-09-13T06:11:43.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.415+0000 7f58f4b16640 1 -- 172.21.15.194:0/4230494589 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f58e00c9030 con 0x7f58f0070bc0 2024-09-13T06:11:43.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.415+0000 7f58f7807980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:11:43.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.415+0000 7f58f7807980 20 zone default found 2024-09-13T06:11:43.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.415+0000 7f58f7807980 4 Realm: () 2024-09-13T06:11:43.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.415+0000 7f58f7807980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:11:43.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.415+0000 7f58f7807980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:11:43.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.415+0000 7f58f7807980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:11:43.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.415+0000 7f58f7807980 20 zonegroup default 2024-09-13T06:11:43.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.415+0000 7f58f7807980 20 rados->read ofs=0 len=0 2024-09-13T06:11:43.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.415+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b214903b20 con 0x7f58e00dc040 2024-09-13T06:11:43.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.415+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f58e800a4d0 con 0x7f58e00dc040 2024-09-13T06:11:43.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.415+0000 7f58f7807980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:43.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.415+0000 7f58f7807980 20 rados->read ofs=0 len=0 2024-09-13T06:11:43.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.415+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b214905500 con 0x55b2148ff420 2024-09-13T06:11:43.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.415+0000 7f58f5317640 1 -- 172.21.15.194:0/4230494589 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f58f0051070 con 0x55b2148ff420 2024-09-13T06:11:43.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.415+0000 7f58f7807980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:43.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.415+0000 7f58f7807980 20 rados->read ofs=0 len=0 2024-09-13T06:11:43.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.415+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b214905970 con 0x55b2148ff420 2024-09-13T06:11:43.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.419+0000 7f58f5317640 1 -- 172.21.15.194:0/4230494589 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f58f0051070 con 0x55b2148ff420 2024-09-13T06:11:43.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.419+0000 7f58f7807980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:43.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.419+0000 7f58f7807980 20 started sync module instance, tier type = 2024-09-13T06:11:43.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.419+0000 7f58f7807980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:11:43.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.419+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b2149049a0 con 0x7f58f0070bc0 2024-09-13T06:11:43.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.419+0000 7f58f4b16640 1 -- 172.21.15.194:0/4230494589 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(44 notify.0 [create] v35'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58e00c9030 con 0x7f58f0070bc0 2024-09-13T06:11:43.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.419+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94223337541008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b214906280 con 0x7f58f0070bc0 2024-09-13T06:11:43.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.419+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b214906ad0 con 0x55b2148faa30 2024-09-13T06:11:43.427 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.419+0000 7f58f4b16640 1 -- 172.21.15.194:0/4230494589 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94223337541008] v35'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58e00c9030 con 0x7f58f0070bc0 2024-09-13T06:11:43.427 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.419+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v35'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58e800a4d0 con 0x55b2148faa30 2024-09-13T06:11:43.427 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.419+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94223337545168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b214906ad0 con 0x55b2148faa30 2024-09-13T06:11:43.427 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.419+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b214907530 con 0x55b2148ff420 2024-09-13T06:11:43.427 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.423+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94223337545168] v35'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58e800a4d0 con 0x55b2148faa30 2024-09-13T06:11:43.427 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.423+0000 7f58f5317640 1 -- 172.21.15.194:0/4230494589 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v35'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58f0051070 con 0x55b2148ff420 2024-09-13T06:11:43.427 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.423+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94223337547296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b214906a40 con 0x55b2148ff420 2024-09-13T06:11:43.427 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.423+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b2149082b0 con 0x7f58f0070bc0 2024-09-13T06:11:43.428 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.423+0000 7f58f4b16640 1 -- 172.21.15.194:0/4230494589 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(50 notify.3 [create] v35'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58e00c9030 con 0x7f58f0070bc0 2024-09-13T06:11:43.428 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.423+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94223337555616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b214908f70 con 0x7f58f0070bc0 2024-09-13T06:11:43.428 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.423+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b214909930 con 0x55b2148faa30 2024-09-13T06:11:43.428 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.427+0000 7f58f5317640 1 -- 172.21.15.194:0/4230494589 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94223337547296] v35'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58f0051070 con 0x55b2148ff420 2024-09-13T06:11:43.428 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.427+0000 7f58f4b16640 1 -- 172.21.15.194:0/4230494589 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94223337555616] v35'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58e00c9030 con 0x7f58f0070bc0 2024-09-13T06:11:43.429 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.427+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v35'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58e800a4d0 con 0x55b2148faa30 2024-09-13T06:11:43.429 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.427+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94223337552208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b214909930 con 0x55b2148faa30 2024-09-13T06:11:43.429 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.427+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b21490a1d0 con 0x7f58e00dc040 2024-09-13T06:11:43.431 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.427+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(54 notify.5 [create] v35'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58e800a4d0 con 0x7f58e00dc040 2024-09-13T06:11:43.431 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.427+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94223337560640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b21490a490 con 0x7f58e00dc040 2024-09-13T06:11:43.431 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.427+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b21490afb0 con 0x7f58e00dc040 2024-09-13T06:11:43.432 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.431+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94223337552208] v35'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58e800a4d0 con 0x55b2148faa30 2024-09-13T06:11:43.433 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.431+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94223337560640] v35'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58e800a4d0 con 0x7f58e00dc040 2024-09-13T06:11:43.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.431+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(56 notify.6 [create] v35'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58e800a4d0 con 0x7f58e00dc040 2024-09-13T06:11:43.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.431+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94223337564800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b214909ee0 con 0x7f58e00dc040 2024-09-13T06:11:43.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.431+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b21490b420 con 0x7f58e00dc040 2024-09-13T06:11:43.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.435+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(58 notify.7 [create] v35'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58e800a4d0 con 0x7f58e00dc040 2024-09-13T06:11:43.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.435+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94223337566064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b21490b390 con 0x7f58e00dc040 2024-09-13T06:11:43.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.435+0000 7f58f7807980 20 add_watcher() i=0 2024-09-13T06:11:43.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.435+0000 7f58f7807980 20 add_watcher() i=1 2024-09-13T06:11:43.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.435+0000 7f58f7807980 20 add_watcher() i=2 2024-09-13T06:11:43.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.435+0000 7f58f7807980 20 add_watcher() i=3 2024-09-13T06:11:43.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.435+0000 7f58f7807980 20 add_watcher() i=4 2024-09-13T06:11:43.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.435+0000 7f58f7807980 20 add_watcher() i=5 2024-09-13T06:11:43.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.435+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94223337564800] v35'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58e800a4d0 con 0x7f58e00dc040 2024-09-13T06:11:43.437 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.435+0000 7f58f7807980 20 add_watcher() i=6 2024-09-13T06:11:43.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.435+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94223337566064] v35'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58e800a4d0 con 0x7f58e00dc040 2024-09-13T06:11:43.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.435+0000 7f58f7807980 20 add_watcher() i=7 2024-09-13T06:11:43.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.435+0000 7f58f7807980 2 all 8 watchers are set, enabling cache 2024-09-13T06:11:43.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.435+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b214909480 con 0x55b2148faa30 2024-09-13T06:11:43.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.435+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f58e800a4d0 con 0x55b2148faa30 2024-09-13T06:11:43.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.435+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94223337559168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b21490bde0 con 0x55b2148faa30 2024-09-13T06:11:43.439 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.435+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94223337559168] v35'232 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f58e800a4d0 con 0x55b2148faa30 2024-09-13T06:11:43.440 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.435+0000 7f57ab7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:11:43.440 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.439+0000 7f58f7807980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:11:43.440 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.439+0000 7f58f7807980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:11:43.440 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.439+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b2149171c0 con 0x55b2148faa30 2024-09-13T06:11:43.442 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.439+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v35'35 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f58e800a4d0 con 0x55b2148faa30 2024-09-13T06:11:43.442 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.439+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b214917810 con 0x7f58e00dc040 2024-09-13T06:11:43.444 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.443+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v35'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f58e800a4d0 con 0x7f58e00dc040 2024-09-13T06:11:43.444 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.443+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b214917c70 con 0x55b2148ff420 2024-09-13T06:11:43.446 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.443+0000 7f58f5317640 1 -- 172.21.15.194:0/4230494589 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v35'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f58f0051070 con 0x55b2148ff420 2024-09-13T06:11:43.446 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.443+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b214917c60 con 0x55b2148faa30 2024-09-13T06:11:43.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.443+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v35'233 uv164 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f58e800a4d0 con 0x55b2148faa30 2024-09-13T06:11:43.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.443+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b214918110 con 0x7f58f0070bc0 2024-09-13T06:11:43.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.447+0000 7f58f4b16640 1 -- 172.21.15.194:0/4230494589 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v35'74 uv53 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f58e00c9030 con 0x7f58f0070bc0 2024-09-13T06:11:43.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.447+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b214915010 con 0x55b2148ff420 2024-09-13T06:11:43.450 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.447+0000 7f58f5317640 1 -- 172.21.15.194:0/4230494589 <== osd.3 v2:172.21.15.194:6816/96632515 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v35'50 uv37 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f58f0051070 con 0x55b2148ff420 2024-09-13T06:11:43.450 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.447+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b214915010 con 0x55b2148faa30 2024-09-13T06:11:43.452 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.451+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v35'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f58e800a4d0 con 0x55b2148faa30 2024-09-13T06:11:43.452 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.451+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b214915010 con 0x7f58e00dc040 2024-09-13T06:11:43.454 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.451+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v35'49 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f58e800a4d0 con 0x7f58e00dc040 2024-09-13T06:11:43.454 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.451+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b214915010 con 0x7f58f0070bc0 2024-09-13T06:11:43.456 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.455+0000 7f58f4b16640 1 -- 172.21.15.194:0/4230494589 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v35'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f58e00c9030 con 0x7f58f0070bc0 2024-09-13T06:11:43.456 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.455+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b214918cc0 con 0x55b2148ff420 2024-09-13T06:11:43.457 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.455+0000 7f58f5317640 1 -- 172.21.15.194:0/4230494589 <== osd.3 v2:172.21.15.194:6816/96632515 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v35'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f58f0051070 con 0x55b2148ff420 2024-09-13T06:11:43.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.455+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b214918cc0 con 0x7f58f0070bc0 2024-09-13T06:11:43.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.455+0000 7f58f4b16640 1 -- 172.21.15.194:0/4230494589 <== osd.2 v2:172.21.15.194:6800/815615585 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v35'75 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f58e00c9030 con 0x7f58f0070bc0 2024-09-13T06:11:43.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.455+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b214919170 con 0x7f58e00dc040 2024-09-13T06:11:43.461 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.459+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v35'35 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f58e800a4d0 con 0x7f58e00dc040 2024-09-13T06:11:43.462 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.459+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b214919170 con 0x7f58f0070bc0 2024-09-13T06:11:43.463 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.459+0000 7f58f4b16640 1 -- 172.21.15.194:0/4230494589 <== osd.2 v2:172.21.15.194:6800/815615585 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v35'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f58e00c9030 con 0x7f58f0070bc0 2024-09-13T06:11:43.463 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.459+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b214919170 con 0x7f58e00dc040 2024-09-13T06:11:43.465 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.463+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v35'55 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f58e800a4d0 con 0x7f58e00dc040 2024-09-13T06:11:43.465 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.463+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b214919170 con 0x55b2148faa30 2024-09-13T06:11:43.467 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.463+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v35'234 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f58e800a4d0 con 0x55b2148faa30 2024-09-13T06:11:43.467 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.463+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b214919170 con 0x55b2148ff420 2024-09-13T06:11:43.471 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.467+0000 7f58f5317640 1 -- 172.21.15.194:0/4230494589 <== osd.3 v2:172.21.15.194:6816/96632515 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v35'68 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f58f0051070 con 0x55b2148ff420 2024-09-13T06:11:43.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.467+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b214919170 con 0x7f58f0070bc0 2024-09-13T06:11:43.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.467+0000 7f58f4b16640 1 -- 172.21.15.194:0/4230494589 <== osd.2 v2:172.21.15.194:6800/815615585 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v35'76 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f58e00c9030 con 0x7f58f0070bc0 2024-09-13T06:11:43.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.467+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b214919170 con 0x55b2148ff420 2024-09-13T06:11:43.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.471+0000 7f58f5317640 1 -- 172.21.15.194:0/4230494589 <== osd.3 v2:172.21.15.194:6816/96632515 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v35'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f58f0051070 con 0x55b2148ff420 2024-09-13T06:11:43.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.471+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b214919170 con 0x55b2148faa30 2024-09-13T06:11:43.475 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.471+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.1 v2:172.21.15.194:6808/3135444559 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v35'36 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f58e800a4d0 con 0x55b2148faa30 2024-09-13T06:11:43.475 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.471+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b214919170 con 0x55b2148faa30 2024-09-13T06:11:43.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.475+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.1 v2:172.21.15.194:6808/3135444559 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v35'235 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f58e800a4d0 con 0x55b2148faa30 2024-09-13T06:11:43.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.475+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b214919170 con 0x55b2148ff420 2024-09-13T06:11:43.479 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.475+0000 7f58f5317640 1 -- 172.21.15.194:0/4230494589 <== osd.3 v2:172.21.15.194:6816/96632515 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v35'69 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f58f0051070 con 0x55b2148ff420 2024-09-13T06:11:43.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.479+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b214919170 con 0x7f58f0070bc0 2024-09-13T06:11:43.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.479+0000 7f58f4b16640 1 -- 172.21.15.194:0/4230494589 <== osd.2 v2:172.21.15.194:6800/815615585 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v35'38 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f58e00c9030 con 0x7f58f0070bc0 2024-09-13T06:11:43.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.479+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b214919170 con 0x55b2148ff420 2024-09-13T06:11:43.483 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.479+0000 7f58f5317640 1 -- 172.21.15.194:0/4230494589 <== osd.3 v2:172.21.15.194:6816/96632515 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v35'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f58f0051070 con 0x55b2148ff420 2024-09-13T06:11:43.483 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.479+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b214919170 con 0x55b2148ff420 2024-09-13T06:11:43.484 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.483+0000 7f58f5317640 1 -- 172.21.15.194:0/4230494589 <== osd.3 v2:172.21.15.194:6816/96632515 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v35'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f58f0051070 con 0x55b2148ff420 2024-09-13T06:11:43.484 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.483+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b214919200 con 0x55b2148ff420 2024-09-13T06:11:43.485 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.483+0000 7f58f5317640 1 -- 172.21.15.194:0/4230494589 <== osd.3 v2:172.21.15.194:6816/96632515 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v35'24 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f58f0051070 con 0x55b2148ff420 2024-09-13T06:11:43.485 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.483+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b214919790 con 0x55b2148ff420 2024-09-13T06:11:43.487 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.483+0000 7f58f5317640 1 -- 172.21.15.194:0/4230494589 <== osd.3 v2:172.21.15.194:6816/96632515 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v35'51 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f58f0051070 con 0x55b2148ff420 2024-09-13T06:11:43.487 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.483+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b214914990 con 0x7f58e00dc040 2024-09-13T06:11:43.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.487+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v35'32 uv25 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f58e800a4d0 con 0x7f58e00dc040 2024-09-13T06:11:43.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.487+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b2149196d0 con 0x55b2148ff420 2024-09-13T06:11:43.491 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.487+0000 7f58f5317640 1 -- 172.21.15.194:0/4230494589 <== osd.3 v2:172.21.15.194:6816/96632515 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v35'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f58f0051070 con 0x55b2148ff420 2024-09-13T06:11:43.491 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.487+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b2149196d0 con 0x7f58e00dc040 2024-09-13T06:11:43.494 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.491+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.0 v2:172.21.15.120:6800/1923744619 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v35'50 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f58e800a4d0 con 0x7f58e00dc040 2024-09-13T06:11:43.494 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.491+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b2149196d0 con 0x55b2148ff420 2024-09-13T06:11:43.496 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.495+0000 7f58f5317640 1 -- 172.21.15.194:0/4230494589 <== osd.3 v2:172.21.15.194:6816/96632515 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v35'70 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f58f0051070 con 0x55b2148ff420 2024-09-13T06:11:43.496 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.495+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b214919270 con 0x7f58e00dc040 2024-09-13T06:11:43.499 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.495+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.0 v2:172.21.15.120:6800/1923744619 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v35'56 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f58e800a4d0 con 0x7f58e00dc040 2024-09-13T06:11:43.499 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.495+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b2149196d0 con 0x7f58f0070bc0 2024-09-13T06:11:43.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.499+0000 7f58f4b16640 1 -- 172.21.15.194:0/4230494589 <== osd.2 v2:172.21.15.194:6800/815615585 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v35'35 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f58e00c9030 con 0x7f58f0070bc0 2024-09-13T06:11:43.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.499+0000 7f57aa7e4640 20 reqs_thread_entry: start 2024-09-13T06:11:43.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.499+0000 7f58f7807980 20 init_complete bucket index max shards: 11 2024-09-13T06:11:43.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.499+0000 7f58f7807980 20 Filter name: none 2024-09-13T06:11:43.503 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.499+0000 7f571bfff640 20 reqs_thread_entry: start 2024-09-13T06:11:43.503 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.499+0000 7f58f7807980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T06:11:43.503 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.499+0000 7f58f7807980 20 rados->read ofs=0 len=0 2024-09-13T06:11:43.503 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.499+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b214934740 con 0x55b2148faa30 2024-09-13T06:11:43.504 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.499+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.1 v2:172.21.15.194:6808/3135444559 27 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv23 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f58e800a4d0 con 0x55b2148faa30 2024-09-13T06:11:43.504 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.499+0000 7f58f7807980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T06:11:43.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.499+0000 7f58f7807980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T06:11:43.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.499+0000 7f58f7807980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T06:11:43.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.499+0000 7f58f7807980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:11:43.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.499+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b2149148e0 con 0x7f58f0070bc0 2024-09-13T06:11:43.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.499+0000 7f58f4b16640 1 -- 172.21.15.194:0/4230494589 <== osd.2 v2:172.21.15.194:6800/815615585 21 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv43 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f58e00c9030 con 0x7f58f0070bc0 2024-09-13T06:11:43.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.499+0000 7f58f7807980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7 : miss 2024-09-13T06:11:43.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.499+0000 7f58f7807980 20 rados->read ofs=0 len=0 2024-09-13T06:11:43.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.499+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:96 8.10 8:0b210059:root::.bucket.meta.myfoo%3a52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b214936e80 con 0x55b2148ff420 2024-09-13T06:11:43.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.503+0000 7f58f5317640 1 -- 172.21.15.194:0/4230494589 <== osd.3 v2:172.21.15.194:6816/96632515 27 ==== osd_op_reply(96 .bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f58f0051070 con 0x55b2148ff420 2024-09-13T06:11:43.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.503+0000 7f58f7807980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T06:11:43.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.503+0000 7f58f7807980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7 info.flags=0x17 2024-09-13T06:11:43.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.503+0000 7f58f7807980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7 to cache LRU end 2024-09-13T06:11:43.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.503+0000 7f58f7807980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:11:43.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.503+0000 7f58f7807980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T06:11:43.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.503+0000 7f58f7807980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7 2024-09-13T06:11:43.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.503+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:97 4.6 4:63b951e7:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b2149b4380 con 0x7f58f0070bc0 2024-09-13T06:11:43.508 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.503+0000 7f58f4b16640 1 -- 172.21.15.194:0/4230494589 <== osd.2 v2:172.21.15.194:6800/815615585 22 ==== osd_op_reply(97 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f58e00c9030 con 0x7f58f0070bc0 2024-09-13T06:11:43.508 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.503+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:98 4.18 4:196765b6:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b2149b4380 con 0x7f58f0070bc0 2024-09-13T06:11:43.508 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.503+0000 7f58f4b16640 1 -- 172.21.15.194:0/4230494589 <== osd.2 v2:172.21.15.194:6800/815615585 23 ==== osd_op_reply(98 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.1 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f58e00c9030 con 0x7f58f0070bc0 2024-09-13T06:11:43.508 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.503+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:99 4.e 4:72ca9536:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b2149b4380 con 0x7f58f0070bc0 2024-09-13T06:11:43.508 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.503+0000 7f58f4b16640 1 -- 172.21.15.194:0/4230494589 <== osd.2 v2:172.21.15.194:6800/815615585 24 ==== osd_op_reply(99 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f58e00c9030 con 0x7f58f0070bc0 2024-09-13T06:11:43.509 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.503+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:100 4.35 4:afdb4393:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b2149b4380 con 0x55b2148faa30 2024-09-13T06:11:43.509 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.503+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.1 v2:172.21.15.194:6808/3135444559 28 ==== osd_op_reply(100 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.3 [call out=85b] v0'0 uv9 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f58e800a4d0 con 0x55b2148faa30 2024-09-13T06:11:43.509 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.503+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:101 4.c 4:3333458d:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b2149b4380 con 0x55b2148faa30 2024-09-13T06:11:43.509 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.503+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.1 v2:172.21.15.194:6808/3135444559 29 ==== osd_op_reply(101 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.4 [call out=426b] v0'0 uv7 ondisk = 0) ==== 194+0+426 (crc 0 0 0) 0x7f58e800a4d0 con 0x55b2148faa30 2024-09-13T06:11:43.509 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.503+0000 7f58f7807980 10 cls_bucket_list_unordered: got 15f6f8dc036519d7fe15b39338f6e5db 2024-09-13T06:11:43.509 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.503+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:102 4.2f 4:f7b35787:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b2149b4380 con 0x55b2148faa30 2024-09-13T06:11:43.509 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.503+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.1 v2:172.21.15.194:6808/3135444559 30 ==== osd_op_reply(102 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f58e800a4d0 con 0x55b2148faa30 2024-09-13T06:11:43.509 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.503+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:103 4.1a 4:593d7944:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b2149b4380 con 0x7f58f0070bc0 2024-09-13T06:11:43.509 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.507+0000 7f58f4b16640 1 -- 172.21.15.194:0/4230494589 <== osd.2 v2:172.21.15.194:6800/815615585 25 ==== osd_op_reply(103 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f58e00c9030 con 0x7f58f0070bc0 2024-09-13T06:11:43.509 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.507+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:104 4.2a 4:5507b116:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b2149b4300 con 0x55b2148faa30 2024-09-13T06:11:43.509 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.507+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.1 v2:172.21.15.194:6808/3135444559 31 ==== osd_op_reply(104 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.7 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f58e800a4d0 con 0x55b2148faa30 2024-09-13T06:11:43.510 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.507+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:105 4.8 4:130b253f:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b2149b4300 con 0x55b2148ff420 2024-09-13T06:11:43.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.507+0000 7f58f5317640 1 -- 172.21.15.194:0/4230494589 <== osd.3 v2:172.21.15.194:6816/96632515 28 ==== osd_op_reply(105 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f58f0051070 con 0x55b2148ff420 2024-09-13T06:11:43.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.507+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:106 4.22 4:448af099:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b2149b4340 con 0x55b2148faa30 2024-09-13T06:11:43.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.507+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.1 v2:172.21.15.194:6808/3135444559 32 ==== osd_op_reply(106 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.9 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f58e800a4d0 con 0x55b2148faa30 2024-09-13T06:11:43.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.507+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:107 4.0 4:03676261:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b2149b4340 con 0x7f58f0070bc0 2024-09-13T06:11:43.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.507+0000 7f58f4b16640 1 -- 172.21.15.194:0/4230494589 <== osd.2 v2:172.21.15.194:6800/815615585 26 ==== osd_op_reply(107 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.10 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f58e00c9030 con 0x7f58f0070bc0 2024-09-13T06:11:43.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.507+0000 7f58f7807980 20 get_obj_state: octx=0x7f58e00d2040 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x55b2149b23e8 s->prefetch_data=0 2024-09-13T06:11:43.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.507+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:108 3.1bs0 3:db06d0c7:::52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7_15f6f8dc036519d7fe15b39338f6e5db:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b2149b3210 con 0x55b2148ff420 2024-09-13T06:11:43.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.507+0000 7f58f5317640 1 -- 172.21.15.194:0/4230494589 <== osd.3 v2:172.21.15.194:6816/96632515 29 ==== osd_op_reply(108 52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7_15f6f8dc036519d7fe15b39338f6e5db [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7f58f0051070 con 0x55b2148ff420 2024-09-13T06:11:43.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.507+0000 7f58f7807980 10 manifest: total_size = 6 2024-09-13T06:11:43.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.507+0000 7f58f7807980 20 get_obj_state: setting s->obj_tag to 52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.16114976695652201317 2024-09-13T06:11:43.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.507+0000 7f58f7807980 20 get_obj_state: octx=0x7f58e00d2040 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x55b2149b23e8 s->prefetch_data=0 2024-09-13T06:11:43.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.507+0000 7f58f7807980 20 prepare_atomic_modification: state is not atomic. state=0x55b2149b23e8 2024-09-13T06:11:43.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.507+0000 7f58f7807980 20 bucket index object: :.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.4 2024-09-13T06:11:43.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.507+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:109 4.c 4:3333458d:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b2149b3c90 con 0x55b2148faa30 2024-09-13T06:11:43.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.507+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.1 v2:172.21.15.194:6808/3135444559 33 ==== osd_op_reply(109 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.4 [stat,call,call] v35'10 uv10 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f58e800a4d0 con 0x55b2148faa30 2024-09-13T06:11:43.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.511+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:110 3.1bs0 3:db06d0c7:::52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7_15f6f8dc036519d7fe15b39338f6e5db:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b2149b3c90 con 0x55b2148ff420 2024-09-13T06:11:43.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.511+0000 7f58f5317640 1 -- 172.21.15.194:0/4230494589 <== osd.3 v2:172.21.15.194:6816/96632515 30 ==== osd_op_reply(110 52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7_15f6f8dc036519d7fe15b39338f6e5db [call] v35'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f58f0051070 con 0x55b2148ff420 2024-09-13T06:11:43.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.511+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:111 4.c 4:3333458d:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b21493bc30 con 0x55b2148faa30 2024-09-13T06:11:43.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.511+0000 7f58f7807980 20 list_objects_ordered: starting attempt 1 2024-09-13T06:11:43.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.511+0000 7f58f7807980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-13T06:11:43.516 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.511+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:112 4.6 4:63b951e7:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b21493e5d0 con 0x7f58f0070bc0 2024-09-13T06:11:43.516 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.511+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:113 4.18 4:196765b6:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b214940aa0 con 0x7f58f0070bc0 2024-09-13T06:11:43.516 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.511+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:114 4.e 4:72ca9536:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b214943410 con 0x7f58f0070bc0 2024-09-13T06:11:43.516 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.511+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:115 4.35 4:afdb4393:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b214940aa0 con 0x55b2148faa30 2024-09-13T06:11:43.516 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.511+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:116 4.c 4:3333458d:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b214948300 con 0x55b2148faa30 2024-09-13T06:11:43.516 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.511+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:117 4.2f 4:f7b35787:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b21494af30 con 0x55b2148faa30 2024-09-13T06:11:43.516 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.511+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:118 4.1a 4:593d7944:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b21494d8c0 con 0x7f58f0070bc0 2024-09-13T06:11:43.516 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.511+0000 7f58f4b16640 1 -- 172.21.15.194:0/4230494589 <== osd.2 v2:172.21.15.194:6800/815615585 27 ==== osd_op_reply(112 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f58e00c9030 con 0x7f58f0070bc0 2024-09-13T06:11:43.516 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.511+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:119 4.2a 4:5507b116:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b21494d8c0 con 0x55b2148faa30 2024-09-13T06:11:43.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.511+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:120 4.8 4:130b253f:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b2149501b0 con 0x55b2148ff420 2024-09-13T06:11:43.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.511+0000 7f58f4b16640 1 -- 172.21.15.194:0/4230494589 <== osd.2 v2:172.21.15.194:6800/815615585 28 ==== osd_op_reply(114 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f58e00c9030 con 0x7f58f0070bc0 2024-09-13T06:11:43.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.511+0000 7f58f4b16640 1 -- 172.21.15.194:0/4230494589 <== osd.2 v2:172.21.15.194:6800/815615585 29 ==== osd_op_reply(113 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.1 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f58e00c9030 con 0x7f58f0070bc0 2024-09-13T06:11:43.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.511+0000 7f58f4b16640 1 -- 172.21.15.194:0/4230494589 <== osd.2 v2:172.21.15.194:6800/815615585 30 ==== osd_op_reply(118 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f58e00c9030 con 0x7f58f0070bc0 2024-09-13T06:11:43.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.511+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.1 v2:172.21.15.194:6808/3135444559 34 ==== osd_op_reply(115 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.3 [call out=85b] v0'0 uv9 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f58e803d060 con 0x55b2148faa30 2024-09-13T06:11:43.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.515+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:121 4.22 4:448af099:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b2149501b0 con 0x55b2148faa30 2024-09-13T06:11:43.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.515+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:122 4.0 4:03676261:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b214943e10 con 0x7f58f0070bc0 2024-09-13T06:11:43.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.515+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.1 v2:172.21.15.194:6808/3135444559 35 ==== osd_op_reply(117 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f58e803d060 con 0x55b2148faa30 2024-09-13T06:11:43.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.515+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.1 v2:172.21.15.194:6808/3135444559 36 ==== osd_op_reply(119 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.7 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f58e803d060 con 0x55b2148faa30 2024-09-13T06:11:43.519 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.515+0000 7f58f4b16640 1 -- 172.21.15.194:0/4230494589 <== osd.2 v2:172.21.15.194:6800/815615585 31 ==== osd_op_reply(122 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.10 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f58e00c9030 con 0x7f58f0070bc0 2024-09-13T06:11:43.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.515+0000 7f58f5317640 1 -- 172.21.15.194:0/4230494589 <== osd.3 v2:172.21.15.194:6816/96632515 31 ==== osd_op_reply(120 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f58f0051070 con 0x55b2148ff420 2024-09-13T06:11:43.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.515+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.1 v2:172.21.15.194:6808/3135444559 37 ==== osd_op_reply(121 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.9 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f58e803d060 con 0x55b2148faa30 2024-09-13T06:11:43.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.515+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.1 v2:172.21.15.194:6808/3135444559 38 ==== osd_op_reply(111 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.4 [stat,call,call] v35'11 uv11 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f58e803d060 con 0x55b2148faa30 2024-09-13T06:11:43.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.515+0000 7f57d8ff9640 20 handle_completion(): completion ok for obj=15f6f8dc036519d7fe15b39338f6e5db 2024-09-13T06:11:43.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.515+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.1 v2:172.21.15.194:6808/3135444559 39 ==== osd_op_reply(116 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.4 [call out=124b] v0'0 uv11 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f58e803d060 con 0x55b2148faa30 2024-09-13T06:11:43.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.515+0000 7f58f7807980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-13T06:11:43.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.515+0000 7f58f7807980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-13T06:11:43.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.515+0000 7f58f7807980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-13T06:11:43.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.515+0000 7f58f7807980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-13T06:11:43.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.515+0000 7f58f7807980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7])"; uploads.size()=0; is_truncated=0 2024-09-13T06:11:43.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.515+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:123 4.6 4:63b951e7:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b21493bc30 con 0x7f58f0070bc0 2024-09-13T06:11:43.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.515+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:124 4.18 4:196765b6:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b214943850 con 0x7f58f0070bc0 2024-09-13T06:11:43.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.515+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:125 4.e 4:72ca9536:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b21494a810 con 0x7f58f0070bc0 2024-09-13T06:11:43.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.515+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:126 4.35 4:afdb4393:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b21494feb0 con 0x55b2148faa30 2024-09-13T06:11:43.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.515+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:127 4.c 4:3333458d:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b21493bc30 con 0x55b2148faa30 2024-09-13T06:11:43.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.515+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:128 4.2f 4:f7b35787:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b214943850 con 0x55b2148faa30 2024-09-13T06:11:43.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.515+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:129 4.1a 4:593d7944:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b21494a810 con 0x7f58f0070bc0 2024-09-13T06:11:43.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.515+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:130 4.2a 4:5507b116:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b21494feb0 con 0x55b2148faa30 2024-09-13T06:11:43.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.515+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:131 4.8 4:130b253f:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b21493bc30 con 0x55b2148ff420 2024-09-13T06:11:43.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.515+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.1 v2:172.21.15.194:6808/3135444559 40 ==== osd_op_reply(126 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.3 [call out=85b] v0'0 uv9 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f58e803d060 con 0x55b2148faa30 2024-09-13T06:11:43.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.515+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:132 4.22 4:448af099:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b214943850 con 0x55b2148faa30 2024-09-13T06:11:43.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.515+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.1 v2:172.21.15.194:6808/3135444559 41 ==== osd_op_reply(127 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.4 [call out=124b] v0'0 uv11 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f58e803d060 con 0x55b2148faa30 2024-09-13T06:11:43.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.515+0000 7f58f4b16640 1 -- 172.21.15.194:0/4230494589 <== osd.2 v2:172.21.15.194:6800/815615585 32 ==== osd_op_reply(123 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f58e00c9030 con 0x7f58f0070bc0 2024-09-13T06:11:43.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.515+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.1 v2:172.21.15.194:6808/3135444559 42 ==== osd_op_reply(128 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f58e803d060 con 0x55b2148faa30 2024-09-13T06:11:43.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.515+0000 7f58f4b16640 1 -- 172.21.15.194:0/4230494589 <== osd.2 v2:172.21.15.194:6800/815615585 33 ==== osd_op_reply(124 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.1 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f58e00c9030 con 0x7f58f0070bc0 2024-09-13T06:11:43.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.515+0000 7f58f4b16640 1 -- 172.21.15.194:0/4230494589 <== osd.2 v2:172.21.15.194:6800/815615585 34 ==== osd_op_reply(129 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f58e00c9030 con 0x7f58f0070bc0 2024-09-13T06:11:43.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.515+0000 7f58f4b16640 1 -- 172.21.15.194:0/4230494589 <== osd.2 v2:172.21.15.194:6800/815615585 35 ==== osd_op_reply(125 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f58e00c9030 con 0x7f58f0070bc0 2024-09-13T06:11:43.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.515+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:133 4.0 4:03676261:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b21494feb0 con 0x7f58f0070bc0 2024-09-13T06:11:43.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.515+0000 7f58f5317640 1 -- 172.21.15.194:0/4230494589 <== osd.3 v2:172.21.15.194:6816/96632515 32 ==== osd_op_reply(131 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f58f0051070 con 0x55b2148ff420 2024-09-13T06:11:43.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.515+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.1 v2:172.21.15.194:6808/3135444559 43 ==== osd_op_reply(130 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.7 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f58e803d060 con 0x55b2148faa30 2024-09-13T06:11:43.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.515+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.1 v2:172.21.15.194:6808/3135444559 44 ==== osd_op_reply(132 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.9 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f58e803d060 con 0x55b2148faa30 2024-09-13T06:11:43.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.515+0000 7f58f4b16640 1 -- 172.21.15.194:0/4230494589 <== osd.2 v2:172.21.15.194:6800/815615585 36 ==== osd_op_reply(133 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.10 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f58e00c9030 con 0x7f58f0070bc0 2024-09-13T06:11:43.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.515+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:134 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b21493bc30 con 0x7f58f0070bc0 2024-09-13T06:11:43.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.519+0000 7f58f4b16640 1 -- 172.21.15.194:0/4230494589 <== osd.2 v2:172.21.15.194:6800/815615585 37 ==== osd_op_reply(134 foo.buckets [call] v35'46 uv46 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f58e00c9030 con 0x7f58f0070bc0 2024-09-13T06:11:43.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.519+0000 7f58f7807980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T06:11:43.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.519+0000 7f58f7807980 20 rados->read ofs=0 len=0 2024-09-13T06:11:43.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.519+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:135 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b21494a810 con 0x7f58f0070bc0 2024-09-13T06:11:43.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.519+0000 7f58f4b16640 1 -- 172.21.15.194:0/4230494589 <== osd.2 v2:172.21.15.194:6800/815615585 38 ==== osd_op_reply(135 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv40 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f58e00c9030 con 0x7f58f0070bc0 2024-09-13T06:11:43.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.519+0000 7f58f7807980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T06:11:43.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.519+0000 7f58f7807980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T06:11:43.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.519+0000 7f58f7807980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T06:11:43.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.519+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:136 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b21493bc30 con 0x7f58f0070bc0 2024-09-13T06:11:43.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.519+0000 7f58f4b16640 1 -- 172.21.15.194:0/4230494589 <== osd.2 v2:172.21.15.194:6800/815615585 39 ==== osd_op_reply(136 myfoo [call,call,delete] v35'47 uv47 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7f58e00c9030 con 0x7f58f0070bc0 2024-09-13T06:11:43.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.519+0000 7f58f7807980 10 removing default.rgw.meta+root+myfoo from cache 2024-09-13T06:11:43.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.519+0000 7f58f7807980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-13T06:11:43.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.519+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:137 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94223337764736 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b21493bba0 con 0x7f58e00dc040 2024-09-13T06:11:43.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.523+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.0 v2:172.21.15.120:6800/1923744619 22 ==== watch-notify(notify (1) cookie 94223337564800 notify 150323855405 ret 0) ==== 191+0+0 (crc 0 0 0) 0x55b2149190a0 con 0x7f58e00dc040 2024-09-13T06:11:43.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.523+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.0 v2:172.21.15.120:6800/1923744619 23 ==== osd_op_reply(137 notify.6 [notify cookie 94223337764736 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f58e803d060 con 0x7f58e00dc040 2024-09-13T06:11:43.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.523+0000 7f57d8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855405 cookie 94223337564800 notifier 4780 bl.length()=149 2024-09-13T06:11:43.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.523+0000 7f57d8ff9640 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:138 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f57b8003d70 con 0x7f58e00dc040 2024-09-13T06:11:43.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.523+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.0 v2:172.21.15.120:6800/1923744619 24 ==== osd_op_reply(138 notify.6 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58e803d060 con 0x7f58e00dc040 2024-09-13T06:11:43.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.523+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.0 v2:172.21.15.120:6800/1923744619 25 ==== watch-notify(notify_complete (2) cookie 94223337764736 notify 150323855405 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b214917390 con 0x7f58e00dc040 2024-09-13T06:11:43.527 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.523+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:139 8.10 8:0b210059:root::.bucket.meta.myfoo%3a52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b21493bc30 con 0x55b2148ff420 2024-09-13T06:11:43.528 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.523+0000 7f58f5317640 1 -- 172.21.15.194:0/4230494589 <== osd.3 v2:172.21.15.194:6816/96632515 33 ==== osd_op_reply(139 .bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7 [call,call,delete] v35'2 uv2 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7f58f0051070 con 0x55b2148ff420 2024-09-13T06:11:43.528 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.523+0000 7f58f7807980 10 removing default.rgw.meta+root+.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7 from cache 2024-09-13T06:11:43.528 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.523+0000 7f58f7807980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7, ofs0, ns] 2024-09-13T06:11:43.528 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.523+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:140 7.9 7:93e5b521:::notify.7:head [notify cookie 94223337745904 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b21493bc30 con 0x7f58e00dc040 2024-09-13T06:11:43.528 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.523+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.0 v2:172.21.15.120:6800/1923744619 26 ==== watch-notify(notify (1) cookie 94223337566064 notify 150323855406 ret 0) ==== 248+0+0 (crc 0 0 0) 0x55b214917390 con 0x7f58e00dc040 2024-09-13T06:11:43.528 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.523+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.0 v2:172.21.15.120:6800/1923744619 27 ==== osd_op_reply(140 notify.7 [notify cookie 94223337745904 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f58e803d060 con 0x7f58e00dc040 2024-09-13T06:11:43.528 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.523+0000 7f57d8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855406 cookie 94223337566064 notifier 4780 bl.length()=206 2024-09-13T06:11:43.528 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.523+0000 7f57d8ff9640 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:141 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f57b8003d70 con 0x7f58e00dc040 2024-09-13T06:11:43.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.527+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.0 v2:172.21.15.120:6800/1923744619 28 ==== osd_op_reply(141 notify.7 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58e803d060 con 0x7f58e00dc040 2024-09-13T06:11:43.530 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.527+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.0 v2:172.21.15.120:6800/1923744619 29 ==== watch-notify(notify_complete (2) cookie 94223337745904 notify 150323855406 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b214917180 con 0x7f58e00dc040 2024-09-13T06:11:43.530 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.527+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:142 4.6 4:63b951e7:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b21493b780 con 0x7f58f0070bc0 2024-09-13T06:11:43.530 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.527+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:143 4.18 4:196765b6:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b214943660 con 0x7f58f0070bc0 2024-09-13T06:11:43.530 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.527+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:144 4.e 4:72ca9536:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b214935340 con 0x7f58f0070bc0 2024-09-13T06:11:43.530 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.527+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:145 4.35 4:afdb4393:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b214935c10 con 0x55b2148faa30 2024-09-13T06:11:43.530 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.527+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:146 4.c 4:3333458d:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b21494b880 con 0x55b2148faa30 2024-09-13T06:11:43.530 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.527+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:147 4.2f 4:f7b35787:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b21493b780 con 0x55b2148faa30 2024-09-13T06:11:43.530 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.527+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:148 4.1a 4:593d7944:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b214943660 con 0x7f58f0070bc0 2024-09-13T06:11:43.530 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.527+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:149 4.2a 4:5507b116:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b21494ca30 con 0x55b2148faa30 2024-09-13T06:11:43.530 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.527+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:150 4.8 4:130b253f:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b214935c10 con 0x55b2148ff420 2024-09-13T06:11:43.530 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.527+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:151 4.22 4:448af099:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b21494b880 con 0x55b2148faa30 2024-09-13T06:11:43.531 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.527+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:152 4.0 4:03676261:::.dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b21493b780 con 0x7f58f0070bc0 2024-09-13T06:11:43.531 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.527+0000 7f58f4b16640 1 -- 172.21.15.194:0/4230494589 <== osd.2 v2:172.21.15.194:6800/815615585 40 ==== osd_op_reply(144 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.2 [delete] v35'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f58e00c9030 con 0x7f58f0070bc0 2024-09-13T06:11:43.531 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.527+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.1 v2:172.21.15.194:6808/3135444559 45 ==== osd_op_reply(147 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.5 [delete] v35'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f58e803d060 con 0x55b2148faa30 2024-09-13T06:11:43.531 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.527+0000 7f58f4b16640 1 -- 172.21.15.194:0/4230494589 <== osd.2 v2:172.21.15.194:6800/815615585 41 ==== osd_op_reply(142 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.0 [delete] v35'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f58e00c9030 con 0x7f58f0070bc0 2024-09-13T06:11:43.533 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.527+0000 7f58f4b16640 1 -- 172.21.15.194:0/4230494589 <== osd.2 v2:172.21.15.194:6800/815615585 42 ==== osd_op_reply(152 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.10 [delete] v35'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f58e00c9030 con 0x7f58f0070bc0 2024-09-13T06:11:43.533 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.531+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.1 v2:172.21.15.194:6808/3135444559 46 ==== osd_op_reply(149 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.7 [delete] v35'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f58e803d060 con 0x55b2148faa30 2024-09-13T06:11:43.533 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.531+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.1 v2:172.21.15.194:6808/3135444559 47 ==== osd_op_reply(145 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.3 [delete] v35'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f58e803d060 con 0x55b2148faa30 2024-09-13T06:11:43.533 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.531+0000 7f58f4b16640 1 -- 172.21.15.194:0/4230494589 <== osd.2 v2:172.21.15.194:6800/815615585 43 ==== osd_op_reply(143 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.1 [delete] v35'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f58e00c9030 con 0x7f58f0070bc0 2024-09-13T06:11:43.533 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.531+0000 7f58f5317640 1 -- 172.21.15.194:0/4230494589 <== osd.3 v2:172.21.15.194:6816/96632515 34 ==== osd_op_reply(150 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.8 [delete] v35'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f58f0051070 con 0x55b2148ff420 2024-09-13T06:11:43.533 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.531+0000 7f58f4b16640 1 -- 172.21.15.194:0/4230494589 <== osd.2 v2:172.21.15.194:6800/815615585 44 ==== osd_op_reply(148 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.6 [delete] v35'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f58e00c9030 con 0x7f58f0070bc0 2024-09-13T06:11:43.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.531+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.1 v2:172.21.15.194:6808/3135444559 48 ==== osd_op_reply(146 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.4 [delete] v35'12 uv12 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f58e803d060 con 0x55b2148faa30 2024-09-13T06:11:43.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.531+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.1 v2:172.21.15.194:6808/3135444559 49 ==== osd_op_reply(151 .dir.52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7.9 [delete] v35'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f58e803d060 con 0x55b2148faa30 2024-09-13T06:11:43.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.531+0000 7f58f7807980 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7 : miss 2024-09-13T06:11:43.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.531+0000 7f58f7807980 20 rados->read ofs=0 len=0 2024-09-13T06:11:43.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.531+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:153 6.1c 6:392d72af:::pubsub..bucket.myfoo%2f52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b214935340 con 0x55b2148ff420 2024-09-13T06:11:43.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.531+0000 7f58f5317640 1 -- 172.21.15.194:0/4230494589 <== osd.3 v2:172.21.15.194:6816/96632515 35 ==== osd_op_reply(153 pubsub..bucket.myfoo/52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f58f0051070 con 0x55b2148ff420 2024-09-13T06:11:43.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.531+0000 7f58f7807980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:43.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.531+0000 7f58f7807980 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7 info.flags=0x0 2024-09-13T06:11:43.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.531+0000 7f58f7807980 10 adding default.rgw.log++pubsub..bucket.myfoo/52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7 to cache LRU end 2024-09-13T06:11:43.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.531+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:154 6.1c 6:392d72af:::pubsub..bucket.myfoo%2f52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b21493b730 con 0x55b2148ff420 2024-09-13T06:11:43.535 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.531+0000 7f58f5317640 1 -- 172.21.15.194:0/4230494589 <== osd.3 v2:172.21.15.194:6816/96632515 36 ==== osd_op_reply(154 pubsub..bucket.myfoo/52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.7 [delete] v35'35 uv27 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f58f0051070 con 0x55b2148ff420 2024-09-13T06:11:43.535 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.531+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:155 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b21493b730 con 0x7f58f0070bc0 2024-09-13T06:11:43.536 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.535+0000 7f58f4b16640 1 -- 172.21.15.194:0/4230494589 <== osd.2 v2:172.21.15.194:6800/815615585 45 ==== osd_op_reply(155 foo.buckets [call] v35'48 uv48 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f58e00c9030 con 0x7f58f0070bc0 2024-09-13T06:11:43.537 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.535+0000 7f58f7807980 10 removing key index: 9te6NH5mcdcq0Tc5i8i1 2024-09-13T06:11:43.537 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.535+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:156 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b21493b730 con 0x7f58e00dc040 2024-09-13T06:11:43.538 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.535+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.0 v2:172.21.15.120:6800/1923744619 30 ==== osd_op_reply(156 9te6NH5mcdcq0Tc5i8i1 [delete] v35'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f58e803d060 con 0x7f58e00dc040 2024-09-13T06:11:43.538 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.535+0000 7f58f7807980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-09-13T06:11:43.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.535+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:157 7.e 7:7759931f:::notify.3:head [notify cookie 94223337745904 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b21493b730 con 0x7f58f0070bc0 2024-09-13T06:11:43.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.535+0000 7f58f4b16640 1 -- 172.21.15.194:0/4230494589 <== osd.2 v2:172.21.15.194:6800/815615585 46 ==== watch-notify(notify (1) cookie 94223337555616 notify 150323855379 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55b214918cc0 con 0x7f58f0070bc0 2024-09-13T06:11:43.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.535+0000 7f58f4b16640 1 -- 172.21.15.194:0/4230494589 <== osd.2 v2:172.21.15.194:6800/815615585 47 ==== osd_op_reply(157 notify.3 [notify cookie 94223337745904 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f58e00c9030 con 0x7f58f0070bc0 2024-09-13T06:11:43.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.535+0000 7f57d8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855379 cookie 94223337555616 notifier 4780 bl.length()=170 2024-09-13T06:11:43.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.535+0000 7f57d8ff9640 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:158 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f57b8003d70 con 0x7f58f0070bc0 2024-09-13T06:11:43.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.535+0000 7f58f4b16640 1 -- 172.21.15.194:0/4230494589 <== osd.2 v2:172.21.15.194:6800/815615585 48 ==== osd_op_reply(158 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58e00c9030 con 0x7f58f0070bc0 2024-09-13T06:11:43.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.535+0000 7f58f4b16640 1 -- 172.21.15.194:0/4230494589 <== osd.2 v2:172.21.15.194:6800/815615585 49 ==== watch-notify(notify_complete (2) cookie 94223337745904 notify 150323855379 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b2149153b0 con 0x7f58f0070bc0 2024-09-13T06:11:43.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.535+0000 7f58f7807980 10 removing email index: foo@foo.com 2024-09-13T06:11:43.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.535+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:159 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b21493b730 con 0x55b2148faa30 2024-09-13T06:11:43.542 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.539+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.1 v2:172.21.15.194:6808/3135444559 50 ==== osd_op_reply(159 foo@foo.com [delete] v35'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f58e803d060 con 0x55b2148faa30 2024-09-13T06:11:43.542 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.539+0000 7f58f7807980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-09-13T06:11:43.542 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.539+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:160 7.e 7:7759931f:::notify.3:head [notify cookie 94223337745904 in=174b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b21493b730 con 0x7f58f0070bc0 2024-09-13T06:11:43.542 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.539+0000 7f58f4b16640 1 -- 172.21.15.194:0/4230494589 <== osd.2 v2:172.21.15.194:6800/815615585 50 ==== watch-notify(notify (1) cookie 94223337555616 notify 150323855380 ret 0) ==== 204+0+0 (crc 0 0 0) 0x55b2149153b0 con 0x7f58f0070bc0 2024-09-13T06:11:43.542 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.539+0000 7f57d8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855380 cookie 94223337555616 notifier 4780 bl.length()=162 2024-09-13T06:11:43.543 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.539+0000 7f57d8ff9640 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:161 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f57b8003d70 con 0x7f58f0070bc0 2024-09-13T06:11:43.543 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.539+0000 7f58f4b16640 1 -- 172.21.15.194:0/4230494589 <== osd.2 v2:172.21.15.194:6800/815615585 51 ==== osd_op_reply(160 notify.3 [notify cookie 94223337745904 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f58e00c9030 con 0x7f58f0070bc0 2024-09-13T06:11:43.543 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.539+0000 7f58f4b16640 1 -- 172.21.15.194:0/4230494589 <== osd.2 v2:172.21.15.194:6800/815615585 52 ==== osd_op_reply(161 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58e00c9030 con 0x7f58f0070bc0 2024-09-13T06:11:43.543 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.539+0000 7f58f4b16640 1 -- 172.21.15.194:0/4230494589 <== osd.2 v2:172.21.15.194:6800/815615585 53 ==== watch-notify(notify_complete (2) cookie 94223337745904 notify 150323855380 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b214917810 con 0x7f58f0070bc0 2024-09-13T06:11:43.543 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.539+0000 7f58f7807980 10 removing user buckets index 2024-09-13T06:11:43.544 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.539+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:162 8.9 8:96d98480:users.uid::foo.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b21493b730 con 0x7f58f0070bc0 2024-09-13T06:11:43.545 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.543+0000 7f58f4b16640 1 -- 172.21.15.194:0/4230494589 <== osd.2 v2:172.21.15.194:6800/815615585 54 ==== osd_op_reply(162 foo.buckets [delete] v35'49 uv49 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f58e00c9030 con 0x7f58f0070bc0 2024-09-13T06:11:43.545 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.543+0000 7f58f7807980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:foo.buckets, ofs0, ns] 2024-09-13T06:11:43.545 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.543+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94223337741552 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b21493b730 con 0x7f58e00dc040 2024-09-13T06:11:43.546 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.543+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.0 v2:172.21.15.120:6800/1923744619 31 ==== watch-notify(notify (1) cookie 94223337560640 notify 150323855407 ret 0) ==== 202+0+0 (crc 0 0 0) 0x7f58e8050040 con 0x7f58e00dc040 2024-09-13T06:11:43.546 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.543+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.0 v2:172.21.15.120:6800/1923744619 32 ==== osd_op_reply(163 notify.5 [notify cookie 94223337741552 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f58e803d060 con 0x7f58e00dc040 2024-09-13T06:11:43.546 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.543+0000 7f57cbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855407 cookie 94223337560640 notifier 4780 bl.length()=160 2024-09-13T06:11:43.546 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.543+0000 7f57cbfff640 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f57280032d0 con 0x7f58e00dc040 2024-09-13T06:11:43.547 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.543+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.0 v2:172.21.15.120:6800/1923744619 33 ==== watch-notify(notify_complete (2) cookie 94223337741552 notify 150323855407 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b214917180 con 0x7f58e00dc040 2024-09-13T06:11:43.547 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.543+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.0 v2:172.21.15.120:6800/1923744619 34 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58e803d060 con 0x7f58e00dc040 2024-09-13T06:11:43.547 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.543+0000 7f58f7807980 10 removing user index: foo 2024-09-13T06:11:43.547 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.543+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:165 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b214936d40 con 0x55b2148faa30 2024-09-13T06:11:43.549 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.547+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.1 v2:172.21.15.194:6808/3135444559 51 ==== osd_op_reply(165 foo [call,call,delete] v35'27 uv27 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f58e803d060 con 0x55b2148faa30 2024-09-13T06:11:43.549 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.547+0000 7f58f7807980 10 removing default.rgw.meta+users.uid+foo from cache 2024-09-13T06:11:43.549 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.547+0000 7f58f7807980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T06:11:43.549 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.547+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:166 7.d 7:b4812045:::notify.4:head [notify cookie 94223337745728 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b21493b730 con 0x55b2148faa30 2024-09-13T06:11:43.549 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.547+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.1 v2:172.21.15.194:6808/3135444559 52 ==== watch-notify(notify (1) cookie 94223337552208 notify 150323855378 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55b214917180 con 0x55b2148faa30 2024-09-13T06:11:43.549 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.547+0000 7f57cbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855378 cookie 94223337552208 notifier 4780 bl.length()=152 2024-09-13T06:11:43.549 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.547+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.1 v2:172.21.15.194:6808/3135444559 53 ==== osd_op_reply(166 notify.4 [notify cookie 94223337745728 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f58e803d060 con 0x55b2148faa30 2024-09-13T06:11:43.549 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.547+0000 7f57cbfff640 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:167 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f57280032b0 con 0x55b2148faa30 2024-09-13T06:11:43.550 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.547+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.1 v2:172.21.15.194:6808/3135444559 54 ==== osd_op_reply(167 notify.4 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58e803d060 con 0x55b2148faa30 2024-09-13T06:11:43.550 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.547+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.1 v2:172.21.15.194:6808/3135444559 55 ==== watch-notify(notify_complete (2) cookie 94223337745728 notify 150323855378 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b214917560 con 0x55b2148faa30 2024-09-13T06:11:43.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.547+0000 7f57ab7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:11:43.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.547+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:168 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94223337559168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b2149167a0 con 0x55b2148faa30 2024-09-13T06:11:43.552 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.551+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.1 v2:172.21.15.194:6808/3135444559 56 ==== osd_op_reply(168 data_loggenerations_metadata [watch unwatch cookie 94223337559168] v35'236 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f58e803d060 con 0x55b2148faa30 2024-09-13T06:11:43.552 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.551+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:169 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94223337541008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b2149167a0 con 0x7f58f0070bc0 2024-09-13T06:11:43.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.551+0000 7f58f4b16640 1 -- 172.21.15.194:0/4230494589 <== osd.2 v2:172.21.15.194:6800/815615585 55 ==== osd_op_reply(169 notify.0 [watch unwatch cookie 94223337541008] v35'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58e00c9030 con 0x7f58f0070bc0 2024-09-13T06:11:43.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.551+0000 7f58f7807980 20 remove_watcher() i=0 2024-09-13T06:11:43.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.551+0000 7f58f7807980 2 removed watcher, disabling cache 2024-09-13T06:11:43.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.551+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:170 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94223337545168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b2149167a0 con 0x55b2148faa30 2024-09-13T06:11:43.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.555+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.1 v2:172.21.15.194:6808/3135444559 57 ==== osd_op_reply(170 notify.1 [watch unwatch cookie 94223337545168] v35'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58e803d060 con 0x55b2148faa30 2024-09-13T06:11:43.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.555+0000 7f58f7807980 20 remove_watcher() i=1 2024-09-13T06:11:43.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.555+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:171 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94223337547296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b2149167a0 con 0x55b2148ff420 2024-09-13T06:11:43.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.555+0000 7f58f5317640 1 -- 172.21.15.194:0/4230494589 <== osd.3 v2:172.21.15.194:6816/96632515 37 ==== osd_op_reply(171 notify.2 [watch unwatch cookie 94223337547296] v35'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58f0051070 con 0x55b2148ff420 2024-09-13T06:11:43.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.555+0000 7f58f7807980 20 remove_watcher() i=2 2024-09-13T06:11:43.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.555+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:172 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94223337555616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b2149167a0 con 0x7f58f0070bc0 2024-09-13T06:11:43.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.559+0000 7f58f4b16640 1 -- 172.21.15.194:0/4230494589 <== osd.2 v2:172.21.15.194:6800/815615585 56 ==== osd_op_reply(172 notify.3 [watch unwatch cookie 94223337555616] v35'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58e00c9030 con 0x7f58f0070bc0 2024-09-13T06:11:43.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.559+0000 7f58f7807980 20 remove_watcher() i=3 2024-09-13T06:11:43.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.559+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:173 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94223337552208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b2149167a0 con 0x55b2148faa30 2024-09-13T06:11:43.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.559+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.1 v2:172.21.15.194:6808/3135444559 58 ==== osd_op_reply(173 notify.4 [watch unwatch cookie 94223337552208] v35'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58e803d060 con 0x55b2148faa30 2024-09-13T06:11:43.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.559+0000 7f58f7807980 20 remove_watcher() i=4 2024-09-13T06:11:43.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.559+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:174 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94223337560640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b2149167a0 con 0x7f58e00dc040 2024-09-13T06:11:43.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.563+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.0 v2:172.21.15.120:6800/1923744619 35 ==== osd_op_reply(174 notify.5 [watch unwatch cookie 94223337560640] v35'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58e803d060 con 0x7f58e00dc040 2024-09-13T06:11:43.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.563+0000 7f58f7807980 20 remove_watcher() i=5 2024-09-13T06:11:43.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.563+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:175 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94223337564800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b2149167a0 con 0x7f58e00dc040 2024-09-13T06:11:43.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.567+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.0 v2:172.21.15.120:6800/1923744619 36 ==== osd_op_reply(175 notify.6 [watch unwatch cookie 94223337564800] v35'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58e803d060 con 0x7f58e00dc040 2024-09-13T06:11:43.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.567+0000 7f58f7807980 20 remove_watcher() i=6 2024-09-13T06:11:43.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.567+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:176 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94223337566064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b2149167a0 con 0x7f58e00dc040 2024-09-13T06:11:43.571 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.567+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 <== osd.0 v2:172.21.15.120:6800/1923744619 37 ==== osd_op_reply(176 notify.7 [watch unwatch cookie 94223337566064] v35'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58e803d060 con 0x7f58e00dc040 2024-09-13T06:11:43.572 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.567+0000 7f58f7807980 20 remove_watcher() i=7 2024-09-13T06:11:43.572 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.567+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f58e00dc040 msgr2=0x7f58e00ce430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.572 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.567+0000 7f58f7807980 1 --2- 172.21.15.194:0/4230494589 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f58e00dc040 0x7f58e00ce430 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.572 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.567+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55b2148faa30 msgr2=0x55b2148fcef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.572 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.567+0000 7f58f7807980 1 --2- 172.21.15.194:0/4230494589 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55b2148faa30 0x55b2148fcef0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.572 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.567+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f58f0070bc0 msgr2=0x7f58f00358c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.572 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.567+0000 7f58f7807980 1 --2- 172.21.15.194:0/4230494589 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f58f0070bc0 0x7f58f00358c0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.572 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.567+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55b2148ff420 msgr2=0x55b214901810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.572 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.567+0000 7f58f7807980 1 --2- 172.21.15.194:0/4230494589 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55b2148ff420 0x55b214901810 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.572 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.567+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f57c00346a0 msgr2=0x7f57c0036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.572 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.567+0000 7f58f7807980 1 --2- 172.21.15.194:0/4230494589 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f57c00346a0 0x7f57c0036b60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f58e001b210 tx=0x7f58e00a7000 comp rx=0 tx=0).stop 2024-09-13T06:11:43.572 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.567+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b2148e8780 msgr2=0x55b2148ef9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.567+0000 7f58f5b18640 1 -- 172.21.15.194:0/4230494589 reap_dead start 2024-09-13T06:11:43.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.567+0000 7f58f7807980 1 --2- 172.21.15.194:0/4230494589 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b2148e8780 0x55b2148ef9a0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f58f000ffb0 tx=0x7f58f0006f90 comp rx=0 tx=0).stop 2024-09-13T06:11:43.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.567+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 shutdown_connections 2024-09-13T06:11:43.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.567+0000 7f58f7807980 1 --2- 172.21.15.194:0/4230494589 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b2148e8780 0x55b2148ef9a0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.567+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 >> 172.21.15.194:0/4230494589 conn(0x55b2148e4b60 msgr2=0x55b2148e2c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:43.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.567+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 shutdown_connections 2024-09-13T06:11:43.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.567+0000 7f58f7807980 1 -- 172.21.15.194:0/4230494589 wait complete. 2024-09-13T06:11:43.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.571+0000 7f58f7807980 1 -- 172.21.15.194:0/3467945047 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f57cc034650 msgr2=0x7f57cc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.571+0000 7f58f7807980 1 --2- 172.21.15.194:0/3467945047 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f57cc034650 0x7f57cc036b10 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x55b2148c5f70 tx=0x7f58e0005ad0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.571+0000 7f58f7807980 1 -- 172.21.15.194:0/3467945047 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b2148dbe80 msgr2=0x55b2148dc2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.571+0000 7f58f7807980 1 --2- 172.21.15.194:0/3467945047 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b2148dbe80 0x55b2148dc2a0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f58f001dfd0 tx=0x7f58f000ecd0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.571+0000 7f58f7807980 1 -- 172.21.15.194:0/3467945047 shutdown_connections 2024-09-13T06:11:43.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.571+0000 7f58f7807980 1 --2- 172.21.15.194:0/3467945047 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f57cc034650 0x7f57cc036b10 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.571+0000 7f58f7807980 1 --2- 172.21.15.194:0/3467945047 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b2148dbe80 0x55b2148dc2a0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.571+0000 7f58f7807980 1 -- 172.21.15.194:0/3467945047 >> 172.21.15.194:0/3467945047 conn(0x55b2148d0fd0 msgr2=0x55b2148d3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:43.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.571+0000 7f58f7807980 1 -- 172.21.15.194:0/3467945047 shutdown_connections 2024-09-13T06:11:43.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.571+0000 7f58f7807980 1 -- 172.21.15.194:0/3467945047 wait complete. 2024-09-13T06:11:43.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.571+0000 7f58f7807980 1 -- 172.21.15.194:0/786728576 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55b2147cc900 msgr2=0x55b2148c5020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.571+0000 7f58f7807980 1 --2- 172.21.15.194:0/786728576 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55b2147cc900 0x55b2148c5020 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.571+0000 7f58f7807980 1 -- 172.21.15.194:0/786728576 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55b2148cb8e0 msgr2=0x55b2148cdcd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.571+0000 7f58f7807980 1 --2- 172.21.15.194:0/786728576 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55b2148cb8e0 0x55b2148cdcd0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.571+0000 7f58f7807980 1 -- 172.21.15.194:0/786728576 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55b2148c79c0 msgr2=0x55b2148c9db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.571+0000 7f58f7807980 1 --2- 172.21.15.194:0/786728576 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55b2148c79c0 0x55b2148c9db0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.571+0000 7f58f7807980 1 -- 172.21.15.194:0/786728576 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f57dc034650 msgr2=0x7f57dc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.571+0000 7f58f7807980 1 --2- 172.21.15.194:0/786728576 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f57dc034650 0x7f57dc036b10 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f58e00ac000 tx=0x7f58e00a5000 comp rx=0 tx=0).stop 2024-09-13T06:11:43.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.571+0000 7f58f7807980 1 -- 172.21.15.194:0/786728576 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b2147c8580 msgr2=0x55b2148be050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.571+0000 7f58f7807980 1 --2- 172.21.15.194:0/786728576 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b2147c8580 0x55b2148be050 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x55b2148b3a40 tx=0x7f58f0000bd0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.571+0000 7f58f5b18640 1 -- 172.21.15.194:0/786728576 reap_dead start 2024-09-13T06:11:43.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.571+0000 7f58f7807980 1 -- 172.21.15.194:0/786728576 shutdown_connections 2024-09-13T06:11:43.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.571+0000 7f58f7807980 1 -- 172.21.15.194:0/786728576 >> 172.21.15.194:0/786728576 conn(0x55b2147c40a0 msgr2=0x55b2148ad010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:43.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.571+0000 7f58f7807980 1 -- 172.21.15.194:0/786728576 shutdown_connections 2024-09-13T06:11:43.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.571+0000 7f58f7807980 1 -- 172.21.15.194:0/786728576 wait complete. 2024-09-13T06:11:43.587 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T06:11:43.587 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T06:11:43.587 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T06:11:43.662 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:11:43.662 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:11:43.663 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.659+0000 7fdbcca7b980 1 Processor -- start 2024-09-13T06:11:43.664 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.659+0000 7fdbcca7b980 1 -- start start 2024-09-13T06:11:43.664 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.663+0000 7fdbcca7b980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55a3ee1cf540 0x55a3ee1cf920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.664 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.663+0000 7fdbcca7b980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a3ee058ae0 con 0x55a3ee1cfe90 2024-09-13T06:11:43.664 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.663+0000 7fdbcca7b980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x55a3ee07ce30 con 0x55a3ee1cf540 2024-09-13T06:11:43.664 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.663+0000 7fdbca58b640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55a3ee1cf540 0x55a3ee1cf920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.663+0000 7fdbc9d8a640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x55a3ee1cfe90 0x55a3ee1d4910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:58308/0 (socket says 172.21.15.194:58308) 2024-09-13T06:11:43.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.663+0000 7fdbc9d8a640 1 -- 172.21.15.194:0/3028281632 learned_addr learned my addr 172.21.15.194:0/3028281632 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-09-13T06:11:43.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.663+0000 7fdbca58b640 1 -- 172.21.15.194:0/3028281632 >> v1:172.21.15.120:6789/0 conn(0x55a3ee1cfe90 legacy=0x55a3ee1d4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.663+0000 7fdbca58b640 1 -- 172.21.15.194:0/3028281632 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3ee1d7160 con 0x55a3ee1cf540 2024-09-13T06:11:43.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.667+0000 7fdbca58b640 1 --2- 172.21.15.194:0/3028281632 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a3ee1cf540 0x55a3ee1cf920 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fdbc400c6d0 tx=0x7fdbc401d6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb496cf555fe807a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.667+0000 7fdbc9589640 1 -- 172.21.15.194:0/3028281632 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbc40a67a0 con 0x55a3ee1cf540 2024-09-13T06:11:43.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.667+0000 7fdbc9589640 1 -- 172.21.15.194:0/3028281632 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbc40aa070 con 0x55a3ee1cf540 2024-09-13T06:11:43.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.667+0000 7fdbc9589640 1 -- 172.21.15.194:0/3028281632 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbc40a6af0 con 0x55a3ee1cf540 2024-09-13T06:11:43.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.667+0000 7fdbcca7b980 1 -- 172.21.15.194:0/3028281632 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a3ee1cf540 msgr2=0x55a3ee1cf920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.667+0000 7fdbcca7b980 1 --2- 172.21.15.194:0/3028281632 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a3ee1cf540 0x55a3ee1cf920 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fdbc400c6d0 tx=0x7fdbc401d6c0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.667+0000 7fdbcca7b980 1 -- 172.21.15.194:0/3028281632 shutdown_connections 2024-09-13T06:11:43.670 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.667+0000 7fdbcca7b980 1 --2- 172.21.15.194:0/3028281632 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a3ee1cf540 0x55a3ee1cf920 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.670 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.667+0000 7fdbcca7b980 1 -- 172.21.15.194:0/3028281632 >> 172.21.15.194:0/3028281632 conn(0x55a3ee1cb060 msgr2=0x55a3ee1cd480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:43.670 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.667+0000 7fdbcca7b980 1 -- 172.21.15.194:0/3028281632 shutdown_connections 2024-09-13T06:11:43.670 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.667+0000 7fdbcca7b980 1 -- 172.21.15.194:0/3028281632 wait complete. 2024-09-13T06:11:43.685 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.683+0000 7fdbcca7b980 1 Processor -- start 2024-09-13T06:11:43.686 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.683+0000 7fdbcca7b980 1 -- start start 2024-09-13T06:11:43.686 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.683+0000 7fdbcca7b980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a3ee1cf540 0x55a3ee2b98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.686 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.683+0000 7fdbcca7b980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55a3ee07e200 con 0x55a3ee1cf540 2024-09-13T06:11:43.686 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.683+0000 7fdbca58b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a3ee1cf540 0x55a3ee2b98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.686 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.683+0000 7fdbca58b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a3ee1cf540 0x55a3ee2b98f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44618/0 (socket says 172.21.15.194:44618) 2024-09-13T06:11:43.687 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.683+0000 7fdbca58b640 1 -- 172.21.15.194:0/332808200 learned_addr learned my addr 172.21.15.194:0/332808200 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:43.687 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.683+0000 7fdbca58b640 1 -- 172.21.15.194:0/332808200 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3ee2b9ec0 con 0x55a3ee1cf540 2024-09-13T06:11:43.687 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.683+0000 7fdbca58b640 1 --2- 172.21.15.194:0/332808200 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a3ee1cf540 0x55a3ee2b98f0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fdbc400c6d0 tx=0x7fdbc40033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=388c67713185b89d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.687 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.683+0000 7fdab8608640 1 -- 172.21.15.194:0/332808200 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbc40a7c40 con 0x55a3ee1cf540 2024-09-13T06:11:43.687 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.683+0000 7fdab8608640 1 -- 172.21.15.194:0/332808200 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbc40b4040 con 0x55a3ee1cf540 2024-09-13T06:11:43.688 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.683+0000 7fdab8608640 1 -- 172.21.15.194:0/332808200 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbc40b9420 con 0x55a3ee1cf540 2024-09-13T06:11:43.689 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.687+0000 7fdbcca7b980 1 -- 172.21.15.194:0/332808200 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a3ee1cf540 msgr2=0x55a3ee2b98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.689 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.687+0000 7fdbcca7b980 1 --2- 172.21.15.194:0/332808200 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a3ee1cf540 0x55a3ee2b98f0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fdbc400c6d0 tx=0x7fdbc40033b0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.689 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.687+0000 7fdbcca7b980 1 -- 172.21.15.194:0/332808200 shutdown_connections 2024-09-13T06:11:43.689 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.687+0000 7fdbcca7b980 1 --2- 172.21.15.194:0/332808200 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a3ee1cf540 0x55a3ee2b98f0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.689 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.687+0000 7fdbcca7b980 1 -- 172.21.15.194:0/332808200 >> 172.21.15.194:0/332808200 conn(0x55a3ee1cb060 msgr2=0x55a3ee2b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:43.689 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.687+0000 7fdbcca7b980 1 -- 172.21.15.194:0/332808200 shutdown_connections 2024-09-13T06:11:43.690 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.687+0000 7fdbcca7b980 1 -- 172.21.15.194:0/332808200 wait complete. 2024-09-13T06:11:43.690 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.687+0000 7fdbcca7b980 1 Processor -- start 2024-09-13T06:11:43.690 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.687+0000 7fdbcca7b980 1 -- start start 2024-09-13T06:11:43.690 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.687+0000 7fdbcca7b980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a3ee1cf540 0x55a3ee2c0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.690 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.687+0000 7fdbcca7b980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55a3ee1d6ba0 con 0x55a3ee1cf540 2024-09-13T06:11:43.690 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.687+0000 7fdbca58b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a3ee1cf540 0x55a3ee2c0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.690 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.687+0000 7fdbca58b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a3ee1cf540 0x55a3ee2c0b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44624/0 (socket says 172.21.15.194:44624) 2024-09-13T06:11:43.690 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.687+0000 7fdbca58b640 1 -- 172.21.15.194:0/3461044744 learned_addr learned my addr 172.21.15.194:0/3461044744 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:43.691 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.687+0000 7fdbca58b640 1 -- 172.21.15.194:0/3461044744 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3ee2c1060 con 0x55a3ee1cf540 2024-09-13T06:11:43.691 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.687+0000 7fdbca58b640 1 --2- 172.21.15.194:0/3461044744 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a3ee1cf540 0x55a3ee2c0b20 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fdbc40bb040 tx=0x7fdbc401a460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.691 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.687+0000 7fdab6e05640 1 -- 172.21.15.194:0/3461044744 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbc40b9a60 con 0x55a3ee1cf540 2024-09-13T06:11:43.691 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.687+0000 7fdab6e05640 1 -- 172.21.15.194:0/3461044744 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbc40b9c00 con 0x55a3ee1cf540 2024-09-13T06:11:43.691 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.687+0000 7fdbcca7b980 1 -- 172.21.15.194:0/3461044744 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a3ee2c12f0 con 0x55a3ee1cf540 2024-09-13T06:11:43.691 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.687+0000 7fdab6e05640 1 -- 172.21.15.194:0/3461044744 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbc40ae410 con 0x55a3ee1cf540 2024-09-13T06:11:43.692 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.687+0000 7fdbcca7b980 1 -- 172.21.15.194:0/3461044744 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3ee2c3fd0 con 0x55a3ee1cf540 2024-09-13T06:11:43.693 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.687+0000 7fdab6e05640 1 -- 172.21.15.194:0/3461044744 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fdbc40ac070 con 0x55a3ee1cf540 2024-09-13T06:11:43.693 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.691+0000 7fdab6e05640 1 --2- 172.21.15.194:0/3461044744 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fdab00346a0 0x7fdab0036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.693 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.691+0000 7fdab6e05640 1 -- 172.21.15.194:0/3461044744 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fdbc40be070 con 0x55a3ee1cf540 2024-09-13T06:11:43.693 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.691+0000 7fdbc9d8a640 1 --2- 172.21.15.194:0/3461044744 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fdab00346a0 0x7fdab0036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.693 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.691+0000 7fdbcca7b980 1 --2- 172.21.15.194:0/3461044744 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55a3ee1cfe90 0x55a3ee2c7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.693 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.691+0000 7fdbcca7b980 1 -- 172.21.15.194:0/3461044744 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee2c80d0 con 0x55a3ee1cfe90 2024-09-13T06:11:43.693 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.691+0000 7fdbcad8c640 1 --2- 172.21.15.194:0/3461044744 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55a3ee1cfe90 0x55a3ee2c7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.693 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.691+0000 7fdbc9d8a640 1 --2- 172.21.15.194:0/3461044744 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fdab00346a0 0x7fdab0036b60 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fdbc0000f70 tx=0x7fdbc00012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.694 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.691+0000 7fdbcad8c640 1 --2- 172.21.15.194:0/3461044744 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55a3ee1cfe90 0x55a3ee2c7ab0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.694 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.691+0000 7fdbcad8c640 1 -- 172.21.15.194:0/3461044744 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdbbc0083f0 con 0x55a3ee1cfe90 2024-09-13T06:11:43.694 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.691+0000 7fdbcca7b980 1 -- 172.21.15.194:0/3461044744 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee2c51f0 con 0x55a3ee1cfe90 2024-09-13T06:11:43.695 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.691+0000 7fdbcad8c640 1 -- 172.21.15.194:0/3461044744 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdbbc0083f0 con 0x55a3ee1cfe90 2024-09-13T06:11:43.695 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.691+0000 7fdbcca7b980 1 --2- 172.21.15.194:0/3461044744 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55a3ee2ca420 0x55a3ee2cc810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.695 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.691+0000 7fdbcca7b980 1 -- 172.21.15.194:0/3461044744 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee2ccee0 con 0x55a3ee2ca420 2024-09-13T06:11:43.695 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.691+0000 7fdbca58b640 1 --2- 172.21.15.194:0/3461044744 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55a3ee2ca420 0x55a3ee2cc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.695 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.691+0000 7fdbca58b640 1 --2- 172.21.15.194:0/3461044744 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55a3ee2ca420 0x55a3ee2cc810 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.695 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.691+0000 7fdbca58b640 1 -- 172.21.15.194:0/3461044744 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdbc40d3070 con 0x55a3ee2ca420 2024-09-13T06:11:43.695 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.691+0000 7fdbcca7b980 1 -- 172.21.15.194:0/3461044744 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee2c9290 con 0x55a3ee1cfe90 2024-09-13T06:11:43.696 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.691+0000 7fdbcad8c640 1 -- 172.21.15.194:0/3461044744 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdbbc0083f0 con 0x55a3ee1cfe90 2024-09-13T06:11:43.696 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.691+0000 7fdbcca7b980 1 --2- 172.21.15.194:0/3461044744 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55a3ee2ce320 0x55a3ee2d0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.696 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.691+0000 7fdbcca7b980 1 -- 172.21.15.194:0/3461044744 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee2d0e80 con 0x55a3ee2ce320 2024-09-13T06:11:43.696 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.691+0000 7fdbc9d8a640 1 --2- 172.21.15.194:0/3461044744 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55a3ee2ce320 0x55a3ee2d0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.696 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.691+0000 7fdbc9d8a640 1 --2- 172.21.15.194:0/3461044744 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55a3ee2ce320 0x55a3ee2d0710 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.697 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.695+0000 7fdbc9d8a640 1 -- 172.21.15.194:0/3461044744 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdbc000e620 con 0x55a3ee2ce320 2024-09-13T06:11:43.697 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.695+0000 7fdbcca7b980 1 Processor -- start 2024-09-13T06:11:43.697 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.695+0000 7fdbcca7b980 1 -- start start 2024-09-13T06:11:43.697 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.695+0000 7fdbcca7b980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a3ee2de8f0 0x55a3ee2ded10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.697 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.695+0000 7fdbcca7b980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55a3ee0d7800 con 0x55a3ee2de8f0 2024-09-13T06:11:43.697 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.695+0000 7fdbca58b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a3ee2de8f0 0x55a3ee2ded10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.697 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.695+0000 7fdbca58b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a3ee2de8f0 0x55a3ee2ded10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44628/0 (socket says 172.21.15.194:44628) 2024-09-13T06:11:43.698 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.695+0000 7fdbca58b640 1 -- 172.21.15.194:0/3457207628 learned_addr learned my addr 172.21.15.194:0/3457207628 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:43.698 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.695+0000 7fdbca58b640 1 -- 172.21.15.194:0/3457207628 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3ee2df250 con 0x55a3ee2de8f0 2024-09-13T06:11:43.699 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.695+0000 7fdbca58b640 1 --2- 172.21.15.194:0/3457207628 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a3ee2de8f0 0x55a3ee2ded10 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fdbc40e59f0 tx=0x7fdbc40c3710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.699 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.695+0000 7fdaaffff640 1 -- 172.21.15.194:0/3457207628 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbc40ec070 con 0x55a3ee2de8f0 2024-09-13T06:11:43.699 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.695+0000 7fdaaffff640 1 -- 172.21.15.194:0/3457207628 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbc40e4400 con 0x55a3ee2de8f0 2024-09-13T06:11:43.699 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.695+0000 7fdbcca7b980 1 -- 172.21.15.194:0/3457207628 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a3ee2df4e0 con 0x55a3ee2de8f0 2024-09-13T06:11:43.699 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.695+0000 7fdaaffff640 1 -- 172.21.15.194:0/3457207628 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbc40c2540 con 0x55a3ee2de8f0 2024-09-13T06:11:43.699 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.695+0000 7fdbcca7b980 1 -- 172.21.15.194:0/3457207628 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3ee2e2160 con 0x55a3ee2de8f0 2024-09-13T06:11:43.700 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.695+0000 7fdaaffff640 1 -- 172.21.15.194:0/3457207628 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fdbc40ef070 con 0x55a3ee2de8f0 2024-09-13T06:11:43.700 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.699+0000 7fdaaffff640 1 --2- 172.21.15.194:0/3457207628 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fdaa4034650 0x7fdaa4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.700 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.699+0000 7fdaaffff640 1 -- 172.21.15.194:0/3457207628 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fdbc40e3030 con 0x55a3ee2de8f0 2024-09-13T06:11:43.700 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.699+0000 7fdbc9d8a640 1 --2- 172.21.15.194:0/3457207628 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fdaa4034650 0x7fdaa4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.700 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.699+0000 7fdbcca7b980 1 Processor -- start 2024-09-13T06:11:43.701 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.699+0000 7fdbcca7b980 1 -- start start 2024-09-13T06:11:43.701 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.699+0000 7fdbcca7b980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a3ee2ef6f0 0x55a3ee2efaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.701 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.699+0000 7fdbcca7b980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55a3ee2ba180 con 0x55a3ee2ef6f0 2024-09-13T06:11:43.701 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.699+0000 7fdbc9d8a640 1 --2- 172.21.15.194:0/3457207628 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fdaa4034650 0x7fdaa4036b10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fdbc000bf60 tx=0x7fdbc000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.702 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.699+0000 7fdbca58b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a3ee2ef6f0 0x55a3ee2efaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.702 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.699+0000 7fdbca58b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a3ee2ef6f0 0x55a3ee2efaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44638/0 (socket says 172.21.15.194:44638) 2024-09-13T06:11:43.702 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.699+0000 7fdbca58b640 1 -- 172.21.15.194:0/3399042947 learned_addr learned my addr 172.21.15.194:0/3399042947 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:43.702 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.699+0000 7fdbca58b640 1 -- 172.21.15.194:0/3399042947 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3ee2f00c0 con 0x55a3ee2ef6f0 2024-09-13T06:11:43.702 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.699+0000 7fdbca58b640 1 --2- 172.21.15.194:0/3399042947 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a3ee2ef6f0 0x55a3ee2efaf0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fdbc40e1fd0 tx=0x7fdbc40ca000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=854ef1ac6e7f75a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.702 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.699+0000 7fdaadffb640 1 -- 172.21.15.194:0/3399042947 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbc4103070 con 0x55a3ee2ef6f0 2024-09-13T06:11:43.702 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.699+0000 7fdaadffb640 1 -- 172.21.15.194:0/3399042947 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbc40bcd60 con 0x55a3ee2ef6f0 2024-09-13T06:11:43.702 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.699+0000 7fdaadffb640 1 -- 172.21.15.194:0/3399042947 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbc40eb170 con 0x55a3ee2ef6f0 2024-09-13T06:11:43.704 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.699+0000 7fdbcca7b980 1 -- 172.21.15.194:0/3399042947 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a3ee2ef6f0 msgr2=0x55a3ee2efaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.704 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.699+0000 7fdbcca7b980 1 --2- 172.21.15.194:0/3399042947 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a3ee2ef6f0 0x55a3ee2efaf0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fdbc40e1fd0 tx=0x7fdbc40ca000 comp rx=0 tx=0).stop 2024-09-13T06:11:43.704 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.699+0000 7fdbcca7b980 1 -- 172.21.15.194:0/3399042947 shutdown_connections 2024-09-13T06:11:43.704 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.699+0000 7fdbcca7b980 1 --2- 172.21.15.194:0/3399042947 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a3ee2ef6f0 0x55a3ee2efaf0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.704 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.699+0000 7fdbcca7b980 1 -- 172.21.15.194:0/3399042947 >> 172.21.15.194:0/3399042947 conn(0x55a3ee2e7620 msgr2=0x55a3ee2e5720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:43.704 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.699+0000 7fdbcca7b980 1 -- 172.21.15.194:0/3399042947 shutdown_connections 2024-09-13T06:11:43.704 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.699+0000 7fdbcca7b980 1 -- 172.21.15.194:0/3399042947 wait complete. 2024-09-13T06:11:43.704 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.699+0000 7fdbcca7b980 1 Processor -- start 2024-09-13T06:11:43.704 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.699+0000 7fdbcca7b980 1 -- start start 2024-09-13T06:11:43.704 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.699+0000 7fdbcca7b980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a3ee2ef6f0 0x55a3ee2f67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.704 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.699+0000 7fdbcca7b980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55a3ee2f05c0 con 0x55a3ee2ef6f0 2024-09-13T06:11:43.704 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.699+0000 7fdbca58b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a3ee2ef6f0 0x55a3ee2f67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.705 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.699+0000 7fdbca58b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a3ee2ef6f0 0x55a3ee2f67c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44648/0 (socket says 172.21.15.194:44648) 2024-09-13T06:11:43.705 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.699+0000 7fdbca58b640 1 -- 172.21.15.194:0/1216843761 learned_addr learned my addr 172.21.15.194:0/1216843761 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:43.705 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.703+0000 7fdbca58b640 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3ee2f6d00 con 0x55a3ee2ef6f0 2024-09-13T06:11:43.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.703+0000 7fdbca58b640 1 --2- 172.21.15.194:0/1216843761 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a3ee2ef6f0 0x55a3ee2f67c0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fdbc40d0fd0 tx=0x7fdbc40acf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.703+0000 7fda9bfff640 1 -- 172.21.15.194:0/1216843761 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbc410c070 con 0x55a3ee2ef6f0 2024-09-13T06:11:43.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.703+0000 7fdbcca7b980 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a3ee2f6d00 con 0x55a3ee2ef6f0 2024-09-13T06:11:43.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.703+0000 7fda9bfff640 1 -- 172.21.15.194:0/1216843761 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbc40cd030 con 0x55a3ee2ef6f0 2024-09-13T06:11:43.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.703+0000 7fda9bfff640 1 -- 172.21.15.194:0/1216843761 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbc4103040 con 0x55a3ee2ef6f0 2024-09-13T06:11:43.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.703+0000 7fdbcca7b980 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3ee2f6d00 con 0x55a3ee2ef6f0 2024-09-13T06:11:43.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.703+0000 7fda9bfff640 1 -- 172.21.15.194:0/1216843761 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fdbc410f070 con 0x55a3ee2ef6f0 2024-09-13T06:11:43.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.703+0000 7fdbcca7b980 20 rados->read ofs=0 len=0 2024-09-13T06:11:43.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.703+0000 7fda9bfff640 1 --2- 172.21.15.194:0/1216843761 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fda94034650 0x7fda94036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.703+0000 7fda9bfff640 1 -- 172.21.15.194:0/1216843761 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fdbc4112d60 con 0x55a3ee2ef6f0 2024-09-13T06:11:43.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.703+0000 7fdbc9d8a640 1 --2- 172.21.15.194:0/1216843761 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fda94034650 0x7fda94036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.703+0000 7fdbcca7b980 1 --2- 172.21.15.194:0/1216843761 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55a3ee3018d0 0x55a3ee303d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.703+0000 7fdbcca7b980 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee3044e0 con 0x55a3ee3018d0 2024-09-13T06:11:43.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.703+0000 7fdbcad8c640 1 --2- 172.21.15.194:0/1216843761 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55a3ee3018d0 0x55a3ee303d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.710 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.703+0000 7fdbc9d8a640 1 --2- 172.21.15.194:0/1216843761 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fda94034650 0x7fda94036b10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x55a3ee2d1260 tx=0x7fdbc0010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.703+0000 7fdbcad8c640 1 --2- 172.21.15.194:0/1216843761 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55a3ee3018d0 0x55a3ee303d90 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.703+0000 7fdbcad8c640 1 -- 172.21.15.194:0/1216843761 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdbbc0083f0 con 0x55a3ee3018d0 2024-09-13T06:11:43.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.703+0000 7fdbcca7b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:43.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.703+0000 7fdbcca7b980 20 realm 2024-09-13T06:11:43.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.703+0000 7fdbcca7b980 20 rados->read ofs=0 len=0 2024-09-13T06:11:43.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.703+0000 7fdbcca7b980 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee3048f0 con 0x55a3ee3018d0 2024-09-13T06:11:43.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.703+0000 7fdbcad8c640 1 -- 172.21.15.194:0/1216843761 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdbbc0083f0 con 0x55a3ee3018d0 2024-09-13T06:11:43.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.703+0000 7fdbcca7b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:43.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.703+0000 7fdbcca7b980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:11:43.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.703+0000 7fdbcca7b980 20 rados->read ofs=0 len=0 2024-09-13T06:11:43.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.703+0000 7fdbcca7b980 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee305190 con 0x55a3ee3018d0 2024-09-13T06:11:43.712 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.703+0000 7fdbcad8c640 1 -- 172.21.15.194:0/1216843761 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdbbc0083f0 con 0x55a3ee3018d0 2024-09-13T06:11:43.712 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.703+0000 7fdbcca7b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:43.712 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.703+0000 7fdbcca7b980 20 rados->read ofs=0 len=0 2024-09-13T06:11:43.712 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.703+0000 7fdbcca7b980 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee305530 con 0x55a3ee3018d0 2024-09-13T06:11:43.712 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.707+0000 7fdbcad8c640 1 -- 172.21.15.194:0/1216843761 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdbbc0083f0 con 0x55a3ee3018d0 2024-09-13T06:11:43.712 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.707+0000 7fdbcca7b980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:11:43.712 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.707+0000 7fdbcca7b980 20 rados->read ofs=0 len=0 2024-09-13T06:11:43.712 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.707+0000 7fdbcca7b980 1 --2- 172.21.15.194:0/1216843761 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55a3ee306290 0x55a3ee308680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.712 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.707+0000 7fdbcca7b980 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee308c00 con 0x55a3ee306290 2024-09-13T06:11:43.712 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.707+0000 7fdbca58b640 1 --2- 172.21.15.194:0/1216843761 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55a3ee306290 0x55a3ee308680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.712 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.707+0000 7fdbca58b640 1 --2- 172.21.15.194:0/1216843761 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55a3ee306290 0x55a3ee308680 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.712 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.707+0000 7fdbca58b640 1 -- 172.21.15.194:0/1216843761 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fdbc4118070 con 0x55a3ee306290 2024-09-13T06:11:43.713 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.707+0000 7fdbcca7b980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:11:43.713 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.707+0000 7fdbcca7b980 20 searching for the correct realm 2024-09-13T06:11:43.713 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.707+0000 7fdbcca7b980 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee30a460 con 0x55a3ee306290 2024-09-13T06:11:43.713 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.707+0000 7fdbca58b640 1 -- 172.21.15.194:0/1216843761 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbc4118070 con 0x55a3ee306290 2024-09-13T06:11:43.713 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.707+0000 7fdbca58b640 1 --2- 172.21.15.194:0/1216843761 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fdbc4111070 0x7fdbc40db580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.713 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.707+0000 7fdbca58b640 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee30a460 con 0x7fdbc4111070 2024-09-13T06:11:43.713 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.707+0000 7fdbc9d8a640 1 --2- 172.21.15.194:0/1216843761 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fdbc4111070 0x7fdbc40db580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.713 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.707+0000 7fdbc9d8a640 1 --2- 172.21.15.194:0/1216843761 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fdbc4111070 0x7fdbc40db580 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.713 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.707+0000 7fdbc9d8a640 1 -- 172.21.15.194:0/1216843761 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fdbc000e620 con 0x7fdbc4111070 2024-09-13T06:11:43.713 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.707+0000 7fdbc9d8a640 1 --2- 172.21.15.194:0/1216843761 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fdbc0037040 0x7fdbc0036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.713 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.707+0000 7fdbc9d8a640 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee30a460 con 0x7fdbc0037040 2024-09-13T06:11:43.713 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.707+0000 7fdbcad8c640 1 --2- 172.21.15.194:0/1216843761 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fdbc0037040 0x7fdbc0036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.716 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.707+0000 7fdbcad8c640 1 --2- 172.21.15.194:0/1216843761 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fdbc0037040 0x7fdbc0036410 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.716 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.711+0000 7fdbcad8c640 1 -- 172.21.15.194:0/1216843761 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbbc0083f0 con 0x7fdbc0037040 2024-09-13T06:11:43.716 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.711+0000 7fdbcad8c640 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee305530 con 0x55a3ee3018d0 2024-09-13T06:11:43.716 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.711+0000 7fdbcad8c640 1 -- 172.21.15.194:0/1216843761 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbbc0083f0 con 0x55a3ee3018d0 2024-09-13T06:11:43.716 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.711+0000 7fdbcad8c640 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee305530 con 0x55a3ee3018d0 2024-09-13T06:11:43.716 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.711+0000 7fdbcad8c640 1 -- 172.21.15.194:0/1216843761 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbbc0083f0 con 0x55a3ee3018d0 2024-09-13T06:11:43.716 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.711+0000 7fdbcad8c640 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee305530 con 0x7fdbc0037040 2024-09-13T06:11:43.716 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.711+0000 7fdbcad8c640 1 -- 172.21.15.194:0/1216843761 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbbc0083f0 con 0x7fdbc0037040 2024-09-13T06:11:43.717 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.711+0000 7fdbcad8c640 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee305530 con 0x7fdbc0037040 2024-09-13T06:11:43.717 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.711+0000 7fdbcad8c640 1 -- 172.21.15.194:0/1216843761 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbbc0083f0 con 0x7fdbc0037040 2024-09-13T06:11:43.717 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.711+0000 7fdbcad8c640 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee305530 con 0x7fdbc4111070 2024-09-13T06:11:43.717 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.711+0000 7fdbc9d8a640 1 -- 172.21.15.194:0/1216843761 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbc000e620 con 0x7fdbc4111070 2024-09-13T06:11:43.717 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.711+0000 7fdbc9d8a640 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee305530 con 0x55a3ee306290 2024-09-13T06:11:43.717 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.711+0000 7fdbca58b640 1 -- 172.21.15.194:0/1216843761 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbc4118070 con 0x55a3ee306290 2024-09-13T06:11:43.717 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.711+0000 7fdbca58b640 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee305530 con 0x55a3ee3018d0 2024-09-13T06:11:43.717 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.711+0000 7fdbcad8c640 1 -- 172.21.15.194:0/1216843761 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbbc0083f0 con 0x55a3ee3018d0 2024-09-13T06:11:43.717 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.711+0000 7fdbcad8c640 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee305530 con 0x7fdbc0037040 2024-09-13T06:11:43.717 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.711+0000 7fdbcad8c640 1 -- 172.21.15.194:0/1216843761 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbbc0083f0 con 0x7fdbc0037040 2024-09-13T06:11:43.717 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.711+0000 7fdbcad8c640 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee305530 con 0x55a3ee3018d0 2024-09-13T06:11:43.717 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.715+0000 7fdbcad8c640 1 -- 172.21.15.194:0/1216843761 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbbc0083f0 con 0x55a3ee3018d0 2024-09-13T06:11:43.718 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.715+0000 7fdbcad8c640 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee305530 con 0x7fdbc4111070 2024-09-13T06:11:43.718 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.715+0000 7fdbc9d8a640 1 -- 172.21.15.194:0/1216843761 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fdbc000e620 con 0x7fdbc4111070 2024-09-13T06:11:43.718 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.715+0000 7fdbc9d8a640 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee305530 con 0x55a3ee306290 2024-09-13T06:11:43.720 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.715+0000 7fdbca58b640 1 -- 172.21.15.194:0/1216843761 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbc4118070 con 0x55a3ee306290 2024-09-13T06:11:43.720 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.715+0000 7fdbca58b640 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee305530 con 0x55a3ee306290 2024-09-13T06:11:43.720 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.715+0000 7fdbca58b640 1 -- 172.21.15.194:0/1216843761 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbc4118070 con 0x55a3ee306290 2024-09-13T06:11:43.720 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.715+0000 7fdbca58b640 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee305530 con 0x7fdbc0037040 2024-09-13T06:11:43.721 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.715+0000 7fdbcad8c640 1 -- 172.21.15.194:0/1216843761 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbbc0083f0 con 0x7fdbc0037040 2024-09-13T06:11:43.721 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.715+0000 7fdbcad8c640 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee305530 con 0x55a3ee306290 2024-09-13T06:11:43.721 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.715+0000 7fdbca58b640 1 -- 172.21.15.194:0/1216843761 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbc4118070 con 0x55a3ee306290 2024-09-13T06:11:43.721 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.715+0000 7fdbca58b640 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee305530 con 0x55a3ee306290 2024-09-13T06:11:43.721 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.715+0000 7fdbca58b640 1 -- 172.21.15.194:0/1216843761 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbc4118070 con 0x55a3ee306290 2024-09-13T06:11:43.721 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.715+0000 7fdbca58b640 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee305530 con 0x55a3ee3018d0 2024-09-13T06:11:43.721 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.715+0000 7fdbcad8c640 1 -- 172.21.15.194:0/1216843761 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbbc0083f0 con 0x55a3ee3018d0 2024-09-13T06:11:43.721 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.715+0000 7fdbcad8c640 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee305530 con 0x55a3ee3018d0 2024-09-13T06:11:43.721 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.715+0000 7fdbcad8c640 1 -- 172.21.15.194:0/1216843761 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fdbbc0083f0 con 0x55a3ee3018d0 2024-09-13T06:11:43.721 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.715+0000 7fdbcad8c640 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee305530 con 0x7fdbc4111070 2024-09-13T06:11:43.721 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.715+0000 7fdbc9d8a640 1 -- 172.21.15.194:0/1216843761 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbc000e620 con 0x7fdbc4111070 2024-09-13T06:11:43.721 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.715+0000 7fdbc9d8a640 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee305530 con 0x55a3ee306290 2024-09-13T06:11:43.722 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.715+0000 7fdbca58b640 1 -- 172.21.15.194:0/1216843761 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbc4118070 con 0x55a3ee306290 2024-09-13T06:11:43.722 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.715+0000 7fdbca58b640 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee305530 con 0x7fdbc4111070 2024-09-13T06:11:43.722 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.715+0000 7fdbc9d8a640 1 -- 172.21.15.194:0/1216843761 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbc000e620 con 0x7fdbc4111070 2024-09-13T06:11:43.722 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.715+0000 7fdbc9d8a640 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee305530 con 0x55a3ee3018d0 2024-09-13T06:11:43.722 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.719+0000 7fdbcad8c640 1 -- 172.21.15.194:0/1216843761 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbbc0083f0 con 0x55a3ee3018d0 2024-09-13T06:11:43.722 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.719+0000 7fdbcad8c640 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee305530 con 0x7fdbc0037040 2024-09-13T06:11:43.722 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.719+0000 7fdbcad8c640 1 -- 172.21.15.194:0/1216843761 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbbc0083f0 con 0x7fdbc0037040 2024-09-13T06:11:43.722 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.719+0000 7fdbcad8c640 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee305530 con 0x55a3ee306290 2024-09-13T06:11:43.726 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.719+0000 7fdbca58b640 1 -- 172.21.15.194:0/1216843761 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fdbc4118070 con 0x55a3ee306290 2024-09-13T06:11:43.726 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.719+0000 7fdbca58b640 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee305530 con 0x7fdbc4111070 2024-09-13T06:11:43.726 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.719+0000 7fdbc9d8a640 1 -- 172.21.15.194:0/1216843761 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbc000e620 con 0x7fdbc4111070 2024-09-13T06:11:43.726 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.719+0000 7fdbc9d8a640 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee305530 con 0x7fdbc4111070 2024-09-13T06:11:43.726 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.719+0000 7fdbc9d8a640 1 -- 172.21.15.194:0/1216843761 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbc000e620 con 0x7fdbc4111070 2024-09-13T06:11:43.726 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.719+0000 7fdbc9d8a640 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee305530 con 0x55a3ee306290 2024-09-13T06:11:43.727 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.719+0000 7fdbca58b640 1 -- 172.21.15.194:0/1216843761 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbc4118070 con 0x55a3ee306290 2024-09-13T06:11:43.727 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.719+0000 7fdbca58b640 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee305530 con 0x7fdbc0037040 2024-09-13T06:11:43.727 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.719+0000 7fdbcad8c640 1 -- 172.21.15.194:0/1216843761 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbbc0083f0 con 0x7fdbc0037040 2024-09-13T06:11:43.727 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.719+0000 7fdbcad8c640 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee305530 con 0x55a3ee3018d0 2024-09-13T06:11:43.727 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.719+0000 7fdbcad8c640 1 -- 172.21.15.194:0/1216843761 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fdbbc0083f0 con 0x55a3ee3018d0 2024-09-13T06:11:43.727 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.719+0000 7fdbcad8c640 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee305530 con 0x7fdbc4111070 2024-09-13T06:11:43.727 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.719+0000 7fdbc9d8a640 1 -- 172.21.15.194:0/1216843761 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbc000e620 con 0x7fdbc4111070 2024-09-13T06:11:43.727 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.719+0000 7fdbcca7b980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:11:43.727 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.719+0000 7fdbcca7b980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:11:43.727 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.719+0000 7fdbcca7b980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:11:43.727 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.719+0000 7fdbcca7b980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:11:43.727 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.719+0000 7fdbcca7b980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:11:43.727 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.719+0000 7fdbcca7b980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:11:43.728 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.719+0000 7fdbcca7b980 20 rados->read ofs=0 len=0 2024-09-13T06:11:43.728 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.719+0000 7fdbcca7b980 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee309550 con 0x55a3ee3018d0 2024-09-13T06:11:43.728 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.719+0000 7fdbcad8c640 1 -- 172.21.15.194:0/1216843761 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdbbc0083f0 con 0x55a3ee3018d0 2024-09-13T06:11:43.728 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.719+0000 7fdbcca7b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:43.728 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.719+0000 7fdbcca7b980 20 rados->read ofs=0 len=0 2024-09-13T06:11:43.728 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.719+0000 7fdbcca7b980 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee309df0 con 0x55a3ee3018d0 2024-09-13T06:11:43.728 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.719+0000 7fdbcad8c640 1 -- 172.21.15.194:0/1216843761 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdbbc0083f0 con 0x55a3ee3018d0 2024-09-13T06:11:43.728 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.723+0000 7fdbcca7b980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:11:43.728 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.723+0000 7fdbcca7b980 20 rados->read ofs=0 len=0 2024-09-13T06:11:43.728 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.723+0000 7fdbcca7b980 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee309190 con 0x7fdbc4111070 2024-09-13T06:11:43.728 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.723+0000 7fdbc9d8a640 1 -- 172.21.15.194:0/1216843761 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fdbc000e620 con 0x7fdbc4111070 2024-09-13T06:11:43.728 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.723+0000 7fdbcca7b980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:11:43.728 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.723+0000 7fdbcca7b980 20 zone default found 2024-09-13T06:11:43.729 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.723+0000 7fdbcca7b980 4 Realm: () 2024-09-13T06:11:43.729 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.723+0000 7fdbcca7b980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:11:43.729 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.723+0000 7fdbcca7b980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:11:43.729 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.723+0000 7fdbcca7b980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:11:43.729 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.723+0000 7fdbcca7b980 20 zonegroup default 2024-09-13T06:11:43.729 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.723+0000 7fdbcca7b980 20 rados->read ofs=0 len=0 2024-09-13T06:11:43.729 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.723+0000 7fdbcca7b980 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee309df0 con 0x7fdbc0037040 2024-09-13T06:11:43.729 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.723+0000 7fdbcad8c640 1 -- 172.21.15.194:0/1216843761 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdbbc0083f0 con 0x7fdbc0037040 2024-09-13T06:11:43.729 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.723+0000 7fdbcca7b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:43.729 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.723+0000 7fdbcca7b980 20 rados->read ofs=0 len=0 2024-09-13T06:11:43.729 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.723+0000 7fdbcca7b980 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee30c2f0 con 0x55a3ee306290 2024-09-13T06:11:43.729 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.723+0000 7fdbca58b640 1 -- 172.21.15.194:0/1216843761 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdbc4118070 con 0x55a3ee306290 2024-09-13T06:11:43.729 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.723+0000 7fdbcca7b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:43.730 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.723+0000 7fdbcca7b980 20 rados->read ofs=0 len=0 2024-09-13T06:11:43.730 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.723+0000 7fdbcca7b980 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee30c690 con 0x55a3ee306290 2024-09-13T06:11:43.730 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.723+0000 7fdbca58b640 1 -- 172.21.15.194:0/1216843761 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdbc4118070 con 0x55a3ee306290 2024-09-13T06:11:43.730 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.723+0000 7fdbcca7b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:43.730 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.723+0000 7fdbcca7b980 20 started sync module instance, tier type = 2024-09-13T06:11:43.730 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.723+0000 7fdbcca7b980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:11:43.730 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.723+0000 7fdbcca7b980 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee30b790 con 0x7fdbc4111070 2024-09-13T06:11:43.731 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.723+0000 7fdbc9d8a640 1 -- 172.21.15.194:0/1216843761 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(44 notify.0 [create] v35'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbc000e620 con 0x7fdbc4111070 2024-09-13T06:11:43.731 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.723+0000 7fdbcca7b980 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94162564201392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee30b3f0 con 0x7fdbc4111070 2024-09-13T06:11:43.731 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.723+0000 7fdbcca7b980 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee30d500 con 0x55a3ee3018d0 2024-09-13T06:11:43.731 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.727+0000 7fdbc9d8a640 1 -- 172.21.15.194:0/1216843761 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94162564201392] v35'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbc000e620 con 0x7fdbc4111070 2024-09-13T06:11:43.731 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.727+0000 7fdbcad8c640 1 -- 172.21.15.194:0/1216843761 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v35'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbbc0083f0 con 0x55a3ee3018d0 2024-09-13T06:11:43.731 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.727+0000 7fdbcca7b980 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94162564206672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee30d470 con 0x55a3ee3018d0 2024-09-13T06:11:43.731 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.727+0000 7fdbcca7b980 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee30e290 con 0x55a3ee306290 2024-09-13T06:11:43.731 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.727+0000 7fdbcad8c640 1 -- 172.21.15.194:0/1216843761 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94162564206672] v35'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbbc0083f0 con 0x55a3ee3018d0 2024-09-13T06:11:43.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.731+0000 7fdbca58b640 1 -- 172.21.15.194:0/1216843761 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v35'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbc4118070 con 0x55a3ee306290 2024-09-13T06:11:43.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.731+0000 7fdbcca7b980 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94162564208880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee30e680 con 0x55a3ee306290 2024-09-13T06:11:43.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.731+0000 7fdbcca7b980 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee30f040 con 0x7fdbc4111070 2024-09-13T06:11:43.733 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.731+0000 7fdbc9d8a640 1 -- 172.21.15.194:0/1216843761 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(50 notify.3 [create] v35'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbc000e620 con 0x7fdbc4111070 2024-09-13T06:11:43.733 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.731+0000 7fdbcca7b980 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94162564215776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee30fcb0 con 0x7fdbc4111070 2024-09-13T06:11:43.733 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.731+0000 7fdbcca7b980 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee310670 con 0x55a3ee3018d0 2024-09-13T06:11:43.734 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.731+0000 7fdbca58b640 1 -- 172.21.15.194:0/1216843761 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94162564208880] v35'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbc4118070 con 0x55a3ee306290 2024-09-13T06:11:43.734 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.731+0000 7fdbc9d8a640 1 -- 172.21.15.194:0/1216843761 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94162564215776] v35'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbc000e620 con 0x7fdbc4111070 2024-09-13T06:11:43.735 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.731+0000 7fdbcad8c640 1 -- 172.21.15.194:0/1216843761 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v35'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbbc0083f0 con 0x55a3ee3018d0 2024-09-13T06:11:43.735 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.731+0000 7fdbcca7b980 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94162564219328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee30fcb0 con 0x55a3ee3018d0 2024-09-13T06:11:43.735 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.731+0000 7fdbcca7b980 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee3105e0 con 0x7fdbc0037040 2024-09-13T06:11:43.737 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.735+0000 7fdbcad8c640 1 -- 172.21.15.194:0/1216843761 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94162564219328] v35'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbbc0083f0 con 0x55a3ee3018d0 2024-09-13T06:11:43.738 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.735+0000 7fdbcad8c640 1 -- 172.21.15.194:0/1216843761 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(54 notify.5 [create] v35'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbbc0083f0 con 0x7fdbc0037040 2024-09-13T06:11:43.738 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.735+0000 7fdbcca7b980 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94162564216832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee30fc20 con 0x7fdbc0037040 2024-09-13T06:11:43.738 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.735+0000 7fdbcca7b980 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee311350 con 0x7fdbc0037040 2024-09-13T06:11:43.740 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.739+0000 7fdbcad8c640 1 -- 172.21.15.194:0/1216843761 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94162564216832] v35'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbbc0083f0 con 0x7fdbc0037040 2024-09-13T06:11:43.740 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.739+0000 7fdbcad8c640 1 -- 172.21.15.194:0/1216843761 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(56 notify.6 [create] v35'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbbc0083f0 con 0x7fdbc0037040 2024-09-13T06:11:43.741 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.739+0000 7fdbcca7b980 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94162564221392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee311350 con 0x7fdbc0037040 2024-09-13T06:11:43.741 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.739+0000 7fdbcca7b980 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee311d50 con 0x7fdbc0037040 2024-09-13T06:11:43.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.739+0000 7fdbcad8c640 1 -- 172.21.15.194:0/1216843761 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(58 notify.7 [create] v35'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbbc0083f0 con 0x7fdbc0037040 2024-09-13T06:11:43.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.739+0000 7fdbcca7b980 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94162564225120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee312170 con 0x7fdbc0037040 2024-09-13T06:11:43.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.739+0000 7fdbcca7b980 20 add_watcher() i=0 2024-09-13T06:11:43.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.739+0000 7fdbcca7b980 20 add_watcher() i=1 2024-09-13T06:11:43.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.739+0000 7fdbcca7b980 20 add_watcher() i=2 2024-09-13T06:11:43.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.739+0000 7fdbcca7b980 20 add_watcher() i=3 2024-09-13T06:11:43.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.739+0000 7fdbcca7b980 20 add_watcher() i=4 2024-09-13T06:11:43.744 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.739+0000 7fdbcca7b980 20 add_watcher() i=5 2024-09-13T06:11:43.744 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.739+0000 7fdbcad8c640 1 -- 172.21.15.194:0/1216843761 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94162564221392] v35'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbbc0083f0 con 0x7fdbc0037040 2024-09-13T06:11:43.744 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.739+0000 7fdbcca7b980 20 add_watcher() i=6 2024-09-13T06:11:43.745 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.743+0000 7fdbcad8c640 1 -- 172.21.15.194:0/1216843761 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94162564225120] v35'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbbc0083f0 con 0x7fdbc0037040 2024-09-13T06:11:43.745 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.743+0000 7fdbcca7b980 20 add_watcher() i=7 2024-09-13T06:11:43.745 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.743+0000 7fdbcca7b980 2 all 8 watchers are set, enabling cache 2024-09-13T06:11:43.745 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.743+0000 7fdbcca7b980 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee310df0 con 0x55a3ee3018d0 2024-09-13T06:11:43.745 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.743+0000 7fdbcad8c640 1 -- 172.21.15.194:0/1216843761 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdbbc0083f0 con 0x55a3ee3018d0 2024-09-13T06:11:43.745 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.743+0000 7fdbcca7b980 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94162564222448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee312680 con 0x55a3ee3018d0 2024-09-13T06:11:43.747 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.743+0000 7fdbcad8c640 1 -- 172.21.15.194:0/1216843761 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94162564222448] v35'237 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdbbc0083f0 con 0x55a3ee3018d0 2024-09-13T06:11:43.747 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.743+0000 7fda80fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:11:43.747 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.743+0000 7fdbcca7b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:11:43.747 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.743+0000 7fdbcca7b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:11:43.747 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.743+0000 7fdbcca7b980 5 note: GC not initialized 2024-09-13T06:11:43.748 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.743+0000 7fd9fb7fe640 20 reqs_thread_entry: start 2024-09-13T06:11:43.748 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.743+0000 7fdbcca7b980 20 init_complete bucket index max shards: 11 2024-09-13T06:11:43.748 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.743+0000 7fdbcca7b980 20 Filter name: none 2024-09-13T06:11:43.748 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.743+0000 7fd9f97fa640 20 reqs_thread_entry: start 2024-09-13T06:11:43.748 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.743+0000 7fdbcca7b980 20 rados->read ofs=0 len=0 2024-09-13T06:11:43.748 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.743+0000 7fdbcca7b980 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee3383b0 con 0x55a3ee3018d0 2024-09-13T06:11:43.749 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.747+0000 7fdbcad8c640 1 -- 172.21.15.194:0/1216843761 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fdbbc0083f0 con 0x55a3ee3018d0 2024-09-13T06:11:43.749 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.747+0000 7fdbcca7b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:43.749 INFO:teuthology.orchestra.run.smithi194.stderr:could not fetch user info: no user info saved 2024-09-13T06:11:43.749 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.747+0000 7fda80fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:11:43.749 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.747+0000 7fdbcca7b980 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94162564222448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee338370 con 0x55a3ee3018d0 2024-09-13T06:11:43.750 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.747+0000 7fdbcad8c640 1 -- 172.21.15.194:0/1216843761 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94162564222448] v35'238 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdbbc0083f0 con 0x55a3ee3018d0 2024-09-13T06:11:43.750 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.747+0000 7fdbcca7b980 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94162564201392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee338370 con 0x7fdbc4111070 2024-09-13T06:11:43.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.747+0000 7fdbc9d8a640 1 -- 172.21.15.194:0/1216843761 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94162564201392] v35'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbc000e620 con 0x7fdbc4111070 2024-09-13T06:11:43.752 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.747+0000 7fdbcca7b980 20 remove_watcher() i=0 2024-09-13T06:11:43.752 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.747+0000 7fdbcca7b980 2 removed watcher, disabling cache 2024-09-13T06:11:43.752 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.747+0000 7fdbcca7b980 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94162564206672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee338370 con 0x55a3ee3018d0 2024-09-13T06:11:43.754 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.751+0000 7fdbcad8c640 1 -- 172.21.15.194:0/1216843761 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94162564206672] v35'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbbc0083f0 con 0x55a3ee3018d0 2024-09-13T06:11:43.754 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.751+0000 7fdbcca7b980 20 remove_watcher() i=1 2024-09-13T06:11:43.754 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.751+0000 7fdbcca7b980 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94162564208880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee338370 con 0x55a3ee306290 2024-09-13T06:11:43.756 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.755+0000 7fdbca58b640 1 -- 172.21.15.194:0/1216843761 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94162564208880] v35'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbc4118070 con 0x55a3ee306290 2024-09-13T06:11:43.756 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.755+0000 7fdbcca7b980 20 remove_watcher() i=2 2024-09-13T06:11:43.756 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.755+0000 7fdbcca7b980 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94162564215776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee338370 con 0x7fdbc4111070 2024-09-13T06:11:43.757 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.755+0000 7fdbc9d8a640 1 -- 172.21.15.194:0/1216843761 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94162564215776] v35'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbc000e620 con 0x7fdbc4111070 2024-09-13T06:11:43.757 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.755+0000 7fdbcca7b980 20 remove_watcher() i=3 2024-09-13T06:11:43.757 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.755+0000 7fdbcca7b980 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94162564219328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee338370 con 0x55a3ee3018d0 2024-09-13T06:11:43.759 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.755+0000 7fdbcad8c640 1 -- 172.21.15.194:0/1216843761 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94162564219328] v35'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbbc0083f0 con 0x55a3ee3018d0 2024-09-13T06:11:43.759 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.755+0000 7fdbcca7b980 20 remove_watcher() i=4 2024-09-13T06:11:43.759 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.755+0000 7fdbcca7b980 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94162564216832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee338370 con 0x7fdbc0037040 2024-09-13T06:11:43.761 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.759+0000 7fdbcad8c640 1 -- 172.21.15.194:0/1216843761 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94162564216832] v35'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbbc0083f0 con 0x7fdbc0037040 2024-09-13T06:11:43.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.759+0000 7fdbcca7b980 20 remove_watcher() i=5 2024-09-13T06:11:43.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.759+0000 7fdbcca7b980 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94162564221392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee338370 con 0x7fdbc0037040 2024-09-13T06:11:43.764 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.763+0000 7fdbcad8c640 1 -- 172.21.15.194:0/1216843761 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94162564221392] v35'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbbc0083f0 con 0x7fdbc0037040 2024-09-13T06:11:43.764 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.763+0000 7fdbcca7b980 20 remove_watcher() i=6 2024-09-13T06:11:43.764 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.763+0000 7fdbcca7b980 1 -- 172.21.15.194:0/1216843761 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94162564225120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a3ee338370 con 0x7fdbc0037040 2024-09-13T06:11:43.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.763+0000 7fdbcad8c640 1 -- 172.21.15.194:0/1216843761 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94162564225120] v35'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbbc0083f0 con 0x7fdbc0037040 2024-09-13T06:11:43.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.763+0000 7fdbcca7b980 20 remove_watcher() i=7 2024-09-13T06:11:43.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.763+0000 7fdbcca7b980 1 -- 172.21.15.194:0/1216843761 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fdbc0037040 msgr2=0x7fdbc0036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.763+0000 7fdbcca7b980 1 --2- 172.21.15.194:0/1216843761 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fdbc0037040 0x7fdbc0036410 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.763+0000 7fdbcca7b980 1 -- 172.21.15.194:0/1216843761 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55a3ee3018d0 msgr2=0x55a3ee303d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.763+0000 7fdbcca7b980 1 --2- 172.21.15.194:0/1216843761 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55a3ee3018d0 0x55a3ee303d90 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.763+0000 7fdbcca7b980 1 -- 172.21.15.194:0/1216843761 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fdbc4111070 msgr2=0x7fdbc40db580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.763+0000 7fdbcca7b980 1 --2- 172.21.15.194:0/1216843761 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fdbc4111070 0x7fdbc40db580 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.763+0000 7fdbcca7b980 1 -- 172.21.15.194:0/1216843761 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55a3ee306290 msgr2=0x55a3ee308680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.763+0000 7fdbcca7b980 1 --2- 172.21.15.194:0/1216843761 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55a3ee306290 0x55a3ee308680 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.763+0000 7fdbcca7b980 1 -- 172.21.15.194:0/1216843761 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fda94034650 msgr2=0x7fda94036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.763+0000 7fdbcca7b980 1 --2- 172.21.15.194:0/1216843761 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fda94034650 0x7fda94036b10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x55a3ee2d1260 tx=0x7fdbc0010000 comp rx=0 tx=0).stop 2024-09-13T06:11:43.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.763+0000 7fdbcca7b980 1 -- 172.21.15.194:0/1216843761 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a3ee2ef6f0 msgr2=0x55a3ee2f67c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.763+0000 7fdbcca7b980 1 --2- 172.21.15.194:0/1216843761 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a3ee2ef6f0 0x55a3ee2f67c0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fdbc40d0fd0 tx=0x7fdbc40acf90 comp rx=0 tx=0).stop 2024-09-13T06:11:43.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.763+0000 7fdbcad8c640 1 -- 172.21.15.194:0/1216843761 reap_dead start 2024-09-13T06:11:43.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.763+0000 7fdbcad8c640 1 -- 172.21.15.194:0/1216843761 reap_dead start 2024-09-13T06:11:43.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.763+0000 7fdbcca7b980 1 -- 172.21.15.194:0/1216843761 shutdown_connections 2024-09-13T06:11:43.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.763+0000 7fdbcca7b980 1 -- 172.21.15.194:0/1216843761 >> 172.21.15.194:0/1216843761 conn(0x55a3ee2e7620 msgr2=0x55a3ee2e56f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:43.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.763+0000 7fdbcca7b980 1 -- 172.21.15.194:0/1216843761 shutdown_connections 2024-09-13T06:11:43.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.763+0000 7fdbcca7b980 1 -- 172.21.15.194:0/1216843761 wait complete. 2024-09-13T06:11:43.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.763+0000 7fdbcca7b980 1 -- 172.21.15.194:0/3457207628 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fdaa4034650 msgr2=0x7fdaa4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.763+0000 7fdbcca7b980 1 --2- 172.21.15.194:0/3457207628 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fdaa4034650 0x7fdaa4036b10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fdbc000bf60 tx=0x7fdbc000f000 comp rx=0 tx=0).stop 2024-09-13T06:11:43.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.763+0000 7fdbcca7b980 1 -- 172.21.15.194:0/3457207628 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a3ee2de8f0 msgr2=0x55a3ee2ded10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.763+0000 7fdbcca7b980 1 --2- 172.21.15.194:0/3457207628 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a3ee2de8f0 0x55a3ee2ded10 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fdbc40e59f0 tx=0x7fdbc40c3710 comp rx=0 tx=0).stop 2024-09-13T06:11:43.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.763+0000 7fdbcca7b980 1 -- 172.21.15.194:0/3457207628 shutdown_connections 2024-09-13T06:11:43.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.763+0000 7fdbcca7b980 1 --2- 172.21.15.194:0/3457207628 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fdaa4034650 0x7fdaa4036b10 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.763+0000 7fdbcca7b980 1 --2- 172.21.15.194:0/3457207628 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a3ee2de8f0 0x55a3ee2ded10 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.763+0000 7fdbcca7b980 1 -- 172.21.15.194:0/3457207628 >> 172.21.15.194:0/3457207628 conn(0x55a3ee2d3a40 msgr2=0x55a3ee2d64c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:43.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.763+0000 7fdbcca7b980 1 -- 172.21.15.194:0/3457207628 shutdown_connections 2024-09-13T06:11:43.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.763+0000 7fdbcca7b980 1 -- 172.21.15.194:0/3457207628 wait complete. 2024-09-13T06:11:43.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.763+0000 7fdbcca7b980 1 -- 172.21.15.194:0/3461044744 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55a3ee1cfe90 msgr2=0x55a3ee2c7ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.763+0000 7fdbcca7b980 1 --2- 172.21.15.194:0/3461044744 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55a3ee1cfe90 0x55a3ee2c7ab0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.763+0000 7fdbcca7b980 1 -- 172.21.15.194:0/3461044744 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55a3ee2ce320 msgr2=0x55a3ee2d0710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.763+0000 7fdbcca7b980 1 --2- 172.21.15.194:0/3461044744 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55a3ee2ce320 0x55a3ee2d0710 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.763+0000 7fdbcca7b980 1 -- 172.21.15.194:0/3461044744 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55a3ee2ca420 msgr2=0x55a3ee2cc810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.763+0000 7fdbcca7b980 1 --2- 172.21.15.194:0/3461044744 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55a3ee2ca420 0x55a3ee2cc810 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.767+0000 7fdbcca7b980 1 -- 172.21.15.194:0/3461044744 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fdab00346a0 msgr2=0x7fdab0036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.767+0000 7fdbcca7b980 1 --2- 172.21.15.194:0/3461044744 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fdab00346a0 0x7fdab0036b60 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fdbc0000f70 tx=0x7fdbc00012c0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.767+0000 7fdbcca7b980 1 -- 172.21.15.194:0/3461044744 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a3ee1cf540 msgr2=0x55a3ee2c0b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.767+0000 7fdbcca7b980 1 --2- 172.21.15.194:0/3461044744 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a3ee1cf540 0x55a3ee2c0b20 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fdbc40bb040 tx=0x7fdbc401a460 comp rx=0 tx=0).stop 2024-09-13T06:11:43.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.767+0000 7fdbcad8c640 1 -- 172.21.15.194:0/3461044744 reap_dead start 2024-09-13T06:11:43.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.767+0000 7fdbcca7b980 1 -- 172.21.15.194:0/3461044744 shutdown_connections 2024-09-13T06:11:43.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.767+0000 7fdbcca7b980 1 -- 172.21.15.194:0/3461044744 >> 172.21.15.194:0/3461044744 conn(0x55a3ee1cb060 msgr2=0x55a3ee2b40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:43.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.767+0000 7fdbcca7b980 1 -- 172.21.15.194:0/3461044744 shutdown_connections 2024-09-13T06:11:43.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.767+0000 7fdbcca7b980 1 -- 172.21.15.194:0/3461044744 wait complete. 2024-09-13T06:11:43.779 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-13T06:11:43.779 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get', '--rgw-zone', 'default'] 2024-09-13T06:11:43.780 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get', '--rgw-zone', 'default'] 2024-09-13T06:11:43.780 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get --rgw-zone default 2024-09-13T06:11:43.855 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:11:43.855 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:11:43.856 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.855+0000 7f3489ff3980 1 Processor -- start 2024-09-13T06:11:43.857 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.855+0000 7f3489ff3980 1 -- start start 2024-09-13T06:11:43.857 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.855+0000 7f3489ff3980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x5634d91e0b40 0x5634d91e2f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.857 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.855+0000 7f3489ff3980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5634d906aae0 con 0x5634d91e3470 2024-09-13T06:11:43.857 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.855+0000 7f3489ff3980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x5634d908ee30 con 0x5634d91e0b40 2024-09-13T06:11:43.857 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.855+0000 7f3487b03640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x5634d91e0b40 0x5634d91e2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.855+0000 7f3487302640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x5634d91e3470 0x5634d91ea010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:58324/0 (socket says 172.21.15.194:58324) 2024-09-13T06:11:43.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.855+0000 7f3487302640 1 -- 172.21.15.194:0/3385917969 learned_addr learned my addr 172.21.15.194:0/3385917969 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-09-13T06:11:43.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.855+0000 7f3486b01640 1 -- 172.21.15.194:0/3385917969 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1002881569 0 0) 0x5634d906aae0 con 0x5634d91e3470 2024-09-13T06:11:43.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.855+0000 7f3486b01640 1 -- 172.21.15.194:0/3385917969 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3470001e20 con 0x5634d91e3470 2024-09-13T06:11:43.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.855+0000 7f3487b03640 1 -- 172.21.15.194:0/3385917969 >> v1:172.21.15.120:6789/0 conn(0x5634d91e3470 legacy=0x5634d91ea010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.855+0000 7f3487b03640 1 -- 172.21.15.194:0/3385917969 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634d91e3910 con 0x5634d91e0b40 2024-09-13T06:11:43.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.859+0000 7f3487b03640 1 --2- 172.21.15.194:0/3385917969 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634d91e0b40 0x5634d91e2f30 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f347800a480 tx=0x7f347801b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9168632c73252e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.859+0000 7f3486b01640 1 -- 172.21.15.194:0/3385917969 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34780aa570 con 0x5634d91e0b40 2024-09-13T06:11:43.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.859+0000 7f3486b01640 1 -- 172.21.15.194:0/3385917969 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34780af070 con 0x5634d91e0b40 2024-09-13T06:11:43.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.859+0000 7f3486b01640 1 -- 172.21.15.194:0/3385917969 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34780aa840 con 0x5634d91e0b40 2024-09-13T06:11:43.861 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.859+0000 7f3489ff3980 1 -- 172.21.15.194:0/3385917969 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634d91e0b40 msgr2=0x5634d91e2f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.861 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.859+0000 7f3489ff3980 1 --2- 172.21.15.194:0/3385917969 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634d91e0b40 0x5634d91e2f30 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f347800a480 tx=0x7f347801b310 comp rx=0 tx=0).stop 2024-09-13T06:11:43.861 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.859+0000 7f3489ff3980 1 -- 172.21.15.194:0/3385917969 shutdown_connections 2024-09-13T06:11:43.861 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.859+0000 7f3489ff3980 1 --2- 172.21.15.194:0/3385917969 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634d91e0b40 0x5634d91e2f30 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.861 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.859+0000 7f3489ff3980 1 -- 172.21.15.194:0/3385917969 >> 172.21.15.194:0/3385917969 conn(0x5634d91dc7e0 msgr2=0x5634d91dec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:43.861 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.859+0000 7f3489ff3980 1 -- 172.21.15.194:0/3385917969 shutdown_connections 2024-09-13T06:11:43.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.859+0000 7f3489ff3980 1 -- 172.21.15.194:0/3385917969 wait complete. 2024-09-13T06:11:43.877 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.875+0000 7f3489ff3980 1 Processor -- start 2024-09-13T06:11:43.877 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.875+0000 7f3489ff3980 1 -- start start 2024-09-13T06:11:43.877 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.875+0000 7f3489ff3980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634d91e0b40 0x5634d92cfa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.877 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.875+0000 7f3489ff3980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5634d9090200 con 0x5634d91e0b40 2024-09-13T06:11:43.878 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.875+0000 7f3487b03640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634d91e0b40 0x5634d92cfa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.878 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.875+0000 7f3487b03640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634d91e0b40 0x5634d92cfa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44664/0 (socket says 172.21.15.194:44664) 2024-09-13T06:11:43.878 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.875+0000 7f3487b03640 1 -- 172.21.15.194:0/3442330972 learned_addr learned my addr 172.21.15.194:0/3442330972 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:43.878 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.875+0000 7f3487b03640 1 -- 172.21.15.194:0/3442330972 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634d92d0050 con 0x5634d91e0b40 2024-09-13T06:11:43.878 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.875+0000 7f3487b03640 1 --2- 172.21.15.194:0/3442330972 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634d91e0b40 0x5634d92cfa80 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f34780199c0 tx=0x7f3478003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcbd1932d2913088 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.878 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.875+0000 7f3375e0b640 1 -- 172.21.15.194:0/3442330972 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34780aa920 con 0x5634d91e0b40 2024-09-13T06:11:43.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.879+0000 7f3375e0b640 1 -- 172.21.15.194:0/3442330972 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34780aaac0 con 0x5634d91e0b40 2024-09-13T06:11:43.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.879+0000 7f3375e0b640 1 -- 172.21.15.194:0/3442330972 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34780aadc0 con 0x5634d91e0b40 2024-09-13T06:11:43.883 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.879+0000 7f3489ff3980 1 -- 172.21.15.194:0/3442330972 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634d91e0b40 msgr2=0x5634d92cfa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.883 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.879+0000 7f3489ff3980 1 --2- 172.21.15.194:0/3442330972 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634d91e0b40 0x5634d92cfa80 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f34780199c0 tx=0x7f3478003030 comp rx=0 tx=0).stop 2024-09-13T06:11:43.884 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.879+0000 7f3489ff3980 1 -- 172.21.15.194:0/3442330972 shutdown_connections 2024-09-13T06:11:43.884 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.879+0000 7f3489ff3980 1 --2- 172.21.15.194:0/3442330972 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634d91e0b40 0x5634d92cfa80 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.884 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.879+0000 7f3489ff3980 1 -- 172.21.15.194:0/3442330972 >> 172.21.15.194:0/3442330972 conn(0x5634d91dc7e0 msgr2=0x5634d92cb6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:43.884 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.879+0000 7f3489ff3980 1 -- 172.21.15.194:0/3442330972 shutdown_connections 2024-09-13T06:11:43.884 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.879+0000 7f3489ff3980 1 -- 172.21.15.194:0/3442330972 wait complete. 2024-09-13T06:11:43.884 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.879+0000 7f3489ff3980 1 Processor -- start 2024-09-13T06:11:43.884 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.879+0000 7f3489ff3980 1 -- start start 2024-09-13T06:11:43.884 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.883+0000 7f3489ff3980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634d91e0b40 0x5634d92d6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.884 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.883+0000 7f3489ff3980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5634d91ee220 con 0x5634d91e0b40 2024-09-13T06:11:43.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.883+0000 7f3487b03640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634d91e0b40 0x5634d92d6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.883+0000 7f3487b03640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634d91e0b40 0x5634d92d6de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44678/0 (socket says 172.21.15.194:44678) 2024-09-13T06:11:43.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.883+0000 7f3487b03640 1 -- 172.21.15.194:0/2004001548 learned_addr learned my addr 172.21.15.194:0/2004001548 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:43.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.883+0000 7f3487b03640 1 -- 172.21.15.194:0/2004001548 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634d92d7320 con 0x5634d91e0b40 2024-09-13T06:11:43.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.883+0000 7f3487b03640 1 --2- 172.21.15.194:0/2004001548 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634d91e0b40 0x5634d92d6de0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f34780199c0 tx=0x7f34780180b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.883+0000 7f336ffff640 1 -- 172.21.15.194:0/2004001548 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34780cd020 con 0x5634d91e0b40 2024-09-13T06:11:43.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.883+0000 7f336ffff640 1 -- 172.21.15.194:0/2004001548 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34780bf730 con 0x5634d91e0b40 2024-09-13T06:11:43.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.883+0000 7f3489ff3980 1 -- 172.21.15.194:0/2004001548 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5634d92d75b0 con 0x5634d91e0b40 2024-09-13T06:11:43.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.883+0000 7f336ffff640 1 -- 172.21.15.194:0/2004001548 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34780c3040 con 0x5634d91e0b40 2024-09-13T06:11:43.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.883+0000 7f3489ff3980 1 -- 172.21.15.194:0/2004001548 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634d92da290 con 0x5634d91e0b40 2024-09-13T06:11:43.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.883+0000 7f3489ff3980 1 Processor -- start 2024-09-13T06:11:43.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.883+0000 7f3489ff3980 1 -- start start 2024-09-13T06:11:43.889 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.883+0000 7f3489ff3980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634d92e3b30 0x5634d92e3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.889 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.883+0000 7f3489ff3980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5634d90e9800 con 0x5634d92e3b30 2024-09-13T06:11:43.890 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.883+0000 7f336ffff640 1 -- 172.21.15.194:0/2004001548 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f34780d0020 con 0x5634d91e0b40 2024-09-13T06:11:43.890 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.883+0000 7f3488304640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634d92e3b30 0x5634d92e3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.890 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.883+0000 7f3488304640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634d92e3b30 0x5634d92e3f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44686/0 (socket says 172.21.15.194:44686) 2024-09-13T06:11:43.890 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.883+0000 7f3488304640 1 -- 172.21.15.194:0/2242459983 learned_addr learned my addr 172.21.15.194:0/2242459983 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:43.890 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.883+0000 7f336ffff640 1 --2- 172.21.15.194:0/2004001548 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3370034650 0x7f3370036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.890 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.883+0000 7f336ffff640 1 -- 172.21.15.194:0/2004001548 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f34780d3570 con 0x5634d91e0b40 2024-09-13T06:11:43.890 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.883+0000 7f3487b03640 1 --2- 172.21.15.194:0/2004001548 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3370034650 0x7f3370036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.890 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.883+0000 7f3488304640 1 -- 172.21.15.194:0/2242459983 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634d92e4470 con 0x5634d92e3b30 2024-09-13T06:11:43.890 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.883+0000 7f3487b03640 1 --2- 172.21.15.194:0/2004001548 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3370034650 0x7f3370036b10 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f34780bfd60 tx=0x7f34780bfcd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.890 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.883+0000 7f3488304640 1 --2- 172.21.15.194:0/2242459983 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634d92e3b30 0x5634d92e3f30 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f348000a430 tx=0x7f348000a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68b181ad98acf849 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.890 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.887+0000 7f336dffb640 1 -- 172.21.15.194:0/2242459983 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f348000f6e0 con 0x5634d92e3b30 2024-09-13T06:11:43.890 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.887+0000 7f336dffb640 1 -- 172.21.15.194:0/2242459983 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3480015070 con 0x5634d92e3b30 2024-09-13T06:11:43.891 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.887+0000 7f336dffb640 1 -- 172.21.15.194:0/2242459983 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f348000fa10 con 0x5634d92e3b30 2024-09-13T06:11:43.891 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.887+0000 7f3489ff3980 1 -- 172.21.15.194:0/2242459983 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634d92e3b30 msgr2=0x5634d92e3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.891 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.887+0000 7f3489ff3980 1 --2- 172.21.15.194:0/2242459983 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634d92e3b30 0x5634d92e3f30 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f348000a430 tx=0x7f348000a8f0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.891 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.887+0000 7f3489ff3980 1 -- 172.21.15.194:0/2242459983 shutdown_connections 2024-09-13T06:11:43.891 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.887+0000 7f3489ff3980 1 --2- 172.21.15.194:0/2242459983 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634d92e3b30 0x5634d92e3f30 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.891 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.887+0000 7f3489ff3980 1 -- 172.21.15.194:0/2242459983 >> 172.21.15.194:0/2242459983 conn(0x5634d91e3470 msgr2=0x5634d92df440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:43.891 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.887+0000 7f3489ff3980 1 -- 172.21.15.194:0/2242459983 shutdown_connections 2024-09-13T06:11:43.891 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.887+0000 7f3489ff3980 1 -- 172.21.15.194:0/2242459983 wait complete. 2024-09-13T06:11:43.891 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.887+0000 7f3489ff3980 1 Processor -- start 2024-09-13T06:11:43.891 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.887+0000 7f3489ff3980 1 -- start start 2024-09-13T06:11:43.891 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.887+0000 7f3489ff3980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634d92e3b30 0x5634d92eaf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.891 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.887+0000 7f3489ff3980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5634d92e4700 con 0x5634d92e3b30 2024-09-13T06:11:43.891 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.887+0000 7f3488304640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634d92e3b30 0x5634d92eaf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.891 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.887+0000 7f3488304640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634d92e3b30 0x5634d92eaf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44690/0 (socket says 172.21.15.194:44690) 2024-09-13T06:11:43.892 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.887+0000 7f3488304640 1 -- 172.21.15.194:0/4169903103 learned_addr learned my addr 172.21.15.194:0/4169903103 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:43.892 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.887+0000 7f3488304640 1 -- 172.21.15.194:0/4169903103 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634d92eb4b0 con 0x5634d92e3b30 2024-09-13T06:11:43.894 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.887+0000 7f3488304640 1 --2- 172.21.15.194:0/4169903103 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634d92e3b30 0x5634d92eaf70 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f348000a930 tx=0x7f3480003380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.894 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.887+0000 7f3367fff640 1 -- 172.21.15.194:0/4169903103 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3480005a50 con 0x5634d92e3b30 2024-09-13T06:11:43.894 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.887+0000 7f3489ff3980 1 -- 172.21.15.194:0/4169903103 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5634d92eb740 con 0x5634d92e3b30 2024-09-13T06:11:43.894 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.887+0000 7f3367fff640 1 -- 172.21.15.194:0/4169903103 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34800109a0 con 0x5634d92e3b30 2024-09-13T06:11:43.894 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.887+0000 7f3367fff640 1 -- 172.21.15.194:0/4169903103 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3480010cc0 con 0x5634d92e3b30 2024-09-13T06:11:43.894 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.887+0000 7f3489ff3980 1 -- 172.21.15.194:0/4169903103 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634d92ee420 con 0x5634d92e3b30 2024-09-13T06:11:43.894 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.891+0000 7f3367fff640 1 -- 172.21.15.194:0/4169903103 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f348001a480 con 0x5634d92e3b30 2024-09-13T06:11:43.894 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.891+0000 7f3489ff3980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:11:43.894 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.891+0000 7f3489ff3980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:11:43.894 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.891+0000 7f3367fff640 1 --2- 172.21.15.194:0/4169903103 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3360034650 0x7f3360036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.894 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.891+0000 7f3367fff640 1 -- 172.21.15.194:0/4169903103 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f348004a520 con 0x5634d92e3b30 2024-09-13T06:11:43.894 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.891+0000 7f3489ff3980 1 Processor -- start 2024-09-13T06:11:43.894 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.891+0000 7f3488304640 1 --2- 172.21.15.194:0/4169903103 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3360034650 0x7f3360036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.895 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.891+0000 7f3489ff3980 1 -- start start 2024-09-13T06:11:43.895 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.891+0000 7f3489ff3980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634d9304720 0x5634d9304b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.895 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.891+0000 7f3489ff3980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5634d92d0370 con 0x5634d9304720 2024-09-13T06:11:43.895 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.891+0000 7f3488304640 1 --2- 172.21.15.194:0/4169903103 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3360034650 0x7f3360036b10 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3480005c30 tx=0x7f348001bf50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.895 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.891+0000 7f3487b03640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634d9304720 0x5634d9304b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.895 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.891+0000 7f3487b03640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634d9304720 0x5634d9304b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44706/0 (socket says 172.21.15.194:44706) 2024-09-13T06:11:43.895 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.891+0000 7f3487b03640 1 -- 172.21.15.194:0/805621137 learned_addr learned my addr 172.21.15.194:0/805621137 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:43.895 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.891+0000 7f3487b03640 1 -- 172.21.15.194:0/805621137 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634d9305110 con 0x5634d9304720 2024-09-13T06:11:43.895 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.891+0000 7f3487b03640 1 --2- 172.21.15.194:0/805621137 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634d9304720 0x5634d9304b40 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f34780aaa90 tx=0x7f34780d3c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.897 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.891+0000 7f32cffff640 1 -- 172.21.15.194:0/805621137 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34780bd9a0 con 0x5634d9304720 2024-09-13T06:11:43.897 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.891+0000 7f32cffff640 1 -- 172.21.15.194:0/805621137 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34780b4630 con 0x5634d9304720 2024-09-13T06:11:43.897 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.891+0000 7f3489ff3980 1 -- 172.21.15.194:0/805621137 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5634d9307d90 con 0x5634d9304720 2024-09-13T06:11:43.897 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.891+0000 7f32cffff640 1 -- 172.21.15.194:0/805621137 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34780b4910 con 0x5634d9304720 2024-09-13T06:11:43.898 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.891+0000 7f3489ff3980 1 -- 172.21.15.194:0/805621137 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634d9308140 con 0x5634d9304720 2024-09-13T06:11:43.898 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.891+0000 7f32cffff640 1 -- 172.21.15.194:0/805621137 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f34780b4ab0 con 0x5634d9304720 2024-09-13T06:11:43.898 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.891+0000 7f32cffff640 1 --2- 172.21.15.194:0/805621137 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f32c0034650 0x7f32c0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.898 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.891+0000 7f32cffff640 1 -- 172.21.15.194:0/805621137 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f34780e2030 con 0x5634d9304720 2024-09-13T06:11:43.898 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.891+0000 7f3487302640 1 --2- 172.21.15.194:0/805621137 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f32c0034650 0x7f32c0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.898 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.895+0000 7f32cdffb640 20 reqs_thread_entry: start 2024-09-13T06:11:43.898 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.895+0000 7f3489ff3980 1 --2- 172.21.15.194:0/2004001548 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5634d930a300 0x5634d930c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.898 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.895+0000 7f3489ff3980 1 -- 172.21.15.194:0/2004001548 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5634d930ce00 con 0x5634d930a300 2024-09-13T06:11:43.898 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.895+0000 7f3487302640 1 --2- 172.21.15.194:0/805621137 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f32c0034650 0x7f32c0036b10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x5634d92dffe0 tx=0x7f347c0012e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.898 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.895+0000 7f3488304640 1 --2- 172.21.15.194:0/2004001548 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5634d930a300 0x5634d930c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.898 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.895+0000 7f3488304640 1 --2- 172.21.15.194:0/2004001548 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5634d930a300 0x5634d930c730 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.898 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.895+0000 7f3488304640 1 -- 172.21.15.194:0/2004001548 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f348000e070 con 0x5634d930a300 2024-09-13T06:11:43.898 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.895+0000 7f3489ff3980 1 --2- 172.21.15.194:0/2004001548 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5634d930ebd0 0x5634d9310fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.899 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.895+0000 7f3489ff3980 1 -- 172.21.15.194:0/2004001548 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:2 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5634d9311660 con 0x5634d930ebd0 2024-09-13T06:11:43.899 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.895+0000 7f3487b03640 1 --2- 172.21.15.194:0/2004001548 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5634d930ebd0 0x5634d9310fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.899 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.895+0000 7f3487b03640 1 --2- 172.21.15.194:0/2004001548 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5634d930ebd0 0x5634d9310fc0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.901 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.895+0000 7f3487b03640 1 -- 172.21.15.194:0/2004001548 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(2 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f34780f9020 con 0x5634d930ebd0 2024-09-13T06:11:43.901 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.895+0000 7f3489ff3980 1 -- 172.21.15.194:0/4169903103 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3360034650 msgr2=0x7f3360036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.901 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.895+0000 7f3489ff3980 1 --2- 172.21.15.194:0/4169903103 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3360034650 0x7f3360036b10 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3480005c30 tx=0x7f348001bf50 comp rx=0 tx=0).stop 2024-09-13T06:11:43.901 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.895+0000 7f3489ff3980 1 -- 172.21.15.194:0/4169903103 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634d92e3b30 msgr2=0x5634d92eaf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.902 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.895+0000 7f3489ff3980 1 --2- 172.21.15.194:0/4169903103 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634d92e3b30 0x5634d92eaf70 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f348000a930 tx=0x7f3480003380 comp rx=0 tx=0).stop 2024-09-13T06:11:43.902 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.895+0000 7f3489ff3980 1 -- 172.21.15.194:0/4169903103 shutdown_connections 2024-09-13T06:11:43.902 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.895+0000 7f3489ff3980 1 --2- 172.21.15.194:0/4169903103 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3360034650 0x7f3360036b10 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.902 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.895+0000 7f3489ff3980 1 --2- 172.21.15.194:0/4169903103 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634d92e3b30 0x5634d92eaf70 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.902 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.895+0000 7f3489ff3980 1 -- 172.21.15.194:0/4169903103 >> 172.21.15.194:0/4169903103 conn(0x5634d91e3470 msgr2=0x5634d92df010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:43.902 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.895+0000 7f3489ff3980 1 -- 172.21.15.194:0/4169903103 shutdown_connections 2024-09-13T06:11:43.902 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.895+0000 7f3489ff3980 1 -- 172.21.15.194:0/4169903103 wait complete. 2024-09-13T06:11:43.902 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.895+0000 7f3489ff3980 1 -- 172.21.15.194:0/805621137 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f32c0034650 msgr2=0x7f32c0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.902 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.895+0000 7f3489ff3980 1 --2- 172.21.15.194:0/805621137 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f32c0034650 0x7f32c0036b10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x5634d92dffe0 tx=0x7f347c0012e0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.902 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.895+0000 7f3489ff3980 1 -- 172.21.15.194:0/805621137 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634d9304720 msgr2=0x5634d9304b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.902 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.895+0000 7f3489ff3980 1 --2- 172.21.15.194:0/805621137 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634d9304720 0x5634d9304b40 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f34780aaa90 tx=0x7f34780d3c10 comp rx=0 tx=0).stop 2024-09-13T06:11:43.902 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.895+0000 7f3489ff3980 1 -- 172.21.15.194:0/805621137 shutdown_connections 2024-09-13T06:11:43.902 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.895+0000 7f3489ff3980 1 --2- 172.21.15.194:0/805621137 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f32c0034650 0x7f32c0036b10 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.895+0000 7f3489ff3980 1 --2- 172.21.15.194:0/805621137 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634d9304720 0x5634d9304b40 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.895+0000 7f3489ff3980 1 -- 172.21.15.194:0/805621137 >> 172.21.15.194:0/805621137 conn(0x5634d92f9790 msgr2=0x5634d92fc080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:43.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.895+0000 7f3489ff3980 1 -- 172.21.15.194:0/805621137 shutdown_connections 2024-09-13T06:11:43.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.895+0000 7f3489ff3980 1 -- 172.21.15.194:0/805621137 wait complete. 2024-09-13T06:11:43.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.895+0000 7f3489ff3980 1 -- 172.21.15.194:0/2004001548 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5634d930a300 msgr2=0x5634d930c730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.895+0000 7f3489ff3980 1 --2- 172.21.15.194:0/2004001548 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5634d930a300 0x5634d930c730 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.895+0000 7f3489ff3980 1 -- 172.21.15.194:0/2004001548 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5634d930ebd0 msgr2=0x5634d9310fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.895+0000 7f3489ff3980 1 --2- 172.21.15.194:0/2004001548 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5634d930ebd0 0x5634d9310fc0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.899+0000 7f3489ff3980 1 -- 172.21.15.194:0/2004001548 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3370034650 msgr2=0x7f3370036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.899+0000 7f3489ff3980 1 --2- 172.21.15.194:0/2004001548 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3370034650 0x7f3370036b10 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f34780bfd60 tx=0x7f34780bfcd0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.899+0000 7f3489ff3980 1 -- 172.21.15.194:0/2004001548 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634d91e0b40 msgr2=0x5634d92d6de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.899+0000 7f3489ff3980 1 --2- 172.21.15.194:0/2004001548 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634d91e0b40 0x5634d92d6de0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f34780199c0 tx=0x7f34780180b0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.899+0000 7f3489ff3980 1 -- 172.21.15.194:0/2004001548 shutdown_connections 2024-09-13T06:11:43.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.899+0000 7f3489ff3980 1 --2- 172.21.15.194:0/2004001548 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5634d930ebd0 0x5634d9310fc0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.899+0000 7f3489ff3980 1 --2- 172.21.15.194:0/2004001548 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5634d930a300 0x5634d930c730 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.899+0000 7f3489ff3980 1 --2- 172.21.15.194:0/2004001548 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f3370034650 0x7f3370036b10 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.899+0000 7f3489ff3980 1 --2- 172.21.15.194:0/2004001548 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634d91e0b40 0x5634d92d6de0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.899+0000 7f3489ff3980 1 -- 172.21.15.194:0/2004001548 >> 172.21.15.194:0/2004001548 conn(0x5634d91dc7e0 msgr2=0x5634d92ca230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:43.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.899+0000 7f3489ff3980 1 -- 172.21.15.194:0/2004001548 shutdown_connections 2024-09-13T06:11:43.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.899+0000 7f3489ff3980 1 -- 172.21.15.194:0/2004001548 wait complete. 2024-09-13T06:11:43.910 INFO:teuthology.orchestra.run.smithi194.stdout:{"id":"52d5ffc2-b91b-4558-98ea-6defdf5151d8","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-13T06:11:43.910 DEBUG:tasks.util.rgw: json result: {'id': '52d5ffc2-b91b-4558-98ea-6defdf5151d8', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-13T06:11:43.911 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'set'] 2024-09-13T06:11:43.911 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'set'] 2024-09-13T06:11:43.911 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone set 2024-09-13T06:11:43.980 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:11:43.980 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:11:43.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.979+0000 7fedb0a60980 1 Processor -- start 2024-09-13T06:11:43.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.979+0000 7fedb0a60980 1 -- start start 2024-09-13T06:11:43.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.979+0000 7fedb0a60980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x556f67c07280 0x556f67c95390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:43.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.979+0000 7fedb0a60980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556f67b1aae0 con 0x556f67c958d0 2024-09-13T06:11:43.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.979+0000 7fedb0a60980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x556f67b3ee30 con 0x556f67c07280 2024-09-13T06:11:43.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.979+0000 7fedae570640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x556f67c07280 0x556f67c95390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:43.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.979+0000 7fedadd6f640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x556f67c958d0 0x556f67c97cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:58326/0 (socket says 172.21.15.194:58326) 2024-09-13T06:11:43.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.979+0000 7fedadd6f640 1 -- 172.21.15.194:0/1015162098 learned_addr learned my addr 172.21.15.194:0/1015162098 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-09-13T06:11:43.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.979+0000 7fedae570640 1 -- 172.21.15.194:0/1015162098 >> v1:172.21.15.120:6789/0 conn(0x556f67c958d0 legacy=0x556f67c97cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.979+0000 7fedae570640 1 -- 172.21.15.194:0/1015162098 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f67c07810 con 0x556f67c07280 2024-09-13T06:11:43.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.983+0000 7fedae570640 1 --2- 172.21.15.194:0/1015162098 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556f67c07280 0x556f67c95390 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7feda000a420 tx=0x7feda001afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c440f89bfa0dd02 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:43.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.983+0000 7fedad56e640 1 -- 172.21.15.194:0/1015162098 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feda00af070 con 0x556f67c07280 2024-09-13T06:11:43.985 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.983+0000 7fedad56e640 1 -- 172.21.15.194:0/1015162098 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feda00aa530 con 0x556f67c07280 2024-09-13T06:11:43.985 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.983+0000 7fedad56e640 1 -- 172.21.15.194:0/1015162098 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feda00aa850 con 0x556f67c07280 2024-09-13T06:11:43.985 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.983+0000 7fedb0a60980 1 -- 172.21.15.194:0/1015162098 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556f67c07280 msgr2=0x556f67c95390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:43.985 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.983+0000 7fedb0a60980 1 --2- 172.21.15.194:0/1015162098 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556f67c07280 0x556f67c95390 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7feda000a420 tx=0x7feda001afd0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.986 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.983+0000 7fedb0a60980 1 -- 172.21.15.194:0/1015162098 shutdown_connections 2024-09-13T06:11:43.986 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.983+0000 7fedb0a60980 1 --2- 172.21.15.194:0/1015162098 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556f67c07280 0x556f67c95390 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:43.986 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.983+0000 7fedb0a60980 1 -- 172.21.15.194:0/1015162098 >> 172.21.15.194:0/1015162098 conn(0x556f67c8d080 msgr2=0x556f67c8f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:43.986 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.983+0000 7fedb0a60980 1 -- 172.21.15.194:0/1015162098 shutdown_connections 2024-09-13T06:11:43.986 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.983+0000 7fedb0a60980 1 -- 172.21.15.194:0/1015162098 wait complete. 2024-09-13T06:11:44.000 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.999+0000 7fedb0a60980 1 Processor -- start 2024-09-13T06:11:44.000 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.999+0000 7fedb0a60980 1 -- start start 2024-09-13T06:11:44.001 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.999+0000 7fedb0a60980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556f67c07280 0x556f67d7da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.001 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.999+0000 7fedb0a60980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x556f67b40200 con 0x556f67c07280 2024-09-13T06:11:44.001 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.999+0000 7fedae570640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556f67c07280 0x556f67d7da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.001 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.999+0000 7fedae570640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556f67c07280 0x556f67d7da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44720/0 (socket says 172.21.15.194:44720) 2024-09-13T06:11:44.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.999+0000 7fedae570640 1 -- 172.21.15.194:0/2923690086 learned_addr learned my addr 172.21.15.194:0/2923690086 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:44.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.999+0000 7fedae570640 1 -- 172.21.15.194:0/2923690086 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f67d7e050 con 0x556f67c07280 2024-09-13T06:11:44.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.999+0000 7fedae570640 1 --2- 172.21.15.194:0/2923690086 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556f67c07280 0x556f67d7da80 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7feda00ad040 tx=0x7feda00033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28dca03035bf8b16 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.999+0000 7fec9c608640 1 -- 172.21.15.194:0/2923690086 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feda00af050 con 0x556f67c07280 2024-09-13T06:11:44.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.999+0000 7fec9c608640 1 -- 172.21.15.194:0/2923690086 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feda00b0040 con 0x556f67c07280 2024-09-13T06:11:44.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.999+0000 7fec9c608640 1 -- 172.21.15.194:0/2923690086 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feda00aaca0 con 0x556f67c07280 2024-09-13T06:11:44.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.999+0000 7fedb0a60980 1 -- 172.21.15.194:0/2923690086 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556f67c07280 msgr2=0x556f67d7da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.999+0000 7fedb0a60980 1 --2- 172.21.15.194:0/2923690086 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556f67c07280 0x556f67d7da80 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7feda00ad040 tx=0x7feda00033b0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.999+0000 7fedb0a60980 1 -- 172.21.15.194:0/2923690086 shutdown_connections 2024-09-13T06:11:44.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.999+0000 7fedb0a60980 1 --2- 172.21.15.194:0/2923690086 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556f67c07280 0x556f67d7da80 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.999+0000 7fedb0a60980 1 -- 172.21.15.194:0/2923690086 >> 172.21.15.194:0/2923690086 conn(0x556f67c8d080 msgr2=0x556f67d796b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:44.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.999+0000 7fedb0a60980 1 -- 172.21.15.194:0/2923690086 shutdown_connections 2024-09-13T06:11:44.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.999+0000 7fedb0a60980 1 -- 172.21.15.194:0/2923690086 wait complete. 2024-09-13T06:11:44.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.999+0000 7fedb0a60980 1 Processor -- start 2024-09-13T06:11:44.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:43.999+0000 7fedb0a60980 1 -- start start 2024-09-13T06:11:44.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.003+0000 7fedb0a60980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556f67c07280 0x556f67d84c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.003+0000 7fedb0a60980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x556f67c99ef0 con 0x556f67c07280 2024-09-13T06:11:44.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.003+0000 7fedae570640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556f67c07280 0x556f67d84c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.003+0000 7fedae570640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556f67c07280 0x556f67d84c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44726/0 (socket says 172.21.15.194:44726) 2024-09-13T06:11:44.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.003+0000 7fedae570640 1 -- 172.21.15.194:0/3340457587 learned_addr learned my addr 172.21.15.194:0/3340457587 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:44.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.003+0000 7fedae570640 1 -- 172.21.15.194:0/3340457587 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f67d85190 con 0x556f67c07280 2024-09-13T06:11:44.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.003+0000 7fedae570640 1 --2- 172.21.15.194:0/3340457587 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556f67c07280 0x556f67d84c50 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7feda0019680 tx=0x7feda0019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.003+0000 7fec9ae05640 1 -- 172.21.15.194:0/3340457587 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feda00c5070 con 0x556f67c07280 2024-09-13T06:11:44.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.003+0000 7fec9ae05640 1 -- 172.21.15.194:0/3340457587 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feda00b6d60 con 0x556f67c07280 2024-09-13T06:11:44.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.003+0000 7fec9ae05640 1 -- 172.21.15.194:0/3340457587 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feda00c15f0 con 0x556f67c07280 2024-09-13T06:11:44.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.003+0000 7fedb0a60980 1 -- 172.21.15.194:0/3340457587 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556f67d85420 con 0x556f67c07280 2024-09-13T06:11:44.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.003+0000 7fedb0a60980 1 -- 172.21.15.194:0/3340457587 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f67d88100 con 0x556f67c07280 2024-09-13T06:11:44.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.003+0000 7fedb0a60980 1 Processor -- start 2024-09-13T06:11:44.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.003+0000 7fedb0a60980 1 -- start start 2024-09-13T06:11:44.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.003+0000 7fedb0a60980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556f67d91a10 0x556f67d91e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.003+0000 7fedb0a60980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x556f67b99800 con 0x556f67d91a10 2024-09-13T06:11:44.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.003+0000 7fec9ae05640 1 -- 172.21.15.194:0/3340457587 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7feda00c8070 con 0x556f67c07280 2024-09-13T06:11:44.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.003+0000 7fedaed71640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556f67d91a10 0x556f67d91e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.003+0000 7fedaed71640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556f67d91a10 0x556f67d91e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44734/0 (socket says 172.21.15.194:44734) 2024-09-13T06:11:44.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.003+0000 7fedaed71640 1 -- 172.21.15.194:0/4230324621 learned_addr learned my addr 172.21.15.194:0/4230324621 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:44.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.003+0000 7fec9ae05640 1 --2- 172.21.15.194:0/3340457587 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fec94034650 0x7fec94036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.003+0000 7fec9ae05640 1 -- 172.21.15.194:0/3340457587 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7feda00bb070 con 0x556f67c07280 2024-09-13T06:11:44.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.003+0000 7fedae570640 1 --2- 172.21.15.194:0/3340457587 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fec94034650 0x7fec94036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.003+0000 7fedaed71640 1 -- 172.21.15.194:0/4230324621 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f67d92350 con 0x556f67d91a10 2024-09-13T06:11:44.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.003+0000 7fedaed71640 1 --2- 172.21.15.194:0/4230324621 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556f67d91a10 0x556f67d91e10 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7feda800a440 tx=0x7feda800a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4e2509a58adc704 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.003+0000 7fedae570640 1 --2- 172.21.15.194:0/3340457587 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fec94034650 0x7fec94036b10 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7feda00a3bf0 tx=0x7feda00cc040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.003+0000 7fec98e01640 1 -- 172.21.15.194:0/4230324621 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feda8008850 con 0x556f67d91a10 2024-09-13T06:11:44.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.003+0000 7fec98e01640 1 -- 172.21.15.194:0/4230324621 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feda8008a10 con 0x556f67d91a10 2024-09-13T06:11:44.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.003+0000 7fec98e01640 1 -- 172.21.15.194:0/4230324621 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feda8008d30 con 0x556f67d91a10 2024-09-13T06:11:44.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.007+0000 7fedb0a60980 1 -- 172.21.15.194:0/4230324621 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556f67d91a10 msgr2=0x556f67d91e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.007+0000 7fedb0a60980 1 --2- 172.21.15.194:0/4230324621 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556f67d91a10 0x556f67d91e10 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7feda800a440 tx=0x7feda800a900 comp rx=0 tx=0).stop 2024-09-13T06:11:44.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.007+0000 7fedb0a60980 1 -- 172.21.15.194:0/4230324621 shutdown_connections 2024-09-13T06:11:44.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.007+0000 7fedb0a60980 1 --2- 172.21.15.194:0/4230324621 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556f67d91a10 0x556f67d91e10 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.007+0000 7fedb0a60980 1 -- 172.21.15.194:0/4230324621 >> 172.21.15.194:0/4230324621 conn(0x556f67c958d0 msgr2=0x556f67d8d320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:44.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.007+0000 7fedb0a60980 1 -- 172.21.15.194:0/4230324621 shutdown_connections 2024-09-13T06:11:44.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.007+0000 7fedb0a60980 1 -- 172.21.15.194:0/4230324621 wait complete. 2024-09-13T06:11:44.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.007+0000 7fedb0a60980 1 Processor -- start 2024-09-13T06:11:44.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.007+0000 7fedb0a60980 1 -- start start 2024-09-13T06:11:44.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.007+0000 7fedb0a60980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556f67d91a10 0x556f67d98d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.007+0000 7fedb0a60980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x556f67d925e0 con 0x556f67d91a10 2024-09-13T06:11:44.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.007+0000 7fedaed71640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556f67d91a10 0x556f67d98d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.007+0000 7fedaed71640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556f67d91a10 0x556f67d98d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44744/0 (socket says 172.21.15.194:44744) 2024-09-13T06:11:44.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.007+0000 7fedaed71640 1 -- 172.21.15.194:0/3922190273 learned_addr learned my addr 172.21.15.194:0/3922190273 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:44.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.007+0000 7fedaed71640 1 -- 172.21.15.194:0/3922190273 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f67d99290 con 0x556f67d91a10 2024-09-13T06:11:44.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.007+0000 7fedaed71640 1 --2- 172.21.15.194:0/3922190273 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556f67d91a10 0x556f67d98d50 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x556f67d927c0 tx=0x7feda8003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.007+0000 7fec92ffd640 1 -- 172.21.15.194:0/3922190273 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feda8013a70 con 0x556f67d91a10 2024-09-13T06:11:44.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.007+0000 7fec92ffd640 1 -- 172.21.15.194:0/3922190273 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feda8023070 con 0x556f67d91a10 2024-09-13T06:11:44.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.007+0000 7fedb0a60980 1 -- 172.21.15.194:0/3922190273 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556f67d99520 con 0x556f67d91a10 2024-09-13T06:11:44.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.007+0000 7fedb0a60980 1 -- 172.21.15.194:0/3922190273 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f67d9c200 con 0x556f67d91a10 2024-09-13T06:11:44.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.007+0000 7fec92ffd640 1 -- 172.21.15.194:0/3922190273 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feda8013d40 con 0x556f67d91a10 2024-09-13T06:11:44.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.007+0000 7fedb0a60980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:11:44.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.007+0000 7fedb0a60980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:11:44.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.011+0000 7fedb0a60980 1 Processor -- start 2024-09-13T06:11:44.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.011+0000 7fec92ffd640 1 -- 172.21.15.194:0/3922190273 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7feda8028460 con 0x556f67d91a10 2024-09-13T06:11:44.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.011+0000 7fedb0a60980 1 -- start start 2024-09-13T06:11:44.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.011+0000 7fec92ffd640 1 --2- 172.21.15.194:0/3922190273 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fec88034650 0x7fec88036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.011+0000 7fedb0a60980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556f67db2610 0x556f67db2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.011+0000 7fedb0a60980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x556f67d7e310 con 0x556f67db2610 2024-09-13T06:11:44.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.011+0000 7fec92ffd640 1 -- 172.21.15.194:0/3922190273 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7feda804a150 con 0x556f67d91a10 2024-09-13T06:11:44.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.011+0000 7fedaed71640 1 --2- 172.21.15.194:0/3922190273 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fec88034650 0x7fec88036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.011+0000 7fedae570640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556f67db2610 0x556f67db2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.011+0000 7fedae570640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556f67db2610 0x556f67db2a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44750/0 (socket says 172.21.15.194:44750) 2024-09-13T06:11:44.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.011+0000 7fedae570640 1 -- 172.21.15.194:0/1350191237 learned_addr learned my addr 172.21.15.194:0/1350191237 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:44.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.011+0000 7fedaed71640 1 --2- 172.21.15.194:0/3922190273 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fec88034650 0x7fec88036b10 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7feda801e590 tx=0x7feda801e520 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.011+0000 7fedae570640 1 -- 172.21.15.194:0/1350191237 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f67db3000 con 0x556f67db2610 2024-09-13T06:11:44.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.011+0000 7fedae570640 1 --2- 172.21.15.194:0/1350191237 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556f67db2610 0x556f67db2a30 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7feda00c88e0 tx=0x7feda00a3b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.011+0000 7fec72fe5640 1 -- 172.21.15.194:0/1350191237 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feda00e9070 con 0x556f67db2610 2024-09-13T06:11:44.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.011+0000 7fec72fe5640 1 -- 172.21.15.194:0/1350191237 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feda00c1b60 con 0x556f67db2610 2024-09-13T06:11:44.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.011+0000 7fedb0a60980 1 -- 172.21.15.194:0/1350191237 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556f67db5c80 con 0x556f67db2610 2024-09-13T06:11:44.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.011+0000 7fec72fe5640 1 -- 172.21.15.194:0/1350191237 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feda00da070 con 0x556f67db2610 2024-09-13T06:11:44.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.011+0000 7fedb0a60980 1 -- 172.21.15.194:0/1350191237 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f67db6030 con 0x556f67db2610 2024-09-13T06:11:44.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.011+0000 7fec72fe5640 1 -- 172.21.15.194:0/1350191237 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7feda00ec070 con 0x556f67db2610 2024-09-13T06:11:44.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.011+0000 7fec72fe5640 1 --2- 172.21.15.194:0/1350191237 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7febf0034600 0x7febf0036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.011+0000 7fec72fe5640 1 -- 172.21.15.194:0/1350191237 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7feda00efd60 con 0x556f67db2610 2024-09-13T06:11:44.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.011+0000 7fedadd6f640 1 --2- 172.21.15.194:0/1350191237 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7febf0034600 0x7febf0036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.011+0000 7fec70fe1640 20 reqs_thread_entry: start 2024-09-13T06:11:44.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.011+0000 7fedb0a60980 1 --2- 172.21.15.194:0/3340457587 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x556f67db81a0 0x556f67dba5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.011+0000 7fedadd6f640 1 --2- 172.21.15.194:0/1350191237 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7febf0034600 0x7febf0036ac0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fed98000f70 tx=0x7fed98001240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.011+0000 7fedb0a60980 1 -- 172.21.15.194:0/3340457587 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556f67dbac50 con 0x556f67db81a0 2024-09-13T06:11:44.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.015+0000 7fedaed71640 1 --2- 172.21.15.194:0/3340457587 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x556f67db81a0 0x556f67dba5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.015+0000 7fedaed71640 1 --2- 172.21.15.194:0/3340457587 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x556f67db81a0 0x556f67dba5d0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.015+0000 7fedaed71640 1 -- 172.21.15.194:0/3340457587 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feda8027ce0 con 0x556f67db81a0 2024-09-13T06:11:44.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.015+0000 7fedb0a60980 1 -- 172.21.15.194:0/3340457587 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556f67dbb500 con 0x556f67db81a0 2024-09-13T06:11:44.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.015+0000 7fedaed71640 1 -- 172.21.15.194:0/3340457587 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7feda8027ce0 con 0x556f67db81a0 2024-09-13T06:11:44.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.015+0000 7fedb0a60980 1 --2- 172.21.15.194:0/3340457587 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x556f67dbce10 0x556f67dbf280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.015+0000 7fedb0a60980 1 -- 172.21.15.194:0/3340457587 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556f67dbf970 con 0x556f67dbce10 2024-09-13T06:11:44.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.015+0000 7fedae570640 1 --2- 172.21.15.194:0/3340457587 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x556f67dbce10 0x556f67dbf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.015+0000 7fedae570640 1 --2- 172.21.15.194:0/3340457587 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x556f67dbce10 0x556f67dbf280 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.015+0000 7fedae570640 1 -- 172.21.15.194:0/3340457587 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7feda00f5070 con 0x556f67dbce10 2024-09-13T06:11:44.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.015+0000 7fedb0a60980 1 -- 172.21.15.194:0/3340457587 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556f67dca550 con 0x556f67db81a0 2024-09-13T06:11:44.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.015+0000 7fedaed71640 1 -- 172.21.15.194:0/3340457587 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feda8027ce0 con 0x556f67db81a0 2024-09-13T06:11:44.019 INFO:teuthology.orchestra.run.smithi194.stderr:NOTICE: set zone's realm_id= 2024-09-13T06:11:44.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.015+0000 7fedb0a60980 1 -- 172.21.15.194:0/3340457587 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556f67dbfda0 con 0x556f67dbce10 2024-09-13T06:11:44.020 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.015+0000 7fedae570640 1 -- 172.21.15.194:0/3340457587 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(5 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feda00f5070 con 0x556f67dbce10 2024-09-13T06:11:44.020 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.015+0000 7fedae570640 1 --2- 172.21.15.194:0/3340457587 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7feda00ee070 0x7feda00e4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.021 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.015+0000 7fedae570640 1 -- 172.21.15.194:0/3340457587 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:6 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556f67dbfda0 con 0x7feda00ee070 2024-09-13T06:11:44.021 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.015+0000 7fedadd6f640 1 --2- 172.21.15.194:0/3340457587 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7feda00ee070 0x7feda00e4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.021 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.015+0000 7fedadd6f640 1 --2- 172.21.15.194:0/3340457587 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7feda00ee070 0x7feda00e4d10 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.021 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.015+0000 7fedadd6f640 1 -- 172.21.15.194:0/3340457587 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fed9800e580 con 0x7feda00ee070 2024-09-13T06:11:44.021 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.015+0000 7fedadd6f640 1 --2- 172.21.15.194:0/3340457587 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fed9800d8f0 0x7fed9800c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.021 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.015+0000 7fedadd6f640 1 -- 172.21.15.194:0/3340457587 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:7 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556f67dbfda0 con 0x7fed9800d8f0 2024-09-13T06:11:44.021 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.015+0000 7fedaed71640 1 --2- 172.21.15.194:0/3340457587 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fed9800d8f0 0x7fed9800c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.021 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.019+0000 7fedaed71640 1 --2- 172.21.15.194:0/3340457587 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fed9800d8f0 0x7fed9800c370 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.019+0000 7fedaed71640 1 -- 172.21.15.194:0/3340457587 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feda8027ce0 con 0x7fed9800d8f0 2024-09-13T06:11:44.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.019+0000 7fedaed71640 1 -- 172.21.15.194:0/3340457587 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:8 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556f67dbfda0 con 0x556f67db81a0 2024-09-13T06:11:44.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.019+0000 7fedaed71640 1 -- 172.21.15.194:0/3340457587 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feda8027ce0 con 0x556f67db81a0 2024-09-13T06:11:44.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.019+0000 7fedaed71640 1 -- 172.21.15.194:0/3340457587 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556f67dbfda0 con 0x556f67db81a0 2024-09-13T06:11:44.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.019+0000 7fedaed71640 1 -- 172.21.15.194:0/3340457587 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feda8027ce0 con 0x556f67db81a0 2024-09-13T06:11:44.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.019+0000 7fedaed71640 1 -- 172.21.15.194:0/3340457587 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:10 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556f67dbfda0 con 0x7fed9800d8f0 2024-09-13T06:11:44.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.019+0000 7fedaed71640 1 -- 172.21.15.194:0/3340457587 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feda8027ce0 con 0x7fed9800d8f0 2024-09-13T06:11:44.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.019+0000 7fedaed71640 1 -- 172.21.15.194:0/3340457587 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556f67dbfda0 con 0x7fed9800d8f0 2024-09-13T06:11:44.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.019+0000 7fedaed71640 1 -- 172.21.15.194:0/3340457587 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feda8027ce0 con 0x7fed9800d8f0 2024-09-13T06:11:44.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.019+0000 7fedaed71640 1 -- 172.21.15.194:0/3340457587 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:12 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556f67dbfda0 con 0x7feda00ee070 2024-09-13T06:11:44.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.019+0000 7fedadd6f640 1 -- 172.21.15.194:0/3340457587 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed9800e580 con 0x7feda00ee070 2024-09-13T06:11:44.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.019+0000 7fedadd6f640 1 -- 172.21.15.194:0/3340457587 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:13 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556f67dbfda0 con 0x556f67dbce10 2024-09-13T06:11:44.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.019+0000 7fedae570640 1 -- 172.21.15.194:0/3340457587 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feda00f5070 con 0x556f67dbce10 2024-09-13T06:11:44.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.019+0000 7fedae570640 1 -- 172.21.15.194:0/3340457587 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:14 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556f67dbfda0 con 0x556f67db81a0 2024-09-13T06:11:44.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.023+0000 7fedaed71640 1 -- 172.21.15.194:0/3340457587 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feda8027ce0 con 0x556f67db81a0 2024-09-13T06:11:44.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.023+0000 7fedaed71640 1 -- 172.21.15.194:0/3340457587 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:15 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556f67dbfda0 con 0x7fed9800d8f0 2024-09-13T06:11:44.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.023+0000 7fedaed71640 1 -- 172.21.15.194:0/3340457587 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feda8027ce0 con 0x7fed9800d8f0 2024-09-13T06:11:44.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.023+0000 7fedaed71640 1 -- 172.21.15.194:0/3340457587 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:16 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556f67dbfda0 con 0x556f67db81a0 2024-09-13T06:11:44.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.023+0000 7fedaed71640 1 -- 172.21.15.194:0/3340457587 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feda8027ce0 con 0x556f67db81a0 2024-09-13T06:11:44.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.023+0000 7fedaed71640 1 -- 172.21.15.194:0/3340457587 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:17 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556f67dbfda0 con 0x7feda00ee070 2024-09-13T06:11:44.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.023+0000 7fedadd6f640 1 -- 172.21.15.194:0/3340457587 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(17 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fed9800e580 con 0x7feda00ee070 2024-09-13T06:11:44.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.023+0000 7fedadd6f640 1 -- 172.21.15.194:0/3340457587 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:18 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556f67dbfda0 con 0x556f67dbce10 2024-09-13T06:11:44.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.023+0000 7fedae570640 1 -- 172.21.15.194:0/3340457587 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(18 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feda00f5070 con 0x556f67dbce10 2024-09-13T06:11:44.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.023+0000 7fedae570640 1 -- 172.21.15.194:0/3340457587 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556f67dbfda0 con 0x556f67dbce10 2024-09-13T06:11:44.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.023+0000 7fedae570640 1 -- 172.21.15.194:0/3340457587 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feda00f5070 con 0x556f67dbce10 2024-09-13T06:11:44.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.023+0000 7fedae570640 1 -- 172.21.15.194:0/3340457587 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:20 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556f67dbfda0 con 0x7fed9800d8f0 2024-09-13T06:11:44.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.023+0000 7fedaed71640 1 -- 172.21.15.194:0/3340457587 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feda8027ce0 con 0x7fed9800d8f0 2024-09-13T06:11:44.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.023+0000 7fedaed71640 1 -- 172.21.15.194:0/3340457587 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:21 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556f67dbfda0 con 0x556f67dbce10 2024-09-13T06:11:44.029 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.023+0000 7fedae570640 1 -- 172.21.15.194:0/3340457587 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feda00f5070 con 0x556f67dbce10 2024-09-13T06:11:44.029 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.023+0000 7fedae570640 1 -- 172.21.15.194:0/3340457587 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556f67dbfda0 con 0x556f67dbce10 2024-09-13T06:11:44.029 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.023+0000 7fedae570640 1 -- 172.21.15.194:0/3340457587 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feda00f5070 con 0x556f67dbce10 2024-09-13T06:11:44.029 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.023+0000 7fedae570640 1 -- 172.21.15.194:0/3340457587 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:23 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556f67dbfda0 con 0x556f67db81a0 2024-09-13T06:11:44.029 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.023+0000 7fedaed71640 1 -- 172.21.15.194:0/3340457587 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feda8027ce0 con 0x556f67db81a0 2024-09-13T06:11:44.029 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.023+0000 7fedaed71640 1 -- 172.21.15.194:0/3340457587 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556f67dbfda0 con 0x556f67db81a0 2024-09-13T06:11:44.029 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.023+0000 7fedaed71640 1 -- 172.21.15.194:0/3340457587 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=74b] v26'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7feda8027ce0 con 0x556f67db81a0 2024-09-13T06:11:44.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.023+0000 7fedaed71640 1 -- 172.21.15.194:0/3340457587 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:25 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556f67dbfda0 con 0x7feda00ee070 2024-09-13T06:11:44.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.027+0000 7fedadd6f640 1 -- 172.21.15.194:0/3340457587 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(25 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed9800e580 con 0x7feda00ee070 2024-09-13T06:11:44.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.027+0000 7fedadd6f640 1 -- 172.21.15.194:0/3340457587 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:26 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556f67dbfda0 con 0x556f67dbce10 2024-09-13T06:11:44.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.027+0000 7fedae570640 1 -- 172.21.15.194:0/3340457587 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feda00f5070 con 0x556f67dbce10 2024-09-13T06:11:44.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.027+0000 7fedae570640 1 -- 172.21.15.194:0/3340457587 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:27 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556f67dbfda0 con 0x7feda00ee070 2024-09-13T06:11:44.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.027+0000 7fedadd6f640 1 -- 172.21.15.194:0/3340457587 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed9800e580 con 0x7feda00ee070 2024-09-13T06:11:44.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.027+0000 7fedadd6f640 1 -- 172.21.15.194:0/3340457587 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:28 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556f67dbfda0 con 0x556f67db81a0 2024-09-13T06:11:44.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.027+0000 7fedaed71640 1 -- 172.21.15.194:0/3340457587 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feda8027ce0 con 0x556f67db81a0 2024-09-13T06:11:44.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.027+0000 7fedaed71640 1 -- 172.21.15.194:0/3340457587 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:29 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556f67dbfda0 con 0x7fed9800d8f0 2024-09-13T06:11:44.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.027+0000 7fedaed71640 1 -- 172.21.15.194:0/3340457587 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feda8027ce0 con 0x7fed9800d8f0 2024-09-13T06:11:44.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.027+0000 7fedaed71640 1 -- 172.21.15.194:0/3340457587 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:30 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556f67dbfda0 con 0x556f67dbce10 2024-09-13T06:11:44.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.027+0000 7fedae570640 1 -- 172.21.15.194:0/3340457587 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(30 [pgnls start_epoch 35 out=107b] v33'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7feda00f5070 con 0x556f67dbce10 2024-09-13T06:11:44.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.027+0000 7fedae570640 1 -- 172.21.15.194:0/3340457587 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:31 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556f67dbfda0 con 0x7feda00ee070 2024-09-13T06:11:44.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.027+0000 7fedadd6f640 1 -- 172.21.15.194:0/3340457587 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed9800e580 con 0x7feda00ee070 2024-09-13T06:11:44.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.027+0000 7fedadd6f640 1 -- 172.21.15.194:0/3340457587 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:32 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556f67dbfda0 con 0x7feda00ee070 2024-09-13T06:11:44.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.027+0000 7fedadd6f640 1 -- 172.21.15.194:0/3340457587 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed9800e580 con 0x7feda00ee070 2024-09-13T06:11:44.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.027+0000 7fedadd6f640 1 -- 172.21.15.194:0/3340457587 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:33 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556f67dbfda0 con 0x556f67dbce10 2024-09-13T06:11:44.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.027+0000 7fedae570640 1 -- 172.21.15.194:0/3340457587 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feda00f5070 con 0x556f67dbce10 2024-09-13T06:11:44.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.027+0000 7fedae570640 1 -- 172.21.15.194:0/3340457587 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:34 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556f67dbfda0 con 0x7fed9800d8f0 2024-09-13T06:11:44.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.027+0000 7fedaed71640 1 -- 172.21.15.194:0/3340457587 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feda8027ce0 con 0x7fed9800d8f0 2024-09-13T06:11:44.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.027+0000 7fedaed71640 1 -- 172.21.15.194:0/3340457587 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:35 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556f67dbfda0 con 0x556f67db81a0 2024-09-13T06:11:44.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.027+0000 7fedaed71640 1 -- 172.21.15.194:0/3340457587 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(35 [pgnls start_epoch 35 out=115b] v26'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7feda8027ce0 con 0x556f67db81a0 2024-09-13T06:11:44.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.027+0000 7fedaed71640 1 -- 172.21.15.194:0/3340457587 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:36 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556f67dbfda0 con 0x7feda00ee070 2024-09-13T06:11:44.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.031+0000 7fedadd6f640 1 -- 172.21.15.194:0/3340457587 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(36 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed9800e580 con 0x7feda00ee070 2024-09-13T06:11:44.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.031+0000 7fedb0a60980 1 -- 172.21.15.194:0/3340457587 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:37 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556f67dc8ed0 con 0x556f67db81a0 2024-09-13T06:11:44.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.031+0000 7fedaed71640 1 -- 172.21.15.194:0/3340457587 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(37 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7feda8027ce0 con 0x556f67db81a0 2024-09-13T06:11:44.034 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.031+0000 7fedb0a60980 1 -- 172.21.15.194:0/3340457587 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:38 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556f67dc5de0 con 0x556f67dbce10 2024-09-13T06:11:44.034 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.031+0000 7fedae570640 1 -- 172.21.15.194:0/3340457587 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(38 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7feda00f5070 con 0x556f67dbce10 2024-09-13T06:11:44.034 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.031+0000 7fedb0a60980 1 -- 172.21.15.194:0/3340457587 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:39 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [create,call version.set in=58b,writefull 0~1155 in=1155b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556f67dc7b20 con 0x556f67dbce10 2024-09-13T06:11:44.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.031+0000 7fedae570640 1 -- 172.21.15.194:0/3340457587 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(39 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [create,call,writefull 0~1155] v35'3 uv3 ondisk = 0) ==== 274+0+0 (crc 0 0 0) 0x7feda00f5070 con 0x556f67dbce10 2024-09-13T06:11:44.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.031+0000 7fedb0a60980 1 -- 172.21.15.194:0/3340457587 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:40 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=58b,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556f67dc50a0 con 0x556f67db81a0 2024-09-13T06:11:44.037 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.035+0000 7fedaed71640 1 -- 172.21.15.194:0/3340457587 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(40 zone_names.default [create,call,writefull 0~46] v35'3 uv3 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7feda8027ce0 con 0x556f67db81a0 2024-09-13T06:11:44.037 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.035+0000 7fedb0a60980 1 -- 172.21.15.194:0/3340457587 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:41 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556f67dc83a0 con 0x556f67db81a0 2024-09-13T06:11:44.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.035+0000 7fedaed71640 1 -- 172.21.15.194:0/3340457587 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(41 default.zone. [create,writefull 0~46] v35'2 uv1 ondisk = -17 ((17) File exists)) ==== 199+0+0 (crc 0 0 0) 0x7feda8027ce0 con 0x556f67db81a0 2024-09-13T06:11:44.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.039+0000 7fedb0a60980 1 -- 172.21.15.194:0/3922190273 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fec88034650 msgr2=0x7fec88036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.039+0000 7fedb0a60980 1 --2- 172.21.15.194:0/3922190273 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fec88034650 0x7fec88036b10 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7feda801e590 tx=0x7feda801e520 comp rx=0 tx=0).stop 2024-09-13T06:11:44.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.039+0000 7fedb0a60980 1 -- 172.21.15.194:0/3922190273 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556f67d91a10 msgr2=0x556f67d98d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.039+0000 7fedb0a60980 1 --2- 172.21.15.194:0/3922190273 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556f67d91a10 0x556f67d98d50 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x556f67d927c0 tx=0x7feda8003000 comp rx=0 tx=0).stop 2024-09-13T06:11:44.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.039+0000 7fedb0a60980 1 -- 172.21.15.194:0/3922190273 shutdown_connections 2024-09-13T06:11:44.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.039+0000 7fedb0a60980 1 --2- 172.21.15.194:0/3922190273 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fec88034650 0x7fec88036b10 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.039+0000 7fedb0a60980 1 --2- 172.21.15.194:0/3922190273 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556f67d91a10 0x556f67d98d50 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.039+0000 7fedb0a60980 1 -- 172.21.15.194:0/3922190273 >> 172.21.15.194:0/3922190273 conn(0x556f67c958d0 msgr2=0x556f67d8ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:44.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.039+0000 7fedb0a60980 1 -- 172.21.15.194:0/3922190273 shutdown_connections 2024-09-13T06:11:44.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.039+0000 7fedb0a60980 1 -- 172.21.15.194:0/3922190273 wait complete. 2024-09-13T06:11:44.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.039+0000 7fedb0a60980 1 -- 172.21.15.194:0/1350191237 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7febf0034600 msgr2=0x7febf0036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.039+0000 7fedb0a60980 1 --2- 172.21.15.194:0/1350191237 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7febf0034600 0x7febf0036ac0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fed98000f70 tx=0x7fed98001240 comp rx=0 tx=0).stop 2024-09-13T06:11:44.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.039+0000 7fedb0a60980 1 -- 172.21.15.194:0/1350191237 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556f67db2610 msgr2=0x556f67db2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.039+0000 7fedb0a60980 1 --2- 172.21.15.194:0/1350191237 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556f67db2610 0x556f67db2a30 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7feda00c88e0 tx=0x7feda00a3b80 comp rx=0 tx=0).stop 2024-09-13T06:11:44.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.039+0000 7fedb0a60980 1 -- 172.21.15.194:0/1350191237 shutdown_connections 2024-09-13T06:11:44.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.039+0000 7fedb0a60980 1 --2- 172.21.15.194:0/1350191237 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7febf0034600 0x7febf0036ac0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.039+0000 7fedb0a60980 1 --2- 172.21.15.194:0/1350191237 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556f67db2610 0x556f67db2a30 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.039+0000 7fedb0a60980 1 -- 172.21.15.194:0/1350191237 >> 172.21.15.194:0/1350191237 conn(0x556f67da75e0 msgr2=0x556f67da9ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:44.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.039+0000 7fedb0a60980 1 -- 172.21.15.194:0/1350191237 shutdown_connections 2024-09-13T06:11:44.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.039+0000 7fedb0a60980 1 -- 172.21.15.194:0/1350191237 wait complete. 2024-09-13T06:11:44.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.039+0000 7fedb0a60980 1 -- 172.21.15.194:0/3340457587 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fed9800d8f0 msgr2=0x7fed9800c370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.039+0000 7fedb0a60980 1 --2- 172.21.15.194:0/3340457587 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fed9800d8f0 0x7fed9800c370 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.039+0000 7fedb0a60980 1 -- 172.21.15.194:0/3340457587 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x556f67db81a0 msgr2=0x556f67dba5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.039+0000 7fedb0a60980 1 --2- 172.21.15.194:0/3340457587 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x556f67db81a0 0x556f67dba5d0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.039+0000 7fedb0a60980 1 -- 172.21.15.194:0/3340457587 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7feda00ee070 msgr2=0x7feda00e4d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.039+0000 7fedb0a60980 1 --2- 172.21.15.194:0/3340457587 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7feda00ee070 0x7feda00e4d10 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.044 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.039+0000 7fedb0a60980 1 -- 172.21.15.194:0/3340457587 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x556f67dbce10 msgr2=0x556f67dbf280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.044 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.039+0000 7fedb0a60980 1 --2- 172.21.15.194:0/3340457587 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x556f67dbce10 0x556f67dbf280 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.044 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.039+0000 7fedb0a60980 1 -- 172.21.15.194:0/3340457587 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fec94034650 msgr2=0x7fec94036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.044 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.039+0000 7fedb0a60980 1 --2- 172.21.15.194:0/3340457587 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fec94034650 0x7fec94036b10 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7feda00a3bf0 tx=0x7feda00cc040 comp rx=0 tx=0).stop 2024-09-13T06:11:44.044 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.039+0000 7fedb0a60980 1 -- 172.21.15.194:0/3340457587 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556f67c07280 msgr2=0x556f67d84c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.044 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.039+0000 7fedb0a60980 1 --2- 172.21.15.194:0/3340457587 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556f67c07280 0x556f67d84c50 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7feda0019680 tx=0x7feda0019810 comp rx=0 tx=0).stop 2024-09-13T06:11:44.044 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.039+0000 7fedaed71640 1 -- 172.21.15.194:0/3340457587 reap_dead start 2024-09-13T06:11:44.044 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.039+0000 7fedaed71640 1 -- 172.21.15.194:0/3340457587 reap_dead start 2024-09-13T06:11:44.044 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.039+0000 7fedb0a60980 1 -- 172.21.15.194:0/3340457587 shutdown_connections 2024-09-13T06:11:44.044 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.039+0000 7fedb0a60980 1 -- 172.21.15.194:0/3340457587 >> 172.21.15.194:0/3340457587 conn(0x556f67c8d080 msgr2=0x556f67d78230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:44.044 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.039+0000 7fedb0a60980 1 -- 172.21.15.194:0/3340457587 shutdown_connections 2024-09-13T06:11:44.044 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.039+0000 7fedb0a60980 1 -- 172.21.15.194:0/3340457587 wait complete. 2024-09-13T06:11:44.051 INFO:teuthology.orchestra.run.smithi194.stdout:{"id":"52d5ffc2-b91b-4558-98ea-6defdf5151d8","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-13T06:11:44.052 DEBUG:tasks.util.rgw: json result: {'id': '52d5ffc2-b91b-4558-98ea-6defdf5151d8', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-13T06:11:44.052 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get'] 2024-09-13T06:11:44.052 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get'] 2024-09-13T06:11:44.052 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get 2024-09-13T06:11:44.125 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:11:44.125 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:11:44.126 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.123+0000 7f8b59c89980 1 Processor -- start 2024-09-13T06:11:44.126 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.123+0000 7f8b59c89980 1 -- start start 2024-09-13T06:11:44.126 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.123+0000 7f8b59c89980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x563322c29530 0x563322c29910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.126 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.123+0000 7f8b59c89980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563322ab2ae0 con 0x563322c29e80 2024-09-13T06:11:44.126 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.123+0000 7f8b59c89980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x563322ad6e30 con 0x563322c29530 2024-09-13T06:11:44.127 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.123+0000 7f8b57799640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x563322c29530 0x563322c29910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.127 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.123+0000 7f8b56f98640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x563322c29e80 0x563322c2e900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:58332/0 (socket says 172.21.15.194:58332) 2024-09-13T06:11:44.127 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.123+0000 7f8b56f98640 1 -- 172.21.15.194:0/3666327254 learned_addr learned my addr 172.21.15.194:0/3666327254 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-09-13T06:11:44.127 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.123+0000 7f8b57799640 1 -- 172.21.15.194:0/3666327254 >> v1:172.21.15.120:6789/0 conn(0x563322c29e80 legacy=0x563322c2e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.128 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.123+0000 7f8b57799640 1 -- 172.21.15.194:0/3666327254 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563322c31150 con 0x563322c29530 2024-09-13T06:11:44.129 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.127+0000 7f8b57799640 1 --2- 172.21.15.194:0/3666327254 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563322c29530 0x563322c29910 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f8b4800a480 tx=0x7f8b4801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2b297128af0e756 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.130 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.127+0000 7f8b56797640 1 -- 172.21.15.194:0/3666327254 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b480b0070 con 0x563322c29530 2024-09-13T06:11:44.130 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.127+0000 7f8b56797640 1 -- 172.21.15.194:0/3666327254 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b480ab540 con 0x563322c29530 2024-09-13T06:11:44.130 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.127+0000 7f8b56797640 1 -- 172.21.15.194:0/3666327254 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b480ab840 con 0x563322c29530 2024-09-13T06:11:44.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.127+0000 7f8b59c89980 1 -- 172.21.15.194:0/3666327254 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563322c29530 msgr2=0x563322c29910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.127+0000 7f8b59c89980 1 --2- 172.21.15.194:0/3666327254 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563322c29530 0x563322c29910 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f8b4800a480 tx=0x7f8b4801b280 comp rx=0 tx=0).stop 2024-09-13T06:11:44.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.127+0000 7f8b59c89980 1 -- 172.21.15.194:0/3666327254 shutdown_connections 2024-09-13T06:11:44.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.127+0000 7f8b59c89980 1 --2- 172.21.15.194:0/3666327254 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563322c29530 0x563322c29910 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.127+0000 7f8b59c89980 1 -- 172.21.15.194:0/3666327254 >> 172.21.15.194:0/3666327254 conn(0x563322c25050 msgr2=0x563322c27470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:44.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.127+0000 7f8b59c89980 1 -- 172.21.15.194:0/3666327254 shutdown_connections 2024-09-13T06:11:44.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.127+0000 7f8b59c89980 1 -- 172.21.15.194:0/3666327254 wait complete. 2024-09-13T06:11:44.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.143+0000 7f8b59c89980 1 Processor -- start 2024-09-13T06:11:44.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.143+0000 7f8b59c89980 1 -- start start 2024-09-13T06:11:44.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.143+0000 7f8b59c89980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563322c29530 0x563322d13870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.143+0000 7f8b59c89980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x563322ad8200 con 0x563322c29530 2024-09-13T06:11:44.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.143+0000 7f8b57799640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563322c29530 0x563322d13870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.143+0000 7f8b57799640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563322c29530 0x563322d13870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44772/0 (socket says 172.21.15.194:44772) 2024-09-13T06:11:44.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.143+0000 7f8b57799640 1 -- 172.21.15.194:0/645075208 learned_addr learned my addr 172.21.15.194:0/645075208 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:44.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.147+0000 7f8b57799640 1 -- 172.21.15.194:0/645075208 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563322d13e40 con 0x563322c29530 2024-09-13T06:11:44.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.147+0000 7f8b57799640 1 --2- 172.21.15.194:0/645075208 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563322c29530 0x563322d13870 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f8b480ae040 tx=0x7f8b48003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43f1f1c9f2ab8eaf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.147+0000 7f8a4560a640 1 -- 172.21.15.194:0/645075208 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b480b0040 con 0x563322c29530 2024-09-13T06:11:44.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.147+0000 7f8a4560a640 1 -- 172.21.15.194:0/645075208 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b480ab9b0 con 0x563322c29530 2024-09-13T06:11:44.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.147+0000 7f8a4560a640 1 -- 172.21.15.194:0/645075208 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b480abc90 con 0x563322c29530 2024-09-13T06:11:44.150 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.147+0000 7f8b59c89980 1 -- 172.21.15.194:0/645075208 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563322c29530 msgr2=0x563322d13870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.150 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.147+0000 7f8b59c89980 1 --2- 172.21.15.194:0/645075208 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563322c29530 0x563322d13870 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f8b480ae040 tx=0x7f8b48003030 comp rx=0 tx=0).stop 2024-09-13T06:11:44.151 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.147+0000 7f8b59c89980 1 -- 172.21.15.194:0/645075208 shutdown_connections 2024-09-13T06:11:44.151 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.147+0000 7f8b59c89980 1 --2- 172.21.15.194:0/645075208 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563322c29530 0x563322d13870 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.151 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.147+0000 7f8b59c89980 1 -- 172.21.15.194:0/645075208 >> 172.21.15.194:0/645075208 conn(0x563322c25050 msgr2=0x563322d0f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:44.151 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.147+0000 7f8b59c89980 1 -- 172.21.15.194:0/645075208 shutdown_connections 2024-09-13T06:11:44.151 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.147+0000 7f8b59c89980 1 -- 172.21.15.194:0/645075208 wait complete. 2024-09-13T06:11:44.151 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.147+0000 7f8b59c89980 1 Processor -- start 2024-09-13T06:11:44.151 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.147+0000 7f8b59c89980 1 -- start start 2024-09-13T06:11:44.151 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.147+0000 7f8b59c89980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563322c29530 0x563322d1aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.151 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.147+0000 7f8b59c89980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x563322c30b90 con 0x563322c29530 2024-09-13T06:11:44.151 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.147+0000 7f8b57799640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563322c29530 0x563322d1aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.151 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.147+0000 7f8b57799640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563322c29530 0x563322d1aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44788/0 (socket says 172.21.15.194:44788) 2024-09-13T06:11:44.151 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.147+0000 7f8b57799640 1 -- 172.21.15.194:0/3870610721 learned_addr learned my addr 172.21.15.194:0/3870610721 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:44.152 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.147+0000 7f8b57799640 1 -- 172.21.15.194:0/3870610721 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563322d1afa0 con 0x563322c29530 2024-09-13T06:11:44.153 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.147+0000 7f8b57799640 1 --2- 172.21.15.194:0/3870610721 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563322c29530 0x563322d1aa60 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f8b480030b0 tx=0x7f8b48018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.153 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.147+0000 7f8a43e07640 1 -- 172.21.15.194:0/3870610721 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b480c5070 con 0x563322c29530 2024-09-13T06:11:44.153 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.147+0000 7f8a43e07640 1 -- 172.21.15.194:0/3870610721 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b480b6970 con 0x563322c29530 2024-09-13T06:11:44.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.147+0000 7f8b59c89980 1 -- 172.21.15.194:0/3870610721 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563322d1b230 con 0x563322c29530 2024-09-13T06:11:44.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.147+0000 7f8a43e07640 1 -- 172.21.15.194:0/3870610721 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b480b0050 con 0x563322c29530 2024-09-13T06:11:44.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.147+0000 7f8b59c89980 1 -- 172.21.15.194:0/3870610721 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563322d1df10 con 0x563322c29530 2024-09-13T06:11:44.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.151+0000 7f8b59c89980 1 Processor -- start 2024-09-13T06:11:44.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.151+0000 7f8b59c89980 1 -- start start 2024-09-13T06:11:44.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.151+0000 7f8b59c89980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563322d27850 0x563322d27c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.151+0000 7f8b59c89980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x563322b31800 con 0x563322d27850 2024-09-13T06:11:44.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.151+0000 7f8a43e07640 1 -- 172.21.15.194:0/3870610721 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8b480c8070 con 0x563322c29530 2024-09-13T06:11:44.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.151+0000 7f8a43e07640 1 --2- 172.21.15.194:0/3870610721 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8a3c034650 0x7f8a3c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.151+0000 7f8a43e07640 1 -- 172.21.15.194:0/3870610721 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f8b480bc070 con 0x563322c29530 2024-09-13T06:11:44.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.151+0000 7f8b57f9a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563322d27850 0x563322d27c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.151+0000 7f8b57f9a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563322d27850 0x563322d27c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44796/0 (socket says 172.21.15.194:44796) 2024-09-13T06:11:44.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.151+0000 7f8b57f9a640 1 -- 172.21.15.194:0/3433128489 learned_addr learned my addr 172.21.15.194:0/3433128489 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:44.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.151+0000 7f8b57799640 1 --2- 172.21.15.194:0/3870610721 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8a3c034650 0x7f8a3c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.151+0000 7f8b57f9a640 1 -- 172.21.15.194:0/3433128489 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563322d28190 con 0x563322d27850 2024-09-13T06:11:44.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.151+0000 7f8b57799640 1 --2- 172.21.15.194:0/3870610721 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8a3c034650 0x7f8a3c036b10 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8b480b5540 tx=0x7f8b480b53d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.151+0000 7f8b57f9a640 1 --2- 172.21.15.194:0/3433128489 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563322d27850 0x563322d27c50 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f8b5000a430 tx=0x7f8b5000a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=846087bda95f889b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.151+0000 7f8a41e03640 1 -- 172.21.15.194:0/3433128489 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b5000f6e0 con 0x563322d27850 2024-09-13T06:11:44.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.151+0000 7f8a41e03640 1 -- 172.21.15.194:0/3433128489 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b50015070 con 0x563322d27850 2024-09-13T06:11:44.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.151+0000 7f8a41e03640 1 -- 172.21.15.194:0/3433128489 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b5000fa10 con 0x563322d27850 2024-09-13T06:11:44.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.151+0000 7f8b59c89980 1 -- 172.21.15.194:0/3433128489 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563322d27850 msgr2=0x563322d27c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.151+0000 7f8b59c89980 1 --2- 172.21.15.194:0/3433128489 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563322d27850 0x563322d27c50 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f8b5000a430 tx=0x7f8b5000a8f0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.151+0000 7f8b59c89980 1 -- 172.21.15.194:0/3433128489 shutdown_connections 2024-09-13T06:11:44.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.151+0000 7f8b59c89980 1 --2- 172.21.15.194:0/3433128489 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563322d27850 0x563322d27c50 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.151+0000 7f8b59c89980 1 -- 172.21.15.194:0/3433128489 >> 172.21.15.194:0/3433128489 conn(0x563322c29e80 msgr2=0x563322d23160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:44.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.151+0000 7f8b59c89980 1 -- 172.21.15.194:0/3433128489 shutdown_connections 2024-09-13T06:11:44.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.151+0000 7f8b59c89980 1 -- 172.21.15.194:0/3433128489 wait complete. 2024-09-13T06:11:44.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.151+0000 7f8b59c89980 1 Processor -- start 2024-09-13T06:11:44.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.151+0000 7f8b59c89980 1 -- start start 2024-09-13T06:11:44.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.151+0000 7f8b59c89980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563322d27850 0x563322d2ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.151+0000 7f8b59c89980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x563322d28420 con 0x563322d27850 2024-09-13T06:11:44.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.151+0000 7f8b57f9a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563322d27850 0x563322d2ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.151+0000 7f8b57f9a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563322d27850 0x563322d2ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44804/0 (socket says 172.21.15.194:44804) 2024-09-13T06:11:44.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.151+0000 7f8b57f9a640 1 -- 172.21.15.194:0/2225166995 learned_addr learned my addr 172.21.15.194:0/2225166995 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:44.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.155+0000 7f8b57f9a640 1 -- 172.21.15.194:0/2225166995 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563322d2f0f0 con 0x563322d27850 2024-09-13T06:11:44.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.155+0000 7f8b57f9a640 1 --2- 172.21.15.194:0/2225166995 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563322d27850 0x563322d2ebb0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x563322d28600 tx=0x7f8b50003380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.155+0000 7f8a33fff640 1 -- 172.21.15.194:0/2225166995 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b5000fe00 con 0x563322d27850 2024-09-13T06:11:44.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.155+0000 7f8a33fff640 1 -- 172.21.15.194:0/2225166995 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b50010a20 con 0x563322d27850 2024-09-13T06:11:44.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.155+0000 7f8a33fff640 1 -- 172.21.15.194:0/2225166995 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b50010dc0 con 0x563322d27850 2024-09-13T06:11:44.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.155+0000 7f8b59c89980 1 -- 172.21.15.194:0/2225166995 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563322d2f380 con 0x563322d27850 2024-09-13T06:11:44.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.155+0000 7f8b59c89980 1 -- 172.21.15.194:0/2225166995 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563322d2f790 con 0x563322d27850 2024-09-13T06:11:44.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.155+0000 7f8a33fff640 1 -- 172.21.15.194:0/2225166995 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8b5001a480 con 0x563322d27850 2024-09-13T06:11:44.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.155+0000 7f8a33fff640 1 --2- 172.21.15.194:0/2225166995 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8a380346a0 0x7f8a38036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.155+0000 7f8a33fff640 1 -- 172.21.15.194:0/2225166995 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f8b5004a5e0 con 0x563322d27850 2024-09-13T06:11:44.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.155+0000 7f8b56f98640 1 --2- 172.21.15.194:0/2225166995 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8a380346a0 0x7f8a38036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.155+0000 7f8b56f98640 1 --2- 172.21.15.194:0/2225166995 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8a380346a0 0x7f8a38036b60 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c000f70 tx=0x7f8b4c001240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.155+0000 7f8b59c89980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:11:44.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.155+0000 7f8b59c89980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:11:44.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.155+0000 7f8b59c89980 1 Processor -- start 2024-09-13T06:11:44.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.155+0000 7f8b59c89980 1 -- start start 2024-09-13T06:11:44.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.159+0000 7f8b59c89980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563322d483f0 0x563322d48810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.159+0000 7f8b59c89980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x563322d14100 con 0x563322d483f0 2024-09-13T06:11:44.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.159+0000 7f8b57799640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563322d483f0 0x563322d48810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.159+0000 7f8b57799640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563322d483f0 0x563322d48810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44820/0 (socket says 172.21.15.194:44820) 2024-09-13T06:11:44.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.159+0000 7f8b57799640 1 -- 172.21.15.194:0/4092012137 learned_addr learned my addr 172.21.15.194:0/4092012137 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:44.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.159+0000 7f8b57799640 1 -- 172.21.15.194:0/4092012137 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563322d48de0 con 0x563322d483f0 2024-09-13T06:11:44.163 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.159+0000 7f8b57799640 1 --2- 172.21.15.194:0/4092012137 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563322d483f0 0x563322d48810 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f8b480c9fd0 tx=0x7f8b480ade20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.163 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.159+0000 7f89a7fff640 1 -- 172.21.15.194:0/4092012137 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b480b44a0 con 0x563322d483f0 2024-09-13T06:11:44.163 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.159+0000 7f8b59c89980 1 -- 172.21.15.194:0/4092012137 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563322d4ba60 con 0x563322d483f0 2024-09-13T06:11:44.163 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.159+0000 7f89a7fff640 1 -- 172.21.15.194:0/4092012137 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b480e8070 con 0x563322d483f0 2024-09-13T06:11:44.163 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.159+0000 7f89a7fff640 1 -- 172.21.15.194:0/4092012137 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b480aaa50 con 0x563322d483f0 2024-09-13T06:11:44.164 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.159+0000 7f8b59c89980 1 -- 172.21.15.194:0/4092012137 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563322d4be10 con 0x563322d483f0 2024-09-13T06:11:44.164 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.159+0000 7f89a7fff640 1 -- 172.21.15.194:0/4092012137 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8b480c9780 con 0x563322d483f0 2024-09-13T06:11:44.164 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.159+0000 7f89a7fff640 1 --2- 172.21.15.194:0/4092012137 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f89980346a0 0x7f8998036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.164 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.159+0000 7f89a7fff640 1 -- 172.21.15.194:0/4092012137 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f8b480df070 con 0x563322d483f0 2024-09-13T06:11:44.164 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.159+0000 7f8b56f98640 1 --2- 172.21.15.194:0/4092012137 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f89980346a0 0x7f8998036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.164 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.159+0000 7f89a5ffb640 20 reqs_thread_entry: start 2024-09-13T06:11:44.164 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.159+0000 7f8b59c89980 1 --2- 172.21.15.194:0/3870610721 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x563322d4df70 0x563322d50400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.164 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.159+0000 7f8b59c89980 1 -- 172.21.15.194:0/3870610721 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563322d50a80 con 0x563322d4df70 2024-09-13T06:11:44.164 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.159+0000 7f8b56f98640 1 --2- 172.21.15.194:0/4092012137 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f89980346a0 0x7f8998036b60 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x563322d23d00 tx=0x7f8b4c00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.164 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.159+0000 7f8b57f9a640 1 --2- 172.21.15.194:0/3870610721 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x563322d4df70 0x563322d50400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.165 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.159+0000 7f8b57f9a640 1 --2- 172.21.15.194:0/3870610721 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x563322d4df70 0x563322d50400 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.166 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.163+0000 7f8b57f9a640 1 -- 172.21.15.194:0/3870610721 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b5000e070 con 0x563322d4df70 2024-09-13T06:11:44.166 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.163+0000 7f8b59c89980 1 -- 172.21.15.194:0/3870610721 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563322d513b0 con 0x563322d4df70 2024-09-13T06:11:44.166 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.163+0000 7f8b57f9a640 1 -- 172.21.15.194:0/3870610721 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8b5000e070 con 0x563322d4df70 2024-09-13T06:11:44.166 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.163+0000 7f8b59c89980 1 --2- 172.21.15.194:0/3870610721 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x563322d52c70 0x563322d55100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.166 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.163+0000 7f8b59c89980 1 -- 172.21.15.194:0/3870610721 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563322d557f0 con 0x563322d52c70 2024-09-13T06:11:44.166 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.163+0000 7f8b57799640 1 --2- 172.21.15.194:0/3870610721 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x563322d52c70 0x563322d55100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.166 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.163+0000 7f8b57799640 1 --2- 172.21.15.194:0/3870610721 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x563322d52c70 0x563322d55100 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.166 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.163+0000 7f8b57799640 1 -- 172.21.15.194:0/3870610721 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7f8b480c7030 con 0x563322d52c70 2024-09-13T06:11:44.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.163+0000 7f8b59c89980 1 -- 172.21.15.194:0/2225166995 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8a380346a0 msgr2=0x7f8a38036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.163+0000 7f8b59c89980 1 --2- 172.21.15.194:0/2225166995 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8a380346a0 0x7f8a38036b60 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c000f70 tx=0x7f8b4c001240 comp rx=0 tx=0).stop 2024-09-13T06:11:44.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.163+0000 7f8b59c89980 1 -- 172.21.15.194:0/2225166995 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563322d27850 msgr2=0x563322d2ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.163+0000 7f8b59c89980 1 --2- 172.21.15.194:0/2225166995 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563322d27850 0x563322d2ebb0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x563322d28600 tx=0x7f8b50003380 comp rx=0 tx=0).stop 2024-09-13T06:11:44.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.163+0000 7f8b59c89980 1 -- 172.21.15.194:0/2225166995 shutdown_connections 2024-09-13T06:11:44.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.163+0000 7f8b59c89980 1 --2- 172.21.15.194:0/2225166995 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8a380346a0 0x7f8a38036b60 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.163+0000 7f8b59c89980 1 --2- 172.21.15.194:0/2225166995 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563322d27850 0x563322d2ebb0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.163+0000 7f8b59c89980 1 -- 172.21.15.194:0/2225166995 >> 172.21.15.194:0/2225166995 conn(0x563322c29e80 msgr2=0x563322d22d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:44.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.163+0000 7f8b59c89980 1 -- 172.21.15.194:0/2225166995 shutdown_connections 2024-09-13T06:11:44.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.163+0000 7f8b59c89980 1 -- 172.21.15.194:0/2225166995 wait complete. 2024-09-13T06:11:44.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.163+0000 7f8b59c89980 1 -- 172.21.15.194:0/4092012137 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f89980346a0 msgr2=0x7f8998036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.163+0000 7f8b59c89980 1 --2- 172.21.15.194:0/4092012137 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f89980346a0 0x7f8998036b60 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x563322d23d00 tx=0x7f8b4c00f000 comp rx=0 tx=0).stop 2024-09-13T06:11:44.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.163+0000 7f8b59c89980 1 -- 172.21.15.194:0/4092012137 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563322d483f0 msgr2=0x563322d48810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.163+0000 7f8b59c89980 1 --2- 172.21.15.194:0/4092012137 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563322d483f0 0x563322d48810 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f8b480c9fd0 tx=0x7f8b480ade20 comp rx=0 tx=0).stop 2024-09-13T06:11:44.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.163+0000 7f8b59c89980 1 -- 172.21.15.194:0/4092012137 shutdown_connections 2024-09-13T06:11:44.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.163+0000 7f8b59c89980 1 --2- 172.21.15.194:0/4092012137 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f89980346a0 0x7f8998036b60 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.163+0000 7f8b59c89980 1 --2- 172.21.15.194:0/4092012137 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563322d483f0 0x563322d48810 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.163+0000 7f8b59c89980 1 -- 172.21.15.194:0/4092012137 >> 172.21.15.194:0/4092012137 conn(0x563322d3d3c0 msgr2=0x563322d3fcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:44.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.163+0000 7f8b59c89980 1 -- 172.21.15.194:0/4092012137 shutdown_connections 2024-09-13T06:11:44.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.163+0000 7f8b59c89980 1 -- 172.21.15.194:0/4092012137 wait complete. 2024-09-13T06:11:44.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.163+0000 7f8b59c89980 1 -- 172.21.15.194:0/3870610721 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x563322d4df70 msgr2=0x563322d50400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.163+0000 7f8b59c89980 1 --2- 172.21.15.194:0/3870610721 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x563322d4df70 0x563322d50400 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.163+0000 7f8b59c89980 1 -- 172.21.15.194:0/3870610721 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x563322d52c70 msgr2=0x563322d55100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.163+0000 7f8b59c89980 1 --2- 172.21.15.194:0/3870610721 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x563322d52c70 0x563322d55100 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.163+0000 7f8b59c89980 1 -- 172.21.15.194:0/3870610721 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8a3c034650 msgr2=0x7f8a3c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.163+0000 7f8b59c89980 1 --2- 172.21.15.194:0/3870610721 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8a3c034650 0x7f8a3c036b10 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8b480b5540 tx=0x7f8b480b53d0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.163+0000 7f8b59c89980 1 -- 172.21.15.194:0/3870610721 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563322c29530 msgr2=0x563322d1aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.163+0000 7f8b59c89980 1 --2- 172.21.15.194:0/3870610721 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563322c29530 0x563322d1aa60 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f8b480030b0 tx=0x7f8b48018020 comp rx=0 tx=0).stop 2024-09-13T06:11:44.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.163+0000 7f8b59c89980 1 -- 172.21.15.194:0/3870610721 shutdown_connections 2024-09-13T06:11:44.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.163+0000 7f8b59c89980 1 --2- 172.21.15.194:0/3870610721 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x563322d52c70 0x563322d55100 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.163+0000 7f8b59c89980 1 --2- 172.21.15.194:0/3870610721 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x563322d4df70 0x563322d50400 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.163+0000 7f8b59c89980 1 --2- 172.21.15.194:0/3870610721 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8a3c034650 0x7f8a3c036b10 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.163+0000 7f8b59c89980 1 --2- 172.21.15.194:0/3870610721 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563322c29530 0x563322d1aa60 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.163+0000 7f8b59c89980 1 -- 172.21.15.194:0/3870610721 >> 172.21.15.194:0/3870610721 conn(0x563322c25050 msgr2=0x563322d0e020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:44.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.163+0000 7f8b59c89980 1 -- 172.21.15.194:0/3870610721 shutdown_connections 2024-09-13T06:11:44.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.167+0000 7f8b59c89980 1 -- 172.21.15.194:0/3870610721 wait complete. 2024-09-13T06:11:44.179 INFO:teuthology.orchestra.run.smithi194.stdout:{"id":"52d5ffc2-b91b-4558-98ea-6defdf5151d8","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-13T06:11:44.179 DEBUG:tasks.util.rgw: json result: {'id': '52d5ffc2-b91b-4558-98ea-6defdf5151d8', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-13T06:11:44.179 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-13T06:11:44.179 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-13T06:11:44.179 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-09-13T06:11:44.258 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:11:44.258 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:11:44.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.255+0000 7f455e8ba980 1 Processor -- start 2024-09-13T06:11:44.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.255+0000 7f455e8ba980 1 -- start start 2024-09-13T06:11:44.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.255+0000 7f455e8ba980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x5581a664c8f0 0x5581a664ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.255+0000 7f455e8ba980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5581a64d1ae0 con 0x5581a6648520 2024-09-13T06:11:44.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.255+0000 7f455e8ba980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x5581a64f5e30 con 0x5581a664c8f0 2024-09-13T06:11:44.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.255+0000 7f455bbc9640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x5581a664c8f0 0x5581a664ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.255+0000 7f455c3ca640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x5581a6648520 0x5581a6648900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:58338/0 (socket says 172.21.15.194:58338) 2024-09-13T06:11:44.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.255+0000 7f455c3ca640 1 -- 172.21.15.194:0/3638050292 learned_addr learned my addr 172.21.15.194:0/3638050292 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-09-13T06:11:44.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.259+0000 7f455bbc9640 1 -- 172.21.15.194:0/3638050292 >> v1:172.21.15.120:6789/0 conn(0x5581a6648520 legacy=0x5581a6648900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.259+0000 7f455bbc9640 1 -- 172.21.15.194:0/3638050292 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581a6650230 con 0x5581a664c8f0 2024-09-13T06:11:44.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.259+0000 7f455bbc9640 1 --2- 172.21.15.194:0/3638050292 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5581a664c8f0 0x5581a664ece0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f455000a480 tx=0x7f455001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=499cea82935de354 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.259+0000 7f455b3c8640 1 -- 172.21.15.194:0/3638050292 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45500b0070 con 0x5581a664c8f0 2024-09-13T06:11:44.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.259+0000 7f455b3c8640 1 -- 172.21.15.194:0/3638050292 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45500ab540 con 0x5581a664c8f0 2024-09-13T06:11:44.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.259+0000 7f455b3c8640 1 -- 172.21.15.194:0/3638050292 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45500ab840 con 0x5581a664c8f0 2024-09-13T06:11:44.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.259+0000 7f455e8ba980 1 -- 172.21.15.194:0/3638050292 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5581a664c8f0 msgr2=0x5581a664ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.259+0000 7f455e8ba980 1 --2- 172.21.15.194:0/3638050292 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5581a664c8f0 0x5581a664ece0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f455000a480 tx=0x7f455001b280 comp rx=0 tx=0).stop 2024-09-13T06:11:44.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.259+0000 7f455e8ba980 1 -- 172.21.15.194:0/3638050292 shutdown_connections 2024-09-13T06:11:44.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.259+0000 7f455e8ba980 1 --2- 172.21.15.194:0/3638050292 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5581a664c8f0 0x5581a664ece0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.259+0000 7f455e8ba980 1 -- 172.21.15.194:0/3638050292 >> 172.21.15.194:0/3638050292 conn(0x5581a6644040 msgr2=0x5581a6646460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:44.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.259+0000 7f455e8ba980 1 -- 172.21.15.194:0/3638050292 shutdown_connections 2024-09-13T06:11:44.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.259+0000 7f455e8ba980 1 -- 172.21.15.194:0/3638050292 wait complete. 2024-09-13T06:11:44.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.275+0000 7f455e8ba980 1 Processor -- start 2024-09-13T06:11:44.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.275+0000 7f455e8ba980 1 -- start start 2024-09-13T06:11:44.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.275+0000 7f455e8ba980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5581a6648520 0x5581a6733960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.275+0000 7f455e8ba980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5581a64f7200 con 0x5581a6648520 2024-09-13T06:11:44.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.275+0000 7f455c3ca640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5581a6648520 0x5581a6733960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.275+0000 7f455c3ca640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5581a6648520 0x5581a6733960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44840/0 (socket says 172.21.15.194:44840) 2024-09-13T06:11:44.280 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.275+0000 7f455c3ca640 1 -- 172.21.15.194:0/1057295308 learned_addr learned my addr 172.21.15.194:0/1057295308 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:44.280 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.275+0000 7f455c3ca640 1 -- 172.21.15.194:0/1057295308 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581a6733f30 con 0x5581a6648520 2024-09-13T06:11:44.280 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.279+0000 7f455c3ca640 1 --2- 172.21.15.194:0/1057295308 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5581a6648520 0x5581a6733960 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f45540015f0 tx=0x7f4554001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49d2f777cb9f015d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.280 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.279+0000 7f444a60c640 1 -- 172.21.15.194:0/1057295308 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4554004530 con 0x5581a6648520 2024-09-13T06:11:44.280 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.279+0000 7f444a60c640 1 -- 172.21.15.194:0/1057295308 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45540046f0 con 0x5581a6648520 2024-09-13T06:11:44.281 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.279+0000 7f444a60c640 1 -- 172.21.15.194:0/1057295308 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4554004a90 con 0x5581a6648520 2024-09-13T06:11:44.282 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.279+0000 7f455e8ba980 1 -- 172.21.15.194:0/1057295308 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5581a6648520 msgr2=0x5581a6733960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.282 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.279+0000 7f455e8ba980 1 --2- 172.21.15.194:0/1057295308 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5581a6648520 0x5581a6733960 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f45540015f0 tx=0x7f4554001ab0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.282 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.279+0000 7f455e8ba980 1 -- 172.21.15.194:0/1057295308 shutdown_connections 2024-09-13T06:11:44.282 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.279+0000 7f455e8ba980 1 --2- 172.21.15.194:0/1057295308 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5581a6648520 0x5581a6733960 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.282 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.279+0000 7f455e8ba980 1 -- 172.21.15.194:0/1057295308 >> 172.21.15.194:0/1057295308 conn(0x5581a6644040 msgr2=0x5581a672f590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:44.282 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.279+0000 7f455e8ba980 1 -- 172.21.15.194:0/1057295308 shutdown_connections 2024-09-13T06:11:44.282 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.279+0000 7f455e8ba980 1 -- 172.21.15.194:0/1057295308 wait complete. 2024-09-13T06:11:44.282 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.279+0000 7f455e8ba980 1 Processor -- start 2024-09-13T06:11:44.282 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.279+0000 7f455e8ba980 1 -- start start 2024-09-13T06:11:44.282 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.279+0000 7f455e8ba980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5581a6648520 0x5581a673e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.283 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.279+0000 7f455e8ba980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5581a664fd30 con 0x5581a6648520 2024-09-13T06:11:44.283 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.279+0000 7f455c3ca640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5581a6648520 0x5581a673e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.283 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.279+0000 7f455c3ca640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5581a6648520 0x5581a673e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44842/0 (socket says 172.21.15.194:44842) 2024-09-13T06:11:44.283 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.279+0000 7f455c3ca640 1 -- 172.21.15.194:0/3365965103 learned_addr learned my addr 172.21.15.194:0/3365965103 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:44.285 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.279+0000 7f455c3ca640 1 -- 172.21.15.194:0/3365965103 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581a673e610 con 0x5581a6648520 2024-09-13T06:11:44.285 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.279+0000 7f455c3ca640 1 --2- 172.21.15.194:0/3365965103 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5581a6648520 0x5581a673e0d0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x5581a6734b40 tx=0x7f4554000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.285 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.279+0000 7f4448e09640 1 -- 172.21.15.194:0/3365965103 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4554013760 con 0x5581a6648520 2024-09-13T06:11:44.285 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.279+0000 7f455e8ba980 1 -- 172.21.15.194:0/3365965103 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5581a673e8a0 con 0x5581a6648520 2024-09-13T06:11:44.286 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.279+0000 7f4448e09640 1 -- 172.21.15.194:0/3365965103 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4554013900 con 0x5581a6648520 2024-09-13T06:11:44.286 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.279+0000 7f4448e09640 1 -- 172.21.15.194:0/3365965103 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4554013be0 con 0x5581a6648520 2024-09-13T06:11:44.286 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.279+0000 7f455e8ba980 1 -- 172.21.15.194:0/3365965103 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581a6741580 con 0x5581a6648520 2024-09-13T06:11:44.286 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.283+0000 7f455e8ba980 1 Processor -- start 2024-09-13T06:11:44.286 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.283+0000 7f455e8ba980 1 -- start start 2024-09-13T06:11:44.286 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.283+0000 7f455e8ba980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5581a674aec0 0x5581a674b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.286 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.283+0000 7f455e8ba980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5581a6550800 con 0x5581a674aec0 2024-09-13T06:11:44.286 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.283+0000 7f4448e09640 1 -- 172.21.15.194:0/3365965103 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4554010070 con 0x5581a6648520 2024-09-13T06:11:44.286 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.283+0000 7f455cbcb640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5581a674aec0 0x5581a674b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.286 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.283+0000 7f455cbcb640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5581a674aec0 0x5581a674b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44858/0 (socket says 172.21.15.194:44858) 2024-09-13T06:11:44.286 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.283+0000 7f455cbcb640 1 -- 172.21.15.194:0/342671966 learned_addr learned my addr 172.21.15.194:0/342671966 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:44.286 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.283+0000 7f4448e09640 1 --2- 172.21.15.194:0/3365965103 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4444034650 0x7f4444036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.286 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.283+0000 7f4448e09640 1 -- 172.21.15.194:0/3365965103 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f4554018070 con 0x5581a6648520 2024-09-13T06:11:44.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.283+0000 7f455c3ca640 1 --2- 172.21.15.194:0/3365965103 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4444034650 0x7f4444036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.283+0000 7f455cbcb640 1 -- 172.21.15.194:0/342671966 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581a674b800 con 0x5581a674aec0 2024-09-13T06:11:44.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.283+0000 7f455cbcb640 1 --2- 172.21.15.194:0/342671966 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5581a674aec0 0x5581a674b2c0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f454c00a440 tx=0x7f454c00a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=942d727616bb312 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.283+0000 7f455c3ca640 1 --2- 172.21.15.194:0/3365965103 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4444034650 0x7f4444036b10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f45540108e0 tx=0x7f4554010770 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.283+0000 7f44427fc640 1 -- 172.21.15.194:0/342671966 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f454c008850 con 0x5581a674aec0 2024-09-13T06:11:44.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.283+0000 7f44427fc640 1 -- 172.21.15.194:0/342671966 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f454c008a10 con 0x5581a674aec0 2024-09-13T06:11:44.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.283+0000 7f44427fc640 1 -- 172.21.15.194:0/342671966 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f454c008d30 con 0x5581a674aec0 2024-09-13T06:11:44.290 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.283+0000 7f455e8ba980 1 -- 172.21.15.194:0/342671966 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5581a674aec0 msgr2=0x5581a674b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.290 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.283+0000 7f455e8ba980 1 --2- 172.21.15.194:0/342671966 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5581a674aec0 0x5581a674b2c0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f454c00a440 tx=0x7f454c00a900 comp rx=0 tx=0).stop 2024-09-13T06:11:44.290 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.283+0000 7f455e8ba980 1 -- 172.21.15.194:0/342671966 shutdown_connections 2024-09-13T06:11:44.290 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.283+0000 7f455e8ba980 1 --2- 172.21.15.194:0/342671966 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5581a674aec0 0x5581a674b2c0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.290 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.283+0000 7f455e8ba980 1 -- 172.21.15.194:0/342671966 >> 172.21.15.194:0/342671966 conn(0x5581a664c8f0 msgr2=0x5581a67467d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:44.290 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.283+0000 7f455e8ba980 1 -- 172.21.15.194:0/342671966 shutdown_connections 2024-09-13T06:11:44.290 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.283+0000 7f455e8ba980 1 -- 172.21.15.194:0/342671966 wait complete. 2024-09-13T06:11:44.290 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.283+0000 7f455e8ba980 1 Processor -- start 2024-09-13T06:11:44.291 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.283+0000 7f455e8ba980 1 -- start start 2024-09-13T06:11:44.291 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.283+0000 7f455e8ba980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5581a674aec0 0x5581a67521e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.291 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.283+0000 7f455e8ba980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5581a674c1e0 con 0x5581a674aec0 2024-09-13T06:11:44.291 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.283+0000 7f455cbcb640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5581a674aec0 0x5581a67521e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.291 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.283+0000 7f455cbcb640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5581a674aec0 0x5581a67521e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44868/0 (socket says 172.21.15.194:44868) 2024-09-13T06:11:44.291 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.283+0000 7f455cbcb640 1 -- 172.21.15.194:0/974455678 learned_addr learned my addr 172.21.15.194:0/974455678 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:44.291 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.283+0000 7f455cbcb640 1 -- 172.21.15.194:0/974455678 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581a6752720 con 0x5581a674aec0 2024-09-13T06:11:44.291 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.287+0000 7f455cbcb640 1 --2- 172.21.15.194:0/974455678 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5581a674aec0 0x5581a67521e0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x5581a674bc70 tx=0x7f454c003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.291 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.287+0000 7f4440ff9640 1 -- 172.21.15.194:0/974455678 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f454c013a70 con 0x5581a674aec0 2024-09-13T06:11:44.291 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.287+0000 7f4440ff9640 1 -- 172.21.15.194:0/974455678 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f454c023070 con 0x5581a674aec0 2024-09-13T06:11:44.291 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.287+0000 7f455e8ba980 1 -- 172.21.15.194:0/974455678 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5581a67529b0 con 0x5581a674aec0 2024-09-13T06:11:44.291 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.287+0000 7f4440ff9640 1 -- 172.21.15.194:0/974455678 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f454c013d40 con 0x5581a674aec0 2024-09-13T06:11:44.292 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.287+0000 7f455e8ba980 1 -- 172.21.15.194:0/974455678 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581a6755690 con 0x5581a674aec0 2024-09-13T06:11:44.292 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.287+0000 7f4440ff9640 1 -- 172.21.15.194:0/974455678 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f454c028460 con 0x5581a674aec0 2024-09-13T06:11:44.292 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.287+0000 7f455e8ba980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:11:44.292 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.287+0000 7f455e8ba980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:11:44.292 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.287+0000 7f4440ff9640 1 --2- 172.21.15.194:0/974455678 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4434034650 0x7f4434036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.292 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.287+0000 7f4440ff9640 1 -- 172.21.15.194:0/974455678 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f454c04a100 con 0x5581a674aec0 2024-09-13T06:11:44.292 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.287+0000 7f455bbc9640 1 --2- 172.21.15.194:0/974455678 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4434034650 0x7f4434036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.292 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.287+0000 7f455e8ba980 1 Processor -- start 2024-09-13T06:11:44.292 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.287+0000 7f455e8ba980 1 -- start start 2024-09-13T06:11:44.292 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.287+0000 7f455e8ba980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5581a676ba40 0x5581a676be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.292 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.287+0000 7f455e8ba980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5581a67342b0 con 0x5581a676ba40 2024-09-13T06:11:44.292 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.287+0000 7f455bbc9640 1 --2- 172.21.15.194:0/974455678 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4434034650 0x7f4434036b10 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f45500ad000 tx=0x7f45500a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.295 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.287+0000 7f455c3ca640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5581a676ba40 0x5581a676be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.295 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.287+0000 7f455c3ca640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5581a676ba40 0x5581a676be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44882/0 (socket says 172.21.15.194:44882) 2024-09-13T06:11:44.295 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.287+0000 7f455c3ca640 1 -- 172.21.15.194:0/2161093582 learned_addr learned my addr 172.21.15.194:0/2161093582 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:44.295 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.287+0000 7f455c3ca640 1 -- 172.21.15.194:0/2161093582 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581a676c410 con 0x5581a676ba40 2024-09-13T06:11:44.295 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.287+0000 7f455c3ca640 1 --2- 172.21.15.194:0/2161093582 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5581a676ba40 0x5581a676be40 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f45540483d0 tx=0x7f4554010540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.295 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.287+0000 7f4420fe1640 1 -- 172.21.15.194:0/2161093582 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4554029680 con 0x5581a676ba40 2024-09-13T06:11:44.295 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.291+0000 7f455e8ba980 1 -- 172.21.15.194:0/2161093582 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5581a676f0b0 con 0x5581a676ba40 2024-09-13T06:11:44.295 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.291+0000 7f4420fe1640 1 -- 172.21.15.194:0/2161093582 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4554029820 con 0x5581a676ba40 2024-09-13T06:11:44.295 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.291+0000 7f4420fe1640 1 -- 172.21.15.194:0/2161093582 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4554020790 con 0x5581a676ba40 2024-09-13T06:11:44.296 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.291+0000 7f455e8ba980 1 -- 172.21.15.194:0/2161093582 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581a676f460 con 0x5581a676ba40 2024-09-13T06:11:44.296 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.291+0000 7f4420fe1640 1 -- 172.21.15.194:0/2161093582 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f455404c020 con 0x5581a676ba40 2024-09-13T06:11:44.296 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.291+0000 7f4420fe1640 1 --2- 172.21.15.194:0/2161093582 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f439c034650 0x7f439c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.296 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.291+0000 7f4420fe1640 1 -- 172.21.15.194:0/2161093582 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f455404fd10 con 0x5581a676ba40 2024-09-13T06:11:44.296 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.291+0000 7f455bbc9640 1 --2- 172.21.15.194:0/2161093582 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f439c034650 0x7f439c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.296 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.291+0000 7f43c27fc640 20 reqs_thread_entry: start 2024-09-13T06:11:44.296 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.291+0000 7f455e8ba980 1 --2- 172.21.15.194:0/3365965103 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5581a6771660 0x5581a6773b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.296 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.291+0000 7f455e8ba980 1 -- 172.21.15.194:0/3365965103 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5581a67741f0 con 0x5581a6771660 2024-09-13T06:11:44.296 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.291+0000 7f455bbc9640 1 --2- 172.21.15.194:0/2161093582 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f439c034650 0x7f439c036b10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4550000c10 tx=0x7f4550005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.296 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.291+0000 7f455cbcb640 1 --2- 172.21.15.194:0/3365965103 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5581a6771660 0x5581a6773b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.296 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.291+0000 7f455cbcb640 1 --2- 172.21.15.194:0/3365965103 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5581a6771660 0x5581a6773b20 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.296 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.291+0000 7f455cbcb640 1 -- 172.21.15.194:0/3365965103 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f454c01e7a0 con 0x5581a6771660 2024-09-13T06:11:44.296 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.291+0000 7f455e8ba980 1 --2- 172.21.15.194:0/3365965103 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5581a6776010 0x5581a6778400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.297 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.291+0000 7f455e8ba980 1 -- 172.21.15.194:0/3365965103 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:2 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5581a6778a50 con 0x5581a6776010 2024-09-13T06:11:44.297 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.291+0000 7f455c3ca640 1 --2- 172.21.15.194:0/3365965103 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5581a6776010 0x5581a6778400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.297 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.291+0000 7f455c3ca640 1 --2- 172.21.15.194:0/3365965103 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5581a6776010 0x5581a6778400 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.297 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.291+0000 7f455c3ca640 1 -- 172.21.15.194:0/3365965103 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(2 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7f455401b030 con 0x5581a6776010 2024-09-13T06:11:44.297 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.291+0000 7f455e8ba980 1 -- 172.21.15.194:0/3365965103 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5581a67754c0 con 0x5581a6776010 2024-09-13T06:11:44.298 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.295+0000 7f455c3ca640 1 -- 172.21.15.194:0/3365965103 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [stat,call,call,writefull 0~993] v35'4 uv4 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7f455401b030 con 0x5581a6776010 2024-09-13T06:11:44.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.295+0000 7f455e8ba980 1 -- 172.21.15.194:0/974455678 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4434034650 msgr2=0x7f4434036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.295+0000 7f455e8ba980 1 --2- 172.21.15.194:0/974455678 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4434034650 0x7f4434036b10 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f45500ad000 tx=0x7f45500a5040 comp rx=0 tx=0).stop 2024-09-13T06:11:44.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.295+0000 7f455e8ba980 1 -- 172.21.15.194:0/974455678 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5581a674aec0 msgr2=0x5581a67521e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.295+0000 7f455e8ba980 1 --2- 172.21.15.194:0/974455678 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5581a674aec0 0x5581a67521e0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x5581a674bc70 tx=0x7f454c003000 comp rx=0 tx=0).stop 2024-09-13T06:11:44.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.295+0000 7f455e8ba980 1 -- 172.21.15.194:0/974455678 shutdown_connections 2024-09-13T06:11:44.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.295+0000 7f455e8ba980 1 --2- 172.21.15.194:0/974455678 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4434034650 0x7f4434036b10 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.295+0000 7f455e8ba980 1 --2- 172.21.15.194:0/974455678 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5581a674aec0 0x5581a67521e0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.295+0000 7f455e8ba980 1 -- 172.21.15.194:0/974455678 >> 172.21.15.194:0/974455678 conn(0x5581a664c8f0 msgr2=0x5581a6746340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:44.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.295+0000 7f455e8ba980 1 -- 172.21.15.194:0/974455678 shutdown_connections 2024-09-13T06:11:44.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.295+0000 7f455e8ba980 1 -- 172.21.15.194:0/974455678 wait complete. 2024-09-13T06:11:44.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.295+0000 7f455e8ba980 1 -- 172.21.15.194:0/2161093582 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f439c034650 msgr2=0x7f439c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.295+0000 7f455e8ba980 1 --2- 172.21.15.194:0/2161093582 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f439c034650 0x7f439c036b10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4550000c10 tx=0x7f4550005a10 comp rx=0 tx=0).stop 2024-09-13T06:11:44.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.295+0000 7f455e8ba980 1 -- 172.21.15.194:0/2161093582 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5581a676ba40 msgr2=0x5581a676be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.295+0000 7f455e8ba980 1 --2- 172.21.15.194:0/2161093582 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5581a676ba40 0x5581a676be40 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f45540483d0 tx=0x7f4554010540 comp rx=0 tx=0).stop 2024-09-13T06:11:44.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.295+0000 7f455e8ba980 1 -- 172.21.15.194:0/2161093582 shutdown_connections 2024-09-13T06:11:44.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.295+0000 7f455e8ba980 1 --2- 172.21.15.194:0/2161093582 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f439c034650 0x7f439c036b10 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.295+0000 7f455e8ba980 1 --2- 172.21.15.194:0/2161093582 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5581a676ba40 0x5581a676be40 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.295+0000 7f455e8ba980 1 -- 172.21.15.194:0/2161093582 >> 172.21.15.194:0/2161093582 conn(0x5581a6760ad0 msgr2=0x5581a67633c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:44.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.295+0000 7f455e8ba980 1 -- 172.21.15.194:0/2161093582 shutdown_connections 2024-09-13T06:11:44.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.295+0000 7f455e8ba980 1 -- 172.21.15.194:0/2161093582 wait complete. 2024-09-13T06:11:44.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.299+0000 7f455e8ba980 1 -- 172.21.15.194:0/3365965103 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5581a6771660 msgr2=0x5581a6773b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.299+0000 7f455e8ba980 1 --2- 172.21.15.194:0/3365965103 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5581a6771660 0x5581a6773b20 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.303 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.299+0000 7f455e8ba980 1 -- 172.21.15.194:0/3365965103 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5581a6776010 msgr2=0x5581a6778400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.303 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.299+0000 7f455e8ba980 1 --2- 172.21.15.194:0/3365965103 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5581a6776010 0x5581a6778400 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.303 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.299+0000 7f455e8ba980 1 -- 172.21.15.194:0/3365965103 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4444034650 msgr2=0x7f4444036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.303 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.299+0000 7f455e8ba980 1 --2- 172.21.15.194:0/3365965103 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4444034650 0x7f4444036b10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f45540108e0 tx=0x7f4554010770 comp rx=0 tx=0).stop 2024-09-13T06:11:44.303 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.299+0000 7f455e8ba980 1 -- 172.21.15.194:0/3365965103 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5581a6648520 msgr2=0x5581a673e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.303 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.299+0000 7f455e8ba980 1 --2- 172.21.15.194:0/3365965103 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5581a6648520 0x5581a673e0d0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x5581a6734b40 tx=0x7f4554000f50 comp rx=0 tx=0).stop 2024-09-13T06:11:44.303 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.299+0000 7f455e8ba980 1 -- 172.21.15.194:0/3365965103 shutdown_connections 2024-09-13T06:11:44.303 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.299+0000 7f455e8ba980 1 --2- 172.21.15.194:0/3365965103 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5581a6776010 0x5581a6778400 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.303 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.299+0000 7f455e8ba980 1 --2- 172.21.15.194:0/3365965103 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5581a6771660 0x5581a6773b20 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.303 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.299+0000 7f455e8ba980 1 --2- 172.21.15.194:0/3365965103 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4444034650 0x7f4444036b10 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.303 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.299+0000 7f455e8ba980 1 --2- 172.21.15.194:0/3365965103 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5581a6648520 0x5581a673e0d0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.303 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.299+0000 7f455e8ba980 1 -- 172.21.15.194:0/3365965103 >> 172.21.15.194:0/3365965103 conn(0x5581a6644040 msgr2=0x5581a672e110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:44.303 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.299+0000 7f455e8ba980 1 -- 172.21.15.194:0/3365965103 shutdown_connections 2024-09-13T06:11:44.304 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.299+0000 7f455e8ba980 1 -- 172.21.15.194:0/3365965103 wait complete. 2024-09-13T06:11:44.310 INFO:teuthology.orchestra.run.smithi194.stdout:{"id":"52d5ffc2-b91b-4558-98ea-6defdf5151d8","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-13T06:11:44.310 DEBUG:tasks.util.rgw: json result: {'id': '52d5ffc2-b91b-4558-98ea-6defdf5151d8', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-13T06:11:44.311 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'get'] 2024-09-13T06:11:44.311 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'get'] 2024-09-13T06:11:44.311 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup get 2024-09-13T06:11:44.378 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:11:44.378 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:11:44.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.375+0000 7f43eab20980 1 Processor -- start 2024-09-13T06:11:44.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.375+0000 7f43eab20980 1 -- start start 2024-09-13T06:11:44.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.375+0000 7f43eab20980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x56254175d560 0x56254175d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.375+0000 7f43eab20980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5625415e6ae0 con 0x56254175deb0 2024-09-13T06:11:44.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.375+0000 7f43eab20980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x56254160ae30 con 0x56254175d560 2024-09-13T06:11:44.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.379+0000 7f43e8630640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x56254175d560 0x56254175d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.379+0000 7f43e7e2f640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x56254175deb0 0x5625417628e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:58348/0 (socket says 172.21.15.194:58348) 2024-09-13T06:11:44.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.379+0000 7f43e7e2f640 1 -- 172.21.15.194:0/2516450632 learned_addr learned my addr 172.21.15.194:0/2516450632 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-09-13T06:11:44.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.379+0000 7f43e8630640 1 -- 172.21.15.194:0/2516450632 >> v1:172.21.15.120:6789/0 conn(0x56254175deb0 legacy=0x5625417628e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.379+0000 7f43e8630640 1 -- 172.21.15.194:0/2516450632 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562541765130 con 0x56254175d560 2024-09-13T06:11:44.383 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.379+0000 7f43e8630640 1 --2- 172.21.15.194:0/2516450632 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56254175d560 0x56254175d940 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f43d800a480 tx=0x7f43d801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e322bff270480d12 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.383 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.379+0000 7f43e762e640 1 -- 172.21.15.194:0/2516450632 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43d80b0070 con 0x56254175d560 2024-09-13T06:11:44.383 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.379+0000 7f43e762e640 1 -- 172.21.15.194:0/2516450632 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43d80ab540 con 0x56254175d560 2024-09-13T06:11:44.383 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.379+0000 7f43e762e640 1 -- 172.21.15.194:0/2516450632 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43d80ab840 con 0x56254175d560 2024-09-13T06:11:44.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.383+0000 7f43eab20980 1 -- 172.21.15.194:0/2516450632 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56254175d560 msgr2=0x56254175d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.383+0000 7f43eab20980 1 --2- 172.21.15.194:0/2516450632 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56254175d560 0x56254175d940 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f43d800a480 tx=0x7f43d801b280 comp rx=0 tx=0).stop 2024-09-13T06:11:44.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.383+0000 7f43eab20980 1 -- 172.21.15.194:0/2516450632 shutdown_connections 2024-09-13T06:11:44.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.383+0000 7f43eab20980 1 --2- 172.21.15.194:0/2516450632 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56254175d560 0x56254175d940 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.385 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.383+0000 7f43eab20980 1 -- 172.21.15.194:0/2516450632 >> 172.21.15.194:0/2516450632 conn(0x562541759080 msgr2=0x56254175b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:44.385 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.383+0000 7f43eab20980 1 -- 172.21.15.194:0/2516450632 shutdown_connections 2024-09-13T06:11:44.385 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.383+0000 7f43eab20980 1 -- 172.21.15.194:0/2516450632 wait complete. 2024-09-13T06:11:44.398 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.395+0000 7f43eab20980 1 Processor -- start 2024-09-13T06:11:44.398 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.395+0000 7f43eab20980 1 -- start start 2024-09-13T06:11:44.398 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.395+0000 7f43eab20980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56254175d560 0x5625416d2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.398 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.395+0000 7f43eab20980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x56254160c200 con 0x56254175d560 2024-09-13T06:11:44.399 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.395+0000 7f43e8630640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56254175d560 0x5625416d2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.399 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.395+0000 7f43e8630640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56254175d560 0x5625416d2bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44908/0 (socket says 172.21.15.194:44908) 2024-09-13T06:11:44.399 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.395+0000 7f43e8630640 1 -- 172.21.15.194:0/2639714404 learned_addr learned my addr 172.21.15.194:0/2639714404 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:44.399 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.395+0000 7f43e8630640 1 -- 172.21.15.194:0/2639714404 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625416d31c0 con 0x56254175d560 2024-09-13T06:11:44.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.395+0000 7f43e8630640 1 --2- 172.21.15.194:0/2639714404 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56254175d560 0x5625416d2bf0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f43d80ae040 tx=0x7f43d8003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e278030ce067e86 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.399+0000 7f42d660c640 1 -- 172.21.15.194:0/2639714404 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43d80b0040 con 0x56254175d560 2024-09-13T06:11:44.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.399+0000 7f42d660c640 1 -- 172.21.15.194:0/2639714404 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43d80ab9b0 con 0x56254175d560 2024-09-13T06:11:44.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.399+0000 7f42d660c640 1 -- 172.21.15.194:0/2639714404 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43d80abc90 con 0x56254175d560 2024-09-13T06:11:44.402 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.399+0000 7f43eab20980 1 -- 172.21.15.194:0/2639714404 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56254175d560 msgr2=0x5625416d2bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.402 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.399+0000 7f43eab20980 1 --2- 172.21.15.194:0/2639714404 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56254175d560 0x5625416d2bf0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f43d80ae040 tx=0x7f43d8003030 comp rx=0 tx=0).stop 2024-09-13T06:11:44.402 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.399+0000 7f43eab20980 1 -- 172.21.15.194:0/2639714404 shutdown_connections 2024-09-13T06:11:44.402 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.399+0000 7f43eab20980 1 --2- 172.21.15.194:0/2639714404 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56254175d560 0x5625416d2bf0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.402 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.399+0000 7f43eab20980 1 -- 172.21.15.194:0/2639714404 >> 172.21.15.194:0/2639714404 conn(0x562541759080 msgr2=0x562541844550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:44.402 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.399+0000 7f43eab20980 1 -- 172.21.15.194:0/2639714404 shutdown_connections 2024-09-13T06:11:44.402 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.399+0000 7f43eab20980 1 -- 172.21.15.194:0/2639714404 wait complete. 2024-09-13T06:11:44.402 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.399+0000 7f43eab20980 1 Processor -- start 2024-09-13T06:11:44.403 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.399+0000 7f43eab20980 1 -- start start 2024-09-13T06:11:44.403 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.399+0000 7f43eab20980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56254175d560 0x562541850bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.403 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.399+0000 7f43eab20980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x562541764b70 con 0x56254175d560 2024-09-13T06:11:44.403 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.399+0000 7f43e8630640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56254175d560 0x562541850bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.403 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.399+0000 7f43e8630640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56254175d560 0x562541850bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44918/0 (socket says 172.21.15.194:44918) 2024-09-13T06:11:44.403 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.399+0000 7f43e8630640 1 -- 172.21.15.194:0/962186178 learned_addr learned my addr 172.21.15.194:0/962186178 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:44.403 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.399+0000 7f43e8630640 1 -- 172.21.15.194:0/962186178 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562541851100 con 0x56254175d560 2024-09-13T06:11:44.406 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.399+0000 7f43e8630640 1 --2- 172.21.15.194:0/962186178 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56254175d560 0x562541850bc0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f43d80030b0 tx=0x7f43d8018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.407 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.399+0000 7f42d4e09640 1 -- 172.21.15.194:0/962186178 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43d80c5070 con 0x56254175d560 2024-09-13T06:11:44.407 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.399+0000 7f42d4e09640 1 -- 172.21.15.194:0/962186178 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43d80b6970 con 0x56254175d560 2024-09-13T06:11:44.407 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.399+0000 7f42d4e09640 1 -- 172.21.15.194:0/962186178 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43d80b0050 con 0x56254175d560 2024-09-13T06:11:44.407 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.399+0000 7f43eab20980 1 -- 172.21.15.194:0/962186178 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562541851390 con 0x56254175d560 2024-09-13T06:11:44.407 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.399+0000 7f43eab20980 1 -- 172.21.15.194:0/962186178 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562541854070 con 0x56254175d560 2024-09-13T06:11:44.407 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.399+0000 7f43eab20980 1 Processor -- start 2024-09-13T06:11:44.407 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.403+0000 7f43eab20980 1 -- start start 2024-09-13T06:11:44.407 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.403+0000 7f43eab20980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56254184a270 0x5625418487f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.407 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.403+0000 7f43eab20980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x562541665800 con 0x56254184a270 2024-09-13T06:11:44.407 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.403+0000 7f42d4e09640 1 -- 172.21.15.194:0/962186178 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f43d80c8070 con 0x56254175d560 2024-09-13T06:11:44.407 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.403+0000 7f43e8e31640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56254184a270 0x5625418487f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.408 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.403+0000 7f43e8e31640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56254184a270 0x5625418487f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44930/0 (socket says 172.21.15.194:44930) 2024-09-13T06:11:44.408 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.403+0000 7f43e8e31640 1 -- 172.21.15.194:0/1573311578 learned_addr learned my addr 172.21.15.194:0/1573311578 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:44.408 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.403+0000 7f42d4e09640 1 --2- 172.21.15.194:0/962186178 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f42d0034650 0x7f42d0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.408 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.403+0000 7f42d4e09640 1 -- 172.21.15.194:0/962186178 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f43d80bc070 con 0x56254175d560 2024-09-13T06:11:44.408 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.403+0000 7f43e8630640 1 --2- 172.21.15.194:0/962186178 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f42d0034650 0x7f42d0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.408 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.403+0000 7f43e8e31640 1 -- 172.21.15.194:0/1573311578 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562541848d30 con 0x56254184a270 2024-09-13T06:11:44.408 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.403+0000 7f43e8e31640 1 --2- 172.21.15.194:0/1573311578 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56254184a270 0x5625418487f0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f43e000a430 tx=0x7f43e000a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b93c84e3838808b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.408 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.403+0000 7f43e8630640 1 --2- 172.21.15.194:0/962186178 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f42d0034650 0x7f42d0036b10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f43d80b6fd0 tx=0x7f43d80b6f60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.408 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.403+0000 7f42ceffd640 1 -- 172.21.15.194:0/1573311578 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43e000f6e0 con 0x56254184a270 2024-09-13T06:11:44.408 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.403+0000 7f42ceffd640 1 -- 172.21.15.194:0/1573311578 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43e0015070 con 0x56254184a270 2024-09-13T06:11:44.408 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.403+0000 7f42ceffd640 1 -- 172.21.15.194:0/1573311578 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43e000fa10 con 0x56254184a270 2024-09-13T06:11:44.408 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.403+0000 7f43eab20980 1 -- 172.21.15.194:0/1573311578 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56254184a270 msgr2=0x5625418487f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.408 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.403+0000 7f43eab20980 1 --2- 172.21.15.194:0/1573311578 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56254184a270 0x5625418487f0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f43e000a430 tx=0x7f43e000a8f0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.403+0000 7f43eab20980 1 -- 172.21.15.194:0/1573311578 shutdown_connections 2024-09-13T06:11:44.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.403+0000 7f43eab20980 1 --2- 172.21.15.194:0/1573311578 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56254184a270 0x5625418487f0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.403+0000 7f43eab20980 1 -- 172.21.15.194:0/1573311578 >> 172.21.15.194:0/1573311578 conn(0x56254175deb0 msgr2=0x5625418592c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:44.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.403+0000 7f43eab20980 1 -- 172.21.15.194:0/1573311578 shutdown_connections 2024-09-13T06:11:44.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.403+0000 7f43eab20980 1 -- 172.21.15.194:0/1573311578 wait complete. 2024-09-13T06:11:44.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.403+0000 7f43eab20980 1 Processor -- start 2024-09-13T06:11:44.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.403+0000 7f43eab20980 1 -- start start 2024-09-13T06:11:44.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.403+0000 7f43eab20980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56254184a270 0x562541866f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.403+0000 7f43eab20980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x562541848ff0 con 0x56254184a270 2024-09-13T06:11:44.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.403+0000 7f43e8e31640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56254184a270 0x562541866f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.403+0000 7f43e8e31640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56254184a270 0x562541866f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44940/0 (socket says 172.21.15.194:44940) 2024-09-13T06:11:44.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.403+0000 7f43e8e31640 1 -- 172.21.15.194:0/492614796 learned_addr learned my addr 172.21.15.194:0/492614796 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:44.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.403+0000 7f43e8e31640 1 -- 172.21.15.194:0/492614796 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562541867470 con 0x56254184a270 2024-09-13T06:11:44.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.403+0000 7f43e8e31640 1 --2- 172.21.15.194:0/492614796 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56254184a270 0x562541866f30 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f43e0011000 tx=0x7f43e0003380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.403+0000 7f42cd7fa640 1 -- 172.21.15.194:0/492614796 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43e000fe00 con 0x56254184a270 2024-09-13T06:11:44.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.403+0000 7f43eab20980 1 -- 172.21.15.194:0/492614796 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562541867700 con 0x56254184a270 2024-09-13T06:11:44.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.407+0000 7f42cd7fa640 1 -- 172.21.15.194:0/492614796 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43e0010a20 con 0x56254184a270 2024-09-13T06:11:44.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.407+0000 7f43eab20980 1 -- 172.21.15.194:0/492614796 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56254186a3e0 con 0x56254184a270 2024-09-13T06:11:44.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.407+0000 7f42cd7fa640 1 -- 172.21.15.194:0/492614796 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43e0010d80 con 0x56254184a270 2024-09-13T06:11:44.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.407+0000 7f42cd7fa640 1 -- 172.21.15.194:0/492614796 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f43e001a480 con 0x56254184a270 2024-09-13T06:11:44.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.407+0000 7f43eab20980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:11:44.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.407+0000 7f43eab20980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:11:44.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.407+0000 7f42cd7fa640 1 --2- 172.21.15.194:0/492614796 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f42c0034650 0x7f42c0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.407+0000 7f43eab20980 1 Processor -- start 2024-09-13T06:11:44.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.407+0000 7f42cd7fa640 1 -- 172.21.15.194:0/492614796 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f43e004a510 con 0x56254184a270 2024-09-13T06:11:44.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.407+0000 7f43e8e31640 1 --2- 172.21.15.194:0/492614796 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f42c0034650 0x7f42c0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.407+0000 7f43eab20980 1 -- start start 2024-09-13T06:11:44.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.407+0000 7f43eab20980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562541880830 0x562541880c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.407+0000 7f43eab20980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5625416d3480 con 0x562541880830 2024-09-13T06:11:44.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.407+0000 7f43e8e31640 1 --2- 172.21.15.194:0/492614796 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f42c0034650 0x7f42c0036b10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f43e000a930 tx=0x7f43e001be90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.407+0000 7f43e8630640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562541880830 0x562541880c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.407+0000 7f43e8630640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562541880830 0x562541880c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44942/0 (socket says 172.21.15.194:44942) 2024-09-13T06:11:44.417 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.407+0000 7f43e8630640 1 -- 172.21.15.194:0/3093476130 learned_addr learned my addr 172.21.15.194:0/3093476130 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:44.417 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.407+0000 7f43e8630640 1 -- 172.21.15.194:0/3093476130 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562541881220 con 0x562541880830 2024-09-13T06:11:44.417 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.407+0000 7f43e8630640 1 --2- 172.21.15.194:0/3093476130 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562541880830 0x562541880c50 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f43d80e1f20 tx=0x7f43d80ad330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.417 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.407+0000 7f42acfe9640 1 -- 172.21.15.194:0/3093476130 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43d80b4370 con 0x562541880830 2024-09-13T06:11:44.417 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.407+0000 7f43eab20980 1 -- 172.21.15.194:0/3093476130 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562541883e20 con 0x562541880830 2024-09-13T06:11:44.417 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.407+0000 7f43eab20980 1 -- 172.21.15.194:0/3093476130 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625418841d0 con 0x562541880830 2024-09-13T06:11:44.417 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.407+0000 7f42acfe9640 1 -- 172.21.15.194:0/3093476130 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43d80e8070 con 0x562541880830 2024-09-13T06:11:44.417 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.407+0000 7f42acfe9640 1 -- 172.21.15.194:0/3093476130 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43d80b4510 con 0x562541880830 2024-09-13T06:11:44.417 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.411+0000 7f42acfe9640 1 -- 172.21.15.194:0/3093476130 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f43d80aacb0 con 0x562541880830 2024-09-13T06:11:44.417 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.411+0000 7f42acfe9640 1 --2- 172.21.15.194:0/3093476130 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4220034600 0x7f4220036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.417 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.411+0000 7f42acfe9640 1 -- 172.21.15.194:0/3093476130 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f43d80df070 con 0x562541880830 2024-09-13T06:11:44.417 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.411+0000 7f43e7e2f640 1 --2- 172.21.15.194:0/3093476130 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4220034600 0x7f4220036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.417 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.411+0000 7f42a67fc640 20 reqs_thread_entry: start 2024-09-13T06:11:44.417 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.411+0000 7f43eab20980 1 --2- 172.21.15.194:0/962186178 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x562541886330 0x562541888780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.418 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.411+0000 7f43eab20980 1 -- 172.21.15.194:0/962186178 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562541888e00 con 0x562541886330 2024-09-13T06:11:44.418 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.411+0000 7f43e7e2f640 1 --2- 172.21.15.194:0/3093476130 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4220034600 0x7f4220036ac0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f43dc000f70 tx=0x7f43dc001240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.418 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.411+0000 7f43e8e31640 1 --2- 172.21.15.194:0/962186178 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x562541886330 0x562541888780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.418 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.411+0000 7f43e8e31640 1 --2- 172.21.15.194:0/962186178 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x562541886330 0x562541888780 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.418 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.411+0000 7f43e8e31640 1 -- 172.21.15.194:0/962186178 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f43e000e070 con 0x562541886330 2024-09-13T06:11:44.418 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.411+0000 7f43eab20980 1 -- 172.21.15.194:0/962186178 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562541889380 con 0x562541886330 2024-09-13T06:11:44.418 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.411+0000 7f43e8e31640 1 -- 172.21.15.194:0/962186178 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f43e000e070 con 0x562541886330 2024-09-13T06:11:44.418 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.411+0000 7f43eab20980 1 --2- 172.21.15.194:0/962186178 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x56254188afa0 0x56254188d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.418 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.411+0000 7f43eab20980 1 -- 172.21.15.194:0/962186178 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:3 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56254188db20 con 0x56254188afa0 2024-09-13T06:11:44.418 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.411+0000 7f43e8630640 1 --2- 172.21.15.194:0/962186178 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x56254188afa0 0x56254188d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.418 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.411+0000 7f43e8630640 1 --2- 172.21.15.194:0/962186178 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x56254188afa0 0x56254188d430 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.418 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.411+0000 7f43e8630640 1 -- 172.21.15.194:0/962186178 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(3 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f43d80e3d70 con 0x56254188afa0 2024-09-13T06:11:44.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.415+0000 7f43eab20980 1 -- 172.21.15.194:0/492614796 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f42c0034650 msgr2=0x7f42c0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.415+0000 7f43eab20980 1 --2- 172.21.15.194:0/492614796 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f42c0034650 0x7f42c0036b10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f43e000a930 tx=0x7f43e001be90 comp rx=0 tx=0).stop 2024-09-13T06:11:44.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.415+0000 7f43eab20980 1 -- 172.21.15.194:0/492614796 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56254184a270 msgr2=0x562541866f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.415+0000 7f43eab20980 1 --2- 172.21.15.194:0/492614796 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56254184a270 0x562541866f30 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f43e0011000 tx=0x7f43e0003380 comp rx=0 tx=0).stop 2024-09-13T06:11:44.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.415+0000 7f43eab20980 1 -- 172.21.15.194:0/492614796 shutdown_connections 2024-09-13T06:11:44.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.415+0000 7f43eab20980 1 --2- 172.21.15.194:0/492614796 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f42c0034650 0x7f42c0036b10 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.415+0000 7f43eab20980 1 --2- 172.21.15.194:0/492614796 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56254184a270 0x562541866f30 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.415+0000 7f43eab20980 1 -- 172.21.15.194:0/492614796 >> 172.21.15.194:0/492614796 conn(0x56254175deb0 msgr2=0x56254185c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:44.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.415+0000 7f43eab20980 1 -- 172.21.15.194:0/492614796 shutdown_connections 2024-09-13T06:11:44.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.415+0000 7f43eab20980 1 -- 172.21.15.194:0/492614796 wait complete. 2024-09-13T06:11:44.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.415+0000 7f43eab20980 1 -- 172.21.15.194:0/3093476130 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4220034600 msgr2=0x7f4220036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.415+0000 7f43eab20980 1 --2- 172.21.15.194:0/3093476130 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4220034600 0x7f4220036ac0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f43dc000f70 tx=0x7f43dc001240 comp rx=0 tx=0).stop 2024-09-13T06:11:44.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.415+0000 7f43eab20980 1 -- 172.21.15.194:0/3093476130 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562541880830 msgr2=0x562541880c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.415+0000 7f43eab20980 1 --2- 172.21.15.194:0/3093476130 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562541880830 0x562541880c50 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f43d80e1f20 tx=0x7f43d80ad330 comp rx=0 tx=0).stop 2024-09-13T06:11:44.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.415+0000 7f43eab20980 1 -- 172.21.15.194:0/3093476130 shutdown_connections 2024-09-13T06:11:44.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.415+0000 7f43eab20980 1 --2- 172.21.15.194:0/3093476130 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4220034600 0x7f4220036ac0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.415+0000 7f43eab20980 1 --2- 172.21.15.194:0/3093476130 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562541880830 0x562541880c50 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.415+0000 7f43eab20980 1 -- 172.21.15.194:0/3093476130 >> 172.21.15.194:0/3093476130 conn(0x562541875800 msgr2=0x5625418780f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:44.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.415+0000 7f43eab20980 1 -- 172.21.15.194:0/3093476130 shutdown_connections 2024-09-13T06:11:44.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.415+0000 7f43eab20980 1 -- 172.21.15.194:0/3093476130 wait complete. 2024-09-13T06:11:44.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.415+0000 7f43eab20980 1 -- 172.21.15.194:0/962186178 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x562541886330 msgr2=0x562541888780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.415+0000 7f43eab20980 1 --2- 172.21.15.194:0/962186178 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x562541886330 0x562541888780 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.415+0000 7f43eab20980 1 -- 172.21.15.194:0/962186178 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x56254188afa0 msgr2=0x56254188d430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.415+0000 7f43eab20980 1 --2- 172.21.15.194:0/962186178 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x56254188afa0 0x56254188d430 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.415+0000 7f43eab20980 1 -- 172.21.15.194:0/962186178 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f42d0034650 msgr2=0x7f42d0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.415+0000 7f43eab20980 1 --2- 172.21.15.194:0/962186178 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f42d0034650 0x7f42d0036b10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f43d80b6fd0 tx=0x7f43d80b6f60 comp rx=0 tx=0).stop 2024-09-13T06:11:44.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.415+0000 7f43eab20980 1 -- 172.21.15.194:0/962186178 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56254175d560 msgr2=0x562541850bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.415+0000 7f43eab20980 1 --2- 172.21.15.194:0/962186178 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56254175d560 0x562541850bc0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f43d80030b0 tx=0x7f43d8018020 comp rx=0 tx=0).stop 2024-09-13T06:11:44.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.415+0000 7f43eab20980 1 -- 172.21.15.194:0/962186178 shutdown_connections 2024-09-13T06:11:44.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.415+0000 7f43eab20980 1 --2- 172.21.15.194:0/962186178 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x56254188afa0 0x56254188d430 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.415+0000 7f43eab20980 1 --2- 172.21.15.194:0/962186178 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x562541886330 0x562541888780 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.415+0000 7f43eab20980 1 --2- 172.21.15.194:0/962186178 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f42d0034650 0x7f42d0036b10 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.415+0000 7f43eab20980 1 --2- 172.21.15.194:0/962186178 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56254175d560 0x562541850bc0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.415+0000 7f43eab20980 1 -- 172.21.15.194:0/962186178 >> 172.21.15.194:0/962186178 conn(0x562541759080 msgr2=0x5625418430d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:44.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.415+0000 7f43eab20980 1 -- 172.21.15.194:0/962186178 shutdown_connections 2024-09-13T06:11:44.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.415+0000 7f43eab20980 1 -- 172.21.15.194:0/962186178 wait complete. 2024-09-13T06:11:44.427 INFO:teuthology.orchestra.run.smithi194.stdout:{"id":"0faf3484-cad7-4c8f-892b-62107a753816","name":"default","api_name":"default","is_master":true,"endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"52d5ffc2-b91b-4558-98ea-6defdf5151d8","zones":[{"id":"52d5ffc2-b91b-4558-98ea-6defdf5151d8","name":"default","endpoints":[],"log_meta":false,"log_data":false,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["notification_v2","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"","sync_policy":{"groups":[]},"enabled_features":["notification_v2","resharding"]} 2024-09-13T06:11:44.427 DEBUG:tasks.util.rgw: json result: {'id': '0faf3484-cad7-4c8f-892b-62107a753816', 'name': 'default', 'api_name': 'default', 'is_master': True, 'endpoints': [], 'hostnames': [], 'hostnames_s3website': [], 'master_zone': '52d5ffc2-b91b-4558-98ea-6defdf5151d8', 'zones': [{'id': '52d5ffc2-b91b-4558-98ea-6defdf5151d8', 'name': 'default', 'endpoints': [], 'log_meta': False, 'log_data': False, 'bucket_index_max_shards': 11, 'read_only': False, 'tier_type': '', 'sync_from_all': True, 'sync_from': [], 'redirect_zone': '', 'supported_features': ['notification_v2', 'resharding']}], 'placement_targets': [{'name': 'default-placement', 'tags': [], 'storage_classes': ['STANDARD']}], 'default_placement': 'default-placement', 'realm_id': '', 'sync_policy': {'groups': []}, 'enabled_features': ['notification_v2', 'resharding']} 2024-09-13T06:11:44.430 INFO:teuthology.run_tasks:Running task radosgw-admin-rest... 2024-09-13T06:11:44.475 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-09-13T06:11:44.475 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-09-13T06:11:44.475 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid ada --display-name 'Ms. Admin User' --access-key MH1WC2XQ1S8UISFDZC8W --secret dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG --max-buckets 0 --caps 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write' 2024-09-13T06:11:44.516 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:11:44.516 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:11:44.516 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.515+0000 7f12b5ec1980 1 Processor -- start 2024-09-13T06:11:44.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.515+0000 7f12b5ec1980 1 -- start start 2024-09-13T06:11:44.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.515+0000 7f12b5ec1980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55b6423ac760 0x55b6423ab220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.515+0000 7f12b5ec1980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b6422bdae0 con 0x55b6423ac350 2024-09-13T06:11:44.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.515+0000 7f12b5ec1980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x55b6422e1e30 con 0x55b6423ac760 2024-09-13T06:11:44.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.515+0000 7f12b31d0640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55b6423ac760 0x55b6423ab220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.515+0000 7f12b39d1640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x55b6423ac350 0x55b6423aab10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:58360/0 (socket says 172.21.15.194:58360) 2024-09-13T06:11:44.518 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.515+0000 7f12b39d1640 1 -- 172.21.15.194:0/4160984025 learned_addr learned my addr 172.21.15.194:0/4160984025 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-09-13T06:11:44.518 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.515+0000 7f12b31d0640 1 -- 172.21.15.194:0/4160984025 >> v1:172.21.15.120:6789/0 conn(0x55b6423ac350 legacy=0x55b6423aab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.518 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.515+0000 7f12b31d0640 1 -- 172.21.15.194:0/4160984025 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6423ab880 con 0x55b6423ac760 2024-09-13T06:11:44.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.519+0000 7f12b31d0640 1 --2- 172.21.15.194:0/4160984025 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b6423ac760 0x55b6423ab220 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f129c00a480 tx=0x7f129c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e40d7eebd3dceea2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.519+0000 7f12b29cf640 1 -- 172.21.15.194:0/4160984025 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f129c0b0070 con 0x55b6423ac760 2024-09-13T06:11:44.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.519+0000 7f12b29cf640 1 -- 172.21.15.194:0/4160984025 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f129c0ab540 con 0x55b6423ac760 2024-09-13T06:11:44.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.519+0000 7f12b29cf640 1 -- 172.21.15.194:0/4160984025 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f129c0ab840 con 0x55b6423ac760 2024-09-13T06:11:44.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.519+0000 7f12b5ec1980 1 -- 172.21.15.194:0/4160984025 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b6423ac760 msgr2=0x55b6423ab220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.519+0000 7f12b5ec1980 1 --2- 172.21.15.194:0/4160984025 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b6423ac760 0x55b6423ab220 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f129c00a480 tx=0x7f129c01b280 comp rx=0 tx=0).stop 2024-09-13T06:11:44.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.519+0000 7f12b5ec1980 1 -- 172.21.15.194:0/4160984025 shutdown_connections 2024-09-13T06:11:44.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.519+0000 7f12b5ec1980 1 --2- 172.21.15.194:0/4160984025 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b6423ac760 0x55b6423ab220 secure :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f129c00a480 tx=0x7f129c01b280 comp rx=0 tx=0).stop 2024-09-13T06:11:44.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.519+0000 7f12b5ec1980 1 -- 172.21.15.194:0/4160984025 >> 172.21.15.194:0/4160984025 conn(0x55b642431150 msgr2=0x55b642433570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:44.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.519+0000 7f12b5ec1980 1 -- 172.21.15.194:0/4160984025 shutdown_connections 2024-09-13T06:11:44.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.519+0000 7f12b5ec1980 1 -- 172.21.15.194:0/4160984025 wait complete. 2024-09-13T06:11:44.535 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.531+0000 7f12b5ec1980 1 Processor -- start 2024-09-13T06:11:44.535 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.531+0000 7f12b5ec1980 1 -- start start 2024-09-13T06:11:44.535 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.531+0000 7f12b5ec1980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b6423ac350 0x55b642522e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.535 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.531+0000 7f12b5ec1980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55b6422e3200 con 0x55b6423ac350 2024-09-13T06:11:44.536 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.535+0000 7f12b39d1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b6423ac350 0x55b642522e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.536 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.535+0000 7f12b39d1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b6423ac350 0x55b642522e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44964/0 (socket says 172.21.15.194:44964) 2024-09-13T06:11:44.536 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.535+0000 7f12b39d1640 1 -- 172.21.15.194:0/3321840769 learned_addr learned my addr 172.21.15.194:0/3321840769 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:44.536 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.535+0000 7f12b39d1640 1 -- 172.21.15.194:0/3321840769 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b642523430 con 0x55b6423ac350 2024-09-13T06:11:44.537 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.535+0000 7f12b39d1640 1 --2- 172.21.15.194:0/3321840769 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b6423ac350 0x55b642522e60 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f12a40015f0 tx=0x7f12a4001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3a250071be2102f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.537 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.535+0000 7f11a1e0b640 1 -- 172.21.15.194:0/3321840769 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12a4004530 con 0x55b6423ac350 2024-09-13T06:11:44.537 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.535+0000 7f11a1e0b640 1 -- 172.21.15.194:0/3321840769 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12a40046f0 con 0x55b6423ac350 2024-09-13T06:11:44.537 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.535+0000 7f11a1e0b640 1 -- 172.21.15.194:0/3321840769 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12a4004a90 con 0x55b6423ac350 2024-09-13T06:11:44.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.535+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3321840769 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b6423ac350 msgr2=0x55b642522e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.535+0000 7f12b5ec1980 1 --2- 172.21.15.194:0/3321840769 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b6423ac350 0x55b642522e60 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f12a40015f0 tx=0x7f12a4001ab0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.535+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3321840769 shutdown_connections 2024-09-13T06:11:44.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.535+0000 7f12b5ec1980 1 --2- 172.21.15.194:0/3321840769 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b6423ac350 0x55b642522e60 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.535+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3321840769 >> 172.21.15.194:0/3321840769 conn(0x55b642431150 msgr2=0x55b64251e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:44.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.535+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3321840769 shutdown_connections 2024-09-13T06:11:44.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.535+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3321840769 wait complete. 2024-09-13T06:11:44.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.535+0000 7f12b5ec1980 1 Processor -- start 2024-09-13T06:11:44.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.535+0000 7f12b5ec1980 1 -- start start 2024-09-13T06:11:44.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.535+0000 7f12b5ec1980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b6423ac350 0x55b64252a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.535+0000 7f12b5ec1980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55b6424411a0 con 0x55b6423ac350 2024-09-13T06:11:44.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.535+0000 7f12b39d1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b6423ac350 0x55b64252a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.535+0000 7f12b39d1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b6423ac350 0x55b64252a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44980/0 (socket says 172.21.15.194:44980) 2024-09-13T06:11:44.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.535+0000 7f12b39d1640 1 -- 172.21.15.194:0/63632736 learned_addr learned my addr 172.21.15.194:0/63632736 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:44.541 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.535+0000 7f12b39d1640 1 -- 172.21.15.194:0/63632736 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b64252a730 con 0x55b6423ac350 2024-09-13T06:11:44.541 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.535+0000 7f12b39d1640 1 --2- 172.21.15.194:0/63632736 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b6423ac350 0x55b64252a1f0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x55b642524040 tx=0x7f12a4000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.542 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.539+0000 7f119bfff640 1 -- 172.21.15.194:0/63632736 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12a4013760 con 0x55b6423ac350 2024-09-13T06:11:44.542 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.539+0000 7f119bfff640 1 -- 172.21.15.194:0/63632736 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12a4013900 con 0x55b6423ac350 2024-09-13T06:11:44.542 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.539+0000 7f12b5ec1980 1 -- 172.21.15.194:0/63632736 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b64252a9c0 con 0x55b6423ac350 2024-09-13T06:11:44.542 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.539+0000 7f119bfff640 1 -- 172.21.15.194:0/63632736 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12a4013be0 con 0x55b6423ac350 2024-09-13T06:11:44.542 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.539+0000 7f12b5ec1980 1 -- 172.21.15.194:0/63632736 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b64252d6a0 con 0x55b6423ac350 2024-09-13T06:11:44.542 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.539+0000 7f119bfff640 1 -- 172.21.15.194:0/63632736 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f12a4010070 con 0x55b6423ac350 2024-09-13T06:11:44.542 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.539+0000 7f119bfff640 1 --2- 172.21.15.194:0/63632736 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f119c034650 0x7f119c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.542 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.539+0000 7f119bfff640 1 -- 172.21.15.194:0/63632736 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f12a4018070 con 0x55b6423ac350 2024-09-13T06:11:44.542 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.539+0000 7f12b31d0640 1 --2- 172.21.15.194:0/63632736 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f119c034650 0x7f119c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.542 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.539+0000 7f12b5ec1980 1 --2- 172.21.15.194:0/63632736 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55b64252f170 0x55b642531580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.542 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.539+0000 7f12b5ec1980 1 -- 172.21.15.194:0/63632736 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b642531bf0 con 0x55b64252f170 2024-09-13T06:11:44.542 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.539+0000 7f12b41d2640 1 --2- 172.21.15.194:0/63632736 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55b64252f170 0x55b642531580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.544 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.539+0000 7f12b31d0640 1 --2- 172.21.15.194:0/63632736 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f119c034650 0x7f119c036b10 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f129c0ad000 tx=0x7f129c0a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.544 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.539+0000 7f12b41d2640 1 --2- 172.21.15.194:0/63632736 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55b64252f170 0x55b642531580 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.545 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.539+0000 7f12b41d2640 1 -- 172.21.15.194:0/63632736 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f12ac0083f0 con 0x55b64252f170 2024-09-13T06:11:44.545 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.539+0000 7f12b5ec1980 1 -- 172.21.15.194:0/63632736 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b64252e8c0 con 0x55b64252f170 2024-09-13T06:11:44.545 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.539+0000 7f12b41d2640 1 -- 172.21.15.194:0/63632736 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f12ac0083f0 con 0x55b64252f170 2024-09-13T06:11:44.545 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.539+0000 7f12b5ec1980 1 --2- 172.21.15.194:0/63632736 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55b642533f70 0x55b642536360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.545 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.539+0000 7f12b5ec1980 1 -- 172.21.15.194:0/63632736 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b642536a50 con 0x55b642533f70 2024-09-13T06:11:44.545 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.539+0000 7f12b39d1640 1 --2- 172.21.15.194:0/63632736 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55b642533f70 0x55b642536360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.545 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.539+0000 7f12b39d1640 1 --2- 172.21.15.194:0/63632736 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55b642533f70 0x55b642536360 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.545 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.539+0000 7f12b39d1640 1 -- 172.21.15.194:0/63632736 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f12a401b030 con 0x55b642533f70 2024-09-13T06:11:44.545 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.539+0000 7f12b5ec1980 1 -- 172.21.15.194:0/63632736 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b642532e10 con 0x55b64252f170 2024-09-13T06:11:44.545 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.543+0000 7f12b41d2640 1 -- 172.21.15.194:0/63632736 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f12ac0083f0 con 0x55b64252f170 2024-09-13T06:11:44.545 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.543+0000 7f12b5ec1980 1 --2- 172.21.15.194:0/63632736 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55b642537eb0 0x55b64253a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.546 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.543+0000 7f12b5ec1980 1 -- 172.21.15.194:0/63632736 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b64253a9e0 con 0x55b642537eb0 2024-09-13T06:11:44.546 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.543+0000 7f12b31d0640 1 --2- 172.21.15.194:0/63632736 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55b642537eb0 0x55b64253a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.546 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.543+0000 7f12b31d0640 1 --2- 172.21.15.194:0/63632736 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55b642537eb0 0x55b64253a2a0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.546 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.543+0000 7f12b31d0640 1 -- 172.21.15.194:0/63632736 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f129c0abbd0 con 0x55b642537eb0 2024-09-13T06:11:44.547 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.543+0000 7f12b5ec1980 1 Processor -- start 2024-09-13T06:11:44.547 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.543+0000 7f12b5ec1980 1 -- start start 2024-09-13T06:11:44.548 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.543+0000 7f12b5ec1980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b642548470 0x55b642548890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.548 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.543+0000 7f12b5ec1980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55b64233c800 con 0x55b642548470 2024-09-13T06:11:44.548 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.543+0000 7f12b39d1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b642548470 0x55b642548890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.548 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.543+0000 7f12b39d1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b642548470 0x55b642548890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44988/0 (socket says 172.21.15.194:44988) 2024-09-13T06:11:44.548 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.543+0000 7f12b39d1640 1 -- 172.21.15.194:0/3122010788 learned_addr learned my addr 172.21.15.194:0/3122010788 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:44.548 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.543+0000 7f12b39d1640 1 -- 172.21.15.194:0/3122010788 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b642548dd0 con 0x55b642548470 2024-09-13T06:11:44.548 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.543+0000 7f12b39d1640 1 --2- 172.21.15.194:0/3122010788 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b642548470 0x55b642548890 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f12a4048390 tx=0x7f12a4012950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.548 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.543+0000 7f11997fa640 1 -- 172.21.15.194:0/3122010788 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12a401d350 con 0x55b642548470 2024-09-13T06:11:44.548 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.543+0000 7f11997fa640 1 -- 172.21.15.194:0/3122010788 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12a4029680 con 0x55b642548470 2024-09-13T06:11:44.548 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.543+0000 7f11997fa640 1 -- 172.21.15.194:0/3122010788 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12a4029960 con 0x55b642548470 2024-09-13T06:11:44.548 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.543+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3122010788 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b642549060 con 0x55b642548470 2024-09-13T06:11:44.549 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.543+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3122010788 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b64254bce0 con 0x55b642548470 2024-09-13T06:11:44.550 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.547+0000 7f11997fa640 1 -- 172.21.15.194:0/3122010788 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f12a404d030 con 0x55b642548470 2024-09-13T06:11:44.550 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.547+0000 7f11997fa640 1 --2- 172.21.15.194:0/3122010788 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f118c0345b0 0x7f118c036a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.550 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.547+0000 7f11997fa640 1 -- 172.21.15.194:0/3122010788 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f12a404b070 con 0x55b642548470 2024-09-13T06:11:44.550 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.547+0000 7f12b31d0640 1 --2- 172.21.15.194:0/3122010788 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f118c0345b0 0x7f118c036a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.550 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.547+0000 7f12b5ec1980 1 Processor -- start 2024-09-13T06:11:44.550 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.547+0000 7f12b5ec1980 1 -- start start 2024-09-13T06:11:44.550 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.547+0000 7f12b31d0640 1 --2- 172.21.15.194:0/3122010788 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f118c0345b0 0x7f118c036a70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x55b6425320f0 tx=0x7f129c005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.547+0000 7f12b5ec1980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b642554e50 0x55b642555250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.547+0000 7f12b5ec1980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55b6425237b0 con 0x55b642554e50 2024-09-13T06:11:44.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.547+0000 7f12b39d1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b642554e50 0x55b642555250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.547+0000 7f12b39d1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b642554e50 0x55b642555250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:44992/0 (socket says 172.21.15.194:44992) 2024-09-13T06:11:44.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.547+0000 7f12b39d1640 1 -- 172.21.15.194:0/1684990976 learned_addr learned my addr 172.21.15.194:0/1684990976 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:44.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.547+0000 7f12b39d1640 1 -- 172.21.15.194:0/1684990976 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b642555820 con 0x55b642554e50 2024-09-13T06:11:44.553 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.547+0000 7f12b39d1640 1 --2- 172.21.15.194:0/1684990976 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b642554e50 0x55b642555250 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f12a4005fd0 tx=0x7f12a4011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67363aae95b98b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.553 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.547+0000 7f1192ffd640 1 -- 172.21.15.194:0/1684990976 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12a4020070 con 0x55b642554e50 2024-09-13T06:11:44.553 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.547+0000 7f1192ffd640 1 -- 172.21.15.194:0/1684990976 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12a4011da0 con 0x55b642554e50 2024-09-13T06:11:44.553 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.547+0000 7f1192ffd640 1 -- 172.21.15.194:0/1684990976 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12a4032c80 con 0x55b642554e50 2024-09-13T06:11:44.553 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.547+0000 7f12b5ec1980 1 -- 172.21.15.194:0/1684990976 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b642554e50 msgr2=0x55b642555250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.553 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.547+0000 7f12b5ec1980 1 --2- 172.21.15.194:0/1684990976 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b642554e50 0x55b642555250 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f12a4005fd0 tx=0x7f12a4011a50 comp rx=0 tx=0).stop 2024-09-13T06:11:44.553 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.547+0000 7f12b5ec1980 1 -- 172.21.15.194:0/1684990976 shutdown_connections 2024-09-13T06:11:44.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.547+0000 7f12b5ec1980 1 --2- 172.21.15.194:0/1684990976 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b642554e50 0x55b642555250 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.547+0000 7f12b5ec1980 1 -- 172.21.15.194:0/1684990976 >> 172.21.15.194:0/1684990976 conn(0x55b642551230 msgr2=0x55b64254f330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:44.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.547+0000 7f12b5ec1980 1 -- 172.21.15.194:0/1684990976 shutdown_connections 2024-09-13T06:11:44.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.547+0000 7f12b5ec1980 1 -- 172.21.15.194:0/1684990976 wait complete. 2024-09-13T06:11:44.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.551+0000 7f12b5ec1980 1 Processor -- start 2024-09-13T06:11:44.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.551+0000 7f12b5ec1980 1 -- start start 2024-09-13T06:11:44.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.551+0000 7f12b5ec1980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b642554e50 0x55b64255c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.551+0000 7f12b5ec1980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55b642555ca0 con 0x55b642554e50 2024-09-13T06:11:44.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.551+0000 7f12b39d1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b642554e50 0x55b64255c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.551+0000 7f12b39d1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b642554e50 0x55b64255c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45008/0 (socket says 172.21.15.194:45008) 2024-09-13T06:11:44.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.551+0000 7f12b39d1640 1 -- 172.21.15.194:0/3239532151 learned_addr learned my addr 172.21.15.194:0/3239532151 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:44.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.551+0000 7f12b39d1640 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b64255c590 con 0x55b642554e50 2024-09-13T06:11:44.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.551+0000 7f12b39d1640 1 --2- 172.21.15.194:0/3239532151 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b642554e50 0x55b64255c050 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f12a4011ce0 tx=0x7f12a404cec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.558 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.551+0000 7f11917fa640 1 -- 172.21.15.194:0/3239532151 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12a4070020 con 0x55b642554e50 2024-09-13T06:11:44.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.551+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b64255c590 con 0x55b642554e50 2024-09-13T06:11:44.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.551+0000 7f11917fa640 1 -- 172.21.15.194:0/3239532151 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12a4005c50 con 0x55b642554e50 2024-09-13T06:11:44.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.551+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b64255c590 con 0x55b642554e50 2024-09-13T06:11:44.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.551+0000 7f11917fa640 1 -- 172.21.15.194:0/3239532151 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12a4068040 con 0x55b642554e50 2024-09-13T06:11:44.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.551+0000 7f11917fa640 1 -- 172.21.15.194:0/3239532151 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f12a4073020 con 0x55b642554e50 2024-09-13T06:11:44.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.551+0000 7f11917fa640 1 --2- 172.21.15.194:0/3239532151 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f117c0345b0 0x7f117c036a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.551+0000 7f11917fa640 1 -- 172.21.15.194:0/3239532151 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f12a4076d10 con 0x55b642554e50 2024-09-13T06:11:44.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.551+0000 7f12b5ec1980 20 rados->read ofs=0 len=0 2024-09-13T06:11:44.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.551+0000 7f12b31d0640 1 --2- 172.21.15.194:0/3239532151 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f117c0345b0 0x7f117c036a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.560 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.551+0000 7f12b5ec1980 1 --2- 172.21.15.194:0/3239532151 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55b6425671c0 0x55b642569680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.560 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.551+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b642569dd0 con 0x55b6425671c0 2024-09-13T06:11:44.560 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.551+0000 7f12b41d2640 1 --2- 172.21.15.194:0/3239532151 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55b6425671c0 0x55b642569680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.560 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.555+0000 7f12b31d0640 1 --2- 172.21.15.194:0/3239532151 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f117c0345b0 0x7f117c036a70 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f129c0c2010 tx=0x7f129c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.560 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.555+0000 7f12b41d2640 1 --2- 172.21.15.194:0/3239532151 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55b6425671c0 0x55b642569680 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.560 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.555+0000 7f12b41d2640 1 -- 172.21.15.194:0/3239532151 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f12ac0083f0 con 0x55b6425671c0 2024-09-13T06:11:44.560 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.555+0000 7f12b5ec1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:44.560 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.555+0000 7f12b5ec1980 20 realm 2024-09-13T06:11:44.560 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.555+0000 7f12b5ec1980 20 rados->read ofs=0 len=0 2024-09-13T06:11:44.560 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.555+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b64256a1e0 con 0x55b6425671c0 2024-09-13T06:11:44.560 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.555+0000 7f12b41d2640 1 -- 172.21.15.194:0/3239532151 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f12ac0083f0 con 0x55b6425671c0 2024-09-13T06:11:44.560 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.555+0000 7f12b5ec1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:44.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.555+0000 7f12b5ec1980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:11:44.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.555+0000 7f12b5ec1980 20 rados->read ofs=0 len=0 2024-09-13T06:11:44.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.555+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b64256aa80 con 0x55b6425671c0 2024-09-13T06:11:44.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.555+0000 7f12b41d2640 1 -- 172.21.15.194:0/3239532151 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f12ac0083f0 con 0x55b6425671c0 2024-09-13T06:11:44.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.555+0000 7f12b5ec1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:44.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.555+0000 7f12b5ec1980 20 rados->read ofs=0 len=0 2024-09-13T06:11:44.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.555+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b64256ae20 con 0x55b6425671c0 2024-09-13T06:11:44.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.555+0000 7f12b41d2640 1 -- 172.21.15.194:0/3239532151 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f12ac0083f0 con 0x55b6425671c0 2024-09-13T06:11:44.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.555+0000 7f12b5ec1980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:11:44.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.555+0000 7f12b5ec1980 20 rados->read ofs=0 len=0 2024-09-13T06:11:44.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.555+0000 7f12b5ec1980 1 --2- 172.21.15.194:0/3239532151 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55b64256bb80 0x55b64256df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.562 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.555+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b64256e5c0 con 0x55b64256bb80 2024-09-13T06:11:44.562 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.555+0000 7f12b39d1640 1 --2- 172.21.15.194:0/3239532151 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55b64256bb80 0x55b64256df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.562 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.555+0000 7f12b39d1640 1 --2- 172.21.15.194:0/3239532151 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55b64256bb80 0x55b64256df70 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.562 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.555+0000 7f12b39d1640 1 -- 172.21.15.194:0/3239532151 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f12a403b070 con 0x55b64256bb80 2024-09-13T06:11:44.562 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.555+0000 7f12b5ec1980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:11:44.562 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.555+0000 7f12b5ec1980 20 searching for the correct realm 2024-09-13T06:11:44.562 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.555+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b64256fe90 con 0x55b64256bb80 2024-09-13T06:11:44.562 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.555+0000 7f12b39d1640 1 -- 172.21.15.194:0/3239532151 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12a403b070 con 0x55b64256bb80 2024-09-13T06:11:44.562 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.555+0000 7f12b39d1640 1 --2- 172.21.15.194:0/3239532151 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f12a4075020 0x7f12a403d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.562 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.555+0000 7f12b39d1640 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b64256fe90 con 0x7f12a4075020 2024-09-13T06:11:44.562 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.555+0000 7f12b31d0640 1 --2- 172.21.15.194:0/3239532151 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f12a4075020 0x7f12a403d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.562 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.555+0000 7f12b31d0640 1 --2- 172.21.15.194:0/3239532151 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f12a4075020 0x7f12a403d800 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.555+0000 7f12b31d0640 1 -- 172.21.15.194:0/3239532151 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f129c0d9070 con 0x7f12a4075020 2024-09-13T06:11:44.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.555+0000 7f12b31d0640 1 --2- 172.21.15.194:0/3239532151 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f129c0ce040 0x7f129c0db920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.555+0000 7f12b31d0640 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b64256fe90 con 0x7f129c0ce040 2024-09-13T06:11:44.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.555+0000 7f12b41d2640 1 --2- 172.21.15.194:0/3239532151 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f129c0ce040 0x7f129c0db920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.559+0000 7f12b41d2640 1 --2- 172.21.15.194:0/3239532151 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f129c0ce040 0x7f129c0db920 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.559+0000 7f12b41d2640 1 -- 172.21.15.194:0/3239532151 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12ac0083f0 con 0x7f129c0ce040 2024-09-13T06:11:44.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.559+0000 7f12b41d2640 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b64256ae20 con 0x55b6425671c0 2024-09-13T06:11:44.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.559+0000 7f12b41d2640 1 -- 172.21.15.194:0/3239532151 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12ac0083f0 con 0x55b6425671c0 2024-09-13T06:11:44.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.559+0000 7f12b41d2640 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b64256ae20 con 0x55b6425671c0 2024-09-13T06:11:44.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.559+0000 7f12b41d2640 1 -- 172.21.15.194:0/3239532151 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12ac0083f0 con 0x55b6425671c0 2024-09-13T06:11:44.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.559+0000 7f12b41d2640 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b64256ae20 con 0x7f129c0ce040 2024-09-13T06:11:44.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.559+0000 7f12b41d2640 1 -- 172.21.15.194:0/3239532151 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12ac0083f0 con 0x7f129c0ce040 2024-09-13T06:11:44.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.559+0000 7f12b41d2640 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b64256ae20 con 0x7f129c0ce040 2024-09-13T06:11:44.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.559+0000 7f12b41d2640 1 -- 172.21.15.194:0/3239532151 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12ac0083f0 con 0x7f129c0ce040 2024-09-13T06:11:44.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.559+0000 7f12b41d2640 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b64256ae20 con 0x7f12a4075020 2024-09-13T06:11:44.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.559+0000 7f12b31d0640 1 -- 172.21.15.194:0/3239532151 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f129c0e5040 con 0x7f12a4075020 2024-09-13T06:11:44.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.559+0000 7f12b31d0640 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b64256ae20 con 0x55b64256bb80 2024-09-13T06:11:44.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.559+0000 7f12b39d1640 1 -- 172.21.15.194:0/3239532151 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12a403b070 con 0x55b64256bb80 2024-09-13T06:11:44.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.559+0000 7f12b39d1640 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b64256ae20 con 0x55b6425671c0 2024-09-13T06:11:44.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.559+0000 7f12b41d2640 1 -- 172.21.15.194:0/3239532151 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12ac0083f0 con 0x55b6425671c0 2024-09-13T06:11:44.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.559+0000 7f12b41d2640 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b64256ae20 con 0x7f129c0ce040 2024-09-13T06:11:44.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.563+0000 7f12b41d2640 1 -- 172.21.15.194:0/3239532151 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12ac0083f0 con 0x7f129c0ce040 2024-09-13T06:11:44.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.563+0000 7f12b41d2640 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b64256ae20 con 0x55b6425671c0 2024-09-13T06:11:44.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.563+0000 7f12b41d2640 1 -- 172.21.15.194:0/3239532151 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12ac0083f0 con 0x55b6425671c0 2024-09-13T06:11:44.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.563+0000 7f12b41d2640 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b64256ae20 con 0x7f12a4075020 2024-09-13T06:11:44.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.563+0000 7f12b31d0640 1 -- 172.21.15.194:0/3239532151 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f129c0e5040 con 0x7f12a4075020 2024-09-13T06:11:44.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.563+0000 7f12b31d0640 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b64256ae20 con 0x55b64256bb80 2024-09-13T06:11:44.569 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.563+0000 7f12b39d1640 1 -- 172.21.15.194:0/3239532151 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12a403b070 con 0x55b64256bb80 2024-09-13T06:11:44.569 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.563+0000 7f12b39d1640 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b64256ae20 con 0x55b64256bb80 2024-09-13T06:11:44.569 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.563+0000 7f12b39d1640 1 -- 172.21.15.194:0/3239532151 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12a403b070 con 0x55b64256bb80 2024-09-13T06:11:44.569 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.563+0000 7f12b39d1640 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b64256ae20 con 0x7f129c0ce040 2024-09-13T06:11:44.569 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.563+0000 7f12b41d2640 1 -- 172.21.15.194:0/3239532151 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12ac0083f0 con 0x7f129c0ce040 2024-09-13T06:11:44.569 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.563+0000 7f12b41d2640 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b64256ae20 con 0x55b64256bb80 2024-09-13T06:11:44.569 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.563+0000 7f12b39d1640 1 -- 172.21.15.194:0/3239532151 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12a403b070 con 0x55b64256bb80 2024-09-13T06:11:44.569 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.563+0000 7f12b39d1640 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b64256ae20 con 0x55b64256bb80 2024-09-13T06:11:44.569 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.563+0000 7f12b39d1640 1 -- 172.21.15.194:0/3239532151 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12a403b070 con 0x55b64256bb80 2024-09-13T06:11:44.569 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.563+0000 7f12b39d1640 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b64256ae20 con 0x55b6425671c0 2024-09-13T06:11:44.569 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.563+0000 7f12b41d2640 1 -- 172.21.15.194:0/3239532151 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12ac0083f0 con 0x55b6425671c0 2024-09-13T06:11:44.570 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.563+0000 7f12b41d2640 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b64256ae20 con 0x55b6425671c0 2024-09-13T06:11:44.570 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.563+0000 7f12b41d2640 1 -- 172.21.15.194:0/3239532151 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v35'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f12ac0083f0 con 0x55b6425671c0 2024-09-13T06:11:44.570 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.563+0000 7f12b41d2640 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b64256ae20 con 0x7f12a4075020 2024-09-13T06:11:44.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.563+0000 7f12b31d0640 1 -- 172.21.15.194:0/3239532151 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f129c0e5040 con 0x7f12a4075020 2024-09-13T06:11:44.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.563+0000 7f12b31d0640 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b64256ae20 con 0x55b64256bb80 2024-09-13T06:11:44.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.563+0000 7f12b39d1640 1 -- 172.21.15.194:0/3239532151 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12a403b070 con 0x55b64256bb80 2024-09-13T06:11:44.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.563+0000 7f12b39d1640 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b64256ae20 con 0x7f12a4075020 2024-09-13T06:11:44.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.567+0000 7f12b31d0640 1 -- 172.21.15.194:0/3239532151 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f129c0e5040 con 0x7f12a4075020 2024-09-13T06:11:44.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.567+0000 7f12b31d0640 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b64256ae20 con 0x55b6425671c0 2024-09-13T06:11:44.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.567+0000 7f12b41d2640 1 -- 172.21.15.194:0/3239532151 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12ac0083f0 con 0x55b6425671c0 2024-09-13T06:11:44.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.567+0000 7f12b41d2640 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b64256ae20 con 0x7f129c0ce040 2024-09-13T06:11:44.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.567+0000 7f12b41d2640 1 -- 172.21.15.194:0/3239532151 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12ac0083f0 con 0x7f129c0ce040 2024-09-13T06:11:44.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.567+0000 7f12b41d2640 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b64256ae20 con 0x55b64256bb80 2024-09-13T06:11:44.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.567+0000 7f12b39d1640 1 -- 172.21.15.194:0/3239532151 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=107b] v35'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f12a403b070 con 0x55b64256bb80 2024-09-13T06:11:44.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.567+0000 7f12b39d1640 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b64256ae20 con 0x7f12a4075020 2024-09-13T06:11:44.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.567+0000 7f12b31d0640 1 -- 172.21.15.194:0/3239532151 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f129c0e5040 con 0x7f12a4075020 2024-09-13T06:11:44.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.567+0000 7f12b31d0640 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b64256ae20 con 0x7f12a4075020 2024-09-13T06:11:44.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.567+0000 7f12b31d0640 1 -- 172.21.15.194:0/3239532151 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f129c0e5040 con 0x7f12a4075020 2024-09-13T06:11:44.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.567+0000 7f12b31d0640 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b64256ae20 con 0x55b64256bb80 2024-09-13T06:11:44.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.567+0000 7f12b39d1640 1 -- 172.21.15.194:0/3239532151 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12a403b070 con 0x55b64256bb80 2024-09-13T06:11:44.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.567+0000 7f12b39d1640 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b64256ae20 con 0x7f129c0ce040 2024-09-13T06:11:44.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.567+0000 7f12b41d2640 1 -- 172.21.15.194:0/3239532151 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12ac0083f0 con 0x7f129c0ce040 2024-09-13T06:11:44.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.567+0000 7f12b41d2640 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b64256ae20 con 0x55b6425671c0 2024-09-13T06:11:44.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.567+0000 7f12b41d2640 1 -- 172.21.15.194:0/3239532151 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v35'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f12ac0083f0 con 0x55b6425671c0 2024-09-13T06:11:44.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.567+0000 7f12b41d2640 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55b64256ae20 con 0x7f12a4075020 2024-09-13T06:11:44.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.567+0000 7f12b31d0640 1 -- 172.21.15.194:0/3239532151 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f129c0e5040 con 0x7f12a4075020 2024-09-13T06:11:44.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.567+0000 7f12b5ec1980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:11:44.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.567+0000 7f12b5ec1980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:11:44.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.567+0000 7f12b5ec1980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:11:44.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.567+0000 7f12b5ec1980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:11:44.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.567+0000 7f12b5ec1980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:11:44.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.567+0000 7f12b5ec1980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:11:44.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.567+0000 7f12b5ec1980 20 rados->read ofs=0 len=0 2024-09-13T06:11:44.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.567+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b64256ef80 con 0x55b6425671c0 2024-09-13T06:11:44.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.567+0000 7f12b41d2640 1 -- 172.21.15.194:0/3239532151 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f12ac0083f0 con 0x55b6425671c0 2024-09-13T06:11:44.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.567+0000 7f12b5ec1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:44.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.567+0000 7f12b5ec1980 20 rados->read ofs=0 len=0 2024-09-13T06:11:44.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.567+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b64256f7d0 con 0x55b6425671c0 2024-09-13T06:11:44.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.567+0000 7f12b41d2640 1 -- 172.21.15.194:0/3239532151 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f12ac0083f0 con 0x55b6425671c0 2024-09-13T06:11:44.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.571+0000 7f12b5ec1980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:11:44.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.571+0000 7f12b5ec1980 20 rados->read ofs=0 len=0 2024-09-13T06:11:44.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.571+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b64256f320 con 0x7f12a4075020 2024-09-13T06:11:44.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.571+0000 7f12b31d0640 1 -- 172.21.15.194:0/3239532151 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f129c0e5040 con 0x7f12a4075020 2024-09-13T06:11:44.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.571+0000 7f12b5ec1980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:11:44.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.571+0000 7f12b5ec1980 20 zone default found 2024-09-13T06:11:44.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.571+0000 7f12b5ec1980 4 Realm: () 2024-09-13T06:11:44.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.571+0000 7f12b5ec1980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:11:44.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.571+0000 7f12b5ec1980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:11:44.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.571+0000 7f12b5ec1980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:11:44.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.571+0000 7f12b5ec1980 20 zonegroup default 2024-09-13T06:11:44.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.571+0000 7f12b5ec1980 20 rados->read ofs=0 len=0 2024-09-13T06:11:44.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.571+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b6425702c0 con 0x7f129c0ce040 2024-09-13T06:11:44.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.571+0000 7f12b41d2640 1 -- 172.21.15.194:0/3239532151 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f12ac0083f0 con 0x7f129c0ce040 2024-09-13T06:11:44.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.571+0000 7f12b5ec1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:44.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.571+0000 7f12b5ec1980 20 rados->read ofs=0 len=0 2024-09-13T06:11:44.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.571+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b642571ca0 con 0x55b64256bb80 2024-09-13T06:11:44.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.571+0000 7f12b39d1640 1 -- 172.21.15.194:0/3239532151 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f12a403b070 con 0x55b64256bb80 2024-09-13T06:11:44.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.571+0000 7f12b5ec1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:44.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.571+0000 7f12b5ec1980 20 rados->read ofs=0 len=0 2024-09-13T06:11:44.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.571+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b6425721c0 con 0x55b64256bb80 2024-09-13T06:11:44.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.571+0000 7f12b39d1640 1 -- 172.21.15.194:0/3239532151 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f12a403b070 con 0x55b64256bb80 2024-09-13T06:11:44.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.571+0000 7f12b5ec1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:44.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.571+0000 7f12b5ec1980 20 started sync module instance, tier type = 2024-09-13T06:11:44.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.571+0000 7f12b5ec1980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:11:44.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.571+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b642571140 con 0x7f12a4075020 2024-09-13T06:11:44.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.571+0000 7f12b31d0640 1 -- 172.21.15.194:0/3239532151 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(44 notify.0 [create] v35'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f129c0e5040 con 0x7f12a4075020 2024-09-13T06:11:44.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.571+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94241285412144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b642570da0 con 0x7f12a4075020 2024-09-13T06:11:44.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.571+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b642572fc0 con 0x55b6425671c0 2024-09-13T06:11:44.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.575+0000 7f12b31d0640 1 -- 172.21.15.194:0/3239532151 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94241285412144] v35'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f129c0e5040 con 0x7f12a4075020 2024-09-13T06:11:44.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.575+0000 7f12b41d2640 1 -- 172.21.15.194:0/3239532151 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v35'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12ac0083f0 con 0x55b6425671c0 2024-09-13T06:11:44.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.575+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94241285416480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b6425733b0 con 0x55b6425671c0 2024-09-13T06:11:44.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.575+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b642573d70 con 0x55b64256bb80 2024-09-13T06:11:44.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.575+0000 7f12b41d2640 1 -- 172.21.15.194:0/3239532151 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94241285416480] v35'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12ac0083f0 con 0x55b6425671c0 2024-09-13T06:11:44.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.575+0000 7f12b39d1640 1 -- 172.21.15.194:0/3239532151 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v35'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12a403b070 con 0x55b64256bb80 2024-09-13T06:11:44.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.575+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94241285421248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b642574160 con 0x55b64256bb80 2024-09-13T06:11:44.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.575+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b642574b20 con 0x7f12a4075020 2024-09-13T06:11:44.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.579+0000 7f12b31d0640 1 -- 172.21.15.194:0/3239532151 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(50 notify.3 [create] v35'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f129c0e5040 con 0x7f12a4075020 2024-09-13T06:11:44.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.579+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94241285424752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b642575370 con 0x7f12a4075020 2024-09-13T06:11:44.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.579+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b642575dc0 con 0x55b6425671c0 2024-09-13T06:11:44.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.579+0000 7f12b39d1640 1 -- 172.21.15.194:0/3239532151 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94241285421248] v35'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12a403b070 con 0x55b64256bb80 2024-09-13T06:11:44.583 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.579+0000 7f12b31d0640 1 -- 172.21.15.194:0/3239532151 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94241285424752] v35'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f129c0e5040 con 0x7f12a4075020 2024-09-13T06:11:44.583 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.579+0000 7f12b41d2640 1 -- 172.21.15.194:0/3239532151 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v35'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12ac0083f0 con 0x55b6425671c0 2024-09-13T06:11:44.583 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.579+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94241285426880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b642572a40 con 0x55b6425671c0 2024-09-13T06:11:44.583 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.579+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b642576660 con 0x7f129c0ce040 2024-09-13T06:11:44.584 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.583+0000 7f12b41d2640 1 -- 172.21.15.194:0/3239532151 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94241285426880] v35'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12ac0083f0 con 0x55b6425671c0 2024-09-13T06:11:44.585 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.583+0000 7f12b41d2640 1 -- 172.21.15.194:0/3239532151 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(54 notify.5 [create] v35'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12ac0083f0 con 0x7f129c0ce040 2024-09-13T06:11:44.585 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.583+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94241285429424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b6425765c0 con 0x7f129c0ce040 2024-09-13T06:11:44.585 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.583+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b642576f80 con 0x7f129c0ce040 2024-09-13T06:11:44.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.583+0000 7f12b41d2640 1 -- 172.21.15.194:0/3239532151 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94241285429424] v35'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12ac0083f0 con 0x7f129c0ce040 2024-09-13T06:11:44.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.587+0000 7f12b41d2640 1 -- 172.21.15.194:0/3239532151 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(56 notify.6 [create] v35'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12ac0083f0 con 0x7f129c0ce040 2024-09-13T06:11:44.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.587+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94241285431840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b642576f80 con 0x7f129c0ce040 2024-09-13T06:11:44.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.587+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b642577940 con 0x7f129c0ce040 2024-09-13T06:11:44.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.587+0000 7f12b41d2640 1 -- 172.21.15.194:0/3239532151 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(58 notify.7 [create] v35'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12ac0083f0 con 0x7f129c0ce040 2024-09-13T06:11:44.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.587+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94241285436560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b642577d60 con 0x7f129c0ce040 2024-09-13T06:11:44.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.587+0000 7f12b5ec1980 20 add_watcher() i=0 2024-09-13T06:11:44.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.587+0000 7f12b5ec1980 20 add_watcher() i=1 2024-09-13T06:11:44.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.587+0000 7f12b5ec1980 20 add_watcher() i=2 2024-09-13T06:11:44.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.587+0000 7f12b5ec1980 20 add_watcher() i=3 2024-09-13T06:11:44.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.587+0000 7f12b5ec1980 20 add_watcher() i=4 2024-09-13T06:11:44.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.587+0000 7f12b5ec1980 20 add_watcher() i=5 2024-09-13T06:11:44.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.587+0000 7f12b41d2640 1 -- 172.21.15.194:0/3239532151 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94241285431840] v35'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12ac0083f0 con 0x7f129c0ce040 2024-09-13T06:11:44.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.587+0000 7f12b5ec1980 20 add_watcher() i=6 2024-09-13T06:11:44.592 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.591+0000 7f12b41d2640 1 -- 172.21.15.194:0/3239532151 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94241285436560] v35'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12ac0083f0 con 0x7f129c0ce040 2024-09-13T06:11:44.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.591+0000 7f12b5ec1980 20 add_watcher() i=7 2024-09-13T06:11:44.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.591+0000 7f12b5ec1980 2 all 8 watchers are set, enabling cache 2024-09-13T06:11:44.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.591+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b642577d60 con 0x55b6425671c0 2024-09-13T06:11:44.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.591+0000 7f12b41d2640 1 -- 172.21.15.194:0/3239532151 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f12ac0083f0 con 0x55b6425671c0 2024-09-13T06:11:44.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.591+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94241285437616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b642577cd0 con 0x55b6425671c0 2024-09-13T06:11:44.594 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.591+0000 7f12b41d2640 1 -- 172.21.15.194:0/3239532151 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94241285437616] v35'239 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f12ac0083f0 con 0x55b6425671c0 2024-09-13T06:11:44.594 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.591+0000 7f1169fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:11:44.594 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.591+0000 7f12b5ec1980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:11:44.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.591+0000 7f12b5ec1980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:11:44.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.591+0000 7f12b5ec1980 5 note: GC not initialized 2024-09-13T06:11:44.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.591+0000 7f1168fe1640 20 reqs_thread_entry: start 2024-09-13T06:11:44.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.591+0000 7f12b5ec1980 20 init_complete bucket index max shards: 11 2024-09-13T06:11:44.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.591+0000 7f12b5ec1980 20 Filter name: none 2024-09-13T06:11:44.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.591+0000 7f10e27fc640 20 reqs_thread_entry: start 2024-09-13T06:11:44.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.591+0000 7f12b5ec1980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T06:11:44.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.591+0000 7f12b5ec1980 20 rados->read ofs=0 len=0 2024-09-13T06:11:44.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.591+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b64259e4c0 con 0x7f129c0ce040 2024-09-13T06:11:44.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.591+0000 7f12b41d2640 1 -- 172.21.15.194:0/3239532151 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(62 ada [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f12ac0083f0 con 0x7f129c0ce040 2024-09-13T06:11:44.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.591+0000 7f12b5ec1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:44.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.591+0000 7f12b5ec1980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x0 2024-09-13T06:11:44.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.591+0000 7f12b5ec1980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T06:11:44.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.591+0000 7f12b5ec1980 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : miss 2024-09-13T06:11:44.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.591+0000 7f12b5ec1980 20 rados->read ofs=0 len=0 2024-09-13T06:11:44.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.591+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:63 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b64259cc60 con 0x55b6425671c0 2024-09-13T06:11:44.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.591+0000 7f12b41d2640 1 -- 172.21.15.194:0/3239532151 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(63 MH1WC2XQ1S8UISFDZC8W [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f12ac0083f0 con 0x55b6425671c0 2024-09-13T06:11:44.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.591+0000 7f12b5ec1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:44.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.591+0000 7f12b5ec1980 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x0 2024-09-13T06:11:44.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.591+0000 7f12b5ec1980 10 adding default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-13T06:11:44.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.591+0000 7f12b5ec1980 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-09-13T06:11:44.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.591+0000 7f12b5ec1980 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-09-13T06:11:44.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.591+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:64 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b64259d500 con 0x7f129c0ce040 2024-09-13T06:11:44.598 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.595+0000 7f12b41d2640 1 -- 172.21.15.194:0/3239532151 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(64 ada [delete,create,call,writefull 0~473] v35'3 uv3 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f12ac0083f0 con 0x7f129c0ce040 2024-09-13T06:11:44.598 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.595+0000 7f12b5ec1980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T06:11:44.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.595+0000 7f12b5ec1980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T06:11:44.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.595+0000 7f12b5ec1980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T06:11:44.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.595+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94241285591120 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b6425a1f60 con 0x55b6425671c0 2024-09-13T06:11:44.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.595+0000 7f12b41d2640 1 -- 172.21.15.194:0/3239532151 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== watch-notify(notify (1) cookie 94241285426880 notify 150323855379 ret 0) ==== 691+0+0 (crc 0 0 0) 0x55b64259d8a0 con 0x55b6425671c0 2024-09-13T06:11:44.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.595+0000 7f1192ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855379 cookie 94241285426880 notifier 4829 bl.length()=649 2024-09-13T06:11:44.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.595+0000 7f1192ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T06:11:44.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.595+0000 7f1192ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T06:11:44.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.595+0000 7f1192ffd640 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f1178003eb0 con 0x55b6425671c0 2024-09-13T06:11:44.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.595+0000 7f12b41d2640 1 -- 172.21.15.194:0/3239532151 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(65 notify.4 [notify cookie 94241285591120 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f12ac0083f0 con 0x55b6425671c0 2024-09-13T06:11:44.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.595+0000 7f12b41d2640 1 -- 172.21.15.194:0/3239532151 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12ac0083f0 con 0x55b6425671c0 2024-09-13T06:11:44.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.595+0000 7f12b41d2640 1 -- 172.21.15.194:0/3239532151 <== osd.1 v2:172.21.15.194:6808/3135444559 25 ==== watch-notify(notify_complete (2) cookie 94241285591120 notify 150323855379 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b64259e070 con 0x55b6425671c0 2024-09-13T06:11:44.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.595+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:67 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b64259d000 con 0x55b6425671c0 2024-09-13T06:11:44.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.599+0000 7f12b41d2640 1 -- 172.21.15.194:0/3239532151 <== osd.1 v2:172.21.15.194:6808/3135444559 26 ==== osd_op_reply(67 MH1WC2XQ1S8UISFDZC8W [delete,create,writefull 0~7] v35'28 uv28 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f12ac0083f0 con 0x55b6425671c0 2024-09-13T06:11:44.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.599+0000 7f12b5ec1980 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-09-13T06:11:44.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.599+0000 7f12b5ec1980 10 moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-13T06:11:44.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.599+0000 7f12b5ec1980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:MH1WC2XQ1S8UISFDZC8W, ofs0, ns] 2024-09-13T06:11:44.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.599+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94241285591040 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b6425a1f60 con 0x55b64256bb80 2024-09-13T06:11:44.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.599+0000 7f12b39d1640 1 -- 172.21.15.194:0/3239532151 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== watch-notify(notify (1) cookie 94241285421248 notify 150323855378 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55b642549060 con 0x55b64256bb80 2024-09-13T06:11:44.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.599+0000 7f11927fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855378 cookie 94241285421248 notifier 4829 bl.length()=177 2024-09-13T06:11:44.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.599+0000 7f11927fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-09-13T06:11:44.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.599+0000 7f12b39d1640 1 -- 172.21.15.194:0/3239532151 <== osd.3 v2:172.21.15.194:6816/96632515 16 ==== osd_op_reply(68 notify.2 [notify cookie 94241285591040 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f12a403b070 con 0x55b64256bb80 2024-09-13T06:11:44.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.599+0000 7f11927fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-13T06:11:44.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.599+0000 7f11927fc640 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f10e8003410 con 0x55b64256bb80 2024-09-13T06:11:44.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.599+0000 7f12b39d1640 1 -- 172.21.15.194:0/3239532151 <== osd.3 v2:172.21.15.194:6816/96632515 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12a403b070 con 0x55b64256bb80 2024-09-13T06:11:44.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.599+0000 7f12b39d1640 1 -- 172.21.15.194:0/3239532151 <== osd.3 v2:172.21.15.194:6816/96632515 18 ==== watch-notify(notify_complete (2) cookie 94241285591040 notify 150323855378 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b642548dd0 con 0x55b64256bb80 2024-09-13T06:11:44.602 INFO:teuthology.orchestra.run.smithi194.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T06:11:44.596796Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:11:44.596784Z","tags":[],"group_ids":[]} 2024-09-13T06:11:44.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.599+0000 7f1169fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:11:44.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.599+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94241285437616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b64259c260 con 0x55b6425671c0 2024-09-13T06:11:44.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.599+0000 7f12b41d2640 1 -- 172.21.15.194:0/3239532151 <== osd.1 v2:172.21.15.194:6808/3135444559 27 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94241285437616] v35'240 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f12ac0083f0 con 0x55b6425671c0 2024-09-13T06:11:44.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.599+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94241285412144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b64259c260 con 0x7f12a4075020 2024-09-13T06:11:44.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.603+0000 7f12b31d0640 1 -- 172.21.15.194:0/3239532151 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94241285412144] v35'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f129c0e5040 con 0x7f12a4075020 2024-09-13T06:11:44.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.603+0000 7f12b5ec1980 20 remove_watcher() i=0 2024-09-13T06:11:44.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.603+0000 7f12b5ec1980 2 removed watcher, disabling cache 2024-09-13T06:11:44.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.603+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94241285416480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b642571530 con 0x55b6425671c0 2024-09-13T06:11:44.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.603+0000 7f12b41d2640 1 -- 172.21.15.194:0/3239532151 <== osd.1 v2:172.21.15.194:6808/3135444559 28 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94241285416480] v35'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12ac0083f0 con 0x55b6425671c0 2024-09-13T06:11:44.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.603+0000 7f12b5ec1980 20 remove_watcher() i=1 2024-09-13T06:11:44.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.603+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94241285421248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b64259c260 con 0x55b64256bb80 2024-09-13T06:11:44.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.607+0000 7f12b39d1640 1 -- 172.21.15.194:0/3239532151 <== osd.3 v2:172.21.15.194:6816/96632515 19 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94241285421248] v35'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12a403b070 con 0x55b64256bb80 2024-09-13T06:11:44.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.607+0000 7f12b5ec1980 20 remove_watcher() i=2 2024-09-13T06:11:44.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.607+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94241285424752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b642572620 con 0x7f12a4075020 2024-09-13T06:11:44.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.607+0000 7f12b31d0640 1 -- 172.21.15.194:0/3239532151 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94241285424752] v35'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f129c0e5040 con 0x7f12a4075020 2024-09-13T06:11:44.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.607+0000 7f12b5ec1980 20 remove_watcher() i=3 2024-09-13T06:11:44.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.607+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94241285426880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b6425738c0 con 0x55b6425671c0 2024-09-13T06:11:44.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.611+0000 7f12b41d2640 1 -- 172.21.15.194:0/3239532151 <== osd.1 v2:172.21.15.194:6808/3135444559 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94241285426880] v35'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12ac0083f0 con 0x55b6425671c0 2024-09-13T06:11:44.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.611+0000 7f12b5ec1980 20 remove_watcher() i=4 2024-09-13T06:11:44.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.611+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94241285429424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b64259c260 con 0x7f129c0ce040 2024-09-13T06:11:44.614 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.611+0000 7f12b41d2640 1 -- 172.21.15.194:0/3239532151 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94241285429424] v35'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12ac0083f0 con 0x7f129c0ce040 2024-09-13T06:11:44.614 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.611+0000 7f12b5ec1980 20 remove_watcher() i=5 2024-09-13T06:11:44.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.611+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94241285431840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b642572620 con 0x7f129c0ce040 2024-09-13T06:11:44.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.615+0000 7f12b41d2640 1 -- 172.21.15.194:0/3239532151 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94241285431840] v35'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12ac0083f0 con 0x7f129c0ce040 2024-09-13T06:11:44.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.615+0000 7f12b5ec1980 20 remove_watcher() i=6 2024-09-13T06:11:44.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.615+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3239532151 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94241285436560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55b6425738c0 con 0x7f129c0ce040 2024-09-13T06:11:44.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.615+0000 7f12b41d2640 1 -- 172.21.15.194:0/3239532151 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94241285436560] v35'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12ac0083f0 con 0x7f129c0ce040 2024-09-13T06:11:44.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.615+0000 7f12b5ec1980 20 remove_watcher() i=7 2024-09-13T06:11:44.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.615+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3239532151 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f129c0ce040 msgr2=0x7f129c0db920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.615+0000 7f12b5ec1980 1 --2- 172.21.15.194:0/3239532151 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f129c0ce040 0x7f129c0db920 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.615+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3239532151 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55b6425671c0 msgr2=0x55b642569680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.615+0000 7f12b5ec1980 1 --2- 172.21.15.194:0/3239532151 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55b6425671c0 0x55b642569680 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.615+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3239532151 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f12a4075020 msgr2=0x7f12a403d800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.615+0000 7f12b5ec1980 1 --2- 172.21.15.194:0/3239532151 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f12a4075020 0x7f12a403d800 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.615+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3239532151 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55b64256bb80 msgr2=0x55b64256df70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.615+0000 7f12b5ec1980 1 --2- 172.21.15.194:0/3239532151 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55b64256bb80 0x55b64256df70 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.615+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3239532151 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f117c0345b0 msgr2=0x7f117c036a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.615+0000 7f12b5ec1980 1 --2- 172.21.15.194:0/3239532151 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f117c0345b0 0x7f117c036a70 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f129c0c2010 tx=0x7f129c0a6000 comp rx=0 tx=0).stop 2024-09-13T06:11:44.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.615+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3239532151 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b642554e50 msgr2=0x55b64255c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.615+0000 7f12b41d2640 1 -- 172.21.15.194:0/3239532151 reap_dead start 2024-09-13T06:11:44.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.615+0000 7f12b5ec1980 1 --2- 172.21.15.194:0/3239532151 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b642554e50 0x55b64255c050 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f12a4011ce0 tx=0x7f12a404cec0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.615+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3239532151 shutdown_connections 2024-09-13T06:11:44.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.615+0000 7f12b5ec1980 1 --2- 172.21.15.194:0/3239532151 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b642554e50 0x55b64255c050 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.624 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.615+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3239532151 >> 172.21.15.194:0/3239532151 conn(0x55b642551230 msgr2=0x55b64254f300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:44.624 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.615+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3239532151 shutdown_connections 2024-09-13T06:11:44.624 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.615+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3239532151 wait complete. 2024-09-13T06:11:44.624 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.615+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3122010788 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f118c0345b0 msgr2=0x7f118c036a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.624 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.615+0000 7f12b5ec1980 1 --2- 172.21.15.194:0/3122010788 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f118c0345b0 0x7f118c036a70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x55b6425320f0 tx=0x7f129c005a10 comp rx=0 tx=0).stop 2024-09-13T06:11:44.624 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.615+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3122010788 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b642548470 msgr2=0x55b642548890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.624 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.615+0000 7f12b5ec1980 1 --2- 172.21.15.194:0/3122010788 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b642548470 0x55b642548890 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f12a4048390 tx=0x7f12a4012950 comp rx=0 tx=0).stop 2024-09-13T06:11:44.624 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.615+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3122010788 shutdown_connections 2024-09-13T06:11:44.624 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.615+0000 7f12b5ec1980 1 --2- 172.21.15.194:0/3122010788 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f118c0345b0 0x7f118c036a70 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.624 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.615+0000 7f12b5ec1980 1 --2- 172.21.15.194:0/3122010788 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b642548470 0x55b642548890 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.624 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.615+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3122010788 >> 172.21.15.194:0/3122010788 conn(0x55b64253d5c0 msgr2=0x55b642540040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:44.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.615+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3122010788 shutdown_connections 2024-09-13T06:11:44.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.615+0000 7f12b5ec1980 1 -- 172.21.15.194:0/3122010788 wait complete. 2024-09-13T06:11:44.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.619+0000 7f12b5ec1980 1 -- 172.21.15.194:0/63632736 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55b64252f170 msgr2=0x55b642531580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.619+0000 7f12b5ec1980 1 --2- 172.21.15.194:0/63632736 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55b64252f170 0x55b642531580 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.619+0000 7f12b5ec1980 1 -- 172.21.15.194:0/63632736 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55b642537eb0 msgr2=0x55b64253a2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.619+0000 7f12b5ec1980 1 --2- 172.21.15.194:0/63632736 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55b642537eb0 0x55b64253a2a0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.619+0000 7f12b5ec1980 1 -- 172.21.15.194:0/63632736 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55b642533f70 msgr2=0x55b642536360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.619+0000 7f12b5ec1980 1 --2- 172.21.15.194:0/63632736 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55b642533f70 0x55b642536360 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.619+0000 7f12b5ec1980 1 -- 172.21.15.194:0/63632736 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f119c034650 msgr2=0x7f119c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.619+0000 7f12b5ec1980 1 --2- 172.21.15.194:0/63632736 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f119c034650 0x7f119c036b10 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f129c0ad000 tx=0x7f129c0a5040 comp rx=0 tx=0).stop 2024-09-13T06:11:44.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.619+0000 7f12b5ec1980 1 -- 172.21.15.194:0/63632736 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b6423ac350 msgr2=0x55b64252a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.619+0000 7f12b5ec1980 1 --2- 172.21.15.194:0/63632736 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b6423ac350 0x55b64252a1f0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x55b642524040 tx=0x7f12a4000f50 comp rx=0 tx=0).stop 2024-09-13T06:11:44.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.619+0000 7f12b41d2640 1 -- 172.21.15.194:0/63632736 reap_dead start 2024-09-13T06:11:44.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.619+0000 7f12b5ec1980 1 -- 172.21.15.194:0/63632736 shutdown_connections 2024-09-13T06:11:44.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.619+0000 7f12b5ec1980 1 -- 172.21.15.194:0/63632736 >> 172.21.15.194:0/63632736 conn(0x55b642431150 msgr2=0x55b64251d570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:44.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.619+0000 7f12b5ec1980 1 -- 172.21.15.194:0/63632736 shutdown_connections 2024-09-13T06:11:44.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.619+0000 7f12b5ec1980 1 -- 172.21.15.194:0/63632736 wait complete. 2024-09-13T06:11:44.631 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T06:11:44.596796Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:11:44.596784Z', 'tags': [], 'group_ids': []} 2024-09-13T06:11:44.631 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T06:11:44.596796Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:11:44.596784Z', 'tags': [], 'group_ids': []} 2024-09-13T06:11:44.631 ERROR:root:0 2024-09-13T06:11:44.633 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T06:11:44.665 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx00000982ae02ded1ebeec-0066e3d7a0-4227-default', 'HostId': '4227-default-default'} 2024-09-13T06:11:44.666 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'foo', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '4'} 2024-09-13T06:11:44.692 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T06:11:44.692 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 0} 2024-09-13T06:11:44.743 INFO:tasks.radosgw_admin_rest: json result: {'keys': [], 'truncated': True, 'count': 0, 'marker': '8:1e6ca5ed:users.uid::foo:head'} 2024-09-13T06:11:44.743 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1} 2024-09-13T06:11:44.789 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['foo'], 'truncated': True, 'count': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-09-13T06:11:44.790 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-09-13T06:11:44.814 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['ada'], 'truncated': False, 'count': 1} 2024-09-13T06:11:44.815 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T06:11:44.827 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T06:11:44.828 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'access-key': '9te6NH5mcdcq0Tc5i8i1', 'uid': 'uid_not_exist'} 2024-09-13T06:11:44.842 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T06:11:44.842 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-13T06:11:44.842 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-13T06:11:44.842 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write' 2024-09-13T06:11:44.883 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:11:44.883 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:11:44.884 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.883+0000 7f1e60d71980 1 Processor -- start 2024-09-13T06:11:44.884 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.883+0000 7f1e60d71980 1 -- start start 2024-09-13T06:11:44.884 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.883+0000 7f1e60d71980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x558056c01c70 0x558056c04060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.884 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.883+0000 7f1e60d71980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558056a83ae0 con 0x558056bfd8f0 2024-09-13T06:11:44.884 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.883+0000 7f1e60d71980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x558056aa7e30 con 0x558056c01c70 2024-09-13T06:11:44.885 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.883+0000 7f1e5e080640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x558056c01c70 0x558056c04060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.885 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.883+0000 7f1e5e881640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x558056bfd8f0 0x558056bfdcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:58366/0 (socket says 172.21.15.194:58366) 2024-09-13T06:11:44.885 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.883+0000 7f1e5e881640 1 -- 172.21.15.194:0/1628289687 learned_addr learned my addr 172.21.15.194:0/1628289687 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-09-13T06:11:44.885 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.883+0000 7f1e5e080640 1 -- 172.21.15.194:0/1628289687 >> v1:172.21.15.120:6789/0 conn(0x558056bfd8f0 legacy=0x558056bfdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.885 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.883+0000 7f1e5e080640 1 -- 172.21.15.194:0/1628289687 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558056c055b0 con 0x558056c01c70 2024-09-13T06:11:44.887 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.883+0000 7f1e5e080640 1 --2- 172.21.15.194:0/1628289687 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558056c01c70 0x558056c04060 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f1e4800a480 tx=0x7f1e4801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b593c84b9c394fc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.888 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.887+0000 7f1e5d87f640 1 -- 172.21.15.194:0/1628289687 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e480b0070 con 0x558056c01c70 2024-09-13T06:11:44.888 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.887+0000 7f1e5d87f640 1 -- 172.21.15.194:0/1628289687 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e480ab540 con 0x558056c01c70 2024-09-13T06:11:44.888 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.887+0000 7f1e5d87f640 1 -- 172.21.15.194:0/1628289687 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e480ab840 con 0x558056c01c70 2024-09-13T06:11:44.888 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.887+0000 7f1e60d71980 1 -- 172.21.15.194:0/1628289687 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558056c01c70 msgr2=0x558056c04060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.889 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.887+0000 7f1e60d71980 1 --2- 172.21.15.194:0/1628289687 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558056c01c70 0x558056c04060 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f1e4800a480 tx=0x7f1e4801b280 comp rx=0 tx=0).stop 2024-09-13T06:11:44.889 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.887+0000 7f1e60d71980 1 -- 172.21.15.194:0/1628289687 shutdown_connections 2024-09-13T06:11:44.889 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.887+0000 7f1e60d71980 1 --2- 172.21.15.194:0/1628289687 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558056c01c70 0x558056c04060 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.889 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.887+0000 7f1e60d71980 1 -- 172.21.15.194:0/1628289687 >> 172.21.15.194:0/1628289687 conn(0x558056b71240 msgr2=0x558056b71650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:44.889 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.887+0000 7f1e60d71980 1 -- 172.21.15.194:0/1628289687 shutdown_connections 2024-09-13T06:11:44.889 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.887+0000 7f1e60d71980 1 -- 172.21.15.194:0/1628289687 wait complete. 2024-09-13T06:11:44.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.903+0000 7f1e60d71980 1 Processor -- start 2024-09-13T06:11:44.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.903+0000 7f1e60d71980 1 -- start start 2024-09-13T06:11:44.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.903+0000 7f1e60d71980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558056bfd8f0 0x558056ce8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.903+0000 7f1e60d71980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x558056aa9200 con 0x558056bfd8f0 2024-09-13T06:11:44.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.903+0000 7f1e5e881640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558056bfd8f0 0x558056ce8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.903+0000 7f1e5e881640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558056bfd8f0 0x558056ce8ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45020/0 (socket says 172.21.15.194:45020) 2024-09-13T06:11:44.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.903+0000 7f1e5e881640 1 -- 172.21.15.194:0/1980072996 learned_addr learned my addr 172.21.15.194:0/1980072996 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:44.906 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.903+0000 7f1e5e881640 1 -- 172.21.15.194:0/1980072996 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558056ce9270 con 0x558056bfd8f0 2024-09-13T06:11:44.906 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.903+0000 7f1e5e881640 1 --2- 172.21.15.194:0/1980072996 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558056bfd8f0 0x558056ce8ca0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f1e580015f0 tx=0x7f1e58001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a908066ff7a1f43 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.906 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.903+0000 7f1d4ce09640 1 -- 172.21.15.194:0/1980072996 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e58004530 con 0x558056bfd8f0 2024-09-13T06:11:44.906 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.903+0000 7f1d4ce09640 1 -- 172.21.15.194:0/1980072996 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e580046f0 con 0x558056bfd8f0 2024-09-13T06:11:44.906 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.903+0000 7f1d4ce09640 1 -- 172.21.15.194:0/1980072996 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e58004a90 con 0x558056bfd8f0 2024-09-13T06:11:44.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.903+0000 7f1e60d71980 1 -- 172.21.15.194:0/1980072996 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558056bfd8f0 msgr2=0x558056ce8ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.903+0000 7f1e60d71980 1 --2- 172.21.15.194:0/1980072996 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558056bfd8f0 0x558056ce8ca0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f1e580015f0 tx=0x7f1e58001ab0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.903+0000 7f1e60d71980 1 -- 172.21.15.194:0/1980072996 shutdown_connections 2024-09-13T06:11:44.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.903+0000 7f1e60d71980 1 --2- 172.21.15.194:0/1980072996 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558056bfd8f0 0x558056ce8ca0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.903+0000 7f1e60d71980 1 -- 172.21.15.194:0/1980072996 >> 172.21.15.194:0/1980072996 conn(0x558056b71240 msgr2=0x558056ce48d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:44.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.903+0000 7f1e60d71980 1 -- 172.21.15.194:0/1980072996 shutdown_connections 2024-09-13T06:11:44.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.903+0000 7f1e60d71980 1 -- 172.21.15.194:0/1980072996 wait complete. 2024-09-13T06:11:44.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.903+0000 7f1e60d71980 1 Processor -- start 2024-09-13T06:11:44.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.903+0000 7f1e60d71980 1 -- start start 2024-09-13T06:11:44.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.903+0000 7f1e60d71980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558056bfd8f0 0x558056cf0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.909 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.903+0000 7f1e60d71980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x558056c050b0 con 0x558056bfd8f0 2024-09-13T06:11:44.909 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.907+0000 7f1e5e881640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558056bfd8f0 0x558056cf0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.909 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.907+0000 7f1e5e881640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558056bfd8f0 0x558056cf0010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45022/0 (socket says 172.21.15.194:45022) 2024-09-13T06:11:44.909 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.907+0000 7f1e5e881640 1 -- 172.21.15.194:0/3341938790 learned_addr learned my addr 172.21.15.194:0/3341938790 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:44.910 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.907+0000 7f1e5e881640 1 -- 172.21.15.194:0/3341938790 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558056cf0550 con 0x558056bfd8f0 2024-09-13T06:11:44.910 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.907+0000 7f1e5e881640 1 --2- 172.21.15.194:0/3341938790 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558056bfd8f0 0x558056cf0010 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x558056ce9e80 tx=0x7f1e58000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.910 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.907+0000 7f1d4b606640 1 -- 172.21.15.194:0/3341938790 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e58013760 con 0x558056bfd8f0 2024-09-13T06:11:44.910 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.907+0000 7f1d4b606640 1 -- 172.21.15.194:0/3341938790 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e58013900 con 0x558056bfd8f0 2024-09-13T06:11:44.910 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.907+0000 7f1e60d71980 1 -- 172.21.15.194:0/3341938790 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558056cf07e0 con 0x558056bfd8f0 2024-09-13T06:11:44.910 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.907+0000 7f1d4b606640 1 -- 172.21.15.194:0/3341938790 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e58013be0 con 0x558056bfd8f0 2024-09-13T06:11:44.910 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.907+0000 7f1e60d71980 1 -- 172.21.15.194:0/3341938790 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558056cf34c0 con 0x558056bfd8f0 2024-09-13T06:11:44.911 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.907+0000 7f1d4b606640 1 -- 172.21.15.194:0/3341938790 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1e58010070 con 0x558056bfd8f0 2024-09-13T06:11:44.911 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.907+0000 7f1d4b606640 1 --2- 172.21.15.194:0/3341938790 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f1d440346f0 0x7f1d44036bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.912 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.907+0000 7f1d4b606640 1 -- 172.21.15.194:0/3341938790 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f1e58018070 con 0x558056bfd8f0 2024-09-13T06:11:44.912 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.907+0000 7f1e5e080640 1 --2- 172.21.15.194:0/3341938790 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f1d440346f0 0x7f1d44036bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.912 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.907+0000 7f1e60d71980 1 --2- 172.21.15.194:0/3341938790 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x558056c01c70 0x558056cf7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.912 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.907+0000 7f1e60d71980 1 -- 172.21.15.194:0/3341938790 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558056cf7670 con 0x558056c01c70 2024-09-13T06:11:44.912 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.907+0000 7f1e5f082640 1 --2- 172.21.15.194:0/3341938790 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x558056c01c70 0x558056cf7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.912 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.907+0000 7f1e5e080640 1 --2- 172.21.15.194:0/3341938790 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f1d440346f0 0x7f1d44036bb0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f1e480ad000 tx=0x7f1e480a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.912 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.907+0000 7f1e5f082640 1 --2- 172.21.15.194:0/3341938790 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x558056c01c70 0x558056cf7000 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.914 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.911+0000 7f1e5f082640 1 -- 172.21.15.194:0/3341938790 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1e500083f0 con 0x558056c01c70 2024-09-13T06:11:44.914 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.911+0000 7f1e60d71980 1 -- 172.21.15.194:0/3341938790 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558056cf46e0 con 0x558056c01c70 2024-09-13T06:11:44.914 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.911+0000 7f1e5f082640 1 -- 172.21.15.194:0/3341938790 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1e500083f0 con 0x558056c01c70 2024-09-13T06:11:44.914 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.911+0000 7f1e60d71980 1 --2- 172.21.15.194:0/3341938790 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x558056cf99a0 0x558056cfbd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.914 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.911+0000 7f1e60d71980 1 -- 172.21.15.194:0/3341938790 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558056cfc460 con 0x558056cf99a0 2024-09-13T06:11:44.914 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.911+0000 7f1e5e881640 1 --2- 172.21.15.194:0/3341938790 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x558056cf99a0 0x558056cfbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.914 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.911+0000 7f1e5e881640 1 --2- 172.21.15.194:0/3341938790 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x558056cf99a0 0x558056cfbd90 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.914 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.911+0000 7f1e5e881640 1 -- 172.21.15.194:0/3341938790 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1e5801b030 con 0x558056cf99a0 2024-09-13T06:11:44.914 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.911+0000 7f1e60d71980 1 -- 172.21.15.194:0/3341938790 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558056cf8840 con 0x558056c01c70 2024-09-13T06:11:44.914 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.911+0000 7f1e5f082640 1 -- 172.21.15.194:0/3341938790 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1e500083f0 con 0x558056c01c70 2024-09-13T06:11:44.914 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.911+0000 7f1e60d71980 1 --2- 172.21.15.194:0/3341938790 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x558056cfd8a0 0x558056cffc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.915 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.911+0000 7f1e60d71980 1 -- 172.21.15.194:0/3341938790 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558056d00420 con 0x558056cfd8a0 2024-09-13T06:11:44.915 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.911+0000 7f1e5e080640 1 --2- 172.21.15.194:0/3341938790 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x558056cfd8a0 0x558056cffc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.915 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.911+0000 7f1e5e080640 1 --2- 172.21.15.194:0/3341938790 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x558056cfd8a0 0x558056cffc90 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.916 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.911+0000 7f1e5e080640 1 -- 172.21.15.194:0/3341938790 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1e480b3040 con 0x558056cfd8a0 2024-09-13T06:11:44.916 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.911+0000 7f1e60d71980 1 Processor -- start 2024-09-13T06:11:44.916 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.911+0000 7f1e60d71980 1 -- start start 2024-09-13T06:11:44.916 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.911+0000 7f1e60d71980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558056d0ded0 0x558056d0e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.916 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.911+0000 7f1e60d71980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x558056b02800 con 0x558056d0ded0 2024-09-13T06:11:44.916 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.911+0000 7f1e5e881640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558056d0ded0 0x558056d0e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.916 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.911+0000 7f1e5e881640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558056d0ded0 0x558056d0e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45030/0 (socket says 172.21.15.194:45030) 2024-09-13T06:11:44.916 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.911+0000 7f1e5e881640 1 -- 172.21.15.194:0/4047560503 learned_addr learned my addr 172.21.15.194:0/4047560503 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:44.916 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.915+0000 7f1e5e881640 1 -- 172.21.15.194:0/4047560503 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558056d0e830 con 0x558056d0ded0 2024-09-13T06:11:44.917 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.915+0000 7f1e5e881640 1 --2- 172.21.15.194:0/4047560503 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558056d0ded0 0x558056d0e2f0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f1e58048380 tx=0x7f1e58020440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.917 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.915+0000 7f1d48e01640 1 -- 172.21.15.194:0/4047560503 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e58021960 con 0x558056d0ded0 2024-09-13T06:11:44.917 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.915+0000 7f1d48e01640 1 -- 172.21.15.194:0/4047560503 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e58021b00 con 0x558056d0ded0 2024-09-13T06:11:44.917 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.915+0000 7f1d48e01640 1 -- 172.21.15.194:0/4047560503 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e58021e00 con 0x558056d0ded0 2024-09-13T06:11:44.917 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.915+0000 7f1e60d71980 1 -- 172.21.15.194:0/4047560503 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558056d0eac0 con 0x558056d0ded0 2024-09-13T06:11:44.917 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.915+0000 7f1e60d71980 1 -- 172.21.15.194:0/4047560503 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558056d0eac0 con 0x558056d0ded0 2024-09-13T06:11:44.918 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.915+0000 7f1d48e01640 1 -- 172.21.15.194:0/4047560503 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1e58010940 con 0x558056d0ded0 2024-09-13T06:11:44.918 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.915+0000 7f1d48e01640 1 --2- 172.21.15.194:0/4047560503 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f1d38034650 0x7f1d38036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.919 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.915+0000 7f1d48e01640 1 -- 172.21.15.194:0/4047560503 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f1e58054af0 con 0x558056d0ded0 2024-09-13T06:11:44.919 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.915+0000 7f1e5e080640 1 --2- 172.21.15.194:0/4047560503 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f1d38034650 0x7f1d38036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.919 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.915+0000 7f1e60d71980 1 Processor -- start 2024-09-13T06:11:44.919 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.915+0000 7f1e60d71980 1 -- start start 2024-09-13T06:11:44.919 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.915+0000 7f1e5e080640 1 --2- 172.21.15.194:0/4047560503 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f1d38034650 0x7f1d38036b10 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f1e4801b2c0 tx=0x7f1e48005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.919 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.915+0000 7f1e60d71980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558056d1a5e0 0x558056d1a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.919 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.915+0000 7f1e60d71980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x558056ce95f0 con 0x558056d1a5e0 2024-09-13T06:11:44.920 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.915+0000 7f1e5e881640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558056d1a5e0 0x558056d1a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.920 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.915+0000 7f1e5e881640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558056d1a5e0 0x558056d1a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45040/0 (socket says 172.21.15.194:45040) 2024-09-13T06:11:44.920 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.915+0000 7f1e5e881640 1 -- 172.21.15.194:0/3616294821 learned_addr learned my addr 172.21.15.194:0/3616294821 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:44.920 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.915+0000 7f1e5e881640 1 -- 172.21.15.194:0/3616294821 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558056d1afb0 con 0x558056d1a5e0 2024-09-13T06:11:44.920 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.919+0000 7f1e5e881640 1 --2- 172.21.15.194:0/3616294821 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558056d1a5e0 0x558056d1a9e0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f1e5800afd0 tx=0x7f1e5803fb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68a3ec65215bb7c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.921 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.919+0000 7f1d427fc640 1 -- 172.21.15.194:0/3616294821 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e580419b0 con 0x558056d1a5e0 2024-09-13T06:11:44.922 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.919+0000 7f1d427fc640 1 -- 172.21.15.194:0/3616294821 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e58062070 con 0x558056d1a5e0 2024-09-13T06:11:44.922 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.919+0000 7f1d427fc640 1 -- 172.21.15.194:0/3616294821 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e58048460 con 0x558056d1a5e0 2024-09-13T06:11:44.922 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.919+0000 7f1e60d71980 1 -- 172.21.15.194:0/3616294821 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558056d1a5e0 msgr2=0x558056d1a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.922 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.919+0000 7f1e60d71980 1 --2- 172.21.15.194:0/3616294821 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558056d1a5e0 0x558056d1a9e0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f1e5800afd0 tx=0x7f1e5803fb20 comp rx=0 tx=0).stop 2024-09-13T06:11:44.922 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.919+0000 7f1e60d71980 1 -- 172.21.15.194:0/3616294821 shutdown_connections 2024-09-13T06:11:44.922 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.919+0000 7f1e60d71980 1 --2- 172.21.15.194:0/3616294821 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558056d1a5e0 0x558056d1a9e0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.922 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.919+0000 7f1e60d71980 1 -- 172.21.15.194:0/3616294821 >> 172.21.15.194:0/3616294821 conn(0x558056d16a10 msgr2=0x558056d14b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:44.922 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.919+0000 7f1e60d71980 1 -- 172.21.15.194:0/3616294821 shutdown_connections 2024-09-13T06:11:44.922 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.919+0000 7f1e60d71980 1 -- 172.21.15.194:0/3616294821 wait complete. 2024-09-13T06:11:44.922 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.919+0000 7f1e60d71980 1 Processor -- start 2024-09-13T06:11:44.922 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.919+0000 7f1e60d71980 1 -- start start 2024-09-13T06:11:44.922 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.919+0000 7f1e60d71980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558056d1a5e0 0x558056d217e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.923 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.919+0000 7f1e60d71980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x558056d1b480 con 0x558056d1a5e0 2024-09-13T06:11:44.924 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.919+0000 7f1e5e881640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558056d1a5e0 0x558056d217e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.924 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.919+0000 7f1e5e881640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558056d1a5e0 0x558056d217e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45048/0 (socket says 172.21.15.194:45048) 2024-09-13T06:11:44.924 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.919+0000 7f1e5e881640 1 -- 172.21.15.194:0/1756387771 learned_addr learned my addr 172.21.15.194:0/1756387771 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:44.924 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.919+0000 7f1e5e881640 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558056d21d20 con 0x558056d1a5e0 2024-09-13T06:11:44.924 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.919+0000 7f1e5e881640 1 --2- 172.21.15.194:0/1756387771 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558056d1a5e0 0x558056d217e0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f1e5803fbc0 tx=0x7f1e58050540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.924 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.919+0000 7f1d40ff9640 1 -- 172.21.15.194:0/1756387771 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e5806f030 con 0x558056d1a5e0 2024-09-13T06:11:44.924 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.919+0000 7f1d40ff9640 1 -- 172.21.15.194:0/1756387771 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e58054e50 con 0x558056d1a5e0 2024-09-13T06:11:44.924 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.919+0000 7f1e60d71980 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558056d21d20 con 0x558056d1a5e0 2024-09-13T06:11:44.924 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.919+0000 7f1d40ff9640 1 -- 172.21.15.194:0/1756387771 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e5802be30 con 0x558056d1a5e0 2024-09-13T06:11:44.924 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.923+0000 7f1e60d71980 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558056d21d20 con 0x558056d1a5e0 2024-09-13T06:11:44.925 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.923+0000 7f1d40ff9640 1 -- 172.21.15.194:0/1756387771 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1e58072030 con 0x558056d1a5e0 2024-09-13T06:11:44.925 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.923+0000 7f1d40ff9640 1 --2- 172.21.15.194:0/1756387771 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f1d28034600 0x7f1d28036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.926 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.923+0000 7f1d40ff9640 1 -- 172.21.15.194:0/1756387771 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f1e58070070 con 0x558056d1a5e0 2024-09-13T06:11:44.926 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.923+0000 7f1e60d71980 20 rados->read ofs=0 len=0 2024-09-13T06:11:44.926 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.923+0000 7f1e5e080640 1 --2- 172.21.15.194:0/1756387771 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f1d28034600 0x7f1d28036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.926 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.923+0000 7f1e60d71980 1 --2- 172.21.15.194:0/1756387771 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x558056d2c730 0x558056d2ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.926 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.923+0000 7f1e60d71980 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558056d2f320 con 0x558056d2c730 2024-09-13T06:11:44.926 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.923+0000 7f1e5f082640 1 --2- 172.21.15.194:0/1756387771 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x558056d2c730 0x558056d2ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.928 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.923+0000 7f1e5e080640 1 --2- 172.21.15.194:0/1756387771 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f1d28034600 0x7f1d28036ac0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1e480abaa0 tx=0x7f1e480b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.929 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.923+0000 7f1e5f082640 1 --2- 172.21.15.194:0/1756387771 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x558056d2c730 0x558056d2ebd0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.929 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.923+0000 7f1e5f082640 1 -- 172.21.15.194:0/1756387771 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1e500083f0 con 0x558056d2c730 2024-09-13T06:11:44.929 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.923+0000 7f1e60d71980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:44.929 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.923+0000 7f1e60d71980 20 realm 2024-09-13T06:11:44.929 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.923+0000 7f1e60d71980 20 rados->read ofs=0 len=0 2024-09-13T06:11:44.929 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.923+0000 7f1e60d71980 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558056d2f730 con 0x558056d2c730 2024-09-13T06:11:44.929 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.923+0000 7f1e5f082640 1 -- 172.21.15.194:0/1756387771 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1e500083f0 con 0x558056d2c730 2024-09-13T06:11:44.929 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.923+0000 7f1e60d71980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:44.929 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.923+0000 7f1e60d71980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:11:44.929 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.923+0000 7f1e60d71980 20 rados->read ofs=0 len=0 2024-09-13T06:11:44.929 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.923+0000 7f1e60d71980 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558056d2ffd0 con 0x558056d2c730 2024-09-13T06:11:44.929 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.923+0000 7f1e5f082640 1 -- 172.21.15.194:0/1756387771 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1e500083f0 con 0x558056d2c730 2024-09-13T06:11:44.929 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.923+0000 7f1e60d71980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:44.930 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.923+0000 7f1e60d71980 20 rados->read ofs=0 len=0 2024-09-13T06:11:44.930 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.923+0000 7f1e60d71980 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558056d30370 con 0x558056d2c730 2024-09-13T06:11:44.930 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.923+0000 7f1e5f082640 1 -- 172.21.15.194:0/1756387771 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1e500083f0 con 0x558056d2c730 2024-09-13T06:11:44.930 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.923+0000 7f1e60d71980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:11:44.930 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.923+0000 7f1e60d71980 20 rados->read ofs=0 len=0 2024-09-13T06:11:44.930 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.923+0000 7f1e60d71980 1 --2- 172.21.15.194:0/1756387771 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x558056d310d0 0x558056d334c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.930 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.923+0000 7f1e60d71980 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558056d33b60 con 0x558056d310d0 2024-09-13T06:11:44.930 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.923+0000 7f1e5e881640 1 --2- 172.21.15.194:0/1756387771 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x558056d310d0 0x558056d334c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.930 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.927+0000 7f1e5e881640 1 --2- 172.21.15.194:0/1756387771 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x558056d310d0 0x558056d334c0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.930 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.927+0000 7f1e5e881640 1 -- 172.21.15.194:0/1756387771 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1e5807b070 con 0x558056d310d0 2024-09-13T06:11:44.930 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.927+0000 7f1e60d71980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:11:44.930 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.927+0000 7f1e60d71980 20 searching for the correct realm 2024-09-13T06:11:44.931 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.927+0000 7f1e60d71980 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558056d353c0 con 0x558056d310d0 2024-09-13T06:11:44.931 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.927+0000 7f1e5e881640 1 -- 172.21.15.194:0/1756387771 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e5807b070 con 0x558056d310d0 2024-09-13T06:11:44.931 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.927+0000 7f1e5e881640 1 --2- 172.21.15.194:0/1756387771 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f1e58041500 0x7f1e5800c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.931 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.927+0000 7f1e5e881640 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558056d353c0 con 0x7f1e58041500 2024-09-13T06:11:44.931 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.927+0000 7f1e5e080640 1 --2- 172.21.15.194:0/1756387771 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f1e58041500 0x7f1e5800c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.933 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.927+0000 7f1e5e080640 1 --2- 172.21.15.194:0/1756387771 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f1e58041500 0x7f1e5800c150 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.933 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.927+0000 7f1e5e080640 1 -- 172.21.15.194:0/1756387771 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1e480c9030 con 0x7f1e58041500 2024-09-13T06:11:44.933 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.927+0000 7f1e5e080640 1 --2- 172.21.15.194:0/1756387771 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f1e480dc040 0x7f1e480ce430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:44.933 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.927+0000 7f1e5e080640 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558056d353c0 con 0x7f1e480dc040 2024-09-13T06:11:44.933 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.927+0000 7f1e5f082640 1 --2- 172.21.15.194:0/1756387771 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f1e480dc040 0x7f1e480ce430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:44.933 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.927+0000 7f1e5f082640 1 --2- 172.21.15.194:0/1756387771 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f1e480dc040 0x7f1e480ce430 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:44.933 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.927+0000 7f1e5f082640 1 -- 172.21.15.194:0/1756387771 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e500083f0 con 0x7f1e480dc040 2024-09-13T06:11:44.933 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.927+0000 7f1e5f082640 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558056d30370 con 0x558056d2c730 2024-09-13T06:11:44.933 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.927+0000 7f1e5f082640 1 -- 172.21.15.194:0/1756387771 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e500083f0 con 0x558056d2c730 2024-09-13T06:11:44.934 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.927+0000 7f1e5f082640 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558056d30370 con 0x558056d2c730 2024-09-13T06:11:44.934 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.927+0000 7f1e5f082640 1 -- 172.21.15.194:0/1756387771 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e500083f0 con 0x558056d2c730 2024-09-13T06:11:44.934 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.927+0000 7f1e5f082640 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558056d30370 con 0x7f1e480dc040 2024-09-13T06:11:44.934 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.931+0000 7f1e5f082640 1 -- 172.21.15.194:0/1756387771 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e500083f0 con 0x7f1e480dc040 2024-09-13T06:11:44.934 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.931+0000 7f1e5f082640 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558056d30370 con 0x7f1e480dc040 2024-09-13T06:11:44.934 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.931+0000 7f1e5f082640 1 -- 172.21.15.194:0/1756387771 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e500083f0 con 0x7f1e480dc040 2024-09-13T06:11:44.934 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.931+0000 7f1e5f082640 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558056d30370 con 0x7f1e58041500 2024-09-13T06:11:44.934 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.931+0000 7f1e5e080640 1 -- 172.21.15.194:0/1756387771 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e480c9030 con 0x7f1e58041500 2024-09-13T06:11:44.934 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.931+0000 7f1e5e080640 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558056d30370 con 0x558056d310d0 2024-09-13T06:11:44.934 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.931+0000 7f1e5e881640 1 -- 172.21.15.194:0/1756387771 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e5807b070 con 0x558056d310d0 2024-09-13T06:11:44.934 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.931+0000 7f1e5e881640 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558056d30370 con 0x558056d2c730 2024-09-13T06:11:44.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.931+0000 7f1e5f082640 1 -- 172.21.15.194:0/1756387771 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e500083f0 con 0x558056d2c730 2024-09-13T06:11:44.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.931+0000 7f1e5f082640 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558056d30370 con 0x7f1e480dc040 2024-09-13T06:11:44.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.931+0000 7f1e5f082640 1 -- 172.21.15.194:0/1756387771 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e500083f0 con 0x7f1e480dc040 2024-09-13T06:11:44.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.931+0000 7f1e5f082640 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558056d30370 con 0x558056d2c730 2024-09-13T06:11:44.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.931+0000 7f1e5f082640 1 -- 172.21.15.194:0/1756387771 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e500083f0 con 0x558056d2c730 2024-09-13T06:11:44.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.931+0000 7f1e5f082640 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558056d30370 con 0x7f1e58041500 2024-09-13T06:11:44.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.931+0000 7f1e5e080640 1 -- 172.21.15.194:0/1756387771 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1e480c9030 con 0x7f1e58041500 2024-09-13T06:11:44.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.931+0000 7f1e5e080640 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558056d30370 con 0x558056d310d0 2024-09-13T06:11:44.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.931+0000 7f1e5e881640 1 -- 172.21.15.194:0/1756387771 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e5807b070 con 0x558056d310d0 2024-09-13T06:11:44.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.931+0000 7f1e5e881640 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558056d30370 con 0x558056d310d0 2024-09-13T06:11:44.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.931+0000 7f1e5e881640 1 -- 172.21.15.194:0/1756387771 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e5807b070 con 0x558056d310d0 2024-09-13T06:11:44.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.931+0000 7f1e5e881640 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558056d30370 con 0x7f1e480dc040 2024-09-13T06:11:44.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.935+0000 7f1e5f082640 1 -- 172.21.15.194:0/1756387771 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e500083f0 con 0x7f1e480dc040 2024-09-13T06:11:44.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.935+0000 7f1e5f082640 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558056d30370 con 0x558056d310d0 2024-09-13T06:11:44.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.935+0000 7f1e5e881640 1 -- 172.21.15.194:0/1756387771 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e5807b070 con 0x558056d310d0 2024-09-13T06:11:44.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.935+0000 7f1e5e881640 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558056d30370 con 0x558056d310d0 2024-09-13T06:11:44.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.935+0000 7f1e5e881640 1 -- 172.21.15.194:0/1756387771 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e5807b070 con 0x558056d310d0 2024-09-13T06:11:44.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.935+0000 7f1e5e881640 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558056d30370 con 0x558056d2c730 2024-09-13T06:11:44.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.935+0000 7f1e5f082640 1 -- 172.21.15.194:0/1756387771 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e500083f0 con 0x558056d2c730 2024-09-13T06:11:44.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.935+0000 7f1e5f082640 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558056d30370 con 0x558056d2c730 2024-09-13T06:11:44.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.935+0000 7f1e5f082640 1 -- 172.21.15.194:0/1756387771 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v35'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1e500083f0 con 0x558056d2c730 2024-09-13T06:11:44.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.935+0000 7f1e5f082640 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558056d30370 con 0x7f1e58041500 2024-09-13T06:11:44.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.935+0000 7f1e5e080640 1 -- 172.21.15.194:0/1756387771 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e480c9030 con 0x7f1e58041500 2024-09-13T06:11:44.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.935+0000 7f1e5e080640 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558056d30370 con 0x558056d310d0 2024-09-13T06:11:44.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.935+0000 7f1e5e881640 1 -- 172.21.15.194:0/1756387771 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e5807b070 con 0x558056d310d0 2024-09-13T06:11:44.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.935+0000 7f1e5e881640 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558056d30370 con 0x7f1e58041500 2024-09-13T06:11:44.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.935+0000 7f1e5e080640 1 -- 172.21.15.194:0/1756387771 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e480c9030 con 0x7f1e58041500 2024-09-13T06:11:44.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.935+0000 7f1e5e080640 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558056d30370 con 0x558056d2c730 2024-09-13T06:11:44.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.935+0000 7f1e5f082640 1 -- 172.21.15.194:0/1756387771 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e500083f0 con 0x558056d2c730 2024-09-13T06:11:44.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.935+0000 7f1e5f082640 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558056d30370 con 0x7f1e480dc040 2024-09-13T06:11:44.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.935+0000 7f1e5f082640 1 -- 172.21.15.194:0/1756387771 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e500083f0 con 0x7f1e480dc040 2024-09-13T06:11:44.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.935+0000 7f1e5f082640 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558056d30370 con 0x558056d310d0 2024-09-13T06:11:44.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.935+0000 7f1e5e881640 1 -- 172.21.15.194:0/1756387771 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=107b] v35'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1e5807b070 con 0x558056d310d0 2024-09-13T06:11:44.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.935+0000 7f1e5e881640 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558056d30370 con 0x7f1e58041500 2024-09-13T06:11:44.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.935+0000 7f1e5e080640 1 -- 172.21.15.194:0/1756387771 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e480c9030 con 0x7f1e58041500 2024-09-13T06:11:44.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.935+0000 7f1e5e080640 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558056d30370 con 0x7f1e58041500 2024-09-13T06:11:44.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.939+0000 7f1e5e080640 1 -- 172.21.15.194:0/1756387771 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e480c9030 con 0x7f1e58041500 2024-09-13T06:11:44.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.939+0000 7f1e5e080640 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558056d30370 con 0x558056d310d0 2024-09-13T06:11:44.945 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.939+0000 7f1e5e881640 1 -- 172.21.15.194:0/1756387771 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e5807b070 con 0x558056d310d0 2024-09-13T06:11:44.945 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.939+0000 7f1e5e881640 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558056d30370 con 0x7f1e480dc040 2024-09-13T06:11:44.945 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.939+0000 7f1e5f082640 1 -- 172.21.15.194:0/1756387771 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e500083f0 con 0x7f1e480dc040 2024-09-13T06:11:44.945 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.939+0000 7f1e5f082640 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558056d30370 con 0x558056d2c730 2024-09-13T06:11:44.945 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.939+0000 7f1e5f082640 1 -- 172.21.15.194:0/1756387771 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v35'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1e500083f0 con 0x558056d2c730 2024-09-13T06:11:44.945 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.939+0000 7f1e5f082640 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558056d30370 con 0x7f1e58041500 2024-09-13T06:11:44.945 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.939+0000 7f1e5e080640 1 -- 172.21.15.194:0/1756387771 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e480c9030 con 0x7f1e58041500 2024-09-13T06:11:44.945 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.939+0000 7f1e60d71980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:11:44.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.939+0000 7f1e60d71980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:11:44.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.939+0000 7f1e60d71980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:11:44.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.939+0000 7f1e60d71980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:11:44.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.939+0000 7f1e60d71980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:11:44.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.939+0000 7f1e60d71980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:11:44.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.939+0000 7f1e60d71980 20 rados->read ofs=0 len=0 2024-09-13T06:11:44.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.939+0000 7f1e60d71980 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558056d344e0 con 0x558056d2c730 2024-09-13T06:11:44.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.939+0000 7f1e5f082640 1 -- 172.21.15.194:0/1756387771 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1e500083f0 con 0x558056d2c730 2024-09-13T06:11:44.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.939+0000 7f1e60d71980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:44.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.939+0000 7f1e60d71980 20 rados->read ofs=0 len=0 2024-09-13T06:11:44.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.939+0000 7f1e60d71980 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558056d34d30 con 0x558056d2c730 2024-09-13T06:11:44.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.939+0000 7f1e5f082640 1 -- 172.21.15.194:0/1756387771 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1e500083f0 con 0x558056d2c730 2024-09-13T06:11:44.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.939+0000 7f1e60d71980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:11:44.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.939+0000 7f1e60d71980 20 rados->read ofs=0 len=0 2024-09-13T06:11:44.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.939+0000 7f1e60d71980 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558056d34140 con 0x7f1e58041500 2024-09-13T06:11:44.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.939+0000 7f1e5e080640 1 -- 172.21.15.194:0/1756387771 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1e480c9030 con 0x7f1e58041500 2024-09-13T06:11:44.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.939+0000 7f1e60d71980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:11:44.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.939+0000 7f1e60d71980 20 zone default found 2024-09-13T06:11:44.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.939+0000 7f1e60d71980 4 Realm: () 2024-09-13T06:11:44.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.939+0000 7f1e60d71980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:11:44.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.939+0000 7f1e60d71980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:11:44.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.939+0000 7f1e60d71980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:11:44.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.939+0000 7f1e60d71980 20 zonegroup default 2024-09-13T06:11:44.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.939+0000 7f1e60d71980 20 rados->read ofs=0 len=0 2024-09-13T06:11:44.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.939+0000 7f1e60d71980 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558056d357f0 con 0x7f1e480dc040 2024-09-13T06:11:44.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.939+0000 7f1e5f082640 1 -- 172.21.15.194:0/1756387771 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1e500083f0 con 0x7f1e480dc040 2024-09-13T06:11:44.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.939+0000 7f1e60d71980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:44.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.939+0000 7f1e60d71980 20 rados->read ofs=0 len=0 2024-09-13T06:11:44.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.939+0000 7f1e60d71980 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558056d371d0 con 0x558056d310d0 2024-09-13T06:11:44.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.939+0000 7f1e5e881640 1 -- 172.21.15.194:0/1756387771 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1e5807b070 con 0x558056d310d0 2024-09-13T06:11:44.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.943+0000 7f1e60d71980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:44.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.943+0000 7f1e60d71980 20 rados->read ofs=0 len=0 2024-09-13T06:11:44.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.943+0000 7f1e60d71980 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558056d376f0 con 0x558056d310d0 2024-09-13T06:11:44.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.943+0000 7f1e5e881640 1 -- 172.21.15.194:0/1756387771 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1e5807b070 con 0x558056d310d0 2024-09-13T06:11:44.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.943+0000 7f1e60d71980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:44.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.943+0000 7f1e60d71980 20 started sync module instance, tier type = 2024-09-13T06:11:44.949 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.943+0000 7f1e60d71980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:11:44.949 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.943+0000 7f1e60d71980 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558056d36670 con 0x7f1e58041500 2024-09-13T06:11:44.950 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.943+0000 7f1e5e080640 1 -- 172.21.15.194:0/1756387771 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(44 notify.0 [create] v35'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e480c9030 con 0x7f1e58041500 2024-09-13T06:11:44.950 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.943+0000 7f1e60d71980 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94009700870752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558056d362d0 con 0x7f1e58041500 2024-09-13T06:11:44.950 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.943+0000 7f1e60d71980 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558056d38530 con 0x558056d2c730 2024-09-13T06:11:44.950 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.943+0000 7f1e5e080640 1 -- 172.21.15.194:0/1756387771 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94009700870752] v35'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e480c9030 con 0x7f1e58041500 2024-09-13T06:11:44.950 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.947+0000 7f1e5f082640 1 -- 172.21.15.194:0/1756387771 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v35'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e500083f0 con 0x558056d2c730 2024-09-13T06:11:44.950 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.947+0000 7f1e60d71980 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94009700875088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558056d38920 con 0x558056d2c730 2024-09-13T06:11:44.950 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.947+0000 7f1e60d71980 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558056d392e0 con 0x558056d310d0 2024-09-13T06:11:44.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.947+0000 7f1e5f082640 1 -- 172.21.15.194:0/1756387771 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94009700875088] v35'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e500083f0 con 0x558056d2c730 2024-09-13T06:11:44.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.947+0000 7f1e5e881640 1 -- 172.21.15.194:0/1756387771 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v35'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e5807b070 con 0x558056d310d0 2024-09-13T06:11:44.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.947+0000 7f1e60d71980 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94009700879920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558056d396d0 con 0x558056d310d0 2024-09-13T06:11:44.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.947+0000 7f1e60d71980 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558056d3a090 con 0x7f1e58041500 2024-09-13T06:11:44.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.951+0000 7f1e5e080640 1 -- 172.21.15.194:0/1756387771 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(50 notify.3 [create] v35'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e480c9030 con 0x7f1e58041500 2024-09-13T06:11:44.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.951+0000 7f1e60d71980 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94009700883424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558056d3a8e0 con 0x7f1e58041500 2024-09-13T06:11:44.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.951+0000 7f1e60d71980 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558056d3b2e0 con 0x558056d2c730 2024-09-13T06:11:44.953 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.951+0000 7f1e5e881640 1 -- 172.21.15.194:0/1756387771 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94009700879920] v35'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e5807b070 con 0x558056d310d0 2024-09-13T06:11:44.953 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.951+0000 7f1e5e080640 1 -- 172.21.15.194:0/1756387771 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94009700883424] v35'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e480c9030 con 0x7f1e58041500 2024-09-13T06:11:44.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.951+0000 7f1e5f082640 1 -- 172.21.15.194:0/1756387771 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v35'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e500083f0 con 0x558056d2c730 2024-09-13T06:11:44.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.951+0000 7f1e60d71980 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94009700876144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558056d3a430 con 0x558056d2c730 2024-09-13T06:11:44.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.951+0000 7f1e60d71980 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558056d3bb80 con 0x7f1e480dc040 2024-09-13T06:11:44.956 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.955+0000 7f1e5f082640 1 -- 172.21.15.194:0/1756387771 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94009700876144] v35'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e500083f0 con 0x558056d2c730 2024-09-13T06:11:44.957 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.955+0000 7f1e5f082640 1 -- 172.21.15.194:0/1756387771 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(54 notify.5 [create] v35'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e500083f0 con 0x7f1e480dc040 2024-09-13T06:11:44.957 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.955+0000 7f1e60d71980 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94009700888048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558056d3a430 con 0x7f1e480dc040 2024-09-13T06:11:44.957 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.955+0000 7f1e60d71980 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558056d3c010 con 0x7f1e480dc040 2024-09-13T06:11:44.958 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.955+0000 7f1e5f082640 1 -- 172.21.15.194:0/1756387771 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94009700888048] v35'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e500083f0 con 0x7f1e480dc040 2024-09-13T06:11:44.959 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.955+0000 7f1e5f082640 1 -- 172.21.15.194:0/1756387771 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(56 notify.6 [create] v35'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e500083f0 con 0x7f1e480dc040 2024-09-13T06:11:44.959 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.955+0000 7f1e60d71980 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94009700889856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558056d3bfd0 con 0x7f1e480dc040 2024-09-13T06:11:44.959 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.955+0000 7f1e60d71980 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558056d3c9f0 con 0x7f1e480dc040 2024-09-13T06:11:44.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.959+0000 7f1e5f082640 1 -- 172.21.15.194:0/1756387771 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94009700889856] v35'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e500083f0 con 0x7f1e480dc040 2024-09-13T06:11:44.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.959+0000 7f1e5f082640 1 -- 172.21.15.194:0/1756387771 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(58 notify.7 [create] v35'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e500083f0 con 0x7f1e480dc040 2024-09-13T06:11:44.962 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.959+0000 7f1e60d71980 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94009700893920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558056d3cbd0 con 0x7f1e480dc040 2024-09-13T06:11:44.962 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.959+0000 7f1e60d71980 20 add_watcher() i=0 2024-09-13T06:11:44.962 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.959+0000 7f1e60d71980 20 add_watcher() i=1 2024-09-13T06:11:44.962 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.959+0000 7f1e60d71980 20 add_watcher() i=2 2024-09-13T06:11:44.962 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.959+0000 7f1e60d71980 20 add_watcher() i=3 2024-09-13T06:11:44.962 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.959+0000 7f1e60d71980 20 add_watcher() i=4 2024-09-13T06:11:44.962 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.959+0000 7f1e60d71980 20 add_watcher() i=5 2024-09-13T06:11:44.962 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.959+0000 7f1e60d71980 20 add_watcher() i=6 2024-09-13T06:11:44.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.959+0000 7f1e5f082640 1 -- 172.21.15.194:0/1756387771 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94009700893920] v35'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e500083f0 con 0x7f1e480dc040 2024-09-13T06:11:44.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.959+0000 7f1e60d71980 20 add_watcher() i=7 2024-09-13T06:11:44.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.959+0000 7f1e60d71980 2 all 8 watchers are set, enabling cache 2024-09-13T06:11:44.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.959+0000 7f1e60d71980 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558056d3ffa0 con 0x558056d2c730 2024-09-13T06:11:44.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.963+0000 7f1e5f082640 1 -- 172.21.15.194:0/1756387771 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1e500083f0 con 0x558056d2c730 2024-09-13T06:11:44.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.963+0000 7f1e60d71980 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94009700895424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558056d3d390 con 0x558056d2c730 2024-09-13T06:11:44.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.963+0000 7f1e5f082640 1 -- 172.21.15.194:0/1756387771 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94009700895424] v35'241 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1e500083f0 con 0x558056d2c730 2024-09-13T06:11:44.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.963+0000 7f1d157e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:11:44.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.963+0000 7f1e60d71980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:11:44.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.963+0000 7f1e60d71980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:11:44.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.963+0000 7f1e60d71980 5 note: GC not initialized 2024-09-13T06:11:44.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.963+0000 7f1c8ffff640 20 reqs_thread_entry: start 2024-09-13T06:11:44.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.963+0000 7f1e60d71980 20 init_complete bucket index max shards: 11 2024-09-13T06:11:44.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.963+0000 7f1e60d71980 20 Filter name: none 2024-09-13T06:11:44.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.963+0000 7f1c8dffb640 20 reqs_thread_entry: start 2024-09-13T06:11:44.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.963+0000 7f1e60d71980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T06:11:44.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.963+0000 7f1e60d71980 20 rados->read ofs=0 len=0 2024-09-13T06:11:44.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.963+0000 7f1e60d71980 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558056d634e0 con 0x7f1e480dc040 2024-09-13T06:11:44.968 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.967+0000 7f1e5f082640 1 -- 172.21.15.194:0/1756387771 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7f1e500083f0 con 0x7f1e480dc040 2024-09-13T06:11:44.968 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.967+0000 7f1e60d71980 20 rados_obj.operate() r=0 bl.length=473 2024-09-13T06:11:44.968 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.967+0000 7f1e60d71980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-13T06:11:44.968 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.967+0000 7f1e60d71980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T06:11:44.968 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.967+0000 7f1e60d71980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:11:44.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.967+0000 7f1e60d71980 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558056d69e00 con 0x7f1e480dc040 2024-09-13T06:11:44.971 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.967+0000 7f1e5f082640 1 -- 172.21.15.194:0/1756387771 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v35'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f1e500083f0 con 0x7f1e480dc040 2024-09-13T06:11:44.971 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.967+0000 7f1e60d71980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T06:11:44.972 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.967+0000 7f1e60d71980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T06:11:44.972 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.967+0000 7f1e60d71980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T06:11:44.972 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.967+0000 7f1e60d71980 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94009701079152 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558056d654f0 con 0x558056d2c730 2024-09-13T06:11:44.972 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.967+0000 7f1e5f082640 1 -- 172.21.15.194:0/1756387771 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== watch-notify(notify (1) cookie 94009700876144 notify 150323855381 ret 0) ==== 678+0+0 (crc 0 0 0) 0x7f1e50010040 con 0x558056d2c730 2024-09-13T06:11:44.972 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.967+0000 7f1d427fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855381 cookie 94009700876144 notifier 4836 bl.length()=636 2024-09-13T06:11:44.972 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.967+0000 7f1d427fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T06:11:44.972 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.967+0000 7f1d427fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T06:11:44.972 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.967+0000 7f1e5f082640 1 -- 172.21.15.194:0/1756387771 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(64 notify.4 [notify cookie 94009701079152 out=8b] v0'0 uv243 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1e500083f0 con 0x558056d2c730 2024-09-13T06:11:44.972 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.967+0000 7f1d427fc640 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f1d24003eb0 con 0x558056d2c730 2024-09-13T06:11:44.972 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.967+0000 7f1e5f082640 1 -- 172.21.15.194:0/1756387771 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e500083f0 con 0x558056d2c730 2024-09-13T06:11:44.972 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.971+0000 7f1e5f082640 1 -- 172.21.15.194:0/1756387771 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== watch-notify(notify_complete (2) cookie 94009701079152 notify 150323855381 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f1e5003c440 con 0x558056d2c730 2024-09-13T06:11:44.973 INFO:teuthology.orchestra.run.smithi194.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T06:11:44.596796Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:11:44.596784Z","tags":[],"group_ids":[]} 2024-09-13T06:11:44.973 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.971+0000 7f1d157e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:11:44.973 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.971+0000 7f1e60d71980 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94009700895424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558056d612e0 con 0x558056d2c730 2024-09-13T06:11:44.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.971+0000 7f1e5f082640 1 -- 172.21.15.194:0/1756387771 <== osd.1 v2:172.21.15.194:6808/3135444559 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94009700895424] v35'242 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1e500083f0 con 0x558056d2c730 2024-09-13T06:11:44.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.971+0000 7f1e60d71980 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94009700870752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558056d612e0 con 0x7f1e58041500 2024-09-13T06:11:44.975 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.971+0000 7f1e5e080640 1 -- 172.21.15.194:0/1756387771 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94009700870752] v35'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e480c9030 con 0x7f1e58041500 2024-09-13T06:11:44.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.971+0000 7f1e60d71980 20 remove_watcher() i=0 2024-09-13T06:11:44.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.971+0000 7f1e60d71980 2 removed watcher, disabling cache 2024-09-13T06:11:44.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.971+0000 7f1e60d71980 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94009700875088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558056d36a60 con 0x558056d2c730 2024-09-13T06:11:44.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.975+0000 7f1e5f082640 1 -- 172.21.15.194:0/1756387771 <== osd.1 v2:172.21.15.194:6808/3135444559 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94009700875088] v35'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e500083f0 con 0x558056d2c730 2024-09-13T06:11:44.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.975+0000 7f1e60d71980 20 remove_watcher() i=1 2024-09-13T06:11:44.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.975+0000 7f1e60d71980 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94009700879920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558056d612e0 con 0x558056d310d0 2024-09-13T06:11:44.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.975+0000 7f1e5e881640 1 -- 172.21.15.194:0/1756387771 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94009700879920] v35'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e5807b070 con 0x558056d310d0 2024-09-13T06:11:44.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.979+0000 7f1e60d71980 20 remove_watcher() i=2 2024-09-13T06:11:44.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.979+0000 7f1e60d71980 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94009700883424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558056d37b50 con 0x7f1e58041500 2024-09-13T06:11:44.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.979+0000 7f1e5e080640 1 -- 172.21.15.194:0/1756387771 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94009700883424] v35'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e480c9030 con 0x7f1e58041500 2024-09-13T06:11:44.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.979+0000 7f1e60d71980 20 remove_watcher() i=3 2024-09-13T06:11:44.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.979+0000 7f1e60d71980 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94009700876144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558056d36a60 con 0x558056d2c730 2024-09-13T06:11:44.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.979+0000 7f1e5f082640 1 -- 172.21.15.194:0/1756387771 <== osd.1 v2:172.21.15.194:6808/3135444559 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94009700876144] v35'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e500083f0 con 0x558056d2c730 2024-09-13T06:11:44.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.979+0000 7f1e60d71980 20 remove_watcher() i=4 2024-09-13T06:11:44.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.979+0000 7f1e60d71980 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94009700888048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558056d38000 con 0x7f1e480dc040 2024-09-13T06:11:44.985 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.983+0000 7f1e5f082640 1 -- 172.21.15.194:0/1756387771 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94009700888048] v35'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e500083f0 con 0x7f1e480dc040 2024-09-13T06:11:44.986 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.983+0000 7f1e60d71980 20 remove_watcher() i=5 2024-09-13T06:11:44.986 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.983+0000 7f1e60d71980 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94009700889856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558056d38000 con 0x7f1e480dc040 2024-09-13T06:11:44.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.983+0000 7f1e5f082640 1 -- 172.21.15.194:0/1756387771 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94009700889856] v35'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e500083f0 con 0x7f1e480dc040 2024-09-13T06:11:44.988 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.983+0000 7f1e60d71980 20 remove_watcher() i=6 2024-09-13T06:11:44.988 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.983+0000 7f1e60d71980 1 -- 172.21.15.194:0/1756387771 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94009700893920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558056d38000 con 0x7f1e480dc040 2024-09-13T06:11:44.990 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.987+0000 7f1e5f082640 1 -- 172.21.15.194:0/1756387771 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94009700893920] v35'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e500083f0 con 0x7f1e480dc040 2024-09-13T06:11:44.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.987+0000 7f1e60d71980 20 remove_watcher() i=7 2024-09-13T06:11:44.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.987+0000 7f1e60d71980 1 -- 172.21.15.194:0/1756387771 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f1e480dc040 msgr2=0x7f1e480ce430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.987+0000 7f1e60d71980 1 --2- 172.21.15.194:0/1756387771 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f1e480dc040 0x7f1e480ce430 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.987+0000 7f1e60d71980 1 -- 172.21.15.194:0/1756387771 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x558056d2c730 msgr2=0x558056d2ebd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.987+0000 7f1e60d71980 1 --2- 172.21.15.194:0/1756387771 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x558056d2c730 0x558056d2ebd0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.987+0000 7f1e60d71980 1 -- 172.21.15.194:0/1756387771 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f1e58041500 msgr2=0x7f1e5800c150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.987+0000 7f1e60d71980 1 --2- 172.21.15.194:0/1756387771 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f1e58041500 0x7f1e5800c150 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.987+0000 7f1e60d71980 1 -- 172.21.15.194:0/1756387771 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x558056d310d0 msgr2=0x558056d334c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.987+0000 7f1e60d71980 1 --2- 172.21.15.194:0/1756387771 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x558056d310d0 0x558056d334c0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.987+0000 7f1e60d71980 1 -- 172.21.15.194:0/1756387771 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f1d28034600 msgr2=0x7f1d28036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.987+0000 7f1e60d71980 1 --2- 172.21.15.194:0/1756387771 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f1d28034600 0x7f1d28036ac0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1e480abaa0 tx=0x7f1e480b9040 comp rx=0 tx=0).stop 2024-09-13T06:11:44.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.987+0000 7f1e5f082640 1 -- 172.21.15.194:0/1756387771 reap_dead start 2024-09-13T06:11:44.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.987+0000 7f1e60d71980 1 -- 172.21.15.194:0/1756387771 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558056d1a5e0 msgr2=0x558056d217e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.987+0000 7f1e60d71980 1 --2- 172.21.15.194:0/1756387771 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558056d1a5e0 0x558056d217e0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f1e5803fbc0 tx=0x7f1e58050540 comp rx=0 tx=0).stop 2024-09-13T06:11:44.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.987+0000 7f1e60d71980 1 -- 172.21.15.194:0/1756387771 shutdown_connections 2024-09-13T06:11:44.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.987+0000 7f1e60d71980 1 --2- 172.21.15.194:0/1756387771 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558056d1a5e0 0x558056d217e0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.987+0000 7f1e60d71980 1 -- 172.21.15.194:0/1756387771 >> 172.21.15.194:0/1756387771 conn(0x558056d16a10 msgr2=0x558056d14ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:44.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.987+0000 7f1e60d71980 1 -- 172.21.15.194:0/1756387771 shutdown_connections 2024-09-13T06:11:44.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.987+0000 7f1e60d71980 1 -- 172.21.15.194:0/1756387771 wait complete. 2024-09-13T06:11:44.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.987+0000 7f1e60d71980 1 -- 172.21.15.194:0/4047560503 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f1d38034650 msgr2=0x7f1d38036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.987+0000 7f1e60d71980 1 --2- 172.21.15.194:0/4047560503 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f1d38034650 0x7f1d38036b10 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f1e4801b2c0 tx=0x7f1e48005a10 comp rx=0 tx=0).stop 2024-09-13T06:11:44.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.987+0000 7f1e60d71980 1 -- 172.21.15.194:0/4047560503 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558056d0ded0 msgr2=0x558056d0e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.987+0000 7f1e60d71980 1 --2- 172.21.15.194:0/4047560503 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558056d0ded0 0x558056d0e2f0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f1e58048380 tx=0x7f1e58020440 comp rx=0 tx=0).stop 2024-09-13T06:11:44.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.987+0000 7f1e60d71980 1 -- 172.21.15.194:0/4047560503 shutdown_connections 2024-09-13T06:11:44.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.987+0000 7f1e60d71980 1 --2- 172.21.15.194:0/4047560503 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f1d38034650 0x7f1d38036b10 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.987+0000 7f1e60d71980 1 --2- 172.21.15.194:0/4047560503 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558056d0ded0 0x558056d0e2f0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.987+0000 7f1e60d71980 1 -- 172.21.15.194:0/4047560503 >> 172.21.15.194:0/4047560503 conn(0x558056d03020 msgr2=0x558056d05aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:44.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.987+0000 7f1e60d71980 1 -- 172.21.15.194:0/4047560503 shutdown_connections 2024-09-13T06:11:44.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.987+0000 7f1e60d71980 1 -- 172.21.15.194:0/4047560503 wait complete. 2024-09-13T06:11:44.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.987+0000 7f1e60d71980 1 -- 172.21.15.194:0/3341938790 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x558056c01c70 msgr2=0x558056cf7000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.987+0000 7f1e60d71980 1 --2- 172.21.15.194:0/3341938790 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x558056c01c70 0x558056cf7000 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.987+0000 7f1e60d71980 1 -- 172.21.15.194:0/3341938790 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x558056cfd8a0 msgr2=0x558056cffc90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.987+0000 7f1e60d71980 1 --2- 172.21.15.194:0/3341938790 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x558056cfd8a0 0x558056cffc90 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.987+0000 7f1e60d71980 1 -- 172.21.15.194:0/3341938790 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x558056cf99a0 msgr2=0x558056cfbd90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.987+0000 7f1e60d71980 1 --2- 172.21.15.194:0/3341938790 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x558056cf99a0 0x558056cfbd90 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:44.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.987+0000 7f1e60d71980 1 -- 172.21.15.194:0/3341938790 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f1d440346f0 msgr2=0x7f1d44036bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.987+0000 7f1e60d71980 1 --2- 172.21.15.194:0/3341938790 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f1d440346f0 0x7f1d44036bb0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f1e480ad000 tx=0x7f1e480a5040 comp rx=0 tx=0).stop 2024-09-13T06:11:44.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.987+0000 7f1e60d71980 1 -- 172.21.15.194:0/3341938790 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558056bfd8f0 msgr2=0x558056cf0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:44.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.987+0000 7f1e60d71980 1 --2- 172.21.15.194:0/3341938790 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558056bfd8f0 0x558056cf0010 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x558056ce9e80 tx=0x7f1e58000f50 comp rx=0 tx=0).stop 2024-09-13T06:11:44.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.987+0000 7f1e5f082640 1 -- 172.21.15.194:0/3341938790 reap_dead start 2024-09-13T06:11:44.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.987+0000 7f1e60d71980 1 -- 172.21.15.194:0/3341938790 shutdown_connections 2024-09-13T06:11:44.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.987+0000 7f1e60d71980 1 -- 172.21.15.194:0/3341938790 >> 172.21.15.194:0/3341938790 conn(0x558056b71240 msgr2=0x558056ce3450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:44.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.987+0000 7f1e60d71980 1 -- 172.21.15.194:0/3341938790 shutdown_connections 2024-09-13T06:11:44.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:44.987+0000 7f1e60d71980 1 -- 172.21.15.194:0/3341938790 wait complete. 2024-09-13T06:11:45.002 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T06:11:44.596796Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:11:44.596784Z', 'tags': [], 'group_ids': []} 2024-09-13T06:11:45.003 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T06:11:44.596796Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:11:44.596784Z', 'tags': [], 'group_ids': []} 2024-09-13T06:11:45.003 ERROR:root:0 2024-09-13T06:11:45.003 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-09-13T06:11:45.003 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-09-13T06:11:45.003 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid system_user --display-name 'System User' --access-key system_akey --secret system_skey --caps user-info-without-keys=read --system 2024-09-13T06:11:45.090 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:11:45.090 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:11:45.091 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.087+0000 7fad3e7e8980 1 Processor -- start 2024-09-13T06:11:45.091 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.087+0000 7fad3e7e8980 1 -- start start 2024-09-13T06:11:45.091 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.087+0000 7fad3e7e8980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x563e1c2bd880 0x563e1c2bdc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.091 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.087+0000 7fad3e7e8980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563e1c143ae0 con 0x563e1c2be1d0 2024-09-13T06:11:45.092 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.087+0000 7fad3e7e8980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x563e1c167e30 con 0x563e1c2bd880 2024-09-13T06:11:45.092 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.091+0000 7fad3c2f8640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x563e1c2bd880 0x563e1c2bdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.092 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.091+0000 7fad3baf7640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x563e1c2be1d0 0x563e1c2c2c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:58376/0 (socket says 172.21.15.194:58376) 2024-09-13T06:11:45.092 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.091+0000 7fad3baf7640 1 -- 172.21.15.194:0/881475836 learned_addr learned my addr 172.21.15.194:0/881475836 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-09-13T06:11:45.093 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.091+0000 7fad3c2f8640 1 -- 172.21.15.194:0/881475836 >> v1:172.21.15.120:6789/0 conn(0x563e1c2be1d0 legacy=0x563e1c2c2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.093 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.091+0000 7fad3c2f8640 1 -- 172.21.15.194:0/881475836 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e1c2c5450 con 0x563e1c2bd880 2024-09-13T06:11:45.095 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.091+0000 7fad3c2f8640 1 --2- 172.21.15.194:0/881475836 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563e1c2bd880 0x563e1c2bdc60 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fad3000a480 tx=0x7fad3001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e44c26b5f5d60eec server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.095 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.091+0000 7fad3b2f6640 1 -- 172.21.15.194:0/881475836 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad300b0070 con 0x563e1c2bd880 2024-09-13T06:11:45.095 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.091+0000 7fad3b2f6640 1 -- 172.21.15.194:0/881475836 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad300ab540 con 0x563e1c2bd880 2024-09-13T06:11:45.095 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.091+0000 7fad3b2f6640 1 -- 172.21.15.194:0/881475836 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad300ab840 con 0x563e1c2bd880 2024-09-13T06:11:45.096 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.095+0000 7fad3e7e8980 1 -- 172.21.15.194:0/881475836 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563e1c2bd880 msgr2=0x563e1c2bdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.096 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.095+0000 7fad3e7e8980 1 --2- 172.21.15.194:0/881475836 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563e1c2bd880 0x563e1c2bdc60 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fad3000a480 tx=0x7fad3001b280 comp rx=0 tx=0).stop 2024-09-13T06:11:45.096 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.095+0000 7fad3e7e8980 1 -- 172.21.15.194:0/881475836 shutdown_connections 2024-09-13T06:11:45.096 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.095+0000 7fad3e7e8980 1 --2- 172.21.15.194:0/881475836 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563e1c2bd880 0x563e1c2bdc60 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:45.096 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.095+0000 7fad3e7e8980 1 -- 172.21.15.194:0/881475836 >> 172.21.15.194:0/881475836 conn(0x563e1c2311d0 msgr2=0x563e1c2315e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:45.096 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.095+0000 7fad3e7e8980 1 -- 172.21.15.194:0/881475836 shutdown_connections 2024-09-13T06:11:45.096 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.095+0000 7fad3e7e8980 1 -- 172.21.15.194:0/881475836 wait complete. 2024-09-13T06:11:45.112 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.107+0000 7fad3e7e8980 1 Processor -- start 2024-09-13T06:11:45.112 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.107+0000 7fad3e7e8980 1 -- start start 2024-09-13T06:11:45.112 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.107+0000 7fad3e7e8980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563e1c2bd880 0x563e1c3a8c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.112 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.107+0000 7fad3e7e8980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x563e1c169200 con 0x563e1c2bd880 2024-09-13T06:11:45.112 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.107+0000 7fad3c2f8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563e1c2bd880 0x563e1c3a8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.112 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.107+0000 7fad3c2f8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563e1c2bd880 0x563e1c3a8c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45060/0 (socket says 172.21.15.194:45060) 2024-09-13T06:11:45.112 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.107+0000 7fad3c2f8640 1 -- 172.21.15.194:0/2818166309 learned_addr learned my addr 172.21.15.194:0/2818166309 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:45.112 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.111+0000 7fad3c2f8640 1 -- 172.21.15.194:0/2818166309 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e1c3a9220 con 0x563e1c2bd880 2024-09-13T06:11:45.114 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.111+0000 7fad3c2f8640 1 --2- 172.21.15.194:0/2818166309 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563e1c2bd880 0x563e1c3a8c50 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fad300ae040 tx=0x7fad30003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50dbcfbadad81698 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.114 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.111+0000 7fac2a60c640 1 -- 172.21.15.194:0/2818166309 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad300b0040 con 0x563e1c2bd880 2024-09-13T06:11:45.115 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.111+0000 7fac2a60c640 1 -- 172.21.15.194:0/2818166309 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad300ab9d0 con 0x563e1c2bd880 2024-09-13T06:11:45.115 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.111+0000 7fac2a60c640 1 -- 172.21.15.194:0/2818166309 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad300abcf0 con 0x563e1c2bd880 2024-09-13T06:11:45.115 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.111+0000 7fad3e7e8980 1 -- 172.21.15.194:0/2818166309 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563e1c2bd880 msgr2=0x563e1c3a8c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.115 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.111+0000 7fad3e7e8980 1 --2- 172.21.15.194:0/2818166309 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563e1c2bd880 0x563e1c3a8c50 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fad300ae040 tx=0x7fad30003030 comp rx=0 tx=0).stop 2024-09-13T06:11:45.115 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.111+0000 7fad3e7e8980 1 -- 172.21.15.194:0/2818166309 shutdown_connections 2024-09-13T06:11:45.115 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.111+0000 7fad3e7e8980 1 --2- 172.21.15.194:0/2818166309 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563e1c2bd880 0x563e1c3a8c50 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:45.115 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.111+0000 7fad3e7e8980 1 -- 172.21.15.194:0/2818166309 >> 172.21.15.194:0/2818166309 conn(0x563e1c2311d0 msgr2=0x563e1c3a4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:45.115 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.111+0000 7fad3e7e8980 1 -- 172.21.15.194:0/2818166309 shutdown_connections 2024-09-13T06:11:45.115 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.111+0000 7fad3e7e8980 1 -- 172.21.15.194:0/2818166309 wait complete. 2024-09-13T06:11:45.115 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.111+0000 7fad3e7e8980 1 Processor -- start 2024-09-13T06:11:45.115 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.111+0000 7fad3e7e8980 1 -- start start 2024-09-13T06:11:45.115 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.111+0000 7fad3e7e8980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563e1c2bd880 0x563e1c3afec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.116 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.111+0000 7fad3e7e8980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x563e1c2c4e90 con 0x563e1c2bd880 2024-09-13T06:11:45.116 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.111+0000 7fad3c2f8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563e1c2bd880 0x563e1c3afec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.116 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.111+0000 7fad3c2f8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563e1c2bd880 0x563e1c3afec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45066/0 (socket says 172.21.15.194:45066) 2024-09-13T06:11:45.116 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.111+0000 7fad3c2f8640 1 -- 172.21.15.194:0/329724718 learned_addr learned my addr 172.21.15.194:0/329724718 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:45.118 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.111+0000 7fad3c2f8640 1 -- 172.21.15.194:0/329724718 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e1c3b0400 con 0x563e1c2bd880 2024-09-13T06:11:45.118 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.111+0000 7fad3c2f8640 1 --2- 172.21.15.194:0/329724718 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563e1c2bd880 0x563e1c3afec0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fad30019930 tx=0x7fad30018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.118 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.111+0000 7fac28e09640 1 -- 172.21.15.194:0/329724718 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad300b0070 con 0x563e1c2bd880 2024-09-13T06:11:45.118 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.111+0000 7fad3e7e8980 1 -- 172.21.15.194:0/329724718 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563e1c3b0690 con 0x563e1c2bd880 2024-09-13T06:11:45.118 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.111+0000 7fac28e09640 1 -- 172.21.15.194:0/329724718 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad300b68b0 con 0x563e1c2bd880 2024-09-13T06:11:45.118 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.111+0000 7fac28e09640 1 -- 172.21.15.194:0/329724718 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad300b6b90 con 0x563e1c2bd880 2024-09-13T06:11:45.118 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.111+0000 7fad3e7e8980 1 -- 172.21.15.194:0/329724718 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e1c3b3370 con 0x563e1c2bd880 2024-09-13T06:11:45.118 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.115+0000 7fac28e09640 1 -- 172.21.15.194:0/329724718 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fad300bf3f0 con 0x563e1c2bd880 2024-09-13T06:11:45.119 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.115+0000 7fac28e09640 1 --2- 172.21.15.194:0/329724718 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fac240346a0 0x7fac24036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.119 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.115+0000 7fac28e09640 1 -- 172.21.15.194:0/329724718 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fad300bc070 con 0x563e1c2bd880 2024-09-13T06:11:45.119 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.115+0000 7fad3baf7640 1 --2- 172.21.15.194:0/329724718 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fac240346a0 0x7fac24036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.119 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.115+0000 7fad3e7e8980 1 --2- 172.21.15.194:0/329724718 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x563e1c2be1d0 0x563e1c3b6e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.119 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.115+0000 7fad3e7e8980 1 -- 172.21.15.194:0/329724718 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3b74a0 con 0x563e1c2be1d0 2024-09-13T06:11:45.119 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.115+0000 7fad3caf9640 1 --2- 172.21.15.194:0/329724718 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x563e1c2be1d0 0x563e1c3b6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.119 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.115+0000 7fad3baf7640 1 --2- 172.21.15.194:0/329724718 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fac240346a0 0x7fac24036b60 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fad2c000f70 tx=0x7fad2c0012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.119 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.115+0000 7fad3caf9640 1 --2- 172.21.15.194:0/329724718 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x563e1c2be1d0 0x563e1c3b6e50 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.122 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.115+0000 7fad3caf9640 1 -- 172.21.15.194:0/329724718 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fad3400a4d0 con 0x563e1c2be1d0 2024-09-13T06:11:45.122 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.115+0000 7fad3e7e8980 1 -- 172.21.15.194:0/329724718 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3b4590 con 0x563e1c2be1d0 2024-09-13T06:11:45.122 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.115+0000 7fad3caf9640 1 -- 172.21.15.194:0/329724718 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fad3400a4d0 con 0x563e1c2be1d0 2024-09-13T06:11:45.122 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.115+0000 7fad3e7e8980 1 --2- 172.21.15.194:0/329724718 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x563e1c3b97d0 0x563e1c3bbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.122 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.115+0000 7fad3e7e8980 1 -- 172.21.15.194:0/329724718 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3bc290 con 0x563e1c3b97d0 2024-09-13T06:11:45.122 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.115+0000 7fad3c2f8640 1 --2- 172.21.15.194:0/329724718 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x563e1c3b97d0 0x563e1c3bbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.122 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.115+0000 7fad3c2f8640 1 --2- 172.21.15.194:0/329724718 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x563e1c3b97d0 0x563e1c3bbbc0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.122 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.115+0000 7fad3c2f8640 1 -- 172.21.15.194:0/329724718 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fad300b3040 con 0x563e1c3b97d0 2024-09-13T06:11:45.122 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.115+0000 7fad3e7e8980 1 -- 172.21.15.194:0/329724718 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3b8670 con 0x563e1c2be1d0 2024-09-13T06:11:45.122 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.119+0000 7fad3caf9640 1 -- 172.21.15.194:0/329724718 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fad3400a4d0 con 0x563e1c2be1d0 2024-09-13T06:11:45.123 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.119+0000 7fad3e7e8980 1 --2- 172.21.15.194:0/329724718 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x563e1c3bd6f0 0x563e1c3bfae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.123 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.119+0000 7fad3e7e8980 1 -- 172.21.15.194:0/329724718 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3c01e0 con 0x563e1c3bd6f0 2024-09-13T06:11:45.123 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.119+0000 7fad3baf7640 1 --2- 172.21.15.194:0/329724718 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x563e1c3bd6f0 0x563e1c3bfae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.123 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.119+0000 7fad3baf7640 1 --2- 172.21.15.194:0/329724718 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x563e1c3bd6f0 0x563e1c3bfae0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.123 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.119+0000 7fad3baf7640 1 -- 172.21.15.194:0/329724718 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fad2c00e620 con 0x563e1c3bd6f0 2024-09-13T06:11:45.123 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.119+0000 7fad3e7e8980 1 Processor -- start 2024-09-13T06:11:45.123 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.119+0000 7fad3e7e8980 1 -- start start 2024-09-13T06:11:45.123 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.119+0000 7fad3e7e8980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563e1c3cdcb0 0x563e1c3ce0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.123 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.119+0000 7fad3e7e8980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x563e1c1c2800 con 0x563e1c3cdcb0 2024-09-13T06:11:45.123 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.119+0000 7fad3c2f8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563e1c3cdcb0 0x563e1c3ce0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.123 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.119+0000 7fad3c2f8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563e1c3cdcb0 0x563e1c3ce0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45068/0 (socket says 172.21.15.194:45068) 2024-09-13T06:11:45.123 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.119+0000 7fad3c2f8640 1 -- 172.21.15.194:0/2835669293 learned_addr learned my addr 172.21.15.194:0/2835669293 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:45.126 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.119+0000 7fad3c2f8640 1 -- 172.21.15.194:0/2835669293 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e1c3ce610 con 0x563e1c3cdcb0 2024-09-13T06:11:45.126 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.119+0000 7fad3c2f8640 1 --2- 172.21.15.194:0/2835669293 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563e1c3cdcb0 0x563e1c3ce0d0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fad300ab510 tx=0x7fad300b56c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.126 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.119+0000 7fac21ffb640 1 -- 172.21.15.194:0/2835669293 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad300b4d90 con 0x563e1c3cdcb0 2024-09-13T06:11:45.126 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.119+0000 7fac21ffb640 1 -- 172.21.15.194:0/2835669293 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad300bf730 con 0x563e1c3cdcb0 2024-09-13T06:11:45.126 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.119+0000 7fad3e7e8980 1 -- 172.21.15.194:0/2835669293 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563e1c3ce840 con 0x563e1c3cdcb0 2024-09-13T06:11:45.126 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.119+0000 7fac21ffb640 1 -- 172.21.15.194:0/2835669293 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad300bfa10 con 0x563e1c3cdcb0 2024-09-13T06:11:45.126 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.119+0000 7fad3e7e8980 1 -- 172.21.15.194:0/2835669293 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e1c3d14c0 con 0x563e1c3cdcb0 2024-09-13T06:11:45.126 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.123+0000 7fac21ffb640 1 -- 172.21.15.194:0/2835669293 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fad300e4aa0 con 0x563e1c3cdcb0 2024-09-13T06:11:45.126 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.123+0000 7fac21ffb640 1 --2- 172.21.15.194:0/2835669293 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fac14034650 0x7fac14036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.127 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.123+0000 7fac21ffb640 1 -- 172.21.15.194:0/2835669293 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fad300d8050 con 0x563e1c3cdcb0 2024-09-13T06:11:45.127 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.123+0000 7fad3baf7640 1 --2- 172.21.15.194:0/2835669293 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fac14034650 0x7fac14036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.127 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.123+0000 7fad3e7e8980 1 Processor -- start 2024-09-13T06:11:45.127 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.123+0000 7fad3e7e8980 1 -- start start 2024-09-13T06:11:45.127 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.123+0000 7fad3baf7640 1 --2- 172.21.15.194:0/2835669293 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fac14034650 0x7fac14036b10 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fad2c00bf60 tx=0x7fad2c00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.127 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.123+0000 7fad3e7e8980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563e1c3da5e0 0x563e1c3da9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.127 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.123+0000 7fad3e7e8980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x563e1c3a94e0 con 0x563e1c3da5e0 2024-09-13T06:11:45.127 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.123+0000 7fad3c2f8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563e1c3da5e0 0x563e1c3da9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.127 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.123+0000 7fad3c2f8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563e1c3da5e0 0x563e1c3da9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45070/0 (socket says 172.21.15.194:45070) 2024-09-13T06:11:45.127 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.123+0000 7fad3c2f8640 1 -- 172.21.15.194:0/254383765 learned_addr learned my addr 172.21.15.194:0/254383765 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:45.127 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.123+0000 7fad3c2f8640 1 -- 172.21.15.194:0/254383765 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e1c3dafb0 con 0x563e1c3da5e0 2024-09-13T06:11:45.128 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.123+0000 7fad3c2f8640 1 --2- 172.21.15.194:0/254383765 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563e1c3da5e0 0x563e1c3da9e0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fad300d2830 tx=0x7fad300d28a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed0322611d83584a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.130 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.123+0000 7fac1b7fe640 1 -- 172.21.15.194:0/254383765 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad300e4770 con 0x563e1c3da5e0 2024-09-13T06:11:45.130 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.123+0000 7fac1b7fe640 1 -- 172.21.15.194:0/254383765 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad30008170 con 0x563e1c3da5e0 2024-09-13T06:11:45.130 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.123+0000 7fac1b7fe640 1 -- 172.21.15.194:0/254383765 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad300e44b0 con 0x563e1c3da5e0 2024-09-13T06:11:45.130 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.123+0000 7fad3e7e8980 1 -- 172.21.15.194:0/254383765 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563e1c3da5e0 msgr2=0x563e1c3da9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.130 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.123+0000 7fad3e7e8980 1 --2- 172.21.15.194:0/254383765 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563e1c3da5e0 0x563e1c3da9e0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fad300d2830 tx=0x7fad300d28a0 comp rx=0 tx=0).stop 2024-09-13T06:11:45.130 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.123+0000 7fad3e7e8980 1 -- 172.21.15.194:0/254383765 shutdown_connections 2024-09-13T06:11:45.130 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.123+0000 7fad3e7e8980 1 --2- 172.21.15.194:0/254383765 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563e1c3da5e0 0x563e1c3da9e0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:45.130 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.123+0000 7fad3e7e8980 1 -- 172.21.15.194:0/254383765 >> 172.21.15.194:0/254383765 conn(0x563e1c3d6970 msgr2=0x563e1c3d4a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:45.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.123+0000 7fad3e7e8980 1 -- 172.21.15.194:0/254383765 shutdown_connections 2024-09-13T06:11:45.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.123+0000 7fad3e7e8980 1 -- 172.21.15.194:0/254383765 wait complete. 2024-09-13T06:11:45.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.123+0000 7fad3e7e8980 1 Processor -- start 2024-09-13T06:11:45.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.123+0000 7fad3e7e8980 1 -- start start 2024-09-13T06:11:45.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.123+0000 7fad3e7e8980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563e1c3da5e0 0x563e1c3e1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.123+0000 7fad3e7e8980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x563e1c3db500 con 0x563e1c3da5e0 2024-09-13T06:11:45.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.127+0000 7fad3c2f8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563e1c3da5e0 0x563e1c3e1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.127+0000 7fad3c2f8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563e1c3da5e0 0x563e1c3e1750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45078/0 (socket says 172.21.15.194:45078) 2024-09-13T06:11:45.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.127+0000 7fad3c2f8640 1 -- 172.21.15.194:0/4157493996 learned_addr learned my addr 172.21.15.194:0/4157493996 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:45.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.127+0000 7fad3c2f8640 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e1c3e1c90 con 0x563e1c3da5e0 2024-09-13T06:11:45.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.127+0000 7fad3c2f8640 1 --2- 172.21.15.194:0/4157493996 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563e1c3da5e0 0x563e1c3e1750 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fad300d28e0 tx=0x7fad300ddea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.132 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.127+0000 7fac19ffb640 1 -- 172.21.15.194:0/4157493996 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad300aa6f0 con 0x563e1c3da5e0 2024-09-13T06:11:45.132 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.127+0000 7fad3e7e8980 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563e1c3e1c90 con 0x563e1c3da5e0 2024-09-13T06:11:45.132 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.127+0000 7fad3e7e8980 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e1c3e1c90 con 0x563e1c3da5e0 2024-09-13T06:11:45.132 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.127+0000 7fac19ffb640 1 -- 172.21.15.194:0/4157493996 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad300c07f0 con 0x563e1c3da5e0 2024-09-13T06:11:45.132 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.127+0000 7fac19ffb640 1 -- 172.21.15.194:0/4157493996 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad300aa890 con 0x563e1c3da5e0 2024-09-13T06:11:45.137 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.127+0000 7fac19ffb640 1 -- 172.21.15.194:0/4157493996 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fad3010a060 con 0x563e1c3da5e0 2024-09-13T06:11:45.137 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.127+0000 7fac19ffb640 1 --2- 172.21.15.194:0/4157493996 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fac0c0346a0 0x7fac0c036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.137 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.127+0000 7fac19ffb640 1 -- 172.21.15.194:0/4157493996 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fad300a8070 con 0x563e1c3da5e0 2024-09-13T06:11:45.137 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.127+0000 7fad3baf7640 1 --2- 172.21.15.194:0/4157493996 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fac0c0346a0 0x7fac0c036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.137 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.127+0000 7fad3e7e8980 20 rados->read ofs=0 len=0 2024-09-13T06:11:45.137 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.127+0000 7fad3e7e8980 1 --2- 172.21.15.194:0/4157493996 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x563e1c3ec710 0x563e1c3eebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.137 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.127+0000 7fad3e7e8980 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3ef320 con 0x563e1c3ec710 2024-09-13T06:11:45.138 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.127+0000 7fad3caf9640 1 --2- 172.21.15.194:0/4157493996 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x563e1c3ec710 0x563e1c3eebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.138 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.127+0000 7fad3baf7640 1 --2- 172.21.15.194:0/4157493996 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fac0c0346a0 0x7fac0c036b60 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x563e1c3b7d80 tx=0x7fad2c010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.138 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.127+0000 7fad3caf9640 1 --2- 172.21.15.194:0/4157493996 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x563e1c3ec710 0x563e1c3eebd0 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.138 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.131+0000 7fad3caf9640 1 -- 172.21.15.194:0/4157493996 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fad3400a4d0 con 0x563e1c3ec710 2024-09-13T06:11:45.138 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.131+0000 7fad3e7e8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:45.138 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.131+0000 7fad3e7e8980 20 realm 2024-09-13T06:11:45.138 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.131+0000 7fad3e7e8980 20 rados->read ofs=0 len=0 2024-09-13T06:11:45.138 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.131+0000 7fad3e7e8980 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3ef730 con 0x563e1c3ec710 2024-09-13T06:11:45.138 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.131+0000 7fad3caf9640 1 -- 172.21.15.194:0/4157493996 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fad3400a4d0 con 0x563e1c3ec710 2024-09-13T06:11:45.138 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.131+0000 7fad3e7e8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:45.138 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.131+0000 7fad3e7e8980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:11:45.138 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.131+0000 7fad3e7e8980 20 rados->read ofs=0 len=0 2024-09-13T06:11:45.139 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.131+0000 7fad3e7e8980 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3f0000 con 0x563e1c3ec710 2024-09-13T06:11:45.139 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.131+0000 7fad3caf9640 1 -- 172.21.15.194:0/4157493996 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fad3400a4d0 con 0x563e1c3ec710 2024-09-13T06:11:45.139 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.131+0000 7fad3e7e8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:45.139 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.131+0000 7fad3e7e8980 20 rados->read ofs=0 len=0 2024-09-13T06:11:45.139 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.131+0000 7fad3e7e8980 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3f03a0 con 0x563e1c3ec710 2024-09-13T06:11:45.139 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.131+0000 7fad3caf9640 1 -- 172.21.15.194:0/4157493996 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fad3400a4d0 con 0x563e1c3ec710 2024-09-13T06:11:45.139 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.131+0000 7fad3e7e8980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:11:45.139 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.131+0000 7fad3e7e8980 20 rados->read ofs=0 len=0 2024-09-13T06:11:45.139 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.131+0000 7fad3e7e8980 1 --2- 172.21.15.194:0/4157493996 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x563e1c3f1100 0x563e1c3f34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.139 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.131+0000 7fad3e7e8980 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3f3b00 con 0x563e1c3f1100 2024-09-13T06:11:45.139 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.131+0000 7fad3c2f8640 1 --2- 172.21.15.194:0/4157493996 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x563e1c3f1100 0x563e1c3f34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.139 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.131+0000 7fad3c2f8640 1 --2- 172.21.15.194:0/4157493996 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x563e1c3f1100 0x563e1c3f34f0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.140 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.131+0000 7fad3c2f8640 1 -- 172.21.15.194:0/4157493996 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fad300b3040 con 0x563e1c3f1100 2024-09-13T06:11:45.140 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.131+0000 7fad3e7e8980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:11:45.140 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.131+0000 7fad3e7e8980 20 searching for the correct realm 2024-09-13T06:11:45.140 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.131+0000 7fad3e7e8980 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3f53d0 con 0x563e1c3f1100 2024-09-13T06:11:45.140 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.131+0000 7fad3c2f8640 1 -- 172.21.15.194:0/4157493996 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad300b3040 con 0x563e1c3f1100 2024-09-13T06:11:45.140 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.131+0000 7fad3c2f8640 1 --2- 172.21.15.194:0/4157493996 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fad300e40b0 0x7fad300db890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.140 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.131+0000 7fad3c2f8640 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3f53d0 con 0x7fad300e40b0 2024-09-13T06:11:45.140 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.131+0000 7fad3baf7640 1 --2- 172.21.15.194:0/4157493996 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fad300e40b0 0x7fad300db890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.140 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.131+0000 7fad3baf7640 1 --2- 172.21.15.194:0/4157493996 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fad300e40b0 0x7fad300db890 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.140 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.131+0000 7fad3baf7640 1 -- 172.21.15.194:0/4157493996 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fad2c00e620 con 0x7fad300e40b0 2024-09-13T06:11:45.140 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.131+0000 7fad3baf7640 1 --2- 172.21.15.194:0/4157493996 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fad2c037040 0x7fad2c036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.140 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.131+0000 7fad3baf7640 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3f53d0 con 0x7fad2c037040 2024-09-13T06:11:45.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.131+0000 7fad3caf9640 1 --2- 172.21.15.194:0/4157493996 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fad2c037040 0x7fad2c036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.135+0000 7fad3caf9640 1 --2- 172.21.15.194:0/4157493996 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fad2c037040 0x7fad2c036410 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.135+0000 7fad3caf9640 1 -- 172.21.15.194:0/4157493996 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad3400a4d0 con 0x7fad2c037040 2024-09-13T06:11:45.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.135+0000 7fad3caf9640 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3f03a0 con 0x563e1c3ec710 2024-09-13T06:11:45.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.135+0000 7fad3caf9640 1 -- 172.21.15.194:0/4157493996 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad3400a4d0 con 0x563e1c3ec710 2024-09-13T06:11:45.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.135+0000 7fad3caf9640 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3f03a0 con 0x563e1c3ec710 2024-09-13T06:11:45.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.135+0000 7fad3caf9640 1 -- 172.21.15.194:0/4157493996 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad3400a4d0 con 0x563e1c3ec710 2024-09-13T06:11:45.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.135+0000 7fad3caf9640 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3f03a0 con 0x7fad2c037040 2024-09-13T06:11:45.146 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.135+0000 7fad3caf9640 1 -- 172.21.15.194:0/4157493996 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad3400a4d0 con 0x7fad2c037040 2024-09-13T06:11:45.146 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.135+0000 7fad3caf9640 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3f03a0 con 0x7fad2c037040 2024-09-13T06:11:45.146 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.135+0000 7fad3caf9640 1 -- 172.21.15.194:0/4157493996 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad3400a4d0 con 0x7fad2c037040 2024-09-13T06:11:45.146 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.135+0000 7fad3caf9640 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3f03a0 con 0x7fad300e40b0 2024-09-13T06:11:45.146 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.135+0000 7fad3baf7640 1 -- 172.21.15.194:0/4157493996 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad2c00e620 con 0x7fad300e40b0 2024-09-13T06:11:45.146 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.135+0000 7fad3baf7640 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3f03a0 con 0x563e1c3f1100 2024-09-13T06:11:45.146 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.135+0000 7fad3c2f8640 1 -- 172.21.15.194:0/4157493996 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad300b3040 con 0x563e1c3f1100 2024-09-13T06:11:45.146 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.135+0000 7fad3c2f8640 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3f03a0 con 0x563e1c3ec710 2024-09-13T06:11:45.146 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.135+0000 7fad3caf9640 1 -- 172.21.15.194:0/4157493996 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad3400a4d0 con 0x563e1c3ec710 2024-09-13T06:11:45.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.135+0000 7fad3caf9640 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3f03a0 con 0x7fad2c037040 2024-09-13T06:11:45.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.135+0000 7fad3caf9640 1 -- 172.21.15.194:0/4157493996 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad3400a4d0 con 0x7fad2c037040 2024-09-13T06:11:45.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.135+0000 7fad3caf9640 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3f03a0 con 0x563e1c3ec710 2024-09-13T06:11:45.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.139+0000 7fad3caf9640 1 -- 172.21.15.194:0/4157493996 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad3400a4d0 con 0x563e1c3ec710 2024-09-13T06:11:45.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.139+0000 7fad3caf9640 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3f03a0 con 0x7fad300e40b0 2024-09-13T06:11:45.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.139+0000 7fad3baf7640 1 -- 172.21.15.194:0/4157493996 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fad2c00e620 con 0x7fad300e40b0 2024-09-13T06:11:45.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.139+0000 7fad3baf7640 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3f03a0 con 0x563e1c3f1100 2024-09-13T06:11:45.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.139+0000 7fad3c2f8640 1 -- 172.21.15.194:0/4157493996 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad300b3040 con 0x563e1c3f1100 2024-09-13T06:11:45.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.139+0000 7fad3c2f8640 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3f03a0 con 0x563e1c3f1100 2024-09-13T06:11:45.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.139+0000 7fad3c2f8640 1 -- 172.21.15.194:0/4157493996 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad300b3040 con 0x563e1c3f1100 2024-09-13T06:11:45.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.139+0000 7fad3c2f8640 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3f03a0 con 0x7fad2c037040 2024-09-13T06:11:45.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.139+0000 7fad3caf9640 1 -- 172.21.15.194:0/4157493996 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad3400a4d0 con 0x7fad2c037040 2024-09-13T06:11:45.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.139+0000 7fad3caf9640 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3f03a0 con 0x563e1c3f1100 2024-09-13T06:11:45.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.139+0000 7fad3c2f8640 1 -- 172.21.15.194:0/4157493996 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad300b3040 con 0x563e1c3f1100 2024-09-13T06:11:45.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.139+0000 7fad3c2f8640 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3f03a0 con 0x563e1c3f1100 2024-09-13T06:11:45.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.139+0000 7fad3c2f8640 1 -- 172.21.15.194:0/4157493996 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad300b3040 con 0x563e1c3f1100 2024-09-13T06:11:45.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.139+0000 7fad3c2f8640 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3f03a0 con 0x563e1c3ec710 2024-09-13T06:11:45.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.139+0000 7fad3caf9640 1 -- 172.21.15.194:0/4157493996 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad3400a4d0 con 0x563e1c3ec710 2024-09-13T06:11:45.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.139+0000 7fad3caf9640 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3f03a0 con 0x563e1c3ec710 2024-09-13T06:11:45.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.139+0000 7fad3caf9640 1 -- 172.21.15.194:0/4157493996 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v35'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fad3400a4d0 con 0x563e1c3ec710 2024-09-13T06:11:45.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.139+0000 7fad3caf9640 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3f03a0 con 0x7fad300e40b0 2024-09-13T06:11:45.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.139+0000 7fad3baf7640 1 -- 172.21.15.194:0/4157493996 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad2c00e620 con 0x7fad300e40b0 2024-09-13T06:11:45.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.139+0000 7fad3baf7640 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3f03a0 con 0x563e1c3f1100 2024-09-13T06:11:45.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.139+0000 7fad3c2f8640 1 -- 172.21.15.194:0/4157493996 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad300b3040 con 0x563e1c3f1100 2024-09-13T06:11:45.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.139+0000 7fad3c2f8640 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3f03a0 con 0x7fad300e40b0 2024-09-13T06:11:45.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.143+0000 7fad3baf7640 1 -- 172.21.15.194:0/4157493996 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad2c00e620 con 0x7fad300e40b0 2024-09-13T06:11:45.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.143+0000 7fad3baf7640 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3f03a0 con 0x563e1c3ec710 2024-09-13T06:11:45.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.143+0000 7fad3caf9640 1 -- 172.21.15.194:0/4157493996 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad3400a4d0 con 0x563e1c3ec710 2024-09-13T06:11:45.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.143+0000 7fad3caf9640 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3f03a0 con 0x7fad2c037040 2024-09-13T06:11:45.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.143+0000 7fad3caf9640 1 -- 172.21.15.194:0/4157493996 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad3400a4d0 con 0x7fad2c037040 2024-09-13T06:11:45.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.143+0000 7fad3caf9640 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3f03a0 con 0x563e1c3f1100 2024-09-13T06:11:45.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.143+0000 7fad3c2f8640 1 -- 172.21.15.194:0/4157493996 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=107b] v35'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fad300b3040 con 0x563e1c3f1100 2024-09-13T06:11:45.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.143+0000 7fad3c2f8640 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3f03a0 con 0x7fad300e40b0 2024-09-13T06:11:45.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.143+0000 7fad3baf7640 1 -- 172.21.15.194:0/4157493996 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad2c00e620 con 0x7fad300e40b0 2024-09-13T06:11:45.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.143+0000 7fad3baf7640 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3f03a0 con 0x7fad300e40b0 2024-09-13T06:11:45.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.143+0000 7fad3baf7640 1 -- 172.21.15.194:0/4157493996 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad2c00e620 con 0x7fad300e40b0 2024-09-13T06:11:45.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.143+0000 7fad3baf7640 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3f03a0 con 0x563e1c3f1100 2024-09-13T06:11:45.150 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.143+0000 7fad3c2f8640 1 -- 172.21.15.194:0/4157493996 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad300b3040 con 0x563e1c3f1100 2024-09-13T06:11:45.150 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.143+0000 7fad3c2f8640 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3f03a0 con 0x7fad2c037040 2024-09-13T06:11:45.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.143+0000 7fad3caf9640 1 -- 172.21.15.194:0/4157493996 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad3400a4d0 con 0x7fad2c037040 2024-09-13T06:11:45.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.143+0000 7fad3caf9640 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3f03a0 con 0x563e1c3ec710 2024-09-13T06:11:45.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.143+0000 7fad3caf9640 1 -- 172.21.15.194:0/4157493996 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v35'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fad3400a4d0 con 0x563e1c3ec710 2024-09-13T06:11:45.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.143+0000 7fad3caf9640 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3f03a0 con 0x7fad300e40b0 2024-09-13T06:11:45.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.143+0000 7fad3baf7640 1 -- 172.21.15.194:0/4157493996 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad2c00e620 con 0x7fad300e40b0 2024-09-13T06:11:45.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.143+0000 7fad3e7e8980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:11:45.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.143+0000 7fad3e7e8980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:11:45.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.143+0000 7fad3e7e8980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:11:45.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.143+0000 7fad3e7e8980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:11:45.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.143+0000 7fad3e7e8980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:11:45.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.143+0000 7fad3e7e8980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:11:45.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.143+0000 7fad3e7e8980 20 rados->read ofs=0 len=0 2024-09-13T06:11:45.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.143+0000 7fad3e7e8980 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3f44f0 con 0x563e1c3ec710 2024-09-13T06:11:45.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.143+0000 7fad3caf9640 1 -- 172.21.15.194:0/4157493996 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fad3400a4d0 con 0x563e1c3ec710 2024-09-13T06:11:45.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.143+0000 7fad3e7e8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:45.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.143+0000 7fad3e7e8980 20 rados->read ofs=0 len=0 2024-09-13T06:11:45.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.143+0000 7fad3e7e8980 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3f4130 con 0x563e1c3ec710 2024-09-13T06:11:45.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.143+0000 7fad3caf9640 1 -- 172.21.15.194:0/4157493996 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fad3400a4d0 con 0x563e1c3ec710 2024-09-13T06:11:45.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.143+0000 7fad3e7e8980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:11:45.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.143+0000 7fad3e7e8980 20 rados->read ofs=0 len=0 2024-09-13T06:11:45.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.143+0000 7fad3e7e8980 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3f4e10 con 0x7fad300e40b0 2024-09-13T06:11:45.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.147+0000 7fad3baf7640 1 -- 172.21.15.194:0/4157493996 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fad2c00e620 con 0x7fad300e40b0 2024-09-13T06:11:45.156 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.147+0000 7fad3e7e8980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:11:45.156 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.147+0000 7fad3e7e8980 20 zone default found 2024-09-13T06:11:45.156 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.147+0000 7fad3e7e8980 4 Realm: () 2024-09-13T06:11:45.156 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.147+0000 7fad3e7e8980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:11:45.156 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.147+0000 7fad3e7e8980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:11:45.156 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.147+0000 7fad3e7e8980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:11:45.156 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.147+0000 7fad3e7e8980 20 zonegroup default 2024-09-13T06:11:45.156 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.147+0000 7fad3e7e8980 20 rados->read ofs=0 len=0 2024-09-13T06:11:45.156 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.147+0000 7fad3e7e8980 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3f5800 con 0x7fad2c037040 2024-09-13T06:11:45.156 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.147+0000 7fad3caf9640 1 -- 172.21.15.194:0/4157493996 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fad3400a4d0 con 0x7fad2c037040 2024-09-13T06:11:45.156 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.147+0000 7fad3e7e8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:45.156 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.147+0000 7fad3e7e8980 20 rados->read ofs=0 len=0 2024-09-13T06:11:45.156 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.147+0000 7fad3e7e8980 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3f71e0 con 0x563e1c3f1100 2024-09-13T06:11:45.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.147+0000 7fad3c2f8640 1 -- 172.21.15.194:0/4157493996 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fad300b3040 con 0x563e1c3f1100 2024-09-13T06:11:45.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.147+0000 7fad3e7e8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:45.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.147+0000 7fad3e7e8980 20 rados->read ofs=0 len=0 2024-09-13T06:11:45.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.147+0000 7fad3e7e8980 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3f76d0 con 0x563e1c3f1100 2024-09-13T06:11:45.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.147+0000 7fad3c2f8640 1 -- 172.21.15.194:0/4157493996 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fad300b3040 con 0x563e1c3f1100 2024-09-13T06:11:45.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.147+0000 7fad3e7e8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:45.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.147+0000 7fad3e7e8980 20 started sync module instance, tier type = 2024-09-13T06:11:45.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.147+0000 7fad3e7e8980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:11:45.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.147+0000 7fad3e7e8980 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3f52e0 con 0x7fad300e40b0 2024-09-13T06:11:45.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.147+0000 7fad3baf7640 1 -- 172.21.15.194:0/4157493996 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(44 notify.0 [create] v35'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad2c00e620 con 0x7fad300e40b0 2024-09-13T06:11:45.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.147+0000 7fad3e7e8980 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94824761878320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3f7b30 con 0x7fad300e40b0 2024-09-13T06:11:45.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.147+0000 7fad3e7e8980 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3f8550 con 0x563e1c3ec710 2024-09-13T06:11:45.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.151+0000 7fad3baf7640 1 -- 172.21.15.194:0/4157493996 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94824761878320] v35'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad2c00e620 con 0x7fad300e40b0 2024-09-13T06:11:45.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.151+0000 7fad3caf9640 1 -- 172.21.15.194:0/4157493996 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v35'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad3400a4d0 con 0x563e1c3ec710 2024-09-13T06:11:45.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.151+0000 7fad3e7e8980 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94824761884736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3f8970 con 0x563e1c3ec710 2024-09-13T06:11:45.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.151+0000 7fad3e7e8980 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3f9330 con 0x563e1c3f1100 2024-09-13T06:11:45.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.151+0000 7fad3caf9640 1 -- 172.21.15.194:0/4157493996 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94824761884736] v35'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad3400a4d0 con 0x563e1c3ec710 2024-09-13T06:11:45.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.155+0000 7fad3c2f8640 1 -- 172.21.15.194:0/4157493996 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v35'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad300b3040 con 0x563e1c3f1100 2024-09-13T06:11:45.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.155+0000 7fad3e7e8980 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94824761888384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3f96d0 con 0x563e1c3f1100 2024-09-13T06:11:45.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.155+0000 7fad3e7e8980 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3fa090 con 0x7fad300e40b0 2024-09-13T06:11:45.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.155+0000 7fad3baf7640 1 -- 172.21.15.194:0/4157493996 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(50 notify.3 [create] v35'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad2c00e620 con 0x7fad300e40b0 2024-09-13T06:11:45.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.155+0000 7fad3e7e8980 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94824761891808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3fa8e0 con 0x7fad300e40b0 2024-09-13T06:11:45.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.155+0000 7fad3e7e8980 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3fb330 con 0x563e1c3ec710 2024-09-13T06:11:45.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.155+0000 7fad3c2f8640 1 -- 172.21.15.194:0/4157493996 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94824761888384] v35'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad300b3040 con 0x563e1c3f1100 2024-09-13T06:11:45.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.155+0000 7fad3baf7640 1 -- 172.21.15.194:0/4157493996 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94824761891808] v35'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad2c00e620 con 0x7fad300e40b0 2024-09-13T06:11:45.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.155+0000 7fad3caf9640 1 -- 172.21.15.194:0/4157493996 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v35'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad3400a4d0 con 0x563e1c3ec710 2024-09-13T06:11:45.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.155+0000 7fad3e7e8980 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94824761896480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3fa430 con 0x563e1c3ec710 2024-09-13T06:11:45.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.155+0000 7fad3e7e8980 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3fbbd0 con 0x7fad2c037040 2024-09-13T06:11:45.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.159+0000 7fad3caf9640 1 -- 172.21.15.194:0/4157493996 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94824761896480] v35'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad3400a4d0 con 0x563e1c3ec710 2024-09-13T06:11:45.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.159+0000 7fad3caf9640 1 -- 172.21.15.194:0/4157493996 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(54 notify.5 [create] v35'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad3400a4d0 con 0x7fad2c037040 2024-09-13T06:11:45.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.159+0000 7fad3e7e8980 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94824761879440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3fa430 con 0x7fad2c037040 2024-09-13T06:11:45.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.159+0000 7fad3e7e8980 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3fc060 con 0x7fad2c037040 2024-09-13T06:11:45.163 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.163+0000 7fad3caf9640 1 -- 172.21.15.194:0/4157493996 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94824761879440] v35'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad3400a4d0 con 0x7fad2c037040 2024-09-13T06:11:45.165 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.163+0000 7fad3caf9640 1 -- 172.21.15.194:0/4157493996 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(56 notify.6 [create] v35'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad3400a4d0 con 0x7fad2c037040 2024-09-13T06:11:45.165 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.163+0000 7fad3e7e8980 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94824761898240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3fc020 con 0x7fad2c037040 2024-09-13T06:11:45.165 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.163+0000 7fad3e7e8980 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3fcaa0 con 0x7fad2c037040 2024-09-13T06:11:45.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.163+0000 7fad3caf9640 1 -- 172.21.15.194:0/4157493996 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94824761898240] v35'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad3400a4d0 con 0x7fad2c037040 2024-09-13T06:11:45.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.163+0000 7fad3caf9640 1 -- 172.21.15.194:0/4157493996 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(58 notify.7 [create] v35'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad3400a4d0 con 0x7fad2c037040 2024-09-13T06:11:45.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.163+0000 7fad3e7e8980 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94824761899888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3fcc80 con 0x7fad2c037040 2024-09-13T06:11:45.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.163+0000 7fad3e7e8980 20 add_watcher() i=0 2024-09-13T06:11:45.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.163+0000 7fad3e7e8980 20 add_watcher() i=1 2024-09-13T06:11:45.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.163+0000 7fad3e7e8980 20 add_watcher() i=2 2024-09-13T06:11:45.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.163+0000 7fad3e7e8980 20 add_watcher() i=3 2024-09-13T06:11:45.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.163+0000 7fad3e7e8980 20 add_watcher() i=4 2024-09-13T06:11:45.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.163+0000 7fad3e7e8980 20 add_watcher() i=5 2024-09-13T06:11:45.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.163+0000 7fad3e7e8980 20 add_watcher() i=6 2024-09-13T06:11:45.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.167+0000 7fad3caf9640 1 -- 172.21.15.194:0/4157493996 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94824761899888] v35'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad3400a4d0 con 0x7fad2c037040 2024-09-13T06:11:45.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.167+0000 7fad3e7e8980 20 add_watcher() i=7 2024-09-13T06:11:45.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.167+0000 7fad3e7e8980 2 all 8 watchers are set, enabling cache 2024-09-13T06:11:45.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.167+0000 7fad3e7e8980 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3ffe20 con 0x563e1c3ec710 2024-09-13T06:11:45.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.167+0000 7fad3caf9640 1 -- 172.21.15.194:0/4157493996 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fad3400a4d0 con 0x563e1c3ec710 2024-09-13T06:11:45.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.167+0000 7fad3e7e8980 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94824761915376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3fcbc0 con 0x563e1c3ec710 2024-09-13T06:11:45.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.167+0000 7fad3caf9640 1 -- 172.21.15.194:0/4157493996 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94824761915376] v35'243 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fad3400a4d0 con 0x563e1c3ec710 2024-09-13T06:11:45.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.167+0000 7fabf27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:11:45.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.167+0000 7fad3e7e8980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:11:45.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.167+0000 7fad3e7e8980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:11:45.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.167+0000 7fad3e7e8980 5 note: GC not initialized 2024-09-13T06:11:45.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.167+0000 7fabf17e2640 20 reqs_thread_entry: start 2024-09-13T06:11:45.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.167+0000 7fad3e7e8980 20 init_complete bucket index max shards: 11 2024-09-13T06:11:45.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.171+0000 7fad3e7e8980 20 Filter name: none 2024-09-13T06:11:45.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.171+0000 7fab62ffd640 20 reqs_thread_entry: start 2024-09-13T06:11:45.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.171+0000 7fad3e7e8980 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-09-13T06:11:45.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.171+0000 7fad3e7e8980 20 rados->read ofs=0 len=0 2024-09-13T06:11:45.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.171+0000 7fad3e7e8980 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:62 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563e1c423550 con 0x7fad2c037040 2024-09-13T06:11:45.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.171+0000 7fad3caf9640 1 -- 172.21.15.194:0/4157493996 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(62 system_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 239+0+0 (crc 0 0 0) 0x7fad3400a4d0 con 0x7fad2c037040 2024-09-13T06:11:45.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.171+0000 7fad3e7e8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:45.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.171+0000 7fad3e7e8980 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x0 2024-09-13T06:11:45.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.171+0000 7fad3e7e8980 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-13T06:11:45.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.171+0000 7fad3e7e8980 10 cache get: name=default.rgw.meta+users.keys+system_akey : miss 2024-09-13T06:11:45.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.171+0000 7fad3e7e8980 20 rados->read ofs=0 len=0 2024-09-13T06:11:45.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.171+0000 7fad3e7e8980 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:63 8.0 8:01223cbf:users.keys::system_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563e1c421cf0 con 0x563e1c3f1100 2024-09-13T06:11:45.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.171+0000 7fad3c2f8640 1 -- 172.21.15.194:0/4157493996 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(63 system_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7fad300b3040 con 0x563e1c3f1100 2024-09-13T06:11:45.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.171+0000 7fad3e7e8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:45.175 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.171+0000 7fad3e7e8980 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x0 2024-09-13T06:11:45.175 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.171+0000 7fad3e7e8980 10 adding default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-13T06:11:45.175 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.171+0000 7fad3e7e8980 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-09-13T06:11:45.175 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.171+0000 7fad3e7e8980 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-09-13T06:11:45.175 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.171+0000 7fad3e7e8980 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:64 8.1e 8:78ce4db0:users.uid::system_user:head [delete,create,call version.set in=58b,writefull 0~349 in=349b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563e1c422590 con 0x7fad2c037040 2024-09-13T06:11:45.176 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.175+0000 7fad3caf9640 1 -- 172.21.15.194:0/4157493996 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(64 system_user [delete,create,call,writefull 0~349] v35'3 uv3 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7fad3400a4d0 con 0x7fad2c037040 2024-09-13T06:11:45.176 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.175+0000 7fad3e7e8980 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-09-13T06:11:45.176 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.175+0000 7fad3e7e8980 10 moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-13T06:11:45.176 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.175+0000 7fad3e7e8980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-09-13T06:11:45.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.175+0000 7fad3e7e8980 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94824762056928 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563e1c426ff0 con 0x7fad300e40b0 2024-09-13T06:11:45.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.175+0000 7fad3baf7640 1 -- 172.21.15.194:0/4157493996 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== watch-notify(notify (1) cookie 94824761878320 notify 150323855383 ret 0) ==== 575+0+0 (crc 0 0 0) 0x563e1c143ae0 con 0x7fad300e40b0 2024-09-13T06:11:45.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.175+0000 7fac1b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855383 cookie 94824761878320 notifier 4843 bl.length()=533 2024-09-13T06:11:45.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.175+0000 7fad3baf7640 1 -- 172.21.15.194:0/4157493996 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== osd_op_reply(65 notify.0 [notify cookie 94824762056928 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fad2c00e620 con 0x7fad300e40b0 2024-09-13T06:11:45.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.175+0000 7fac1b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-09-13T06:11:45.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.175+0000 7fac1b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-13T06:11:45.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.175+0000 7fac1b7fe640 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fac00003eb0 con 0x7fad300e40b0 2024-09-13T06:11:45.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.175+0000 7fad3baf7640 1 -- 172.21.15.194:0/4157493996 <== osd.2 v2:172.21.15.194:6800/815615585 16 ==== watch-notify(notify_complete (2) cookie 94824762056928 notify 150323855383 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fad2c038880 con 0x7fad300e40b0 2024-09-13T06:11:45.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.175+0000 7fad3baf7640 1 -- 172.21.15.194:0/4157493996 <== osd.2 v2:172.21.15.194:6800/815615585 17 ==== osd_op_reply(66 notify.0 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad2c00e620 con 0x7fad300e40b0 2024-09-13T06:11:45.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.175+0000 7fad3e7e8980 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:67 8.0 8:01223cbf:users.keys::system_akey:head [delete,create,writefull 0~15 in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563e1c4220e0 con 0x563e1c3f1100 2024-09-13T06:11:45.179 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.175+0000 7fad3c2f8640 1 -- 172.21.15.194:0/4157493996 <== osd.3 v2:172.21.15.194:6816/96632515 16 ==== osd_op_reply(67 system_akey [delete,create,writefull 0~15] v35'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7fad300b3040 con 0x563e1c3f1100 2024-09-13T06:11:45.179 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.175+0000 7fad3e7e8980 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-09-13T06:11:45.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.175+0000 7fad3e7e8980 10 moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-13T06:11:45.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.175+0000 7fad3e7e8980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-09-13T06:11:45.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.175+0000 7fad3e7e8980 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify cookie 94824762056928 in=188b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563e1c426ff0 con 0x563e1c3ec710 2024-09-13T06:11:45.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.175+0000 7fad3caf9640 1 -- 172.21.15.194:0/4157493996 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== watch-notify(notify (1) cookie 94824761884736 notify 150323855382 ret 0) ==== 218+0+0 (crc 0 0 0) 0x563e1c422930 con 0x563e1c3ec710 2024-09-13T06:11:45.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.175+0000 7fac1b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855382 cookie 94824761884736 notifier 4843 bl.length()=176 2024-09-13T06:11:45.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.175+0000 7fac1b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-09-13T06:11:45.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.175+0000 7fac1b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-13T06:11:45.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.175+0000 7fac1b7fe640 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fac00003eb0 con 0x563e1c3ec710 2024-09-13T06:11:45.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.175+0000 7fad3caf9640 1 -- 172.21.15.194:0/4157493996 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(68 notify.1 [notify cookie 94824762056928 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fad3400a4d0 con 0x563e1c3ec710 2024-09-13T06:11:45.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.175+0000 7fad3caf9640 1 -- 172.21.15.194:0/4157493996 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(69 notify.1 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad3400a4d0 con 0x563e1c3ec710 2024-09-13T06:11:45.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.175+0000 7fad3caf9640 1 -- 172.21.15.194:0/4157493996 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== watch-notify(notify_complete (2) cookie 94824762056928 notify 150323855382 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563e1c422fa0 con 0x563e1c3ec710 2024-09-13T06:11:45.181 INFO:teuthology.orchestra.run.smithi194.stdout:{"user_id":"system_user","display_name":"System User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"system_user","access_key":"system_akey","secret_key":"system_skey","active":true,"create_date":"2024-09-13T06:11:45.174287Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","system":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:11:45.174271Z","tags":[],"group_ids":[]} 2024-09-13T06:11:45.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.179+0000 7fabf27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:11:45.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.179+0000 7fad3e7e8980 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94824761915376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563e1c421350 con 0x563e1c3ec710 2024-09-13T06:11:45.182 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.179+0000 7fad3caf9640 1 -- 172.21.15.194:0/4157493996 <== osd.1 v2:172.21.15.194:6808/3135444559 25 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94824761915376] v35'244 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fad3400a4d0 con 0x563e1c3ec710 2024-09-13T06:11:45.182 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.179+0000 7fad3e7e8980 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94824761878320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563e1c421350 con 0x7fad300e40b0 2024-09-13T06:11:45.183 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.179+0000 7fad3baf7640 1 -- 172.21.15.194:0/4157493996 <== osd.2 v2:172.21.15.194:6800/815615585 18 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94824761878320] v35'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad2c00e620 con 0x7fad300e40b0 2024-09-13T06:11:45.183 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.179+0000 7fad3e7e8980 20 remove_watcher() i=0 2024-09-13T06:11:45.183 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.179+0000 7fad3e7e8980 2 removed watcher, disabling cache 2024-09-13T06:11:45.184 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.179+0000 7fad3e7e8980 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94824761884736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3f6730 con 0x563e1c3ec710 2024-09-13T06:11:45.185 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.183+0000 7fad3caf9640 1 -- 172.21.15.194:0/4157493996 <== osd.1 v2:172.21.15.194:6808/3135444559 26 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94824761884736] v35'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad3400a4d0 con 0x563e1c3ec710 2024-09-13T06:11:45.185 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.183+0000 7fad3e7e8980 20 remove_watcher() i=1 2024-09-13T06:11:45.185 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.183+0000 7fad3e7e8980 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94824761888384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563e1c421350 con 0x563e1c3f1100 2024-09-13T06:11:45.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.183+0000 7fad3c2f8640 1 -- 172.21.15.194:0/4157493996 <== osd.3 v2:172.21.15.194:6816/96632515 17 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94824761888384] v35'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad300b3040 con 0x563e1c3f1100 2024-09-13T06:11:45.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.183+0000 7fad3e7e8980 20 remove_watcher() i=2 2024-09-13T06:11:45.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.183+0000 7fad3e7e8980 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94824761891808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3f8e80 con 0x7fad300e40b0 2024-09-13T06:11:45.189 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.187+0000 7fad3baf7640 1 -- 172.21.15.194:0/4157493996 <== osd.2 v2:172.21.15.194:6800/815615585 19 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94824761891808] v35'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad2c00e620 con 0x7fad300e40b0 2024-09-13T06:11:45.189 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.187+0000 7fad3e7e8980 20 remove_watcher() i=3 2024-09-13T06:11:45.189 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.187+0000 7fad3e7e8980 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94824761896480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563e1c421350 con 0x563e1c3ec710 2024-09-13T06:11:45.191 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.187+0000 7fad3caf9640 1 -- 172.21.15.194:0/4157493996 <== osd.1 v2:172.21.15.194:6808/3135444559 27 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94824761896480] v35'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad3400a4d0 con 0x563e1c3ec710 2024-09-13T06:11:45.191 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.187+0000 7fad3e7e8980 20 remove_watcher() i=4 2024-09-13T06:11:45.191 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.187+0000 7fad3e7e8980 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94824761879440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3fae20 con 0x7fad2c037040 2024-09-13T06:11:45.193 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.191+0000 7fad3caf9640 1 -- 172.21.15.194:0/4157493996 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94824761879440] v35'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad3400a4d0 con 0x7fad2c037040 2024-09-13T06:11:45.193 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.191+0000 7fad3e7e8980 20 remove_watcher() i=5 2024-09-13T06:11:45.193 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.191+0000 7fad3e7e8980 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94824761898240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3f6be0 con 0x7fad2c037040 2024-09-13T06:11:45.194 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.191+0000 7fad3caf9640 1 -- 172.21.15.194:0/4157493996 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94824761898240] v35'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad3400a4d0 con 0x7fad2c037040 2024-09-13T06:11:45.194 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.191+0000 7fad3e7e8980 20 remove_watcher() i=6 2024-09-13T06:11:45.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.191+0000 7fad3e7e8980 1 -- 172.21.15.194:0/4157493996 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94824761899888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563e1c3f6be0 con 0x7fad2c037040 2024-09-13T06:11:45.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.195+0000 7fad3caf9640 1 -- 172.21.15.194:0/4157493996 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94824761899888] v35'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad3400a4d0 con 0x7fad2c037040 2024-09-13T06:11:45.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.195+0000 7fad3e7e8980 20 remove_watcher() i=7 2024-09-13T06:11:45.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.195+0000 7fad3e7e8980 1 -- 172.21.15.194:0/4157493996 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fad2c037040 msgr2=0x7fad2c036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.195+0000 7fad3e7e8980 1 --2- 172.21.15.194:0/4157493996 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fad2c037040 0x7fad2c036410 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:45.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.195+0000 7fad3e7e8980 1 -- 172.21.15.194:0/4157493996 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x563e1c3ec710 msgr2=0x563e1c3eebd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.195+0000 7fad3e7e8980 1 --2- 172.21.15.194:0/4157493996 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x563e1c3ec710 0x563e1c3eebd0 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:45.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.195+0000 7fad3e7e8980 1 -- 172.21.15.194:0/4157493996 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fad300e40b0 msgr2=0x7fad300db890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.195+0000 7fad3e7e8980 1 --2- 172.21.15.194:0/4157493996 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fad300e40b0 0x7fad300db890 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:45.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.195+0000 7fad3e7e8980 1 -- 172.21.15.194:0/4157493996 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x563e1c3f1100 msgr2=0x563e1c3f34f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.195+0000 7fad3e7e8980 1 --2- 172.21.15.194:0/4157493996 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x563e1c3f1100 0x563e1c3f34f0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:45.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.195+0000 7fad3e7e8980 1 -- 172.21.15.194:0/4157493996 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fac0c0346a0 msgr2=0x7fac0c036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.195+0000 7fad3e7e8980 1 --2- 172.21.15.194:0/4157493996 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fac0c0346a0 0x7fac0c036b60 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x563e1c3b7d80 tx=0x7fad2c010000 comp rx=0 tx=0).stop 2024-09-13T06:11:45.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.195+0000 7fad3e7e8980 1 -- 172.21.15.194:0/4157493996 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563e1c3da5e0 msgr2=0x563e1c3e1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.195+0000 7fad3caf9640 1 -- 172.21.15.194:0/4157493996 reap_dead start 2024-09-13T06:11:45.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.195+0000 7fad3e7e8980 1 --2- 172.21.15.194:0/4157493996 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563e1c3da5e0 0x563e1c3e1750 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fad300d28e0 tx=0x7fad300ddea0 comp rx=0 tx=0).stop 2024-09-13T06:11:45.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.195+0000 7fad3e7e8980 1 -- 172.21.15.194:0/4157493996 shutdown_connections 2024-09-13T06:11:45.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.195+0000 7fad3e7e8980 1 --2- 172.21.15.194:0/4157493996 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563e1c3da5e0 0x563e1c3e1750 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:45.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.195+0000 7fad3e7e8980 1 -- 172.21.15.194:0/4157493996 >> 172.21.15.194:0/4157493996 conn(0x563e1c3d6970 msgr2=0x563e1c3d4a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:45.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.195+0000 7fad3e7e8980 1 -- 172.21.15.194:0/4157493996 shutdown_connections 2024-09-13T06:11:45.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.195+0000 7fad3e7e8980 1 -- 172.21.15.194:0/4157493996 wait complete. 2024-09-13T06:11:45.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.195+0000 7fad3e7e8980 1 -- 172.21.15.194:0/2835669293 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fac14034650 msgr2=0x7fac14036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.195+0000 7fad3e7e8980 1 --2- 172.21.15.194:0/2835669293 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fac14034650 0x7fac14036b10 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fad2c00bf60 tx=0x7fad2c00f000 comp rx=0 tx=0).stop 2024-09-13T06:11:45.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.195+0000 7fad3e7e8980 1 -- 172.21.15.194:0/2835669293 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563e1c3cdcb0 msgr2=0x563e1c3ce0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.195+0000 7fad3e7e8980 1 --2- 172.21.15.194:0/2835669293 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563e1c3cdcb0 0x563e1c3ce0d0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fad300ab510 tx=0x7fad300b56c0 comp rx=0 tx=0).stop 2024-09-13T06:11:45.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.195+0000 7fad3e7e8980 1 -- 172.21.15.194:0/2835669293 shutdown_connections 2024-09-13T06:11:45.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.195+0000 7fad3e7e8980 1 --2- 172.21.15.194:0/2835669293 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fac14034650 0x7fac14036b10 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:45.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.195+0000 7fad3e7e8980 1 --2- 172.21.15.194:0/2835669293 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563e1c3cdcb0 0x563e1c3ce0d0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:45.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.195+0000 7fad3e7e8980 1 -- 172.21.15.194:0/2835669293 >> 172.21.15.194:0/2835669293 conn(0x563e1c3c2e00 msgr2=0x563e1c3c5880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:45.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.195+0000 7fad3e7e8980 1 -- 172.21.15.194:0/2835669293 shutdown_connections 2024-09-13T06:11:45.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.195+0000 7fad3e7e8980 1 -- 172.21.15.194:0/2835669293 wait complete. 2024-09-13T06:11:45.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.195+0000 7fad3e7e8980 1 -- 172.21.15.194:0/329724718 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x563e1c2be1d0 msgr2=0x563e1c3b6e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.195+0000 7fad3e7e8980 1 --2- 172.21.15.194:0/329724718 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x563e1c2be1d0 0x563e1c3b6e50 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:45.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.195+0000 7fad3e7e8980 1 -- 172.21.15.194:0/329724718 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x563e1c3bd6f0 msgr2=0x563e1c3bfae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.195+0000 7fad3e7e8980 1 --2- 172.21.15.194:0/329724718 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x563e1c3bd6f0 0x563e1c3bfae0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:45.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.195+0000 7fad3e7e8980 1 -- 172.21.15.194:0/329724718 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x563e1c3b97d0 msgr2=0x563e1c3bbbc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.195+0000 7fad3e7e8980 1 --2- 172.21.15.194:0/329724718 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x563e1c3b97d0 0x563e1c3bbbc0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:45.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.195+0000 7fad3e7e8980 1 -- 172.21.15.194:0/329724718 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fac240346a0 msgr2=0x7fac24036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.195+0000 7fad3e7e8980 1 --2- 172.21.15.194:0/329724718 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fac240346a0 0x7fac24036b60 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fad2c000f70 tx=0x7fad2c0012c0 comp rx=0 tx=0).stop 2024-09-13T06:11:45.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.195+0000 7fad3e7e8980 1 -- 172.21.15.194:0/329724718 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563e1c2bd880 msgr2=0x563e1c3afec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.195+0000 7fad3e7e8980 1 --2- 172.21.15.194:0/329724718 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563e1c2bd880 0x563e1c3afec0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fad30019930 tx=0x7fad30018020 comp rx=0 tx=0).stop 2024-09-13T06:11:45.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.195+0000 7fad3caf9640 1 -- 172.21.15.194:0/329724718 reap_dead start 2024-09-13T06:11:45.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.195+0000 7fad3e7e8980 1 -- 172.21.15.194:0/329724718 shutdown_connections 2024-09-13T06:11:45.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.195+0000 7fad3e7e8980 1 -- 172.21.15.194:0/329724718 >> 172.21.15.194:0/329724718 conn(0x563e1c2311d0 msgr2=0x563e1c3a3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:45.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.195+0000 7fad3e7e8980 1 -- 172.21.15.194:0/329724718 shutdown_connections 2024-09-13T06:11:45.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.195+0000 7fad3e7e8980 1 -- 172.21.15.194:0/329724718 wait complete. 2024-09-13T06:11:45.209 DEBUG:tasks.util.rgw: json result: {'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-09-13T06:11:45.174287Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:11:45.174271Z', 'tags': [], 'group_ids': []} 2024-09-13T06:11:45.209 ERROR:root:{'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-09-13T06:11:45.174287Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:11:45.174271Z', 'tags': [], 'group_ids': []} 2024-09-13T06:11:45.209 ERROR:root:0 2024-09-13T06:11:45.210 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T06:11:45.238 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T06:11:45.239 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'system_user'] 2024-09-13T06:11:45.239 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'system_user'] 2024-09-13T06:11:45.239 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid system_user 2024-09-13T06:11:45.270 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:11:45.271 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:11:45.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.267+0000 7fd4bc841980 1 Processor -- start 2024-09-13T06:11:45.272 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.267+0000 7fd4bc841980 1 -- start start 2024-09-13T06:11:45.272 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.271+0000 7fd4bc841980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55a4c47e3690 0x55a4c47e3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.272 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.271+0000 7fd4bc841980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a4c466bae0 con 0x55a4c47e3fe0 2024-09-13T06:11:45.272 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.271+0000 7fd4bc841980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x55a4c468fe30 con 0x55a4c47e3690 2024-09-13T06:11:45.273 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.271+0000 7fd4ba351640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55a4c47e3690 0x55a4c47e3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.273 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.271+0000 7fd4b9b50640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x55a4c47e3fe0 0x55a4c47e8a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:58382/0 (socket says 172.21.15.194:58382) 2024-09-13T06:11:45.273 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.271+0000 7fd4ba351640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55a4c47e3690 0x55a4c47e3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45082/0 (socket says 172.21.15.194:45082) 2024-09-13T06:11:45.273 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.271+0000 7fd4b9b50640 1 -- 172.21.15.194:0/2997477716 learned_addr learned my addr 172.21.15.194:0/2997477716 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-09-13T06:11:45.273 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.271+0000 7fd4ba351640 1 -- 172.21.15.194:0/2997477716 >> v1:172.21.15.120:6789/0 conn(0x55a4c47e3fe0 legacy=0x55a4c47e8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.273 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.271+0000 7fd4ba351640 1 -- 172.21.15.194:0/2997477716 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4c47eb260 con 0x55a4c47e3690 2024-09-13T06:11:45.275 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.271+0000 7fd4ba351640 1 --2- 172.21.15.194:0/2997477716 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a4c47e3690 0x55a4c47e3a70 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fd4b400a420 tx=0x7fd4b401afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=657f55fd7fd1443 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.275 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.271+0000 7fd4b934f640 1 -- 172.21.15.194:0/2997477716 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4b40af070 con 0x55a4c47e3690 2024-09-13T06:11:45.275 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.271+0000 7fd4b934f640 1 -- 172.21.15.194:0/2997477716 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4b40aa530 con 0x55a4c47e3690 2024-09-13T06:11:45.276 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.271+0000 7fd4b934f640 1 -- 172.21.15.194:0/2997477716 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4b40aa850 con 0x55a4c47e3690 2024-09-13T06:11:45.276 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.275+0000 7fd4bc841980 1 -- 172.21.15.194:0/2997477716 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a4c47e3690 msgr2=0x55a4c47e3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.276 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.275+0000 7fd4bc841980 1 --2- 172.21.15.194:0/2997477716 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a4c47e3690 0x55a4c47e3a70 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fd4b400a420 tx=0x7fd4b401afd0 comp rx=0 tx=0).stop 2024-09-13T06:11:45.277 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.275+0000 7fd4bc841980 1 -- 172.21.15.194:0/2997477716 shutdown_connections 2024-09-13T06:11:45.277 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.275+0000 7fd4bc841980 1 --2- 172.21.15.194:0/2997477716 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a4c47e3690 0x55a4c47e3a70 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:45.277 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.275+0000 7fd4bc841980 1 -- 172.21.15.194:0/2997477716 >> 172.21.15.194:0/2997477716 conn(0x55a4c47df1b0 msgr2=0x55a4c47e15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:45.277 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.275+0000 7fd4bc841980 1 -- 172.21.15.194:0/2997477716 shutdown_connections 2024-09-13T06:11:45.277 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.275+0000 7fd4bc841980 1 -- 172.21.15.194:0/2997477716 wait complete. 2024-09-13T06:11:45.291 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.287+0000 7fd4bc841980 1 Processor -- start 2024-09-13T06:11:45.292 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.287+0000 7fd4bc841980 1 -- start start 2024-09-13T06:11:45.292 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.287+0000 7fd4bc841980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a4c47e3690 0x55a4c48cea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.292 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.287+0000 7fd4bc841980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55a4c4691200 con 0x55a4c47e3690 2024-09-13T06:11:45.292 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.291+0000 7fd4ba351640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a4c47e3690 0x55a4c48cea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.291+0000 7fd4ba351640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a4c47e3690 0x55a4c48cea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45088/0 (socket says 172.21.15.194:45088) 2024-09-13T06:11:45.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.291+0000 7fd4ba351640 1 -- 172.21.15.194:0/2225936534 learned_addr learned my addr 172.21.15.194:0/2225936534 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:45.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.291+0000 7fd4ba351640 1 -- 172.21.15.194:0/2225936534 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4c48cf010 con 0x55a4c47e3690 2024-09-13T06:11:45.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.291+0000 7fd4ba351640 1 --2- 172.21.15.194:0/2225936534 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a4c47e3690 0x55a4c48cea40 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fd4b400a420 tx=0x7fd4b40033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d4f07a169c13f7e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.294 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.291+0000 7fd3a8608640 1 -- 172.21.15.194:0/2225936534 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4b40af050 con 0x55a4c47e3690 2024-09-13T06:11:45.294 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.291+0000 7fd3a8608640 1 -- 172.21.15.194:0/2225936534 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4b40b0040 con 0x55a4c47e3690 2024-09-13T06:11:45.295 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.291+0000 7fd3a8608640 1 -- 172.21.15.194:0/2225936534 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4b40aac60 con 0x55a4c47e3690 2024-09-13T06:11:45.295 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.291+0000 7fd4bc841980 1 -- 172.21.15.194:0/2225936534 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a4c47e3690 msgr2=0x55a4c48cea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.295 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.291+0000 7fd4bc841980 1 --2- 172.21.15.194:0/2225936534 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a4c47e3690 0x55a4c48cea40 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fd4b400a420 tx=0x7fd4b40033b0 comp rx=0 tx=0).stop 2024-09-13T06:11:45.295 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.291+0000 7fd4bc841980 1 -- 172.21.15.194:0/2225936534 shutdown_connections 2024-09-13T06:11:45.295 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.291+0000 7fd4bc841980 1 --2- 172.21.15.194:0/2225936534 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a4c47e3690 0x55a4c48cea40 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:45.295 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.291+0000 7fd4bc841980 1 -- 172.21.15.194:0/2225936534 >> 172.21.15.194:0/2225936534 conn(0x55a4c47df1b0 msgr2=0x55a4c48ca670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:45.295 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.291+0000 7fd4bc841980 1 -- 172.21.15.194:0/2225936534 shutdown_connections 2024-09-13T06:11:45.295 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.291+0000 7fd4bc841980 1 -- 172.21.15.194:0/2225936534 wait complete. 2024-09-13T06:11:45.295 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.291+0000 7fd4bc841980 1 Processor -- start 2024-09-13T06:11:45.295 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.291+0000 7fd4bc841980 1 -- start start 2024-09-13T06:11:45.295 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.291+0000 7fd4bc841980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a4c47e3690 0x55a4c475a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.295 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.291+0000 7fd4bc841980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55a4c47eaca0 con 0x55a4c47e3690 2024-09-13T06:11:45.297 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.291+0000 7fd4ba351640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a4c47e3690 0x55a4c475a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.297 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.291+0000 7fd4ba351640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a4c47e3690 0x55a4c475a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45098/0 (socket says 172.21.15.194:45098) 2024-09-13T06:11:45.297 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.291+0000 7fd4ba351640 1 -- 172.21.15.194:0/3108600465 learned_addr learned my addr 172.21.15.194:0/3108600465 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:45.297 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.291+0000 7fd4ba351640 1 -- 172.21.15.194:0/3108600465 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4c475aa30 con 0x55a4c47e3690 2024-09-13T06:11:45.297 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.295+0000 7fd4ba351640 1 --2- 172.21.15.194:0/3108600465 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a4c47e3690 0x55a4c475a4f0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fd4b401b870 tx=0x7fd4b4019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.297 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.295+0000 7fd3a6e05640 1 -- 172.21.15.194:0/3108600465 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4b40c5020 con 0x55a4c47e3690 2024-09-13T06:11:45.297 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.295+0000 7fd4bc841980 1 -- 172.21.15.194:0/3108600465 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a4c4758c10 con 0x55a4c47e3690 2024-09-13T06:11:45.297 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.295+0000 7fd3a6e05640 1 -- 172.21.15.194:0/3108600465 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4b40b6cb0 con 0x55a4c47e3690 2024-09-13T06:11:45.297 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.295+0000 7fd3a6e05640 1 -- 172.21.15.194:0/3108600465 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4b40c1480 con 0x55a4c47e3690 2024-09-13T06:11:45.297 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.295+0000 7fd4bc841980 1 -- 172.21.15.194:0/3108600465 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4c4759160 con 0x55a4c47e3690 2024-09-13T06:11:45.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.295+0000 7fd3a6e05640 1 -- 172.21.15.194:0/3108600465 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd4b40c8070 con 0x55a4c47e3690 2024-09-13T06:11:45.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.295+0000 7fd3a6e05640 1 --2- 172.21.15.194:0/3108600465 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fd3a0034650 0x7fd3a0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.295+0000 7fd3a6e05640 1 -- 172.21.15.194:0/3108600465 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fd4b40bb070 con 0x55a4c47e3690 2024-09-13T06:11:45.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.295+0000 7fd4b9b50640 1 --2- 172.21.15.194:0/3108600465 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fd3a0034650 0x7fd3a0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.295+0000 7fd4bc841980 1 --2- 172.21.15.194:0/3108600465 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55a4c47e3fe0 0x55a4c48df080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.295+0000 7fd4bc841980 1 -- 172.21.15.194:0/3108600465 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a4c48df5c0 con 0x55a4c47e3fe0 2024-09-13T06:11:45.300 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.295+0000 7fd4bab52640 1 --2- 172.21.15.194:0/3108600465 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55a4c47e3fe0 0x55a4c48df080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.300 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.295+0000 7fd4b9b50640 1 --2- 172.21.15.194:0/3108600465 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fd3a0034650 0x7fd3a0036b10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd4b0000f70 tx=0x7fd4b00012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.300 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.295+0000 7fd4bab52640 1 --2- 172.21.15.194:0/3108600465 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55a4c47e3fe0 0x55a4c48df080 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.300 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.295+0000 7fd4bab52640 1 -- 172.21.15.194:0/3108600465 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd4ac0083f0 con 0x55a4c47e3fe0 2024-09-13T06:11:45.300 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.295+0000 7fd4bc841980 1 -- 172.21.15.194:0/3108600465 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4759480 con 0x55a4c47e3fe0 2024-09-13T06:11:45.300 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.295+0000 7fd4bab52640 1 -- 172.21.15.194:0/3108600465 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd4ac0083f0 con 0x55a4c47e3fe0 2024-09-13T06:11:45.300 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.295+0000 7fd4bc841980 1 --2- 172.21.15.194:0/3108600465 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55a4c48e1830 0x55a4c48e3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.300 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.295+0000 7fd4bc841980 1 -- 172.21.15.194:0/3108600465 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a4c48e42f0 con 0x55a4c48e1830 2024-09-13T06:11:45.300 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.295+0000 7fd4ba351640 1 --2- 172.21.15.194:0/3108600465 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55a4c48e1830 0x55a4c48e3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.295+0000 7fd4ba351640 1 --2- 172.21.15.194:0/3108600465 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55a4c48e1830 0x55a4c48e3c20 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.299+0000 7fd4ba351640 1 -- 172.21.15.194:0/3108600465 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd4b40c7030 con 0x55a4c48e1830 2024-09-13T06:11:45.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.299+0000 7fd4bc841980 1 -- 172.21.15.194:0/3108600465 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a4c48e06d0 con 0x55a4c47e3fe0 2024-09-13T06:11:45.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.299+0000 7fd4bab52640 1 -- 172.21.15.194:0/3108600465 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd4ac0083f0 con 0x55a4c47e3fe0 2024-09-13T06:11:45.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.299+0000 7fd4bc841980 1 --2- 172.21.15.194:0/3108600465 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55a4c48e5750 0x55a4c48e7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.299+0000 7fd4bc841980 1 -- 172.21.15.194:0/3108600465 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a4c48e8280 con 0x55a4c48e5750 2024-09-13T06:11:45.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.299+0000 7fd4b9b50640 1 --2- 172.21.15.194:0/3108600465 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55a4c48e5750 0x55a4c48e7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.299+0000 7fd4b9b50640 1 --2- 172.21.15.194:0/3108600465 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55a4c48e5750 0x55a4c48e7b40 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.299+0000 7fd4b9b50640 1 -- 172.21.15.194:0/3108600465 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd4b000e620 con 0x55a4c48e5750 2024-09-13T06:11:45.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.299+0000 7fd4bc841980 1 Processor -- start 2024-09-13T06:11:45.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.299+0000 7fd4bc841980 1 -- start start 2024-09-13T06:11:45.303 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.299+0000 7fd4bc841980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a4c48f5d50 0x55a4c48f6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.303 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.299+0000 7fd4bc841980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55a4c46ea800 con 0x55a4c48f5d50 2024-09-13T06:11:45.304 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.299+0000 7fd4ba351640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a4c48f5d50 0x55a4c48f6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.304 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.299+0000 7fd4ba351640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a4c48f5d50 0x55a4c48f6170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45108/0 (socket says 172.21.15.194:45108) 2024-09-13T06:11:45.304 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.299+0000 7fd4ba351640 1 -- 172.21.15.194:0/4004393961 learned_addr learned my addr 172.21.15.194:0/4004393961 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:45.304 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.299+0000 7fd4ba351640 1 -- 172.21.15.194:0/4004393961 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4c48f66b0 con 0x55a4c48f5d50 2024-09-13T06:11:45.304 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.299+0000 7fd4ba351640 1 --2- 172.21.15.194:0/4004393961 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a4c48f5d50 0x55a4c48f6170 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fd4b40b8010 tx=0x7fd4b40a9d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.304 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.299+0000 7fd39ffff640 1 -- 172.21.15.194:0/4004393961 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4b40053e0 con 0x55a4c48f5d50 2024-09-13T06:11:45.304 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.299+0000 7fd39ffff640 1 -- 172.21.15.194:0/4004393961 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4b40e4050 con 0x55a4c48f5d50 2024-09-13T06:11:45.304 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.299+0000 7fd4bc841980 1 -- 172.21.15.194:0/4004393961 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a4c48f6940 con 0x55a4c48f5d50 2024-09-13T06:11:45.305 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.299+0000 7fd39ffff640 1 -- 172.21.15.194:0/4004393961 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4b40e4350 con 0x55a4c48f5d50 2024-09-13T06:11:45.305 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.299+0000 7fd4bc841980 1 -- 172.21.15.194:0/4004393961 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4c48f95c0 con 0x55a4c48f5d50 2024-09-13T06:11:45.306 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.303+0000 7fd39ffff640 1 -- 172.21.15.194:0/4004393961 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd4b40e11a0 con 0x55a4c48f5d50 2024-09-13T06:11:45.306 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.303+0000 7fd39ffff640 1 --2- 172.21.15.194:0/4004393961 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fd394034650 0x7fd394036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.306 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.303+0000 7fd39ffff640 1 -- 172.21.15.194:0/4004393961 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fd4b40c3070 con 0x55a4c48f5d50 2024-09-13T06:11:45.306 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.303+0000 7fd4b9b50640 1 --2- 172.21.15.194:0/4004393961 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fd394034650 0x7fd394036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.307 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.303+0000 7fd4bc841980 1 Processor -- start 2024-09-13T06:11:45.307 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.303+0000 7fd4bc841980 1 -- start start 2024-09-13T06:11:45.307 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.303+0000 7fd4b9b50640 1 --2- 172.21.15.194:0/4004393961 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fd394034650 0x7fd394036b10 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd4b000bf60 tx=0x7fd4b000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.307 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.303+0000 7fd4bc841980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a4c49026a0 0x55a4c4902aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.307 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.303+0000 7fd4bc841980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55a4c48cf2d0 con 0x55a4c49026a0 2024-09-13T06:11:45.307 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.303+0000 7fd4ba351640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a4c49026a0 0x55a4c4902aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.307 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.303+0000 7fd4ba351640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a4c49026a0 0x55a4c4902aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45114/0 (socket says 172.21.15.194:45114) 2024-09-13T06:11:45.307 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.303+0000 7fd4ba351640 1 -- 172.21.15.194:0/3882678500 learned_addr learned my addr 172.21.15.194:0/3882678500 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:45.307 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.303+0000 7fd4ba351640 1 -- 172.21.15.194:0/3882678500 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4c4903070 con 0x55a4c49026a0 2024-09-13T06:11:45.307 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.303+0000 7fd4ba351640 1 --2- 172.21.15.194:0/3882678500 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a4c49026a0 0x55a4c4902aa0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fd4b40c8f90 tx=0x7fd4b40e0fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8581700853c0cecc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.309 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.303+0000 7fd39dffb640 1 -- 172.21.15.194:0/3882678500 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4b40c1750 con 0x55a4c49026a0 2024-09-13T06:11:45.309 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.303+0000 7fd39dffb640 1 -- 172.21.15.194:0/3882678500 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4b40f6070 con 0x55a4c49026a0 2024-09-13T06:11:45.309 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.303+0000 7fd39dffb640 1 -- 172.21.15.194:0/3882678500 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4b40e15c0 con 0x55a4c49026a0 2024-09-13T06:11:45.309 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.303+0000 7fd4bc841980 1 -- 172.21.15.194:0/3882678500 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a4c49026a0 msgr2=0x55a4c4902aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.309 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.303+0000 7fd4bc841980 1 --2- 172.21.15.194:0/3882678500 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a4c49026a0 0x55a4c4902aa0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fd4b40c8f90 tx=0x7fd4b40e0fa0 comp rx=0 tx=0).stop 2024-09-13T06:11:45.309 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.303+0000 7fd4bc841980 1 -- 172.21.15.194:0/3882678500 shutdown_connections 2024-09-13T06:11:45.309 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.303+0000 7fd4bc841980 1 --2- 172.21.15.194:0/3882678500 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a4c49026a0 0x55a4c4902aa0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:45.310 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.303+0000 7fd4bc841980 1 -- 172.21.15.194:0/3882678500 >> 172.21.15.194:0/3882678500 conn(0x55a4c48fead0 msgr2=0x55a4c48fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:45.310 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.303+0000 7fd4bc841980 1 -- 172.21.15.194:0/3882678500 shutdown_connections 2024-09-13T06:11:45.310 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.307+0000 7fd4bc841980 1 -- 172.21.15.194:0/3882678500 wait complete. 2024-09-13T06:11:45.310 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.307+0000 7fd4bc841980 1 Processor -- start 2024-09-13T06:11:45.310 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.307+0000 7fd4bc841980 1 -- start start 2024-09-13T06:11:45.310 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.307+0000 7fd4bc841980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a4c49026a0 0x55a4c49098a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.310 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.307+0000 7fd4bc841980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55a4c4903540 con 0x55a4c49026a0 2024-09-13T06:11:45.310 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.307+0000 7fd4ba351640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a4c49026a0 0x55a4c49098a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.310 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.307+0000 7fd4ba351640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a4c49026a0 0x55a4c49098a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45120/0 (socket says 172.21.15.194:45120) 2024-09-13T06:11:45.310 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.307+0000 7fd4ba351640 1 -- 172.21.15.194:0/1943396376 learned_addr learned my addr 172.21.15.194:0/1943396376 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:45.310 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.307+0000 7fd4ba351640 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4c4909de0 con 0x55a4c49026a0 2024-09-13T06:11:45.314 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.307+0000 7fd4ba351640 1 --2- 172.21.15.194:0/1943396376 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a4c49026a0 0x55a4c49098a0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fd4b40daff0 tx=0x7fd4b40daf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.314 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.307+0000 7fd38bfff640 1 -- 172.21.15.194:0/1943396376 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4b40b4530 con 0x55a4c49026a0 2024-09-13T06:11:45.314 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.307+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a4c4909de0 con 0x55a4c49026a0 2024-09-13T06:11:45.315 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.307+0000 7fd38bfff640 1 -- 172.21.15.194:0/1943396376 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4b40b46d0 con 0x55a4c49026a0 2024-09-13T06:11:45.315 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.307+0000 7fd38bfff640 1 -- 172.21.15.194:0/1943396376 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4b40b49f0 con 0x55a4c49026a0 2024-09-13T06:11:45.315 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.307+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4c490a250 con 0x55a4c49026a0 2024-09-13T06:11:45.315 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.307+0000 7fd38bfff640 1 -- 172.21.15.194:0/1943396376 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd4b410d060 con 0x55a4c49026a0 2024-09-13T06:11:45.315 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.307+0000 7fd38bfff640 1 --2- 172.21.15.194:0/1943396376 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fd384034650 0x7fd384036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.315 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.307+0000 7fd38bfff640 1 -- 172.21.15.194:0/1943396376 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fd4b40fcd80 con 0x55a4c49026a0 2024-09-13T06:11:45.315 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.307+0000 7fd4bc841980 20 rados->read ofs=0 len=0 2024-09-13T06:11:45.315 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.307+0000 7fd4b9b50640 1 --2- 172.21.15.194:0/1943396376 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fd384034650 0x7fd384036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.315 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.307+0000 7fd4bc841980 1 --2- 172.21.15.194:0/1943396376 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55a4c4914a20 0x55a4c4916ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.315 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.307+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4917630 con 0x55a4c4914a20 2024-09-13T06:11:45.315 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.311+0000 7fd4bab52640 1 --2- 172.21.15.194:0/1943396376 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55a4c4914a20 0x55a4c4916ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.316 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.311+0000 7fd4b9b50640 1 --2- 172.21.15.194:0/1943396376 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fd384034650 0x7fd384036b10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x55a4c48dfa00 tx=0x7fd4b0010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.316 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.311+0000 7fd4bab52640 1 --2- 172.21.15.194:0/1943396376 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55a4c4914a20 0x55a4c4916ee0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.316 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.311+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd4ac0083f0 con 0x55a4c4914a20 2024-09-13T06:11:45.316 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.311+0000 7fd4bc841980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:45.316 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.311+0000 7fd4bc841980 20 realm 2024-09-13T06:11:45.316 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.311+0000 7fd4bc841980 20 rados->read ofs=0 len=0 2024-09-13T06:11:45.316 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.311+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4917a40 con 0x55a4c4914a20 2024-09-13T06:11:45.316 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.311+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd4ac0083f0 con 0x55a4c4914a20 2024-09-13T06:11:45.316 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.311+0000 7fd4bc841980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:45.316 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.311+0000 7fd4bc841980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:11:45.316 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.311+0000 7fd4bc841980 20 rados->read ofs=0 len=0 2024-09-13T06:11:45.316 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.311+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a4c49182e0 con 0x55a4c4914a20 2024-09-13T06:11:45.317 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.311+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd4ac0083f0 con 0x55a4c4914a20 2024-09-13T06:11:45.317 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.311+0000 7fd4bc841980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:45.317 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.311+0000 7fd4bc841980 20 rados->read ofs=0 len=0 2024-09-13T06:11:45.317 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.311+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4918680 con 0x55a4c4914a20 2024-09-13T06:11:45.317 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.311+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd4ac0083f0 con 0x55a4c4914a20 2024-09-13T06:11:45.317 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.311+0000 7fd4bc841980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:11:45.317 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.311+0000 7fd4bc841980 20 rados->read ofs=0 len=0 2024-09-13T06:11:45.317 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.311+0000 7fd4bc841980 1 --2- 172.21.15.194:0/1943396376 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55a4c49193e0 0x55a4c491b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.317 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.311+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a4c491be20 con 0x55a4c49193e0 2024-09-13T06:11:45.317 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.311+0000 7fd4ba351640 1 --2- 172.21.15.194:0/1943396376 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55a4c49193e0 0x55a4c491b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.317 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.311+0000 7fd4ba351640 1 --2- 172.21.15.194:0/1943396376 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55a4c49193e0 0x55a4c491b7d0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.317 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.311+0000 7fd4ba351640 1 -- 172.21.15.194:0/1943396376 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd4b40db070 con 0x55a4c49193e0 2024-09-13T06:11:45.318 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.311+0000 7fd4bc841980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:11:45.318 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.311+0000 7fd4bc841980 20 searching for the correct realm 2024-09-13T06:11:45.318 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.311+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a4c491d6f0 con 0x55a4c49193e0 2024-09-13T06:11:45.318 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.311+0000 7fd4ba351640 1 -- 172.21.15.194:0/1943396376 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4b40db070 con 0x55a4c49193e0 2024-09-13T06:11:45.318 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.311+0000 7fd4ba351640 1 --2- 172.21.15.194:0/1943396376 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fd4b40ca060 0x7fd4b40c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.318 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.311+0000 7fd4ba351640 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a4c491d6f0 con 0x7fd4b40ca060 2024-09-13T06:11:45.318 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.311+0000 7fd4b9b50640 1 --2- 172.21.15.194:0/1943396376 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fd4b40ca060 0x7fd4b40c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.321 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.311+0000 7fd4b9b50640 1 --2- 172.21.15.194:0/1943396376 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fd4b40ca060 0x7fd4b40c9a00 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.321 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.311+0000 7fd4b9b50640 1 -- 172.21.15.194:0/1943396376 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd4b000e620 con 0x7fd4b40ca060 2024-09-13T06:11:45.321 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.311+0000 7fd4b9b50640 1 --2- 172.21.15.194:0/1943396376 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fd4b0037040 0x7fd4b0036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.321 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.311+0000 7fd4b9b50640 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a4c491d6f0 con 0x7fd4b0037040 2024-09-13T06:11:45.321 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.315+0000 7fd4bab52640 1 --2- 172.21.15.194:0/1943396376 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fd4b0037040 0x7fd4b0036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.321 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.315+0000 7fd4bab52640 1 --2- 172.21.15.194:0/1943396376 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fd4b0037040 0x7fd4b0036410 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.321 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.315+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4ac0083f0 con 0x7fd4b0037040 2024-09-13T06:11:45.321 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.315+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4918680 con 0x55a4c4914a20 2024-09-13T06:11:45.322 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.315+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4ac0083f0 con 0x55a4c4914a20 2024-09-13T06:11:45.322 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.315+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4918680 con 0x55a4c4914a20 2024-09-13T06:11:45.322 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.315+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4ac0083f0 con 0x55a4c4914a20 2024-09-13T06:11:45.322 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.315+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4918680 con 0x7fd4b0037040 2024-09-13T06:11:45.322 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.315+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4ac0083f0 con 0x7fd4b0037040 2024-09-13T06:11:45.322 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.315+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4918680 con 0x7fd4b0037040 2024-09-13T06:11:45.322 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.315+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4ac0083f0 con 0x7fd4b0037040 2024-09-13T06:11:45.322 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.315+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4918680 con 0x7fd4b40ca060 2024-09-13T06:11:45.322 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.315+0000 7fd4b9b50640 1 -- 172.21.15.194:0/1943396376 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4b000e620 con 0x7fd4b40ca060 2024-09-13T06:11:45.322 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.315+0000 7fd4b9b50640 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4918680 con 0x55a4c49193e0 2024-09-13T06:11:45.322 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.315+0000 7fd4ba351640 1 -- 172.21.15.194:0/1943396376 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4b40db070 con 0x55a4c49193e0 2024-09-13T06:11:45.322 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.315+0000 7fd4ba351640 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4918680 con 0x55a4c4914a20 2024-09-13T06:11:45.322 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.315+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4ac0083f0 con 0x55a4c4914a20 2024-09-13T06:11:45.323 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.315+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4918680 con 0x7fd4b0037040 2024-09-13T06:11:45.323 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.319+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4ac0083f0 con 0x7fd4b0037040 2024-09-13T06:11:45.323 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.319+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4918680 con 0x55a4c4914a20 2024-09-13T06:11:45.323 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.319+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4ac0083f0 con 0x55a4c4914a20 2024-09-13T06:11:45.323 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.319+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4918680 con 0x7fd4b40ca060 2024-09-13T06:11:45.323 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.319+0000 7fd4b9b50640 1 -- 172.21.15.194:0/1943396376 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd4b000e620 con 0x7fd4b40ca060 2024-09-13T06:11:45.323 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.319+0000 7fd4b9b50640 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4918680 con 0x55a4c49193e0 2024-09-13T06:11:45.323 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.319+0000 7fd4ba351640 1 -- 172.21.15.194:0/1943396376 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4b40db070 con 0x55a4c49193e0 2024-09-13T06:11:45.323 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.319+0000 7fd4ba351640 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4918680 con 0x55a4c49193e0 2024-09-13T06:11:45.326 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.319+0000 7fd4ba351640 1 -- 172.21.15.194:0/1943396376 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4b40db070 con 0x55a4c49193e0 2024-09-13T06:11:45.326 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.319+0000 7fd4ba351640 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4918680 con 0x7fd4b0037040 2024-09-13T06:11:45.326 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.319+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4ac0083f0 con 0x7fd4b0037040 2024-09-13T06:11:45.326 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.319+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4918680 con 0x55a4c49193e0 2024-09-13T06:11:45.326 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.319+0000 7fd4ba351640 1 -- 172.21.15.194:0/1943396376 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4b40db070 con 0x55a4c49193e0 2024-09-13T06:11:45.326 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.319+0000 7fd4ba351640 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4918680 con 0x55a4c49193e0 2024-09-13T06:11:45.327 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.319+0000 7fd4ba351640 1 -- 172.21.15.194:0/1943396376 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4b40db070 con 0x55a4c49193e0 2024-09-13T06:11:45.327 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.319+0000 7fd4ba351640 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4918680 con 0x55a4c4914a20 2024-09-13T06:11:45.327 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.319+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4ac0083f0 con 0x55a4c4914a20 2024-09-13T06:11:45.327 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.319+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4918680 con 0x55a4c4914a20 2024-09-13T06:11:45.327 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.319+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v35'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd4ac0083f0 con 0x55a4c4914a20 2024-09-13T06:11:45.327 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.319+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4918680 con 0x7fd4b40ca060 2024-09-13T06:11:45.327 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.323+0000 7fd4b9b50640 1 -- 172.21.15.194:0/1943396376 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4b000e620 con 0x7fd4b40ca060 2024-09-13T06:11:45.327 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.323+0000 7fd4b9b50640 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4918680 con 0x55a4c49193e0 2024-09-13T06:11:45.327 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.323+0000 7fd4ba351640 1 -- 172.21.15.194:0/1943396376 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4b40db070 con 0x55a4c49193e0 2024-09-13T06:11:45.327 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.323+0000 7fd4ba351640 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4918680 con 0x7fd4b40ca060 2024-09-13T06:11:45.327 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.323+0000 7fd4b9b50640 1 -- 172.21.15.194:0/1943396376 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4b000e620 con 0x7fd4b40ca060 2024-09-13T06:11:45.327 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.323+0000 7fd4b9b50640 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4918680 con 0x55a4c4914a20 2024-09-13T06:11:45.328 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.323+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4ac0083f0 con 0x55a4c4914a20 2024-09-13T06:11:45.328 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.323+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4918680 con 0x7fd4b0037040 2024-09-13T06:11:45.328 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.323+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4ac0083f0 con 0x7fd4b0037040 2024-09-13T06:11:45.328 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.323+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4918680 con 0x55a4c49193e0 2024-09-13T06:11:45.328 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.323+0000 7fd4ba351640 1 -- 172.21.15.194:0/1943396376 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=107b] v35'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd4b40db070 con 0x55a4c49193e0 2024-09-13T06:11:45.328 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.323+0000 7fd4ba351640 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4918680 con 0x7fd4b40ca060 2024-09-13T06:11:45.328 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.323+0000 7fd4b9b50640 1 -- 172.21.15.194:0/1943396376 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4b000e620 con 0x7fd4b40ca060 2024-09-13T06:11:45.328 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.323+0000 7fd4b9b50640 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4918680 con 0x7fd4b40ca060 2024-09-13T06:11:45.328 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.323+0000 7fd4b9b50640 1 -- 172.21.15.194:0/1943396376 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4b000e620 con 0x7fd4b40ca060 2024-09-13T06:11:45.328 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.323+0000 7fd4b9b50640 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4918680 con 0x55a4c49193e0 2024-09-13T06:11:45.328 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.323+0000 7fd4ba351640 1 -- 172.21.15.194:0/1943396376 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4b40db070 con 0x55a4c49193e0 2024-09-13T06:11:45.328 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.323+0000 7fd4ba351640 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4918680 con 0x7fd4b0037040 2024-09-13T06:11:45.332 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.323+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4ac0083f0 con 0x7fd4b0037040 2024-09-13T06:11:45.332 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.323+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4918680 con 0x55a4c4914a20 2024-09-13T06:11:45.332 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.323+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v35'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd4ac0083f0 con 0x55a4c4914a20 2024-09-13T06:11:45.332 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.323+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4918680 con 0x7fd4b40ca060 2024-09-13T06:11:45.332 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.327+0000 7fd4b9b50640 1 -- 172.21.15.194:0/1943396376 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4b000e620 con 0x7fd4b40ca060 2024-09-13T06:11:45.332 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.327+0000 7fd4bc841980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:11:45.332 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.327+0000 7fd4bc841980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:11:45.332 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.327+0000 7fd4bc841980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:11:45.332 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.327+0000 7fd4bc841980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:11:45.332 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.327+0000 7fd4bc841980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:11:45.332 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.327+0000 7fd4bc841980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:11:45.333 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.327+0000 7fd4bc841980 20 rados->read ofs=0 len=0 2024-09-13T06:11:45.333 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.327+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a4c491c810 con 0x55a4c4914a20 2024-09-13T06:11:45.333 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.327+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd4ac0083f0 con 0x55a4c4914a20 2024-09-13T06:11:45.333 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.327+0000 7fd4bc841980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:45.333 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.327+0000 7fd4bc841980 20 rados->read ofs=0 len=0 2024-09-13T06:11:45.333 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.327+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a4c491d060 con 0x55a4c4914a20 2024-09-13T06:11:45.333 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.327+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd4ac0083f0 con 0x55a4c4914a20 2024-09-13T06:11:45.333 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.327+0000 7fd4bc841980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:11:45.333 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.327+0000 7fd4bc841980 20 rados->read ofs=0 len=0 2024-09-13T06:11:45.333 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.327+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a4c491c450 con 0x7fd4b40ca060 2024-09-13T06:11:45.333 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.327+0000 7fd4b9b50640 1 -- 172.21.15.194:0/1943396376 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd4b000e620 con 0x7fd4b40ca060 2024-09-13T06:11:45.333 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.327+0000 7fd4bc841980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:11:45.333 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.327+0000 7fd4bc841980 20 zone default found 2024-09-13T06:11:45.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.327+0000 7fd4bc841980 4 Realm: () 2024-09-13T06:11:45.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.327+0000 7fd4bc841980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:11:45.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.327+0000 7fd4bc841980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:11:45.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.327+0000 7fd4bc841980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:11:45.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.327+0000 7fd4bc841980 20 zonegroup default 2024-09-13T06:11:45.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.327+0000 7fd4bc841980 20 rados->read ofs=0 len=0 2024-09-13T06:11:45.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.327+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a4c491db20 con 0x7fd4b0037040 2024-09-13T06:11:45.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.327+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd4ac0083f0 con 0x7fd4b0037040 2024-09-13T06:11:45.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.327+0000 7fd4bc841980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:45.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.327+0000 7fd4bc841980 20 rados->read ofs=0 len=0 2024-09-13T06:11:45.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.327+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a4c491f560 con 0x55a4c49193e0 2024-09-13T06:11:45.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.327+0000 7fd4ba351640 1 -- 172.21.15.194:0/1943396376 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd4b40db070 con 0x55a4c49193e0 2024-09-13T06:11:45.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.327+0000 7fd4bc841980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:45.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.327+0000 7fd4bc841980 20 rados->read ofs=0 len=0 2024-09-13T06:11:45.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.327+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a4c491fa50 con 0x55a4c49193e0 2024-09-13T06:11:45.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.327+0000 7fd4ba351640 1 -- 172.21.15.194:0/1943396376 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd4b40db070 con 0x55a4c49193e0 2024-09-13T06:11:45.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.327+0000 7fd4bc841980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:45.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.327+0000 7fd4bc841980 20 started sync module instance, tier type = 2024-09-13T06:11:45.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.327+0000 7fd4bc841980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:11:45.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.327+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a4c491e9a0 con 0x7fd4b40ca060 2024-09-13T06:11:45.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.327+0000 7fd4b9b50640 1 -- 172.21.15.194:0/1943396376 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(44 notify.0 [create] v35'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4b000e620 con 0x7fd4b40ca060 2024-09-13T06:11:45.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.327+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94166160895376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4920360 con 0x7fd4b40ca060 2024-09-13T06:11:45.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.327+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4920bb0 con 0x55a4c4914a20 2024-09-13T06:11:45.336 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.331+0000 7fd4b9b50640 1 -- 172.21.15.194:0/1943396376 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94166160895376] v35'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4b000e620 con 0x7fd4b40ca060 2024-09-13T06:11:45.336 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.331+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v35'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4ac0083f0 con 0x55a4c4914a20 2024-09-13T06:11:45.337 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.331+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94166160899760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4920bb0 con 0x55a4c4914a20 2024-09-13T06:11:45.337 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.331+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4921630 con 0x55a4c49193e0 2024-09-13T06:11:45.337 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.331+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94166160899760] v35'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4ac0083f0 con 0x55a4c4914a20 2024-09-13T06:11:45.337 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.335+0000 7fd4ba351640 1 -- 172.21.15.194:0/1943396376 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v35'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4b40db070 con 0x55a4c49193e0 2024-09-13T06:11:45.337 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.335+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94166160904480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4920bb0 con 0x55a4c49193e0 2024-09-13T06:11:45.337 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.335+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4922070 con 0x7fd4b40ca060 2024-09-13T06:11:45.338 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.335+0000 7fd4b9b50640 1 -- 172.21.15.194:0/1943396376 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(50 notify.3 [create] v35'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4b000e620 con 0x7fd4b40ca060 2024-09-13T06:11:45.338 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.335+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94166160907200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a4c49228c0 con 0x7fd4b40ca060 2024-09-13T06:11:45.338 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.335+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4923280 con 0x55a4c4914a20 2024-09-13T06:11:45.338 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.335+0000 7fd4ba351640 1 -- 172.21.15.194:0/1943396376 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94166160904480] v35'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4b40db070 con 0x55a4c49193e0 2024-09-13T06:11:45.338 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.335+0000 7fd4b9b50640 1 -- 172.21.15.194:0/1943396376 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94166160907200] v35'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4b000e620 con 0x7fd4b40ca060 2024-09-13T06:11:45.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.335+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v35'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4ac0083f0 con 0x55a4c4914a20 2024-09-13T06:11:45.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.335+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94166160911824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a4c49228c0 con 0x55a4c4914a20 2024-09-13T06:11:45.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.335+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4923230 con 0x7fd4b0037040 2024-09-13T06:11:45.341 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.339+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94166160911824] v35'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4ac0083f0 con 0x55a4c4914a20 2024-09-13T06:11:45.341 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.339+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(54 notify.5 [create] v35'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4ac0083f0 con 0x7fd4b0037040 2024-09-13T06:11:45.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.339+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94166160909328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4922830 con 0x7fd4b0037040 2024-09-13T06:11:45.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.339+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4924000 con 0x7fd4b0037040 2024-09-13T06:11:45.344 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.343+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(56 notify.6 [create] v35'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4ac0083f0 con 0x7fd4b0037040 2024-09-13T06:11:45.344 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.343+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94166160915152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4924470 con 0x7fd4b0037040 2024-09-13T06:11:45.344 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.343+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4924f50 con 0x7fd4b0037040 2024-09-13T06:11:45.344 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.343+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94166160909328] v35'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4ac0083f0 con 0x7fd4b0037040 2024-09-13T06:11:45.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.343+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94166160915152] v35'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4ac0083f0 con 0x7fd4b0037040 2024-09-13T06:11:45.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.343+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(58 notify.7 [create] v35'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4ac0083f0 con 0x7fd4b0037040 2024-09-13T06:11:45.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.343+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94166160919136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4923fc0 con 0x7fd4b0037040 2024-09-13T06:11:45.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.343+0000 7fd4bc841980 20 add_watcher() i=0 2024-09-13T06:11:45.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.343+0000 7fd4bc841980 20 add_watcher() i=1 2024-09-13T06:11:45.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.343+0000 7fd4bc841980 20 add_watcher() i=2 2024-09-13T06:11:45.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.343+0000 7fd4bc841980 20 add_watcher() i=3 2024-09-13T06:11:45.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.343+0000 7fd4bc841980 20 add_watcher() i=4 2024-09-13T06:11:45.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.343+0000 7fd4bc841980 20 add_watcher() i=5 2024-09-13T06:11:45.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.343+0000 7fd4bc841980 20 add_watcher() i=6 2024-09-13T06:11:45.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.347+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94166160919136] v35'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4ac0083f0 con 0x7fd4b0037040 2024-09-13T06:11:45.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.347+0000 7fd4bc841980 20 add_watcher() i=7 2024-09-13T06:11:45.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.347+0000 7fd4bc841980 2 all 8 watchers are set, enabling cache 2024-09-13T06:11:45.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.347+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4928050 con 0x55a4c4914a20 2024-09-13T06:11:45.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.347+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd4ac0083f0 con 0x55a4c4914a20 2024-09-13T06:11:45.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.347+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94166160913872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a4c49254d0 con 0x55a4c4914a20 2024-09-13T06:11:45.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.347+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94166160913872] v35'245 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd4ac0083f0 con 0x55a4c4914a20 2024-09-13T06:11:45.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.347+0000 7fd370fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:11:45.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.347+0000 7fd4bc841980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:11:45.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.347+0000 7fd4bc841980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:11:45.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.347+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4930770 con 0x55a4c4914a20 2024-09-13T06:11:45.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.351+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v35'36 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd4ac0083f0 con 0x55a4c4914a20 2024-09-13T06:11:45.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.351+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4930e40 con 0x7fd4b0037040 2024-09-13T06:11:45.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.351+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v35'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd4ac0083f0 con 0x7fd4b0037040 2024-09-13T06:11:45.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.351+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4931260 con 0x55a4c49193e0 2024-09-13T06:11:45.355 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.351+0000 7fd4ba351640 1 -- 172.21.15.194:0/1943396376 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v35'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd4b40db070 con 0x55a4c49193e0 2024-09-13T06:11:45.355 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.351+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4931230 con 0x55a4c4914a20 2024-09-13T06:11:45.357 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.355+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v35'246 uv164 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd4ac0083f0 con 0x55a4c4914a20 2024-09-13T06:11:45.357 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.355+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a4c49317a0 con 0x7fd4b40ca060 2024-09-13T06:11:45.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.355+0000 7fd4b9b50640 1 -- 172.21.15.194:0/1943396376 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v35'77 uv53 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd4b000e620 con 0x7fd4b40ca060 2024-09-13T06:11:45.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.355+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4931d10 con 0x55a4c49193e0 2024-09-13T06:11:45.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.355+0000 7fd4ba351640 1 -- 172.21.15.194:0/1943396376 <== osd.3 v2:172.21.15.194:6816/96632515 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v35'52 uv37 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd4b40db070 con 0x55a4c49193e0 2024-09-13T06:11:45.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.355+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4931da0 con 0x55a4c4914a20 2024-09-13T06:11:45.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.359+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v35'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd4ac0083f0 con 0x55a4c4914a20 2024-09-13T06:11:45.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.359+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4932180 con 0x7fd4b0037040 2024-09-13T06:11:45.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.359+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v35'51 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd4ac0083f0 con 0x7fd4b0037040 2024-09-13T06:11:45.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.359+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4932180 con 0x7fd4b40ca060 2024-09-13T06:11:45.366 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.363+0000 7fd4b9b50640 1 -- 172.21.15.194:0/1943396376 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v35'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd4b000e620 con 0x7fd4b40ca060 2024-09-13T06:11:45.366 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.363+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4932180 con 0x55a4c49193e0 2024-09-13T06:11:45.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.363+0000 7fd4ba351640 1 -- 172.21.15.194:0/1943396376 <== osd.3 v2:172.21.15.194:6816/96632515 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v35'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd4b40db070 con 0x55a4c49193e0 2024-09-13T06:11:45.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.363+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a4c49301a0 con 0x7fd4b40ca060 2024-09-13T06:11:45.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.367+0000 7fd4b9b50640 1 -- 172.21.15.194:0/1943396376 <== osd.2 v2:172.21.15.194:6800/815615585 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v35'78 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd4b000e620 con 0x7fd4b40ca060 2024-09-13T06:11:45.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.367+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4932980 con 0x7fd4b0037040 2024-09-13T06:11:45.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.367+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v35'36 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd4ac0083f0 con 0x7fd4b0037040 2024-09-13T06:11:45.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.367+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4932980 con 0x7fd4b40ca060 2024-09-13T06:11:45.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.371+0000 7fd4b9b50640 1 -- 172.21.15.194:0/1943396376 <== osd.2 v2:172.21.15.194:6800/815615585 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v35'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd4b000e620 con 0x7fd4b40ca060 2024-09-13T06:11:45.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.371+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4932840 con 0x7fd4b0037040 2024-09-13T06:11:45.374 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.371+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v35'57 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd4ac0083f0 con 0x7fd4b0037040 2024-09-13T06:11:45.374 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.371+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4932840 con 0x55a4c4914a20 2024-09-13T06:11:45.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.371+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v35'247 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd4ac0083f0 con 0x55a4c4914a20 2024-09-13T06:11:45.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.375+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4932840 con 0x55a4c49193e0 2024-09-13T06:11:45.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.375+0000 7fd4ba351640 1 -- 172.21.15.194:0/1943396376 <== osd.3 v2:172.21.15.194:6816/96632515 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v35'71 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd4b40db070 con 0x55a4c49193e0 2024-09-13T06:11:45.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.375+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a4c49328d0 con 0x7fd4b40ca060 2024-09-13T06:11:45.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.375+0000 7fd4b9b50640 1 -- 172.21.15.194:0/1943396376 <== osd.2 v2:172.21.15.194:6800/815615585 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v35'79 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd4b000e620 con 0x7fd4b40ca060 2024-09-13T06:11:45.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.375+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a4c49328d0 con 0x55a4c49193e0 2024-09-13T06:11:45.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.379+0000 7fd4ba351640 1 -- 172.21.15.194:0/1943396376 <== osd.3 v2:172.21.15.194:6816/96632515 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v35'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd4b40db070 con 0x55a4c49193e0 2024-09-13T06:11:45.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.379+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a4c49328d0 con 0x55a4c4914a20 2024-09-13T06:11:45.382 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.379+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 <== osd.1 v2:172.21.15.194:6808/3135444559 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v35'37 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd4ac0083f0 con 0x55a4c4914a20 2024-09-13T06:11:45.382 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.379+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a4c49328d0 con 0x55a4c4914a20 2024-09-13T06:11:45.383 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.379+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 <== osd.1 v2:172.21.15.194:6808/3135444559 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v35'248 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd4ac0083f0 con 0x55a4c4914a20 2024-09-13T06:11:45.383 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.379+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a4c49328d0 con 0x55a4c49193e0 2024-09-13T06:11:45.385 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.383+0000 7fd4ba351640 1 -- 172.21.15.194:0/1943396376 <== osd.3 v2:172.21.15.194:6816/96632515 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v35'72 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd4b40db070 con 0x55a4c49193e0 2024-09-13T06:11:45.385 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.383+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4932e30 con 0x7fd4b40ca060 2024-09-13T06:11:45.387 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.383+0000 7fd4b9b50640 1 -- 172.21.15.194:0/1943396376 <== osd.2 v2:172.21.15.194:6800/815615585 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v35'39 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd4b000e620 con 0x7fd4b40ca060 2024-09-13T06:11:45.387 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.383+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4932e30 con 0x55a4c49193e0 2024-09-13T06:11:45.388 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.387+0000 7fd4ba351640 1 -- 172.21.15.194:0/1943396376 <== osd.3 v2:172.21.15.194:6816/96632515 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v35'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd4b40db070 con 0x55a4c49193e0 2024-09-13T06:11:45.388 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.387+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4932e30 con 0x55a4c49193e0 2024-09-13T06:11:45.389 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.387+0000 7fd4ba351640 1 -- 172.21.15.194:0/1943396376 <== osd.3 v2:172.21.15.194:6816/96632515 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v35'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd4b40db070 con 0x55a4c49193e0 2024-09-13T06:11:45.389 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.387+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4932e30 con 0x55a4c49193e0 2024-09-13T06:11:45.390 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.387+0000 7fd4ba351640 1 -- 172.21.15.194:0/1943396376 <== osd.3 v2:172.21.15.194:6816/96632515 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v35'25 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd4b40db070 con 0x55a4c49193e0 2024-09-13T06:11:45.390 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.387+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4932e30 con 0x55a4c49193e0 2024-09-13T06:11:45.391 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.387+0000 7fd4ba351640 1 -- 172.21.15.194:0/1943396376 <== osd.3 v2:172.21.15.194:6816/96632515 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v35'53 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd4b40db070 con 0x55a4c49193e0 2024-09-13T06:11:45.391 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.387+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4932e30 con 0x7fd4b0037040 2024-09-13T06:11:45.394 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.391+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v35'33 uv25 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd4ac0083f0 con 0x7fd4b0037040 2024-09-13T06:11:45.394 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.391+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4932e30 con 0x55a4c49193e0 2024-09-13T06:11:45.395 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.391+0000 7fd4ba351640 1 -- 172.21.15.194:0/1943396376 <== osd.3 v2:172.21.15.194:6816/96632515 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v35'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd4b40db070 con 0x55a4c49193e0 2024-09-13T06:11:45.395 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.391+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4932e30 con 0x7fd4b0037040 2024-09-13T06:11:45.398 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.395+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 <== osd.0 v2:172.21.15.120:6800/1923744619 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v35'52 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd4ac0083f0 con 0x7fd4b0037040 2024-09-13T06:11:45.398 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.395+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4932e30 con 0x55a4c49193e0 2024-09-13T06:11:45.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.399+0000 7fd4ba351640 1 -- 172.21.15.194:0/1943396376 <== osd.3 v2:172.21.15.194:6816/96632515 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v35'73 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd4b40db070 con 0x55a4c49193e0 2024-09-13T06:11:45.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.399+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4932e30 con 0x7fd4b0037040 2024-09-13T06:11:45.402 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.399+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 <== osd.0 v2:172.21.15.120:6800/1923744619 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v35'58 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd4ac0083f0 con 0x7fd4b0037040 2024-09-13T06:11:45.402 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.399+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4932e30 con 0x7fd4b40ca060 2024-09-13T06:11:45.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.403+0000 7fd4b9b50640 1 -- 172.21.15.194:0/1943396376 <== osd.2 v2:172.21.15.194:6800/815615585 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v35'36 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd4b000e620 con 0x7fd4b40ca060 2024-09-13T06:11:45.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.403+0000 7fd2eb7fe640 20 reqs_thread_entry: start 2024-09-13T06:11:45.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.403+0000 7fd4bc841980 20 init_complete bucket index max shards: 11 2024-09-13T06:11:45.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.403+0000 7fd4bc841980 20 Filter name: none 2024-09-13T06:11:45.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.403+0000 7fd2e97fa640 20 reqs_thread_entry: start 2024-09-13T06:11:45.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.403+0000 7fd4bc841980 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-09-13T06:11:45.406 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.403+0000 7fd4bc841980 20 rados->read ofs=0 len=0 2024-09-13T06:11:45.406 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.403+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:94 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a4c494e0b0 con 0x7fd4b0037040 2024-09-13T06:11:45.407 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.403+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 <== osd.0 v2:172.21.15.120:6800/1923744619 22 ==== osd_op_reply(94 system_user [call out=48b,read 0~349 out=349b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 239+0+472 (crc 0 0 0) 0x7fd4ac0083f0 con 0x7fd4b0037040 2024-09-13T06:11:45.407 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.403+0000 7fd4bc841980 20 rados_obj.operate() r=0 bl.length=349 2024-09-13T06:11:45.407 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.403+0000 7fd4bc841980 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x13 2024-09-13T06:11:45.407 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.403+0000 7fd4bc841980 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-13T06:11:45.407 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.403+0000 7fd4bc841980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:11:45.407 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.403+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:95 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4950580 con 0x7fd4b0037040 2024-09-13T06:11:45.408 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.403+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 <== osd.0 v2:172.21.15.120:6800/1923744619 23 ==== osd_op_reply(95 system_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7fd4ac0083f0 con 0x7fd4b0037040 2024-09-13T06:11:45.408 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.403+0000 7fd4bc841980 10 removing key index: system_akey 2024-09-13T06:11:45.408 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.407+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:96 8.0 8:01223cbf:users.keys::system_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a4c494e560 con 0x55a4c49193e0 2024-09-13T06:11:45.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.407+0000 7fd4ba351640 1 -- 172.21.15.194:0/1943396376 <== osd.3 v2:172.21.15.194:6816/96632515 27 ==== osd_op_reply(96 system_akey [delete] v35'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fd4b40db070 con 0x55a4c49193e0 2024-09-13T06:11:45.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.407+0000 7fd4bc841980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-09-13T06:11:45.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.407+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [notify cookie 94166161092800 in=173b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4950ac0 con 0x55a4c4914a20 2024-09-13T06:11:45.410 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.407+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 <== osd.1 v2:172.21.15.194:6808/3135444559 27 ==== watch-notify(notify (1) cookie 94166160899760 notify 150323855383 ret 0) ==== 203+0+0 (crc 0 0 0) 0x55a4c49301a0 con 0x55a4c4914a20 2024-09-13T06:11:45.410 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.407+0000 7fd39dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855383 cookie 94166160899760 notifier 4850 bl.length()=161 2024-09-13T06:11:45.410 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.407+0000 7fd39dffb640 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fd380003d70 con 0x55a4c4914a20 2024-09-13T06:11:45.410 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.407+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 <== osd.1 v2:172.21.15.194:6808/3135444559 28 ==== osd_op_reply(97 notify.1 [notify cookie 94166161092800 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd4ac0083f0 con 0x55a4c4914a20 2024-09-13T06:11:45.410 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.407+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 <== osd.1 v2:172.21.15.194:6808/3135444559 29 ==== watch-notify(notify_complete (2) cookie 94166161092800 notify 150323855383 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a4c48f6940 con 0x55a4c4914a20 2024-09-13T06:11:45.410 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.407+0000 7fd4bc841980 10 removing email index: 2024-09-13T06:11:45.410 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.407+0000 7fd4bc841980 10 removing user buckets index 2024-09-13T06:11:45.410 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.407+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 <== osd.1 v2:172.21.15.194:6808/3135444559 30 ==== osd_op_reply(98 notify.1 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4ac0083f0 con 0x55a4c4914a20 2024-09-13T06:11:45.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.407+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:99 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4950a40 con 0x7fd4b0037040 2024-09-13T06:11:45.412 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.411+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 <== osd.0 v2:172.21.15.120:6800/1923744619 24 ==== osd_op_reply(99 system_user.buckets [delete] v35'4 uv3 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7fd4ac0083f0 con 0x7fd4b0037040 2024-09-13T06:11:45.412 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.411+0000 7fd4bc841980 10 removing user index: system_user 2024-09-13T06:11:45.412 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.411+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:100 8.1e 8:78ce4db0:users.uid::system_user:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4950580 con 0x7fd4b0037040 2024-09-13T06:11:45.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.411+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 <== osd.0 v2:172.21.15.120:6800/1923744619 25 ==== osd_op_reply(100 system_user [call,call,delete] v35'5 uv5 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7fd4ac0083f0 con 0x7fd4b0037040 2024-09-13T06:11:45.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.411+0000 7fd4bc841980 10 removing default.rgw.meta+users.uid+system_user from cache 2024-09-13T06:11:45.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.411+0000 7fd4bc841980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-09-13T06:11:45.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.411+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94166161088688 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a4c494f990 con 0x7fd4b40ca060 2024-09-13T06:11:45.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.411+0000 7fd4b9b50640 1 -- 172.21.15.194:0/1943396376 <== osd.2 v2:172.21.15.194:6800/815615585 21 ==== watch-notify(notify (1) cookie 94166160895376 notify 150323855384 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55a4c4930370 con 0x7fd4b40ca060 2024-09-13T06:11:45.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.411+0000 7fd39d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855384 cookie 94166160895376 notifier 4850 bl.length()=160 2024-09-13T06:11:45.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.411+0000 7fd39d7fa640 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fd2f00032d0 con 0x7fd4b40ca060 2024-09-13T06:11:45.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.411+0000 7fd4b9b50640 1 -- 172.21.15.194:0/1943396376 <== osd.2 v2:172.21.15.194:6800/815615585 22 ==== osd_op_reply(101 notify.0 [notify cookie 94166161088688 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd4b000e620 con 0x7fd4b40ca060 2024-09-13T06:11:45.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.411+0000 7fd4b9b50640 1 -- 172.21.15.194:0/1943396376 <== osd.2 v2:172.21.15.194:6800/815615585 23 ==== osd_op_reply(102 notify.0 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4b000e620 con 0x7fd4b40ca060 2024-09-13T06:11:45.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.411+0000 7fd4b9b50640 1 -- 172.21.15.194:0/1943396376 <== osd.2 v2:172.21.15.194:6800/815615585 24 ==== watch-notify(notify_complete (2) cookie 94166161088688 notify 150323855384 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a4c49317a0 con 0x7fd4b40ca060 2024-09-13T06:11:45.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.415+0000 7fd370fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:11:45.417 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.415+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94166160913872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a4c492cbb0 con 0x55a4c4914a20 2024-09-13T06:11:45.418 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.415+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 <== osd.1 v2:172.21.15.194:6808/3135444559 31 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94166160913872] v35'249 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd4ac0083f0 con 0x55a4c4914a20 2024-09-13T06:11:45.418 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.415+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94166160895376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a4c49235d0 con 0x7fd4b40ca060 2024-09-13T06:11:45.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.415+0000 7fd4b9b50640 1 -- 172.21.15.194:0/1943396376 <== osd.2 v2:172.21.15.194:6800/815615585 25 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94166160895376] v35'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4b000e620 con 0x7fd4b40ca060 2024-09-13T06:11:45.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.415+0000 7fd4bc841980 20 remove_watcher() i=0 2024-09-13T06:11:45.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.415+0000 7fd4bc841980 2 removed watcher, disabling cache 2024-09-13T06:11:45.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.415+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94166160899760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a4c491ed90 con 0x55a4c4914a20 2024-09-13T06:11:45.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.419+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 <== osd.1 v2:172.21.15.194:6808/3135444559 32 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94166160899760] v35'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4ac0083f0 con 0x55a4c4914a20 2024-09-13T06:11:45.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.419+0000 7fd4bc841980 20 remove_watcher() i=1 2024-09-13T06:11:45.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.419+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94166160904480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a4c491ed90 con 0x55a4c49193e0 2024-09-13T06:11:45.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.423+0000 7fd4ba351640 1 -- 172.21.15.194:0/1943396376 <== osd.3 v2:172.21.15.194:6816/96632515 28 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94166160904480] v35'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4b40db070 con 0x55a4c49193e0 2024-09-13T06:11:45.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.423+0000 7fd4bc841980 20 remove_watcher() i=2 2024-09-13T06:11:45.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.423+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94166160907200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a4c491ed90 con 0x7fd4b40ca060 2024-09-13T06:11:45.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.423+0000 7fd4b9b50640 1 -- 172.21.15.194:0/1943396376 <== osd.2 v2:172.21.15.194:6800/815615585 26 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94166160907200] v35'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4b000e620 con 0x7fd4b40ca060 2024-09-13T06:11:45.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.423+0000 7fd4bc841980 20 remove_watcher() i=3 2024-09-13T06:11:45.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.423+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94166160911824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a4c491ed90 con 0x55a4c4914a20 2024-09-13T06:11:45.428 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.423+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 <== osd.1 v2:172.21.15.194:6808/3135444559 33 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94166160911824] v35'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4ac0083f0 con 0x55a4c4914a20 2024-09-13T06:11:45.428 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.427+0000 7fd4bc841980 20 remove_watcher() i=4 2024-09-13T06:11:45.428 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.427+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94166160909328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4922dd0 con 0x7fd4b0037040 2024-09-13T06:11:45.430 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.427+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 <== osd.0 v2:172.21.15.120:6800/1923744619 26 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94166160909328] v35'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4ac0083f0 con 0x7fd4b0037040 2024-09-13T06:11:45.430 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.427+0000 7fd4bc841980 20 remove_watcher() i=5 2024-09-13T06:11:45.430 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.427+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94166160915152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a4c491ed90 con 0x7fd4b0037040 2024-09-13T06:11:45.432 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.431+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 <== osd.0 v2:172.21.15.120:6800/1923744619 27 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94166160915152] v35'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4ac0083f0 con 0x7fd4b0037040 2024-09-13T06:11:45.433 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.431+0000 7fd4bc841980 20 remove_watcher() i=6 2024-09-13T06:11:45.433 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.431+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94166160919136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a4c4922410 con 0x7fd4b0037040 2024-09-13T06:11:45.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.431+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 <== osd.0 v2:172.21.15.120:6800/1923744619 28 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94166160919136] v35'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4ac0083f0 con 0x7fd4b0037040 2024-09-13T06:11:45.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.431+0000 7fd4bc841980 20 remove_watcher() i=7 2024-09-13T06:11:45.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.431+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fd4b0037040 msgr2=0x7fd4b0036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.439 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.431+0000 7fd4bc841980 1 --2- 172.21.15.194:0/1943396376 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fd4b0037040 0x7fd4b0036410 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:45.439 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.431+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55a4c4914a20 msgr2=0x55a4c4916ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.439 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.431+0000 7fd4bc841980 1 --2- 172.21.15.194:0/1943396376 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55a4c4914a20 0x55a4c4916ee0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:45.439 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.431+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fd4b40ca060 msgr2=0x7fd4b40c9a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.439 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.431+0000 7fd4bc841980 1 --2- 172.21.15.194:0/1943396376 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fd4b40ca060 0x7fd4b40c9a00 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:45.439 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.431+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55a4c49193e0 msgr2=0x55a4c491b7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.439 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.431+0000 7fd4bc841980 1 --2- 172.21.15.194:0/1943396376 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55a4c49193e0 0x55a4c491b7d0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:45.439 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.431+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fd384034650 msgr2=0x7fd384036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.439 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.431+0000 7fd4bc841980 1 --2- 172.21.15.194:0/1943396376 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fd384034650 0x7fd384036b10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x55a4c48dfa00 tx=0x7fd4b0010000 comp rx=0 tx=0).stop 2024-09-13T06:11:45.439 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.431+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a4c49026a0 msgr2=0x55a4c49098a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.439 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.431+0000 7fd4bab52640 1 -- 172.21.15.194:0/1943396376 reap_dead start 2024-09-13T06:11:45.439 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.431+0000 7fd4bc841980 1 --2- 172.21.15.194:0/1943396376 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a4c49026a0 0x55a4c49098a0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fd4b40daff0 tx=0x7fd4b40daf80 comp rx=0 tx=0).stop 2024-09-13T06:11:45.440 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.435+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 shutdown_connections 2024-09-13T06:11:45.440 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.435+0000 7fd4bc841980 1 --2- 172.21.15.194:0/1943396376 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a4c49026a0 0x55a4c49098a0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:45.440 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.435+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 >> 172.21.15.194:0/1943396376 conn(0x55a4c48fead0 msgr2=0x55a4c48fcba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:45.440 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.435+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 shutdown_connections 2024-09-13T06:11:45.440 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.435+0000 7fd4bc841980 1 -- 172.21.15.194:0/1943396376 wait complete. 2024-09-13T06:11:45.440 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.435+0000 7fd4bc841980 1 -- 172.21.15.194:0/4004393961 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fd394034650 msgr2=0x7fd394036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.440 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.435+0000 7fd4bc841980 1 --2- 172.21.15.194:0/4004393961 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fd394034650 0x7fd394036b10 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd4b000bf60 tx=0x7fd4b000f000 comp rx=0 tx=0).stop 2024-09-13T06:11:45.440 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.435+0000 7fd4bc841980 1 -- 172.21.15.194:0/4004393961 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a4c48f5d50 msgr2=0x55a4c48f6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.440 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.435+0000 7fd4bc841980 1 --2- 172.21.15.194:0/4004393961 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a4c48f5d50 0x55a4c48f6170 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fd4b40b8010 tx=0x7fd4b40a9d20 comp rx=0 tx=0).stop 2024-09-13T06:11:45.440 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.435+0000 7fd4bc841980 1 -- 172.21.15.194:0/4004393961 shutdown_connections 2024-09-13T06:11:45.440 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.435+0000 7fd4bc841980 1 --2- 172.21.15.194:0/4004393961 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fd394034650 0x7fd394036b10 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:45.440 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.435+0000 7fd4bc841980 1 --2- 172.21.15.194:0/4004393961 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a4c48f5d50 0x55a4c48f6170 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:45.441 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.435+0000 7fd4bc841980 1 -- 172.21.15.194:0/4004393961 >> 172.21.15.194:0/4004393961 conn(0x55a4c48eaea0 msgr2=0x55a4c48ed920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:45.441 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.435+0000 7fd4bc841980 1 -- 172.21.15.194:0/4004393961 shutdown_connections 2024-09-13T06:11:45.441 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.435+0000 7fd4bc841980 1 -- 172.21.15.194:0/4004393961 wait complete. 2024-09-13T06:11:45.441 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.435+0000 7fd4bc841980 1 -- 172.21.15.194:0/3108600465 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55a4c47e3fe0 msgr2=0x55a4c48df080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.441 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.435+0000 7fd4bc841980 1 --2- 172.21.15.194:0/3108600465 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55a4c47e3fe0 0x55a4c48df080 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:45.441 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.435+0000 7fd4bc841980 1 -- 172.21.15.194:0/3108600465 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55a4c48e5750 msgr2=0x55a4c48e7b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.441 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.435+0000 7fd4bc841980 1 --2- 172.21.15.194:0/3108600465 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55a4c48e5750 0x55a4c48e7b40 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:45.441 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.435+0000 7fd4bc841980 1 -- 172.21.15.194:0/3108600465 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55a4c48e1830 msgr2=0x55a4c48e3c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.441 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.435+0000 7fd4bc841980 1 --2- 172.21.15.194:0/3108600465 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55a4c48e1830 0x55a4c48e3c20 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:45.441 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.435+0000 7fd4bc841980 1 -- 172.21.15.194:0/3108600465 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fd3a0034650 msgr2=0x7fd3a0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.441 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.435+0000 7fd4bc841980 1 --2- 172.21.15.194:0/3108600465 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fd3a0034650 0x7fd3a0036b10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd4b0000f70 tx=0x7fd4b00012c0 comp rx=0 tx=0).stop 2024-09-13T06:11:45.441 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.435+0000 7fd4bc841980 1 -- 172.21.15.194:0/3108600465 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a4c47e3690 msgr2=0x55a4c475a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.441 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.435+0000 7fd4bc841980 1 --2- 172.21.15.194:0/3108600465 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a4c47e3690 0x55a4c475a4f0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fd4b401b870 tx=0x7fd4b4019810 comp rx=0 tx=0).stop 2024-09-13T06:11:45.442 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.435+0000 7fd4bab52640 1 -- 172.21.15.194:0/3108600465 reap_dead start 2024-09-13T06:11:45.442 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.435+0000 7fd4bc841980 1 -- 172.21.15.194:0/3108600465 shutdown_connections 2024-09-13T06:11:45.442 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.435+0000 7fd4bc841980 1 -- 172.21.15.194:0/3108600465 >> 172.21.15.194:0/3108600465 conn(0x55a4c47df1b0 msgr2=0x55a4c48c91f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:45.442 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.435+0000 7fd4bc841980 1 -- 172.21.15.194:0/3108600465 shutdown_connections 2024-09-13T06:11:45.442 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.435+0000 7fd4bc841980 1 -- 172.21.15.194:0/3108600465 wait complete. 2024-09-13T06:11:45.451 ERROR:root:None 2024-09-13T06:11:45.451 ERROR:root:0 2024-09-13T06:11:45.451 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-09-13T06:11:45.451 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-09-13T06:11:45.451 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid a_user --display-name 'True Admin User' --access-key true_admin_akey --secret true_admin_skey --caps user-info-without-keys=read --admin 2024-09-13T06:11:45.538 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:11:45.538 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:11:45.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.535+0000 7fd3e0145980 1 Processor -- start 2024-09-13T06:11:45.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.535+0000 7fd3e0145980 1 -- start start 2024-09-13T06:11:45.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.535+0000 7fd3e0145980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x5628e0d03880 0x5628e0d03c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.535+0000 7fd3e0145980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5628e0b89ae0 con 0x5628e0d041d0 2024-09-13T06:11:45.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.535+0000 7fd3e0145980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x5628e0bade30 con 0x5628e0d03880 2024-09-13T06:11:45.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.535+0000 7fd3ddc55640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x5628e0d03880 0x5628e0d03c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.535+0000 7fd3dd454640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x5628e0d041d0 0x5628e0d08c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:58390/0 (socket says 172.21.15.194:58390) 2024-09-13T06:11:45.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.535+0000 7fd3dd454640 1 -- 172.21.15.194:0/3563205485 learned_addr learned my addr 172.21.15.194:0/3563205485 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-09-13T06:11:45.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.539+0000 7fd3ddc55640 1 -- 172.21.15.194:0/3563205485 >> v1:172.21.15.120:6789/0 conn(0x5628e0d041d0 legacy=0x5628e0d08c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.539+0000 7fd3ddc55640 1 -- 172.21.15.194:0/3563205485 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628e0d0b450 con 0x5628e0d03880 2024-09-13T06:11:45.543 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.539+0000 7fd3ddc55640 1 --2- 172.21.15.194:0/3563205485 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628e0d03880 0x5628e0d03c60 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fd3d000a480 tx=0x7fd3d001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d46dd2d21aa3d117 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.543 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.539+0000 7fd3dcc53640 1 -- 172.21.15.194:0/3563205485 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3d00b0070 con 0x5628e0d03880 2024-09-13T06:11:45.543 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.539+0000 7fd3dcc53640 1 -- 172.21.15.194:0/3563205485 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3d00ab540 con 0x5628e0d03880 2024-09-13T06:11:45.543 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.539+0000 7fd3dcc53640 1 -- 172.21.15.194:0/3563205485 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3d00ab840 con 0x5628e0d03880 2024-09-13T06:11:45.544 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.539+0000 7fd3e0145980 1 -- 172.21.15.194:0/3563205485 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628e0d03880 msgr2=0x5628e0d03c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.544 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.539+0000 7fd3e0145980 1 --2- 172.21.15.194:0/3563205485 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628e0d03880 0x5628e0d03c60 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fd3d000a480 tx=0x7fd3d001b280 comp rx=0 tx=0).stop 2024-09-13T06:11:45.544 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.539+0000 7fd3e0145980 1 -- 172.21.15.194:0/3563205485 shutdown_connections 2024-09-13T06:11:45.544 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.543+0000 7fd3e0145980 1 --2- 172.21.15.194:0/3563205485 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628e0d03880 0x5628e0d03c60 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:45.544 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.543+0000 7fd3e0145980 1 -- 172.21.15.194:0/3563205485 >> 172.21.15.194:0/3563205485 conn(0x5628e0c771d0 msgr2=0x5628e0c775e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:45.544 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.543+0000 7fd3e0145980 1 -- 172.21.15.194:0/3563205485 shutdown_connections 2024-09-13T06:11:45.544 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.543+0000 7fd3e0145980 1 -- 172.21.15.194:0/3563205485 wait complete. 2024-09-13T06:11:45.560 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.559+0000 7fd3e0145980 1 Processor -- start 2024-09-13T06:11:45.560 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.559+0000 7fd3e0145980 1 -- start start 2024-09-13T06:11:45.560 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.559+0000 7fd3e0145980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628e0d03880 0x5628e0deebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.560 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.559+0000 7fd3e0145980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5628e0baf200 con 0x5628e0d03880 2024-09-13T06:11:45.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.559+0000 7fd3ddc55640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628e0d03880 0x5628e0deebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.559+0000 7fd3ddc55640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628e0d03880 0x5628e0deebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45138/0 (socket says 172.21.15.194:45138) 2024-09-13T06:11:45.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.559+0000 7fd3ddc55640 1 -- 172.21.15.194:0/539657020 learned_addr learned my addr 172.21.15.194:0/539657020 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:45.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.559+0000 7fd3ddc55640 1 -- 172.21.15.194:0/539657020 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628e0def1a0 con 0x5628e0d03880 2024-09-13T06:11:45.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.559+0000 7fd3ddc55640 1 --2- 172.21.15.194:0/539657020 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628e0d03880 0x5628e0deebd0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fd3d00ae040 tx=0x7fd3d0003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ee5345338083bfb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.562 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.559+0000 7fd2cbe07640 1 -- 172.21.15.194:0/539657020 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3d00b0040 con 0x5628e0d03880 2024-09-13T06:11:45.562 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.559+0000 7fd2cbe07640 1 -- 172.21.15.194:0/539657020 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3d00ab9b0 con 0x5628e0d03880 2024-09-13T06:11:45.562 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.559+0000 7fd2cbe07640 1 -- 172.21.15.194:0/539657020 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3d00abc90 con 0x5628e0d03880 2024-09-13T06:11:45.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.559+0000 7fd3e0145980 1 -- 172.21.15.194:0/539657020 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628e0d03880 msgr2=0x5628e0deebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.559+0000 7fd3e0145980 1 --2- 172.21.15.194:0/539657020 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628e0d03880 0x5628e0deebd0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fd3d00ae040 tx=0x7fd3d0003030 comp rx=0 tx=0).stop 2024-09-13T06:11:45.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.559+0000 7fd3e0145980 1 -- 172.21.15.194:0/539657020 shutdown_connections 2024-09-13T06:11:45.564 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.559+0000 7fd3e0145980 1 --2- 172.21.15.194:0/539657020 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628e0d03880 0x5628e0deebd0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:45.564 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.559+0000 7fd3e0145980 1 -- 172.21.15.194:0/539657020 >> 172.21.15.194:0/539657020 conn(0x5628e0c771d0 msgr2=0x5628e0dea800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:45.564 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.559+0000 7fd3e0145980 1 -- 172.21.15.194:0/539657020 shutdown_connections 2024-09-13T06:11:45.564 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.559+0000 7fd3e0145980 1 -- 172.21.15.194:0/539657020 wait complete. 2024-09-13T06:11:45.564 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.559+0000 7fd3e0145980 1 Processor -- start 2024-09-13T06:11:45.564 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.559+0000 7fd3e0145980 1 -- start start 2024-09-13T06:11:45.564 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.559+0000 7fd3e0145980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628e0d03880 0x5628e0df5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.564 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.559+0000 7fd3e0145980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5628e0d0ae90 con 0x5628e0d03880 2024-09-13T06:11:45.564 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.559+0000 7fd3ddc55640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628e0d03880 0x5628e0df5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.564 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.559+0000 7fd3ddc55640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628e0d03880 0x5628e0df5e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45150/0 (socket says 172.21.15.194:45150) 2024-09-13T06:11:45.564 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.559+0000 7fd3ddc55640 1 -- 172.21.15.194:0/2539773583 learned_addr learned my addr 172.21.15.194:0/2539773583 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:45.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.563+0000 7fd3ddc55640 1 -- 172.21.15.194:0/2539773583 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628e0df6340 con 0x5628e0d03880 2024-09-13T06:11:45.566 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.563+0000 7fd3ddc55640 1 --2- 172.21.15.194:0/2539773583 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628e0d03880 0x5628e0df5e00 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fd3d00030b0 tx=0x7fd3d0018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.566 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.563+0000 7fd2ca604640 1 -- 172.21.15.194:0/2539773583 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3d00c5070 con 0x5628e0d03880 2024-09-13T06:11:45.566 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.563+0000 7fd2ca604640 1 -- 172.21.15.194:0/2539773583 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3d00b6970 con 0x5628e0d03880 2024-09-13T06:11:45.566 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.563+0000 7fd3e0145980 1 -- 172.21.15.194:0/2539773583 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5628e0df65d0 con 0x5628e0d03880 2024-09-13T06:11:45.566 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.563+0000 7fd2ca604640 1 -- 172.21.15.194:0/2539773583 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3d00b0050 con 0x5628e0d03880 2024-09-13T06:11:45.566 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.563+0000 7fd3e0145980 1 -- 172.21.15.194:0/2539773583 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628e0df92b0 con 0x5628e0d03880 2024-09-13T06:11:45.566 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.563+0000 7fd2ca604640 1 -- 172.21.15.194:0/2539773583 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd3d00c8070 con 0x5628e0d03880 2024-09-13T06:11:45.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.563+0000 7fd2ca604640 1 --2- 172.21.15.194:0/2539773583 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fd2c4034650 0x7fd2c4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.563+0000 7fd2ca604640 1 -- 172.21.15.194:0/2539773583 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fd3d00bc070 con 0x5628e0d03880 2024-09-13T06:11:45.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.563+0000 7fd3dd454640 1 --2- 172.21.15.194:0/2539773583 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fd2c4034650 0x7fd2c4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.563+0000 7fd3e0145980 1 --2- 172.21.15.194:0/2539773583 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5628e0d041d0 0x5628e0dfcd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.563+0000 7fd3e0145980 1 -- 172.21.15.194:0/2539773583 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5628e0dfd400 con 0x5628e0d041d0 2024-09-13T06:11:45.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.563+0000 7fd3de456640 1 --2- 172.21.15.194:0/2539773583 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5628e0d041d0 0x5628e0dfcd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.563+0000 7fd3dd454640 1 --2- 172.21.15.194:0/2539773583 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fd2c4034650 0x7fd2c4036b10 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd3c8000f70 tx=0x7fd3c80012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.563+0000 7fd3de456640 1 --2- 172.21.15.194:0/2539773583 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5628e0d041d0 0x5628e0dfcd90 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.563+0000 7fd3de456640 1 -- 172.21.15.194:0/2539773583 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd3d800a4d0 con 0x5628e0d041d0 2024-09-13T06:11:45.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.563+0000 7fd3e0145980 1 -- 172.21.15.194:0/2539773583 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5628e0dfa4d0 con 0x5628e0d041d0 2024-09-13T06:11:45.569 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.567+0000 7fd3de456640 1 -- 172.21.15.194:0/2539773583 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd3d800a4d0 con 0x5628e0d041d0 2024-09-13T06:11:45.569 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.567+0000 7fd3e0145980 1 --2- 172.21.15.194:0/2539773583 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5628e0dff750 0x5628e0e01b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.570 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.567+0000 7fd3e0145980 1 -- 172.21.15.194:0/2539773583 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e02210 con 0x5628e0dff750 2024-09-13T06:11:45.570 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.567+0000 7fd3ddc55640 1 --2- 172.21.15.194:0/2539773583 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5628e0dff750 0x5628e0e01b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.570 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.567+0000 7fd3ddc55640 1 --2- 172.21.15.194:0/2539773583 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5628e0dff750 0x5628e0e01b40 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.570 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.567+0000 7fd3ddc55640 1 -- 172.21.15.194:0/2539773583 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd3d00c7030 con 0x5628e0dff750 2024-09-13T06:11:45.570 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.567+0000 7fd3e0145980 1 -- 172.21.15.194:0/2539773583 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5628e0dfe5f0 con 0x5628e0d041d0 2024-09-13T06:11:45.570 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.567+0000 7fd3de456640 1 -- 172.21.15.194:0/2539773583 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd3d800a4d0 con 0x5628e0d041d0 2024-09-13T06:11:45.570 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.567+0000 7fd3e0145980 1 --2- 172.21.15.194:0/2539773583 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5628e0e03650 0x5628e0e05a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.570 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.567+0000 7fd3e0145980 1 -- 172.21.15.194:0/2539773583 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e06180 con 0x5628e0e03650 2024-09-13T06:11:45.570 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.567+0000 7fd3dd454640 1 --2- 172.21.15.194:0/2539773583 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5628e0e03650 0x5628e0e05a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.570 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.567+0000 7fd3dd454640 1 --2- 172.21.15.194:0/2539773583 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5628e0e03650 0x5628e0e05a40 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.571 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.567+0000 7fd3dd454640 1 -- 172.21.15.194:0/2539773583 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd3c800e620 con 0x5628e0e03650 2024-09-13T06:11:45.571 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.567+0000 7fd3e0145980 1 Processor -- start 2024-09-13T06:11:45.571 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.567+0000 7fd3e0145980 1 -- start start 2024-09-13T06:11:45.571 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.567+0000 7fd3e0145980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628e0e13c10 0x5628e0e14030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.572 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.567+0000 7fd3e0145980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5628e0c08800 con 0x5628e0e13c10 2024-09-13T06:11:45.572 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.567+0000 7fd3ddc55640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628e0e13c10 0x5628e0e14030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.572 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.567+0000 7fd3ddc55640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628e0e13c10 0x5628e0e14030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45162/0 (socket says 172.21.15.194:45162) 2024-09-13T06:11:45.572 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.567+0000 7fd3ddc55640 1 -- 172.21.15.194:0/993700122 learned_addr learned my addr 172.21.15.194:0/993700122 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:45.572 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.567+0000 7fd3ddc55640 1 -- 172.21.15.194:0/993700122 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628e0e14570 con 0x5628e0e13c10 2024-09-13T06:11:45.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.571+0000 7fd3ddc55640 1 --2- 172.21.15.194:0/993700122 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628e0e13c10 0x5628e0e14030 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fd3d00e1fb0 tx=0x7fd3d00b4610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.571+0000 7fd2c37fe640 1 -- 172.21.15.194:0/993700122 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3d00add90 con 0x5628e0e13c10 2024-09-13T06:11:45.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.571+0000 7fd2c37fe640 1 -- 172.21.15.194:0/993700122 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3d00c93b0 con 0x5628e0e13c10 2024-09-13T06:11:45.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.571+0000 7fd3e0145980 1 -- 172.21.15.194:0/993700122 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5628e0e14800 con 0x5628e0e13c10 2024-09-13T06:11:45.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.571+0000 7fd2c37fe640 1 -- 172.21.15.194:0/993700122 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3d00c9690 con 0x5628e0e13c10 2024-09-13T06:11:45.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.571+0000 7fd3e0145980 1 -- 172.21.15.194:0/993700122 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628e0e17480 con 0x5628e0e13c10 2024-09-13T06:11:45.574 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.571+0000 7fd2c37fe640 1 -- 172.21.15.194:0/993700122 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd3d00c9830 con 0x5628e0e13c10 2024-09-13T06:11:45.574 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.571+0000 7fd2c37fe640 1 --2- 172.21.15.194:0/993700122 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fd2b8034650 0x7fd2b8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.574 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.571+0000 7fd2c37fe640 1 -- 172.21.15.194:0/993700122 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fd3d00dd070 con 0x5628e0e13c10 2024-09-13T06:11:45.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.571+0000 7fd3dd454640 1 --2- 172.21.15.194:0/993700122 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fd2b8034650 0x7fd2b8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.571+0000 7fd3e0145980 1 Processor -- start 2024-09-13T06:11:45.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.571+0000 7fd3e0145980 1 -- start start 2024-09-13T06:11:45.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.571+0000 7fd3e0145980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628e0e205a0 0x5628e0e20980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.571+0000 7fd3e0145980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5628e0def460 con 0x5628e0e205a0 2024-09-13T06:11:45.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.571+0000 7fd3dd454640 1 --2- 172.21.15.194:0/993700122 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fd2b8034650 0x7fd2b8036b10 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd3c800bf60 tx=0x7fd3c800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.571+0000 7fd3ddc55640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628e0e205a0 0x5628e0e20980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.571+0000 7fd3ddc55640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628e0e205a0 0x5628e0e20980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45168/0 (socket says 172.21.15.194:45168) 2024-09-13T06:11:45.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.571+0000 7fd3ddc55640 1 -- 172.21.15.194:0/677363370 learned_addr learned my addr 172.21.15.194:0/677363370 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:45.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.571+0000 7fd3ddc55640 1 -- 172.21.15.194:0/677363370 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628e0e20f50 con 0x5628e0e205a0 2024-09-13T06:11:45.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.571+0000 7fd3ddc55640 1 --2- 172.21.15.194:0/677363370 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628e0e205a0 0x5628e0e20980 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fd3d00ca8e0 tx=0x7fd3d00caa10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b1a3b77a204aaad server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.571+0000 7fd2c17fa640 1 -- 172.21.15.194:0/677363370 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3d00fb020 con 0x5628e0e205a0 2024-09-13T06:11:45.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.575+0000 7fd2c17fa640 1 -- 172.21.15.194:0/677363370 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3d00b5ce0 con 0x5628e0e205a0 2024-09-13T06:11:45.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.575+0000 7fd2c17fa640 1 -- 172.21.15.194:0/677363370 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3d00aa3b0 con 0x5628e0e205a0 2024-09-13T06:11:45.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.575+0000 7fd3e0145980 1 -- 172.21.15.194:0/677363370 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628e0e205a0 msgr2=0x5628e0e20980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.575+0000 7fd3e0145980 1 --2- 172.21.15.194:0/677363370 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628e0e205a0 0x5628e0e20980 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fd3d00ca8e0 tx=0x7fd3d00caa10 comp rx=0 tx=0).stop 2024-09-13T06:11:45.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.575+0000 7fd3e0145980 1 -- 172.21.15.194:0/677363370 shutdown_connections 2024-09-13T06:11:45.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.575+0000 7fd3e0145980 1 --2- 172.21.15.194:0/677363370 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628e0e205a0 0x5628e0e20980 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:45.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.575+0000 7fd3e0145980 1 -- 172.21.15.194:0/677363370 >> 172.21.15.194:0/677363370 conn(0x5628e0e1c980 msgr2=0x5628e0e1aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:45.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.575+0000 7fd3e0145980 1 -- 172.21.15.194:0/677363370 shutdown_connections 2024-09-13T06:11:45.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.575+0000 7fd3e0145980 1 -- 172.21.15.194:0/677363370 wait complete. 2024-09-13T06:11:45.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.575+0000 7fd3e0145980 1 Processor -- start 2024-09-13T06:11:45.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.575+0000 7fd3e0145980 1 -- start start 2024-09-13T06:11:45.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.575+0000 7fd3e0145980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628e0e205a0 0x5628e0e27560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.575+0000 7fd3e0145980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5628e0e20f50 con 0x5628e0e205a0 2024-09-13T06:11:45.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.575+0000 7fd3ddc55640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628e0e205a0 0x5628e0e27560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.575+0000 7fd3ddc55640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628e0e205a0 0x5628e0e27560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45180/0 (socket says 172.21.15.194:45180) 2024-09-13T06:11:45.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.575+0000 7fd3ddc55640 1 -- 172.21.15.194:0/1832853662 learned_addr learned my addr 172.21.15.194:0/1832853662 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:45.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.575+0000 7fd3ddc55640 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628e0e27aa0 con 0x5628e0e205a0 2024-09-13T06:11:45.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.575+0000 7fd3ddc55640 1 --2- 172.21.15.194:0/1832853662 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628e0e205a0 0x5628e0e27560 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fd3d00ca8e0 tx=0x7fd3d00cef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.575+0000 7fd2af7fe640 1 -- 172.21.15.194:0/1832853662 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3d0110070 con 0x5628e0e205a0 2024-09-13T06:11:45.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.575+0000 7fd3e0145980 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5628e0e27aa0 con 0x5628e0e205a0 2024-09-13T06:11:45.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.575+0000 7fd3e0145980 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628e0e27aa0 con 0x5628e0e205a0 2024-09-13T06:11:45.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.575+0000 7fd2af7fe640 1 -- 172.21.15.194:0/1832853662 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3d00b5ae0 con 0x5628e0e205a0 2024-09-13T06:11:45.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.575+0000 7fd2af7fe640 1 -- 172.21.15.194:0/1832853662 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3d00ec510 con 0x5628e0e205a0 2024-09-13T06:11:45.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.579+0000 7fd2af7fe640 1 -- 172.21.15.194:0/1832853662 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd3d0113070 con 0x5628e0e205a0 2024-09-13T06:11:45.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.579+0000 7fd2af7fe640 1 --2- 172.21.15.194:0/1832853662 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fd2a8034650 0x7fd2a8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.579+0000 7fd2af7fe640 1 -- 172.21.15.194:0/1832853662 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fd3d0106030 con 0x5628e0e205a0 2024-09-13T06:11:45.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.579+0000 7fd3dd454640 1 --2- 172.21.15.194:0/1832853662 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fd2a8034650 0x7fd2a8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.579+0000 7fd3e0145980 20 rados->read ofs=0 len=0 2024-09-13T06:11:45.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.579+0000 7fd3e0145980 1 --2- 172.21.15.194:0/1832853662 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5628e0e325a0 0x5628e0e34a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.579+0000 7fd3e0145980 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e351b0 con 0x5628e0e325a0 2024-09-13T06:11:45.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.579+0000 7fd3de456640 1 --2- 172.21.15.194:0/1832853662 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5628e0e325a0 0x5628e0e34a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.579+0000 7fd3dd454640 1 --2- 172.21.15.194:0/1832853662 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fd2a8034650 0x7fd2a8036b10 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x5628e0e06580 tx=0x7fd3c8010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.583 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.579+0000 7fd3de456640 1 --2- 172.21.15.194:0/1832853662 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5628e0e325a0 0x5628e0e34a60 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.583 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.579+0000 7fd3de456640 1 -- 172.21.15.194:0/1832853662 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd3d800a4d0 con 0x5628e0e325a0 2024-09-13T06:11:45.583 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.579+0000 7fd3e0145980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:45.583 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.579+0000 7fd3e0145980 20 realm 2024-09-13T06:11:45.583 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.579+0000 7fd3e0145980 20 rados->read ofs=0 len=0 2024-09-13T06:11:45.583 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.579+0000 7fd3e0145980 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e355c0 con 0x5628e0e325a0 2024-09-13T06:11:45.584 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.579+0000 7fd3de456640 1 -- 172.21.15.194:0/1832853662 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd3d800a4d0 con 0x5628e0e325a0 2024-09-13T06:11:45.584 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.579+0000 7fd3e0145980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:45.584 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.579+0000 7fd3e0145980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:11:45.584 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.579+0000 7fd3e0145980 20 rados->read ofs=0 len=0 2024-09-13T06:11:45.584 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.579+0000 7fd3e0145980 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e35e90 con 0x5628e0e325a0 2024-09-13T06:11:45.584 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.579+0000 7fd3de456640 1 -- 172.21.15.194:0/1832853662 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd3d800a4d0 con 0x5628e0e325a0 2024-09-13T06:11:45.584 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.579+0000 7fd3e0145980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:45.584 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.579+0000 7fd3e0145980 20 rados->read ofs=0 len=0 2024-09-13T06:11:45.584 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.579+0000 7fd3e0145980 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e36230 con 0x5628e0e325a0 2024-09-13T06:11:45.584 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.579+0000 7fd3de456640 1 -- 172.21.15.194:0/1832853662 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd3d800a4d0 con 0x5628e0e325a0 2024-09-13T06:11:45.584 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.579+0000 7fd3e0145980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:11:45.584 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.579+0000 7fd3e0145980 20 rados->read ofs=0 len=0 2024-09-13T06:11:45.585 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.579+0000 7fd3e0145980 1 --2- 172.21.15.194:0/1832853662 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5628e0e36f90 0x5628e0e39380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.585 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.579+0000 7fd3e0145980 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e39950 con 0x5628e0e36f90 2024-09-13T06:11:45.585 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.579+0000 7fd3ddc55640 1 --2- 172.21.15.194:0/1832853662 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5628e0e36f90 0x5628e0e39380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.585 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.579+0000 7fd3ddc55640 1 --2- 172.21.15.194:0/1832853662 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5628e0e36f90 0x5628e0e39380 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.579+0000 7fd3ddc55640 1 -- 172.21.15.194:0/1832853662 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd3d0112030 con 0x5628e0e36f90 2024-09-13T06:11:45.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.579+0000 7fd3e0145980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:11:45.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.579+0000 7fd3e0145980 20 searching for the correct realm 2024-09-13T06:11:45.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.579+0000 7fd3e0145980 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e3b220 con 0x5628e0e36f90 2024-09-13T06:11:45.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.583+0000 7fd3ddc55640 1 -- 172.21.15.194:0/1832853662 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3d0112030 con 0x5628e0e36f90 2024-09-13T06:11:45.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.583+0000 7fd3ddc55640 1 --2- 172.21.15.194:0/1832853662 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fd3d0115060 0x7fd3d00c8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.583+0000 7fd3ddc55640 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e3b220 con 0x7fd3d0115060 2024-09-13T06:11:45.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.583+0000 7fd3dd454640 1 --2- 172.21.15.194:0/1832853662 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fd3d0115060 0x7fd3d00c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.583+0000 7fd3dd454640 1 --2- 172.21.15.194:0/1832853662 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fd3d0115060 0x7fd3d00c8580 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.583+0000 7fd3dd454640 1 -- 172.21.15.194:0/1832853662 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd3c800e620 con 0x7fd3d0115060 2024-09-13T06:11:45.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.583+0000 7fd3dd454640 1 --2- 172.21.15.194:0/1832853662 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fd3c8037040 0x7fd3c8036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.583+0000 7fd3dd454640 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e3b220 con 0x7fd3c8037040 2024-09-13T06:11:45.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.583+0000 7fd3de456640 1 --2- 172.21.15.194:0/1832853662 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fd3c8037040 0x7fd3c8036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.583+0000 7fd3de456640 1 --2- 172.21.15.194:0/1832853662 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fd3c8037040 0x7fd3c8036410 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.583+0000 7fd3de456640 1 -- 172.21.15.194:0/1832853662 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3d800a4d0 con 0x7fd3c8037040 2024-09-13T06:11:45.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.583+0000 7fd3de456640 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e36230 con 0x5628e0e325a0 2024-09-13T06:11:45.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.583+0000 7fd3de456640 1 -- 172.21.15.194:0/1832853662 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3d800a4d0 con 0x5628e0e325a0 2024-09-13T06:11:45.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.583+0000 7fd3de456640 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e36230 con 0x5628e0e325a0 2024-09-13T06:11:45.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.583+0000 7fd3de456640 1 -- 172.21.15.194:0/1832853662 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3d800a4d0 con 0x5628e0e325a0 2024-09-13T06:11:45.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.583+0000 7fd3de456640 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e36230 con 0x7fd3c8037040 2024-09-13T06:11:45.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.587+0000 7fd3de456640 1 -- 172.21.15.194:0/1832853662 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3d800a4d0 con 0x7fd3c8037040 2024-09-13T06:11:45.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.587+0000 7fd3de456640 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e36230 con 0x7fd3c8037040 2024-09-13T06:11:45.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.587+0000 7fd3de456640 1 -- 172.21.15.194:0/1832853662 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3d800a4d0 con 0x7fd3c8037040 2024-09-13T06:11:45.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.587+0000 7fd3de456640 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e36230 con 0x7fd3d0115060 2024-09-13T06:11:45.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.587+0000 7fd3dd454640 1 -- 172.21.15.194:0/1832853662 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3c800e620 con 0x7fd3d0115060 2024-09-13T06:11:45.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.587+0000 7fd3dd454640 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e36230 con 0x5628e0e36f90 2024-09-13T06:11:45.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.587+0000 7fd3ddc55640 1 -- 172.21.15.194:0/1832853662 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3d0112030 con 0x5628e0e36f90 2024-09-13T06:11:45.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.587+0000 7fd3ddc55640 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e36230 con 0x5628e0e325a0 2024-09-13T06:11:45.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.587+0000 7fd3de456640 1 -- 172.21.15.194:0/1832853662 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3d800a4d0 con 0x5628e0e325a0 2024-09-13T06:11:45.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.587+0000 7fd3de456640 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e36230 con 0x7fd3c8037040 2024-09-13T06:11:45.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.587+0000 7fd3de456640 1 -- 172.21.15.194:0/1832853662 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3d800a4d0 con 0x7fd3c8037040 2024-09-13T06:11:45.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.587+0000 7fd3de456640 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e36230 con 0x5628e0e325a0 2024-09-13T06:11:45.592 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.587+0000 7fd3de456640 1 -- 172.21.15.194:0/1832853662 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3d800a4d0 con 0x5628e0e325a0 2024-09-13T06:11:45.592 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.587+0000 7fd3de456640 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e36230 con 0x7fd3d0115060 2024-09-13T06:11:45.592 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.587+0000 7fd3dd454640 1 -- 172.21.15.194:0/1832853662 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd3c800e620 con 0x7fd3d0115060 2024-09-13T06:11:45.592 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.587+0000 7fd3dd454640 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e36230 con 0x5628e0e36f90 2024-09-13T06:11:45.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.587+0000 7fd3ddc55640 1 -- 172.21.15.194:0/1832853662 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3d0112030 con 0x5628e0e36f90 2024-09-13T06:11:45.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.587+0000 7fd3ddc55640 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e36230 con 0x5628e0e36f90 2024-09-13T06:11:45.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.587+0000 7fd3ddc55640 1 -- 172.21.15.194:0/1832853662 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3d0112030 con 0x5628e0e36f90 2024-09-13T06:11:45.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.587+0000 7fd3ddc55640 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e36230 con 0x7fd3c8037040 2024-09-13T06:11:45.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.591+0000 7fd3de456640 1 -- 172.21.15.194:0/1832853662 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3d800a4d0 con 0x7fd3c8037040 2024-09-13T06:11:45.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.591+0000 7fd3de456640 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e36230 con 0x5628e0e36f90 2024-09-13T06:11:45.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.591+0000 7fd3ddc55640 1 -- 172.21.15.194:0/1832853662 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3d0112030 con 0x5628e0e36f90 2024-09-13T06:11:45.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.591+0000 7fd3ddc55640 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e36230 con 0x5628e0e36f90 2024-09-13T06:11:45.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.591+0000 7fd3ddc55640 1 -- 172.21.15.194:0/1832853662 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3d0112030 con 0x5628e0e36f90 2024-09-13T06:11:45.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.591+0000 7fd3ddc55640 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e36230 con 0x5628e0e325a0 2024-09-13T06:11:45.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.591+0000 7fd3de456640 1 -- 172.21.15.194:0/1832853662 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3d800a4d0 con 0x5628e0e325a0 2024-09-13T06:11:45.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.591+0000 7fd3de456640 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e36230 con 0x5628e0e325a0 2024-09-13T06:11:45.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.591+0000 7fd3de456640 1 -- 172.21.15.194:0/1832853662 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v35'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd3d800a4d0 con 0x5628e0e325a0 2024-09-13T06:11:45.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.591+0000 7fd3de456640 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e36230 con 0x7fd3d0115060 2024-09-13T06:11:45.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.591+0000 7fd3dd454640 1 -- 172.21.15.194:0/1832853662 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3c800e620 con 0x7fd3d0115060 2024-09-13T06:11:45.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.591+0000 7fd3dd454640 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e36230 con 0x5628e0e36f90 2024-09-13T06:11:45.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.591+0000 7fd3ddc55640 1 -- 172.21.15.194:0/1832853662 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3d0112030 con 0x5628e0e36f90 2024-09-13T06:11:45.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.591+0000 7fd3ddc55640 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e36230 con 0x7fd3d0115060 2024-09-13T06:11:45.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.591+0000 7fd3dd454640 1 -- 172.21.15.194:0/1832853662 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3c800e620 con 0x7fd3d0115060 2024-09-13T06:11:45.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.591+0000 7fd3dd454640 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e36230 con 0x5628e0e325a0 2024-09-13T06:11:45.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.591+0000 7fd3de456640 1 -- 172.21.15.194:0/1832853662 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3d800a4d0 con 0x5628e0e325a0 2024-09-13T06:11:45.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.591+0000 7fd3de456640 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e36230 con 0x7fd3c8037040 2024-09-13T06:11:45.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.591+0000 7fd3de456640 1 -- 172.21.15.194:0/1832853662 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3d800a4d0 con 0x7fd3c8037040 2024-09-13T06:11:45.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.591+0000 7fd3de456640 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e36230 con 0x5628e0e36f90 2024-09-13T06:11:45.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.591+0000 7fd3ddc55640 1 -- 172.21.15.194:0/1832853662 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=107b] v35'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd3d0112030 con 0x5628e0e36f90 2024-09-13T06:11:45.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.591+0000 7fd3ddc55640 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e36230 con 0x7fd3d0115060 2024-09-13T06:11:45.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.591+0000 7fd3dd454640 1 -- 172.21.15.194:0/1832853662 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3c800e620 con 0x7fd3d0115060 2024-09-13T06:11:45.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.591+0000 7fd3dd454640 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e36230 con 0x7fd3d0115060 2024-09-13T06:11:45.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.595+0000 7fd3dd454640 1 -- 172.21.15.194:0/1832853662 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3c800e620 con 0x7fd3d0115060 2024-09-13T06:11:45.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.595+0000 7fd3dd454640 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e36230 con 0x5628e0e36f90 2024-09-13T06:11:45.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.595+0000 7fd3ddc55640 1 -- 172.21.15.194:0/1832853662 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3d0112030 con 0x5628e0e36f90 2024-09-13T06:11:45.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.595+0000 7fd3ddc55640 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e36230 con 0x7fd3c8037040 2024-09-13T06:11:45.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.595+0000 7fd3de456640 1 -- 172.21.15.194:0/1832853662 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3d800a4d0 con 0x7fd3c8037040 2024-09-13T06:11:45.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.595+0000 7fd3de456640 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e36230 con 0x5628e0e325a0 2024-09-13T06:11:45.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.595+0000 7fd3de456640 1 -- 172.21.15.194:0/1832853662 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v35'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd3d800a4d0 con 0x5628e0e325a0 2024-09-13T06:11:45.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.595+0000 7fd3de456640 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e36230 con 0x7fd3d0115060 2024-09-13T06:11:45.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.595+0000 7fd3dd454640 1 -- 172.21.15.194:0/1832853662 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3c800e620 con 0x7fd3d0115060 2024-09-13T06:11:45.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.595+0000 7fd3e0145980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:11:45.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.595+0000 7fd3e0145980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:11:45.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.595+0000 7fd3e0145980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:11:45.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.595+0000 7fd3e0145980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:11:45.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.595+0000 7fd3e0145980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:11:45.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.595+0000 7fd3e0145980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:11:45.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.595+0000 7fd3e0145980 20 rados->read ofs=0 len=0 2024-09-13T06:11:45.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.595+0000 7fd3e0145980 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e3a340 con 0x5628e0e325a0 2024-09-13T06:11:45.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.595+0000 7fd3de456640 1 -- 172.21.15.194:0/1832853662 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd3d800a4d0 con 0x5628e0e325a0 2024-09-13T06:11:45.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.595+0000 7fd3e0145980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:45.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.595+0000 7fd3e0145980 20 rados->read ofs=0 len=0 2024-09-13T06:11:45.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.595+0000 7fd3e0145980 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e3abe0 con 0x5628e0e325a0 2024-09-13T06:11:45.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.595+0000 7fd3de456640 1 -- 172.21.15.194:0/1832853662 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd3d800a4d0 con 0x5628e0e325a0 2024-09-13T06:11:45.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.595+0000 7fd3e0145980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:11:45.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.595+0000 7fd3e0145980 20 rados->read ofs=0 len=0 2024-09-13T06:11:45.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.595+0000 7fd3e0145980 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e3a730 con 0x7fd3d0115060 2024-09-13T06:11:45.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.595+0000 7fd3dd454640 1 -- 172.21.15.194:0/1832853662 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd3c800e620 con 0x7fd3d0115060 2024-09-13T06:11:45.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.595+0000 7fd3e0145980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:11:45.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.595+0000 7fd3e0145980 20 zone default found 2024-09-13T06:11:45.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.595+0000 7fd3e0145980 4 Realm: () 2024-09-13T06:11:45.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.595+0000 7fd3e0145980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:11:45.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.595+0000 7fd3e0145980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:11:45.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.595+0000 7fd3e0145980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:11:45.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.595+0000 7fd3e0145980 20 zonegroup default 2024-09-13T06:11:45.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.595+0000 7fd3e0145980 20 rados->read ofs=0 len=0 2024-09-13T06:11:45.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.595+0000 7fd3e0145980 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e3b650 con 0x7fd3c8037040 2024-09-13T06:11:45.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.595+0000 7fd3de456640 1 -- 172.21.15.194:0/1832853662 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd3d800a4d0 con 0x7fd3c8037040 2024-09-13T06:11:45.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.595+0000 7fd3e0145980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:45.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.595+0000 7fd3e0145980 20 rados->read ofs=0 len=0 2024-09-13T06:11:45.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.595+0000 7fd3e0145980 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e3d0c0 con 0x5628e0e36f90 2024-09-13T06:11:45.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.595+0000 7fd3ddc55640 1 -- 172.21.15.194:0/1832853662 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd3d0112030 con 0x5628e0e36f90 2024-09-13T06:11:45.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.599+0000 7fd3e0145980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:45.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.599+0000 7fd3e0145980 20 rados->read ofs=0 len=0 2024-09-13T06:11:45.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.599+0000 7fd3e0145980 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e3d530 con 0x5628e0e36f90 2024-09-13T06:11:45.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.599+0000 7fd3ddc55640 1 -- 172.21.15.194:0/1832853662 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd3d0112030 con 0x5628e0e36f90 2024-09-13T06:11:45.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.599+0000 7fd3e0145980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:45.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.599+0000 7fd3e0145980 20 started sync module instance, tier type = 2024-09-13T06:11:45.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.599+0000 7fd3e0145980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:11:45.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.599+0000 7fd3e0145980 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e3c4d0 con 0x7fd3d0115060 2024-09-13T06:11:45.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.599+0000 7fd3dd454640 1 -- 172.21.15.194:0/1832853662 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(44 notify.0 [create] v35'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3c800e620 con 0x7fd3d0115060 2024-09-13T06:11:45.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.599+0000 7fd3e0145980 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94733571705024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e3c130 con 0x7fd3d0115060 2024-09-13T06:11:45.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.599+0000 7fd3e0145980 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e3e460 con 0x5628e0e325a0 2024-09-13T06:11:45.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.599+0000 7fd3dd454640 1 -- 172.21.15.194:0/1832853662 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94733571705024] v35'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3c800e620 con 0x7fd3d0115060 2024-09-13T06:11:45.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.599+0000 7fd3de456640 1 -- 172.21.15.194:0/1832853662 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v35'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3d800a4d0 con 0x5628e0e325a0 2024-09-13T06:11:45.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.599+0000 7fd3e0145980 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94733571710896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e3e880 con 0x5628e0e325a0 2024-09-13T06:11:45.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.599+0000 7fd3e0145980 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e3f130 con 0x5628e0e36f90 2024-09-13T06:11:45.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.603+0000 7fd3ddc55640 1 -- 172.21.15.194:0/1832853662 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v35'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3d0112030 con 0x5628e0e36f90 2024-09-13T06:11:45.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.603+0000 7fd3de456640 1 -- 172.21.15.194:0/1832853662 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94733571710896] v35'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3d800a4d0 con 0x5628e0e325a0 2024-09-13T06:11:45.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.603+0000 7fd3e0145980 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94733571713456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e3f9d0 con 0x5628e0e36f90 2024-09-13T06:11:45.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.603+0000 7fd3e0145980 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e3e3d0 con 0x7fd3d0115060 2024-09-13T06:11:45.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.607+0000 7fd3dd454640 1 -- 172.21.15.194:0/1832853662 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(50 notify.3 [create] v35'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3c800e620 con 0x7fd3d0115060 2024-09-13T06:11:45.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.607+0000 7fd3e0145980 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94733571719152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e409a0 con 0x7fd3d0115060 2024-09-13T06:11:45.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.607+0000 7fd3e0145980 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e41490 con 0x5628e0e325a0 2024-09-13T06:11:45.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.607+0000 7fd3ddc55640 1 -- 172.21.15.194:0/1832853662 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94733571713456] v35'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3d0112030 con 0x5628e0e36f90 2024-09-13T06:11:45.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.607+0000 7fd3de456640 1 -- 172.21.15.194:0/1832853662 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v35'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3d800a4d0 con 0x5628e0e325a0 2024-09-13T06:11:45.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.607+0000 7fd3e0145980 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94733571723104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e41450 con 0x5628e0e325a0 2024-09-13T06:11:45.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.607+0000 7fd3e0145980 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e41ea0 con 0x7fd3c8037040 2024-09-13T06:11:45.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.607+0000 7fd3dd454640 1 -- 172.21.15.194:0/1832853662 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94733571719152] v35'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3c800e620 con 0x7fd3d0115060 2024-09-13T06:11:45.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.611+0000 7fd3de456640 1 -- 172.21.15.194:0/1832853662 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94733571723104] v35'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3d800a4d0 con 0x5628e0e325a0 2024-09-13T06:11:45.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.611+0000 7fd3de456640 1 -- 172.21.15.194:0/1832853662 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(54 notify.5 [create] v35'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3d800a4d0 con 0x7fd3c8037040 2024-09-13T06:11:45.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.611+0000 7fd3e0145980 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94733571716384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e419f0 con 0x7fd3c8037040 2024-09-13T06:11:45.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.611+0000 7fd3e0145980 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e42740 con 0x7fd3c8037040 2024-09-13T06:11:45.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.611+0000 7fd3de456640 1 -- 172.21.15.194:0/1832853662 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(56 notify.6 [create] v35'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3d800a4d0 con 0x7fd3c8037040 2024-09-13T06:11:45.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.611+0000 7fd3e0145980 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94733571728016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e419f0 con 0x7fd3c8037040 2024-09-13T06:11:45.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.611+0000 7fd3e0145980 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e43180 con 0x7fd3c8037040 2024-09-13T06:11:45.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.611+0000 7fd3de456640 1 -- 172.21.15.194:0/1832853662 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94733571716384] v35'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3d800a4d0 con 0x7fd3c8037040 2024-09-13T06:11:45.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.615+0000 7fd3de456640 1 -- 172.21.15.194:0/1832853662 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94733571728016] v35'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3d800a4d0 con 0x7fd3c8037040 2024-09-13T06:11:45.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.615+0000 7fd3de456640 1 -- 172.21.15.194:0/1832853662 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(58 notify.7 [create] v35'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3d800a4d0 con 0x7fd3c8037040 2024-09-13T06:11:45.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.615+0000 7fd3e0145980 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94733571729072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e42cd0 con 0x7fd3c8037040 2024-09-13T06:11:45.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.615+0000 7fd3e0145980 20 add_watcher() i=0 2024-09-13T06:11:45.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.615+0000 7fd3e0145980 20 add_watcher() i=1 2024-09-13T06:11:45.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.615+0000 7fd3e0145980 20 add_watcher() i=2 2024-09-13T06:11:45.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.615+0000 7fd3e0145980 20 add_watcher() i=3 2024-09-13T06:11:45.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.615+0000 7fd3e0145980 20 add_watcher() i=4 2024-09-13T06:11:45.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.615+0000 7fd3e0145980 20 add_watcher() i=5 2024-09-13T06:11:45.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.615+0000 7fd3e0145980 20 add_watcher() i=6 2024-09-13T06:11:45.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.615+0000 7fd3de456640 1 -- 172.21.15.194:0/1832853662 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94733571729072] v35'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3d800a4d0 con 0x7fd3c8037040 2024-09-13T06:11:45.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.615+0000 7fd3e0145980 20 add_watcher() i=7 2024-09-13T06:11:45.620 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.615+0000 7fd3e0145980 2 all 8 watchers are set, enabling cache 2024-09-13T06:11:45.620 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.615+0000 7fd3e0145980 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e461b0 con 0x5628e0e325a0 2024-09-13T06:11:45.620 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.619+0000 7fd3de456640 1 -- 172.21.15.194:0/1832853662 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd3d800a4d0 con 0x5628e0e325a0 2024-09-13T06:11:45.620 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.619+0000 7fd3e0145980 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94733571730640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e435a0 con 0x5628e0e325a0 2024-09-13T06:11:45.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.619+0000 7fd3de456640 1 -- 172.21.15.194:0/1832853662 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94733571730640] v35'250 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd3d800a4d0 con 0x5628e0e325a0 2024-09-13T06:11:45.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.619+0000 7fd28f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:11:45.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.619+0000 7fd3e0145980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:11:45.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.619+0000 7fd3e0145980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:11:45.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.619+0000 7fd3e0145980 5 note: GC not initialized 2024-09-13T06:11:45.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.619+0000 7fd28e7fc640 20 reqs_thread_entry: start 2024-09-13T06:11:45.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.619+0000 7fd3e0145980 20 init_complete bucket index max shards: 11 2024-09-13T06:11:45.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.619+0000 7fd3e0145980 20 Filter name: none 2024-09-13T06:11:45.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.619+0000 7fd1fffff640 20 reqs_thread_entry: start 2024-09-13T06:11:45.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.619+0000 7fd3e0145980 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-09-13T06:11:45.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.619+0000 7fd3e0145980 20 rados->read ofs=0 len=0 2024-09-13T06:11:45.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.619+0000 7fd3e0145980 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:62 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e69770 con 0x5628e0e36f90 2024-09-13T06:11:45.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.619+0000 7fd3ddc55640 1 -- 172.21.15.194:0/1832853662 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(62 a_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 234+0+0 (crc 0 0 0) 0x7fd3d0112030 con 0x5628e0e36f90 2024-09-13T06:11:45.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.619+0000 7fd3e0145980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:45.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.619+0000 7fd3e0145980 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x0 2024-09-13T06:11:45.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.619+0000 7fd3e0145980 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-13T06:11:45.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.619+0000 7fd3e0145980 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : miss 2024-09-13T06:11:45.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.619+0000 7fd3e0145980 20 rados->read ofs=0 len=0 2024-09-13T06:11:45.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.619+0000 7fd3e0145980 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:63 8.15 8:afe09604:users.keys::true_admin_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e67f10 con 0x5628e0e36f90 2024-09-13T06:11:45.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.619+0000 7fd3ddc55640 1 -- 172.21.15.194:0/1832853662 <== osd.3 v2:172.21.15.194:6816/96632515 16 ==== osd_op_reply(63 true_admin_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 201+0+0 (crc 0 0 0) 0x7fd3d0112030 con 0x5628e0e36f90 2024-09-13T06:11:45.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.619+0000 7fd3e0145980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:45.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.619+0000 7fd3e0145980 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x0 2024-09-13T06:11:45.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.619+0000 7fd3e0145980 10 adding default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-13T06:11:45.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.619+0000 7fd3e0145980 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-09-13T06:11:45.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.619+0000 7fd3e0145980 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-09-13T06:11:45.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.619+0000 7fd3e0145980 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:64 8.14 8:2efb937b:users.uid::a_user:head [delete,create,call version.set in=58b,writefull 0~363 in=363b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e687b0 con 0x5628e0e36f90 2024-09-13T06:11:45.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.623+0000 7fd3ddc55640 1 -- 172.21.15.194:0/1832853662 <== osd.3 v2:172.21.15.194:6816/96632515 17 ==== osd_op_reply(64 a_user [delete,create,call,writefull 0~363] v35'1 uv1 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7fd3d0112030 con 0x5628e0e36f90 2024-09-13T06:11:45.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.623+0000 7fd3e0145980 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-09-13T06:11:45.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.623+0000 7fd3e0145980 10 moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-13T06:11:45.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.623+0000 7fd3e0145980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-09-13T06:11:45.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.623+0000 7fd3e0145980 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:65 7.15 7:a93a5511:::notify.2:head [notify cookie 94733571883776 in=554b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e6cd60 con 0x5628e0e36f90 2024-09-13T06:11:45.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.623+0000 7fd3ddc55640 1 -- 172.21.15.194:0/1832853662 <== osd.3 v2:172.21.15.194:6816/96632515 18 ==== watch-notify(notify (1) cookie 94733571713456 notify 150323855379 ret 0) ==== 584+0+0 (crc 0 0 0) 0x5628e0e691c0 con 0x5628e0e36f90 2024-09-13T06:11:45.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.623+0000 7fd2c17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855379 cookie 94733571713456 notifier 4857 bl.length()=542 2024-09-13T06:11:45.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.623+0000 7fd2c17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-09-13T06:11:45.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.623+0000 7fd2c17fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-13T06:11:45.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.623+0000 7fd3ddc55640 1 -- 172.21.15.194:0/1832853662 <== osd.3 v2:172.21.15.194:6816/96632515 19 ==== osd_op_reply(65 notify.2 [notify cookie 94733571883776 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd3d0112030 con 0x5628e0e36f90 2024-09-13T06:11:45.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.623+0000 7fd2c17fa640 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fd2a0003eb0 con 0x5628e0e36f90 2024-09-13T06:11:45.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.623+0000 7fd3ddc55640 1 -- 172.21.15.194:0/1832853662 <== osd.3 v2:172.21.15.194:6816/96632515 20 ==== osd_op_reply(66 notify.2 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3d0112030 con 0x5628e0e36f90 2024-09-13T06:11:45.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.623+0000 7fd3ddc55640 1 -- 172.21.15.194:0/1832853662 <== osd.3 v2:172.21.15.194:6816/96632515 21 ==== watch-notify(notify_complete (2) cookie 94733571883776 notify 150323855379 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5628e0e14570 con 0x5628e0e36f90 2024-09-13T06:11:45.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.623+0000 7fd3e0145980 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:67 8.15 8:afe09604:users.keys::true_admin_akey:head [delete,create,writefull 0~10 in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e68760 con 0x5628e0e36f90 2024-09-13T06:11:45.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.623+0000 7fd3ddc55640 1 -- 172.21.15.194:0/1832853662 <== osd.3 v2:172.21.15.194:6816/96632515 22 ==== osd_op_reply(67 true_admin_akey [delete,create,writefull 0~10] v35'3 uv3 ondisk = 0) ==== 243+0+0 (crc 0 0 0) 0x7fd3d0112030 con 0x5628e0e36f90 2024-09-13T06:11:45.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.623+0000 7fd3e0145980 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-09-13T06:11:45.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.623+0000 7fd3e0145980 10 moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-13T06:11:45.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.623+0000 7fd3e0145980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-09-13T06:11:45.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.623+0000 7fd3e0145980 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94733571883696 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e6cd60 con 0x7fd3c8037040 2024-09-13T06:11:45.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.623+0000 7fd3de456640 1 -- 172.21.15.194:0/1832853662 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== watch-notify(notify (1) cookie 94733571716384 notify 150323855408 ret 0) ==== 217+0+0 (crc 0 0 0) 0x7fd3d802d040 con 0x7fd3c8037040 2024-09-13T06:11:45.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.623+0000 7fd2c17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855408 cookie 94733571716384 notifier 4857 bl.length()=175 2024-09-13T06:11:45.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.623+0000 7fd2c17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-09-13T06:11:45.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.623+0000 7fd2c17fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-13T06:11:45.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.623+0000 7fd2c17fa640 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fd2a0003eb0 con 0x7fd3c8037040 2024-09-13T06:11:45.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.623+0000 7fd3de456640 1 -- 172.21.15.194:0/1832853662 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(68 notify.5 [notify cookie 94733571883696 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd3d800a4d0 con 0x7fd3c8037040 2024-09-13T06:11:45.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.627+0000 7fd3de456640 1 -- 172.21.15.194:0/1832853662 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3d800a4d0 con 0x7fd3c8037040 2024-09-13T06:11:45.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.627+0000 7fd3de456640 1 -- 172.21.15.194:0/1832853662 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== watch-notify(notify_complete (2) cookie 94733571883696 notify 150323855408 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fd3d801e040 con 0x7fd3c8037040 2024-09-13T06:11:45.630 INFO:teuthology.orchestra.run.smithi194.stdout:{"user_id":"a_user","display_name":"True Admin User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"a_user","access_key":"true_admin_akey","secret_key":"true_admin_skey","active":true,"create_date":"2024-09-13T06:11:45.624140Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","admin":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:11:45.624123Z","tags":[],"group_ids":[]} 2024-09-13T06:11:45.631 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.627+0000 7fd28f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:11:45.631 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.627+0000 7fd3e0145980 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94733571730640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e67570 con 0x5628e0e325a0 2024-09-13T06:11:45.631 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.627+0000 7fd3de456640 1 -- 172.21.15.194:0/1832853662 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94733571730640] v35'251 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd3d800a4d0 con 0x5628e0e325a0 2024-09-13T06:11:45.631 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.627+0000 7fd3e0145980 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94733571705024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e67570 con 0x7fd3d0115060 2024-09-13T06:11:45.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.627+0000 7fd3dd454640 1 -- 172.21.15.194:0/1832853662 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94733571705024] v35'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3c800e620 con 0x7fd3d0115060 2024-09-13T06:11:45.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.631+0000 7fd3e0145980 20 remove_watcher() i=0 2024-09-13T06:11:45.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.631+0000 7fd3e0145980 2 removed watcher, disabling cache 2024-09-13T06:11:45.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.631+0000 7fd3e0145980 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94733571710896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e3c8c0 con 0x5628e0e325a0 2024-09-13T06:11:45.634 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.631+0000 7fd3de456640 1 -- 172.21.15.194:0/1832853662 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94733571710896] v35'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3d800a4d0 con 0x5628e0e325a0 2024-09-13T06:11:45.634 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.631+0000 7fd3e0145980 20 remove_watcher() i=1 2024-09-13T06:11:45.634 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.631+0000 7fd3e0145980 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94733571713456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e67570 con 0x5628e0e36f90 2024-09-13T06:11:45.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.631+0000 7fd3ddc55640 1 -- 172.21.15.194:0/1832853662 <== osd.3 v2:172.21.15.194:6816/96632515 23 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94733571713456] v35'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3d0112030 con 0x5628e0e36f90 2024-09-13T06:11:45.636 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.631+0000 7fd3e0145980 20 remove_watcher() i=2 2024-09-13T06:11:45.636 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.631+0000 7fd3e0145980 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94733571719152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e3dfb0 con 0x7fd3d0115060 2024-09-13T06:11:45.637 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.635+0000 7fd3dd454640 1 -- 172.21.15.194:0/1832853662 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94733571719152] v35'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3c800e620 con 0x7fd3d0115060 2024-09-13T06:11:45.637 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.635+0000 7fd3e0145980 20 remove_watcher() i=3 2024-09-13T06:11:45.637 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.635+0000 7fd3e0145980 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94733571723104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e3c8c0 con 0x5628e0e325a0 2024-09-13T06:11:45.639 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.635+0000 7fd3de456640 1 -- 172.21.15.194:0/1832853662 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94733571723104] v35'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3d800a4d0 con 0x5628e0e325a0 2024-09-13T06:11:45.639 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.635+0000 7fd3e0145980 20 remove_watcher() i=4 2024-09-13T06:11:45.639 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.635+0000 7fd3e0145980 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94733571716384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e67570 con 0x7fd3c8037040 2024-09-13T06:11:45.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.639+0000 7fd3de456640 1 -- 172.21.15.194:0/1832853662 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94733571716384] v35'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3d800a4d0 con 0x7fd3c8037040 2024-09-13T06:11:45.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.639+0000 7fd3e0145980 20 remove_watcher() i=5 2024-09-13T06:11:45.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.639+0000 7fd3e0145980 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94733571728016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e3fff0 con 0x7fd3c8037040 2024-09-13T06:11:45.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.639+0000 7fd3de456640 1 -- 172.21.15.194:0/1832853662 <== osd.0 v2:172.21.15.120:6800/1923744619 20 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94733571728016] v35'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3d800a4d0 con 0x7fd3c8037040 2024-09-13T06:11:45.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.639+0000 7fd3e0145980 20 remove_watcher() i=6 2024-09-13T06:11:45.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.639+0000 7fd3e0145980 1 -- 172.21.15.194:0/1832853662 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94733571729072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5628e0e3dfb0 con 0x7fd3c8037040 2024-09-13T06:11:45.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.643+0000 7fd3de456640 1 -- 172.21.15.194:0/1832853662 <== osd.0 v2:172.21.15.120:6800/1923744619 21 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94733571729072] v35'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3d800a4d0 con 0x7fd3c8037040 2024-09-13T06:11:45.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.643+0000 7fd3e0145980 20 remove_watcher() i=7 2024-09-13T06:11:45.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.643+0000 7fd3e0145980 1 -- 172.21.15.194:0/1832853662 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fd3c8037040 msgr2=0x7fd3c8036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.643+0000 7fd3e0145980 1 --2- 172.21.15.194:0/1832853662 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fd3c8037040 0x7fd3c8036410 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:45.649 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.643+0000 7fd3e0145980 1 -- 172.21.15.194:0/1832853662 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5628e0e325a0 msgr2=0x5628e0e34a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.649 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.643+0000 7fd3e0145980 1 --2- 172.21.15.194:0/1832853662 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5628e0e325a0 0x5628e0e34a60 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:45.649 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.643+0000 7fd3e0145980 1 -- 172.21.15.194:0/1832853662 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fd3d0115060 msgr2=0x7fd3d00c8580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.649 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.643+0000 7fd3e0145980 1 --2- 172.21.15.194:0/1832853662 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fd3d0115060 0x7fd3d00c8580 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:45.649 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.643+0000 7fd3e0145980 1 -- 172.21.15.194:0/1832853662 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5628e0e36f90 msgr2=0x5628e0e39380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.649 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.643+0000 7fd3e0145980 1 --2- 172.21.15.194:0/1832853662 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5628e0e36f90 0x5628e0e39380 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:45.649 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.643+0000 7fd3e0145980 1 -- 172.21.15.194:0/1832853662 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fd2a8034650 msgr2=0x7fd2a8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.649 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.643+0000 7fd3e0145980 1 --2- 172.21.15.194:0/1832853662 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fd2a8034650 0x7fd2a8036b10 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x5628e0e06580 tx=0x7fd3c8010000 comp rx=0 tx=0).stop 2024-09-13T06:11:45.649 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.643+0000 7fd3e0145980 1 -- 172.21.15.194:0/1832853662 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628e0e205a0 msgr2=0x5628e0e27560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.649 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.643+0000 7fd3e0145980 1 --2- 172.21.15.194:0/1832853662 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628e0e205a0 0x5628e0e27560 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fd3d00ca8e0 tx=0x7fd3d00cef20 comp rx=0 tx=0).stop 2024-09-13T06:11:45.649 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.643+0000 7fd3de456640 1 -- 172.21.15.194:0/1832853662 reap_dead start 2024-09-13T06:11:45.649 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.643+0000 7fd3e0145980 1 -- 172.21.15.194:0/1832853662 shutdown_connections 2024-09-13T06:11:45.649 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.643+0000 7fd3e0145980 1 --2- 172.21.15.194:0/1832853662 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628e0e205a0 0x5628e0e27560 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:45.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.643+0000 7fd3e0145980 1 -- 172.21.15.194:0/1832853662 >> 172.21.15.194:0/1832853662 conn(0x5628e0e1c980 msgr2=0x5628e0e1aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:45.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.643+0000 7fd3e0145980 1 -- 172.21.15.194:0/1832853662 shutdown_connections 2024-09-13T06:11:45.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.643+0000 7fd3e0145980 1 -- 172.21.15.194:0/1832853662 wait complete. 2024-09-13T06:11:45.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.643+0000 7fd3e0145980 1 -- 172.21.15.194:0/993700122 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fd2b8034650 msgr2=0x7fd2b8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.643+0000 7fd3e0145980 1 --2- 172.21.15.194:0/993700122 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fd2b8034650 0x7fd2b8036b10 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd3c800bf60 tx=0x7fd3c800f000 comp rx=0 tx=0).stop 2024-09-13T06:11:45.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.643+0000 7fd3e0145980 1 -- 172.21.15.194:0/993700122 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628e0e13c10 msgr2=0x5628e0e14030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.643+0000 7fd3e0145980 1 --2- 172.21.15.194:0/993700122 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628e0e13c10 0x5628e0e14030 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fd3d00e1fb0 tx=0x7fd3d00b4610 comp rx=0 tx=0).stop 2024-09-13T06:11:45.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.643+0000 7fd3e0145980 1 -- 172.21.15.194:0/993700122 shutdown_connections 2024-09-13T06:11:45.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.643+0000 7fd3e0145980 1 --2- 172.21.15.194:0/993700122 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fd2b8034650 0x7fd2b8036b10 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:45.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.643+0000 7fd3e0145980 1 --2- 172.21.15.194:0/993700122 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628e0e13c10 0x5628e0e14030 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:45.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.643+0000 7fd3e0145980 1 -- 172.21.15.194:0/993700122 >> 172.21.15.194:0/993700122 conn(0x5628e0e08d60 msgr2=0x5628e0e0b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:45.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.643+0000 7fd3e0145980 1 -- 172.21.15.194:0/993700122 shutdown_connections 2024-09-13T06:11:45.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.643+0000 7fd3e0145980 1 -- 172.21.15.194:0/993700122 wait complete. 2024-09-13T06:11:45.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.643+0000 7fd3e0145980 1 -- 172.21.15.194:0/2539773583 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5628e0d041d0 msgr2=0x5628e0dfcd90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.643+0000 7fd3e0145980 1 --2- 172.21.15.194:0/2539773583 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5628e0d041d0 0x5628e0dfcd90 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:45.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.643+0000 7fd3e0145980 1 -- 172.21.15.194:0/2539773583 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5628e0e03650 msgr2=0x5628e0e05a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.643+0000 7fd3e0145980 1 --2- 172.21.15.194:0/2539773583 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5628e0e03650 0x5628e0e05a40 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:45.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.643+0000 7fd3e0145980 1 -- 172.21.15.194:0/2539773583 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5628e0dff750 msgr2=0x5628e0e01b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.643+0000 7fd3e0145980 1 --2- 172.21.15.194:0/2539773583 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5628e0dff750 0x5628e0e01b40 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:45.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.643+0000 7fd3e0145980 1 -- 172.21.15.194:0/2539773583 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fd2c4034650 msgr2=0x7fd2c4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.643+0000 7fd3e0145980 1 --2- 172.21.15.194:0/2539773583 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fd2c4034650 0x7fd2c4036b10 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd3c8000f70 tx=0x7fd3c80012c0 comp rx=0 tx=0).stop 2024-09-13T06:11:45.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.643+0000 7fd3e0145980 1 -- 172.21.15.194:0/2539773583 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628e0d03880 msgr2=0x5628e0df5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.643+0000 7fd3e0145980 1 --2- 172.21.15.194:0/2539773583 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5628e0d03880 0x5628e0df5e00 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fd3d00030b0 tx=0x7fd3d0018020 comp rx=0 tx=0).stop 2024-09-13T06:11:45.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.643+0000 7fd3de456640 1 -- 172.21.15.194:0/2539773583 reap_dead start 2024-09-13T06:11:45.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.647+0000 7fd3e0145980 1 -- 172.21.15.194:0/2539773583 shutdown_connections 2024-09-13T06:11:45.652 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.647+0000 7fd3e0145980 1 -- 172.21.15.194:0/2539773583 >> 172.21.15.194:0/2539773583 conn(0x5628e0c771d0 msgr2=0x5628e0de9380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:45.652 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.647+0000 7fd3e0145980 1 -- 172.21.15.194:0/2539773583 shutdown_connections 2024-09-13T06:11:45.652 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.647+0000 7fd3e0145980 1 -- 172.21.15.194:0/2539773583 wait complete. 2024-09-13T06:11:45.659 DEBUG:tasks.util.rgw: json result: {'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-09-13T06:11:45.624140Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:11:45.624123Z', 'tags': [], 'group_ids': []} 2024-09-13T06:11:45.659 ERROR:root:{'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-09-13T06:11:45.624140Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:11:45.624123Z', 'tags': [], 'group_ids': []} 2024-09-13T06:11:45.659 ERROR:root:0 2024-09-13T06:11:45.660 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T06:11:45.673 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T06:11:45.673 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'a_user'] 2024-09-13T06:11:45.674 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'a_user'] 2024-09-13T06:11:45.674 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid a_user 2024-09-13T06:11:45.704 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:11:45.704 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:11:45.705 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.703+0000 7f843c7aa980 1 Processor -- start 2024-09-13T06:11:45.705 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.703+0000 7f843c7aa980 1 -- start start 2024-09-13T06:11:45.705 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.703+0000 7f843c7aa980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x560cdf9a8a90 0x560cdf9aae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.703+0000 7f843c7aa980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560cdf82cae0 con 0x560cdf918ac0 2024-09-13T06:11:45.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.703+0000 7f843c7aa980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x560cdf850e30 con 0x560cdf9a8a90 2024-09-13T06:11:45.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.703+0000 7f8439ab9640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x560cdf9a8a90 0x560cdf9aae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.703+0000 7f843a2ba640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x560cdf918ac0 0x560cdf9a7370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:58406/0 (socket says 172.21.15.194:58406) 2024-09-13T06:11:45.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.703+0000 7f843a2ba640 1 -- 172.21.15.194:0/848979501 learned_addr learned my addr 172.21.15.194:0/848979501 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-09-13T06:11:45.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.703+0000 7f8439ab9640 1 -- 172.21.15.194:0/848979501 >> v1:172.21.15.120:6789/0 conn(0x560cdf918ac0 legacy=0x560cdf9a7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.703+0000 7f8439ab9640 1 -- 172.21.15.194:0/848979501 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560cdf9ac3d0 con 0x560cdf9a8a90 2024-09-13T06:11:45.709 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.707+0000 7f8439ab9640 1 --2- 172.21.15.194:0/848979501 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560cdf9a8a90 0x560cdf9aae80 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f843000a480 tx=0x7f843001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9af4843fea90f06 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.709 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.707+0000 7f84392b8640 1 -- 172.21.15.194:0/848979501 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84300b0070 con 0x560cdf9a8a90 2024-09-13T06:11:45.709 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.707+0000 7f84392b8640 1 -- 172.21.15.194:0/848979501 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84300ab540 con 0x560cdf9a8a90 2024-09-13T06:11:45.709 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.707+0000 7f84392b8640 1 -- 172.21.15.194:0/848979501 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84300ab840 con 0x560cdf9a8a90 2024-09-13T06:11:45.710 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.707+0000 7f843c7aa980 1 -- 172.21.15.194:0/848979501 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560cdf9a8a90 msgr2=0x560cdf9aae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.710 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.707+0000 7f843c7aa980 1 --2- 172.21.15.194:0/848979501 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560cdf9a8a90 0x560cdf9aae80 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f843000a480 tx=0x7f843001b280 comp rx=0 tx=0).stop 2024-09-13T06:11:45.710 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.707+0000 7f843c7aa980 1 -- 172.21.15.194:0/848979501 shutdown_connections 2024-09-13T06:11:45.710 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.707+0000 7f843c7aa980 1 --2- 172.21.15.194:0/848979501 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560cdf9a8a90 0x560cdf9aae80 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:45.710 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.707+0000 7f843c7aa980 1 -- 172.21.15.194:0/848979501 >> 172.21.15.194:0/848979501 conn(0x560cdf99f060 msgr2=0x560cdf9a1480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:45.710 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.707+0000 7f843c7aa980 1 -- 172.21.15.194:0/848979501 shutdown_connections 2024-09-13T06:11:45.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.707+0000 7f843c7aa980 1 -- 172.21.15.194:0/848979501 wait complete. 2024-09-13T06:11:45.725 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.723+0000 7f843c7aa980 1 Processor -- start 2024-09-13T06:11:45.725 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.723+0000 7f843c7aa980 1 -- start start 2024-09-13T06:11:45.725 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.723+0000 7f843c7aa980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560cdf918ac0 0x560cdfa91ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.725 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.723+0000 7f843c7aa980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x560cdf852200 con 0x560cdf918ac0 2024-09-13T06:11:45.726 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.723+0000 7f843a2ba640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560cdf918ac0 0x560cdfa91ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.726 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.723+0000 7f843a2ba640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560cdf918ac0 0x560cdfa91ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45200/0 (socket says 172.21.15.194:45200) 2024-09-13T06:11:45.726 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.723+0000 7f843a2ba640 1 -- 172.21.15.194:0/2514120383 learned_addr learned my addr 172.21.15.194:0/2514120383 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:45.726 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.723+0000 7f843a2ba640 1 -- 172.21.15.194:0/2514120383 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560cdfa922b0 con 0x560cdf918ac0 2024-09-13T06:11:45.726 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.723+0000 7f843a2ba640 1 --2- 172.21.15.194:0/2514120383 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560cdf918ac0 0x560cdfa91ce0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f842c001e20 tx=0x7f842c00b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72ddf5d248f5846b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.728 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.723+0000 7f8328608640 1 -- 172.21.15.194:0/2514120383 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f842c012020 con 0x560cdf918ac0 2024-09-13T06:11:45.728 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.723+0000 7f8328608640 1 -- 172.21.15.194:0/2514120383 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f842c00e7c0 con 0x560cdf918ac0 2024-09-13T06:11:45.728 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.723+0000 7f8328608640 1 -- 172.21.15.194:0/2514120383 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f842c00eb00 con 0x560cdf918ac0 2024-09-13T06:11:45.728 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.723+0000 7f843c7aa980 1 -- 172.21.15.194:0/2514120383 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560cdf918ac0 msgr2=0x560cdfa91ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.728 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.723+0000 7f843c7aa980 1 --2- 172.21.15.194:0/2514120383 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560cdf918ac0 0x560cdfa91ce0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f842c001e20 tx=0x7f842c00b790 comp rx=0 tx=0).stop 2024-09-13T06:11:45.728 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.723+0000 7f843c7aa980 1 -- 172.21.15.194:0/2514120383 shutdown_connections 2024-09-13T06:11:45.728 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.723+0000 7f843c7aa980 1 --2- 172.21.15.194:0/2514120383 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560cdf918ac0 0x560cdfa91ce0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:45.728 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.723+0000 7f843c7aa980 1 -- 172.21.15.194:0/2514120383 >> 172.21.15.194:0/2514120383 conn(0x560cdf99f060 msgr2=0x560cdfa8d910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:45.728 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.723+0000 7f843c7aa980 1 -- 172.21.15.194:0/2514120383 shutdown_connections 2024-09-13T06:11:45.728 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.723+0000 7f843c7aa980 1 -- 172.21.15.194:0/2514120383 wait complete. 2024-09-13T06:11:45.728 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.727+0000 7f843c7aa980 1 Processor -- start 2024-09-13T06:11:45.729 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.727+0000 7f843c7aa980 1 -- start start 2024-09-13T06:11:45.729 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.727+0000 7f843c7aa980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560cdf918ac0 0x560cdfa99050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.729 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.727+0000 7f843c7aa980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x560cdf9abe10 con 0x560cdf918ac0 2024-09-13T06:11:45.730 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.727+0000 7f843a2ba640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560cdf918ac0 0x560cdfa99050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.730 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.727+0000 7f843a2ba640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560cdf918ac0 0x560cdfa99050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45206/0 (socket says 172.21.15.194:45206) 2024-09-13T06:11:45.730 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.727+0000 7f843a2ba640 1 -- 172.21.15.194:0/3221619340 learned_addr learned my addr 172.21.15.194:0/3221619340 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:45.730 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.727+0000 7f843a2ba640 1 -- 172.21.15.194:0/3221619340 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560cdfa99590 con 0x560cdf918ac0 2024-09-13T06:11:45.730 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.727+0000 7f843a2ba640 1 --2- 172.21.15.194:0/3221619340 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560cdf918ac0 0x560cdfa99050 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f842c001e20 tx=0x7f842c000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.730 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.727+0000 7f8326e05640 1 -- 172.21.15.194:0/3221619340 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f842c012030 con 0x560cdf918ac0 2024-09-13T06:11:45.731 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.727+0000 7f8326e05640 1 -- 172.21.15.194:0/3221619340 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f842c001480 con 0x560cdf918ac0 2024-09-13T06:11:45.731 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.727+0000 7f843c7aa980 1 -- 172.21.15.194:0/3221619340 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560cdfa99820 con 0x560cdf918ac0 2024-09-13T06:11:45.731 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.727+0000 7f8326e05640 1 -- 172.21.15.194:0/3221619340 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f842c01a940 con 0x560cdf918ac0 2024-09-13T06:11:45.731 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.727+0000 7f843c7aa980 1 -- 172.21.15.194:0/3221619340 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560cdfa9c500 con 0x560cdf918ac0 2024-09-13T06:11:45.733 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.727+0000 7f8326e05640 1 -- 172.21.15.194:0/3221619340 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f842c015020 con 0x560cdf918ac0 2024-09-13T06:11:45.733 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.727+0000 7f8326e05640 1 --2- 172.21.15.194:0/3221619340 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f83200346a0 0x7f8320036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.733 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.727+0000 7f8326e05640 1 -- 172.21.15.194:0/3221619340 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f842c020030 con 0x560cdf918ac0 2024-09-13T06:11:45.733 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.727+0000 7f8439ab9640 1 --2- 172.21.15.194:0/3221619340 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f83200346a0 0x7f8320036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.733 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.727+0000 7f843c7aa980 1 --2- 172.21.15.194:0/3221619340 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x560cdf9a8a90 0x560cdfa9ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.733 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.727+0000 7f843c7aa980 1 -- 172.21.15.194:0/3221619340 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560cdfaa0600 con 0x560cdf9a8a90 2024-09-13T06:11:45.733 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.727+0000 7f843aabb640 1 --2- 172.21.15.194:0/3221619340 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x560cdf9a8a90 0x560cdfa9ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.734 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.731+0000 7f8439ab9640 1 --2- 172.21.15.194:0/3221619340 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f83200346a0 0x7f8320036b60 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f84300ad000 tx=0x7f84300a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.734 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.731+0000 7f843aabb640 1 --2- 172.21.15.194:0/3221619340 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x560cdf9a8a90 0x560cdfa9ffe0 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.734 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.731+0000 7f843aabb640 1 -- 172.21.15.194:0/3221619340 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f843400a4d0 con 0x560cdf9a8a90 2024-09-13T06:11:45.734 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.731+0000 7f843c7aa980 1 -- 172.21.15.194:0/3221619340 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560cdfa9d720 con 0x560cdf9a8a90 2024-09-13T06:11:45.734 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.731+0000 7f843aabb640 1 -- 172.21.15.194:0/3221619340 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f843400a4d0 con 0x560cdf9a8a90 2024-09-13T06:11:45.734 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.731+0000 7f843c7aa980 1 --2- 172.21.15.194:0/3221619340 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x560cdfaa2950 0x560cdfaa4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.734 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.731+0000 7f843c7aa980 1 -- 172.21.15.194:0/3221619340 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560cdfaa5430 con 0x560cdfaa2950 2024-09-13T06:11:45.734 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.731+0000 7f843a2ba640 1 --2- 172.21.15.194:0/3221619340 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x560cdfaa2950 0x560cdfaa4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.734 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.731+0000 7f843a2ba640 1 --2- 172.21.15.194:0/3221619340 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x560cdfaa2950 0x560cdfaa4d40 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.736 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.731+0000 7f843a2ba640 1 -- 172.21.15.194:0/3221619340 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f842c008030 con 0x560cdfaa2950 2024-09-13T06:11:45.736 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.731+0000 7f843c7aa980 1 -- 172.21.15.194:0/3221619340 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560cdfaa17f0 con 0x560cdf9a8a90 2024-09-13T06:11:45.736 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.731+0000 7f843aabb640 1 -- 172.21.15.194:0/3221619340 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f843400a4d0 con 0x560cdf9a8a90 2024-09-13T06:11:45.736 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.731+0000 7f843c7aa980 1 --2- 172.21.15.194:0/3221619340 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x560cdfaa6890 0x560cdfaa8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.736 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.731+0000 7f843c7aa980 1 -- 172.21.15.194:0/3221619340 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560cdfaa93c0 con 0x560cdfaa6890 2024-09-13T06:11:45.736 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.731+0000 7f8439ab9640 1 --2- 172.21.15.194:0/3221619340 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x560cdfaa6890 0x560cdfaa8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.736 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.731+0000 7f8439ab9640 1 --2- 172.21.15.194:0/3221619340 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x560cdfaa6890 0x560cdfaa8c80 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.736 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.731+0000 7f8439ab9640 1 -- 172.21.15.194:0/3221619340 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f84300b3040 con 0x560cdfaa6890 2024-09-13T06:11:45.736 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.731+0000 7f843c7aa980 1 Processor -- start 2024-09-13T06:11:45.737 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.731+0000 7f843c7aa980 1 -- start start 2024-09-13T06:11:45.737 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.731+0000 7f843c7aa980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560cdfab6e90 0x560cdfab72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.737 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.731+0000 7f843c7aa980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x560cdf8ab800 con 0x560cdfab6e90 2024-09-13T06:11:45.737 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.731+0000 7f843a2ba640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560cdfab6e90 0x560cdfab72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.737 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.731+0000 7f843a2ba640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560cdfab6e90 0x560cdfab72b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45222/0 (socket says 172.21.15.194:45222) 2024-09-13T06:11:45.737 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.731+0000 7f843a2ba640 1 -- 172.21.15.194:0/2316687653 learned_addr learned my addr 172.21.15.194:0/2316687653 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:45.737 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.735+0000 7f843a2ba640 1 -- 172.21.15.194:0/2316687653 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560cdfab77f0 con 0x560cdfab6e90 2024-09-13T06:11:45.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.735+0000 7f843a2ba640 1 --2- 172.21.15.194:0/2316687653 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560cdfab6e90 0x560cdfab72b0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f842c01a740 tx=0x7f842c016470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.735+0000 7f831ffff640 1 -- 172.21.15.194:0/2316687653 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f842c041bb0 con 0x560cdfab6e90 2024-09-13T06:11:45.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.735+0000 7f831ffff640 1 -- 172.21.15.194:0/2316687653 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f842c041d50 con 0x560cdfab6e90 2024-09-13T06:11:45.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.735+0000 7f843c7aa980 1 -- 172.21.15.194:0/2316687653 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560cdfab7a80 con 0x560cdfab6e90 2024-09-13T06:11:45.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.735+0000 7f831ffff640 1 -- 172.21.15.194:0/2316687653 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f842c042030 con 0x560cdfab6e90 2024-09-13T06:11:45.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.735+0000 7f843c7aa980 1 -- 172.21.15.194:0/2316687653 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560cdfab7a80 con 0x560cdfab6e90 2024-09-13T06:11:45.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.735+0000 7f831ffff640 1 -- 172.21.15.194:0/2316687653 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f842c009070 con 0x560cdfab6e90 2024-09-13T06:11:45.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.735+0000 7f831ffff640 1 --2- 172.21.15.194:0/2316687653 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8314034650 0x7f8314036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.735+0000 7f831ffff640 1 -- 172.21.15.194:0/2316687653 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f842c005050 con 0x560cdfab6e90 2024-09-13T06:11:45.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.735+0000 7f8439ab9640 1 --2- 172.21.15.194:0/2316687653 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8314034650 0x7f8314036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.735+0000 7f843c7aa980 1 Processor -- start 2024-09-13T06:11:45.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.735+0000 7f843c7aa980 1 -- start start 2024-09-13T06:11:45.740 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.735+0000 7f8439ab9640 1 --2- 172.21.15.194:0/2316687653 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8314034650 0x7f8314036b10 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x560cdfaa0ad0 tx=0x7f8430005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.740 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.735+0000 7f843c7aa980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560cdfac3610 0x560cdfac39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.740 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.735+0000 7f843c7aa980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x560cdfa92630 con 0x560cdfac3610 2024-09-13T06:11:45.741 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.735+0000 7f843a2ba640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560cdfac3610 0x560cdfac39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.742 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.735+0000 7f843a2ba640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560cdfac3610 0x560cdfac39f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45238/0 (socket says 172.21.15.194:45238) 2024-09-13T06:11:45.742 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.735+0000 7f843a2ba640 1 -- 172.21.15.194:0/2011523032 learned_addr learned my addr 172.21.15.194:0/2011523032 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:45.742 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.735+0000 7f843a2ba640 1 -- 172.21.15.194:0/2011523032 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560cdfac3fc0 con 0x560cdfac3610 2024-09-13T06:11:45.742 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.739+0000 7f843a2ba640 1 --2- 172.21.15.194:0/2011523032 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560cdfac3610 0x560cdfac39f0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f842c0413b0 tx=0x7f842c041ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62267ba290659165 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.742 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.739+0000 7f831dffb640 1 -- 172.21.15.194:0/2011523032 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f842c0393c0 con 0x560cdfac3610 2024-09-13T06:11:45.742 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.739+0000 7f831dffb640 1 -- 172.21.15.194:0/2011523032 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f842c02d820 con 0x560cdfac3610 2024-09-13T06:11:45.742 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.739+0000 7f831dffb640 1 -- 172.21.15.194:0/2011523032 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f842c03ad60 con 0x560cdfac3610 2024-09-13T06:11:45.742 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.739+0000 7f843c7aa980 1 -- 172.21.15.194:0/2011523032 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560cdfac3610 msgr2=0x560cdfac39f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.742 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.739+0000 7f843c7aa980 1 --2- 172.21.15.194:0/2011523032 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560cdfac3610 0x560cdfac39f0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f842c0413b0 tx=0x7f842c041ad0 comp rx=0 tx=0).stop 2024-09-13T06:11:45.742 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.739+0000 7f843c7aa980 1 -- 172.21.15.194:0/2011523032 shutdown_connections 2024-09-13T06:11:45.742 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.739+0000 7f843c7aa980 1 --2- 172.21.15.194:0/2011523032 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560cdfac3610 0x560cdfac39f0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:45.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.739+0000 7f843c7aa980 1 -- 172.21.15.194:0/2011523032 >> 172.21.15.194:0/2011523032 conn(0x560cdfabf9f0 msgr2=0x560cdfabdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:45.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.739+0000 7f843c7aa980 1 -- 172.21.15.194:0/2011523032 shutdown_connections 2024-09-13T06:11:45.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.739+0000 7f843c7aa980 1 -- 172.21.15.194:0/2011523032 wait complete. 2024-09-13T06:11:45.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.739+0000 7f843c7aa980 1 Processor -- start 2024-09-13T06:11:45.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.739+0000 7f843c7aa980 1 -- start start 2024-09-13T06:11:45.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.739+0000 7f843c7aa980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560cdfac3610 0x560cdfaca790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.739+0000 7f843c7aa980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x560cdfac4460 con 0x560cdfac3610 2024-09-13T06:11:45.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.739+0000 7f843a2ba640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560cdfac3610 0x560cdfaca790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.739+0000 7f843a2ba640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560cdfac3610 0x560cdfaca790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45242/0 (socket says 172.21.15.194:45242) 2024-09-13T06:11:45.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.739+0000 7f843a2ba640 1 -- 172.21.15.194:0/2498507463 learned_addr learned my addr 172.21.15.194:0/2498507463 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:45.745 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.739+0000 7f843a2ba640 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560cdfacacd0 con 0x560cdfac3610 2024-09-13T06:11:45.745 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.739+0000 7f843a2ba640 1 --2- 172.21.15.194:0/2498507463 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560cdfac3610 0x560cdfaca790 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f842c0413b0 tx=0x7f842c034f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.745 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.739+0000 7f830bfff640 1 -- 172.21.15.194:0/2498507463 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f842c04c440 con 0x560cdfac3610 2024-09-13T06:11:45.745 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.739+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560cdfacacd0 con 0x560cdfac3610 2024-09-13T06:11:45.745 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.739+0000 7f830bfff640 1 -- 172.21.15.194:0/2498507463 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f842c011a80 con 0x560cdfac3610 2024-09-13T06:11:45.745 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.739+0000 7f830bfff640 1 -- 172.21.15.194:0/2498507463 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f842c04c5e0 con 0x560cdfac3610 2024-09-13T06:11:45.745 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.739+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560cdfacacd0 con 0x560cdfac3610 2024-09-13T06:11:45.745 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.743+0000 7f830bfff640 1 -- 172.21.15.194:0/2498507463 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f842c0489a0 con 0x560cdfac3610 2024-09-13T06:11:45.746 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.743+0000 7f830bfff640 1 --2- 172.21.15.194:0/2498507463 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8304034650 0x7f8304036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.746 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.743+0000 7f830bfff640 1 -- 172.21.15.194:0/2498507463 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f842c013650 con 0x560cdfac3610 2024-09-13T06:11:45.746 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.743+0000 7f8439ab9640 1 --2- 172.21.15.194:0/2498507463 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8304034650 0x7f8304036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.746 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.743+0000 7f843c7aa980 20 rados->read ofs=0 len=0 2024-09-13T06:11:45.746 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.743+0000 7f843c7aa980 1 --2- 172.21.15.194:0/2498507463 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x560cdfad5870 0x560cdfad7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.746 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.743+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560cdfad8480 con 0x560cdfad5870 2024-09-13T06:11:45.746 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.743+0000 7f843aabb640 1 --2- 172.21.15.194:0/2498507463 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x560cdfad5870 0x560cdfad7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.750 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.743+0000 7f8439ab9640 1 --2- 172.21.15.194:0/2498507463 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8304034650 0x7f8304036b10 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8430000c10 tx=0x7f84300b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.750 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.743+0000 7f843aabb640 1 --2- 172.21.15.194:0/2498507463 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x560cdfad5870 0x560cdfad7d30 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.750 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.743+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f843400a4d0 con 0x560cdfad5870 2024-09-13T06:11:45.750 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.743+0000 7f843c7aa980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:45.750 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.743+0000 7f843c7aa980 20 realm 2024-09-13T06:11:45.750 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.743+0000 7f843c7aa980 20 rados->read ofs=0 len=0 2024-09-13T06:11:45.750 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.743+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560cdfad8890 con 0x560cdfad5870 2024-09-13T06:11:45.750 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.743+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f843400a4d0 con 0x560cdfad5870 2024-09-13T06:11:45.750 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.743+0000 7f843c7aa980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:45.750 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.743+0000 7f843c7aa980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:11:45.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.743+0000 7f843c7aa980 20 rados->read ofs=0 len=0 2024-09-13T06:11:45.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.743+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560cdfad9160 con 0x560cdfad5870 2024-09-13T06:11:45.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.743+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f843400a4d0 con 0x560cdfad5870 2024-09-13T06:11:45.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.743+0000 7f843c7aa980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:45.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.743+0000 7f843c7aa980 20 rados->read ofs=0 len=0 2024-09-13T06:11:45.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.743+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560cdfad9500 con 0x560cdfad5870 2024-09-13T06:11:45.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.743+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f843400a4d0 con 0x560cdfad5870 2024-09-13T06:11:45.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.743+0000 7f843c7aa980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:11:45.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.743+0000 7f843c7aa980 20 rados->read ofs=0 len=0 2024-09-13T06:11:45.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.743+0000 7f843c7aa980 1 --2- 172.21.15.194:0/2498507463 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x560cdfada260 0x560cdfadc650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.743+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560cdfadcc60 con 0x560cdfada260 2024-09-13T06:11:45.752 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.743+0000 7f843a2ba640 1 --2- 172.21.15.194:0/2498507463 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x560cdfada260 0x560cdfadc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.752 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.743+0000 7f843a2ba640 1 --2- 172.21.15.194:0/2498507463 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x560cdfada260 0x560cdfadc650 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.752 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.747+0000 7f843a2ba640 1 -- 172.21.15.194:0/2498507463 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f842c008030 con 0x560cdfada260 2024-09-13T06:11:45.752 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.747+0000 7f843c7aa980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:11:45.752 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.747+0000 7f843c7aa980 20 searching for the correct realm 2024-09-13T06:11:45.752 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.747+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560cdfade530 con 0x560cdfada260 2024-09-13T06:11:45.752 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.747+0000 7f843a2ba640 1 -- 172.21.15.194:0/2498507463 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f842c008030 con 0x560cdfada260 2024-09-13T06:11:45.752 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.747+0000 7f843a2ba640 1 --2- 172.21.15.194:0/2498507463 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f842c017050 0x7f842c013970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.752 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.747+0000 7f843a2ba640 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560cdfade530 con 0x7f842c017050 2024-09-13T06:11:45.752 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.747+0000 7f8439ab9640 1 --2- 172.21.15.194:0/2498507463 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f842c017050 0x7f842c013970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.752 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.747+0000 7f8439ab9640 1 --2- 172.21.15.194:0/2498507463 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f842c017050 0x7f842c013970 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.752 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.747+0000 7f8439ab9640 1 -- 172.21.15.194:0/2498507463 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f84300c9030 con 0x7f842c017050 2024-09-13T06:11:45.752 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.747+0000 7f8439ab9640 1 --2- 172.21.15.194:0/2498507463 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f84300dc040 0x7f84300dd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.753 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.747+0000 7f8439ab9640 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560cdfade530 con 0x7f84300dc040 2024-09-13T06:11:45.753 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.747+0000 7f843aabb640 1 --2- 172.21.15.194:0/2498507463 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f84300dc040 0x7f84300dd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.753 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.747+0000 7f843aabb640 1 --2- 172.21.15.194:0/2498507463 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f84300dc040 0x7f84300dd430 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.756 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.747+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f843400a4d0 con 0x7f84300dc040 2024-09-13T06:11:45.756 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.747+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560cdfad9500 con 0x560cdfad5870 2024-09-13T06:11:45.756 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.747+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f843400a4d0 con 0x560cdfad5870 2024-09-13T06:11:45.756 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.747+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560cdfad9500 con 0x560cdfad5870 2024-09-13T06:11:45.756 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.747+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f843400a4d0 con 0x560cdfad5870 2024-09-13T06:11:45.757 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.747+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560cdfad9500 con 0x7f84300dc040 2024-09-13T06:11:45.757 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.747+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f843400a4d0 con 0x7f84300dc040 2024-09-13T06:11:45.757 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.747+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560cdfad9500 con 0x7f84300dc040 2024-09-13T06:11:45.757 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.751+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f843400a4d0 con 0x7f84300dc040 2024-09-13T06:11:45.757 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.751+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560cdfad9500 con 0x7f842c017050 2024-09-13T06:11:45.757 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.751+0000 7f8439ab9640 1 -- 172.21.15.194:0/2498507463 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84300c9030 con 0x7f842c017050 2024-09-13T06:11:45.757 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.751+0000 7f8439ab9640 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560cdfad9500 con 0x560cdfada260 2024-09-13T06:11:45.757 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.751+0000 7f843a2ba640 1 -- 172.21.15.194:0/2498507463 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f842c008030 con 0x560cdfada260 2024-09-13T06:11:45.757 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.751+0000 7f843a2ba640 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560cdfad9500 con 0x560cdfad5870 2024-09-13T06:11:45.757 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.751+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f843400a4d0 con 0x560cdfad5870 2024-09-13T06:11:45.757 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.751+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560cdfad9500 con 0x7f84300dc040 2024-09-13T06:11:45.757 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.751+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f843400a4d0 con 0x7f84300dc040 2024-09-13T06:11:45.757 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.751+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560cdfad9500 con 0x560cdfad5870 2024-09-13T06:11:45.758 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.751+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f843400a4d0 con 0x560cdfad5870 2024-09-13T06:11:45.758 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.751+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560cdfad9500 con 0x7f842c017050 2024-09-13T06:11:45.758 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.751+0000 7f8439ab9640 1 -- 172.21.15.194:0/2498507463 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f84300c9030 con 0x7f842c017050 2024-09-13T06:11:45.758 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.751+0000 7f8439ab9640 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560cdfad9500 con 0x560cdfada260 2024-09-13T06:11:45.758 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.751+0000 7f843a2ba640 1 -- 172.21.15.194:0/2498507463 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f842c008030 con 0x560cdfada260 2024-09-13T06:11:45.758 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.751+0000 7f843a2ba640 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560cdfad9500 con 0x560cdfada260 2024-09-13T06:11:45.758 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.751+0000 7f843a2ba640 1 -- 172.21.15.194:0/2498507463 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f842c008030 con 0x560cdfada260 2024-09-13T06:11:45.758 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.751+0000 7f843a2ba640 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560cdfad9500 con 0x7f84300dc040 2024-09-13T06:11:45.758 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.751+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f843400a4d0 con 0x7f84300dc040 2024-09-13T06:11:45.758 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.751+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560cdfad9500 con 0x560cdfada260 2024-09-13T06:11:45.758 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.755+0000 7f843a2ba640 1 -- 172.21.15.194:0/2498507463 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f842c008030 con 0x560cdfada260 2024-09-13T06:11:45.758 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.755+0000 7f843a2ba640 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560cdfad9500 con 0x560cdfada260 2024-09-13T06:11:45.759 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.755+0000 7f843a2ba640 1 -- 172.21.15.194:0/2498507463 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f842c008030 con 0x560cdfada260 2024-09-13T06:11:45.759 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.755+0000 7f843a2ba640 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560cdfad9500 con 0x560cdfad5870 2024-09-13T06:11:45.759 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.755+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f843400a4d0 con 0x560cdfad5870 2024-09-13T06:11:45.759 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.755+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560cdfad9500 con 0x560cdfad5870 2024-09-13T06:11:45.764 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.755+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v35'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f843400a4d0 con 0x560cdfad5870 2024-09-13T06:11:45.764 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.755+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560cdfad9500 con 0x7f842c017050 2024-09-13T06:11:45.764 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.755+0000 7f8439ab9640 1 -- 172.21.15.194:0/2498507463 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84300c9030 con 0x7f842c017050 2024-09-13T06:11:45.764 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.755+0000 7f8439ab9640 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560cdfad9500 con 0x560cdfada260 2024-09-13T06:11:45.764 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.755+0000 7f843a2ba640 1 -- 172.21.15.194:0/2498507463 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f842c008030 con 0x560cdfada260 2024-09-13T06:11:45.764 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.755+0000 7f843a2ba640 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560cdfad9500 con 0x7f842c017050 2024-09-13T06:11:45.765 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.755+0000 7f8439ab9640 1 -- 172.21.15.194:0/2498507463 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84300c9030 con 0x7f842c017050 2024-09-13T06:11:45.765 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.755+0000 7f8439ab9640 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560cdfad9500 con 0x560cdfad5870 2024-09-13T06:11:45.765 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.755+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f843400a4d0 con 0x560cdfad5870 2024-09-13T06:11:45.765 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.755+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560cdfad9500 con 0x7f84300dc040 2024-09-13T06:11:45.765 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.755+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f843400a4d0 con 0x7f84300dc040 2024-09-13T06:11:45.765 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.755+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560cdfad9500 con 0x560cdfada260 2024-09-13T06:11:45.765 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.755+0000 7f843a2ba640 1 -- 172.21.15.194:0/2498507463 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=107b] v35'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f842c008030 con 0x560cdfada260 2024-09-13T06:11:45.765 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.755+0000 7f843a2ba640 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560cdfad9500 con 0x7f842c017050 2024-09-13T06:11:45.765 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.755+0000 7f8439ab9640 1 -- 172.21.15.194:0/2498507463 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84300c9030 con 0x7f842c017050 2024-09-13T06:11:45.765 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.755+0000 7f8439ab9640 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560cdfad9500 con 0x7f842c017050 2024-09-13T06:11:45.765 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.755+0000 7f8439ab9640 1 -- 172.21.15.194:0/2498507463 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84300c9030 con 0x7f842c017050 2024-09-13T06:11:45.765 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.755+0000 7f8439ab9640 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560cdfad9500 con 0x560cdfada260 2024-09-13T06:11:45.766 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.755+0000 7f843a2ba640 1 -- 172.21.15.194:0/2498507463 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f842c008030 con 0x560cdfada260 2024-09-13T06:11:45.766 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.755+0000 7f843a2ba640 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560cdfad9500 con 0x7f84300dc040 2024-09-13T06:11:45.766 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.759+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f843400a4d0 con 0x7f84300dc040 2024-09-13T06:11:45.766 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.759+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560cdfad9500 con 0x560cdfad5870 2024-09-13T06:11:45.766 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.759+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v35'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f843400a4d0 con 0x560cdfad5870 2024-09-13T06:11:45.766 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.759+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560cdfad9500 con 0x7f842c017050 2024-09-13T06:11:45.766 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.759+0000 7f8439ab9640 1 -- 172.21.15.194:0/2498507463 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84300c9030 con 0x7f842c017050 2024-09-13T06:11:45.766 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.759+0000 7f843c7aa980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:11:45.766 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.759+0000 7f843c7aa980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:11:45.766 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.759+0000 7f843c7aa980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:11:45.766 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.759+0000 7f843c7aa980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:11:45.766 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.759+0000 7f843c7aa980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:11:45.766 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.759+0000 7f843c7aa980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:11:45.766 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.759+0000 7f843c7aa980 20 rados->read ofs=0 len=0 2024-09-13T06:11:45.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.759+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560cdfadd650 con 0x560cdfad5870 2024-09-13T06:11:45.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.759+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f843400a4d0 con 0x560cdfad5870 2024-09-13T06:11:45.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.759+0000 7f843c7aa980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:45.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.759+0000 7f843c7aa980 20 rados->read ofs=0 len=0 2024-09-13T06:11:45.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.759+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560cdfadd290 con 0x560cdfad5870 2024-09-13T06:11:45.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.759+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f843400a4d0 con 0x560cdfad5870 2024-09-13T06:11:45.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.759+0000 7f843c7aa980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:11:45.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.759+0000 7f843c7aa980 20 rados->read ofs=0 len=0 2024-09-13T06:11:45.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.759+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560cdfaddf70 con 0x7f842c017050 2024-09-13T06:11:45.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.759+0000 7f8439ab9640 1 -- 172.21.15.194:0/2498507463 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f84300c9030 con 0x7f842c017050 2024-09-13T06:11:45.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.759+0000 7f843c7aa980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:11:45.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.759+0000 7f843c7aa980 20 zone default found 2024-09-13T06:11:45.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.759+0000 7f843c7aa980 4 Realm: () 2024-09-13T06:11:45.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.759+0000 7f843c7aa980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:11:45.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.759+0000 7f843c7aa980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:11:45.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.759+0000 7f843c7aa980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:11:45.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.759+0000 7f843c7aa980 20 zonegroup default 2024-09-13T06:11:45.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.759+0000 7f843c7aa980 20 rados->read ofs=0 len=0 2024-09-13T06:11:45.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.759+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560cdfade960 con 0x7f84300dc040 2024-09-13T06:11:45.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.759+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f843400a4d0 con 0x7f84300dc040 2024-09-13T06:11:45.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.759+0000 7f843c7aa980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:45.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.759+0000 7f843c7aa980 20 rados->read ofs=0 len=0 2024-09-13T06:11:45.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.759+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560cdfae0340 con 0x560cdfada260 2024-09-13T06:11:45.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.759+0000 7f843a2ba640 1 -- 172.21.15.194:0/2498507463 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f842c008030 con 0x560cdfada260 2024-09-13T06:11:45.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.759+0000 7f843c7aa980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:45.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.759+0000 7f843c7aa980 20 rados->read ofs=0 len=0 2024-09-13T06:11:45.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.759+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560cdfae0830 con 0x560cdfada260 2024-09-13T06:11:45.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.759+0000 7f843a2ba640 1 -- 172.21.15.194:0/2498507463 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f842c008030 con 0x560cdfada260 2024-09-13T06:11:45.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.759+0000 7f843c7aa980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:45.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.759+0000 7f843c7aa980 20 started sync module instance, tier type = 2024-09-13T06:11:45.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.759+0000 7f843c7aa980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:11:45.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.759+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560cdfadf7e0 con 0x7f842c017050 2024-09-13T06:11:45.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.763+0000 7f8439ab9640 1 -- 172.21.15.194:0/2498507463 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(44 notify.0 [create] v35'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84300c9030 con 0x7f842c017050 2024-09-13T06:11:45.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.763+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94613292317696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560cdfae1140 con 0x7f842c017050 2024-09-13T06:11:45.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.763+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560cdfae1990 con 0x560cdfad5870 2024-09-13T06:11:45.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.763+0000 7f8439ab9640 1 -- 172.21.15.194:0/2498507463 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94613292317696] v35'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84300c9030 con 0x7f842c017050 2024-09-13T06:11:45.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.763+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v35'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f843400a4d0 con 0x560cdfad5870 2024-09-13T06:11:45.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.763+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94613292321936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560cdfae1990 con 0x560cdfad5870 2024-09-13T06:11:45.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.763+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560cdfae2450 con 0x560cdfada260 2024-09-13T06:11:45.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.767+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94613292321936] v35'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f843400a4d0 con 0x560cdfad5870 2024-09-13T06:11:45.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.767+0000 7f843a2ba640 1 -- 172.21.15.194:0/2498507463 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v35'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f842c008030 con 0x560cdfada260 2024-09-13T06:11:45.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.767+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94613292324064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560cdfae1900 con 0x560cdfada260 2024-09-13T06:11:45.772 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.767+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560cdfae31e0 con 0x7f842c017050 2024-09-13T06:11:45.772 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.767+0000 7f8439ab9640 1 -- 172.21.15.194:0/2498507463 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(50 notify.3 [create] v35'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84300c9030 con 0x7f842c017050 2024-09-13T06:11:45.772 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.767+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94613292330224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560cdfae3a80 con 0x7f842c017050 2024-09-13T06:11:45.772 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.767+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560cdfae4480 con 0x560cdfad5870 2024-09-13T06:11:45.772 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.767+0000 7f843a2ba640 1 -- 172.21.15.194:0/2498507463 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94613292324064] v35'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f842c008030 con 0x560cdfada260 2024-09-13T06:11:45.773 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.767+0000 7f8439ab9640 1 -- 172.21.15.194:0/2498507463 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94613292330224] v35'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84300c9030 con 0x7f842c017050 2024-09-13T06:11:45.773 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.771+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v35'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f843400a4d0 con 0x560cdfad5870 2024-09-13T06:11:45.773 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.771+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94613292329024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560cdfae35d0 con 0x560cdfad5870 2024-09-13T06:11:45.773 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.771+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560cdfae4d20 con 0x7f84300dc040 2024-09-13T06:11:45.774 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.771+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94613292329024] v35'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f843400a4d0 con 0x560cdfad5870 2024-09-13T06:11:45.774 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.771+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(54 notify.5 [create] v35'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f843400a4d0 con 0x7f84300dc040 2024-09-13T06:11:45.774 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.771+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94613292334992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560cdfae35d0 con 0x7f84300dc040 2024-09-13T06:11:45.774 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.771+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560cdfae51b0 con 0x7f84300dc040 2024-09-13T06:11:45.777 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.775+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94613292334992] v35'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f843400a4d0 con 0x7f84300dc040 2024-09-13T06:11:45.777 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.775+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(56 notify.6 [create] v35'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f843400a4d0 con 0x7f84300dc040 2024-09-13T06:11:45.777 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.775+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94613292336800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560cdfae5170 con 0x7f84300dc040 2024-09-13T06:11:45.777 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.775+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560cdfae5b70 con 0x7f84300dc040 2024-09-13T06:11:45.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.775+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(58 notify.7 [create] v35'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f843400a4d0 con 0x7f84300dc040 2024-09-13T06:11:45.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.775+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94613292340864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560cdfae5f90 con 0x7f84300dc040 2024-09-13T06:11:45.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.775+0000 7f843c7aa980 20 add_watcher() i=0 2024-09-13T06:11:45.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.775+0000 7f843c7aa980 20 add_watcher() i=1 2024-09-13T06:11:45.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.775+0000 7f843c7aa980 20 add_watcher() i=2 2024-09-13T06:11:45.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.775+0000 7f843c7aa980 20 add_watcher() i=3 2024-09-13T06:11:45.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.775+0000 7f843c7aa980 20 add_watcher() i=4 2024-09-13T06:11:45.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.775+0000 7f843c7aa980 20 add_watcher() i=5 2024-09-13T06:11:45.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.775+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94613292336800] v35'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f843400a4d0 con 0x7f84300dc040 2024-09-13T06:11:45.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.775+0000 7f843c7aa980 20 add_watcher() i=6 2024-09-13T06:11:45.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.779+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94613292340864] v35'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f843400a4d0 con 0x7f84300dc040 2024-09-13T06:11:45.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.779+0000 7f843c7aa980 20 add_watcher() i=7 2024-09-13T06:11:45.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.779+0000 7f843c7aa980 2 all 8 watchers are set, enabling cache 2024-09-13T06:11:45.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.779+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560cdfae4cc0 con 0x560cdfad5870 2024-09-13T06:11:45.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.779+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f843400a4d0 con 0x560cdfad5870 2024-09-13T06:11:45.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.779+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94613292338368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560cdfae64a0 con 0x560cdfad5870 2024-09-13T06:11:45.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.779+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94613292338368] v35'252 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f843400a4d0 con 0x560cdfad5870 2024-09-13T06:11:45.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.779+0000 7f82f0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:11:45.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.779+0000 7f843c7aa980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:11:45.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.779+0000 7f843c7aa980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:11:45.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.779+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560cdfaf1900 con 0x560cdfad5870 2024-09-13T06:11:45.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.783+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v35'37 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f843400a4d0 con 0x560cdfad5870 2024-09-13T06:11:45.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.783+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560cdfaf1f50 con 0x7f84300dc040 2024-09-13T06:11:45.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.783+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v35'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f843400a4d0 con 0x7f84300dc040 2024-09-13T06:11:45.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.783+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560cdfaf23b0 con 0x560cdfada260 2024-09-13T06:11:45.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.783+0000 7f843a2ba640 1 -- 172.21.15.194:0/2498507463 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v35'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f842c008030 con 0x560cdfada260 2024-09-13T06:11:45.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.783+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560cdfaf23c0 con 0x560cdfad5870 2024-09-13T06:11:45.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.787+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v35'253 uv164 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f843400a4d0 con 0x560cdfad5870 2024-09-13T06:11:45.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.787+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560cdfaf2870 con 0x7f842c017050 2024-09-13T06:11:45.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.787+0000 7f8439ab9640 1 -- 172.21.15.194:0/2498507463 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v35'80 uv53 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f84300c9030 con 0x7f842c017050 2024-09-13T06:11:45.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.787+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560cdfaf0980 con 0x560cdfada260 2024-09-13T06:11:45.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.787+0000 7f843a2ba640 1 -- 172.21.15.194:0/2498507463 <== osd.3 v2:172.21.15.194:6816/96632515 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v35'54 uv37 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f842c008030 con 0x560cdfada260 2024-09-13T06:11:45.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.787+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560cdfaf0980 con 0x560cdfad5870 2024-09-13T06:11:45.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.791+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v35'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f843400a4d0 con 0x560cdfad5870 2024-09-13T06:11:45.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.791+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560cdfaf0980 con 0x7f84300dc040 2024-09-13T06:11:45.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.791+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v35'53 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f843400a4d0 con 0x7f84300dc040 2024-09-13T06:11:45.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.791+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560cdfaf0980 con 0x7f842c017050 2024-09-13T06:11:45.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.795+0000 7f8439ab9640 1 -- 172.21.15.194:0/2498507463 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v35'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f84300c9030 con 0x7f842c017050 2024-09-13T06:11:45.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.795+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560cdfaf33d0 con 0x560cdfada260 2024-09-13T06:11:45.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.795+0000 7f843a2ba640 1 -- 172.21.15.194:0/2498507463 <== osd.3 v2:172.21.15.194:6816/96632515 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v35'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f842c008030 con 0x560cdfada260 2024-09-13T06:11:45.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.795+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560cdfaf33d0 con 0x7f842c017050 2024-09-13T06:11:45.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.795+0000 7f8439ab9640 1 -- 172.21.15.194:0/2498507463 <== osd.2 v2:172.21.15.194:6800/815615585 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v35'81 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f84300c9030 con 0x7f842c017050 2024-09-13T06:11:45.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.795+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560cdfaf39c0 con 0x7f84300dc040 2024-09-13T06:11:45.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.799+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v35'37 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f843400a4d0 con 0x7f84300dc040 2024-09-13T06:11:45.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.799+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560cdfaf39c0 con 0x7f842c017050 2024-09-13T06:11:45.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.799+0000 7f8439ab9640 1 -- 172.21.15.194:0/2498507463 <== osd.2 v2:172.21.15.194:6800/815615585 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v35'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f84300c9030 con 0x7f842c017050 2024-09-13T06:11:45.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.799+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560cdfaf3880 con 0x7f84300dc040 2024-09-13T06:11:45.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.803+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v35'59 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f843400a4d0 con 0x7f84300dc040 2024-09-13T06:11:45.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.803+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560cdfaf3880 con 0x560cdfad5870 2024-09-13T06:11:45.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.803+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v35'254 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f843400a4d0 con 0x560cdfad5870 2024-09-13T06:11:45.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.803+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560cdfaf3880 con 0x560cdfada260 2024-09-13T06:11:45.808 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.807+0000 7f843a2ba640 1 -- 172.21.15.194:0/2498507463 <== osd.3 v2:172.21.15.194:6816/96632515 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v35'74 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f842c008030 con 0x560cdfada260 2024-09-13T06:11:45.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.807+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560cdfaf3a50 con 0x7f842c017050 2024-09-13T06:11:45.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.807+0000 7f8439ab9640 1 -- 172.21.15.194:0/2498507463 <== osd.2 v2:172.21.15.194:6800/815615585 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v35'82 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f84300c9030 con 0x7f842c017050 2024-09-13T06:11:45.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.807+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560cdfaf3a50 con 0x560cdfada260 2024-09-13T06:11:45.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.807+0000 7f843a2ba640 1 -- 172.21.15.194:0/2498507463 <== osd.3 v2:172.21.15.194:6816/96632515 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v35'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f842c008030 con 0x560cdfada260 2024-09-13T06:11:45.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.807+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560cdfaf3a50 con 0x560cdfad5870 2024-09-13T06:11:45.813 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.811+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 <== osd.1 v2:172.21.15.194:6808/3135444559 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v35'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f843400a4d0 con 0x560cdfad5870 2024-09-13T06:11:45.813 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.811+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560cdfaf3a50 con 0x560cdfad5870 2024-09-13T06:11:45.814 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.811+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 <== osd.1 v2:172.21.15.194:6808/3135444559 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v35'255 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f843400a4d0 con 0x560cdfad5870 2024-09-13T06:11:45.814 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.811+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560cdfaf3a50 con 0x560cdfada260 2024-09-13T06:11:45.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.815+0000 7f843a2ba640 1 -- 172.21.15.194:0/2498507463 <== osd.3 v2:172.21.15.194:6816/96632515 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v35'75 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f842c008030 con 0x560cdfada260 2024-09-13T06:11:45.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.815+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560cdfaf3a50 con 0x7f842c017050 2024-09-13T06:11:45.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.815+0000 7f8439ab9640 1 -- 172.21.15.194:0/2498507463 <== osd.2 v2:172.21.15.194:6800/815615585 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v35'40 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f84300c9030 con 0x7f842c017050 2024-09-13T06:11:45.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.815+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560cdfaf4060 con 0x560cdfada260 2024-09-13T06:11:45.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.815+0000 7f843a2ba640 1 -- 172.21.15.194:0/2498507463 <== osd.3 v2:172.21.15.194:6816/96632515 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v35'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f842c008030 con 0x560cdfada260 2024-09-13T06:11:45.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.815+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560cdfaf3ca0 con 0x560cdfada260 2024-09-13T06:11:45.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.819+0000 7f843a2ba640 1 -- 172.21.15.194:0/2498507463 <== osd.3 v2:172.21.15.194:6816/96632515 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v35'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f842c008030 con 0x560cdfada260 2024-09-13T06:11:45.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.819+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560cdfaf3ca0 con 0x560cdfada260 2024-09-13T06:11:45.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.819+0000 7f843a2ba640 1 -- 172.21.15.194:0/2498507463 <== osd.3 v2:172.21.15.194:6816/96632515 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v35'26 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f842c008030 con 0x560cdfada260 2024-09-13T06:11:45.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.819+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560cdfaf3ca0 con 0x560cdfada260 2024-09-13T06:11:45.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.819+0000 7f843a2ba640 1 -- 172.21.15.194:0/2498507463 <== osd.3 v2:172.21.15.194:6816/96632515 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v35'55 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f842c008030 con 0x560cdfada260 2024-09-13T06:11:45.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.819+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560cdfaf3ca0 con 0x7f84300dc040 2024-09-13T06:11:45.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.823+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v35'34 uv25 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f843400a4d0 con 0x7f84300dc040 2024-09-13T06:11:45.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.823+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560cdfaf3ca0 con 0x560cdfada260 2024-09-13T06:11:45.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.823+0000 7f843a2ba640 1 -- 172.21.15.194:0/2498507463 <== osd.3 v2:172.21.15.194:6816/96632515 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v35'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f842c008030 con 0x560cdfada260 2024-09-13T06:11:45.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.823+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560cdfaf3ca0 con 0x7f84300dc040 2024-09-13T06:11:45.829 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.827+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 <== osd.0 v2:172.21.15.120:6800/1923744619 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v35'54 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f843400a4d0 con 0x7f84300dc040 2024-09-13T06:11:45.829 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.827+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560cdfaf3ca0 con 0x560cdfada260 2024-09-13T06:11:45.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.827+0000 7f843a2ba640 1 -- 172.21.15.194:0/2498507463 <== osd.3 v2:172.21.15.194:6816/96632515 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v35'76 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f842c008030 con 0x560cdfada260 2024-09-13T06:11:45.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.827+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560cdfaf3ca0 con 0x7f84300dc040 2024-09-13T06:11:45.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.831+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 <== osd.0 v2:172.21.15.120:6800/1923744619 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v35'60 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f843400a4d0 con 0x7f84300dc040 2024-09-13T06:11:45.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.831+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560cdfaf3ca0 con 0x7f842c017050 2024-09-13T06:11:45.836 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.835+0000 7f8439ab9640 1 -- 172.21.15.194:0/2498507463 <== osd.2 v2:172.21.15.194:6800/815615585 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v35'37 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f84300c9030 con 0x7f842c017050 2024-09-13T06:11:45.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.835+0000 7f826b7fe640 20 reqs_thread_entry: start 2024-09-13T06:11:45.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.835+0000 7f843c7aa980 20 init_complete bucket index max shards: 11 2024-09-13T06:11:45.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.835+0000 7f843c7aa980 20 Filter name: none 2024-09-13T06:11:45.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.835+0000 7f82697fa640 20 reqs_thread_entry: start 2024-09-13T06:11:45.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.835+0000 7f843c7aa980 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-09-13T06:11:45.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.835+0000 7f843c7aa980 20 rados->read ofs=0 len=0 2024-09-13T06:11:45.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.835+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:94 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560cdfb0f300 con 0x560cdfada260 2024-09-13T06:11:45.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.835+0000 7f843a2ba640 1 -- 172.21.15.194:0/2498507463 <== osd.3 v2:172.21.15.194:6816/96632515 27 ==== osd_op_reply(94 a_user [call out=48b,read 0~363 out=363b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 234+0+486 (crc 0 0 0) 0x7f842c008030 con 0x560cdfada260 2024-09-13T06:11:45.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.835+0000 7f843c7aa980 20 rados_obj.operate() r=0 bl.length=363 2024-09-13T06:11:45.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.835+0000 7f843c7aa980 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x13 2024-09-13T06:11:45.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.835+0000 7f843c7aa980 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-13T06:11:45.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.835+0000 7f843c7aa980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:11:45.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.835+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:95 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560cdfb117d0 con 0x560cdfada260 2024-09-13T06:11:45.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.835+0000 7f843a2ba640 1 -- 172.21.15.194:0/2498507463 <== osd.3 v2:172.21.15.194:6816/96632515 28 ==== osd_op_reply(95 a_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7f842c008030 con 0x560cdfada260 2024-09-13T06:11:45.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.835+0000 7f843c7aa980 10 removing key index: true_admin_akey 2024-09-13T06:11:45.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.835+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:96 8.15 8:afe09604:users.keys::true_admin_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560cdfb0f7e0 con 0x560cdfada260 2024-09-13T06:11:45.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.835+0000 7f843a2ba640 1 -- 172.21.15.194:0/2498507463 <== osd.3 v2:172.21.15.194:6816/96632515 29 ==== osd_op_reply(96 true_admin_akey [delete] v35'4 uv4 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f842c094040 con 0x560cdfada260 2024-09-13T06:11:45.840 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.835+0000 7f843c7aa980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-09-13T06:11:45.840 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.835+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:97 7.3 7:c609908c:::notify.5:head [notify cookie 94613292512048 in=177b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560cdfb11070 con 0x7f84300dc040 2024-09-13T06:11:45.840 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.839+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 <== osd.0 v2:172.21.15.120:6800/1923744619 22 ==== watch-notify(notify (1) cookie 94613292334992 notify 150323855409 ret 0) ==== 207+0+0 (crc 0 0 0) 0x560cdfaf33d0 con 0x7f84300dc040 2024-09-13T06:11:45.840 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.839+0000 7f831dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855409 cookie 94613292334992 notifier 4864 bl.length()=165 2024-09-13T06:11:45.840 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.839+0000 7f831dffb640 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f8300003d70 con 0x7f84300dc040 2024-09-13T06:11:45.841 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.839+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 <== osd.0 v2:172.21.15.120:6800/1923744619 23 ==== osd_op_reply(97 notify.5 [notify cookie 94613292512048 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f843400a4d0 con 0x7f84300dc040 2024-09-13T06:11:45.841 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.839+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 <== osd.0 v2:172.21.15.120:6800/1923744619 24 ==== osd_op_reply(98 notify.5 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f843400a4d0 con 0x7f84300dc040 2024-09-13T06:11:45.841 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.839+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 <== osd.0 v2:172.21.15.120:6800/1923744619 25 ==== watch-notify(notify_complete (2) cookie 94613292512048 notify 150323855409 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560cdfaf1ad0 con 0x7f84300dc040 2024-09-13T06:11:45.842 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.839+0000 7f843c7aa980 10 removing email index: 2024-09-13T06:11:45.842 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.839+0000 7f843c7aa980 10 removing user buckets index 2024-09-13T06:11:45.842 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.839+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:99 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560cdfb0f330 con 0x560cdfada260 2024-09-13T06:11:45.843 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.839+0000 7f843a2ba640 1 -- 172.21.15.194:0/2498507463 <== osd.3 v2:172.21.15.194:6816/96632515 30 ==== osd_op_reply(99 a_user.buckets [delete] v35'3 uv2 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7f842c094040 con 0x560cdfada260 2024-09-13T06:11:45.843 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.839+0000 7f843c7aa980 10 removing user index: a_user 2024-09-13T06:11:45.843 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.839+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:100 8.14 8:2efb937b:users.uid::a_user:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560cdfb0f300 con 0x560cdfada260 2024-09-13T06:11:45.845 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.843+0000 7f843a2ba640 1 -- 172.21.15.194:0/2498507463 <== osd.3 v2:172.21.15.194:6816/96632515 31 ==== osd_op_reply(100 a_user [call,call,delete] v35'2 uv2 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f842c094040 con 0x560cdfada260 2024-09-13T06:11:45.845 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.843+0000 7f843c7aa980 10 removing default.rgw.meta+users.uid+a_user from cache 2024-09-13T06:11:45.845 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.843+0000 7f843c7aa980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-09-13T06:11:45.845 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.843+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:101 7.15 7:a93a5511:::notify.2:head [notify cookie 94613292512000 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560cdfb11460 con 0x560cdfada260 2024-09-13T06:11:45.845 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.843+0000 7f843a2ba640 1 -- 172.21.15.194:0/2498507463 <== osd.3 v2:172.21.15.194:6816/96632515 32 ==== watch-notify(notify (1) cookie 94613292324064 notify 150323855380 ret 0) ==== 197+0+0 (crc 0 0 0) 0x560cdfaf35a0 con 0x560cdfada260 2024-09-13T06:11:45.845 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.843+0000 7f831d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855380 cookie 94613292324064 notifier 4864 bl.length()=155 2024-09-13T06:11:45.845 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.843+0000 7f831d7fa640 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:102 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f82700032d0 con 0x560cdfada260 2024-09-13T06:11:45.845 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.843+0000 7f843a2ba640 1 -- 172.21.15.194:0/2498507463 <== osd.3 v2:172.21.15.194:6816/96632515 33 ==== osd_op_reply(101 notify.2 [notify cookie 94613292512000 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f842c094040 con 0x560cdfada260 2024-09-13T06:11:45.846 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.843+0000 7f843a2ba640 1 -- 172.21.15.194:0/2498507463 <== osd.3 v2:172.21.15.194:6816/96632515 34 ==== osd_op_reply(102 notify.2 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f842c094040 con 0x560cdfada260 2024-09-13T06:11:45.846 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.843+0000 7f843a2ba640 1 -- 172.21.15.194:0/2498507463 <== osd.3 v2:172.21.15.194:6816/96632515 35 ==== watch-notify(notify_complete (2) cookie 94613292512000 notify 150323855380 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f842c033030 con 0x560cdfada260 2024-09-13T06:11:45.846 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.843+0000 7f82f0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:11:45.846 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.843+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94613292338368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560cdfad2f90 con 0x560cdfad5870 2024-09-13T06:11:45.848 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.843+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 <== osd.1 v2:172.21.15.194:6808/3135444559 27 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94613292338368] v35'256 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f843400a4d0 con 0x560cdfad5870 2024-09-13T06:11:45.848 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.847+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94613292317696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560cdfae4cc0 con 0x7f842c017050 2024-09-13T06:11:45.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.847+0000 7f8439ab9640 1 -- 172.21.15.194:0/2498507463 <== osd.2 v2:172.21.15.194:6800/815615585 21 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94613292317696] v35'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84300c9030 con 0x7f842c017050 2024-09-13T06:11:45.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.847+0000 7f843c7aa980 20 remove_watcher() i=0 2024-09-13T06:11:45.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.847+0000 7f843c7aa980 2 removed watcher, disabling cache 2024-09-13T06:11:45.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.847+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94613292321936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560cdfadfc00 con 0x560cdfad5870 2024-09-13T06:11:45.853 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.851+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 <== osd.1 v2:172.21.15.194:6808/3135444559 28 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94613292321936] v35'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f843400a4d0 con 0x560cdfad5870 2024-09-13T06:11:45.853 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.851+0000 7f843c7aa980 20 remove_watcher() i=1 2024-09-13T06:11:45.853 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.851+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94613292324064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560cdfae0c90 con 0x560cdfada260 2024-09-13T06:11:45.855 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.851+0000 7f843a2ba640 1 -- 172.21.15.194:0/2498507463 <== osd.3 v2:172.21.15.194:6816/96632515 36 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94613292324064] v35'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f842c094040 con 0x560cdfada260 2024-09-13T06:11:45.855 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.851+0000 7f843c7aa980 20 remove_watcher() i=2 2024-09-13T06:11:45.855 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.851+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94613292330224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560cdfae14e0 con 0x7f842c017050 2024-09-13T06:11:45.856 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.855+0000 7f8439ab9640 1 -- 172.21.15.194:0/2498507463 <== osd.2 v2:172.21.15.194:6800/815615585 22 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94613292330224] v35'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84300c9030 con 0x7f842c017050 2024-09-13T06:11:45.856 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.855+0000 7f843c7aa980 20 remove_watcher() i=3 2024-09-13T06:11:45.857 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.855+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94613292329024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560cdfae14e0 con 0x560cdfad5870 2024-09-13T06:11:45.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.855+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 <== osd.1 v2:172.21.15.194:6808/3135444559 29 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94613292329024] v35'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f843400a4d0 con 0x560cdfad5870 2024-09-13T06:11:45.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.855+0000 7f843c7aa980 20 remove_watcher() i=4 2024-09-13T06:11:45.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.855+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94613292334992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560cdfae14e0 con 0x7f84300dc040 2024-09-13T06:11:45.861 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.859+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 <== osd.0 v2:172.21.15.120:6800/1923744619 26 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94613292334992] v35'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f843400a4d0 con 0x7f84300dc040 2024-09-13T06:11:45.861 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.859+0000 7f843c7aa980 20 remove_watcher() i=5 2024-09-13T06:11:45.861 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.859+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94613292336800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560cdfae3f90 con 0x7f84300dc040 2024-09-13T06:11:45.863 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.859+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 <== osd.0 v2:172.21.15.120:6800/1923744619 27 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94613292336800] v35'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f843400a4d0 con 0x7f84300dc040 2024-09-13T06:11:45.863 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.859+0000 7f843c7aa980 20 remove_watcher() i=6 2024-09-13T06:11:45.863 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.859+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94613292340864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560cdfae14e0 con 0x7f84300dc040 2024-09-13T06:11:45.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.863+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 <== osd.0 v2:172.21.15.120:6800/1923744619 28 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94613292340864] v35'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f843400a4d0 con 0x7f84300dc040 2024-09-13T06:11:45.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.863+0000 7f843c7aa980 20 remove_watcher() i=7 2024-09-13T06:11:45.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.863+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f84300dc040 msgr2=0x7f84300dd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.863+0000 7f843c7aa980 1 --2- 172.21.15.194:0/2498507463 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f84300dc040 0x7f84300dd430 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:45.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.863+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x560cdfad5870 msgr2=0x560cdfad7d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.863+0000 7f843c7aa980 1 --2- 172.21.15.194:0/2498507463 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x560cdfad5870 0x560cdfad7d30 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:45.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.863+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f842c017050 msgr2=0x7f842c013970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.863+0000 7f843c7aa980 1 --2- 172.21.15.194:0/2498507463 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f842c017050 0x7f842c013970 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:45.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.863+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x560cdfada260 msgr2=0x560cdfadc650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.863+0000 7f843c7aa980 1 --2- 172.21.15.194:0/2498507463 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x560cdfada260 0x560cdfadc650 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:45.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.863+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8304034650 msgr2=0x7f8304036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.863+0000 7f843c7aa980 1 --2- 172.21.15.194:0/2498507463 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8304034650 0x7f8304036b10 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8430000c10 tx=0x7f84300b9040 comp rx=0 tx=0).stop 2024-09-13T06:11:45.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.863+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560cdfac3610 msgr2=0x560cdfaca790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.863+0000 7f843aabb640 1 -- 172.21.15.194:0/2498507463 reap_dead start 2024-09-13T06:11:45.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.863+0000 7f843c7aa980 1 --2- 172.21.15.194:0/2498507463 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560cdfac3610 0x560cdfaca790 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f842c0413b0 tx=0x7f842c034f80 comp rx=0 tx=0).stop 2024-09-13T06:11:45.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.863+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 shutdown_connections 2024-09-13T06:11:45.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.863+0000 7f843c7aa980 1 --2- 172.21.15.194:0/2498507463 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560cdfac3610 0x560cdfaca790 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:45.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.863+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 >> 172.21.15.194:0/2498507463 conn(0x560cdfabf9f0 msgr2=0x560cdfabdac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:45.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.863+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 shutdown_connections 2024-09-13T06:11:45.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.863+0000 7f843c7aa980 1 -- 172.21.15.194:0/2498507463 wait complete. 2024-09-13T06:11:45.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.863+0000 7f843c7aa980 1 -- 172.21.15.194:0/2316687653 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8314034650 msgr2=0x7f8314036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.870 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.863+0000 7f843c7aa980 1 --2- 172.21.15.194:0/2316687653 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8314034650 0x7f8314036b10 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x560cdfaa0ad0 tx=0x7f8430005a10 comp rx=0 tx=0).stop 2024-09-13T06:11:45.870 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.863+0000 7f843c7aa980 1 -- 172.21.15.194:0/2316687653 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560cdfab6e90 msgr2=0x560cdfab72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.870 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.863+0000 7f843c7aa980 1 --2- 172.21.15.194:0/2316687653 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560cdfab6e90 0x560cdfab72b0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f842c01a740 tx=0x7f842c016470 comp rx=0 tx=0).stop 2024-09-13T06:11:45.870 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.863+0000 7f843c7aa980 1 -- 172.21.15.194:0/2316687653 shutdown_connections 2024-09-13T06:11:45.870 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.863+0000 7f843c7aa980 1 --2- 172.21.15.194:0/2316687653 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f8314034650 0x7f8314036b10 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:45.870 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.863+0000 7f843c7aa980 1 --2- 172.21.15.194:0/2316687653 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560cdfab6e90 0x560cdfab72b0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:45.870 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.863+0000 7f843c7aa980 1 -- 172.21.15.194:0/2316687653 >> 172.21.15.194:0/2316687653 conn(0x560cdfaabfe0 msgr2=0x560cdfaaea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:45.870 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.863+0000 7f843c7aa980 1 -- 172.21.15.194:0/2316687653 shutdown_connections 2024-09-13T06:11:45.870 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.863+0000 7f843c7aa980 1 -- 172.21.15.194:0/2316687653 wait complete. 2024-09-13T06:11:45.870 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.863+0000 7f843c7aa980 1 -- 172.21.15.194:0/3221619340 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x560cdf9a8a90 msgr2=0x560cdfa9ffe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.870 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.863+0000 7f843c7aa980 1 --2- 172.21.15.194:0/3221619340 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x560cdf9a8a90 0x560cdfa9ffe0 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:45.870 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.863+0000 7f843c7aa980 1 -- 172.21.15.194:0/3221619340 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x560cdfaa6890 msgr2=0x560cdfaa8c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.871 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.863+0000 7f843c7aa980 1 --2- 172.21.15.194:0/3221619340 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x560cdfaa6890 0x560cdfaa8c80 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:45.871 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.863+0000 7f843c7aa980 1 -- 172.21.15.194:0/3221619340 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x560cdfaa2950 msgr2=0x560cdfaa4d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.871 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.863+0000 7f843c7aa980 1 --2- 172.21.15.194:0/3221619340 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x560cdfaa2950 0x560cdfaa4d40 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:45.871 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.863+0000 7f843c7aa980 1 -- 172.21.15.194:0/3221619340 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f83200346a0 msgr2=0x7f8320036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.871 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.863+0000 7f843c7aa980 1 --2- 172.21.15.194:0/3221619340 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f83200346a0 0x7f8320036b60 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f84300ad000 tx=0x7f84300a5040 comp rx=0 tx=0).stop 2024-09-13T06:11:45.871 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.863+0000 7f843c7aa980 1 -- 172.21.15.194:0/3221619340 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560cdf918ac0 msgr2=0x560cdfa99050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.871 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.863+0000 7f843c7aa980 1 --2- 172.21.15.194:0/3221619340 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560cdf918ac0 0x560cdfa99050 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f842c001e20 tx=0x7f842c000ee0 comp rx=0 tx=0).stop 2024-09-13T06:11:45.871 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.863+0000 7f843aabb640 1 -- 172.21.15.194:0/3221619340 reap_dead start 2024-09-13T06:11:45.871 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.863+0000 7f843c7aa980 1 -- 172.21.15.194:0/3221619340 shutdown_connections 2024-09-13T06:11:45.871 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.867+0000 7f843c7aa980 1 -- 172.21.15.194:0/3221619340 >> 172.21.15.194:0/3221619340 conn(0x560cdf99f060 msgr2=0x560cdfa8c490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:45.871 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.867+0000 7f843c7aa980 1 -- 172.21.15.194:0/3221619340 shutdown_connections 2024-09-13T06:11:45.871 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.867+0000 7f843c7aa980 1 -- 172.21.15.194:0/3221619340 wait complete. 2024-09-13T06:11:45.879 ERROR:root:None 2024-09-13T06:11:45.879 ERROR:root:0 2024-09-13T06:11:45.879 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-09-13T06:11:45.879 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-09-13T06:11:45.880 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=read 2024-09-13T06:11:45.958 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:11:45.958 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:11:45.959 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.955+0000 7f6076c13980 1 Processor -- start 2024-09-13T06:11:45.959 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.955+0000 7f6076c13980 1 -- start start 2024-09-13T06:11:45.959 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.955+0000 7f6076c13980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x5614f8588c70 0x5614f858b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.960 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.955+0000 7f6076c13980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5614f840aae0 con 0x5614f85848f0 2024-09-13T06:11:45.960 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.955+0000 7f6076c13980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x5614f842ee30 con 0x5614f8588c70 2024-09-13T06:11:45.960 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.959+0000 7f6073f22640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x5614f8588c70 0x5614f858b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.959+0000 7f6074723640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x5614f85848f0 0x5614f8584cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:58420/0 (socket says 172.21.15.194:58420) 2024-09-13T06:11:45.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.959+0000 7f6074723640 1 -- 172.21.15.194:0/2282251839 learned_addr learned my addr 172.21.15.194:0/2282251839 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-09-13T06:11:45.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.959+0000 7f6073f22640 1 -- 172.21.15.194:0/2282251839 >> v1:172.21.15.120:6789/0 conn(0x5614f85848f0 legacy=0x5614f8584cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.959+0000 7f6073f22640 1 -- 172.21.15.194:0/2282251839 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614f858c5b0 con 0x5614f8588c70 2024-09-13T06:11:45.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.959+0000 7f6073f22640 1 --2- 172.21.15.194:0/2282251839 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5614f8588c70 0x5614f858b060 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f605c00a480 tx=0x7f605c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb774bf3bc5da49c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.959+0000 7f6073721640 1 -- 172.21.15.194:0/2282251839 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f605c0b0070 con 0x5614f8588c70 2024-09-13T06:11:45.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.959+0000 7f6073721640 1 -- 172.21.15.194:0/2282251839 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f605c0ab540 con 0x5614f8588c70 2024-09-13T06:11:45.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.959+0000 7f6073721640 1 -- 172.21.15.194:0/2282251839 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f605c0ab840 con 0x5614f8588c70 2024-09-13T06:11:45.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.963+0000 7f6076c13980 1 -- 172.21.15.194:0/2282251839 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5614f8588c70 msgr2=0x5614f858b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.965 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.963+0000 7f6076c13980 1 --2- 172.21.15.194:0/2282251839 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5614f8588c70 0x5614f858b060 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f605c00a480 tx=0x7f605c01b280 comp rx=0 tx=0).stop 2024-09-13T06:11:45.965 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.963+0000 7f6076c13980 1 -- 172.21.15.194:0/2282251839 shutdown_connections 2024-09-13T06:11:45.965 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.963+0000 7f6076c13980 1 --2- 172.21.15.194:0/2282251839 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5614f8588c70 0x5614f858b060 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:45.965 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.963+0000 7f6076c13980 1 -- 172.21.15.194:0/2282251839 >> 172.21.15.194:0/2282251839 conn(0x5614f84f8240 msgr2=0x5614f84f8650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:45.965 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.963+0000 7f6076c13980 1 -- 172.21.15.194:0/2282251839 shutdown_connections 2024-09-13T06:11:45.965 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.963+0000 7f6076c13980 1 -- 172.21.15.194:0/2282251839 wait complete. 2024-09-13T06:11:45.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.975+0000 7f6076c13980 1 Processor -- start 2024-09-13T06:11:45.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.975+0000 7f6076c13980 1 -- start start 2024-09-13T06:11:45.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.975+0000 7f6076c13980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5614f85848f0 0x5614f866fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.975+0000 7f6076c13980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5614f8430200 con 0x5614f85848f0 2024-09-13T06:11:45.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.979+0000 7f6074723640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5614f85848f0 0x5614f866fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.979+0000 7f6074723640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5614f85848f0 0x5614f866fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45258/0 (socket says 172.21.15.194:45258) 2024-09-13T06:11:45.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.979+0000 7f6074723640 1 -- 172.21.15.194:0/1725980438 learned_addr learned my addr 172.21.15.194:0/1725980438 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:45.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.979+0000 7f6074723640 1 -- 172.21.15.194:0/1725980438 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614f8670280 con 0x5614f85848f0 2024-09-13T06:11:45.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.979+0000 7f6074723640 1 --2- 172.21.15.194:0/1725980438 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5614f85848f0 0x5614f866fcb0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f606c001e20 tx=0x7f606c00b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64598030ce798eb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.979+0000 7f5f6260c640 1 -- 172.21.15.194:0/1725980438 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f606c012020 con 0x5614f85848f0 2024-09-13T06:11:45.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.979+0000 7f5f6260c640 1 -- 172.21.15.194:0/1725980438 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f606c00e7c0 con 0x5614f85848f0 2024-09-13T06:11:45.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.979+0000 7f5f6260c640 1 -- 172.21.15.194:0/1725980438 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f606c00eb00 con 0x5614f85848f0 2024-09-13T06:11:45.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.979+0000 7f6076c13980 1 -- 172.21.15.194:0/1725980438 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5614f85848f0 msgr2=0x5614f866fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.979+0000 7f6076c13980 1 --2- 172.21.15.194:0/1725980438 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5614f85848f0 0x5614f866fcb0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f606c001e20 tx=0x7f606c00b790 comp rx=0 tx=0).stop 2024-09-13T06:11:45.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.979+0000 7f6076c13980 1 -- 172.21.15.194:0/1725980438 shutdown_connections 2024-09-13T06:11:45.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.979+0000 7f6076c13980 1 --2- 172.21.15.194:0/1725980438 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5614f85848f0 0x5614f866fcb0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:45.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.979+0000 7f6076c13980 1 -- 172.21.15.194:0/1725980438 >> 172.21.15.194:0/1725980438 conn(0x5614f84f8240 msgr2=0x5614f866b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:45.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.979+0000 7f6076c13980 1 -- 172.21.15.194:0/1725980438 shutdown_connections 2024-09-13T06:11:45.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.979+0000 7f6076c13980 1 -- 172.21.15.194:0/1725980438 wait complete. 2024-09-13T06:11:45.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.979+0000 7f6076c13980 1 Processor -- start 2024-09-13T06:11:45.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.979+0000 7f6076c13980 1 -- start start 2024-09-13T06:11:45.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.979+0000 7f6076c13980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5614f85848f0 0x5614f8677060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.979+0000 7f6076c13980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5614f858c0b0 con 0x5614f85848f0 2024-09-13T06:11:45.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.979+0000 7f6074723640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5614f85848f0 0x5614f8677060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.979+0000 7f6074723640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5614f85848f0 0x5614f8677060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45268/0 (socket says 172.21.15.194:45268) 2024-09-13T06:11:45.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.979+0000 7f6074723640 1 -- 172.21.15.194:0/691413493 learned_addr learned my addr 172.21.15.194:0/691413493 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:45.985 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.979+0000 7f6074723640 1 -- 172.21.15.194:0/691413493 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614f86775a0 con 0x5614f85848f0 2024-09-13T06:11:45.985 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.983+0000 7f6074723640 1 --2- 172.21.15.194:0/691413493 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5614f85848f0 0x5614f8677060 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f606c001e20 tx=0x7f606c000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.985 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.983+0000 7f5f60e09640 1 -- 172.21.15.194:0/691413493 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f606c012030 con 0x5614f85848f0 2024-09-13T06:11:45.985 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.983+0000 7f5f60e09640 1 -- 172.21.15.194:0/691413493 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f606c001480 con 0x5614f85848f0 2024-09-13T06:11:45.985 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.983+0000 7f6076c13980 1 -- 172.21.15.194:0/691413493 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5614f8677830 con 0x5614f85848f0 2024-09-13T06:11:45.986 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.983+0000 7f5f60e09640 1 -- 172.21.15.194:0/691413493 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f606c01a940 con 0x5614f85848f0 2024-09-13T06:11:45.986 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.983+0000 7f6076c13980 1 -- 172.21.15.194:0/691413493 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614f867a510 con 0x5614f85848f0 2024-09-13T06:11:45.986 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.983+0000 7f5f60e09640 1 -- 172.21.15.194:0/691413493 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f606c015020 con 0x5614f85848f0 2024-09-13T06:11:45.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.983+0000 7f5f60e09640 1 --2- 172.21.15.194:0/691413493 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f5f5c0346a0 0x7f5f5c036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.988 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.983+0000 7f5f60e09640 1 -- 172.21.15.194:0/691413493 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f606c020030 con 0x5614f85848f0 2024-09-13T06:11:45.988 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.983+0000 7f6073f22640 1 --2- 172.21.15.194:0/691413493 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f5f5c0346a0 0x7f5f5c036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.988 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.983+0000 7f6076c13980 1 --2- 172.21.15.194:0/691413493 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5614f8588c70 0x5614f867dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.988 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.983+0000 7f6076c13980 1 -- 172.21.15.194:0/691413493 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5614f867e660 con 0x5614f8588c70 2024-09-13T06:11:45.988 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.983+0000 7f6074f24640 1 --2- 172.21.15.194:0/691413493 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5614f8588c70 0x5614f867dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.988 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.983+0000 7f6073f22640 1 --2- 172.21.15.194:0/691413493 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f5f5c0346a0 0x7f5f5c036b60 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f605c0ad000 tx=0x7f605c0a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.988 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.983+0000 7f6074f24640 1 --2- 172.21.15.194:0/691413493 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5614f8588c70 0x5614f867dff0 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.988 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.983+0000 7f6074f24640 1 -- 172.21.15.194:0/691413493 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f606400a4d0 con 0x5614f8588c70 2024-09-13T06:11:45.988 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.983+0000 7f6076c13980 1 -- 172.21.15.194:0/691413493 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5614f867b730 con 0x5614f8588c70 2024-09-13T06:11:45.988 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.983+0000 7f6074f24640 1 -- 172.21.15.194:0/691413493 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f606400a4d0 con 0x5614f8588c70 2024-09-13T06:11:45.988 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.983+0000 7f6076c13980 1 --2- 172.21.15.194:0/691413493 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5614f86809b0 0x5614f8682da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.988 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.983+0000 7f6076c13980 1 -- 172.21.15.194:0/691413493 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5614f8683490 con 0x5614f86809b0 2024-09-13T06:11:45.989 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.983+0000 7f6074723640 1 --2- 172.21.15.194:0/691413493 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5614f86809b0 0x5614f8682da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.989 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.987+0000 7f6074723640 1 --2- 172.21.15.194:0/691413493 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5614f86809b0 0x5614f8682da0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.990 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.987+0000 7f6074723640 1 -- 172.21.15.194:0/691413493 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f606c008030 con 0x5614f86809b0 2024-09-13T06:11:45.990 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.987+0000 7f6076c13980 1 -- 172.21.15.194:0/691413493 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5614f867f850 con 0x5614f8588c70 2024-09-13T06:11:45.990 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.987+0000 7f6074f24640 1 -- 172.21.15.194:0/691413493 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f606400a4d0 con 0x5614f8588c70 2024-09-13T06:11:45.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.987+0000 7f6076c13980 1 --2- 172.21.15.194:0/691413493 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5614f86848f0 0x5614f8686ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.987+0000 7f6076c13980 1 -- 172.21.15.194:0/691413493 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5614f8687420 con 0x5614f86848f0 2024-09-13T06:11:45.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.987+0000 7f6073f22640 1 --2- 172.21.15.194:0/691413493 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5614f86848f0 0x5614f8686ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.987+0000 7f6073f22640 1 --2- 172.21.15.194:0/691413493 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5614f86848f0 0x5614f8686ce0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.987+0000 7f6073f22640 1 -- 172.21.15.194:0/691413493 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f605c0b3040 con 0x5614f86848f0 2024-09-13T06:11:45.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.987+0000 7f6076c13980 1 Processor -- start 2024-09-13T06:11:45.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.987+0000 7f6076c13980 1 -- start start 2024-09-13T06:11:45.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.987+0000 7f6076c13980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5614f8694ef0 0x5614f8695310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.987+0000 7f6076c13980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5614f8489800 con 0x5614f8694ef0 2024-09-13T06:11:45.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.987+0000 7f6074723640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5614f8694ef0 0x5614f8695310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.987+0000 7f6074723640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5614f8694ef0 0x5614f8695310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45270/0 (socket says 172.21.15.194:45270) 2024-09-13T06:11:45.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.987+0000 7f6074723640 1 -- 172.21.15.194:0/1844733770 learned_addr learned my addr 172.21.15.194:0/1844733770 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:45.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.987+0000 7f6074723640 1 -- 172.21.15.194:0/1844733770 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614f8695850 con 0x5614f8694ef0 2024-09-13T06:11:45.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.987+0000 7f6074723640 1 --2- 172.21.15.194:0/1844733770 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5614f8694ef0 0x5614f8695310 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f606c00e790 tx=0x7f606c016b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.987+0000 7f5f59ffb640 1 -- 172.21.15.194:0/1844733770 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f606c017d80 con 0x5614f8694ef0 2024-09-13T06:11:45.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.987+0000 7f5f59ffb640 1 -- 172.21.15.194:0/1844733770 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f606c00c580 con 0x5614f8694ef0 2024-09-13T06:11:45.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.987+0000 7f5f59ffb640 1 -- 172.21.15.194:0/1844733770 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f606c00c860 con 0x5614f8694ef0 2024-09-13T06:11:45.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.991+0000 7f6076c13980 1 -- 172.21.15.194:0/1844733770 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5614f8695ae0 con 0x5614f8694ef0 2024-09-13T06:11:45.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.991+0000 7f6076c13980 1 -- 172.21.15.194:0/1844733770 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614f8698760 con 0x5614f8694ef0 2024-09-13T06:11:45.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.991+0000 7f5f59ffb640 1 -- 172.21.15.194:0/1844733770 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f606c009070 con 0x5614f8694ef0 2024-09-13T06:11:45.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.991+0000 7f5f59ffb640 1 --2- 172.21.15.194:0/1844733770 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f5f4c034650 0x7f5f4c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.991+0000 7f5f59ffb640 1 -- 172.21.15.194:0/1844733770 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f606c005050 con 0x5614f8694ef0 2024-09-13T06:11:45.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.991+0000 7f6073f22640 1 --2- 172.21.15.194:0/1844733770 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f5f4c034650 0x7f5f4c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.991+0000 7f6076c13980 1 Processor -- start 2024-09-13T06:11:45.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.991+0000 7f6076c13980 1 -- start start 2024-09-13T06:11:45.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.991+0000 7f6073f22640 1 --2- 172.21.15.194:0/1844733770 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f5f4c034650 0x7f5f4c036b10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x5614f867eb30 tx=0x7f605c005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.991+0000 7f6076c13980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5614f86a17f0 0x5614f86a1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.991+0000 7f6076c13980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5614f8670600 con 0x5614f86a17f0 2024-09-13T06:11:45.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.991+0000 7f6074723640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5614f86a17f0 0x5614f86a1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.991+0000 7f6074723640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5614f86a17f0 0x5614f86a1bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45286/0 (socket says 172.21.15.194:45286) 2024-09-13T06:11:45.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.991+0000 7f6074723640 1 -- 172.21.15.194:0/2814982745 learned_addr learned my addr 172.21.15.194:0/2814982745 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:45.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.991+0000 7f6074723640 1 -- 172.21.15.194:0/2814982745 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614f86a21a0 con 0x5614f86a17f0 2024-09-13T06:11:45.997 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.991+0000 7f6074723640 1 --2- 172.21.15.194:0/2814982745 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5614f86a17f0 0x5614f86a1bd0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f606c0166a0 tx=0x7f606c0249d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccaaf1e7a336c5d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:45.997 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.991+0000 7f5f4b7fe640 1 -- 172.21.15.194:0/2814982745 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f606c02f0b0 con 0x5614f86a17f0 2024-09-13T06:11:45.997 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.991+0000 7f5f4b7fe640 1 -- 172.21.15.194:0/2814982745 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f606c024cf0 con 0x5614f86a17f0 2024-09-13T06:11:45.997 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.991+0000 7f5f4b7fe640 1 -- 172.21.15.194:0/2814982745 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f606c0419b0 con 0x5614f86a17f0 2024-09-13T06:11:45.997 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.995+0000 7f6076c13980 1 -- 172.21.15.194:0/2814982745 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5614f86a17f0 msgr2=0x5614f86a1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:45.997 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.995+0000 7f6076c13980 1 --2- 172.21.15.194:0/2814982745 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5614f86a17f0 0x5614f86a1bd0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f606c0166a0 tx=0x7f606c0249d0 comp rx=0 tx=0).stop 2024-09-13T06:11:45.997 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.995+0000 7f6076c13980 1 -- 172.21.15.194:0/2814982745 shutdown_connections 2024-09-13T06:11:45.997 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.995+0000 7f6076c13980 1 --2- 172.21.15.194:0/2814982745 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5614f86a17f0 0x5614f86a1bd0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:45.998 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.995+0000 7f6076c13980 1 -- 172.21.15.194:0/2814982745 >> 172.21.15.194:0/2814982745 conn(0x5614f869dbd0 msgr2=0x5614f869bcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:45.998 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.995+0000 7f6076c13980 1 -- 172.21.15.194:0/2814982745 shutdown_connections 2024-09-13T06:11:45.998 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.995+0000 7f6076c13980 1 -- 172.21.15.194:0/2814982745 wait complete. 2024-09-13T06:11:45.998 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.995+0000 7f6076c13980 1 Processor -- start 2024-09-13T06:11:45.998 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.995+0000 7f6076c13980 1 -- start start 2024-09-13T06:11:45.998 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.995+0000 7f6076c13980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5614f86a17f0 0x5614f86a89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:45.998 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.995+0000 7f6076c13980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5614f86a2640 con 0x5614f86a17f0 2024-09-13T06:11:45.998 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.995+0000 7f6074723640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5614f86a17f0 0x5614f86a89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:45.998 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.995+0000 7f6074723640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5614f86a17f0 0x5614f86a89f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45294/0 (socket says 172.21.15.194:45294) 2024-09-13T06:11:45.998 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.995+0000 7f6074723640 1 -- 172.21.15.194:0/2119056928 learned_addr learned my addr 172.21.15.194:0/2119056928 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:46.000 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.995+0000 7f6074723640 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614f86a8f30 con 0x5614f86a17f0 2024-09-13T06:11:46.000 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.995+0000 7f6074723640 1 --2- 172.21.15.194:0/2119056928 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5614f86a17f0 0x5614f86a89f0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f606c005f70 tx=0x7f606c009f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.000 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.995+0000 7f5f49ffb640 1 -- 172.21.15.194:0/2119056928 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f606c02f0b0 con 0x5614f86a17f0 2024-09-13T06:11:46.000 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.995+0000 7f5f49ffb640 1 -- 172.21.15.194:0/2119056928 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f606c0489f0 con 0x5614f86a17f0 2024-09-13T06:11:46.000 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.995+0000 7f5f49ffb640 1 -- 172.21.15.194:0/2119056928 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f606c048cd0 con 0x5614f86a17f0 2024-09-13T06:11:46.000 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.995+0000 7f6076c13980 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5614f86a8f30 con 0x5614f86a17f0 2024-09-13T06:11:46.000 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.995+0000 7f6076c13980 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614f86a8f30 con 0x5614f86a17f0 2024-09-13T06:11:46.000 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.995+0000 7f5f49ffb640 1 -- 172.21.15.194:0/2119056928 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f606c060040 con 0x5614f86a17f0 2024-09-13T06:11:46.000 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.995+0000 7f5f49ffb640 1 --2- 172.21.15.194:0/2119056928 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f5f3c034650 0x7f5f3c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.001 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.999+0000 7f5f49ffb640 1 -- 172.21.15.194:0/2119056928 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f606c05e020 con 0x5614f86a17f0 2024-09-13T06:11:46.001 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.999+0000 7f6076c13980 20 rados->read ofs=0 len=0 2024-09-13T06:11:46.001 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.999+0000 7f6073f22640 1 --2- 172.21.15.194:0/2119056928 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f5f3c034650 0x7f5f3c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.001 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.999+0000 7f6076c13980 1 --2- 172.21.15.194:0/2119056928 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5614f86b3ae0 0x5614f86b5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.001 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.999+0000 7f6076c13980 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5614f86b66f0 con 0x5614f86b3ae0 2024-09-13T06:11:46.001 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.999+0000 7f6074f24640 1 --2- 172.21.15.194:0/2119056928 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5614f86b3ae0 0x5614f86b5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.999+0000 7f6073f22640 1 --2- 172.21.15.194:0/2119056928 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f5f3c034650 0x7f5f3c036b10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f605c000c10 tx=0x7f605c0b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.999+0000 7f6074f24640 1 --2- 172.21.15.194:0/2119056928 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5614f86b3ae0 0x5614f86b5fa0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.999+0000 7f6074f24640 1 -- 172.21.15.194:0/2119056928 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f606400a4d0 con 0x5614f86b3ae0 2024-09-13T06:11:46.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.999+0000 7f6076c13980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:46.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.999+0000 7f6076c13980 20 realm 2024-09-13T06:11:46.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.999+0000 7f6076c13980 20 rados->read ofs=0 len=0 2024-09-13T06:11:46.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.999+0000 7f6076c13980 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5614f86b6b00 con 0x5614f86b3ae0 2024-09-13T06:11:46.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.999+0000 7f6074f24640 1 -- 172.21.15.194:0/2119056928 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f606400a4d0 con 0x5614f86b3ae0 2024-09-13T06:11:46.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.999+0000 7f6076c13980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:46.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.999+0000 7f6076c13980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:11:46.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.999+0000 7f6076c13980 20 rados->read ofs=0 len=0 2024-09-13T06:11:46.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.999+0000 7f6076c13980 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5614f86b73d0 con 0x5614f86b3ae0 2024-09-13T06:11:46.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.999+0000 7f6074f24640 1 -- 172.21.15.194:0/2119056928 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f606400a4d0 con 0x5614f86b3ae0 2024-09-13T06:11:46.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.999+0000 7f6076c13980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:46.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.999+0000 7f6076c13980 20 rados->read ofs=0 len=0 2024-09-13T06:11:46.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.999+0000 7f6076c13980 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5614f86b7770 con 0x5614f86b3ae0 2024-09-13T06:11:46.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.999+0000 7f6074f24640 1 -- 172.21.15.194:0/2119056928 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f606400a4d0 con 0x5614f86b3ae0 2024-09-13T06:11:46.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.999+0000 7f6076c13980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:11:46.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.999+0000 7f6076c13980 20 rados->read ofs=0 len=0 2024-09-13T06:11:46.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.999+0000 7f6076c13980 1 --2- 172.21.15.194:0/2119056928 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5614f86b84d0 0x5614f86ba8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.999+0000 7f6076c13980 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5614f86baed0 con 0x5614f86b84d0 2024-09-13T06:11:46.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.999+0000 7f6074723640 1 --2- 172.21.15.194:0/2119056928 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5614f86b84d0 0x5614f86ba8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.999+0000 7f6074723640 1 --2- 172.21.15.194:0/2119056928 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5614f86b84d0 0x5614f86ba8c0 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.999+0000 7f6074723640 1 -- 172.21.15.194:0/2119056928 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f606c073020 con 0x5614f86b84d0 2024-09-13T06:11:46.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.999+0000 7f6076c13980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:11:46.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.999+0000 7f6076c13980 20 searching for the correct realm 2024-09-13T06:11:46.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.999+0000 7f6076c13980 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5614f86bc7a0 con 0x5614f86b84d0 2024-09-13T06:11:46.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.999+0000 7f6074723640 1 -- 172.21.15.194:0/2119056928 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f606c073020 con 0x5614f86b84d0 2024-09-13T06:11:46.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.999+0000 7f6074723640 1 --2- 172.21.15.194:0/2119056928 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f606c063050 0x7f606c02d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.999+0000 7f6074723640 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5614f86bc7a0 con 0x7f606c063050 2024-09-13T06:11:46.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.999+0000 7f6073f22640 1 --2- 172.21.15.194:0/2119056928 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f606c063050 0x7f606c02d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.999+0000 7f6073f22640 1 --2- 172.21.15.194:0/2119056928 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f606c063050 0x7f606c02d3f0 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.999+0000 7f6073f22640 1 -- 172.21.15.194:0/2119056928 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f605c0c9030 con 0x7f606c063050 2024-09-13T06:11:46.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.999+0000 7f6073f22640 1 --2- 172.21.15.194:0/2119056928 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f605c0dc040 0x7f605c0dd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:45.999+0000 7f6073f22640 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5614f86bc7a0 con 0x7f605c0dc040 2024-09-13T06:11:46.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.003+0000 7f6074f24640 1 --2- 172.21.15.194:0/2119056928 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f605c0dc040 0x7f605c0dd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.003+0000 7f6074f24640 1 --2- 172.21.15.194:0/2119056928 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f605c0dc040 0x7f605c0dd430 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.003+0000 7f6074f24640 1 -- 172.21.15.194:0/2119056928 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f606400a4d0 con 0x7f605c0dc040 2024-09-13T06:11:46.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.003+0000 7f6074f24640 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5614f86b7770 con 0x5614f86b3ae0 2024-09-13T06:11:46.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.003+0000 7f6074f24640 1 -- 172.21.15.194:0/2119056928 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f606400a4d0 con 0x5614f86b3ae0 2024-09-13T06:11:46.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.003+0000 7f6074f24640 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5614f86b7770 con 0x5614f86b3ae0 2024-09-13T06:11:46.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.003+0000 7f6074f24640 1 -- 172.21.15.194:0/2119056928 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f606400a4d0 con 0x5614f86b3ae0 2024-09-13T06:11:46.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.003+0000 7f6074f24640 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5614f86b7770 con 0x7f605c0dc040 2024-09-13T06:11:46.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.003+0000 7f6074f24640 1 -- 172.21.15.194:0/2119056928 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f606400a4d0 con 0x7f605c0dc040 2024-09-13T06:11:46.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.003+0000 7f6074f24640 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5614f86b7770 con 0x7f605c0dc040 2024-09-13T06:11:46.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.003+0000 7f6074f24640 1 -- 172.21.15.194:0/2119056928 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f606400a4d0 con 0x7f605c0dc040 2024-09-13T06:11:46.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.003+0000 7f6074f24640 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5614f86b7770 con 0x7f606c063050 2024-09-13T06:11:46.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.003+0000 7f6073f22640 1 -- 172.21.15.194:0/2119056928 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f605c0c9030 con 0x7f606c063050 2024-09-13T06:11:46.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.003+0000 7f6073f22640 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5614f86b7770 con 0x5614f86b84d0 2024-09-13T06:11:46.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.003+0000 7f6074723640 1 -- 172.21.15.194:0/2119056928 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f606c073020 con 0x5614f86b84d0 2024-09-13T06:11:46.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.003+0000 7f6074723640 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5614f86b7770 con 0x5614f86b3ae0 2024-09-13T06:11:46.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.007+0000 7f6074f24640 1 -- 172.21.15.194:0/2119056928 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f606400a4d0 con 0x5614f86b3ae0 2024-09-13T06:11:46.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.007+0000 7f6074f24640 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5614f86b7770 con 0x7f605c0dc040 2024-09-13T06:11:46.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.007+0000 7f6074f24640 1 -- 172.21.15.194:0/2119056928 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f606400a4d0 con 0x7f605c0dc040 2024-09-13T06:11:46.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.007+0000 7f6074f24640 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5614f86b7770 con 0x5614f86b3ae0 2024-09-13T06:11:46.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.007+0000 7f6074f24640 1 -- 172.21.15.194:0/2119056928 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f606400a4d0 con 0x5614f86b3ae0 2024-09-13T06:11:46.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.007+0000 7f6074f24640 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5614f86b7770 con 0x7f606c063050 2024-09-13T06:11:46.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.007+0000 7f6073f22640 1 -- 172.21.15.194:0/2119056928 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f605c0c9030 con 0x7f606c063050 2024-09-13T06:11:46.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.007+0000 7f6073f22640 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5614f86b7770 con 0x5614f86b84d0 2024-09-13T06:11:46.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.007+0000 7f6074723640 1 -- 172.21.15.194:0/2119056928 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f606c073020 con 0x5614f86b84d0 2024-09-13T06:11:46.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.007+0000 7f6074723640 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5614f86b7770 con 0x5614f86b84d0 2024-09-13T06:11:46.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.007+0000 7f6074723640 1 -- 172.21.15.194:0/2119056928 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f606c073020 con 0x5614f86b84d0 2024-09-13T06:11:46.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.007+0000 7f6074723640 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5614f86b7770 con 0x7f605c0dc040 2024-09-13T06:11:46.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.007+0000 7f6074f24640 1 -- 172.21.15.194:0/2119056928 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f606400a4d0 con 0x7f605c0dc040 2024-09-13T06:11:46.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.007+0000 7f6074f24640 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5614f86b7770 con 0x5614f86b84d0 2024-09-13T06:11:46.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.007+0000 7f6074723640 1 -- 172.21.15.194:0/2119056928 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f606c073020 con 0x5614f86b84d0 2024-09-13T06:11:46.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.007+0000 7f6074723640 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5614f86b7770 con 0x5614f86b84d0 2024-09-13T06:11:46.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.007+0000 7f6074723640 1 -- 172.21.15.194:0/2119056928 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f606c073020 con 0x5614f86b84d0 2024-09-13T06:11:46.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.007+0000 7f6074723640 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5614f86b7770 con 0x5614f86b3ae0 2024-09-13T06:11:46.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.007+0000 7f6074f24640 1 -- 172.21.15.194:0/2119056928 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f606400a4d0 con 0x5614f86b3ae0 2024-09-13T06:11:46.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.007+0000 7f6074f24640 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5614f86b7770 con 0x5614f86b3ae0 2024-09-13T06:11:46.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.011+0000 7f6074f24640 1 -- 172.21.15.194:0/2119056928 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v35'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f606400a4d0 con 0x5614f86b3ae0 2024-09-13T06:11:46.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.011+0000 7f6074f24640 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5614f86b7770 con 0x7f606c063050 2024-09-13T06:11:46.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.011+0000 7f6073f22640 1 -- 172.21.15.194:0/2119056928 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f605c0c9030 con 0x7f606c063050 2024-09-13T06:11:46.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.011+0000 7f6073f22640 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5614f86b7770 con 0x5614f86b84d0 2024-09-13T06:11:46.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.011+0000 7f6074723640 1 -- 172.21.15.194:0/2119056928 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f606c073020 con 0x5614f86b84d0 2024-09-13T06:11:46.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.011+0000 7f6074723640 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5614f86b7770 con 0x7f606c063050 2024-09-13T06:11:46.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.011+0000 7f6073f22640 1 -- 172.21.15.194:0/2119056928 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f605c0c9030 con 0x7f606c063050 2024-09-13T06:11:46.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.011+0000 7f6073f22640 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5614f86b7770 con 0x5614f86b3ae0 2024-09-13T06:11:46.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.011+0000 7f6074f24640 1 -- 172.21.15.194:0/2119056928 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f606400a4d0 con 0x5614f86b3ae0 2024-09-13T06:11:46.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.011+0000 7f6074f24640 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5614f86b7770 con 0x7f605c0dc040 2024-09-13T06:11:46.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.011+0000 7f6074f24640 1 -- 172.21.15.194:0/2119056928 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f606400a4d0 con 0x7f605c0dc040 2024-09-13T06:11:46.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.011+0000 7f6074f24640 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5614f86b7770 con 0x5614f86b84d0 2024-09-13T06:11:46.017 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.011+0000 7f6074723640 1 -- 172.21.15.194:0/2119056928 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=107b] v35'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f606c073020 con 0x5614f86b84d0 2024-09-13T06:11:46.017 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.011+0000 7f6074723640 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5614f86b7770 con 0x7f606c063050 2024-09-13T06:11:46.017 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.011+0000 7f6073f22640 1 -- 172.21.15.194:0/2119056928 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f605c0c9030 con 0x7f606c063050 2024-09-13T06:11:46.017 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.011+0000 7f6073f22640 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5614f86b7770 con 0x7f606c063050 2024-09-13T06:11:46.017 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.011+0000 7f6073f22640 1 -- 172.21.15.194:0/2119056928 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f605c0c9030 con 0x7f606c063050 2024-09-13T06:11:46.017 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.011+0000 7f6073f22640 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5614f86b7770 con 0x5614f86b84d0 2024-09-13T06:11:46.017 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.011+0000 7f6074723640 1 -- 172.21.15.194:0/2119056928 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f606c073020 con 0x5614f86b84d0 2024-09-13T06:11:46.017 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.011+0000 7f6074723640 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5614f86b7770 con 0x7f605c0dc040 2024-09-13T06:11:46.021 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.011+0000 7f6074f24640 1 -- 172.21.15.194:0/2119056928 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f606400a4d0 con 0x7f605c0dc040 2024-09-13T06:11:46.021 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.011+0000 7f6074f24640 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5614f86b7770 con 0x5614f86b3ae0 2024-09-13T06:11:46.021 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.015+0000 7f6074f24640 1 -- 172.21.15.194:0/2119056928 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v35'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f606400a4d0 con 0x5614f86b3ae0 2024-09-13T06:11:46.021 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.015+0000 7f6074f24640 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5614f86b7770 con 0x7f606c063050 2024-09-13T06:11:46.021 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.015+0000 7f6073f22640 1 -- 172.21.15.194:0/2119056928 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f605c0c9030 con 0x7f606c063050 2024-09-13T06:11:46.021 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.015+0000 7f6076c13980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:11:46.021 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.015+0000 7f6076c13980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:11:46.021 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.015+0000 7f6076c13980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:11:46.021 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.015+0000 7f6076c13980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:11:46.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.015+0000 7f6076c13980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:11:46.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.015+0000 7f6076c13980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:11:46.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.015+0000 7f6076c13980 20 rados->read ofs=0 len=0 2024-09-13T06:11:46.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.015+0000 7f6076c13980 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5614f86bb8c0 con 0x5614f86b3ae0 2024-09-13T06:11:46.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.015+0000 7f6074f24640 1 -- 172.21.15.194:0/2119056928 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f606400a4d0 con 0x5614f86b3ae0 2024-09-13T06:11:46.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.015+0000 7f6076c13980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:46.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.015+0000 7f6076c13980 20 rados->read ofs=0 len=0 2024-09-13T06:11:46.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.015+0000 7f6076c13980 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5614f86bc110 con 0x5614f86b3ae0 2024-09-13T06:11:46.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.015+0000 7f6074f24640 1 -- 172.21.15.194:0/2119056928 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f606400a4d0 con 0x5614f86b3ae0 2024-09-13T06:11:46.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.015+0000 7f6076c13980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:11:46.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.015+0000 7f6076c13980 20 rados->read ofs=0 len=0 2024-09-13T06:11:46.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.015+0000 7f6076c13980 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5614f86bbc60 con 0x7f606c063050 2024-09-13T06:11:46.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.015+0000 7f6073f22640 1 -- 172.21.15.194:0/2119056928 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f605c0c9030 con 0x7f606c063050 2024-09-13T06:11:46.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.015+0000 7f6076c13980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:11:46.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.015+0000 7f6076c13980 20 zone default found 2024-09-13T06:11:46.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.015+0000 7f6076c13980 4 Realm: () 2024-09-13T06:11:46.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.015+0000 7f6076c13980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:11:46.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.015+0000 7f6076c13980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:11:46.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.015+0000 7f6076c13980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:11:46.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.015+0000 7f6076c13980 20 zonegroup default 2024-09-13T06:11:46.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.015+0000 7f6076c13980 20 rados->read ofs=0 len=0 2024-09-13T06:11:46.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.015+0000 7f6076c13980 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5614f86bcbd0 con 0x7f605c0dc040 2024-09-13T06:11:46.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.015+0000 7f6074f24640 1 -- 172.21.15.194:0/2119056928 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f606400a4d0 con 0x7f605c0dc040 2024-09-13T06:11:46.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.015+0000 7f6076c13980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:46.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.015+0000 7f6076c13980 20 rados->read ofs=0 len=0 2024-09-13T06:11:46.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.015+0000 7f6076c13980 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5614f86be5b0 con 0x5614f86b84d0 2024-09-13T06:11:46.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.015+0000 7f6074723640 1 -- 172.21.15.194:0/2119056928 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f606c073020 con 0x5614f86b84d0 2024-09-13T06:11:46.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.015+0000 7f6076c13980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:46.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.015+0000 7f6076c13980 20 rados->read ofs=0 len=0 2024-09-13T06:11:46.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.015+0000 7f6076c13980 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5614f86bead0 con 0x5614f86b84d0 2024-09-13T06:11:46.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.015+0000 7f6074723640 1 -- 172.21.15.194:0/2119056928 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f606c073020 con 0x5614f86b84d0 2024-09-13T06:11:46.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.015+0000 7f6076c13980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:46.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.015+0000 7f6076c13980 20 started sync module instance, tier type = 2024-09-13T06:11:46.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.015+0000 7f6076c13980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:11:46.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.015+0000 7f6076c13980 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5614f86bda50 con 0x7f606c063050 2024-09-13T06:11:46.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.019+0000 7f6073f22640 1 -- 172.21.15.194:0/2119056928 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(44 notify.0 [create] v35'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f605c0c9030 con 0x7f606c063050 2024-09-13T06:11:46.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.019+0000 7f6076c13980 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94648067153472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5614f86bd6b0 con 0x7f606c063050 2024-09-13T06:11:46.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.019+0000 7f6076c13980 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5614f86bf8f0 con 0x5614f86b3ae0 2024-09-13T06:11:46.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.019+0000 7f6073f22640 1 -- 172.21.15.194:0/2119056928 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94648067153472] v35'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f605c0c9030 con 0x7f606c063050 2024-09-13T06:11:46.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.019+0000 7f6074f24640 1 -- 172.21.15.194:0/2119056928 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v35'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f606400a4d0 con 0x5614f86b3ae0 2024-09-13T06:11:46.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.019+0000 7f6076c13980 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94648067157808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5614f86bfce0 con 0x5614f86b3ae0 2024-09-13T06:11:46.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.019+0000 7f6076c13980 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5614f86c06a0 con 0x5614f86b84d0 2024-09-13T06:11:46.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.023+0000 7f6074f24640 1 -- 172.21.15.194:0/2119056928 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94648067157808] v35'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f606400a4d0 con 0x5614f86b3ae0 2024-09-13T06:11:46.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.023+0000 7f6074723640 1 -- 172.21.15.194:0/2119056928 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v35'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f606c073020 con 0x5614f86b84d0 2024-09-13T06:11:46.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.023+0000 7f6076c13980 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94648067162608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5614f86c0a90 con 0x5614f86b84d0 2024-09-13T06:11:46.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.023+0000 7f6076c13980 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5614f86c1450 con 0x7f606c063050 2024-09-13T06:11:46.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.023+0000 7f6073f22640 1 -- 172.21.15.194:0/2119056928 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(50 notify.3 [create] v35'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f605c0c9030 con 0x7f606c063050 2024-09-13T06:11:46.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.023+0000 7f6076c13980 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94648067166112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5614f86c1ca0 con 0x7f606c063050 2024-09-13T06:11:46.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.023+0000 7f6076c13980 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5614f86c26a0 con 0x5614f86b3ae0 2024-09-13T06:11:46.028 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.023+0000 7f6074723640 1 -- 172.21.15.194:0/2119056928 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94648067162608] v35'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f606c073020 con 0x5614f86b84d0 2024-09-13T06:11:46.028 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.023+0000 7f6073f22640 1 -- 172.21.15.194:0/2119056928 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94648067166112] v35'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f605c0c9030 con 0x7f606c063050 2024-09-13T06:11:46.028 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.027+0000 7f6074f24640 1 -- 172.21.15.194:0/2119056928 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v35'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f606400a4d0 con 0x5614f86b3ae0 2024-09-13T06:11:46.028 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.027+0000 7f6076c13980 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94648067158864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5614f86c17f0 con 0x5614f86b3ae0 2024-09-13T06:11:46.028 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.027+0000 7f6076c13980 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5614f86c2f40 con 0x7f605c0dc040 2024-09-13T06:11:46.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.027+0000 7f6074f24640 1 -- 172.21.15.194:0/2119056928 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94648067158864] v35'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f606400a4d0 con 0x5614f86b3ae0 2024-09-13T06:11:46.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.027+0000 7f6074f24640 1 -- 172.21.15.194:0/2119056928 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(54 notify.5 [create] v35'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f606400a4d0 con 0x7f605c0dc040 2024-09-13T06:11:46.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.027+0000 7f6076c13980 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94648067170736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5614f86c17f0 con 0x7f605c0dc040 2024-09-13T06:11:46.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.027+0000 7f6076c13980 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5614f86c33d0 con 0x7f605c0dc040 2024-09-13T06:11:46.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.031+0000 7f6074f24640 1 -- 172.21.15.194:0/2119056928 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94648067170736] v35'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f606400a4d0 con 0x7f605c0dc040 2024-09-13T06:11:46.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.031+0000 7f6074f24640 1 -- 172.21.15.194:0/2119056928 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(56 notify.6 [create] v35'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f606400a4d0 con 0x7f605c0dc040 2024-09-13T06:11:46.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.031+0000 7f6076c13980 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94648067172544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5614f86c3390 con 0x7f605c0dc040 2024-09-13T06:11:46.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.031+0000 7f6076c13980 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5614f86c3e10 con 0x7f605c0dc040 2024-09-13T06:11:46.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.031+0000 7f6074f24640 1 -- 172.21.15.194:0/2119056928 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94648067172544] v35'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f606400a4d0 con 0x7f605c0dc040 2024-09-13T06:11:46.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.031+0000 7f6074f24640 1 -- 172.21.15.194:0/2119056928 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(58 notify.7 [create] v35'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f606400a4d0 con 0x7f605c0dc040 2024-09-13T06:11:46.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.031+0000 7f6076c13980 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94648067174112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5614f86c3ff0 con 0x7f605c0dc040 2024-09-13T06:11:46.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.031+0000 7f6076c13980 20 add_watcher() i=0 2024-09-13T06:11:46.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.031+0000 7f6076c13980 20 add_watcher() i=1 2024-09-13T06:11:46.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.031+0000 7f6076c13980 20 add_watcher() i=2 2024-09-13T06:11:46.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.031+0000 7f6076c13980 20 add_watcher() i=3 2024-09-13T06:11:46.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.031+0000 7f6076c13980 20 add_watcher() i=4 2024-09-13T06:11:46.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.031+0000 7f6076c13980 20 add_watcher() i=5 2024-09-13T06:11:46.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.031+0000 7f6076c13980 20 add_watcher() i=6 2024-09-13T06:11:46.037 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.035+0000 7f6074f24640 1 -- 172.21.15.194:0/2119056928 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94648067174112] v35'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f606400a4d0 con 0x7f605c0dc040 2024-09-13T06:11:46.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.035+0000 7f6076c13980 20 add_watcher() i=7 2024-09-13T06:11:46.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.035+0000 7f6076c13980 2 all 8 watchers are set, enabling cache 2024-09-13T06:11:46.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.035+0000 7f6076c13980 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5614f86c71c0 con 0x5614f86b3ae0 2024-09-13T06:11:46.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.035+0000 7f6074f24640 1 -- 172.21.15.194:0/2119056928 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f606400a4d0 con 0x5614f86b3ae0 2024-09-13T06:11:46.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.035+0000 7f6076c13980 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94648067189648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5614f86c3f60 con 0x5614f86b3ae0 2024-09-13T06:11:46.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.035+0000 7f6074f24640 1 -- 172.21.15.194:0/2119056928 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94648067189648] v35'257 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f606400a4d0 con 0x5614f86b3ae0 2024-09-13T06:11:46.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.035+0000 7f5f2afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:11:46.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.035+0000 7f6076c13980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:11:46.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.035+0000 7f6076c13980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:11:46.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.035+0000 7f6076c13980 5 note: GC not initialized 2024-09-13T06:11:46.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.039+0000 7f5f29fdb640 20 reqs_thread_entry: start 2024-09-13T06:11:46.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.039+0000 7f6076c13980 20 init_complete bucket index max shards: 11 2024-09-13T06:11:46.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.039+0000 7f6076c13980 20 Filter name: none 2024-09-13T06:11:46.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.039+0000 7f5e9b7fe640 20 reqs_thread_entry: start 2024-09-13T06:11:46.041 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.039+0000 7f6076c13980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T06:11:46.041 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.039+0000 7f6076c13980 20 rados->read ofs=0 len=0 2024-09-13T06:11:46.041 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.039+0000 7f6076c13980 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5614f86ea8e0 con 0x7f605c0dc040 2024-09-13T06:11:46.041 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.039+0000 7f6074f24640 1 -- 172.21.15.194:0/2119056928 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f606400a4d0 con 0x7f605c0dc040 2024-09-13T06:11:46.041 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.039+0000 7f6076c13980 20 rados_obj.operate() r=0 bl.length=460 2024-09-13T06:11:46.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.039+0000 7f6076c13980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-13T06:11:46.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.039+0000 7f6076c13980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T06:11:46.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.039+0000 7f6076c13980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:11:46.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.039+0000 7f6076c13980 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5614f86f0ef0 con 0x7f605c0dc040 2024-09-13T06:11:46.044 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.043+0000 7f6074f24640 1 -- 172.21.15.194:0/2119056928 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v35'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f606400a4d0 con 0x7f605c0dc040 2024-09-13T06:11:46.044 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.043+0000 7f6076c13980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T06:11:46.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.043+0000 7f6076c13980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T06:11:46.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.043+0000 7f6076c13980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T06:11:46.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.043+0000 7f6076c13980 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94648067361120 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5614f86ec600 con 0x5614f86b3ae0 2024-09-13T06:11:46.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.043+0000 7f6074f24640 1 -- 172.21.15.194:0/2119056928 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== watch-notify(notify (1) cookie 94648067158864 notify 150323855384 ret 0) ==== 708+0+0 (crc 0 0 0) 0x7f606402d040 con 0x5614f86b3ae0 2024-09-13T06:11:46.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.043+0000 7f5f4b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855384 cookie 94648067158864 notifier 4871 bl.length()=666 2024-09-13T06:11:46.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.043+0000 7f5f4b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T06:11:46.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.043+0000 7f5f4b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T06:11:46.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.043+0000 7f5f4b7fe640 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f5f40003eb0 con 0x5614f86b3ae0 2024-09-13T06:11:46.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.043+0000 7f6074f24640 1 -- 172.21.15.194:0/2119056928 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(64 notify.4 [notify cookie 94648067361120 out=8b] v0'0 uv258 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f606400a4d0 con 0x5614f86b3ae0 2024-09-13T06:11:46.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.043+0000 7f6074f24640 1 -- 172.21.15.194:0/2119056928 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f606400a4d0 con 0x5614f86b3ae0 2024-09-13T06:11:46.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.043+0000 7f6074f24640 1 -- 172.21.15.194:0/2119056928 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== watch-notify(notify_complete (2) cookie 94648067361120 notify 150323855384 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f606401e040 con 0x5614f86b3ae0 2024-09-13T06:11:46.046 INFO:teuthology.orchestra.run.smithi194.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T06:11:44.596796Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"read"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:11:44.596784Z","tags":[],"group_ids":[]} 2024-09-13T06:11:46.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.043+0000 7f5f2afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:11:46.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.043+0000 7f6076c13980 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94648067189648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5614f86e86e0 con 0x5614f86b3ae0 2024-09-13T06:11:46.047 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.043+0000 7f6074f24640 1 -- 172.21.15.194:0/2119056928 <== osd.1 v2:172.21.15.194:6808/3135444559 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94648067189648] v35'258 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f606400a4d0 con 0x5614f86b3ae0 2024-09-13T06:11:46.047 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.043+0000 7f6076c13980 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94648067153472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5614f86e86e0 con 0x7f606c063050 2024-09-13T06:11:46.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.047+0000 7f6073f22640 1 -- 172.21.15.194:0/2119056928 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94648067153472] v35'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f605c0c9030 con 0x7f606c063050 2024-09-13T06:11:46.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.047+0000 7f6076c13980 20 remove_watcher() i=0 2024-09-13T06:11:46.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.047+0000 7f6076c13980 2 removed watcher, disabling cache 2024-09-13T06:11:46.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.047+0000 7f6076c13980 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94648067157808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5614f86e86e0 con 0x5614f86b3ae0 2024-09-13T06:11:46.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.047+0000 7f6074f24640 1 -- 172.21.15.194:0/2119056928 <== osd.1 v2:172.21.15.194:6808/3135444559 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94648067157808] v35'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f606400a4d0 con 0x5614f86b3ae0 2024-09-13T06:11:46.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.047+0000 7f6076c13980 20 remove_watcher() i=1 2024-09-13T06:11:46.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.047+0000 7f6076c13980 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94648067162608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5614f86bef30 con 0x5614f86b84d0 2024-09-13T06:11:46.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.051+0000 7f6074723640 1 -- 172.21.15.194:0/2119056928 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94648067162608] v35'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f606c073020 con 0x5614f86b84d0 2024-09-13T06:11:46.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.051+0000 7f6076c13980 20 remove_watcher() i=2 2024-09-13T06:11:46.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.051+0000 7f6076c13980 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94648067166112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5614f86e86e0 con 0x7f606c063050 2024-09-13T06:11:46.057 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.051+0000 7f6073f22640 1 -- 172.21.15.194:0/2119056928 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94648067166112] v35'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f605c0c9030 con 0x7f606c063050 2024-09-13T06:11:46.057 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.051+0000 7f6076c13980 20 remove_watcher() i=3 2024-09-13T06:11:46.057 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.051+0000 7f6076c13980 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94648067158864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5614f86bef30 con 0x5614f86b3ae0 2024-09-13T06:11:46.057 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.055+0000 7f6074f24640 1 -- 172.21.15.194:0/2119056928 <== osd.1 v2:172.21.15.194:6808/3135444559 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94648067158864] v35'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f606400a4d0 con 0x5614f86b3ae0 2024-09-13T06:11:46.057 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.055+0000 7f6076c13980 20 remove_watcher() i=4 2024-09-13T06:11:46.057 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.055+0000 7f6076c13980 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94648067170736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5614f86c0fa0 con 0x7f605c0dc040 2024-09-13T06:11:46.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.055+0000 7f6074f24640 1 -- 172.21.15.194:0/2119056928 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94648067170736] v35'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f606400a4d0 con 0x7f605c0dc040 2024-09-13T06:11:46.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.055+0000 7f6076c13980 20 remove_watcher() i=5 2024-09-13T06:11:46.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.055+0000 7f6076c13980 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94648067172544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5614f86e86e0 con 0x7f605c0dc040 2024-09-13T06:11:46.061 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.059+0000 7f6074f24640 1 -- 172.21.15.194:0/2119056928 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94648067172544] v35'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f606400a4d0 con 0x7f605c0dc040 2024-09-13T06:11:46.061 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.059+0000 7f6076c13980 20 remove_watcher() i=6 2024-09-13T06:11:46.061 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.059+0000 7f6076c13980 1 -- 172.21.15.194:0/2119056928 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94648067174112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5614f86c0fa0 con 0x7f605c0dc040 2024-09-13T06:11:46.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.059+0000 7f6074f24640 1 -- 172.21.15.194:0/2119056928 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94648067174112] v35'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f606400a4d0 con 0x7f605c0dc040 2024-09-13T06:11:46.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.059+0000 7f6076c13980 20 remove_watcher() i=7 2024-09-13T06:11:46.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.059+0000 7f6076c13980 1 -- 172.21.15.194:0/2119056928 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f605c0dc040 msgr2=0x7f605c0dd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.059+0000 7f6076c13980 1 --2- 172.21.15.194:0/2119056928 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f605c0dc040 0x7f605c0dd430 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.059+0000 7f6076c13980 1 -- 172.21.15.194:0/2119056928 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5614f86b3ae0 msgr2=0x5614f86b5fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.059+0000 7f6076c13980 1 --2- 172.21.15.194:0/2119056928 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5614f86b3ae0 0x5614f86b5fa0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.059+0000 7f6076c13980 1 -- 172.21.15.194:0/2119056928 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f606c063050 msgr2=0x7f606c02d3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.059+0000 7f6076c13980 1 --2- 172.21.15.194:0/2119056928 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f606c063050 0x7f606c02d3f0 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.059+0000 7f6076c13980 1 -- 172.21.15.194:0/2119056928 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5614f86b84d0 msgr2=0x5614f86ba8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.059+0000 7f6076c13980 1 --2- 172.21.15.194:0/2119056928 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5614f86b84d0 0x5614f86ba8c0 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.063+0000 7f6076c13980 1 -- 172.21.15.194:0/2119056928 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f5f3c034650 msgr2=0x7f5f3c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.063+0000 7f6076c13980 1 --2- 172.21.15.194:0/2119056928 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f5f3c034650 0x7f5f3c036b10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f605c000c10 tx=0x7f605c0b9040 comp rx=0 tx=0).stop 2024-09-13T06:11:46.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.063+0000 7f6076c13980 1 -- 172.21.15.194:0/2119056928 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5614f86a17f0 msgr2=0x5614f86a89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.063+0000 7f6076c13980 1 --2- 172.21.15.194:0/2119056928 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5614f86a17f0 0x5614f86a89f0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f606c005f70 tx=0x7f606c009f20 comp rx=0 tx=0).stop 2024-09-13T06:11:46.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.063+0000 7f6074f24640 1 -- 172.21.15.194:0/2119056928 reap_dead start 2024-09-13T06:11:46.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.063+0000 7f6076c13980 1 -- 172.21.15.194:0/2119056928 shutdown_connections 2024-09-13T06:11:46.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.063+0000 7f6076c13980 1 -- 172.21.15.194:0/2119056928 >> 172.21.15.194:0/2119056928 conn(0x5614f869dbd0 msgr2=0x5614f869bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:46.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.063+0000 7f6076c13980 1 -- 172.21.15.194:0/2119056928 shutdown_connections 2024-09-13T06:11:46.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.063+0000 7f6076c13980 1 -- 172.21.15.194:0/2119056928 wait complete. 2024-09-13T06:11:46.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.063+0000 7f6076c13980 1 -- 172.21.15.194:0/1844733770 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f5f4c034650 msgr2=0x7f5f4c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.063+0000 7f6076c13980 1 --2- 172.21.15.194:0/1844733770 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f5f4c034650 0x7f5f4c036b10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x5614f867eb30 tx=0x7f605c005a10 comp rx=0 tx=0).stop 2024-09-13T06:11:46.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.063+0000 7f6076c13980 1 -- 172.21.15.194:0/1844733770 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5614f8694ef0 msgr2=0x5614f8695310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.063+0000 7f6076c13980 1 --2- 172.21.15.194:0/1844733770 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5614f8694ef0 0x5614f8695310 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f606c00e790 tx=0x7f606c016b00 comp rx=0 tx=0).stop 2024-09-13T06:11:46.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.063+0000 7f6076c13980 1 -- 172.21.15.194:0/1844733770 shutdown_connections 2024-09-13T06:11:46.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.063+0000 7f6076c13980 1 --2- 172.21.15.194:0/1844733770 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f5f4c034650 0x7f5f4c036b10 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.063+0000 7f6076c13980 1 --2- 172.21.15.194:0/1844733770 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5614f8694ef0 0x5614f8695310 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.063+0000 7f6076c13980 1 -- 172.21.15.194:0/1844733770 >> 172.21.15.194:0/1844733770 conn(0x5614f868a040 msgr2=0x5614f868cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:46.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.063+0000 7f6076c13980 1 -- 172.21.15.194:0/1844733770 shutdown_connections 2024-09-13T06:11:46.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.063+0000 7f6076c13980 1 -- 172.21.15.194:0/1844733770 wait complete. 2024-09-13T06:11:46.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.063+0000 7f6076c13980 1 -- 172.21.15.194:0/691413493 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5614f8588c70 msgr2=0x5614f867dff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.068 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.063+0000 7f6076c13980 1 --2- 172.21.15.194:0/691413493 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x5614f8588c70 0x5614f867dff0 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.068 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.063+0000 7f6076c13980 1 -- 172.21.15.194:0/691413493 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5614f86848f0 msgr2=0x5614f8686ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.068 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.063+0000 7f6076c13980 1 --2- 172.21.15.194:0/691413493 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x5614f86848f0 0x5614f8686ce0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.068 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.063+0000 7f6076c13980 1 -- 172.21.15.194:0/691413493 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5614f86809b0 msgr2=0x5614f8682da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.068 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.063+0000 7f6076c13980 1 --2- 172.21.15.194:0/691413493 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x5614f86809b0 0x5614f8682da0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.068 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.063+0000 7f6076c13980 1 -- 172.21.15.194:0/691413493 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f5f5c0346a0 msgr2=0x7f5f5c036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.068 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.063+0000 7f6076c13980 1 --2- 172.21.15.194:0/691413493 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f5f5c0346a0 0x7f5f5c036b60 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f605c0ad000 tx=0x7f605c0a5040 comp rx=0 tx=0).stop 2024-09-13T06:11:46.068 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.063+0000 7f6076c13980 1 -- 172.21.15.194:0/691413493 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5614f85848f0 msgr2=0x5614f8677060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.068 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.063+0000 7f6076c13980 1 --2- 172.21.15.194:0/691413493 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5614f85848f0 0x5614f8677060 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f606c001e20 tx=0x7f606c000ee0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.068 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.063+0000 7f6074f24640 1 -- 172.21.15.194:0/691413493 reap_dead start 2024-09-13T06:11:46.068 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.063+0000 7f6076c13980 1 -- 172.21.15.194:0/691413493 shutdown_connections 2024-09-13T06:11:46.068 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.063+0000 7f6076c13980 1 -- 172.21.15.194:0/691413493 >> 172.21.15.194:0/691413493 conn(0x5614f84f8240 msgr2=0x5614f866a460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:46.068 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.063+0000 7f6076c13980 1 -- 172.21.15.194:0/691413493 shutdown_connections 2024-09-13T06:11:46.069 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.063+0000 7f6076c13980 1 -- 172.21.15.194:0/691413493 wait complete. 2024-09-13T06:11:46.077 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T06:11:44.596796Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:11:44.596784Z', 'tags': [], 'group_ids': []} 2024-09-13T06:11:46.077 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T06:11:44.596796Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:11:44.596784Z', 'tags': [], 'group_ids': []} 2024-09-13T06:11:46.077 ERROR:root:0 2024-09-13T06:11:46.077 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T06:11:46.089 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T06:11:46.090 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-09-13T06:11:46.090 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-09-13T06:11:46.090 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'user-info-without-keys=*' 2024-09-13T06:11:46.154 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:11:46.154 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:11:46.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.151+0000 7f6d931b7980 1 Processor -- start 2024-09-13T06:11:46.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.151+0000 7f6d931b7980 1 -- start start 2024-09-13T06:11:46.156 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.151+0000 7f6d931b7980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55f20acdac70 0x55f20acdd060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.156 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.151+0000 7f6d931b7980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f20ab5cae0 con 0x55f20acd68f0 2024-09-13T06:11:46.156 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.151+0000 7f6d931b7980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x55f20ab80e30 con 0x55f20acdac70 2024-09-13T06:11:46.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.155+0000 7f6d904c6640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55f20acdac70 0x55f20acdd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.155+0000 7f6d90cc7640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x55f20acd68f0 0x55f20acd6cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:58426/0 (socket says 172.21.15.194:58426) 2024-09-13T06:11:46.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.155+0000 7f6d90cc7640 1 -- 172.21.15.194:0/177973258 learned_addr learned my addr 172.21.15.194:0/177973258 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-09-13T06:11:46.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.155+0000 7f6d8fcc5640 1 -- 172.21.15.194:0/177973258 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3330403577 0 0) 0x55f20ab5cae0 con 0x55f20acd68f0 2024-09-13T06:11:46.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.155+0000 7f6d8fcc5640 1 -- 172.21.15.194:0/177973258 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6d78001e20 con 0x55f20acd68f0 2024-09-13T06:11:46.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.155+0000 7f6d904c6640 1 -- 172.21.15.194:0/177973258 >> v1:172.21.15.120:6789/0 conn(0x55f20acd68f0 legacy=0x55f20acd6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.155+0000 7f6d904c6640 1 -- 172.21.15.194:0/177973258 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f20acde5b0 con 0x55f20acdac70 2024-09-13T06:11:46.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.159+0000 7f6d904c6640 1 --2- 172.21.15.194:0/177973258 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f20acdac70 0x55f20acdd060 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f6d8400a480 tx=0x7f6d8401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82a8efccb78d482e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.159+0000 7f6d8fcc5640 1 -- 172.21.15.194:0/177973258 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d840b0070 con 0x55f20acdac70 2024-09-13T06:11:46.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.159+0000 7f6d8fcc5640 1 -- 172.21.15.194:0/177973258 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d840ab540 con 0x55f20acdac70 2024-09-13T06:11:46.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.159+0000 7f6d8fcc5640 1 -- 172.21.15.194:0/177973258 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d840ab820 con 0x55f20acdac70 2024-09-13T06:11:46.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.159+0000 7f6d931b7980 1 -- 172.21.15.194:0/177973258 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f20acdac70 msgr2=0x55f20acdd060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.163 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.159+0000 7f6d931b7980 1 --2- 172.21.15.194:0/177973258 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f20acdac70 0x55f20acdd060 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f6d8400a480 tx=0x7f6d8401b280 comp rx=0 tx=0).stop 2024-09-13T06:11:46.163 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.159+0000 7f6d931b7980 1 -- 172.21.15.194:0/177973258 shutdown_connections 2024-09-13T06:11:46.163 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.159+0000 7f6d931b7980 1 --2- 172.21.15.194:0/177973258 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f20acdac70 0x55f20acdd060 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.163 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.159+0000 7f6d931b7980 1 -- 172.21.15.194:0/177973258 >> 172.21.15.194:0/177973258 conn(0x55f20ac4a240 msgr2=0x55f20ac4a650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:46.163 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.159+0000 7f6d931b7980 1 -- 172.21.15.194:0/177973258 shutdown_connections 2024-09-13T06:11:46.163 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.159+0000 7f6d931b7980 1 -- 172.21.15.194:0/177973258 wait complete. 2024-09-13T06:11:46.179 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.175+0000 7f6d931b7980 1 Processor -- start 2024-09-13T06:11:46.179 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.175+0000 7f6d931b7980 1 -- start start 2024-09-13T06:11:46.179 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.175+0000 7f6d931b7980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f20acd68f0 0x55f20adc1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.179 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.175+0000 7f6d931b7980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55f20ab82200 con 0x55f20acd68f0 2024-09-13T06:11:46.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.179+0000 7f6d90cc7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f20acd68f0 0x55f20adc1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.179+0000 7f6d90cc7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f20acd68f0 0x55f20adc1a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45306/0 (socket says 172.21.15.194:45306) 2024-09-13T06:11:46.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.179+0000 7f6d90cc7640 1 -- 172.21.15.194:0/852844263 learned_addr learned my addr 172.21.15.194:0/852844263 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:46.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.179+0000 7f6d90cc7640 1 -- 172.21.15.194:0/852844263 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f20adc2060 con 0x55f20acd68f0 2024-09-13T06:11:46.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.179+0000 7f6d90cc7640 1 --2- 172.21.15.194:0/852844263 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f20acd68f0 0x55f20adc1a90 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f6d80001dc0 tx=0x7f6d8000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14854ea125c5743d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.179+0000 7f6c7ee0d640 1 -- 172.21.15.194:0/852844263 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d80012020 con 0x55f20acd68f0 2024-09-13T06:11:46.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.179+0000 7f6c7ee0d640 1 -- 172.21.15.194:0/852844263 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d8000e7c0 con 0x55f20acd68f0 2024-09-13T06:11:46.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.179+0000 7f6c7ee0d640 1 -- 172.21.15.194:0/852844263 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d8000eb40 con 0x55f20acd68f0 2024-09-13T06:11:46.182 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.179+0000 7f6d931b7980 1 -- 172.21.15.194:0/852844263 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f20acd68f0 msgr2=0x55f20adc1a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.182 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.179+0000 7f6d931b7980 1 --2- 172.21.15.194:0/852844263 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f20acd68f0 0x55f20adc1a90 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f6d80001dc0 tx=0x7f6d8000b6d0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.182 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.179+0000 7f6d931b7980 1 -- 172.21.15.194:0/852844263 shutdown_connections 2024-09-13T06:11:46.183 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.179+0000 7f6d931b7980 1 --2- 172.21.15.194:0/852844263 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f20acd68f0 0x55f20adc1a90 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.183 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.179+0000 7f6d931b7980 1 -- 172.21.15.194:0/852844263 >> 172.21.15.194:0/852844263 conn(0x55f20ac4a240 msgr2=0x55f20adbd6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:46.183 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.179+0000 7f6d931b7980 1 -- 172.21.15.194:0/852844263 shutdown_connections 2024-09-13T06:11:46.183 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.179+0000 7f6d931b7980 1 -- 172.21.15.194:0/852844263 wait complete. 2024-09-13T06:11:46.183 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.179+0000 7f6d931b7980 1 Processor -- start 2024-09-13T06:11:46.183 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.179+0000 7f6d931b7980 1 -- start start 2024-09-13T06:11:46.183 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.179+0000 7f6d931b7980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f20acd68f0 0x55f20adc8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.183 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.179+0000 7f6d931b7980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55f20acde0b0 con 0x55f20acd68f0 2024-09-13T06:11:46.184 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.179+0000 7f6d90cc7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f20acd68f0 0x55f20adc8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.184 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.179+0000 7f6d90cc7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f20acd68f0 0x55f20adc8e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45314/0 (socket says 172.21.15.194:45314) 2024-09-13T06:11:46.185 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.179+0000 7f6d90cc7640 1 -- 172.21.15.194:0/3372080696 learned_addr learned my addr 172.21.15.194:0/3372080696 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:46.185 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.179+0000 7f6d90cc7640 1 -- 172.21.15.194:0/3372080696 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f20adc9380 con 0x55f20acd68f0 2024-09-13T06:11:46.185 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.183+0000 7f6d90cc7640 1 --2- 172.21.15.194:0/3372080696 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f20acd68f0 0x55f20adc8e40 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x55f20adc2c70 tx=0x7f6d80000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.185 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.183+0000 7f6c7d60a640 1 -- 172.21.15.194:0/3372080696 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d80012030 con 0x55f20acd68f0 2024-09-13T06:11:46.185 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.183+0000 7f6d931b7980 1 -- 172.21.15.194:0/3372080696 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f20adc9610 con 0x55f20acd68f0 2024-09-13T06:11:46.185 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.183+0000 7f6c7d60a640 1 -- 172.21.15.194:0/3372080696 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d80001440 con 0x55f20acd68f0 2024-09-13T06:11:46.185 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.183+0000 7f6c7d60a640 1 -- 172.21.15.194:0/3372080696 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d8001aaf0 con 0x55f20acd68f0 2024-09-13T06:11:46.185 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.183+0000 7f6d931b7980 1 -- 172.21.15.194:0/3372080696 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f20adcc2f0 con 0x55f20acd68f0 2024-09-13T06:11:46.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.183+0000 7f6c7d60a640 1 -- 172.21.15.194:0/3372080696 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6d80015020 con 0x55f20acd68f0 2024-09-13T06:11:46.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.183+0000 7f6c7d60a640 1 --2- 172.21.15.194:0/3372080696 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6c78034650 0x7f6c78036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.183+0000 7f6c7d60a640 1 -- 172.21.15.194:0/3372080696 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f6d80020030 con 0x55f20acd68f0 2024-09-13T06:11:46.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.183+0000 7f6d904c6640 1 --2- 172.21.15.194:0/3372080696 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6c78034650 0x7f6c78036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.183+0000 7f6d931b7980 1 --2- 172.21.15.194:0/3372080696 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55f20acdac70 0x55f20adcfdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.183+0000 7f6d931b7980 1 -- 172.21.15.194:0/3372080696 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f20add0460 con 0x55f20acdac70 2024-09-13T06:11:46.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.183+0000 7f6d914c8640 1 --2- 172.21.15.194:0/3372080696 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55f20acdac70 0x55f20adcfdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.183+0000 7f6d904c6640 1 --2- 172.21.15.194:0/3372080696 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6c78034650 0x7f6c78036b10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f6d840ad000 tx=0x7f6d840a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.183+0000 7f6d914c8640 1 --2- 172.21.15.194:0/3372080696 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55f20acdac70 0x55f20adcfdf0 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.183+0000 7f6d914c8640 1 -- 172.21.15.194:0/3372080696 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d8800a4d0 con 0x55f20acdac70 2024-09-13T06:11:46.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.183+0000 7f6d931b7980 1 -- 172.21.15.194:0/3372080696 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f20adcd510 con 0x55f20acdac70 2024-09-13T06:11:46.189 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.183+0000 7f6d914c8640 1 -- 172.21.15.194:0/3372080696 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6d8800a4d0 con 0x55f20acdac70 2024-09-13T06:11:46.189 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.183+0000 7f6d931b7980 1 --2- 172.21.15.194:0/3372080696 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55f20add27b0 0x55f20add4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.189 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.183+0000 7f6d931b7980 1 -- 172.21.15.194:0/3372080696 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f20add5270 con 0x55f20add27b0 2024-09-13T06:11:46.189 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.183+0000 7f6d90cc7640 1 --2- 172.21.15.194:0/3372080696 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55f20add27b0 0x55f20add4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.189 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.183+0000 7f6d90cc7640 1 --2- 172.21.15.194:0/3372080696 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55f20add27b0 0x55f20add4ba0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.189 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.187+0000 7f6d90cc7640 1 -- 172.21.15.194:0/3372080696 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6d80008030 con 0x55f20add27b0 2024-09-13T06:11:46.189 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.187+0000 7f6d931b7980 1 -- 172.21.15.194:0/3372080696 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f20add1650 con 0x55f20acdac70 2024-09-13T06:11:46.189 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.187+0000 7f6d914c8640 1 -- 172.21.15.194:0/3372080696 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6d8800a4d0 con 0x55f20acdac70 2024-09-13T06:11:46.189 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.187+0000 7f6d931b7980 1 --2- 172.21.15.194:0/3372080696 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55f20add66d0 0x55f20add8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.189 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.187+0000 7f6d931b7980 1 -- 172.21.15.194:0/3372080696 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f20add9200 con 0x55f20add66d0 2024-09-13T06:11:46.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.187+0000 7f6d904c6640 1 --2- 172.21.15.194:0/3372080696 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55f20add66d0 0x55f20add8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.187+0000 7f6d904c6640 1 --2- 172.21.15.194:0/3372080696 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55f20add66d0 0x55f20add8ac0 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.191 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.187+0000 7f6d904c6640 1 -- 172.21.15.194:0/3372080696 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6d840b3040 con 0x55f20add66d0 2024-09-13T06:11:46.191 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.187+0000 7f6d931b7980 1 Processor -- start 2024-09-13T06:11:46.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.187+0000 7f6d931b7980 1 -- start start 2024-09-13T06:11:46.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.187+0000 7f6d931b7980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f20ade6cf0 0x55f20ade7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.187+0000 7f6d931b7980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55f20abdb800 con 0x55f20ade6cf0 2024-09-13T06:11:46.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.187+0000 7f6d90cc7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f20ade6cf0 0x55f20ade7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.187+0000 7f6d90cc7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f20ade6cf0 0x55f20ade7110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45330/0 (socket says 172.21.15.194:45330) 2024-09-13T06:11:46.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.187+0000 7f6d90cc7640 1 -- 172.21.15.194:0/3653874773 learned_addr learned my addr 172.21.15.194:0/3653874773 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:46.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.187+0000 7f6d90cc7640 1 -- 172.21.15.194:0/3653874773 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f20ade7650 con 0x55f20ade6cf0 2024-09-13T06:11:46.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.187+0000 7f6d90cc7640 1 --2- 172.21.15.194:0/3653874773 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f20ade6cf0 0x55f20ade7110 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f6d80048590 tx=0x7f6d8004a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.187+0000 7f6c767fc640 1 -- 172.21.15.194:0/3653874773 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d80016570 con 0x55f20ade6cf0 2024-09-13T06:11:46.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.187+0000 7f6c767fc640 1 -- 172.21.15.194:0/3653874773 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d80016710 con 0x55f20ade6cf0 2024-09-13T06:11:46.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.187+0000 7f6d931b7980 1 -- 172.21.15.194:0/3653874773 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f20ade7880 con 0x55f20ade6cf0 2024-09-13T06:11:46.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.187+0000 7f6c767fc640 1 -- 172.21.15.194:0/3653874773 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d80018430 con 0x55f20ade6cf0 2024-09-13T06:11:46.193 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.187+0000 7f6d931b7980 1 -- 172.21.15.194:0/3653874773 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f20adea500 con 0x55f20ade6cf0 2024-09-13T06:11:46.194 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.191+0000 7f6c767fc640 1 -- 172.21.15.194:0/3653874773 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6d80009070 con 0x55f20ade6cf0 2024-09-13T06:11:46.194 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.191+0000 7f6c767fc640 1 --2- 172.21.15.194:0/3653874773 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6c68034650 0x7f6c68036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.194 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.191+0000 7f6c767fc640 1 -- 172.21.15.194:0/3653874773 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f6d80037070 con 0x55f20ade6cf0 2024-09-13T06:11:46.194 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.191+0000 7f6d904c6640 1 --2- 172.21.15.194:0/3653874773 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6c68034650 0x7f6c68036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.191+0000 7f6d931b7980 1 Processor -- start 2024-09-13T06:11:46.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.191+0000 7f6d931b7980 1 -- start start 2024-09-13T06:11:46.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.191+0000 7f6d931b7980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f20adf35d0 0x55f20adf39d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.191+0000 7f6d931b7980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55f20adc23e0 con 0x55f20adf35d0 2024-09-13T06:11:46.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.191+0000 7f6d904c6640 1 --2- 172.21.15.194:0/3653874773 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6c68034650 0x7f6c68036b10 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x55f20add0d60 tx=0x7f6d84005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.191+0000 7f6d90cc7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f20adf35d0 0x55f20adf39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.191+0000 7f6d90cc7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f20adf35d0 0x55f20adf39d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45344/0 (socket says 172.21.15.194:45344) 2024-09-13T06:11:46.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.191+0000 7f6d90cc7640 1 -- 172.21.15.194:0/3868284532 learned_addr learned my addr 172.21.15.194:0/3868284532 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:46.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.191+0000 7f6d90cc7640 1 -- 172.21.15.194:0/3868284532 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f20adf3fa0 con 0x55f20adf35d0 2024-09-13T06:11:46.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.191+0000 7f6d90cc7640 1 --2- 172.21.15.194:0/3868284532 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f20adf35d0 0x55f20adf39d0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f6d800307c0 tx=0x7f6d800307f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5acb313fb8f1603b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.197 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.191+0000 7f6c67fff640 1 -- 172.21.15.194:0/3868284532 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d80059030 con 0x55f20adf35d0 2024-09-13T06:11:46.197 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.191+0000 7f6c67fff640 1 -- 172.21.15.194:0/3868284532 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d80041710 con 0x55f20adf35d0 2024-09-13T06:11:46.197 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.191+0000 7f6c67fff640 1 -- 172.21.15.194:0/3868284532 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d80030d20 con 0x55f20adf35d0 2024-09-13T06:11:46.197 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.191+0000 7f6d931b7980 1 -- 172.21.15.194:0/3868284532 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f20adf35d0 msgr2=0x55f20adf39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.191+0000 7f6d931b7980 1 --2- 172.21.15.194:0/3868284532 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f20adf35d0 0x55f20adf39d0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f6d800307c0 tx=0x7f6d800307f0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.191+0000 7f6d931b7980 1 -- 172.21.15.194:0/3868284532 shutdown_connections 2024-09-13T06:11:46.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.191+0000 7f6d931b7980 1 --2- 172.21.15.194:0/3868284532 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f20adf35d0 0x55f20adf39d0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.191+0000 7f6d931b7980 1 -- 172.21.15.194:0/3868284532 >> 172.21.15.194:0/3868284532 conn(0x55f20adef9b0 msgr2=0x55f20adedab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:46.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.191+0000 7f6d931b7980 1 -- 172.21.15.194:0/3868284532 shutdown_connections 2024-09-13T06:11:46.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.191+0000 7f6d931b7980 1 -- 172.21.15.194:0/3868284532 wait complete. 2024-09-13T06:11:46.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.195+0000 7f6d931b7980 1 Processor -- start 2024-09-13T06:11:46.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.195+0000 7f6d931b7980 1 -- start start 2024-09-13T06:11:46.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.195+0000 7f6d931b7980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f20adf35d0 0x55f20adfa850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.195+0000 7f6d931b7980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55f20adf4420 con 0x55f20adf35d0 2024-09-13T06:11:46.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.195+0000 7f6d90cc7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f20adf35d0 0x55f20adfa850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.195+0000 7f6d90cc7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f20adf35d0 0x55f20adfa850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45356/0 (socket says 172.21.15.194:45356) 2024-09-13T06:11:46.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.195+0000 7f6d90cc7640 1 -- 172.21.15.194:0/1669510257 learned_addr learned my addr 172.21.15.194:0/1669510257 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:46.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.195+0000 7f6d90cc7640 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f20adfad90 con 0x55f20adf35d0 2024-09-13T06:11:46.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.195+0000 7f6d90cc7640 1 --2- 172.21.15.194:0/1669510257 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f20adf35d0 0x55f20adfa850 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f6d80026040 tx=0x7f6d80055000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.195+0000 7f6c667fc640 1 -- 172.21.15.194:0/1669510257 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d8006d070 con 0x55f20adf35d0 2024-09-13T06:11:46.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.195+0000 7f6d931b7980 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f20adfad90 con 0x55f20adf35d0 2024-09-13T06:11:46.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.195+0000 7f6c667fc640 1 -- 172.21.15.194:0/1669510257 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d8000c960 con 0x55f20adf35d0 2024-09-13T06:11:46.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.195+0000 7f6c667fc640 1 -- 172.21.15.194:0/1669510257 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d8000d860 con 0x55f20adf35d0 2024-09-13T06:11:46.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.195+0000 7f6d931b7980 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f20adfb260 con 0x55f20adf35d0 2024-09-13T06:11:46.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.195+0000 7f6c667fc640 1 -- 172.21.15.194:0/1669510257 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6d80070070 con 0x55f20adf35d0 2024-09-13T06:11:46.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.195+0000 7f6c667fc640 1 --2- 172.21.15.194:0/1669510257 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6c5c034650 0x7f6c5c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.195+0000 7f6c667fc640 1 -- 172.21.15.194:0/1669510257 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f6d8005a070 con 0x55f20adf35d0 2024-09-13T06:11:46.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.195+0000 7f6d904c6640 1 --2- 172.21.15.194:0/1669510257 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6c5c034650 0x7f6c5c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.195+0000 7f6d931b7980 20 rados->read ofs=0 len=0 2024-09-13T06:11:46.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.195+0000 7f6d931b7980 1 --2- 172.21.15.194:0/1669510257 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55f20ae058a0 0x55f20ae07d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.195+0000 7f6d931b7980 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae084b0 con 0x55f20ae058a0 2024-09-13T06:11:46.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.195+0000 7f6d914c8640 1 --2- 172.21.15.194:0/1669510257 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55f20ae058a0 0x55f20ae07d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.199+0000 7f6d904c6640 1 --2- 172.21.15.194:0/1669510257 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6c5c034650 0x7f6c5c036b10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f6d84018eb0 tx=0x7f6d840b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.199+0000 7f6d914c8640 1 --2- 172.21.15.194:0/1669510257 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55f20ae058a0 0x55f20ae07d60 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.199+0000 7f6d914c8640 1 -- 172.21.15.194:0/1669510257 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d8800a4d0 con 0x55f20ae058a0 2024-09-13T06:11:46.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.199+0000 7f6d931b7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:46.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.199+0000 7f6d931b7980 20 realm 2024-09-13T06:11:46.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.199+0000 7f6d931b7980 20 rados->read ofs=0 len=0 2024-09-13T06:11:46.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.199+0000 7f6d931b7980 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae088c0 con 0x55f20ae058a0 2024-09-13T06:11:46.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.199+0000 7f6d914c8640 1 -- 172.21.15.194:0/1669510257 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d8800a4d0 con 0x55f20ae058a0 2024-09-13T06:11:46.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.199+0000 7f6d931b7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:46.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.199+0000 7f6d931b7980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:11:46.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.199+0000 7f6d931b7980 20 rados->read ofs=0 len=0 2024-09-13T06:11:46.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.199+0000 7f6d931b7980 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae09190 con 0x55f20ae058a0 2024-09-13T06:11:46.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.199+0000 7f6d914c8640 1 -- 172.21.15.194:0/1669510257 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d8800a4d0 con 0x55f20ae058a0 2024-09-13T06:11:46.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.199+0000 7f6d931b7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:46.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.199+0000 7f6d931b7980 20 rados->read ofs=0 len=0 2024-09-13T06:11:46.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.199+0000 7f6d931b7980 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae09530 con 0x55f20ae058a0 2024-09-13T06:11:46.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.199+0000 7f6d914c8640 1 -- 172.21.15.194:0/1669510257 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6d8800a4d0 con 0x55f20ae058a0 2024-09-13T06:11:46.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.199+0000 7f6d931b7980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:11:46.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.199+0000 7f6d931b7980 20 rados->read ofs=0 len=0 2024-09-13T06:11:46.205 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.199+0000 7f6d931b7980 1 --2- 172.21.15.194:0/1669510257 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55f20ae0a290 0x55f20ae0c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.205 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.199+0000 7f6d931b7980 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae0cc90 con 0x55f20ae0a290 2024-09-13T06:11:46.205 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.199+0000 7f6d90cc7640 1 --2- 172.21.15.194:0/1669510257 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55f20ae0a290 0x55f20ae0c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.205 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.199+0000 7f6d90cc7640 1 --2- 172.21.15.194:0/1669510257 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55f20ae0a290 0x55f20ae0c680 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.205 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.199+0000 7f6d90cc7640 1 -- 172.21.15.194:0/1669510257 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6d8006f030 con 0x55f20ae0a290 2024-09-13T06:11:46.205 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.199+0000 7f6d931b7980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:11:46.205 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.199+0000 7f6d931b7980 20 searching for the correct realm 2024-09-13T06:11:46.205 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.199+0000 7f6d931b7980 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae0e4f0 con 0x55f20ae0a290 2024-09-13T06:11:46.205 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.199+0000 7f6d90cc7640 1 -- 172.21.15.194:0/1669510257 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d8006f030 con 0x55f20ae0a290 2024-09-13T06:11:46.205 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.199+0000 7f6d90cc7640 1 --2- 172.21.15.194:0/1669510257 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f6d80072060 0x7f6d80005a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.205 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.199+0000 7f6d90cc7640 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae0e4f0 con 0x7f6d80072060 2024-09-13T06:11:46.206 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.199+0000 7f6d904c6640 1 --2- 172.21.15.194:0/1669510257 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f6d80072060 0x7f6d80005a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.206 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.199+0000 7f6d904c6640 1 --2- 172.21.15.194:0/1669510257 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f6d80072060 0x7f6d80005a20 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.206 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.199+0000 7f6d904c6640 1 -- 172.21.15.194:0/1669510257 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6d840c9030 con 0x7f6d80072060 2024-09-13T06:11:46.206 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.199+0000 7f6d904c6640 1 --2- 172.21.15.194:0/1669510257 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f6d840dc040 0x7f6d840dd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.206 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.199+0000 7f6d904c6640 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae0e4f0 con 0x7f6d840dc040 2024-09-13T06:11:46.206 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.203+0000 7f6d914c8640 1 --2- 172.21.15.194:0/1669510257 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f6d840dc040 0x7f6d840dd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.206 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.203+0000 7f6d914c8640 1 --2- 172.21.15.194:0/1669510257 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f6d840dc040 0x7f6d840dd430 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.203+0000 7f6d914c8640 1 -- 172.21.15.194:0/1669510257 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d8800a4d0 con 0x7f6d840dc040 2024-09-13T06:11:46.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.203+0000 7f6d914c8640 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae09530 con 0x55f20ae058a0 2024-09-13T06:11:46.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.203+0000 7f6d914c8640 1 -- 172.21.15.194:0/1669510257 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d8800a4d0 con 0x55f20ae058a0 2024-09-13T06:11:46.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.203+0000 7f6d914c8640 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae09530 con 0x55f20ae058a0 2024-09-13T06:11:46.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.203+0000 7f6d914c8640 1 -- 172.21.15.194:0/1669510257 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d8800a4d0 con 0x55f20ae058a0 2024-09-13T06:11:46.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.203+0000 7f6d914c8640 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae09530 con 0x7f6d840dc040 2024-09-13T06:11:46.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.203+0000 7f6d914c8640 1 -- 172.21.15.194:0/1669510257 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d8800a4d0 con 0x7f6d840dc040 2024-09-13T06:11:46.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.203+0000 7f6d914c8640 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae09530 con 0x7f6d840dc040 2024-09-13T06:11:46.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.203+0000 7f6d914c8640 1 -- 172.21.15.194:0/1669510257 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d8800a4d0 con 0x7f6d840dc040 2024-09-13T06:11:46.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.203+0000 7f6d914c8640 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae09530 con 0x7f6d80072060 2024-09-13T06:11:46.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.203+0000 7f6d904c6640 1 -- 172.21.15.194:0/1669510257 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d840c9030 con 0x7f6d80072060 2024-09-13T06:11:46.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.203+0000 7f6d904c6640 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae09530 con 0x55f20ae0a290 2024-09-13T06:11:46.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.203+0000 7f6d90cc7640 1 -- 172.21.15.194:0/1669510257 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d8006f030 con 0x55f20ae0a290 2024-09-13T06:11:46.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.203+0000 7f6d90cc7640 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae09530 con 0x55f20ae058a0 2024-09-13T06:11:46.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.207+0000 7f6d914c8640 1 -- 172.21.15.194:0/1669510257 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d8800a4d0 con 0x55f20ae058a0 2024-09-13T06:11:46.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.207+0000 7f6d914c8640 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae09530 con 0x7f6d840dc040 2024-09-13T06:11:46.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.207+0000 7f6d914c8640 1 -- 172.21.15.194:0/1669510257 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d8800a4d0 con 0x7f6d840dc040 2024-09-13T06:11:46.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.207+0000 7f6d914c8640 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae09530 con 0x55f20ae058a0 2024-09-13T06:11:46.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.207+0000 7f6d914c8640 1 -- 172.21.15.194:0/1669510257 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d8800a4d0 con 0x55f20ae058a0 2024-09-13T06:11:46.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.207+0000 7f6d914c8640 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae09530 con 0x7f6d80072060 2024-09-13T06:11:46.212 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.207+0000 7f6d904c6640 1 -- 172.21.15.194:0/1669510257 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6d840c9030 con 0x7f6d80072060 2024-09-13T06:11:46.212 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.207+0000 7f6d904c6640 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae09530 con 0x55f20ae0a290 2024-09-13T06:11:46.212 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.207+0000 7f6d90cc7640 1 -- 172.21.15.194:0/1669510257 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d8006f030 con 0x55f20ae0a290 2024-09-13T06:11:46.212 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.207+0000 7f6d90cc7640 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae09530 con 0x55f20ae0a290 2024-09-13T06:11:46.212 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.207+0000 7f6d90cc7640 1 -- 172.21.15.194:0/1669510257 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d8006f030 con 0x55f20ae0a290 2024-09-13T06:11:46.212 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.207+0000 7f6d90cc7640 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae09530 con 0x7f6d840dc040 2024-09-13T06:11:46.215 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.207+0000 7f6d914c8640 1 -- 172.21.15.194:0/1669510257 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d8800a4d0 con 0x7f6d840dc040 2024-09-13T06:11:46.215 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.207+0000 7f6d914c8640 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae09530 con 0x55f20ae0a290 2024-09-13T06:11:46.215 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.207+0000 7f6d90cc7640 1 -- 172.21.15.194:0/1669510257 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d8006f030 con 0x55f20ae0a290 2024-09-13T06:11:46.215 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.207+0000 7f6d90cc7640 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae09530 con 0x55f20ae0a290 2024-09-13T06:11:46.215 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.207+0000 7f6d90cc7640 1 -- 172.21.15.194:0/1669510257 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d8006f030 con 0x55f20ae0a290 2024-09-13T06:11:46.215 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.207+0000 7f6d90cc7640 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae09530 con 0x55f20ae058a0 2024-09-13T06:11:46.215 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.207+0000 7f6d914c8640 1 -- 172.21.15.194:0/1669510257 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d8800a4d0 con 0x55f20ae058a0 2024-09-13T06:11:46.215 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.207+0000 7f6d914c8640 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae09530 con 0x55f20ae058a0 2024-09-13T06:11:46.215 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.207+0000 7f6d914c8640 1 -- 172.21.15.194:0/1669510257 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v35'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6d8800a4d0 con 0x55f20ae058a0 2024-09-13T06:11:46.215 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.207+0000 7f6d914c8640 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae09530 con 0x7f6d80072060 2024-09-13T06:11:46.215 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.211+0000 7f6d904c6640 1 -- 172.21.15.194:0/1669510257 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d840c9030 con 0x7f6d80072060 2024-09-13T06:11:46.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.211+0000 7f6d904c6640 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae09530 con 0x55f20ae0a290 2024-09-13T06:11:46.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.211+0000 7f6d90cc7640 1 -- 172.21.15.194:0/1669510257 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d8006f030 con 0x55f20ae0a290 2024-09-13T06:11:46.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.211+0000 7f6d90cc7640 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae09530 con 0x7f6d80072060 2024-09-13T06:11:46.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.211+0000 7f6d904c6640 1 -- 172.21.15.194:0/1669510257 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d840c9030 con 0x7f6d80072060 2024-09-13T06:11:46.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.211+0000 7f6d904c6640 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae09530 con 0x55f20ae058a0 2024-09-13T06:11:46.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.211+0000 7f6d914c8640 1 -- 172.21.15.194:0/1669510257 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d8800a4d0 con 0x55f20ae058a0 2024-09-13T06:11:46.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.211+0000 7f6d914c8640 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae09530 con 0x7f6d840dc040 2024-09-13T06:11:46.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.211+0000 7f6d914c8640 1 -- 172.21.15.194:0/1669510257 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d8800a4d0 con 0x7f6d840dc040 2024-09-13T06:11:46.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.211+0000 7f6d914c8640 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae09530 con 0x55f20ae0a290 2024-09-13T06:11:46.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.211+0000 7f6d90cc7640 1 -- 172.21.15.194:0/1669510257 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=107b] v35'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6d8006f030 con 0x55f20ae0a290 2024-09-13T06:11:46.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.211+0000 7f6d90cc7640 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae09530 con 0x7f6d80072060 2024-09-13T06:11:46.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.211+0000 7f6d904c6640 1 -- 172.21.15.194:0/1669510257 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d840c9030 con 0x7f6d80072060 2024-09-13T06:11:46.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.211+0000 7f6d904c6640 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae09530 con 0x7f6d80072060 2024-09-13T06:11:46.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.211+0000 7f6d904c6640 1 -- 172.21.15.194:0/1669510257 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d840c9030 con 0x7f6d80072060 2024-09-13T06:11:46.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.211+0000 7f6d904c6640 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae09530 con 0x55f20ae0a290 2024-09-13T06:11:46.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.211+0000 7f6d90cc7640 1 -- 172.21.15.194:0/1669510257 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d8006f030 con 0x55f20ae0a290 2024-09-13T06:11:46.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.211+0000 7f6d90cc7640 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae09530 con 0x7f6d840dc040 2024-09-13T06:11:46.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.211+0000 7f6d914c8640 1 -- 172.21.15.194:0/1669510257 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d8800a4d0 con 0x7f6d840dc040 2024-09-13T06:11:46.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.211+0000 7f6d914c8640 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae09530 con 0x55f20ae058a0 2024-09-13T06:11:46.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.215+0000 7f6d914c8640 1 -- 172.21.15.194:0/1669510257 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v35'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6d8800a4d0 con 0x55f20ae058a0 2024-09-13T06:11:46.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.215+0000 7f6d914c8640 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae09530 con 0x7f6d80072060 2024-09-13T06:11:46.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.215+0000 7f6d904c6640 1 -- 172.21.15.194:0/1669510257 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d840c9030 con 0x7f6d80072060 2024-09-13T06:11:46.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.215+0000 7f6d931b7980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:11:46.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.215+0000 7f6d931b7980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:11:46.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.215+0000 7f6d931b7980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:11:46.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.215+0000 7f6d931b7980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:11:46.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.215+0000 7f6d931b7980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:11:46.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.215+0000 7f6d931b7980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:11:46.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.215+0000 7f6d931b7980 20 rados->read ofs=0 len=0 2024-09-13T06:11:46.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.215+0000 7f6d931b7980 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae0d5e0 con 0x55f20ae058a0 2024-09-13T06:11:46.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.215+0000 7f6d914c8640 1 -- 172.21.15.194:0/1669510257 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d8800a4d0 con 0x55f20ae058a0 2024-09-13T06:11:46.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.215+0000 7f6d931b7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:46.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.215+0000 7f6d931b7980 20 rados->read ofs=0 len=0 2024-09-13T06:11:46.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.215+0000 7f6d931b7980 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae0de30 con 0x55f20ae058a0 2024-09-13T06:11:46.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.215+0000 7f6d914c8640 1 -- 172.21.15.194:0/1669510257 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6d8800a4d0 con 0x55f20ae058a0 2024-09-13T06:11:46.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.215+0000 7f6d931b7980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:11:46.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.215+0000 7f6d931b7980 20 rados->read ofs=0 len=0 2024-09-13T06:11:46.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.215+0000 7f6d931b7980 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae0d980 con 0x7f6d80072060 2024-09-13T06:11:46.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.215+0000 7f6d904c6640 1 -- 172.21.15.194:0/1669510257 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6d840c9030 con 0x7f6d80072060 2024-09-13T06:11:46.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.215+0000 7f6d931b7980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:11:46.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.215+0000 7f6d931b7980 20 zone default found 2024-09-13T06:11:46.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.215+0000 7f6d931b7980 4 Realm: () 2024-09-13T06:11:46.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.215+0000 7f6d931b7980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:11:46.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.215+0000 7f6d931b7980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:11:46.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.215+0000 7f6d931b7980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:11:46.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.215+0000 7f6d931b7980 20 zonegroup default 2024-09-13T06:11:46.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.215+0000 7f6d931b7980 20 rados->read ofs=0 len=0 2024-09-13T06:11:46.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.215+0000 7f6d931b7980 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae0e920 con 0x7f6d840dc040 2024-09-13T06:11:46.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.215+0000 7f6d914c8640 1 -- 172.21.15.194:0/1669510257 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6d8800a4d0 con 0x7f6d840dc040 2024-09-13T06:11:46.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.215+0000 7f6d931b7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:46.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.215+0000 7f6d931b7980 20 rados->read ofs=0 len=0 2024-09-13T06:11:46.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.215+0000 7f6d931b7980 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae10300 con 0x55f20ae0a290 2024-09-13T06:11:46.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.215+0000 7f6d90cc7640 1 -- 172.21.15.194:0/1669510257 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6d8006f030 con 0x55f20ae0a290 2024-09-13T06:11:46.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.215+0000 7f6d931b7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:46.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.215+0000 7f6d931b7980 20 rados->read ofs=0 len=0 2024-09-13T06:11:46.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.215+0000 7f6d931b7980 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae10720 con 0x55f20ae0a290 2024-09-13T06:11:46.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.215+0000 7f6d90cc7640 1 -- 172.21.15.194:0/1669510257 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6d8006f030 con 0x55f20ae0a290 2024-09-13T06:11:46.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.215+0000 7f6d931b7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:46.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.215+0000 7f6d931b7980 20 started sync module instance, tier type = 2024-09-13T06:11:46.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.215+0000 7f6d931b7980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:11:46.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.215+0000 7f6d931b7980 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae0f7a0 con 0x7f6d80072060 2024-09-13T06:11:46.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.219+0000 7f6d904c6640 1 -- 172.21.15.194:0/1669510257 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(44 notify.0 [create] v35'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d840c9030 con 0x7f6d80072060 2024-09-13T06:11:46.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.219+0000 7f6d931b7980 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94498052963216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae0f400 con 0x7f6d80072060 2024-09-13T06:11:46.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.219+0000 7f6d931b7980 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae11650 con 0x55f20ae058a0 2024-09-13T06:11:46.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.219+0000 7f6d904c6640 1 -- 172.21.15.194:0/1669510257 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94498052963216] v35'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d840c9030 con 0x7f6d80072060 2024-09-13T06:11:46.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.219+0000 7f6d914c8640 1 -- 172.21.15.194:0/1669510257 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v35'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d8800a4d0 con 0x55f20ae058a0 2024-09-13T06:11:46.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.219+0000 7f6d931b7980 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94498052968864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae115c0 con 0x55f20ae058a0 2024-09-13T06:11:46.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.219+0000 7f6d931b7980 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae12400 con 0x55f20ae0a290 2024-09-13T06:11:46.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.223+0000 7f6d914c8640 1 -- 172.21.15.194:0/1669510257 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94498052968864] v35'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d8800a4d0 con 0x55f20ae058a0 2024-09-13T06:11:46.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.223+0000 7f6d90cc7640 1 -- 172.21.15.194:0/1669510257 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v35'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d8006f030 con 0x55f20ae0a290 2024-09-13T06:11:46.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.223+0000 7f6d931b7980 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94498052971072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae127f0 con 0x55f20ae0a290 2024-09-13T06:11:46.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.223+0000 7f6d931b7980 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae131b0 con 0x7f6d80072060 2024-09-13T06:11:46.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.223+0000 7f6d904c6640 1 -- 172.21.15.194:0/1669510257 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(50 notify.3 [create] v35'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d840c9030 con 0x7f6d80072060 2024-09-13T06:11:46.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.223+0000 7f6d931b7980 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94498052978000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae13e20 con 0x7f6d80072060 2024-09-13T06:11:46.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.223+0000 7f6d931b7980 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae147e0 con 0x55f20ae058a0 2024-09-13T06:11:46.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.223+0000 7f6d90cc7640 1 -- 172.21.15.194:0/1669510257 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94498052971072] v35'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d8006f030 con 0x55f20ae0a290 2024-09-13T06:11:46.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.227+0000 7f6d904c6640 1 -- 172.21.15.194:0/1669510257 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94498052978000] v35'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d840c9030 con 0x7f6d80072060 2024-09-13T06:11:46.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.227+0000 7f6d914c8640 1 -- 172.21.15.194:0/1669510257 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v35'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d8800a4d0 con 0x55f20ae058a0 2024-09-13T06:11:46.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.227+0000 7f6d931b7980 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94498052981552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae13e20 con 0x55f20ae058a0 2024-09-13T06:11:46.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.227+0000 7f6d931b7980 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae14750 con 0x7f6d840dc040 2024-09-13T06:11:46.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.227+0000 7f6d914c8640 1 -- 172.21.15.194:0/1669510257 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94498052981552] v35'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d8800a4d0 con 0x55f20ae058a0 2024-09-13T06:11:46.231 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.227+0000 7f6d914c8640 1 -- 172.21.15.194:0/1669510257 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(54 notify.5 [create] v35'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d8800a4d0 con 0x7f6d840dc040 2024-09-13T06:11:46.231 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.227+0000 7f6d931b7980 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94498052979056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae13d90 con 0x7f6d840dc040 2024-09-13T06:11:46.231 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.227+0000 7f6d931b7980 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae15610 con 0x7f6d840dc040 2024-09-13T06:11:46.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.231+0000 7f6d914c8640 1 -- 172.21.15.194:0/1669510257 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(56 notify.6 [create] v35'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d8800a4d0 con 0x7f6d840dc040 2024-09-13T06:11:46.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.231+0000 7f6d931b7980 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94498052985184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae15a30 con 0x7f6d840dc040 2024-09-13T06:11:46.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.231+0000 7f6d931b7980 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae16490 con 0x7f6d840dc040 2024-09-13T06:11:46.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.231+0000 7f6d914c8640 1 -- 172.21.15.194:0/1669510257 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94498052979056] v35'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d8800a4d0 con 0x7f6d840dc040 2024-09-13T06:11:46.235 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.231+0000 7f6d914c8640 1 -- 172.21.15.194:0/1669510257 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94498052985184] v35'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d8800a4d0 con 0x7f6d840dc040 2024-09-13T06:11:46.235 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.231+0000 7f6d914c8640 1 -- 172.21.15.194:0/1669510257 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(58 notify.7 [create] v35'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d8800a4d0 con 0x7f6d840dc040 2024-09-13T06:11:46.236 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.231+0000 7f6d931b7980 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94498052988784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae15580 con 0x7f6d840dc040 2024-09-13T06:11:46.236 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.231+0000 7f6d931b7980 20 add_watcher() i=0 2024-09-13T06:11:46.236 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.231+0000 7f6d931b7980 20 add_watcher() i=1 2024-09-13T06:11:46.236 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.235+0000 7f6d931b7980 20 add_watcher() i=2 2024-09-13T06:11:46.236 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.235+0000 7f6d931b7980 20 add_watcher() i=3 2024-09-13T06:11:46.236 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.235+0000 7f6d931b7980 20 add_watcher() i=4 2024-09-13T06:11:46.236 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.235+0000 7f6d931b7980 20 add_watcher() i=5 2024-09-13T06:11:46.236 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.235+0000 7f6d931b7980 20 add_watcher() i=6 2024-09-13T06:11:46.238 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.235+0000 7f6d914c8640 1 -- 172.21.15.194:0/1669510257 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94498052988784] v35'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d8800a4d0 con 0x7f6d840dc040 2024-09-13T06:11:46.238 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.235+0000 7f6d931b7980 20 add_watcher() i=7 2024-09-13T06:11:46.238 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.235+0000 7f6d931b7980 2 all 8 watchers are set, enabling cache 2024-09-13T06:11:46.238 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.235+0000 7f6d931b7980 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae19590 con 0x55f20ae058a0 2024-09-13T06:11:46.238 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.235+0000 7f6d914c8640 1 -- 172.21.15.194:0/1669510257 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6d8800a4d0 con 0x55f20ae058a0 2024-09-13T06:11:46.238 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.235+0000 7f6d931b7980 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94498052983536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae16a10 con 0x55f20ae058a0 2024-09-13T06:11:46.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.235+0000 7f6d914c8640 1 -- 172.21.15.194:0/1669510257 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94498052983536] v35'259 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6d8800a4d0 con 0x55f20ae058a0 2024-09-13T06:11:46.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.239+0000 7f6c46fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:11:46.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.239+0000 7f6d931b7980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:11:46.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.239+0000 7f6d931b7980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:11:46.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.239+0000 7f6d931b7980 5 note: GC not initialized 2024-09-13T06:11:46.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.239+0000 7f6c45fe3640 20 reqs_thread_entry: start 2024-09-13T06:11:46.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.239+0000 7f6d931b7980 20 init_complete bucket index max shards: 11 2024-09-13T06:11:46.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.239+0000 7f6d931b7980 20 Filter name: none 2024-09-13T06:11:46.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.239+0000 7f6bb77fe640 20 reqs_thread_entry: start 2024-09-13T06:11:46.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.239+0000 7f6d931b7980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T06:11:46.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.239+0000 7f6d931b7980 20 rados->read ofs=0 len=0 2024-09-13T06:11:46.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.239+0000 7f6d931b7980 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae3ca20 con 0x7f6d840dc040 2024-09-13T06:11:46.242 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.239+0000 7f6d914c8640 1 -- 172.21.15.194:0/1669510257 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7f6d8800a4d0 con 0x7f6d840dc040 2024-09-13T06:11:46.242 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.239+0000 7f6d931b7980 20 rados_obj.operate() r=0 bl.length=490 2024-09-13T06:11:46.242 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.239+0000 7f6d931b7980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-13T06:11:46.242 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.239+0000 7f6d931b7980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T06:11:46.242 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.239+0000 7f6d931b7980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:11:46.242 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.239+0000 7f6d931b7980 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae43390 con 0x7f6d840dc040 2024-09-13T06:11:46.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.243+0000 7f6d914c8640 1 -- 172.21.15.194:0/1669510257 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v35'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f6d8800a4d0 con 0x7f6d840dc040 2024-09-13T06:11:46.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.243+0000 7f6d931b7980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T06:11:46.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.243+0000 7f6d931b7980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T06:11:46.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.243+0000 7f6d931b7980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T06:11:46.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.243+0000 7f6d931b7980 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94498053172736 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae3ea60 con 0x55f20ae058a0 2024-09-13T06:11:46.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.243+0000 7f6d914c8640 1 -- 172.21.15.194:0/1669510257 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== watch-notify(notify (1) cookie 94498052981552 notify 150323855385 ret 0) ==== 708+0+0 (crc 0 0 0) 0x7f6d8802d040 con 0x55f20ae058a0 2024-09-13T06:11:46.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.243+0000 7f6c67fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855385 cookie 94498052981552 notifier 4878 bl.length()=666 2024-09-13T06:11:46.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.243+0000 7f6c67fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T06:11:46.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.243+0000 7f6c67fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T06:11:46.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.243+0000 7f6c67fff640 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f6c54003eb0 con 0x55f20ae058a0 2024-09-13T06:11:46.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.243+0000 7f6d914c8640 1 -- 172.21.15.194:0/1669510257 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(64 notify.4 [notify cookie 94498053172736 out=8b] v0'0 uv261 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6d8800a4d0 con 0x55f20ae058a0 2024-09-13T06:11:46.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.243+0000 7f6d914c8640 1 -- 172.21.15.194:0/1669510257 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d8800a4d0 con 0x55f20ae058a0 2024-09-13T06:11:46.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.243+0000 7f6d914c8640 1 -- 172.21.15.194:0/1669510257 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== watch-notify(notify_complete (2) cookie 94498053172736 notify 150323855385 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f6d8801e040 con 0x55f20ae058a0 2024-09-13T06:11:46.246 INFO:teuthology.orchestra.run.smithi194.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T06:11:44.596796Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:11:44.596784Z","tags":[],"group_ids":[]} 2024-09-13T06:11:46.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.243+0000 7f6c46fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:11:46.247 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.243+0000 7f6d931b7980 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94498052983536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae3a820 con 0x55f20ae058a0 2024-09-13T06:11:46.247 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.243+0000 7f6d914c8640 1 -- 172.21.15.194:0/1669510257 <== osd.1 v2:172.21.15.194:6808/3135444559 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94498052983536] v35'260 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6d8800a4d0 con 0x55f20ae058a0 2024-09-13T06:11:46.248 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.243+0000 7f6d931b7980 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94498052963216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae3a820 con 0x7f6d80072060 2024-09-13T06:11:46.249 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.247+0000 7f6d904c6640 1 -- 172.21.15.194:0/1669510257 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94498052963216] v35'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d840c9030 con 0x7f6d80072060 2024-09-13T06:11:46.249 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.247+0000 7f6d931b7980 20 remove_watcher() i=0 2024-09-13T06:11:46.249 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.247+0000 7f6d931b7980 2 removed watcher, disabling cache 2024-09-13T06:11:46.249 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.247+0000 7f6d931b7980 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94498052968864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae0fb90 con 0x55f20ae058a0 2024-09-13T06:11:46.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.247+0000 7f6d914c8640 1 -- 172.21.15.194:0/1669510257 <== osd.1 v2:172.21.15.194:6808/3135444559 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94498052968864] v35'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d8800a4d0 con 0x55f20ae058a0 2024-09-13T06:11:46.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.247+0000 7f6d931b7980 20 remove_watcher() i=1 2024-09-13T06:11:46.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.247+0000 7f6d931b7980 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94498052971072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae3a820 con 0x55f20ae0a290 2024-09-13T06:11:46.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.251+0000 7f6d90cc7640 1 -- 172.21.15.194:0/1669510257 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94498052971072] v35'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d8006f030 con 0x55f20ae0a290 2024-09-13T06:11:46.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.251+0000 7f6d931b7980 20 remove_watcher() i=2 2024-09-13T06:11:46.254 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.251+0000 7f6d931b7980 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94498052978000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae111a0 con 0x7f6d80072060 2024-09-13T06:11:46.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.251+0000 7f6d904c6640 1 -- 172.21.15.194:0/1669510257 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94498052978000] v35'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d840c9030 con 0x7f6d80072060 2024-09-13T06:11:46.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.251+0000 7f6d931b7980 20 remove_watcher() i=3 2024-09-13T06:11:46.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.251+0000 7f6d931b7980 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94498052981552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae0fb90 con 0x55f20ae058a0 2024-09-13T06:11:46.256 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.255+0000 7f6d914c8640 1 -- 172.21.15.194:0/1669510257 <== osd.1 v2:172.21.15.194:6808/3135444559 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94498052981552] v35'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d8800a4d0 con 0x55f20ae058a0 2024-09-13T06:11:46.257 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.255+0000 7f6d931b7980 20 remove_watcher() i=4 2024-09-13T06:11:46.257 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.255+0000 7f6d931b7980 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94498052979056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae3a820 con 0x7f6d840dc040 2024-09-13T06:11:46.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.255+0000 7f6d914c8640 1 -- 172.21.15.194:0/1669510257 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94498052979056] v35'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d8800a4d0 con 0x7f6d840dc040 2024-09-13T06:11:46.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.255+0000 7f6d931b7980 20 remove_watcher() i=5 2024-09-13T06:11:46.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.255+0000 7f6d931b7980 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94498052985184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae111a0 con 0x7f6d840dc040 2024-09-13T06:11:46.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.259+0000 7f6d914c8640 1 -- 172.21.15.194:0/1669510257 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94498052985184] v35'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d8800a4d0 con 0x7f6d840dc040 2024-09-13T06:11:46.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.259+0000 7f6d931b7980 20 remove_watcher() i=6 2024-09-13T06:11:46.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.259+0000 7f6d931b7980 1 -- 172.21.15.194:0/1669510257 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94498052988784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f20ae14330 con 0x7f6d840dc040 2024-09-13T06:11:46.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.259+0000 7f6d914c8640 1 -- 172.21.15.194:0/1669510257 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94498052988784] v35'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d8800a4d0 con 0x7f6d840dc040 2024-09-13T06:11:46.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.259+0000 7f6d931b7980 20 remove_watcher() i=7 2024-09-13T06:11:46.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.259+0000 7f6d931b7980 1 -- 172.21.15.194:0/1669510257 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f6d840dc040 msgr2=0x7f6d840dd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.259+0000 7f6d931b7980 1 --2- 172.21.15.194:0/1669510257 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f6d840dc040 0x7f6d840dd430 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.259+0000 7f6d931b7980 1 -- 172.21.15.194:0/1669510257 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55f20ae058a0 msgr2=0x55f20ae07d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.259+0000 7f6d931b7980 1 --2- 172.21.15.194:0/1669510257 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55f20ae058a0 0x55f20ae07d60 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.259+0000 7f6d931b7980 1 -- 172.21.15.194:0/1669510257 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f6d80072060 msgr2=0x7f6d80005a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.259+0000 7f6d931b7980 1 --2- 172.21.15.194:0/1669510257 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f6d80072060 0x7f6d80005a20 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.259+0000 7f6d931b7980 1 -- 172.21.15.194:0/1669510257 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55f20ae0a290 msgr2=0x55f20ae0c680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.259+0000 7f6d931b7980 1 --2- 172.21.15.194:0/1669510257 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55f20ae0a290 0x55f20ae0c680 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.259+0000 7f6d931b7980 1 -- 172.21.15.194:0/1669510257 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6c5c034650 msgr2=0x7f6c5c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.263+0000 7f6d931b7980 1 --2- 172.21.15.194:0/1669510257 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6c5c034650 0x7f6c5c036b10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f6d84018eb0 tx=0x7f6d840b9040 comp rx=0 tx=0).stop 2024-09-13T06:11:46.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.263+0000 7f6d931b7980 1 -- 172.21.15.194:0/1669510257 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f20adf35d0 msgr2=0x55f20adfa850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.263+0000 7f6d931b7980 1 --2- 172.21.15.194:0/1669510257 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f20adf35d0 0x55f20adfa850 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f6d80026040 tx=0x7f6d80055000 comp rx=0 tx=0).stop 2024-09-13T06:11:46.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.263+0000 7f6d914c8640 1 -- 172.21.15.194:0/1669510257 reap_dead start 2024-09-13T06:11:46.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.263+0000 7f6d931b7980 1 -- 172.21.15.194:0/1669510257 shutdown_connections 2024-09-13T06:11:46.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.263+0000 7f6d931b7980 1 -- 172.21.15.194:0/1669510257 >> 172.21.15.194:0/1669510257 conn(0x55f20adef9b0 msgr2=0x55f20adeda80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:46.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.263+0000 7f6d931b7980 1 -- 172.21.15.194:0/1669510257 shutdown_connections 2024-09-13T06:11:46.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.263+0000 7f6d931b7980 1 -- 172.21.15.194:0/1669510257 wait complete. 2024-09-13T06:11:46.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.263+0000 7f6d931b7980 1 -- 172.21.15.194:0/3653874773 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6c68034650 msgr2=0x7f6c68036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.263+0000 7f6d931b7980 1 --2- 172.21.15.194:0/3653874773 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6c68034650 0x7f6c68036b10 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x55f20add0d60 tx=0x7f6d84005a10 comp rx=0 tx=0).stop 2024-09-13T06:11:46.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.263+0000 7f6d931b7980 1 -- 172.21.15.194:0/3653874773 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f20ade6cf0 msgr2=0x55f20ade7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.263+0000 7f6d931b7980 1 --2- 172.21.15.194:0/3653874773 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f20ade6cf0 0x55f20ade7110 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f6d80048590 tx=0x7f6d8004a1e0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.263+0000 7f6d931b7980 1 -- 172.21.15.194:0/3653874773 shutdown_connections 2024-09-13T06:11:46.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.263+0000 7f6d931b7980 1 --2- 172.21.15.194:0/3653874773 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6c68034650 0x7f6c68036b10 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.263+0000 7f6d931b7980 1 --2- 172.21.15.194:0/3653874773 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f20ade6cf0 0x55f20ade7110 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.263+0000 7f6d931b7980 1 -- 172.21.15.194:0/3653874773 >> 172.21.15.194:0/3653874773 conn(0x55f20addbe40 msgr2=0x55f20adde8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:46.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.263+0000 7f6d931b7980 1 -- 172.21.15.194:0/3653874773 shutdown_connections 2024-09-13T06:11:46.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.263+0000 7f6d931b7980 1 -- 172.21.15.194:0/3653874773 wait complete. 2024-09-13T06:11:46.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.263+0000 7f6d931b7980 1 -- 172.21.15.194:0/3372080696 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55f20acdac70 msgr2=0x55f20adcfdf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.263+0000 7f6d931b7980 1 --2- 172.21.15.194:0/3372080696 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55f20acdac70 0x55f20adcfdf0 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.263+0000 7f6d931b7980 1 -- 172.21.15.194:0/3372080696 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55f20add66d0 msgr2=0x55f20add8ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.263+0000 7f6d931b7980 1 --2- 172.21.15.194:0/3372080696 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55f20add66d0 0x55f20add8ac0 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.263+0000 7f6d931b7980 1 -- 172.21.15.194:0/3372080696 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55f20add27b0 msgr2=0x55f20add4ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.263+0000 7f6d931b7980 1 --2- 172.21.15.194:0/3372080696 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55f20add27b0 0x55f20add4ba0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.263+0000 7f6d931b7980 1 -- 172.21.15.194:0/3372080696 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6c78034650 msgr2=0x7f6c78036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.263+0000 7f6d931b7980 1 --2- 172.21.15.194:0/3372080696 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f6c78034650 0x7f6c78036b10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f6d840ad000 tx=0x7f6d840a5040 comp rx=0 tx=0).stop 2024-09-13T06:11:46.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.263+0000 7f6d931b7980 1 -- 172.21.15.194:0/3372080696 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f20acd68f0 msgr2=0x55f20adc8e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.263+0000 7f6d931b7980 1 --2- 172.21.15.194:0/3372080696 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f20acd68f0 0x55f20adc8e40 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x55f20adc2c70 tx=0x7f6d80000bd0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.263+0000 7f6d914c8640 1 -- 172.21.15.194:0/3372080696 reap_dead start 2024-09-13T06:11:46.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.263+0000 7f6d931b7980 1 -- 172.21.15.194:0/3372080696 shutdown_connections 2024-09-13T06:11:46.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.263+0000 7f6d931b7980 1 -- 172.21.15.194:0/3372080696 >> 172.21.15.194:0/3372080696 conn(0x55f20ac4a240 msgr2=0x55f20adbc240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:46.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.263+0000 7f6d931b7980 1 -- 172.21.15.194:0/3372080696 shutdown_connections 2024-09-13T06:11:46.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.263+0000 7f6d931b7980 1 -- 172.21.15.194:0/3372080696 wait complete. 2024-09-13T06:11:46.276 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T06:11:44.596796Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:11:44.596784Z', 'tags': [], 'group_ids': []} 2024-09-13T06:11:46.276 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T06:11:44.596796Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:11:44.596784Z', 'tags': [], 'group_ids': []} 2024-09-13T06:11:46.277 ERROR:root:0 2024-09-13T06:11:46.277 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T06:11:46.289 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T06:11:46.290 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-13T06:11:46.290 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-13T06:11:46.290 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-13T06:11:46.358 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:11:46.358 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:11:46.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.355+0000 7fba41d2d980 1 Processor -- start 2024-09-13T06:11:46.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.355+0000 7fba41d2d980 1 -- start start 2024-09-13T06:11:46.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.355+0000 7fba41d2d980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x560ad17fc6a0 0x560ad17fca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.355+0000 7fba41d2d980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560ad1684ae0 con 0x560ad17fcff0 2024-09-13T06:11:46.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.355+0000 7fba41d2d980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x560ad16a8e30 con 0x560ad17fc6a0 2024-09-13T06:11:46.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.355+0000 7fba3f83d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x560ad17fc6a0 0x560ad17fca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.355+0000 7fba3f03c640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x560ad17fcff0 0x560ad1801a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:58440/0 (socket says 172.21.15.194:58440) 2024-09-13T06:11:46.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.355+0000 7fba3f03c640 1 -- 172.21.15.194:0/3229468607 learned_addr learned my addr 172.21.15.194:0/3229468607 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-09-13T06:11:46.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.359+0000 7fba3f83d640 1 -- 172.21.15.194:0/3229468607 >> v1:172.21.15.120:6789/0 conn(0x560ad17fcff0 legacy=0x560ad1801a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.359+0000 7fba3f83d640 1 -- 172.21.15.194:0/3229468607 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ad1804270 con 0x560ad17fc6a0 2024-09-13T06:11:46.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.363+0000 7fba3f83d640 1 --2- 172.21.15.194:0/3229468607 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560ad17fc6a0 0x560ad17fca80 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fba3000a480 tx=0x7fba3001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a653a038df2bf1a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.363+0000 7fba3e83b640 1 -- 172.21.15.194:0/3229468607 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba300b0070 con 0x560ad17fc6a0 2024-09-13T06:11:46.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.363+0000 7fba3e83b640 1 -- 172.21.15.194:0/3229468607 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba300ab540 con 0x560ad17fc6a0 2024-09-13T06:11:46.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.363+0000 7fba3e83b640 1 -- 172.21.15.194:0/3229468607 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba300ab840 con 0x560ad17fc6a0 2024-09-13T06:11:46.365 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.363+0000 7fba41d2d980 1 -- 172.21.15.194:0/3229468607 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560ad17fc6a0 msgr2=0x560ad17fca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.365 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.363+0000 7fba41d2d980 1 --2- 172.21.15.194:0/3229468607 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560ad17fc6a0 0x560ad17fca80 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fba3000a480 tx=0x7fba3001b280 comp rx=0 tx=0).stop 2024-09-13T06:11:46.365 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.363+0000 7fba41d2d980 1 -- 172.21.15.194:0/3229468607 shutdown_connections 2024-09-13T06:11:46.366 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.363+0000 7fba41d2d980 1 --2- 172.21.15.194:0/3229468607 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560ad17fc6a0 0x560ad17fca80 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.366 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.363+0000 7fba41d2d980 1 -- 172.21.15.194:0/3229468607 >> 172.21.15.194:0/3229468607 conn(0x560ad17f81c0 msgr2=0x560ad17fa5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:46.366 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.363+0000 7fba41d2d980 1 -- 172.21.15.194:0/3229468607 shutdown_connections 2024-09-13T06:11:46.366 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.363+0000 7fba41d2d980 1 -- 172.21.15.194:0/3229468607 wait complete. 2024-09-13T06:11:46.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.379+0000 7fba41d2d980 1 Processor -- start 2024-09-13T06:11:46.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.379+0000 7fba41d2d980 1 -- start start 2024-09-13T06:11:46.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.379+0000 7fba41d2d980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560ad17fc6a0 0x560ad18e7af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.379+0000 7fba41d2d980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x560ad16aa200 con 0x560ad17fc6a0 2024-09-13T06:11:46.382 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.379+0000 7fba3f83d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560ad17fc6a0 0x560ad18e7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.382 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.379+0000 7fba3f83d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560ad17fc6a0 0x560ad18e7af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45376/0 (socket says 172.21.15.194:45376) 2024-09-13T06:11:46.382 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.379+0000 7fba3f83d640 1 -- 172.21.15.194:0/3721683751 learned_addr learned my addr 172.21.15.194:0/3721683751 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:46.382 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.379+0000 7fba3f83d640 1 -- 172.21.15.194:0/3721683751 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ad18e80c0 con 0x560ad17fc6a0 2024-09-13T06:11:46.382 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.379+0000 7fba3f83d640 1 --2- 172.21.15.194:0/3721683751 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560ad17fc6a0 0x560ad18e7af0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fba300ae040 tx=0x7fba30003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b9ee783ec692ecb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.383 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.379+0000 7fb92de0b640 1 -- 172.21.15.194:0/3721683751 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba300b0040 con 0x560ad17fc6a0 2024-09-13T06:11:46.383 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.379+0000 7fb92de0b640 1 -- 172.21.15.194:0/3721683751 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba300ab9d0 con 0x560ad17fc6a0 2024-09-13T06:11:46.383 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.379+0000 7fb92de0b640 1 -- 172.21.15.194:0/3721683751 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba300abcf0 con 0x560ad17fc6a0 2024-09-13T06:11:46.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.379+0000 7fba41d2d980 1 -- 172.21.15.194:0/3721683751 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560ad17fc6a0 msgr2=0x560ad18e7af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.379+0000 7fba41d2d980 1 --2- 172.21.15.194:0/3721683751 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560ad17fc6a0 0x560ad18e7af0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fba300ae040 tx=0x7fba30003030 comp rx=0 tx=0).stop 2024-09-13T06:11:46.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.379+0000 7fba41d2d980 1 -- 172.21.15.194:0/3721683751 shutdown_connections 2024-09-13T06:11:46.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.379+0000 7fba41d2d980 1 --2- 172.21.15.194:0/3721683751 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560ad17fc6a0 0x560ad18e7af0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.379+0000 7fba41d2d980 1 -- 172.21.15.194:0/3721683751 >> 172.21.15.194:0/3721683751 conn(0x560ad17f81c0 msgr2=0x560ad18e3720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:46.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.379+0000 7fba41d2d980 1 -- 172.21.15.194:0/3721683751 shutdown_connections 2024-09-13T06:11:46.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.379+0000 7fba41d2d980 1 -- 172.21.15.194:0/3721683751 wait complete. 2024-09-13T06:11:46.385 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.383+0000 7fba41d2d980 1 Processor -- start 2024-09-13T06:11:46.385 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.383+0000 7fba41d2d980 1 -- start start 2024-09-13T06:11:46.385 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.383+0000 7fba41d2d980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560ad17fc6a0 0x560ad18eeca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.385 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.383+0000 7fba41d2d980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x560ad1803cb0 con 0x560ad17fc6a0 2024-09-13T06:11:46.386 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.383+0000 7fba3f83d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560ad17fc6a0 0x560ad18eeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.386 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.383+0000 7fba3f83d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560ad17fc6a0 0x560ad18eeca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45380/0 (socket says 172.21.15.194:45380) 2024-09-13T06:11:46.386 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.383+0000 7fba3f83d640 1 -- 172.21.15.194:0/2748546247 learned_addr learned my addr 172.21.15.194:0/2748546247 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:46.386 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.383+0000 7fba3f83d640 1 -- 172.21.15.194:0/2748546247 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ad18ef1e0 con 0x560ad17fc6a0 2024-09-13T06:11:46.386 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.383+0000 7fba3f83d640 1 --2- 172.21.15.194:0/2748546247 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560ad17fc6a0 0x560ad18eeca0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fba30019930 tx=0x7fba30018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.386 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.383+0000 7fb927fff640 1 -- 172.21.15.194:0/2748546247 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba300b0070 con 0x560ad17fc6a0 2024-09-13T06:11:46.386 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.383+0000 7fba41d2d980 1 -- 172.21.15.194:0/2748546247 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560ad18ef470 con 0x560ad17fc6a0 2024-09-13T06:11:46.386 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.383+0000 7fb927fff640 1 -- 172.21.15.194:0/2748546247 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba300b68b0 con 0x560ad17fc6a0 2024-09-13T06:11:46.387 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.383+0000 7fb927fff640 1 -- 172.21.15.194:0/2748546247 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba300b6b90 con 0x560ad17fc6a0 2024-09-13T06:11:46.387 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.383+0000 7fba41d2d980 1 -- 172.21.15.194:0/2748546247 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ad18f2150 con 0x560ad17fc6a0 2024-09-13T06:11:46.387 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.383+0000 7fb927fff640 1 -- 172.21.15.194:0/2748546247 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fba300bf3f0 con 0x560ad17fc6a0 2024-09-13T06:11:46.388 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.383+0000 7fb927fff640 1 --2- 172.21.15.194:0/2748546247 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fb928034650 0x7fb928036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.388 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.387+0000 7fb927fff640 1 -- 172.21.15.194:0/2748546247 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fba300bc070 con 0x560ad17fc6a0 2024-09-13T06:11:46.388 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.387+0000 7fba3f03c640 1 --2- 172.21.15.194:0/2748546247 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fb928034650 0x7fb928036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.388 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.387+0000 7fba41d2d980 1 --2- 172.21.15.194:0/2748546247 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x560ad17fcff0 0x560ad18f5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.388 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.387+0000 7fba41d2d980 1 -- 172.21.15.194:0/2748546247 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560ad18f62e0 con 0x560ad17fcff0 2024-09-13T06:11:46.389 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.387+0000 7fba4003e640 1 --2- 172.21.15.194:0/2748546247 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x560ad17fcff0 0x560ad18f5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.389 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.387+0000 7fba3f03c640 1 --2- 172.21.15.194:0/2748546247 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fb928034650 0x7fb928036b10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fba34001da0 tx=0x7fba34001300 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.389 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.387+0000 7fba4003e640 1 --2- 172.21.15.194:0/2748546247 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x560ad17fcff0 0x560ad18f5da0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.390 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.387+0000 7fba4003e640 1 -- 172.21.15.194:0/2748546247 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fba3800a4d0 con 0x560ad17fcff0 2024-09-13T06:11:46.390 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.387+0000 7fba41d2d980 1 -- 172.21.15.194:0/2748546247 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560ad18f3350 con 0x560ad17fcff0 2024-09-13T06:11:46.390 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.387+0000 7fba4003e640 1 -- 172.21.15.194:0/2748546247 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fba3800a4d0 con 0x560ad17fcff0 2024-09-13T06:11:46.390 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.387+0000 7fba41d2d980 1 --2- 172.21.15.194:0/2748546247 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x560ad18f8600 0x560ad18fa9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.391 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.387+0000 7fba41d2d980 1 -- 172.21.15.194:0/2748546247 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560ad18fb0c0 con 0x560ad18f8600 2024-09-13T06:11:46.391 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.387+0000 7fba3f83d640 1 --2- 172.21.15.194:0/2748546247 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x560ad18f8600 0x560ad18fa9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.391 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.387+0000 7fba3f83d640 1 --2- 172.21.15.194:0/2748546247 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x560ad18f8600 0x560ad18fa9f0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.391 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.387+0000 7fba3f83d640 1 -- 172.21.15.194:0/2748546247 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fba300b3040 con 0x560ad18f8600 2024-09-13T06:11:46.391 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.387+0000 7fba41d2d980 1 -- 172.21.15.194:0/2748546247 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560ad18f74a0 con 0x560ad17fcff0 2024-09-13T06:11:46.391 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.387+0000 7fba4003e640 1 -- 172.21.15.194:0/2748546247 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fba3800a4d0 con 0x560ad17fcff0 2024-09-13T06:11:46.391 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.387+0000 7fba41d2d980 1 --2- 172.21.15.194:0/2748546247 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x560ad18fc500 0x560ad18fe8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.391 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.387+0000 7fba41d2d980 1 -- 172.21.15.194:0/2748546247 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560ad18ff080 con 0x560ad18fc500 2024-09-13T06:11:46.391 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.387+0000 7fba3f03c640 1 --2- 172.21.15.194:0/2748546247 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x560ad18fc500 0x560ad18fe8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.392 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.387+0000 7fba3f03c640 1 --2- 172.21.15.194:0/2748546247 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x560ad18fc500 0x560ad18fe8f0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.392 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.387+0000 7fba3f03c640 1 -- 172.21.15.194:0/2748546247 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fba3400e6c0 con 0x560ad18fc500 2024-09-13T06:11:46.392 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.387+0000 7fba41d2d980 1 Processor -- start 2024-09-13T06:11:46.392 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.387+0000 7fba41d2d980 1 -- start start 2024-09-13T06:11:46.393 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.391+0000 7fba41d2d980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560ad1773580 0x560ad1771c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.393 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.391+0000 7fba41d2d980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x560ad1703800 con 0x560ad1773580 2024-09-13T06:11:46.393 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.391+0000 7fba3f83d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560ad1773580 0x560ad1771c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.393 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.391+0000 7fba3f83d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560ad1773580 0x560ad1771c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45386/0 (socket says 172.21.15.194:45386) 2024-09-13T06:11:46.393 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.391+0000 7fba3f83d640 1 -- 172.21.15.194:0/998838701 learned_addr learned my addr 172.21.15.194:0/998838701 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:46.394 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.391+0000 7fba3f83d640 1 -- 172.21.15.194:0/998838701 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ad17739a0 con 0x560ad1773580 2024-09-13T06:11:46.394 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.391+0000 7fba3f83d640 1 --2- 172.21.15.194:0/998838701 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560ad1773580 0x560ad1771c00 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fba30006b40 tx=0x7fba300b4430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.394 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.391+0000 7fb9257fa640 1 -- 172.21.15.194:0/998838701 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba300b5aa0 con 0x560ad1773580 2024-09-13T06:11:46.394 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.391+0000 7fb9257fa640 1 -- 172.21.15.194:0/998838701 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba300e4ad0 con 0x560ad1773580 2024-09-13T06:11:46.394 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.391+0000 7fb9257fa640 1 -- 172.21.15.194:0/998838701 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba300e4df0 con 0x560ad1773580 2024-09-13T06:11:46.394 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.391+0000 7fba41d2d980 1 -- 172.21.15.194:0/998838701 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560ad17721a0 con 0x560ad1773580 2024-09-13T06:11:46.394 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.391+0000 7fba41d2d980 1 -- 172.21.15.194:0/998838701 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ad1772670 con 0x560ad1773580 2024-09-13T06:11:46.396 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.391+0000 7fb9257fa640 1 -- 172.21.15.194:0/998838701 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fba300dc430 con 0x560ad1773580 2024-09-13T06:11:46.396 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.391+0000 7fb9257fa640 1 --2- 172.21.15.194:0/998838701 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fb918034600 0x7fb918036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.396 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.391+0000 7fb9257fa640 1 -- 172.21.15.194:0/998838701 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fba300a8070 con 0x560ad1773580 2024-09-13T06:11:46.396 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.391+0000 7fba3f03c640 1 --2- 172.21.15.194:0/998838701 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fb918034600 0x7fb918036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.396 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.391+0000 7fba41d2d980 1 Processor -- start 2024-09-13T06:11:46.397 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.391+0000 7fba41d2d980 1 -- start start 2024-09-13T06:11:46.397 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.391+0000 7fba3f03c640 1 --2- 172.21.15.194:0/998838701 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fb918034600 0x7fb918036ac0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x560ad18ff480 tx=0x7fba3400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.397 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.391+0000 7fba41d2d980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560ad191b600 0x560ad191ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.397 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.391+0000 7fba41d2d980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x560ad18e8380 con 0x560ad191b600 2024-09-13T06:11:46.397 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.395+0000 7fba3f83d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560ad191b600 0x560ad191ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.397 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.395+0000 7fba3f83d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560ad191b600 0x560ad191ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45400/0 (socket says 172.21.15.194:45400) 2024-09-13T06:11:46.397 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.395+0000 7fba3f83d640 1 -- 172.21.15.194:0/431077713 learned_addr learned my addr 172.21.15.194:0/431077713 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:46.397 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.395+0000 7fba3f83d640 1 -- 172.21.15.194:0/431077713 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ad191bfd0 con 0x560ad191b600 2024-09-13T06:11:46.399 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.395+0000 7fba3f83d640 1 --2- 172.21.15.194:0/431077713 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560ad191b600 0x560ad191ba00 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fba300b49c0 tx=0x7fba300a4f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4412c9b24aa5afe0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.399 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.395+0000 7fb91effd640 1 -- 172.21.15.194:0/431077713 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba300fd070 con 0x560ad191b600 2024-09-13T06:11:46.399 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.395+0000 7fb91effd640 1 -- 172.21.15.194:0/431077713 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba300b4a30 con 0x560ad191b600 2024-09-13T06:11:46.399 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.395+0000 7fb91effd640 1 -- 172.21.15.194:0/431077713 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba300e11a0 con 0x560ad191b600 2024-09-13T06:11:46.399 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.395+0000 7fba41d2d980 1 -- 172.21.15.194:0/431077713 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560ad191b600 msgr2=0x560ad191ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.399 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.395+0000 7fba41d2d980 1 --2- 172.21.15.194:0/431077713 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560ad191b600 0x560ad191ba00 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fba300b49c0 tx=0x7fba300a4f90 comp rx=0 tx=0).stop 2024-09-13T06:11:46.399 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.395+0000 7fba41d2d980 1 -- 172.21.15.194:0/431077713 shutdown_connections 2024-09-13T06:11:46.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.395+0000 7fba41d2d980 1 --2- 172.21.15.194:0/431077713 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560ad191b600 0x560ad191ba00 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.395+0000 7fba41d2d980 1 -- 172.21.15.194:0/431077713 >> 172.21.15.194:0/431077713 conn(0x560ad19179e0 msgr2=0x560ad1915ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:46.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.395+0000 7fba41d2d980 1 -- 172.21.15.194:0/431077713 shutdown_connections 2024-09-13T06:11:46.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.395+0000 7fba41d2d980 1 -- 172.21.15.194:0/431077713 wait complete. 2024-09-13T06:11:46.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.395+0000 7fba41d2d980 1 Processor -- start 2024-09-13T06:11:46.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.395+0000 7fba41d2d980 1 -- start start 2024-09-13T06:11:46.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.395+0000 7fba41d2d980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560ad191b600 0x560ad19227c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.395+0000 7fba41d2d980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x560ad191c450 con 0x560ad191b600 2024-09-13T06:11:46.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.395+0000 7fba3f83d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560ad191b600 0x560ad19227c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.395+0000 7fba3f83d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560ad191b600 0x560ad19227c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45412/0 (socket says 172.21.15.194:45412) 2024-09-13T06:11:46.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.395+0000 7fba3f83d640 1 -- 172.21.15.194:0/1527402949 learned_addr learned my addr 172.21.15.194:0/1527402949 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:46.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.395+0000 7fba3f83d640 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ad1922d00 con 0x560ad191b600 2024-09-13T06:11:46.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.395+0000 7fba3f83d640 1 --2- 172.21.15.194:0/1527402949 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560ad191b600 0x560ad19227c0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fba300e4a60 tx=0x7fba300aef50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.395+0000 7fb91d7fa640 1 -- 172.21.15.194:0/1527402949 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba300fd050 con 0x560ad191b600 2024-09-13T06:11:46.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.395+0000 7fba41d2d980 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560ad1922d00 con 0x560ad191b600 2024-09-13T06:11:46.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.395+0000 7fb91d7fa640 1 -- 172.21.15.194:0/1527402949 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba300fe040 con 0x560ad191b600 2024-09-13T06:11:46.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.399+0000 7fb91d7fa640 1 -- 172.21.15.194:0/1527402949 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba300d6da0 con 0x560ad191b600 2024-09-13T06:11:46.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.399+0000 7fba41d2d980 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ad1922d00 con 0x560ad191b600 2024-09-13T06:11:46.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.399+0000 7fb91d7fa640 1 -- 172.21.15.194:0/1527402949 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fba3010b020 con 0x560ad191b600 2024-09-13T06:11:46.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.399+0000 7fb91d7fa640 1 --2- 172.21.15.194:0/1527402949 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fb908034600 0x7fb908036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.399+0000 7fb91d7fa640 1 -- 172.21.15.194:0/1527402949 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fba30109020 con 0x560ad191b600 2024-09-13T06:11:46.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.399+0000 7fba3f03c640 1 --2- 172.21.15.194:0/1527402949 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fb908034600 0x7fb908036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.399+0000 7fba41d2d980 20 rados->read ofs=0 len=0 2024-09-13T06:11:46.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.399+0000 7fba41d2d980 1 --2- 172.21.15.194:0/1527402949 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x560ad192d750 0x560ad192fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.399+0000 7fba41d2d980 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560ad1930360 con 0x560ad192d750 2024-09-13T06:11:46.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.399+0000 7fba4003e640 1 --2- 172.21.15.194:0/1527402949 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x560ad192d750 0x560ad192fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.399+0000 7fba3f03c640 1 --2- 172.21.15.194:0/1527402949 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fb908034600 0x7fb908036ac0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fba3400bb60 tx=0x7fba34010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.399+0000 7fba4003e640 1 --2- 172.21.15.194:0/1527402949 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x560ad192d750 0x560ad192fc10 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.399+0000 7fba4003e640 1 -- 172.21.15.194:0/1527402949 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fba3800a4d0 con 0x560ad192d750 2024-09-13T06:11:46.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.399+0000 7fba41d2d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:46.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.399+0000 7fba41d2d980 20 realm 2024-09-13T06:11:46.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.399+0000 7fba41d2d980 20 rados->read ofs=0 len=0 2024-09-13T06:11:46.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.399+0000 7fba41d2d980 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560ad1930770 con 0x560ad192d750 2024-09-13T06:11:46.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.399+0000 7fba4003e640 1 -- 172.21.15.194:0/1527402949 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fba3800a4d0 con 0x560ad192d750 2024-09-13T06:11:46.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.399+0000 7fba41d2d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:46.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.399+0000 7fba41d2d980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:11:46.406 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.399+0000 7fba41d2d980 20 rados->read ofs=0 len=0 2024-09-13T06:11:46.406 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.399+0000 7fba41d2d980 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560ad1931040 con 0x560ad192d750 2024-09-13T06:11:46.406 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.399+0000 7fba4003e640 1 -- 172.21.15.194:0/1527402949 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fba3800a4d0 con 0x560ad192d750 2024-09-13T06:11:46.406 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.399+0000 7fba41d2d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:46.406 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.399+0000 7fba41d2d980 20 rados->read ofs=0 len=0 2024-09-13T06:11:46.406 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.399+0000 7fba41d2d980 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560ad19313e0 con 0x560ad192d750 2024-09-13T06:11:46.406 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.399+0000 7fba4003e640 1 -- 172.21.15.194:0/1527402949 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fba3800a4d0 con 0x560ad192d750 2024-09-13T06:11:46.406 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.399+0000 7fba41d2d980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:11:46.406 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.399+0000 7fba41d2d980 20 rados->read ofs=0 len=0 2024-09-13T06:11:46.406 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.399+0000 7fba41d2d980 1 --2- 172.21.15.194:0/1527402949 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x560ad1932140 0x560ad1934530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.406 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.399+0000 7fba41d2d980 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560ad1934b00 con 0x560ad1932140 2024-09-13T06:11:46.407 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.399+0000 7fba3f83d640 1 --2- 172.21.15.194:0/1527402949 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x560ad1932140 0x560ad1934530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.407 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.403+0000 7fba3f83d640 1 --2- 172.21.15.194:0/1527402949 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x560ad1932140 0x560ad1934530 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.410 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.403+0000 7fba3f83d640 1 -- 172.21.15.194:0/1527402949 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fba30100070 con 0x560ad1932140 2024-09-13T06:11:46.410 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.403+0000 7fba41d2d980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:11:46.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.403+0000 7fba41d2d980 20 searching for the correct realm 2024-09-13T06:11:46.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.403+0000 7fba41d2d980 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560ad19363d0 con 0x560ad1932140 2024-09-13T06:11:46.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.403+0000 7fba3f83d640 1 -- 172.21.15.194:0/1527402949 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba30100070 con 0x560ad1932140 2024-09-13T06:11:46.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.403+0000 7fba3f83d640 1 --2- 172.21.15.194:0/1527402949 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fba30104070 0x7fba300ee430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.403+0000 7fba3f83d640 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560ad19363d0 con 0x7fba30104070 2024-09-13T06:11:46.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.403+0000 7fba3f03c640 1 --2- 172.21.15.194:0/1527402949 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fba30104070 0x7fba300ee430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.403+0000 7fba3f03c640 1 --2- 172.21.15.194:0/1527402949 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fba30104070 0x7fba300ee430 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.403+0000 7fba3f03c640 1 -- 172.21.15.194:0/1527402949 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fba3400e6c0 con 0x7fba30104070 2024-09-13T06:11:46.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.403+0000 7fba3f03c640 1 --2- 172.21.15.194:0/1527402949 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fba34037040 0x7fba34036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.403+0000 7fba3f03c640 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560ad19363d0 con 0x7fba34037040 2024-09-13T06:11:46.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.403+0000 7fba4003e640 1 --2- 172.21.15.194:0/1527402949 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fba34037040 0x7fba34036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.412 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.403+0000 7fba4003e640 1 --2- 172.21.15.194:0/1527402949 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fba34037040 0x7fba34036410 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.412 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.403+0000 7fba4003e640 1 -- 172.21.15.194:0/1527402949 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba3800a4d0 con 0x7fba34037040 2024-09-13T06:11:46.412 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.403+0000 7fba4003e640 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560ad19313e0 con 0x560ad192d750 2024-09-13T06:11:46.412 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.403+0000 7fba4003e640 1 -- 172.21.15.194:0/1527402949 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba3800a4d0 con 0x560ad192d750 2024-09-13T06:11:46.412 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.403+0000 7fba4003e640 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560ad19313e0 con 0x560ad192d750 2024-09-13T06:11:46.412 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.403+0000 7fba4003e640 1 -- 172.21.15.194:0/1527402949 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba3800a4d0 con 0x560ad192d750 2024-09-13T06:11:46.412 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.403+0000 7fba4003e640 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560ad19313e0 con 0x7fba34037040 2024-09-13T06:11:46.412 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.407+0000 7fba4003e640 1 -- 172.21.15.194:0/1527402949 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba3800a4d0 con 0x7fba34037040 2024-09-13T06:11:46.412 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.407+0000 7fba4003e640 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560ad19313e0 con 0x7fba34037040 2024-09-13T06:11:46.412 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.407+0000 7fba4003e640 1 -- 172.21.15.194:0/1527402949 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba3800a4d0 con 0x7fba34037040 2024-09-13T06:11:46.412 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.407+0000 7fba4003e640 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560ad19313e0 con 0x7fba30104070 2024-09-13T06:11:46.412 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.407+0000 7fba3f03c640 1 -- 172.21.15.194:0/1527402949 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba3400e6c0 con 0x7fba30104070 2024-09-13T06:11:46.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.407+0000 7fba3f03c640 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560ad19313e0 con 0x560ad1932140 2024-09-13T06:11:46.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.407+0000 7fba3f83d640 1 -- 172.21.15.194:0/1527402949 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba30100070 con 0x560ad1932140 2024-09-13T06:11:46.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.407+0000 7fba3f83d640 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560ad19313e0 con 0x560ad192d750 2024-09-13T06:11:46.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.407+0000 7fba4003e640 1 -- 172.21.15.194:0/1527402949 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba3800a4d0 con 0x560ad192d750 2024-09-13T06:11:46.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.407+0000 7fba4003e640 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560ad19313e0 con 0x7fba34037040 2024-09-13T06:11:46.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.407+0000 7fba4003e640 1 -- 172.21.15.194:0/1527402949 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba3800a4d0 con 0x7fba34037040 2024-09-13T06:11:46.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.407+0000 7fba4003e640 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560ad19313e0 con 0x560ad192d750 2024-09-13T06:11:46.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.407+0000 7fba4003e640 1 -- 172.21.15.194:0/1527402949 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba3800a4d0 con 0x560ad192d750 2024-09-13T06:11:46.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.407+0000 7fba4003e640 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560ad19313e0 con 0x7fba30104070 2024-09-13T06:11:46.417 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.407+0000 7fba3f03c640 1 -- 172.21.15.194:0/1527402949 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fba3400e6c0 con 0x7fba30104070 2024-09-13T06:11:46.417 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.407+0000 7fba3f03c640 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560ad19313e0 con 0x560ad1932140 2024-09-13T06:11:46.417 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.407+0000 7fba3f83d640 1 -- 172.21.15.194:0/1527402949 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba30100070 con 0x560ad1932140 2024-09-13T06:11:46.418 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.407+0000 7fba3f83d640 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560ad19313e0 con 0x560ad1932140 2024-09-13T06:11:46.418 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.407+0000 7fba3f83d640 1 -- 172.21.15.194:0/1527402949 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba30100070 con 0x560ad1932140 2024-09-13T06:11:46.418 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.407+0000 7fba3f83d640 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560ad19313e0 con 0x7fba34037040 2024-09-13T06:11:46.418 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.411+0000 7fba4003e640 1 -- 172.21.15.194:0/1527402949 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba3800a4d0 con 0x7fba34037040 2024-09-13T06:11:46.418 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.411+0000 7fba4003e640 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560ad19313e0 con 0x560ad1932140 2024-09-13T06:11:46.418 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.411+0000 7fba3f83d640 1 -- 172.21.15.194:0/1527402949 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba30100070 con 0x560ad1932140 2024-09-13T06:11:46.418 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.411+0000 7fba3f83d640 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560ad19313e0 con 0x560ad1932140 2024-09-13T06:11:46.418 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.411+0000 7fba3f83d640 1 -- 172.21.15.194:0/1527402949 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba30100070 con 0x560ad1932140 2024-09-13T06:11:46.418 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.411+0000 7fba3f83d640 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560ad19313e0 con 0x560ad192d750 2024-09-13T06:11:46.418 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.411+0000 7fba4003e640 1 -- 172.21.15.194:0/1527402949 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba3800a4d0 con 0x560ad192d750 2024-09-13T06:11:46.418 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.411+0000 7fba4003e640 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560ad19313e0 con 0x560ad192d750 2024-09-13T06:11:46.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.411+0000 7fba4003e640 1 -- 172.21.15.194:0/1527402949 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v35'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fba3800a4d0 con 0x560ad192d750 2024-09-13T06:11:46.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.411+0000 7fba4003e640 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560ad19313e0 con 0x7fba30104070 2024-09-13T06:11:46.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.411+0000 7fba3f03c640 1 -- 172.21.15.194:0/1527402949 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba3400e6c0 con 0x7fba30104070 2024-09-13T06:11:46.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.411+0000 7fba3f03c640 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560ad19313e0 con 0x560ad1932140 2024-09-13T06:11:46.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.411+0000 7fba3f83d640 1 -- 172.21.15.194:0/1527402949 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba30100070 con 0x560ad1932140 2024-09-13T06:11:46.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.411+0000 7fba3f83d640 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560ad19313e0 con 0x7fba30104070 2024-09-13T06:11:46.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.411+0000 7fba3f03c640 1 -- 172.21.15.194:0/1527402949 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba3400e6c0 con 0x7fba30104070 2024-09-13T06:11:46.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.411+0000 7fba3f03c640 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560ad19313e0 con 0x560ad192d750 2024-09-13T06:11:46.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.411+0000 7fba4003e640 1 -- 172.21.15.194:0/1527402949 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba3800a4d0 con 0x560ad192d750 2024-09-13T06:11:46.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.411+0000 7fba4003e640 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560ad19313e0 con 0x7fba34037040 2024-09-13T06:11:46.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.411+0000 7fba4003e640 1 -- 172.21.15.194:0/1527402949 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba3800a4d0 con 0x7fba34037040 2024-09-13T06:11:46.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.411+0000 7fba4003e640 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560ad19313e0 con 0x560ad1932140 2024-09-13T06:11:46.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.415+0000 7fba3f83d640 1 -- 172.21.15.194:0/1527402949 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=107b] v35'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fba30100070 con 0x560ad1932140 2024-09-13T06:11:46.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.415+0000 7fba3f83d640 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560ad19313e0 con 0x7fba30104070 2024-09-13T06:11:46.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.415+0000 7fba3f03c640 1 -- 172.21.15.194:0/1527402949 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba3400e6c0 con 0x7fba30104070 2024-09-13T06:11:46.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.415+0000 7fba3f03c640 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560ad19313e0 con 0x7fba30104070 2024-09-13T06:11:46.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.415+0000 7fba3f03c640 1 -- 172.21.15.194:0/1527402949 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba3400e6c0 con 0x7fba30104070 2024-09-13T06:11:46.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.415+0000 7fba3f03c640 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560ad19313e0 con 0x560ad1932140 2024-09-13T06:11:46.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.415+0000 7fba3f83d640 1 -- 172.21.15.194:0/1527402949 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba30100070 con 0x560ad1932140 2024-09-13T06:11:46.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.415+0000 7fba3f83d640 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560ad19313e0 con 0x7fba34037040 2024-09-13T06:11:46.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.415+0000 7fba4003e640 1 -- 172.21.15.194:0/1527402949 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba3800a4d0 con 0x7fba34037040 2024-09-13T06:11:46.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.415+0000 7fba4003e640 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560ad19313e0 con 0x560ad192d750 2024-09-13T06:11:46.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.415+0000 7fba4003e640 1 -- 172.21.15.194:0/1527402949 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v35'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fba3800a4d0 con 0x560ad192d750 2024-09-13T06:11:46.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.415+0000 7fba4003e640 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560ad19313e0 con 0x7fba30104070 2024-09-13T06:11:46.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.415+0000 7fba3f03c640 1 -- 172.21.15.194:0/1527402949 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba3400e6c0 con 0x7fba30104070 2024-09-13T06:11:46.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.415+0000 7fba41d2d980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:11:46.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.415+0000 7fba41d2d980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:11:46.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.415+0000 7fba41d2d980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:11:46.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.415+0000 7fba41d2d980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:11:46.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.415+0000 7fba41d2d980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:11:46.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.415+0000 7fba41d2d980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:11:46.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.415+0000 7fba41d2d980 20 rados->read ofs=0 len=0 2024-09-13T06:11:46.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.415+0000 7fba41d2d980 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560ad19354f0 con 0x560ad192d750 2024-09-13T06:11:46.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.415+0000 7fba4003e640 1 -- 172.21.15.194:0/1527402949 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fba3800a4d0 con 0x560ad192d750 2024-09-13T06:11:46.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.415+0000 7fba41d2d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:46.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.415+0000 7fba41d2d980 20 rados->read ofs=0 len=0 2024-09-13T06:11:46.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.415+0000 7fba41d2d980 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560ad1935d90 con 0x560ad192d750 2024-09-13T06:11:46.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.415+0000 7fba4003e640 1 -- 172.21.15.194:0/1527402949 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fba3800a4d0 con 0x560ad192d750 2024-09-13T06:11:46.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.415+0000 7fba41d2d980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:11:46.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.415+0000 7fba41d2d980 20 rados->read ofs=0 len=0 2024-09-13T06:11:46.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.415+0000 7fba41d2d980 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560ad19358e0 con 0x7fba30104070 2024-09-13T06:11:46.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.415+0000 7fba3f03c640 1 -- 172.21.15.194:0/1527402949 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fba3400e6c0 con 0x7fba30104070 2024-09-13T06:11:46.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.415+0000 7fba41d2d980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:11:46.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.415+0000 7fba41d2d980 20 zone default found 2024-09-13T06:11:46.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.415+0000 7fba41d2d980 4 Realm: () 2024-09-13T06:11:46.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.415+0000 7fba41d2d980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:11:46.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.415+0000 7fba41d2d980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:11:46.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.415+0000 7fba41d2d980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:11:46.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.415+0000 7fba41d2d980 20 zonegroup default 2024-09-13T06:11:46.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.415+0000 7fba41d2d980 20 rados->read ofs=0 len=0 2024-09-13T06:11:46.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.415+0000 7fba41d2d980 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560ad1936800 con 0x7fba34037040 2024-09-13T06:11:46.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.415+0000 7fba4003e640 1 -- 172.21.15.194:0/1527402949 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fba3800a4d0 con 0x7fba34037040 2024-09-13T06:11:46.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.419+0000 7fba41d2d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:46.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.419+0000 7fba41d2d980 20 rados->read ofs=0 len=0 2024-09-13T06:11:46.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.419+0000 7fba41d2d980 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560ad1938240 con 0x560ad1932140 2024-09-13T06:11:46.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.419+0000 7fba3f83d640 1 -- 172.21.15.194:0/1527402949 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fba30100070 con 0x560ad1932140 2024-09-13T06:11:46.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.419+0000 7fba41d2d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:46.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.419+0000 7fba41d2d980 20 rados->read ofs=0 len=0 2024-09-13T06:11:46.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.419+0000 7fba41d2d980 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560ad19386d0 con 0x560ad1932140 2024-09-13T06:11:46.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.419+0000 7fba3f83d640 1 -- 172.21.15.194:0/1527402949 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fba30100070 con 0x560ad1932140 2024-09-13T06:11:46.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.419+0000 7fba41d2d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:46.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.419+0000 7fba41d2d980 20 started sync module instance, tier type = 2024-09-13T06:11:46.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.419+0000 7fba41d2d980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:11:46.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.419+0000 7fba41d2d980 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560ad1937680 con 0x7fba30104070 2024-09-13T06:11:46.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.419+0000 7fba3f03c640 1 -- 172.21.15.194:0/1527402949 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(44 notify.0 [create] v35'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba3400e6c0 con 0x7fba30104070 2024-09-13T06:11:46.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.419+0000 7fba41d2d980 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94604465764976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560ad1937e90 con 0x7fba30104070 2024-09-13T06:11:46.427 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.419+0000 7fba41d2d980 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560ad19395e0 con 0x560ad192d750 2024-09-13T06:11:46.427 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.419+0000 7fba3f03c640 1 -- 172.21.15.194:0/1527402949 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94604465764976] v35'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba3400e6c0 con 0x7fba30104070 2024-09-13T06:11:46.428 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.423+0000 7fba4003e640 1 -- 172.21.15.194:0/1527402949 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v35'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba3800a4d0 con 0x560ad192d750 2024-09-13T06:11:46.428 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.423+0000 7fba41d2d980 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94604465770800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560ad1939a00 con 0x560ad192d750 2024-09-13T06:11:46.428 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.423+0000 7fba41d2d980 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560ad193a290 con 0x560ad1932140 2024-09-13T06:11:46.428 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.423+0000 7fba3f83d640 1 -- 172.21.15.194:0/1527402949 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v35'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba30100070 con 0x560ad1932140 2024-09-13T06:11:46.428 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.423+0000 7fba41d2d980 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94604465773056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560ad1939e20 con 0x560ad1932140 2024-09-13T06:11:46.428 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.423+0000 7fba41d2d980 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560ad193b190 con 0x7fba30104070 2024-09-13T06:11:46.428 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.423+0000 7fba4003e640 1 -- 172.21.15.194:0/1527402949 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94604465770800] v35'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba3800a4d0 con 0x560ad192d750 2024-09-13T06:11:46.428 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.427+0000 7fba3f03c640 1 -- 172.21.15.194:0/1527402949 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(50 notify.3 [create] v35'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba3400e6c0 con 0x7fba30104070 2024-09-13T06:11:46.429 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.427+0000 7fba41d2d980 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94604465771856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560ad193b580 con 0x7fba30104070 2024-09-13T06:11:46.429 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.427+0000 7fba41d2d980 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560ad193bf40 con 0x560ad192d750 2024-09-13T06:11:46.429 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.427+0000 7fba3f83d640 1 -- 172.21.15.194:0/1527402949 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94604465773056] v35'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba30100070 con 0x560ad1932140 2024-09-13T06:11:46.429 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.427+0000 7fba3f03c640 1 -- 172.21.15.194:0/1527402949 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94604465771856] v35'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba3400e6c0 con 0x7fba30104070 2024-09-13T06:11:46.430 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.427+0000 7fba4003e640 1 -- 172.21.15.194:0/1527402949 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v35'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba3800a4d0 con 0x560ad192d750 2024-09-13T06:11:46.430 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.427+0000 7fba41d2d980 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94604465776256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560ad193bf40 con 0x560ad192d750 2024-09-13T06:11:46.430 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.427+0000 7fba41d2d980 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560ad193c790 con 0x7fba34037040 2024-09-13T06:11:46.432 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.431+0000 7fba4003e640 1 -- 172.21.15.194:0/1527402949 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94604465776256] v35'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba3800a4d0 con 0x560ad192d750 2024-09-13T06:11:46.433 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.431+0000 7fba4003e640 1 -- 172.21.15.194:0/1527402949 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(54 notify.5 [create] v35'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba3800a4d0 con 0x7fba34037040 2024-09-13T06:11:46.433 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.431+0000 7fba41d2d980 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94604465781664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560ad193c4d0 con 0x7fba34037040 2024-09-13T06:11:46.433 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.431+0000 7fba41d2d980 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560ad193cfd0 con 0x7fba34037040 2024-09-13T06:11:46.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.431+0000 7fba4003e640 1 -- 172.21.15.194:0/1527402949 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(56 notify.6 [create] v35'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba3800a4d0 con 0x7fba34037040 2024-09-13T06:11:46.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.431+0000 7fba41d2d980 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94604465785536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560ad193d440 con 0x7fba34037040 2024-09-13T06:11:46.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.431+0000 7fba41d2d980 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560ad193df10 con 0x7fba34037040 2024-09-13T06:11:46.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.431+0000 7fba4003e640 1 -- 172.21.15.194:0/1527402949 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94604465781664] v35'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba3800a4d0 con 0x7fba34037040 2024-09-13T06:11:46.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.435+0000 7fba4003e640 1 -- 172.21.15.194:0/1527402949 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94604465785536] v35'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba3800a4d0 con 0x7fba34037040 2024-09-13T06:11:46.437 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.435+0000 7fba4003e640 1 -- 172.21.15.194:0/1527402949 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(58 notify.7 [create] v35'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba3800a4d0 con 0x7fba34037040 2024-09-13T06:11:46.437 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.435+0000 7fba41d2d980 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94604465782720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560ad193d440 con 0x7fba34037040 2024-09-13T06:11:46.437 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.435+0000 7fba41d2d980 20 add_watcher() i=0 2024-09-13T06:11:46.437 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.435+0000 7fba41d2d980 20 add_watcher() i=1 2024-09-13T06:11:46.437 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.435+0000 7fba41d2d980 20 add_watcher() i=2 2024-09-13T06:11:46.437 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.435+0000 7fba41d2d980 20 add_watcher() i=3 2024-09-13T06:11:46.437 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.435+0000 7fba41d2d980 20 add_watcher() i=4 2024-09-13T06:11:46.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.435+0000 7fba41d2d980 20 add_watcher() i=5 2024-09-13T06:11:46.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.435+0000 7fba41d2d980 20 add_watcher() i=6 2024-09-13T06:11:46.439 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.435+0000 7fba4003e640 1 -- 172.21.15.194:0/1527402949 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94604465782720] v35'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba3800a4d0 con 0x7fba34037040 2024-09-13T06:11:46.439 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.435+0000 7fba41d2d980 20 add_watcher() i=7 2024-09-13T06:11:46.440 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.435+0000 7fba41d2d980 2 all 8 watchers are set, enabling cache 2024-09-13T06:11:46.440 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.435+0000 7fba41d2d980 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560ad1940f00 con 0x560ad192d750 2024-09-13T06:11:46.440 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.435+0000 7fba4003e640 1 -- 172.21.15.194:0/1527402949 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fba3800a4d0 con 0x560ad192d750 2024-09-13T06:11:46.440 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.439+0000 7fba41d2d980 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94604465787232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560ad193e380 con 0x560ad192d750 2024-09-13T06:11:46.441 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.439+0000 7fba4003e640 1 -- 172.21.15.194:0/1527402949 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94604465787232] v35'261 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fba3800a4d0 con 0x560ad192d750 2024-09-13T06:11:46.441 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.439+0000 7fb8f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:11:46.441 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.439+0000 7fba41d2d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:11:46.441 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.439+0000 7fba41d2d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:11:46.441 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.439+0000 7fba41d2d980 5 note: GC not initialized 2024-09-13T06:11:46.442 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.439+0000 7fb8f4fe1640 20 reqs_thread_entry: start 2024-09-13T06:11:46.442 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.439+0000 7fba41d2d980 20 init_complete bucket index max shards: 11 2024-09-13T06:11:46.442 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.439+0000 7fba41d2d980 20 Filter name: none 2024-09-13T06:11:46.442 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.439+0000 7fb86e7fc640 20 reqs_thread_entry: start 2024-09-13T06:11:46.442 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.439+0000 7fba41d2d980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T06:11:46.443 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.439+0000 7fba41d2d980 20 rados->read ofs=0 len=0 2024-09-13T06:11:46.443 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.439+0000 7fba41d2d980 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560ad1964440 con 0x7fba34037040 2024-09-13T06:11:46.443 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.439+0000 7fba4003e640 1 -- 172.21.15.194:0/1527402949 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7fba3800a4d0 con 0x7fba34037040 2024-09-13T06:11:46.443 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.439+0000 7fba41d2d980 20 rados_obj.operate() r=0 bl.length=490 2024-09-13T06:11:46.443 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.439+0000 7fba41d2d980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-13T06:11:46.443 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.439+0000 7fba41d2d980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T06:11:46.443 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.439+0000 7fba41d2d980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:11:46.444 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.439+0000 7fba41d2d980 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~503 in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560ad196ade0 con 0x7fba34037040 2024-09-13T06:11:46.446 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.443+0000 7fba4003e640 1 -- 172.21.15.194:0/1527402949 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~503] v35'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fba3800a4d0 con 0x7fba34037040 2024-09-13T06:11:46.446 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.443+0000 7fba41d2d980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T06:11:46.446 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.443+0000 7fba41d2d980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T06:11:46.446 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.443+0000 7fba41d2d980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T06:11:46.446 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.443+0000 7fba41d2d980 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94604465973328 in=691b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560ad1966470 con 0x560ad192d750 2024-09-13T06:11:46.446 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.443+0000 7fba4003e640 1 -- 172.21.15.194:0/1527402949 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== watch-notify(notify (1) cookie 94604465776256 notify 150323855386 ret 0) ==== 721+0+0 (crc 0 0 0) 0x7fba3802d040 con 0x560ad192d750 2024-09-13T06:11:46.446 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.443+0000 7fba4003e640 1 -- 172.21.15.194:0/1527402949 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(64 notify.4 [notify cookie 94604465973328 out=8b] v0'0 uv264 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fba3800a4d0 con 0x560ad192d750 2024-09-13T06:11:46.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.443+0000 7fb91e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855386 cookie 94604465776256 notifier 4885 bl.length()=679 2024-09-13T06:11:46.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.443+0000 7fb91e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T06:11:46.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.443+0000 7fb91e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T06:11:46.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.443+0000 7fb91e7fc640 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fb874003440 con 0x560ad192d750 2024-09-13T06:11:46.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.443+0000 7fba4003e640 1 -- 172.21.15.194:0/1527402949 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba3800a4d0 con 0x560ad192d750 2024-09-13T06:11:46.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.443+0000 7fba4003e640 1 -- 172.21.15.194:0/1527402949 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== watch-notify(notify_complete (2) cookie 94604465973328 notify 150323855386 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fba3801e040 con 0x560ad192d750 2024-09-13T06:11:46.448 INFO:teuthology.orchestra.run.smithi194.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T06:11:44.596796Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:11:44.596784Z","tags":[],"group_ids":[]} 2024-09-13T06:11:46.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.447+0000 7fb8f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:11:46.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.447+0000 7fba41d2d980 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94604465787232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560ad1962270 con 0x560ad192d750 2024-09-13T06:11:46.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.447+0000 7fba4003e640 1 -- 172.21.15.194:0/1527402949 <== osd.1 v2:172.21.15.194:6808/3135444559 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94604465787232] v35'262 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fba3800a4d0 con 0x560ad192d750 2024-09-13T06:11:46.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.447+0000 7fba41d2d980 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94604465764976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560ad1962270 con 0x7fba30104070 2024-09-13T06:11:46.450 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.447+0000 7fba3f03c640 1 -- 172.21.15.194:0/1527402949 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94604465764976] v35'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba3400e6c0 con 0x7fba30104070 2024-09-13T06:11:46.451 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.447+0000 7fba41d2d980 20 remove_watcher() i=0 2024-09-13T06:11:46.451 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.447+0000 7fba41d2d980 2 removed watcher, disabling cache 2024-09-13T06:11:46.451 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.447+0000 7fba41d2d980 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94604465770800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560ad1962270 con 0x560ad192d750 2024-09-13T06:11:46.453 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.451+0000 7fba4003e640 1 -- 172.21.15.194:0/1527402949 <== osd.1 v2:172.21.15.194:6808/3135444559 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94604465770800] v35'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba3800a4d0 con 0x560ad192d750 2024-09-13T06:11:46.453 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.451+0000 7fba41d2d980 20 remove_watcher() i=1 2024-09-13T06:11:46.453 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.451+0000 7fba41d2d980 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94604465773056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560ad1962270 con 0x560ad1932140 2024-09-13T06:11:46.455 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.451+0000 7fba3f83d640 1 -- 172.21.15.194:0/1527402949 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94604465773056] v35'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba30100070 con 0x560ad1932140 2024-09-13T06:11:46.455 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.451+0000 7fba41d2d980 20 remove_watcher() i=2 2024-09-13T06:11:46.455 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.451+0000 7fba41d2d980 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94604465771856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560ad1962270 con 0x7fba30104070 2024-09-13T06:11:46.457 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.455+0000 7fba3f03c640 1 -- 172.21.15.194:0/1527402949 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94604465771856] v35'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba3400e6c0 con 0x7fba30104070 2024-09-13T06:11:46.457 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.455+0000 7fba41d2d980 20 remove_watcher() i=3 2024-09-13T06:11:46.457 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.455+0000 7fba41d2d980 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94604465776256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560ad1962270 con 0x560ad192d750 2024-09-13T06:11:46.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.455+0000 7fba4003e640 1 -- 172.21.15.194:0/1527402949 <== osd.1 v2:172.21.15.194:6808/3135444559 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94604465776256] v35'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba3800a4d0 con 0x560ad192d750 2024-09-13T06:11:46.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.455+0000 7fba41d2d980 20 remove_watcher() i=4 2024-09-13T06:11:46.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.455+0000 7fba41d2d980 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94604465781664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560ad1962270 con 0x7fba34037040 2024-09-13T06:11:46.461 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.459+0000 7fba4003e640 1 -- 172.21.15.194:0/1527402949 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94604465781664] v35'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba3800a4d0 con 0x7fba34037040 2024-09-13T06:11:46.461 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.459+0000 7fba41d2d980 20 remove_watcher() i=5 2024-09-13T06:11:46.461 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.459+0000 7fba41d2d980 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94604465785536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560ad1962270 con 0x7fba34037040 2024-09-13T06:11:46.463 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.459+0000 7fba4003e640 1 -- 172.21.15.194:0/1527402949 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94604465785536] v35'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba3800a4d0 con 0x7fba34037040 2024-09-13T06:11:46.463 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.459+0000 7fba41d2d980 20 remove_watcher() i=6 2024-09-13T06:11:46.463 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.459+0000 7fba41d2d980 1 -- 172.21.15.194:0/1527402949 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94604465782720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560ad1962270 con 0x7fba34037040 2024-09-13T06:11:46.467 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.463+0000 7fba4003e640 1 -- 172.21.15.194:0/1527402949 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94604465782720] v35'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba3800a4d0 con 0x7fba34037040 2024-09-13T06:11:46.467 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.463+0000 7fba41d2d980 20 remove_watcher() i=7 2024-09-13T06:11:46.467 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.463+0000 7fba41d2d980 1 -- 172.21.15.194:0/1527402949 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fba34037040 msgr2=0x7fba34036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.467 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.463+0000 7fba41d2d980 1 --2- 172.21.15.194:0/1527402949 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fba34037040 0x7fba34036410 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.467 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.463+0000 7fba41d2d980 1 -- 172.21.15.194:0/1527402949 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x560ad192d750 msgr2=0x560ad192fc10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.467 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.463+0000 7fba41d2d980 1 --2- 172.21.15.194:0/1527402949 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x560ad192d750 0x560ad192fc10 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.467 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.463+0000 7fba41d2d980 1 -- 172.21.15.194:0/1527402949 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fba30104070 msgr2=0x7fba300ee430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.467 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.463+0000 7fba41d2d980 1 --2- 172.21.15.194:0/1527402949 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fba30104070 0x7fba300ee430 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.467 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.463+0000 7fba41d2d980 1 -- 172.21.15.194:0/1527402949 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x560ad1932140 msgr2=0x560ad1934530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.467 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.463+0000 7fba41d2d980 1 --2- 172.21.15.194:0/1527402949 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x560ad1932140 0x560ad1934530 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.467 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.463+0000 7fba41d2d980 1 -- 172.21.15.194:0/1527402949 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fb908034600 msgr2=0x7fb908036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.468 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.463+0000 7fba41d2d980 1 --2- 172.21.15.194:0/1527402949 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fb908034600 0x7fb908036ac0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fba3400bb60 tx=0x7fba34010000 comp rx=0 tx=0).stop 2024-09-13T06:11:46.468 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.463+0000 7fba41d2d980 1 -- 172.21.15.194:0/1527402949 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560ad191b600 msgr2=0x560ad19227c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.468 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.463+0000 7fba4003e640 1 -- 172.21.15.194:0/1527402949 reap_dead start 2024-09-13T06:11:46.468 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.463+0000 7fba41d2d980 1 --2- 172.21.15.194:0/1527402949 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560ad191b600 0x560ad19227c0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fba300e4a60 tx=0x7fba300aef50 comp rx=0 tx=0).stop 2024-09-13T06:11:46.468 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.463+0000 7fba41d2d980 1 -- 172.21.15.194:0/1527402949 shutdown_connections 2024-09-13T06:11:46.468 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.463+0000 7fba41d2d980 1 --2- 172.21.15.194:0/1527402949 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560ad191b600 0x560ad19227c0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.468 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.463+0000 7fba41d2d980 1 -- 172.21.15.194:0/1527402949 >> 172.21.15.194:0/1527402949 conn(0x560ad19179e0 msgr2=0x560ad1915ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:46.468 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.463+0000 7fba41d2d980 1 -- 172.21.15.194:0/1527402949 shutdown_connections 2024-09-13T06:11:46.468 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.463+0000 7fba41d2d980 1 -- 172.21.15.194:0/1527402949 wait complete. 2024-09-13T06:11:46.468 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.463+0000 7fba41d2d980 1 -- 172.21.15.194:0/998838701 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fb918034600 msgr2=0x7fb918036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.468 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.463+0000 7fba41d2d980 1 --2- 172.21.15.194:0/998838701 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fb918034600 0x7fb918036ac0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x560ad18ff480 tx=0x7fba3400f000 comp rx=0 tx=0).stop 2024-09-13T06:11:46.468 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.463+0000 7fba41d2d980 1 -- 172.21.15.194:0/998838701 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560ad1773580 msgr2=0x560ad1771c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.468 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.463+0000 7fba41d2d980 1 --2- 172.21.15.194:0/998838701 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560ad1773580 0x560ad1771c00 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fba30006b40 tx=0x7fba300b4430 comp rx=0 tx=0).stop 2024-09-13T06:11:46.469 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.463+0000 7fba41d2d980 1 -- 172.21.15.194:0/998838701 shutdown_connections 2024-09-13T06:11:46.469 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.463+0000 7fba41d2d980 1 --2- 172.21.15.194:0/998838701 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fb918034600 0x7fb918036ac0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.469 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.463+0000 7fba41d2d980 1 --2- 172.21.15.194:0/998838701 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560ad1773580 0x560ad1771c00 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.469 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.463+0000 7fba41d2d980 1 -- 172.21.15.194:0/998838701 >> 172.21.15.194:0/998838701 conn(0x560ad1901c60 msgr2=0x560ad19046e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:46.469 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.463+0000 7fba41d2d980 1 -- 172.21.15.194:0/998838701 shutdown_connections 2024-09-13T06:11:46.469 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.463+0000 7fba41d2d980 1 -- 172.21.15.194:0/998838701 wait complete. 2024-09-13T06:11:46.469 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.463+0000 7fba41d2d980 1 -- 172.21.15.194:0/2748546247 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x560ad17fcff0 msgr2=0x560ad18f5da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.469 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.463+0000 7fba41d2d980 1 --2- 172.21.15.194:0/2748546247 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x560ad17fcff0 0x560ad18f5da0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.469 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.463+0000 7fba41d2d980 1 -- 172.21.15.194:0/2748546247 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x560ad18fc500 msgr2=0x560ad18fe8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.469 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.463+0000 7fba41d2d980 1 --2- 172.21.15.194:0/2748546247 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x560ad18fc500 0x560ad18fe8f0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.469 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.463+0000 7fba41d2d980 1 -- 172.21.15.194:0/2748546247 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x560ad18f8600 msgr2=0x560ad18fa9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.469 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.463+0000 7fba41d2d980 1 --2- 172.21.15.194:0/2748546247 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x560ad18f8600 0x560ad18fa9f0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.469 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.463+0000 7fba41d2d980 1 -- 172.21.15.194:0/2748546247 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fb928034650 msgr2=0x7fb928036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.470 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.463+0000 7fba41d2d980 1 --2- 172.21.15.194:0/2748546247 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fb928034650 0x7fb928036b10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fba34001da0 tx=0x7fba34001300 comp rx=0 tx=0).stop 2024-09-13T06:11:46.470 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.463+0000 7fba41d2d980 1 -- 172.21.15.194:0/2748546247 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560ad17fc6a0 msgr2=0x560ad18eeca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.470 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.463+0000 7fba41d2d980 1 --2- 172.21.15.194:0/2748546247 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560ad17fc6a0 0x560ad18eeca0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fba30019930 tx=0x7fba30018020 comp rx=0 tx=0).stop 2024-09-13T06:11:46.470 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.463+0000 7fba4003e640 1 -- 172.21.15.194:0/2748546247 reap_dead start 2024-09-13T06:11:46.470 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.463+0000 7fba41d2d980 1 -- 172.21.15.194:0/2748546247 shutdown_connections 2024-09-13T06:11:46.470 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.463+0000 7fba41d2d980 1 -- 172.21.15.194:0/2748546247 >> 172.21.15.194:0/2748546247 conn(0x560ad17f81c0 msgr2=0x560ad18e22a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:46.470 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.463+0000 7fba41d2d980 1 -- 172.21.15.194:0/2748546247 shutdown_connections 2024-09-13T06:11:46.470 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.463+0000 7fba41d2d980 1 -- 172.21.15.194:0/2748546247 wait complete. 2024-09-13T06:11:46.478 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T06:11:44.596796Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:11:44.596784Z', 'tags': [], 'group_ids': []} 2024-09-13T06:11:46.478 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T06:11:44.596796Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:11:44.596784Z', 'tags': [], 'group_ids': []} 2024-09-13T06:11:46.478 ERROR:root:0 2024-09-13T06:11:46.478 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T06:11:46.492 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T06:11:46.492 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-09-13T06:11:46.492 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-09-13T06:11:46.493 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write; user-info-without-keys=*' 2024-09-13T06:11:46.554 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:11:46.555 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:11:46.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.551+0000 7ff3e6f42980 1 Processor -- start 2024-09-13T06:11:46.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.551+0000 7ff3e6f42980 1 -- start start 2024-09-13T06:11:46.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.555+0000 7ff3e6f42980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x564ed5d8c9e0 0x564ed5d8edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.555+0000 7ff3e6f42980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564ed5c10ae0 con 0x564ed5d88660 2024-09-13T06:11:46.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.555+0000 7ff3e6f42980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x564ed5c34e30 con 0x564ed5d8c9e0 2024-09-13T06:11:46.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.555+0000 7ff3e4251640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x564ed5d8c9e0 0x564ed5d8edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.555+0000 7ff3e4a52640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x564ed5d88660 0x564ed5d88a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:58442/0 (socket says 172.21.15.194:58442) 2024-09-13T06:11:46.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.555+0000 7ff3e4a52640 1 -- 172.21.15.194:0/294889120 learned_addr learned my addr 172.21.15.194:0/294889120 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-09-13T06:11:46.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.555+0000 7ff3e3a50640 1 -- 172.21.15.194:0/294889120 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 796168517 0 0) 0x564ed5c10ae0 con 0x564ed5d88660 2024-09-13T06:11:46.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.555+0000 7ff3e3a50640 1 -- 172.21.15.194:0/294889120 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff3cc001e20 con 0x564ed5d88660 2024-09-13T06:11:46.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.555+0000 7ff3e4251640 1 -- 172.21.15.194:0/294889120 >> v1:172.21.15.120:6789/0 conn(0x564ed5d88660 legacy=0x564ed5d88a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.555+0000 7ff3e4251640 1 -- 172.21.15.194:0/294889120 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ed5d90320 con 0x564ed5d8c9e0 2024-09-13T06:11:46.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.555+0000 7ff3e4251640 1 --2- 172.21.15.194:0/294889120 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564ed5d8c9e0 0x564ed5d8edd0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7ff3d800a480 tx=0x7ff3d801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=599880c2effbedd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.560 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.559+0000 7ff3e3a50640 1 -- 172.21.15.194:0/294889120 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3d80b0070 con 0x564ed5d8c9e0 2024-09-13T06:11:46.560 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.559+0000 7ff3e3a50640 1 -- 172.21.15.194:0/294889120 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3d80ab540 con 0x564ed5d8c9e0 2024-09-13T06:11:46.560 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.559+0000 7ff3e3a50640 1 -- 172.21.15.194:0/294889120 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3d80ab820 con 0x564ed5d8c9e0 2024-09-13T06:11:46.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.559+0000 7ff3e6f42980 1 -- 172.21.15.194:0/294889120 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564ed5d8c9e0 msgr2=0x564ed5d8edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.559+0000 7ff3e6f42980 1 --2- 172.21.15.194:0/294889120 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564ed5d8c9e0 0x564ed5d8edd0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7ff3d800a480 tx=0x7ff3d801b280 comp rx=0 tx=0).stop 2024-09-13T06:11:46.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.559+0000 7ff3e6f42980 1 -- 172.21.15.194:0/294889120 shutdown_connections 2024-09-13T06:11:46.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.559+0000 7ff3e6f42980 1 --2- 172.21.15.194:0/294889120 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564ed5d8c9e0 0x564ed5d8edd0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.559+0000 7ff3e6f42980 1 -- 172.21.15.194:0/294889120 >> 172.21.15.194:0/294889120 conn(0x564ed5d84180 msgr2=0x564ed5d865a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:46.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.559+0000 7ff3e6f42980 1 -- 172.21.15.194:0/294889120 shutdown_connections 2024-09-13T06:11:46.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.559+0000 7ff3e6f42980 1 -- 172.21.15.194:0/294889120 wait complete. 2024-09-13T06:11:46.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.575+0000 7ff3e6f42980 1 Processor -- start 2024-09-13T06:11:46.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.575+0000 7ff3e6f42980 1 -- start start 2024-09-13T06:11:46.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.575+0000 7ff3e6f42980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564ed5d88660 0x564ed5e738d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.575+0000 7ff3e6f42980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x564ed5c36200 con 0x564ed5d88660 2024-09-13T06:11:46.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.575+0000 7ff3e4a52640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564ed5d88660 0x564ed5e738d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.575+0000 7ff3e4a52640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564ed5d88660 0x564ed5e738d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45438/0 (socket says 172.21.15.194:45438) 2024-09-13T06:11:46.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.575+0000 7ff3e4a52640 1 -- 172.21.15.194:0/4285900380 learned_addr learned my addr 172.21.15.194:0/4285900380 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:46.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.575+0000 7ff3e4a52640 1 -- 172.21.15.194:0/4285900380 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ed5e73ea0 con 0x564ed5d88660 2024-09-13T06:11:46.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.575+0000 7ff3e4a52640 1 --2- 172.21.15.194:0/4285900380 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564ed5d88660 0x564ed5e738d0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc006fc0 tx=0x7ff3dc001af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5196db69c7e404ee server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.575+0000 7ff2d2e0d640 1 -- 172.21.15.194:0/4285900380 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3dc004530 con 0x564ed5d88660 2024-09-13T06:11:46.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.575+0000 7ff2d2e0d640 1 -- 172.21.15.194:0/4285900380 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3dc0046d0 con 0x564ed5d88660 2024-09-13T06:11:46.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.575+0000 7ff2d2e0d640 1 -- 172.21.15.194:0/4285900380 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3dc004a70 con 0x564ed5d88660 2024-09-13T06:11:46.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.575+0000 7ff3e6f42980 1 -- 172.21.15.194:0/4285900380 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564ed5d88660 msgr2=0x564ed5e738d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.575+0000 7ff3e6f42980 1 --2- 172.21.15.194:0/4285900380 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564ed5d88660 0x564ed5e738d0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc006fc0 tx=0x7ff3dc001af0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.575+0000 7ff3e6f42980 1 -- 172.21.15.194:0/4285900380 shutdown_connections 2024-09-13T06:11:46.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.575+0000 7ff3e6f42980 1 --2- 172.21.15.194:0/4285900380 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564ed5d88660 0x564ed5e738d0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.575+0000 7ff3e6f42980 1 -- 172.21.15.194:0/4285900380 >> 172.21.15.194:0/4285900380 conn(0x564ed5d84180 msgr2=0x564ed5e6f500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:46.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.575+0000 7ff3e6f42980 1 -- 172.21.15.194:0/4285900380 shutdown_connections 2024-09-13T06:11:46.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.575+0000 7ff3e6f42980 1 -- 172.21.15.194:0/4285900380 wait complete. 2024-09-13T06:11:46.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.575+0000 7ff3e6f42980 1 Processor -- start 2024-09-13T06:11:46.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.579+0000 7ff3e6f42980 1 -- start start 2024-09-13T06:11:46.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.579+0000 7ff3e6f42980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564ed5d88660 0x564ed5e7ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.579+0000 7ff3e6f42980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x564ed5d8fe20 con 0x564ed5d88660 2024-09-13T06:11:46.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.579+0000 7ff3e4a52640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564ed5d88660 0x564ed5e7ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.579+0000 7ff3e4a52640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564ed5d88660 0x564ed5e7ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45442/0 (socket says 172.21.15.194:45442) 2024-09-13T06:11:46.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.579+0000 7ff3e4a52640 1 -- 172.21.15.194:0/3132000709 learned_addr learned my addr 172.21.15.194:0/3132000709 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:46.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.579+0000 7ff3e4a52640 1 -- 172.21.15.194:0/3132000709 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ed5e7b1a0 con 0x564ed5d88660 2024-09-13T06:11:46.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.579+0000 7ff3e4a52640 1 --2- 172.21.15.194:0/3132000709 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564ed5d88660 0x564ed5e7ac60 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc002260 tx=0x7ff3dc000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.579+0000 7ff2d160a640 1 -- 172.21.15.194:0/3132000709 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3dc013760 con 0x564ed5d88660 2024-09-13T06:11:46.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.579+0000 7ff3e6f42980 1 -- 172.21.15.194:0/3132000709 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564ed5e7b430 con 0x564ed5d88660 2024-09-13T06:11:46.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.579+0000 7ff2d160a640 1 -- 172.21.15.194:0/3132000709 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3dc013900 con 0x564ed5d88660 2024-09-13T06:11:46.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.579+0000 7ff2d160a640 1 -- 172.21.15.194:0/3132000709 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3dc013c20 con 0x564ed5d88660 2024-09-13T06:11:46.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.579+0000 7ff3e6f42980 1 -- 172.21.15.194:0/3132000709 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ed5e7e110 con 0x564ed5d88660 2024-09-13T06:11:46.584 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.579+0000 7ff2d160a640 1 -- 172.21.15.194:0/3132000709 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff3dc010070 con 0x564ed5d88660 2024-09-13T06:11:46.584 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.579+0000 7ff2d160a640 1 --2- 172.21.15.194:0/3132000709 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff2cc034650 0x7ff2cc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.584 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.579+0000 7ff2d160a640 1 -- 172.21.15.194:0/3132000709 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7ff3dc018070 con 0x564ed5d88660 2024-09-13T06:11:46.584 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.579+0000 7ff3e4251640 1 --2- 172.21.15.194:0/3132000709 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff2cc034650 0x7ff2cc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.584 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.579+0000 7ff3e6f42980 1 --2- 172.21.15.194:0/3132000709 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x564ed5d8c9e0 0x564ed5e81c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.584 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.579+0000 7ff3e6f42980 1 -- 172.21.15.194:0/3132000709 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564ed5e822a0 con 0x564ed5d8c9e0 2024-09-13T06:11:46.584 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.579+0000 7ff3e5253640 1 --2- 172.21.15.194:0/3132000709 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x564ed5d8c9e0 0x564ed5e81c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.584 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.583+0000 7ff3e4251640 1 --2- 172.21.15.194:0/3132000709 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff2cc034650 0x7ff2cc036b10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ff3d80ad000 tx=0x7ff3d80a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.584 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.583+0000 7ff3e5253640 1 --2- 172.21.15.194:0/3132000709 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x564ed5d8c9e0 0x564ed5e81c30 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.586 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.583+0000 7ff3e5253640 1 -- 172.21.15.194:0/3132000709 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff3d40083f0 con 0x564ed5d8c9e0 2024-09-13T06:11:46.586 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.583+0000 7ff3e6f42980 1 -- 172.21.15.194:0/3132000709 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564ed5e7f330 con 0x564ed5d8c9e0 2024-09-13T06:11:46.586 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.583+0000 7ff3e5253640 1 -- 172.21.15.194:0/3132000709 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff3d40083f0 con 0x564ed5d8c9e0 2024-09-13T06:11:46.586 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.583+0000 7ff3e6f42980 1 --2- 172.21.15.194:0/3132000709 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x564ed5e845f0 0x564ed5e869e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.586 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.583+0000 7ff3e6f42980 1 -- 172.21.15.194:0/3132000709 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564ed5e870d0 con 0x564ed5e845f0 2024-09-13T06:11:46.586 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.583+0000 7ff3e4a52640 1 --2- 172.21.15.194:0/3132000709 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x564ed5e845f0 0x564ed5e869e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.583+0000 7ff3e4a52640 1 --2- 172.21.15.194:0/3132000709 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x564ed5e845f0 0x564ed5e869e0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.583+0000 7ff3e4a52640 1 -- 172.21.15.194:0/3132000709 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff3dc01b030 con 0x564ed5e845f0 2024-09-13T06:11:46.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.583+0000 7ff3e6f42980 1 -- 172.21.15.194:0/3132000709 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564ed5e83490 con 0x564ed5d8c9e0 2024-09-13T06:11:46.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.583+0000 7ff3e5253640 1 -- 172.21.15.194:0/3132000709 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff3d40083f0 con 0x564ed5d8c9e0 2024-09-13T06:11:46.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.583+0000 7ff3e6f42980 1 --2- 172.21.15.194:0/3132000709 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x564ed5e88530 0x564ed5e8a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.583+0000 7ff3e6f42980 1 -- 172.21.15.194:0/3132000709 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564ed5e8b060 con 0x564ed5e88530 2024-09-13T06:11:46.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.583+0000 7ff3e4251640 1 --2- 172.21.15.194:0/3132000709 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x564ed5e88530 0x564ed5e8a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.583+0000 7ff3e4251640 1 --2- 172.21.15.194:0/3132000709 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x564ed5e88530 0x564ed5e8a920 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.583+0000 7ff3e4251640 1 -- 172.21.15.194:0/3132000709 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff3d80b3040 con 0x564ed5e88530 2024-09-13T06:11:46.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.583+0000 7ff3e6f42980 1 Processor -- start 2024-09-13T06:11:46.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.583+0000 7ff3e6f42980 1 -- start start 2024-09-13T06:11:46.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.583+0000 7ff3e6f42980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564ed5e98b30 0x564ed5e98f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.583+0000 7ff3e6f42980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x564ed5c8f800 con 0x564ed5e98b30 2024-09-13T06:11:46.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.587+0000 7ff3e4a52640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564ed5e98b30 0x564ed5e98f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.587+0000 7ff3e4a52640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564ed5e98b30 0x564ed5e98f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45450/0 (socket says 172.21.15.194:45450) 2024-09-13T06:11:46.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.587+0000 7ff3e4a52640 1 -- 172.21.15.194:0/2706995478 learned_addr learned my addr 172.21.15.194:0/2706995478 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:46.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.587+0000 7ff3e4a52640 1 -- 172.21.15.194:0/2706995478 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ed5e99490 con 0x564ed5e98b30 2024-09-13T06:11:46.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.587+0000 7ff3e4a52640 1 --2- 172.21.15.194:0/2706995478 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564ed5e98b30 0x564ed5e98f50 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc0483f0 tx=0x7ff3dc021cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.587+0000 7ff2ca7fc640 1 -- 172.21.15.194:0/2706995478 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3dc029680 con 0x564ed5e98b30 2024-09-13T06:11:46.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.587+0000 7ff2ca7fc640 1 -- 172.21.15.194:0/2706995478 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3dc029840 con 0x564ed5e98b30 2024-09-13T06:11:46.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.587+0000 7ff3e6f42980 1 -- 172.21.15.194:0/2706995478 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564ed5e99720 con 0x564ed5e98b30 2024-09-13T06:11:46.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.587+0000 7ff2ca7fc640 1 -- 172.21.15.194:0/2706995478 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3dc0123c0 con 0x564ed5e98b30 2024-09-13T06:11:46.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.587+0000 7ff3e6f42980 1 -- 172.21.15.194:0/2706995478 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ed5e9c3a0 con 0x564ed5e98b30 2024-09-13T06:11:46.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.587+0000 7ff2ca7fc640 1 -- 172.21.15.194:0/2706995478 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff3dc012560 con 0x564ed5e98b30 2024-09-13T06:11:46.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.587+0000 7ff2ca7fc640 1 --2- 172.21.15.194:0/2706995478 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff2bc034650 0x7ff2bc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.587+0000 7ff2ca7fc640 1 -- 172.21.15.194:0/2706995478 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7ff3dc014050 con 0x564ed5e98b30 2024-09-13T06:11:46.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.587+0000 7ff3e4251640 1 --2- 172.21.15.194:0/2706995478 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff2bc034650 0x7ff2bc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.587+0000 7ff3e6f42980 1 Processor -- start 2024-09-13T06:11:46.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.587+0000 7ff3e6f42980 1 -- start start 2024-09-13T06:11:46.592 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.587+0000 7ff3e4251640 1 --2- 172.21.15.194:0/2706995478 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff2bc034650 0x7ff2bc036b10 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x564ed5e82770 tx=0x7ff3d8005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.587+0000 7ff3e6f42980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564ed5ea52a0 0x564ed5ea56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.587+0000 7ff3e6f42980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x564ed5e74220 con 0x564ed5ea52a0 2024-09-13T06:11:46.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.587+0000 7ff3e4a52640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564ed5ea52a0 0x564ed5ea56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.587+0000 7ff3e4a52640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564ed5ea52a0 0x564ed5ea56a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45452/0 (socket says 172.21.15.194:45452) 2024-09-13T06:11:46.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.587+0000 7ff3e4a52640 1 -- 172.21.15.194:0/3771439718 learned_addr learned my addr 172.21.15.194:0/3771439718 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:46.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.591+0000 7ff3e4a52640 1 -- 172.21.15.194:0/3771439718 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ed5ea5c70 con 0x564ed5ea52a0 2024-09-13T06:11:46.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.591+0000 7ff3e4a52640 1 --2- 172.21.15.194:0/3771439718 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564ed5ea52a0 0x564ed5ea56a0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc050030 tx=0x7ff3dc04eb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77abc8a1ff54a7d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.591+0000 7ff2bbfff640 1 -- 172.21.15.194:0/3771439718 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3dc015e40 con 0x564ed5ea52a0 2024-09-13T06:11:46.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.591+0000 7ff2bbfff640 1 -- 172.21.15.194:0/3771439718 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3dc011be0 con 0x564ed5ea52a0 2024-09-13T06:11:46.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.591+0000 7ff2bbfff640 1 -- 172.21.15.194:0/3771439718 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3dc028830 con 0x564ed5ea52a0 2024-09-13T06:11:46.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.591+0000 7ff3e6f42980 1 -- 172.21.15.194:0/3771439718 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564ed5ea52a0 msgr2=0x564ed5ea56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.591+0000 7ff3e6f42980 1 --2- 172.21.15.194:0/3771439718 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564ed5ea52a0 0x564ed5ea56a0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc050030 tx=0x7ff3dc04eb70 comp rx=0 tx=0).stop 2024-09-13T06:11:46.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.591+0000 7ff3e6f42980 1 -- 172.21.15.194:0/3771439718 shutdown_connections 2024-09-13T06:11:46.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.591+0000 7ff3e6f42980 1 --2- 172.21.15.194:0/3771439718 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564ed5ea52a0 0x564ed5ea56a0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.591+0000 7ff3e6f42980 1 -- 172.21.15.194:0/3771439718 >> 172.21.15.194:0/3771439718 conn(0x564ed5ea1680 msgr2=0x564ed5e9f780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:46.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.591+0000 7ff3e6f42980 1 -- 172.21.15.194:0/3771439718 shutdown_connections 2024-09-13T06:11:46.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.591+0000 7ff3e6f42980 1 -- 172.21.15.194:0/3771439718 wait complete. 2024-09-13T06:11:46.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.591+0000 7ff3e6f42980 1 Processor -- start 2024-09-13T06:11:46.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.591+0000 7ff3e6f42980 1 -- start start 2024-09-13T06:11:46.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.591+0000 7ff3e6f42980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564ed5ea52a0 0x564ed5cfecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.591+0000 7ff3e6f42980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x564ed5ea60f0 con 0x564ed5ea52a0 2024-09-13T06:11:46.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.591+0000 7ff3e4a52640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564ed5ea52a0 0x564ed5cfecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.591+0000 7ff3e4a52640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564ed5ea52a0 0x564ed5cfecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45460/0 (socket says 172.21.15.194:45460) 2024-09-13T06:11:46.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.591+0000 7ff3e4a52640 1 -- 172.21.15.194:0/2558235830 learned_addr learned my addr 172.21.15.194:0/2558235830 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:46.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.591+0000 7ff3e4a52640 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ed5cff200 con 0x564ed5ea52a0 2024-09-13T06:11:46.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.591+0000 7ff3e4a52640 1 --2- 172.21.15.194:0/2558235830 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564ed5ea52a0 0x564ed5cfecc0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc038010 tx=0x7ff3dc04ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.591+0000 7ff2ba7fc640 1 -- 172.21.15.194:0/2558235830 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3dc028830 con 0x564ed5ea52a0 2024-09-13T06:11:46.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.591+0000 7ff3e6f42980 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564ed5cff200 con 0x564ed5ea52a0 2024-09-13T06:11:46.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.591+0000 7ff2ba7fc640 1 -- 172.21.15.194:0/2558235830 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3dc0115d0 con 0x564ed5ea52a0 2024-09-13T06:11:46.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.591+0000 7ff2ba7fc640 1 -- 172.21.15.194:0/2558235830 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3dc0289d0 con 0x564ed5ea52a0 2024-09-13T06:11:46.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.591+0000 7ff3e6f42980 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ed5cff200 con 0x564ed5ea52a0 2024-09-13T06:11:46.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.595+0000 7ff2ba7fc640 1 -- 172.21.15.194:0/2558235830 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff3dc075060 con 0x564ed5ea52a0 2024-09-13T06:11:46.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.595+0000 7ff2ba7fc640 1 --2- 172.21.15.194:0/2558235830 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff2b0034650 0x7ff2b0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.595+0000 7ff2ba7fc640 1 -- 172.21.15.194:0/2558235830 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7ff3dc078d10 con 0x564ed5ea52a0 2024-09-13T06:11:46.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.595+0000 7ff3e4251640 1 --2- 172.21.15.194:0/2558235830 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff2b0034650 0x7ff2b0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.595+0000 7ff3e6f42980 20 rados->read ofs=0 len=0 2024-09-13T06:11:46.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.595+0000 7ff3e6f42980 1 --2- 172.21.15.194:0/2558235830 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x564ed5eb9750 0x564ed5ebbc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.595+0000 7ff3e6f42980 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564ed5ebc360 con 0x564ed5eb9750 2024-09-13T06:11:46.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.595+0000 7ff3e5253640 1 --2- 172.21.15.194:0/2558235830 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x564ed5eb9750 0x564ed5ebbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.595+0000 7ff3e4251640 1 --2- 172.21.15.194:0/2558235830 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff2b0034650 0x7ff2b0036b10 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff3d80ae040 tx=0x7ff3d80b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.595+0000 7ff3e5253640 1 --2- 172.21.15.194:0/2558235830 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x564ed5eb9750 0x564ed5ebbc10 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.595+0000 7ff3e5253640 1 -- 172.21.15.194:0/2558235830 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff3d40083f0 con 0x564ed5eb9750 2024-09-13T06:11:46.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.595+0000 7ff3e6f42980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:46.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.595+0000 7ff3e6f42980 20 realm 2024-09-13T06:11:46.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.595+0000 7ff3e6f42980 20 rados->read ofs=0 len=0 2024-09-13T06:11:46.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.595+0000 7ff3e6f42980 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564ed5ebc770 con 0x564ed5eb9750 2024-09-13T06:11:46.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.595+0000 7ff3e5253640 1 -- 172.21.15.194:0/2558235830 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff3d40083f0 con 0x564ed5eb9750 2024-09-13T06:11:46.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.595+0000 7ff3e6f42980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:46.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.595+0000 7ff3e6f42980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:11:46.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.595+0000 7ff3e6f42980 20 rados->read ofs=0 len=0 2024-09-13T06:11:46.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.595+0000 7ff3e6f42980 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564ed5ebd040 con 0x564ed5eb9750 2024-09-13T06:11:46.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.595+0000 7ff3e5253640 1 -- 172.21.15.194:0/2558235830 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff3d40083f0 con 0x564ed5eb9750 2024-09-13T06:11:46.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.595+0000 7ff3e6f42980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:46.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.595+0000 7ff3e6f42980 20 rados->read ofs=0 len=0 2024-09-13T06:11:46.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.595+0000 7ff3e6f42980 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564ed5ebd3e0 con 0x564ed5eb9750 2024-09-13T06:11:46.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.595+0000 7ff3e5253640 1 -- 172.21.15.194:0/2558235830 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff3d40083f0 con 0x564ed5eb9750 2024-09-13T06:11:46.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.595+0000 7ff3e6f42980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:11:46.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.595+0000 7ff3e6f42980 20 rados->read ofs=0 len=0 2024-09-13T06:11:46.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.595+0000 7ff3e6f42980 1 --2- 172.21.15.194:0/2558235830 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x564ed5ebe140 0x564ed5ec0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.595+0000 7ff3e6f42980 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564ed5ec0b00 con 0x564ed5ebe140 2024-09-13T06:11:46.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.595+0000 7ff3e4a52640 1 --2- 172.21.15.194:0/2558235830 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x564ed5ebe140 0x564ed5ec0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.595+0000 7ff3e4a52640 1 --2- 172.21.15.194:0/2558235830 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x564ed5ebe140 0x564ed5ec0530 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.595+0000 7ff3e4a52640 1 -- 172.21.15.194:0/2558235830 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff3dc01b030 con 0x564ed5ebe140 2024-09-13T06:11:46.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.595+0000 7ff3e6f42980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:11:46.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.595+0000 7ff3e6f42980 20 searching for the correct realm 2024-09-13T06:11:46.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.599+0000 7ff3e6f42980 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564ed5ec23d0 con 0x564ed5ebe140 2024-09-13T06:11:46.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.599+0000 7ff3e4a52640 1 -- 172.21.15.194:0/2558235830 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff3dc01b030 con 0x564ed5ebe140 2024-09-13T06:11:46.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.599+0000 7ff3e4a52640 1 --2- 172.21.15.194:0/2558235830 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7ff3dc064b60 0x7ff3dc0484d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.599+0000 7ff3e4a52640 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564ed5ec23d0 con 0x7ff3dc064b60 2024-09-13T06:11:46.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.599+0000 7ff3e4251640 1 --2- 172.21.15.194:0/2558235830 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7ff3dc064b60 0x7ff3dc0484d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.599+0000 7ff3e4251640 1 --2- 172.21.15.194:0/2558235830 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7ff3dc064b60 0x7ff3dc0484d0 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.599+0000 7ff3e4251640 1 -- 172.21.15.194:0/2558235830 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff3d80c9030 con 0x7ff3dc064b60 2024-09-13T06:11:46.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.599+0000 7ff3e4251640 1 --2- 172.21.15.194:0/2558235830 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7ff3d80dc040 0x7ff3d80dd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.599+0000 7ff3e4251640 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564ed5ec23d0 con 0x7ff3d80dc040 2024-09-13T06:11:46.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.599+0000 7ff3e5253640 1 --2- 172.21.15.194:0/2558235830 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7ff3d80dc040 0x7ff3d80dd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.599+0000 7ff3e5253640 1 --2- 172.21.15.194:0/2558235830 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7ff3d80dc040 0x7ff3d80dd430 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.599+0000 7ff3e5253640 1 -- 172.21.15.194:0/2558235830 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff3d40083f0 con 0x7ff3d80dc040 2024-09-13T06:11:46.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.599+0000 7ff3e5253640 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564ed5ebd3e0 con 0x564ed5eb9750 2024-09-13T06:11:46.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.599+0000 7ff3e5253640 1 -- 172.21.15.194:0/2558235830 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff3d40083f0 con 0x564ed5eb9750 2024-09-13T06:11:46.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.599+0000 7ff3e5253640 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564ed5ebd3e0 con 0x564ed5eb9750 2024-09-13T06:11:46.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.599+0000 7ff3e5253640 1 -- 172.21.15.194:0/2558235830 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff3d40083f0 con 0x564ed5eb9750 2024-09-13T06:11:46.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.599+0000 7ff3e5253640 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564ed5ebd3e0 con 0x7ff3d80dc040 2024-09-13T06:11:46.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.603+0000 7ff3e5253640 1 -- 172.21.15.194:0/2558235830 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff3d40083f0 con 0x7ff3d80dc040 2024-09-13T06:11:46.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.603+0000 7ff3e5253640 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564ed5ebd3e0 con 0x7ff3d80dc040 2024-09-13T06:11:46.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.603+0000 7ff3e5253640 1 -- 172.21.15.194:0/2558235830 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff3d40083f0 con 0x7ff3d80dc040 2024-09-13T06:11:46.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.603+0000 7ff3e5253640 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564ed5ebd3e0 con 0x7ff3dc064b60 2024-09-13T06:11:46.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.603+0000 7ff3e4251640 1 -- 172.21.15.194:0/2558235830 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff3d80c9030 con 0x7ff3dc064b60 2024-09-13T06:11:46.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.603+0000 7ff3e4251640 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564ed5ebd3e0 con 0x564ed5ebe140 2024-09-13T06:11:46.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.603+0000 7ff3e4a52640 1 -- 172.21.15.194:0/2558235830 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff3dc01b030 con 0x564ed5ebe140 2024-09-13T06:11:46.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.603+0000 7ff3e4a52640 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564ed5ebd3e0 con 0x564ed5eb9750 2024-09-13T06:11:46.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.603+0000 7ff3e5253640 1 -- 172.21.15.194:0/2558235830 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff3d40083f0 con 0x564ed5eb9750 2024-09-13T06:11:46.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.603+0000 7ff3e5253640 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564ed5ebd3e0 con 0x7ff3d80dc040 2024-09-13T06:11:46.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.603+0000 7ff3e5253640 1 -- 172.21.15.194:0/2558235830 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff3d40083f0 con 0x7ff3d80dc040 2024-09-13T06:11:46.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.603+0000 7ff3e5253640 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564ed5ebd3e0 con 0x564ed5eb9750 2024-09-13T06:11:46.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.603+0000 7ff3e5253640 1 -- 172.21.15.194:0/2558235830 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff3d40083f0 con 0x564ed5eb9750 2024-09-13T06:11:46.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.603+0000 7ff3e5253640 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564ed5ebd3e0 con 0x7ff3dc064b60 2024-09-13T06:11:46.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.603+0000 7ff3e4251640 1 -- 172.21.15.194:0/2558235830 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff3d80c9030 con 0x7ff3dc064b60 2024-09-13T06:11:46.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.603+0000 7ff3e4251640 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564ed5ebd3e0 con 0x564ed5ebe140 2024-09-13T06:11:46.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.603+0000 7ff3e4a52640 1 -- 172.21.15.194:0/2558235830 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff3dc01b030 con 0x564ed5ebe140 2024-09-13T06:11:46.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.603+0000 7ff3e4a52640 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564ed5ebd3e0 con 0x564ed5ebe140 2024-09-13T06:11:46.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.603+0000 7ff3e4a52640 1 -- 172.21.15.194:0/2558235830 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff3dc01b030 con 0x564ed5ebe140 2024-09-13T06:11:46.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.603+0000 7ff3e4a52640 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564ed5ebd3e0 con 0x7ff3d80dc040 2024-09-13T06:11:46.614 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.603+0000 7ff3e5253640 1 -- 172.21.15.194:0/2558235830 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff3d40083f0 con 0x7ff3d80dc040 2024-09-13T06:11:46.614 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.603+0000 7ff3e5253640 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564ed5ebd3e0 con 0x564ed5ebe140 2024-09-13T06:11:46.614 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.607+0000 7ff3e4a52640 1 -- 172.21.15.194:0/2558235830 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff3dc01b030 con 0x564ed5ebe140 2024-09-13T06:11:46.614 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.607+0000 7ff3e4a52640 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564ed5ebd3e0 con 0x564ed5ebe140 2024-09-13T06:11:46.614 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.607+0000 7ff3e4a52640 1 -- 172.21.15.194:0/2558235830 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff3dc01b030 con 0x564ed5ebe140 2024-09-13T06:11:46.614 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.607+0000 7ff3e4a52640 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564ed5ebd3e0 con 0x564ed5eb9750 2024-09-13T06:11:46.614 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.607+0000 7ff3e5253640 1 -- 172.21.15.194:0/2558235830 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff3d40083f0 con 0x564ed5eb9750 2024-09-13T06:11:46.614 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.607+0000 7ff3e5253640 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564ed5ebd3e0 con 0x564ed5eb9750 2024-09-13T06:11:46.614 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.607+0000 7ff3e5253640 1 -- 172.21.15.194:0/2558235830 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v35'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff3d40083f0 con 0x564ed5eb9750 2024-09-13T06:11:46.614 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.607+0000 7ff3e5253640 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564ed5ebd3e0 con 0x7ff3dc064b60 2024-09-13T06:11:46.614 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.607+0000 7ff3e4251640 1 -- 172.21.15.194:0/2558235830 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff3d80c9030 con 0x7ff3dc064b60 2024-09-13T06:11:46.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.607+0000 7ff3e4251640 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564ed5ebd3e0 con 0x564ed5ebe140 2024-09-13T06:11:46.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.607+0000 7ff3e4a52640 1 -- 172.21.15.194:0/2558235830 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff3dc01b030 con 0x564ed5ebe140 2024-09-13T06:11:46.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.607+0000 7ff3e4a52640 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564ed5ebd3e0 con 0x7ff3dc064b60 2024-09-13T06:11:46.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.607+0000 7ff3e4251640 1 -- 172.21.15.194:0/2558235830 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff3d80c9030 con 0x7ff3dc064b60 2024-09-13T06:11:46.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.607+0000 7ff3e4251640 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564ed5ebd3e0 con 0x564ed5eb9750 2024-09-13T06:11:46.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.607+0000 7ff3e5253640 1 -- 172.21.15.194:0/2558235830 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff3d40083f0 con 0x564ed5eb9750 2024-09-13T06:11:46.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.607+0000 7ff3e5253640 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564ed5ebd3e0 con 0x7ff3d80dc040 2024-09-13T06:11:46.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.607+0000 7ff3e5253640 1 -- 172.21.15.194:0/2558235830 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff3d40083f0 con 0x7ff3d80dc040 2024-09-13T06:11:46.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.607+0000 7ff3e5253640 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564ed5ebd3e0 con 0x564ed5ebe140 2024-09-13T06:11:46.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.607+0000 7ff3e4a52640 1 -- 172.21.15.194:0/2558235830 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=107b] v35'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff3dc01b030 con 0x564ed5ebe140 2024-09-13T06:11:46.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.607+0000 7ff3e4a52640 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564ed5ebd3e0 con 0x7ff3dc064b60 2024-09-13T06:11:46.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.607+0000 7ff3e4251640 1 -- 172.21.15.194:0/2558235830 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff3d80c9030 con 0x7ff3dc064b60 2024-09-13T06:11:46.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.607+0000 7ff3e4251640 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564ed5ebd3e0 con 0x7ff3dc064b60 2024-09-13T06:11:46.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.607+0000 7ff3e4251640 1 -- 172.21.15.194:0/2558235830 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff3d80c9030 con 0x7ff3dc064b60 2024-09-13T06:11:46.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.607+0000 7ff3e4251640 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564ed5ebd3e0 con 0x564ed5ebe140 2024-09-13T06:11:46.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.607+0000 7ff3e4a52640 1 -- 172.21.15.194:0/2558235830 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff3dc01b030 con 0x564ed5ebe140 2024-09-13T06:11:46.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.607+0000 7ff3e4a52640 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564ed5ebd3e0 con 0x7ff3d80dc040 2024-09-13T06:11:46.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.611+0000 7ff3e5253640 1 -- 172.21.15.194:0/2558235830 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff3d40083f0 con 0x7ff3d80dc040 2024-09-13T06:11:46.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.611+0000 7ff3e5253640 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564ed5ebd3e0 con 0x564ed5eb9750 2024-09-13T06:11:46.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.611+0000 7ff3e5253640 1 -- 172.21.15.194:0/2558235830 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v35'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff3d40083f0 con 0x564ed5eb9750 2024-09-13T06:11:46.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.611+0000 7ff3e5253640 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564ed5ebd3e0 con 0x7ff3dc064b60 2024-09-13T06:11:46.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.611+0000 7ff3e4251640 1 -- 172.21.15.194:0/2558235830 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff3d80c9030 con 0x7ff3dc064b60 2024-09-13T06:11:46.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.611+0000 7ff3e6f42980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:11:46.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.611+0000 7ff3e6f42980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:11:46.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.611+0000 7ff3e6f42980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:11:46.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.611+0000 7ff3e6f42980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:11:46.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.611+0000 7ff3e6f42980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:11:46.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.611+0000 7ff3e6f42980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:11:46.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.611+0000 7ff3e6f42980 20 rados->read ofs=0 len=0 2024-09-13T06:11:46.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.611+0000 7ff3e6f42980 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564ed5ec14c0 con 0x564ed5eb9750 2024-09-13T06:11:46.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.611+0000 7ff3e5253640 1 -- 172.21.15.194:0/2558235830 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff3d40083f0 con 0x564ed5eb9750 2024-09-13T06:11:46.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.611+0000 7ff3e6f42980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:46.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.611+0000 7ff3e6f42980 20 rados->read ofs=0 len=0 2024-09-13T06:11:46.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.611+0000 7ff3e6f42980 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564ed5ec1100 con 0x564ed5eb9750 2024-09-13T06:11:46.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.611+0000 7ff3e5253640 1 -- 172.21.15.194:0/2558235830 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff3d40083f0 con 0x564ed5eb9750 2024-09-13T06:11:46.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.611+0000 7ff3e6f42980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:11:46.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.611+0000 7ff3e6f42980 20 rados->read ofs=0 len=0 2024-09-13T06:11:46.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.611+0000 7ff3e6f42980 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564ed5ec1de0 con 0x7ff3dc064b60 2024-09-13T06:11:46.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.611+0000 7ff3e4251640 1 -- 172.21.15.194:0/2558235830 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff3d80c9030 con 0x7ff3dc064b60 2024-09-13T06:11:46.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.611+0000 7ff3e6f42980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:11:46.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.611+0000 7ff3e6f42980 20 zone default found 2024-09-13T06:11:46.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.611+0000 7ff3e6f42980 4 Realm: () 2024-09-13T06:11:46.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.611+0000 7ff3e6f42980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:11:46.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.611+0000 7ff3e6f42980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:11:46.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.611+0000 7ff3e6f42980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:11:46.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.611+0000 7ff3e6f42980 20 zonegroup default 2024-09-13T06:11:46.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.611+0000 7ff3e6f42980 20 rados->read ofs=0 len=0 2024-09-13T06:11:46.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.611+0000 7ff3e6f42980 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564ed5ec2800 con 0x7ff3d80dc040 2024-09-13T06:11:46.620 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.611+0000 7ff3e5253640 1 -- 172.21.15.194:0/2558235830 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff3d40083f0 con 0x7ff3d80dc040 2024-09-13T06:11:46.620 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.611+0000 7ff3e6f42980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:46.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.611+0000 7ff3e6f42980 20 rados->read ofs=0 len=0 2024-09-13T06:11:46.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.611+0000 7ff3e6f42980 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564ed5ec41e0 con 0x564ed5ebe140 2024-09-13T06:11:46.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.611+0000 7ff3e4a52640 1 -- 172.21.15.194:0/2558235830 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff3dc01b030 con 0x564ed5ebe140 2024-09-13T06:11:46.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.611+0000 7ff3e6f42980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:46.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.611+0000 7ff3e6f42980 20 rados->read ofs=0 len=0 2024-09-13T06:11:46.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.611+0000 7ff3e6f42980 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564ed5ec45f0 con 0x564ed5ebe140 2024-09-13T06:11:46.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.611+0000 7ff3e4a52640 1 -- 172.21.15.194:0/2558235830 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff3dc01b030 con 0x564ed5ebe140 2024-09-13T06:11:46.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.611+0000 7ff3e6f42980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:46.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.611+0000 7ff3e6f42980 20 started sync module instance, tier type = 2024-09-13T06:11:46.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.611+0000 7ff3e6f42980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:11:46.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.611+0000 7ff3e6f42980 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564ed5ec3680 con 0x7ff3dc064b60 2024-09-13T06:11:46.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.615+0000 7ff3e4251640 1 -- 172.21.15.194:0/2558235830 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(44 notify.0 [create] v35'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff3d80c9030 con 0x7ff3dc064b60 2024-09-13T06:11:46.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.615+0000 7ff3e6f42980 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94896596466288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564ed5ec4f00 con 0x7ff3dc064b60 2024-09-13T06:11:46.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.615+0000 7ff3e6f42980 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564ed5ec5750 con 0x564ed5eb9750 2024-09-13T06:11:46.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.615+0000 7ff3e4251640 1 -- 172.21.15.194:0/2558235830 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94896596466288] v35'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff3d80c9030 con 0x7ff3dc064b60 2024-09-13T06:11:46.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.615+0000 7ff3e5253640 1 -- 172.21.15.194:0/2558235830 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v35'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff3d40083f0 con 0x564ed5eb9750 2024-09-13T06:11:46.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.615+0000 7ff3e6f42980 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94896596470352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564ed5ec5750 con 0x564ed5eb9750 2024-09-13T06:11:46.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.615+0000 7ff3e6f42980 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564ed5ec61f0 con 0x564ed5ebe140 2024-09-13T06:11:46.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.619+0000 7ff3e5253640 1 -- 172.21.15.194:0/2558235830 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94896596470352] v35'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff3d40083f0 con 0x564ed5eb9750 2024-09-13T06:11:46.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.619+0000 7ff3e4a52640 1 -- 172.21.15.194:0/2558235830 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v35'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff3dc01b030 con 0x564ed5ebe140 2024-09-13T06:11:46.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.619+0000 7ff3e6f42980 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94896596472480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564ed5ec56c0 con 0x564ed5ebe140 2024-09-13T06:11:46.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.619+0000 7ff3e6f42980 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564ed5ec6f40 con 0x7ff3dc064b60 2024-09-13T06:11:46.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.619+0000 7ff3e4251640 1 -- 172.21.15.194:0/2558235830 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(50 notify.3 [create] v35'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff3d80c9030 con 0x7ff3dc064b60 2024-09-13T06:11:46.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.619+0000 7ff3e6f42980 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94896596478608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564ed5ec77e0 con 0x7ff3dc064b60 2024-09-13T06:11:46.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.619+0000 7ff3e6f42980 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564ed5ec81e0 con 0x564ed5eb9750 2024-09-13T06:11:46.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.619+0000 7ff3e4a52640 1 -- 172.21.15.194:0/2558235830 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94896596472480] v35'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff3dc01b030 con 0x564ed5ebe140 2024-09-13T06:11:46.624 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.619+0000 7ff3e4251640 1 -- 172.21.15.194:0/2558235830 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94896596478608] v35'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff3d80c9030 con 0x7ff3dc064b60 2024-09-13T06:11:46.624 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.623+0000 7ff3e5253640 1 -- 172.21.15.194:0/2558235830 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v35'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff3d40083f0 con 0x564ed5eb9750 2024-09-13T06:11:46.624 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.623+0000 7ff3e6f42980 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94896596477408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564ed5ec7330 con 0x564ed5eb9750 2024-09-13T06:11:46.624 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.623+0000 7ff3e6f42980 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564ed5ec8a80 con 0x7ff3d80dc040 2024-09-13T06:11:46.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.623+0000 7ff3e5253640 1 -- 172.21.15.194:0/2558235830 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(54 notify.5 [create] v35'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff3d40083f0 con 0x7ff3d80dc040 2024-09-13T06:11:46.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.623+0000 7ff3e6f42980 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94896596485120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564ed5ec8cd0 con 0x7ff3d80dc040 2024-09-13T06:11:46.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.623+0000 7ff3e6f42980 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564ed5ec9520 con 0x7ff3d80dc040 2024-09-13T06:11:46.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.623+0000 7ff3e5253640 1 -- 172.21.15.194:0/2558235830 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94896596477408] v35'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff3d40083f0 con 0x564ed5eb9750 2024-09-13T06:11:46.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.627+0000 7ff3e5253640 1 -- 172.21.15.194:0/2558235830 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(56 notify.6 [create] v35'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff3d40083f0 con 0x7ff3d80dc040 2024-09-13T06:11:46.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.627+0000 7ff3e6f42980 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94896596487376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564ed5ec95a0 con 0x7ff3d80dc040 2024-09-13T06:11:46.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.627+0000 7ff3e6f42980 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564ed5ec9e50 con 0x7ff3d80dc040 2024-09-13T06:11:46.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.627+0000 7ff3e5253640 1 -- 172.21.15.194:0/2558235830 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94896596485120] v35'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff3d40083f0 con 0x7ff3d80dc040 2024-09-13T06:11:46.631 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.627+0000 7ff3e5253640 1 -- 172.21.15.194:0/2558235830 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94896596487376] v35'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff3d40083f0 con 0x7ff3d80dc040 2024-09-13T06:11:46.631 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.627+0000 7ff3e5253640 1 -- 172.21.15.194:0/2558235830 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(58 notify.7 [create] v35'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff3d40083f0 con 0x7ff3d80dc040 2024-09-13T06:11:46.631 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.627+0000 7ff3e6f42980 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94896596486176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564ed5ec95a0 con 0x7ff3d80dc040 2024-09-13T06:11:46.631 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.627+0000 7ff3e6f42980 20 add_watcher() i=0 2024-09-13T06:11:46.631 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.627+0000 7ff3e6f42980 20 add_watcher() i=1 2024-09-13T06:11:46.631 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.627+0000 7ff3e6f42980 20 add_watcher() i=2 2024-09-13T06:11:46.631 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.627+0000 7ff3e6f42980 20 add_watcher() i=3 2024-09-13T06:11:46.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.627+0000 7ff3e6f42980 20 add_watcher() i=4 2024-09-13T06:11:46.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.627+0000 7ff3e6f42980 20 add_watcher() i=5 2024-09-13T06:11:46.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.627+0000 7ff3e6f42980 20 add_watcher() i=6 2024-09-13T06:11:46.633 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.631+0000 7ff3e5253640 1 -- 172.21.15.194:0/2558235830 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94896596486176] v35'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff3d40083f0 con 0x7ff3d80dc040 2024-09-13T06:11:46.633 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.631+0000 7ff3e6f42980 20 add_watcher() i=7 2024-09-13T06:11:46.633 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.631+0000 7ff3e6f42980 2 all 8 watchers are set, enabling cache 2024-09-13T06:11:46.633 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.631+0000 7ff3e6f42980 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564ed5eccf50 con 0x564ed5eb9750 2024-09-13T06:11:46.633 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.631+0000 7ff3e5253640 1 -- 172.21.15.194:0/2558235830 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff3d40083f0 con 0x564ed5eb9750 2024-09-13T06:11:46.633 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.631+0000 7ff3e6f42980 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94896596488432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564ed5eca3d0 con 0x564ed5eb9750 2024-09-13T06:11:46.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.631+0000 7ff3e5253640 1 -- 172.21.15.194:0/2558235830 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94896596488432] v35'263 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff3d40083f0 con 0x564ed5eb9750 2024-09-13T06:11:46.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.631+0000 7ff29afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:11:46.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.631+0000 7ff3e6f42980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:11:46.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.631+0000 7ff3e6f42980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:11:46.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.631+0000 7ff3e6f42980 5 note: GC not initialized 2024-09-13T06:11:46.636 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.631+0000 7ff299fe3640 20 reqs_thread_entry: start 2024-09-13T06:11:46.636 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.631+0000 7ff3e6f42980 20 init_complete bucket index max shards: 11 2024-09-13T06:11:46.636 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.631+0000 7ff3e6f42980 20 Filter name: none 2024-09-13T06:11:46.636 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.631+0000 7ff20b7fe640 20 reqs_thread_entry: start 2024-09-13T06:11:46.636 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.631+0000 7ff3e6f42980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T06:11:46.636 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.631+0000 7ff3e6f42980 20 rados->read ofs=0 len=0 2024-09-13T06:11:46.636 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.631+0000 7ff3e6f42980 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564ed5ef03f0 con 0x7ff3d80dc040 2024-09-13T06:11:46.637 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.635+0000 7ff3e5253640 1 -- 172.21.15.194:0/2558235830 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(62 ada [call out=48b,read 0~503 out=503b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+626 (crc 0 0 0) 0x7ff3d40083f0 con 0x7ff3d80dc040 2024-09-13T06:11:46.637 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.635+0000 7ff3e6f42980 20 rados_obj.operate() r=0 bl.length=503 2024-09-13T06:11:46.637 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.635+0000 7ff3e6f42980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-13T06:11:46.637 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.635+0000 7ff3e6f42980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T06:11:46.637 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.635+0000 7ff3e6f42980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:11:46.637 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.635+0000 7ff3e6f42980 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564ed5ef6da0 con 0x7ff3d80dc040 2024-09-13T06:11:46.639 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.635+0000 7ff3e5253640 1 -- 172.21.15.194:0/2558235830 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v35'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7ff3d40083f0 con 0x7ff3d80dc040 2024-09-13T06:11:46.639 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.635+0000 7ff3e6f42980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T06:11:46.639 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.635+0000 7ff3e6f42980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T06:11:46.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.635+0000 7ff3e6f42980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T06:11:46.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.635+0000 7ff3e6f42980 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94896596674576 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564ed5ef24d0 con 0x564ed5eb9750 2024-09-13T06:11:46.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.635+0000 7ff3e5253640 1 -- 172.21.15.194:0/2558235830 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== watch-notify(notify (1) cookie 94896596477408 notify 150323855387 ret 0) ==== 678+0+0 (crc 0 0 0) 0x7ff3d4010040 con 0x564ed5eb9750 2024-09-13T06:11:46.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.635+0000 7ff2bbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855387 cookie 94896596477408 notifier 4892 bl.length()=636 2024-09-13T06:11:46.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.635+0000 7ff2bbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T06:11:46.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.635+0000 7ff2bbfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T06:11:46.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.635+0000 7ff3e5253640 1 -- 172.21.15.194:0/2558235830 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(64 notify.4 [notify cookie 94896596674576 out=8b] v0'0 uv267 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff3d40083f0 con 0x564ed5eb9750 2024-09-13T06:11:46.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.635+0000 7ff2bbfff640 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7ff2a8003eb0 con 0x564ed5eb9750 2024-09-13T06:11:46.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.639+0000 7ff3e5253640 1 -- 172.21.15.194:0/2558235830 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== watch-notify(notify_complete (2) cookie 94896596674576 notify 150323855387 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7ff3d4029430 con 0x564ed5eb9750 2024-09-13T06:11:46.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.639+0000 7ff3e5253640 1 -- 172.21.15.194:0/2558235830 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff3d40083f0 con 0x564ed5eb9750 2024-09-13T06:11:46.641 INFO:teuthology.orchestra.run.smithi194.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T06:11:44.596796Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:11:44.596784Z","tags":[],"group_ids":[]} 2024-09-13T06:11:46.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.639+0000 7ff29afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:11:46.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.639+0000 7ff3e6f42980 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94896596488432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564ed5eee1e0 con 0x564ed5eb9750 2024-09-13T06:11:46.642 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.639+0000 7ff3e5253640 1 -- 172.21.15.194:0/2558235830 <== osd.1 v2:172.21.15.194:6808/3135444559 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94896596488432] v35'264 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff3d40083f0 con 0x564ed5eb9750 2024-09-13T06:11:46.642 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.639+0000 7ff3e6f42980 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94896596466288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564ed5eee1e0 con 0x7ff3dc064b60 2024-09-13T06:11:46.643 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.639+0000 7ff3e4251640 1 -- 172.21.15.194:0/2558235830 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94896596466288] v35'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff3d80c9030 con 0x7ff3dc064b60 2024-09-13T06:11:46.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.639+0000 7ff3e6f42980 20 remove_watcher() i=0 2024-09-13T06:11:46.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.639+0000 7ff3e6f42980 2 removed watcher, disabling cache 2024-09-13T06:11:46.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.639+0000 7ff3e6f42980 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94896596470352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564ed5eee1e0 con 0x564ed5eb9750 2024-09-13T06:11:46.645 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.643+0000 7ff3e5253640 1 -- 172.21.15.194:0/2558235830 <== osd.1 v2:172.21.15.194:6808/3135444559 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94896596470352] v35'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff3d40083f0 con 0x564ed5eb9750 2024-09-13T06:11:46.645 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.643+0000 7ff3e6f42980 20 remove_watcher() i=1 2024-09-13T06:11:46.645 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.643+0000 7ff3e6f42980 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94896596472480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564ed5eee1e0 con 0x564ed5ebe140 2024-09-13T06:11:46.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.647+0000 7ff3e4a52640 1 -- 172.21.15.194:0/2558235830 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94896596472480] v35'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff3dc01b030 con 0x564ed5ebe140 2024-09-13T06:11:46.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.647+0000 7ff3e6f42980 20 remove_watcher() i=2 2024-09-13T06:11:46.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.647+0000 7ff3e6f42980 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94896596478608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564ed5eee1e0 con 0x7ff3dc064b60 2024-09-13T06:11:46.649 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.647+0000 7ff3e4251640 1 -- 172.21.15.194:0/2558235830 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94896596478608] v35'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff3d80c9030 con 0x7ff3dc064b60 2024-09-13T06:11:46.649 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.647+0000 7ff3e6f42980 20 remove_watcher() i=3 2024-09-13T06:11:46.649 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.647+0000 7ff3e6f42980 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94896596477408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564ed5ec6a90 con 0x564ed5eb9750 2024-09-13T06:11:46.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.647+0000 7ff3e5253640 1 -- 172.21.15.194:0/2558235830 <== osd.1 v2:172.21.15.194:6808/3135444559 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94896596477408] v35'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff3d40083f0 con 0x564ed5eb9750 2024-09-13T06:11:46.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.647+0000 7ff3e6f42980 20 remove_watcher() i=4 2024-09-13T06:11:46.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.647+0000 7ff3e6f42980 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94896596485120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564ed5eee1e0 con 0x7ff3d80dc040 2024-09-13T06:11:46.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.651+0000 7ff3e5253640 1 -- 172.21.15.194:0/2558235830 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94896596485120] v35'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff3d40083f0 con 0x7ff3d80dc040 2024-09-13T06:11:46.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.651+0000 7ff3e6f42980 20 remove_watcher() i=5 2024-09-13T06:11:46.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.651+0000 7ff3e6f42980 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94896596487376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564ed5ec65e0 con 0x7ff3d80dc040 2024-09-13T06:11:46.655 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.651+0000 7ff3e5253640 1 -- 172.21.15.194:0/2558235830 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94896596487376] v35'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff3d40083f0 con 0x7ff3d80dc040 2024-09-13T06:11:46.655 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.651+0000 7ff3e6f42980 20 remove_watcher() i=6 2024-09-13T06:11:46.656 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.651+0000 7ff3e6f42980 1 -- 172.21.15.194:0/2558235830 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94896596486176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564ed5ec8400 con 0x7ff3d80dc040 2024-09-13T06:11:46.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.655+0000 7ff3e5253640 1 -- 172.21.15.194:0/2558235830 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94896596486176] v35'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff3d40083f0 con 0x7ff3d80dc040 2024-09-13T06:11:46.660 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.655+0000 7ff3e6f42980 20 remove_watcher() i=7 2024-09-13T06:11:46.660 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.655+0000 7ff3e6f42980 1 -- 172.21.15.194:0/2558235830 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7ff3d80dc040 msgr2=0x7ff3d80dd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.660 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.655+0000 7ff3e6f42980 1 --2- 172.21.15.194:0/2558235830 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7ff3d80dc040 0x7ff3d80dd430 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.660 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.655+0000 7ff3e6f42980 1 -- 172.21.15.194:0/2558235830 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x564ed5eb9750 msgr2=0x564ed5ebbc10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.660 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.655+0000 7ff3e6f42980 1 --2- 172.21.15.194:0/2558235830 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x564ed5eb9750 0x564ed5ebbc10 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.660 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.655+0000 7ff3e6f42980 1 -- 172.21.15.194:0/2558235830 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7ff3dc064b60 msgr2=0x7ff3dc0484d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.660 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.655+0000 7ff3e6f42980 1 --2- 172.21.15.194:0/2558235830 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7ff3dc064b60 0x7ff3dc0484d0 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.660 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.655+0000 7ff3e6f42980 1 -- 172.21.15.194:0/2558235830 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x564ed5ebe140 msgr2=0x564ed5ec0530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.660 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.655+0000 7ff3e6f42980 1 --2- 172.21.15.194:0/2558235830 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x564ed5ebe140 0x564ed5ec0530 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.660 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.655+0000 7ff3e6f42980 1 -- 172.21.15.194:0/2558235830 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff2b0034650 msgr2=0x7ff2b0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.660 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.655+0000 7ff3e6f42980 1 --2- 172.21.15.194:0/2558235830 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff2b0034650 0x7ff2b0036b10 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff3d80ae040 tx=0x7ff3d80b9040 comp rx=0 tx=0).stop 2024-09-13T06:11:46.661 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.655+0000 7ff3e6f42980 1 -- 172.21.15.194:0/2558235830 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564ed5ea52a0 msgr2=0x564ed5cfecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.661 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.655+0000 7ff3e5253640 1 -- 172.21.15.194:0/2558235830 reap_dead start 2024-09-13T06:11:46.661 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.655+0000 7ff3e6f42980 1 --2- 172.21.15.194:0/2558235830 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564ed5ea52a0 0x564ed5cfecc0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc038010 tx=0x7ff3dc04ef40 comp rx=0 tx=0).stop 2024-09-13T06:11:46.661 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.655+0000 7ff3e6f42980 1 -- 172.21.15.194:0/2558235830 shutdown_connections 2024-09-13T06:11:46.661 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.655+0000 7ff3e6f42980 1 --2- 172.21.15.194:0/2558235830 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564ed5ea52a0 0x564ed5cfecc0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.661 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.655+0000 7ff3e6f42980 1 -- 172.21.15.194:0/2558235830 >> 172.21.15.194:0/2558235830 conn(0x564ed5ea1680 msgr2=0x564ed5e9f750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:46.661 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.655+0000 7ff3e6f42980 1 -- 172.21.15.194:0/2558235830 shutdown_connections 2024-09-13T06:11:46.661 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.655+0000 7ff3e6f42980 1 -- 172.21.15.194:0/2558235830 wait complete. 2024-09-13T06:11:46.661 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.655+0000 7ff3e6f42980 1 -- 172.21.15.194:0/2706995478 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff2bc034650 msgr2=0x7ff2bc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.661 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.655+0000 7ff3e6f42980 1 --2- 172.21.15.194:0/2706995478 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff2bc034650 0x7ff2bc036b10 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x564ed5e82770 tx=0x7ff3d8005a10 comp rx=0 tx=0).stop 2024-09-13T06:11:46.661 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.655+0000 7ff3e6f42980 1 -- 172.21.15.194:0/2706995478 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564ed5e98b30 msgr2=0x564ed5e98f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.661 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.655+0000 7ff3e6f42980 1 --2- 172.21.15.194:0/2706995478 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564ed5e98b30 0x564ed5e98f50 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc0483f0 tx=0x7ff3dc021cd0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.661 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.655+0000 7ff3e6f42980 1 -- 172.21.15.194:0/2706995478 shutdown_connections 2024-09-13T06:11:46.662 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.655+0000 7ff3e6f42980 1 --2- 172.21.15.194:0/2706995478 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff2bc034650 0x7ff2bc036b10 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.662 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.655+0000 7ff3e6f42980 1 --2- 172.21.15.194:0/2706995478 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564ed5e98b30 0x564ed5e98f50 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.662 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.655+0000 7ff3e6f42980 1 -- 172.21.15.194:0/2706995478 >> 172.21.15.194:0/2706995478 conn(0x564ed5e8dc80 msgr2=0x564ed5e90700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:46.662 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.655+0000 7ff3e6f42980 1 -- 172.21.15.194:0/2706995478 shutdown_connections 2024-09-13T06:11:46.662 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.655+0000 7ff3e6f42980 1 -- 172.21.15.194:0/2706995478 wait complete. 2024-09-13T06:11:46.662 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.655+0000 7ff3e6f42980 1 -- 172.21.15.194:0/3132000709 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x564ed5d8c9e0 msgr2=0x564ed5e81c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.662 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.655+0000 7ff3e6f42980 1 --2- 172.21.15.194:0/3132000709 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x564ed5d8c9e0 0x564ed5e81c30 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.662 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.655+0000 7ff3e6f42980 1 -- 172.21.15.194:0/3132000709 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x564ed5e88530 msgr2=0x564ed5e8a920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.662 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.655+0000 7ff3e6f42980 1 --2- 172.21.15.194:0/3132000709 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x564ed5e88530 0x564ed5e8a920 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.662 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.655+0000 7ff3e6f42980 1 -- 172.21.15.194:0/3132000709 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x564ed5e845f0 msgr2=0x564ed5e869e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.662 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.655+0000 7ff3e6f42980 1 --2- 172.21.15.194:0/3132000709 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x564ed5e845f0 0x564ed5e869e0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.662 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.655+0000 7ff3e6f42980 1 -- 172.21.15.194:0/3132000709 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff2cc034650 msgr2=0x7ff2cc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.662 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.655+0000 7ff3e6f42980 1 --2- 172.21.15.194:0/3132000709 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff2cc034650 0x7ff2cc036b10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ff3d80ad000 tx=0x7ff3d80a5040 comp rx=0 tx=0).stop 2024-09-13T06:11:46.663 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.655+0000 7ff3e6f42980 1 -- 172.21.15.194:0/3132000709 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564ed5d88660 msgr2=0x564ed5e7ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.663 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.655+0000 7ff3e6f42980 1 --2- 172.21.15.194:0/3132000709 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564ed5d88660 0x564ed5e7ac60 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc002260 tx=0x7ff3dc000f50 comp rx=0 tx=0).stop 2024-09-13T06:11:46.663 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.655+0000 7ff3e5253640 1 -- 172.21.15.194:0/3132000709 reap_dead start 2024-09-13T06:11:46.663 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.655+0000 7ff3e6f42980 1 -- 172.21.15.194:0/3132000709 shutdown_connections 2024-09-13T06:11:46.663 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.655+0000 7ff3e6f42980 1 -- 172.21.15.194:0/3132000709 >> 172.21.15.194:0/3132000709 conn(0x564ed5d84180 msgr2=0x564ed5e6e080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:46.663 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.655+0000 7ff3e6f42980 1 -- 172.21.15.194:0/3132000709 shutdown_connections 2024-09-13T06:11:46.663 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.655+0000 7ff3e6f42980 1 -- 172.21.15.194:0/3132000709 wait complete. 2024-09-13T06:11:46.670 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T06:11:44.596796Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:11:44.596784Z', 'tags': [], 'group_ids': []} 2024-09-13T06:11:46.670 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T06:11:44.596796Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:11:44.596784Z', 'tags': [], 'group_ids': []} 2024-09-13T06:11:46.670 ERROR:root:0 2024-09-13T06:11:46.670 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-13T06:11:46.671 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-13T06:11:46.671 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=write 2024-09-13T06:11:46.750 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:11:46.750 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:11:46.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.747+0000 7f0ca96e6980 1 Processor -- start 2024-09-13T06:11:46.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.747+0000 7f0ca96e6980 1 -- start start 2024-09-13T06:11:46.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.747+0000 7f0ca96e6980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55dc7d2e6a60 0x55dc7d2e8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.747+0000 7f0ca96e6980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55dc7d16aae0 con 0x55dc7d256b10 2024-09-13T06:11:46.752 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.747+0000 7f0ca96e6980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x55dc7d18ee30 con 0x55dc7d2e6a60 2024-09-13T06:11:46.752 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.751+0000 7f0ca69f5640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55dc7d2e6a60 0x55dc7d2e8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.753 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.751+0000 7f0ca71f6640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x55dc7d256b10 0x55dc7d2e5340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:58454/0 (socket says 172.21.15.194:58454) 2024-09-13T06:11:46.753 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.751+0000 7f0ca71f6640 1 -- 172.21.15.194:0/3586247312 learned_addr learned my addr 172.21.15.194:0/3586247312 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-09-13T06:11:46.753 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.751+0000 7f0ca61f4640 1 -- 172.21.15.194:0/3586247312 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 8133603 0 0) 0x55dc7d16aae0 con 0x55dc7d256b10 2024-09-13T06:11:46.753 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.751+0000 7f0ca61f4640 1 -- 172.21.15.194:0/3586247312 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c94001e20 con 0x55dc7d256b10 2024-09-13T06:11:46.753 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.751+0000 7f0ca69f5640 1 -- 172.21.15.194:0/3586247312 >> v1:172.21.15.120:6789/0 conn(0x55dc7d256b10 legacy=0x55dc7d2e5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.753 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.751+0000 7f0ca69f5640 1 -- 172.21.15.194:0/3586247312 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc7d2ea3a0 con 0x55dc7d2e6a60 2024-09-13T06:11:46.755 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.751+0000 7f0ca69f5640 1 --2- 172.21.15.194:0/3586247312 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dc7d2e6a60 0x55dc7d2e8e50 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f0c9000a480 tx=0x7f0c9001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a95f249aa53e5f15 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.755 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.751+0000 7f0ca61f4640 1 -- 172.21.15.194:0/3586247312 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c900b0070 con 0x55dc7d2e6a60 2024-09-13T06:11:46.755 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.751+0000 7f0ca61f4640 1 -- 172.21.15.194:0/3586247312 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c900ab540 con 0x55dc7d2e6a60 2024-09-13T06:11:46.756 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.751+0000 7f0ca61f4640 1 -- 172.21.15.194:0/3586247312 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c900ab840 con 0x55dc7d2e6a60 2024-09-13T06:11:46.756 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.755+0000 7f0ca96e6980 1 -- 172.21.15.194:0/3586247312 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dc7d2e6a60 msgr2=0x55dc7d2e8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.756 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.755+0000 7f0ca96e6980 1 --2- 172.21.15.194:0/3586247312 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dc7d2e6a60 0x55dc7d2e8e50 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f0c9000a480 tx=0x7f0c9001b280 comp rx=0 tx=0).stop 2024-09-13T06:11:46.756 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.755+0000 7f0ca96e6980 1 -- 172.21.15.194:0/3586247312 shutdown_connections 2024-09-13T06:11:46.757 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.755+0000 7f0ca96e6980 1 --2- 172.21.15.194:0/3586247312 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dc7d2e6a60 0x55dc7d2e8e50 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.757 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.755+0000 7f0ca96e6980 1 -- 172.21.15.194:0/3586247312 >> 172.21.15.194:0/3586247312 conn(0x55dc7d2dd070 msgr2=0x55dc7d2df490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:46.757 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.755+0000 7f0ca96e6980 1 -- 172.21.15.194:0/3586247312 shutdown_connections 2024-09-13T06:11:46.757 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.755+0000 7f0ca96e6980 1 -- 172.21.15.194:0/3586247312 wait complete. 2024-09-13T06:11:46.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.767+0000 7f0ca96e6980 1 Processor -- start 2024-09-13T06:11:46.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.767+0000 7f0ca96e6980 1 -- start start 2024-09-13T06:11:46.772 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.767+0000 7f0ca96e6980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dc7d256b10 0x55dc7d3cd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.772 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.767+0000 7f0ca96e6980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55dc7d190200 con 0x55dc7d256b10 2024-09-13T06:11:46.772 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.771+0000 7f0ca71f6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dc7d256b10 0x55dc7d3cd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.772 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.771+0000 7f0ca71f6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dc7d256b10 0x55dc7d3cd8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45472/0 (socket says 172.21.15.194:45472) 2024-09-13T06:11:46.772 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.771+0000 7f0ca71f6640 1 -- 172.21.15.194:0/833257772 learned_addr learned my addr 172.21.15.194:0/833257772 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:46.772 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.771+0000 7f0ca71f6640 1 -- 172.21.15.194:0/833257772 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc7d3cdec0 con 0x55dc7d256b10 2024-09-13T06:11:46.773 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.771+0000 7f0ca71f6640 1 --2- 172.21.15.194:0/833257772 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dc7d256b10 0x55dc7d3cd8f0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f0c98001740 tx=0x7f0c98001c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dbaf23181fb2005 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.773 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.771+0000 7f0b9560a640 1 -- 172.21.15.194:0/833257772 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c98016070 con 0x55dc7d256b10 2024-09-13T06:11:46.773 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.771+0000 7f0b9560a640 1 -- 172.21.15.194:0/833257772 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c98004530 con 0x55dc7d256b10 2024-09-13T06:11:46.773 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.771+0000 7f0b9560a640 1 -- 172.21.15.194:0/833257772 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c98004850 con 0x55dc7d256b10 2024-09-13T06:11:46.775 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.771+0000 7f0ca96e6980 1 -- 172.21.15.194:0/833257772 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dc7d256b10 msgr2=0x55dc7d3cd8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.775 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.771+0000 7f0ca96e6980 1 --2- 172.21.15.194:0/833257772 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dc7d256b10 0x55dc7d3cd8f0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f0c98001740 tx=0x7f0c98001c00 comp rx=0 tx=0).stop 2024-09-13T06:11:46.775 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.771+0000 7f0ca96e6980 1 -- 172.21.15.194:0/833257772 shutdown_connections 2024-09-13T06:11:46.775 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.771+0000 7f0ca96e6980 1 --2- 172.21.15.194:0/833257772 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dc7d256b10 0x55dc7d3cd8f0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.775 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.771+0000 7f0ca96e6980 1 -- 172.21.15.194:0/833257772 >> 172.21.15.194:0/833257772 conn(0x55dc7d2dd070 msgr2=0x55dc7d3c9520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:46.775 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.771+0000 7f0ca96e6980 1 -- 172.21.15.194:0/833257772 shutdown_connections 2024-09-13T06:11:46.775 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.771+0000 7f0ca96e6980 1 -- 172.21.15.194:0/833257772 wait complete. 2024-09-13T06:11:46.775 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.771+0000 7f0ca96e6980 1 Processor -- start 2024-09-13T06:11:46.775 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.771+0000 7f0ca96e6980 1 -- start start 2024-09-13T06:11:46.776 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.771+0000 7f0ca96e6980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dc7d2e6a60 0x55dc7d3d4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.776 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.771+0000 7f0ca96e6980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55dc7d2e9e40 con 0x55dc7d2e6a60 2024-09-13T06:11:46.776 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.771+0000 7f0ca71f6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dc7d2e6a60 0x55dc7d3d4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.776 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.771+0000 7f0ca71f6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dc7d2e6a60 0x55dc7d3d4f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45488/0 (socket says 172.21.15.194:45488) 2024-09-13T06:11:46.776 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.771+0000 7f0ca71f6640 1 -- 172.21.15.194:0/2242092656 learned_addr learned my addr 172.21.15.194:0/2242092656 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:46.777 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.775+0000 7f0ca71f6640 1 -- 172.21.15.194:0/2242092656 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc7d3d5470 con 0x55dc7d2e6a60 2024-09-13T06:11:46.777 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.775+0000 7f0ca71f6640 1 --2- 172.21.15.194:0/2242092656 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dc7d2e6a60 0x55dc7d3d4f30 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f0c98014040 tx=0x7f0c98001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.777 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.775+0000 7f0b93e07640 1 -- 172.21.15.194:0/2242092656 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c98016030 con 0x55dc7d2e6a60 2024-09-13T06:11:46.777 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.775+0000 7f0ca96e6980 1 -- 172.21.15.194:0/2242092656 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dc7d3d5700 con 0x55dc7d2e6a60 2024-09-13T06:11:46.777 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.775+0000 7f0b93e07640 1 -- 172.21.15.194:0/2242092656 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c9801d430 con 0x55dc7d2e6a60 2024-09-13T06:11:46.777 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.775+0000 7f0b93e07640 1 -- 172.21.15.194:0/2242092656 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c9801d750 con 0x55dc7d2e6a60 2024-09-13T06:11:46.777 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.775+0000 7f0ca96e6980 1 -- 172.21.15.194:0/2242092656 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc7d3d83e0 con 0x55dc7d2e6a60 2024-09-13T06:11:46.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.775+0000 7f0b93e07640 1 -- 172.21.15.194:0/2242092656 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0c9801d8f0 con 0x55dc7d2e6a60 2024-09-13T06:11:46.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.775+0000 7f0b93e07640 1 --2- 172.21.15.194:0/2242092656 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0b8c0346a0 0x7f0b8c036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.775+0000 7f0b93e07640 1 -- 172.21.15.194:0/2242092656 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f0c98017070 con 0x55dc7d2e6a60 2024-09-13T06:11:46.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.775+0000 7f0ca69f5640 1 --2- 172.21.15.194:0/2242092656 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0b8c0346a0 0x7f0b8c036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.775+0000 7f0ca96e6980 1 --2- 172.21.15.194:0/2242092656 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55dc7d3da020 0x55dc7d3dc410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.775+0000 7f0ca96e6980 1 -- 172.21.15.194:0/2242092656 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d3dc950 con 0x55dc7d3da020 2024-09-13T06:11:46.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.775+0000 7f0ca79f7640 1 --2- 172.21.15.194:0/2242092656 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55dc7d3da020 0x55dc7d3dc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.775+0000 7f0ca69f5640 1 --2- 172.21.15.194:0/2242092656 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0b8c0346a0 0x7f0b8c036b60 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f0c900ad000 tx=0x7f0c900a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.775+0000 7f0ca79f7640 1 --2- 172.21.15.194:0/2242092656 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55dc7d3da020 0x55dc7d3dc410 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.775+0000 7f0ca79f7640 1 -- 172.21.15.194:0/2242092656 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0ca00083f0 con 0x55dc7d3da020 2024-09-13T06:11:46.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.775+0000 7f0ca96e6980 1 -- 172.21.15.194:0/2242092656 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d3d95e0 con 0x55dc7d3da020 2024-09-13T06:11:46.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.775+0000 7f0ca79f7640 1 -- 172.21.15.194:0/2242092656 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0ca00083f0 con 0x55dc7d3da020 2024-09-13T06:11:46.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.775+0000 7f0ca96e6980 1 --2- 172.21.15.194:0/2242092656 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55dc7d3dec20 0x55dc7d3e1010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.775+0000 7f0ca96e6980 1 -- 172.21.15.194:0/2242092656 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d3e16e0 con 0x55dc7d3dec20 2024-09-13T06:11:46.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.775+0000 7f0ca71f6640 1 --2- 172.21.15.194:0/2242092656 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55dc7d3dec20 0x55dc7d3e1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.779+0000 7f0ca71f6640 1 --2- 172.21.15.194:0/2242092656 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55dc7d3dec20 0x55dc7d3e1010 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.779+0000 7f0ca71f6640 1 -- 172.21.15.194:0/2242092656 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0c98023020 con 0x55dc7d3dec20 2024-09-13T06:11:46.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.779+0000 7f0ca96e6980 1 -- 172.21.15.194:0/2242092656 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d3ddac0 con 0x55dc7d3da020 2024-09-13T06:11:46.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.779+0000 7f0ca79f7640 1 -- 172.21.15.194:0/2242092656 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0ca00083f0 con 0x55dc7d3da020 2024-09-13T06:11:46.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.779+0000 7f0ca96e6980 1 --2- 172.21.15.194:0/2242092656 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55dc7d3e2b40 0x55dc7d3e4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.779+0000 7f0ca96e6980 1 -- 172.21.15.194:0/2242092656 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d3e5630 con 0x55dc7d3e2b40 2024-09-13T06:11:46.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.779+0000 7f0ca69f5640 1 --2- 172.21.15.194:0/2242092656 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55dc7d3e2b40 0x55dc7d3e4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.779+0000 7f0ca69f5640 1 --2- 172.21.15.194:0/2242092656 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55dc7d3e2b40 0x55dc7d3e4f30 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.779+0000 7f0ca69f5640 1 -- 172.21.15.194:0/2242092656 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0c900b3040 con 0x55dc7d3e2b40 2024-09-13T06:11:46.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.779+0000 7f0ca96e6980 1 Processor -- start 2024-09-13T06:11:46.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.779+0000 7f0ca96e6980 1 -- start start 2024-09-13T06:11:46.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.779+0000 7f0ca96e6980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dc7d2e2ca0 0x55dc7d2e1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.779+0000 7f0ca96e6980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55dc7d1e9800 con 0x55dc7d2e2ca0 2024-09-13T06:11:46.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.779+0000 7f0ca71f6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dc7d2e2ca0 0x55dc7d2e1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.779+0000 7f0ca71f6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dc7d2e2ca0 0x55dc7d2e1320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45502/0 (socket says 172.21.15.194:45502) 2024-09-13T06:11:46.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.779+0000 7f0ca71f6640 1 -- 172.21.15.194:0/2937165999 learned_addr learned my addr 172.21.15.194:0/2937165999 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:46.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.779+0000 7f0ca71f6640 1 -- 172.21.15.194:0/2937165999 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc7d2e30c0 con 0x55dc7d2e2ca0 2024-09-13T06:11:46.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.779+0000 7f0ca71f6640 1 --2- 172.21.15.194:0/2937165999 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dc7d2e2ca0 0x55dc7d2e1320 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f0c98024c90 tx=0x7f0c9801cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.779+0000 7f0b91602640 1 -- 172.21.15.194:0/2937165999 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c98024480 con 0x55dc7d2e2ca0 2024-09-13T06:11:46.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.779+0000 7f0b91602640 1 -- 172.21.15.194:0/2937165999 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c980246d0 con 0x55dc7d2e2ca0 2024-09-13T06:11:46.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.779+0000 7f0b91602640 1 -- 172.21.15.194:0/2937165999 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c980249f0 con 0x55dc7d2e2ca0 2024-09-13T06:11:46.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.783+0000 7f0ca96e6980 1 -- 172.21.15.194:0/2937165999 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dc7d2e18c0 con 0x55dc7d2e2ca0 2024-09-13T06:11:46.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.783+0000 7f0ca96e6980 1 -- 172.21.15.194:0/2937165999 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc7d2e18c0 con 0x55dc7d2e2ca0 2024-09-13T06:11:46.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.783+0000 7f0b91602640 1 -- 172.21.15.194:0/2937165999 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0c98041a90 con 0x55dc7d2e2ca0 2024-09-13T06:11:46.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.783+0000 7f0b91602640 1 --2- 172.21.15.194:0/2937165999 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0b80034750 0x7f0b80036c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.783+0000 7f0b91602640 1 -- 172.21.15.194:0/2937165999 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f0c98037070 con 0x55dc7d2e2ca0 2024-09-13T06:11:46.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.783+0000 7f0ca69f5640 1 --2- 172.21.15.194:0/2937165999 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0b80034750 0x7f0b80036c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.783+0000 7f0ca96e6980 1 Processor -- start 2024-09-13T06:11:46.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.783+0000 7f0ca96e6980 1 -- start start 2024-09-13T06:11:46.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.783+0000 7f0ca96e6980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dc7d4019f0 0x55dc7d401dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.783+0000 7f0ca69f5640 1 --2- 172.21.15.194:0/2937165999 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0b80034750 0x7f0b80036c10 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x55dc7d3dd1d0 tx=0x7f0c90005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.783+0000 7f0ca96e6980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55dc7d3ce240 con 0x55dc7d4019f0 2024-09-13T06:11:46.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.783+0000 7f0ca71f6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dc7d4019f0 0x55dc7d401dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.783+0000 7f0ca71f6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dc7d4019f0 0x55dc7d401dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45510/0 (socket says 172.21.15.194:45510) 2024-09-13T06:11:46.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.783+0000 7f0ca71f6640 1 -- 172.21.15.194:0/1986436306 learned_addr learned my addr 172.21.15.194:0/1986436306 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:46.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.783+0000 7f0ca71f6640 1 -- 172.21.15.194:0/1986436306 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc7d4023a0 con 0x55dc7d4019f0 2024-09-13T06:11:46.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.783+0000 7f0ca71f6640 1 --2- 172.21.15.194:0/1986436306 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dc7d4019f0 0x55dc7d401dd0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f0c980412c0 tx=0x7f0c98046880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e85132e8b4a108d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.783+0000 7f0b8affd640 1 -- 172.21.15.194:0/1986436306 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c9802e380 con 0x55dc7d4019f0 2024-09-13T06:11:46.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.783+0000 7f0b8affd640 1 -- 172.21.15.194:0/1986436306 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c9805b070 con 0x55dc7d4019f0 2024-09-13T06:11:46.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.783+0000 7f0b8affd640 1 -- 172.21.15.194:0/1986436306 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c980497c0 con 0x55dc7d4019f0 2024-09-13T06:11:46.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.787+0000 7f0ca96e6980 1 -- 172.21.15.194:0/1986436306 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dc7d4019f0 msgr2=0x55dc7d401dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.787+0000 7f0ca96e6980 1 --2- 172.21.15.194:0/1986436306 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dc7d4019f0 0x55dc7d401dd0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f0c980412c0 tx=0x7f0c98046880 comp rx=0 tx=0).stop 2024-09-13T06:11:46.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.787+0000 7f0ca96e6980 1 -- 172.21.15.194:0/1986436306 shutdown_connections 2024-09-13T06:11:46.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.787+0000 7f0ca96e6980 1 --2- 172.21.15.194:0/1986436306 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dc7d4019f0 0x55dc7d401dd0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.787+0000 7f0ca96e6980 1 -- 172.21.15.194:0/1986436306 >> 172.21.15.194:0/1986436306 conn(0x55dc7d3fddd0 msgr2=0x55dc7d3fbed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:46.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.787+0000 7f0ca96e6980 1 -- 172.21.15.194:0/1986436306 shutdown_connections 2024-09-13T06:11:46.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.787+0000 7f0ca96e6980 1 -- 172.21.15.194:0/1986436306 wait complete. 2024-09-13T06:11:46.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.787+0000 7f0ca96e6980 1 Processor -- start 2024-09-13T06:11:46.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.787+0000 7f0ca96e6980 1 -- start start 2024-09-13T06:11:46.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.787+0000 7f0ca96e6980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dc7d4019f0 0x55dc7d408be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.787+0000 7f0ca96e6980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55dc7d402840 con 0x55dc7d4019f0 2024-09-13T06:11:46.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.787+0000 7f0ca71f6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dc7d4019f0 0x55dc7d408be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.787+0000 7f0ca71f6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dc7d4019f0 0x55dc7d408be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45524/0 (socket says 172.21.15.194:45524) 2024-09-13T06:11:46.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.787+0000 7f0ca71f6640 1 -- 172.21.15.194:0/3754285996 learned_addr learned my addr 172.21.15.194:0/3754285996 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:46.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.787+0000 7f0ca71f6640 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc7d409120 con 0x55dc7d4019f0 2024-09-13T06:11:46.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.787+0000 7f0ca71f6640 1 --2- 172.21.15.194:0/3754285996 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dc7d4019f0 0x55dc7d408be0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f0c98049a90 tx=0x7f0c98026c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.787+0000 7f0b897fa640 1 -- 172.21.15.194:0/3754285996 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c9806e070 con 0x55dc7d4019f0 2024-09-13T06:11:46.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.787+0000 7f0ca96e6980 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dc7d409120 con 0x55dc7d4019f0 2024-09-13T06:11:46.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.787+0000 7f0b897fa640 1 -- 172.21.15.194:0/3754285996 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c98046130 con 0x55dc7d4019f0 2024-09-13T06:11:46.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.787+0000 7f0b897fa640 1 -- 172.21.15.194:0/3754285996 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c980059b0 con 0x55dc7d4019f0 2024-09-13T06:11:46.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.787+0000 7f0ca96e6980 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc7d409120 con 0x55dc7d4019f0 2024-09-13T06:11:46.794 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.787+0000 7f0b897fa640 1 -- 172.21.15.194:0/3754285996 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0c98071070 con 0x55dc7d4019f0 2024-09-13T06:11:46.794 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.791+0000 7f0b897fa640 1 --2- 172.21.15.194:0/3754285996 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0b70034650 0x7f0b70036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.791+0000 7f0b897fa640 1 -- 172.21.15.194:0/3754285996 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f0c98074d50 con 0x55dc7d4019f0 2024-09-13T06:11:46.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.791+0000 7f0ca69f5640 1 --2- 172.21.15.194:0/3754285996 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0b70034650 0x7f0b70036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.791+0000 7f0ca96e6980 20 rados->read ofs=0 len=0 2024-09-13T06:11:46.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.791+0000 7f0ca96e6980 1 --2- 172.21.15.194:0/3754285996 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55dc7d413a20 0x55dc7d415ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.791+0000 7f0ca96e6980 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d416630 con 0x55dc7d413a20 2024-09-13T06:11:46.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.791+0000 7f0ca79f7640 1 --2- 172.21.15.194:0/3754285996 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55dc7d413a20 0x55dc7d415ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.791+0000 7f0ca69f5640 1 --2- 172.21.15.194:0/3754285996 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0b70034650 0x7f0b70036b10 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0c90000c10 tx=0x7f0c900b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.791+0000 7f0ca79f7640 1 --2- 172.21.15.194:0/3754285996 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55dc7d413a20 0x55dc7d415ee0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.791+0000 7f0ca79f7640 1 -- 172.21.15.194:0/3754285996 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0ca00083f0 con 0x55dc7d413a20 2024-09-13T06:11:46.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.791+0000 7f0ca96e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:46.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.791+0000 7f0ca96e6980 20 realm 2024-09-13T06:11:46.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.791+0000 7f0ca96e6980 20 rados->read ofs=0 len=0 2024-09-13T06:11:46.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.791+0000 7f0ca96e6980 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d416a40 con 0x55dc7d413a20 2024-09-13T06:11:46.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.791+0000 7f0ca79f7640 1 -- 172.21.15.194:0/3754285996 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0ca00083f0 con 0x55dc7d413a20 2024-09-13T06:11:46.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.791+0000 7f0ca96e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:46.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.791+0000 7f0ca96e6980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:11:46.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.791+0000 7f0ca96e6980 20 rados->read ofs=0 len=0 2024-09-13T06:11:46.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.791+0000 7f0ca96e6980 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d417310 con 0x55dc7d413a20 2024-09-13T06:11:46.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.791+0000 7f0ca79f7640 1 -- 172.21.15.194:0/3754285996 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0ca00083f0 con 0x55dc7d413a20 2024-09-13T06:11:46.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.791+0000 7f0ca96e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:46.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.791+0000 7f0ca96e6980 20 rados->read ofs=0 len=0 2024-09-13T06:11:46.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.791+0000 7f0ca96e6980 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d4176b0 con 0x55dc7d413a20 2024-09-13T06:11:46.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.791+0000 7f0ca79f7640 1 -- 172.21.15.194:0/3754285996 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0ca00083f0 con 0x55dc7d413a20 2024-09-13T06:11:46.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.791+0000 7f0ca96e6980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:11:46.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.791+0000 7f0ca96e6980 20 rados->read ofs=0 len=0 2024-09-13T06:11:46.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.791+0000 7f0ca96e6980 1 --2- 172.21.15.194:0/3754285996 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55dc7d418410 0x55dc7d41a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.791+0000 7f0ca96e6980 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d41ae10 con 0x55dc7d418410 2024-09-13T06:11:46.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.791+0000 7f0ca71f6640 1 --2- 172.21.15.194:0/3754285996 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55dc7d418410 0x55dc7d41a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.791+0000 7f0ca71f6640 1 --2- 172.21.15.194:0/3754285996 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55dc7d418410 0x55dc7d41a800 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.791+0000 7f0ca71f6640 1 -- 172.21.15.194:0/3754285996 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0c98070030 con 0x55dc7d418410 2024-09-13T06:11:46.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.791+0000 7f0ca96e6980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:11:46.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.791+0000 7f0ca96e6980 20 searching for the correct realm 2024-09-13T06:11:46.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.791+0000 7f0ca96e6980 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d41c6e0 con 0x55dc7d418410 2024-09-13T06:11:46.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.791+0000 7f0ca71f6640 1 -- 172.21.15.194:0/3754285996 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c98070030 con 0x55dc7d418410 2024-09-13T06:11:46.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.791+0000 7f0ca71f6640 1 --2- 172.21.15.194:0/3754285996 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f0c98073060 0x7f0c980208c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.791+0000 7f0ca71f6640 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d41c6e0 con 0x7f0c98073060 2024-09-13T06:11:46.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.791+0000 7f0ca69f5640 1 --2- 172.21.15.194:0/3754285996 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f0c98073060 0x7f0c980208c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.795+0000 7f0ca69f5640 1 --2- 172.21.15.194:0/3754285996 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f0c98073060 0x7f0c980208c0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.795+0000 7f0ca69f5640 1 -- 172.21.15.194:0/3754285996 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0c900d8070 con 0x7f0c98073060 2024-09-13T06:11:46.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.795+0000 7f0ca69f5640 1 --2- 172.21.15.194:0/3754285996 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f0c900cd040 0x7f0c900b7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.795+0000 7f0ca69f5640 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d41c6e0 con 0x7f0c900cd040 2024-09-13T06:11:46.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.795+0000 7f0ca79f7640 1 --2- 172.21.15.194:0/3754285996 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f0c900cd040 0x7f0c900b7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.795+0000 7f0ca79f7640 1 --2- 172.21.15.194:0/3754285996 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f0c900cd040 0x7f0c900b7420 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.795+0000 7f0ca79f7640 1 -- 172.21.15.194:0/3754285996 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ca00083f0 con 0x7f0c900cd040 2024-09-13T06:11:46.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.795+0000 7f0ca79f7640 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d4176b0 con 0x55dc7d413a20 2024-09-13T06:11:46.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.795+0000 7f0ca79f7640 1 -- 172.21.15.194:0/3754285996 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ca00083f0 con 0x55dc7d413a20 2024-09-13T06:11:46.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.795+0000 7f0ca79f7640 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d4176b0 con 0x55dc7d413a20 2024-09-13T06:11:46.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.795+0000 7f0ca79f7640 1 -- 172.21.15.194:0/3754285996 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ca00083f0 con 0x55dc7d413a20 2024-09-13T06:11:46.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.795+0000 7f0ca79f7640 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d4176b0 con 0x7f0c900cd040 2024-09-13T06:11:46.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.795+0000 7f0ca79f7640 1 -- 172.21.15.194:0/3754285996 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ca00083f0 con 0x7f0c900cd040 2024-09-13T06:11:46.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.795+0000 7f0ca79f7640 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d4176b0 con 0x7f0c900cd040 2024-09-13T06:11:46.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.795+0000 7f0ca79f7640 1 -- 172.21.15.194:0/3754285996 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ca00083f0 con 0x7f0c900cd040 2024-09-13T06:11:46.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.795+0000 7f0ca79f7640 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d4176b0 con 0x7f0c98073060 2024-09-13T06:11:46.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.799+0000 7f0ca69f5640 1 -- 172.21.15.194:0/3754285996 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c900d8070 con 0x7f0c98073060 2024-09-13T06:11:46.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.799+0000 7f0ca69f5640 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d4176b0 con 0x55dc7d418410 2024-09-13T06:11:46.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.799+0000 7f0ca71f6640 1 -- 172.21.15.194:0/3754285996 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c98070030 con 0x55dc7d418410 2024-09-13T06:11:46.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.799+0000 7f0ca71f6640 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d4176b0 con 0x55dc7d413a20 2024-09-13T06:11:46.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.799+0000 7f0ca79f7640 1 -- 172.21.15.194:0/3754285996 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ca00083f0 con 0x55dc7d413a20 2024-09-13T06:11:46.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.799+0000 7f0ca79f7640 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d4176b0 con 0x7f0c900cd040 2024-09-13T06:11:46.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.799+0000 7f0ca79f7640 1 -- 172.21.15.194:0/3754285996 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ca00083f0 con 0x7f0c900cd040 2024-09-13T06:11:46.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.799+0000 7f0ca79f7640 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d4176b0 con 0x55dc7d413a20 2024-09-13T06:11:46.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.799+0000 7f0ca79f7640 1 -- 172.21.15.194:0/3754285996 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ca00083f0 con 0x55dc7d413a20 2024-09-13T06:11:46.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.799+0000 7f0ca79f7640 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d4176b0 con 0x7f0c98073060 2024-09-13T06:11:46.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.799+0000 7f0ca69f5640 1 -- 172.21.15.194:0/3754285996 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0c900d8070 con 0x7f0c98073060 2024-09-13T06:11:46.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.799+0000 7f0ca69f5640 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d4176b0 con 0x55dc7d418410 2024-09-13T06:11:46.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.799+0000 7f0ca71f6640 1 -- 172.21.15.194:0/3754285996 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c98070030 con 0x55dc7d418410 2024-09-13T06:11:46.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.799+0000 7f0ca71f6640 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d4176b0 con 0x55dc7d418410 2024-09-13T06:11:46.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.799+0000 7f0ca71f6640 1 -- 172.21.15.194:0/3754285996 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c98070030 con 0x55dc7d418410 2024-09-13T06:11:46.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.799+0000 7f0ca71f6640 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d4176b0 con 0x7f0c900cd040 2024-09-13T06:11:46.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.799+0000 7f0ca79f7640 1 -- 172.21.15.194:0/3754285996 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ca00083f0 con 0x7f0c900cd040 2024-09-13T06:11:46.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.799+0000 7f0ca79f7640 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d4176b0 con 0x55dc7d418410 2024-09-13T06:11:46.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.799+0000 7f0ca71f6640 1 -- 172.21.15.194:0/3754285996 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c98070030 con 0x55dc7d418410 2024-09-13T06:11:46.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.799+0000 7f0ca71f6640 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d4176b0 con 0x55dc7d418410 2024-09-13T06:11:46.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.799+0000 7f0ca71f6640 1 -- 172.21.15.194:0/3754285996 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c98070030 con 0x55dc7d418410 2024-09-13T06:11:46.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.799+0000 7f0ca71f6640 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d4176b0 con 0x55dc7d413a20 2024-09-13T06:11:46.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.799+0000 7f0ca79f7640 1 -- 172.21.15.194:0/3754285996 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ca00083f0 con 0x55dc7d413a20 2024-09-13T06:11:46.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.799+0000 7f0ca79f7640 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d4176b0 con 0x55dc7d413a20 2024-09-13T06:11:46.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.803+0000 7f0ca79f7640 1 -- 172.21.15.194:0/3754285996 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v35'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0ca00083f0 con 0x55dc7d413a20 2024-09-13T06:11:46.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.803+0000 7f0ca79f7640 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d4176b0 con 0x7f0c98073060 2024-09-13T06:11:46.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.803+0000 7f0ca69f5640 1 -- 172.21.15.194:0/3754285996 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c900d8070 con 0x7f0c98073060 2024-09-13T06:11:46.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.803+0000 7f0ca69f5640 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d4176b0 con 0x55dc7d418410 2024-09-13T06:11:46.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.803+0000 7f0ca71f6640 1 -- 172.21.15.194:0/3754285996 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c98070030 con 0x55dc7d418410 2024-09-13T06:11:46.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.803+0000 7f0ca71f6640 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d4176b0 con 0x7f0c98073060 2024-09-13T06:11:46.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.803+0000 7f0ca69f5640 1 -- 172.21.15.194:0/3754285996 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c900d8070 con 0x7f0c98073060 2024-09-13T06:11:46.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.803+0000 7f0ca69f5640 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d4176b0 con 0x55dc7d413a20 2024-09-13T06:11:46.812 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.803+0000 7f0ca79f7640 1 -- 172.21.15.194:0/3754285996 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ca00083f0 con 0x55dc7d413a20 2024-09-13T06:11:46.812 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.803+0000 7f0ca79f7640 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d4176b0 con 0x7f0c900cd040 2024-09-13T06:11:46.813 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.803+0000 7f0ca79f7640 1 -- 172.21.15.194:0/3754285996 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ca00083f0 con 0x7f0c900cd040 2024-09-13T06:11:46.813 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.803+0000 7f0ca79f7640 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d4176b0 con 0x55dc7d418410 2024-09-13T06:11:46.813 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.803+0000 7f0ca71f6640 1 -- 172.21.15.194:0/3754285996 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=107b] v35'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0c98070030 con 0x55dc7d418410 2024-09-13T06:11:46.813 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.803+0000 7f0ca71f6640 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d4176b0 con 0x7f0c98073060 2024-09-13T06:11:46.813 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.803+0000 7f0ca69f5640 1 -- 172.21.15.194:0/3754285996 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c900d8070 con 0x7f0c98073060 2024-09-13T06:11:46.813 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.803+0000 7f0ca69f5640 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d4176b0 con 0x7f0c98073060 2024-09-13T06:11:46.813 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.803+0000 7f0ca69f5640 1 -- 172.21.15.194:0/3754285996 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c900d8070 con 0x7f0c98073060 2024-09-13T06:11:46.813 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.803+0000 7f0ca69f5640 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d4176b0 con 0x55dc7d418410 2024-09-13T06:11:46.813 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.803+0000 7f0ca71f6640 1 -- 172.21.15.194:0/3754285996 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c98070030 con 0x55dc7d418410 2024-09-13T06:11:46.813 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.803+0000 7f0ca71f6640 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d4176b0 con 0x7f0c900cd040 2024-09-13T06:11:46.814 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.803+0000 7f0ca79f7640 1 -- 172.21.15.194:0/3754285996 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ca00083f0 con 0x7f0c900cd040 2024-09-13T06:11:46.814 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.803+0000 7f0ca79f7640 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d4176b0 con 0x55dc7d413a20 2024-09-13T06:11:46.814 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.807+0000 7f0ca79f7640 1 -- 172.21.15.194:0/3754285996 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v35'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0ca00083f0 con 0x55dc7d413a20 2024-09-13T06:11:46.814 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.807+0000 7f0ca79f7640 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d4176b0 con 0x7f0c98073060 2024-09-13T06:11:46.814 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.807+0000 7f0ca69f5640 1 -- 172.21.15.194:0/3754285996 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c900d8070 con 0x7f0c98073060 2024-09-13T06:11:46.814 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.807+0000 7f0ca96e6980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:11:46.814 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.807+0000 7f0ca96e6980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:11:46.814 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.807+0000 7f0ca96e6980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:11:46.814 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.807+0000 7f0ca96e6980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:11:46.814 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.807+0000 7f0ca96e6980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:11:46.814 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.807+0000 7f0ca96e6980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:11:46.814 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.807+0000 7f0ca96e6980 20 rados->read ofs=0 len=0 2024-09-13T06:11:46.814 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.807+0000 7f0ca96e6980 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d41b7d0 con 0x55dc7d413a20 2024-09-13T06:11:46.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.807+0000 7f0ca79f7640 1 -- 172.21.15.194:0/3754285996 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0ca00083f0 con 0x55dc7d413a20 2024-09-13T06:11:46.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.807+0000 7f0ca96e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:46.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.807+0000 7f0ca96e6980 20 rados->read ofs=0 len=0 2024-09-13T06:11:46.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.807+0000 7f0ca96e6980 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d41b410 con 0x55dc7d413a20 2024-09-13T06:11:46.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.807+0000 7f0ca79f7640 1 -- 172.21.15.194:0/3754285996 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0ca00083f0 con 0x55dc7d413a20 2024-09-13T06:11:46.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.807+0000 7f0ca96e6980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:11:46.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.807+0000 7f0ca96e6980 20 rados->read ofs=0 len=0 2024-09-13T06:11:46.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.807+0000 7f0ca96e6980 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d41c0f0 con 0x7f0c98073060 2024-09-13T06:11:46.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.807+0000 7f0ca69f5640 1 -- 172.21.15.194:0/3754285996 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0c900d8070 con 0x7f0c98073060 2024-09-13T06:11:46.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.807+0000 7f0ca96e6980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:11:46.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.807+0000 7f0ca96e6980 20 zone default found 2024-09-13T06:11:46.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.807+0000 7f0ca96e6980 4 Realm: () 2024-09-13T06:11:46.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.807+0000 7f0ca96e6980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:11:46.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.807+0000 7f0ca96e6980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:11:46.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.807+0000 7f0ca96e6980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:11:46.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.807+0000 7f0ca96e6980 20 zonegroup default 2024-09-13T06:11:46.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.807+0000 7f0ca96e6980 20 rados->read ofs=0 len=0 2024-09-13T06:11:46.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.807+0000 7f0ca96e6980 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d41cb10 con 0x7f0c900cd040 2024-09-13T06:11:46.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.807+0000 7f0ca79f7640 1 -- 172.21.15.194:0/3754285996 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0ca00083f0 con 0x7f0c900cd040 2024-09-13T06:11:46.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.807+0000 7f0ca96e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:46.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.807+0000 7f0ca96e6980 20 rados->read ofs=0 len=0 2024-09-13T06:11:46.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.807+0000 7f0ca96e6980 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d41e4f0 con 0x55dc7d418410 2024-09-13T06:11:46.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.807+0000 7f0ca71f6640 1 -- 172.21.15.194:0/3754285996 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0c98070030 con 0x55dc7d418410 2024-09-13T06:11:46.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.807+0000 7f0ca96e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:46.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.807+0000 7f0ca96e6980 20 rados->read ofs=0 len=0 2024-09-13T06:11:46.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.807+0000 7f0ca96e6980 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d41e990 con 0x55dc7d418410 2024-09-13T06:11:46.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.807+0000 7f0ca71f6640 1 -- 172.21.15.194:0/3754285996 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0c98070030 con 0x55dc7d418410 2024-09-13T06:11:46.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.807+0000 7f0ca96e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:46.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.807+0000 7f0ca96e6980 20 started sync module instance, tier type = 2024-09-13T06:11:46.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.807+0000 7f0ca96e6980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:11:46.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.807+0000 7f0ca96e6980 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d41d990 con 0x7f0c98073060 2024-09-13T06:11:46.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.811+0000 7f0ca69f5640 1 -- 172.21.15.194:0/3754285996 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(44 notify.0 [create] v35'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c900d8070 con 0x7f0c98073060 2024-09-13T06:11:46.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.811+0000 7f0ca96e6980 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94405482634624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d41f2a0 con 0x7f0c98073060 2024-09-13T06:11:46.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.811+0000 7f0ca96e6980 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d41faf0 con 0x55dc7d413a20 2024-09-13T06:11:46.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.811+0000 7f0ca69f5640 1 -- 172.21.15.194:0/3754285996 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94405482634624] v35'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c900d8070 con 0x7f0c98073060 2024-09-13T06:11:46.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.811+0000 7f0ca79f7640 1 -- 172.21.15.194:0/3754285996 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v35'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ca00083f0 con 0x55dc7d413a20 2024-09-13T06:11:46.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.811+0000 7f0ca96e6980 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94405482638832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d41faf0 con 0x55dc7d413a20 2024-09-13T06:11:46.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.811+0000 7f0ca96e6980 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d420570 con 0x55dc7d418410 2024-09-13T06:11:46.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.815+0000 7f0ca79f7640 1 -- 172.21.15.194:0/3754285996 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94405482638832] v35'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ca00083f0 con 0x55dc7d413a20 2024-09-13T06:11:46.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.815+0000 7f0ca71f6640 1 -- 172.21.15.194:0/3754285996 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v35'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c98070030 con 0x55dc7d418410 2024-09-13T06:11:46.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.815+0000 7f0ca96e6980 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94405482640960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d41fa60 con 0x55dc7d418410 2024-09-13T06:11:46.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.815+0000 7f0ca96e6980 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d4212f0 con 0x7f0c98073060 2024-09-13T06:11:46.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.815+0000 7f0ca69f5640 1 -- 172.21.15.194:0/3754285996 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(50 notify.3 [create] v35'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c900d8070 con 0x7f0c98073060 2024-09-13T06:11:46.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.815+0000 7f0ca96e6980 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94405482649312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d421fb0 con 0x7f0c98073060 2024-09-13T06:11:46.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.815+0000 7f0ca96e6980 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d422970 con 0x55dc7d413a20 2024-09-13T06:11:46.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.815+0000 7f0ca71f6640 1 -- 172.21.15.194:0/3754285996 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94405482640960] v35'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c98070030 con 0x55dc7d418410 2024-09-13T06:11:46.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.815+0000 7f0ca69f5640 1 -- 172.21.15.194:0/3754285996 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94405482649312] v35'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c900d8070 con 0x7f0c98073060 2024-09-13T06:11:46.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.819+0000 7f0ca79f7640 1 -- 172.21.15.194:0/3754285996 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v35'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ca00083f0 con 0x55dc7d413a20 2024-09-13T06:11:46.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.819+0000 7f0ca96e6980 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94405482652864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d421fb0 con 0x55dc7d413a20 2024-09-13T06:11:46.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.819+0000 7f0ca96e6980 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d4228e0 con 0x7f0c900cd040 2024-09-13T06:11:46.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.819+0000 7f0ca79f7640 1 -- 172.21.15.194:0/3754285996 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94405482652864] v35'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ca00083f0 con 0x55dc7d413a20 2024-09-13T06:11:46.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.819+0000 7f0ca79f7640 1 -- 172.21.15.194:0/3754285996 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(54 notify.5 [create] v35'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ca00083f0 con 0x7f0c900cd040 2024-09-13T06:11:46.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.819+0000 7f0ca96e6980 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94405482650368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d421f20 con 0x7f0c900cd040 2024-09-13T06:11:46.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.819+0000 7f0ca96e6980 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d423670 con 0x7f0c900cd040 2024-09-13T06:11:46.824 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.823+0000 7f0ca79f7640 1 -- 172.21.15.194:0/3754285996 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94405482650368] v35'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ca00083f0 con 0x7f0c900cd040 2024-09-13T06:11:46.824 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.823+0000 7f0ca79f7640 1 -- 172.21.15.194:0/3754285996 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(56 notify.6 [create] v35'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ca00083f0 con 0x7f0c900cd040 2024-09-13T06:11:46.824 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.823+0000 7f0ca96e6980 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94405482654928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d4235a0 con 0x7f0c900cd040 2024-09-13T06:11:46.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.823+0000 7f0ca96e6980 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d424040 con 0x7f0c900cd040 2024-09-13T06:11:46.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.823+0000 7f0ca79f7640 1 -- 172.21.15.194:0/3754285996 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94405482654928] v35'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ca00083f0 con 0x7f0c900cd040 2024-09-13T06:11:46.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.823+0000 7f0ca79f7640 1 -- 172.21.15.194:0/3754285996 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(58 notify.7 [create] v35'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ca00083f0 con 0x7f0c900cd040 2024-09-13T06:11:46.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.823+0000 7f0ca96e6980 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94405482658576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d424220 con 0x7f0c900cd040 2024-09-13T06:11:46.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.823+0000 7f0ca96e6980 20 add_watcher() i=0 2024-09-13T06:11:46.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.823+0000 7f0ca96e6980 20 add_watcher() i=1 2024-09-13T06:11:46.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.823+0000 7f0ca96e6980 20 add_watcher() i=2 2024-09-13T06:11:46.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.823+0000 7f0ca96e6980 20 add_watcher() i=3 2024-09-13T06:11:46.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.823+0000 7f0ca96e6980 20 add_watcher() i=4 2024-09-13T06:11:46.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.823+0000 7f0ca96e6980 20 add_watcher() i=5 2024-09-13T06:11:46.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.823+0000 7f0ca96e6980 20 add_watcher() i=6 2024-09-13T06:11:46.829 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.827+0000 7f0ca79f7640 1 -- 172.21.15.194:0/3754285996 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94405482658576] v35'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ca00083f0 con 0x7f0c900cd040 2024-09-13T06:11:46.829 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.827+0000 7f0ca96e6980 20 add_watcher() i=7 2024-09-13T06:11:46.829 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.827+0000 7f0ca96e6980 2 all 8 watchers are set, enabling cache 2024-09-13T06:11:46.829 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.827+0000 7f0ca96e6980 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d4275f0 con 0x55dc7d413a20 2024-09-13T06:11:46.829 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.827+0000 7f0ca79f7640 1 -- 172.21.15.194:0/3754285996 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0ca00083f0 con 0x55dc7d413a20 2024-09-13T06:11:46.829 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.827+0000 7f0ca96e6980 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94405482660112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d4249e0 con 0x55dc7d413a20 2024-09-13T06:11:46.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.827+0000 7f0ca79f7640 1 -- 172.21.15.194:0/3754285996 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94405482660112] v35'265 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0ca00083f0 con 0x55dc7d413a20 2024-09-13T06:11:46.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.827+0000 7f0b5dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:11:46.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.827+0000 7f0ca96e6980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:11:46.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.827+0000 7f0ca96e6980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:11:46.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.827+0000 7f0ca96e6980 5 note: GC not initialized 2024-09-13T06:11:46.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.827+0000 7f0b5cfe1640 20 reqs_thread_entry: start 2024-09-13T06:11:46.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.827+0000 7f0ca96e6980 20 init_complete bucket index max shards: 11 2024-09-13T06:11:46.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.827+0000 7f0ca96e6980 20 Filter name: none 2024-09-13T06:11:46.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.827+0000 7f0ad67fc640 20 reqs_thread_entry: start 2024-09-13T06:11:46.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.827+0000 7f0ca96e6980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T06:11:46.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.827+0000 7f0ca96e6980 20 rados->read ofs=0 len=0 2024-09-13T06:11:46.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.827+0000 7f0ca96e6980 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d44ab30 con 0x7f0c900cd040 2024-09-13T06:11:46.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.831+0000 7f0ca79f7640 1 -- 172.21.15.194:0/3754285996 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f0ca00083f0 con 0x7f0c900cd040 2024-09-13T06:11:46.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.831+0000 7f0ca96e6980 20 rados_obj.operate() r=0 bl.length=460 2024-09-13T06:11:46.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.831+0000 7f0ca96e6980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-13T06:11:46.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.831+0000 7f0ca96e6980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T06:11:46.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.831+0000 7f0ca96e6980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:11:46.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.831+0000 7f0ca96e6980 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d451160 con 0x7f0c900cd040 2024-09-13T06:11:46.835 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.831+0000 7f0ca79f7640 1 -- 172.21.15.194:0/3754285996 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v35'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f0ca00083f0 con 0x7f0c900cd040 2024-09-13T06:11:46.835 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.831+0000 7f0ca96e6980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T06:11:46.836 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.831+0000 7f0ca96e6980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T06:11:46.836 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.831+0000 7f0ca96e6980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T06:11:46.836 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.831+0000 7f0ca96e6980 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94405482843088 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d44c850 con 0x55dc7d413a20 2024-09-13T06:11:46.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.835+0000 7f0ca79f7640 1 -- 172.21.15.194:0/3754285996 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== watch-notify(notify (1) cookie 94405482652864 notify 150323855388 ret 0) ==== 708+0+0 (crc 0 0 0) 0x7f0ca0010040 con 0x55dc7d413a20 2024-09-13T06:11:46.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.835+0000 7f0b8affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855388 cookie 94405482652864 notifier 4899 bl.length()=666 2024-09-13T06:11:46.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.835+0000 7f0b8affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T06:11:46.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.835+0000 7f0b8affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T06:11:46.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.835+0000 7f0ca79f7640 1 -- 172.21.15.194:0/3754285996 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(64 notify.4 [notify cookie 94405482843088 out=8b] v0'0 uv270 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0ca00083f0 con 0x55dc7d413a20 2024-09-13T06:11:46.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.835+0000 7f0b8affd640 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f0b6c003eb0 con 0x55dc7d413a20 2024-09-13T06:11:46.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.835+0000 7f0ca79f7640 1 -- 172.21.15.194:0/3754285996 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ca00083f0 con 0x55dc7d413a20 2024-09-13T06:11:46.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.835+0000 7f0ca79f7640 1 -- 172.21.15.194:0/3754285996 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== watch-notify(notify_complete (2) cookie 94405482843088 notify 150323855388 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f0ca000bc30 con 0x55dc7d413a20 2024-09-13T06:11:46.837 INFO:teuthology.orchestra.run.smithi194.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T06:11:44.596796Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"write"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:11:44.596784Z","tags":[],"group_ids":[]} 2024-09-13T06:11:46.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.835+0000 7f0b5dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:11:46.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.835+0000 7f0ca96e6980 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94405482660112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d448930 con 0x55dc7d413a20 2024-09-13T06:11:46.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.835+0000 7f0ca79f7640 1 -- 172.21.15.194:0/3754285996 <== osd.1 v2:172.21.15.194:6808/3135444559 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94405482660112] v35'266 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0ca00083f0 con 0x55dc7d413a20 2024-09-13T06:11:46.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.835+0000 7f0ca96e6980 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94405482634624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d448930 con 0x7f0c98073060 2024-09-13T06:11:46.840 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.839+0000 7f0ca69f5640 1 -- 172.21.15.194:0/3754285996 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94405482634624] v35'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c900d8070 con 0x7f0c98073060 2024-09-13T06:11:46.840 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.839+0000 7f0ca96e6980 20 remove_watcher() i=0 2024-09-13T06:11:46.840 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.839+0000 7f0ca96e6980 2 removed watcher, disabling cache 2024-09-13T06:11:46.840 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.839+0000 7f0ca96e6980 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94405482638832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d449f10 con 0x55dc7d413a20 2024-09-13T06:11:46.842 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.839+0000 7f0ca79f7640 1 -- 172.21.15.194:0/3754285996 <== osd.1 v2:172.21.15.194:6808/3135444559 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94405482638832] v35'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ca00083f0 con 0x55dc7d413a20 2024-09-13T06:11:46.842 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.839+0000 7f0ca96e6980 20 remove_watcher() i=1 2024-09-13T06:11:46.842 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.839+0000 7f0ca96e6980 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94405482640960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d449f10 con 0x55dc7d418410 2024-09-13T06:11:46.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.843+0000 7f0ca71f6640 1 -- 172.21.15.194:0/3754285996 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94405482640960] v35'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c98070030 con 0x55dc7d418410 2024-09-13T06:11:46.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.843+0000 7f0ca96e6980 20 remove_watcher() i=2 2024-09-13T06:11:46.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.843+0000 7f0ca96e6980 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94405482649312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d448930 con 0x7f0c98073060 2024-09-13T06:11:46.846 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.843+0000 7f0ca69f5640 1 -- 172.21.15.194:0/3754285996 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94405482649312] v35'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c900d8070 con 0x7f0c98073060 2024-09-13T06:11:46.846 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.843+0000 7f0ca96e6980 20 remove_watcher() i=3 2024-09-13T06:11:46.846 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.843+0000 7f0ca96e6980 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94405482652864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d41f640 con 0x55dc7d413a20 2024-09-13T06:11:46.848 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.847+0000 7f0ca79f7640 1 -- 172.21.15.194:0/3754285996 <== osd.1 v2:172.21.15.194:6808/3135444559 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94405482652864] v35'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ca00083f0 con 0x55dc7d413a20 2024-09-13T06:11:46.848 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.847+0000 7f0ca96e6980 20 remove_watcher() i=4 2024-09-13T06:11:46.849 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.847+0000 7f0ca96e6980 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94405482650368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d4216e0 con 0x7f0c900cd040 2024-09-13T06:11:46.850 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.847+0000 7f0ca79f7640 1 -- 172.21.15.194:0/3754285996 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94405482650368] v35'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ca00083f0 con 0x7f0c900cd040 2024-09-13T06:11:46.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.847+0000 7f0ca96e6980 20 remove_watcher() i=5 2024-09-13T06:11:46.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.847+0000 7f0ca96e6980 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94405482654928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d448930 con 0x7f0c900cd040 2024-09-13T06:11:46.853 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.851+0000 7f0ca79f7640 1 -- 172.21.15.194:0/3754285996 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94405482654928] v35'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ca00083f0 con 0x7f0c900cd040 2024-09-13T06:11:46.853 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.851+0000 7f0ca96e6980 20 remove_watcher() i=6 2024-09-13T06:11:46.853 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.851+0000 7f0ca96e6980 1 -- 172.21.15.194:0/3754285996 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94405482658576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55dc7d4224c0 con 0x7f0c900cd040 2024-09-13T06:11:46.857 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.851+0000 7f0ca79f7640 1 -- 172.21.15.194:0/3754285996 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94405482658576] v35'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ca00083f0 con 0x7f0c900cd040 2024-09-13T06:11:46.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.851+0000 7f0ca96e6980 20 remove_watcher() i=7 2024-09-13T06:11:46.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.851+0000 7f0ca96e6980 1 -- 172.21.15.194:0/3754285996 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f0c900cd040 msgr2=0x7f0c900b7420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.851+0000 7f0ca96e6980 1 --2- 172.21.15.194:0/3754285996 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f0c900cd040 0x7f0c900b7420 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.851+0000 7f0ca96e6980 1 -- 172.21.15.194:0/3754285996 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55dc7d413a20 msgr2=0x55dc7d415ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.851+0000 7f0ca96e6980 1 --2- 172.21.15.194:0/3754285996 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55dc7d413a20 0x55dc7d415ee0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.851+0000 7f0ca96e6980 1 -- 172.21.15.194:0/3754285996 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f0c98073060 msgr2=0x7f0c980208c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.851+0000 7f0ca96e6980 1 --2- 172.21.15.194:0/3754285996 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f0c98073060 0x7f0c980208c0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.851+0000 7f0ca96e6980 1 -- 172.21.15.194:0/3754285996 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55dc7d418410 msgr2=0x55dc7d41a800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.851+0000 7f0ca96e6980 1 --2- 172.21.15.194:0/3754285996 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55dc7d418410 0x55dc7d41a800 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.851+0000 7f0ca96e6980 1 -- 172.21.15.194:0/3754285996 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0b70034650 msgr2=0x7f0b70036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.851+0000 7f0ca96e6980 1 --2- 172.21.15.194:0/3754285996 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0b70034650 0x7f0b70036b10 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0c90000c10 tx=0x7f0c900b9040 comp rx=0 tx=0).stop 2024-09-13T06:11:46.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.855+0000 7f0ca96e6980 1 -- 172.21.15.194:0/3754285996 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dc7d4019f0 msgr2=0x55dc7d408be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.855+0000 7f0ca79f7640 1 -- 172.21.15.194:0/3754285996 reap_dead start 2024-09-13T06:11:46.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.855+0000 7f0ca96e6980 1 --2- 172.21.15.194:0/3754285996 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dc7d4019f0 0x55dc7d408be0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f0c98049a90 tx=0x7f0c98026c90 comp rx=0 tx=0).stop 2024-09-13T06:11:46.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.855+0000 7f0ca96e6980 1 -- 172.21.15.194:0/3754285996 shutdown_connections 2024-09-13T06:11:46.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.855+0000 7f0ca96e6980 1 --2- 172.21.15.194:0/3754285996 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dc7d4019f0 0x55dc7d408be0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.855+0000 7f0ca96e6980 1 -- 172.21.15.194:0/3754285996 >> 172.21.15.194:0/3754285996 conn(0x55dc7d3fddd0 msgr2=0x55dc7d3fbea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:46.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.855+0000 7f0ca96e6980 1 -- 172.21.15.194:0/3754285996 shutdown_connections 2024-09-13T06:11:46.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.855+0000 7f0ca96e6980 1 -- 172.21.15.194:0/3754285996 wait complete. 2024-09-13T06:11:46.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.855+0000 7f0ca96e6980 1 -- 172.21.15.194:0/2937165999 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0b80034750 msgr2=0x7f0b80036c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.855+0000 7f0ca96e6980 1 --2- 172.21.15.194:0/2937165999 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0b80034750 0x7f0b80036c10 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x55dc7d3dd1d0 tx=0x7f0c90005a10 comp rx=0 tx=0).stop 2024-09-13T06:11:46.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.855+0000 7f0ca96e6980 1 -- 172.21.15.194:0/2937165999 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dc7d2e2ca0 msgr2=0x55dc7d2e1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.855+0000 7f0ca96e6980 1 --2- 172.21.15.194:0/2937165999 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dc7d2e2ca0 0x55dc7d2e1320 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f0c98024c90 tx=0x7f0c9801cf50 comp rx=0 tx=0).stop 2024-09-13T06:11:46.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.855+0000 7f0ca96e6980 1 -- 172.21.15.194:0/2937165999 shutdown_connections 2024-09-13T06:11:46.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.855+0000 7f0ca96e6980 1 --2- 172.21.15.194:0/2937165999 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0b80034750 0x7f0b80036c10 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.855+0000 7f0ca96e6980 1 --2- 172.21.15.194:0/2937165999 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dc7d2e2ca0 0x55dc7d2e1320 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.855+0000 7f0ca96e6980 1 -- 172.21.15.194:0/2937165999 >> 172.21.15.194:0/2937165999 conn(0x55dc7d3e8250 msgr2=0x55dc7d3eacd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:46.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.855+0000 7f0ca96e6980 1 -- 172.21.15.194:0/2937165999 shutdown_connections 2024-09-13T06:11:46.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.855+0000 7f0ca96e6980 1 -- 172.21.15.194:0/2937165999 wait complete. 2024-09-13T06:11:46.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.855+0000 7f0ca96e6980 1 -- 172.21.15.194:0/2242092656 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55dc7d3da020 msgr2=0x55dc7d3dc410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.855+0000 7f0ca96e6980 1 --2- 172.21.15.194:0/2242092656 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55dc7d3da020 0x55dc7d3dc410 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.855+0000 7f0ca96e6980 1 -- 172.21.15.194:0/2242092656 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55dc7d3e2b40 msgr2=0x55dc7d3e4f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.855+0000 7f0ca96e6980 1 --2- 172.21.15.194:0/2242092656 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55dc7d3e2b40 0x55dc7d3e4f30 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.855+0000 7f0ca96e6980 1 -- 172.21.15.194:0/2242092656 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55dc7d3dec20 msgr2=0x55dc7d3e1010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.855+0000 7f0ca96e6980 1 --2- 172.21.15.194:0/2242092656 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55dc7d3dec20 0x55dc7d3e1010 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.855+0000 7f0ca96e6980 1 -- 172.21.15.194:0/2242092656 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0b8c0346a0 msgr2=0x7f0b8c036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.855+0000 7f0ca96e6980 1 --2- 172.21.15.194:0/2242092656 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0b8c0346a0 0x7f0b8c036b60 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f0c900ad000 tx=0x7f0c900a5040 comp rx=0 tx=0).stop 2024-09-13T06:11:46.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.855+0000 7f0ca96e6980 1 -- 172.21.15.194:0/2242092656 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dc7d2e6a60 msgr2=0x55dc7d3d4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.861 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.855+0000 7f0ca96e6980 1 --2- 172.21.15.194:0/2242092656 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dc7d2e6a60 0x55dc7d3d4f30 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f0c98014040 tx=0x7f0c98001260 comp rx=0 tx=0).stop 2024-09-13T06:11:46.861 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.855+0000 7f0ca79f7640 1 -- 172.21.15.194:0/2242092656 reap_dead start 2024-09-13T06:11:46.861 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.855+0000 7f0ca96e6980 1 -- 172.21.15.194:0/2242092656 shutdown_connections 2024-09-13T06:11:46.861 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.855+0000 7f0ca96e6980 1 -- 172.21.15.194:0/2242092656 >> 172.21.15.194:0/2242092656 conn(0x55dc7d2dd070 msgr2=0x55dc7d3c80a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:46.861 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.855+0000 7f0ca96e6980 1 -- 172.21.15.194:0/2242092656 shutdown_connections 2024-09-13T06:11:46.861 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.855+0000 7f0ca96e6980 1 -- 172.21.15.194:0/2242092656 wait complete. 2024-09-13T06:11:46.868 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T06:11:44.596796Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:11:44.596784Z', 'tags': [], 'group_ids': []} 2024-09-13T06:11:46.868 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T06:11:44.596796Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:11:44.596784Z', 'tags': [], 'group_ids': []} 2024-09-13T06:11:46.869 ERROR:root:0 2024-09-13T06:11:46.869 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T06:11:46.882 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'AccessDenied', 'Message': '', 'RequestId': 'tx00000ccc83b0ea81ce03b-0066e3d7a2-4227-default', 'HostId': '4227-default-default'} 2024-09-13T06:11:46.882 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-13T06:11:46.882 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-13T06:11:46.882 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps user-info-without-keys=write 2024-09-13T06:11:46.945 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:11:46.945 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:11:46.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.943+0000 7fa1c642a980 1 Processor -- start 2024-09-13T06:11:46.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.943+0000 7fa1c642a980 1 -- start start 2024-09-13T06:11:46.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.943+0000 7fa1c642a980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x561de91458a0 0x561de9145c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.943+0000 7fa1c642a980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561de8fcfae0 con 0x561de91462b0 2024-09-13T06:11:46.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.943+0000 7fa1c642a980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x561de8ff3e30 con 0x561de91458a0 2024-09-13T06:11:46.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.943+0000 7fa1c3f3a640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x561de91458a0 0x561de9145c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.943+0000 7fa1bbfff640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x561de91462b0 0x561de914cbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:58462/0 (socket says 172.21.15.194:58462) 2024-09-13T06:11:46.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.943+0000 7fa1bbfff640 1 -- 172.21.15.194:0/1524293213 learned_addr learned my addr 172.21.15.194:0/1524293213 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-09-13T06:11:46.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.943+0000 7fa1c3f3a640 1 -- 172.21.15.194:0/1524293213 >> v1:172.21.15.120:6789/0 conn(0x561de91462b0 legacy=0x561de914cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.943+0000 7fa1c3f3a640 1 -- 172.21.15.194:0/1524293213 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561de914f310 con 0x561de91458a0 2024-09-13T06:11:46.950 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.947+0000 7fa1c3f3a640 1 --2- 172.21.15.194:0/1524293213 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561de91458a0 0x561de9145c80 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fa1b400a480 tx=0x7fa1b401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4093446786940541 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.950 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.947+0000 7fa1c3739640 1 -- 172.21.15.194:0/1524293213 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1b40b0070 con 0x561de91458a0 2024-09-13T06:11:46.950 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.947+0000 7fa1c3739640 1 -- 172.21.15.194:0/1524293213 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1b40ab540 con 0x561de91458a0 2024-09-13T06:11:46.950 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.947+0000 7fa1c3739640 1 -- 172.21.15.194:0/1524293213 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1b40ab840 con 0x561de91458a0 2024-09-13T06:11:46.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.947+0000 7fa1c642a980 1 -- 172.21.15.194:0/1524293213 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561de91458a0 msgr2=0x561de9145c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.947+0000 7fa1c642a980 1 --2- 172.21.15.194:0/1524293213 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561de91458a0 0x561de9145c80 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fa1b400a480 tx=0x7fa1b401b280 comp rx=0 tx=0).stop 2024-09-13T06:11:46.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.947+0000 7fa1c642a980 1 -- 172.21.15.194:0/1524293213 shutdown_connections 2024-09-13T06:11:46.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.947+0000 7fa1c642a980 1 --2- 172.21.15.194:0/1524293213 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561de91458a0 0x561de9145c80 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.947+0000 7fa1c642a980 1 -- 172.21.15.194:0/1524293213 >> 172.21.15.194:0/1524293213 conn(0x561de91417b0 msgr2=0x561de9143bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:46.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.947+0000 7fa1c642a980 1 -- 172.21.15.194:0/1524293213 shutdown_connections 2024-09-13T06:11:46.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.947+0000 7fa1c642a980 1 -- 172.21.15.194:0/1524293213 wait complete. 2024-09-13T06:11:46.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.963+0000 7fa1c642a980 1 Processor -- start 2024-09-13T06:11:46.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.963+0000 7fa1c642a980 1 -- start start 2024-09-13T06:11:46.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.963+0000 7fa1c642a980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561de91458a0 0x561de92329e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.963+0000 7fa1c642a980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x561de8ff5200 con 0x561de91458a0 2024-09-13T06:11:46.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.963+0000 7fa1c3f3a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561de91458a0 0x561de92329e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.963+0000 7fa1c3f3a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561de91458a0 0x561de92329e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45540/0 (socket says 172.21.15.194:45540) 2024-09-13T06:11:46.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.963+0000 7fa1c3f3a640 1 -- 172.21.15.194:0/224671174 learned_addr learned my addr 172.21.15.194:0/224671174 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:46.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.963+0000 7fa1c3f3a640 1 -- 172.21.15.194:0/224671174 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561de9232fb0 con 0x561de91458a0 2024-09-13T06:11:46.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.963+0000 7fa1c3f3a640 1 --2- 172.21.15.194:0/224671174 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561de91458a0 0x561de92329e0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fa1b40ae040 tx=0x7fa1b4003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2462aef90444f7f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.967+0000 7fa0b1e0b640 1 -- 172.21.15.194:0/224671174 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1b40b0040 con 0x561de91458a0 2024-09-13T06:11:46.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.967+0000 7fa0b1e0b640 1 -- 172.21.15.194:0/224671174 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1b40ab9b0 con 0x561de91458a0 2024-09-13T06:11:46.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.967+0000 7fa0b1e0b640 1 -- 172.21.15.194:0/224671174 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1b40abc90 con 0x561de91458a0 2024-09-13T06:11:46.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.967+0000 7fa1c642a980 1 -- 172.21.15.194:0/224671174 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561de91458a0 msgr2=0x561de92329e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.967+0000 7fa1c642a980 1 --2- 172.21.15.194:0/224671174 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561de91458a0 0x561de92329e0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fa1b40ae040 tx=0x7fa1b4003030 comp rx=0 tx=0).stop 2024-09-13T06:11:46.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.967+0000 7fa1c642a980 1 -- 172.21.15.194:0/224671174 shutdown_connections 2024-09-13T06:11:46.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.967+0000 7fa1c642a980 1 --2- 172.21.15.194:0/224671174 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561de91458a0 0x561de92329e0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.967+0000 7fa1c642a980 1 -- 172.21.15.194:0/224671174 >> 172.21.15.194:0/224671174 conn(0x561de91417b0 msgr2=0x561de922e610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:46.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.967+0000 7fa1c642a980 1 -- 172.21.15.194:0/224671174 shutdown_connections 2024-09-13T06:11:46.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.967+0000 7fa1c642a980 1 -- 172.21.15.194:0/224671174 wait complete. 2024-09-13T06:11:46.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.967+0000 7fa1c642a980 1 Processor -- start 2024-09-13T06:11:46.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.967+0000 7fa1c642a980 1 -- start start 2024-09-13T06:11:46.971 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.967+0000 7fa1c642a980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561de91458a0 0x561de9239d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.971 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.967+0000 7fa1c642a980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x561de914ee10 con 0x561de91458a0 2024-09-13T06:11:46.971 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.967+0000 7fa1c3f3a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561de91458a0 0x561de9239d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.971 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.967+0000 7fa1c3f3a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561de91458a0 0x561de9239d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45554/0 (socket says 172.21.15.194:45554) 2024-09-13T06:11:46.971 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.967+0000 7fa1c3f3a640 1 -- 172.21.15.194:0/3224501162 learned_addr learned my addr 172.21.15.194:0/3224501162 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:46.972 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.967+0000 7fa1c3f3a640 1 -- 172.21.15.194:0/3224501162 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561de923a2d0 con 0x561de91458a0 2024-09-13T06:11:46.972 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.967+0000 7fa1c3f3a640 1 --2- 172.21.15.194:0/3224501162 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561de91458a0 0x561de9239d90 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fa1b400a480 tx=0x7fa1b4018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.972 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.967+0000 7fa0abfff640 1 -- 172.21.15.194:0/3224501162 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1b40b0070 con 0x561de91458a0 2024-09-13T06:11:46.972 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.967+0000 7fa0abfff640 1 -- 172.21.15.194:0/3224501162 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1b40b68f0 con 0x561de91458a0 2024-09-13T06:11:46.972 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.967+0000 7fa1c642a980 1 -- 172.21.15.194:0/3224501162 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561de923a560 con 0x561de91458a0 2024-09-13T06:11:46.972 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.967+0000 7fa0abfff640 1 -- 172.21.15.194:0/3224501162 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1b40b6bd0 con 0x561de91458a0 2024-09-13T06:11:46.972 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.967+0000 7fa1c642a980 1 -- 172.21.15.194:0/3224501162 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561de923d240 con 0x561de91458a0 2024-09-13T06:11:46.973 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.971+0000 7fa0abfff640 1 -- 172.21.15.194:0/3224501162 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa1b40b7420 con 0x561de91458a0 2024-09-13T06:11:46.973 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.971+0000 7fa0abfff640 1 --2- 172.21.15.194:0/3224501162 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa0ac0346a0 0x7fa0ac036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.973 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.971+0000 7fa0abfff640 1 -- 172.21.15.194:0/3224501162 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fa1b40bc070 con 0x561de91458a0 2024-09-13T06:11:46.973 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.971+0000 7fa1bbfff640 1 --2- 172.21.15.194:0/3224501162 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa0ac0346a0 0x7fa0ac036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.973 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.971+0000 7fa1c642a980 1 --2- 172.21.15.194:0/3224501162 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x561de91462b0 0x561de9240e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.973 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.971+0000 7fa1c642a980 1 -- 172.21.15.194:0/3224501162 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561de92413d0 con 0x561de91462b0 2024-09-13T06:11:46.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.971+0000 7fa1c473b640 1 --2- 172.21.15.194:0/3224501162 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x561de91462b0 0x561de9240e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.975 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.971+0000 7fa1bbfff640 1 --2- 172.21.15.194:0/3224501162 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa0ac0346a0 0x7fa0ac036b60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac000f70 tx=0x7fa1ac0012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.975 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.971+0000 7fa1c473b640 1 --2- 172.21.15.194:0/3224501162 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x561de91462b0 0x561de9240e90 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.975 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.971+0000 7fa1c473b640 1 -- 172.21.15.194:0/3224501162 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa1bc00a4d0 con 0x561de91462b0 2024-09-13T06:11:46.975 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.971+0000 7fa1c642a980 1 -- 172.21.15.194:0/3224501162 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561de923e460 con 0x561de91462b0 2024-09-13T06:11:46.975 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.971+0000 7fa1c473b640 1 -- 172.21.15.194:0/3224501162 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa1bc00a4d0 con 0x561de91462b0 2024-09-13T06:11:46.975 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.971+0000 7fa1c642a980 1 --2- 172.21.15.194:0/3224501162 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x561de92436c0 0x561de9245ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.971+0000 7fa1c642a980 1 -- 172.21.15.194:0/3224501162 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561de9246180 con 0x561de92436c0 2024-09-13T06:11:46.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.971+0000 7fa1c3f3a640 1 --2- 172.21.15.194:0/3224501162 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x561de92436c0 0x561de9245ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.971+0000 7fa1c3f3a640 1 --2- 172.21.15.194:0/3224501162 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x561de92436c0 0x561de9245ab0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.971+0000 7fa1c3f3a640 1 -- 172.21.15.194:0/3224501162 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa1b40b3040 con 0x561de92436c0 2024-09-13T06:11:46.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.971+0000 7fa1c642a980 1 -- 172.21.15.194:0/3224501162 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561de9242530 con 0x561de91462b0 2024-09-13T06:11:46.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.971+0000 7fa1c473b640 1 -- 172.21.15.194:0/3224501162 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa1bc00a4d0 con 0x561de91462b0 2024-09-13T06:11:46.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.971+0000 7fa1c642a980 1 --2- 172.21.15.194:0/3224501162 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x561de92475e0 0x561de92499d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.971+0000 7fa1c642a980 1 -- 172.21.15.194:0/3224501162 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561de924a0c0 con 0x561de92475e0 2024-09-13T06:11:46.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.971+0000 7fa1bbfff640 1 --2- 172.21.15.194:0/3224501162 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x561de92475e0 0x561de92499d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.975+0000 7fa1bbfff640 1 --2- 172.21.15.194:0/3224501162 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x561de92475e0 0x561de92499d0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.975+0000 7fa1bbfff640 1 -- 172.21.15.194:0/3224501162 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa1ac00e620 con 0x561de92475e0 2024-09-13T06:11:46.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.975+0000 7fa1c642a980 1 Processor -- start 2024-09-13T06:11:46.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.975+0000 7fa1c642a980 1 -- start start 2024-09-13T06:11:46.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.975+0000 7fa1c642a980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561de9257b70 0x561de9257f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.975+0000 7fa1c642a980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x561de904e800 con 0x561de9257b70 2024-09-13T06:11:46.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.975+0000 7fa1c3f3a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561de9257b70 0x561de9257f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.975+0000 7fa1c3f3a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561de9257b70 0x561de9257f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45556/0 (socket says 172.21.15.194:45556) 2024-09-13T06:11:46.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.975+0000 7fa1c3f3a640 1 -- 172.21.15.194:0/1831362302 learned_addr learned my addr 172.21.15.194:0/1831362302 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:46.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.975+0000 7fa1c3f3a640 1 -- 172.21.15.194:0/1831362302 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561de92584d0 con 0x561de9257b70 2024-09-13T06:11:46.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.975+0000 7fa1c3f3a640 1 --2- 172.21.15.194:0/1831362302 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561de9257b70 0x561de9257f90 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fa1b40e2be0 tx=0x7fa1b40b4700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.975+0000 7fa0a97fa640 1 -- 172.21.15.194:0/1831362302 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1b40e4a20 con 0x561de9257b70 2024-09-13T06:11:46.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.975+0000 7fa0a97fa640 1 -- 172.21.15.194:0/1831362302 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1b40e4bc0 con 0x561de9257b70 2024-09-13T06:11:46.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.975+0000 7fa1c642a980 1 -- 172.21.15.194:0/1831362302 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561de9258760 con 0x561de9257b70 2024-09-13T06:11:46.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.975+0000 7fa0a97fa640 1 -- 172.21.15.194:0/1831362302 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1b40aa3b0 con 0x561de9257b70 2024-09-13T06:11:46.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.975+0000 7fa1c642a980 1 -- 172.21.15.194:0/1831362302 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561de925b3e0 con 0x561de9257b70 2024-09-13T06:11:46.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.975+0000 7fa0a97fa640 1 -- 172.21.15.194:0/1831362302 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa1b40da030 con 0x561de9257b70 2024-09-13T06:11:46.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.979+0000 7fa0a97fa640 1 --2- 172.21.15.194:0/1831362302 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa09c034650 0x7fa09c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.979+0000 7fa0a97fa640 1 -- 172.21.15.194:0/1831362302 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fa1b40a8070 con 0x561de9257b70 2024-09-13T06:11:46.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.979+0000 7fa1bbfff640 1 --2- 172.21.15.194:0/1831362302 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa09c034650 0x7fa09c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.979+0000 7fa1c642a980 1 Processor -- start 2024-09-13T06:11:46.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.979+0000 7fa1c642a980 1 -- start start 2024-09-13T06:11:46.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.979+0000 7fa1bbfff640 1 --2- 172.21.15.194:0/1831362302 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa09c034650 0x7fa09c036b10 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac00bf60 tx=0x7fa1ac00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.979+0000 7fa1c642a980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561de9264510 0x561de92648f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.979+0000 7fa1c642a980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x561de92332d0 con 0x561de9264510 2024-09-13T06:11:46.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.979+0000 7fa1c3f3a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561de9264510 0x561de92648f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.979+0000 7fa1c3f3a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561de9264510 0x561de92648f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45566/0 (socket says 172.21.15.194:45566) 2024-09-13T06:11:46.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.979+0000 7fa1c3f3a640 1 -- 172.21.15.194:0/3607929798 learned_addr learned my addr 172.21.15.194:0/3607929798 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:46.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.979+0000 7fa1c3f3a640 1 -- 172.21.15.194:0/3607929798 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561de9264ec0 con 0x561de9264510 2024-09-13T06:11:46.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.979+0000 7fa1c3f3a640 1 --2- 172.21.15.194:0/3607929798 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561de9264510 0x561de92648f0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fa1b40b4c20 tx=0x7fa1b40c7690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fb44edf8e7bdf56 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.979+0000 7fa0a2ffd640 1 -- 172.21.15.194:0/3607929798 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1b40f7070 con 0x561de9264510 2024-09-13T06:11:46.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.979+0000 7fa0a2ffd640 1 -- 172.21.15.194:0/3607929798 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1b40c0df0 con 0x561de9264510 2024-09-13T06:11:46.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.979+0000 7fa0a2ffd640 1 -- 172.21.15.194:0/3607929798 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1b40bb300 con 0x561de9264510 2024-09-13T06:11:46.985 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.979+0000 7fa1c642a980 1 -- 172.21.15.194:0/3607929798 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561de9264510 msgr2=0x561de92648f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:46.985 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.979+0000 7fa1c642a980 1 --2- 172.21.15.194:0/3607929798 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561de9264510 0x561de92648f0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fa1b40b4c20 tx=0x7fa1b40c7690 comp rx=0 tx=0).stop 2024-09-13T06:11:46.985 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.979+0000 7fa1c642a980 1 -- 172.21.15.194:0/3607929798 shutdown_connections 2024-09-13T06:11:46.985 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.979+0000 7fa1c642a980 1 --2- 172.21.15.194:0/3607929798 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561de9264510 0x561de92648f0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:46.985 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.979+0000 7fa1c642a980 1 -- 172.21.15.194:0/3607929798 >> 172.21.15.194:0/3607929798 conn(0x561de92608f0 msgr2=0x561de925e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:46.985 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.979+0000 7fa1c642a980 1 -- 172.21.15.194:0/3607929798 shutdown_connections 2024-09-13T06:11:46.985 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.979+0000 7fa1c642a980 1 -- 172.21.15.194:0/3607929798 wait complete. 2024-09-13T06:11:46.985 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.979+0000 7fa1c642a980 1 Processor -- start 2024-09-13T06:11:46.985 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.979+0000 7fa1c642a980 1 -- start start 2024-09-13T06:11:46.985 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.979+0000 7fa1c642a980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561de9264510 0x561de926b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.986 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.979+0000 7fa1c642a980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x561de9265360 con 0x561de9264510 2024-09-13T06:11:46.986 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.979+0000 7fa1c3f3a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561de9264510 0x561de926b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.986 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.979+0000 7fa1c3f3a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561de9264510 0x561de926b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45576/0 (socket says 172.21.15.194:45576) 2024-09-13T06:11:46.986 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.979+0000 7fa1c3f3a640 1 -- 172.21.15.194:0/3119069375 learned_addr learned my addr 172.21.15.194:0/3119069375 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:46.986 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.983+0000 7fa1c3f3a640 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561de926bc60 con 0x561de9264510 2024-09-13T06:11:46.986 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.983+0000 7fa1c3f3a640 1 --2- 172.21.15.194:0/3119069375 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561de9264510 0x561de926b720 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fa1b40c7b50 tx=0x7fa1b40c1e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.986 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.983+0000 7fa0a17fa640 1 -- 172.21.15.194:0/3119069375 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1b410d070 con 0x561de9264510 2024-09-13T06:11:46.986 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.983+0000 7fa1c642a980 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561de926bc60 con 0x561de9264510 2024-09-13T06:11:46.986 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.983+0000 7fa0a17fa640 1 -- 172.21.15.194:0/3119069375 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1b4102040 con 0x561de9264510 2024-09-13T06:11:46.986 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.983+0000 7fa0a17fa640 1 -- 172.21.15.194:0/3119069375 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1b40d1b40 con 0x561de9264510 2024-09-13T06:11:46.986 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.983+0000 7fa1c642a980 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561de926c0d0 con 0x561de9264510 2024-09-13T06:11:46.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.983+0000 7fa0a17fa640 1 -- 172.21.15.194:0/3119069375 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa1b4110070 con 0x561de9264510 2024-09-13T06:11:46.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.983+0000 7fa0a17fa640 1 --2- 172.21.15.194:0/3119069375 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa08c038a60 0x7fa08c03af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.983+0000 7fa0a17fa640 1 -- 172.21.15.194:0/3119069375 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fa1b4109d50 con 0x561de9264510 2024-09-13T06:11:46.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.983+0000 7fa1bbfff640 1 --2- 172.21.15.194:0/3119069375 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa08c038a60 0x7fa08c03af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.983+0000 7fa1c642a980 20 rados->read ofs=0 len=0 2024-09-13T06:11:46.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.983+0000 7fa1c642a980 1 --2- 172.21.15.194:0/3119069375 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x561de9274590 0x561de9276a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.983+0000 7fa1c642a980 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561de92771a0 con 0x561de9274590 2024-09-13T06:11:46.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.983+0000 7fa1c473b640 1 --2- 172.21.15.194:0/3119069375 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x561de9274590 0x561de9276a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.983+0000 7fa1bbfff640 1 --2- 172.21.15.194:0/3119069375 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa08c038a60 0x7fa08c03af20 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x561de9241c70 tx=0x7fa1ac010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.983+0000 7fa1c473b640 1 --2- 172.21.15.194:0/3119069375 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x561de9274590 0x561de9276a50 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.983+0000 7fa1c473b640 1 -- 172.21.15.194:0/3119069375 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa1bc00a4d0 con 0x561de9274590 2024-09-13T06:11:46.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.983+0000 7fa1c642a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:46.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.983+0000 7fa1c642a980 20 realm 2024-09-13T06:11:46.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.983+0000 7fa1c642a980 20 rados->read ofs=0 len=0 2024-09-13T06:11:46.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.983+0000 7fa1c642a980 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561de92775b0 con 0x561de9274590 2024-09-13T06:11:46.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.983+0000 7fa1c473b640 1 -- 172.21.15.194:0/3119069375 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa1bc00a4d0 con 0x561de9274590 2024-09-13T06:11:46.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.983+0000 7fa1c642a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:46.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.983+0000 7fa1c642a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:11:46.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.983+0000 7fa1c642a980 20 rados->read ofs=0 len=0 2024-09-13T06:11:46.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.983+0000 7fa1c642a980 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561de9277e80 con 0x561de9274590 2024-09-13T06:11:46.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.983+0000 7fa1c473b640 1 -- 172.21.15.194:0/3119069375 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa1bc00a4d0 con 0x561de9274590 2024-09-13T06:11:46.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.983+0000 7fa1c642a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:46.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.983+0000 7fa1c642a980 20 rados->read ofs=0 len=0 2024-09-13T06:11:46.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.983+0000 7fa1c642a980 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561de9278220 con 0x561de9274590 2024-09-13T06:11:46.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.987+0000 7fa1c473b640 1 -- 172.21.15.194:0/3119069375 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa1bc00a4d0 con 0x561de9274590 2024-09-13T06:11:46.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.987+0000 7fa1c642a980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:11:46.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.987+0000 7fa1c642a980 20 rados->read ofs=0 len=0 2024-09-13T06:11:46.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.987+0000 7fa1c642a980 1 --2- 172.21.15.194:0/3119069375 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x561de9278f80 0x561de927b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.987+0000 7fa1c642a980 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561de927b980 con 0x561de9278f80 2024-09-13T06:11:46.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.987+0000 7fa1c3f3a640 1 --2- 172.21.15.194:0/3119069375 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x561de9278f80 0x561de927b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.987+0000 7fa1c3f3a640 1 --2- 172.21.15.194:0/3119069375 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x561de9278f80 0x561de927b370 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.987+0000 7fa1c3f3a640 1 -- 172.21.15.194:0/3119069375 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa1b410f030 con 0x561de9278f80 2024-09-13T06:11:46.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.987+0000 7fa1c642a980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:11:46.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.987+0000 7fa1c642a980 20 searching for the correct realm 2024-09-13T06:11:46.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.987+0000 7fa1c642a980 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561de927d250 con 0x561de9278f80 2024-09-13T06:11:46.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.987+0000 7fa1c3f3a640 1 -- 172.21.15.194:0/3119069375 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1b410f030 con 0x561de9278f80 2024-09-13T06:11:46.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.987+0000 7fa1c3f3a640 1 --2- 172.21.15.194:0/3119069375 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fa1b4112060 0x7fa1b40fb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.987+0000 7fa1c3f3a640 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561de927d250 con 0x7fa1b4112060 2024-09-13T06:11:46.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.987+0000 7fa1bbfff640 1 --2- 172.21.15.194:0/3119069375 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fa1b4112060 0x7fa1b40fb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.987+0000 7fa1bbfff640 1 --2- 172.21.15.194:0/3119069375 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fa1b4112060 0x7fa1b40fb3c0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.987+0000 7fa1bbfff640 1 -- 172.21.15.194:0/3119069375 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa1ac00e620 con 0x7fa1b4112060 2024-09-13T06:11:46.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.987+0000 7fa1bbfff640 1 --2- 172.21.15.194:0/3119069375 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fa1ac037040 0x7fa1ac036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:46.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.987+0000 7fa1bbfff640 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561de927d250 con 0x7fa1ac037040 2024-09-13T06:11:46.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.987+0000 7fa1c473b640 1 --2- 172.21.15.194:0/3119069375 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fa1ac037040 0x7fa1ac036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:46.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.987+0000 7fa1c473b640 1 --2- 172.21.15.194:0/3119069375 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fa1ac037040 0x7fa1ac036410 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:46.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.987+0000 7fa1c473b640 1 -- 172.21.15.194:0/3119069375 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1bc00a4d0 con 0x7fa1ac037040 2024-09-13T06:11:46.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.987+0000 7fa1c473b640 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561de9278220 con 0x561de9274590 2024-09-13T06:11:46.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.987+0000 7fa1c473b640 1 -- 172.21.15.194:0/3119069375 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1bc00a4d0 con 0x561de9274590 2024-09-13T06:11:46.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.987+0000 7fa1c473b640 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561de9278220 con 0x561de9274590 2024-09-13T06:11:47.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.987+0000 7fa1c473b640 1 -- 172.21.15.194:0/3119069375 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1bc00a4d0 con 0x561de9274590 2024-09-13T06:11:47.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.987+0000 7fa1c473b640 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561de9278220 con 0x7fa1ac037040 2024-09-13T06:11:47.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.991+0000 7fa1c473b640 1 -- 172.21.15.194:0/3119069375 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1bc00a4d0 con 0x7fa1ac037040 2024-09-13T06:11:47.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.991+0000 7fa1c473b640 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561de9278220 con 0x7fa1ac037040 2024-09-13T06:11:47.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.991+0000 7fa1c473b640 1 -- 172.21.15.194:0/3119069375 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1bc00a4d0 con 0x7fa1ac037040 2024-09-13T06:11:47.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.991+0000 7fa1c473b640 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561de9278220 con 0x7fa1b4112060 2024-09-13T06:11:47.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.991+0000 7fa1bbfff640 1 -- 172.21.15.194:0/3119069375 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1ac00e620 con 0x7fa1b4112060 2024-09-13T06:11:47.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.991+0000 7fa1bbfff640 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561de9278220 con 0x561de9278f80 2024-09-13T06:11:47.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.991+0000 7fa1c3f3a640 1 -- 172.21.15.194:0/3119069375 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1b410f030 con 0x561de9278f80 2024-09-13T06:11:47.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.991+0000 7fa1c3f3a640 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561de9278220 con 0x561de9274590 2024-09-13T06:11:47.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.991+0000 7fa1c473b640 1 -- 172.21.15.194:0/3119069375 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1bc00a4d0 con 0x561de9274590 2024-09-13T06:11:47.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.991+0000 7fa1c473b640 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561de9278220 con 0x7fa1ac037040 2024-09-13T06:11:47.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.991+0000 7fa1c473b640 1 -- 172.21.15.194:0/3119069375 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1bc00a4d0 con 0x7fa1ac037040 2024-09-13T06:11:47.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.991+0000 7fa1c473b640 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561de9278220 con 0x561de9274590 2024-09-13T06:11:47.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.991+0000 7fa1c473b640 1 -- 172.21.15.194:0/3119069375 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1bc00a4d0 con 0x561de9274590 2024-09-13T06:11:47.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.991+0000 7fa1c473b640 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561de9278220 con 0x7fa1b4112060 2024-09-13T06:11:47.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.991+0000 7fa1bbfff640 1 -- 172.21.15.194:0/3119069375 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa1ac00e620 con 0x7fa1b4112060 2024-09-13T06:11:47.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.991+0000 7fa1bbfff640 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561de9278220 con 0x561de9278f80 2024-09-13T06:11:47.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.991+0000 7fa1c3f3a640 1 -- 172.21.15.194:0/3119069375 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1b410f030 con 0x561de9278f80 2024-09-13T06:11:47.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.991+0000 7fa1c3f3a640 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561de9278220 con 0x561de9278f80 2024-09-13T06:11:47.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.991+0000 7fa1c3f3a640 1 -- 172.21.15.194:0/3119069375 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1b410f030 con 0x561de9278f80 2024-09-13T06:11:47.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.991+0000 7fa1c3f3a640 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561de9278220 con 0x7fa1ac037040 2024-09-13T06:11:47.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.995+0000 7fa1c473b640 1 -- 172.21.15.194:0/3119069375 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1bc00a4d0 con 0x7fa1ac037040 2024-09-13T06:11:47.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.995+0000 7fa1c473b640 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561de9278220 con 0x561de9278f80 2024-09-13T06:11:47.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.995+0000 7fa1c3f3a640 1 -- 172.21.15.194:0/3119069375 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1b410f030 con 0x561de9278f80 2024-09-13T06:11:47.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.995+0000 7fa1c3f3a640 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561de9278220 con 0x561de9278f80 2024-09-13T06:11:47.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.995+0000 7fa1c3f3a640 1 -- 172.21.15.194:0/3119069375 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1b410f030 con 0x561de9278f80 2024-09-13T06:11:47.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.995+0000 7fa1c3f3a640 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561de9278220 con 0x561de9274590 2024-09-13T06:11:47.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.995+0000 7fa1c473b640 1 -- 172.21.15.194:0/3119069375 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1bc00a4d0 con 0x561de9274590 2024-09-13T06:11:47.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.995+0000 7fa1c473b640 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561de9278220 con 0x561de9274590 2024-09-13T06:11:47.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.995+0000 7fa1c473b640 1 -- 172.21.15.194:0/3119069375 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v35'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa1bc00a4d0 con 0x561de9274590 2024-09-13T06:11:47.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.995+0000 7fa1c473b640 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561de9278220 con 0x7fa1b4112060 2024-09-13T06:11:47.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.995+0000 7fa1bbfff640 1 -- 172.21.15.194:0/3119069375 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1ac00e620 con 0x7fa1b4112060 2024-09-13T06:11:47.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.995+0000 7fa1bbfff640 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561de9278220 con 0x561de9278f80 2024-09-13T06:11:47.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.995+0000 7fa1c3f3a640 1 -- 172.21.15.194:0/3119069375 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1b410f030 con 0x561de9278f80 2024-09-13T06:11:47.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.995+0000 7fa1c3f3a640 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561de9278220 con 0x7fa1b4112060 2024-09-13T06:11:47.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.995+0000 7fa1bbfff640 1 -- 172.21.15.194:0/3119069375 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1ac00e620 con 0x7fa1b4112060 2024-09-13T06:11:47.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.995+0000 7fa1bbfff640 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561de9278220 con 0x561de9274590 2024-09-13T06:11:47.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.995+0000 7fa1c473b640 1 -- 172.21.15.194:0/3119069375 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1bc00a4d0 con 0x561de9274590 2024-09-13T06:11:47.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.995+0000 7fa1c473b640 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561de9278220 con 0x7fa1ac037040 2024-09-13T06:11:47.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.995+0000 7fa1c473b640 1 -- 172.21.15.194:0/3119069375 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1bc00a4d0 con 0x7fa1ac037040 2024-09-13T06:11:47.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.995+0000 7fa1c473b640 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561de9278220 con 0x561de9278f80 2024-09-13T06:11:47.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.995+0000 7fa1c3f3a640 1 -- 172.21.15.194:0/3119069375 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=107b] v35'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa1b410f030 con 0x561de9278f80 2024-09-13T06:11:47.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.995+0000 7fa1c3f3a640 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561de9278220 con 0x7fa1b4112060 2024-09-13T06:11:47.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.995+0000 7fa1bbfff640 1 -- 172.21.15.194:0/3119069375 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1ac00e620 con 0x7fa1b4112060 2024-09-13T06:11:47.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.995+0000 7fa1bbfff640 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561de9278220 con 0x7fa1b4112060 2024-09-13T06:11:47.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.999+0000 7fa1bbfff640 1 -- 172.21.15.194:0/3119069375 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1ac00e620 con 0x7fa1b4112060 2024-09-13T06:11:47.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.999+0000 7fa1bbfff640 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561de9278220 con 0x561de9278f80 2024-09-13T06:11:47.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.999+0000 7fa1c3f3a640 1 -- 172.21.15.194:0/3119069375 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1b410f030 con 0x561de9278f80 2024-09-13T06:11:47.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.999+0000 7fa1c3f3a640 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561de9278220 con 0x7fa1ac037040 2024-09-13T06:11:47.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.999+0000 7fa1c473b640 1 -- 172.21.15.194:0/3119069375 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1bc00a4d0 con 0x7fa1ac037040 2024-09-13T06:11:47.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.999+0000 7fa1c473b640 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561de9278220 con 0x561de9274590 2024-09-13T06:11:47.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.999+0000 7fa1c473b640 1 -- 172.21.15.194:0/3119069375 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v35'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa1bc00a4d0 con 0x561de9274590 2024-09-13T06:11:47.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.999+0000 7fa1c473b640 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561de9278220 con 0x7fa1b4112060 2024-09-13T06:11:47.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.999+0000 7fa1bbfff640 1 -- 172.21.15.194:0/3119069375 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1ac00e620 con 0x7fa1b4112060 2024-09-13T06:11:47.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.999+0000 7fa1c642a980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:11:47.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.999+0000 7fa1c642a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:11:47.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.999+0000 7fa1c642a980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:11:47.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.999+0000 7fa1c642a980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:11:47.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.999+0000 7fa1c642a980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:11:47.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.999+0000 7fa1c642a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:11:47.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.999+0000 7fa1c642a980 20 rados->read ofs=0 len=0 2024-09-13T06:11:47.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.999+0000 7fa1c642a980 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561de927c370 con 0x561de9274590 2024-09-13T06:11:47.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.999+0000 7fa1c473b640 1 -- 172.21.15.194:0/3119069375 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa1bc00a4d0 con 0x561de9274590 2024-09-13T06:11:47.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.999+0000 7fa1c642a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:47.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.999+0000 7fa1c642a980 20 rados->read ofs=0 len=0 2024-09-13T06:11:47.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.999+0000 7fa1c642a980 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561de927cbc0 con 0x561de9274590 2024-09-13T06:11:47.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.999+0000 7fa1c473b640 1 -- 172.21.15.194:0/3119069375 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa1bc00a4d0 con 0x561de9274590 2024-09-13T06:11:47.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.999+0000 7fa1c642a980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:11:47.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.999+0000 7fa1c642a980 20 rados->read ofs=0 len=0 2024-09-13T06:11:47.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.999+0000 7fa1c642a980 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561de927c710 con 0x7fa1b4112060 2024-09-13T06:11:47.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.999+0000 7fa1bbfff640 1 -- 172.21.15.194:0/3119069375 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa1ac00e620 con 0x7fa1b4112060 2024-09-13T06:11:47.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.999+0000 7fa1c642a980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:11:47.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.999+0000 7fa1c642a980 20 zone default found 2024-09-13T06:11:47.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.999+0000 7fa1c642a980 4 Realm: () 2024-09-13T06:11:47.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.999+0000 7fa1c642a980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:11:47.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.999+0000 7fa1c642a980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:11:47.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.999+0000 7fa1c642a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:11:47.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.999+0000 7fa1c642a980 20 zonegroup default 2024-09-13T06:11:47.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.999+0000 7fa1c642a980 20 rados->read ofs=0 len=0 2024-09-13T06:11:47.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.999+0000 7fa1c642a980 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561de927d680 con 0x7fa1ac037040 2024-09-13T06:11:47.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.999+0000 7fa1c473b640 1 -- 172.21.15.194:0/3119069375 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa1bc00a4d0 con 0x7fa1ac037040 2024-09-13T06:11:47.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.999+0000 7fa1c642a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:47.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.999+0000 7fa1c642a980 20 rados->read ofs=0 len=0 2024-09-13T06:11:47.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.999+0000 7fa1c642a980 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561de927f060 con 0x561de9278f80 2024-09-13T06:11:47.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.999+0000 7fa1c3f3a640 1 -- 172.21.15.194:0/3119069375 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa1b410f030 con 0x561de9278f80 2024-09-13T06:11:47.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.999+0000 7fa1c642a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:47.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.999+0000 7fa1c642a980 20 rados->read ofs=0 len=0 2024-09-13T06:11:47.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.999+0000 7fa1c642a980 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561de927f5a0 con 0x561de9278f80 2024-09-13T06:11:47.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.999+0000 7fa1c3f3a640 1 -- 172.21.15.194:0/3119069375 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa1b410f030 con 0x561de9278f80 2024-09-13T06:11:47.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.999+0000 7fa1c642a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:47.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.999+0000 7fa1c642a980 20 started sync module instance, tier type = 2024-09-13T06:11:47.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.999+0000 7fa1c642a980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:11:47.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:46.999+0000 7fa1c642a980 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561de927e500 con 0x7fa1b4112060 2024-09-13T06:11:47.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.003+0000 7fa1bbfff640 1 -- 172.21.15.194:0/3119069375 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(44 notify.0 [create] v35'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1ac00e620 con 0x7fa1b4112060 2024-09-13T06:11:47.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.003+0000 7fa1c642a980 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94686465747184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561de927feb0 con 0x7fa1b4112060 2024-09-13T06:11:47.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.003+0000 7fa1c642a980 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561de9280700 con 0x561de9274590 2024-09-13T06:11:47.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.003+0000 7fa1bbfff640 1 -- 172.21.15.194:0/3119069375 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94686465747184] v35'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1ac00e620 con 0x7fa1b4112060 2024-09-13T06:11:47.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.003+0000 7fa1c473b640 1 -- 172.21.15.194:0/3119069375 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v35'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1bc00a4d0 con 0x561de9274590 2024-09-13T06:11:47.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.003+0000 7fa1c642a980 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94686465751552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561de9280700 con 0x561de9274590 2024-09-13T06:11:47.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.003+0000 7fa1c642a980 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561de9281180 con 0x561de9278f80 2024-09-13T06:11:47.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.007+0000 7fa1c473b640 1 -- 172.21.15.194:0/3119069375 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94686465751552] v35'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1bc00a4d0 con 0x561de9274590 2024-09-13T06:11:47.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.007+0000 7fa1c3f3a640 1 -- 172.21.15.194:0/3119069375 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v35'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1b410f030 con 0x561de9278f80 2024-09-13T06:11:47.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.007+0000 7fa1c642a980 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94686465753680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561de9280670 con 0x561de9278f80 2024-09-13T06:11:47.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.007+0000 7fa1c642a980 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561de9281ed0 con 0x7fa1b4112060 2024-09-13T06:11:47.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.007+0000 7fa1bbfff640 1 -- 172.21.15.194:0/3119069375 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(50 notify.3 [create] v35'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1ac00e620 con 0x7fa1b4112060 2024-09-13T06:11:47.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.007+0000 7fa1c642a980 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94686465761984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561de9282b90 con 0x7fa1b4112060 2024-09-13T06:11:47.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.007+0000 7fa1c642a980 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561de9283550 con 0x561de9274590 2024-09-13T06:11:47.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.007+0000 7fa1c3f3a640 1 -- 172.21.15.194:0/3119069375 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94686465753680] v35'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1b410f030 con 0x561de9278f80 2024-09-13T06:11:47.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.011+0000 7fa1bbfff640 1 -- 172.21.15.194:0/3119069375 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94686465761984] v35'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1ac00e620 con 0x7fa1b4112060 2024-09-13T06:11:47.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.011+0000 7fa1c473b640 1 -- 172.21.15.194:0/3119069375 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v35'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1bc00a4d0 con 0x561de9274590 2024-09-13T06:11:47.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.011+0000 7fa1c642a980 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94686465765536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561de9282b90 con 0x561de9274590 2024-09-13T06:11:47.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.011+0000 7fa1c642a980 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561de92834c0 con 0x7fa1ac037040 2024-09-13T06:11:47.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.011+0000 7fa1c473b640 1 -- 172.21.15.194:0/3119069375 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(54 notify.5 [create] v35'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1bc00a4d0 con 0x7fa1ac037040 2024-09-13T06:11:47.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.011+0000 7fa1c642a980 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94686465767600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561de92834c0 con 0x7fa1ac037040 2024-09-13T06:11:47.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.011+0000 7fa1c642a980 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561de92847e0 con 0x7fa1ac037040 2024-09-13T06:11:47.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.011+0000 7fa1c473b640 1 -- 172.21.15.194:0/3119069375 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94686465765536] v35'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1bc00a4d0 con 0x561de9274590 2024-09-13T06:11:47.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.015+0000 7fa1c473b640 1 -- 172.21.15.194:0/3119069375 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94686465767600] v35'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1bc00a4d0 con 0x7fa1ac037040 2024-09-13T06:11:47.017 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.015+0000 7fa1c473b640 1 -- 172.21.15.194:0/3119069375 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(56 notify.6 [create] v35'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1bc00a4d0 con 0x7fa1ac037040 2024-09-13T06:11:47.017 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.015+0000 7fa1c642a980 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94686465768656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561de92842f0 con 0x7fa1ac037040 2024-09-13T06:11:47.017 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.015+0000 7fa1c642a980 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561de9284cb0 con 0x7fa1ac037040 2024-09-13T06:11:47.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.015+0000 7fa1c473b640 1 -- 172.21.15.194:0/3119069375 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94686465768656] v35'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1bc00a4d0 con 0x7fa1ac037040 2024-09-13T06:11:47.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.015+0000 7fa1c473b640 1 -- 172.21.15.194:0/3119069375 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(58 notify.7 [create] v35'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1bc00a4d0 con 0x7fa1ac037040 2024-09-13T06:11:47.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.015+0000 7fa1c642a980 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94686465763040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561de9284cb0 con 0x7fa1ac037040 2024-09-13T06:11:47.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.015+0000 7fa1c642a980 20 add_watcher() i=0 2024-09-13T06:11:47.020 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.015+0000 7fa1c642a980 20 add_watcher() i=1 2024-09-13T06:11:47.020 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.015+0000 7fa1c642a980 20 add_watcher() i=2 2024-09-13T06:11:47.020 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.015+0000 7fa1c642a980 20 add_watcher() i=3 2024-09-13T06:11:47.020 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.015+0000 7fa1c642a980 20 add_watcher() i=4 2024-09-13T06:11:47.020 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.015+0000 7fa1c642a980 20 add_watcher() i=5 2024-09-13T06:11:47.020 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.015+0000 7fa1c642a980 20 add_watcher() i=6 2024-09-13T06:11:47.021 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.019+0000 7fa1c473b640 1 -- 172.21.15.194:0/3119069375 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94686465763040] v35'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1bc00a4d0 con 0x7fa1ac037040 2024-09-13T06:11:47.021 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.019+0000 7fa1c642a980 20 add_watcher() i=7 2024-09-13T06:11:47.021 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.019+0000 7fa1c642a980 2 all 8 watchers are set, enabling cache 2024-09-13T06:11:47.021 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.019+0000 7fa1c642a980 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561de92880b0 con 0x561de9274590 2024-09-13T06:11:47.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.019+0000 7fa1c473b640 1 -- 172.21.15.194:0/3119069375 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa1bc00a4d0 con 0x561de9274590 2024-09-13T06:11:47.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.019+0000 7fa1c642a980 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94686465771984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561de92855d0 con 0x561de9274590 2024-09-13T06:11:47.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.019+0000 7fa1c473b640 1 -- 172.21.15.194:0/3119069375 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94686465771984] v35'267 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa1bc00a4d0 con 0x561de9274590 2024-09-13T06:11:47.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.019+0000 7fa079fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:11:47.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.019+0000 7fa1c642a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:11:47.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.019+0000 7fa1c642a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:11:47.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.019+0000 7fa1c642a980 5 note: GC not initialized 2024-09-13T06:11:47.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.019+0000 7fa078fe1640 20 reqs_thread_entry: start 2024-09-13T06:11:47.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.023+0000 7fa1c642a980 20 init_complete bucket index max shards: 11 2024-09-13T06:11:47.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.023+0000 7fa1c642a980 20 Filter name: none 2024-09-13T06:11:47.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.023+0000 7f9ff27fc640 20 reqs_thread_entry: start 2024-09-13T06:11:47.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.023+0000 7fa1c642a980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T06:11:47.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.023+0000 7fa1c642a980 20 rados->read ofs=0 len=0 2024-09-13T06:11:47.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.023+0000 7fa1c642a980 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561de92ab750 con 0x7fa1ac037040 2024-09-13T06:11:47.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.023+0000 7fa1c473b640 1 -- 172.21.15.194:0/3119069375 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7fa1bc00a4d0 con 0x7fa1ac037040 2024-09-13T06:11:47.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.023+0000 7fa1c642a980 20 rados_obj.operate() r=0 bl.length=490 2024-09-13T06:11:47.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.023+0000 7fa1c642a980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-13T06:11:47.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.023+0000 7fa1c642a980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T06:11:47.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.023+0000 7fa1c642a980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:11:47.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.023+0000 7fa1c642a980 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561de92b20a0 con 0x7fa1ac037040 2024-09-13T06:11:47.029 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.027+0000 7fa1c473b640 1 -- 172.21.15.194:0/3119069375 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v35'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fa1bc00a4d0 con 0x7fa1ac037040 2024-09-13T06:11:47.029 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.027+0000 7fa1c642a980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T06:11:47.029 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.027+0000 7fa1c642a980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T06:11:47.029 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.027+0000 7fa1c642a980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T06:11:47.029 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.027+0000 7fa1c642a980 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94686465956624 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561de92ad790 con 0x561de9274590 2024-09-13T06:11:47.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.027+0000 7fa1c473b640 1 -- 172.21.15.194:0/3119069375 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== watch-notify(notify (1) cookie 94686465765536 notify 150323855389 ret 0) ==== 678+0+0 (crc 0 0 0) 0x7fa1bc02d040 con 0x561de9274590 2024-09-13T06:11:47.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.027+0000 7fa0a2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855389 cookie 94686465765536 notifier 4906 bl.length()=636 2024-09-13T06:11:47.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.027+0000 7fa0a2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T06:11:47.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.027+0000 7fa0a2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T06:11:47.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.027+0000 7fa1c473b640 1 -- 172.21.15.194:0/3119069375 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(64 notify.4 [notify cookie 94686465956624 out=8b] v0'0 uv273 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa1bc00a4d0 con 0x561de9274590 2024-09-13T06:11:47.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.027+0000 7fa0a2ffd640 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fa088003eb0 con 0x561de9274590 2024-09-13T06:11:47.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.027+0000 7fa1c473b640 1 -- 172.21.15.194:0/3119069375 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1bc00a4d0 con 0x561de9274590 2024-09-13T06:11:47.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.027+0000 7fa1c473b640 1 -- 172.21.15.194:0/3119069375 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== watch-notify(notify_complete (2) cookie 94686465956624 notify 150323855389 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fa1bc01e040 con 0x561de9274590 2024-09-13T06:11:47.030 INFO:teuthology.orchestra.run.smithi194.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T06:11:44.596796Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:11:44.596784Z","tags":[],"group_ids":[]} 2024-09-13T06:11:47.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.027+0000 7fa079fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:11:47.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.027+0000 7fa1c642a980 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94686465771984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561de92a9580 con 0x561de9274590 2024-09-13T06:11:47.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.027+0000 7fa1c473b640 1 -- 172.21.15.194:0/3119069375 <== osd.1 v2:172.21.15.194:6808/3135444559 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94686465771984] v35'268 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa1bc00a4d0 con 0x561de9274590 2024-09-13T06:11:47.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.027+0000 7fa1c642a980 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94686465747184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561de92a9580 con 0x7fa1b4112060 2024-09-13T06:11:47.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.031+0000 7fa1bbfff640 1 -- 172.21.15.194:0/3119069375 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94686465747184] v35'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1ac00e620 con 0x7fa1b4112060 2024-09-13T06:11:47.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.031+0000 7fa1c642a980 20 remove_watcher() i=0 2024-09-13T06:11:47.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.031+0000 7fa1c642a980 2 removed watcher, disabling cache 2024-09-13T06:11:47.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.031+0000 7fa1c642a980 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94686465751552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561de92a9580 con 0x561de9274590 2024-09-13T06:11:47.034 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.031+0000 7fa1c473b640 1 -- 172.21.15.194:0/3119069375 <== osd.1 v2:172.21.15.194:6808/3135444559 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94686465751552] v35'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1bc00a4d0 con 0x561de9274590 2024-09-13T06:11:47.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.031+0000 7fa1c642a980 20 remove_watcher() i=1 2024-09-13T06:11:47.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.031+0000 7fa1c642a980 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94686465753680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561de92a9580 con 0x561de9278f80 2024-09-13T06:11:47.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.035+0000 7fa1c3f3a640 1 -- 172.21.15.194:0/3119069375 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94686465753680] v35'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1b410f030 con 0x561de9278f80 2024-09-13T06:11:47.037 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.035+0000 7fa1c642a980 20 remove_watcher() i=2 2024-09-13T06:11:47.037 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.035+0000 7fa1c642a980 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94686465761984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561de92a9580 con 0x7fa1b4112060 2024-09-13T06:11:47.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.035+0000 7fa1bbfff640 1 -- 172.21.15.194:0/3119069375 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94686465761984] v35'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1ac00e620 con 0x7fa1b4112060 2024-09-13T06:11:47.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.035+0000 7fa1c642a980 20 remove_watcher() i=3 2024-09-13T06:11:47.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.035+0000 7fa1c642a980 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94686465765536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561de92a9580 con 0x561de9274590 2024-09-13T06:11:47.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.039+0000 7fa1c473b640 1 -- 172.21.15.194:0/3119069375 <== osd.1 v2:172.21.15.194:6808/3135444559 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94686465765536] v35'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1bc00a4d0 con 0x561de9274590 2024-09-13T06:11:47.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.039+0000 7fa1c642a980 20 remove_watcher() i=4 2024-09-13T06:11:47.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.039+0000 7fa1c642a980 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94686465767600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561de92a9580 con 0x7fa1ac037040 2024-09-13T06:11:47.041 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.039+0000 7fa1c473b640 1 -- 172.21.15.194:0/3119069375 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94686465767600] v35'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1bc00a4d0 con 0x7fa1ac037040 2024-09-13T06:11:47.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.039+0000 7fa1c642a980 20 remove_watcher() i=5 2024-09-13T06:11:47.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.039+0000 7fa1c642a980 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94686465768656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561de92a9580 con 0x7fa1ac037040 2024-09-13T06:11:47.044 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.039+0000 7fa1c473b640 1 -- 172.21.15.194:0/3119069375 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94686465768656] v35'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1bc00a4d0 con 0x7fa1ac037040 2024-09-13T06:11:47.044 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.039+0000 7fa1c642a980 20 remove_watcher() i=6 2024-09-13T06:11:47.044 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.039+0000 7fa1c642a980 1 -- 172.21.15.194:0/3119069375 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94686465763040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561de92a9580 con 0x7fa1ac037040 2024-09-13T06:11:47.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.043+0000 7fa1c473b640 1 -- 172.21.15.194:0/3119069375 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94686465763040] v35'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1bc00a4d0 con 0x7fa1ac037040 2024-09-13T06:11:47.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.043+0000 7fa1c642a980 20 remove_watcher() i=7 2024-09-13T06:11:47.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.043+0000 7fa1c642a980 1 -- 172.21.15.194:0/3119069375 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fa1ac037040 msgr2=0x7fa1ac036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:47.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.043+0000 7fa1c642a980 1 --2- 172.21.15.194:0/3119069375 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fa1ac037040 0x7fa1ac036410 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:47.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.043+0000 7fa1c642a980 1 -- 172.21.15.194:0/3119069375 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x561de9274590 msgr2=0x561de9276a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:47.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.043+0000 7fa1c642a980 1 --2- 172.21.15.194:0/3119069375 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x561de9274590 0x561de9276a50 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:47.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.043+0000 7fa1c642a980 1 -- 172.21.15.194:0/3119069375 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fa1b4112060 msgr2=0x7fa1b40fb3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:47.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.043+0000 7fa1c642a980 1 --2- 172.21.15.194:0/3119069375 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fa1b4112060 0x7fa1b40fb3c0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:47.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.043+0000 7fa1c642a980 1 -- 172.21.15.194:0/3119069375 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x561de9278f80 msgr2=0x561de927b370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:47.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.043+0000 7fa1c642a980 1 --2- 172.21.15.194:0/3119069375 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x561de9278f80 0x561de927b370 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:47.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.043+0000 7fa1c642a980 1 -- 172.21.15.194:0/3119069375 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa08c038a60 msgr2=0x7fa08c03af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:47.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.043+0000 7fa1c642a980 1 --2- 172.21.15.194:0/3119069375 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa08c038a60 0x7fa08c03af20 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x561de9241c70 tx=0x7fa1ac010000 comp rx=0 tx=0).stop 2024-09-13T06:11:47.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.043+0000 7fa1c642a980 1 -- 172.21.15.194:0/3119069375 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561de9264510 msgr2=0x561de926b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:47.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.043+0000 7fa1c642a980 1 --2- 172.21.15.194:0/3119069375 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561de9264510 0x561de926b720 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fa1b40c7b50 tx=0x7fa1b40c1e90 comp rx=0 tx=0).stop 2024-09-13T06:11:47.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.043+0000 7fa1c473b640 1 -- 172.21.15.194:0/3119069375 reap_dead start 2024-09-13T06:11:47.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.043+0000 7fa1c473b640 1 -- 172.21.15.194:0/3119069375 reap_dead start 2024-09-13T06:11:47.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.043+0000 7fa1c642a980 1 -- 172.21.15.194:0/3119069375 shutdown_connections 2024-09-13T06:11:47.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.043+0000 7fa1c642a980 1 -- 172.21.15.194:0/3119069375 >> 172.21.15.194:0/3119069375 conn(0x561de92608f0 msgr2=0x561de925e9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:47.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.043+0000 7fa1c642a980 1 -- 172.21.15.194:0/3119069375 shutdown_connections 2024-09-13T06:11:47.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.043+0000 7fa1c642a980 1 -- 172.21.15.194:0/3119069375 wait complete. 2024-09-13T06:11:47.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.043+0000 7fa1c642a980 1 -- 172.21.15.194:0/1831362302 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa09c034650 msgr2=0x7fa09c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:47.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.043+0000 7fa1c642a980 1 --2- 172.21.15.194:0/1831362302 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa09c034650 0x7fa09c036b10 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac00bf60 tx=0x7fa1ac00f000 comp rx=0 tx=0).stop 2024-09-13T06:11:47.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.043+0000 7fa1c642a980 1 -- 172.21.15.194:0/1831362302 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561de9257b70 msgr2=0x561de9257f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:47.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.043+0000 7fa1c642a980 1 --2- 172.21.15.194:0/1831362302 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561de9257b70 0x561de9257f90 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fa1b40e2be0 tx=0x7fa1b40b4700 comp rx=0 tx=0).stop 2024-09-13T06:11:47.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.043+0000 7fa1c642a980 1 -- 172.21.15.194:0/1831362302 shutdown_connections 2024-09-13T06:11:47.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.043+0000 7fa1c642a980 1 --2- 172.21.15.194:0/1831362302 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa09c034650 0x7fa09c036b10 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:47.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.043+0000 7fa1c642a980 1 --2- 172.21.15.194:0/1831362302 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561de9257b70 0x561de9257f90 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:47.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.043+0000 7fa1c642a980 1 -- 172.21.15.194:0/1831362302 >> 172.21.15.194:0/1831362302 conn(0x561de924ccc0 msgr2=0x561de924f740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:47.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.043+0000 7fa1c642a980 1 -- 172.21.15.194:0/1831362302 shutdown_connections 2024-09-13T06:11:47.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.043+0000 7fa1c642a980 1 -- 172.21.15.194:0/1831362302 wait complete. 2024-09-13T06:11:47.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.043+0000 7fa1c642a980 1 -- 172.21.15.194:0/3224501162 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x561de91462b0 msgr2=0x561de9240e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:47.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.043+0000 7fa1c642a980 1 --2- 172.21.15.194:0/3224501162 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x561de91462b0 0x561de9240e90 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:47.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.043+0000 7fa1c642a980 1 -- 172.21.15.194:0/3224501162 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x561de92475e0 msgr2=0x561de92499d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:47.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.043+0000 7fa1c642a980 1 --2- 172.21.15.194:0/3224501162 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x561de92475e0 0x561de92499d0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:47.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.043+0000 7fa1c642a980 1 -- 172.21.15.194:0/3224501162 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x561de92436c0 msgr2=0x561de9245ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:47.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.043+0000 7fa1c642a980 1 --2- 172.21.15.194:0/3224501162 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x561de92436c0 0x561de9245ab0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:47.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.043+0000 7fa1c642a980 1 -- 172.21.15.194:0/3224501162 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa0ac0346a0 msgr2=0x7fa0ac036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:47.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.043+0000 7fa1c642a980 1 --2- 172.21.15.194:0/3224501162 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa0ac0346a0 0x7fa0ac036b60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac000f70 tx=0x7fa1ac0012c0 comp rx=0 tx=0).stop 2024-09-13T06:11:47.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.043+0000 7fa1c642a980 1 -- 172.21.15.194:0/3224501162 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561de91458a0 msgr2=0x561de9239d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:47.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.043+0000 7fa1c642a980 1 --2- 172.21.15.194:0/3224501162 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561de91458a0 0x561de9239d90 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fa1b400a480 tx=0x7fa1b4018020 comp rx=0 tx=0).stop 2024-09-13T06:11:47.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.043+0000 7fa1c473b640 1 -- 172.21.15.194:0/3224501162 reap_dead start 2024-09-13T06:11:47.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.043+0000 7fa1c642a980 1 -- 172.21.15.194:0/3224501162 shutdown_connections 2024-09-13T06:11:47.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.043+0000 7fa1c642a980 1 -- 172.21.15.194:0/3224501162 >> 172.21.15.194:0/3224501162 conn(0x561de91417b0 msgr2=0x561de922d190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:47.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.043+0000 7fa1c642a980 1 -- 172.21.15.194:0/3224501162 shutdown_connections 2024-09-13T06:11:47.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.043+0000 7fa1c642a980 1 -- 172.21.15.194:0/3224501162 wait complete. 2024-09-13T06:11:47.056 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T06:11:44.596796Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:11:44.596784Z', 'tags': [], 'group_ids': []} 2024-09-13T06:11:47.056 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T06:11:44.596796Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:11:44.596784Z', 'tags': [], 'group_ids': []} 2024-09-13T06:11:47.056 ERROR:root:0 2024-09-13T06:11:47.056 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-13T06:11:47.056 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-13T06:11:47.057 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-13T06:11:47.129 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:11:47.129 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:11:47.130 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.127+0000 7f4a83873980 1 Processor -- start 2024-09-13T06:11:47.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.127+0000 7f4a83873980 1 -- start start 2024-09-13T06:11:47.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.127+0000 7f4a83873980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55ff4929fb10 0x55ff4932e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:47.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.127+0000 7f4a83873980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ff491b3ae0 con 0x55ff4932e880 2024-09-13T06:11:47.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.127+0000 7f4a83873980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x55ff491d7e30 con 0x55ff4929fb10 2024-09-13T06:11:47.132 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.127+0000 7f4a81383640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55ff4929fb10 0x55ff4932e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:47.132 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.127+0000 7f4a80b82640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x55ff4932e880 0x55ff49330c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:58464/0 (socket says 172.21.15.194:58464) 2024-09-13T06:11:47.132 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.127+0000 7f4a80b82640 1 -- 172.21.15.194:0/1696473970 learned_addr learned my addr 172.21.15.194:0/1696473970 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-09-13T06:11:47.132 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.127+0000 7f4a73fff640 1 -- 172.21.15.194:0/1696473970 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2683006000 0 0) 0x55ff491b3ae0 con 0x55ff4932e880 2024-09-13T06:11:47.132 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.127+0000 7f4a73fff640 1 -- 172.21.15.194:0/1696473970 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a6c001e20 con 0x55ff4932e880 2024-09-13T06:11:47.132 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.127+0000 7f4a81383640 1 -- 172.21.15.194:0/1696473970 >> v1:172.21.15.120:6789/0 conn(0x55ff4932e880 legacy=0x55ff49330c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:47.132 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.127+0000 7f4a81383640 1 -- 172.21.15.194:0/1696473970 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff493333a0 con 0x55ff4929fb10 2024-09-13T06:11:47.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.131+0000 7f4a81383640 1 --2- 172.21.15.194:0/1696473970 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff4929fb10 0x55ff4932e340 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f4a7400a420 tx=0x7f4a7401afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55f72d295590a946 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:47.135 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.131+0000 7f4a73fff640 1 -- 172.21.15.194:0/1696473970 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a740af070 con 0x55ff4929fb10 2024-09-13T06:11:47.135 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.131+0000 7f4a73fff640 1 -- 172.21.15.194:0/1696473970 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a740aa530 con 0x55ff4929fb10 2024-09-13T06:11:47.135 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.131+0000 7f4a73fff640 1 -- 172.21.15.194:0/1696473970 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a740aa850 con 0x55ff4929fb10 2024-09-13T06:11:47.135 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.131+0000 7f4a83873980 1 -- 172.21.15.194:0/1696473970 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff4929fb10 msgr2=0x55ff4932e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:47.136 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.131+0000 7f4a83873980 1 --2- 172.21.15.194:0/1696473970 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff4929fb10 0x55ff4932e340 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f4a7400a420 tx=0x7f4a7401afd0 comp rx=0 tx=0).stop 2024-09-13T06:11:47.136 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.131+0000 7f4a83873980 1 -- 172.21.15.194:0/1696473970 shutdown_connections 2024-09-13T06:11:47.136 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.131+0000 7f4a83873980 1 --2- 172.21.15.194:0/1696473970 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff4929fb10 0x55ff4932e340 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:47.136 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.131+0000 7f4a83873980 1 -- 172.21.15.194:0/1696473970 >> 172.21.15.194:0/1696473970 conn(0x55ff49326070 msgr2=0x55ff49328490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:47.136 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.131+0000 7f4a83873980 1 -- 172.21.15.194:0/1696473970 shutdown_connections 2024-09-13T06:11:47.136 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.131+0000 7f4a83873980 1 -- 172.21.15.194:0/1696473970 wait complete. 2024-09-13T06:11:47.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.143+0000 7f4a83873980 1 Processor -- start 2024-09-13T06:11:47.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.147+0000 7f4a83873980 1 -- start start 2024-09-13T06:11:47.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.147+0000 7f4a83873980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff4929fb10 0x55ff4932baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:47.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.147+0000 7f4a83873980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55ff491d9200 con 0x55ff4929fb10 2024-09-13T06:11:47.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.147+0000 7f4a81383640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff4929fb10 0x55ff4932baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:47.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.147+0000 7f4a81383640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff4929fb10 0x55ff4932baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45604/0 (socket says 172.21.15.194:45604) 2024-09-13T06:11:47.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.147+0000 7f4a81383640 1 -- 172.21.15.194:0/2450888551 learned_addr learned my addr 172.21.15.194:0/2450888551 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:47.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.147+0000 7f4a81383640 1 -- 172.21.15.194:0/2450888551 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff4932c070 con 0x55ff4929fb10 2024-09-13T06:11:47.150 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.147+0000 7f4a81383640 1 --2- 172.21.15.194:0/2450888551 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff4929fb10 0x55ff4932baa0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f4a74017be0 tx=0x7f4a740033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b1abdebc4ec70bd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:47.150 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.147+0000 7f496f606640 1 -- 172.21.15.194:0/2450888551 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a740af050 con 0x55ff4929fb10 2024-09-13T06:11:47.150 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.147+0000 7f496f606640 1 -- 172.21.15.194:0/2450888551 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a740b0040 con 0x55ff4929fb10 2024-09-13T06:11:47.150 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.147+0000 7f496f606640 1 -- 172.21.15.194:0/2450888551 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a740aaaf0 con 0x55ff4929fb10 2024-09-13T06:11:47.151 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.147+0000 7f4a83873980 1 -- 172.21.15.194:0/2450888551 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff4929fb10 msgr2=0x55ff4932baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:47.151 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.147+0000 7f4a83873980 1 --2- 172.21.15.194:0/2450888551 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff4929fb10 0x55ff4932baa0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f4a74017be0 tx=0x7f4a740033b0 comp rx=0 tx=0).stop 2024-09-13T06:11:47.151 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.147+0000 7f4a83873980 1 -- 172.21.15.194:0/2450888551 shutdown_connections 2024-09-13T06:11:47.151 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.147+0000 7f4a83873980 1 --2- 172.21.15.194:0/2450888551 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff4929fb10 0x55ff4932baa0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:47.151 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.147+0000 7f4a83873980 1 -- 172.21.15.194:0/2450888551 >> 172.21.15.194:0/2450888551 conn(0x55ff49326070 msgr2=0x55ff49412460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:47.151 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.147+0000 7f4a83873980 1 -- 172.21.15.194:0/2450888551 shutdown_connections 2024-09-13T06:11:47.151 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.147+0000 7f4a83873980 1 -- 172.21.15.194:0/2450888551 wait complete. 2024-09-13T06:11:47.151 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.147+0000 7f4a83873980 1 Processor -- start 2024-09-13T06:11:47.152 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.147+0000 7f4a83873980 1 -- start start 2024-09-13T06:11:47.152 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.147+0000 7f4a83873980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff4929fb10 0x55ff4941fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:47.152 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.147+0000 7f4a83873980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55ff49332e40 con 0x55ff4929fb10 2024-09-13T06:11:47.153 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.147+0000 7f4a81383640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff4929fb10 0x55ff4941fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:47.153 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.147+0000 7f4a81383640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff4929fb10 0x55ff4941fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45606/0 (socket says 172.21.15.194:45606) 2024-09-13T06:11:47.153 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.147+0000 7f4a81383640 1 -- 172.21.15.194:0/1950759742 learned_addr learned my addr 172.21.15.194:0/1950759742 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:47.153 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.151+0000 7f4a81383640 1 -- 172.21.15.194:0/1950759742 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff494201e0 con 0x55ff4929fb10 2024-09-13T06:11:47.153 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.151+0000 7f4a81383640 1 --2- 172.21.15.194:0/1950759742 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff4929fb10 0x55ff4941fca0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f4a7401b870 tx=0x7f4a74019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:47.153 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.151+0000 7f496de03640 1 -- 172.21.15.194:0/1950759742 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a740b6bf0 con 0x55ff4929fb10 2024-09-13T06:11:47.153 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.151+0000 7f496de03640 1 -- 172.21.15.194:0/1950759742 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a740b6d90 con 0x55ff4929fb10 2024-09-13T06:11:47.153 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.151+0000 7f4a83873980 1 -- 172.21.15.194:0/1950759742 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ff49420470 con 0x55ff4929fb10 2024-09-13T06:11:47.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.151+0000 7f496de03640 1 -- 172.21.15.194:0/1950759742 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a740bf530 con 0x55ff4929fb10 2024-09-13T06:11:47.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.151+0000 7f4a83873980 1 -- 172.21.15.194:0/1950759742 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff49423150 con 0x55ff4929fb10 2024-09-13T06:11:47.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.151+0000 7f496de03640 1 -- 172.21.15.194:0/1950759742 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4a740bf6d0 con 0x55ff4929fb10 2024-09-13T06:11:47.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.151+0000 7f496de03640 1 --2- 172.21.15.194:0/1950759742 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4968034650 0x7f4968036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:47.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.151+0000 7f496de03640 1 -- 172.21.15.194:0/1950759742 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f4a740bb070 con 0x55ff4929fb10 2024-09-13T06:11:47.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.151+0000 7f4a80b82640 1 --2- 172.21.15.194:0/1950759742 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4968034650 0x7f4968036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:47.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.151+0000 7f4a83873980 1 --2- 172.21.15.194:0/1950759742 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ff4932e880 0x55ff49426c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:47.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.151+0000 7f4a83873980 1 -- 172.21.15.194:0/1950759742 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff49427300 con 0x55ff4932e880 2024-09-13T06:11:47.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.151+0000 7f4a81b84640 1 --2- 172.21.15.194:0/1950759742 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ff4932e880 0x55ff49426c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:47.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.151+0000 7f4a80b82640 1 --2- 172.21.15.194:0/1950759742 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4968034650 0x7f4968036b10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f4a78001dc0 tx=0x7f4a78001360 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:47.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.151+0000 7f4a81b84640 1 --2- 172.21.15.194:0/1950759742 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ff4932e880 0x55ff49426c90 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:47.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.151+0000 7f4a81b84640 1 -- 172.21.15.194:0/1950759742 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4a7c0083f0 con 0x55ff4932e880 2024-09-13T06:11:47.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.151+0000 7f4a83873980 1 -- 172.21.15.194:0/1950759742 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff49424370 con 0x55ff4932e880 2024-09-13T06:11:47.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.151+0000 7f4a81b84640 1 -- 172.21.15.194:0/1950759742 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4a7c0083f0 con 0x55ff4932e880 2024-09-13T06:11:47.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.151+0000 7f4a83873980 1 --2- 172.21.15.194:0/1950759742 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ff49429680 0x55ff4942ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:47.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.151+0000 7f4a83873980 1 -- 172.21.15.194:0/1950759742 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff4942c160 con 0x55ff49429680 2024-09-13T06:11:47.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.155+0000 7f4a81383640 1 --2- 172.21.15.194:0/1950759742 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ff49429680 0x55ff4942ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:47.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.155+0000 7f4a81383640 1 --2- 172.21.15.194:0/1950759742 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ff49429680 0x55ff4942ba70 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:47.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.155+0000 7f4a81383640 1 -- 172.21.15.194:0/1950759742 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4a740b2070 con 0x55ff49429680 2024-09-13T06:11:47.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.155+0000 7f4a83873980 1 -- 172.21.15.194:0/1950759742 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff49428520 con 0x55ff4932e880 2024-09-13T06:11:47.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.155+0000 7f4a81b84640 1 -- 172.21.15.194:0/1950759742 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4a7c0083f0 con 0x55ff4932e880 2024-09-13T06:11:47.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.155+0000 7f4a83873980 1 --2- 172.21.15.194:0/1950759742 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55ff4942d5c0 0x55ff4942f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:47.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.155+0000 7f4a83873980 1 -- 172.21.15.194:0/1950759742 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff49430120 con 0x55ff4942d5c0 2024-09-13T06:11:47.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.155+0000 7f4a80b82640 1 --2- 172.21.15.194:0/1950759742 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55ff4942d5c0 0x55ff4942f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:47.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.155+0000 7f4a80b82640 1 --2- 172.21.15.194:0/1950759742 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55ff4942d5c0 0x55ff4942f9b0 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:47.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.155+0000 7f4a80b82640 1 -- 172.21.15.194:0/1950759742 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4a7800e6e0 con 0x55ff4942d5c0 2024-09-13T06:11:47.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.155+0000 7f4a83873980 1 Processor -- start 2024-09-13T06:11:47.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.155+0000 7f4a83873980 1 -- start start 2024-09-13T06:11:47.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.155+0000 7f4a83873980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff4943db90 0x55ff4943dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:47.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.155+0000 7f4a83873980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55ff49232800 con 0x55ff4943db90 2024-09-13T06:11:47.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.155+0000 7f4a81383640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff4943db90 0x55ff4943dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:47.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.155+0000 7f4a81383640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff4943db90 0x55ff4943dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45608/0 (socket says 172.21.15.194:45608) 2024-09-13T06:11:47.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.155+0000 7f4a81383640 1 -- 172.21.15.194:0/1338751124 learned_addr learned my addr 172.21.15.194:0/1338751124 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:47.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.155+0000 7f4a81383640 1 -- 172.21.15.194:0/1338751124 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff4943e4f0 con 0x55ff4943db90 2024-09-13T06:11:47.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.155+0000 7f4a81383640 1 --2- 172.21.15.194:0/1338751124 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff4943db90 0x55ff4943dfb0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f4a740e4010 tx=0x7f4a740be590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:47.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.155+0000 7f4966ffd640 1 -- 172.21.15.194:0/1338751124 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a740c9c40 con 0x55ff4943db90 2024-09-13T06:11:47.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.155+0000 7f4966ffd640 1 -- 172.21.15.194:0/1338751124 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a740c9e00 con 0x55ff4943db90 2024-09-13T06:11:47.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.155+0000 7f4a83873980 1 -- 172.21.15.194:0/1338751124 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ff4943e780 con 0x55ff4943db90 2024-09-13T06:11:47.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.155+0000 7f4966ffd640 1 -- 172.21.15.194:0/1338751124 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a740bfdb0 con 0x55ff4943db90 2024-09-13T06:11:47.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.155+0000 7f4a83873980 1 -- 172.21.15.194:0/1338751124 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff49441400 con 0x55ff4943db90 2024-09-13T06:11:47.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.159+0000 7f4966ffd640 1 -- 172.21.15.194:0/1338751124 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4a740be6e0 con 0x55ff4943db90 2024-09-13T06:11:47.163 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.159+0000 7f4966ffd640 1 --2- 172.21.15.194:0/1338751124 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4958034650 0x7f4958036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:47.163 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.159+0000 7f4966ffd640 1 -- 172.21.15.194:0/1338751124 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f4a740db050 con 0x55ff4943db90 2024-09-13T06:11:47.163 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.159+0000 7f4a80b82640 1 --2- 172.21.15.194:0/1338751124 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4958034650 0x7f4958036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:47.163 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.159+0000 7f4a83873980 1 Processor -- start 2024-09-13T06:11:47.163 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.159+0000 7f4a83873980 1 -- start start 2024-09-13T06:11:47.163 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.159+0000 7f4a80b82640 1 --2- 172.21.15.194:0/1338751124 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4958034650 0x7f4958036b10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f4a7800bfe0 tx=0x7f4a7800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:47.163 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.159+0000 7f4a83873980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff4944a430 0x55ff4944a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:47.163 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.159+0000 7f4a83873980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55ff4932a1d0 con 0x55ff4944a430 2024-09-13T06:11:47.163 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.159+0000 7f4a81383640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff4944a430 0x55ff4944a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:47.163 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.159+0000 7f4a81383640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff4944a430 0x55ff4944a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45624/0 (socket says 172.21.15.194:45624) 2024-09-13T06:11:47.163 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.159+0000 7f4a81383640 1 -- 172.21.15.194:0/1312018603 learned_addr learned my addr 172.21.15.194:0/1312018603 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:47.163 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.159+0000 7f4a81383640 1 -- 172.21.15.194:0/1312018603 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff4944ade0 con 0x55ff4944a430 2024-09-13T06:11:47.164 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.159+0000 7f4a81383640 1 --2- 172.21.15.194:0/1312018603 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff4944a430 0x55ff4944a810 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f4a740c6020 tx=0x7f4a740dffc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0dc3c093264a7cb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:47.164 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.159+0000 7f4964ff9640 1 -- 172.21.15.194:0/1312018603 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a740c89a0 con 0x55ff4944a430 2024-09-13T06:11:47.164 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.159+0000 7f4964ff9640 1 -- 172.21.15.194:0/1312018603 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a740e40b0 con 0x55ff4944a430 2024-09-13T06:11:47.164 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.159+0000 7f4964ff9640 1 -- 172.21.15.194:0/1312018603 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a740e4c50 con 0x55ff4944a430 2024-09-13T06:11:47.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.159+0000 7f4a83873980 1 -- 172.21.15.194:0/1312018603 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff4944a430 msgr2=0x55ff4944a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:47.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.159+0000 7f4a83873980 1 --2- 172.21.15.194:0/1312018603 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff4944a430 0x55ff4944a810 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f4a740c6020 tx=0x7f4a740dffc0 comp rx=0 tx=0).stop 2024-09-13T06:11:47.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.159+0000 7f4a83873980 1 -- 172.21.15.194:0/1312018603 shutdown_connections 2024-09-13T06:11:47.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.159+0000 7f4a83873980 1 --2- 172.21.15.194:0/1312018603 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff4944a430 0x55ff4944a810 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:47.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.159+0000 7f4a83873980 1 -- 172.21.15.194:0/1312018603 >> 172.21.15.194:0/1312018603 conn(0x55ff49446810 msgr2=0x55ff49444910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:47.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.159+0000 7f4a83873980 1 -- 172.21.15.194:0/1312018603 shutdown_connections 2024-09-13T06:11:47.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.159+0000 7f4a83873980 1 -- 172.21.15.194:0/1312018603 wait complete. 2024-09-13T06:11:47.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.159+0000 7f4a83873980 1 Processor -- start 2024-09-13T06:11:47.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.159+0000 7f4a83873980 1 -- start start 2024-09-13T06:11:47.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.163+0000 7f4a83873980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff4944a430 0x55ff49451620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:47.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.163+0000 7f4a83873980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55ff4944b280 con 0x55ff4944a430 2024-09-13T06:11:47.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.163+0000 7f4a81383640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff4944a430 0x55ff49451620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:47.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.163+0000 7f4a81383640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff4944a430 0x55ff49451620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45636/0 (socket says 172.21.15.194:45636) 2024-09-13T06:11:47.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.163+0000 7f4a81383640 1 -- 172.21.15.194:0/1529138190 learned_addr learned my addr 172.21.15.194:0/1529138190 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:47.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.163+0000 7f4a81383640 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff49451b60 con 0x55ff4944a430 2024-09-13T06:11:47.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.163+0000 7f4a81383640 1 --2- 172.21.15.194:0/1529138190 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff4944a430 0x55ff49451620 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f4a740c9fd0 tx=0x7f4a740d9ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:47.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.163+0000 7f4956ffd640 1 -- 172.21.15.194:0/1529138190 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a74105070 con 0x55ff4944a430 2024-09-13T06:11:47.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.163+0000 7f4956ffd640 1 -- 172.21.15.194:0/1529138190 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a740e4c50 con 0x55ff4944a430 2024-09-13T06:11:47.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.163+0000 7f4a83873980 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ff49451b60 con 0x55ff4944a430 2024-09-13T06:11:47.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.163+0000 7f4956ffd640 1 -- 172.21.15.194:0/1529138190 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a740c83a0 con 0x55ff4944a430 2024-09-13T06:11:47.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.163+0000 7f4a83873980 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff49451b60 con 0x55ff4944a430 2024-09-13T06:11:47.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.163+0000 7f4956ffd640 1 -- 172.21.15.194:0/1529138190 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4a74110060 con 0x55ff4944a430 2024-09-13T06:11:47.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.163+0000 7f4956ffd640 1 --2- 172.21.15.194:0/1529138190 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f494c034650 0x7f494c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:47.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.163+0000 7f4956ffd640 1 -- 172.21.15.194:0/1529138190 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f4a740fb020 con 0x55ff4944a430 2024-09-13T06:11:47.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.163+0000 7f4a80b82640 1 --2- 172.21.15.194:0/1529138190 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f494c034650 0x7f494c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:47.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.163+0000 7f4a83873980 20 rados->read ofs=0 len=0 2024-09-13T06:11:47.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.163+0000 7f4a83873980 1 --2- 172.21.15.194:0/1529138190 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ff4945c750 0x55ff4945ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:47.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.163+0000 7f4a83873980 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff4945f360 con 0x55ff4945c750 2024-09-13T06:11:47.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.163+0000 7f4a81b84640 1 --2- 172.21.15.194:0/1529138190 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ff4945c750 0x55ff4945ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:47.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.163+0000 7f4a80b82640 1 --2- 172.21.15.194:0/1529138190 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f494c034650 0x7f494c036b10 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x55ff49430500 tx=0x7f4a78010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:47.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.163+0000 7f4a81b84640 1 --2- 172.21.15.194:0/1529138190 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ff4945c750 0x55ff4945ec10 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:47.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.163+0000 7f4a81b84640 1 -- 172.21.15.194:0/1529138190 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4a7c0083f0 con 0x55ff4945c750 2024-09-13T06:11:47.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.163+0000 7f4a83873980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:47.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.163+0000 7f4a83873980 20 realm 2024-09-13T06:11:47.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.163+0000 7f4a83873980 20 rados->read ofs=0 len=0 2024-09-13T06:11:47.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.163+0000 7f4a83873980 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff4945f770 con 0x55ff4945c750 2024-09-13T06:11:47.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.163+0000 7f4a81b84640 1 -- 172.21.15.194:0/1529138190 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4a7c0083f0 con 0x55ff4945c750 2024-09-13T06:11:47.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.163+0000 7f4a83873980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:47.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.163+0000 7f4a83873980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:11:47.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.163+0000 7f4a83873980 20 rados->read ofs=0 len=0 2024-09-13T06:11:47.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.163+0000 7f4a83873980 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff49460010 con 0x55ff4945c750 2024-09-13T06:11:47.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.167+0000 7f4a81b84640 1 -- 172.21.15.194:0/1529138190 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4a7c0083f0 con 0x55ff4945c750 2024-09-13T06:11:47.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.167+0000 7f4a83873980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:47.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.167+0000 7f4a83873980 20 rados->read ofs=0 len=0 2024-09-13T06:11:47.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.167+0000 7f4a83873980 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff494603b0 con 0x55ff4945c750 2024-09-13T06:11:47.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.167+0000 7f4a81b84640 1 -- 172.21.15.194:0/1529138190 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4a7c0083f0 con 0x55ff4945c750 2024-09-13T06:11:47.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.167+0000 7f4a83873980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:11:47.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.167+0000 7f4a83873980 20 rados->read ofs=0 len=0 2024-09-13T06:11:47.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.167+0000 7f4a83873980 1 --2- 172.21.15.194:0/1529138190 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ff49461110 0x55ff49463500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:47.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.167+0000 7f4a83873980 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff49463b50 con 0x55ff49461110 2024-09-13T06:11:47.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.167+0000 7f4a81383640 1 --2- 172.21.15.194:0/1529138190 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ff49461110 0x55ff49463500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:47.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.167+0000 7f4a81383640 1 --2- 172.21.15.194:0/1529138190 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ff49461110 0x55ff49463500 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:47.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.167+0000 7f4a81383640 1 -- 172.21.15.194:0/1529138190 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4a740f4030 con 0x55ff49461110 2024-09-13T06:11:47.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.167+0000 7f4a83873980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:11:47.175 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.167+0000 7f4a83873980 20 searching for the correct realm 2024-09-13T06:11:47.175 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.167+0000 7f4a83873980 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ff494653b0 con 0x55ff49461110 2024-09-13T06:11:47.175 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.167+0000 7f4a81383640 1 -- 172.21.15.194:0/1529138190 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a740f4030 con 0x55ff49461110 2024-09-13T06:11:47.175 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.167+0000 7f4a81383640 1 --2- 172.21.15.194:0/1529138190 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f4a74109020 0x7f4a74105210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:47.175 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.167+0000 7f4a81383640 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ff494653b0 con 0x7f4a74109020 2024-09-13T06:11:47.175 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.167+0000 7f4a80b82640 1 --2- 172.21.15.194:0/1529138190 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f4a74109020 0x7f4a74105210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:47.175 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.167+0000 7f4a80b82640 1 --2- 172.21.15.194:0/1529138190 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f4a74109020 0x7f4a74105210 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:47.175 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.167+0000 7f4a80b82640 1 -- 172.21.15.194:0/1529138190 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4a7800e6e0 con 0x7f4a74109020 2024-09-13T06:11:47.175 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.167+0000 7f4a80b82640 1 --2- 172.21.15.194:0/1529138190 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f4a78037040 0x7f4a78036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:47.175 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.167+0000 7f4a80b82640 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ff494653b0 con 0x7f4a78037040 2024-09-13T06:11:47.175 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.167+0000 7f4a81b84640 1 --2- 172.21.15.194:0/1529138190 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f4a78037040 0x7f4a78036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:47.175 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.167+0000 7f4a81b84640 1 --2- 172.21.15.194:0/1529138190 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f4a78037040 0x7f4a78036410 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:47.175 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.167+0000 7f4a81b84640 1 -- 172.21.15.194:0/1529138190 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a7c0083f0 con 0x7f4a78037040 2024-09-13T06:11:47.176 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.167+0000 7f4a81b84640 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ff494603b0 con 0x55ff4945c750 2024-09-13T06:11:47.176 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.171+0000 7f4a81b84640 1 -- 172.21.15.194:0/1529138190 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a7c0083f0 con 0x55ff4945c750 2024-09-13T06:11:47.176 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.171+0000 7f4a81b84640 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ff494603b0 con 0x55ff4945c750 2024-09-13T06:11:47.176 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.171+0000 7f4a81b84640 1 -- 172.21.15.194:0/1529138190 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a7c0083f0 con 0x55ff4945c750 2024-09-13T06:11:47.176 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.171+0000 7f4a81b84640 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ff494603b0 con 0x7f4a78037040 2024-09-13T06:11:47.176 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.171+0000 7f4a81b84640 1 -- 172.21.15.194:0/1529138190 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a7c0083f0 con 0x7f4a78037040 2024-09-13T06:11:47.176 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.171+0000 7f4a81b84640 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ff494603b0 con 0x7f4a78037040 2024-09-13T06:11:47.176 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.171+0000 7f4a81b84640 1 -- 172.21.15.194:0/1529138190 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a7c0083f0 con 0x7f4a78037040 2024-09-13T06:11:47.176 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.171+0000 7f4a81b84640 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ff494603b0 con 0x7f4a74109020 2024-09-13T06:11:47.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.171+0000 7f4a80b82640 1 -- 172.21.15.194:0/1529138190 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a7800e6e0 con 0x7f4a74109020 2024-09-13T06:11:47.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.171+0000 7f4a80b82640 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ff494603b0 con 0x55ff49461110 2024-09-13T06:11:47.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.171+0000 7f4a81383640 1 -- 172.21.15.194:0/1529138190 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a740f4030 con 0x55ff49461110 2024-09-13T06:11:47.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.171+0000 7f4a81383640 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ff494603b0 con 0x55ff4945c750 2024-09-13T06:11:47.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.171+0000 7f4a81b84640 1 -- 172.21.15.194:0/1529138190 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a7c0083f0 con 0x55ff4945c750 2024-09-13T06:11:47.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.171+0000 7f4a81b84640 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ff494603b0 con 0x7f4a78037040 2024-09-13T06:11:47.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.171+0000 7f4a81b84640 1 -- 172.21.15.194:0/1529138190 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a7c0083f0 con 0x7f4a78037040 2024-09-13T06:11:47.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.171+0000 7f4a81b84640 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ff494603b0 con 0x55ff4945c750 2024-09-13T06:11:47.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.171+0000 7f4a81b84640 1 -- 172.21.15.194:0/1529138190 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a7c0083f0 con 0x55ff4945c750 2024-09-13T06:11:47.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.171+0000 7f4a81b84640 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ff494603b0 con 0x7f4a74109020 2024-09-13T06:11:47.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.171+0000 7f4a80b82640 1 -- 172.21.15.194:0/1529138190 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4a7800e6e0 con 0x7f4a74109020 2024-09-13T06:11:47.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.171+0000 7f4a80b82640 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ff494603b0 con 0x55ff49461110 2024-09-13T06:11:47.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.171+0000 7f4a81383640 1 -- 172.21.15.194:0/1529138190 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a740f4030 con 0x55ff49461110 2024-09-13T06:11:47.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.171+0000 7f4a81383640 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ff494603b0 con 0x55ff49461110 2024-09-13T06:11:47.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.175+0000 7f4a81383640 1 -- 172.21.15.194:0/1529138190 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a740f4030 con 0x55ff49461110 2024-09-13T06:11:47.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.175+0000 7f4a81383640 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ff494603b0 con 0x7f4a78037040 2024-09-13T06:11:47.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.175+0000 7f4a81b84640 1 -- 172.21.15.194:0/1529138190 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a7c0083f0 con 0x7f4a78037040 2024-09-13T06:11:47.182 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.175+0000 7f4a81b84640 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ff494603b0 con 0x55ff49461110 2024-09-13T06:11:47.182 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.175+0000 7f4a81383640 1 -- 172.21.15.194:0/1529138190 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a740f4030 con 0x55ff49461110 2024-09-13T06:11:47.182 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.175+0000 7f4a81383640 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ff494603b0 con 0x55ff49461110 2024-09-13T06:11:47.182 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.175+0000 7f4a81383640 1 -- 172.21.15.194:0/1529138190 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a740f4030 con 0x55ff49461110 2024-09-13T06:11:47.182 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.175+0000 7f4a81383640 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ff494603b0 con 0x55ff4945c750 2024-09-13T06:11:47.182 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.175+0000 7f4a81b84640 1 -- 172.21.15.194:0/1529138190 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a7c0083f0 con 0x55ff4945c750 2024-09-13T06:11:47.182 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.175+0000 7f4a81b84640 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ff494603b0 con 0x55ff4945c750 2024-09-13T06:11:47.182 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.175+0000 7f4a81b84640 1 -- 172.21.15.194:0/1529138190 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v35'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4a7c0083f0 con 0x55ff4945c750 2024-09-13T06:11:47.182 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.175+0000 7f4a81b84640 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ff494603b0 con 0x7f4a74109020 2024-09-13T06:11:47.182 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.175+0000 7f4a80b82640 1 -- 172.21.15.194:0/1529138190 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a7800e6e0 con 0x7f4a74109020 2024-09-13T06:11:47.182 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.175+0000 7f4a80b82640 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ff494603b0 con 0x55ff49461110 2024-09-13T06:11:47.182 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.175+0000 7f4a81383640 1 -- 172.21.15.194:0/1529138190 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a740f4030 con 0x55ff49461110 2024-09-13T06:11:47.183 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.175+0000 7f4a81383640 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ff494603b0 con 0x7f4a74109020 2024-09-13T06:11:47.183 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.175+0000 7f4a80b82640 1 -- 172.21.15.194:0/1529138190 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a7800e6e0 con 0x7f4a74109020 2024-09-13T06:11:47.183 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.175+0000 7f4a80b82640 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ff494603b0 con 0x55ff4945c750 2024-09-13T06:11:47.183 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.175+0000 7f4a81b84640 1 -- 172.21.15.194:0/1529138190 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a7c0083f0 con 0x55ff4945c750 2024-09-13T06:11:47.183 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.175+0000 7f4a81b84640 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ff494603b0 con 0x7f4a78037040 2024-09-13T06:11:47.183 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.175+0000 7f4a81b84640 1 -- 172.21.15.194:0/1529138190 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a7c0083f0 con 0x7f4a78037040 2024-09-13T06:11:47.183 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.175+0000 7f4a81b84640 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ff494603b0 con 0x55ff49461110 2024-09-13T06:11:47.183 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.175+0000 7f4a81383640 1 -- 172.21.15.194:0/1529138190 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=107b] v35'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4a740f4030 con 0x55ff49461110 2024-09-13T06:11:47.183 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.175+0000 7f4a81383640 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ff494603b0 con 0x7f4a74109020 2024-09-13T06:11:47.183 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.179+0000 7f4a80b82640 1 -- 172.21.15.194:0/1529138190 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a7800e6e0 con 0x7f4a74109020 2024-09-13T06:11:47.183 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.179+0000 7f4a80b82640 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ff494603b0 con 0x7f4a74109020 2024-09-13T06:11:47.183 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.179+0000 7f4a80b82640 1 -- 172.21.15.194:0/1529138190 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a7800e6e0 con 0x7f4a74109020 2024-09-13T06:11:47.183 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.179+0000 7f4a80b82640 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ff494603b0 con 0x55ff49461110 2024-09-13T06:11:47.184 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.179+0000 7f4a81383640 1 -- 172.21.15.194:0/1529138190 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a740f4030 con 0x55ff49461110 2024-09-13T06:11:47.184 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.179+0000 7f4a81383640 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ff494603b0 con 0x7f4a78037040 2024-09-13T06:11:47.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.179+0000 7f4a81b84640 1 -- 172.21.15.194:0/1529138190 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a7c0083f0 con 0x7f4a78037040 2024-09-13T06:11:47.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.179+0000 7f4a81b84640 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ff494603b0 con 0x55ff4945c750 2024-09-13T06:11:47.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.179+0000 7f4a81b84640 1 -- 172.21.15.194:0/1529138190 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v35'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4a7c0083f0 con 0x55ff4945c750 2024-09-13T06:11:47.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.179+0000 7f4a81b84640 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ff494603b0 con 0x7f4a74109020 2024-09-13T06:11:47.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.179+0000 7f4a80b82640 1 -- 172.21.15.194:0/1529138190 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a7800e6e0 con 0x7f4a74109020 2024-09-13T06:11:47.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.179+0000 7f4a83873980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:11:47.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.179+0000 7f4a83873980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:11:47.188 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.179+0000 7f4a83873980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:11:47.188 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.179+0000 7f4a83873980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:11:47.188 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.179+0000 7f4a83873980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:11:47.188 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.179+0000 7f4a83873980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:11:47.188 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.179+0000 7f4a83873980 20 rados->read ofs=0 len=0 2024-09-13T06:11:47.188 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.179+0000 7f4a83873980 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff494644d0 con 0x55ff4945c750 2024-09-13T06:11:47.188 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.179+0000 7f4a81b84640 1 -- 172.21.15.194:0/1529138190 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4a7c0083f0 con 0x55ff4945c750 2024-09-13T06:11:47.188 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.179+0000 7f4a83873980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:47.188 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.179+0000 7f4a83873980 20 rados->read ofs=0 len=0 2024-09-13T06:11:47.188 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.179+0000 7f4a83873980 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff49464d20 con 0x55ff4945c750 2024-09-13T06:11:47.188 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.179+0000 7f4a81b84640 1 -- 172.21.15.194:0/1529138190 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4a7c0083f0 con 0x55ff4945c750 2024-09-13T06:11:47.188 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.179+0000 7f4a83873980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:11:47.188 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.179+0000 7f4a83873980 20 rados->read ofs=0 len=0 2024-09-13T06:11:47.188 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.179+0000 7f4a83873980 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff49464870 con 0x7f4a74109020 2024-09-13T06:11:47.189 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.179+0000 7f4a80b82640 1 -- 172.21.15.194:0/1529138190 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4a7800e6e0 con 0x7f4a74109020 2024-09-13T06:11:47.189 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.179+0000 7f4a83873980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:11:47.189 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.179+0000 7f4a83873980 20 zone default found 2024-09-13T06:11:47.189 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.179+0000 7f4a83873980 4 Realm: () 2024-09-13T06:11:47.189 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.179+0000 7f4a83873980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:11:47.189 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.179+0000 7f4a83873980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:11:47.189 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.179+0000 7f4a83873980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:11:47.189 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.179+0000 7f4a83873980 20 zonegroup default 2024-09-13T06:11:47.189 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.179+0000 7f4a83873980 20 rados->read ofs=0 len=0 2024-09-13T06:11:47.189 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.179+0000 7f4a83873980 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff494657e0 con 0x7f4a78037040 2024-09-13T06:11:47.189 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.179+0000 7f4a81b84640 1 -- 172.21.15.194:0/1529138190 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4a7c0083f0 con 0x7f4a78037040 2024-09-13T06:11:47.189 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.179+0000 7f4a83873980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:47.189 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.179+0000 7f4a83873980 20 rados->read ofs=0 len=0 2024-09-13T06:11:47.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.179+0000 7f4a83873980 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff494671f0 con 0x55ff49461110 2024-09-13T06:11:47.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.179+0000 7f4a81383640 1 -- 172.21.15.194:0/1529138190 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4a740f4030 con 0x55ff49461110 2024-09-13T06:11:47.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.179+0000 7f4a83873980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:47.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.179+0000 7f4a83873980 20 rados->read ofs=0 len=0 2024-09-13T06:11:47.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.179+0000 7f4a83873980 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff49467690 con 0x55ff49461110 2024-09-13T06:11:47.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.179+0000 7f4a81383640 1 -- 172.21.15.194:0/1529138190 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4a740f4030 con 0x55ff49461110 2024-09-13T06:11:47.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.183+0000 7f4a83873980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:47.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.183+0000 7f4a83873980 20 started sync module instance, tier type = 2024-09-13T06:11:47.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.183+0000 7f4a83873980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:11:47.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.183+0000 7f4a83873980 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff49466660 con 0x7f4a74109020 2024-09-13T06:11:47.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.183+0000 7f4a80b82640 1 -- 172.21.15.194:0/1529138190 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(44 notify.0 [create] v35'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a7800e6e0 con 0x7f4a74109020 2024-09-13T06:11:47.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.183+0000 7f4a83873980 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94554934372944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff494662c0 con 0x7f4a74109020 2024-09-13T06:11:47.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.183+0000 7f4a83873980 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff494685c0 con 0x55ff4945c750 2024-09-13T06:11:47.191 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.183+0000 7f4a80b82640 1 -- 172.21.15.194:0/1529138190 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94554934372944] v35'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a7800e6e0 con 0x7f4a74109020 2024-09-13T06:11:47.191 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.183+0000 7f4a81b84640 1 -- 172.21.15.194:0/1529138190 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v35'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a7c0083f0 con 0x55ff4945c750 2024-09-13T06:11:47.191 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.183+0000 7f4a83873980 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94554934378768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff494689e0 con 0x55ff4945c750 2024-09-13T06:11:47.191 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.183+0000 7f4a83873980 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff49469290 con 0x55ff49461110 2024-09-13T06:11:47.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.187+0000 7f4a81b84640 1 -- 172.21.15.194:0/1529138190 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94554934378768] v35'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a7c0083f0 con 0x55ff4945c750 2024-09-13T06:11:47.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.187+0000 7f4a81383640 1 -- 172.21.15.194:0/1529138190 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v35'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a740f4030 con 0x55ff49461110 2024-09-13T06:11:47.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.187+0000 7f4a83873980 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94554934380128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff49469680 con 0x55ff49461110 2024-09-13T06:11:47.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.187+0000 7f4a83873980 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff4946a040 con 0x7f4a74109020 2024-09-13T06:11:47.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.187+0000 7f4a80b82640 1 -- 172.21.15.194:0/1529138190 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(50 notify.3 [create] v35'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a7800e6e0 con 0x7f4a74109020 2024-09-13T06:11:47.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.187+0000 7f4a83873980 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94554934387760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff4946ad00 con 0x7f4a74109020 2024-09-13T06:11:47.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.187+0000 7f4a83873980 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff4946b6c0 con 0x55ff4945c750 2024-09-13T06:11:47.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.187+0000 7f4a80b82640 1 -- 172.21.15.194:0/1529138190 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94554934387760] v35'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a7800e6e0 con 0x7f4a74109020 2024-09-13T06:11:47.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.191+0000 7f4a81383640 1 -- 172.21.15.194:0/1529138190 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94554934380128] v35'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a740f4030 con 0x55ff49461110 2024-09-13T06:11:47.193 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.191+0000 7f4a81b84640 1 -- 172.21.15.194:0/1529138190 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v35'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a7c0083f0 con 0x55ff4945c750 2024-09-13T06:11:47.193 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.191+0000 7f4a83873980 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94554934391312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff4946ad00 con 0x55ff4945c750 2024-09-13T06:11:47.193 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.191+0000 7f4a83873980 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff4946b630 con 0x7f4a78037040 2024-09-13T06:11:47.194 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.191+0000 7f4a81b84640 1 -- 172.21.15.194:0/1529138190 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94554934391312] v35'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a7c0083f0 con 0x55ff4945c750 2024-09-13T06:11:47.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.191+0000 7f4a81b84640 1 -- 172.21.15.194:0/1529138190 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(54 notify.5 [create] v35'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a7c0083f0 con 0x7f4a78037040 2024-09-13T06:11:47.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.191+0000 7f4a83873980 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94554934388816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff4946ac70 con 0x7f4a78037040 2024-09-13T06:11:47.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.191+0000 7f4a83873980 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff4946c4f0 con 0x7f4a78037040 2024-09-13T06:11:47.197 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.195+0000 7f4a81b84640 1 -- 172.21.15.194:0/1529138190 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(56 notify.6 [create] v35'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a7c0083f0 con 0x7f4a78037040 2024-09-13T06:11:47.197 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.195+0000 7f4a81b84640 1 -- 172.21.15.194:0/1529138190 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94554934388816] v35'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a7c0083f0 con 0x7f4a78037040 2024-09-13T06:11:47.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.195+0000 7f4a83873980 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94554934394944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff4946c910 con 0x7f4a78037040 2024-09-13T06:11:47.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.195+0000 7f4a83873980 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff4946ba60 con 0x7f4a78037040 2024-09-13T06:11:47.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.195+0000 7f4a81b84640 1 -- 172.21.15.194:0/1529138190 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(58 notify.7 [create] v35'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a7c0083f0 con 0x7f4a78037040 2024-09-13T06:11:47.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.195+0000 7f4a83873980 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94554934398624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff4946ba60 con 0x7f4a78037040 2024-09-13T06:11:47.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.195+0000 7f4a83873980 20 add_watcher() i=0 2024-09-13T06:11:47.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.195+0000 7f4a83873980 20 add_watcher() i=1 2024-09-13T06:11:47.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.195+0000 7f4a83873980 20 add_watcher() i=2 2024-09-13T06:11:47.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.195+0000 7f4a83873980 20 add_watcher() i=3 2024-09-13T06:11:47.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.195+0000 7f4a83873980 20 add_watcher() i=4 2024-09-13T06:11:47.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.195+0000 7f4a83873980 20 add_watcher() i=5 2024-09-13T06:11:47.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.195+0000 7f4a81b84640 1 -- 172.21.15.194:0/1529138190 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94554934394944] v35'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a7c0083f0 con 0x7f4a78037040 2024-09-13T06:11:47.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.195+0000 7f4a83873980 20 add_watcher() i=6 2024-09-13T06:11:47.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.199+0000 7f4a81b84640 1 -- 172.21.15.194:0/1529138190 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94554934398624] v35'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a7c0083f0 con 0x7f4a78037040 2024-09-13T06:11:47.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.199+0000 7f4a83873980 20 add_watcher() i=7 2024-09-13T06:11:47.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.199+0000 7f4a83873980 2 all 8 watchers are set, enabling cache 2024-09-13T06:11:47.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.199+0000 7f4a83873980 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff4946c460 con 0x55ff4945c750 2024-09-13T06:11:47.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.199+0000 7f4a81b84640 1 -- 172.21.15.194:0/1529138190 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4a7c0083f0 con 0x55ff4945c750 2024-09-13T06:11:47.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.199+0000 7f4a83873980 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94554934396000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff4946d7d0 con 0x55ff4945c750 2024-09-13T06:11:47.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.199+0000 7f4a81b84640 1 -- 172.21.15.194:0/1529138190 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94554934396000] v35'269 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4a7c0083f0 con 0x55ff4945c750 2024-09-13T06:11:47.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.199+0000 7f4937fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:11:47.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.199+0000 7f4a83873980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:11:47.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.199+0000 7f4a83873980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:11:47.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.199+0000 7f4a83873980 5 note: GC not initialized 2024-09-13T06:11:47.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.199+0000 7f4936fe5640 20 reqs_thread_entry: start 2024-09-13T06:11:47.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.199+0000 7f4a83873980 20 init_complete bucket index max shards: 11 2024-09-13T06:11:47.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.199+0000 7f4a83873980 20 Filter name: none 2024-09-13T06:11:47.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.199+0000 7f4934fe1640 20 reqs_thread_entry: start 2024-09-13T06:11:47.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.199+0000 7f4a83873980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T06:11:47.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.199+0000 7f4a83873980 20 rados->read ofs=0 len=0 2024-09-13T06:11:47.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.199+0000 7f4a83873980 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff49493970 con 0x7f4a78037040 2024-09-13T06:11:47.205 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.203+0000 7f4a81b84640 1 -- 172.21.15.194:0/1529138190 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f4a7c0083f0 con 0x7f4a78037040 2024-09-13T06:11:47.205 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.203+0000 7f4a83873980 20 rados_obj.operate() r=0 bl.length=460 2024-09-13T06:11:47.205 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.203+0000 7f4a83873980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-13T06:11:47.205 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.203+0000 7f4a83873980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T06:11:47.205 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.203+0000 7f4a83873980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:11:47.205 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.203+0000 7f4a83873980 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff49499f70 con 0x7f4a78037040 2024-09-13T06:11:47.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.207+0000 7f4a81b84640 1 -- 172.21.15.194:0/1529138190 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v35'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f4a7c0083f0 con 0x7f4a78037040 2024-09-13T06:11:47.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.207+0000 7f4a83873980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T06:11:47.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.207+0000 7f4a83873980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T06:11:47.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.207+0000 7f4a83873980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T06:11:47.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.207+0000 7f4a83873980 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94554934581728 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff49495660 con 0x55ff4945c750 2024-09-13T06:11:47.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.207+0000 7f4a81b84640 1 -- 172.21.15.194:0/1529138190 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== watch-notify(notify (1) cookie 94554934391312 notify 150323855390 ret 0) ==== 691+0+0 (crc 0 0 0) 0x7f4a7c010040 con 0x55ff4945c750 2024-09-13T06:11:47.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.207+0000 7f4964ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855390 cookie 94554934391312 notifier 4913 bl.length()=649 2024-09-13T06:11:47.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.207+0000 7f4964ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T06:11:47.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.207+0000 7f4964ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T06:11:47.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.207+0000 7f4964ff9640 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f4944003eb0 con 0x55ff4945c750 2024-09-13T06:11:47.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.207+0000 7f4a81b84640 1 -- 172.21.15.194:0/1529138190 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(64 notify.4 [notify cookie 94554934581728 out=8b] v0'0 uv276 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4a7c0083f0 con 0x55ff4945c750 2024-09-13T06:11:47.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.207+0000 7f4a81b84640 1 -- 172.21.15.194:0/1529138190 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a7c0083f0 con 0x55ff4945c750 2024-09-13T06:11:47.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.207+0000 7f4a81b84640 1 -- 172.21.15.194:0/1529138190 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== watch-notify(notify_complete (2) cookie 94554934581728 notify 150323855390 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f4a7c00b820 con 0x55ff4945c750 2024-09-13T06:11:47.210 INFO:teuthology.orchestra.run.smithi194.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T06:11:44.596796Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:11:44.596784Z","tags":[],"group_ids":[]} 2024-09-13T06:11:47.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.207+0000 7f4937fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:11:47.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.207+0000 7f4a83873980 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94554934396000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff49495e20 con 0x55ff4945c750 2024-09-13T06:11:47.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.207+0000 7f4a81b84640 1 -- 172.21.15.194:0/1529138190 <== osd.1 v2:172.21.15.194:6808/3135444559 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94554934396000] v35'270 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4a7c0083f0 con 0x55ff4945c750 2024-09-13T06:11:47.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.207+0000 7f4a83873980 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94554934372944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff49491770 con 0x7f4a74109020 2024-09-13T06:11:47.212 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.211+0000 7f4a80b82640 1 -- 172.21.15.194:0/1529138190 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94554934372944] v35'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a7800e6e0 con 0x7f4a74109020 2024-09-13T06:11:47.212 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.211+0000 7f4a83873980 20 remove_watcher() i=0 2024-09-13T06:11:47.212 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.211+0000 7f4a83873980 2 removed watcher, disabling cache 2024-09-13T06:11:47.212 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.211+0000 7f4a83873980 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94554934378768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff49491770 con 0x55ff4945c750 2024-09-13T06:11:47.214 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.211+0000 7f4a81b84640 1 -- 172.21.15.194:0/1529138190 <== osd.1 v2:172.21.15.194:6808/3135444559 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94554934378768] v35'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a7c0083f0 con 0x55ff4945c750 2024-09-13T06:11:47.214 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.211+0000 7f4a83873980 20 remove_watcher() i=1 2024-09-13T06:11:47.214 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.211+0000 7f4a83873980 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94554934380128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff49491770 con 0x55ff49461110 2024-09-13T06:11:47.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.215+0000 7f4a81383640 1 -- 172.21.15.194:0/1529138190 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94554934380128] v35'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a740f4030 con 0x55ff49461110 2024-09-13T06:11:47.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.215+0000 7f4a83873980 20 remove_watcher() i=2 2024-09-13T06:11:47.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.215+0000 7f4a83873980 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94554934387760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff49468660 con 0x7f4a74109020 2024-09-13T06:11:47.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.215+0000 7f4a80b82640 1 -- 172.21.15.194:0/1529138190 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94554934387760] v35'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a7800e6e0 con 0x7f4a74109020 2024-09-13T06:11:47.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.215+0000 7f4a83873980 20 remove_watcher() i=3 2024-09-13T06:11:47.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.215+0000 7f4a83873980 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94554934391312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff4946a430 con 0x55ff4945c750 2024-09-13T06:11:47.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.215+0000 7f4a81b84640 1 -- 172.21.15.194:0/1529138190 <== osd.1 v2:172.21.15.194:6808/3135444559 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94554934391312] v35'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a7c0083f0 con 0x55ff4945c750 2024-09-13T06:11:47.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.215+0000 7f4a83873980 20 remove_watcher() i=4 2024-09-13T06:11:47.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.215+0000 7f4a83873980 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94554934388816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff4946b210 con 0x7f4a78037040 2024-09-13T06:11:47.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.219+0000 7f4a81b84640 1 -- 172.21.15.194:0/1529138190 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94554934388816] v35'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a7c0083f0 con 0x7f4a78037040 2024-09-13T06:11:47.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.219+0000 7f4a83873980 20 remove_watcher() i=5 2024-09-13T06:11:47.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.219+0000 7f4a83873980 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94554934394944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff4946b210 con 0x7f4a78037040 2024-09-13T06:11:47.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.219+0000 7f4a81b84640 1 -- 172.21.15.194:0/1529138190 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94554934394944] v35'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a7c0083f0 con 0x7f4a78037040 2024-09-13T06:11:47.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.219+0000 7f4a83873980 20 remove_watcher() i=6 2024-09-13T06:11:47.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.219+0000 7f4a83873980 1 -- 172.21.15.194:0/1529138190 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94554934398624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff4946b210 con 0x7f4a78037040 2024-09-13T06:11:47.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.223+0000 7f4a81b84640 1 -- 172.21.15.194:0/1529138190 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94554934398624] v35'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a7c0083f0 con 0x7f4a78037040 2024-09-13T06:11:47.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.223+0000 7f4a83873980 20 remove_watcher() i=7 2024-09-13T06:11:47.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.223+0000 7f4a83873980 1 -- 172.21.15.194:0/1529138190 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f4a78037040 msgr2=0x7f4a78036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:47.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.223+0000 7f4a83873980 1 --2- 172.21.15.194:0/1529138190 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f4a78037040 0x7f4a78036410 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:47.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.223+0000 7f4a83873980 1 -- 172.21.15.194:0/1529138190 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ff4945c750 msgr2=0x55ff4945ec10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:47.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.223+0000 7f4a83873980 1 --2- 172.21.15.194:0/1529138190 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ff4945c750 0x55ff4945ec10 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:47.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.223+0000 7f4a83873980 1 -- 172.21.15.194:0/1529138190 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f4a74109020 msgr2=0x7f4a74105210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:47.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.223+0000 7f4a83873980 1 --2- 172.21.15.194:0/1529138190 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f4a74109020 0x7f4a74105210 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:47.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.223+0000 7f4a83873980 1 -- 172.21.15.194:0/1529138190 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ff49461110 msgr2=0x55ff49463500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:47.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.223+0000 7f4a83873980 1 --2- 172.21.15.194:0/1529138190 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ff49461110 0x55ff49463500 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:47.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.223+0000 7f4a83873980 1 -- 172.21.15.194:0/1529138190 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f494c034650 msgr2=0x7f494c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:47.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.223+0000 7f4a83873980 1 --2- 172.21.15.194:0/1529138190 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f494c034650 0x7f494c036b10 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x55ff49430500 tx=0x7f4a78010000 comp rx=0 tx=0).stop 2024-09-13T06:11:47.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.223+0000 7f4a83873980 1 -- 172.21.15.194:0/1529138190 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff4944a430 msgr2=0x55ff49451620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:47.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.223+0000 7f4a83873980 1 --2- 172.21.15.194:0/1529138190 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff4944a430 0x55ff49451620 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f4a740c9fd0 tx=0x7f4a740d9ed0 comp rx=0 tx=0).stop 2024-09-13T06:11:47.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.223+0000 7f4a81b84640 1 -- 172.21.15.194:0/1529138190 reap_dead start 2024-09-13T06:11:47.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.223+0000 7f4a83873980 1 -- 172.21.15.194:0/1529138190 shutdown_connections 2024-09-13T06:11:47.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.223+0000 7f4a83873980 1 -- 172.21.15.194:0/1529138190 >> 172.21.15.194:0/1529138190 conn(0x55ff49446810 msgr2=0x55ff494448e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:47.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.223+0000 7f4a83873980 1 -- 172.21.15.194:0/1529138190 shutdown_connections 2024-09-13T06:11:47.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.223+0000 7f4a83873980 1 -- 172.21.15.194:0/1529138190 wait complete. 2024-09-13T06:11:47.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.223+0000 7f4a83873980 1 -- 172.21.15.194:0/1338751124 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4958034650 msgr2=0x7f4958036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:47.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.223+0000 7f4a83873980 1 --2- 172.21.15.194:0/1338751124 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4958034650 0x7f4958036b10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f4a7800bfe0 tx=0x7f4a7800f000 comp rx=0 tx=0).stop 2024-09-13T06:11:47.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.223+0000 7f4a83873980 1 -- 172.21.15.194:0/1338751124 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff4943db90 msgr2=0x55ff4943dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:47.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.223+0000 7f4a83873980 1 --2- 172.21.15.194:0/1338751124 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff4943db90 0x55ff4943dfb0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f4a740e4010 tx=0x7f4a740be590 comp rx=0 tx=0).stop 2024-09-13T06:11:47.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.223+0000 7f4a83873980 1 -- 172.21.15.194:0/1338751124 shutdown_connections 2024-09-13T06:11:47.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.223+0000 7f4a83873980 1 --2- 172.21.15.194:0/1338751124 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4958034650 0x7f4958036b10 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:47.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.223+0000 7f4a83873980 1 --2- 172.21.15.194:0/1338751124 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff4943db90 0x55ff4943dfb0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:47.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.223+0000 7f4a83873980 1 -- 172.21.15.194:0/1338751124 >> 172.21.15.194:0/1338751124 conn(0x55ff49432ce0 msgr2=0x55ff49435760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:47.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.223+0000 7f4a83873980 1 -- 172.21.15.194:0/1338751124 shutdown_connections 2024-09-13T06:11:47.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.223+0000 7f4a83873980 1 -- 172.21.15.194:0/1338751124 wait complete. 2024-09-13T06:11:47.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.223+0000 7f4a83873980 1 -- 172.21.15.194:0/1950759742 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ff4932e880 msgr2=0x55ff49426c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:47.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.223+0000 7f4a83873980 1 --2- 172.21.15.194:0/1950759742 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ff4932e880 0x55ff49426c90 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:47.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.223+0000 7f4a83873980 1 -- 172.21.15.194:0/1950759742 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55ff4942d5c0 msgr2=0x55ff4942f9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:47.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.223+0000 7f4a83873980 1 --2- 172.21.15.194:0/1950759742 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55ff4942d5c0 0x55ff4942f9b0 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:47.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.223+0000 7f4a83873980 1 -- 172.21.15.194:0/1950759742 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ff49429680 msgr2=0x55ff4942ba70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:47.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.223+0000 7f4a83873980 1 --2- 172.21.15.194:0/1950759742 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ff49429680 0x55ff4942ba70 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:47.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.223+0000 7f4a83873980 1 -- 172.21.15.194:0/1950759742 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4968034650 msgr2=0x7f4968036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:47.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.223+0000 7f4a83873980 1 --2- 172.21.15.194:0/1950759742 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f4968034650 0x7f4968036b10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f4a78001dc0 tx=0x7f4a78001360 comp rx=0 tx=0).stop 2024-09-13T06:11:47.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.223+0000 7f4a83873980 1 -- 172.21.15.194:0/1950759742 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff4929fb10 msgr2=0x55ff4941fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:47.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.223+0000 7f4a83873980 1 --2- 172.21.15.194:0/1950759742 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff4929fb10 0x55ff4941fca0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f4a7401b870 tx=0x7f4a74019810 comp rx=0 tx=0).stop 2024-09-13T06:11:47.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.223+0000 7f4a81b84640 1 -- 172.21.15.194:0/1950759742 reap_dead start 2024-09-13T06:11:47.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.223+0000 7f4a83873980 1 -- 172.21.15.194:0/1950759742 shutdown_connections 2024-09-13T06:11:47.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.223+0000 7f4a83873980 1 -- 172.21.15.194:0/1950759742 >> 172.21.15.194:0/1950759742 conn(0x55ff49326070 msgr2=0x55ff4932a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:47.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.223+0000 7f4a83873980 1 -- 172.21.15.194:0/1950759742 shutdown_connections 2024-09-13T06:11:47.231 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.223+0000 7f4a83873980 1 -- 172.21.15.194:0/1950759742 wait complete. 2024-09-13T06:11:47.236 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T06:11:44.596796Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:11:44.596784Z', 'tags': [], 'group_ids': []} 2024-09-13T06:11:47.236 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T06:11:44.596796Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:11:44.596784Z', 'tags': [], 'group_ids': []} 2024-09-13T06:11:47.236 ERROR:root:0 2024-09-13T06:11:47.237 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-13T06:11:47.237 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-13T06:11:47.237 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-13T06:11:47.316 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:11:47.316 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:11:47.318 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.315+0000 7f7d5c3a6980 1 Processor -- start 2024-09-13T06:11:47.318 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.315+0000 7f7d5c3a6980 1 -- start start 2024-09-13T06:11:47.318 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.315+0000 7f7d5c3a6980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x555d02f64900 0x555d02f66cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:47.318 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.315+0000 7f7d5c3a6980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555d02de9ae0 con 0x555d02f60580 2024-09-13T06:11:47.318 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.315+0000 7f7d5c3a6980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x555d02e0de30 con 0x555d02f64900 2024-09-13T06:11:47.318 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.315+0000 7f7d596b5640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x555d02f64900 0x555d02f66cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:47.318 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.315+0000 7f7d59eb6640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x555d02f60580 0x555d02f60960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:58480/0 (socket says 172.21.15.194:58480) 2024-09-13T06:11:47.318 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.315+0000 7f7d596b5640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x555d02f64900 0x555d02f66cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45648/0 (socket says 172.21.15.194:45648) 2024-09-13T06:11:47.318 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.315+0000 7f7d59eb6640 1 -- 172.21.15.194:0/3063868514 learned_addr learned my addr 172.21.15.194:0/3063868514 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-09-13T06:11:47.319 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.315+0000 7f7d596b5640 1 -- 172.21.15.194:0/3063868514 >> v1:172.21.15.120:6789/0 conn(0x555d02f60580 legacy=0x555d02f60960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:47.319 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.315+0000 7f7d596b5640 1 -- 172.21.15.194:0/3063868514 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d02f68240 con 0x555d02f64900 2024-09-13T06:11:47.321 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.319+0000 7f7d596b5640 1 --2- 172.21.15.194:0/3063868514 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555d02f64900 0x555d02f66cf0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f7d4400a420 tx=0x7f7d4401afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=240ab364e4e4f0d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:47.321 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.319+0000 7f7d58eb4640 1 -- 172.21.15.194:0/3063868514 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d440af070 con 0x555d02f64900 2024-09-13T06:11:47.321 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.319+0000 7f7d58eb4640 1 -- 172.21.15.194:0/3063868514 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d440aa530 con 0x555d02f64900 2024-09-13T06:11:47.321 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.319+0000 7f7d58eb4640 1 -- 172.21.15.194:0/3063868514 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d440aa850 con 0x555d02f64900 2024-09-13T06:11:47.322 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.319+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/3063868514 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555d02f64900 msgr2=0x555d02f66cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:47.322 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.319+0000 7f7d5c3a6980 1 --2- 172.21.15.194:0/3063868514 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555d02f64900 0x555d02f66cf0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f7d4400a420 tx=0x7f7d4401afd0 comp rx=0 tx=0).stop 2024-09-13T06:11:47.322 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.319+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/3063868514 shutdown_connections 2024-09-13T06:11:47.322 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.319+0000 7f7d5c3a6980 1 --2- 172.21.15.194:0/3063868514 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555d02f64900 0x555d02f66cf0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:47.322 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.319+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/3063868514 >> 172.21.15.194:0/3063868514 conn(0x555d02f5c0a0 msgr2=0x555d02f5e4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:47.323 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.319+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/3063868514 shutdown_connections 2024-09-13T06:11:47.323 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.319+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/3063868514 wait complete. 2024-09-13T06:11:47.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.331+0000 7f7d5c3a6980 1 Processor -- start 2024-09-13T06:11:47.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.331+0000 7f7d5c3a6980 1 -- start start 2024-09-13T06:11:47.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.331+0000 7f7d5c3a6980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555d02f60580 0x555d02ed5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:47.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.331+0000 7f7d5c3a6980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x555d02e0f200 con 0x555d02f60580 2024-09-13T06:11:47.336 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.335+0000 7f7d59eb6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555d02f60580 0x555d02ed5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:47.336 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.335+0000 7f7d59eb6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555d02f60580 0x555d02ed5c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45660/0 (socket says 172.21.15.194:45660) 2024-09-13T06:11:47.336 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.335+0000 7f7d59eb6640 1 -- 172.21.15.194:0/2470799638 learned_addr learned my addr 172.21.15.194:0/2470799638 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:47.337 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.335+0000 7f7d59eb6640 1 -- 172.21.15.194:0/2470799638 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d02ed61e0 con 0x555d02f60580 2024-09-13T06:11:47.337 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.335+0000 7f7d59eb6640 1 --2- 172.21.15.194:0/2470799638 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555d02f60580 0x555d02ed5c10 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f7d54001d90 tx=0x7f7d54001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac9be6522bef47f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:47.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.335+0000 7f7c47e07640 1 -- 172.21.15.194:0/2470799638 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d54013030 con 0x555d02f60580 2024-09-13T06:11:47.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.335+0000 7f7c47e07640 1 -- 172.21.15.194:0/2470799638 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d5400e690 con 0x555d02f60580 2024-09-13T06:11:47.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.335+0000 7f7c47e07640 1 -- 172.21.15.194:0/2470799638 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d5400ea10 con 0x555d02f60580 2024-09-13T06:11:47.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.335+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/2470799638 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555d02f60580 msgr2=0x555d02ed5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:47.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.335+0000 7f7d5c3a6980 1 --2- 172.21.15.194:0/2470799638 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555d02f60580 0x555d02ed5c10 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f7d54001d90 tx=0x7f7d54001e80 comp rx=0 tx=0).stop 2024-09-13T06:11:47.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.335+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/2470799638 shutdown_connections 2024-09-13T06:11:47.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.335+0000 7f7d5c3a6980 1 --2- 172.21.15.194:0/2470799638 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555d02f60580 0x555d02ed5c10 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:47.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.335+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/2470799638 >> 172.21.15.194:0/2470799638 conn(0x555d02f5c0a0 msgr2=0x555d030475b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:47.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.335+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/2470799638 shutdown_connections 2024-09-13T06:11:47.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.335+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/2470799638 wait complete. 2024-09-13T06:11:47.340 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.335+0000 7f7d5c3a6980 1 Processor -- start 2024-09-13T06:11:47.340 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.335+0000 7f7d5c3a6980 1 -- start start 2024-09-13T06:11:47.340 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.335+0000 7f7d5c3a6980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555d02f60580 0x555d03055fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:47.340 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.335+0000 7f7d5c3a6980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x555d02f67d40 con 0x555d02f60580 2024-09-13T06:11:47.340 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.335+0000 7f7d59eb6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555d02f60580 0x555d03055fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:47.340 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.335+0000 7f7d59eb6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555d02f60580 0x555d03055fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45674/0 (socket says 172.21.15.194:45674) 2024-09-13T06:11:47.340 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.335+0000 7f7d59eb6640 1 -- 172.21.15.194:0/1133742902 learned_addr learned my addr 172.21.15.194:0/1133742902 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:47.341 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.335+0000 7f7d59eb6640 1 -- 172.21.15.194:0/1133742902 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d03056500 con 0x555d02f60580 2024-09-13T06:11:47.341 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.339+0000 7f7d59eb6640 1 --2- 172.21.15.194:0/1133742902 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555d02f60580 0x555d03055fc0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x555d0304ba70 tx=0x7f7d54000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:47.341 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.339+0000 7f7c46604640 1 -- 172.21.15.194:0/1133742902 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d54027070 con 0x555d02f60580 2024-09-13T06:11:47.341 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.339+0000 7f7c46604640 1 -- 172.21.15.194:0/1133742902 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d54019900 con 0x555d02f60580 2024-09-13T06:11:47.341 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.339+0000 7f7c46604640 1 -- 172.21.15.194:0/1133742902 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d54019c20 con 0x555d02f60580 2024-09-13T06:11:47.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.339+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/1133742902 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555d03056790 con 0x555d02f60580 2024-09-13T06:11:47.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.339+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/1133742902 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d03059470 con 0x555d02f60580 2024-09-13T06:11:47.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.339+0000 7f7c46604640 1 -- 172.21.15.194:0/1133742902 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7d5402a070 con 0x555d02f60580 2024-09-13T06:11:47.345 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.339+0000 7f7c46604640 1 --2- 172.21.15.194:0/1133742902 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7c400346a0 0x7f7c40036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:47.345 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.339+0000 7f7c46604640 1 -- 172.21.15.194:0/1133742902 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f7d5401f070 con 0x555d02f60580 2024-09-13T06:11:47.345 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.339+0000 7f7d596b5640 1 --2- 172.21.15.194:0/1133742902 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7c400346a0 0x7f7c40036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:47.345 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.339+0000 7f7d5c3a6980 1 --2- 172.21.15.194:0/1133742902 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x555d02f64900 0x555d0305cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:47.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.339+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/1133742902 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555d0305d570 con 0x555d02f64900 2024-09-13T06:11:47.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.339+0000 7f7d5a6b7640 1 --2- 172.21.15.194:0/1133742902 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x555d02f64900 0x555d0305cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:47.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.339+0000 7f7d596b5640 1 --2- 172.21.15.194:0/1133742902 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7c400346a0 0x7f7c40036b60 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7d440ac000 tx=0x7f7d440a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:47.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.339+0000 7f7d5a6b7640 1 --2- 172.21.15.194:0/1133742902 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x555d02f64900 0x555d0305cf50 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:47.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.339+0000 7f7d5a6b7640 1 -- 172.21.15.194:0/1133742902 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d4c0083f0 con 0x555d02f64900 2024-09-13T06:11:47.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.339+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/1133742902 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555d0305a690 con 0x555d02f64900 2024-09-13T06:11:47.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.339+0000 7f7d5a6b7640 1 -- 172.21.15.194:0/1133742902 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7d4c0083f0 con 0x555d02f64900 2024-09-13T06:11:47.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.339+0000 7f7d5c3a6980 1 --2- 172.21.15.194:0/1133742902 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x555d0305f8c0 0x555d03061cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:47.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.339+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/1133742902 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555d03062380 con 0x555d0305f8c0 2024-09-13T06:11:47.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.339+0000 7f7d59eb6640 1 --2- 172.21.15.194:0/1133742902 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x555d0305f8c0 0x555d03061cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:47.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.339+0000 7f7d59eb6640 1 --2- 172.21.15.194:0/1133742902 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x555d0305f8c0 0x555d03061cb0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:47.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.343+0000 7f7d59eb6640 1 -- 172.21.15.194:0/1133742902 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7d54029030 con 0x555d0305f8c0 2024-09-13T06:11:47.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.343+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/1133742902 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555d0305e760 con 0x555d02f64900 2024-09-13T06:11:47.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.343+0000 7f7d5a6b7640 1 -- 172.21.15.194:0/1133742902 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7d4c0083f0 con 0x555d02f64900 2024-09-13T06:11:47.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.343+0000 7f7d5c3a6980 1 --2- 172.21.15.194:0/1133742902 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x555d030637c0 0x555d03065bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:47.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.343+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/1133742902 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555d03066340 con 0x555d030637c0 2024-09-13T06:11:47.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.343+0000 7f7d596b5640 1 --2- 172.21.15.194:0/1133742902 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x555d030637c0 0x555d03065bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:47.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.343+0000 7f7d596b5640 1 --2- 172.21.15.194:0/1133742902 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x555d030637c0 0x555d03065bb0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:47.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.343+0000 7f7d596b5640 1 -- 172.21.15.194:0/1133742902 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7d440b2070 con 0x555d030637c0 2024-09-13T06:11:47.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.343+0000 7f7d5c3a6980 1 Processor -- start 2024-09-13T06:11:47.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.343+0000 7f7d5c3a6980 1 -- start start 2024-09-13T06:11:47.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.343+0000 7f7d5c3a6980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555d03073dd0 0x555d030741f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:47.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.343+0000 7f7d5c3a6980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x555d02e68800 con 0x555d03073dd0 2024-09-13T06:11:47.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.343+0000 7f7d59eb6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555d03073dd0 0x555d030741f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:47.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.343+0000 7f7d59eb6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555d03073dd0 0x555d030741f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45690/0 (socket says 172.21.15.194:45690) 2024-09-13T06:11:47.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.343+0000 7f7d59eb6640 1 -- 172.21.15.194:0/3093199879 learned_addr learned my addr 172.21.15.194:0/3093199879 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:47.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.343+0000 7f7d59eb6640 1 -- 172.21.15.194:0/3093199879 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d03074730 con 0x555d03073dd0 2024-09-13T06:11:47.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.343+0000 7f7d59eb6640 1 --2- 172.21.15.194:0/3093199879 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555d03073dd0 0x555d030741f0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f7d54048430 tx=0x7f7d54016e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:47.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.343+0000 7f7c3f7fe640 1 -- 172.21.15.194:0/3093199879 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d5402a670 con 0x555d03073dd0 2024-09-13T06:11:47.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.343+0000 7f7c3f7fe640 1 -- 172.21.15.194:0/3093199879 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d5402a810 con 0x555d03073dd0 2024-09-13T06:11:47.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.343+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/3093199879 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555d030749c0 con 0x555d03073dd0 2024-09-13T06:11:47.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.343+0000 7f7c3f7fe640 1 -- 172.21.15.194:0/3093199879 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d5402ab30 con 0x555d03073dd0 2024-09-13T06:11:47.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.343+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/3093199879 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d03077640 con 0x555d03073dd0 2024-09-13T06:11:47.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.347+0000 7f7c3f7fe640 1 -- 172.21.15.194:0/3093199879 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7d54036040 con 0x555d03073dd0 2024-09-13T06:11:47.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.347+0000 7f7c3f7fe640 1 --2- 172.21.15.194:0/3093199879 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7c34034650 0x7f7c34036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:47.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.347+0000 7f7c3f7fe640 1 -- 172.21.15.194:0/3093199879 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f7d54044040 con 0x555d03073dd0 2024-09-13T06:11:47.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.347+0000 7f7d596b5640 1 --2- 172.21.15.194:0/3093199879 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7c34034650 0x7f7c34036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:47.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.347+0000 7f7d5c3a6980 1 Processor -- start 2024-09-13T06:11:47.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.347+0000 7f7d5c3a6980 1 -- start start 2024-09-13T06:11:47.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.347+0000 7f7d596b5640 1 --2- 172.21.15.194:0/3093199879 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7c34034650 0x7f7c34036b10 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f7d44017be0 tx=0x7f7d44005d90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:47.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.347+0000 7f7d5c3a6980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555d030807b0 0x555d03080b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:47.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.347+0000 7f7d5c3a6980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x555d02ed6560 con 0x555d030807b0 2024-09-13T06:11:47.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.347+0000 7f7d59eb6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555d030807b0 0x555d03080b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:47.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.347+0000 7f7d59eb6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555d030807b0 0x555d03080b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45700/0 (socket says 172.21.15.194:45700) 2024-09-13T06:11:47.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.347+0000 7f7d59eb6640 1 -- 172.21.15.194:0/4120198274 learned_addr learned my addr 172.21.15.194:0/4120198274 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:47.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.347+0000 7f7d59eb6640 1 -- 172.21.15.194:0/4120198274 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d03081160 con 0x555d030807b0 2024-09-13T06:11:47.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.347+0000 7f7d59eb6640 1 --2- 172.21.15.194:0/4120198274 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555d030807b0 0x555d03080b90 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f7d5402eff0 tx=0x7f7d540224d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=710f8db2a4030950 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:47.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.347+0000 7f7c3d7fa640 1 -- 172.21.15.194:0/4120198274 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d54021c60 con 0x555d030807b0 2024-09-13T06:11:47.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.347+0000 7f7c3d7fa640 1 -- 172.21.15.194:0/4120198274 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d54060070 con 0x555d030807b0 2024-09-13T06:11:47.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.347+0000 7f7c3d7fa640 1 -- 172.21.15.194:0/4120198274 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d5402b500 con 0x555d030807b0 2024-09-13T06:11:47.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.347+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/4120198274 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555d030807b0 msgr2=0x555d03080b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:47.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.347+0000 7f7d5c3a6980 1 --2- 172.21.15.194:0/4120198274 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555d030807b0 0x555d03080b90 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f7d5402eff0 tx=0x7f7d540224d0 comp rx=0 tx=0).stop 2024-09-13T06:11:47.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.347+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/4120198274 shutdown_connections 2024-09-13T06:11:47.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.347+0000 7f7d5c3a6980 1 --2- 172.21.15.194:0/4120198274 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555d030807b0 0x555d03080b90 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:47.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.347+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/4120198274 >> 172.21.15.194:0/4120198274 conn(0x555d0307cae0 msgr2=0x555d0307abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:47.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.347+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/4120198274 shutdown_connections 2024-09-13T06:11:47.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.347+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/4120198274 wait complete. 2024-09-13T06:11:47.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.347+0000 7f7d5c3a6980 1 Processor -- start 2024-09-13T06:11:47.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.347+0000 7f7d5c3a6980 1 -- start start 2024-09-13T06:11:47.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.347+0000 7f7d5c3a6980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555d030807b0 0x555d03087920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:47.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.347+0000 7f7d5c3a6980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x555d03081670 con 0x555d030807b0 2024-09-13T06:11:47.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.351+0000 7f7d59eb6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555d030807b0 0x555d03087920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:47.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.351+0000 7f7d59eb6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555d030807b0 0x555d03087920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:45706/0 (socket says 172.21.15.194:45706) 2024-09-13T06:11:47.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.351+0000 7f7d59eb6640 1 -- 172.21.15.194:0/4293055954 learned_addr learned my addr 172.21.15.194:0/4293055954 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:11:47.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.351+0000 7f7d59eb6640 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d03087e60 con 0x555d030807b0 2024-09-13T06:11:47.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.351+0000 7f7d59eb6640 1 --2- 172.21.15.194:0/4293055954 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555d030807b0 0x555d03087920 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f7d54047250 tx=0x7f7d54032ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:47.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.351+0000 7f7c2b7fe640 1 -- 172.21.15.194:0/4293055954 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d54019140 con 0x555d030807b0 2024-09-13T06:11:47.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.351+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555d03087e60 con 0x555d030807b0 2024-09-13T06:11:47.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.351+0000 7f7c2b7fe640 1 -- 172.21.15.194:0/4293055954 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d54038440 con 0x555d030807b0 2024-09-13T06:11:47.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.351+0000 7f7c2b7fe640 1 -- 172.21.15.194:0/4293055954 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d54022c00 con 0x555d030807b0 2024-09-13T06:11:47.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.351+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d03088330 con 0x555d030807b0 2024-09-13T06:11:47.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.351+0000 7f7c2b7fe640 1 -- 172.21.15.194:0/4293055954 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7d54016070 con 0x555d030807b0 2024-09-13T06:11:47.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.351+0000 7f7c2b7fe640 1 --2- 172.21.15.194:0/4293055954 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7c24034650 0x7f7c24036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:47.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.351+0000 7f7c2b7fe640 1 -- 172.21.15.194:0/4293055954 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f7d54014070 con 0x555d030807b0 2024-09-13T06:11:47.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.351+0000 7f7d5c3a6980 20 rados->read ofs=0 len=0 2024-09-13T06:11:47.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.351+0000 7f7d596b5640 1 --2- 172.21.15.194:0/4293055954 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7c24034650 0x7f7c24036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:47.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.351+0000 7f7d5c3a6980 1 --2- 172.21.15.194:0/4293055954 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x555d030929e0 0x555d03094e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:47.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.351+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555d030955c0 con 0x555d030929e0 2024-09-13T06:11:47.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.351+0000 7f7d5a6b7640 1 --2- 172.21.15.194:0/4293055954 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x555d030929e0 0x555d03094e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:47.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.351+0000 7f7d596b5640 1 --2- 172.21.15.194:0/4293055954 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7c24034650 0x7f7c24036b10 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f7d440aafd0 tx=0x7f7d440a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:47.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.351+0000 7f7d5a6b7640 1 --2- 172.21.15.194:0/4293055954 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x555d030929e0 0x555d03094e70 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:47.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.351+0000 7f7d5a6b7640 1 -- 172.21.15.194:0/4293055954 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d4c0083f0 con 0x555d030929e0 2024-09-13T06:11:47.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.351+0000 7f7d5c3a6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:47.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.351+0000 7f7d5c3a6980 20 realm 2024-09-13T06:11:47.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.351+0000 7f7d5c3a6980 20 rados->read ofs=0 len=0 2024-09-13T06:11:47.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.351+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555d030959d0 con 0x555d030929e0 2024-09-13T06:11:47.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.351+0000 7f7d5a6b7640 1 -- 172.21.15.194:0/4293055954 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d4c0083f0 con 0x555d030929e0 2024-09-13T06:11:47.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.351+0000 7f7d5c3a6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:47.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.351+0000 7f7d5c3a6980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:11:47.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.351+0000 7f7d5c3a6980 20 rados->read ofs=0 len=0 2024-09-13T06:11:47.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.351+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555d03096270 con 0x555d030929e0 2024-09-13T06:11:47.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.351+0000 7f7d5a6b7640 1 -- 172.21.15.194:0/4293055954 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d4c0083f0 con 0x555d030929e0 2024-09-13T06:11:47.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.351+0000 7f7d5c3a6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:47.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.351+0000 7f7d5c3a6980 20 rados->read ofs=0 len=0 2024-09-13T06:11:47.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.351+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555d03096610 con 0x555d030929e0 2024-09-13T06:11:47.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.355+0000 7f7d5a6b7640 1 -- 172.21.15.194:0/4293055954 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7d4c0083f0 con 0x555d030929e0 2024-09-13T06:11:47.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.355+0000 7f7d5c3a6980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:11:47.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.355+0000 7f7d5c3a6980 20 rados->read ofs=0 len=0 2024-09-13T06:11:47.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.355+0000 7f7d5c3a6980 1 --2- 172.21.15.194:0/4293055954 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x555d03097370 0x555d03099760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:47.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.355+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555d03099db0 con 0x555d03097370 2024-09-13T06:11:47.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.355+0000 7f7d59eb6640 1 --2- 172.21.15.194:0/4293055954 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x555d03097370 0x555d03099760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:47.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.355+0000 7f7d59eb6640 1 --2- 172.21.15.194:0/4293055954 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x555d03097370 0x555d03099760 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:47.365 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.355+0000 7f7d59eb6640 1 -- 172.21.15.194:0/4293055954 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7d54058040 con 0x555d03097370 2024-09-13T06:11:47.365 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.355+0000 7f7d5c3a6980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:11:47.365 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.355+0000 7f7d5c3a6980 20 searching for the correct realm 2024-09-13T06:11:47.365 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.355+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555d0309b610 con 0x555d03097370 2024-09-13T06:11:47.365 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.355+0000 7f7d59eb6640 1 -- 172.21.15.194:0/4293055954 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d54058040 con 0x555d03097370 2024-09-13T06:11:47.365 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.355+0000 7f7d59eb6640 1 --2- 172.21.15.194:0/4293055954 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f7d54067040 0x7f7d540048a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:47.365 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.355+0000 7f7d59eb6640 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555d0309b610 con 0x7f7d54067040 2024-09-13T06:11:47.365 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.355+0000 7f7d596b5640 1 --2- 172.21.15.194:0/4293055954 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f7d54067040 0x7f7d540048a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:47.365 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.355+0000 7f7d596b5640 1 --2- 172.21.15.194:0/4293055954 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f7d54067040 0x7f7d540048a0 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:47.365 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.355+0000 7f7d596b5640 1 -- 172.21.15.194:0/4293055954 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7d440c9070 con 0x7f7d54067040 2024-09-13T06:11:47.365 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.355+0000 7f7d596b5640 1 --2- 172.21.15.194:0/4293055954 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f7d440da040 0x7f7d440da420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:11:47.365 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.355+0000 7f7d596b5640 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555d0309b610 con 0x7f7d440da040 2024-09-13T06:11:47.366 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.355+0000 7f7d5a6b7640 1 --2- 172.21.15.194:0/4293055954 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f7d440da040 0x7f7d440da420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:11:47.366 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.355+0000 7f7d5a6b7640 1 --2- 172.21.15.194:0/4293055954 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f7d440da040 0x7f7d440da420 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:11:47.366 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.355+0000 7f7d5a6b7640 1 -- 172.21.15.194:0/4293055954 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d4c0083f0 con 0x7f7d440da040 2024-09-13T06:11:47.366 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.355+0000 7f7d5a6b7640 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555d03096610 con 0x555d030929e0 2024-09-13T06:11:47.366 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.355+0000 7f7d5a6b7640 1 -- 172.21.15.194:0/4293055954 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d4c0083f0 con 0x555d030929e0 2024-09-13T06:11:47.366 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.355+0000 7f7d5a6b7640 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555d03096610 con 0x555d030929e0 2024-09-13T06:11:47.366 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.355+0000 7f7d5a6b7640 1 -- 172.21.15.194:0/4293055954 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d4c0083f0 con 0x555d030929e0 2024-09-13T06:11:47.366 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.355+0000 7f7d5a6b7640 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555d03096610 con 0x7f7d440da040 2024-09-13T06:11:47.374 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.359+0000 7f7d5a6b7640 1 -- 172.21.15.194:0/4293055954 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d4c0083f0 con 0x7f7d440da040 2024-09-13T06:11:47.374 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.359+0000 7f7d5a6b7640 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555d03096610 con 0x7f7d440da040 2024-09-13T06:11:47.374 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.359+0000 7f7d5a6b7640 1 -- 172.21.15.194:0/4293055954 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d4c0083f0 con 0x7f7d440da040 2024-09-13T06:11:47.374 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.359+0000 7f7d5a6b7640 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555d03096610 con 0x7f7d54067040 2024-09-13T06:11:47.374 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.359+0000 7f7d596b5640 1 -- 172.21.15.194:0/4293055954 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d440c9070 con 0x7f7d54067040 2024-09-13T06:11:47.374 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.359+0000 7f7d596b5640 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555d03096610 con 0x555d03097370 2024-09-13T06:11:47.374 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.359+0000 7f7d59eb6640 1 -- 172.21.15.194:0/4293055954 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d54058040 con 0x555d03097370 2024-09-13T06:11:47.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.359+0000 7f7d59eb6640 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555d03096610 con 0x555d030929e0 2024-09-13T06:11:47.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.359+0000 7f7d5a6b7640 1 -- 172.21.15.194:0/4293055954 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d4c0083f0 con 0x555d030929e0 2024-09-13T06:11:47.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.359+0000 7f7d5a6b7640 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555d03096610 con 0x7f7d440da040 2024-09-13T06:11:47.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.359+0000 7f7d5a6b7640 1 -- 172.21.15.194:0/4293055954 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d4c0083f0 con 0x7f7d440da040 2024-09-13T06:11:47.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.359+0000 7f7d5a6b7640 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555d03096610 con 0x555d030929e0 2024-09-13T06:11:47.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.359+0000 7f7d5a6b7640 1 -- 172.21.15.194:0/4293055954 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d4c0083f0 con 0x555d030929e0 2024-09-13T06:11:47.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.359+0000 7f7d5a6b7640 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555d03096610 con 0x7f7d54067040 2024-09-13T06:11:47.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.359+0000 7f7d596b5640 1 -- 172.21.15.194:0/4293055954 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7d440c9070 con 0x7f7d54067040 2024-09-13T06:11:47.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.359+0000 7f7d596b5640 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555d03096610 con 0x555d03097370 2024-09-13T06:11:47.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.359+0000 7f7d59eb6640 1 -- 172.21.15.194:0/4293055954 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d54058040 con 0x555d03097370 2024-09-13T06:11:47.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.359+0000 7f7d59eb6640 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555d03096610 con 0x555d03097370 2024-09-13T06:11:47.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.359+0000 7f7d59eb6640 1 -- 172.21.15.194:0/4293055954 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d54058040 con 0x555d03097370 2024-09-13T06:11:47.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.359+0000 7f7d59eb6640 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555d03096610 con 0x7f7d440da040 2024-09-13T06:11:47.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.363+0000 7f7d5a6b7640 1 -- 172.21.15.194:0/4293055954 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d4c0083f0 con 0x7f7d440da040 2024-09-13T06:11:47.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.363+0000 7f7d5a6b7640 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555d03096610 con 0x555d03097370 2024-09-13T06:11:47.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.363+0000 7f7d59eb6640 1 -- 172.21.15.194:0/4293055954 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d54058040 con 0x555d03097370 2024-09-13T06:11:47.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.363+0000 7f7d59eb6640 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555d03096610 con 0x555d03097370 2024-09-13T06:11:47.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.363+0000 7f7d59eb6640 1 -- 172.21.15.194:0/4293055954 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d54058040 con 0x555d03097370 2024-09-13T06:11:47.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.363+0000 7f7d59eb6640 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555d03096610 con 0x555d030929e0 2024-09-13T06:11:47.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.363+0000 7f7d5a6b7640 1 -- 172.21.15.194:0/4293055954 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d4c0083f0 con 0x555d030929e0 2024-09-13T06:11:47.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.363+0000 7f7d5a6b7640 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555d03096610 con 0x555d030929e0 2024-09-13T06:11:47.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.363+0000 7f7d5a6b7640 1 -- 172.21.15.194:0/4293055954 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v35'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7d4c0083f0 con 0x555d030929e0 2024-09-13T06:11:47.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.363+0000 7f7d5a6b7640 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555d03096610 con 0x7f7d54067040 2024-09-13T06:11:47.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.363+0000 7f7d596b5640 1 -- 172.21.15.194:0/4293055954 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d440c9070 con 0x7f7d54067040 2024-09-13T06:11:47.377 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.363+0000 7f7d596b5640 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555d03096610 con 0x555d03097370 2024-09-13T06:11:47.377 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.363+0000 7f7d59eb6640 1 -- 172.21.15.194:0/4293055954 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d54058040 con 0x555d03097370 2024-09-13T06:11:47.377 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.363+0000 7f7d59eb6640 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555d03096610 con 0x7f7d54067040 2024-09-13T06:11:47.377 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.363+0000 7f7d596b5640 1 -- 172.21.15.194:0/4293055954 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d440c9070 con 0x7f7d54067040 2024-09-13T06:11:47.377 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.363+0000 7f7d596b5640 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555d03096610 con 0x555d030929e0 2024-09-13T06:11:47.377 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.363+0000 7f7d5a6b7640 1 -- 172.21.15.194:0/4293055954 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d4c0083f0 con 0x555d030929e0 2024-09-13T06:11:47.377 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.363+0000 7f7d5a6b7640 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555d03096610 con 0x7f7d440da040 2024-09-13T06:11:47.377 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.363+0000 7f7d5a6b7640 1 -- 172.21.15.194:0/4293055954 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d4c0083f0 con 0x7f7d440da040 2024-09-13T06:11:47.377 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.363+0000 7f7d5a6b7640 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555d03096610 con 0x555d03097370 2024-09-13T06:11:47.377 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.363+0000 7f7d59eb6640 1 -- 172.21.15.194:0/4293055954 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=107b] v35'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7d54058040 con 0x555d03097370 2024-09-13T06:11:47.377 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.363+0000 7f7d59eb6640 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555d03096610 con 0x7f7d54067040 2024-09-13T06:11:47.377 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.363+0000 7f7d596b5640 1 -- 172.21.15.194:0/4293055954 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d440c9070 con 0x7f7d54067040 2024-09-13T06:11:47.377 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.363+0000 7f7d596b5640 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555d03096610 con 0x7f7d54067040 2024-09-13T06:11:47.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.363+0000 7f7d596b5640 1 -- 172.21.15.194:0/4293055954 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d440c9070 con 0x7f7d54067040 2024-09-13T06:11:47.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.363+0000 7f7d596b5640 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555d03096610 con 0x555d03097370 2024-09-13T06:11:47.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.363+0000 7f7d59eb6640 1 -- 172.21.15.194:0/4293055954 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d54091040 con 0x555d03097370 2024-09-13T06:11:47.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.363+0000 7f7d59eb6640 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555d03096610 con 0x7f7d440da040 2024-09-13T06:11:47.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.367+0000 7f7d5a6b7640 1 -- 172.21.15.194:0/4293055954 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d4c0083f0 con 0x7f7d440da040 2024-09-13T06:11:47.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.367+0000 7f7d5a6b7640 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555d03096610 con 0x555d030929e0 2024-09-13T06:11:47.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.367+0000 7f7d5a6b7640 1 -- 172.21.15.194:0/4293055954 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v35'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7d4c0083f0 con 0x555d030929e0 2024-09-13T06:11:47.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.367+0000 7f7d5a6b7640 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555d03096610 con 0x7f7d54067040 2024-09-13T06:11:47.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.367+0000 7f7d596b5640 1 -- 172.21.15.194:0/4293055954 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d440c9070 con 0x7f7d54067040 2024-09-13T06:11:47.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.367+0000 7f7d5c3a6980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:11:47.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.367+0000 7f7d5c3a6980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:11:47.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.367+0000 7f7d5c3a6980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:11:47.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.367+0000 7f7d5c3a6980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:11:47.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.367+0000 7f7d5c3a6980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:11:47.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.367+0000 7f7d5c3a6980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:11:47.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.367+0000 7f7d5c3a6980 20 rados->read ofs=0 len=0 2024-09-13T06:11:47.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.367+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555d0309a730 con 0x555d030929e0 2024-09-13T06:11:47.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.367+0000 7f7d5a6b7640 1 -- 172.21.15.194:0/4293055954 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d4c0083f0 con 0x555d030929e0 2024-09-13T06:11:47.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.367+0000 7f7d5c3a6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:47.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.367+0000 7f7d5c3a6980 20 rados->read ofs=0 len=0 2024-09-13T06:11:47.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.367+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555d0309af80 con 0x555d030929e0 2024-09-13T06:11:47.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.367+0000 7f7d5a6b7640 1 -- 172.21.15.194:0/4293055954 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7d4c0083f0 con 0x555d030929e0 2024-09-13T06:11:47.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.367+0000 7f7d5c3a6980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:11:47.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.367+0000 7f7d5c3a6980 20 rados->read ofs=0 len=0 2024-09-13T06:11:47.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.367+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555d0309aad0 con 0x7f7d54067040 2024-09-13T06:11:47.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.367+0000 7f7d596b5640 1 -- 172.21.15.194:0/4293055954 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7d440c9070 con 0x7f7d54067040 2024-09-13T06:11:47.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.367+0000 7f7d5c3a6980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:11:47.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.367+0000 7f7d5c3a6980 20 zone default found 2024-09-13T06:11:47.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.367+0000 7f7d5c3a6980 4 Realm: () 2024-09-13T06:11:47.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.367+0000 7f7d5c3a6980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:11:47.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.367+0000 7f7d5c3a6980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:11:47.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.367+0000 7f7d5c3a6980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:11:47.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.367+0000 7f7d5c3a6980 20 zonegroup default 2024-09-13T06:11:47.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.367+0000 7f7d5c3a6980 20 rados->read ofs=0 len=0 2024-09-13T06:11:47.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.367+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555d0309ba40 con 0x7f7d440da040 2024-09-13T06:11:47.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.367+0000 7f7d5a6b7640 1 -- 172.21.15.194:0/4293055954 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7d4c0083f0 con 0x7f7d440da040 2024-09-13T06:11:47.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.367+0000 7f7d5c3a6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:47.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.367+0000 7f7d5c3a6980 20 rados->read ofs=0 len=0 2024-09-13T06:11:47.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.367+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555d0309d450 con 0x555d03097370 2024-09-13T06:11:47.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.367+0000 7f7d59eb6640 1 -- 172.21.15.194:0/4293055954 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7d54091040 con 0x555d03097370 2024-09-13T06:11:47.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.367+0000 7f7d5c3a6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:47.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.367+0000 7f7d5c3a6980 20 rados->read ofs=0 len=0 2024-09-13T06:11:47.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.367+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555d0309d920 con 0x555d03097370 2024-09-13T06:11:47.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.367+0000 7f7d59eb6640 1 -- 172.21.15.194:0/4293055954 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7d54091040 con 0x555d03097370 2024-09-13T06:11:47.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.367+0000 7f7d5c3a6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:11:47.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.367+0000 7f7d5c3a6980 20 started sync module instance, tier type = 2024-09-13T06:11:47.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.367+0000 7f7d5c3a6980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:11:47.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.367+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555d0309c8c0 con 0x7f7d54067040 2024-09-13T06:11:47.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.371+0000 7f7d596b5640 1 -- 172.21.15.194:0/4293055954 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(44 notify.0 [create] v35'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d440c9070 con 0x7f7d54067040 2024-09-13T06:11:47.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.371+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93857971293360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555d0309c520 con 0x7f7d54067040 2024-09-13T06:11:47.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.371+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555d0309e850 con 0x555d030929e0 2024-09-13T06:11:47.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.371+0000 7f7d596b5640 1 -- 172.21.15.194:0/4293055954 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 93857971293360] v35'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d440c9070 con 0x7f7d54067040 2024-09-13T06:11:47.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.371+0000 7f7d5a6b7640 1 -- 172.21.15.194:0/4293055954 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v35'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d4c0083f0 con 0x555d030929e0 2024-09-13T06:11:47.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.371+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93857971299232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555d0309ec70 con 0x555d030929e0 2024-09-13T06:11:47.382 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.371+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555d0309f540 con 0x555d03097370 2024-09-13T06:11:47.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.375+0000 7f7d59eb6640 1 -- 172.21.15.194:0/4293055954 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v35'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d54091040 con 0x555d03097370 2024-09-13T06:11:47.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.375+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93857971301488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555d0309f090 con 0x555d03097370 2024-09-13T06:11:47.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.375+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555d030a04c0 con 0x7f7d54067040 2024-09-13T06:11:47.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.375+0000 7f7d5a6b7640 1 -- 172.21.15.194:0/4293055954 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93857971299232] v35'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d4c0083f0 con 0x555d030929e0 2024-09-13T06:11:47.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.375+0000 7f7d596b5640 1 -- 172.21.15.194:0/4293055954 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(50 notify.3 [create] v35'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d440c9070 con 0x7f7d54067040 2024-09-13T06:11:47.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.375+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93857971306416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555d030a08b0 con 0x7f7d54067040 2024-09-13T06:11:47.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.375+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555d030a1270 con 0x555d030929e0 2024-09-13T06:11:47.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.375+0000 7f7d59eb6640 1 -- 172.21.15.194:0/4293055954 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93857971301488] v35'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d54091040 con 0x555d03097370 2024-09-13T06:11:47.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.375+0000 7f7d596b5640 1 -- 172.21.15.194:0/4293055954 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 93857971306416] v35'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d440c9070 con 0x7f7d54067040 2024-09-13T06:11:47.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.375+0000 7f7d5a6b7640 1 -- 172.21.15.194:0/4293055954 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v35'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d4c0083f0 con 0x555d030929e0 2024-09-13T06:11:47.385 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.375+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93857971304752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555d030a1270 con 0x555d030929e0 2024-09-13T06:11:47.385 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.375+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555d030a1ac0 con 0x7f7d440da040 2024-09-13T06:11:47.385 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.379+0000 7f7d5a6b7640 1 -- 172.21.15.194:0/4293055954 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93857971304752] v35'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d4c0083f0 con 0x555d030929e0 2024-09-13T06:11:47.385 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.379+0000 7f7d5a6b7640 1 -- 172.21.15.194:0/4293055954 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(54 notify.5 [create] v35'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d4c0083f0 con 0x7f7d440da040 2024-09-13T06:11:47.385 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.379+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93857971310288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555d030a1820 con 0x7f7d440da040 2024-09-13T06:11:47.385 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.379+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555d030a2310 con 0x7f7d440da040 2024-09-13T06:11:47.385 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.379+0000 7f7d5a6b7640 1 -- 172.21.15.194:0/4293055954 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(56 notify.6 [create] v35'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d4c0083f0 con 0x7f7d440da040 2024-09-13T06:11:47.385 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.379+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93857971314144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555d030a2780 con 0x7f7d440da040 2024-09-13T06:11:47.385 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.379+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555d030a3240 con 0x7f7d440da040 2024-09-13T06:11:47.385 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.383+0000 7f7d5a6b7640 1 -- 172.21.15.194:0/4293055954 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93857971310288] v35'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d4c0083f0 con 0x7f7d440da040 2024-09-13T06:11:47.386 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.383+0000 7f7d5a6b7640 1 -- 172.21.15.194:0/4293055954 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 93857971314144] v35'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d4c0083f0 con 0x7f7d440da040 2024-09-13T06:11:47.386 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.383+0000 7f7d5a6b7640 1 -- 172.21.15.194:0/4293055954 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(58 notify.7 [create] v35'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d4c0083f0 con 0x7f7d440da040 2024-09-13T06:11:47.386 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.383+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93857971318032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555d030a22d0 con 0x7f7d440da040 2024-09-13T06:11:47.386 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.383+0000 7f7d5c3a6980 20 add_watcher() i=0 2024-09-13T06:11:47.387 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.383+0000 7f7d5c3a6980 20 add_watcher() i=1 2024-09-13T06:11:47.387 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.383+0000 7f7d5c3a6980 20 add_watcher() i=2 2024-09-13T06:11:47.387 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.383+0000 7f7d5c3a6980 20 add_watcher() i=3 2024-09-13T06:11:47.387 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.383+0000 7f7d5c3a6980 20 add_watcher() i=4 2024-09-13T06:11:47.387 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.383+0000 7f7d5c3a6980 20 add_watcher() i=5 2024-09-13T06:11:47.387 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.383+0000 7f7d5c3a6980 20 add_watcher() i=6 2024-09-13T06:11:47.388 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.383+0000 7f7d5a6b7640 1 -- 172.21.15.194:0/4293055954 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 93857971318032] v35'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d4c0083f0 con 0x7f7d440da040 2024-09-13T06:11:47.388 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.383+0000 7f7d5c3a6980 20 add_watcher() i=7 2024-09-13T06:11:47.388 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.383+0000 7f7d5c3a6980 2 all 8 watchers are set, enabling cache 2024-09-13T06:11:47.388 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.383+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555d030a22d0 con 0x555d030929e0 2024-09-13T06:11:47.388 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.383+0000 7f7d5a6b7640 1 -- 172.21.15.194:0/4293055954 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7d4c0083f0 con 0x555d030929e0 2024-09-13T06:11:47.388 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.383+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93857971311344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555d030a22d0 con 0x555d030929e0 2024-09-13T06:11:47.390 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.387+0000 7f7d5a6b7640 1 -- 172.21.15.194:0/4293055954 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93857971311344] v35'271 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7d4c0083f0 con 0x555d030929e0 2024-09-13T06:11:47.390 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.387+0000 7f7c0b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:11:47.390 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.387+0000 7f7d5c3a6980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:11:47.390 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.387+0000 7f7d5c3a6980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:11:47.390 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.387+0000 7f7d5c3a6980 5 note: GC not initialized 2024-09-13T06:11:47.390 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.387+0000 7f7c0a7fc640 20 reqs_thread_entry: start 2024-09-13T06:11:47.390 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.387+0000 7f7d5c3a6980 20 init_complete bucket index max shards: 11 2024-09-13T06:11:47.390 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.387+0000 7f7d5c3a6980 20 Filter name: none 2024-09-13T06:11:47.390 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.387+0000 7f7b7bfff640 20 reqs_thread_entry: start 2024-09-13T06:11:47.391 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.387+0000 7f7d5c3a6980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T06:11:47.391 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.387+0000 7f7d5c3a6980 20 rados->read ofs=0 len=0 2024-09-13T06:11:47.391 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.387+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555d030c97c0 con 0x7f7d440da040 2024-09-13T06:11:47.391 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.387+0000 7f7d5a6b7640 1 -- 172.21.15.194:0/4293055954 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7f7d4c0083f0 con 0x7f7d440da040 2024-09-13T06:11:47.391 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.387+0000 7f7d5c3a6980 20 rados_obj.operate() r=0 bl.length=473 2024-09-13T06:11:47.391 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.387+0000 7f7d5c3a6980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-13T06:11:47.392 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.387+0000 7f7d5c3a6980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T06:11:47.392 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.387+0000 7f7d5c3a6980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T06:11:47.392 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.387+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555d030d00c0 con 0x7f7d440da040 2024-09-13T06:11:47.394 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.391+0000 7f7d5a6b7640 1 -- 172.21.15.194:0/4293055954 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v35'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f7d4c0083f0 con 0x7f7d440da040 2024-09-13T06:11:47.394 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.391+0000 7f7d5c3a6980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T06:11:47.394 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.391+0000 7f7d5c3a6980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T06:11:47.394 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.391+0000 7f7d5c3a6980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T06:11:47.394 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.391+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93857971501872 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555d030cb7d0 con 0x555d030929e0 2024-09-13T06:11:47.394 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.391+0000 7f7d5a6b7640 1 -- 172.21.15.194:0/4293055954 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== watch-notify(notify (1) cookie 93857971304752 notify 150323855391 ret 0) ==== 691+0+0 (crc 0 0 0) 0x7f7d4c010040 con 0x555d030929e0 2024-09-13T06:11:47.394 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.391+0000 7f7c3d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855391 cookie 93857971304752 notifier 4920 bl.length()=649 2024-09-13T06:11:47.394 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.391+0000 7f7c3d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T06:11:47.394 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.391+0000 7f7c3d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T06:11:47.395 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.391+0000 7f7c3d7fa640 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f7c1c003eb0 con 0x555d030929e0 2024-09-13T06:11:47.395 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.391+0000 7f7d5a6b7640 1 -- 172.21.15.194:0/4293055954 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(64 notify.4 [notify cookie 93857971501872 out=8b] v0'0 uv279 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7d4c0083f0 con 0x555d030929e0 2024-09-13T06:11:47.395 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.391+0000 7f7d5a6b7640 1 -- 172.21.15.194:0/4293055954 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d4c0083f0 con 0x555d030929e0 2024-09-13T06:11:47.395 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.391+0000 7f7d5a6b7640 1 -- 172.21.15.194:0/4293055954 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== watch-notify(notify_complete (2) cookie 93857971501872 notify 150323855391 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f7d4c03c760 con 0x555d030929e0 2024-09-13T06:11:47.395 INFO:teuthology.orchestra.run.smithi194.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T06:11:44.596796Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T06:11:44.596784Z","tags":[],"group_ids":[]} 2024-09-13T06:11:47.396 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.391+0000 7f7c0b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:11:47.396 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.391+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93857971311344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555d030cbf90 con 0x555d030929e0 2024-09-13T06:11:47.396 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.395+0000 7f7d5a6b7640 1 -- 172.21.15.194:0/4293055954 <== osd.1 v2:172.21.15.194:6808/3135444559 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93857971311344] v35'272 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7d4c0083f0 con 0x555d030929e0 2024-09-13T06:11:47.396 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.395+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93857971293360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555d030cbf90 con 0x7f7d54067040 2024-09-13T06:11:47.397 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.395+0000 7f7d596b5640 1 -- 172.21.15.194:0/4293055954 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93857971293360] v35'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d440c9070 con 0x7f7d54067040 2024-09-13T06:11:47.397 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.395+0000 7f7d5c3a6980 20 remove_watcher() i=0 2024-09-13T06:11:47.397 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.395+0000 7f7d5c3a6980 2 removed watcher, disabling cache 2024-09-13T06:11:47.397 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.395+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93857971299232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555d030cbf90 con 0x555d030929e0 2024-09-13T06:11:47.399 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.395+0000 7f7d5a6b7640 1 -- 172.21.15.194:0/4293055954 <== osd.1 v2:172.21.15.194:6808/3135444559 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93857971299232] v35'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d4c0083f0 con 0x555d030929e0 2024-09-13T06:11:47.399 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.395+0000 7f7d5c3a6980 20 remove_watcher() i=1 2024-09-13T06:11:47.399 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.395+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93857971301488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555d030cbf90 con 0x555d03097370 2024-09-13T06:11:47.401 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.399+0000 7f7d59eb6640 1 -- 172.21.15.194:0/4293055954 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93857971301488] v35'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d54091040 con 0x555d03097370 2024-09-13T06:11:47.401 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.399+0000 7f7d5c3a6980 20 remove_watcher() i=2 2024-09-13T06:11:47.401 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.399+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93857971306416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555d030cbf90 con 0x7f7d54067040 2024-09-13T06:11:47.402 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.399+0000 7f7d596b5640 1 -- 172.21.15.194:0/4293055954 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93857971306416] v35'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d440c9070 con 0x7f7d54067040 2024-09-13T06:11:47.402 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.399+0000 7f7d5c3a6980 20 remove_watcher() i=3 2024-09-13T06:11:47.402 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.399+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93857971304752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555d030a12f0 con 0x555d030929e0 2024-09-13T06:11:47.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.403+0000 7f7d5a6b7640 1 -- 172.21.15.194:0/4293055954 <== osd.1 v2:172.21.15.194:6808/3135444559 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93857971304752] v35'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d4c0083f0 con 0x555d030929e0 2024-09-13T06:11:47.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.403+0000 7f7d5c3a6980 20 remove_watcher() i=4 2024-09-13T06:11:47.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.403+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93857971310288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555d0309ccb0 con 0x7f7d440da040 2024-09-13T06:11:47.407 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.403+0000 7f7d5a6b7640 1 -- 172.21.15.194:0/4293055954 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93857971310288] v35'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d4c0083f0 con 0x7f7d440da040 2024-09-13T06:11:47.407 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.403+0000 7f7d5c3a6980 20 remove_watcher() i=5 2024-09-13T06:11:47.407 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.403+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93857971314144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555d0309e3a0 con 0x7f7d440da040 2024-09-13T06:11:47.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.407+0000 7f7d5a6b7640 1 -- 172.21.15.194:0/4293055954 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93857971314144] v35'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d4c0083f0 con 0x7f7d440da040 2024-09-13T06:11:47.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.407+0000 7f7d5c3a6980 20 remove_watcher() i=6 2024-09-13T06:11:47.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.407+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/4293055954 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93857971318032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555d0309e3a0 con 0x7f7d440da040 2024-09-13T06:11:47.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.407+0000 7f7d5a6b7640 1 -- 172.21.15.194:0/4293055954 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93857971318032] v35'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d4c0083f0 con 0x7f7d440da040 2024-09-13T06:11:47.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.407+0000 7f7d5c3a6980 20 remove_watcher() i=7 2024-09-13T06:11:47.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.407+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/4293055954 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f7d440da040 msgr2=0x7f7d440da420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:47.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.407+0000 7f7d5c3a6980 1 --2- 172.21.15.194:0/4293055954 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f7d440da040 0x7f7d440da420 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:47.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.407+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/4293055954 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x555d030929e0 msgr2=0x555d03094e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:47.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.407+0000 7f7d5c3a6980 1 --2- 172.21.15.194:0/4293055954 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x555d030929e0 0x555d03094e70 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:47.414 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.407+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/4293055954 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f7d54067040 msgr2=0x7f7d540048a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:47.414 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.407+0000 7f7d5c3a6980 1 --2- 172.21.15.194:0/4293055954 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f7d54067040 0x7f7d540048a0 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:47.414 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.407+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/4293055954 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x555d03097370 msgr2=0x555d03099760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:47.414 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.407+0000 7f7d5c3a6980 1 --2- 172.21.15.194:0/4293055954 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x555d03097370 0x555d03099760 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:47.414 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.407+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/4293055954 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7c24034650 msgr2=0x7f7c24036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:47.414 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.407+0000 7f7d5c3a6980 1 --2- 172.21.15.194:0/4293055954 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7c24034650 0x7f7c24036b10 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f7d440aafd0 tx=0x7f7d440a7000 comp rx=0 tx=0).stop 2024-09-13T06:11:47.414 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.407+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/4293055954 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555d030807b0 msgr2=0x555d03087920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:47.414 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.407+0000 7f7d5c3a6980 1 --2- 172.21.15.194:0/4293055954 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555d030807b0 0x555d03087920 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f7d54047250 tx=0x7f7d54032ea0 comp rx=0 tx=0).stop 2024-09-13T06:11:47.414 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.407+0000 7f7d5a6b7640 1 -- 172.21.15.194:0/4293055954 reap_dead start 2024-09-13T06:11:47.414 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.407+0000 7f7d5a6b7640 1 -- 172.21.15.194:0/4293055954 reap_dead start 2024-09-13T06:11:47.414 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.407+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/4293055954 shutdown_connections 2024-09-13T06:11:47.414 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.407+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/4293055954 >> 172.21.15.194:0/4293055954 conn(0x555d0307cae0 msgr2=0x555d0307abb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:47.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.407+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/4293055954 shutdown_connections 2024-09-13T06:11:47.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.407+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/4293055954 wait complete. 2024-09-13T06:11:47.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.407+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/3093199879 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7c34034650 msgr2=0x7f7c34036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:47.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.407+0000 7f7d5c3a6980 1 --2- 172.21.15.194:0/3093199879 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7c34034650 0x7f7c34036b10 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f7d44017be0 tx=0x7f7d44005d90 comp rx=0 tx=0).stop 2024-09-13T06:11:47.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.407+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/3093199879 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555d03073dd0 msgr2=0x555d030741f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:47.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.407+0000 7f7d5c3a6980 1 --2- 172.21.15.194:0/3093199879 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555d03073dd0 0x555d030741f0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f7d54048430 tx=0x7f7d54016e80 comp rx=0 tx=0).stop 2024-09-13T06:11:47.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.407+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/3093199879 shutdown_connections 2024-09-13T06:11:47.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.407+0000 7f7d5c3a6980 1 --2- 172.21.15.194:0/3093199879 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7c34034650 0x7f7c34036b10 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:47.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.407+0000 7f7d5c3a6980 1 --2- 172.21.15.194:0/3093199879 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555d03073dd0 0x555d030741f0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:47.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.407+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/3093199879 >> 172.21.15.194:0/3093199879 conn(0x555d03068f20 msgr2=0x555d0306b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:47.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.407+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/3093199879 shutdown_connections 2024-09-13T06:11:47.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.411+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/3093199879 wait complete. 2024-09-13T06:11:47.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.411+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/1133742902 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x555d02f64900 msgr2=0x555d0305cf50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:47.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.411+0000 7f7d5c3a6980 1 --2- 172.21.15.194:0/1133742902 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x555d02f64900 0x555d0305cf50 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:47.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.411+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/1133742902 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x555d030637c0 msgr2=0x555d03065bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:47.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.411+0000 7f7d5c3a6980 1 --2- 172.21.15.194:0/1133742902 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x555d030637c0 0x555d03065bb0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:47.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.411+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/1133742902 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x555d0305f8c0 msgr2=0x555d03061cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:47.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.411+0000 7f7d5c3a6980 1 --2- 172.21.15.194:0/1133742902 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x555d0305f8c0 0x555d03061cb0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:11:47.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.411+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/1133742902 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7c400346a0 msgr2=0x7f7c40036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:47.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.411+0000 7f7d5c3a6980 1 --2- 172.21.15.194:0/1133742902 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7c400346a0 0x7f7c40036b60 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7d440ac000 tx=0x7f7d440a5000 comp rx=0 tx=0).stop 2024-09-13T06:11:47.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.411+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/1133742902 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555d02f60580 msgr2=0x555d03055fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:11:47.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.411+0000 7f7d5c3a6980 1 --2- 172.21.15.194:0/1133742902 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555d02f60580 0x555d03055fc0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x555d0304ba70 tx=0x7f7d54000bd0 comp rx=0 tx=0).stop 2024-09-13T06:11:47.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.411+0000 7f7d5a6b7640 1 -- 172.21.15.194:0/1133742902 reap_dead start 2024-09-13T06:11:47.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.411+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/1133742902 shutdown_connections 2024-09-13T06:11:47.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.411+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/1133742902 >> 172.21.15.194:0/1133742902 conn(0x555d02f5c0a0 msgr2=0x555d03046130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:11:47.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.411+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/1133742902 shutdown_connections 2024-09-13T06:11:47.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:11:47.411+0000 7f7d5c3a6980 1 -- 172.21.15.194:0/1133742902 wait complete. 2024-09-13T06:11:47.421 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T06:11:44.596796Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:11:44.596784Z', 'tags': [], 'group_ids': []} 2024-09-13T06:11:47.422 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T06:11:44.596796Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T06:11:44.596784Z', 'tags': [], 'group_ids': []} 2024-09-13T06:11:47.422 ERROR:root:0 2024-09-13T06:11:47.422 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-09-13T06:11:47.437 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T06:11:47.438 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T06:11:47.450 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T06:11:47.450 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-09-13T06:11:47.464 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T06:11:47.464 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T06:11:47.476 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T06:11:47.476 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'create'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'} 2024-09-13T06:11:47.497 INFO:tasks.radosgw_admin_rest: json result: [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}] 2024-09-13T06:11:47.497 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T06:11:47.510 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T06:11:47.511 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ'} 2024-09-13T06:11:47.530 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T06:11:47.530 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T06:11:47.543 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T06:11:47.543 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo1', 'secret-key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'key-type': 'swift'} 2024-09-13T06:11:47.562 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}] 2024-09-13T06:11:47.562 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T06:11:47.574 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T06:11:47.574 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo2', 'secret-key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'key-type': 'swift'} 2024-09-13T06:11:47.594 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}] 2024-09-13T06:11:47.595 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T06:11:47.606 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T06:11:47.606 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'subuser': 'foo:foo1', 'key-type': 'swift'} 2024-09-13T06:11:47.624 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T06:11:47.625 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T06:11:47.638 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T06:11:47.638 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo1'} 2024-09-13T06:11:47.655 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T06:11:47.655 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T06:11:47.668 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T06:11:47.668 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo2', 'key-type': 'swift', '{purge-keys': True} 2024-09-13T06:11:47.689 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T06:11:47.689 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T06:11:47.701 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T06:11:47.701 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-09-13T06:11:47.714 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-13T06:11:47.715 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-09-13T06:11:47.728 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-13T06:11:47.762 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-09-13T06:11:47.775 INFO:tasks.radosgw_admin_rest: json result: ['myfoo'] 2024-09-13T06:11:47.776 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-13T06:11:47.790 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '0faf3484-cad7-4c8f-892b-62107a753816', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.11', 'marker': '52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-13T06:11:47.750638Z', 'creation_time': '2024-09-13T06:11:47.743124Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-13T06:11:47.791 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-09-13T06:11:47.807 INFO:tasks.radosgw_admin_rest: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '0faf3484-cad7-4c8f-892b-62107a753816', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.11', 'marker': '52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-13T06:11:47.750638Z', 'creation_time': '2024-09-13T06:11:47.743124Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}}] 2024-09-13T06:11:47.818 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-13T06:11:47.833 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '0faf3484-cad7-4c8f-892b-62107a753816', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.11', 'marker': '52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-13T06:11:47.750638Z', 'creation_time': '2024-09-13T06:11:47.743124Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-13T06:11:47.833 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'doesnotexist'} 2024-09-13T06:11:47.846 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchBucket', 'Message': '', 'RequestId': 'tx00000d98282ffa8c64d99-0066e3d7a3-4227-default', 'HostId': '4227-default-default'} 2024-09-13T06:11:47.857 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'unlink'] {'uid': 'foo', 'bucket': 'myfoo'} 2024-09-13T06:11:47.879 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T06:11:47.879 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'fud', 'display-name': 'Fud', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'max-buckets': '1'} 2024-09-13T06:11:47.905 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T06:11:47.925 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'fud', 'bucket': 'myfoo', 'bucket-id': '52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.11'} 2024-09-13T06:11:47.954 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T06:11:48.001 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'foo', 'bucket': 'myfoo', 'bucket-id': '52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.11'} 2024-09-13T06:11:48.032 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T06:11:48.032 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'fud'} 2024-09-13T06:11:48.061 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T06:11:48.082 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['object', 'rm'] {'bucket': 'myfoo', 'object': 'four'} 2024-09-13T06:11:48.103 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T06:11:48.103 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-13T06:11:48.119 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '0faf3484-cad7-4c8f-892b-62107a753816', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.11', 'marker': '52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-13T06:11:48.018887Z', 'creation_time': '2024-09-13T06:11:47.743124Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-13T06:12:48.245 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'categories': 'delete_obj'} 2024-09-13T06:12:48.288 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'anonymous', 'categories': []}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'bar', 'categories': []}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'bud', 'categories': []}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}, {'bucket': 'useless-bucket', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'fud', 'categories': []}, {'bucket': 'myfoo7', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'fud', 'categories': []}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'bar', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'bud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}}, {'user': 'fud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}]} 2024-09-13T06:12:48.288 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] None 2024-09-13T06:12:48.326 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'fud', 'categories': [{'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 0, 'ops': 1, 'successful_ops': 0}]}, {'bucket': 'myfoo7', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}, {'user': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 8, 'ops': 2, 'successful_ops': 2}}, {'user': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 16, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10}}, {'user': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 8, 'ops': 2, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 242, 'bytes_received': 8, 'ops': 5, 'successful_ops': 4}}]} 2024-09-13T06:12:48.327 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-09-13T06:12:48.341 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10}}]} 2024-09-13T06:12:48.341 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'create_bucket'} 2024-09-13T06:12:48.356 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'useless-bucket', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}}]} 2024-09-13T06:12:48.356 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'put_obj'} 2024-09-13T06:12:48.370 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}}]} 2024-09-13T06:12:48.370 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_obj'} 2024-09-13T06:12:48.384 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}, {'bucket': 'useless-bucket', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}}]} 2024-09-13T06:12:48.384 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_bucket'} 2024-09-13T06:12:48.398 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': []}, {'bucket': 'useless-bucket', 'time': '2024-09-13T06:00:00.000000Z', 'epoch': 1726207200, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}]} 2024-09-13T06:12:48.399 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'trim'] {'uid': 'foo'} 2024-09-13T06:12:48.417 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T06:12:48.418 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-09-13T06:12:48.431 INFO:tasks.radosgw_admin_rest: json result: {'entries': [], 'summary': []} 2024-09-13T06:12:48.432 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-09-13T06:12:48.455 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T06:12:48.468 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-09-13T06:12:48.492 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T06:12:48.869 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-09-13T06:12:48.883 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx00000c829ac5d2f42c7af-0066e3d7e0-4227-default', 'HostId': '4227-default-default'} 2024-09-13T06:12:49.063 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-09-13T06:12:49.077 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [], 'grant_map': [{'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-09-13T06:12:49.088 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-09-13T06:12:49.101 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [{'group': 1, 'acl': 1}], 'grant_map': [{'id': '', 'grant': {'type': {'type': 2}, 'group': 1, 'permission': {'flags': 1}}}, {'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-09-13T06:12:49.249 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'rm'] {'bucket': 'myfoo', 'purge-objects': True} 2024-09-13T06:12:49.350 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T06:12:49.350 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'add'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-09-13T06:12:49.369 INFO:tasks.radosgw_admin_rest: json result: [{'type': 'usage', 'perm': 'read'}] 2024-09-13T06:12:49.369 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'rm'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-09-13T06:12:49.386 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-13T06:12:49.413 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-09-13T06:12:49.426 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx00000cd1e576dd185f2af-0066e3d7e1-4227-default', 'HostId': '4227-default-default'} 2024-09-13T06:12:49.473 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo', 'purge-data': True} 2024-09-13T06:12:49.557 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T06:12:49.557 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T06:12:49.571 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx00000009c489926538980-0066e3d7e1-4227-default', 'HostId': '4227-default-default'} 2024-09-13T06:12:49.571 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['info', ''] None 2024-09-13T06:12:49.583 INFO:tasks.radosgw_admin_rest: json result: {'info': {'storage_backends': [{'name': 'rados', 'cluster_id': 'b924da04-5ce7-4b88-90c8-d1e25fda89f0'}]}} 2024-09-13T06:12:49.583 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'ratelimit_user', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '1000'} 2024-09-13T06:12:49.614 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'ratelimit_user', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'ratelimit_user', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T06:12:49.614 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-09-13T06:12:49.626 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-13T06:12:49.627 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring'} 2024-09-13T06:12:49.639 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000f4c25b4e34eb5d63-0066e3d7e1-4227-default', 'HostId': '4227-default-default'} 2024-09-13T06:12:49.639 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user'} 2024-09-13T06:12:49.652 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000cd6b7a5f60b3a14d-0066e3d7e1-4227-default', 'HostId': '4227-default-default'} 2024-09-13T06:12:49.676 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-09-13T06:12:49.689 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-13T06:12:49.690 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring'} 2024-09-13T06:12:49.703 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx000009cbf746c47ed9930-0066e3d7e1-4227-default', 'HostId': '4227-default-default'} 2024-09-13T06:12:49.703 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket'} 2024-09-13T06:12:49.715 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000de1383492dd60407-0066e3d7e1-4227-default', 'HostId': '4227-default-default'} 2024-09-13T06:12:49.715 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'global': 'true'} 2024-09-13T06:12:49.729 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'anonymous_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-13T06:12:49.729 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring', 'enabled': 'true'} 2024-09-13T06:12:49.742 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx000002b7f00158fc1b6a0-0066e3d7e1-4227-default', 'HostId': '4227-default-default'} 2024-09-13T06:12:49.742 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user'} 2024-09-13T06:12:49.754 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx0000060709bb9003e59a4-0066e3d7e1-4227-default', 'HostId': '4227-default-default'} 2024-09-13T06:12:49.754 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring', 'enabled': 'true'} 2024-09-13T06:12:49.767 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000ecd7a683508f3196-0066e3d7e1-4227-default', 'HostId': '4227-default-default'} 2024-09-13T06:12:49.767 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'enabled': 'true'} 2024-09-13T06:12:49.779 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx000004746bd06cd2e4715-0066e3d7e1-4227-default', 'HostId': '4227-default-default'} 2024-09-13T06:12:49.779 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user', 'enabled': 'true', 'max-read-bytes': '2'} 2024-09-13T06:12:49.807 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T06:12:49.807 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-09-13T06:12:49.820 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 2, 'max_write_bytes': 0, 'enabled': True}} 2024-09-13T06:12:49.820 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket', 'enabled': 'true', 'max-write-bytes': '2'} 2024-09-13T06:12:49.837 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T06:12:49.838 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-09-13T06:12:49.850 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 2, 'enabled': True}} 2024-09-13T06:12:49.850 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'global': 'true', 'enabled': 'true'} 2024-09-13T06:12:49.868 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T06:12:49.875 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-13T06:12:49.885 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-13T06:12:49.885 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T06:12:49.887 INFO:tasks.rgw.client.0.smithi194.stdout:2024-09-13T06:12:49.882+0000 7fe2a7396640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 29345) UID: 0 2024-09-13T06:12:49.887 INFO:tasks.rgw.client.0.smithi194.stdout:2024-09-13T06:12:49.882+0000 7fe2aabdea40 -1 shutting down 2024-09-13T06:13:18.592 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-09-13T06:13:20.394 INFO:tasks.rgw.client.0:Stopped 2024-09-13T06:13:20.394 DEBUG:teuthology.orchestra.run.smithi194:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-13T06:13:20.401 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f /etc/ceph/vault-root-token 2024-09-13T06:13:20.455 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-13T06:13:20.511 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-13T06:13:20.511 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-13T06:13:20.511 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-13T06:13:20.590 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setuser ceph since I am not root 2024-09-13T06:13:20.591 INFO:teuthology.orchestra.run.smithi194.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T06:13:20.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.590+0000 7fad2ddfc980 1 Processor -- start 2024-09-13T06:13:20.592 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.590+0000 7fad2ddfc980 1 -- start start 2024-09-13T06:13:20.592 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.590+0000 7fad2ddfc980 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55ff42b6aa10 0x55ff42b6ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:13:20.592 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.590+0000 7fad2ddfc980 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ff429eeae0 con 0x55ff42b66690 2024-09-13T06:13:20.592 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.590+0000 7fad2ddfc980 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x55ff42a12e30 con 0x55ff42b6aa10 2024-09-13T06:13:20.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.590+0000 7fad2b10b640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55ff42b6aa10 0x55ff42b6ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:13:20.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.590+0000 7fad2b10b640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x55ff42b6aa10 0x55ff42b6ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:49216/0 (socket says 172.21.15.194:49216) 2024-09-13T06:13:20.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.590+0000 7fad2b10b640 1 -- 172.21.15.194:0/3053813624 learned_addr learned my addr 172.21.15.194:0/3053813624 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:13:20.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.590+0000 7fad2b90c640 1 --1- 172.21.15.194:0/3053813624 >> v1:172.21.15.120:6789/0 conn(0x55ff42b66690 0x55ff42b66a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.194:34958/0 (socket says 172.21.15.194:34958) 2024-09-13T06:13:20.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.590+0000 7fad2b10b640 1 -- 172.21.15.194:0/3053813624 >> v1:172.21.15.120:6789/0 conn(0x55ff42b66690 legacy=0x55ff42b66a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:20.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.590+0000 7fad2b10b640 1 -- 172.21.15.194:0/3053813624 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff42b6e350 con 0x55ff42b6aa10 2024-09-13T06:13:20.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.594+0000 7fad2b10b640 1 --2- 172.21.15.194:0/3053813624 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff42b6aa10 0x55ff42b6ce00 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fad1400a5c0 tx=0x7fad1401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c68c3e8fa890e021 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:13:20.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.594+0000 7fad2a90a640 1 -- 172.21.15.194:0/3053813624 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad140a6070 con 0x55ff42b6aa10 2024-09-13T06:13:20.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.594+0000 7fad2a90a640 1 -- 172.21.15.194:0/3053813624 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad140af070 con 0x55ff42b6aa10 2024-09-13T06:13:20.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.594+0000 7fad2a90a640 1 -- 172.21.15.194:0/3053813624 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad140aa5c0 con 0x55ff42b6aa10 2024-09-13T06:13:20.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.594+0000 7fad2ddfc980 1 -- 172.21.15.194:0/3053813624 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff42b6aa10 msgr2=0x55ff42b6ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:20.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.594+0000 7fad2ddfc980 1 --2- 172.21.15.194:0/3053813624 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff42b6aa10 0x55ff42b6ce00 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fad1400a5c0 tx=0x7fad1401b340 comp rx=0 tx=0).stop 2024-09-13T06:13:20.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.594+0000 7fad2ddfc980 1 -- 172.21.15.194:0/3053813624 shutdown_connections 2024-09-13T06:13:20.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.594+0000 7fad2ddfc980 1 --2- 172.21.15.194:0/3053813624 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff42b6aa10 0x55ff42b6ce00 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:13:20.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.594+0000 7fad2ddfc980 1 -- 172.21.15.194:0/3053813624 >> 172.21.15.194:0/3053813624 conn(0x55ff42b621b0 msgr2=0x55ff42b645d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:13:20.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.594+0000 7fad2ddfc980 1 -- 172.21.15.194:0/3053813624 shutdown_connections 2024-09-13T06:13:20.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.594+0000 7fad2ddfc980 1 -- 172.21.15.194:0/3053813624 wait complete. 2024-09-13T06:13:20.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.610+0000 7fad2ddfc980 1 Processor -- start 2024-09-13T06:13:20.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.610+0000 7fad2ddfc980 1 -- start start 2024-09-13T06:13:20.614 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.610+0000 7fad2ddfc980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff42b66690 0x55ff42c51a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:13:20.614 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.610+0000 7fad2ddfc980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55ff42a14200 con 0x55ff42b66690 2024-09-13T06:13:20.614 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.610+0000 7fad2b90c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff42b66690 0x55ff42c51a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:13:20.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.610+0000 7fad2b90c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff42b66690 0x55ff42c51a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:49222/0 (socket says 172.21.15.194:49222) 2024-09-13T06:13:20.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.610+0000 7fad2b90c640 1 -- 172.21.15.194:0/1519618584 learned_addr learned my addr 172.21.15.194:0/1519618584 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:13:20.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.610+0000 7fad2b90c640 1 -- 172.21.15.194:0/1519618584 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff42c51ff0 con 0x55ff42b66690 2024-09-13T06:13:20.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.610+0000 7fad2b90c640 1 --2- 172.21.15.194:0/1519618584 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff42b66690 0x55ff42c51a20 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fad1c001e50 tx=0x7fad1c001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7773cd8949a88905 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:13:20.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.614+0000 7fac19e0b640 1 -- 172.21.15.194:0/1519618584 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad1c00e5d0 con 0x55ff42b66690 2024-09-13T06:13:20.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.614+0000 7fac19e0b640 1 -- 172.21.15.194:0/1519618584 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad1c00e770 con 0x55ff42b66690 2024-09-13T06:13:20.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.614+0000 7fac19e0b640 1 -- 172.21.15.194:0/1519618584 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad1c00eab0 con 0x55ff42b66690 2024-09-13T06:13:20.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.614+0000 7fad2ddfc980 1 -- 172.21.15.194:0/1519618584 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff42b66690 msgr2=0x55ff42c51a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:20.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.614+0000 7fad2ddfc980 1 --2- 172.21.15.194:0/1519618584 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff42b66690 0x55ff42c51a20 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fad1c001e50 tx=0x7fad1c001e80 comp rx=0 tx=0).stop 2024-09-13T06:13:20.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.614+0000 7fad2ddfc980 1 -- 172.21.15.194:0/1519618584 shutdown_connections 2024-09-13T06:13:20.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.614+0000 7fad2ddfc980 1 --2- 172.21.15.194:0/1519618584 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff42b66690 0x55ff42c51a20 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:13:20.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.614+0000 7fad2ddfc980 1 -- 172.21.15.194:0/1519618584 >> 172.21.15.194:0/1519618584 conn(0x55ff42b621b0 msgr2=0x55ff42c4d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:13:20.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.614+0000 7fad2ddfc980 1 -- 172.21.15.194:0/1519618584 shutdown_connections 2024-09-13T06:13:20.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.614+0000 7fad2ddfc980 1 -- 172.21.15.194:0/1519618584 wait complete. 2024-09-13T06:13:20.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.614+0000 7fad2ddfc980 1 Processor -- start 2024-09-13T06:13:20.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.614+0000 7fad2ddfc980 1 -- start start 2024-09-13T06:13:20.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.614+0000 7fad2ddfc980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff42b6aa10 0x55ff42add4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:13:20.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.614+0000 7fad2ddfc980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55ff42b6de50 con 0x55ff42b6aa10 2024-09-13T06:13:20.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.614+0000 7fad2b90c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff42b6aa10 0x55ff42add4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:13:20.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.614+0000 7fad2b90c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff42b6aa10 0x55ff42add4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:49228/0 (socket says 172.21.15.194:49228) 2024-09-13T06:13:20.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.614+0000 7fad2b90c640 1 -- 172.21.15.194:0/522371604 learned_addr learned my addr 172.21.15.194:0/522371604 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:13:20.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.614+0000 7fad2b90c640 1 -- 172.21.15.194:0/522371604 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff42adda30 con 0x55ff42b6aa10 2024-09-13T06:13:20.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.614+0000 7fad2b90c640 1 --2- 172.21.15.194:0/522371604 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff42b6aa10 0x55ff42add4f0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fad1c004000 tx=0x7fad1c000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:13:20.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.614+0000 7fac13fff640 1 -- 172.21.15.194:0/522371604 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad1c001260 con 0x55ff42b6aa10 2024-09-13T06:13:20.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.614+0000 7fad2ddfc980 1 -- 172.21.15.194:0/522371604 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ff42adbc10 con 0x55ff42b6aa10 2024-09-13T06:13:20.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.614+0000 7fac13fff640 1 -- 172.21.15.194:0/522371604 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad1c00f9a0 con 0x55ff42b6aa10 2024-09-13T06:13:20.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.614+0000 7fac13fff640 1 -- 172.21.15.194:0/522371604 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad1c02c060 con 0x55ff42b6aa10 2024-09-13T06:13:20.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.614+0000 7fad2ddfc980 1 -- 172.21.15.194:0/522371604 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff42adc100 con 0x55ff42b6aa10 2024-09-13T06:13:20.620 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.618+0000 7fac13fff640 1 -- 172.21.15.194:0/522371604 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fad1c017070 con 0x55ff42b6aa10 2024-09-13T06:13:20.620 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.618+0000 7fac13fff640 1 --2- 172.21.15.194:0/522371604 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fac14034650 0x7fac14036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:13:20.620 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.618+0000 7fac13fff640 1 -- 172.21.15.194:0/522371604 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fad1c015020 con 0x55ff42b6aa10 2024-09-13T06:13:20.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.618+0000 7fad2b10b640 1 --2- 172.21.15.194:0/522371604 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fac14034650 0x7fac14036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:13:20.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.618+0000 7fad2ddfc980 1 --2- 172.21.15.194:0/522371604 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ff42c60410 0x55ff42c62800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:13:20.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.618+0000 7fad2ddfc980 1 -- 172.21.15.194:0/522371604 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42c62d40 con 0x55ff42c60410 2024-09-13T06:13:20.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.618+0000 7fad2c10d640 1 --2- 172.21.15.194:0/522371604 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ff42c60410 0x55ff42c62800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:13:20.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.618+0000 7fad2b10b640 1 --2- 172.21.15.194:0/522371604 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fac14034650 0x7fac14036b10 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fad140ae000 tx=0x7fad140a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:13:20.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.618+0000 7fad2c10d640 1 --2- 172.21.15.194:0/522371604 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ff42c60410 0x55ff42c62800 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:13:20.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.618+0000 7fad2c10d640 1 -- 172.21.15.194:0/522371604 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fad2400a4d0 con 0x55ff42c60410 2024-09-13T06:13:20.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.618+0000 7fad2ddfc980 1 -- 172.21.15.194:0/522371604 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42c630e0 con 0x55ff42c60410 2024-09-13T06:13:20.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.618+0000 7fad2c10d640 1 -- 172.21.15.194:0/522371604 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fad2400a4d0 con 0x55ff42c60410 2024-09-13T06:13:20.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.618+0000 7fad2ddfc980 1 --2- 172.21.15.194:0/522371604 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ff42c64ea0 0x55ff42c67290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:13:20.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.618+0000 7fad2ddfc980 1 -- 172.21.15.194:0/522371604 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:3 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42c67960 con 0x55ff42c64ea0 2024-09-13T06:13:20.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.618+0000 7fad2b90c640 1 --2- 172.21.15.194:0/522371604 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ff42c64ea0 0x55ff42c67290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:13:20.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.618+0000 7fad2b90c640 1 --2- 172.21.15.194:0/522371604 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ff42c64ea0 0x55ff42c67290 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:13:20.624 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.618+0000 7fad2b90c640 1 -- 172.21.15.194:0/522371604 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(3 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c64ea0 2024-09-13T06:13:20.624 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.618+0000 7fad2ddfc980 1 -- 172.21.15.194:0/522371604 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42c63d40 con 0x55ff42c60410 2024-09-13T06:13:20.624 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.618+0000 7fad2c10d640 1 -- 172.21.15.194:0/522371604 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fad2400a4d0 con 0x55ff42c60410 2024-09-13T06:13:20.624 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.618+0000 7fad2ddfc980 1 --2- 172.21.15.194:0/522371604 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55ff42c68dc0 0x55ff42c6b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:13:20.624 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.618+0000 7fad2ddfc980 1 -- 172.21.15.194:0/522371604 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:5 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42c6b8f0 con 0x55ff42c68dc0 2024-09-13T06:13:20.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.622+0000 7fad2b10b640 1 --2- 172.21.15.194:0/522371604 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55ff42c68dc0 0x55ff42c6b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:13:20.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.622+0000 7fad2b10b640 1 --2- 172.21.15.194:0/522371604 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55ff42c68dc0 0x55ff42c6b1b0 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:13:20.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.622+0000 7fad2b10b640 1 -- 172.21.15.194:0/522371604 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(5 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fad140aaae0 con 0x55ff42c68dc0 2024-09-13T06:13:20.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.622+0000 7fad2ddfc980 1 Processor -- start 2024-09-13T06:13:20.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.622+0000 7fad2ddfc980 1 -- start start 2024-09-13T06:13:20.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.622+0000 7fad2ddfc980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff42c793c0 0x55ff42c797e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:13:20.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.622+0000 7fad2ddfc980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55ff42a6d800 con 0x55ff42c793c0 2024-09-13T06:13:20.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.622+0000 7fad2b90c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff42c793c0 0x55ff42c797e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:13:20.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.622+0000 7fad2b90c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff42c793c0 0x55ff42c797e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:49230/0 (socket says 172.21.15.194:49230) 2024-09-13T06:13:20.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.622+0000 7fad2b90c640 1 -- 172.21.15.194:0/1507120050 learned_addr learned my addr 172.21.15.194:0/1507120050 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:13:20.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.622+0000 7fad2b90c640 1 -- 172.21.15.194:0/1507120050 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff42c79d20 con 0x55ff42c793c0 2024-09-13T06:13:20.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.622+0000 7fad2b90c640 1 --2- 172.21.15.194:0/1507120050 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff42c793c0 0x55ff42c797e0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fad1c01b7a0 tx=0x7fad1c01bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:13:20.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.622+0000 7fac117fa640 1 -- 172.21.15.194:0/1507120050 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad1c041070 con 0x55ff42c793c0 2024-09-13T06:13:20.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.622+0000 7fad2ddfc980 1 -- 172.21.15.194:0/1507120050 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ff42c79fb0 con 0x55ff42c793c0 2024-09-13T06:13:20.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.622+0000 7fac117fa640 1 -- 172.21.15.194:0/1507120050 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad1c027bf0 con 0x55ff42c793c0 2024-09-13T06:13:20.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.622+0000 7fac117fa640 1 -- 172.21.15.194:0/1507120050 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad1c048e60 con 0x55ff42c793c0 2024-09-13T06:13:20.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.622+0000 7fad2ddfc980 1 -- 172.21.15.194:0/1507120050 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff42c7cc30 con 0x55ff42c793c0 2024-09-13T06:13:20.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.626+0000 7fac117fa640 1 -- 172.21.15.194:0/1507120050 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fad1c03a070 con 0x55ff42c793c0 2024-09-13T06:13:20.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.626+0000 7fac117fa640 1 --2- 172.21.15.194:0/1507120050 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fac04034650 0x7fac04036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:13:20.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.626+0000 7fac117fa640 1 -- 172.21.15.194:0/1507120050 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fad1c010530 con 0x55ff42c793c0 2024-09-13T06:13:20.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.626+0000 7fad2b10b640 1 --2- 172.21.15.194:0/1507120050 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fac04034650 0x7fac04036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:13:20.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.626+0000 7fad2ddfc980 1 Processor -- start 2024-09-13T06:13:20.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.626+0000 7fad2ddfc980 1 -- start start 2024-09-13T06:13:20.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.626+0000 7fad2b10b640 1 --2- 172.21.15.194:0/1507120050 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fac04034650 0x7fac04036b10 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x55ff42adc420 tx=0x7fad14005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:13:20.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.626+0000 7fad2ddfc980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff42c85b30 0x55ff42c85f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:13:20.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.626+0000 7fad2ddfc980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55ff42c52370 con 0x55ff42c85b30 2024-09-13T06:13:20.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.626+0000 7fad2b90c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff42c85b30 0x55ff42c85f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:13:20.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.626+0000 7fad2b90c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff42c85b30 0x55ff42c85f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:49236/0 (socket says 172.21.15.194:49236) 2024-09-13T06:13:20.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.626+0000 7fad2b90c640 1 -- 172.21.15.194:0/3554484976 learned_addr learned my addr 172.21.15.194:0/3554484976 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:13:20.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.626+0000 7fad2b90c640 1 -- 172.21.15.194:0/3554484976 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff42c864e0 con 0x55ff42c85b30 2024-09-13T06:13:20.631 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.626+0000 7fad2b90c640 1 --2- 172.21.15.194:0/3554484976 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff42c85b30 0x55ff42c85f10 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fad1c01afd0 tx=0x7fad1c031ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bea9367333c9a8a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:13:20.631 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.626+0000 7fac0affd640 1 -- 172.21.15.194:0/3554484976 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad1c03cd60 con 0x55ff42c85b30 2024-09-13T06:13:20.631 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.626+0000 7fac0affd640 1 -- 172.21.15.194:0/3554484976 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad1c04a440 con 0x55ff42c85b30 2024-09-13T06:13:20.631 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.626+0000 7fac0affd640 1 -- 172.21.15.194:0/3554484976 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad1c035130 con 0x55ff42c85b30 2024-09-13T06:13:20.631 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.626+0000 7fad2ddfc980 1 -- 172.21.15.194:0/3554484976 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff42c85b30 msgr2=0x55ff42c85f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:20.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.626+0000 7fad2ddfc980 1 --2- 172.21.15.194:0/3554484976 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff42c85b30 0x55ff42c85f10 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fad1c01afd0 tx=0x7fad1c031ac0 comp rx=0 tx=0).stop 2024-09-13T06:13:20.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.626+0000 7fad2ddfc980 1 -- 172.21.15.194:0/3554484976 shutdown_connections 2024-09-13T06:13:20.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.626+0000 7fad2ddfc980 1 --2- 172.21.15.194:0/3554484976 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff42c85b30 0x55ff42c85f10 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:13:20.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.626+0000 7fad2ddfc980 1 -- 172.21.15.194:0/3554484976 >> 172.21.15.194:0/3554484976 conn(0x55ff42c81f10 msgr2=0x55ff42c80010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:13:20.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.626+0000 7fad2ddfc980 1 -- 172.21.15.194:0/3554484976 shutdown_connections 2024-09-13T06:13:20.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.626+0000 7fad2ddfc980 1 -- 172.21.15.194:0/3554484976 wait complete. 2024-09-13T06:13:20.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.626+0000 7fad2ddfc980 1 Processor -- start 2024-09-13T06:13:20.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.626+0000 7fad2ddfc980 1 -- start start 2024-09-13T06:13:20.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.630+0000 7fad2ddfc980 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff42c85b30 0x55ff42c8cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:13:20.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.630+0000 7fad2ddfc980 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55ff42c86980 con 0x55ff42c85b30 2024-09-13T06:13:20.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.630+0000 7fad2b90c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff42c85b30 0x55ff42c8cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:13:20.633 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.630+0000 7fad2b90c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff42c85b30 0x55ff42c8cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:49240/0 (socket says 172.21.15.194:49240) 2024-09-13T06:13:20.633 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.630+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 learned_addr learned my addr 172.21.15.194:0/941026899 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T06:13:20.633 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.630+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff42c8d280 con 0x55ff42c85b30 2024-09-13T06:13:20.633 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.630+0000 7fad2b90c640 1 --2- 172.21.15.194:0/941026899 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff42c85b30 0x55ff42c8cd40 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fad1c0474c0 tx=0x7fad1c010170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:13:20.634 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.630+0000 7fac097fa640 1 -- 172.21.15.194:0/941026899 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad1c029e00 con 0x55ff42c85b30 2024-09-13T06:13:20.634 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.630+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ff42c8d280 con 0x55ff42c85b30 2024-09-13T06:13:20.634 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.630+0000 7fac097fa640 1 -- 172.21.15.194:0/941026899 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad1c0423b0 con 0x55ff42c85b30 2024-09-13T06:13:20.634 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.630+0000 7fac097fa640 1 -- 172.21.15.194:0/941026899 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad1c042710 con 0x55ff42c85b30 2024-09-13T06:13:20.634 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.630+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff42c8d6f0 con 0x55ff42c85b30 2024-09-13T06:13:20.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.630+0000 7fac097fa640 1 -- 172.21.15.194:0/941026899 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fad1c070030 con 0x55ff42c85b30 2024-09-13T06:13:20.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.630+0000 7fac097fa640 1 --2- 172.21.15.194:0/941026899 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fabf4034650 0x7fabf4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:13:20.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.630+0000 7fac097fa640 1 -- 172.21.15.194:0/941026899 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fad1c06e070 con 0x55ff42c85b30 2024-09-13T06:13:20.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.630+0000 7fad2b10b640 1 --2- 172.21.15.194:0/941026899 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fabf4034650 0x7fabf4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:13:20.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.630+0000 7fad2ddfc980 20 rados->read ofs=0 len=0 2024-09-13T06:13:20.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.630+0000 7fad2ddfc980 1 --2- 172.21.15.194:0/941026899 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ff42c97e10 0x55ff42c9a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:13:20.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.630+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42c9aa20 con 0x55ff42c97e10 2024-09-13T06:13:20.636 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.630+0000 7fad2c10d640 1 --2- 172.21.15.194:0/941026899 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ff42c97e10 0x55ff42c9a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:13:20.636 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.634+0000 7fad2b10b640 1 --2- 172.21.15.194:0/941026899 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fabf4034650 0x7fabf4036b10 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fad14000c10 tx=0x7fad140c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:13:20.636 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.634+0000 7fad2c10d640 1 --2- 172.21.15.194:0/941026899 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ff42c97e10 0x55ff42c9a2d0 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:13:20.639 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.634+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fad2400a4d0 con 0x55ff42c97e10 2024-09-13T06:13:20.639 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.634+0000 7fad2ddfc980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:13:20.639 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.634+0000 7fad2ddfc980 20 realm 2024-09-13T06:13:20.639 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.634+0000 7fad2ddfc980 20 rados->read ofs=0 len=0 2024-09-13T06:13:20.639 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.634+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42c9ae30 con 0x55ff42c97e10 2024-09-13T06:13:20.639 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.634+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fad2400a4d0 con 0x55ff42c97e10 2024-09-13T06:13:20.639 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.634+0000 7fad2ddfc980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:13:20.639 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.634+0000 7fad2ddfc980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T06:13:20.639 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.634+0000 7fad2ddfc980 20 rados->read ofs=0 len=0 2024-09-13T06:13:20.639 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.634+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42c9b700 con 0x55ff42c97e10 2024-09-13T06:13:20.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.634+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.1 v2:172.21.15.194:6808/3135444559 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fad2400a4d0 con 0x55ff42c97e10 2024-09-13T06:13:20.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.634+0000 7fad2ddfc980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:13:20.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.634+0000 7fad2ddfc980 20 rados->read ofs=0 len=0 2024-09-13T06:13:20.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.634+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42c9baa0 con 0x55ff42c97e10 2024-09-13T06:13:20.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.634+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.1 v2:172.21.15.194:6808/3135444559 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fad2400a4d0 con 0x55ff42c97e10 2024-09-13T06:13:20.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.634+0000 7fad2ddfc980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:13:20.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.634+0000 7fad2ddfc980 20 rados->read ofs=0 len=0 2024-09-13T06:13:20.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.634+0000 7fad2ddfc980 1 --2- 172.21.15.194:0/941026899 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ff42c9c800 0x55ff42c9ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:13:20.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.634+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:5 5.13 5:c961f17a:::zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42c9f200 con 0x55ff42c9c800 2024-09-13T06:13:20.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.634+0000 7fad2b90c640 1 --2- 172.21.15.194:0/941026899 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ff42c9c800 0x55ff42c9ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:13:20.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.634+0000 7fad2b90c640 1 --2- 172.21.15.194:0/941026899 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ff42c9c800 0x55ff42c9ebf0 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:13:20.640 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.634+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== osd_op_reply(5 zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.634+0000 7fad2ddfc980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T06:13:20.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.634+0000 7fad2ddfc980 20 searching for the correct realm 2024-09-13T06:13:20.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.634+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ff42ca0ad0 con 0x55ff42c9c800 2024-09-13T06:13:20.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.634+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.634+0000 7fad2b90c640 1 --2- 172.21.15.194:0/941026899 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fad1c055040 0x7fad1c053870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:13:20.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.634+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ff42ca0ad0 con 0x7fad1c055040 2024-09-13T06:13:20.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.634+0000 7fad2b10b640 1 --2- 172.21.15.194:0/941026899 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fad1c055040 0x7fad1c053870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:13:20.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.634+0000 7fad2b10b640 1 --2- 172.21.15.194:0/941026899 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fad1c055040 0x7fad1c053870 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:13:20.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.634+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=112b] v26'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fad140aaae0 con 0x7fad1c055040 2024-09-13T06:13:20.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.634+0000 7fad2b10b640 1 --2- 172.21.15.194:0/941026899 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fad140e0040 0x7fad140e0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:13:20.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.634+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ff42ca0ad0 con 0x7fad140e0040 2024-09-13T06:13:20.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.638+0000 7fad2c10d640 1 --2- 172.21.15.194:0/941026899 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fad140e0040 0x7fad140e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:13:20.643 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.638+0000 7fad2c10d640 1 --2- 172.21.15.194:0/941026899 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fad140e0040 0x7fad140e0420 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:13:20.643 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.638+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad2400a4d0 con 0x7fad140e0040 2024-09-13T06:13:20.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.638+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ff42c9baa0 con 0x55ff42c97e10 2024-09-13T06:13:20.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.638+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.1 v2:172.21.15.194:6808/3135444559 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad2400a4d0 con 0x55ff42c97e10 2024-09-13T06:13:20.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.638+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ff42c9baa0 con 0x55ff42c97e10 2024-09-13T06:13:20.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.638+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.1 v2:172.21.15.194:6808/3135444559 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad2400a4d0 con 0x55ff42c97e10 2024-09-13T06:13:20.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.638+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ff42c9baa0 con 0x7fad140e0040 2024-09-13T06:13:20.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.638+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad2400a4d0 con 0x7fad140e0040 2024-09-13T06:13:20.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.638+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ff42c9baa0 con 0x7fad140e0040 2024-09-13T06:13:20.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.638+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.0 v2:172.21.15.120:6800/1923744619 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad2400a4d0 con 0x7fad140e0040 2024-09-13T06:13:20.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.638+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ff42c9baa0 con 0x7fad1c055040 2024-09-13T06:13:20.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.638+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad140aaae0 con 0x7fad1c055040 2024-09-13T06:13:20.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.638+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ff42c9baa0 con 0x55ff42c9c800 2024-09-13T06:13:20.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.638+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.645 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.638+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ff42c9baa0 con 0x55ff42c97e10 2024-09-13T06:13:20.645 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.642+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.1 v2:172.21.15.194:6808/3135444559 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad2400a4d0 con 0x55ff42c97e10 2024-09-13T06:13:20.645 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.642+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ff42c9baa0 con 0x7fad140e0040 2024-09-13T06:13:20.647 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.642+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.0 v2:172.21.15.120:6800/1923744619 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad2400a4d0 con 0x7fad140e0040 2024-09-13T06:13:20.647 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.642+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ff42c9baa0 con 0x55ff42c97e10 2024-09-13T06:13:20.647 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.642+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.1 v2:172.21.15.194:6808/3135444559 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad2400a4d0 con 0x55ff42c97e10 2024-09-13T06:13:20.647 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.642+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ff42c9baa0 con 0x7fad1c055040 2024-09-13T06:13:20.647 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.642+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 <== osd.2 v2:172.21.15.194:6800/815615585 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v26'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fad140aaae0 con 0x7fad1c055040 2024-09-13T06:13:20.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.642+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ff42c9baa0 con 0x55ff42c9c800 2024-09-13T06:13:20.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.642+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.642+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ff42c9baa0 con 0x55ff42c9c800 2024-09-13T06:13:20.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.642+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.642+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ff42c9baa0 con 0x7fad140e0040 2024-09-13T06:13:20.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.642+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.0 v2:172.21.15.120:6800/1923744619 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad2400a4d0 con 0x7fad140e0040 2024-09-13T06:13:20.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.642+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ff42c9baa0 con 0x55ff42c9c800 2024-09-13T06:13:20.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.642+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.642+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ff42c9baa0 con 0x55ff42c9c800 2024-09-13T06:13:20.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.642+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.642+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ff42c9baa0 con 0x55ff42c97e10 2024-09-13T06:13:20.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.642+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.1 v2:172.21.15.194:6808/3135444559 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad2400a4d0 con 0x55ff42c97e10 2024-09-13T06:13:20.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.642+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ff42c9baa0 con 0x55ff42c97e10 2024-09-13T06:13:20.649 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.646+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.1 v2:172.21.15.194:6808/3135444559 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v35'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fad2400a4d0 con 0x55ff42c97e10 2024-09-13T06:13:20.649 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.646+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ff42c9baa0 con 0x7fad1c055040 2024-09-13T06:13:20.649 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.646+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 <== osd.2 v2:172.21.15.194:6800/815615585 4 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad140aaae0 con 0x7fad1c055040 2024-09-13T06:13:20.649 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.646+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ff42c9baa0 con 0x55ff42c9c800 2024-09-13T06:13:20.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.646+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.646+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ff42c9baa0 con 0x7fad1c055040 2024-09-13T06:13:20.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.646+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 <== osd.2 v2:172.21.15.194:6800/815615585 5 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad140aaae0 con 0x7fad1c055040 2024-09-13T06:13:20.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.646+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ff42c9baa0 con 0x55ff42c97e10 2024-09-13T06:13:20.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.646+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.1 v2:172.21.15.194:6808/3135444559 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad2400a4d0 con 0x55ff42c97e10 2024-09-13T06:13:20.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.646+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ff42c9baa0 con 0x7fad140e0040 2024-09-13T06:13:20.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.646+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.0 v2:172.21.15.120:6800/1923744619 6 ==== osd_op_reply(30 [pgnls start_epoch 35 out=82b] v35'1 uv1 ondisk = 1) ==== 144+0+82 (crc 0 0 0) 0x7fad2400a4d0 con 0x7fad140e0040 2024-09-13T06:13:20.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.646+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ff42c9baa0 con 0x55ff42c9c800 2024-09-13T06:13:20.652 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.646+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=107b] v35'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.652 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.646+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ff42c9baa0 con 0x7fad1c055040 2024-09-13T06:13:20.652 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.646+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 <== osd.2 v2:172.21.15.194:6800/815615585 6 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad140aaae0 con 0x7fad1c055040 2024-09-13T06:13:20.652 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.646+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ff42c9baa0 con 0x7fad1c055040 2024-09-13T06:13:20.652 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.646+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 <== osd.2 v2:172.21.15.194:6800/815615585 7 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad140aaae0 con 0x7fad1c055040 2024-09-13T06:13:20.652 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.646+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ff42c9baa0 con 0x55ff42c9c800 2024-09-13T06:13:20.652 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.646+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.652 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.646+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ff42c9baa0 con 0x7fad140e0040 2024-09-13T06:13:20.652 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.646+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.0 v2:172.21.15.120:6800/1923744619 7 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad2400a4d0 con 0x7fad140e0040 2024-09-13T06:13:20.652 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.646+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ff42c9baa0 con 0x55ff42c97e10 2024-09-13T06:13:20.652 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.650+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.1 v2:172.21.15.194:6808/3135444559 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v35'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fad2400a4d0 con 0x55ff42c97e10 2024-09-13T06:13:20.652 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.650+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ff42c9baa0 con 0x7fad1c055040 2024-09-13T06:13:20.655 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.650+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 <== osd.2 v2:172.21.15.194:6800/815615585 8 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad140aaae0 con 0x7fad1c055040 2024-09-13T06:13:20.655 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.650+0000 7fad2ddfc980 20 RGWRados::pool_iterate: got zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 2024-09-13T06:13:20.655 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.650+0000 7fad2ddfc980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T06:13:20.655 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.650+0000 7fad2ddfc980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T06:13:20.655 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.650+0000 7fad2ddfc980 20 RGWRados::pool_iterate: got period_config.default 2024-09-13T06:13:20.655 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.650+0000 7fad2ddfc980 20 RGWRados::pool_iterate: got zone_info.52d5ffc2-b91b-4558-98ea-6defdf5151d8 2024-09-13T06:13:20.655 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.650+0000 7fad2ddfc980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T06:13:20.656 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.650+0000 7fad2ddfc980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T06:13:20.656 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.650+0000 7fad2ddfc980 20 rados->read ofs=0 len=0 2024-09-13T06:13:20.656 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.650+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42c9fbf0 con 0x55ff42c97e10 2024-09-13T06:13:20.656 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.650+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.1 v2:172.21.15.194:6808/3135444559 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fad2400a4d0 con 0x55ff42c97e10 2024-09-13T06:13:20.656 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.650+0000 7fad2ddfc980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:13:20.656 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.650+0000 7fad2ddfc980 20 rados->read ofs=0 len=0 2024-09-13T06:13:20.656 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.650+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42c9f830 con 0x55ff42c97e10 2024-09-13T06:13:20.656 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.650+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.1 v2:172.21.15.194:6808/3135444559 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fad2400a4d0 con 0x55ff42c97e10 2024-09-13T06:13:20.656 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.650+0000 7fad2ddfc980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T06:13:20.656 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.650+0000 7fad2ddfc980 20 rados->read ofs=0 len=0 2024-09-13T06:13:20.656 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.650+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:40 5.10 5:0998a182:::zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42ca0510 con 0x7fad1c055040 2024-09-13T06:13:20.656 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.650+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 <== osd.2 v2:172.21.15.194:6800/815615585 9 ==== osd_op_reply(40 zonegroup_info.0faf3484-cad7-4c8f-892b-62107a753816 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fad140aaae0 con 0x7fad1c055040 2024-09-13T06:13:20.656 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.650+0000 7fad2ddfc980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T06:13:20.656 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.650+0000 7fad2ddfc980 20 zone default found 2024-09-13T06:13:20.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.650+0000 7fad2ddfc980 4 Realm: () 2024-09-13T06:13:20.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.650+0000 7fad2ddfc980 4 ZoneGroup: default (0faf3484-cad7-4c8f-892b-62107a753816) 2024-09-13T06:13:20.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.650+0000 7fad2ddfc980 4 Zone: default (52d5ffc2-b91b-4558-98ea-6defdf5151d8) 2024-09-13T06:13:20.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.650+0000 7fad2ddfc980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T06:13:20.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.650+0000 7fad2ddfc980 20 zonegroup default 2024-09-13T06:13:20.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.650+0000 7fad2ddfc980 20 rados->read ofs=0 len=0 2024-09-13T06:13:20.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.650+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42ca0f00 con 0x7fad140e0040 2024-09-13T06:13:20.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.650+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.0 v2:172.21.15.120:6800/1923744619 8 ==== osd_op_reply(41 period_config.default [read 0~187 out=187b] v0'0 uv1 ondisk = 0) ==== 165+0+187 (crc 0 0 0) 0x7fad2400a4d0 con 0x7fad140e0040 2024-09-13T06:13:20.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.650+0000 7fad2ddfc980 20 rados_obj.operate() r=0 bl.length=187 2024-09-13T06:13:20.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.650+0000 7fad2ddfc980 20 rados->read ofs=0 len=0 2024-09-13T06:13:20.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.650+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42ca0a30 con 0x55ff42c9c800 2024-09-13T06:13:20.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.650+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.650+0000 7fad2ddfc980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:13:20.658 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.650+0000 7fad2ddfc980 20 rados->read ofs=0 len=0 2024-09-13T06:13:20.658 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.650+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42ca2eb0 con 0x55ff42c9c800 2024-09-13T06:13:20.658 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.650+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.658 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.650+0000 7fad2ddfc980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T06:13:20.658 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.650+0000 7fad2ddfc980 20 started sync module instance, tier type = 2024-09-13T06:13:20.658 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.650+0000 7fad2ddfc980 20 started zone id=52d5ffc2-b91b-4558-98ea-6defdf5151d8 (name=default) with tier type = 2024-09-13T06:13:20.658 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.650+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42ca2220 con 0x7fad1c055040 2024-09-13T06:13:20.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.654+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 <== osd.2 v2:172.21.15.194:6800/815615585 10 ==== osd_op_reply(44 notify.0 [create] v35'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad140aaae0 con 0x7fad1c055040 2024-09-13T06:13:20.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.654+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94554825565712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42ca1e80 con 0x7fad1c055040 2024-09-13T06:13:20.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.654+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42ca3cd0 con 0x55ff42c97e10 2024-09-13T06:13:20.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.654+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 <== osd.2 v2:172.21.15.194:6800/815615585 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94554825565712] v35'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad140aaae0 con 0x7fad1c055040 2024-09-13T06:13:20.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.654+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.1 v2:172.21.15.194:6808/3135444559 15 ==== osd_op_reply(46 notify.1 [create] v35'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad2400a4d0 con 0x55ff42c97e10 2024-09-13T06:13:20.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.654+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94554825569040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42ca40c0 con 0x55ff42c97e10 2024-09-13T06:13:20.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.654+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42ca4a80 con 0x55ff42c9c800 2024-09-13T06:13:20.660 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.658+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.1 v2:172.21.15.194:6808/3135444559 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94554825569040] v35'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad2400a4d0 con 0x55ff42c97e10 2024-09-13T06:13:20.661 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.658+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 13 ==== osd_op_reply(48 notify.2 [create] v35'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.661 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.658+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94554825573840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42ca4e70 con 0x55ff42c9c800 2024-09-13T06:13:20.661 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.658+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42ca5830 con 0x7fad1c055040 2024-09-13T06:13:20.662 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.658+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 <== osd.2 v2:172.21.15.194:6800/815615585 12 ==== osd_op_reply(50 notify.3 [create] v35'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad140aaae0 con 0x7fad1c055040 2024-09-13T06:13:20.662 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.658+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94554825579472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42ca64a0 con 0x7fad1c055040 2024-09-13T06:13:20.662 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.658+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42ca6e60 con 0x55ff42c97e10 2024-09-13T06:13:20.663 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.658+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94554825573840] v35'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.663 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.662+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 <== osd.2 v2:172.21.15.194:6800/815615585 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94554825579472] v35'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad140aaae0 con 0x7fad1c055040 2024-09-13T06:13:20.664 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.662+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.1 v2:172.21.15.194:6808/3135444559 17 ==== osd_op_reply(52 notify.4 [create] v35'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad2400a4d0 con 0x55ff42c97e10 2024-09-13T06:13:20.664 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.662+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94554825580528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42ca6410 con 0x55ff42c97e10 2024-09-13T06:13:20.664 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.662+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42ca7310 con 0x7fad140e0040 2024-09-13T06:13:20.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.662+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.1 v2:172.21.15.194:6808/3135444559 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94554825580528] v35'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad2400a4d0 con 0x55ff42c97e10 2024-09-13T06:13:20.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.662+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.0 v2:172.21.15.120:6800/1923744619 9 ==== osd_op_reply(54 notify.5 [create] v35'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad2400a4d0 con 0x7fad140e0040 2024-09-13T06:13:20.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.662+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94554825583024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42ca7280 con 0x7fad140e0040 2024-09-13T06:13:20.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.662+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42ca7b30 con 0x7fad140e0040 2024-09-13T06:13:20.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.666+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.0 v2:172.21.15.120:6800/1923744619 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94554825583024] v35'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad2400a4d0 con 0x7fad140e0040 2024-09-13T06:13:20.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.666+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.0 v2:172.21.15.120:6800/1923744619 11 ==== osd_op_reply(56 notify.6 [create] v35'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad2400a4d0 con 0x7fad140e0040 2024-09-13T06:13:20.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.666+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94554825584080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42ca7c40 con 0x7fad140e0040 2024-09-13T06:13:20.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.666+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42ca8490 con 0x7fad140e0040 2024-09-13T06:13:20.671 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.670+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.0 v2:172.21.15.120:6800/1923744619 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94554825584080] v35'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad2400a4d0 con 0x7fad140e0040 2024-09-13T06:13:20.672 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.670+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.0 v2:172.21.15.120:6800/1923744619 13 ==== osd_op_reply(58 notify.7 [create] v35'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad2400a4d0 con 0x7fad140e0040 2024-09-13T06:13:20.672 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.670+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94554825587776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42ca8510 con 0x7fad140e0040 2024-09-13T06:13:20.672 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.670+0000 7fad2ddfc980 20 add_watcher() i=0 2024-09-13T06:13:20.672 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.670+0000 7fad2ddfc980 20 add_watcher() i=1 2024-09-13T06:13:20.672 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.670+0000 7fad2ddfc980 20 add_watcher() i=2 2024-09-13T06:13:20.672 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.670+0000 7fad2ddfc980 20 add_watcher() i=3 2024-09-13T06:13:20.672 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.670+0000 7fad2ddfc980 20 add_watcher() i=4 2024-09-13T06:13:20.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.670+0000 7fad2ddfc980 20 add_watcher() i=5 2024-09-13T06:13:20.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.670+0000 7fad2ddfc980 20 add_watcher() i=6 2024-09-13T06:13:20.674 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.670+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.0 v2:172.21.15.120:6800/1923744619 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94554825587776] v35'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad2400a4d0 con 0x7fad140e0040 2024-09-13T06:13:20.674 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.670+0000 7fad2ddfc980 20 add_watcher() i=7 2024-09-13T06:13:20.674 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.670+0000 7fad2ddfc980 2 all 8 watchers are set, enabling cache 2024-09-13T06:13:20.674 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.670+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cab7e0 con 0x55ff42c97e10 2024-09-13T06:13:20.674 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.670+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.1 v2:172.21.15.194:6808/3135444559 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fad2400a4d0 con 0x55ff42c97e10 2024-09-13T06:13:20.674 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.670+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94554825589200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42ca8aa0 con 0x55ff42c97e10 2024-09-13T06:13:20.676 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.674+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.1 v2:172.21.15.194:6808/3135444559 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94554825589200] v35'275 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fad2400a4d0 con 0x55ff42c97e10 2024-09-13T06:13:20.676 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.674+0000 7fabe1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:13:20.676 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.674+0000 7fad2ddfc980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T06:13:20.676 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.674+0000 7fad2ddfc980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T06:13:20.676 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.674+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42caaf00 con 0x55ff42c97e10 2024-09-13T06:13:20.678 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.674+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.1 v2:172.21.15.194:6808/3135444559 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v35'38 uv28 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fad2400a4d0 con 0x55ff42c97e10 2024-09-13T06:13:20.678 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.674+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cb48a0 con 0x7fad140e0040 2024-09-13T06:13:20.680 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.678+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.0 v2:172.21.15.120:6800/1923744619 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v35'32 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fad2400a4d0 con 0x7fad140e0040 2024-09-13T06:13:20.680 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.678+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cb4d50 con 0x55ff42c9c800 2024-09-13T06:13:20.681 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.678+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v35'32 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.681 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.678+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cb50f0 con 0x55ff42c97e10 2024-09-13T06:13:20.683 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.678+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.1 v2:172.21.15.194:6808/3135444559 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v35'276 uv164 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fad2400a4d0 con 0x55ff42c97e10 2024-09-13T06:13:20.683 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.678+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cb55a0 con 0x7fad1c055040 2024-09-13T06:13:20.685 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.682+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 <== osd.2 v2:172.21.15.194:6800/815615585 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v35'83 uv53 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fad140aaae0 con 0x7fad1c055040 2024-09-13T06:13:20.685 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.682+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cb2f00 con 0x55ff42c9c800 2024-09-13T06:13:20.686 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.682+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v35'57 uv56 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.686 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.682+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cb2f00 con 0x55ff42c97e10 2024-09-13T06:13:20.688 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.686+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.1 v2:172.21.15.194:6808/3135444559 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v35'34 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fad2400a4d0 con 0x55ff42c97e10 2024-09-13T06:13:20.688 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.686+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cb2f00 con 0x7fad140e0040 2024-09-13T06:13:20.691 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.686+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.0 v2:172.21.15.120:6800/1923744619 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v35'55 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fad2400a4d0 con 0x7fad140e0040 2024-09-13T06:13:20.691 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.686+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cb2f00 con 0x7fad1c055040 2024-09-13T06:13:20.693 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.690+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 <== osd.2 v2:172.21.15.194:6800/815615585 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v35'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fad140aaae0 con 0x7fad1c055040 2024-09-13T06:13:20.693 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.690+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cb6100 con 0x55ff42c9c800 2024-09-13T06:13:20.695 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.694+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v35'38 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.695 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.694+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cb6100 con 0x7fad1c055040 2024-09-13T06:13:20.697 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.694+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 <== osd.2 v2:172.21.15.194:6800/815615585 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v35'84 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fad140aaae0 con 0x7fad1c055040 2024-09-13T06:13:20.697 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.694+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cb6670 con 0x7fad140e0040 2024-09-13T06:13:20.699 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.698+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.0 v2:172.21.15.120:6800/1923744619 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v35'42 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fad2400a4d0 con 0x7fad140e0040 2024-09-13T06:13:20.699 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.698+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cb6670 con 0x7fad1c055040 2024-09-13T06:13:20.701 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.698+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 <== osd.2 v2:172.21.15.194:6800/815615585 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v35'32 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fad140aaae0 con 0x7fad1c055040 2024-09-13T06:13:20.701 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.698+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cb6860 con 0x7fad140e0040 2024-09-13T06:13:20.703 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.702+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.0 v2:172.21.15.120:6800/1923744619 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v35'62 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fad2400a4d0 con 0x7fad140e0040 2024-09-13T06:13:20.703 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.702+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cb6860 con 0x55ff42c97e10 2024-09-13T06:13:20.705 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.702+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.1 v2:172.21.15.194:6808/3135444559 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v35'277 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fad2400a4d0 con 0x55ff42c97e10 2024-09-13T06:13:20.705 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.702+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cb6860 con 0x55ff42c9c800 2024-09-13T06:13:20.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.706+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v35'77 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.706+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cb6860 con 0x7fad1c055040 2024-09-13T06:13:20.709 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.706+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 <== osd.2 v2:172.21.15.194:6800/815615585 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v35'85 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fad140aaae0 con 0x7fad1c055040 2024-09-13T06:13:20.709 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.706+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cb6860 con 0x55ff42c9c800 2024-09-13T06:13:20.710 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.706+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v35'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.706+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cb6860 con 0x55ff42c97e10 2024-09-13T06:13:20.713 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.710+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.1 v2:172.21.15.194:6808/3135444559 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v35'39 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fad2400a4d0 con 0x55ff42c97e10 2024-09-13T06:13:20.713 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.710+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cb6860 con 0x55ff42c97e10 2024-09-13T06:13:20.715 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.710+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.1 v2:172.21.15.194:6808/3135444559 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v35'278 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fad2400a4d0 con 0x55ff42c97e10 2024-09-13T06:13:20.715 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.710+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cb6860 con 0x55ff42c9c800 2024-09-13T06:13:20.717 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.714+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v35'78 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.717 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.714+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cb6860 con 0x7fad1c055040 2024-09-13T06:13:20.719 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.718+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 <== osd.2 v2:172.21.15.194:6800/815615585 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v35'41 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fad140aaae0 con 0x7fad1c055040 2024-09-13T06:13:20.719 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.718+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cb6860 con 0x55ff42c9c800 2024-09-13T06:13:20.721 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.718+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v35'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.721 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.718+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cb6940 con 0x55ff42c9c800 2024-09-13T06:13:20.723 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.718+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v35'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.723 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.718+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cb6940 con 0x55ff42c9c800 2024-09-13T06:13:20.724 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.722+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v35'27 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.725 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.722+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cb6940 con 0x55ff42c9c800 2024-09-13T06:13:20.726 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.722+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v35'58 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.726 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.722+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cb6940 con 0x7fad140e0040 2024-09-13T06:13:20.729 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.726+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.0 v2:172.21.15.120:6800/1923744619 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v35'35 uv25 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fad2400a4d0 con 0x7fad140e0040 2024-09-13T06:13:20.729 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.726+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cb6940 con 0x55ff42c9c800 2024-09-13T06:13:20.731 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.726+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v35'33 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.731 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.726+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cb6940 con 0x7fad140e0040 2024-09-13T06:13:20.734 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.730+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.0 v2:172.21.15.120:6800/1923744619 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v35'56 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fad2400a4d0 con 0x7fad140e0040 2024-09-13T06:13:20.734 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.730+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cb6940 con 0x55ff42c9c800 2024-09-13T06:13:20.736 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.734+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v35'79 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.736 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.734+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cb6940 con 0x7fad140e0040 2024-09-13T06:13:20.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.734+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.0 v2:172.21.15.120:6800/1923744619 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v35'63 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fad2400a4d0 con 0x7fad140e0040 2024-09-13T06:13:20.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.738+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cb6940 con 0x7fad1c055040 2024-09-13T06:13:20.741 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.738+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 <== osd.2 v2:172.21.15.194:6800/815615585 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v35'38 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fad140aaae0 con 0x7fad1c055040 2024-09-13T06:13:20.742 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.738+0000 7fabe0fe1640 20 reqs_thread_entry: start 2024-09-13T06:13:20.742 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.738+0000 7fad2ddfc980 20 init_complete bucket index max shards: 11 2024-09-13T06:13:20.742 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.738+0000 7fad2ddfc980 20 Filter name: none 2024-09-13T06:13:20.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.738+0000 7fab5a7fc640 20 reqs_thread_entry: start 2024-09-13T06:13:20.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.738+0000 7fad2ddfc980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-13T06:13:20.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.738+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:94 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x7fad1c055040 2024-09-13T06:13:20.745 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.742+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 <== osd.2 v2:172.21.15.194:6800/815615585 21 ==== osd_op_reply(94 gc.8 [call] v35'32 uv32 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fad140aaae0 con 0x7fad1c055040 2024-09-13T06:13:20.745 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.742+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:95 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x7fad1c055040 2024-09-13T06:13:20.745 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.742+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 <== osd.2 v2:172.21.15.194:6800/815615585 22 ==== osd_op_reply(95 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fad140aaae0 con 0x7fad1c055040 2024-09-13T06:13:20.745 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.742+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:13:20.745 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.742+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:96 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd1f40 con 0x7fad1c055040 2024-09-13T06:13:20.746 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.742+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 <== osd.2 v2:172.21.15.194:6800/815615585 23 ==== osd_op_reply(96 gc.8 [call out=24b] v0'0 uv32 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fad140aaae0 con 0x7fad1c055040 2024-09-13T06:13:20.746 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.742+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:97 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x7fad1c055040 2024-09-13T06:13:20.747 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.742+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 <== osd.2 v2:172.21.15.194:6800/815615585 24 ==== osd_op_reply(97 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fad140aaae0 con 0x7fad1c055040 2024-09-13T06:13:20.747 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.742+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:13:20.747 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.742+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:98 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x7fad1c055040 2024-09-13T06:13:20.747 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.742+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 <== osd.2 v2:172.21.15.194:6800/815615585 25 ==== osd_op_reply(98 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fad140aaae0 con 0x7fad1c055040 2024-09-13T06:13:20.747 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.742+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:13:20.747 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.742+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:99 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x7fad1c055040 2024-09-13T06:13:20.748 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.746+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 <== osd.2 v2:172.21.15.194:6800/815615585 26 ==== osd_op_reply(99 gc.8 [call] v35'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fad140aaae0 con 0x7fad1c055040 2024-09-13T06:13:20.748 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.746+0000 7fad2ddfc980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-13T06:13:20.748 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.746+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:100 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c9c800 2024-09-13T06:13:20.750 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.746+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 27 ==== osd_op_reply(100 gc.9 [call] v35'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.750 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.746+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:101 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c9c800 2024-09-13T06:13:20.750 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.746+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 28 ==== osd_op_reply(101 gc.9 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.746+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:13:20.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.746+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:102 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd1f40 con 0x55ff42c9c800 2024-09-13T06:13:20.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.746+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 29 ==== osd_op_reply(102 gc.9 [call out=24b] v0'0 uv39 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.746+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:103 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c9c800 2024-09-13T06:13:20.752 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.746+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 30 ==== osd_op_reply(103 gc.9 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.752 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.746+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:13:20.752 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.746+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:104 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c9c800 2024-09-13T06:13:20.752 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.750+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 31 ==== osd_op_reply(104 gc.9 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.752 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.750+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:13:20.752 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.750+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:105 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c9c800 2024-09-13T06:13:20.753 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.750+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 32 ==== osd_op_reply(105 gc.9 [call] v35'40 uv40 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.753 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.750+0000 7fad2ddfc980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-13T06:13:20.753 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.750+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:106 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x7fad1c055040 2024-09-13T06:13:20.758 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.750+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 <== osd.2 v2:172.21.15.194:6800/815615585 27 ==== osd_op_reply(106 gc.10 [call] v35'86 uv86 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fad140aaae0 con 0x7fad1c055040 2024-09-13T06:13:20.758 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.750+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:107 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x7fad1c055040 2024-09-13T06:13:20.758 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.750+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 <== osd.2 v2:172.21.15.194:6800/815615585 28 ==== osd_op_reply(107 gc.10 [call out=15b] v0'0 uv86 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fad140aaae0 con 0x7fad1c055040 2024-09-13T06:13:20.758 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.750+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:13:20.759 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.750+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:108 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd1f40 con 0x7fad1c055040 2024-09-13T06:13:20.759 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.750+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 <== osd.2 v2:172.21.15.194:6800/815615585 29 ==== osd_op_reply(108 gc.10 [call out=24b] v0'0 uv86 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fad140aaae0 con 0x7fad1c055040 2024-09-13T06:13:20.759 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.750+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:109 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x7fad1c055040 2024-09-13T06:13:20.759 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.754+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 <== osd.2 v2:172.21.15.194:6800/815615585 30 ==== osd_op_reply(109 gc.10 [call out=15b] v0'0 uv86 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fad140aaae0 con 0x7fad1c055040 2024-09-13T06:13:20.759 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.754+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:13:20.759 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.754+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:110 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x7fad1c055040 2024-09-13T06:13:20.759 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.754+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 <== osd.2 v2:172.21.15.194:6800/815615585 31 ==== osd_op_reply(110 gc.10 [call out=15b] v0'0 uv86 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fad140aaae0 con 0x7fad1c055040 2024-09-13T06:13:20.759 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.754+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:13:20.759 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.754+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:111 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x7fad1c055040 2024-09-13T06:13:20.759 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.754+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 <== osd.2 v2:172.21.15.194:6800/815615585 32 ==== osd_op_reply(111 gc.10 [call] v35'87 uv87 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fad140aaae0 con 0x7fad1c055040 2024-09-13T06:13:20.759 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.754+0000 7fad2ddfc980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-13T06:13:20.760 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.754+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:112 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x7fad140e0040 2024-09-13T06:13:20.760 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.758+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.0 v2:172.21.15.120:6800/1923744619 22 ==== osd_op_reply(112 gc.11 [call] v35'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fad2400a4d0 con 0x7fad140e0040 2024-09-13T06:13:20.761 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.758+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:113 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x7fad140e0040 2024-09-13T06:13:20.761 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.758+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.0 v2:172.21.15.120:6800/1923744619 23 ==== osd_op_reply(113 gc.11 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fad2400a4d0 con 0x7fad140e0040 2024-09-13T06:13:20.761 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.758+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:13:20.761 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.758+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:114 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd1f40 con 0x7fad140e0040 2024-09-13T06:13:20.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.758+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.0 v2:172.21.15.120:6800/1923744619 24 ==== osd_op_reply(114 gc.11 [call out=24b] v0'0 uv43 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fad2400a4d0 con 0x7fad140e0040 2024-09-13T06:13:20.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.758+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:115 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x7fad140e0040 2024-09-13T06:13:20.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.758+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.0 v2:172.21.15.120:6800/1923744619 25 ==== osd_op_reply(115 gc.11 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fad2400a4d0 con 0x7fad140e0040 2024-09-13T06:13:20.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.758+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:13:20.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.758+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:116 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x7fad140e0040 2024-09-13T06:13:20.763 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.758+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.0 v2:172.21.15.120:6800/1923744619 26 ==== osd_op_reply(116 gc.11 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fad2400a4d0 con 0x7fad140e0040 2024-09-13T06:13:20.763 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.758+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:13:20.763 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.758+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:117 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x7fad140e0040 2024-09-13T06:13:20.765 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.762+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.0 v2:172.21.15.120:6800/1923744619 27 ==== osd_op_reply(117 gc.11 [call] v35'44 uv44 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fad2400a4d0 con 0x7fad140e0040 2024-09-13T06:13:20.765 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.762+0000 7fad2ddfc980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-13T06:13:20.765 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.762+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:118 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x7fad1c055040 2024-09-13T06:13:20.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.762+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 <== osd.2 v2:172.21.15.194:6800/815615585 33 ==== osd_op_reply(118 gc.12 [call] v35'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fad140aaae0 con 0x7fad1c055040 2024-09-13T06:13:20.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.766+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:119 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x7fad1c055040 2024-09-13T06:13:20.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.766+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 <== osd.2 v2:172.21.15.194:6800/815615585 34 ==== osd_op_reply(119 gc.12 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fad140aaae0 con 0x7fad1c055040 2024-09-13T06:13:20.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.766+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:13:20.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.766+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:120 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd1f40 con 0x7fad1c055040 2024-09-13T06:13:20.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.766+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 <== osd.2 v2:172.21.15.194:6800/815615585 35 ==== osd_op_reply(120 gc.12 [call out=24b] v0'0 uv33 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fad140aaae0 con 0x7fad1c055040 2024-09-13T06:13:20.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.766+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:121 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x7fad1c055040 2024-09-13T06:13:20.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.766+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 <== osd.2 v2:172.21.15.194:6800/815615585 36 ==== osd_op_reply(121 gc.12 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fad140aaae0 con 0x7fad1c055040 2024-09-13T06:13:20.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.766+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:13:20.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.766+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:122 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x7fad1c055040 2024-09-13T06:13:20.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.766+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 <== osd.2 v2:172.21.15.194:6800/815615585 37 ==== osd_op_reply(122 gc.12 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fad140aaae0 con 0x7fad1c055040 2024-09-13T06:13:20.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.766+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:13:20.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.766+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:123 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x7fad1c055040 2024-09-13T06:13:20.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.766+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 <== osd.2 v2:172.21.15.194:6800/815615585 38 ==== osd_op_reply(123 gc.12 [call] v35'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fad140aaae0 con 0x7fad1c055040 2024-09-13T06:13:20.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.766+0000 7fad2ddfc980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-13T06:13:20.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.766+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:124 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x7fad140e0040 2024-09-13T06:13:20.772 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.770+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.0 v2:172.21.15.120:6800/1923744619 28 ==== osd_op_reply(124 gc.13 [call] v35'64 uv64 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fad2400a4d0 con 0x7fad140e0040 2024-09-13T06:13:20.772 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.770+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:125 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x7fad140e0040 2024-09-13T06:13:20.773 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.770+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.0 v2:172.21.15.120:6800/1923744619 29 ==== osd_op_reply(125 gc.13 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fad2400a4d0 con 0x7fad140e0040 2024-09-13T06:13:20.773 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.770+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:13:20.773 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.770+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:126 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd1f40 con 0x7fad140e0040 2024-09-13T06:13:20.774 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.770+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.0 v2:172.21.15.120:6800/1923744619 30 ==== osd_op_reply(126 gc.13 [call out=24b] v0'0 uv64 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fad2400a4d0 con 0x7fad140e0040 2024-09-13T06:13:20.774 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.770+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:127 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x7fad140e0040 2024-09-13T06:13:20.775 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.770+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.0 v2:172.21.15.120:6800/1923744619 31 ==== osd_op_reply(127 gc.13 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fad2403c040 con 0x7fad140e0040 2024-09-13T06:13:20.775 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.770+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:13:20.775 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.770+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:128 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x7fad140e0040 2024-09-13T06:13:20.776 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.774+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.0 v2:172.21.15.120:6800/1923744619 32 ==== osd_op_reply(128 gc.13 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fad2403c040 con 0x7fad140e0040 2024-09-13T06:13:20.776 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.774+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:13:20.776 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.774+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:129 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x7fad140e0040 2024-09-13T06:13:20.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.774+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.0 v2:172.21.15.120:6800/1923744619 33 ==== osd_op_reply(129 gc.13 [call] v35'65 uv65 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fad2403c040 con 0x7fad140e0040 2024-09-13T06:13:20.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.774+0000 7fad2ddfc980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-13T06:13:20.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.774+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:130 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c97e10 2024-09-13T06:13:20.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.778+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.1 v2:172.21.15.194:6808/3135444559 27 ==== osd_op_reply(130 gc.14 [call] v35'279 uv279 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fad2403c040 con 0x55ff42c97e10 2024-09-13T06:13:20.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.778+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:131 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c97e10 2024-09-13T06:13:20.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.778+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.1 v2:172.21.15.194:6808/3135444559 28 ==== osd_op_reply(131 gc.14 [call out=15b] v0'0 uv279 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fad2403c040 con 0x55ff42c97e10 2024-09-13T06:13:20.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.778+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:13:20.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.778+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:132 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd1f40 con 0x55ff42c97e10 2024-09-13T06:13:20.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.778+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.1 v2:172.21.15.194:6808/3135444559 29 ==== osd_op_reply(132 gc.14 [call out=24b] v0'0 uv279 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fad2403c040 con 0x55ff42c97e10 2024-09-13T06:13:20.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.778+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:133 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c97e10 2024-09-13T06:13:20.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.778+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.1 v2:172.21.15.194:6808/3135444559 30 ==== osd_op_reply(133 gc.14 [call out=15b] v0'0 uv279 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fad2403c040 con 0x55ff42c97e10 2024-09-13T06:13:20.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.778+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:13:20.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.778+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:134 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c97e10 2024-09-13T06:13:20.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.778+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.1 v2:172.21.15.194:6808/3135444559 31 ==== osd_op_reply(134 gc.14 [call out=15b] v0'0 uv279 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fad2403c040 con 0x55ff42c97e10 2024-09-13T06:13:20.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.778+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:13:20.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.778+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:135 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c97e10 2024-09-13T06:13:20.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.782+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.1 v2:172.21.15.194:6808/3135444559 32 ==== osd_op_reply(135 gc.14 [call] v35'280 uv280 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fad2403c040 con 0x55ff42c97e10 2024-09-13T06:13:20.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.782+0000 7fad2ddfc980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-13T06:13:20.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.782+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:136 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c9c800 2024-09-13T06:13:20.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.782+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 33 ==== osd_op_reply(136 gc.15 [call] v35'80 uv80 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.782+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:137 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c9c800 2024-09-13T06:13:20.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.782+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 34 ==== osd_op_reply(137 gc.15 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.782+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:13:20.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.782+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:138 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd1f40 con 0x55ff42c9c800 2024-09-13T06:13:20.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.782+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 35 ==== osd_op_reply(138 gc.15 [call out=24b] v0'0 uv80 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.782+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c9c800 2024-09-13T06:13:20.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.786+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 36 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.786+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:13:20.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.786+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c9c800 2024-09-13T06:13:20.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.786+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 37 ==== osd_op_reply(140 gc.15 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.786+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:13:20.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.786+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c9c800 2024-09-13T06:13:20.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.786+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 38 ==== osd_op_reply(141 gc.15 [call] v35'81 uv81 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.786+0000 7fad2ddfc980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-13T06:13:20.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.786+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x7fad1c055040 2024-09-13T06:13:20.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.790+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 <== osd.2 v2:172.21.15.194:6800/815615585 39 ==== osd_op_reply(142 gc.16 [call] v35'88 uv88 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fad140aaae0 con 0x7fad1c055040 2024-09-13T06:13:20.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.790+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x7fad1c055040 2024-09-13T06:13:20.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.790+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 <== osd.2 v2:172.21.15.194:6800/815615585 40 ==== osd_op_reply(143 gc.16 [call out=15b] v0'0 uv88 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fad140aaae0 con 0x7fad1c055040 2024-09-13T06:13:20.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.790+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:13:20.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.790+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd1f40 con 0x7fad1c055040 2024-09-13T06:13:20.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.790+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 <== osd.2 v2:172.21.15.194:6800/815615585 41 ==== osd_op_reply(144 gc.16 [call out=24b] v0'0 uv88 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fad140aaae0 con 0x7fad1c055040 2024-09-13T06:13:20.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.790+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:145 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x7fad1c055040 2024-09-13T06:13:20.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.790+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 <== osd.2 v2:172.21.15.194:6800/815615585 42 ==== osd_op_reply(145 gc.16 [call out=15b] v0'0 uv88 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fad140aaae0 con 0x7fad1c055040 2024-09-13T06:13:20.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.790+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:13:20.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.790+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:146 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x7fad1c055040 2024-09-13T06:13:20.794 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.790+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 <== osd.2 v2:172.21.15.194:6800/815615585 43 ==== osd_op_reply(146 gc.16 [call out=15b] v0'0 uv88 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fad140aaae0 con 0x7fad1c055040 2024-09-13T06:13:20.794 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.790+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:13:20.794 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.790+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:147 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x7fad1c055040 2024-09-13T06:13:20.794 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.790+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 <== osd.2 v2:172.21.15.194:6800/815615585 44 ==== osd_op_reply(147 gc.16 [call] v35'89 uv89 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fad140aaae0 con 0x7fad1c055040 2024-09-13T06:13:20.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.790+0000 7fad2ddfc980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-13T06:13:20.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.790+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:148 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c9c800 2024-09-13T06:13:20.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.794+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 39 ==== osd_op_reply(148 gc.17 [call] v35'32 uv32 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.794+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:149 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c9c800 2024-09-13T06:13:20.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.794+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 40 ==== osd_op_reply(149 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.794+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:13:20.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.794+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:150 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd1f40 con 0x55ff42c9c800 2024-09-13T06:13:20.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.794+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 41 ==== osd_op_reply(150 gc.17 [call out=24b] v0'0 uv32 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.794+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:151 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c9c800 2024-09-13T06:13:20.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.794+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 42 ==== osd_op_reply(151 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.794+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:13:20.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.794+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:152 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c9c800 2024-09-13T06:13:20.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.794+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 43 ==== osd_op_reply(152 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.794+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:13:20.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.794+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:153 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c9c800 2024-09-13T06:13:20.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.798+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 44 ==== osd_op_reply(153 gc.17 [call] v35'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.798+0000 7fad2ddfc980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-13T06:13:20.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.798+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:154 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c97e10 2024-09-13T06:13:20.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.798+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.1 v2:172.21.15.194:6808/3135444559 33 ==== osd_op_reply(154 gc.18 [call] v35'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fad2403c040 con 0x55ff42c97e10 2024-09-13T06:13:20.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.798+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:155 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c97e10 2024-09-13T06:13:20.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.798+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.1 v2:172.21.15.194:6808/3135444559 34 ==== osd_op_reply(155 gc.18 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fad2403c040 con 0x55ff42c97e10 2024-09-13T06:13:20.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.798+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:13:20.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.798+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:156 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd1f40 con 0x55ff42c97e10 2024-09-13T06:13:20.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.798+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.1 v2:172.21.15.194:6808/3135444559 35 ==== osd_op_reply(156 gc.18 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fad2403c040 con 0x55ff42c97e10 2024-09-13T06:13:20.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.802+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:157 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c97e10 2024-09-13T06:13:20.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.802+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.1 v2:172.21.15.194:6808/3135444559 36 ==== osd_op_reply(157 gc.18 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fad2403c040 con 0x55ff42c97e10 2024-09-13T06:13:20.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.802+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:13:20.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.802+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:158 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c97e10 2024-09-13T06:13:20.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.802+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.1 v2:172.21.15.194:6808/3135444559 37 ==== osd_op_reply(158 gc.18 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fad2403c040 con 0x55ff42c97e10 2024-09-13T06:13:20.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.802+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:13:20.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.802+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:159 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c97e10 2024-09-13T06:13:20.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.802+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.1 v2:172.21.15.194:6808/3135444559 38 ==== osd_op_reply(159 gc.18 [call] v35'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fad2403c040 con 0x55ff42c97e10 2024-09-13T06:13:20.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.802+0000 7fad2ddfc980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-13T06:13:20.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.802+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:160 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c97e10 2024-09-13T06:13:20.808 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.806+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.1 v2:172.21.15.194:6808/3135444559 39 ==== osd_op_reply(160 gc.19 [call] v35'281 uv281 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fad2403c040 con 0x55ff42c97e10 2024-09-13T06:13:20.808 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.806+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:161 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c97e10 2024-09-13T06:13:20.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.806+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.1 v2:172.21.15.194:6808/3135444559 40 ==== osd_op_reply(161 gc.19 [call out=15b] v0'0 uv281 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fad2403c040 con 0x55ff42c97e10 2024-09-13T06:13:20.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.806+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:13:20.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.806+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:162 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd1f40 con 0x55ff42c97e10 2024-09-13T06:13:20.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.806+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.1 v2:172.21.15.194:6808/3135444559 41 ==== osd_op_reply(162 gc.19 [call out=24b] v0'0 uv281 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fad2403c040 con 0x55ff42c97e10 2024-09-13T06:13:20.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.806+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:163 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c97e10 2024-09-13T06:13:20.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.806+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.1 v2:172.21.15.194:6808/3135444559 42 ==== osd_op_reply(163 gc.19 [call out=15b] v0'0 uv281 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fad2403c040 con 0x55ff42c97e10 2024-09-13T06:13:20.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.806+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:13:20.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.806+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:164 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c97e10 2024-09-13T06:13:20.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.806+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.1 v2:172.21.15.194:6808/3135444559 43 ==== osd_op_reply(164 gc.19 [call out=15b] v0'0 uv281 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fad2403c040 con 0x55ff42c97e10 2024-09-13T06:13:20.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.806+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:13:20.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.806+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:165 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c97e10 2024-09-13T06:13:20.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.810+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.1 v2:172.21.15.194:6808/3135444559 44 ==== osd_op_reply(165 gc.19 [call] v35'282 uv282 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fad2403c040 con 0x55ff42c97e10 2024-09-13T06:13:20.812 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.810+0000 7fad2ddfc980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-13T06:13:20.812 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.810+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:166 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c9c800 2024-09-13T06:13:20.814 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.810+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 45 ==== osd_op_reply(166 gc.20 [call] v35'82 uv82 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.814 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.810+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:167 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c9c800 2024-09-13T06:13:20.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.810+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 46 ==== osd_op_reply(167 gc.20 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.810+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:13:20.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.810+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:168 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd1f40 con 0x55ff42c9c800 2024-09-13T06:13:20.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.814+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 47 ==== osd_op_reply(168 gc.20 [call out=24b] v0'0 uv82 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.814+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:169 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c9c800 2024-09-13T06:13:20.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.814+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 48 ==== osd_op_reply(169 gc.20 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.814+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:13:20.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.814+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:170 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c9c800 2024-09-13T06:13:20.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.814+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 49 ==== osd_op_reply(170 gc.20 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.814+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:13:20.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.814+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:171 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c9c800 2024-09-13T06:13:20.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.818+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 50 ==== osd_op_reply(171 gc.20 [call] v35'83 uv83 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.818+0000 7fad2ddfc980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-13T06:13:20.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.818+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:172 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x7fad1c055040 2024-09-13T06:13:20.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.818+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 <== osd.2 v2:172.21.15.194:6800/815615585 45 ==== osd_op_reply(172 gc.21 [call] v35'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fad140aaae0 con 0x7fad1c055040 2024-09-13T06:13:20.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.818+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:173 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x7fad1c055040 2024-09-13T06:13:20.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.818+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 <== osd.2 v2:172.21.15.194:6800/815615585 46 ==== osd_op_reply(173 gc.21 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fad140aaae0 con 0x7fad1c055040 2024-09-13T06:13:20.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.818+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:13:20.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.818+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:174 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd1f40 con 0x7fad1c055040 2024-09-13T06:13:20.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.818+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 <== osd.2 v2:172.21.15.194:6800/815615585 47 ==== osd_op_reply(174 gc.21 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fad140aaae0 con 0x7fad1c055040 2024-09-13T06:13:20.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.818+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:175 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x7fad1c055040 2024-09-13T06:13:20.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.818+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 <== osd.2 v2:172.21.15.194:6800/815615585 48 ==== osd_op_reply(175 gc.21 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fad140aaae0 con 0x7fad1c055040 2024-09-13T06:13:20.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.818+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:13:20.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.818+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:176 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x7fad1c055040 2024-09-13T06:13:20.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.818+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 <== osd.2 v2:172.21.15.194:6800/815615585 49 ==== osd_op_reply(176 gc.21 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fad140aaae0 con 0x7fad1c055040 2024-09-13T06:13:20.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.818+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:13:20.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.818+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:177 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x7fad1c055040 2024-09-13T06:13:20.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.822+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 <== osd.2 v2:172.21.15.194:6800/815615585 50 ==== osd_op_reply(177 gc.21 [call] v35'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fad140aaae0 con 0x7fad1c055040 2024-09-13T06:13:20.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.822+0000 7fad2ddfc980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-13T06:13:20.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.822+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:178 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c9c800 2024-09-13T06:13:20.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.822+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 51 ==== osd_op_reply(178 gc.22 [call] v35'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.822+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:179 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c9c800 2024-09-13T06:13:20.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.822+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 52 ==== osd_op_reply(179 gc.22 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.822+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:13:20.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.822+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:180 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd1f40 con 0x55ff42c9c800 2024-09-13T06:13:20.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.822+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 53 ==== osd_op_reply(180 gc.22 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.822+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:181 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c9c800 2024-09-13T06:13:20.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.826+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 54 ==== osd_op_reply(181 gc.22 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.826+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:13:20.829 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.826+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:182 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c9c800 2024-09-13T06:13:20.829 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.826+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 55 ==== osd_op_reply(182 gc.22 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.829 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.826+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:13:20.829 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.826+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:183 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c9c800 2024-09-13T06:13:20.829 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.826+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 56 ==== osd_op_reply(183 gc.22 [call] v35'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.830 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.826+0000 7fad2ddfc980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-13T06:13:20.830 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.826+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:184 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c9c800 2024-09-13T06:13:20.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.830+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 57 ==== osd_op_reply(184 gc.23 [call] v35'38 uv38 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.830+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:185 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c9c800 2024-09-13T06:13:20.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.830+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 58 ==== osd_op_reply(185 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.830+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:13:20.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.830+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:186 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd1f40 con 0x55ff42c9c800 2024-09-13T06:13:20.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.830+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 59 ==== osd_op_reply(186 gc.23 [call out=24b] v0'0 uv38 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.830+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:187 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c9c800 2024-09-13T06:13:20.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.830+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 60 ==== osd_op_reply(187 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.830+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:13:20.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.830+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:188 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c9c800 2024-09-13T06:13:20.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.830+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 61 ==== osd_op_reply(188 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.830+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:13:20.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.830+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:189 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c9c800 2024-09-13T06:13:20.835 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.830+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 62 ==== osd_op_reply(189 gc.23 [call] v35'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.835 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.834+0000 7fad2ddfc980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-13T06:13:20.835 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.834+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:190 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c9c800 2024-09-13T06:13:20.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.834+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 63 ==== osd_op_reply(190 gc.24 [call] v35'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.834+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:191 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c9c800 2024-09-13T06:13:20.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.834+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 64 ==== osd_op_reply(191 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.834+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:13:20.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.834+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:192 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd1f40 con 0x55ff42c9c800 2024-09-13T06:13:20.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.834+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 65 ==== osd_op_reply(192 gc.24 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.834+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:193 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c9c800 2024-09-13T06:13:20.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.834+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 66 ==== osd_op_reply(193 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.834+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:13:20.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.834+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:194 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c9c800 2024-09-13T06:13:20.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.834+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 67 ==== osd_op_reply(194 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.838+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:13:20.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.838+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:195 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c9c800 2024-09-13T06:13:20.841 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.838+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 68 ==== osd_op_reply(195 gc.24 [call] v35'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.841 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.838+0000 7fad2ddfc980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-13T06:13:20.841 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.838+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:196 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c9c800 2024-09-13T06:13:20.842 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.838+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 69 ==== osd_op_reply(196 gc.25 [call] v35'59 uv59 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.842 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.838+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:197 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c9c800 2024-09-13T06:13:20.843 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.842+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 70 ==== osd_op_reply(197 gc.25 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.843 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.842+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:13:20.843 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.842+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:198 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd1f40 con 0x55ff42c9c800 2024-09-13T06:13:20.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.842+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 71 ==== osd_op_reply(198 gc.25 [call out=24b] v0'0 uv59 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.842+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:199 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c9c800 2024-09-13T06:13:20.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.842+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 72 ==== osd_op_reply(199 gc.25 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.842+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:13:20.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.842+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:200 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c9c800 2024-09-13T06:13:20.845 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.842+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 73 ==== osd_op_reply(200 gc.25 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.845 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.842+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:13:20.845 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.842+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:201 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c9c800 2024-09-13T06:13:20.846 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.842+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 74 ==== osd_op_reply(201 gc.25 [call] v35'60 uv60 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.846 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.842+0000 7fad2ddfc980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-13T06:13:20.846 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.842+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:202 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x7fad140e0040 2024-09-13T06:13:20.849 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.846+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.0 v2:172.21.15.120:6800/1923744619 34 ==== osd_op_reply(202 gc.26 [call] v35'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fad2403c040 con 0x7fad140e0040 2024-09-13T06:13:20.849 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.846+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:203 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x7fad140e0040 2024-09-13T06:13:20.850 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.846+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.0 v2:172.21.15.120:6800/1923744619 35 ==== osd_op_reply(203 gc.26 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fad2403c040 con 0x7fad140e0040 2024-09-13T06:13:20.850 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.846+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:13:20.850 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.846+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:204 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd1f40 con 0x7fad140e0040 2024-09-13T06:13:20.850 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.846+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.0 v2:172.21.15.120:6800/1923744619 36 ==== osd_op_reply(204 gc.26 [call out=24b] v0'0 uv36 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fad2403c040 con 0x7fad140e0040 2024-09-13T06:13:20.850 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.846+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:205 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x7fad140e0040 2024-09-13T06:13:20.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.850+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.0 v2:172.21.15.120:6800/1923744619 37 ==== osd_op_reply(205 gc.26 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fad2403c040 con 0x7fad140e0040 2024-09-13T06:13:20.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.850+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:13:20.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.850+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:206 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x7fad140e0040 2024-09-13T06:13:20.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.850+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.0 v2:172.21.15.120:6800/1923744619 38 ==== osd_op_reply(206 gc.26 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fad2403c040 con 0x7fad140e0040 2024-09-13T06:13:20.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.850+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:13:20.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.850+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:207 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x7fad140e0040 2024-09-13T06:13:20.855 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.850+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.0 v2:172.21.15.120:6800/1923744619 39 ==== osd_op_reply(207 gc.26 [call] v35'37 uv37 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fad2403c040 con 0x7fad140e0040 2024-09-13T06:13:20.855 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.850+0000 7fad2ddfc980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-13T06:13:20.855 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.850+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:208 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c9c800 2024-09-13T06:13:20.857 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.854+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 75 ==== osd_op_reply(208 gc.27 [call] v35'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.857 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.854+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:209 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c9c800 2024-09-13T06:13:20.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.854+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 76 ==== osd_op_reply(209 gc.27 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.854+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:13:20.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.854+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:210 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd1f40 con 0x55ff42c9c800 2024-09-13T06:13:20.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.854+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 77 ==== osd_op_reply(210 gc.27 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.854+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:211 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c9c800 2024-09-13T06:13:20.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.854+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 78 ==== osd_op_reply(211 gc.27 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.854+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:13:20.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.854+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:212 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c9c800 2024-09-13T06:13:20.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.858+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 79 ==== osd_op_reply(212 gc.27 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.858+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:13:20.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.858+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:213 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c9c800 2024-09-13T06:13:20.861 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.858+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 80 ==== osd_op_reply(213 gc.27 [call] v35'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.861 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.858+0000 7fad2ddfc980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-13T06:13:20.861 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.858+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:214 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x7fad140e0040 2024-09-13T06:13:20.863 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.862+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.0 v2:172.21.15.120:6800/1923744619 40 ==== osd_op_reply(214 gc.28 [call] v35'57 uv57 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fad2403c040 con 0x7fad140e0040 2024-09-13T06:13:20.863 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.862+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:215 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x7fad140e0040 2024-09-13T06:13:20.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.862+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.0 v2:172.21.15.120:6800/1923744619 41 ==== osd_op_reply(215 gc.28 [call out=15b] v0'0 uv57 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fad2403c040 con 0x7fad140e0040 2024-09-13T06:13:20.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.862+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:13:20.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.862+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:216 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd1f40 con 0x7fad140e0040 2024-09-13T06:13:20.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.862+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.0 v2:172.21.15.120:6800/1923744619 42 ==== osd_op_reply(216 gc.28 [call out=24b] v0'0 uv57 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fad2403c040 con 0x7fad140e0040 2024-09-13T06:13:20.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.862+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:217 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x7fad140e0040 2024-09-13T06:13:20.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.862+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.0 v2:172.21.15.120:6800/1923744619 43 ==== osd_op_reply(217 gc.28 [call out=15b] v0'0 uv57 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fad2403c040 con 0x7fad140e0040 2024-09-13T06:13:20.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.862+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:13:20.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.862+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:218 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x7fad140e0040 2024-09-13T06:13:20.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.862+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.0 v2:172.21.15.120:6800/1923744619 44 ==== osd_op_reply(218 gc.28 [call out=15b] v0'0 uv57 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fad2403c040 con 0x7fad140e0040 2024-09-13T06:13:20.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.862+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:13:20.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.862+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:219 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x7fad140e0040 2024-09-13T06:13:20.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.866+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.0 v2:172.21.15.120:6800/1923744619 45 ==== osd_op_reply(219 gc.28 [call] v35'58 uv58 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fad2403c040 con 0x7fad140e0040 2024-09-13T06:13:20.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.866+0000 7fad2ddfc980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-13T06:13:20.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.866+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:220 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c9c800 2024-09-13T06:13:20.872 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.870+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 81 ==== osd_op_reply(220 gc.29 [call] v35'84 uv84 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.872 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.870+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:221 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c9c800 2024-09-13T06:13:20.872 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.870+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 82 ==== osd_op_reply(221 gc.29 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.872 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.870+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:13:20.873 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.870+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:222 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd1f40 con 0x55ff42c9c800 2024-09-13T06:13:20.873 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.870+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 83 ==== osd_op_reply(222 gc.29 [call out=24b] v0'0 uv84 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.873 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.870+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:223 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c9c800 2024-09-13T06:13:20.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.870+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 84 ==== osd_op_reply(223 gc.29 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.870+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:13:20.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.870+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:224 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c9c800 2024-09-13T06:13:20.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.870+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 85 ==== osd_op_reply(224 gc.29 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.870+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:13:20.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.870+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:225 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c9c800 2024-09-13T06:13:20.877 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.874+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 86 ==== osd_op_reply(225 gc.29 [call] v35'85 uv85 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.877 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.874+0000 7fad2ddfc980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-13T06:13:20.877 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.874+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:226 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x7fad140e0040 2024-09-13T06:13:20.880 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.878+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.0 v2:172.21.15.120:6800/1923744619 46 ==== osd_op_reply(226 gc.30 [call] v35'66 uv66 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fad2403c040 con 0x7fad140e0040 2024-09-13T06:13:20.880 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.878+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:227 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x7fad140e0040 2024-09-13T06:13:20.881 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.878+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.0 v2:172.21.15.120:6800/1923744619 47 ==== osd_op_reply(227 gc.30 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fad2403c040 con 0x7fad140e0040 2024-09-13T06:13:20.881 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.878+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:13:20.881 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.878+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:228 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd1f40 con 0x7fad140e0040 2024-09-13T06:13:20.881 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.878+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.0 v2:172.21.15.120:6800/1923744619 48 ==== osd_op_reply(228 gc.30 [call out=24b] v0'0 uv66 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fad2403c040 con 0x7fad140e0040 2024-09-13T06:13:20.881 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.878+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:229 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x7fad140e0040 2024-09-13T06:13:20.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.878+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.0 v2:172.21.15.120:6800/1923744619 49 ==== osd_op_reply(229 gc.30 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fad2403c040 con 0x7fad140e0040 2024-09-13T06:13:20.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.878+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:13:20.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.878+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:230 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x7fad140e0040 2024-09-13T06:13:20.883 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.878+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.0 v2:172.21.15.120:6800/1923744619 50 ==== osd_op_reply(230 gc.30 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fad2403c040 con 0x7fad140e0040 2024-09-13T06:13:20.883 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.878+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:13:20.883 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.878+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:231 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x7fad140e0040 2024-09-13T06:13:20.885 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.882+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.0 v2:172.21.15.120:6800/1923744619 51 ==== osd_op_reply(231 gc.30 [call] v35'67 uv67 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fad2403c040 con 0x7fad140e0040 2024-09-13T06:13:20.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.882+0000 7fad2ddfc980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-13T06:13:20.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.882+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:232 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x7fad1c055040 2024-09-13T06:13:20.889 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.886+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 <== osd.2 v2:172.21.15.194:6800/815615585 51 ==== osd_op_reply(232 gc.31 [call] v35'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fad140aaae0 con 0x7fad1c055040 2024-09-13T06:13:20.889 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.886+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:233 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x7fad1c055040 2024-09-13T06:13:20.889 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.886+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 <== osd.2 v2:172.21.15.194:6800/815615585 52 ==== osd_op_reply(233 gc.31 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fad140aaae0 con 0x7fad1c055040 2024-09-13T06:13:20.889 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.886+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:13:20.889 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.886+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:234 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd1f40 con 0x7fad1c055040 2024-09-13T06:13:20.890 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.886+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 <== osd.2 v2:172.21.15.194:6800/815615585 53 ==== osd_op_reply(234 gc.31 [call out=24b] v0'0 uv39 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fad140aaae0 con 0x7fad1c055040 2024-09-13T06:13:20.890 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.886+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:235 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x7fad1c055040 2024-09-13T06:13:20.891 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.890+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 <== osd.2 v2:172.21.15.194:6800/815615585 54 ==== osd_op_reply(235 gc.31 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fad140aaae0 con 0x7fad1c055040 2024-09-13T06:13:20.891 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.890+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:13:20.891 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.890+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:236 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x7fad1c055040 2024-09-13T06:13:20.892 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.890+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 <== osd.2 v2:172.21.15.194:6800/815615585 55 ==== osd_op_reply(236 gc.31 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fad140aaae0 con 0x7fad1c055040 2024-09-13T06:13:20.892 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.890+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:13:20.892 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.890+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:237 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x7fad1c055040 2024-09-13T06:13:20.895 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.894+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 <== osd.2 v2:172.21.15.194:6800/815615585 56 ==== osd_op_reply(237 gc.31 [call] v35'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fad140aaae0 con 0x7fad1c055040 2024-09-13T06:13:20.895 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.894+0000 7fad2ddfc980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-13T06:13:20.895 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.894+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:238 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c97e10 2024-09-13T06:13:20.898 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.894+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.1 v2:172.21.15.194:6808/3135444559 45 ==== osd_op_reply(238 gc.0 [call] v35'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fad2403c040 con 0x55ff42c97e10 2024-09-13T06:13:20.898 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.894+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:239 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c97e10 2024-09-13T06:13:20.898 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.894+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.1 v2:172.21.15.194:6808/3135444559 46 ==== osd_op_reply(239 gc.0 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fad2403c040 con 0x55ff42c97e10 2024-09-13T06:13:20.898 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.894+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:13:20.899 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.894+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:240 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd1f40 con 0x55ff42c97e10 2024-09-13T06:13:20.899 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.898+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.1 v2:172.21.15.194:6808/3135444559 47 ==== osd_op_reply(240 gc.0 [call out=24b] v0'0 uv39 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fad2403c040 con 0x55ff42c97e10 2024-09-13T06:13:20.899 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.898+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:241 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c97e10 2024-09-13T06:13:20.900 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.898+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.1 v2:172.21.15.194:6808/3135444559 48 ==== osd_op_reply(241 gc.0 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fad2403c040 con 0x55ff42c97e10 2024-09-13T06:13:20.900 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.898+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:13:20.900 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.898+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:242 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c97e10 2024-09-13T06:13:20.900 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.898+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.1 v2:172.21.15.194:6808/3135444559 49 ==== osd_op_reply(242 gc.0 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fad2403c040 con 0x55ff42c97e10 2024-09-13T06:13:20.900 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.898+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:13:20.901 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.898+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:243 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c97e10 2024-09-13T06:13:20.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.898+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.1 v2:172.21.15.194:6808/3135444559 50 ==== osd_op_reply(243 gc.0 [call] v35'40 uv40 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fad2403c040 con 0x55ff42c97e10 2024-09-13T06:13:20.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.898+0000 7fad2ddfc980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-13T06:13:20.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.898+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:244 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x7fad140e0040 2024-09-13T06:13:20.906 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.902+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.0 v2:172.21.15.120:6800/1923744619 52 ==== osd_op_reply(244 gc.1 [call] v35'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fad2403c040 con 0x7fad140e0040 2024-09-13T06:13:20.906 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.902+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:245 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x7fad140e0040 2024-09-13T06:13:20.906 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.902+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.0 v2:172.21.15.120:6800/1923744619 53 ==== osd_op_reply(245 gc.1 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fad2403c040 con 0x7fad140e0040 2024-09-13T06:13:20.906 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.902+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:13:20.907 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.902+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:246 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd1f40 con 0x7fad140e0040 2024-09-13T06:13:20.907 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.906+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.0 v2:172.21.15.120:6800/1923744619 54 ==== osd_op_reply(246 gc.1 [call out=24b] v0'0 uv33 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fad2403c040 con 0x7fad140e0040 2024-09-13T06:13:20.907 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.906+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:247 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x7fad140e0040 2024-09-13T06:13:20.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.906+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.0 v2:172.21.15.120:6800/1923744619 55 ==== osd_op_reply(247 gc.1 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fad2403c040 con 0x7fad140e0040 2024-09-13T06:13:20.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.906+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:13:20.909 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.906+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:248 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x7fad140e0040 2024-09-13T06:13:20.909 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.906+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.0 v2:172.21.15.120:6800/1923744619 56 ==== osd_op_reply(248 gc.1 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fad2403c040 con 0x7fad140e0040 2024-09-13T06:13:20.909 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.906+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:13:20.909 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.906+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:249 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x7fad140e0040 2024-09-13T06:13:20.912 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.910+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.0 v2:172.21.15.120:6800/1923744619 57 ==== osd_op_reply(249 gc.1 [call] v35'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fad2403c040 con 0x7fad140e0040 2024-09-13T06:13:20.912 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.910+0000 7fad2ddfc980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-13T06:13:20.912 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.910+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:250 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c9c800 2024-09-13T06:13:20.914 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.910+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 87 ==== osd_op_reply(250 gc.2 [call] v35'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.914 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.910+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:251 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c9c800 2024-09-13T06:13:20.915 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.914+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 88 ==== osd_op_reply(251 gc.2 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.915 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.914+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:13:20.915 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.914+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:252 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd1f40 con 0x55ff42c9c800 2024-09-13T06:13:20.916 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.914+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 89 ==== osd_op_reply(252 gc.2 [call out=24b] v0'0 uv33 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.916 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.914+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:253 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c9c800 2024-09-13T06:13:20.917 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.914+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 90 ==== osd_op_reply(253 gc.2 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.917 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.914+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:13:20.917 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.914+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:254 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c9c800 2024-09-13T06:13:20.917 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.914+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 91 ==== osd_op_reply(254 gc.2 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.918 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.914+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:13:20.918 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.914+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:255 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c9c800 2024-09-13T06:13:20.920 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.918+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 92 ==== osd_op_reply(255 gc.2 [call] v35'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.920 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.918+0000 7fad2ddfc980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-13T06:13:20.920 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.918+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:256 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c97e10 2024-09-13T06:13:20.923 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.922+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.1 v2:172.21.15.194:6808/3135444559 51 ==== osd_op_reply(256 gc.3 [call] v35'283 uv283 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fad2403c040 con 0x55ff42c97e10 2024-09-13T06:13:20.923 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.922+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:257 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c97e10 2024-09-13T06:13:20.924 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.922+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.1 v2:172.21.15.194:6808/3135444559 52 ==== osd_op_reply(257 gc.3 [call out=15b] v0'0 uv283 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fad2403c040 con 0x55ff42c97e10 2024-09-13T06:13:20.924 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.922+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:13:20.924 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.922+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:258 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd1f40 con 0x55ff42c97e10 2024-09-13T06:13:20.925 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.922+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.1 v2:172.21.15.194:6808/3135444559 53 ==== osd_op_reply(258 gc.3 [call out=24b] v0'0 uv283 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fad2403c040 con 0x55ff42c97e10 2024-09-13T06:13:20.925 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.922+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:259 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c97e10 2024-09-13T06:13:20.926 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.922+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.1 v2:172.21.15.194:6808/3135444559 54 ==== osd_op_reply(259 gc.3 [call out=15b] v0'0 uv283 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fad2403c040 con 0x55ff42c97e10 2024-09-13T06:13:20.926 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.922+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:13:20.926 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.922+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:260 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c97e10 2024-09-13T06:13:20.927 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.922+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.1 v2:172.21.15.194:6808/3135444559 55 ==== osd_op_reply(260 gc.3 [call out=15b] v0'0 uv283 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fad2403c040 con 0x55ff42c97e10 2024-09-13T06:13:20.927 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.922+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:13:20.927 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.922+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:261 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c97e10 2024-09-13T06:13:20.929 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.926+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.1 v2:172.21.15.194:6808/3135444559 56 ==== osd_op_reply(261 gc.3 [call] v35'284 uv284 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fad2403c040 con 0x55ff42c97e10 2024-09-13T06:13:20.929 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.926+0000 7fad2ddfc980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-13T06:13:20.929 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.926+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:262 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x7fad1c055040 2024-09-13T06:13:20.932 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.930+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 <== osd.2 v2:172.21.15.194:6800/815615585 57 ==== osd_op_reply(262 gc.4 [call] v35'90 uv90 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fad140aaae0 con 0x7fad1c055040 2024-09-13T06:13:20.932 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.930+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:263 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x7fad1c055040 2024-09-13T06:13:20.933 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.930+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 <== osd.2 v2:172.21.15.194:6800/815615585 58 ==== osd_op_reply(263 gc.4 [call out=15b] v0'0 uv90 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fad140aaae0 con 0x7fad1c055040 2024-09-13T06:13:20.933 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.930+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:13:20.933 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.930+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:264 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd1f40 con 0x7fad1c055040 2024-09-13T06:13:20.934 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.930+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 <== osd.2 v2:172.21.15.194:6800/815615585 59 ==== osd_op_reply(264 gc.4 [call out=24b] v0'0 uv90 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fad140aaae0 con 0x7fad1c055040 2024-09-13T06:13:20.934 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.930+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:265 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x7fad1c055040 2024-09-13T06:13:20.934 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.930+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 <== osd.2 v2:172.21.15.194:6800/815615585 60 ==== osd_op_reply(265 gc.4 [call out=15b] v0'0 uv90 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fad140aaae0 con 0x7fad1c055040 2024-09-13T06:13:20.934 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.930+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:13:20.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.930+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:266 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x7fad1c055040 2024-09-13T06:13:20.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.934+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 <== osd.2 v2:172.21.15.194:6800/815615585 61 ==== osd_op_reply(266 gc.4 [call out=15b] v0'0 uv90 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fad140aaae0 con 0x7fad1c055040 2024-09-13T06:13:20.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.934+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:13:20.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.934+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:267 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x7fad1c055040 2024-09-13T06:13:20.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.934+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 <== osd.2 v2:172.21.15.194:6800/815615585 62 ==== osd_op_reply(267 gc.4 [call] v35'91 uv91 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fad140aaae0 con 0x7fad1c055040 2024-09-13T06:13:20.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.934+0000 7fad2ddfc980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-13T06:13:20.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.934+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:268 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c9c800 2024-09-13T06:13:20.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.938+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 93 ==== osd_op_reply(268 gc.5 [call] v35'61 uv61 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.938+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:269 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c9c800 2024-09-13T06:13:20.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.938+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 94 ==== osd_op_reply(269 gc.5 [call out=15b] v0'0 uv61 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.938+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:13:20.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.938+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:270 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd1f40 con 0x55ff42c9c800 2024-09-13T06:13:20.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.938+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 95 ==== osd_op_reply(270 gc.5 [call out=24b] v0'0 uv61 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.938+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:271 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c9c800 2024-09-13T06:13:20.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.938+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 96 ==== osd_op_reply(271 gc.5 [call out=15b] v0'0 uv61 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.938+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:13:20.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.938+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:272 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd2f50 con 0x55ff42c9c800 2024-09-13T06:13:20.944 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.942+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 97 ==== osd_op_reply(272 gc.5 [call out=1715b] v0'0 uv61 ondisk = 0) ==== 148+0+1715 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.944 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.942+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-13T06:13:20.944 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.942+0000 7fad2ddfc980 20 garbage collection: RGWGC::process iterating over entry tag='52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.5158605777314813090', time=2024-09-13T06:13:03.867936+0000, chain.objs.size()=7 2024-09-13T06:13:20.944 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.942+0000 7fad2ddfc980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.11__shadow_.RZ5kV0Q2A3hMGDdn59HeIv4VwaJusHa_1 2024-09-13T06:13:20.944 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.942+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:273 3.18s0 3:196e2976:::52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.11__shadow_.RZ5kV0Q2A3hMGDdn59HeIv4VwaJusHa_1:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd3400 con 0x55ff42c9c800 2024-09-13T06:13:20.944 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.942+0000 7fad2ddfc980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.11__shadow_.RZ5kV0Q2A3hMGDdn59HeIv4VwaJusHa_2 2024-09-13T06:13:20.944 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.942+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:274 3.2as0 3:570cf446:::52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.11__shadow_.RZ5kV0Q2A3hMGDdn59HeIv4VwaJusHa_2:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd5f20 con 0x55ff42c97e10 2024-09-13T06:13:20.944 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.942+0000 7fad2ddfc980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.11__shadow_.RZ5kV0Q2A3hMGDdn59HeIv4VwaJusHa_3 2024-09-13T06:13:20.944 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.942+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:275 3.11s0 3:890b8cde:::52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.11__shadow_.RZ5kV0Q2A3hMGDdn59HeIv4VwaJusHa_3:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd8980 con 0x55ff42c9c800 2024-09-13T06:13:20.945 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.942+0000 7fad2ddfc980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.11__shadow_.RZ5kV0Q2A3hMGDdn59HeIv4VwaJusHa_4 2024-09-13T06:13:20.945 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.942+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:276 3.bs0 3:d370dfa8:::52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.11__shadow_.RZ5kV0Q2A3hMGDdn59HeIv4VwaJusHa_4:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cdb1f0 con 0x7fad140e0040 2024-09-13T06:13:20.945 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.942+0000 7fad2ddfc980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.11__shadow_.RZ5kV0Q2A3hMGDdn59HeIv4VwaJusHa_5 2024-09-13T06:13:20.945 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.942+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:277 3.ds0 3:b043a398:::52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.11__shadow_.RZ5kV0Q2A3hMGDdn59HeIv4VwaJusHa_5:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cd8980 con 0x55ff42c9c800 2024-09-13T06:13:20.945 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.942+0000 7fad2ddfc980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.11__shadow_.RZ5kV0Q2A3hMGDdn59HeIv4VwaJusHa_6 2024-09-13T06:13:20.945 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.942+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:278 3.2es0 3:76d8fa28:::52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.11__shadow_.RZ5kV0Q2A3hMGDdn59HeIv4VwaJusHa_6:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42cdffb0 con 0x7fad1c055040 2024-09-13T06:13:20.945 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.942+0000 7fad2ddfc980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.11__shadow_.RZ5kV0Q2A3hMGDdn59HeIv4VwaJusHa_7 2024-09-13T06:13:20.945 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.942+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:279 3.27s0 3:e6614aad:::52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.11__shadow_.RZ5kV0Q2A3hMGDdn59HeIv4VwaJusHa_7:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42ce2b20 con 0x7fad140e0040 2024-09-13T06:13:20.953 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.950+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 <== osd.2 v2:172.21.15.194:6800/815615585 63 ==== osd_op_reply(278 52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.11__shadow_.RZ5kV0Q2A3hMGDdn59HeIv4VwaJusHa_6 [call] v35'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fad140aaae0 con 0x7fad1c055040 2024-09-13T06:13:20.957 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.950+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.0 v2:172.21.15.120:6800/1923744619 58 ==== osd_op_reply(279 52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.11__shadow_.RZ5kV0Q2A3hMGDdn59HeIv4VwaJusHa_7 [call] v35'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fad2403c040 con 0x7fad140e0040 2024-09-13T06:13:20.957 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.954+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.0 v2:172.21.15.120:6800/1923744619 59 ==== osd_op_reply(276 52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.11__shadow_.RZ5kV0Q2A3hMGDdn59HeIv4VwaJusHa_4 [call] v35'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fad2403c040 con 0x7fad140e0040 2024-09-13T06:13:20.957 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.954+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.1 v2:172.21.15.194:6808/3135444559 57 ==== osd_op_reply(274 52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.11__shadow_.RZ5kV0Q2A3hMGDdn59HeIv4VwaJusHa_2 [call] v35'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fad2403c040 con 0x55ff42c97e10 2024-09-13T06:13:20.957 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.954+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 98 ==== osd_op_reply(273 52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.11__shadow_.RZ5kV0Q2A3hMGDdn59HeIv4VwaJusHa_1 [call] v35'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.957 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.954+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 99 ==== osd_op_reply(275 52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.11__shadow_.RZ5kV0Q2A3hMGDdn59HeIv4VwaJusHa_3 [call] v35'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.960 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.954+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 100 ==== osd_op_reply(277 52d5ffc2-b91b-4558-98ea-6defdf5151d8.4227.11__shadow_.RZ5kV0Q2A3hMGDdn59HeIv4VwaJusHa_5 [call] v35'6 uv6 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.960 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.958+0000 7fad2ddfc980 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-13T06:13:20.960 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.958+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:280 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42ce2b20 con 0x55ff42c9c800 2024-09-13T06:13:20.965 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.962+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 101 ==== osd_op_reply(280 gc.5 [call] v35'62 uv62 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.965 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.962+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:281 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42ce2b20 con 0x55ff42c9c800 2024-09-13T06:13:20.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.966+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 102 ==== osd_op_reply(281 gc.5 [call] v35'63 uv63 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.966+0000 7fad2ddfc980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-13T06:13:20.968 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.966+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:282 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42ce2b20 con 0x55ff42c97e10 2024-09-13T06:13:20.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.966+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.1 v2:172.21.15.194:6808/3135444559 58 ==== osd_op_reply(282 gc.6 [call] v35'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fad2403c040 con 0x55ff42c97e10 2024-09-13T06:13:20.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.966+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:283 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42ce2b20 con 0x55ff42c97e10 2024-09-13T06:13:20.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.966+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.1 v2:172.21.15.194:6808/3135444559 59 ==== osd_op_reply(283 gc.6 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fad2403c040 con 0x55ff42c97e10 2024-09-13T06:13:20.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.966+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:13:20.971 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.966+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:284 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42ce2b20 con 0x55ff42c97e10 2024-09-13T06:13:20.971 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.970+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.1 v2:172.21.15.194:6808/3135444559 60 ==== osd_op_reply(284 gc.6 [call out=24b] v0'0 uv35 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fad2403c040 con 0x55ff42c97e10 2024-09-13T06:13:20.971 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.970+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:285 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42ce2b20 con 0x55ff42c97e10 2024-09-13T06:13:20.972 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.970+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.1 v2:172.21.15.194:6808/3135444559 61 ==== osd_op_reply(285 gc.6 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fad2403c040 con 0x55ff42c97e10 2024-09-13T06:13:20.972 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.970+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:13:20.972 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.970+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:286 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42ce2b20 con 0x55ff42c97e10 2024-09-13T06:13:20.972 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.970+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.1 v2:172.21.15.194:6808/3135444559 62 ==== osd_op_reply(286 gc.6 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fad2403c040 con 0x55ff42c97e10 2024-09-13T06:13:20.973 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.970+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:13:20.973 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.970+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:287 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42ce2b20 con 0x55ff42c97e10 2024-09-13T06:13:20.975 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.970+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.1 v2:172.21.15.194:6808/3135444559 63 ==== osd_op_reply(287 gc.6 [call] v35'36 uv36 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fad2403c040 con 0x55ff42c97e10 2024-09-13T06:13:20.975 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.970+0000 7fad2ddfc980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-13T06:13:20.975 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.974+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:288 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42ce2b20 con 0x7fad140e0040 2024-09-13T06:13:20.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.974+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.0 v2:172.21.15.120:6800/1923744619 60 ==== osd_op_reply(288 gc.7 [call] v35'59 uv59 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fad2403c040 con 0x7fad140e0040 2024-09-13T06:13:20.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.974+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:289 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42ce2b20 con 0x7fad140e0040 2024-09-13T06:13:20.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.974+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.0 v2:172.21.15.120:6800/1923744619 61 ==== osd_op_reply(289 gc.7 [call out=15b] v0'0 uv59 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fad2403c040 con 0x7fad140e0040 2024-09-13T06:13:20.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.974+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:13:20.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.974+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:290 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42ce2b20 con 0x7fad140e0040 2024-09-13T06:13:20.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.978+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.0 v2:172.21.15.120:6800/1923744619 62 ==== osd_op_reply(290 gc.7 [call out=24b] v0'0 uv59 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fad2403c040 con 0x7fad140e0040 2024-09-13T06:13:20.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.978+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:291 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42ce2b20 con 0x7fad140e0040 2024-09-13T06:13:20.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.978+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.0 v2:172.21.15.120:6800/1923744619 63 ==== osd_op_reply(291 gc.7 [call out=15b] v0'0 uv59 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fad2403c040 con 0x7fad140e0040 2024-09-13T06:13:20.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.978+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T06:13:20.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.978+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:292 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ff42ce2b20 con 0x7fad140e0040 2024-09-13T06:13:20.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.978+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.0 v2:172.21.15.120:6800/1923744619 64 ==== osd_op_reply(292 gc.7 [call out=15b] v0'0 uv59 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fad2403c040 con 0x7fad140e0040 2024-09-13T06:13:20.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.978+0000 7fad2ddfc980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T06:13:20.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.978+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:293 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42ce2b20 con 0x7fad140e0040 2024-09-13T06:13:20.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.982+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.0 v2:172.21.15.120:6800/1923744619 65 ==== osd_op_reply(293 gc.7 [call] v35'60 uv60 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fad2403c040 con 0x7fad140e0040 2024-09-13T06:13:20.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.982+0000 7fabe1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T06:13:20.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.982+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94554825589200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42ce2b20 con 0x55ff42c97e10 2024-09-13T06:13:20.989 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.986+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.1 v2:172.21.15.194:6808/3135444559 64 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94554825589200] v35'285 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fad2403c040 con 0x55ff42c97e10 2024-09-13T06:13:20.989 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.986+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94554825565712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42ce2b20 con 0x7fad1c055040 2024-09-13T06:13:20.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.986+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 <== osd.2 v2:172.21.15.194:6800/815615585 64 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94554825565712] v35'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad140aaae0 con 0x7fad1c055040 2024-09-13T06:13:20.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.986+0000 7fad2ddfc980 20 remove_watcher() i=0 2024-09-13T06:13:20.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.986+0000 7fad2ddfc980 2 removed watcher, disabling cache 2024-09-13T06:13:20.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.986+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94554825569040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42ca2610 con 0x55ff42c97e10 2024-09-13T06:13:20.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.990+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.1 v2:172.21.15.194:6808/3135444559 65 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94554825569040] v35'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad2403c040 con 0x55ff42c97e10 2024-09-13T06:13:20.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.990+0000 7fad2ddfc980 20 remove_watcher() i=1 2024-09-13T06:13:20.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.990+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94554825573840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42ca2610 con 0x55ff42c9c800 2024-09-13T06:13:20.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.994+0000 7fad2b90c640 1 -- 172.21.15.194:0/941026899 <== osd.3 v2:172.21.15.194:6816/96632515 103 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94554825573840] v35'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad1c02e070 con 0x55ff42c9c800 2024-09-13T06:13:20.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.994+0000 7fad2ddfc980 20 remove_watcher() i=2 2024-09-13T06:13:20.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.994+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94554825579472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42ca45d0 con 0x7fad1c055040 2024-09-13T06:13:20.998 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.994+0000 7fad2b10b640 1 -- 172.21.15.194:0/941026899 <== osd.2 v2:172.21.15.194:6800/815615585 65 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94554825579472] v35'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad140aaae0 con 0x7fad1c055040 2024-09-13T06:13:20.998 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.994+0000 7fad2ddfc980 20 remove_watcher() i=3 2024-09-13T06:13:20.998 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.994+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94554825580528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42ca2610 con 0x55ff42c97e10 2024-09-13T06:13:21.001 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.998+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.1 v2:172.21.15.194:6808/3135444559 66 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94554825580528] v35'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad2403c040 con 0x55ff42c97e10 2024-09-13T06:13:21.001 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.998+0000 7fad2ddfc980 20 remove_watcher() i=4 2024-09-13T06:13:21.001 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:20.998+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94554825583024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42ca3310 con 0x7fad140e0040 2024-09-13T06:13:21.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:21.002+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.0 v2:172.21.15.120:6800/1923744619 66 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94554825583024] v35'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad2403c040 con 0x7fad140e0040 2024-09-13T06:13:21.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:21.002+0000 7fad2ddfc980 20 remove_watcher() i=5 2024-09-13T06:13:21.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:21.002+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94554825584080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42ca3310 con 0x7fad140e0040 2024-09-13T06:13:21.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:21.002+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.0 v2:172.21.15.120:6800/1923744619 67 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94554825584080] v35'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad2403c040 con 0x7fad140e0040 2024-09-13T06:13:21.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:21.002+0000 7fad2ddfc980 20 remove_watcher() i=6 2024-09-13T06:13:21.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:21.002+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94554825587776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ff42ca3310 con 0x7fad140e0040 2024-09-13T06:13:21.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:21.006+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 <== osd.0 v2:172.21.15.120:6800/1923744619 68 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94554825587776] v35'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad2403c040 con 0x7fad140e0040 2024-09-13T06:13:21.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:21.006+0000 7fad2ddfc980 20 remove_watcher() i=7 2024-09-13T06:13:21.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:21.006+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fad140e0040 msgr2=0x7fad140e0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:21.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:21.006+0000 7fad2ddfc980 1 --2- 172.21.15.194:0/941026899 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7fad140e0040 0x7fad140e0420 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:13:21.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:21.006+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ff42c97e10 msgr2=0x55ff42c9a2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:21.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:21.006+0000 7fad2ddfc980 1 --2- 172.21.15.194:0/941026899 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ff42c97e10 0x55ff42c9a2d0 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:13:21.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:21.006+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fad1c055040 msgr2=0x7fad1c053870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:21.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:21.006+0000 7fad2ddfc980 1 --2- 172.21.15.194:0/941026899 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7fad1c055040 0x7fad1c053870 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:13:21.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:21.006+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ff42c9c800 msgr2=0x55ff42c9ebf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:21.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:21.006+0000 7fad2ddfc980 1 --2- 172.21.15.194:0/941026899 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ff42c9c800 0x55ff42c9ebf0 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:13:21.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:21.006+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fabf4034650 msgr2=0x7fabf4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:21.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:21.006+0000 7fad2ddfc980 1 --2- 172.21.15.194:0/941026899 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fabf4034650 0x7fabf4036b10 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fad14000c10 tx=0x7fad140c1040 comp rx=0 tx=0).stop 2024-09-13T06:13:21.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:21.006+0000 7fad2c10d640 1 -- 172.21.15.194:0/941026899 reap_dead start 2024-09-13T06:13:21.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:21.006+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff42c85b30 msgr2=0x55ff42c8cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:21.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:21.006+0000 7fad2ddfc980 1 --2- 172.21.15.194:0/941026899 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff42c85b30 0x55ff42c8cd40 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fad1c0474c0 tx=0x7fad1c010170 comp rx=0 tx=0).stop 2024-09-13T06:13:21.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:21.006+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 shutdown_connections 2024-09-13T06:13:21.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:21.006+0000 7fad2ddfc980 1 --2- 172.21.15.194:0/941026899 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff42c85b30 0x55ff42c8cd40 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:13:21.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:21.006+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 >> 172.21.15.194:0/941026899 conn(0x55ff42c81f10 msgr2=0x55ff42c7ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:13:21.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:21.006+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 shutdown_connections 2024-09-13T06:13:21.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:21.006+0000 7fad2ddfc980 1 -- 172.21.15.194:0/941026899 wait complete. 2024-09-13T06:13:21.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:21.006+0000 7fad2ddfc980 1 -- 172.21.15.194:0/1507120050 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fac04034650 msgr2=0x7fac04036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:21.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:21.006+0000 7fad2ddfc980 1 --2- 172.21.15.194:0/1507120050 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fac04034650 0x7fac04036b10 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x55ff42adc420 tx=0x7fad14005ad0 comp rx=0 tx=0).stop 2024-09-13T06:13:21.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:21.006+0000 7fad2ddfc980 1 -- 172.21.15.194:0/1507120050 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff42c793c0 msgr2=0x55ff42c797e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:21.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:21.006+0000 7fad2ddfc980 1 --2- 172.21.15.194:0/1507120050 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff42c793c0 0x55ff42c797e0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fad1c01b7a0 tx=0x7fad1c01bed0 comp rx=0 tx=0).stop 2024-09-13T06:13:21.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:21.006+0000 7fad2ddfc980 1 -- 172.21.15.194:0/1507120050 shutdown_connections 2024-09-13T06:13:21.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:21.006+0000 7fad2ddfc980 1 --2- 172.21.15.194:0/1507120050 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fac04034650 0x7fac04036b10 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:13:21.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:21.006+0000 7fad2ddfc980 1 --2- 172.21.15.194:0/1507120050 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff42c793c0 0x55ff42c797e0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:13:21.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:21.006+0000 7fad2ddfc980 1 -- 172.21.15.194:0/1507120050 >> 172.21.15.194:0/1507120050 conn(0x55ff42c6e510 msgr2=0x55ff42c70f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:13:21.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:21.010+0000 7fad2ddfc980 1 -- 172.21.15.194:0/1507120050 shutdown_connections 2024-09-13T06:13:21.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:21.010+0000 7fad2ddfc980 1 -- 172.21.15.194:0/1507120050 wait complete. 2024-09-13T06:13:21.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:21.010+0000 7fad2ddfc980 1 -- 172.21.15.194:0/522371604 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ff42c60410 msgr2=0x55ff42c62800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:21.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:21.010+0000 7fad2ddfc980 1 --2- 172.21.15.194:0/522371604 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x55ff42c60410 0x55ff42c62800 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:13:21.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:21.010+0000 7fad2ddfc980 1 -- 172.21.15.194:0/522371604 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55ff42c68dc0 msgr2=0x55ff42c6b1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:21.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:21.010+0000 7fad2ddfc980 1 --2- 172.21.15.194:0/522371604 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x55ff42c68dc0 0x55ff42c6b1b0 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:13:21.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:21.010+0000 7fad2ddfc980 1 -- 172.21.15.194:0/522371604 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ff42c64ea0 msgr2=0x55ff42c67290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:21.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:21.010+0000 7fad2ddfc980 1 --2- 172.21.15.194:0/522371604 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x55ff42c64ea0 0x55ff42c67290 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:13:21.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:21.010+0000 7fad2ddfc980 1 -- 172.21.15.194:0/522371604 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fac14034650 msgr2=0x7fac14036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:21.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:21.010+0000 7fad2ddfc980 1 --2- 172.21.15.194:0/522371604 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fac14034650 0x7fac14036b10 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fad140ae000 tx=0x7fad140a6000 comp rx=0 tx=0).stop 2024-09-13T06:13:21.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:21.010+0000 7fad2ddfc980 1 -- 172.21.15.194:0/522371604 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff42b6aa10 msgr2=0x55ff42add4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:21.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:21.010+0000 7fad2ddfc980 1 --2- 172.21.15.194:0/522371604 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55ff42b6aa10 0x55ff42add4f0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fad1c004000 tx=0x7fad1c000bd0 comp rx=0 tx=0).stop 2024-09-13T06:13:21.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:21.010+0000 7fad2c10d640 1 -- 172.21.15.194:0/522371604 reap_dead start 2024-09-13T06:13:21.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:21.010+0000 7fad2ddfc980 1 -- 172.21.15.194:0/522371604 shutdown_connections 2024-09-13T06:13:21.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:21.010+0000 7fad2ddfc980 1 -- 172.21.15.194:0/522371604 >> 172.21.15.194:0/522371604 conn(0x55ff42b621b0 msgr2=0x55ff42c4c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:13:21.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:21.010+0000 7fad2ddfc980 1 -- 172.21.15.194:0/522371604 shutdown_connections 2024-09-13T06:13:21.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T06:13:21.010+0000 7fad2ddfc980 1 -- 172.21.15.194:0/522371604 wait complete. 2024-09-13T06:13:21.029 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-13T06:13:21.038 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-13T06:13:21.038 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T06:13:21.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.164+0000 7f4102b9d640 1 Processor -- start 2024-09-13T06:13:21.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.164+0000 7f4102b9d640 1 -- start start 2024-09-13T06:13:21.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.164+0000 7f4102b9d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f40fc06ece0 0x7f40fc130e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:13:21.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.164+0000 7f4102b9d640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40fc06f750 con 0x7f40fc06e1f0 2024-09-13T06:13:21.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.164+0000 7f4102b9d640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f40fc070c10 con 0x7f40fc06ece0 2024-09-13T06:13:21.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.168+0000 7f40fbfff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f40fc06ece0 0x7f40fc130e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:13:21.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.168+0000 7f4100939640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f40fc06e1f0 0x7f40fc06e5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:34280/0 (socket says 172.21.15.120:34280) 2024-09-13T06:13:21.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.168+0000 7f4100939640 1 -- 172.21.15.120:0/498341311 learned_addr learned my addr 172.21.15.120:0/498341311 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-13T06:13:21.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.168+0000 7f40fb7fe640 1 -- 172.21.15.120:0/498341311 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1746987630 0 0) 0x7f40fc06f750 con 0x7f40fc06e1f0 2024-09-13T06:13:21.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.168+0000 7f40fb7fe640 1 -- 172.21.15.120:0/498341311 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f40e4003530 con 0x7f40fc06e1f0 2024-09-13T06:13:21.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.168+0000 7f40fbfff640 1 -- 172.21.15.120:0/498341311 >> v1:172.21.15.120:6789/0 conn(0x7f40fc06e1f0 legacy=0x7f40fc06e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:21.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.168+0000 7f40fbfff640 1 -- 172.21.15.120:0/498341311 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40fc0703f0 con 0x7f40fc06ece0 2024-09-13T06:13:21.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.168+0000 7f40fbfff640 1 --2- 172.21.15.120:0/498341311 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40fc06ece0 0x7f40fc130e50 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f40f0009740 tx=0x7f40f001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e5c33b0951bfbf7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:13:21.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.168+0000 7f40fb7fe640 1 -- 172.21.15.120:0/498341311 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40f00b0070 con 0x7f40fc06ece0 2024-09-13T06:13:21.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.168+0000 7f40fb7fe640 1 -- 172.21.15.120:0/498341311 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40f00ab530 con 0x7f40fc06ece0 2024-09-13T06:13:21.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.168+0000 7f40fb7fe640 1 -- 172.21.15.120:0/498341311 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40f00ab830 con 0x7f40fc06ece0 2024-09-13T06:13:21.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.168+0000 7f4102b9d640 1 -- 172.21.15.120:0/498341311 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40fc06ece0 msgr2=0x7f40fc130e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:21.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.168+0000 7f4102b9d640 1 --2- 172.21.15.120:0/498341311 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40fc06ece0 0x7f40fc130e50 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f40f0009740 tx=0x7f40f001c370 comp rx=0 tx=0).stop 2024-09-13T06:13:21.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.168+0000 7f4102b9d640 1 -- 172.21.15.120:0/498341311 shutdown_connections 2024-09-13T06:13:21.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.168+0000 7f4102b9d640 1 --2- 172.21.15.120:0/498341311 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40fc06ece0 0x7f40fc130e50 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:13:21.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.168+0000 7f4102b9d640 1 -- 172.21.15.120:0/498341311 >> 172.21.15.120:0/498341311 conn(0x7f40fc099a50 msgr2=0x7f40fc0972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:13:21.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.168+0000 7f4102b9d640 1 -- 172.21.15.120:0/498341311 shutdown_connections 2024-09-13T06:13:21.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.168+0000 7f4102b9d640 1 -- 172.21.15.120:0/498341311 wait complete. 2024-09-13T06:13:21.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.172+0000 7f4102b9d640 1 Processor -- start 2024-09-13T06:13:21.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.172+0000 7f4102b9d640 1 -- start start 2024-09-13T06:13:21.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.172+0000 7f4102b9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40fc06e1f0 0x7f40fc12a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:13:21.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.172+0000 7f4102b9d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f40fc133d30 con 0x7f40fc06e1f0 2024-09-13T06:13:21.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.172+0000 7f4100939640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40fc06e1f0 0x7f40fc12a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:13:21.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.172+0000 7f4100939640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40fc06e1f0 0x7f40fc12a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:42752/0 (socket says 172.21.15.120:42752) 2024-09-13T06:13:21.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.172+0000 7f4100939640 1 -- 172.21.15.120:0/3487201150 learned_addr learned my addr 172.21.15.120:0/3487201150 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-13T06:13:21.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.172+0000 7f4100939640 1 -- 172.21.15.120:0/3487201150 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40fc08b390 con 0x7f40fc06e1f0 2024-09-13T06:13:21.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.172+0000 7f4100939640 1 --2- 172.21.15.120:0/3487201150 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40fc06e1f0 0x7f40fc12a080 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f40ec00c450 tx=0x7f40ec00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:13:21.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.172+0000 7f40f97fa640 1 -- 172.21.15.120:0/3487201150 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40ec017070 con 0x7f40fc06e1f0 2024-09-13T06:13:21.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.172+0000 7f40f97fa640 1 -- 172.21.15.120:0/3487201150 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40ec005c20 con 0x7f40fc06e1f0 2024-09-13T06:13:21.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.172+0000 7f4102b9d640 1 -- 172.21.15.120:0/3487201150 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40fc12bb30 con 0x7f40fc06e1f0 2024-09-13T06:13:21.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.172+0000 7f40f97fa640 1 -- 172.21.15.120:0/3487201150 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40ec007070 con 0x7f40fc06e1f0 2024-09-13T06:13:21.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.172+0000 7f4102b9d640 1 -- 172.21.15.120:0/3487201150 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40fc08c350 con 0x7f40fc06e1f0 2024-09-13T06:13:21.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.172+0000 7f40f97fa640 1 -- 172.21.15.120:0/3487201150 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f40ec01a070 con 0x7f40fc06e1f0 2024-09-13T06:13:21.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.172+0000 7f4102b9d640 1 -- 172.21.15.120:0/3487201150 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40fc06e5d0 con 0x7f40fc06e1f0 2024-09-13T06:13:21.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.172+0000 7f40f97fa640 1 --2- 172.21.15.120:0/3487201150 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f40e8035db0 0x7f40e8038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:13:21.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.172+0000 7f40f97fa640 1 -- 172.21.15.120:0/3487201150 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f40ec0484f0 con 0x7f40fc06e1f0 2024-09-13T06:13:21.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.172+0000 7f40fbfff640 1 --2- 172.21.15.120:0/3487201150 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f40e8035db0 0x7f40e8038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:13:21.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.172+0000 7f40fbfff640 1 --2- 172.21.15.120:0/3487201150 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f40e8035db0 0x7f40e8038270 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f40f00ad000 tx=0x7f40f00a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:13:21.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.176+0000 7f40f97fa640 1 -- 172.21.15.120:0/3487201150 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f40ec012400 con 0x7f40fc06e1f0 2024-09-13T06:13:21.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.336+0000 7f4102b9d640 1 -- 172.21.15.120:0/3487201150 --> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f40fc073790 con 0x7f40e8035db0 2024-09-13T06:13:21.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.396+0000 7f40f97fa640 1 -- 172.21.15.120:0/3487201150 <== mgr.4100 v2:172.21.15.194:6824/3475680902 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666046 (secure 0 0 0) 0x7f40fc073790 con 0x7f40e8035db0 2024-09-13T06:13:21.404 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T06:13:21.411 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-09-13T06:13:21.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.404+0000 7f4102b9d640 1 -- 172.21.15.120:0/3487201150 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f40e8035db0 msgr2=0x7f40e8038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:21.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.404+0000 7f4102b9d640 1 --2- 172.21.15.120:0/3487201150 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f40e8035db0 0x7f40e8038270 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f40f00ad000 tx=0x7f40f00a6000 comp rx=0 tx=0).stop 2024-09-13T06:13:21.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.404+0000 7f4102b9d640 1 -- 172.21.15.120:0/3487201150 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40fc06e1f0 msgr2=0x7f40fc12a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:21.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.404+0000 7f4102b9d640 1 --2- 172.21.15.120:0/3487201150 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40fc06e1f0 0x7f40fc12a080 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f40ec00c450 tx=0x7f40ec00c910 comp rx=0 tx=0).stop 2024-09-13T06:13:21.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.404+0000 7f4102b9d640 1 -- 172.21.15.120:0/3487201150 shutdown_connections 2024-09-13T06:13:21.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.404+0000 7f4102b9d640 1 --2- 172.21.15.120:0/3487201150 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f40e8035db0 0x7f40e8038270 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:13:21.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.404+0000 7f4102b9d640 1 --2- 172.21.15.120:0/3487201150 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40fc06e1f0 0x7f40fc12a080 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:13:21.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.404+0000 7f4102b9d640 1 -- 172.21.15.120:0/3487201150 >> 172.21.15.120:0/3487201150 conn(0x7f40fc099a50 msgr2=0x7f40fc06d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:13:21.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.404+0000 7f4102b9d640 1 -- 172.21.15.120:0/3487201150 shutdown_connections 2024-09-13T06:13:21.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.404+0000 7f4102b9d640 1 -- 172.21.15.120:0/3487201150 wait complete. 2024-09-13T06:13:21.426 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":154,"stamp":"2024-09-13T06:13:19.817115+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26416904,"num_objects":229,"num_object_clones":0,"num_object_copies":472,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":229,"num_whiteouts":0,"num_read":4892,"num_read_kb":4469,"num_write":2108,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4480,"ondisk_log_size":4480,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":190424,"kb_used_data":36568,"kb_used_omap":6,"kb_used_meta":153785,"kb_avail":377296936,"statfs":{"total":386547056640,"available":386352062464,"internally_reserved":0,"allocated":37445632,"data_stored":36223120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":157476630},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006642"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.802800+0000","last_change":"2024-09-13T06:09:32.142010+0000","last_active":"2024-09-13T06:10:10.802800+0000","last_peered":"2024-09-13T06:10:10.802800+0000","last_clean":"2024-09-13T06:10:10.802800+0000","last_became_active":"2024-09-13T06:09:32.140025+0000","last_became_peered":"2024-09-13T06:09:32.140025+0000","last_unstale":"2024-09-13T06:10:10.802800+0000","last_undegraded":"2024-09-13T06:10:10.802800+0000","last_fullsized":"2024-09-13T06:10:10.802800+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:15:48.717644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"35'22","reported_seq":94,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.323141+0000","last_change":"2024-09-13T06:09:34.126675+0000","last_active":"2024-09-13T06:12:49.323141+0000","last_peered":"2024-09-13T06:12:49.323141+0000","last_clean":"2024-09-13T06:12:49.323141+0000","last_became_active":"2024-09-13T06:09:34.122656+0000","last_became_peered":"2024-09-13T06:09:34.122656+0000","last_unstale":"2024-09-13T06:12:49.323141+0000","last_undegraded":"2024-09-13T06:12:49.323141+0000","last_fullsized":"2024-09-13T06:12:49.323141+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:04:23.927249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":88,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:18.044019+0000","last_change":"2024-09-13T06:09:32.135771+0000","last_active":"2024-09-13T06:10:18.044019+0000","last_peered":"2024-09-13T06:10:18.044019+0000","last_clean":"2024-09-13T06:10:18.044019+0000","last_became_active":"2024-09-13T06:09:32.134020+0000","last_became_peered":"2024-09-13T06:09:32.134020+0000","last_unstale":"2024-09-13T06:10:18.044019+0000","last_undegraded":"2024-09-13T06:10:18.044019+0000","last_fullsized":"2024-09-13T06:10:18.044019+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:24:08.865544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"35'4","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:02.877682+0000","last_change":"2024-09-13T06:09:34.117071+0000","last_active":"2024-09-13T06:11:02.877682+0000","last_peered":"2024-09-13T06:11:02.877682+0000","last_clean":"2024-09-13T06:11:02.877682+0000","last_became_active":"2024-09-13T06:09:34.116715+0000","last_became_peered":"2024-09-13T06:09:34.116715+0000","last_unstale":"2024-09-13T06:11:02.877682+0000","last_undegraded":"2024-09-13T06:11:02.877682+0000","last_fullsized":"2024-09-13T06:11:02.877682+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:06:01.417735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.813339+0000","last_change":"2024-09-13T06:09:32.130525+0000","last_active":"2024-09-13T06:10:10.813339+0000","last_peered":"2024-09-13T06:10:10.813339+0000","last_clean":"2024-09-13T06:10:10.813339+0000","last_became_active":"2024-09-13T06:09:32.116345+0000","last_became_peered":"2024-09-13T06:09:32.116345+0000","last_unstale":"2024-09-13T06:10:10.813339+0000","last_undegraded":"2024-09-13T06:10:10.813339+0000","last_fullsized":"2024-09-13T06:10:10.813339+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:47:58.332268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.805435+0000","last_change":"2024-09-13T06:09:34.118858+0000","last_active":"2024-09-13T06:10:10.805435+0000","last_peered":"2024-09-13T06:10:10.805435+0000","last_clean":"2024-09-13T06:10:10.805435+0000","last_became_active":"2024-09-13T06:09:34.117940+0000","last_became_peered":"2024-09-13T06:09:34.117940+0000","last_unstale":"2024-09-13T06:10:10.805435+0000","last_undegraded":"2024-09-13T06:10:10.805435+0000","last_fullsized":"2024-09-13T06:10:10.805435+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:31:13.005586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"35'4","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.308971+0000","last_change":"2024-09-13T06:09:32.120391+0000","last_active":"2024-09-13T06:12:49.308971+0000","last_peered":"2024-09-13T06:12:49.308971+0000","last_clean":"2024-09-13T06:12:49.308971+0000","last_became_active":"2024-09-13T06:09:32.119806+0000","last_became_peered":"2024-09-13T06:09:32.119806+0000","last_unstale":"2024-09-13T06:12:49.308971+0000","last_undegraded":"2024-09-13T06:12:49.308971+0000","last_fullsized":"2024-09-13T06:12:49.308971+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:16:11.746030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"35'4","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.110973+0000","last_change":"2024-09-13T06:09:34.123442+0000","last_active":"2024-09-13T06:12:49.110973+0000","last_peered":"2024-09-13T06:12:49.110973+0000","last_clean":"2024-09-13T06:12:49.110973+0000","last_became_active":"2024-09-13T06:09:34.122631+0000","last_became_peered":"2024-09-13T06:09:34.122631+0000","last_unstale":"2024-09-13T06:12:49.110973+0000","last_undegraded":"2024-09-13T06:12:49.110973+0000","last_fullsized":"2024-09-13T06:12:49.110973+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:05:27.025085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:18.043979+0000","last_change":"2024-09-13T06:09:32.129860+0000","last_active":"2024-09-13T06:10:18.043979+0000","last_peered":"2024-09-13T06:10:18.043979+0000","last_clean":"2024-09-13T06:10:18.043979+0000","last_became_active":"2024-09-13T06:09:32.121803+0000","last_became_peered":"2024-09-13T06:09:32.121803+0000","last_unstale":"2024-09-13T06:10:18.043979+0000","last_undegraded":"2024-09-13T06:10:18.043979+0000","last_fullsized":"2024-09-13T06:10:18.043979+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:35:53.036270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"35'4","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.112548+0000","last_change":"2024-09-13T06:09:34.127392+0000","last_active":"2024-09-13T06:12:49.112548+0000","last_peered":"2024-09-13T06:12:49.112548+0000","last_clean":"2024-09-13T06:12:49.112548+0000","last_became_active":"2024-09-13T06:09:34.124728+0000","last_became_peered":"2024-09-13T06:09:34.124728+0000","last_unstale":"2024-09-13T06:12:49.112548+0000","last_undegraded":"2024-09-13T06:12:49.112548+0000","last_fullsized":"2024-09-13T06:12:49.112548+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:16:25.577037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.300520+0000","last_change":"2024-09-13T06:09:32.117055+0000","last_active":"2024-09-13T06:12:49.300520+0000","last_peered":"2024-09-13T06:12:49.300520+0000","last_clean":"2024-09-13T06:12:49.300520+0000","last_became_active":"2024-09-13T06:09:32.116422+0000","last_became_peered":"2024-09-13T06:09:32.116422+0000","last_unstale":"2024-09-13T06:12:49.300520+0000","last_undegraded":"2024-09-13T06:12:49.300520+0000","last_fullsized":"2024-09-13T06:12:49.300520+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:42:30.526894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"35'4","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.513278+0000","last_change":"2024-09-13T06:10:10.823960+0000","last_active":"2024-09-13T06:12:49.513278+0000","last_peered":"2024-09-13T06:12:49.513278+0000","last_clean":"2024-09-13T06:12:49.513278+0000","last_became_active":"2024-09-13T06:10:10.810259+0000","last_became_peered":"2024-09-13T06:10:10.810259+0000","last_unstale":"2024-09-13T06:12:49.513278+0000","last_undegraded":"2024-09-13T06:12:49.513278+0000","last_fullsized":"2024-09-13T06:12:49.513278+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:20:38.364042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"35'4","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:19.634736+0000","last_change":"2024-09-13T06:09:32.130200+0000","last_active":"2024-09-13T06:10:19.634736+0000","last_peered":"2024-09-13T06:10:19.634736+0000","last_clean":"2024-09-13T06:10:19.634736+0000","last_became_active":"2024-09-13T06:09:32.122126+0000","last_became_peered":"2024-09-13T06:09:32.122126+0000","last_unstale":"2024-09-13T06:10:19.634736+0000","last_undegraded":"2024-09-13T06:10:19.634736+0000","last_fullsized":"2024-09-13T06:10:19.634736+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:26:21.113764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"35'10","reported_seq":59,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.436094+0000","last_change":"2024-09-13T06:09:34.120695+0000","last_active":"2024-09-13T06:12:49.436094+0000","last_peered":"2024-09-13T06:12:49.436094+0000","last_clean":"2024-09-13T06:12:49.436094+0000","last_became_active":"2024-09-13T06:09:34.120349+0000","last_became_peered":"2024-09-13T06:09:34.120349+0000","last_unstale":"2024-09-13T06:12:49.436094+0000","last_undegraded":"2024-09-13T06:12:49.436094+0000","last_fullsized":"2024-09-13T06:12:49.436094+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:11:30.370585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.943818+0000","last_change":"2024-09-13T06:09:32.149245+0000","last_active":"2024-09-13T06:10:10.943818+0000","last_peered":"2024-09-13T06:10:10.943818+0000","last_clean":"2024-09-13T06:10:10.943818+0000","last_became_active":"2024-09-13T06:09:32.147504+0000","last_became_peered":"2024-09-13T06:09:32.147504+0000","last_unstale":"2024-09-13T06:10:10.943818+0000","last_undegraded":"2024-09-13T06:10:10.943818+0000","last_fullsized":"2024-09-13T06:10:10.943818+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:06:35.186829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"35'9","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:41.798014+0000","last_change":"2024-09-13T06:09:34.104380+0000","last_active":"2024-09-13T06:11:41.798014+0000","last_peered":"2024-09-13T06:11:41.798014+0000","last_clean":"2024-09-13T06:11:41.798014+0000","last_became_active":"2024-09-13T06:09:34.104043+0000","last_became_peered":"2024-09-13T06:09:34.104043+0000","last_unstale":"2024-09-13T06:11:41.798014+0000","last_undegraded":"2024-09-13T06:11:41.798014+0000","last_fullsized":"2024-09-13T06:11:41.798014+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:57:58.370368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"35'4","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.513237+0000","last_change":"2024-09-13T06:09:34.116800+0000","last_active":"2024-09-13T06:12:49.513237+0000","last_peered":"2024-09-13T06:12:49.513237+0000","last_clean":"2024-09-13T06:12:49.513237+0000","last_became_active":"2024-09-13T06:09:34.116359+0000","last_became_peered":"2024-09-13T06:09:34.116359+0000","last_unstale":"2024-09-13T06:12:49.513237+0000","last_undegraded":"2024-09-13T06:12:49.513237+0000","last_fullsized":"2024-09-13T06:12:49.513237+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:45:39.768477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.282953+0000","last_change":"2024-09-13T06:09:32.135469+0000","last_active":"2024-09-13T06:12:49.282953+0000","last_peered":"2024-09-13T06:12:49.282953+0000","last_clean":"2024-09-13T06:12:49.282953+0000","last_became_active":"2024-09-13T06:09:32.134667+0000","last_became_peered":"2024-09-13T06:09:32.134667+0000","last_unstale":"2024-09-13T06:12:49.282953+0000","last_undegraded":"2024-09-13T06:12:49.282953+0000","last_fullsized":"2024-09-13T06:12:49.282953+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:48:22.672562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"35'18","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.437837+0000","last_change":"2024-09-13T06:09:34.118112+0000","last_active":"2024-09-13T06:12:49.437837+0000","last_peered":"2024-09-13T06:12:49.437837+0000","last_clean":"2024-09-13T06:12:49.437837+0000","last_became_active":"2024-09-13T06:09:34.115348+0000","last_became_peered":"2024-09-13T06:09:34.115348+0000","last_unstale":"2024-09-13T06:12:49.437837+0000","last_undegraded":"2024-09-13T06:12:49.437837+0000","last_fullsized":"2024-09-13T06:12:49.437837+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:27:45.493240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":45,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.804770+0000","last_change":"2024-09-13T06:09:32.137039+0000","last_active":"2024-09-13T06:10:10.804770+0000","last_peered":"2024-09-13T06:10:10.804770+0000","last_clean":"2024-09-13T06:10:10.804770+0000","last_became_active":"2024-09-13T06:09:32.135460+0000","last_became_peered":"2024-09-13T06:09:32.135460+0000","last_unstale":"2024-09-13T06:10:10.804770+0000","last_undegraded":"2024-09-13T06:10:10.804770+0000","last_fullsized":"2024-09-13T06:10:10.804770+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:11:15.868187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"35'2","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:19.300519+0000","last_change":"2024-09-13T06:09:34.115425+0000","last_active":"2024-09-13T06:10:19.300519+0000","last_peered":"2024-09-13T06:10:19.300519+0000","last_clean":"2024-09-13T06:10:19.300519+0000","last_became_active":"2024-09-13T06:09:34.115047+0000","last_became_peered":"2024-09-13T06:09:34.115047+0000","last_unstale":"2024-09-13T06:10:19.300519+0000","last_undegraded":"2024-09-13T06:10:19.300519+0000","last_fullsized":"2024-09-13T06:10:19.300519+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:46:23.635958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:18.040942+0000","last_change":"2024-09-13T06:09:32.143123+0000","last_active":"2024-09-13T06:10:18.040942+0000","last_peered":"2024-09-13T06:10:18.040942+0000","last_clean":"2024-09-13T06:10:18.040942+0000","last_became_active":"2024-09-13T06:09:32.141166+0000","last_became_peered":"2024-09-13T06:09:32.141166+0000","last_unstale":"2024-09-13T06:10:18.040942+0000","last_undegraded":"2024-09-13T06:10:18.040942+0000","last_fullsized":"2024-09-13T06:10:18.040942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:03:45.423034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"35'4","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.435819+0000","last_change":"2024-09-13T06:09:34.116108+0000","last_active":"2024-09-13T06:12:49.435819+0000","last_peered":"2024-09-13T06:12:49.435819+0000","last_clean":"2024-09-13T06:12:49.435819+0000","last_became_active":"2024-09-13T06:09:34.114242+0000","last_became_peered":"2024-09-13T06:09:34.114242+0000","last_unstale":"2024-09-13T06:12:49.435819+0000","last_undegraded":"2024-09-13T06:12:49.435819+0000","last_fullsized":"2024-09-13T06:12:49.435819+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:51:17.686447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.816928+0000","last_change":"2024-09-13T06:09:32.144134+0000","last_active":"2024-09-13T06:10:10.816928+0000","last_peered":"2024-09-13T06:10:10.816928+0000","last_clean":"2024-09-13T06:10:10.816928+0000","last_became_active":"2024-09-13T06:09:32.143746+0000","last_became_peered":"2024-09-13T06:09:32.143746+0000","last_unstale":"2024-09-13T06:10:10.816928+0000","last_undegraded":"2024-09-13T06:10:10.816928+0000","last_fullsized":"2024-09-13T06:10:10.816928+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:37:03.391739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"35'8","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.532750+0000","last_change":"2024-09-13T06:09:34.101552+0000","last_active":"2024-09-13T06:12:49.532750+0000","last_peered":"2024-09-13T06:12:49.532750+0000","last_clean":"2024-09-13T06:12:49.532750+0000","last_became_active":"2024-09-13T06:09:34.101167+0000","last_became_peered":"2024-09-13T06:09:34.101167+0000","last_unstale":"2024-09-13T06:12:49.532750+0000","last_undegraded":"2024-09-13T06:12:49.532750+0000","last_fullsized":"2024-09-13T06:12:49.532750+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:16:44.971572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.950455+0000","last_change":"2024-09-13T06:09:32.153552+0000","last_active":"2024-09-13T06:10:10.950455+0000","last_peered":"2024-09-13T06:10:10.950455+0000","last_clean":"2024-09-13T06:10:10.950455+0000","last_became_active":"2024-09-13T06:09:32.149885+0000","last_became_peered":"2024-09-13T06:09:32.149885+0000","last_unstale":"2024-09-13T06:10:10.950455+0000","last_undegraded":"2024-09-13T06:10:10.950455+0000","last_fullsized":"2024-09-13T06:10:10.950455+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:11:15.868187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"35'14","reported_seq":65,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.436750+0000","last_change":"2024-09-13T06:09:34.127656+0000","last_active":"2024-09-13T06:12:49.436750+0000","last_peered":"2024-09-13T06:12:49.436750+0000","last_clean":"2024-09-13T06:12:49.436750+0000","last_became_active":"2024-09-13T06:09:34.124299+0000","last_became_peered":"2024-09-13T06:09:34.124299+0000","last_unstale":"2024-09-13T06:12:49.436750+0000","last_undegraded":"2024-09-13T06:12:49.436750+0000","last_fullsized":"2024-09-13T06:12:49.436750+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:33:59.661744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.804400+0000","last_change":"2024-09-13T06:09:32.141692+0000","last_active":"2024-09-13T06:10:10.804400+0000","last_peered":"2024-09-13T06:10:10.804400+0000","last_clean":"2024-09-13T06:10:10.804400+0000","last_became_active":"2024-09-13T06:09:32.128376+0000","last_became_peered":"2024-09-13T06:09:32.128376+0000","last_unstale":"2024-09-13T06:10:10.804400+0000","last_undegraded":"2024-09-13T06:10:10.804400+0000","last_fullsized":"2024-09-13T06:10:10.804400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:45:45.430627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"35'43","reported_seq":124,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.385246+0000","last_change":"2024-09-13T06:09:42.187344+0000","last_active":"2024-09-13T06:12:49.385246+0000","last_peered":"2024-09-13T06:12:49.385246+0000","last_clean":"2024-09-13T06:12:49.385246+0000","last_became_active":"2024-09-13T06:09:42.186091+0000","last_became_peered":"2024-09-13T06:09:42.186091+0000","last_unstale":"2024-09-13T06:12:49.385246+0000","last_undegraded":"2024-09-13T06:12:49.385246+0000","last_fullsized":"2024-09-13T06:12:49.385246+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:11:39.558405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":246,"num_read_kb":228,"num_write":124,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"35'16","reported_seq":106,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:48.979007+0000","last_change":"2024-09-13T06:09:34.118780+0000","last_active":"2024-09-13T06:12:48.979007+0000","last_peered":"2024-09-13T06:12:48.979007+0000","last_clean":"2024-09-13T06:12:48.979007+0000","last_became_active":"2024-09-13T06:09:34.118393+0000","last_became_peered":"2024-09-13T06:09:34.118393+0000","last_unstale":"2024-09-13T06:12:48.979007+0000","last_undegraded":"2024-09-13T06:12:48.979007+0000","last_fullsized":"2024-09-13T06:12:48.979007+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:21:29.722330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":90,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"35'6","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:19.613864+0000","last_change":"2024-09-13T06:09:32.139342+0000","last_active":"2024-09-13T06:10:19.613864+0000","last_peered":"2024-09-13T06:10:19.613864+0000","last_clean":"2024-09-13T06:10:19.613864+0000","last_became_active":"2024-09-13T06:09:32.133545+0000","last_became_peered":"2024-09-13T06:09:32.133545+0000","last_unstale":"2024-09-13T06:10:19.613864+0000","last_undegraded":"2024-09-13T06:10:19.613864+0000","last_fullsized":"2024-09-13T06:10:19.613864+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:33:10.777679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.811858+0000","last_change":"2024-09-13T06:09:36.155061+0000","last_active":"2024-09-13T06:10:10.811858+0000","last_peered":"2024-09-13T06:10:10.811858+0000","last_clean":"2024-09-13T06:10:10.811858+0000","last_became_active":"2024-09-13T06:09:36.153420+0000","last_became_peered":"2024-09-13T06:09:36.153420+0000","last_unstale":"2024-09-13T06:10:10.811858+0000","last_undegraded":"2024-09-13T06:10:10.811858+0000","last_fullsized":"2024-09-13T06:10:10.811858+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:15:11.225972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"35'30","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:45.812130+0000","last_change":"2024-09-13T06:09:38.177058+0000","last_active":"2024-09-13T06:11:45.812130+0000","last_peered":"2024-09-13T06:11:45.812130+0000","last_clean":"2024-09-13T06:11:45.812130+0000","last_became_active":"2024-09-13T06:09:38.175393+0000","last_became_peered":"2024-09-13T06:09:38.175393+0000","last_unstale":"2024-09-13T06:11:45.812130+0000","last_undegraded":"2024-09-13T06:11:45.812130+0000","last_fullsized":"2024-09-13T06:11:45.812130+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:11:00.288447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.822023+0000","last_change":"2024-09-13T06:09:40.186286+0000","last_active":"2024-09-13T06:10:10.822023+0000","last_peered":"2024-09-13T06:10:10.822023+0000","last_clean":"2024-09-13T06:10:10.822023+0000","last_became_active":"2024-09-13T06:09:40.185574+0000","last_became_peered":"2024-09-13T06:09:40.185574+0000","last_unstale":"2024-09-13T06:10:10.822023+0000","last_undegraded":"2024-09-13T06:10:10.822023+0000","last_fullsized":"2024-09-13T06:10:10.822023+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:03:19.605623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"35'9","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:02.618334+0000","last_change":"2024-09-13T06:09:42.183906+0000","last_active":"2024-09-13T06:11:02.618334+0000","last_peered":"2024-09-13T06:11:02.618334+0000","last_clean":"2024-09-13T06:11:02.618334+0000","last_became_active":"2024-09-13T06:09:42.183162+0000","last_became_peered":"2024-09-13T06:09:42.183162+0000","last_unstale":"2024-09-13T06:11:02.618334+0000","last_undegraded":"2024-09-13T06:11:02.618334+0000","last_fullsized":"2024-09-13T06:11:02.618334+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:59:27.808952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":19,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"35'6","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.321683+0000","last_change":"2024-09-13T06:09:34.120990+0000","last_active":"2024-09-13T06:12:49.321683+0000","last_peered":"2024-09-13T06:12:49.321683+0000","last_clean":"2024-09-13T06:12:49.321683+0000","last_became_active":"2024-09-13T06:09:34.120600+0000","last_became_peered":"2024-09-13T06:09:34.120600+0000","last_unstale":"2024-09-13T06:12:49.321683+0000","last_undegraded":"2024-09-13T06:12:49.321683+0000","last_fullsized":"2024-09-13T06:12:49.321683+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:55:39.596421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.794741+0000","last_change":"2024-09-13T06:09:32.139993+0000","last_active":"2024-09-13T06:10:10.794741+0000","last_peered":"2024-09-13T06:10:10.794741+0000","last_clean":"2024-09-13T06:10:10.794741+0000","last_became_active":"2024-09-13T06:09:32.138643+0000","last_became_peered":"2024-09-13T06:09:32.138643+0000","last_unstale":"2024-09-13T06:10:10.794741+0000","last_undegraded":"2024-09-13T06:10:10.794741+0000","last_fullsized":"2024-09-13T06:10:10.794741+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:53:16.188364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.946255+0000","last_change":"2024-09-13T06:09:36.139879+0000","last_active":"2024-09-13T06:10:10.946255+0000","last_peered":"2024-09-13T06:10:10.946255+0000","last_clean":"2024-09-13T06:10:10.946255+0000","last_became_active":"2024-09-13T06:09:36.139235+0000","last_became_peered":"2024-09-13T06:09:36.139235+0000","last_unstale":"2024-09-13T06:10:10.946255+0000","last_undegraded":"2024-09-13T06:10:10.946255+0000","last_fullsized":"2024-09-13T06:10:10.946255+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:12:32.105314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"33'6","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.821659+0000","last_change":"2024-09-13T06:09:38.162297+0000","last_active":"2024-09-13T06:10:10.821659+0000","last_peered":"2024-09-13T06:10:10.821659+0000","last_clean":"2024-09-13T06:10:10.821659+0000","last_became_active":"2024-09-13T06:09:38.161539+0000","last_became_peered":"2024-09-13T06:09:38.161539+0000","last_unstale":"2024-09-13T06:10:10.821659+0000","last_undegraded":"2024-09-13T06:10:10.821659+0000","last_fullsized":"2024-09-13T06:10:10.821659+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:40:25.153315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.820538+0000","last_change":"2024-09-13T06:09:40.183211+0000","last_active":"2024-09-13T06:10:10.820538+0000","last_peered":"2024-09-13T06:10:10.820538+0000","last_clean":"2024-09-13T06:10:10.820538+0000","last_became_active":"2024-09-13T06:09:40.182436+0000","last_became_peered":"2024-09-13T06:09:40.182436+0000","last_unstale":"2024-09-13T06:10:10.820538+0000","last_undegraded":"2024-09-13T06:10:10.820538+0000","last_fullsized":"2024-09-13T06:10:10.820538+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:23:15.512719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"33'2","reported_seq":19,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.943536+0000","last_change":"2024-09-13T06:09:42.209170+0000","last_active":"2024-09-13T06:10:10.943536+0000","last_peered":"2024-09-13T06:10:10.943536+0000","last_clean":"2024-09-13T06:10:10.943536+0000","last_became_active":"2024-09-13T06:09:42.208430+0000","last_became_peered":"2024-09-13T06:09:42.208430+0000","last_unstale":"2024-09-13T06:10:10.943536+0000","last_undegraded":"2024-09-13T06:10:10.943536+0000","last_fullsized":"2024-09-13T06:10:10.943536+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:29:22.362293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"35'6","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.321687+0000","last_change":"2024-09-13T06:09:34.123289+0000","last_active":"2024-09-13T06:12:49.321687+0000","last_peered":"2024-09-13T06:12:49.321687+0000","last_clean":"2024-09-13T06:12:49.321687+0000","last_became_active":"2024-09-13T06:09:34.122001+0000","last_became_peered":"2024-09-13T06:09:34.122001+0000","last_unstale":"2024-09-13T06:12:49.321687+0000","last_undegraded":"2024-09-13T06:12:49.321687+0000","last_fullsized":"2024-09-13T06:12:49.321687+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:24:35.914145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"35'1","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:52.809110+0000","last_change":"2024-09-13T06:09:32.132575+0000","last_active":"2024-09-13T06:11:52.809110+0000","last_peered":"2024-09-13T06:11:52.809110+0000","last_clean":"2024-09-13T06:11:52.809110+0000","last_became_active":"2024-09-13T06:09:32.129739+0000","last_became_peered":"2024-09-13T06:09:32.129739+0000","last_unstale":"2024-09-13T06:11:52.809110+0000","last_undegraded":"2024-09-13T06:11:52.809110+0000","last_fullsized":"2024-09-13T06:11:52.809110+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:34:42.649939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.951834+0000","last_change":"2024-09-13T06:09:36.144172+0000","last_active":"2024-09-13T06:10:10.951834+0000","last_peered":"2024-09-13T06:10:10.951834+0000","last_clean":"2024-09-13T06:10:10.951834+0000","last_became_active":"2024-09-13T06:09:36.143405+0000","last_became_peered":"2024-09-13T06:09:36.143405+0000","last_unstale":"2024-09-13T06:10:10.951834+0000","last_undegraded":"2024-09-13T06:10:10.951834+0000","last_fullsized":"2024-09-13T06:10:10.951834+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:08:14.626902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"33'10","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.797420+0000","last_change":"2024-09-13T06:09:38.155433+0000","last_active":"2024-09-13T06:10:10.797420+0000","last_peered":"2024-09-13T06:10:10.797420+0000","last_clean":"2024-09-13T06:10:10.797420+0000","last_became_active":"2024-09-13T06:09:38.154654+0000","last_became_peered":"2024-09-13T06:09:38.154654+0000","last_unstale":"2024-09-13T06:10:10.797420+0000","last_undegraded":"2024-09-13T06:10:10.797420+0000","last_fullsized":"2024-09-13T06:10:10.797420+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:57:04.837597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"35'282","reported_seq":405,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:46.394775+0000","last_change":"2024-09-13T06:09:40.192039+0000","last_active":"2024-09-13T06:12:46.394775+0000","last_peered":"2024-09-13T06:12:46.394775+0000","last_clean":"2024-09-13T06:12:46.394775+0000","last_became_active":"2024-09-13T06:09:40.190377+0000","last_became_peered":"2024-09-13T06:09:40.190377+0000","last_unstale":"2024-09-13T06:12:46.394775+0000","last_undegraded":"2024-09-13T06:12:46.394775+0000","last_fullsized":"2024-09-13T06:12:46.394775+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:35:10.494464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.796286+0000","last_change":"2024-09-13T06:09:42.204612+0000","last_active":"2024-09-13T06:10:10.796286+0000","last_peered":"2024-09-13T06:10:10.796286+0000","last_clean":"2024-09-13T06:10:10.796286+0000","last_became_active":"2024-09-13T06:09:42.204083+0000","last_became_peered":"2024-09-13T06:09:42.204083+0000","last_unstale":"2024-09-13T06:10:10.796286+0000","last_undegraded":"2024-09-13T06:10:10.796286+0000","last_fullsized":"2024-09-13T06:10:10.796286+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:07:08.179083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"35'6","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:48.235953+0000","last_change":"2024-09-13T06:09:34.131719+0000","last_active":"2024-09-13T06:11:48.235953+0000","last_peered":"2024-09-13T06:11:48.235953+0000","last_clean":"2024-09-13T06:11:48.235953+0000","last_became_active":"2024-09-13T06:09:34.130815+0000","last_became_peered":"2024-09-13T06:09:34.130815+0000","last_unstale":"2024-09-13T06:11:48.235953+0000","last_undegraded":"2024-09-13T06:11:48.235953+0000","last_fullsized":"2024-09-13T06:11:48.235953+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:14:31.056024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.807240+0000","last_change":"2024-09-13T06:09:32.118707+0000","last_active":"2024-09-13T06:10:10.807240+0000","last_peered":"2024-09-13T06:10:10.807240+0000","last_clean":"2024-09-13T06:10:10.807240+0000","last_became_active":"2024-09-13T06:09:32.118278+0000","last_became_peered":"2024-09-13T06:09:32.118278+0000","last_unstale":"2024-09-13T06:10:10.807240+0000","last_undegraded":"2024-09-13T06:10:10.807240+0000","last_fullsized":"2024-09-13T06:10:10.807240+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:27:21.997161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.826255+0000","last_change":"2024-09-13T06:10:10.825317+0000","last_active":"2024-09-13T06:10:10.826255+0000","last_peered":"2024-09-13T06:10:10.826255+0000","last_clean":"2024-09-13T06:10:10.826255+0000","last_became_active":"2024-09-13T06:10:10.824420+0000","last_became_peered":"2024-09-13T06:10:10.824420+0000","last_unstale":"2024-09-13T06:10:10.826255+0000","last_undegraded":"2024-09-13T06:10:10.826255+0000","last_fullsized":"2024-09-13T06:10:10.826255+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:36:20.133257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"35'31","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:45.803977+0000","last_change":"2024-09-13T06:09:38.158195+0000","last_active":"2024-09-13T06:11:45.803977+0000","last_peered":"2024-09-13T06:11:45.803977+0000","last_clean":"2024-09-13T06:11:45.803977+0000","last_became_active":"2024-09-13T06:09:38.157430+0000","last_became_peered":"2024-09-13T06:09:38.157430+0000","last_unstale":"2024-09-13T06:11:45.803977+0000","last_undegraded":"2024-09-13T06:11:45.803977+0000","last_fullsized":"2024-09-13T06:11:45.803977+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:00:13.206413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"35'282","reported_seq":436,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.525879+0000","last_change":"2024-09-13T06:09:40.176671+0000","last_active":"2024-09-13T06:12:49.525879+0000","last_peered":"2024-09-13T06:12:49.525879+0000","last_clean":"2024-09-13T06:12:49.525879+0000","last_became_active":"2024-09-13T06:09:40.175871+0000","last_became_peered":"2024-09-13T06:09:40.175871+0000","last_unstale":"2024-09-13T06:12:49.525879+0000","last_undegraded":"2024-09-13T06:12:49.525879+0000","last_fullsized":"2024-09-13T06:12:49.525879+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:17:37.423986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"35'2","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:43.532992+0000","last_change":"2024-09-13T06:09:34.127109+0000","last_active":"2024-09-13T06:11:43.532992+0000","last_peered":"2024-09-13T06:11:43.532992+0000","last_clean":"2024-09-13T06:11:43.532992+0000","last_became_active":"2024-09-13T06:09:34.126374+0000","last_became_peered":"2024-09-13T06:09:34.126374+0000","last_unstale":"2024-09-13T06:11:43.532992+0000","last_undegraded":"2024-09-13T06:11:43.532992+0000","last_fullsized":"2024-09-13T06:11:43.532992+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:41:31.632632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.797517+0000","last_change":"2024-09-13T06:09:32.131764+0000","last_active":"2024-09-13T06:10:10.797517+0000","last_peered":"2024-09-13T06:10:10.797517+0000","last_clean":"2024-09-13T06:10:10.797517+0000","last_became_active":"2024-09-13T06:09:32.131373+0000","last_became_peered":"2024-09-13T06:09:32.131373+0000","last_unstale":"2024-09-13T06:10:10.797517+0000","last_undegraded":"2024-09-13T06:10:10.797517+0000","last_fullsized":"2024-09-13T06:10:10.797517+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:24:08.865544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.814065+0000","last_change":"2024-09-13T06:09:36.139927+0000","last_active":"2024-09-13T06:10:10.814065+0000","last_peered":"2024-09-13T06:10:10.814065+0000","last_clean":"2024-09-13T06:10:10.814065+0000","last_became_active":"2024-09-13T06:09:36.137016+0000","last_became_peered":"2024-09-13T06:09:36.137016+0000","last_unstale":"2024-09-13T06:10:10.814065+0000","last_undegraded":"2024-09-13T06:10:10.814065+0000","last_fullsized":"2024-09-13T06:10:10.814065+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:42:25.451374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"35'40","reported_seq":87,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:45.818460+0000","last_change":"2024-09-13T06:09:38.164413+0000","last_active":"2024-09-13T06:11:45.818460+0000","last_peered":"2024-09-13T06:11:45.818460+0000","last_clean":"2024-09-13T06:11:45.818460+0000","last_became_active":"2024-09-13T06:09:38.163472+0000","last_became_peered":"2024-09-13T06:09:38.163472+0000","last_unstale":"2024-09-13T06:11:45.818460+0000","last_undegraded":"2024-09-13T06:11:45.818460+0000","last_fullsized":"2024-09-13T06:11:45.818460+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:08:16.650346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.948584+0000","last_change":"2024-09-13T06:09:40.172425+0000","last_active":"2024-09-13T06:10:10.948584+0000","last_peered":"2024-09-13T06:10:10.948584+0000","last_clean":"2024-09-13T06:10:10.948584+0000","last_became_active":"2024-09-13T06:09:40.171609+0000","last_became_peered":"2024-09-13T06:09:40.171609+0000","last_unstale":"2024-09-13T06:10:10.948584+0000","last_undegraded":"2024-09-13T06:10:10.948584+0000","last_fullsized":"2024-09-13T06:10:10.948584+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:46:09.860554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"35'5","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.403220+0000","last_change":"2024-09-13T06:09:42.208317+0000","last_active":"2024-09-13T06:12:49.403220+0000","last_peered":"2024-09-13T06:12:49.403220+0000","last_clean":"2024-09-13T06:12:49.403220+0000","last_became_active":"2024-09-13T06:09:42.193426+0000","last_became_peered":"2024-09-13T06:09:42.193426+0000","last_unstale":"2024-09-13T06:12:49.403220+0000","last_undegraded":"2024-09-13T06:12:49.403220+0000","last_fullsized":"2024-09-13T06:12:49.403220+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:49:53.497381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"35'6","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.321762+0000","last_change":"2024-09-13T06:09:34.118017+0000","last_active":"2024-09-13T06:12:49.321762+0000","last_peered":"2024-09-13T06:12:49.321762+0000","last_clean":"2024-09-13T06:12:49.321762+0000","last_became_active":"2024-09-13T06:09:34.114999+0000","last_became_peered":"2024-09-13T06:09:34.114999+0000","last_unstale":"2024-09-13T06:12:49.321762+0000","last_undegraded":"2024-09-13T06:12:49.321762+0000","last_fullsized":"2024-09-13T06:12:49.321762+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:31:56.256920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.803293+0000","last_change":"2024-09-13T06:09:32.118402+0000","last_active":"2024-09-13T06:10:10.803293+0000","last_peered":"2024-09-13T06:10:10.803293+0000","last_clean":"2024-09-13T06:10:10.803293+0000","last_became_active":"2024-09-13T06:09:32.117779+0000","last_became_peered":"2024-09-13T06:09:32.117779+0000","last_unstale":"2024-09-13T06:10:10.803293+0000","last_undegraded":"2024-09-13T06:10:10.803293+0000","last_fullsized":"2024-09-13T06:10:10.803293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:42:54.943685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.943993+0000","last_change":"2024-09-13T06:09:36.136523+0000","last_active":"2024-09-13T06:10:10.943993+0000","last_peered":"2024-09-13T06:10:10.943993+0000","last_clean":"2024-09-13T06:10:10.943993+0000","last_became_active":"2024-09-13T06:09:36.135862+0000","last_became_peered":"2024-09-13T06:09:36.135862+0000","last_unstale":"2024-09-13T06:10:10.943993+0000","last_undegraded":"2024-09-13T06:10:10.943993+0000","last_fullsized":"2024-09-13T06:10:10.943993+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:48:51.597962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"35'31","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:45.788050+0000","last_change":"2024-09-13T06:09:38.173198+0000","last_active":"2024-09-13T06:11:45.788050+0000","last_peered":"2024-09-13T06:11:45.788050+0000","last_clean":"2024-09-13T06:11:45.788050+0000","last_became_active":"2024-09-13T06:09:38.171931+0000","last_became_peered":"2024-09-13T06:09:38.171931+0000","last_unstale":"2024-09-13T06:11:45.788050+0000","last_undegraded":"2024-09-13T06:11:45.788050+0000","last_fullsized":"2024-09-13T06:11:45.788050+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:38:56.011466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.945598+0000","last_change":"2024-09-13T06:09:40.179448+0000","last_active":"2024-09-13T06:10:10.945598+0000","last_peered":"2024-09-13T06:10:10.945598+0000","last_clean":"2024-09-13T06:10:10.945598+0000","last_became_active":"2024-09-13T06:09:40.178545+0000","last_became_peered":"2024-09-13T06:09:40.178545+0000","last_unstale":"2024-09-13T06:10:10.945598+0000","last_undegraded":"2024-09-13T06:10:10.945598+0000","last_fullsized":"2024-09-13T06:10:10.945598+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:54:35.378117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"35'5","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.000310+0000","last_change":"2024-09-13T06:09:42.206012+0000","last_active":"2024-09-13T06:12:49.000310+0000","last_peered":"2024-09-13T06:12:49.000310+0000","last_clean":"2024-09-13T06:12:49.000310+0000","last_became_active":"2024-09-13T06:09:42.204945+0000","last_became_peered":"2024-09-13T06:09:42.204945+0000","last_unstale":"2024-09-13T06:12:49.000310+0000","last_undegraded":"2024-09-13T06:12:49.000310+0000","last_fullsized":"2024-09-13T06:12:49.000310+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:32:49.081082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"33'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.799349+0000","last_change":"2024-09-13T06:09:34.104885+0000","last_active":"2024-09-13T06:10:10.799349+0000","last_peered":"2024-09-13T06:10:10.799349+0000","last_clean":"2024-09-13T06:10:10.799349+0000","last_became_active":"2024-09-13T06:09:34.102657+0000","last_became_peered":"2024-09-13T06:09:34.102657+0000","last_unstale":"2024-09-13T06:10:10.799349+0000","last_undegraded":"2024-09-13T06:10:10.799349+0000","last_fullsized":"2024-09-13T06:10:10.799349+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:18:18.221662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"35'5","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.500828+0000","last_change":"2024-09-13T06:09:32.136390+0000","last_active":"2024-09-13T06:12:49.500828+0000","last_peered":"2024-09-13T06:12:49.500828+0000","last_clean":"2024-09-13T06:12:49.500828+0000","last_became_active":"2024-09-13T06:09:32.133020+0000","last_became_peered":"2024-09-13T06:09:32.133020+0000","last_unstale":"2024-09-13T06:12:49.500828+0000","last_undegraded":"2024-09-13T06:12:49.500828+0000","last_fullsized":"2024-09-13T06:12:49.500828+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:29:18.318697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":21,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:11.778692+0000","last_change":"2024-09-13T06:10:10.810157+0000","last_active":"2024-09-13T06:10:11.778692+0000","last_peered":"2024-09-13T06:10:11.778692+0000","last_clean":"2024-09-13T06:10:11.778692+0000","last_became_active":"2024-09-13T06:10:10.809442+0000","last_became_peered":"2024-09-13T06:10:10.809442+0000","last_unstale":"2024-09-13T06:10:11.778692+0000","last_undegraded":"2024-09-13T06:10:11.778692+0000","last_fullsized":"2024-09-13T06:10:11.778692+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:15:18.836646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"35'36","reported_seq":81,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:45.821011+0000","last_change":"2024-09-13T06:09:38.155448+0000","last_active":"2024-09-13T06:11:45.821011+0000","last_peered":"2024-09-13T06:11:45.821011+0000","last_clean":"2024-09-13T06:11:45.821011+0000","last_became_active":"2024-09-13T06:09:38.154720+0000","last_became_peered":"2024-09-13T06:09:38.154720+0000","last_unstale":"2024-09-13T06:11:45.821011+0000","last_undegraded":"2024-09-13T06:11:45.821011+0000","last_fullsized":"2024-09-13T06:11:45.821011+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:23:45.584512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"35'282","reported_seq":398,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.868570+0000","last_change":"2024-09-13T06:09:40.187775+0000","last_active":"2024-09-13T06:12:49.868570+0000","last_peered":"2024-09-13T06:12:49.868570+0000","last_clean":"2024-09-13T06:12:49.868570+0000","last_became_active":"2024-09-13T06:09:40.186987+0000","last_became_peered":"2024-09-13T06:09:40.186987+0000","last_unstale":"2024-09-13T06:12:49.868570+0000","last_undegraded":"2024-09-13T06:12:49.868570+0000","last_fullsized":"2024-09-13T06:12:49.868570+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:05:45.705137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"35'2","reported_seq":19,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:48.226943+0000","last_change":"2024-09-13T06:09:42.202356+0000","last_active":"2024-09-13T06:11:48.226943+0000","last_peered":"2024-09-13T06:11:48.226943+0000","last_clean":"2024-09-13T06:11:48.226943+0000","last_became_active":"2024-09-13T06:09:42.201678+0000","last_became_peered":"2024-09-13T06:09:42.201678+0000","last_unstale":"2024-09-13T06:11:48.226943+0000","last_undegraded":"2024-09-13T06:11:48.226943+0000","last_fullsized":"2024-09-13T06:11:48.226943+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:44:32.357425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"35'14","reported_seq":69,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:48.237783+0000","last_change":"2024-09-13T06:09:34.103681+0000","last_active":"2024-09-13T06:11:48.237783+0000","last_peered":"2024-09-13T06:11:48.237783+0000","last_clean":"2024-09-13T06:11:48.237783+0000","last_became_active":"2024-09-13T06:09:34.103295+0000","last_became_peered":"2024-09-13T06:09:34.103295+0000","last_unstale":"2024-09-13T06:11:48.237783+0000","last_undegraded":"2024-09-13T06:11:48.237783+0000","last_fullsized":"2024-09-13T06:11:48.237783+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:12:41.439746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.809624+0000","last_change":"2024-09-13T06:09:32.128209+0000","last_active":"2024-09-13T06:10:10.809624+0000","last_peered":"2024-09-13T06:10:10.809624+0000","last_clean":"2024-09-13T06:10:10.809624+0000","last_became_active":"2024-09-13T06:09:32.125047+0000","last_became_peered":"2024-09-13T06:09:32.125047+0000","last_unstale":"2024-09-13T06:10:10.809624+0000","last_undegraded":"2024-09-13T06:10:10.809624+0000","last_fullsized":"2024-09-13T06:10:10.809624+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:22:25.339690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.946037+0000","last_change":"2024-09-13T06:09:36.136740+0000","last_active":"2024-09-13T06:10:10.946037+0000","last_peered":"2024-09-13T06:10:10.946037+0000","last_clean":"2024-09-13T06:10:10.946037+0000","last_became_active":"2024-09-13T06:09:36.135896+0000","last_became_peered":"2024-09-13T06:09:36.135896+0000","last_unstale":"2024-09-13T06:10:10.946037+0000","last_undegraded":"2024-09-13T06:10:10.946037+0000","last_fullsized":"2024-09-13T06:10:10.946037+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:38:41.311788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"35'56","reported_seq":112,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:47.807514+0000","last_change":"2024-09-13T06:09:38.176653+0000","last_active":"2024-09-13T06:11:47.807514+0000","last_peered":"2024-09-13T06:11:47.807514+0000","last_clean":"2024-09-13T06:11:47.807514+0000","last_became_active":"2024-09-13T06:09:38.175404+0000","last_became_peered":"2024-09-13T06:09:38.175404+0000","last_unstale":"2024-09-13T06:11:47.807514+0000","last_undegraded":"2024-09-13T06:11:47.807514+0000","last_fullsized":"2024-09-13T06:11:47.807514+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:20:41.974878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5916,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":51,"num_read_kb":42,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.943056+0000","last_change":"2024-09-13T06:09:40.178019+0000","last_active":"2024-09-13T06:10:10.943056+0000","last_peered":"2024-09-13T06:10:10.943056+0000","last_clean":"2024-09-13T06:10:10.943056+0000","last_became_active":"2024-09-13T06:09:40.177127+0000","last_became_peered":"2024-09-13T06:09:40.177127+0000","last_unstale":"2024-09-13T06:10:10.943056+0000","last_undegraded":"2024-09-13T06:10:10.943056+0000","last_fullsized":"2024-09-13T06:10:10.943056+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:03:59.282151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"35'18","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.796652+0000","last_change":"2024-09-13T06:09:42.177354+0000","last_active":"2024-09-13T06:12:49.796652+0000","last_peered":"2024-09-13T06:12:49.796652+0000","last_clean":"2024-09-13T06:12:49.796652+0000","last_became_active":"2024-09-13T06:09:42.176229+0000","last_became_peered":"2024-09-13T06:09:42.176229+0000","last_unstale":"2024-09-13T06:12:49.796652+0000","last_undegraded":"2024-09-13T06:12:49.796652+0000","last_fullsized":"2024-09-13T06:12:49.796652+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:00:06.521241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"35'16","reported_seq":77,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.114923+0000","last_change":"2024-09-13T06:09:34.121751+0000","last_active":"2024-09-13T06:12:49.114923+0000","last_peered":"2024-09-13T06:12:49.114923+0000","last_clean":"2024-09-13T06:12:49.114923+0000","last_became_active":"2024-09-13T06:09:34.119018+0000","last_became_peered":"2024-09-13T06:09:34.119018+0000","last_unstale":"2024-09-13T06:12:49.114923+0000","last_undegraded":"2024-09-13T06:12:49.114923+0000","last_fullsized":"2024-09-13T06:12:49.114923+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:43:00.917159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"35'1","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:50.799501+0000","last_change":"2024-09-13T06:09:32.151752+0000","last_active":"2024-09-13T06:11:50.799501+0000","last_peered":"2024-09-13T06:11:50.799501+0000","last_clean":"2024-09-13T06:11:50.799501+0000","last_became_active":"2024-09-13T06:09:32.148505+0000","last_became_peered":"2024-09-13T06:09:32.148505+0000","last_unstale":"2024-09-13T06:11:50.799501+0000","last_undegraded":"2024-09-13T06:11:50.799501+0000","last_fullsized":"2024-09-13T06:11:50.799501+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:15:48.717644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.807504+0000","last_change":"2024-09-13T06:09:36.132310+0000","last_active":"2024-09-13T06:10:10.807504+0000","last_peered":"2024-09-13T06:10:10.807504+0000","last_clean":"2024-09-13T06:10:10.807504+0000","last_became_active":"2024-09-13T06:09:36.131611+0000","last_became_peered":"2024-09-13T06:09:36.131611+0000","last_unstale":"2024-09-13T06:10:10.807504+0000","last_undegraded":"2024-09-13T06:10:10.807504+0000","last_fullsized":"2024-09-13T06:10:10.807504+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:13:56.015822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"35'33","reported_seq":76,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:48.241969+0000","last_change":"2024-09-13T06:09:38.166492+0000","last_active":"2024-09-13T06:11:48.241969+0000","last_peered":"2024-09-13T06:11:48.241969+0000","last_clean":"2024-09-13T06:11:48.241969+0000","last_became_active":"2024-09-13T06:09:38.165747+0000","last_became_peered":"2024-09-13T06:09:38.165747+0000","last_unstale":"2024-09-13T06:11:48.241969+0000","last_undegraded":"2024-09-13T06:11:48.241969+0000","last_fullsized":"2024-09-13T06:11:48.241969+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:11:40.651218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.816868+0000","last_change":"2024-09-13T06:09:40.190860+0000","last_active":"2024-09-13T06:10:10.816868+0000","last_peered":"2024-09-13T06:10:10.816868+0000","last_clean":"2024-09-13T06:10:10.816868+0000","last_became_active":"2024-09-13T06:09:40.190314+0000","last_became_peered":"2024-09-13T06:09:40.190314+0000","last_unstale":"2024-09-13T06:10:10.816868+0000","last_undegraded":"2024-09-13T06:10:10.816868+0000","last_fullsized":"2024-09-13T06:10:10.816868+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:52:35.906978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"35'3","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:45.410142+0000","last_change":"2024-09-13T06:09:42.202356+0000","last_active":"2024-09-13T06:11:45.410142+0000","last_peered":"2024-09-13T06:11:45.410142+0000","last_clean":"2024-09-13T06:11:45.410142+0000","last_became_active":"2024-09-13T06:09:42.201211+0000","last_became_peered":"2024-09-13T06:09:42.201211+0000","last_unstale":"2024-09-13T06:11:45.410142+0000","last_undegraded":"2024-09-13T06:11:45.410142+0000","last_fullsized":"2024-09-13T06:11:45.410142+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:35:04.349746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"35'5","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.455185+0000","last_change":"2024-09-13T06:09:34.132190+0000","last_active":"2024-09-13T06:12:49.455185+0000","last_peered":"2024-09-13T06:12:49.455185+0000","last_clean":"2024-09-13T06:12:49.455185+0000","last_became_active":"2024-09-13T06:09:34.131882+0000","last_became_peered":"2024-09-13T06:09:34.131882+0000","last_unstale":"2024-09-13T06:12:49.455185+0000","last_undegraded":"2024-09-13T06:12:49.455185+0000","last_fullsized":"2024-09-13T06:12:49.455185+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:12:40.844517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.805785+0000","last_change":"2024-09-13T06:09:32.143831+0000","last_active":"2024-09-13T06:10:10.805785+0000","last_peered":"2024-09-13T06:10:10.805785+0000","last_clean":"2024-09-13T06:10:10.805785+0000","last_became_active":"2024-09-13T06:09:32.138731+0000","last_became_peered":"2024-09-13T06:09:32.138731+0000","last_unstale":"2024-09-13T06:10:10.805785+0000","last_undegraded":"2024-09-13T06:10:10.805785+0000","last_fullsized":"2024-09-13T06:10:10.805785+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:23:59.928536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.946508+0000","last_change":"2024-09-13T06:09:36.136407+0000","last_active":"2024-09-13T06:10:10.946508+0000","last_peered":"2024-09-13T06:10:10.946508+0000","last_clean":"2024-09-13T06:10:10.946508+0000","last_became_active":"2024-09-13T06:09:36.135660+0000","last_became_peered":"2024-09-13T06:09:36.135660+0000","last_unstale":"2024-09-13T06:10:10.946508+0000","last_undegraded":"2024-09-13T06:10:10.946508+0000","last_fullsized":"2024-09-13T06:10:10.946508+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:13:54.253064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"35'37","reported_seq":82,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:45.837051+0000","last_change":"2024-09-13T06:09:38.144183+0000","last_active":"2024-09-13T06:11:45.837051+0000","last_peered":"2024-09-13T06:11:45.837051+0000","last_clean":"2024-09-13T06:11:45.837051+0000","last_became_active":"2024-09-13T06:09:38.143209+0000","last_became_peered":"2024-09-13T06:09:38.143209+0000","last_unstale":"2024-09-13T06:11:45.837051+0000","last_undegraded":"2024-09-13T06:11:45.837051+0000","last_fullsized":"2024-09-13T06:11:45.837051+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:50:01.265885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"35'282","reported_seq":404,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.808418+0000","last_change":"2024-09-13T06:09:40.188885+0000","last_active":"2024-09-13T06:12:49.808418+0000","last_peered":"2024-09-13T06:12:49.808418+0000","last_clean":"2024-09-13T06:12:49.808418+0000","last_became_active":"2024-09-13T06:09:40.188246+0000","last_became_peered":"2024-09-13T06:09:40.188246+0000","last_unstale":"2024-09-13T06:12:49.808418+0000","last_undegraded":"2024-09-13T06:12:49.808418+0000","last_fullsized":"2024-09-13T06:12:49.808418+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:10:07.607618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"35'16","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:50.799267+0000","last_change":"2024-09-13T06:09:42.201997+0000","last_active":"2024-09-13T06:11:50.799267+0000","last_peered":"2024-09-13T06:11:50.799267+0000","last_clean":"2024-09-13T06:11:50.799267+0000","last_became_active":"2024-09-13T06:09:42.201304+0000","last_became_peered":"2024-09-13T06:09:42.201304+0000","last_unstale":"2024-09-13T06:11:50.799267+0000","last_undegraded":"2024-09-13T06:11:50.799267+0000","last_fullsized":"2024-09-13T06:11:50.799267+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:45:43.763240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":29,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"35'4","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:48.236290+0000","last_change":"2024-09-13T06:09:34.102998+0000","last_active":"2024-09-13T06:11:48.236290+0000","last_peered":"2024-09-13T06:11:48.236290+0000","last_clean":"2024-09-13T06:11:48.236290+0000","last_became_active":"2024-09-13T06:09:34.102586+0000","last_became_peered":"2024-09-13T06:09:34.102586+0000","last_unstale":"2024-09-13T06:11:48.236290+0000","last_undegraded":"2024-09-13T06:11:48.236290+0000","last_fullsized":"2024-09-13T06:11:48.236290+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:03:45.932431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:48.859872+0000","last_change":"2024-09-13T06:09:32.125108+0000","last_active":"2024-09-13T06:12:48.859872+0000","last_peered":"2024-09-13T06:12:48.859872+0000","last_clean":"2024-09-13T06:12:48.859872+0000","last_became_active":"2024-09-13T06:09:32.122121+0000","last_became_peered":"2024-09-13T06:09:32.122121+0000","last_unstale":"2024-09-13T06:12:48.859872+0000","last_undegraded":"2024-09-13T06:12:48.859872+0000","last_fullsized":"2024-09-13T06:12:48.859872+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:04:21.918429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"35'3","reported_seq":413,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:47.370234+0000","last_change":"2024-09-13T06:09:36.143569+0000","last_active":"2024-09-13T06:11:47.370234+0000","last_peered":"2024-09-13T06:11:47.370234+0000","last_clean":"2024-09-13T06:11:47.370234+0000","last_became_active":"2024-09-13T06:09:36.141789+0000","last_became_peered":"2024-09-13T06:09:36.141789+0000","last_unstale":"2024-09-13T06:11:47.370234+0000","last_undegraded":"2024-09-13T06:11:47.370234+0000","last_fullsized":"2024-09-13T06:11:47.370234+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:45:41.784572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"33'10","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.811432+0000","last_change":"2024-09-13T06:09:38.177849+0000","last_active":"2024-09-13T06:10:10.811432+0000","last_peered":"2024-09-13T06:10:10.811432+0000","last_clean":"2024-09-13T06:10:10.811432+0000","last_became_active":"2024-09-13T06:09:38.177217+0000","last_became_peered":"2024-09-13T06:09:38.177217+0000","last_unstale":"2024-09-13T06:10:10.811432+0000","last_undegraded":"2024-09-13T06:10:10.811432+0000","last_fullsized":"2024-09-13T06:10:10.811432+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:10.962665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"35'282","reported_seq":460,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.674152+0000","last_change":"2024-09-13T06:09:40.181202+0000","last_active":"2024-09-13T06:12:49.674152+0000","last_peered":"2024-09-13T06:12:49.674152+0000","last_clean":"2024-09-13T06:12:49.674152+0000","last_became_active":"2024-09-13T06:09:40.179438+0000","last_became_peered":"2024-09-13T06:09:40.179438+0000","last_unstale":"2024-09-13T06:12:49.674152+0000","last_undegraded":"2024-09-13T06:12:49.674152+0000","last_fullsized":"2024-09-13T06:12:49.674152+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:27:07.073401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"35'6","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:47.594182+0000","last_change":"2024-09-13T06:09:42.204120+0000","last_active":"2024-09-13T06:11:47.594182+0000","last_peered":"2024-09-13T06:11:47.594182+0000","last_clean":"2024-09-13T06:11:47.594182+0000","last_became_active":"2024-09-13T06:09:42.181854+0000","last_became_peered":"2024-09-13T06:09:42.181854+0000","last_unstale":"2024-09-13T06:11:47.594182+0000","last_undegraded":"2024-09-13T06:11:47.594182+0000","last_fullsized":"2024-09-13T06:11:47.594182+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:16:33.568846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.822741+0000","last_change":"2024-09-13T06:09:34.127227+0000","last_active":"2024-09-13T06:10:10.822741+0000","last_peered":"2024-09-13T06:10:10.822741+0000","last_clean":"2024-09-13T06:10:10.822741+0000","last_became_active":"2024-09-13T06:09:34.126843+0000","last_became_peered":"2024-09-13T06:09:34.126843+0000","last_unstale":"2024-09-13T06:10:10.822741+0000","last_undegraded":"2024-09-13T06:10:10.822741+0000","last_fullsized":"2024-09-13T06:10:10.822741+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:44:57.098322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"35'5","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:02.598499+0000","last_change":"2024-09-13T06:09:32.133494+0000","last_active":"2024-09-13T06:11:02.598499+0000","last_peered":"2024-09-13T06:11:02.598499+0000","last_clean":"2024-09-13T06:11:02.598499+0000","last_became_active":"2024-09-13T06:09:32.129984+0000","last_became_peered":"2024-09-13T06:09:32.129984+0000","last_unstale":"2024-09-13T06:11:02.598499+0000","last_undegraded":"2024-09-13T06:11:02.598499+0000","last_fullsized":"2024-09-13T06:11:02.598499+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:45:08.493467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.818317+0000","last_change":"2024-09-13T06:09:36.155279+0000","last_active":"2024-09-13T06:10:10.818317+0000","last_peered":"2024-09-13T06:10:10.818317+0000","last_clean":"2024-09-13T06:10:10.818317+0000","last_became_active":"2024-09-13T06:09:36.153614+0000","last_became_peered":"2024-09-13T06:09:36.153614+0000","last_unstale":"2024-09-13T06:10:10.818317+0000","last_undegraded":"2024-09-13T06:10:10.818317+0000","last_fullsized":"2024-09-13T06:10:10.818317+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:27:07.877373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"35'38","reported_seq":84,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:45.813983+0000","last_change":"2024-09-13T06:09:38.158380+0000","last_active":"2024-09-13T06:11:45.813983+0000","last_peered":"2024-09-13T06:11:45.813983+0000","last_clean":"2024-09-13T06:11:45.813983+0000","last_became_active":"2024-09-13T06:09:38.155463+0000","last_became_peered":"2024-09-13T06:09:38.155463+0000","last_unstale":"2024-09-13T06:11:45.813983+0000","last_undegraded":"2024-09-13T06:11:45.813983+0000","last_fullsized":"2024-09-13T06:11:45.813983+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:24:39.953684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.796986+0000","last_change":"2024-09-13T06:09:40.169126+0000","last_active":"2024-09-13T06:10:10.796986+0000","last_peered":"2024-09-13T06:10:10.796986+0000","last_clean":"2024-09-13T06:10:10.796986+0000","last_became_active":"2024-09-13T06:09:40.167733+0000","last_became_peered":"2024-09-13T06:09:40.167733+0000","last_unstale":"2024-09-13T06:10:10.796986+0000","last_undegraded":"2024-09-13T06:10:10.796986+0000","last_fullsized":"2024-09-13T06:10:10.796986+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:10:42.824333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"35'6","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.608133+0000","last_change":"2024-09-13T06:09:42.177915+0000","last_active":"2024-09-13T06:12:49.608133+0000","last_peered":"2024-09-13T06:12:49.608133+0000","last_clean":"2024-09-13T06:12:49.608133+0000","last_became_active":"2024-09-13T06:09:42.172937+0000","last_became_peered":"2024-09-13T06:09:42.172937+0000","last_unstale":"2024-09-13T06:12:49.608133+0000","last_undegraded":"2024-09-13T06:12:49.608133+0000","last_fullsized":"2024-09-13T06:12:49.608133+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:30:04.561419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"35'12","reported_seq":77,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:18.855926+0000","last_change":"2024-09-13T06:09:34.131384+0000","last_active":"2024-09-13T06:10:18.855926+0000","last_peered":"2024-09-13T06:10:18.855926+0000","last_clean":"2024-09-13T06:10:18.855926+0000","last_became_active":"2024-09-13T06:09:34.131113+0000","last_became_peered":"2024-09-13T06:09:34.131113+0000","last_unstale":"2024-09-13T06:10:18.855926+0000","last_undegraded":"2024-09-13T06:10:18.855926+0000","last_fullsized":"2024-09-13T06:10:18.855926+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:51:08.067895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":60,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"14'117","reported_seq":205,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.805897+0000","last_change":"2024-09-13T06:09:19.565573+0000","last_active":"2024-09-13T06:10:10.805897+0000","last_peered":"2024-09-13T06:10:10.805897+0000","last_clean":"2024-09-13T06:10:10.805897+0000","last_became_active":"2024-09-13T06:09:19.561434+0000","last_became_peered":"2024-09-13T06:09:19.561434+0000","last_unstale":"2024-09-13T06:10:10.805897+0000","last_undegraded":"2024-09-13T06:10:10.805897+0000","last_fullsized":"2024-09-13T06:10:10.805897+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:18.163598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:18.163598+0000","last_clean_scrub_stamp":"2024-09-13T06:09:18.163598+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:04:43.437453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.809377+0000","last_change":"2024-09-13T06:09:24.220777+0000","last_active":"2024-09-13T06:10:10.809377+0000","last_peered":"2024-09-13T06:10:10.809377+0000","last_clean":"2024-09-13T06:10:10.809377+0000","last_became_active":"2024-09-13T06:09:22.217131+0000","last_became_peered":"2024-09-13T06:09:22.217131+0000","last_unstale":"2024-09-13T06:10:10.809377+0000","last_undegraded":"2024-09-13T06:10:10.809377+0000","last_fullsized":"2024-09-13T06:10:10.809377+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_clean_scrub_stamp":"2024-09-13T06:09:21.188659+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:58:05.578609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090967000000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"35'4","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:18.041669+0000","last_change":"2024-09-13T06:09:32.144633+0000","last_active":"2024-09-13T06:10:18.041669+0000","last_peered":"2024-09-13T06:10:18.041669+0000","last_clean":"2024-09-13T06:10:18.041669+0000","last_became_active":"2024-09-13T06:09:32.141646+0000","last_became_peered":"2024-09-13T06:09:32.141646+0000","last_unstale":"2024-09-13T06:10:18.041669+0000","last_undegraded":"2024-09-13T06:10:18.041669+0000","last_fullsized":"2024-09-13T06:10:18.041669+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:53:43.971322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.818078+0000","last_change":"2024-09-13T06:09:36.141123+0000","last_active":"2024-09-13T06:10:10.818078+0000","last_peered":"2024-09-13T06:10:10.818078+0000","last_clean":"2024-09-13T06:10:10.818078+0000","last_became_active":"2024-09-13T06:09:36.140417+0000","last_became_peered":"2024-09-13T06:09:36.140417+0000","last_unstale":"2024-09-13T06:10:10.818078+0000","last_undegraded":"2024-09-13T06:10:10.818078+0000","last_fullsized":"2024-09-13T06:10:10.818078+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:44:41.173375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"35'76","reported_seq":145,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:45.831796+0000","last_change":"2024-09-13T06:09:38.177538+0000","last_active":"2024-09-13T06:11:45.831796+0000","last_peered":"2024-09-13T06:11:45.831796+0000","last_clean":"2024-09-13T06:11:45.831796+0000","last_became_active":"2024-09-13T06:09:38.176365+0000","last_became_peered":"2024-09-13T06:09:38.176365+0000","last_unstale":"2024-09-13T06:11:45.831796+0000","last_undegraded":"2024-09-13T06:11:45.831796+0000","last_fullsized":"2024-09-13T06:11:45.831796+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:56:32.152357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.948040+0000","last_change":"2024-09-13T06:09:40.180407+0000","last_active":"2024-09-13T06:10:10.948040+0000","last_peered":"2024-09-13T06:10:10.948040+0000","last_clean":"2024-09-13T06:10:10.948040+0000","last_became_active":"2024-09-13T06:09:40.178872+0000","last_became_peered":"2024-09-13T06:09:40.178872+0000","last_unstale":"2024-09-13T06:10:10.948040+0000","last_undegraded":"2024-09-13T06:10:10.948040+0000","last_fullsized":"2024-09-13T06:10:10.948040+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:52:35.265077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"35'82","reported_seq":163,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.540178+0000","last_change":"2024-09-13T06:09:42.198530+0000","last_active":"2024-09-13T06:12:49.540178+0000","last_peered":"2024-09-13T06:12:49.540178+0000","last_clean":"2024-09-13T06:12:49.540178+0000","last_became_active":"2024-09-13T06:09:42.197803+0000","last_became_peered":"2024-09-13T06:09:42.197803+0000","last_unstale":"2024-09-13T06:12:49.540178+0000","last_undegraded":"2024-09-13T06:12:49.540178+0000","last_fullsized":"2024-09-13T06:12:49.540178+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:45:34.331341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"35'9","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.532885+0000","last_change":"2024-09-13T06:10:10.942337+0000","last_active":"2024-09-13T06:12:49.532885+0000","last_peered":"2024-09-13T06:12:49.532885+0000","last_clean":"2024-09-13T06:12:49.532885+0000","last_became_active":"2024-09-13T06:10:10.941771+0000","last_became_peered":"2024-09-13T06:10:10.941771+0000","last_unstale":"2024-09-13T06:12:49.532885+0000","last_undegraded":"2024-09-13T06:12:49.532885+0000","last_fullsized":"2024-09-13T06:12:49.532885+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:28:10.595005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.800700+0000","last_change":"2024-09-13T06:09:24.220722+0000","last_active":"2024-09-13T06:10:10.800700+0000","last_peered":"2024-09-13T06:10:10.800700+0000","last_clean":"2024-09-13T06:10:10.800700+0000","last_became_active":"2024-09-13T06:09:22.217643+0000","last_became_peered":"2024-09-13T06:09:22.217643+0000","last_unstale":"2024-09-13T06:10:10.800700+0000","last_undegraded":"2024-09-13T06:10:10.800700+0000","last_fullsized":"2024-09-13T06:10:10.800700+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_clean_scrub_stamp":"2024-09-13T06:09:21.188659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:44:20.577838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082521999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:48.095340+0000","last_change":"2024-09-13T06:09:32.151263+0000","last_active":"2024-09-13T06:11:48.095340+0000","last_peered":"2024-09-13T06:11:48.095340+0000","last_clean":"2024-09-13T06:11:48.095340+0000","last_became_active":"2024-09-13T06:09:32.147837+0000","last_became_peered":"2024-09-13T06:09:32.147837+0000","last_unstale":"2024-09-13T06:11:48.095340+0000","last_undegraded":"2024-09-13T06:11:48.095340+0000","last_fullsized":"2024-09-13T06:11:48.095340+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:55:55.407168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.817292+0000","last_change":"2024-09-13T06:09:36.154146+0000","last_active":"2024-09-13T06:10:10.817292+0000","last_peered":"2024-09-13T06:10:10.817292+0000","last_clean":"2024-09-13T06:10:10.817292+0000","last_became_active":"2024-09-13T06:09:36.153430+0000","last_became_peered":"2024-09-13T06:09:36.153430+0000","last_unstale":"2024-09-13T06:10:10.817292+0000","last_undegraded":"2024-09-13T06:10:10.817292+0000","last_fullsized":"2024-09-13T06:10:10.817292+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:50:22.555296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"35'274","reported_seq":478,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.347794+0000","last_change":"2024-09-13T06:09:38.160949+0000","last_active":"2024-09-13T06:12:49.347794+0000","last_peered":"2024-09-13T06:12:49.347794+0000","last_clean":"2024-09-13T06:12:49.347794+0000","last_became_active":"2024-09-13T06:09:38.160192+0000","last_became_peered":"2024-09-13T06:09:38.160192+0000","last_unstale":"2024-09-13T06:12:49.347794+0000","last_undegraded":"2024-09-13T06:12:49.347794+0000","last_fullsized":"2024-09-13T06:12:49.347794+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:36:16.623805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.810896+0000","last_change":"2024-09-13T06:09:40.189965+0000","last_active":"2024-09-13T06:10:10.810896+0000","last_peered":"2024-09-13T06:10:10.810896+0000","last_clean":"2024-09-13T06:10:10.810896+0000","last_became_active":"2024-09-13T06:09:40.188859+0000","last_became_peered":"2024-09-13T06:09:40.188859+0000","last_unstale":"2024-09-13T06:10:10.810896+0000","last_undegraded":"2024-09-13T06:10:10.810896+0000","last_fullsized":"2024-09-13T06:10:10.810896+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:09:59.010638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"35'5","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.668016+0000","last_change":"2024-09-13T06:09:42.205523+0000","last_active":"2024-09-13T06:12:49.668016+0000","last_peered":"2024-09-13T06:12:49.668016+0000","last_clean":"2024-09-13T06:12:49.668016+0000","last_became_active":"2024-09-13T06:09:42.204736+0000","last_became_peered":"2024-09-13T06:09:42.204736+0000","last_unstale":"2024-09-13T06:12:49.668016+0000","last_undegraded":"2024-09-13T06:12:49.668016+0000","last_fullsized":"2024-09-13T06:12:49.668016+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:13:21.283440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"35'8","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:02.611023+0000","last_change":"2024-09-13T06:09:34.132298+0000","last_active":"2024-09-13T06:11:02.611023+0000","last_peered":"2024-09-13T06:11:02.611023+0000","last_clean":"2024-09-13T06:11:02.611023+0000","last_became_active":"2024-09-13T06:09:34.131564+0000","last_became_peered":"2024-09-13T06:09:34.131564+0000","last_unstale":"2024-09-13T06:11:02.611023+0000","last_undegraded":"2024-09-13T06:11:02.611023+0000","last_fullsized":"2024-09-13T06:11:02.611023+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:50:10.277490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.795564+0000","last_change":"2024-09-13T06:09:24.565111+0000","last_active":"2024-09-13T06:10:10.795564+0000","last_peered":"2024-09-13T06:10:10.795564+0000","last_clean":"2024-09-13T06:10:10.795564+0000","last_became_active":"2024-09-13T06:09:22.214952+0000","last_became_peered":"2024-09-13T06:09:22.214952+0000","last_unstale":"2024-09-13T06:10:10.795564+0000","last_undegraded":"2024-09-13T06:10:10.795564+0000","last_fullsized":"2024-09-13T06:10:10.795564+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_clean_scrub_stamp":"2024-09-13T06:09:21.188659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:20:29.599784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097860299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.942408+0000","last_change":"2024-09-13T06:09:32.152695+0000","last_active":"2024-09-13T06:10:10.942408+0000","last_peered":"2024-09-13T06:10:10.942408+0000","last_clean":"2024-09-13T06:10:10.942408+0000","last_became_active":"2024-09-13T06:09:32.148803+0000","last_became_peered":"2024-09-13T06:09:32.148803+0000","last_unstale":"2024-09-13T06:10:10.942408+0000","last_undegraded":"2024-09-13T06:10:10.942408+0000","last_fullsized":"2024-09-13T06:10:10.942408+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:16:11.746030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"26'1","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.797255+0000","last_change":"2024-09-13T06:09:36.127208+0000","last_active":"2024-09-13T06:10:10.797255+0000","last_peered":"2024-09-13T06:10:10.797255+0000","last_clean":"2024-09-13T06:10:10.797255+0000","last_became_active":"2024-09-13T06:09:36.126497+0000","last_became_peered":"2024-09-13T06:09:36.126497+0000","last_unstale":"2024-09-13T06:10:10.797255+0000","last_undegraded":"2024-09-13T06:10:10.797255+0000","last_fullsized":"2024-09-13T06:10:10.797255+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:34:31.838383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"35'16","reported_seq":85,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:46.394535+0000","last_change":"2024-09-13T06:09:38.163577+0000","last_active":"2024-09-13T06:12:46.394535+0000","last_peered":"2024-09-13T06:12:46.394535+0000","last_clean":"2024-09-13T06:12:46.394535+0000","last_became_active":"2024-09-13T06:09:38.162358+0000","last_became_peered":"2024-09-13T06:09:38.162358+0000","last_unstale":"2024-09-13T06:12:46.394535+0000","last_undegraded":"2024-09-13T06:12:46.394535+0000","last_fullsized":"2024-09-13T06:12:46.394535+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:37:23.050896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.948281+0000","last_change":"2024-09-13T06:09:40.180051+0000","last_active":"2024-09-13T06:10:10.948281+0000","last_peered":"2024-09-13T06:10:10.948281+0000","last_clean":"2024-09-13T06:10:10.948281+0000","last_became_active":"2024-09-13T06:09:40.179250+0000","last_became_peered":"2024-09-13T06:09:40.179250+0000","last_unstale":"2024-09-13T06:10:10.948281+0000","last_undegraded":"2024-09-13T06:10:10.948281+0000","last_fullsized":"2024-09-13T06:10:10.948281+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:45:23.967679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"33'2","reported_seq":19,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.802883+0000","last_change":"2024-09-13T06:09:42.203843+0000","last_active":"2024-09-13T06:10:10.802883+0000","last_peered":"2024-09-13T06:10:10.802883+0000","last_clean":"2024-09-13T06:10:10.802883+0000","last_became_active":"2024-09-13T06:09:42.203232+0000","last_became_peered":"2024-09-13T06:09:42.203232+0000","last_unstale":"2024-09-13T06:10:10.802883+0000","last_undegraded":"2024-09-13T06:10:10.802883+0000","last_fullsized":"2024-09-13T06:10:10.802883+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:59:55.860934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"35'6","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:02.878771+0000","last_change":"2024-09-13T06:09:34.116295+0000","last_active":"2024-09-13T06:11:02.878771+0000","last_peered":"2024-09-13T06:11:02.878771+0000","last_clean":"2024-09-13T06:11:02.878771+0000","last_became_active":"2024-09-13T06:09:34.113002+0000","last_became_peered":"2024-09-13T06:09:34.113002+0000","last_unstale":"2024-09-13T06:11:02.878771+0000","last_undegraded":"2024-09-13T06:11:02.878771+0000","last_fullsized":"2024-09-13T06:11:02.878771+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:14:37.877574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.803179+0000","last_change":"2024-09-13T06:09:24.222172+0000","last_active":"2024-09-13T06:10:10.803179+0000","last_peered":"2024-09-13T06:10:10.803179+0000","last_clean":"2024-09-13T06:10:10.803179+0000","last_became_active":"2024-09-13T06:09:22.217581+0000","last_became_peered":"2024-09-13T06:09:22.217581+0000","last_unstale":"2024-09-13T06:10:10.803179+0000","last_undegraded":"2024-09-13T06:10:10.803179+0000","last_fullsized":"2024-09-13T06:10:10.803179+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_clean_scrub_stamp":"2024-09-13T06:09:21.188659+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:02:07.684980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022711580000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.798782+0000","last_change":"2024-09-13T06:09:32.139418+0000","last_active":"2024-09-13T06:10:10.798782+0000","last_peered":"2024-09-13T06:10:10.798782+0000","last_clean":"2024-09-13T06:10:10.798782+0000","last_became_active":"2024-09-13T06:09:32.138838+0000","last_became_peered":"2024-09-13T06:09:32.138838+0000","last_unstale":"2024-09-13T06:10:10.798782+0000","last_undegraded":"2024-09-13T06:10:10.798782+0000","last_fullsized":"2024-09-13T06:10:10.798782+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:06:35.186829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:11.778800+0000","last_change":"2024-09-13T06:10:10.810748+0000","last_active":"2024-09-13T06:10:11.778800+0000","last_peered":"2024-09-13T06:10:11.778800+0000","last_clean":"2024-09-13T06:10:11.778800+0000","last_became_active":"2024-09-13T06:10:10.809216+0000","last_became_peered":"2024-09-13T06:10:10.809216+0000","last_unstale":"2024-09-13T06:10:11.778800+0000","last_undegraded":"2024-09-13T06:10:11.778800+0000","last_fullsized":"2024-09-13T06:10:11.778800+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:31:29.839767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"35'13","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:48.267532+0000","last_change":"2024-09-13T06:09:38.179168+0000","last_active":"2024-09-13T06:12:48.267532+0000","last_peered":"2024-09-13T06:12:48.267532+0000","last_clean":"2024-09-13T06:12:48.267532+0000","last_became_active":"2024-09-13T06:09:38.176307+0000","last_became_peered":"2024-09-13T06:09:38.176307+0000","last_unstale":"2024-09-13T06:12:48.267532+0000","last_undegraded":"2024-09-13T06:12:48.267532+0000","last_fullsized":"2024-09-13T06:12:48.267532+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:48:06.539631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.817869+0000","last_change":"2024-09-13T06:09:40.189861+0000","last_active":"2024-09-13T06:10:10.817869+0000","last_peered":"2024-09-13T06:10:10.817869+0000","last_clean":"2024-09-13T06:10:10.817869+0000","last_became_active":"2024-09-13T06:09:40.189259+0000","last_became_peered":"2024-09-13T06:09:40.189259+0000","last_unstale":"2024-09-13T06:10:10.817869+0000","last_undegraded":"2024-09-13T06:10:10.817869+0000","last_fullsized":"2024-09-13T06:10:10.817869+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:50:40.590067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"35'4","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:47.623875+0000","last_change":"2024-09-13T06:09:42.186776+0000","last_active":"2024-09-13T06:11:47.623875+0000","last_peered":"2024-09-13T06:11:47.623875+0000","last_clean":"2024-09-13T06:11:47.623875+0000","last_became_active":"2024-09-13T06:09:42.185210+0000","last_became_peered":"2024-09-13T06:09:42.185210+0000","last_unstale":"2024-09-13T06:11:47.623875+0000","last_undegraded":"2024-09-13T06:11:47.623875+0000","last_fullsized":"2024-09-13T06:11:47.623875+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:46:22.560475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"35'3","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.344035+0000","last_change":"2024-09-13T06:09:34.122137+0000","last_active":"2024-09-13T06:12:49.344035+0000","last_peered":"2024-09-13T06:12:49.344035+0000","last_clean":"2024-09-13T06:12:49.344035+0000","last_became_active":"2024-09-13T06:09:34.119283+0000","last_became_peered":"2024-09-13T06:09:34.119283+0000","last_unstale":"2024-09-13T06:12:49.344035+0000","last_undegraded":"2024-09-13T06:12:49.344035+0000","last_fullsized":"2024-09-13T06:12:49.344035+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:10:47.867373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:18.820356+0000","last_change":"2024-09-13T06:09:32.139797+0000","last_active":"2024-09-13T06:10:18.820356+0000","last_peered":"2024-09-13T06:10:18.820356+0000","last_clean":"2024-09-13T06:10:18.820356+0000","last_became_active":"2024-09-13T06:09:32.139313+0000","last_became_peered":"2024-09-13T06:09:32.139313+0000","last_unstale":"2024-09-13T06:10:18.820356+0000","last_undegraded":"2024-09-13T06:10:18.820356+0000","last_fullsized":"2024-09-13T06:10:18.820356+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:52:39.866148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.948023+0000","last_change":"2024-09-13T06:09:24.227949+0000","last_active":"2024-09-13T06:10:10.948023+0000","last_peered":"2024-09-13T06:10:10.948023+0000","last_clean":"2024-09-13T06:10:10.948023+0000","last_became_active":"2024-09-13T06:09:22.216659+0000","last_became_peered":"2024-09-13T06:09:22.216659+0000","last_unstale":"2024-09-13T06:10:10.948023+0000","last_undegraded":"2024-09-13T06:10:10.948023+0000","last_fullsized":"2024-09-13T06:10:10.948023+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_clean_scrub_stamp":"2024-09-13T06:09:21.188659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:49:43.834788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010625330000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"35'1","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:40.796808+0000","last_change":"2024-09-13T06:09:36.133083+0000","last_active":"2024-09-13T06:11:40.796808+0000","last_peered":"2024-09-13T06:11:40.796808+0000","last_clean":"2024-09-13T06:11:40.796808+0000","last_became_active":"2024-09-13T06:09:36.132376+0000","last_became_peered":"2024-09-13T06:09:36.132376+0000","last_unstale":"2024-09-13T06:11:40.796808+0000","last_undegraded":"2024-09-13T06:11:40.796808+0000","last_fullsized":"2024-09-13T06:11:40.796808+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:33:42.194072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"35'61","reported_seq":120,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:45.834397+0000","last_change":"2024-09-13T06:09:38.158348+0000","last_active":"2024-09-13T06:11:45.834397+0000","last_peered":"2024-09-13T06:11:45.834397+0000","last_clean":"2024-09-13T06:11:45.834397+0000","last_became_active":"2024-09-13T06:09:38.157579+0000","last_became_peered":"2024-09-13T06:09:38.157579+0000","last_unstale":"2024-09-13T06:11:45.834397+0000","last_undegraded":"2024-09-13T06:11:45.834397+0000","last_fullsized":"2024-09-13T06:11:45.834397+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:10:00.668843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.793704+0000","last_change":"2024-09-13T06:09:40.185803+0000","last_active":"2024-09-13T06:10:10.793704+0000","last_peered":"2024-09-13T06:10:10.793704+0000","last_clean":"2024-09-13T06:10:10.793704+0000","last_became_active":"2024-09-13T06:09:40.185234+0000","last_became_peered":"2024-09-13T06:09:40.185234+0000","last_unstale":"2024-09-13T06:10:10.793704+0000","last_undegraded":"2024-09-13T06:10:10.793704+0000","last_fullsized":"2024-09-13T06:10:10.793704+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:15:00.667693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"35'11","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:48.059535+0000","last_change":"2024-09-13T06:09:42.176351+0000","last_active":"2024-09-13T06:11:48.059535+0000","last_peered":"2024-09-13T06:11:48.059535+0000","last_clean":"2024-09-13T06:11:48.059535+0000","last_became_active":"2024-09-13T06:09:42.170302+0000","last_became_peered":"2024-09-13T06:09:42.170302+0000","last_unstale":"2024-09-13T06:11:48.059535+0000","last_undegraded":"2024-09-13T06:11:48.059535+0000","last_fullsized":"2024-09-13T06:11:48.059535+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:18:04.598744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":25,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"35'10","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:20.342360+0000","last_change":"2024-09-13T06:09:34.122222+0000","last_active":"2024-09-13T06:10:20.342360+0000","last_peered":"2024-09-13T06:10:20.342360+0000","last_clean":"2024-09-13T06:10:20.342360+0000","last_became_active":"2024-09-13T06:09:34.121836+0000","last_became_peered":"2024-09-13T06:09:34.121836+0000","last_unstale":"2024-09-13T06:10:20.342360+0000","last_undegraded":"2024-09-13T06:10:20.342360+0000","last_fullsized":"2024-09-13T06:10:20.342360+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:33:26.123983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.950946+0000","last_change":"2024-09-13T06:09:32.137231+0000","last_active":"2024-09-13T06:10:10.950946+0000","last_peered":"2024-09-13T06:10:10.950946+0000","last_clean":"2024-09-13T06:10:10.950946+0000","last_became_active":"2024-09-13T06:09:32.136238+0000","last_became_peered":"2024-09-13T06:09:32.136238+0000","last_unstale":"2024-09-13T06:10:10.950946+0000","last_undegraded":"2024-09-13T06:10:10.950946+0000","last_fullsized":"2024-09-13T06:10:10.950946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:12:38.569078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.812165+0000","last_change":"2024-09-13T06:09:24.221355+0000","last_active":"2024-09-13T06:10:10.812165+0000","last_peered":"2024-09-13T06:10:10.812165+0000","last_clean":"2024-09-13T06:10:10.812165+0000","last_became_active":"2024-09-13T06:09:22.217809+0000","last_became_peered":"2024-09-13T06:09:22.217809+0000","last_unstale":"2024-09-13T06:10:10.812165+0000","last_undegraded":"2024-09-13T06:10:10.812165+0000","last_fullsized":"2024-09-13T06:10:10.812165+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_clean_scrub_stamp":"2024-09-13T06:09:21.188659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:16:27.098773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001447545,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.802066+0000","last_change":"2024-09-13T06:09:36.152257+0000","last_active":"2024-09-13T06:10:10.802066+0000","last_peered":"2024-09-13T06:10:10.802066+0000","last_clean":"2024-09-13T06:10:10.802066+0000","last_became_active":"2024-09-13T06:09:36.151605+0000","last_became_peered":"2024-09-13T06:09:36.151605+0000","last_unstale":"2024-09-13T06:10:10.802066+0000","last_undegraded":"2024-09-13T06:10:10.802066+0000","last_fullsized":"2024-09-13T06:10:10.802066+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:14:15.857728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"35'15","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:02.613378+0000","last_change":"2024-09-13T06:09:38.167368+0000","last_active":"2024-09-13T06:11:02.613378+0000","last_peered":"2024-09-13T06:11:02.613378+0000","last_clean":"2024-09-13T06:11:02.613378+0000","last_became_active":"2024-09-13T06:09:38.165916+0000","last_became_peered":"2024-09-13T06:09:38.165916+0000","last_unstale":"2024-09-13T06:11:02.613378+0000","last_undegraded":"2024-09-13T06:11:02.613378+0000","last_fullsized":"2024-09-13T06:11:02.613378+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:51:12.107434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"35'282","reported_seq":347,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:46.393919+0000","last_change":"2024-09-13T06:09:40.182289+0000","last_active":"2024-09-13T06:12:46.393919+0000","last_peered":"2024-09-13T06:12:46.393919+0000","last_clean":"2024-09-13T06:12:46.393919+0000","last_became_active":"2024-09-13T06:09:40.181415+0000","last_became_peered":"2024-09-13T06:09:40.181415+0000","last_unstale":"2024-09-13T06:12:46.393919+0000","last_undegraded":"2024-09-13T06:12:46.393919+0000","last_fullsized":"2024-09-13T06:12:46.393919+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:49:07.565350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.816311+0000","last_change":"2024-09-13T06:09:42.195360+0000","last_active":"2024-09-13T06:10:10.816311+0000","last_peered":"2024-09-13T06:10:10.816311+0000","last_clean":"2024-09-13T06:10:10.816311+0000","last_became_active":"2024-09-13T06:09:42.194558+0000","last_became_peered":"2024-09-13T06:09:42.194558+0000","last_unstale":"2024-09-13T06:10:10.816311+0000","last_undegraded":"2024-09-13T06:10:10.816311+0000","last_fullsized":"2024-09-13T06:10:10.816311+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:15:46.155508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"35'6","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.513665+0000","last_change":"2024-09-13T06:10:10.814500+0000","last_active":"2024-09-13T06:12:49.513665+0000","last_peered":"2024-09-13T06:12:49.513665+0000","last_clean":"2024-09-13T06:12:49.513665+0000","last_became_active":"2024-09-13T06:10:10.813656+0000","last_became_peered":"2024-09-13T06:10:10.813656+0000","last_unstale":"2024-09-13T06:12:49.513665+0000","last_undegraded":"2024-09-13T06:12:49.513665+0000","last_fullsized":"2024-09-13T06:12:49.513665+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:35:54.499508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.819500+0000","last_change":"2024-09-13T06:09:32.133206+0000","last_active":"2024-09-13T06:10:10.819500+0000","last_peered":"2024-09-13T06:10:10.819500+0000","last_clean":"2024-09-13T06:10:10.819500+0000","last_became_active":"2024-09-13T06:09:32.130385+0000","last_became_peered":"2024-09-13T06:09:32.130385+0000","last_unstale":"2024-09-13T06:10:10.819500+0000","last_undegraded":"2024-09-13T06:10:10.819500+0000","last_fullsized":"2024-09-13T06:10:10.819500+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:10:45.858553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.948419+0000","last_change":"2024-09-13T06:09:24.227867+0000","last_active":"2024-09-13T06:10:10.948419+0000","last_peered":"2024-09-13T06:10:10.948419+0000","last_clean":"2024-09-13T06:10:10.948419+0000","last_became_active":"2024-09-13T06:09:22.216905+0000","last_became_peered":"2024-09-13T06:09:22.216905+0000","last_unstale":"2024-09-13T06:10:10.948419+0000","last_undegraded":"2024-09-13T06:10:10.948419+0000","last_fullsized":"2024-09-13T06:10:10.948419+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_clean_scrub_stamp":"2024-09-13T06:09:21.188659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:24:00.674357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001005588,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.802233+0000","last_change":"2024-09-13T06:09:36.152413+0000","last_active":"2024-09-13T06:10:10.802233+0000","last_peered":"2024-09-13T06:10:10.802233+0000","last_clean":"2024-09-13T06:10:10.802233+0000","last_became_active":"2024-09-13T06:09:36.149051+0000","last_became_peered":"2024-09-13T06:09:36.149051+0000","last_unstale":"2024-09-13T06:10:10.802233+0000","last_undegraded":"2024-09-13T06:10:10.802233+0000","last_fullsized":"2024-09-13T06:10:10.802233+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:40:05.139581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"33'10","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.805068+0000","last_change":"2024-09-13T06:09:38.175171+0000","last_active":"2024-09-13T06:10:10.805068+0000","last_peered":"2024-09-13T06:10:10.805068+0000","last_clean":"2024-09-13T06:10:10.805068+0000","last_became_active":"2024-09-13T06:09:38.173017+0000","last_became_peered":"2024-09-13T06:09:38.173017+0000","last_unstale":"2024-09-13T06:10:10.805068+0000","last_undegraded":"2024-09-13T06:10:10.805068+0000","last_fullsized":"2024-09-13T06:10:10.805068+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:34:30.481224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"35'282","reported_seq":390,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.798465+0000","last_change":"2024-09-13T06:09:40.171525+0000","last_active":"2024-09-13T06:12:49.798465+0000","last_peered":"2024-09-13T06:12:49.798465+0000","last_clean":"2024-09-13T06:12:49.798465+0000","last_became_active":"2024-09-13T06:09:40.170879+0000","last_became_peered":"2024-09-13T06:09:40.170879+0000","last_unstale":"2024-09-13T06:12:49.798465+0000","last_undegraded":"2024-09-13T06:12:49.798465+0000","last_fullsized":"2024-09-13T06:12:49.798465+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:49:51.483537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"33'3","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.816551+0000","last_change":"2024-09-13T06:09:42.183057+0000","last_active":"2024-09-13T06:10:10.816551+0000","last_peered":"2024-09-13T06:10:10.816551+0000","last_clean":"2024-09-13T06:10:10.816551+0000","last_became_active":"2024-09-13T06:09:42.178890+0000","last_became_peered":"2024-09-13T06:09:42.178890+0000","last_unstale":"2024-09-13T06:10:10.816551+0000","last_undegraded":"2024-09-13T06:10:10.816551+0000","last_fullsized":"2024-09-13T06:10:10.816551+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:06:09.567725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"35'4","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.321911+0000","last_change":"2024-09-13T06:09:34.104607+0000","last_active":"2024-09-13T06:12:49.321911+0000","last_peered":"2024-09-13T06:12:49.321911+0000","last_clean":"2024-09-13T06:12:49.321911+0000","last_became_active":"2024-09-13T06:09:34.104194+0000","last_became_peered":"2024-09-13T06:09:34.104194+0000","last_unstale":"2024-09-13T06:12:49.321911+0000","last_undegraded":"2024-09-13T06:12:49.321911+0000","last_fullsized":"2024-09-13T06:12:49.321911+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:54:03.779728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.820560+0000","last_change":"2024-09-13T06:09:32.118940+0000","last_active":"2024-09-13T06:10:10.820560+0000","last_peered":"2024-09-13T06:10:10.820560+0000","last_clean":"2024-09-13T06:10:10.820560+0000","last_became_active":"2024-09-13T06:09:32.118386+0000","last_became_peered":"2024-09-13T06:09:32.118386+0000","last_unstale":"2024-09-13T06:10:10.820560+0000","last_undegraded":"2024-09-13T06:10:10.820560+0000","last_fullsized":"2024-09-13T06:10:10.820560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:49:16.214220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.819052+0000","last_change":"2024-09-13T06:09:24.222245+0000","last_active":"2024-09-13T06:10:10.819052+0000","last_peered":"2024-09-13T06:10:10.819052+0000","last_clean":"2024-09-13T06:10:10.819052+0000","last_became_active":"2024-09-13T06:09:22.495259+0000","last_became_peered":"2024-09-13T06:09:22.495259+0000","last_unstale":"2024-09-13T06:10:10.819052+0000","last_undegraded":"2024-09-13T06:10:10.819052+0000","last_fullsized":"2024-09-13T06:10:10.819052+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_clean_scrub_stamp":"2024-09-13T06:09:21.188659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:50:33.808976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002230409,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.800590+0000","last_change":"2024-09-13T06:09:36.148104+0000","last_active":"2024-09-13T06:10:10.800590+0000","last_peered":"2024-09-13T06:10:10.800590+0000","last_clean":"2024-09-13T06:10:10.800590+0000","last_became_active":"2024-09-13T06:09:36.144463+0000","last_became_peered":"2024-09-13T06:09:36.144463+0000","last_unstale":"2024-09-13T06:10:10.800590+0000","last_undegraded":"2024-09-13T06:10:10.800590+0000","last_fullsized":"2024-09-13T06:10:10.800590+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:03:15.568444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"35'82","reported_seq":154,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:45.810912+0000","last_change":"2024-09-13T06:09:38.159139+0000","last_active":"2024-09-13T06:11:45.810912+0000","last_peered":"2024-09-13T06:11:45.810912+0000","last_clean":"2024-09-13T06:11:45.810912+0000","last_became_active":"2024-09-13T06:09:38.158436+0000","last_became_peered":"2024-09-13T06:09:38.158436+0000","last_unstale":"2024-09-13T06:11:45.810912+0000","last_undegraded":"2024-09-13T06:11:45.810912+0000","last_fullsized":"2024-09-13T06:11:45.810912+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:59:31.499614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.944095+0000","last_change":"2024-09-13T06:09:40.177714+0000","last_active":"2024-09-13T06:10:10.944095+0000","last_peered":"2024-09-13T06:10:10.944095+0000","last_clean":"2024-09-13T06:10:10.944095+0000","last_became_active":"2024-09-13T06:09:40.176677+0000","last_became_peered":"2024-09-13T06:09:40.176677+0000","last_unstale":"2024-09-13T06:10:10.944095+0000","last_undegraded":"2024-09-13T06:10:10.944095+0000","last_fullsized":"2024-09-13T06:10:10.944095+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:16:31.555002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.807736+0000","last_change":"2024-09-13T06:09:42.205263+0000","last_active":"2024-09-13T06:10:10.807736+0000","last_peered":"2024-09-13T06:10:10.807736+0000","last_clean":"2024-09-13T06:10:10.807736+0000","last_became_active":"2024-09-13T06:09:42.204574+0000","last_became_peered":"2024-09-13T06:09:42.204574+0000","last_unstale":"2024-09-13T06:10:10.807736+0000","last_undegraded":"2024-09-13T06:10:10.807736+0000","last_fullsized":"2024-09-13T06:10:10.807736+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:05:47.718981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.797254+0000","last_change":"2024-09-13T06:09:42.198602+0000","last_active":"2024-09-13T06:10:10.797254+0000","last_peered":"2024-09-13T06:10:10.797254+0000","last_clean":"2024-09-13T06:10:10.797254+0000","last_became_active":"2024-09-13T06:09:42.197788+0000","last_became_peered":"2024-09-13T06:09:42.197788+0000","last_unstale":"2024-09-13T06:10:10.797254+0000","last_undegraded":"2024-09-13T06:10:10.797254+0000","last_fullsized":"2024-09-13T06:10:10.797254+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:04:01.295995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"35'8","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:18.855854+0000","last_change":"2024-09-13T06:09:34.104017+0000","last_active":"2024-09-13T06:10:18.855854+0000","last_peered":"2024-09-13T06:10:18.855854+0000","last_clean":"2024-09-13T06:10:18.855854+0000","last_became_active":"2024-09-13T06:09:34.101193+0000","last_became_peered":"2024-09-13T06:09:34.101193+0000","last_unstale":"2024-09-13T06:10:18.855854+0000","last_undegraded":"2024-09-13T06:10:18.855854+0000","last_fullsized":"2024-09-13T06:10:18.855854+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:51:17.686447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.809691+0000","last_change":"2024-09-13T06:09:32.125105+0000","last_active":"2024-09-13T06:10:10.809691+0000","last_peered":"2024-09-13T06:10:10.809691+0000","last_clean":"2024-09-13T06:10:10.809691+0000","last_became_active":"2024-09-13T06:09:32.124198+0000","last_became_peered":"2024-09-13T06:09:32.124198+0000","last_unstale":"2024-09-13T06:10:10.809691+0000","last_undegraded":"2024-09-13T06:10:10.809691+0000","last_fullsized":"2024-09-13T06:10:10.809691+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:34:37.470372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.813867+0000","last_change":"2024-09-13T06:09:36.134319+0000","last_active":"2024-09-13T06:10:10.813867+0000","last_peered":"2024-09-13T06:10:10.813867+0000","last_clean":"2024-09-13T06:10:10.813867+0000","last_became_active":"2024-09-13T06:09:36.133568+0000","last_became_peered":"2024-09-13T06:09:36.133568+0000","last_unstale":"2024-09-13T06:10:10.813867+0000","last_undegraded":"2024-09-13T06:10:10.813867+0000","last_fullsized":"2024-09-13T06:10:10.813867+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:20:35.376308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"35'32","reported_seq":75,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:45.819774+0000","last_change":"2024-09-13T06:09:38.172743+0000","last_active":"2024-09-13T06:11:45.819774+0000","last_peered":"2024-09-13T06:11:45.819774+0000","last_clean":"2024-09-13T06:11:45.819774+0000","last_became_active":"2024-09-13T06:09:38.172109+0000","last_became_peered":"2024-09-13T06:09:38.172109+0000","last_unstale":"2024-09-13T06:11:45.819774+0000","last_undegraded":"2024-09-13T06:11:45.819774+0000","last_fullsized":"2024-09-13T06:11:45.819774+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:28:50.103863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.802591+0000","last_change":"2024-09-13T06:09:40.189717+0000","last_active":"2024-09-13T06:10:10.802591+0000","last_peered":"2024-09-13T06:10:10.802591+0000","last_clean":"2024-09-13T06:10:10.802591+0000","last_became_active":"2024-09-13T06:09:40.189223+0000","last_became_peered":"2024-09-13T06:09:40.189223+0000","last_unstale":"2024-09-13T06:10:10.802591+0000","last_undegraded":"2024-09-13T06:10:10.802591+0000","last_fullsized":"2024-09-13T06:10:10.802591+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:33:39.326453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"35'5","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:45.415504+0000","last_change":"2024-09-13T06:09:42.179227+0000","last_active":"2024-09-13T06:11:45.415504+0000","last_peered":"2024-09-13T06:11:45.415504+0000","last_clean":"2024-09-13T06:11:45.415504+0000","last_became_active":"2024-09-13T06:09:42.177378+0000","last_became_peered":"2024-09-13T06:09:42.177378+0000","last_unstale":"2024-09-13T06:11:45.415504+0000","last_undegraded":"2024-09-13T06:11:45.415504+0000","last_fullsized":"2024-09-13T06:11:45.415504+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:40:05.274490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"35'18","reported_seq":75,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.343992+0000","last_change":"2024-09-13T06:09:34.119010+0000","last_active":"2024-09-13T06:12:49.343992+0000","last_peered":"2024-09-13T06:12:49.343992+0000","last_clean":"2024-09-13T06:12:49.343992+0000","last_became_active":"2024-09-13T06:09:34.118441+0000","last_became_peered":"2024-09-13T06:09:34.118441+0000","last_unstale":"2024-09-13T06:12:49.343992+0000","last_undegraded":"2024-09-13T06:12:49.343992+0000","last_fullsized":"2024-09-13T06:12:49.343992+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:34:39.479193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":59,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.796239+0000","last_change":"2024-09-13T06:09:32.139144+0000","last_active":"2024-09-13T06:10:10.796239+0000","last_peered":"2024-09-13T06:10:10.796239+0000","last_clean":"2024-09-13T06:10:10.796239+0000","last_became_active":"2024-09-13T06:09:32.138664+0000","last_became_peered":"2024-09-13T06:09:32.138664+0000","last_unstale":"2024-09-13T06:10:10.796239+0000","last_undegraded":"2024-09-13T06:10:10.796239+0000","last_fullsized":"2024-09-13T06:10:10.796239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:56:32.022947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"35'4","reported_seq":226,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:47.357736+0000","last_change":"2024-09-13T06:09:36.154113+0000","last_active":"2024-09-13T06:11:47.357736+0000","last_peered":"2024-09-13T06:11:47.357736+0000","last_clean":"2024-09-13T06:11:47.357736+0000","last_became_active":"2024-09-13T06:09:36.153526+0000","last_became_peered":"2024-09-13T06:09:36.153526+0000","last_unstale":"2024-09-13T06:11:47.357736+0000","last_undegraded":"2024-09-13T06:11:47.357736+0000","last_fullsized":"2024-09-13T06:11:47.357736+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:55:06.950934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"35'6","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:48.315866+0000","last_change":"2024-09-13T06:09:38.150778+0000","last_active":"2024-09-13T06:12:48.315866+0000","last_peered":"2024-09-13T06:12:48.315866+0000","last_clean":"2024-09-13T06:12:48.315866+0000","last_became_active":"2024-09-13T06:09:38.150063+0000","last_became_peered":"2024-09-13T06:09:38.150063+0000","last_unstale":"2024-09-13T06:12:48.315866+0000","last_undegraded":"2024-09-13T06:12:48.315866+0000","last_fullsized":"2024-09-13T06:12:48.315866+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:02:22.999686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.794330+0000","last_change":"2024-09-13T06:09:40.182455+0000","last_active":"2024-09-13T06:10:10.794330+0000","last_peered":"2024-09-13T06:10:10.794330+0000","last_clean":"2024-09-13T06:10:10.794330+0000","last_became_active":"2024-09-13T06:09:40.181807+0000","last_became_peered":"2024-09-13T06:09:40.181807+0000","last_unstale":"2024-09-13T06:10:10.794330+0000","last_undegraded":"2024-09-13T06:10:10.794330+0000","last_fullsized":"2024-09-13T06:10:10.794330+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:06:21.895535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"35'2","reported_seq":19,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.441035+0000","last_change":"2024-09-13T06:09:42.209380+0000","last_active":"2024-09-13T06:12:49.441035+0000","last_peered":"2024-09-13T06:12:49.441035+0000","last_clean":"2024-09-13T06:12:49.441035+0000","last_became_active":"2024-09-13T06:09:42.208567+0000","last_became_peered":"2024-09-13T06:09:42.208567+0000","last_unstale":"2024-09-13T06:12:49.441035+0000","last_undegraded":"2024-09-13T06:12:49.441035+0000","last_fullsized":"2024-09-13T06:12:49.441035+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:25:17.333516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"35'12","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.320978+0000","last_change":"2024-09-13T06:09:34.115480+0000","last_active":"2024-09-13T06:12:49.320978+0000","last_peered":"2024-09-13T06:12:49.320978+0000","last_clean":"2024-09-13T06:12:49.320978+0000","last_became_active":"2024-09-13T06:09:34.113455+0000","last_became_peered":"2024-09-13T06:09:34.113455+0000","last_unstale":"2024-09-13T06:12:49.320978+0000","last_undegraded":"2024-09-13T06:12:49.320978+0000","last_fullsized":"2024-09-13T06:12:49.320978+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:12:41.439746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:18.044718+0000","last_change":"2024-09-13T06:09:32.118643+0000","last_active":"2024-09-13T06:10:18.044718+0000","last_peered":"2024-09-13T06:10:18.044718+0000","last_clean":"2024-09-13T06:10:18.044718+0000","last_became_active":"2024-09-13T06:09:32.118235+0000","last_became_peered":"2024-09-13T06:09:32.118235+0000","last_unstale":"2024-09-13T06:10:18.044718+0000","last_undegraded":"2024-09-13T06:10:18.044718+0000","last_fullsized":"2024-09-13T06:10:18.044718+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:42:07.291597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"26'1","reported_seq":218,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:47.370504+0000","last_change":"2024-09-13T06:09:36.135737+0000","last_active":"2024-09-13T06:11:47.370504+0000","last_peered":"2024-09-13T06:11:47.370504+0000","last_clean":"2024-09-13T06:11:47.370504+0000","last_became_active":"2024-09-13T06:09:36.135184+0000","last_became_peered":"2024-09-13T06:09:36.135184+0000","last_unstale":"2024-09-13T06:11:47.370504+0000","last_undegraded":"2024-09-13T06:11:47.370504+0000","last_fullsized":"2024-09-13T06:11:47.370504+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:29:10.875574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"35'41","reported_seq":100,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:48.431925+0000","last_change":"2024-09-13T06:09:38.166891+0000","last_active":"2024-09-13T06:12:48.431925+0000","last_peered":"2024-09-13T06:12:48.431925+0000","last_clean":"2024-09-13T06:12:48.431925+0000","last_became_active":"2024-09-13T06:09:38.166381+0000","last_became_peered":"2024-09-13T06:09:38.166381+0000","last_unstale":"2024-09-13T06:12:48.431925+0000","last_undegraded":"2024-09-13T06:12:48.431925+0000","last_fullsized":"2024-09-13T06:12:48.431925+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:19:25.019683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.813101+0000","last_change":"2024-09-13T06:09:40.182185+0000","last_active":"2024-09-13T06:10:10.813101+0000","last_peered":"2024-09-13T06:10:10.813101+0000","last_clean":"2024-09-13T06:10:10.813101+0000","last_became_active":"2024-09-13T06:09:40.181329+0000","last_became_peered":"2024-09-13T06:09:40.181329+0000","last_unstale":"2024-09-13T06:10:10.813101+0000","last_undegraded":"2024-09-13T06:10:10.813101+0000","last_fullsized":"2024-09-13T06:10:10.813101+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:44:49.118858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.808748+0000","last_change":"2024-09-13T06:09:42.211550+0000","last_active":"2024-09-13T06:10:10.808748+0000","last_peered":"2024-09-13T06:10:10.808748+0000","last_clean":"2024-09-13T06:10:10.808748+0000","last_became_active":"2024-09-13T06:09:42.211005+0000","last_became_peered":"2024-09-13T06:09:42.211005+0000","last_unstale":"2024-09-13T06:10:10.808748+0000","last_undegraded":"2024-09-13T06:10:10.808748+0000","last_fullsized":"2024-09-13T06:10:10.808748+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:13:33.778909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"35'6","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:02.880093+0000","last_change":"2024-09-13T06:09:34.127109+0000","last_active":"2024-09-13T06:11:02.880093+0000","last_peered":"2024-09-13T06:11:02.880093+0000","last_clean":"2024-09-13T06:11:02.880093+0000","last_became_active":"2024-09-13T06:09:34.126798+0000","last_became_peered":"2024-09-13T06:09:34.126798+0000","last_unstale":"2024-09-13T06:11:02.880093+0000","last_undegraded":"2024-09-13T06:11:02.880093+0000","last_fullsized":"2024-09-13T06:11:02.880093+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:26:26.734970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.821879+0000","last_change":"2024-09-13T06:09:32.126749+0000","last_active":"2024-09-13T06:10:10.821879+0000","last_peered":"2024-09-13T06:10:10.821879+0000","last_clean":"2024-09-13T06:10:10.821879+0000","last_became_active":"2024-09-13T06:09:32.126213+0000","last_became_peered":"2024-09-13T06:09:32.126213+0000","last_unstale":"2024-09-13T06:10:10.821879+0000","last_undegraded":"2024-09-13T06:10:10.821879+0000","last_fullsized":"2024-09-13T06:10:10.821879+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:09.204807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.801959+0000","last_change":"2024-09-13T06:09:36.148938+0000","last_active":"2024-09-13T06:10:10.801959+0000","last_peered":"2024-09-13T06:10:10.801959+0000","last_clean":"2024-09-13T06:10:10.801959+0000","last_became_active":"2024-09-13T06:09:36.148016+0000","last_became_peered":"2024-09-13T06:09:36.148016+0000","last_unstale":"2024-09-13T06:10:10.801959+0000","last_undegraded":"2024-09-13T06:10:10.801959+0000","last_fullsized":"2024-09-13T06:10:10.801959+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:59:53.400572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"35'30","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:45.798259+0000","last_change":"2024-09-13T06:09:38.141951+0000","last_active":"2024-09-13T06:11:45.798259+0000","last_peered":"2024-09-13T06:11:45.798259+0000","last_clean":"2024-09-13T06:11:45.798259+0000","last_became_active":"2024-09-13T06:09:38.141182+0000","last_became_peered":"2024-09-13T06:09:38.141182+0000","last_unstale":"2024-09-13T06:11:45.798259+0000","last_undegraded":"2024-09-13T06:11:45.798259+0000","last_fullsized":"2024-09-13T06:11:45.798259+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:13:56.276508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.796907+0000","last_change":"2024-09-13T06:09:40.166939+0000","last_active":"2024-09-13T06:10:10.796907+0000","last_peered":"2024-09-13T06:10:10.796907+0000","last_clean":"2024-09-13T06:10:10.796907+0000","last_became_active":"2024-09-13T06:09:40.166229+0000","last_became_peered":"2024-09-13T06:09:40.166229+0000","last_unstale":"2024-09-13T06:10:10.796907+0000","last_undegraded":"2024-09-13T06:10:10.796907+0000","last_fullsized":"2024-09-13T06:10:10.796907+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:34:36.456263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"35'6","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.131054+0000","last_change":"2024-09-13T06:09:34.122302+0000","last_active":"2024-09-13T06:12:49.131054+0000","last_peered":"2024-09-13T06:12:49.131054+0000","last_clean":"2024-09-13T06:12:49.131054+0000","last_became_active":"2024-09-13T06:09:34.122034+0000","last_became_peered":"2024-09-13T06:09:34.122034+0000","last_unstale":"2024-09-13T06:12:49.131054+0000","last_undegraded":"2024-09-13T06:12:49.131054+0000","last_fullsized":"2024-09-13T06:12:49.131054+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:11:36.611679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"35'1","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:57.810367+0000","last_change":"2024-09-13T06:09:32.124543+0000","last_active":"2024-09-13T06:11:57.810367+0000","last_peered":"2024-09-13T06:11:57.810367+0000","last_clean":"2024-09-13T06:11:57.810367+0000","last_became_active":"2024-09-13T06:09:32.121948+0000","last_became_peered":"2024-09-13T06:09:32.121948+0000","last_unstale":"2024-09-13T06:11:57.810367+0000","last_undegraded":"2024-09-13T06:11:57.810367+0000","last_fullsized":"2024-09-13T06:11:57.810367+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:32:08.664673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.948430+0000","last_change":"2024-09-13T06:09:36.132935+0000","last_active":"2024-09-13T06:10:10.948430+0000","last_peered":"2024-09-13T06:10:10.948430+0000","last_clean":"2024-09-13T06:10:10.948430+0000","last_became_active":"2024-09-13T06:09:36.132227+0000","last_became_peered":"2024-09-13T06:09:36.132227+0000","last_unstale":"2024-09-13T06:10:10.948430+0000","last_undegraded":"2024-09-13T06:10:10.948430+0000","last_fullsized":"2024-09-13T06:10:10.948430+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:57:02.814153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"35'54","reported_seq":110,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:45.829484+0000","last_change":"2024-09-13T06:09:38.150760+0000","last_active":"2024-09-13T06:11:45.829484+0000","last_peered":"2024-09-13T06:11:45.829484+0000","last_clean":"2024-09-13T06:11:45.829484+0000","last_became_active":"2024-09-13T06:09:38.150070+0000","last_became_peered":"2024-09-13T06:09:38.150070+0000","last_unstale":"2024-09-13T06:11:45.829484+0000","last_undegraded":"2024-09-13T06:11:45.829484+0000","last_fullsized":"2024-09-13T06:11:45.829484+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:07:27.806351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.797513+0000","last_change":"2024-09-13T06:09:40.172438+0000","last_active":"2024-09-13T06:10:10.797513+0000","last_peered":"2024-09-13T06:10:10.797513+0000","last_clean":"2024-09-13T06:10:10.797513+0000","last_became_active":"2024-09-13T06:09:40.168550+0000","last_became_peered":"2024-09-13T06:09:40.168550+0000","last_unstale":"2024-09-13T06:10:10.797513+0000","last_undegraded":"2024-09-13T06:10:10.797513+0000","last_fullsized":"2024-09-13T06:10:10.797513+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:45:10.856259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"35'14","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:48.049705+0000","last_change":"2024-09-13T06:09:42.212051+0000","last_active":"2024-09-13T06:11:48.049705+0000","last_peered":"2024-09-13T06:11:48.049705+0000","last_clean":"2024-09-13T06:11:48.049705+0000","last_became_active":"2024-09-13T06:09:42.211508+0000","last_became_peered":"2024-09-13T06:09:42.211508+0000","last_unstale":"2024-09-13T06:11:48.049705+0000","last_undegraded":"2024-09-13T06:11:48.049705+0000","last_fullsized":"2024-09-13T06:11:48.049705+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:12:02.782157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"35'8","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:02.612403+0000","last_change":"2024-09-13T06:09:34.123413+0000","last_active":"2024-09-13T06:11:02.612403+0000","last_peered":"2024-09-13T06:11:02.612403+0000","last_clean":"2024-09-13T06:11:02.612403+0000","last_became_active":"2024-09-13T06:09:34.122881+0000","last_became_peered":"2024-09-13T06:09:34.122881+0000","last_unstale":"2024-09-13T06:11:02.612403+0000","last_undegraded":"2024-09-13T06:11:02.612403+0000","last_fullsized":"2024-09-13T06:11:02.612403+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:16:44.971572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":11,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.811694+0000","last_change":"2024-09-13T06:09:32.120176+0000","last_active":"2024-09-13T06:10:10.811694+0000","last_peered":"2024-09-13T06:10:10.811694+0000","last_clean":"2024-09-13T06:10:10.811694+0000","last_became_active":"2024-09-13T06:09:32.119573+0000","last_became_peered":"2024-09-13T06:09:32.119573+0000","last_unstale":"2024-09-13T06:10:10.811694+0000","last_undegraded":"2024-09-13T06:10:10.811694+0000","last_fullsized":"2024-09-13T06:10:10.811694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:40:56.947438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.799409+0000","last_change":"2024-09-13T06:09:36.128456+0000","last_active":"2024-09-13T06:10:10.799409+0000","last_peered":"2024-09-13T06:10:10.799409+0000","last_clean":"2024-09-13T06:10:10.799409+0000","last_became_active":"2024-09-13T06:09:36.127719+0000","last_became_peered":"2024-09-13T06:09:36.127719+0000","last_unstale":"2024-09-13T06:10:10.799409+0000","last_undegraded":"2024-09-13T06:10:10.799409+0000","last_fullsized":"2024-09-13T06:10:10.799409+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:41:36.178856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"35'37","reported_seq":82,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:45.799506+0000","last_change":"2024-09-13T06:09:38.176074+0000","last_active":"2024-09-13T06:11:45.799506+0000","last_peered":"2024-09-13T06:11:45.799506+0000","last_clean":"2024-09-13T06:11:45.799506+0000","last_became_active":"2024-09-13T06:09:38.175443+0000","last_became_peered":"2024-09-13T06:09:38.175443+0000","last_unstale":"2024-09-13T06:11:45.799506+0000","last_undegraded":"2024-09-13T06:11:45.799506+0000","last_fullsized":"2024-09-13T06:11:45.799506+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:17:36.487054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.817232+0000","last_change":"2024-09-13T06:09:40.185799+0000","last_active":"2024-09-13T06:10:10.817232+0000","last_peered":"2024-09-13T06:10:10.817232+0000","last_clean":"2024-09-13T06:10:10.817232+0000","last_became_active":"2024-09-13T06:09:40.185222+0000","last_became_peered":"2024-09-13T06:09:40.185222+0000","last_unstale":"2024-09-13T06:10:10.817232+0000","last_undegraded":"2024-09-13T06:10:10.817232+0000","last_fullsized":"2024-09-13T06:10:10.817232+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:05:13.593940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.801505+0000","last_change":"2024-09-13T06:09:42.197504+0000","last_active":"2024-09-13T06:10:10.801505+0000","last_peered":"2024-09-13T06:10:10.801505+0000","last_clean":"2024-09-13T06:10:10.801505+0000","last_became_active":"2024-09-13T06:09:42.196679+0000","last_became_peered":"2024-09-13T06:09:42.196679+0000","last_unstale":"2024-09-13T06:10:10.801505+0000","last_undegraded":"2024-09-13T06:10:10.801505+0000","last_fullsized":"2024-09-13T06:10:10.801505+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:50:54.126547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"35'15","reported_seq":76,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:48.978469+0000","last_change":"2024-09-13T06:09:34.133093+0000","last_active":"2024-09-13T06:12:48.978469+0000","last_peered":"2024-09-13T06:12:48.978469+0000","last_clean":"2024-09-13T06:12:48.978469+0000","last_became_active":"2024-09-13T06:09:34.132777+0000","last_became_peered":"2024-09-13T06:09:34.132777+0000","last_unstale":"2024-09-13T06:12:48.978469+0000","last_undegraded":"2024-09-13T06:12:48.978469+0000","last_fullsized":"2024-09-13T06:12:48.978469+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:22:38.070470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":57,"num_read_kb":53,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.814118+0000","last_change":"2024-09-13T06:09:32.118851+0000","last_active":"2024-09-13T06:10:10.814118+0000","last_peered":"2024-09-13T06:10:10.814118+0000","last_clean":"2024-09-13T06:10:10.814118+0000","last_became_active":"2024-09-13T06:09:32.117988+0000","last_became_peered":"2024-09-13T06:09:32.117988+0000","last_unstale":"2024-09-13T06:10:10.814118+0000","last_undegraded":"2024-09-13T06:10:10.814118+0000","last_fullsized":"2024-09-13T06:10:10.814118+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:23:34.478662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.799299+0000","last_change":"2024-09-13T06:09:36.130203+0000","last_active":"2024-09-13T06:10:10.799299+0000","last_peered":"2024-09-13T06:10:10.799299+0000","last_clean":"2024-09-13T06:10:10.799299+0000","last_became_active":"2024-09-13T06:09:36.129471+0000","last_became_peered":"2024-09-13T06:09:36.129471+0000","last_unstale":"2024-09-13T06:10:10.799299+0000","last_undegraded":"2024-09-13T06:10:10.799299+0000","last_fullsized":"2024-09-13T06:10:10.799299+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:24:11.325179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"35'34","reported_seq":77,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:45.798283+0000","last_change":"2024-09-13T06:09:38.154073+0000","last_active":"2024-09-13T06:11:45.798283+0000","last_peered":"2024-09-13T06:11:45.798283+0000","last_clean":"2024-09-13T06:11:45.798283+0000","last_became_active":"2024-09-13T06:09:38.153433+0000","last_became_peered":"2024-09-13T06:09:38.153433+0000","last_unstale":"2024-09-13T06:11:45.798283+0000","last_undegraded":"2024-09-13T06:11:45.798283+0000","last_fullsized":"2024-09-13T06:11:45.798283+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:14:58.653958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":46,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.947882+0000","last_change":"2024-09-13T06:09:40.172148+0000","last_active":"2024-09-13T06:10:10.947882+0000","last_peered":"2024-09-13T06:10:10.947882+0000","last_clean":"2024-09-13T06:10:10.947882+0000","last_became_active":"2024-09-13T06:09:40.171455+0000","last_became_peered":"2024-09-13T06:09:40.171455+0000","last_unstale":"2024-09-13T06:10:10.947882+0000","last_undegraded":"2024-09-13T06:10:10.947882+0000","last_fullsized":"2024-09-13T06:10:10.947882+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:14:59.315430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"35'5","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:48.222496+0000","last_change":"2024-09-13T06:09:42.202743+0000","last_active":"2024-09-13T06:11:48.222496+0000","last_peered":"2024-09-13T06:11:48.222496+0000","last_clean":"2024-09-13T06:11:48.222496+0000","last_became_active":"2024-09-13T06:09:42.202004+0000","last_became_peered":"2024-09-13T06:09:42.202004+0000","last_unstale":"2024-09-13T06:11:48.222496+0000","last_undegraded":"2024-09-13T06:11:48.222496+0000","last_fullsized":"2024-09-13T06:11:48.222496+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:46:50.902863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.951802+0000","last_change":"2024-09-13T06:09:34.117065+0000","last_active":"2024-09-13T06:10:10.951802+0000","last_peered":"2024-09-13T06:10:10.951802+0000","last_clean":"2024-09-13T06:10:10.951802+0000","last_became_active":"2024-09-13T06:09:34.116197+0000","last_became_peered":"2024-09-13T06:09:34.116197+0000","last_unstale":"2024-09-13T06:10:10.951802+0000","last_undegraded":"2024-09-13T06:10:10.951802+0000","last_fullsized":"2024-09-13T06:10:10.951802+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:56:27.933046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:43.515452+0000","last_change":"2024-09-13T06:09:32.132784+0000","last_active":"2024-09-13T06:11:43.515452+0000","last_peered":"2024-09-13T06:11:43.515452+0000","last_clean":"2024-09-13T06:11:43.515452+0000","last_became_active":"2024-09-13T06:09:32.124989+0000","last_became_peered":"2024-09-13T06:09:32.124989+0000","last_unstale":"2024-09-13T06:11:43.515452+0000","last_undegraded":"2024-09-13T06:11:43.515452+0000","last_fullsized":"2024-09-13T06:11:43.515452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:48:08.025389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.817750+0000","last_change":"2024-09-13T06:09:36.140817+0000","last_active":"2024-09-13T06:10:10.817750+0000","last_peered":"2024-09-13T06:10:10.817750+0000","last_clean":"2024-09-13T06:10:10.817750+0000","last_became_active":"2024-09-13T06:09:36.140149+0000","last_became_peered":"2024-09-13T06:09:36.140149+0000","last_unstale":"2024-09-13T06:10:10.817750+0000","last_undegraded":"2024-09-13T06:10:10.817750+0000","last_fullsized":"2024-09-13T06:10:10.817750+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:04:48.637365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'10","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.816866+0000","last_change":"2024-09-13T06:09:38.178539+0000","last_active":"2024-09-13T06:10:10.816866+0000","last_peered":"2024-09-13T06:10:10.816866+0000","last_clean":"2024-09-13T06:10:10.816866+0000","last_became_active":"2024-09-13T06:09:38.177699+0000","last_became_peered":"2024-09-13T06:09:38.177699+0000","last_unstale":"2024-09-13T06:10:10.816866+0000","last_undegraded":"2024-09-13T06:10:10.816866+0000","last_fullsized":"2024-09-13T06:10:10.816866+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:32:51.733389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"35'282","reported_seq":371,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.838611+0000","last_change":"2024-09-13T06:09:40.167569+0000","last_active":"2024-09-13T06:12:49.838611+0000","last_peered":"2024-09-13T06:12:49.838611+0000","last_clean":"2024-09-13T06:12:49.838611+0000","last_became_active":"2024-09-13T06:09:40.166780+0000","last_became_peered":"2024-09-13T06:09:40.166780+0000","last_unstale":"2024-09-13T06:12:49.838611+0000","last_undegraded":"2024-09-13T06:12:49.838611+0000","last_fullsized":"2024-09-13T06:12:49.838611+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:49:12.694438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"35'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:43.527859+0000","last_change":"2024-09-13T06:09:42.201112+0000","last_active":"2024-09-13T06:11:43.527859+0000","last_peered":"2024-09-13T06:11:43.527859+0000","last_clean":"2024-09-13T06:11:43.527859+0000","last_became_active":"2024-09-13T06:09:42.196063+0000","last_became_peered":"2024-09-13T06:09:42.196063+0000","last_unstale":"2024-09-13T06:11:43.527859+0000","last_undegraded":"2024-09-13T06:11:43.527859+0000","last_fullsized":"2024-09-13T06:11:43.527859+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:58:32.682955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"35'6","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:48.962756+0000","last_change":"2024-09-13T06:09:34.108198+0000","last_active":"2024-09-13T06:12:48.962756+0000","last_peered":"2024-09-13T06:12:48.962756+0000","last_clean":"2024-09-13T06:12:48.962756+0000","last_became_active":"2024-09-13T06:09:34.107821+0000","last_became_peered":"2024-09-13T06:09:34.107821+0000","last_unstale":"2024-09-13T06:12:48.962756+0000","last_undegraded":"2024-09-13T06:12:48.962756+0000","last_fullsized":"2024-09-13T06:12:48.962756+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:32:59.845317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:19.619406+0000","last_change":"2024-09-13T06:09:32.141297+0000","last_active":"2024-09-13T06:10:19.619406+0000","last_peered":"2024-09-13T06:10:19.619406+0000","last_clean":"2024-09-13T06:10:19.619406+0000","last_became_active":"2024-09-13T06:09:32.140816+0000","last_became_peered":"2024-09-13T06:09:32.140816+0000","last_unstale":"2024-09-13T06:10:19.619406+0000","last_undegraded":"2024-09-13T06:10:19.619406+0000","last_fullsized":"2024-09-13T06:10:19.619406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:40:42.202859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.813629+0000","last_change":"2024-09-13T06:09:36.141476+0000","last_active":"2024-09-13T06:10:10.813629+0000","last_peered":"2024-09-13T06:10:10.813629+0000","last_clean":"2024-09-13T06:10:10.813629+0000","last_became_active":"2024-09-13T06:09:36.140770+0000","last_became_peered":"2024-09-13T06:09:36.140770+0000","last_unstale":"2024-09-13T06:10:10.813629+0000","last_undegraded":"2024-09-13T06:10:10.813629+0000","last_fullsized":"2024-09-13T06:10:10.813629+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:26:28.751065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"35'37","reported_seq":82,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:45.784945+0000","last_change":"2024-09-13T06:09:38.167920+0000","last_active":"2024-09-13T06:11:45.784945+0000","last_peered":"2024-09-13T06:11:45.784945+0000","last_clean":"2024-09-13T06:11:45.784945+0000","last_became_active":"2024-09-13T06:09:38.166681+0000","last_became_peered":"2024-09-13T06:09:38.166681+0000","last_unstale":"2024-09-13T06:11:45.784945+0000","last_undegraded":"2024-09-13T06:11:45.784945+0000","last_fullsized":"2024-09-13T06:11:45.784945+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:55:43.635960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.942532+0000","last_change":"2024-09-13T06:09:40.179339+0000","last_active":"2024-09-13T06:10:10.942532+0000","last_peered":"2024-09-13T06:10:10.942532+0000","last_clean":"2024-09-13T06:10:10.942532+0000","last_became_active":"2024-09-13T06:09:40.178484+0000","last_became_peered":"2024-09-13T06:09:40.178484+0000","last_unstale":"2024-09-13T06:10:10.942532+0000","last_undegraded":"2024-09-13T06:10:10.942532+0000","last_fullsized":"2024-09-13T06:10:10.942532+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:45:32.317497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"35'4","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:02.607121+0000","last_change":"2024-09-13T06:09:42.201123+0000","last_active":"2024-09-13T06:11:02.607121+0000","last_peered":"2024-09-13T06:11:02.607121+0000","last_clean":"2024-09-13T06:11:02.607121+0000","last_became_active":"2024-09-13T06:09:42.199609+0000","last_became_peered":"2024-09-13T06:09:42.199609+0000","last_unstale":"2024-09-13T06:11:02.607121+0000","last_undegraded":"2024-09-13T06:11:02.607121+0000","last_fullsized":"2024-09-13T06:11:02.607121+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:30:15.851819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"35'5","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:06.802967+0000","last_change":"2024-09-13T06:09:34.100754+0000","last_active":"2024-09-13T06:12:06.802967+0000","last_peered":"2024-09-13T06:12:06.802967+0000","last_clean":"2024-09-13T06:12:06.802967+0000","last_became_active":"2024-09-13T06:09:34.100355+0000","last_became_peered":"2024-09-13T06:09:34.100355+0000","last_unstale":"2024-09-13T06:12:06.802967+0000","last_undegraded":"2024-09-13T06:12:06.802967+0000","last_fullsized":"2024-09-13T06:12:06.802967+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:09:45.564486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.812408+0000","last_change":"2024-09-13T06:09:32.133279+0000","last_active":"2024-09-13T06:10:10.812408+0000","last_peered":"2024-09-13T06:10:10.812408+0000","last_clean":"2024-09-13T06:10:10.812408+0000","last_became_active":"2024-09-13T06:09:32.125049+0000","last_became_peered":"2024-09-13T06:09:32.125049+0000","last_unstale":"2024-09-13T06:10:10.812408+0000","last_undegraded":"2024-09-13T06:10:10.812408+0000","last_fullsized":"2024-09-13T06:10:10.812408+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:46:21.627138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.803001+0000","last_change":"2024-09-13T06:09:36.128406+0000","last_active":"2024-09-13T06:10:10.803001+0000","last_peered":"2024-09-13T06:10:10.803001+0000","last_clean":"2024-09-13T06:10:10.803001+0000","last_became_active":"2024-09-13T06:09:36.127684+0000","last_became_peered":"2024-09-13T06:09:36.127684+0000","last_unstale":"2024-09-13T06:10:10.803001+0000","last_undegraded":"2024-09-13T06:10:10.803001+0000","last_fullsized":"2024-09-13T06:10:10.803001+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:19:14.299050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"35'31","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:05.803369+0000","last_change":"2024-09-13T06:09:38.158011+0000","last_active":"2024-09-13T06:12:05.803369+0000","last_peered":"2024-09-13T06:12:05.803369+0000","last_clean":"2024-09-13T06:12:05.803369+0000","last_became_active":"2024-09-13T06:09:38.157278+0000","last_became_peered":"2024-09-13T06:09:38.157278+0000","last_unstale":"2024-09-13T06:12:05.803369+0000","last_undegraded":"2024-09-13T06:12:05.803369+0000","last_fullsized":"2024-09-13T06:12:05.803369+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:38:47.813081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.801307+0000","last_change":"2024-09-13T06:09:40.189802+0000","last_active":"2024-09-13T06:10:10.801307+0000","last_peered":"2024-09-13T06:10:10.801307+0000","last_clean":"2024-09-13T06:10:10.801307+0000","last_became_active":"2024-09-13T06:09:40.189165+0000","last_became_peered":"2024-09-13T06:09:40.189165+0000","last_unstale":"2024-09-13T06:10:10.801307+0000","last_undegraded":"2024-09-13T06:10:10.801307+0000","last_fullsized":"2024-09-13T06:10:10.801307+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:46:51.067583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.817340+0000","last_change":"2024-09-13T06:09:42.214239+0000","last_active":"2024-09-13T06:10:10.817340+0000","last_peered":"2024-09-13T06:10:10.817340+0000","last_clean":"2024-09-13T06:10:10.817340+0000","last_became_active":"2024-09-13T06:09:42.213756+0000","last_became_peered":"2024-09-13T06:09:42.213756+0000","last_unstale":"2024-09-13T06:10:10.817340+0000","last_undegraded":"2024-09-13T06:10:10.817340+0000","last_fullsized":"2024-09-13T06:10:10.817340+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:18:10.840742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.802714+0000","last_change":"2024-09-13T06:09:34.118052+0000","last_active":"2024-09-13T06:10:10.802714+0000","last_peered":"2024-09-13T06:10:10.802714+0000","last_clean":"2024-09-13T06:10:10.802714+0000","last_became_active":"2024-09-13T06:09:34.117789+0000","last_became_peered":"2024-09-13T06:09:34.117789+0000","last_unstale":"2024-09-13T06:10:10.802714+0000","last_undegraded":"2024-09-13T06:10:10.802714+0000","last_fullsized":"2024-09-13T06:10:10.802714+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:20:33.360213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.948743+0000","last_change":"2024-09-13T06:09:32.135815+0000","last_active":"2024-09-13T06:10:10.948743+0000","last_peered":"2024-09-13T06:10:10.948743+0000","last_clean":"2024-09-13T06:10:10.948743+0000","last_became_active":"2024-09-13T06:09:32.134696+0000","last_became_peered":"2024-09-13T06:09:32.134696+0000","last_unstale":"2024-09-13T06:10:10.948743+0000","last_undegraded":"2024-09-13T06:10:10.948743+0000","last_fullsized":"2024-09-13T06:10:10.948743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:26:57.128770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.805495+0000","last_change":"2024-09-13T06:09:36.132556+0000","last_active":"2024-09-13T06:10:10.805495+0000","last_peered":"2024-09-13T06:10:10.805495+0000","last_clean":"2024-09-13T06:10:10.805495+0000","last_became_active":"2024-09-13T06:09:36.131976+0000","last_became_peered":"2024-09-13T06:09:36.131976+0000","last_unstale":"2024-09-13T06:10:10.805495+0000","last_undegraded":"2024-09-13T06:10:10.805495+0000","last_fullsized":"2024-09-13T06:10:10.805495+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:48:01.480885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"35'26","reported_seq":66,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:45.822287+0000","last_change":"2024-09-13T06:09:38.173782+0000","last_active":"2024-09-13T06:11:45.822287+0000","last_peered":"2024-09-13T06:11:45.822287+0000","last_clean":"2024-09-13T06:11:45.822287+0000","last_became_active":"2024-09-13T06:09:38.171538+0000","last_became_peered":"2024-09-13T06:09:38.171538+0000","last_unstale":"2024-09-13T06:11:45.822287+0000","last_undegraded":"2024-09-13T06:11:45.822287+0000","last_fullsized":"2024-09-13T06:11:45.822287+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:03:14.025680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.802940+0000","last_change":"2024-09-13T06:09:40.185942+0000","last_active":"2024-09-13T06:10:10.802940+0000","last_peered":"2024-09-13T06:10:10.802940+0000","last_clean":"2024-09-13T06:10:10.802940+0000","last_became_active":"2024-09-13T06:09:40.185277+0000","last_became_peered":"2024-09-13T06:09:40.185277+0000","last_unstale":"2024-09-13T06:10:10.802940+0000","last_undegraded":"2024-09-13T06:10:10.802940+0000","last_fullsized":"2024-09-13T06:10:10.802940+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:32:01.193186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"35'6","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.118315+0000","last_change":"2024-09-13T06:09:42.211802+0000","last_active":"2024-09-13T06:12:49.118315+0000","last_peered":"2024-09-13T06:12:49.118315+0000","last_clean":"2024-09-13T06:12:49.118315+0000","last_became_active":"2024-09-13T06:09:42.211176+0000","last_became_peered":"2024-09-13T06:09:42.211176+0000","last_unstale":"2024-09-13T06:12:49.118315+0000","last_undegraded":"2024-09-13T06:12:49.118315+0000","last_fullsized":"2024-09-13T06:12:49.118315+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:57:39.347061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"35'7","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:01.801830+0000","last_change":"2024-09-13T06:09:34.105846+0000","last_active":"2024-09-13T06:12:01.801830+0000","last_peered":"2024-09-13T06:12:01.801830+0000","last_clean":"2024-09-13T06:12:01.801830+0000","last_became_active":"2024-09-13T06:09:34.105494+0000","last_became_peered":"2024-09-13T06:09:34.105494+0000","last_unstale":"2024-09-13T06:12:01.801830+0000","last_undegraded":"2024-09-13T06:12:01.801830+0000","last_fullsized":"2024-09-13T06:12:01.801830+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:49:45.129882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:48.169232+0000","last_change":"2024-09-13T06:09:32.143211+0000","last_active":"2024-09-13T06:11:48.169232+0000","last_peered":"2024-09-13T06:11:48.169232+0000","last_clean":"2024-09-13T06:11:48.169232+0000","last_became_active":"2024-09-13T06:09:32.142726+0000","last_became_peered":"2024-09-13T06:09:32.142726+0000","last_unstale":"2024-09-13T06:11:48.169232+0000","last_undegraded":"2024-09-13T06:11:48.169232+0000","last_fullsized":"2024-09-13T06:11:48.169232+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:21:43.192771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"35'2","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:44.039922+0000","last_change":"2024-09-13T06:09:36.137208+0000","last_active":"2024-09-13T06:11:44.039922+0000","last_peered":"2024-09-13T06:11:44.039922+0000","last_clean":"2024-09-13T06:11:44.039922+0000","last_became_active":"2024-09-13T06:09:36.136792+0000","last_became_peered":"2024-09-13T06:09:36.136792+0000","last_unstale":"2024-09-13T06:11:44.039922+0000","last_undegraded":"2024-09-13T06:11:44.039922+0000","last_fullsized":"2024-09-13T06:11:44.039922+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:41.098706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"35'32","reported_seq":76,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:48.279549+0000","last_change":"2024-09-13T06:09:38.167295+0000","last_active":"2024-09-13T06:12:48.279549+0000","last_peered":"2024-09-13T06:12:48.279549+0000","last_clean":"2024-09-13T06:12:48.279549+0000","last_became_active":"2024-09-13T06:09:38.166333+0000","last_became_peered":"2024-09-13T06:09:38.166333+0000","last_unstale":"2024-09-13T06:12:48.279549+0000","last_undegraded":"2024-09-13T06:12:48.279549+0000","last_fullsized":"2024-09-13T06:12:48.279549+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:04:00.098517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.946008+0000","last_change":"2024-09-13T06:09:40.179631+0000","last_active":"2024-09-13T06:10:10.946008+0000","last_peered":"2024-09-13T06:10:10.946008+0000","last_clean":"2024-09-13T06:10:10.946008+0000","last_became_active":"2024-09-13T06:09:40.178392+0000","last_became_peered":"2024-09-13T06:09:40.178392+0000","last_unstale":"2024-09-13T06:10:10.946008+0000","last_undegraded":"2024-09-13T06:10:10.946008+0000","last_fullsized":"2024-09-13T06:10:10.946008+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:07:06.165239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"35'8","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:48.486283+0000","last_change":"2024-09-13T06:09:42.214258+0000","last_active":"2024-09-13T06:12:48.486283+0000","last_peered":"2024-09-13T06:12:48.486283+0000","last_clean":"2024-09-13T06:12:48.486283+0000","last_became_active":"2024-09-13T06:09:42.213809+0000","last_became_peered":"2024-09-13T06:09:42.213809+0000","last_unstale":"2024-09-13T06:12:48.486283+0000","last_undegraded":"2024-09-13T06:12:48.486283+0000","last_fullsized":"2024-09-13T06:12:48.486283+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:14:08.749509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"35'6","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:18.858941+0000","last_change":"2024-09-13T06:09:34.126954+0000","last_active":"2024-09-13T06:10:18.858941+0000","last_peered":"2024-09-13T06:10:18.858941+0000","last_clean":"2024-09-13T06:10:18.858941+0000","last_became_active":"2024-09-13T06:09:34.124044+0000","last_became_peered":"2024-09-13T06:09:34.124044+0000","last_unstale":"2024-09-13T06:10:18.858941+0000","last_undegraded":"2024-09-13T06:10:18.858941+0000","last_fullsized":"2024-09-13T06:10:18.858941+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:41:52.801670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.793841+0000","last_change":"2024-09-13T06:09:32.134687+0000","last_active":"2024-09-13T06:10:10.793841+0000","last_peered":"2024-09-13T06:10:10.793841+0000","last_clean":"2024-09-13T06:10:10.793841+0000","last_became_active":"2024-09-13T06:09:32.133972+0000","last_became_peered":"2024-09-13T06:09:32.133972+0000","last_unstale":"2024-09-13T06:10:10.793841+0000","last_undegraded":"2024-09-13T06:10:10.793841+0000","last_fullsized":"2024-09-13T06:10:10.793841+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:28:08.722107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"35'12","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.513040+0000","last_change":"2024-09-13T06:09:34.113604+0000","last_active":"2024-09-13T06:12:49.513040+0000","last_peered":"2024-09-13T06:12:49.513040+0000","last_clean":"2024-09-13T06:12:49.513040+0000","last_became_active":"2024-09-13T06:09:34.112805+0000","last_became_peered":"2024-09-13T06:09:34.112805+0000","last_unstale":"2024-09-13T06:12:49.513040+0000","last_undegraded":"2024-09-13T06:12:49.513040+0000","last_fullsized":"2024-09-13T06:12:49.513040+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:57:58.370368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:18.043879+0000","last_change":"2024-09-13T06:09:32.150318+0000","last_active":"2024-09-13T06:10:18.043879+0000","last_peered":"2024-09-13T06:10:18.043879+0000","last_clean":"2024-09-13T06:10:18.043879+0000","last_became_active":"2024-09-13T06:09:32.145941+0000","last_became_peered":"2024-09-13T06:09:32.145941+0000","last_unstale":"2024-09-13T06:10:18.043879+0000","last_undegraded":"2024-09-13T06:10:18.043879+0000","last_fullsized":"2024-09-13T06:10:18.043879+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:52:39.866148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"35'10","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.435817+0000","last_change":"2024-09-13T06:09:34.118956+0000","last_active":"2024-09-13T06:12:49.435817+0000","last_peered":"2024-09-13T06:12:49.435817+0000","last_clean":"2024-09-13T06:12:49.435817+0000","last_became_active":"2024-09-13T06:09:34.118325+0000","last_became_peered":"2024-09-13T06:09:34.118325+0000","last_unstale":"2024-09-13T06:12:49.435817+0000","last_undegraded":"2024-09-13T06:12:49.435817+0000","last_fullsized":"2024-09-13T06:12:49.435817+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:29:20.078139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:19.629629+0000","last_change":"2024-09-13T06:09:32.144168+0000","last_active":"2024-09-13T06:10:19.629629+0000","last_peered":"2024-09-13T06:10:19.629629+0000","last_clean":"2024-09-13T06:10:19.629629+0000","last_became_active":"2024-09-13T06:09:32.133230+0000","last_became_peered":"2024-09-13T06:09:32.133230+0000","last_unstale":"2024-09-13T06:10:19.629629+0000","last_undegraded":"2024-09-13T06:10:19.629629+0000","last_fullsized":"2024-09-13T06:10:19.629629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:30:40.767524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"35'4","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.512979+0000","last_change":"2024-09-13T06:09:34.117053+0000","last_active":"2024-09-13T06:12:49.512979+0000","last_peered":"2024-09-13T06:12:49.512979+0000","last_clean":"2024-09-13T06:12:49.512979+0000","last_became_active":"2024-09-13T06:09:34.115512+0000","last_became_peered":"2024-09-13T06:09:34.115512+0000","last_unstale":"2024-09-13T06:12:49.512979+0000","last_undegraded":"2024-09-13T06:12:49.512979+0000","last_fullsized":"2024-09-13T06:12:49.512979+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:41:07.174428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:48.905752+0000","last_change":"2024-09-13T06:09:32.153571+0000","last_active":"2024-09-13T06:12:48.905752+0000","last_peered":"2024-09-13T06:12:48.905752+0000","last_clean":"2024-09-13T06:12:48.905752+0000","last_became_active":"2024-09-13T06:09:32.150328+0000","last_became_peered":"2024-09-13T06:09:32.150328+0000","last_unstale":"2024-09-13T06:12:48.905752+0000","last_undegraded":"2024-09-13T06:12:48.905752+0000","last_fullsized":"2024-09-13T06:12:48.905752+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:42:54.943685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"35'12","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.109084+0000","last_change":"2024-09-13T06:09:34.115843+0000","last_active":"2024-09-13T06:12:49.109084+0000","last_peered":"2024-09-13T06:12:49.109084+0000","last_clean":"2024-09-13T06:12:49.109084+0000","last_became_active":"2024-09-13T06:09:34.113986+0000","last_became_peered":"2024-09-13T06:09:34.113986+0000","last_unstale":"2024-09-13T06:12:49.109084+0000","last_undegraded":"2024-09-13T06:12:49.109084+0000","last_fullsized":"2024-09-13T06:12:49.109084+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:03:45.932431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.948985+0000","last_change":"2024-09-13T06:09:32.137258+0000","last_active":"2024-09-13T06:10:10.948985+0000","last_peered":"2024-09-13T06:10:10.948985+0000","last_clean":"2024-09-13T06:10:10.948985+0000","last_became_active":"2024-09-13T06:09:32.136268+0000","last_became_peered":"2024-09-13T06:09:32.136268+0000","last_unstale":"2024-09-13T06:10:10.948985+0000","last_undegraded":"2024-09-13T06:10:10.948985+0000","last_fullsized":"2024-09-13T06:10:10.948985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:42:07.291597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"35'4","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:43.519164+0000","last_change":"2024-09-13T06:09:34.124112+0000","last_active":"2024-09-13T06:11:43.519164+0000","last_peered":"2024-09-13T06:11:43.519164+0000","last_clean":"2024-09-13T06:11:43.519164+0000","last_became_active":"2024-09-13T06:09:34.121261+0000","last_became_peered":"2024-09-13T06:09:34.121261+0000","last_unstale":"2024-09-13T06:11:43.519164+0000","last_undegraded":"2024-09-13T06:11:43.519164+0000","last_fullsized":"2024-09-13T06:11:43.519164+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:29:20.327517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.818014+0000","last_change":"2024-09-13T06:09:32.142747+0000","last_active":"2024-09-13T06:10:10.818014+0000","last_peered":"2024-09-13T06:10:10.818014+0000","last_clean":"2024-09-13T06:10:10.818014+0000","last_became_active":"2024-09-13T06:09:32.141602+0000","last_became_peered":"2024-09-13T06:09:32.141602+0000","last_unstale":"2024-09-13T06:10:10.818014+0000","last_undegraded":"2024-09-13T06:10:10.818014+0000","last_fullsized":"2024-09-13T06:10:10.818014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:12:22.491041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"35'6","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.512979+0000","last_change":"2024-09-13T06:09:34.123392+0000","last_active":"2024-09-13T06:12:49.512979+0000","last_peered":"2024-09-13T06:12:49.512979+0000","last_clean":"2024-09-13T06:12:49.512979+0000","last_became_active":"2024-09-13T06:09:34.122424+0000","last_became_peered":"2024-09-13T06:09:34.122424+0000","last_unstale":"2024-09-13T06:12:49.512979+0000","last_undegraded":"2024-09-13T06:12:49.512979+0000","last_fullsized":"2024-09-13T06:12:49.512979+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:32:59.845317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.803937+0000","last_change":"2024-09-13T06:09:32.120069+0000","last_active":"2024-09-13T06:10:10.803937+0000","last_peered":"2024-09-13T06:10:10.803937+0000","last_clean":"2024-09-13T06:10:10.803937+0000","last_became_active":"2024-09-13T06:09:32.119665+0000","last_became_peered":"2024-09-13T06:09:32.119665+0000","last_unstale":"2024-09-13T06:10:10.803937+0000","last_undegraded":"2024-09-13T06:10:10.803937+0000","last_fullsized":"2024-09-13T06:10:10.803937+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:12:38.569078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"35'9","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.454353+0000","last_change":"2024-09-13T06:09:34.121479+0000","last_active":"2024-09-13T06:12:49.454353+0000","last_peered":"2024-09-13T06:12:49.454353+0000","last_clean":"2024-09-13T06:12:49.454353+0000","last_became_active":"2024-09-13T06:09:34.114378+0000","last_became_peered":"2024-09-13T06:09:34.114378+0000","last_unstale":"2024-09-13T06:12:49.454353+0000","last_undegraded":"2024-09-13T06:12:49.454353+0000","last_fullsized":"2024-09-13T06:12:49.454353+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:48:00.341088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"35'3","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:45.798306+0000","last_change":"2024-09-13T06:09:32.147166+0000","last_active":"2024-09-13T06:11:45.798306+0000","last_peered":"2024-09-13T06:11:45.798306+0000","last_clean":"2024-09-13T06:11:45.798306+0000","last_became_active":"2024-09-13T06:09:32.146011+0000","last_became_peered":"2024-09-13T06:09:32.146011+0000","last_unstale":"2024-09-13T06:11:45.798306+0000","last_undegraded":"2024-09-13T06:11:45.798306+0000","last_fullsized":"2024-09-13T06:11:45.798306+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:56:46.777275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668544,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":11,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"35'2","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:43.532529+0000","last_change":"2024-09-13T06:09:34.118796+0000","last_active":"2024-09-13T06:11:43.532529+0000","last_peered":"2024-09-13T06:11:43.532529+0000","last_clean":"2024-09-13T06:11:43.532529+0000","last_became_active":"2024-09-13T06:09:34.117659+0000","last_became_peered":"2024-09-13T06:09:34.117659+0000","last_unstale":"2024-09-13T06:11:43.532529+0000","last_undegraded":"2024-09-13T06:11:43.532529+0000","last_fullsized":"2024-09-13T06:11:43.532529+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:26:28.789376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:47.850255+0000","last_change":"2024-09-13T06:09:32.124201+0000","last_active":"2024-09-13T06:11:47.850255+0000","last_peered":"2024-09-13T06:11:47.850255+0000","last_clean":"2024-09-13T06:11:47.850255+0000","last_became_active":"2024-09-13T06:09:32.121250+0000","last_became_peered":"2024-09-13T06:09:32.121250+0000","last_unstale":"2024-09-13T06:11:47.850255+0000","last_undegraded":"2024-09-13T06:11:47.850255+0000","last_fullsized":"2024-09-13T06:11:47.850255+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:52:58.934306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"35'5","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:57.810848+0000","last_change":"2024-09-13T06:09:34.118552+0000","last_active":"2024-09-13T06:11:57.810848+0000","last_peered":"2024-09-13T06:11:57.810848+0000","last_clean":"2024-09-13T06:11:57.810848+0000","last_became_active":"2024-09-13T06:09:34.118270+0000","last_became_peered":"2024-09-13T06:09:34.118270+0000","last_unstale":"2024-09-13T06:11:57.810848+0000","last_undegraded":"2024-09-13T06:11:57.810848+0000","last_fullsized":"2024-09-13T06:11:57.810848+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:36:12.584267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:18.044995+0000","last_change":"2024-09-13T06:09:32.151004+0000","last_active":"2024-09-13T06:10:18.044995+0000","last_peered":"2024-09-13T06:10:18.044995+0000","last_clean":"2024-09-13T06:10:18.044995+0000","last_became_active":"2024-09-13T06:09:32.145988+0000","last_became_peered":"2024-09-13T06:09:32.145988+0000","last_unstale":"2024-09-13T06:10:18.044995+0000","last_undegraded":"2024-09-13T06:10:18.044995+0000","last_fullsized":"2024-09-13T06:10:18.044995+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:56:32.022947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"33'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.951431+0000","last_change":"2024-09-13T06:09:34.118753+0000","last_active":"2024-09-13T06:10:10.951431+0000","last_peered":"2024-09-13T06:10:10.951431+0000","last_clean":"2024-09-13T06:10:10.951431+0000","last_became_active":"2024-09-13T06:09:34.117320+0000","last_became_peered":"2024-09-13T06:09:34.117320+0000","last_unstale":"2024-09-13T06:10:10.951431+0000","last_undegraded":"2024-09-13T06:10:10.951431+0000","last_fullsized":"2024-09-13T06:10:10.951431+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:09:45.564486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"35'1","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:47.803012+0000","last_change":"2024-09-13T06:09:32.141516+0000","last_active":"2024-09-13T06:11:47.803012+0000","last_peered":"2024-09-13T06:11:47.803012+0000","last_clean":"2024-09-13T06:11:47.803012+0000","last_became_active":"2024-09-13T06:09:32.141009+0000","last_became_peered":"2024-09-13T06:09:32.141009+0000","last_unstale":"2024-09-13T06:11:47.803012+0000","last_undegraded":"2024-09-13T06:11:47.803012+0000","last_fullsized":"2024-09-13T06:11:47.803012+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:33:27.853475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"35'12","reported_seq":82,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.436923+0000","last_change":"2024-09-13T06:09:34.124580+0000","last_active":"2024-09-13T06:12:49.436923+0000","last_peered":"2024-09-13T06:12:49.436923+0000","last_clean":"2024-09-13T06:12:49.436923+0000","last_became_active":"2024-09-13T06:09:34.124270+0000","last_became_peered":"2024-09-13T06:09:34.124270+0000","last_unstale":"2024-09-13T06:12:49.436923+0000","last_undegraded":"2024-09-13T06:12:49.436923+0000","last_fullsized":"2024-09-13T06:12:49.436923+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:54:14.588264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:47.918751+0000","last_change":"2024-09-13T06:09:32.143000+0000","last_active":"2024-09-13T06:11:47.918751+0000","last_peered":"2024-09-13T06:11:47.918751+0000","last_clean":"2024-09-13T06:11:47.918751+0000","last_became_active":"2024-09-13T06:09:32.142581+0000","last_became_peered":"2024-09-13T06:09:32.142581+0000","last_unstale":"2024-09-13T06:11:47.918751+0000","last_undegraded":"2024-09-13T06:11:47.918751+0000","last_fullsized":"2024-09-13T06:11:47.918751+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:04:11.910433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"35'16","reported_seq":76,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.437303+0000","last_change":"2024-09-13T06:09:34.118681+0000","last_active":"2024-09-13T06:12:49.437303+0000","last_peered":"2024-09-13T06:12:49.437303+0000","last_clean":"2024-09-13T06:12:49.437303+0000","last_became_active":"2024-09-13T06:09:34.118290+0000","last_became_peered":"2024-09-13T06:09:34.118290+0000","last_unstale":"2024-09-13T06:12:49.437303+0000","last_undegraded":"2024-09-13T06:12:49.437303+0000","last_fullsized":"2024-09-13T06:12:49.437303+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:00:27.052532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":58,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.809957+0000","last_change":"2024-09-13T06:09:32.124596+0000","last_active":"2024-09-13T06:10:10.809957+0000","last_peered":"2024-09-13T06:10:10.809957+0000","last_clean":"2024-09-13T06:10:10.809957+0000","last_became_active":"2024-09-13T06:09:32.121400+0000","last_became_peered":"2024-09-13T06:09:32.121400+0000","last_unstale":"2024-09-13T06:10:10.809957+0000","last_undegraded":"2024-09-13T06:10:10.809957+0000","last_fullsized":"2024-09-13T06:10:10.809957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:19:33.910739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"35'13","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.533331+0000","last_change":"2024-09-13T06:09:34.124551+0000","last_active":"2024-09-13T06:12:49.533331+0000","last_peered":"2024-09-13T06:12:49.533331+0000","last_clean":"2024-09-13T06:12:49.533331+0000","last_became_active":"2024-09-13T06:09:34.121743+0000","last_became_peered":"2024-09-13T06:09:34.121743+0000","last_unstale":"2024-09-13T06:12:49.533331+0000","last_undegraded":"2024-09-13T06:12:49.533331+0000","last_fullsized":"2024-09-13T06:12:49.533331+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:34:44.658759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.291785+0000","last_change":"2024-09-13T06:09:32.135724+0000","last_active":"2024-09-13T06:12:49.291785+0000","last_peered":"2024-09-13T06:12:49.291785+0000","last_clean":"2024-09-13T06:12:49.291785+0000","last_became_active":"2024-09-13T06:09:32.127830+0000","last_became_peered":"2024-09-13T06:09:32.127830+0000","last_unstale":"2024-09-13T06:12:49.291785+0000","last_undegraded":"2024-09-13T06:12:49.291785+0000","last_fullsized":"2024-09-13T06:12:49.291785+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:27:43.484419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"35'4","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:19.300831+0000","last_change":"2024-09-13T06:09:34.126475+0000","last_active":"2024-09-13T06:10:19.300831+0000","last_peered":"2024-09-13T06:10:19.300831+0000","last_clean":"2024-09-13T06:10:19.300831+0000","last_became_active":"2024-09-13T06:09:34.126020+0000","last_became_peered":"2024-09-13T06:09:34.126020+0000","last_unstale":"2024-09-13T06:10:19.300831+0000","last_undegraded":"2024-09-13T06:10:19.300831+0000","last_fullsized":"2024-09-13T06:10:19.300831+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:44:39.157280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"35'1","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:51.799858+0000","last_change":"2024-09-13T06:09:32.119928+0000","last_active":"2024-09-13T06:11:51.799858+0000","last_peered":"2024-09-13T06:11:51.799858+0000","last_clean":"2024-09-13T06:11:51.799858+0000","last_became_active":"2024-09-13T06:09:32.119542+0000","last_became_peered":"2024-09-13T06:09:32.119542+0000","last_unstale":"2024-09-13T06:11:51.799858+0000","last_undegraded":"2024-09-13T06:11:51.799858+0000","last_fullsized":"2024-09-13T06:11:51.799858+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:55:55.407168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"35'6","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.513282+0000","last_change":"2024-09-13T06:09:34.118722+0000","last_active":"2024-09-13T06:12:49.513282+0000","last_peered":"2024-09-13T06:12:49.513282+0000","last_clean":"2024-09-13T06:12:49.513282+0000","last_became_active":"2024-09-13T06:09:34.110506+0000","last_became_peered":"2024-09-13T06:09:34.110506+0000","last_unstale":"2024-09-13T06:12:49.513282+0000","last_undegraded":"2024-09-13T06:12:49.513282+0000","last_fullsized":"2024-09-13T06:12:49.513282+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:22:27.348511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.818133+0000","last_change":"2024-09-13T06:09:32.130216+0000","last_active":"2024-09-13T06:10:10.818133+0000","last_peered":"2024-09-13T06:10:10.818133+0000","last_clean":"2024-09-13T06:10:10.818133+0000","last_became_active":"2024-09-13T06:09:32.121895+0000","last_became_peered":"2024-09-13T06:09:32.121895+0000","last_unstale":"2024-09-13T06:10:10.818133+0000","last_undegraded":"2024-09-13T06:10:10.818133+0000","last_fullsized":"2024-09-13T06:10:10.818133+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:31:54.248100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.802008+0000","last_change":"2024-09-13T06:09:32.132716+0000","last_active":"2024-09-13T06:10:10.802008+0000","last_peered":"2024-09-13T06:10:10.802008+0000","last_clean":"2024-09-13T06:10:10.802008+0000","last_became_active":"2024-09-13T06:09:32.130056+0000","last_became_peered":"2024-09-13T06:09:32.130056+0000","last_unstale":"2024-09-13T06:10:10.802008+0000","last_undegraded":"2024-09-13T06:10:10.802008+0000","last_fullsized":"2024-09-13T06:10:10.802008+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:57:09.275474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"35'8","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:48.958693+0000","last_change":"2024-09-13T06:09:34.132050+0000","last_active":"2024-09-13T06:12:48.958693+0000","last_peered":"2024-09-13T06:12:48.958693+0000","last_clean":"2024-09-13T06:12:48.958693+0000","last_became_active":"2024-09-13T06:09:34.130980+0000","last_became_peered":"2024-09-13T06:09:34.130980+0000","last_unstale":"2024-09-13T06:12:48.958693+0000","last_undegraded":"2024-09-13T06:12:48.958693+0000","last_fullsized":"2024-09-13T06:12:48.958693+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:11:30.370585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"33'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.944159+0000","last_change":"2024-09-13T06:09:32.152088+0000","last_active":"2024-09-13T06:10:10.944159+0000","last_peered":"2024-09-13T06:10:10.944159+0000","last_clean":"2024-09-13T06:10:10.944159+0000","last_became_active":"2024-09-13T06:09:32.149426+0000","last_became_peered":"2024-09-13T06:09:32.149426+0000","last_unstale":"2024-09-13T06:10:10.944159+0000","last_undegraded":"2024-09-13T06:10:10.944159+0000","last_fullsized":"2024-09-13T06:10:10.944159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:53:16.188364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"35'3","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:02.807090+0000","last_change":"2024-09-13T06:09:34.118994+0000","last_active":"2024-09-13T06:12:02.807090+0000","last_peered":"2024-09-13T06:12:02.807090+0000","last_clean":"2024-09-13T06:12:02.807090+0000","last_became_active":"2024-09-13T06:09:34.111230+0000","last_became_peered":"2024-09-13T06:09:34.111230+0000","last_unstale":"2024-09-13T06:12:02.807090+0000","last_undegraded":"2024-09-13T06:12:02.807090+0000","last_fullsized":"2024-09-13T06:12:02.807090+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:48:17.434872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13384,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1618,"num_read_kb":1508,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25809792,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":34422784,"data_stored":34422784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640309,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48392,"kb_used_data":8888,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323448,"statfs":{"total":96636764160,"available":96587210752,"internally_reserved":0,"allocated":9101312,"data_stored":8762833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640309,"num_pgs":155,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44772,"kb_used_data":9428,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327068,"statfs":{"total":96636764160,"available":96590917632,"internally_reserved":0,"allocated":9654272,"data_stored":9351111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673013,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48904,"kb_used_data":9400,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94322936,"statfs":{"total":96636764160,"available":96586686464,"internally_reserved":0,"allocated":9625600,"data_stored":9349057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705714,"num_pgs":170,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48356,"kb_used_data":8852,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323484,"statfs":{"total":96636764160,"available":96587247616,"internally_reserved":0,"allocated":9064448,"data_stored":8760119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T06:13:21.437 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T06:13:21.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.592+0000 7f167737c640 1 Processor -- start 2024-09-13T06:13:21.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.592+0000 7f167737c640 1 -- start start 2024-09-13T06:13:21.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.592+0000 7f167737c640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f167012f390 0x7f1670133a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:13:21.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.592+0000 7f167737c640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16700984f0 con 0x7f167012e760 2024-09-13T06:13:21.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.592+0000 7f167737c640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f1670098dc0 con 0x7f167012f390 2024-09-13T06:13:21.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.592+0000 7f1674917640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f167012f390 0x7f1670133a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:13:21.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.592+0000 7f1675118640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f167012e760 0x7f167012ec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:34288/0 (socket says 172.21.15.120:34288) 2024-09-13T06:13:21.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.592+0000 7f1675118640 1 -- 172.21.15.120:0/3902892855 learned_addr learned my addr 172.21.15.120:0/3902892855 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-13T06:13:21.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.592+0000 7f1667fff640 1 -- 172.21.15.120:0/3902892855 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1382151475 0 0) 0x7f16700984f0 con 0x7f167012e760 2024-09-13T06:13:21.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.592+0000 7f1667fff640 1 -- 172.21.15.120:0/3902892855 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f165c003530 con 0x7f167012e760 2024-09-13T06:13:21.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.592+0000 7f1674917640 1 -- 172.21.15.120:0/3902892855 >> v1:172.21.15.120:6789/0 conn(0x7f167012e760 legacy=0x7f167012ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:21.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.592+0000 7f1674917640 1 -- 172.21.15.120:0/3902892855 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16700981a0 con 0x7f167012f390 2024-09-13T06:13:21.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.596+0000 7f1674917640 1 --2- 172.21.15.120:0/3902892855 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f167012f390 0x7f1670133a80 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f1660009740 tx=0x7f166001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb6d034b76366a5c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:13:21.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.596+0000 7f1667fff640 1 -- 172.21.15.120:0/3902892855 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16600b1070 con 0x7f167012f390 2024-09-13T06:13:21.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.596+0000 7f1667fff640 1 -- 172.21.15.120:0/3902892855 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16600ac570 con 0x7f167012f390 2024-09-13T06:13:21.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.596+0000 7f1667fff640 1 -- 172.21.15.120:0/3902892855 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16600ac870 con 0x7f167012f390 2024-09-13T06:13:21.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.596+0000 7f167737c640 1 -- 172.21.15.120:0/3902892855 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f167012f390 msgr2=0x7f1670133a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:21.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.596+0000 7f167737c640 1 --2- 172.21.15.120:0/3902892855 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f167012f390 0x7f1670133a80 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f1660009740 tx=0x7f166001c400 comp rx=0 tx=0).stop 2024-09-13T06:13:21.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.596+0000 7f167737c640 1 -- 172.21.15.120:0/3902892855 shutdown_connections 2024-09-13T06:13:21.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.596+0000 7f167737c640 1 --2- 172.21.15.120:0/3902892855 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f167012f390 0x7f1670133a80 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:13:21.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.596+0000 7f167737c640 1 -- 172.21.15.120:0/3902892855 >> 172.21.15.120:0/3902892855 conn(0x7f16700a10a0 msgr2=0x7f16700a14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:13:21.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.596+0000 7f167737c640 1 -- 172.21.15.120:0/3902892855 shutdown_connections 2024-09-13T06:13:21.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.596+0000 7f167737c640 1 -- 172.21.15.120:0/3902892855 wait complete. 2024-09-13T06:13:21.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.596+0000 7f167737c640 1 Processor -- start 2024-09-13T06:13:21.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.596+0000 7f167737c640 1 -- start start 2024-09-13T06:13:21.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.596+0000 7f167737c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f167012e760 0x7f167012fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:13:21.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.596+0000 7f167737c640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f1670136b70 con 0x7f167012e760 2024-09-13T06:13:21.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.600+0000 7f1675118640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f167012e760 0x7f167012fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:13:21.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.600+0000 7f1675118640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f167012e760 0x7f167012fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:42780/0 (socket says 172.21.15.120:42780) 2024-09-13T06:13:21.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.600+0000 7f1675118640 1 -- 172.21.15.120:0/1451145396 learned_addr learned my addr 172.21.15.120:0/1451145396 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-13T06:13:21.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.600+0000 7f1675118640 1 -- 172.21.15.120:0/1451145396 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1670132930 con 0x7f167012e760 2024-09-13T06:13:21.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.600+0000 7f1675118640 1 --2- 172.21.15.120:0/1451145396 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f167012e760 0x7f167012fd20 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f166c00c450 tx=0x7f166c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:13:21.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.600+0000 7f1665ffb640 1 -- 172.21.15.120:0/1451145396 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f166c017070 con 0x7f167012e760 2024-09-13T06:13:21.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.600+0000 7f1665ffb640 1 -- 172.21.15.120:0/1451145396 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f166c005c20 con 0x7f167012e760 2024-09-13T06:13:21.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.600+0000 7f167737c640 1 -- 172.21.15.120:0/1451145396 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16701314b0 con 0x7f167012e760 2024-09-13T06:13:21.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.600+0000 7f1665ffb640 1 -- 172.21.15.120:0/1451145396 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f166c007070 con 0x7f167012e760 2024-09-13T06:13:21.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.600+0000 7f167737c640 1 -- 172.21.15.120:0/1451145396 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1670130260 con 0x7f167012e760 2024-09-13T06:13:21.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.600+0000 7f1665ffb640 1 -- 172.21.15.120:0/1451145396 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f166c01a070 con 0x7f167012e760 2024-09-13T06:13:21.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.600+0000 7f167737c640 1 -- 172.21.15.120:0/1451145396 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f167012ec80 con 0x7f167012e760 2024-09-13T06:13:21.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.600+0000 7f1665ffb640 1 --2- 172.21.15.120:0/1451145396 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f1654035db0 0x7f1654038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:13:21.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.600+0000 7f1665ffb640 1 -- 172.21.15.120:0/1451145396 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f166c0484c0 con 0x7f167012e760 2024-09-13T06:13:21.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.600+0000 7f1674917640 1 --2- 172.21.15.120:0/1451145396 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f1654035db0 0x7f1654038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:13:21.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.600+0000 7f1674917640 1 --2- 172.21.15.120:0/1451145396 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f1654035db0 0x7f1654038270 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f16600ae000 tx=0x7f1660008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:13:21.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.604+0000 7f1665ffb640 1 -- 172.21.15.120:0/1451145396 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f166c007210 con 0x7f167012e760 2024-09-13T06:13:21.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.764+0000 7f167737c640 1 -- 172.21.15.120:0/1451145396 --> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1670128f50 con 0x7f1654035db0 2024-09-13T06:13:21.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.808+0000 7f1665ffb640 1 -- 172.21.15.120:0/1451145396 <== mgr.4100 v2:172.21.15.194:6824/3475680902 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666046 (secure 0 0 0) 0x7f1670128f50 con 0x7f1654035db0 2024-09-13T06:13:21.814 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T06:13:21.820 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-09-13T06:13:21.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.812+0000 7f167737c640 1 -- 172.21.15.120:0/1451145396 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f1654035db0 msgr2=0x7f1654038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:21.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.812+0000 7f167737c640 1 --2- 172.21.15.120:0/1451145396 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f1654035db0 0x7f1654038270 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f16600ae000 tx=0x7f1660008040 comp rx=0 tx=0).stop 2024-09-13T06:13:21.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.812+0000 7f167737c640 1 -- 172.21.15.120:0/1451145396 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f167012e760 msgr2=0x7f167012fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:21.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.812+0000 7f167737c640 1 --2- 172.21.15.120:0/1451145396 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f167012e760 0x7f167012fd20 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f166c00c450 tx=0x7f166c00c910 comp rx=0 tx=0).stop 2024-09-13T06:13:21.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.812+0000 7f167737c640 1 -- 172.21.15.120:0/1451145396 shutdown_connections 2024-09-13T06:13:21.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.812+0000 7f167737c640 1 --2- 172.21.15.120:0/1451145396 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f1654035db0 0x7f1654038270 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:13:21.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.812+0000 7f167737c640 1 --2- 172.21.15.120:0/1451145396 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f167012e760 0x7f167012fd20 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:13:21.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.812+0000 7f167737c640 1 -- 172.21.15.120:0/1451145396 >> 172.21.15.120:0/1451145396 conn(0x7f16700a10a0 msgr2=0x7f16701280b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:13:21.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.812+0000 7f167737c640 1 -- 172.21.15.120:0/1451145396 shutdown_connections 2024-09-13T06:13:21.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.812+0000 7f167737c640 1 -- 172.21.15.120:0/1451145396 wait complete. 2024-09-13T06:13:21.831 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":154,"stamp":"2024-09-13T06:13:19.817115+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26416904,"num_objects":229,"num_object_clones":0,"num_object_copies":472,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":229,"num_whiteouts":0,"num_read":4892,"num_read_kb":4469,"num_write":2108,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4480,"ondisk_log_size":4480,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":190424,"kb_used_data":36568,"kb_used_omap":6,"kb_used_meta":153785,"kb_avail":377296936,"statfs":{"total":386547056640,"available":386352062464,"internally_reserved":0,"allocated":37445632,"data_stored":36223120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":157476630},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006642"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.802800+0000","last_change":"2024-09-13T06:09:32.142010+0000","last_active":"2024-09-13T06:10:10.802800+0000","last_peered":"2024-09-13T06:10:10.802800+0000","last_clean":"2024-09-13T06:10:10.802800+0000","last_became_active":"2024-09-13T06:09:32.140025+0000","last_became_peered":"2024-09-13T06:09:32.140025+0000","last_unstale":"2024-09-13T06:10:10.802800+0000","last_undegraded":"2024-09-13T06:10:10.802800+0000","last_fullsized":"2024-09-13T06:10:10.802800+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:15:48.717644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"35'22","reported_seq":94,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.323141+0000","last_change":"2024-09-13T06:09:34.126675+0000","last_active":"2024-09-13T06:12:49.323141+0000","last_peered":"2024-09-13T06:12:49.323141+0000","last_clean":"2024-09-13T06:12:49.323141+0000","last_became_active":"2024-09-13T06:09:34.122656+0000","last_became_peered":"2024-09-13T06:09:34.122656+0000","last_unstale":"2024-09-13T06:12:49.323141+0000","last_undegraded":"2024-09-13T06:12:49.323141+0000","last_fullsized":"2024-09-13T06:12:49.323141+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:04:23.927249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":88,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:18.044019+0000","last_change":"2024-09-13T06:09:32.135771+0000","last_active":"2024-09-13T06:10:18.044019+0000","last_peered":"2024-09-13T06:10:18.044019+0000","last_clean":"2024-09-13T06:10:18.044019+0000","last_became_active":"2024-09-13T06:09:32.134020+0000","last_became_peered":"2024-09-13T06:09:32.134020+0000","last_unstale":"2024-09-13T06:10:18.044019+0000","last_undegraded":"2024-09-13T06:10:18.044019+0000","last_fullsized":"2024-09-13T06:10:18.044019+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:24:08.865544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"35'4","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:02.877682+0000","last_change":"2024-09-13T06:09:34.117071+0000","last_active":"2024-09-13T06:11:02.877682+0000","last_peered":"2024-09-13T06:11:02.877682+0000","last_clean":"2024-09-13T06:11:02.877682+0000","last_became_active":"2024-09-13T06:09:34.116715+0000","last_became_peered":"2024-09-13T06:09:34.116715+0000","last_unstale":"2024-09-13T06:11:02.877682+0000","last_undegraded":"2024-09-13T06:11:02.877682+0000","last_fullsized":"2024-09-13T06:11:02.877682+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:06:01.417735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.813339+0000","last_change":"2024-09-13T06:09:32.130525+0000","last_active":"2024-09-13T06:10:10.813339+0000","last_peered":"2024-09-13T06:10:10.813339+0000","last_clean":"2024-09-13T06:10:10.813339+0000","last_became_active":"2024-09-13T06:09:32.116345+0000","last_became_peered":"2024-09-13T06:09:32.116345+0000","last_unstale":"2024-09-13T06:10:10.813339+0000","last_undegraded":"2024-09-13T06:10:10.813339+0000","last_fullsized":"2024-09-13T06:10:10.813339+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:47:58.332268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.805435+0000","last_change":"2024-09-13T06:09:34.118858+0000","last_active":"2024-09-13T06:10:10.805435+0000","last_peered":"2024-09-13T06:10:10.805435+0000","last_clean":"2024-09-13T06:10:10.805435+0000","last_became_active":"2024-09-13T06:09:34.117940+0000","last_became_peered":"2024-09-13T06:09:34.117940+0000","last_unstale":"2024-09-13T06:10:10.805435+0000","last_undegraded":"2024-09-13T06:10:10.805435+0000","last_fullsized":"2024-09-13T06:10:10.805435+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:31:13.005586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"35'4","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.308971+0000","last_change":"2024-09-13T06:09:32.120391+0000","last_active":"2024-09-13T06:12:49.308971+0000","last_peered":"2024-09-13T06:12:49.308971+0000","last_clean":"2024-09-13T06:12:49.308971+0000","last_became_active":"2024-09-13T06:09:32.119806+0000","last_became_peered":"2024-09-13T06:09:32.119806+0000","last_unstale":"2024-09-13T06:12:49.308971+0000","last_undegraded":"2024-09-13T06:12:49.308971+0000","last_fullsized":"2024-09-13T06:12:49.308971+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:16:11.746030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"35'4","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.110973+0000","last_change":"2024-09-13T06:09:34.123442+0000","last_active":"2024-09-13T06:12:49.110973+0000","last_peered":"2024-09-13T06:12:49.110973+0000","last_clean":"2024-09-13T06:12:49.110973+0000","last_became_active":"2024-09-13T06:09:34.122631+0000","last_became_peered":"2024-09-13T06:09:34.122631+0000","last_unstale":"2024-09-13T06:12:49.110973+0000","last_undegraded":"2024-09-13T06:12:49.110973+0000","last_fullsized":"2024-09-13T06:12:49.110973+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:05:27.025085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:18.043979+0000","last_change":"2024-09-13T06:09:32.129860+0000","last_active":"2024-09-13T06:10:18.043979+0000","last_peered":"2024-09-13T06:10:18.043979+0000","last_clean":"2024-09-13T06:10:18.043979+0000","last_became_active":"2024-09-13T06:09:32.121803+0000","last_became_peered":"2024-09-13T06:09:32.121803+0000","last_unstale":"2024-09-13T06:10:18.043979+0000","last_undegraded":"2024-09-13T06:10:18.043979+0000","last_fullsized":"2024-09-13T06:10:18.043979+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:35:53.036270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"35'4","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.112548+0000","last_change":"2024-09-13T06:09:34.127392+0000","last_active":"2024-09-13T06:12:49.112548+0000","last_peered":"2024-09-13T06:12:49.112548+0000","last_clean":"2024-09-13T06:12:49.112548+0000","last_became_active":"2024-09-13T06:09:34.124728+0000","last_became_peered":"2024-09-13T06:09:34.124728+0000","last_unstale":"2024-09-13T06:12:49.112548+0000","last_undegraded":"2024-09-13T06:12:49.112548+0000","last_fullsized":"2024-09-13T06:12:49.112548+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:16:25.577037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.300520+0000","last_change":"2024-09-13T06:09:32.117055+0000","last_active":"2024-09-13T06:12:49.300520+0000","last_peered":"2024-09-13T06:12:49.300520+0000","last_clean":"2024-09-13T06:12:49.300520+0000","last_became_active":"2024-09-13T06:09:32.116422+0000","last_became_peered":"2024-09-13T06:09:32.116422+0000","last_unstale":"2024-09-13T06:12:49.300520+0000","last_undegraded":"2024-09-13T06:12:49.300520+0000","last_fullsized":"2024-09-13T06:12:49.300520+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:42:30.526894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"35'4","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.513278+0000","last_change":"2024-09-13T06:10:10.823960+0000","last_active":"2024-09-13T06:12:49.513278+0000","last_peered":"2024-09-13T06:12:49.513278+0000","last_clean":"2024-09-13T06:12:49.513278+0000","last_became_active":"2024-09-13T06:10:10.810259+0000","last_became_peered":"2024-09-13T06:10:10.810259+0000","last_unstale":"2024-09-13T06:12:49.513278+0000","last_undegraded":"2024-09-13T06:12:49.513278+0000","last_fullsized":"2024-09-13T06:12:49.513278+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:20:38.364042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"35'4","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:19.634736+0000","last_change":"2024-09-13T06:09:32.130200+0000","last_active":"2024-09-13T06:10:19.634736+0000","last_peered":"2024-09-13T06:10:19.634736+0000","last_clean":"2024-09-13T06:10:19.634736+0000","last_became_active":"2024-09-13T06:09:32.122126+0000","last_became_peered":"2024-09-13T06:09:32.122126+0000","last_unstale":"2024-09-13T06:10:19.634736+0000","last_undegraded":"2024-09-13T06:10:19.634736+0000","last_fullsized":"2024-09-13T06:10:19.634736+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:26:21.113764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"35'10","reported_seq":59,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.436094+0000","last_change":"2024-09-13T06:09:34.120695+0000","last_active":"2024-09-13T06:12:49.436094+0000","last_peered":"2024-09-13T06:12:49.436094+0000","last_clean":"2024-09-13T06:12:49.436094+0000","last_became_active":"2024-09-13T06:09:34.120349+0000","last_became_peered":"2024-09-13T06:09:34.120349+0000","last_unstale":"2024-09-13T06:12:49.436094+0000","last_undegraded":"2024-09-13T06:12:49.436094+0000","last_fullsized":"2024-09-13T06:12:49.436094+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:11:30.370585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.943818+0000","last_change":"2024-09-13T06:09:32.149245+0000","last_active":"2024-09-13T06:10:10.943818+0000","last_peered":"2024-09-13T06:10:10.943818+0000","last_clean":"2024-09-13T06:10:10.943818+0000","last_became_active":"2024-09-13T06:09:32.147504+0000","last_became_peered":"2024-09-13T06:09:32.147504+0000","last_unstale":"2024-09-13T06:10:10.943818+0000","last_undegraded":"2024-09-13T06:10:10.943818+0000","last_fullsized":"2024-09-13T06:10:10.943818+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:06:35.186829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"35'9","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:41.798014+0000","last_change":"2024-09-13T06:09:34.104380+0000","last_active":"2024-09-13T06:11:41.798014+0000","last_peered":"2024-09-13T06:11:41.798014+0000","last_clean":"2024-09-13T06:11:41.798014+0000","last_became_active":"2024-09-13T06:09:34.104043+0000","last_became_peered":"2024-09-13T06:09:34.104043+0000","last_unstale":"2024-09-13T06:11:41.798014+0000","last_undegraded":"2024-09-13T06:11:41.798014+0000","last_fullsized":"2024-09-13T06:11:41.798014+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:57:58.370368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"35'4","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.513237+0000","last_change":"2024-09-13T06:09:34.116800+0000","last_active":"2024-09-13T06:12:49.513237+0000","last_peered":"2024-09-13T06:12:49.513237+0000","last_clean":"2024-09-13T06:12:49.513237+0000","last_became_active":"2024-09-13T06:09:34.116359+0000","last_became_peered":"2024-09-13T06:09:34.116359+0000","last_unstale":"2024-09-13T06:12:49.513237+0000","last_undegraded":"2024-09-13T06:12:49.513237+0000","last_fullsized":"2024-09-13T06:12:49.513237+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:45:39.768477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.282953+0000","last_change":"2024-09-13T06:09:32.135469+0000","last_active":"2024-09-13T06:12:49.282953+0000","last_peered":"2024-09-13T06:12:49.282953+0000","last_clean":"2024-09-13T06:12:49.282953+0000","last_became_active":"2024-09-13T06:09:32.134667+0000","last_became_peered":"2024-09-13T06:09:32.134667+0000","last_unstale":"2024-09-13T06:12:49.282953+0000","last_undegraded":"2024-09-13T06:12:49.282953+0000","last_fullsized":"2024-09-13T06:12:49.282953+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:48:22.672562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"35'18","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.437837+0000","last_change":"2024-09-13T06:09:34.118112+0000","last_active":"2024-09-13T06:12:49.437837+0000","last_peered":"2024-09-13T06:12:49.437837+0000","last_clean":"2024-09-13T06:12:49.437837+0000","last_became_active":"2024-09-13T06:09:34.115348+0000","last_became_peered":"2024-09-13T06:09:34.115348+0000","last_unstale":"2024-09-13T06:12:49.437837+0000","last_undegraded":"2024-09-13T06:12:49.437837+0000","last_fullsized":"2024-09-13T06:12:49.437837+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:27:45.493240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":45,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.804770+0000","last_change":"2024-09-13T06:09:32.137039+0000","last_active":"2024-09-13T06:10:10.804770+0000","last_peered":"2024-09-13T06:10:10.804770+0000","last_clean":"2024-09-13T06:10:10.804770+0000","last_became_active":"2024-09-13T06:09:32.135460+0000","last_became_peered":"2024-09-13T06:09:32.135460+0000","last_unstale":"2024-09-13T06:10:10.804770+0000","last_undegraded":"2024-09-13T06:10:10.804770+0000","last_fullsized":"2024-09-13T06:10:10.804770+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:11:15.868187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"35'2","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:19.300519+0000","last_change":"2024-09-13T06:09:34.115425+0000","last_active":"2024-09-13T06:10:19.300519+0000","last_peered":"2024-09-13T06:10:19.300519+0000","last_clean":"2024-09-13T06:10:19.300519+0000","last_became_active":"2024-09-13T06:09:34.115047+0000","last_became_peered":"2024-09-13T06:09:34.115047+0000","last_unstale":"2024-09-13T06:10:19.300519+0000","last_undegraded":"2024-09-13T06:10:19.300519+0000","last_fullsized":"2024-09-13T06:10:19.300519+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:46:23.635958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:18.040942+0000","last_change":"2024-09-13T06:09:32.143123+0000","last_active":"2024-09-13T06:10:18.040942+0000","last_peered":"2024-09-13T06:10:18.040942+0000","last_clean":"2024-09-13T06:10:18.040942+0000","last_became_active":"2024-09-13T06:09:32.141166+0000","last_became_peered":"2024-09-13T06:09:32.141166+0000","last_unstale":"2024-09-13T06:10:18.040942+0000","last_undegraded":"2024-09-13T06:10:18.040942+0000","last_fullsized":"2024-09-13T06:10:18.040942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:03:45.423034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"35'4","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.435819+0000","last_change":"2024-09-13T06:09:34.116108+0000","last_active":"2024-09-13T06:12:49.435819+0000","last_peered":"2024-09-13T06:12:49.435819+0000","last_clean":"2024-09-13T06:12:49.435819+0000","last_became_active":"2024-09-13T06:09:34.114242+0000","last_became_peered":"2024-09-13T06:09:34.114242+0000","last_unstale":"2024-09-13T06:12:49.435819+0000","last_undegraded":"2024-09-13T06:12:49.435819+0000","last_fullsized":"2024-09-13T06:12:49.435819+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:51:17.686447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.816928+0000","last_change":"2024-09-13T06:09:32.144134+0000","last_active":"2024-09-13T06:10:10.816928+0000","last_peered":"2024-09-13T06:10:10.816928+0000","last_clean":"2024-09-13T06:10:10.816928+0000","last_became_active":"2024-09-13T06:09:32.143746+0000","last_became_peered":"2024-09-13T06:09:32.143746+0000","last_unstale":"2024-09-13T06:10:10.816928+0000","last_undegraded":"2024-09-13T06:10:10.816928+0000","last_fullsized":"2024-09-13T06:10:10.816928+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:37:03.391739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"35'8","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.532750+0000","last_change":"2024-09-13T06:09:34.101552+0000","last_active":"2024-09-13T06:12:49.532750+0000","last_peered":"2024-09-13T06:12:49.532750+0000","last_clean":"2024-09-13T06:12:49.532750+0000","last_became_active":"2024-09-13T06:09:34.101167+0000","last_became_peered":"2024-09-13T06:09:34.101167+0000","last_unstale":"2024-09-13T06:12:49.532750+0000","last_undegraded":"2024-09-13T06:12:49.532750+0000","last_fullsized":"2024-09-13T06:12:49.532750+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:16:44.971572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.950455+0000","last_change":"2024-09-13T06:09:32.153552+0000","last_active":"2024-09-13T06:10:10.950455+0000","last_peered":"2024-09-13T06:10:10.950455+0000","last_clean":"2024-09-13T06:10:10.950455+0000","last_became_active":"2024-09-13T06:09:32.149885+0000","last_became_peered":"2024-09-13T06:09:32.149885+0000","last_unstale":"2024-09-13T06:10:10.950455+0000","last_undegraded":"2024-09-13T06:10:10.950455+0000","last_fullsized":"2024-09-13T06:10:10.950455+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:11:15.868187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"35'14","reported_seq":65,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.436750+0000","last_change":"2024-09-13T06:09:34.127656+0000","last_active":"2024-09-13T06:12:49.436750+0000","last_peered":"2024-09-13T06:12:49.436750+0000","last_clean":"2024-09-13T06:12:49.436750+0000","last_became_active":"2024-09-13T06:09:34.124299+0000","last_became_peered":"2024-09-13T06:09:34.124299+0000","last_unstale":"2024-09-13T06:12:49.436750+0000","last_undegraded":"2024-09-13T06:12:49.436750+0000","last_fullsized":"2024-09-13T06:12:49.436750+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:33:59.661744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.804400+0000","last_change":"2024-09-13T06:09:32.141692+0000","last_active":"2024-09-13T06:10:10.804400+0000","last_peered":"2024-09-13T06:10:10.804400+0000","last_clean":"2024-09-13T06:10:10.804400+0000","last_became_active":"2024-09-13T06:09:32.128376+0000","last_became_peered":"2024-09-13T06:09:32.128376+0000","last_unstale":"2024-09-13T06:10:10.804400+0000","last_undegraded":"2024-09-13T06:10:10.804400+0000","last_fullsized":"2024-09-13T06:10:10.804400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:45:45.430627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"35'43","reported_seq":124,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.385246+0000","last_change":"2024-09-13T06:09:42.187344+0000","last_active":"2024-09-13T06:12:49.385246+0000","last_peered":"2024-09-13T06:12:49.385246+0000","last_clean":"2024-09-13T06:12:49.385246+0000","last_became_active":"2024-09-13T06:09:42.186091+0000","last_became_peered":"2024-09-13T06:09:42.186091+0000","last_unstale":"2024-09-13T06:12:49.385246+0000","last_undegraded":"2024-09-13T06:12:49.385246+0000","last_fullsized":"2024-09-13T06:12:49.385246+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:11:39.558405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":246,"num_read_kb":228,"num_write":124,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"35'16","reported_seq":106,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:48.979007+0000","last_change":"2024-09-13T06:09:34.118780+0000","last_active":"2024-09-13T06:12:48.979007+0000","last_peered":"2024-09-13T06:12:48.979007+0000","last_clean":"2024-09-13T06:12:48.979007+0000","last_became_active":"2024-09-13T06:09:34.118393+0000","last_became_peered":"2024-09-13T06:09:34.118393+0000","last_unstale":"2024-09-13T06:12:48.979007+0000","last_undegraded":"2024-09-13T06:12:48.979007+0000","last_fullsized":"2024-09-13T06:12:48.979007+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:21:29.722330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":90,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"35'6","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:19.613864+0000","last_change":"2024-09-13T06:09:32.139342+0000","last_active":"2024-09-13T06:10:19.613864+0000","last_peered":"2024-09-13T06:10:19.613864+0000","last_clean":"2024-09-13T06:10:19.613864+0000","last_became_active":"2024-09-13T06:09:32.133545+0000","last_became_peered":"2024-09-13T06:09:32.133545+0000","last_unstale":"2024-09-13T06:10:19.613864+0000","last_undegraded":"2024-09-13T06:10:19.613864+0000","last_fullsized":"2024-09-13T06:10:19.613864+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:33:10.777679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.811858+0000","last_change":"2024-09-13T06:09:36.155061+0000","last_active":"2024-09-13T06:10:10.811858+0000","last_peered":"2024-09-13T06:10:10.811858+0000","last_clean":"2024-09-13T06:10:10.811858+0000","last_became_active":"2024-09-13T06:09:36.153420+0000","last_became_peered":"2024-09-13T06:09:36.153420+0000","last_unstale":"2024-09-13T06:10:10.811858+0000","last_undegraded":"2024-09-13T06:10:10.811858+0000","last_fullsized":"2024-09-13T06:10:10.811858+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:15:11.225972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"35'30","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:45.812130+0000","last_change":"2024-09-13T06:09:38.177058+0000","last_active":"2024-09-13T06:11:45.812130+0000","last_peered":"2024-09-13T06:11:45.812130+0000","last_clean":"2024-09-13T06:11:45.812130+0000","last_became_active":"2024-09-13T06:09:38.175393+0000","last_became_peered":"2024-09-13T06:09:38.175393+0000","last_unstale":"2024-09-13T06:11:45.812130+0000","last_undegraded":"2024-09-13T06:11:45.812130+0000","last_fullsized":"2024-09-13T06:11:45.812130+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:11:00.288447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.822023+0000","last_change":"2024-09-13T06:09:40.186286+0000","last_active":"2024-09-13T06:10:10.822023+0000","last_peered":"2024-09-13T06:10:10.822023+0000","last_clean":"2024-09-13T06:10:10.822023+0000","last_became_active":"2024-09-13T06:09:40.185574+0000","last_became_peered":"2024-09-13T06:09:40.185574+0000","last_unstale":"2024-09-13T06:10:10.822023+0000","last_undegraded":"2024-09-13T06:10:10.822023+0000","last_fullsized":"2024-09-13T06:10:10.822023+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:03:19.605623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"35'9","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:02.618334+0000","last_change":"2024-09-13T06:09:42.183906+0000","last_active":"2024-09-13T06:11:02.618334+0000","last_peered":"2024-09-13T06:11:02.618334+0000","last_clean":"2024-09-13T06:11:02.618334+0000","last_became_active":"2024-09-13T06:09:42.183162+0000","last_became_peered":"2024-09-13T06:09:42.183162+0000","last_unstale":"2024-09-13T06:11:02.618334+0000","last_undegraded":"2024-09-13T06:11:02.618334+0000","last_fullsized":"2024-09-13T06:11:02.618334+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:59:27.808952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":19,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"35'6","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.321683+0000","last_change":"2024-09-13T06:09:34.120990+0000","last_active":"2024-09-13T06:12:49.321683+0000","last_peered":"2024-09-13T06:12:49.321683+0000","last_clean":"2024-09-13T06:12:49.321683+0000","last_became_active":"2024-09-13T06:09:34.120600+0000","last_became_peered":"2024-09-13T06:09:34.120600+0000","last_unstale":"2024-09-13T06:12:49.321683+0000","last_undegraded":"2024-09-13T06:12:49.321683+0000","last_fullsized":"2024-09-13T06:12:49.321683+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:55:39.596421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.794741+0000","last_change":"2024-09-13T06:09:32.139993+0000","last_active":"2024-09-13T06:10:10.794741+0000","last_peered":"2024-09-13T06:10:10.794741+0000","last_clean":"2024-09-13T06:10:10.794741+0000","last_became_active":"2024-09-13T06:09:32.138643+0000","last_became_peered":"2024-09-13T06:09:32.138643+0000","last_unstale":"2024-09-13T06:10:10.794741+0000","last_undegraded":"2024-09-13T06:10:10.794741+0000","last_fullsized":"2024-09-13T06:10:10.794741+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:53:16.188364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.946255+0000","last_change":"2024-09-13T06:09:36.139879+0000","last_active":"2024-09-13T06:10:10.946255+0000","last_peered":"2024-09-13T06:10:10.946255+0000","last_clean":"2024-09-13T06:10:10.946255+0000","last_became_active":"2024-09-13T06:09:36.139235+0000","last_became_peered":"2024-09-13T06:09:36.139235+0000","last_unstale":"2024-09-13T06:10:10.946255+0000","last_undegraded":"2024-09-13T06:10:10.946255+0000","last_fullsized":"2024-09-13T06:10:10.946255+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:12:32.105314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"33'6","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.821659+0000","last_change":"2024-09-13T06:09:38.162297+0000","last_active":"2024-09-13T06:10:10.821659+0000","last_peered":"2024-09-13T06:10:10.821659+0000","last_clean":"2024-09-13T06:10:10.821659+0000","last_became_active":"2024-09-13T06:09:38.161539+0000","last_became_peered":"2024-09-13T06:09:38.161539+0000","last_unstale":"2024-09-13T06:10:10.821659+0000","last_undegraded":"2024-09-13T06:10:10.821659+0000","last_fullsized":"2024-09-13T06:10:10.821659+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:40:25.153315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.820538+0000","last_change":"2024-09-13T06:09:40.183211+0000","last_active":"2024-09-13T06:10:10.820538+0000","last_peered":"2024-09-13T06:10:10.820538+0000","last_clean":"2024-09-13T06:10:10.820538+0000","last_became_active":"2024-09-13T06:09:40.182436+0000","last_became_peered":"2024-09-13T06:09:40.182436+0000","last_unstale":"2024-09-13T06:10:10.820538+0000","last_undegraded":"2024-09-13T06:10:10.820538+0000","last_fullsized":"2024-09-13T06:10:10.820538+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:23:15.512719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"33'2","reported_seq":19,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.943536+0000","last_change":"2024-09-13T06:09:42.209170+0000","last_active":"2024-09-13T06:10:10.943536+0000","last_peered":"2024-09-13T06:10:10.943536+0000","last_clean":"2024-09-13T06:10:10.943536+0000","last_became_active":"2024-09-13T06:09:42.208430+0000","last_became_peered":"2024-09-13T06:09:42.208430+0000","last_unstale":"2024-09-13T06:10:10.943536+0000","last_undegraded":"2024-09-13T06:10:10.943536+0000","last_fullsized":"2024-09-13T06:10:10.943536+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:29:22.362293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"35'6","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.321687+0000","last_change":"2024-09-13T06:09:34.123289+0000","last_active":"2024-09-13T06:12:49.321687+0000","last_peered":"2024-09-13T06:12:49.321687+0000","last_clean":"2024-09-13T06:12:49.321687+0000","last_became_active":"2024-09-13T06:09:34.122001+0000","last_became_peered":"2024-09-13T06:09:34.122001+0000","last_unstale":"2024-09-13T06:12:49.321687+0000","last_undegraded":"2024-09-13T06:12:49.321687+0000","last_fullsized":"2024-09-13T06:12:49.321687+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:24:35.914145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"35'1","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:52.809110+0000","last_change":"2024-09-13T06:09:32.132575+0000","last_active":"2024-09-13T06:11:52.809110+0000","last_peered":"2024-09-13T06:11:52.809110+0000","last_clean":"2024-09-13T06:11:52.809110+0000","last_became_active":"2024-09-13T06:09:32.129739+0000","last_became_peered":"2024-09-13T06:09:32.129739+0000","last_unstale":"2024-09-13T06:11:52.809110+0000","last_undegraded":"2024-09-13T06:11:52.809110+0000","last_fullsized":"2024-09-13T06:11:52.809110+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:34:42.649939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.951834+0000","last_change":"2024-09-13T06:09:36.144172+0000","last_active":"2024-09-13T06:10:10.951834+0000","last_peered":"2024-09-13T06:10:10.951834+0000","last_clean":"2024-09-13T06:10:10.951834+0000","last_became_active":"2024-09-13T06:09:36.143405+0000","last_became_peered":"2024-09-13T06:09:36.143405+0000","last_unstale":"2024-09-13T06:10:10.951834+0000","last_undegraded":"2024-09-13T06:10:10.951834+0000","last_fullsized":"2024-09-13T06:10:10.951834+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:08:14.626902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"33'10","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.797420+0000","last_change":"2024-09-13T06:09:38.155433+0000","last_active":"2024-09-13T06:10:10.797420+0000","last_peered":"2024-09-13T06:10:10.797420+0000","last_clean":"2024-09-13T06:10:10.797420+0000","last_became_active":"2024-09-13T06:09:38.154654+0000","last_became_peered":"2024-09-13T06:09:38.154654+0000","last_unstale":"2024-09-13T06:10:10.797420+0000","last_undegraded":"2024-09-13T06:10:10.797420+0000","last_fullsized":"2024-09-13T06:10:10.797420+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:57:04.837597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"35'282","reported_seq":405,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:46.394775+0000","last_change":"2024-09-13T06:09:40.192039+0000","last_active":"2024-09-13T06:12:46.394775+0000","last_peered":"2024-09-13T06:12:46.394775+0000","last_clean":"2024-09-13T06:12:46.394775+0000","last_became_active":"2024-09-13T06:09:40.190377+0000","last_became_peered":"2024-09-13T06:09:40.190377+0000","last_unstale":"2024-09-13T06:12:46.394775+0000","last_undegraded":"2024-09-13T06:12:46.394775+0000","last_fullsized":"2024-09-13T06:12:46.394775+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:35:10.494464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.796286+0000","last_change":"2024-09-13T06:09:42.204612+0000","last_active":"2024-09-13T06:10:10.796286+0000","last_peered":"2024-09-13T06:10:10.796286+0000","last_clean":"2024-09-13T06:10:10.796286+0000","last_became_active":"2024-09-13T06:09:42.204083+0000","last_became_peered":"2024-09-13T06:09:42.204083+0000","last_unstale":"2024-09-13T06:10:10.796286+0000","last_undegraded":"2024-09-13T06:10:10.796286+0000","last_fullsized":"2024-09-13T06:10:10.796286+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:07:08.179083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"35'6","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:48.235953+0000","last_change":"2024-09-13T06:09:34.131719+0000","last_active":"2024-09-13T06:11:48.235953+0000","last_peered":"2024-09-13T06:11:48.235953+0000","last_clean":"2024-09-13T06:11:48.235953+0000","last_became_active":"2024-09-13T06:09:34.130815+0000","last_became_peered":"2024-09-13T06:09:34.130815+0000","last_unstale":"2024-09-13T06:11:48.235953+0000","last_undegraded":"2024-09-13T06:11:48.235953+0000","last_fullsized":"2024-09-13T06:11:48.235953+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:14:31.056024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.807240+0000","last_change":"2024-09-13T06:09:32.118707+0000","last_active":"2024-09-13T06:10:10.807240+0000","last_peered":"2024-09-13T06:10:10.807240+0000","last_clean":"2024-09-13T06:10:10.807240+0000","last_became_active":"2024-09-13T06:09:32.118278+0000","last_became_peered":"2024-09-13T06:09:32.118278+0000","last_unstale":"2024-09-13T06:10:10.807240+0000","last_undegraded":"2024-09-13T06:10:10.807240+0000","last_fullsized":"2024-09-13T06:10:10.807240+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:27:21.997161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.826255+0000","last_change":"2024-09-13T06:10:10.825317+0000","last_active":"2024-09-13T06:10:10.826255+0000","last_peered":"2024-09-13T06:10:10.826255+0000","last_clean":"2024-09-13T06:10:10.826255+0000","last_became_active":"2024-09-13T06:10:10.824420+0000","last_became_peered":"2024-09-13T06:10:10.824420+0000","last_unstale":"2024-09-13T06:10:10.826255+0000","last_undegraded":"2024-09-13T06:10:10.826255+0000","last_fullsized":"2024-09-13T06:10:10.826255+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:36:20.133257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"35'31","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:45.803977+0000","last_change":"2024-09-13T06:09:38.158195+0000","last_active":"2024-09-13T06:11:45.803977+0000","last_peered":"2024-09-13T06:11:45.803977+0000","last_clean":"2024-09-13T06:11:45.803977+0000","last_became_active":"2024-09-13T06:09:38.157430+0000","last_became_peered":"2024-09-13T06:09:38.157430+0000","last_unstale":"2024-09-13T06:11:45.803977+0000","last_undegraded":"2024-09-13T06:11:45.803977+0000","last_fullsized":"2024-09-13T06:11:45.803977+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:00:13.206413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"35'282","reported_seq":436,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.525879+0000","last_change":"2024-09-13T06:09:40.176671+0000","last_active":"2024-09-13T06:12:49.525879+0000","last_peered":"2024-09-13T06:12:49.525879+0000","last_clean":"2024-09-13T06:12:49.525879+0000","last_became_active":"2024-09-13T06:09:40.175871+0000","last_became_peered":"2024-09-13T06:09:40.175871+0000","last_unstale":"2024-09-13T06:12:49.525879+0000","last_undegraded":"2024-09-13T06:12:49.525879+0000","last_fullsized":"2024-09-13T06:12:49.525879+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:17:37.423986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"35'2","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:43.532992+0000","last_change":"2024-09-13T06:09:34.127109+0000","last_active":"2024-09-13T06:11:43.532992+0000","last_peered":"2024-09-13T06:11:43.532992+0000","last_clean":"2024-09-13T06:11:43.532992+0000","last_became_active":"2024-09-13T06:09:34.126374+0000","last_became_peered":"2024-09-13T06:09:34.126374+0000","last_unstale":"2024-09-13T06:11:43.532992+0000","last_undegraded":"2024-09-13T06:11:43.532992+0000","last_fullsized":"2024-09-13T06:11:43.532992+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:41:31.632632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.797517+0000","last_change":"2024-09-13T06:09:32.131764+0000","last_active":"2024-09-13T06:10:10.797517+0000","last_peered":"2024-09-13T06:10:10.797517+0000","last_clean":"2024-09-13T06:10:10.797517+0000","last_became_active":"2024-09-13T06:09:32.131373+0000","last_became_peered":"2024-09-13T06:09:32.131373+0000","last_unstale":"2024-09-13T06:10:10.797517+0000","last_undegraded":"2024-09-13T06:10:10.797517+0000","last_fullsized":"2024-09-13T06:10:10.797517+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:24:08.865544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.814065+0000","last_change":"2024-09-13T06:09:36.139927+0000","last_active":"2024-09-13T06:10:10.814065+0000","last_peered":"2024-09-13T06:10:10.814065+0000","last_clean":"2024-09-13T06:10:10.814065+0000","last_became_active":"2024-09-13T06:09:36.137016+0000","last_became_peered":"2024-09-13T06:09:36.137016+0000","last_unstale":"2024-09-13T06:10:10.814065+0000","last_undegraded":"2024-09-13T06:10:10.814065+0000","last_fullsized":"2024-09-13T06:10:10.814065+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:42:25.451374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"35'40","reported_seq":87,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:45.818460+0000","last_change":"2024-09-13T06:09:38.164413+0000","last_active":"2024-09-13T06:11:45.818460+0000","last_peered":"2024-09-13T06:11:45.818460+0000","last_clean":"2024-09-13T06:11:45.818460+0000","last_became_active":"2024-09-13T06:09:38.163472+0000","last_became_peered":"2024-09-13T06:09:38.163472+0000","last_unstale":"2024-09-13T06:11:45.818460+0000","last_undegraded":"2024-09-13T06:11:45.818460+0000","last_fullsized":"2024-09-13T06:11:45.818460+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:08:16.650346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.948584+0000","last_change":"2024-09-13T06:09:40.172425+0000","last_active":"2024-09-13T06:10:10.948584+0000","last_peered":"2024-09-13T06:10:10.948584+0000","last_clean":"2024-09-13T06:10:10.948584+0000","last_became_active":"2024-09-13T06:09:40.171609+0000","last_became_peered":"2024-09-13T06:09:40.171609+0000","last_unstale":"2024-09-13T06:10:10.948584+0000","last_undegraded":"2024-09-13T06:10:10.948584+0000","last_fullsized":"2024-09-13T06:10:10.948584+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:46:09.860554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"35'5","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.403220+0000","last_change":"2024-09-13T06:09:42.208317+0000","last_active":"2024-09-13T06:12:49.403220+0000","last_peered":"2024-09-13T06:12:49.403220+0000","last_clean":"2024-09-13T06:12:49.403220+0000","last_became_active":"2024-09-13T06:09:42.193426+0000","last_became_peered":"2024-09-13T06:09:42.193426+0000","last_unstale":"2024-09-13T06:12:49.403220+0000","last_undegraded":"2024-09-13T06:12:49.403220+0000","last_fullsized":"2024-09-13T06:12:49.403220+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:49:53.497381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"35'6","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.321762+0000","last_change":"2024-09-13T06:09:34.118017+0000","last_active":"2024-09-13T06:12:49.321762+0000","last_peered":"2024-09-13T06:12:49.321762+0000","last_clean":"2024-09-13T06:12:49.321762+0000","last_became_active":"2024-09-13T06:09:34.114999+0000","last_became_peered":"2024-09-13T06:09:34.114999+0000","last_unstale":"2024-09-13T06:12:49.321762+0000","last_undegraded":"2024-09-13T06:12:49.321762+0000","last_fullsized":"2024-09-13T06:12:49.321762+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:31:56.256920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.803293+0000","last_change":"2024-09-13T06:09:32.118402+0000","last_active":"2024-09-13T06:10:10.803293+0000","last_peered":"2024-09-13T06:10:10.803293+0000","last_clean":"2024-09-13T06:10:10.803293+0000","last_became_active":"2024-09-13T06:09:32.117779+0000","last_became_peered":"2024-09-13T06:09:32.117779+0000","last_unstale":"2024-09-13T06:10:10.803293+0000","last_undegraded":"2024-09-13T06:10:10.803293+0000","last_fullsized":"2024-09-13T06:10:10.803293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:42:54.943685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.943993+0000","last_change":"2024-09-13T06:09:36.136523+0000","last_active":"2024-09-13T06:10:10.943993+0000","last_peered":"2024-09-13T06:10:10.943993+0000","last_clean":"2024-09-13T06:10:10.943993+0000","last_became_active":"2024-09-13T06:09:36.135862+0000","last_became_peered":"2024-09-13T06:09:36.135862+0000","last_unstale":"2024-09-13T06:10:10.943993+0000","last_undegraded":"2024-09-13T06:10:10.943993+0000","last_fullsized":"2024-09-13T06:10:10.943993+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:48:51.597962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"35'31","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:45.788050+0000","last_change":"2024-09-13T06:09:38.173198+0000","last_active":"2024-09-13T06:11:45.788050+0000","last_peered":"2024-09-13T06:11:45.788050+0000","last_clean":"2024-09-13T06:11:45.788050+0000","last_became_active":"2024-09-13T06:09:38.171931+0000","last_became_peered":"2024-09-13T06:09:38.171931+0000","last_unstale":"2024-09-13T06:11:45.788050+0000","last_undegraded":"2024-09-13T06:11:45.788050+0000","last_fullsized":"2024-09-13T06:11:45.788050+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:38:56.011466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.945598+0000","last_change":"2024-09-13T06:09:40.179448+0000","last_active":"2024-09-13T06:10:10.945598+0000","last_peered":"2024-09-13T06:10:10.945598+0000","last_clean":"2024-09-13T06:10:10.945598+0000","last_became_active":"2024-09-13T06:09:40.178545+0000","last_became_peered":"2024-09-13T06:09:40.178545+0000","last_unstale":"2024-09-13T06:10:10.945598+0000","last_undegraded":"2024-09-13T06:10:10.945598+0000","last_fullsized":"2024-09-13T06:10:10.945598+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:54:35.378117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"35'5","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.000310+0000","last_change":"2024-09-13T06:09:42.206012+0000","last_active":"2024-09-13T06:12:49.000310+0000","last_peered":"2024-09-13T06:12:49.000310+0000","last_clean":"2024-09-13T06:12:49.000310+0000","last_became_active":"2024-09-13T06:09:42.204945+0000","last_became_peered":"2024-09-13T06:09:42.204945+0000","last_unstale":"2024-09-13T06:12:49.000310+0000","last_undegraded":"2024-09-13T06:12:49.000310+0000","last_fullsized":"2024-09-13T06:12:49.000310+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:32:49.081082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"33'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.799349+0000","last_change":"2024-09-13T06:09:34.104885+0000","last_active":"2024-09-13T06:10:10.799349+0000","last_peered":"2024-09-13T06:10:10.799349+0000","last_clean":"2024-09-13T06:10:10.799349+0000","last_became_active":"2024-09-13T06:09:34.102657+0000","last_became_peered":"2024-09-13T06:09:34.102657+0000","last_unstale":"2024-09-13T06:10:10.799349+0000","last_undegraded":"2024-09-13T06:10:10.799349+0000","last_fullsized":"2024-09-13T06:10:10.799349+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:18:18.221662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"35'5","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.500828+0000","last_change":"2024-09-13T06:09:32.136390+0000","last_active":"2024-09-13T06:12:49.500828+0000","last_peered":"2024-09-13T06:12:49.500828+0000","last_clean":"2024-09-13T06:12:49.500828+0000","last_became_active":"2024-09-13T06:09:32.133020+0000","last_became_peered":"2024-09-13T06:09:32.133020+0000","last_unstale":"2024-09-13T06:12:49.500828+0000","last_undegraded":"2024-09-13T06:12:49.500828+0000","last_fullsized":"2024-09-13T06:12:49.500828+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:29:18.318697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":21,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:11.778692+0000","last_change":"2024-09-13T06:10:10.810157+0000","last_active":"2024-09-13T06:10:11.778692+0000","last_peered":"2024-09-13T06:10:11.778692+0000","last_clean":"2024-09-13T06:10:11.778692+0000","last_became_active":"2024-09-13T06:10:10.809442+0000","last_became_peered":"2024-09-13T06:10:10.809442+0000","last_unstale":"2024-09-13T06:10:11.778692+0000","last_undegraded":"2024-09-13T06:10:11.778692+0000","last_fullsized":"2024-09-13T06:10:11.778692+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:15:18.836646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"35'36","reported_seq":81,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:45.821011+0000","last_change":"2024-09-13T06:09:38.155448+0000","last_active":"2024-09-13T06:11:45.821011+0000","last_peered":"2024-09-13T06:11:45.821011+0000","last_clean":"2024-09-13T06:11:45.821011+0000","last_became_active":"2024-09-13T06:09:38.154720+0000","last_became_peered":"2024-09-13T06:09:38.154720+0000","last_unstale":"2024-09-13T06:11:45.821011+0000","last_undegraded":"2024-09-13T06:11:45.821011+0000","last_fullsized":"2024-09-13T06:11:45.821011+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:23:45.584512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"35'282","reported_seq":398,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.868570+0000","last_change":"2024-09-13T06:09:40.187775+0000","last_active":"2024-09-13T06:12:49.868570+0000","last_peered":"2024-09-13T06:12:49.868570+0000","last_clean":"2024-09-13T06:12:49.868570+0000","last_became_active":"2024-09-13T06:09:40.186987+0000","last_became_peered":"2024-09-13T06:09:40.186987+0000","last_unstale":"2024-09-13T06:12:49.868570+0000","last_undegraded":"2024-09-13T06:12:49.868570+0000","last_fullsized":"2024-09-13T06:12:49.868570+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:05:45.705137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"35'2","reported_seq":19,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:48.226943+0000","last_change":"2024-09-13T06:09:42.202356+0000","last_active":"2024-09-13T06:11:48.226943+0000","last_peered":"2024-09-13T06:11:48.226943+0000","last_clean":"2024-09-13T06:11:48.226943+0000","last_became_active":"2024-09-13T06:09:42.201678+0000","last_became_peered":"2024-09-13T06:09:42.201678+0000","last_unstale":"2024-09-13T06:11:48.226943+0000","last_undegraded":"2024-09-13T06:11:48.226943+0000","last_fullsized":"2024-09-13T06:11:48.226943+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:44:32.357425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"35'14","reported_seq":69,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:48.237783+0000","last_change":"2024-09-13T06:09:34.103681+0000","last_active":"2024-09-13T06:11:48.237783+0000","last_peered":"2024-09-13T06:11:48.237783+0000","last_clean":"2024-09-13T06:11:48.237783+0000","last_became_active":"2024-09-13T06:09:34.103295+0000","last_became_peered":"2024-09-13T06:09:34.103295+0000","last_unstale":"2024-09-13T06:11:48.237783+0000","last_undegraded":"2024-09-13T06:11:48.237783+0000","last_fullsized":"2024-09-13T06:11:48.237783+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:12:41.439746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.809624+0000","last_change":"2024-09-13T06:09:32.128209+0000","last_active":"2024-09-13T06:10:10.809624+0000","last_peered":"2024-09-13T06:10:10.809624+0000","last_clean":"2024-09-13T06:10:10.809624+0000","last_became_active":"2024-09-13T06:09:32.125047+0000","last_became_peered":"2024-09-13T06:09:32.125047+0000","last_unstale":"2024-09-13T06:10:10.809624+0000","last_undegraded":"2024-09-13T06:10:10.809624+0000","last_fullsized":"2024-09-13T06:10:10.809624+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:22:25.339690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.946037+0000","last_change":"2024-09-13T06:09:36.136740+0000","last_active":"2024-09-13T06:10:10.946037+0000","last_peered":"2024-09-13T06:10:10.946037+0000","last_clean":"2024-09-13T06:10:10.946037+0000","last_became_active":"2024-09-13T06:09:36.135896+0000","last_became_peered":"2024-09-13T06:09:36.135896+0000","last_unstale":"2024-09-13T06:10:10.946037+0000","last_undegraded":"2024-09-13T06:10:10.946037+0000","last_fullsized":"2024-09-13T06:10:10.946037+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:38:41.311788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"35'56","reported_seq":112,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:47.807514+0000","last_change":"2024-09-13T06:09:38.176653+0000","last_active":"2024-09-13T06:11:47.807514+0000","last_peered":"2024-09-13T06:11:47.807514+0000","last_clean":"2024-09-13T06:11:47.807514+0000","last_became_active":"2024-09-13T06:09:38.175404+0000","last_became_peered":"2024-09-13T06:09:38.175404+0000","last_unstale":"2024-09-13T06:11:47.807514+0000","last_undegraded":"2024-09-13T06:11:47.807514+0000","last_fullsized":"2024-09-13T06:11:47.807514+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:20:41.974878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5916,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":51,"num_read_kb":42,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.943056+0000","last_change":"2024-09-13T06:09:40.178019+0000","last_active":"2024-09-13T06:10:10.943056+0000","last_peered":"2024-09-13T06:10:10.943056+0000","last_clean":"2024-09-13T06:10:10.943056+0000","last_became_active":"2024-09-13T06:09:40.177127+0000","last_became_peered":"2024-09-13T06:09:40.177127+0000","last_unstale":"2024-09-13T06:10:10.943056+0000","last_undegraded":"2024-09-13T06:10:10.943056+0000","last_fullsized":"2024-09-13T06:10:10.943056+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:03:59.282151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"35'18","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.796652+0000","last_change":"2024-09-13T06:09:42.177354+0000","last_active":"2024-09-13T06:12:49.796652+0000","last_peered":"2024-09-13T06:12:49.796652+0000","last_clean":"2024-09-13T06:12:49.796652+0000","last_became_active":"2024-09-13T06:09:42.176229+0000","last_became_peered":"2024-09-13T06:09:42.176229+0000","last_unstale":"2024-09-13T06:12:49.796652+0000","last_undegraded":"2024-09-13T06:12:49.796652+0000","last_fullsized":"2024-09-13T06:12:49.796652+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:00:06.521241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"35'16","reported_seq":77,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.114923+0000","last_change":"2024-09-13T06:09:34.121751+0000","last_active":"2024-09-13T06:12:49.114923+0000","last_peered":"2024-09-13T06:12:49.114923+0000","last_clean":"2024-09-13T06:12:49.114923+0000","last_became_active":"2024-09-13T06:09:34.119018+0000","last_became_peered":"2024-09-13T06:09:34.119018+0000","last_unstale":"2024-09-13T06:12:49.114923+0000","last_undegraded":"2024-09-13T06:12:49.114923+0000","last_fullsized":"2024-09-13T06:12:49.114923+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:43:00.917159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"35'1","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:50.799501+0000","last_change":"2024-09-13T06:09:32.151752+0000","last_active":"2024-09-13T06:11:50.799501+0000","last_peered":"2024-09-13T06:11:50.799501+0000","last_clean":"2024-09-13T06:11:50.799501+0000","last_became_active":"2024-09-13T06:09:32.148505+0000","last_became_peered":"2024-09-13T06:09:32.148505+0000","last_unstale":"2024-09-13T06:11:50.799501+0000","last_undegraded":"2024-09-13T06:11:50.799501+0000","last_fullsized":"2024-09-13T06:11:50.799501+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:15:48.717644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.807504+0000","last_change":"2024-09-13T06:09:36.132310+0000","last_active":"2024-09-13T06:10:10.807504+0000","last_peered":"2024-09-13T06:10:10.807504+0000","last_clean":"2024-09-13T06:10:10.807504+0000","last_became_active":"2024-09-13T06:09:36.131611+0000","last_became_peered":"2024-09-13T06:09:36.131611+0000","last_unstale":"2024-09-13T06:10:10.807504+0000","last_undegraded":"2024-09-13T06:10:10.807504+0000","last_fullsized":"2024-09-13T06:10:10.807504+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:13:56.015822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"35'33","reported_seq":76,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:48.241969+0000","last_change":"2024-09-13T06:09:38.166492+0000","last_active":"2024-09-13T06:11:48.241969+0000","last_peered":"2024-09-13T06:11:48.241969+0000","last_clean":"2024-09-13T06:11:48.241969+0000","last_became_active":"2024-09-13T06:09:38.165747+0000","last_became_peered":"2024-09-13T06:09:38.165747+0000","last_unstale":"2024-09-13T06:11:48.241969+0000","last_undegraded":"2024-09-13T06:11:48.241969+0000","last_fullsized":"2024-09-13T06:11:48.241969+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:11:40.651218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.816868+0000","last_change":"2024-09-13T06:09:40.190860+0000","last_active":"2024-09-13T06:10:10.816868+0000","last_peered":"2024-09-13T06:10:10.816868+0000","last_clean":"2024-09-13T06:10:10.816868+0000","last_became_active":"2024-09-13T06:09:40.190314+0000","last_became_peered":"2024-09-13T06:09:40.190314+0000","last_unstale":"2024-09-13T06:10:10.816868+0000","last_undegraded":"2024-09-13T06:10:10.816868+0000","last_fullsized":"2024-09-13T06:10:10.816868+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:52:35.906978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"35'3","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:45.410142+0000","last_change":"2024-09-13T06:09:42.202356+0000","last_active":"2024-09-13T06:11:45.410142+0000","last_peered":"2024-09-13T06:11:45.410142+0000","last_clean":"2024-09-13T06:11:45.410142+0000","last_became_active":"2024-09-13T06:09:42.201211+0000","last_became_peered":"2024-09-13T06:09:42.201211+0000","last_unstale":"2024-09-13T06:11:45.410142+0000","last_undegraded":"2024-09-13T06:11:45.410142+0000","last_fullsized":"2024-09-13T06:11:45.410142+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:35:04.349746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"35'5","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.455185+0000","last_change":"2024-09-13T06:09:34.132190+0000","last_active":"2024-09-13T06:12:49.455185+0000","last_peered":"2024-09-13T06:12:49.455185+0000","last_clean":"2024-09-13T06:12:49.455185+0000","last_became_active":"2024-09-13T06:09:34.131882+0000","last_became_peered":"2024-09-13T06:09:34.131882+0000","last_unstale":"2024-09-13T06:12:49.455185+0000","last_undegraded":"2024-09-13T06:12:49.455185+0000","last_fullsized":"2024-09-13T06:12:49.455185+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:12:40.844517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.805785+0000","last_change":"2024-09-13T06:09:32.143831+0000","last_active":"2024-09-13T06:10:10.805785+0000","last_peered":"2024-09-13T06:10:10.805785+0000","last_clean":"2024-09-13T06:10:10.805785+0000","last_became_active":"2024-09-13T06:09:32.138731+0000","last_became_peered":"2024-09-13T06:09:32.138731+0000","last_unstale":"2024-09-13T06:10:10.805785+0000","last_undegraded":"2024-09-13T06:10:10.805785+0000","last_fullsized":"2024-09-13T06:10:10.805785+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:23:59.928536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.946508+0000","last_change":"2024-09-13T06:09:36.136407+0000","last_active":"2024-09-13T06:10:10.946508+0000","last_peered":"2024-09-13T06:10:10.946508+0000","last_clean":"2024-09-13T06:10:10.946508+0000","last_became_active":"2024-09-13T06:09:36.135660+0000","last_became_peered":"2024-09-13T06:09:36.135660+0000","last_unstale":"2024-09-13T06:10:10.946508+0000","last_undegraded":"2024-09-13T06:10:10.946508+0000","last_fullsized":"2024-09-13T06:10:10.946508+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:13:54.253064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"35'37","reported_seq":82,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:45.837051+0000","last_change":"2024-09-13T06:09:38.144183+0000","last_active":"2024-09-13T06:11:45.837051+0000","last_peered":"2024-09-13T06:11:45.837051+0000","last_clean":"2024-09-13T06:11:45.837051+0000","last_became_active":"2024-09-13T06:09:38.143209+0000","last_became_peered":"2024-09-13T06:09:38.143209+0000","last_unstale":"2024-09-13T06:11:45.837051+0000","last_undegraded":"2024-09-13T06:11:45.837051+0000","last_fullsized":"2024-09-13T06:11:45.837051+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:50:01.265885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"35'282","reported_seq":404,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.808418+0000","last_change":"2024-09-13T06:09:40.188885+0000","last_active":"2024-09-13T06:12:49.808418+0000","last_peered":"2024-09-13T06:12:49.808418+0000","last_clean":"2024-09-13T06:12:49.808418+0000","last_became_active":"2024-09-13T06:09:40.188246+0000","last_became_peered":"2024-09-13T06:09:40.188246+0000","last_unstale":"2024-09-13T06:12:49.808418+0000","last_undegraded":"2024-09-13T06:12:49.808418+0000","last_fullsized":"2024-09-13T06:12:49.808418+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:10:07.607618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"35'16","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:50.799267+0000","last_change":"2024-09-13T06:09:42.201997+0000","last_active":"2024-09-13T06:11:50.799267+0000","last_peered":"2024-09-13T06:11:50.799267+0000","last_clean":"2024-09-13T06:11:50.799267+0000","last_became_active":"2024-09-13T06:09:42.201304+0000","last_became_peered":"2024-09-13T06:09:42.201304+0000","last_unstale":"2024-09-13T06:11:50.799267+0000","last_undegraded":"2024-09-13T06:11:50.799267+0000","last_fullsized":"2024-09-13T06:11:50.799267+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:45:43.763240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":29,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"35'4","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:48.236290+0000","last_change":"2024-09-13T06:09:34.102998+0000","last_active":"2024-09-13T06:11:48.236290+0000","last_peered":"2024-09-13T06:11:48.236290+0000","last_clean":"2024-09-13T06:11:48.236290+0000","last_became_active":"2024-09-13T06:09:34.102586+0000","last_became_peered":"2024-09-13T06:09:34.102586+0000","last_unstale":"2024-09-13T06:11:48.236290+0000","last_undegraded":"2024-09-13T06:11:48.236290+0000","last_fullsized":"2024-09-13T06:11:48.236290+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:03:45.932431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:48.859872+0000","last_change":"2024-09-13T06:09:32.125108+0000","last_active":"2024-09-13T06:12:48.859872+0000","last_peered":"2024-09-13T06:12:48.859872+0000","last_clean":"2024-09-13T06:12:48.859872+0000","last_became_active":"2024-09-13T06:09:32.122121+0000","last_became_peered":"2024-09-13T06:09:32.122121+0000","last_unstale":"2024-09-13T06:12:48.859872+0000","last_undegraded":"2024-09-13T06:12:48.859872+0000","last_fullsized":"2024-09-13T06:12:48.859872+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:04:21.918429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"35'3","reported_seq":413,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:47.370234+0000","last_change":"2024-09-13T06:09:36.143569+0000","last_active":"2024-09-13T06:11:47.370234+0000","last_peered":"2024-09-13T06:11:47.370234+0000","last_clean":"2024-09-13T06:11:47.370234+0000","last_became_active":"2024-09-13T06:09:36.141789+0000","last_became_peered":"2024-09-13T06:09:36.141789+0000","last_unstale":"2024-09-13T06:11:47.370234+0000","last_undegraded":"2024-09-13T06:11:47.370234+0000","last_fullsized":"2024-09-13T06:11:47.370234+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:45:41.784572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"33'10","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.811432+0000","last_change":"2024-09-13T06:09:38.177849+0000","last_active":"2024-09-13T06:10:10.811432+0000","last_peered":"2024-09-13T06:10:10.811432+0000","last_clean":"2024-09-13T06:10:10.811432+0000","last_became_active":"2024-09-13T06:09:38.177217+0000","last_became_peered":"2024-09-13T06:09:38.177217+0000","last_unstale":"2024-09-13T06:10:10.811432+0000","last_undegraded":"2024-09-13T06:10:10.811432+0000","last_fullsized":"2024-09-13T06:10:10.811432+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:10.962665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"35'282","reported_seq":460,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.674152+0000","last_change":"2024-09-13T06:09:40.181202+0000","last_active":"2024-09-13T06:12:49.674152+0000","last_peered":"2024-09-13T06:12:49.674152+0000","last_clean":"2024-09-13T06:12:49.674152+0000","last_became_active":"2024-09-13T06:09:40.179438+0000","last_became_peered":"2024-09-13T06:09:40.179438+0000","last_unstale":"2024-09-13T06:12:49.674152+0000","last_undegraded":"2024-09-13T06:12:49.674152+0000","last_fullsized":"2024-09-13T06:12:49.674152+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:27:07.073401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"35'6","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:47.594182+0000","last_change":"2024-09-13T06:09:42.204120+0000","last_active":"2024-09-13T06:11:47.594182+0000","last_peered":"2024-09-13T06:11:47.594182+0000","last_clean":"2024-09-13T06:11:47.594182+0000","last_became_active":"2024-09-13T06:09:42.181854+0000","last_became_peered":"2024-09-13T06:09:42.181854+0000","last_unstale":"2024-09-13T06:11:47.594182+0000","last_undegraded":"2024-09-13T06:11:47.594182+0000","last_fullsized":"2024-09-13T06:11:47.594182+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:16:33.568846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.822741+0000","last_change":"2024-09-13T06:09:34.127227+0000","last_active":"2024-09-13T06:10:10.822741+0000","last_peered":"2024-09-13T06:10:10.822741+0000","last_clean":"2024-09-13T06:10:10.822741+0000","last_became_active":"2024-09-13T06:09:34.126843+0000","last_became_peered":"2024-09-13T06:09:34.126843+0000","last_unstale":"2024-09-13T06:10:10.822741+0000","last_undegraded":"2024-09-13T06:10:10.822741+0000","last_fullsized":"2024-09-13T06:10:10.822741+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:44:57.098322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"35'5","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:02.598499+0000","last_change":"2024-09-13T06:09:32.133494+0000","last_active":"2024-09-13T06:11:02.598499+0000","last_peered":"2024-09-13T06:11:02.598499+0000","last_clean":"2024-09-13T06:11:02.598499+0000","last_became_active":"2024-09-13T06:09:32.129984+0000","last_became_peered":"2024-09-13T06:09:32.129984+0000","last_unstale":"2024-09-13T06:11:02.598499+0000","last_undegraded":"2024-09-13T06:11:02.598499+0000","last_fullsized":"2024-09-13T06:11:02.598499+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:45:08.493467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.818317+0000","last_change":"2024-09-13T06:09:36.155279+0000","last_active":"2024-09-13T06:10:10.818317+0000","last_peered":"2024-09-13T06:10:10.818317+0000","last_clean":"2024-09-13T06:10:10.818317+0000","last_became_active":"2024-09-13T06:09:36.153614+0000","last_became_peered":"2024-09-13T06:09:36.153614+0000","last_unstale":"2024-09-13T06:10:10.818317+0000","last_undegraded":"2024-09-13T06:10:10.818317+0000","last_fullsized":"2024-09-13T06:10:10.818317+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:27:07.877373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"35'38","reported_seq":84,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:45.813983+0000","last_change":"2024-09-13T06:09:38.158380+0000","last_active":"2024-09-13T06:11:45.813983+0000","last_peered":"2024-09-13T06:11:45.813983+0000","last_clean":"2024-09-13T06:11:45.813983+0000","last_became_active":"2024-09-13T06:09:38.155463+0000","last_became_peered":"2024-09-13T06:09:38.155463+0000","last_unstale":"2024-09-13T06:11:45.813983+0000","last_undegraded":"2024-09-13T06:11:45.813983+0000","last_fullsized":"2024-09-13T06:11:45.813983+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:24:39.953684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.796986+0000","last_change":"2024-09-13T06:09:40.169126+0000","last_active":"2024-09-13T06:10:10.796986+0000","last_peered":"2024-09-13T06:10:10.796986+0000","last_clean":"2024-09-13T06:10:10.796986+0000","last_became_active":"2024-09-13T06:09:40.167733+0000","last_became_peered":"2024-09-13T06:09:40.167733+0000","last_unstale":"2024-09-13T06:10:10.796986+0000","last_undegraded":"2024-09-13T06:10:10.796986+0000","last_fullsized":"2024-09-13T06:10:10.796986+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:10:42.824333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"35'6","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.608133+0000","last_change":"2024-09-13T06:09:42.177915+0000","last_active":"2024-09-13T06:12:49.608133+0000","last_peered":"2024-09-13T06:12:49.608133+0000","last_clean":"2024-09-13T06:12:49.608133+0000","last_became_active":"2024-09-13T06:09:42.172937+0000","last_became_peered":"2024-09-13T06:09:42.172937+0000","last_unstale":"2024-09-13T06:12:49.608133+0000","last_undegraded":"2024-09-13T06:12:49.608133+0000","last_fullsized":"2024-09-13T06:12:49.608133+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:30:04.561419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"35'12","reported_seq":77,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:18.855926+0000","last_change":"2024-09-13T06:09:34.131384+0000","last_active":"2024-09-13T06:10:18.855926+0000","last_peered":"2024-09-13T06:10:18.855926+0000","last_clean":"2024-09-13T06:10:18.855926+0000","last_became_active":"2024-09-13T06:09:34.131113+0000","last_became_peered":"2024-09-13T06:09:34.131113+0000","last_unstale":"2024-09-13T06:10:18.855926+0000","last_undegraded":"2024-09-13T06:10:18.855926+0000","last_fullsized":"2024-09-13T06:10:18.855926+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:51:08.067895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":60,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"14'117","reported_seq":205,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.805897+0000","last_change":"2024-09-13T06:09:19.565573+0000","last_active":"2024-09-13T06:10:10.805897+0000","last_peered":"2024-09-13T06:10:10.805897+0000","last_clean":"2024-09-13T06:10:10.805897+0000","last_became_active":"2024-09-13T06:09:19.561434+0000","last_became_peered":"2024-09-13T06:09:19.561434+0000","last_unstale":"2024-09-13T06:10:10.805897+0000","last_undegraded":"2024-09-13T06:10:10.805897+0000","last_fullsized":"2024-09-13T06:10:10.805897+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:18.163598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:18.163598+0000","last_clean_scrub_stamp":"2024-09-13T06:09:18.163598+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:04:43.437453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.809377+0000","last_change":"2024-09-13T06:09:24.220777+0000","last_active":"2024-09-13T06:10:10.809377+0000","last_peered":"2024-09-13T06:10:10.809377+0000","last_clean":"2024-09-13T06:10:10.809377+0000","last_became_active":"2024-09-13T06:09:22.217131+0000","last_became_peered":"2024-09-13T06:09:22.217131+0000","last_unstale":"2024-09-13T06:10:10.809377+0000","last_undegraded":"2024-09-13T06:10:10.809377+0000","last_fullsized":"2024-09-13T06:10:10.809377+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_clean_scrub_stamp":"2024-09-13T06:09:21.188659+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:58:05.578609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090967000000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"35'4","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:18.041669+0000","last_change":"2024-09-13T06:09:32.144633+0000","last_active":"2024-09-13T06:10:18.041669+0000","last_peered":"2024-09-13T06:10:18.041669+0000","last_clean":"2024-09-13T06:10:18.041669+0000","last_became_active":"2024-09-13T06:09:32.141646+0000","last_became_peered":"2024-09-13T06:09:32.141646+0000","last_unstale":"2024-09-13T06:10:18.041669+0000","last_undegraded":"2024-09-13T06:10:18.041669+0000","last_fullsized":"2024-09-13T06:10:18.041669+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:53:43.971322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.818078+0000","last_change":"2024-09-13T06:09:36.141123+0000","last_active":"2024-09-13T06:10:10.818078+0000","last_peered":"2024-09-13T06:10:10.818078+0000","last_clean":"2024-09-13T06:10:10.818078+0000","last_became_active":"2024-09-13T06:09:36.140417+0000","last_became_peered":"2024-09-13T06:09:36.140417+0000","last_unstale":"2024-09-13T06:10:10.818078+0000","last_undegraded":"2024-09-13T06:10:10.818078+0000","last_fullsized":"2024-09-13T06:10:10.818078+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:44:41.173375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"35'76","reported_seq":145,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:45.831796+0000","last_change":"2024-09-13T06:09:38.177538+0000","last_active":"2024-09-13T06:11:45.831796+0000","last_peered":"2024-09-13T06:11:45.831796+0000","last_clean":"2024-09-13T06:11:45.831796+0000","last_became_active":"2024-09-13T06:09:38.176365+0000","last_became_peered":"2024-09-13T06:09:38.176365+0000","last_unstale":"2024-09-13T06:11:45.831796+0000","last_undegraded":"2024-09-13T06:11:45.831796+0000","last_fullsized":"2024-09-13T06:11:45.831796+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:56:32.152357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.948040+0000","last_change":"2024-09-13T06:09:40.180407+0000","last_active":"2024-09-13T06:10:10.948040+0000","last_peered":"2024-09-13T06:10:10.948040+0000","last_clean":"2024-09-13T06:10:10.948040+0000","last_became_active":"2024-09-13T06:09:40.178872+0000","last_became_peered":"2024-09-13T06:09:40.178872+0000","last_unstale":"2024-09-13T06:10:10.948040+0000","last_undegraded":"2024-09-13T06:10:10.948040+0000","last_fullsized":"2024-09-13T06:10:10.948040+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:52:35.265077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"35'82","reported_seq":163,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.540178+0000","last_change":"2024-09-13T06:09:42.198530+0000","last_active":"2024-09-13T06:12:49.540178+0000","last_peered":"2024-09-13T06:12:49.540178+0000","last_clean":"2024-09-13T06:12:49.540178+0000","last_became_active":"2024-09-13T06:09:42.197803+0000","last_became_peered":"2024-09-13T06:09:42.197803+0000","last_unstale":"2024-09-13T06:12:49.540178+0000","last_undegraded":"2024-09-13T06:12:49.540178+0000","last_fullsized":"2024-09-13T06:12:49.540178+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:45:34.331341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"35'9","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.532885+0000","last_change":"2024-09-13T06:10:10.942337+0000","last_active":"2024-09-13T06:12:49.532885+0000","last_peered":"2024-09-13T06:12:49.532885+0000","last_clean":"2024-09-13T06:12:49.532885+0000","last_became_active":"2024-09-13T06:10:10.941771+0000","last_became_peered":"2024-09-13T06:10:10.941771+0000","last_unstale":"2024-09-13T06:12:49.532885+0000","last_undegraded":"2024-09-13T06:12:49.532885+0000","last_fullsized":"2024-09-13T06:12:49.532885+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:28:10.595005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.800700+0000","last_change":"2024-09-13T06:09:24.220722+0000","last_active":"2024-09-13T06:10:10.800700+0000","last_peered":"2024-09-13T06:10:10.800700+0000","last_clean":"2024-09-13T06:10:10.800700+0000","last_became_active":"2024-09-13T06:09:22.217643+0000","last_became_peered":"2024-09-13T06:09:22.217643+0000","last_unstale":"2024-09-13T06:10:10.800700+0000","last_undegraded":"2024-09-13T06:10:10.800700+0000","last_fullsized":"2024-09-13T06:10:10.800700+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_clean_scrub_stamp":"2024-09-13T06:09:21.188659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:44:20.577838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082521999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:48.095340+0000","last_change":"2024-09-13T06:09:32.151263+0000","last_active":"2024-09-13T06:11:48.095340+0000","last_peered":"2024-09-13T06:11:48.095340+0000","last_clean":"2024-09-13T06:11:48.095340+0000","last_became_active":"2024-09-13T06:09:32.147837+0000","last_became_peered":"2024-09-13T06:09:32.147837+0000","last_unstale":"2024-09-13T06:11:48.095340+0000","last_undegraded":"2024-09-13T06:11:48.095340+0000","last_fullsized":"2024-09-13T06:11:48.095340+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:55:55.407168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.817292+0000","last_change":"2024-09-13T06:09:36.154146+0000","last_active":"2024-09-13T06:10:10.817292+0000","last_peered":"2024-09-13T06:10:10.817292+0000","last_clean":"2024-09-13T06:10:10.817292+0000","last_became_active":"2024-09-13T06:09:36.153430+0000","last_became_peered":"2024-09-13T06:09:36.153430+0000","last_unstale":"2024-09-13T06:10:10.817292+0000","last_undegraded":"2024-09-13T06:10:10.817292+0000","last_fullsized":"2024-09-13T06:10:10.817292+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:50:22.555296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"35'274","reported_seq":478,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.347794+0000","last_change":"2024-09-13T06:09:38.160949+0000","last_active":"2024-09-13T06:12:49.347794+0000","last_peered":"2024-09-13T06:12:49.347794+0000","last_clean":"2024-09-13T06:12:49.347794+0000","last_became_active":"2024-09-13T06:09:38.160192+0000","last_became_peered":"2024-09-13T06:09:38.160192+0000","last_unstale":"2024-09-13T06:12:49.347794+0000","last_undegraded":"2024-09-13T06:12:49.347794+0000","last_fullsized":"2024-09-13T06:12:49.347794+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:36:16.623805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.810896+0000","last_change":"2024-09-13T06:09:40.189965+0000","last_active":"2024-09-13T06:10:10.810896+0000","last_peered":"2024-09-13T06:10:10.810896+0000","last_clean":"2024-09-13T06:10:10.810896+0000","last_became_active":"2024-09-13T06:09:40.188859+0000","last_became_peered":"2024-09-13T06:09:40.188859+0000","last_unstale":"2024-09-13T06:10:10.810896+0000","last_undegraded":"2024-09-13T06:10:10.810896+0000","last_fullsized":"2024-09-13T06:10:10.810896+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:09:59.010638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"35'5","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.668016+0000","last_change":"2024-09-13T06:09:42.205523+0000","last_active":"2024-09-13T06:12:49.668016+0000","last_peered":"2024-09-13T06:12:49.668016+0000","last_clean":"2024-09-13T06:12:49.668016+0000","last_became_active":"2024-09-13T06:09:42.204736+0000","last_became_peered":"2024-09-13T06:09:42.204736+0000","last_unstale":"2024-09-13T06:12:49.668016+0000","last_undegraded":"2024-09-13T06:12:49.668016+0000","last_fullsized":"2024-09-13T06:12:49.668016+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:13:21.283440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"35'8","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:02.611023+0000","last_change":"2024-09-13T06:09:34.132298+0000","last_active":"2024-09-13T06:11:02.611023+0000","last_peered":"2024-09-13T06:11:02.611023+0000","last_clean":"2024-09-13T06:11:02.611023+0000","last_became_active":"2024-09-13T06:09:34.131564+0000","last_became_peered":"2024-09-13T06:09:34.131564+0000","last_unstale":"2024-09-13T06:11:02.611023+0000","last_undegraded":"2024-09-13T06:11:02.611023+0000","last_fullsized":"2024-09-13T06:11:02.611023+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:50:10.277490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.795564+0000","last_change":"2024-09-13T06:09:24.565111+0000","last_active":"2024-09-13T06:10:10.795564+0000","last_peered":"2024-09-13T06:10:10.795564+0000","last_clean":"2024-09-13T06:10:10.795564+0000","last_became_active":"2024-09-13T06:09:22.214952+0000","last_became_peered":"2024-09-13T06:09:22.214952+0000","last_unstale":"2024-09-13T06:10:10.795564+0000","last_undegraded":"2024-09-13T06:10:10.795564+0000","last_fullsized":"2024-09-13T06:10:10.795564+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_clean_scrub_stamp":"2024-09-13T06:09:21.188659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:20:29.599784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097860299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.942408+0000","last_change":"2024-09-13T06:09:32.152695+0000","last_active":"2024-09-13T06:10:10.942408+0000","last_peered":"2024-09-13T06:10:10.942408+0000","last_clean":"2024-09-13T06:10:10.942408+0000","last_became_active":"2024-09-13T06:09:32.148803+0000","last_became_peered":"2024-09-13T06:09:32.148803+0000","last_unstale":"2024-09-13T06:10:10.942408+0000","last_undegraded":"2024-09-13T06:10:10.942408+0000","last_fullsized":"2024-09-13T06:10:10.942408+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:16:11.746030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"26'1","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.797255+0000","last_change":"2024-09-13T06:09:36.127208+0000","last_active":"2024-09-13T06:10:10.797255+0000","last_peered":"2024-09-13T06:10:10.797255+0000","last_clean":"2024-09-13T06:10:10.797255+0000","last_became_active":"2024-09-13T06:09:36.126497+0000","last_became_peered":"2024-09-13T06:09:36.126497+0000","last_unstale":"2024-09-13T06:10:10.797255+0000","last_undegraded":"2024-09-13T06:10:10.797255+0000","last_fullsized":"2024-09-13T06:10:10.797255+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:34:31.838383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"35'16","reported_seq":85,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:46.394535+0000","last_change":"2024-09-13T06:09:38.163577+0000","last_active":"2024-09-13T06:12:46.394535+0000","last_peered":"2024-09-13T06:12:46.394535+0000","last_clean":"2024-09-13T06:12:46.394535+0000","last_became_active":"2024-09-13T06:09:38.162358+0000","last_became_peered":"2024-09-13T06:09:38.162358+0000","last_unstale":"2024-09-13T06:12:46.394535+0000","last_undegraded":"2024-09-13T06:12:46.394535+0000","last_fullsized":"2024-09-13T06:12:46.394535+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:37:23.050896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.948281+0000","last_change":"2024-09-13T06:09:40.180051+0000","last_active":"2024-09-13T06:10:10.948281+0000","last_peered":"2024-09-13T06:10:10.948281+0000","last_clean":"2024-09-13T06:10:10.948281+0000","last_became_active":"2024-09-13T06:09:40.179250+0000","last_became_peered":"2024-09-13T06:09:40.179250+0000","last_unstale":"2024-09-13T06:10:10.948281+0000","last_undegraded":"2024-09-13T06:10:10.948281+0000","last_fullsized":"2024-09-13T06:10:10.948281+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:45:23.967679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"33'2","reported_seq":19,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.802883+0000","last_change":"2024-09-13T06:09:42.203843+0000","last_active":"2024-09-13T06:10:10.802883+0000","last_peered":"2024-09-13T06:10:10.802883+0000","last_clean":"2024-09-13T06:10:10.802883+0000","last_became_active":"2024-09-13T06:09:42.203232+0000","last_became_peered":"2024-09-13T06:09:42.203232+0000","last_unstale":"2024-09-13T06:10:10.802883+0000","last_undegraded":"2024-09-13T06:10:10.802883+0000","last_fullsized":"2024-09-13T06:10:10.802883+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:59:55.860934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"35'6","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:02.878771+0000","last_change":"2024-09-13T06:09:34.116295+0000","last_active":"2024-09-13T06:11:02.878771+0000","last_peered":"2024-09-13T06:11:02.878771+0000","last_clean":"2024-09-13T06:11:02.878771+0000","last_became_active":"2024-09-13T06:09:34.113002+0000","last_became_peered":"2024-09-13T06:09:34.113002+0000","last_unstale":"2024-09-13T06:11:02.878771+0000","last_undegraded":"2024-09-13T06:11:02.878771+0000","last_fullsized":"2024-09-13T06:11:02.878771+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:14:37.877574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.803179+0000","last_change":"2024-09-13T06:09:24.222172+0000","last_active":"2024-09-13T06:10:10.803179+0000","last_peered":"2024-09-13T06:10:10.803179+0000","last_clean":"2024-09-13T06:10:10.803179+0000","last_became_active":"2024-09-13T06:09:22.217581+0000","last_became_peered":"2024-09-13T06:09:22.217581+0000","last_unstale":"2024-09-13T06:10:10.803179+0000","last_undegraded":"2024-09-13T06:10:10.803179+0000","last_fullsized":"2024-09-13T06:10:10.803179+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_clean_scrub_stamp":"2024-09-13T06:09:21.188659+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:02:07.684980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022711580000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.798782+0000","last_change":"2024-09-13T06:09:32.139418+0000","last_active":"2024-09-13T06:10:10.798782+0000","last_peered":"2024-09-13T06:10:10.798782+0000","last_clean":"2024-09-13T06:10:10.798782+0000","last_became_active":"2024-09-13T06:09:32.138838+0000","last_became_peered":"2024-09-13T06:09:32.138838+0000","last_unstale":"2024-09-13T06:10:10.798782+0000","last_undegraded":"2024-09-13T06:10:10.798782+0000","last_fullsized":"2024-09-13T06:10:10.798782+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:06:35.186829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:11.778800+0000","last_change":"2024-09-13T06:10:10.810748+0000","last_active":"2024-09-13T06:10:11.778800+0000","last_peered":"2024-09-13T06:10:11.778800+0000","last_clean":"2024-09-13T06:10:11.778800+0000","last_became_active":"2024-09-13T06:10:10.809216+0000","last_became_peered":"2024-09-13T06:10:10.809216+0000","last_unstale":"2024-09-13T06:10:11.778800+0000","last_undegraded":"2024-09-13T06:10:11.778800+0000","last_fullsized":"2024-09-13T06:10:11.778800+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:31:29.839767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"35'13","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:48.267532+0000","last_change":"2024-09-13T06:09:38.179168+0000","last_active":"2024-09-13T06:12:48.267532+0000","last_peered":"2024-09-13T06:12:48.267532+0000","last_clean":"2024-09-13T06:12:48.267532+0000","last_became_active":"2024-09-13T06:09:38.176307+0000","last_became_peered":"2024-09-13T06:09:38.176307+0000","last_unstale":"2024-09-13T06:12:48.267532+0000","last_undegraded":"2024-09-13T06:12:48.267532+0000","last_fullsized":"2024-09-13T06:12:48.267532+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:48:06.539631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.817869+0000","last_change":"2024-09-13T06:09:40.189861+0000","last_active":"2024-09-13T06:10:10.817869+0000","last_peered":"2024-09-13T06:10:10.817869+0000","last_clean":"2024-09-13T06:10:10.817869+0000","last_became_active":"2024-09-13T06:09:40.189259+0000","last_became_peered":"2024-09-13T06:09:40.189259+0000","last_unstale":"2024-09-13T06:10:10.817869+0000","last_undegraded":"2024-09-13T06:10:10.817869+0000","last_fullsized":"2024-09-13T06:10:10.817869+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:50:40.590067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"35'4","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:47.623875+0000","last_change":"2024-09-13T06:09:42.186776+0000","last_active":"2024-09-13T06:11:47.623875+0000","last_peered":"2024-09-13T06:11:47.623875+0000","last_clean":"2024-09-13T06:11:47.623875+0000","last_became_active":"2024-09-13T06:09:42.185210+0000","last_became_peered":"2024-09-13T06:09:42.185210+0000","last_unstale":"2024-09-13T06:11:47.623875+0000","last_undegraded":"2024-09-13T06:11:47.623875+0000","last_fullsized":"2024-09-13T06:11:47.623875+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:46:22.560475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"35'3","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.344035+0000","last_change":"2024-09-13T06:09:34.122137+0000","last_active":"2024-09-13T06:12:49.344035+0000","last_peered":"2024-09-13T06:12:49.344035+0000","last_clean":"2024-09-13T06:12:49.344035+0000","last_became_active":"2024-09-13T06:09:34.119283+0000","last_became_peered":"2024-09-13T06:09:34.119283+0000","last_unstale":"2024-09-13T06:12:49.344035+0000","last_undegraded":"2024-09-13T06:12:49.344035+0000","last_fullsized":"2024-09-13T06:12:49.344035+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:10:47.867373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:18.820356+0000","last_change":"2024-09-13T06:09:32.139797+0000","last_active":"2024-09-13T06:10:18.820356+0000","last_peered":"2024-09-13T06:10:18.820356+0000","last_clean":"2024-09-13T06:10:18.820356+0000","last_became_active":"2024-09-13T06:09:32.139313+0000","last_became_peered":"2024-09-13T06:09:32.139313+0000","last_unstale":"2024-09-13T06:10:18.820356+0000","last_undegraded":"2024-09-13T06:10:18.820356+0000","last_fullsized":"2024-09-13T06:10:18.820356+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:52:39.866148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.948023+0000","last_change":"2024-09-13T06:09:24.227949+0000","last_active":"2024-09-13T06:10:10.948023+0000","last_peered":"2024-09-13T06:10:10.948023+0000","last_clean":"2024-09-13T06:10:10.948023+0000","last_became_active":"2024-09-13T06:09:22.216659+0000","last_became_peered":"2024-09-13T06:09:22.216659+0000","last_unstale":"2024-09-13T06:10:10.948023+0000","last_undegraded":"2024-09-13T06:10:10.948023+0000","last_fullsized":"2024-09-13T06:10:10.948023+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_clean_scrub_stamp":"2024-09-13T06:09:21.188659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:49:43.834788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010625330000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"35'1","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:40.796808+0000","last_change":"2024-09-13T06:09:36.133083+0000","last_active":"2024-09-13T06:11:40.796808+0000","last_peered":"2024-09-13T06:11:40.796808+0000","last_clean":"2024-09-13T06:11:40.796808+0000","last_became_active":"2024-09-13T06:09:36.132376+0000","last_became_peered":"2024-09-13T06:09:36.132376+0000","last_unstale":"2024-09-13T06:11:40.796808+0000","last_undegraded":"2024-09-13T06:11:40.796808+0000","last_fullsized":"2024-09-13T06:11:40.796808+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:33:42.194072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"35'61","reported_seq":120,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:45.834397+0000","last_change":"2024-09-13T06:09:38.158348+0000","last_active":"2024-09-13T06:11:45.834397+0000","last_peered":"2024-09-13T06:11:45.834397+0000","last_clean":"2024-09-13T06:11:45.834397+0000","last_became_active":"2024-09-13T06:09:38.157579+0000","last_became_peered":"2024-09-13T06:09:38.157579+0000","last_unstale":"2024-09-13T06:11:45.834397+0000","last_undegraded":"2024-09-13T06:11:45.834397+0000","last_fullsized":"2024-09-13T06:11:45.834397+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:10:00.668843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.793704+0000","last_change":"2024-09-13T06:09:40.185803+0000","last_active":"2024-09-13T06:10:10.793704+0000","last_peered":"2024-09-13T06:10:10.793704+0000","last_clean":"2024-09-13T06:10:10.793704+0000","last_became_active":"2024-09-13T06:09:40.185234+0000","last_became_peered":"2024-09-13T06:09:40.185234+0000","last_unstale":"2024-09-13T06:10:10.793704+0000","last_undegraded":"2024-09-13T06:10:10.793704+0000","last_fullsized":"2024-09-13T06:10:10.793704+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:15:00.667693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"35'11","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:48.059535+0000","last_change":"2024-09-13T06:09:42.176351+0000","last_active":"2024-09-13T06:11:48.059535+0000","last_peered":"2024-09-13T06:11:48.059535+0000","last_clean":"2024-09-13T06:11:48.059535+0000","last_became_active":"2024-09-13T06:09:42.170302+0000","last_became_peered":"2024-09-13T06:09:42.170302+0000","last_unstale":"2024-09-13T06:11:48.059535+0000","last_undegraded":"2024-09-13T06:11:48.059535+0000","last_fullsized":"2024-09-13T06:11:48.059535+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:18:04.598744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":25,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"35'10","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:20.342360+0000","last_change":"2024-09-13T06:09:34.122222+0000","last_active":"2024-09-13T06:10:20.342360+0000","last_peered":"2024-09-13T06:10:20.342360+0000","last_clean":"2024-09-13T06:10:20.342360+0000","last_became_active":"2024-09-13T06:09:34.121836+0000","last_became_peered":"2024-09-13T06:09:34.121836+0000","last_unstale":"2024-09-13T06:10:20.342360+0000","last_undegraded":"2024-09-13T06:10:20.342360+0000","last_fullsized":"2024-09-13T06:10:20.342360+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:33:26.123983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.950946+0000","last_change":"2024-09-13T06:09:32.137231+0000","last_active":"2024-09-13T06:10:10.950946+0000","last_peered":"2024-09-13T06:10:10.950946+0000","last_clean":"2024-09-13T06:10:10.950946+0000","last_became_active":"2024-09-13T06:09:32.136238+0000","last_became_peered":"2024-09-13T06:09:32.136238+0000","last_unstale":"2024-09-13T06:10:10.950946+0000","last_undegraded":"2024-09-13T06:10:10.950946+0000","last_fullsized":"2024-09-13T06:10:10.950946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:12:38.569078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.812165+0000","last_change":"2024-09-13T06:09:24.221355+0000","last_active":"2024-09-13T06:10:10.812165+0000","last_peered":"2024-09-13T06:10:10.812165+0000","last_clean":"2024-09-13T06:10:10.812165+0000","last_became_active":"2024-09-13T06:09:22.217809+0000","last_became_peered":"2024-09-13T06:09:22.217809+0000","last_unstale":"2024-09-13T06:10:10.812165+0000","last_undegraded":"2024-09-13T06:10:10.812165+0000","last_fullsized":"2024-09-13T06:10:10.812165+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_clean_scrub_stamp":"2024-09-13T06:09:21.188659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:16:27.098773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001447545,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.802066+0000","last_change":"2024-09-13T06:09:36.152257+0000","last_active":"2024-09-13T06:10:10.802066+0000","last_peered":"2024-09-13T06:10:10.802066+0000","last_clean":"2024-09-13T06:10:10.802066+0000","last_became_active":"2024-09-13T06:09:36.151605+0000","last_became_peered":"2024-09-13T06:09:36.151605+0000","last_unstale":"2024-09-13T06:10:10.802066+0000","last_undegraded":"2024-09-13T06:10:10.802066+0000","last_fullsized":"2024-09-13T06:10:10.802066+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:14:15.857728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"35'15","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:02.613378+0000","last_change":"2024-09-13T06:09:38.167368+0000","last_active":"2024-09-13T06:11:02.613378+0000","last_peered":"2024-09-13T06:11:02.613378+0000","last_clean":"2024-09-13T06:11:02.613378+0000","last_became_active":"2024-09-13T06:09:38.165916+0000","last_became_peered":"2024-09-13T06:09:38.165916+0000","last_unstale":"2024-09-13T06:11:02.613378+0000","last_undegraded":"2024-09-13T06:11:02.613378+0000","last_fullsized":"2024-09-13T06:11:02.613378+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:51:12.107434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"35'282","reported_seq":347,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:46.393919+0000","last_change":"2024-09-13T06:09:40.182289+0000","last_active":"2024-09-13T06:12:46.393919+0000","last_peered":"2024-09-13T06:12:46.393919+0000","last_clean":"2024-09-13T06:12:46.393919+0000","last_became_active":"2024-09-13T06:09:40.181415+0000","last_became_peered":"2024-09-13T06:09:40.181415+0000","last_unstale":"2024-09-13T06:12:46.393919+0000","last_undegraded":"2024-09-13T06:12:46.393919+0000","last_fullsized":"2024-09-13T06:12:46.393919+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:49:07.565350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.816311+0000","last_change":"2024-09-13T06:09:42.195360+0000","last_active":"2024-09-13T06:10:10.816311+0000","last_peered":"2024-09-13T06:10:10.816311+0000","last_clean":"2024-09-13T06:10:10.816311+0000","last_became_active":"2024-09-13T06:09:42.194558+0000","last_became_peered":"2024-09-13T06:09:42.194558+0000","last_unstale":"2024-09-13T06:10:10.816311+0000","last_undegraded":"2024-09-13T06:10:10.816311+0000","last_fullsized":"2024-09-13T06:10:10.816311+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:15:46.155508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"35'6","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.513665+0000","last_change":"2024-09-13T06:10:10.814500+0000","last_active":"2024-09-13T06:12:49.513665+0000","last_peered":"2024-09-13T06:12:49.513665+0000","last_clean":"2024-09-13T06:12:49.513665+0000","last_became_active":"2024-09-13T06:10:10.813656+0000","last_became_peered":"2024-09-13T06:10:10.813656+0000","last_unstale":"2024-09-13T06:12:49.513665+0000","last_undegraded":"2024-09-13T06:12:49.513665+0000","last_fullsized":"2024-09-13T06:12:49.513665+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:35:54.499508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.819500+0000","last_change":"2024-09-13T06:09:32.133206+0000","last_active":"2024-09-13T06:10:10.819500+0000","last_peered":"2024-09-13T06:10:10.819500+0000","last_clean":"2024-09-13T06:10:10.819500+0000","last_became_active":"2024-09-13T06:09:32.130385+0000","last_became_peered":"2024-09-13T06:09:32.130385+0000","last_unstale":"2024-09-13T06:10:10.819500+0000","last_undegraded":"2024-09-13T06:10:10.819500+0000","last_fullsized":"2024-09-13T06:10:10.819500+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:10:45.858553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.948419+0000","last_change":"2024-09-13T06:09:24.227867+0000","last_active":"2024-09-13T06:10:10.948419+0000","last_peered":"2024-09-13T06:10:10.948419+0000","last_clean":"2024-09-13T06:10:10.948419+0000","last_became_active":"2024-09-13T06:09:22.216905+0000","last_became_peered":"2024-09-13T06:09:22.216905+0000","last_unstale":"2024-09-13T06:10:10.948419+0000","last_undegraded":"2024-09-13T06:10:10.948419+0000","last_fullsized":"2024-09-13T06:10:10.948419+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_clean_scrub_stamp":"2024-09-13T06:09:21.188659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:24:00.674357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001005588,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.802233+0000","last_change":"2024-09-13T06:09:36.152413+0000","last_active":"2024-09-13T06:10:10.802233+0000","last_peered":"2024-09-13T06:10:10.802233+0000","last_clean":"2024-09-13T06:10:10.802233+0000","last_became_active":"2024-09-13T06:09:36.149051+0000","last_became_peered":"2024-09-13T06:09:36.149051+0000","last_unstale":"2024-09-13T06:10:10.802233+0000","last_undegraded":"2024-09-13T06:10:10.802233+0000","last_fullsized":"2024-09-13T06:10:10.802233+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:40:05.139581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"33'10","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.805068+0000","last_change":"2024-09-13T06:09:38.175171+0000","last_active":"2024-09-13T06:10:10.805068+0000","last_peered":"2024-09-13T06:10:10.805068+0000","last_clean":"2024-09-13T06:10:10.805068+0000","last_became_active":"2024-09-13T06:09:38.173017+0000","last_became_peered":"2024-09-13T06:09:38.173017+0000","last_unstale":"2024-09-13T06:10:10.805068+0000","last_undegraded":"2024-09-13T06:10:10.805068+0000","last_fullsized":"2024-09-13T06:10:10.805068+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:34:30.481224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"35'282","reported_seq":390,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.798465+0000","last_change":"2024-09-13T06:09:40.171525+0000","last_active":"2024-09-13T06:12:49.798465+0000","last_peered":"2024-09-13T06:12:49.798465+0000","last_clean":"2024-09-13T06:12:49.798465+0000","last_became_active":"2024-09-13T06:09:40.170879+0000","last_became_peered":"2024-09-13T06:09:40.170879+0000","last_unstale":"2024-09-13T06:12:49.798465+0000","last_undegraded":"2024-09-13T06:12:49.798465+0000","last_fullsized":"2024-09-13T06:12:49.798465+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:49:51.483537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"33'3","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.816551+0000","last_change":"2024-09-13T06:09:42.183057+0000","last_active":"2024-09-13T06:10:10.816551+0000","last_peered":"2024-09-13T06:10:10.816551+0000","last_clean":"2024-09-13T06:10:10.816551+0000","last_became_active":"2024-09-13T06:09:42.178890+0000","last_became_peered":"2024-09-13T06:09:42.178890+0000","last_unstale":"2024-09-13T06:10:10.816551+0000","last_undegraded":"2024-09-13T06:10:10.816551+0000","last_fullsized":"2024-09-13T06:10:10.816551+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:06:09.567725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"35'4","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.321911+0000","last_change":"2024-09-13T06:09:34.104607+0000","last_active":"2024-09-13T06:12:49.321911+0000","last_peered":"2024-09-13T06:12:49.321911+0000","last_clean":"2024-09-13T06:12:49.321911+0000","last_became_active":"2024-09-13T06:09:34.104194+0000","last_became_peered":"2024-09-13T06:09:34.104194+0000","last_unstale":"2024-09-13T06:12:49.321911+0000","last_undegraded":"2024-09-13T06:12:49.321911+0000","last_fullsized":"2024-09-13T06:12:49.321911+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:54:03.779728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.820560+0000","last_change":"2024-09-13T06:09:32.118940+0000","last_active":"2024-09-13T06:10:10.820560+0000","last_peered":"2024-09-13T06:10:10.820560+0000","last_clean":"2024-09-13T06:10:10.820560+0000","last_became_active":"2024-09-13T06:09:32.118386+0000","last_became_peered":"2024-09-13T06:09:32.118386+0000","last_unstale":"2024-09-13T06:10:10.820560+0000","last_undegraded":"2024-09-13T06:10:10.820560+0000","last_fullsized":"2024-09-13T06:10:10.820560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:49:16.214220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.819052+0000","last_change":"2024-09-13T06:09:24.222245+0000","last_active":"2024-09-13T06:10:10.819052+0000","last_peered":"2024-09-13T06:10:10.819052+0000","last_clean":"2024-09-13T06:10:10.819052+0000","last_became_active":"2024-09-13T06:09:22.495259+0000","last_became_peered":"2024-09-13T06:09:22.495259+0000","last_unstale":"2024-09-13T06:10:10.819052+0000","last_undegraded":"2024-09-13T06:10:10.819052+0000","last_fullsized":"2024-09-13T06:10:10.819052+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_clean_scrub_stamp":"2024-09-13T06:09:21.188659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:50:33.808976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002230409,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.800590+0000","last_change":"2024-09-13T06:09:36.148104+0000","last_active":"2024-09-13T06:10:10.800590+0000","last_peered":"2024-09-13T06:10:10.800590+0000","last_clean":"2024-09-13T06:10:10.800590+0000","last_became_active":"2024-09-13T06:09:36.144463+0000","last_became_peered":"2024-09-13T06:09:36.144463+0000","last_unstale":"2024-09-13T06:10:10.800590+0000","last_undegraded":"2024-09-13T06:10:10.800590+0000","last_fullsized":"2024-09-13T06:10:10.800590+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:03:15.568444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"35'82","reported_seq":154,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:45.810912+0000","last_change":"2024-09-13T06:09:38.159139+0000","last_active":"2024-09-13T06:11:45.810912+0000","last_peered":"2024-09-13T06:11:45.810912+0000","last_clean":"2024-09-13T06:11:45.810912+0000","last_became_active":"2024-09-13T06:09:38.158436+0000","last_became_peered":"2024-09-13T06:09:38.158436+0000","last_unstale":"2024-09-13T06:11:45.810912+0000","last_undegraded":"2024-09-13T06:11:45.810912+0000","last_fullsized":"2024-09-13T06:11:45.810912+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:59:31.499614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.944095+0000","last_change":"2024-09-13T06:09:40.177714+0000","last_active":"2024-09-13T06:10:10.944095+0000","last_peered":"2024-09-13T06:10:10.944095+0000","last_clean":"2024-09-13T06:10:10.944095+0000","last_became_active":"2024-09-13T06:09:40.176677+0000","last_became_peered":"2024-09-13T06:09:40.176677+0000","last_unstale":"2024-09-13T06:10:10.944095+0000","last_undegraded":"2024-09-13T06:10:10.944095+0000","last_fullsized":"2024-09-13T06:10:10.944095+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:16:31.555002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.807736+0000","last_change":"2024-09-13T06:09:42.205263+0000","last_active":"2024-09-13T06:10:10.807736+0000","last_peered":"2024-09-13T06:10:10.807736+0000","last_clean":"2024-09-13T06:10:10.807736+0000","last_became_active":"2024-09-13T06:09:42.204574+0000","last_became_peered":"2024-09-13T06:09:42.204574+0000","last_unstale":"2024-09-13T06:10:10.807736+0000","last_undegraded":"2024-09-13T06:10:10.807736+0000","last_fullsized":"2024-09-13T06:10:10.807736+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:05:47.718981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.797254+0000","last_change":"2024-09-13T06:09:42.198602+0000","last_active":"2024-09-13T06:10:10.797254+0000","last_peered":"2024-09-13T06:10:10.797254+0000","last_clean":"2024-09-13T06:10:10.797254+0000","last_became_active":"2024-09-13T06:09:42.197788+0000","last_became_peered":"2024-09-13T06:09:42.197788+0000","last_unstale":"2024-09-13T06:10:10.797254+0000","last_undegraded":"2024-09-13T06:10:10.797254+0000","last_fullsized":"2024-09-13T06:10:10.797254+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:04:01.295995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"35'8","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:18.855854+0000","last_change":"2024-09-13T06:09:34.104017+0000","last_active":"2024-09-13T06:10:18.855854+0000","last_peered":"2024-09-13T06:10:18.855854+0000","last_clean":"2024-09-13T06:10:18.855854+0000","last_became_active":"2024-09-13T06:09:34.101193+0000","last_became_peered":"2024-09-13T06:09:34.101193+0000","last_unstale":"2024-09-13T06:10:18.855854+0000","last_undegraded":"2024-09-13T06:10:18.855854+0000","last_fullsized":"2024-09-13T06:10:18.855854+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:51:17.686447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.809691+0000","last_change":"2024-09-13T06:09:32.125105+0000","last_active":"2024-09-13T06:10:10.809691+0000","last_peered":"2024-09-13T06:10:10.809691+0000","last_clean":"2024-09-13T06:10:10.809691+0000","last_became_active":"2024-09-13T06:09:32.124198+0000","last_became_peered":"2024-09-13T06:09:32.124198+0000","last_unstale":"2024-09-13T06:10:10.809691+0000","last_undegraded":"2024-09-13T06:10:10.809691+0000","last_fullsized":"2024-09-13T06:10:10.809691+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:34:37.470372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.813867+0000","last_change":"2024-09-13T06:09:36.134319+0000","last_active":"2024-09-13T06:10:10.813867+0000","last_peered":"2024-09-13T06:10:10.813867+0000","last_clean":"2024-09-13T06:10:10.813867+0000","last_became_active":"2024-09-13T06:09:36.133568+0000","last_became_peered":"2024-09-13T06:09:36.133568+0000","last_unstale":"2024-09-13T06:10:10.813867+0000","last_undegraded":"2024-09-13T06:10:10.813867+0000","last_fullsized":"2024-09-13T06:10:10.813867+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:20:35.376308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"35'32","reported_seq":75,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:45.819774+0000","last_change":"2024-09-13T06:09:38.172743+0000","last_active":"2024-09-13T06:11:45.819774+0000","last_peered":"2024-09-13T06:11:45.819774+0000","last_clean":"2024-09-13T06:11:45.819774+0000","last_became_active":"2024-09-13T06:09:38.172109+0000","last_became_peered":"2024-09-13T06:09:38.172109+0000","last_unstale":"2024-09-13T06:11:45.819774+0000","last_undegraded":"2024-09-13T06:11:45.819774+0000","last_fullsized":"2024-09-13T06:11:45.819774+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:28:50.103863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.802591+0000","last_change":"2024-09-13T06:09:40.189717+0000","last_active":"2024-09-13T06:10:10.802591+0000","last_peered":"2024-09-13T06:10:10.802591+0000","last_clean":"2024-09-13T06:10:10.802591+0000","last_became_active":"2024-09-13T06:09:40.189223+0000","last_became_peered":"2024-09-13T06:09:40.189223+0000","last_unstale":"2024-09-13T06:10:10.802591+0000","last_undegraded":"2024-09-13T06:10:10.802591+0000","last_fullsized":"2024-09-13T06:10:10.802591+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:33:39.326453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"35'5","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:45.415504+0000","last_change":"2024-09-13T06:09:42.179227+0000","last_active":"2024-09-13T06:11:45.415504+0000","last_peered":"2024-09-13T06:11:45.415504+0000","last_clean":"2024-09-13T06:11:45.415504+0000","last_became_active":"2024-09-13T06:09:42.177378+0000","last_became_peered":"2024-09-13T06:09:42.177378+0000","last_unstale":"2024-09-13T06:11:45.415504+0000","last_undegraded":"2024-09-13T06:11:45.415504+0000","last_fullsized":"2024-09-13T06:11:45.415504+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:40:05.274490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"35'18","reported_seq":75,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.343992+0000","last_change":"2024-09-13T06:09:34.119010+0000","last_active":"2024-09-13T06:12:49.343992+0000","last_peered":"2024-09-13T06:12:49.343992+0000","last_clean":"2024-09-13T06:12:49.343992+0000","last_became_active":"2024-09-13T06:09:34.118441+0000","last_became_peered":"2024-09-13T06:09:34.118441+0000","last_unstale":"2024-09-13T06:12:49.343992+0000","last_undegraded":"2024-09-13T06:12:49.343992+0000","last_fullsized":"2024-09-13T06:12:49.343992+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:34:39.479193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":59,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.796239+0000","last_change":"2024-09-13T06:09:32.139144+0000","last_active":"2024-09-13T06:10:10.796239+0000","last_peered":"2024-09-13T06:10:10.796239+0000","last_clean":"2024-09-13T06:10:10.796239+0000","last_became_active":"2024-09-13T06:09:32.138664+0000","last_became_peered":"2024-09-13T06:09:32.138664+0000","last_unstale":"2024-09-13T06:10:10.796239+0000","last_undegraded":"2024-09-13T06:10:10.796239+0000","last_fullsized":"2024-09-13T06:10:10.796239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:56:32.022947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"35'4","reported_seq":226,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:47.357736+0000","last_change":"2024-09-13T06:09:36.154113+0000","last_active":"2024-09-13T06:11:47.357736+0000","last_peered":"2024-09-13T06:11:47.357736+0000","last_clean":"2024-09-13T06:11:47.357736+0000","last_became_active":"2024-09-13T06:09:36.153526+0000","last_became_peered":"2024-09-13T06:09:36.153526+0000","last_unstale":"2024-09-13T06:11:47.357736+0000","last_undegraded":"2024-09-13T06:11:47.357736+0000","last_fullsized":"2024-09-13T06:11:47.357736+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:55:06.950934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"35'6","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:48.315866+0000","last_change":"2024-09-13T06:09:38.150778+0000","last_active":"2024-09-13T06:12:48.315866+0000","last_peered":"2024-09-13T06:12:48.315866+0000","last_clean":"2024-09-13T06:12:48.315866+0000","last_became_active":"2024-09-13T06:09:38.150063+0000","last_became_peered":"2024-09-13T06:09:38.150063+0000","last_unstale":"2024-09-13T06:12:48.315866+0000","last_undegraded":"2024-09-13T06:12:48.315866+0000","last_fullsized":"2024-09-13T06:12:48.315866+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:02:22.999686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.794330+0000","last_change":"2024-09-13T06:09:40.182455+0000","last_active":"2024-09-13T06:10:10.794330+0000","last_peered":"2024-09-13T06:10:10.794330+0000","last_clean":"2024-09-13T06:10:10.794330+0000","last_became_active":"2024-09-13T06:09:40.181807+0000","last_became_peered":"2024-09-13T06:09:40.181807+0000","last_unstale":"2024-09-13T06:10:10.794330+0000","last_undegraded":"2024-09-13T06:10:10.794330+0000","last_fullsized":"2024-09-13T06:10:10.794330+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:06:21.895535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"35'2","reported_seq":19,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.441035+0000","last_change":"2024-09-13T06:09:42.209380+0000","last_active":"2024-09-13T06:12:49.441035+0000","last_peered":"2024-09-13T06:12:49.441035+0000","last_clean":"2024-09-13T06:12:49.441035+0000","last_became_active":"2024-09-13T06:09:42.208567+0000","last_became_peered":"2024-09-13T06:09:42.208567+0000","last_unstale":"2024-09-13T06:12:49.441035+0000","last_undegraded":"2024-09-13T06:12:49.441035+0000","last_fullsized":"2024-09-13T06:12:49.441035+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:25:17.333516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"35'12","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.320978+0000","last_change":"2024-09-13T06:09:34.115480+0000","last_active":"2024-09-13T06:12:49.320978+0000","last_peered":"2024-09-13T06:12:49.320978+0000","last_clean":"2024-09-13T06:12:49.320978+0000","last_became_active":"2024-09-13T06:09:34.113455+0000","last_became_peered":"2024-09-13T06:09:34.113455+0000","last_unstale":"2024-09-13T06:12:49.320978+0000","last_undegraded":"2024-09-13T06:12:49.320978+0000","last_fullsized":"2024-09-13T06:12:49.320978+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:12:41.439746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:18.044718+0000","last_change":"2024-09-13T06:09:32.118643+0000","last_active":"2024-09-13T06:10:18.044718+0000","last_peered":"2024-09-13T06:10:18.044718+0000","last_clean":"2024-09-13T06:10:18.044718+0000","last_became_active":"2024-09-13T06:09:32.118235+0000","last_became_peered":"2024-09-13T06:09:32.118235+0000","last_unstale":"2024-09-13T06:10:18.044718+0000","last_undegraded":"2024-09-13T06:10:18.044718+0000","last_fullsized":"2024-09-13T06:10:18.044718+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:42:07.291597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"26'1","reported_seq":218,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:47.370504+0000","last_change":"2024-09-13T06:09:36.135737+0000","last_active":"2024-09-13T06:11:47.370504+0000","last_peered":"2024-09-13T06:11:47.370504+0000","last_clean":"2024-09-13T06:11:47.370504+0000","last_became_active":"2024-09-13T06:09:36.135184+0000","last_became_peered":"2024-09-13T06:09:36.135184+0000","last_unstale":"2024-09-13T06:11:47.370504+0000","last_undegraded":"2024-09-13T06:11:47.370504+0000","last_fullsized":"2024-09-13T06:11:47.370504+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:29:10.875574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"35'41","reported_seq":100,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:48.431925+0000","last_change":"2024-09-13T06:09:38.166891+0000","last_active":"2024-09-13T06:12:48.431925+0000","last_peered":"2024-09-13T06:12:48.431925+0000","last_clean":"2024-09-13T06:12:48.431925+0000","last_became_active":"2024-09-13T06:09:38.166381+0000","last_became_peered":"2024-09-13T06:09:38.166381+0000","last_unstale":"2024-09-13T06:12:48.431925+0000","last_undegraded":"2024-09-13T06:12:48.431925+0000","last_fullsized":"2024-09-13T06:12:48.431925+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:19:25.019683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.813101+0000","last_change":"2024-09-13T06:09:40.182185+0000","last_active":"2024-09-13T06:10:10.813101+0000","last_peered":"2024-09-13T06:10:10.813101+0000","last_clean":"2024-09-13T06:10:10.813101+0000","last_became_active":"2024-09-13T06:09:40.181329+0000","last_became_peered":"2024-09-13T06:09:40.181329+0000","last_unstale":"2024-09-13T06:10:10.813101+0000","last_undegraded":"2024-09-13T06:10:10.813101+0000","last_fullsized":"2024-09-13T06:10:10.813101+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:44:49.118858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.808748+0000","last_change":"2024-09-13T06:09:42.211550+0000","last_active":"2024-09-13T06:10:10.808748+0000","last_peered":"2024-09-13T06:10:10.808748+0000","last_clean":"2024-09-13T06:10:10.808748+0000","last_became_active":"2024-09-13T06:09:42.211005+0000","last_became_peered":"2024-09-13T06:09:42.211005+0000","last_unstale":"2024-09-13T06:10:10.808748+0000","last_undegraded":"2024-09-13T06:10:10.808748+0000","last_fullsized":"2024-09-13T06:10:10.808748+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:13:33.778909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"35'6","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:02.880093+0000","last_change":"2024-09-13T06:09:34.127109+0000","last_active":"2024-09-13T06:11:02.880093+0000","last_peered":"2024-09-13T06:11:02.880093+0000","last_clean":"2024-09-13T06:11:02.880093+0000","last_became_active":"2024-09-13T06:09:34.126798+0000","last_became_peered":"2024-09-13T06:09:34.126798+0000","last_unstale":"2024-09-13T06:11:02.880093+0000","last_undegraded":"2024-09-13T06:11:02.880093+0000","last_fullsized":"2024-09-13T06:11:02.880093+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:26:26.734970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.821879+0000","last_change":"2024-09-13T06:09:32.126749+0000","last_active":"2024-09-13T06:10:10.821879+0000","last_peered":"2024-09-13T06:10:10.821879+0000","last_clean":"2024-09-13T06:10:10.821879+0000","last_became_active":"2024-09-13T06:09:32.126213+0000","last_became_peered":"2024-09-13T06:09:32.126213+0000","last_unstale":"2024-09-13T06:10:10.821879+0000","last_undegraded":"2024-09-13T06:10:10.821879+0000","last_fullsized":"2024-09-13T06:10:10.821879+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:09.204807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.801959+0000","last_change":"2024-09-13T06:09:36.148938+0000","last_active":"2024-09-13T06:10:10.801959+0000","last_peered":"2024-09-13T06:10:10.801959+0000","last_clean":"2024-09-13T06:10:10.801959+0000","last_became_active":"2024-09-13T06:09:36.148016+0000","last_became_peered":"2024-09-13T06:09:36.148016+0000","last_unstale":"2024-09-13T06:10:10.801959+0000","last_undegraded":"2024-09-13T06:10:10.801959+0000","last_fullsized":"2024-09-13T06:10:10.801959+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:59:53.400572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"35'30","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:45.798259+0000","last_change":"2024-09-13T06:09:38.141951+0000","last_active":"2024-09-13T06:11:45.798259+0000","last_peered":"2024-09-13T06:11:45.798259+0000","last_clean":"2024-09-13T06:11:45.798259+0000","last_became_active":"2024-09-13T06:09:38.141182+0000","last_became_peered":"2024-09-13T06:09:38.141182+0000","last_unstale":"2024-09-13T06:11:45.798259+0000","last_undegraded":"2024-09-13T06:11:45.798259+0000","last_fullsized":"2024-09-13T06:11:45.798259+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:13:56.276508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.796907+0000","last_change":"2024-09-13T06:09:40.166939+0000","last_active":"2024-09-13T06:10:10.796907+0000","last_peered":"2024-09-13T06:10:10.796907+0000","last_clean":"2024-09-13T06:10:10.796907+0000","last_became_active":"2024-09-13T06:09:40.166229+0000","last_became_peered":"2024-09-13T06:09:40.166229+0000","last_unstale":"2024-09-13T06:10:10.796907+0000","last_undegraded":"2024-09-13T06:10:10.796907+0000","last_fullsized":"2024-09-13T06:10:10.796907+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:34:36.456263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"35'6","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.131054+0000","last_change":"2024-09-13T06:09:34.122302+0000","last_active":"2024-09-13T06:12:49.131054+0000","last_peered":"2024-09-13T06:12:49.131054+0000","last_clean":"2024-09-13T06:12:49.131054+0000","last_became_active":"2024-09-13T06:09:34.122034+0000","last_became_peered":"2024-09-13T06:09:34.122034+0000","last_unstale":"2024-09-13T06:12:49.131054+0000","last_undegraded":"2024-09-13T06:12:49.131054+0000","last_fullsized":"2024-09-13T06:12:49.131054+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:11:36.611679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"35'1","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:57.810367+0000","last_change":"2024-09-13T06:09:32.124543+0000","last_active":"2024-09-13T06:11:57.810367+0000","last_peered":"2024-09-13T06:11:57.810367+0000","last_clean":"2024-09-13T06:11:57.810367+0000","last_became_active":"2024-09-13T06:09:32.121948+0000","last_became_peered":"2024-09-13T06:09:32.121948+0000","last_unstale":"2024-09-13T06:11:57.810367+0000","last_undegraded":"2024-09-13T06:11:57.810367+0000","last_fullsized":"2024-09-13T06:11:57.810367+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:32:08.664673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.948430+0000","last_change":"2024-09-13T06:09:36.132935+0000","last_active":"2024-09-13T06:10:10.948430+0000","last_peered":"2024-09-13T06:10:10.948430+0000","last_clean":"2024-09-13T06:10:10.948430+0000","last_became_active":"2024-09-13T06:09:36.132227+0000","last_became_peered":"2024-09-13T06:09:36.132227+0000","last_unstale":"2024-09-13T06:10:10.948430+0000","last_undegraded":"2024-09-13T06:10:10.948430+0000","last_fullsized":"2024-09-13T06:10:10.948430+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:57:02.814153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"35'54","reported_seq":110,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:45.829484+0000","last_change":"2024-09-13T06:09:38.150760+0000","last_active":"2024-09-13T06:11:45.829484+0000","last_peered":"2024-09-13T06:11:45.829484+0000","last_clean":"2024-09-13T06:11:45.829484+0000","last_became_active":"2024-09-13T06:09:38.150070+0000","last_became_peered":"2024-09-13T06:09:38.150070+0000","last_unstale":"2024-09-13T06:11:45.829484+0000","last_undegraded":"2024-09-13T06:11:45.829484+0000","last_fullsized":"2024-09-13T06:11:45.829484+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:07:27.806351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.797513+0000","last_change":"2024-09-13T06:09:40.172438+0000","last_active":"2024-09-13T06:10:10.797513+0000","last_peered":"2024-09-13T06:10:10.797513+0000","last_clean":"2024-09-13T06:10:10.797513+0000","last_became_active":"2024-09-13T06:09:40.168550+0000","last_became_peered":"2024-09-13T06:09:40.168550+0000","last_unstale":"2024-09-13T06:10:10.797513+0000","last_undegraded":"2024-09-13T06:10:10.797513+0000","last_fullsized":"2024-09-13T06:10:10.797513+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:45:10.856259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"35'14","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:48.049705+0000","last_change":"2024-09-13T06:09:42.212051+0000","last_active":"2024-09-13T06:11:48.049705+0000","last_peered":"2024-09-13T06:11:48.049705+0000","last_clean":"2024-09-13T06:11:48.049705+0000","last_became_active":"2024-09-13T06:09:42.211508+0000","last_became_peered":"2024-09-13T06:09:42.211508+0000","last_unstale":"2024-09-13T06:11:48.049705+0000","last_undegraded":"2024-09-13T06:11:48.049705+0000","last_fullsized":"2024-09-13T06:11:48.049705+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:12:02.782157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"35'8","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:02.612403+0000","last_change":"2024-09-13T06:09:34.123413+0000","last_active":"2024-09-13T06:11:02.612403+0000","last_peered":"2024-09-13T06:11:02.612403+0000","last_clean":"2024-09-13T06:11:02.612403+0000","last_became_active":"2024-09-13T06:09:34.122881+0000","last_became_peered":"2024-09-13T06:09:34.122881+0000","last_unstale":"2024-09-13T06:11:02.612403+0000","last_undegraded":"2024-09-13T06:11:02.612403+0000","last_fullsized":"2024-09-13T06:11:02.612403+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:16:44.971572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":11,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.811694+0000","last_change":"2024-09-13T06:09:32.120176+0000","last_active":"2024-09-13T06:10:10.811694+0000","last_peered":"2024-09-13T06:10:10.811694+0000","last_clean":"2024-09-13T06:10:10.811694+0000","last_became_active":"2024-09-13T06:09:32.119573+0000","last_became_peered":"2024-09-13T06:09:32.119573+0000","last_unstale":"2024-09-13T06:10:10.811694+0000","last_undegraded":"2024-09-13T06:10:10.811694+0000","last_fullsized":"2024-09-13T06:10:10.811694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:40:56.947438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.799409+0000","last_change":"2024-09-13T06:09:36.128456+0000","last_active":"2024-09-13T06:10:10.799409+0000","last_peered":"2024-09-13T06:10:10.799409+0000","last_clean":"2024-09-13T06:10:10.799409+0000","last_became_active":"2024-09-13T06:09:36.127719+0000","last_became_peered":"2024-09-13T06:09:36.127719+0000","last_unstale":"2024-09-13T06:10:10.799409+0000","last_undegraded":"2024-09-13T06:10:10.799409+0000","last_fullsized":"2024-09-13T06:10:10.799409+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:41:36.178856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"35'37","reported_seq":82,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:45.799506+0000","last_change":"2024-09-13T06:09:38.176074+0000","last_active":"2024-09-13T06:11:45.799506+0000","last_peered":"2024-09-13T06:11:45.799506+0000","last_clean":"2024-09-13T06:11:45.799506+0000","last_became_active":"2024-09-13T06:09:38.175443+0000","last_became_peered":"2024-09-13T06:09:38.175443+0000","last_unstale":"2024-09-13T06:11:45.799506+0000","last_undegraded":"2024-09-13T06:11:45.799506+0000","last_fullsized":"2024-09-13T06:11:45.799506+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:17:36.487054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.817232+0000","last_change":"2024-09-13T06:09:40.185799+0000","last_active":"2024-09-13T06:10:10.817232+0000","last_peered":"2024-09-13T06:10:10.817232+0000","last_clean":"2024-09-13T06:10:10.817232+0000","last_became_active":"2024-09-13T06:09:40.185222+0000","last_became_peered":"2024-09-13T06:09:40.185222+0000","last_unstale":"2024-09-13T06:10:10.817232+0000","last_undegraded":"2024-09-13T06:10:10.817232+0000","last_fullsized":"2024-09-13T06:10:10.817232+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:05:13.593940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.801505+0000","last_change":"2024-09-13T06:09:42.197504+0000","last_active":"2024-09-13T06:10:10.801505+0000","last_peered":"2024-09-13T06:10:10.801505+0000","last_clean":"2024-09-13T06:10:10.801505+0000","last_became_active":"2024-09-13T06:09:42.196679+0000","last_became_peered":"2024-09-13T06:09:42.196679+0000","last_unstale":"2024-09-13T06:10:10.801505+0000","last_undegraded":"2024-09-13T06:10:10.801505+0000","last_fullsized":"2024-09-13T06:10:10.801505+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:50:54.126547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"35'15","reported_seq":76,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:48.978469+0000","last_change":"2024-09-13T06:09:34.133093+0000","last_active":"2024-09-13T06:12:48.978469+0000","last_peered":"2024-09-13T06:12:48.978469+0000","last_clean":"2024-09-13T06:12:48.978469+0000","last_became_active":"2024-09-13T06:09:34.132777+0000","last_became_peered":"2024-09-13T06:09:34.132777+0000","last_unstale":"2024-09-13T06:12:48.978469+0000","last_undegraded":"2024-09-13T06:12:48.978469+0000","last_fullsized":"2024-09-13T06:12:48.978469+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:22:38.070470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":57,"num_read_kb":53,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.814118+0000","last_change":"2024-09-13T06:09:32.118851+0000","last_active":"2024-09-13T06:10:10.814118+0000","last_peered":"2024-09-13T06:10:10.814118+0000","last_clean":"2024-09-13T06:10:10.814118+0000","last_became_active":"2024-09-13T06:09:32.117988+0000","last_became_peered":"2024-09-13T06:09:32.117988+0000","last_unstale":"2024-09-13T06:10:10.814118+0000","last_undegraded":"2024-09-13T06:10:10.814118+0000","last_fullsized":"2024-09-13T06:10:10.814118+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:23:34.478662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.799299+0000","last_change":"2024-09-13T06:09:36.130203+0000","last_active":"2024-09-13T06:10:10.799299+0000","last_peered":"2024-09-13T06:10:10.799299+0000","last_clean":"2024-09-13T06:10:10.799299+0000","last_became_active":"2024-09-13T06:09:36.129471+0000","last_became_peered":"2024-09-13T06:09:36.129471+0000","last_unstale":"2024-09-13T06:10:10.799299+0000","last_undegraded":"2024-09-13T06:10:10.799299+0000","last_fullsized":"2024-09-13T06:10:10.799299+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:24:11.325179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"35'34","reported_seq":77,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:45.798283+0000","last_change":"2024-09-13T06:09:38.154073+0000","last_active":"2024-09-13T06:11:45.798283+0000","last_peered":"2024-09-13T06:11:45.798283+0000","last_clean":"2024-09-13T06:11:45.798283+0000","last_became_active":"2024-09-13T06:09:38.153433+0000","last_became_peered":"2024-09-13T06:09:38.153433+0000","last_unstale":"2024-09-13T06:11:45.798283+0000","last_undegraded":"2024-09-13T06:11:45.798283+0000","last_fullsized":"2024-09-13T06:11:45.798283+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:14:58.653958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":46,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.947882+0000","last_change":"2024-09-13T06:09:40.172148+0000","last_active":"2024-09-13T06:10:10.947882+0000","last_peered":"2024-09-13T06:10:10.947882+0000","last_clean":"2024-09-13T06:10:10.947882+0000","last_became_active":"2024-09-13T06:09:40.171455+0000","last_became_peered":"2024-09-13T06:09:40.171455+0000","last_unstale":"2024-09-13T06:10:10.947882+0000","last_undegraded":"2024-09-13T06:10:10.947882+0000","last_fullsized":"2024-09-13T06:10:10.947882+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:14:59.315430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"35'5","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:48.222496+0000","last_change":"2024-09-13T06:09:42.202743+0000","last_active":"2024-09-13T06:11:48.222496+0000","last_peered":"2024-09-13T06:11:48.222496+0000","last_clean":"2024-09-13T06:11:48.222496+0000","last_became_active":"2024-09-13T06:09:42.202004+0000","last_became_peered":"2024-09-13T06:09:42.202004+0000","last_unstale":"2024-09-13T06:11:48.222496+0000","last_undegraded":"2024-09-13T06:11:48.222496+0000","last_fullsized":"2024-09-13T06:11:48.222496+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:46:50.902863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.951802+0000","last_change":"2024-09-13T06:09:34.117065+0000","last_active":"2024-09-13T06:10:10.951802+0000","last_peered":"2024-09-13T06:10:10.951802+0000","last_clean":"2024-09-13T06:10:10.951802+0000","last_became_active":"2024-09-13T06:09:34.116197+0000","last_became_peered":"2024-09-13T06:09:34.116197+0000","last_unstale":"2024-09-13T06:10:10.951802+0000","last_undegraded":"2024-09-13T06:10:10.951802+0000","last_fullsized":"2024-09-13T06:10:10.951802+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:56:27.933046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:43.515452+0000","last_change":"2024-09-13T06:09:32.132784+0000","last_active":"2024-09-13T06:11:43.515452+0000","last_peered":"2024-09-13T06:11:43.515452+0000","last_clean":"2024-09-13T06:11:43.515452+0000","last_became_active":"2024-09-13T06:09:32.124989+0000","last_became_peered":"2024-09-13T06:09:32.124989+0000","last_unstale":"2024-09-13T06:11:43.515452+0000","last_undegraded":"2024-09-13T06:11:43.515452+0000","last_fullsized":"2024-09-13T06:11:43.515452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:48:08.025389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.817750+0000","last_change":"2024-09-13T06:09:36.140817+0000","last_active":"2024-09-13T06:10:10.817750+0000","last_peered":"2024-09-13T06:10:10.817750+0000","last_clean":"2024-09-13T06:10:10.817750+0000","last_became_active":"2024-09-13T06:09:36.140149+0000","last_became_peered":"2024-09-13T06:09:36.140149+0000","last_unstale":"2024-09-13T06:10:10.817750+0000","last_undegraded":"2024-09-13T06:10:10.817750+0000","last_fullsized":"2024-09-13T06:10:10.817750+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:04:48.637365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'10","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.816866+0000","last_change":"2024-09-13T06:09:38.178539+0000","last_active":"2024-09-13T06:10:10.816866+0000","last_peered":"2024-09-13T06:10:10.816866+0000","last_clean":"2024-09-13T06:10:10.816866+0000","last_became_active":"2024-09-13T06:09:38.177699+0000","last_became_peered":"2024-09-13T06:09:38.177699+0000","last_unstale":"2024-09-13T06:10:10.816866+0000","last_undegraded":"2024-09-13T06:10:10.816866+0000","last_fullsized":"2024-09-13T06:10:10.816866+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:32:51.733389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"35'282","reported_seq":371,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.838611+0000","last_change":"2024-09-13T06:09:40.167569+0000","last_active":"2024-09-13T06:12:49.838611+0000","last_peered":"2024-09-13T06:12:49.838611+0000","last_clean":"2024-09-13T06:12:49.838611+0000","last_became_active":"2024-09-13T06:09:40.166780+0000","last_became_peered":"2024-09-13T06:09:40.166780+0000","last_unstale":"2024-09-13T06:12:49.838611+0000","last_undegraded":"2024-09-13T06:12:49.838611+0000","last_fullsized":"2024-09-13T06:12:49.838611+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:49:12.694438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"35'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:43.527859+0000","last_change":"2024-09-13T06:09:42.201112+0000","last_active":"2024-09-13T06:11:43.527859+0000","last_peered":"2024-09-13T06:11:43.527859+0000","last_clean":"2024-09-13T06:11:43.527859+0000","last_became_active":"2024-09-13T06:09:42.196063+0000","last_became_peered":"2024-09-13T06:09:42.196063+0000","last_unstale":"2024-09-13T06:11:43.527859+0000","last_undegraded":"2024-09-13T06:11:43.527859+0000","last_fullsized":"2024-09-13T06:11:43.527859+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:58:32.682955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"35'6","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:48.962756+0000","last_change":"2024-09-13T06:09:34.108198+0000","last_active":"2024-09-13T06:12:48.962756+0000","last_peered":"2024-09-13T06:12:48.962756+0000","last_clean":"2024-09-13T06:12:48.962756+0000","last_became_active":"2024-09-13T06:09:34.107821+0000","last_became_peered":"2024-09-13T06:09:34.107821+0000","last_unstale":"2024-09-13T06:12:48.962756+0000","last_undegraded":"2024-09-13T06:12:48.962756+0000","last_fullsized":"2024-09-13T06:12:48.962756+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:32:59.845317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:19.619406+0000","last_change":"2024-09-13T06:09:32.141297+0000","last_active":"2024-09-13T06:10:19.619406+0000","last_peered":"2024-09-13T06:10:19.619406+0000","last_clean":"2024-09-13T06:10:19.619406+0000","last_became_active":"2024-09-13T06:09:32.140816+0000","last_became_peered":"2024-09-13T06:09:32.140816+0000","last_unstale":"2024-09-13T06:10:19.619406+0000","last_undegraded":"2024-09-13T06:10:19.619406+0000","last_fullsized":"2024-09-13T06:10:19.619406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:40:42.202859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.813629+0000","last_change":"2024-09-13T06:09:36.141476+0000","last_active":"2024-09-13T06:10:10.813629+0000","last_peered":"2024-09-13T06:10:10.813629+0000","last_clean":"2024-09-13T06:10:10.813629+0000","last_became_active":"2024-09-13T06:09:36.140770+0000","last_became_peered":"2024-09-13T06:09:36.140770+0000","last_unstale":"2024-09-13T06:10:10.813629+0000","last_undegraded":"2024-09-13T06:10:10.813629+0000","last_fullsized":"2024-09-13T06:10:10.813629+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:26:28.751065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"35'37","reported_seq":82,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:45.784945+0000","last_change":"2024-09-13T06:09:38.167920+0000","last_active":"2024-09-13T06:11:45.784945+0000","last_peered":"2024-09-13T06:11:45.784945+0000","last_clean":"2024-09-13T06:11:45.784945+0000","last_became_active":"2024-09-13T06:09:38.166681+0000","last_became_peered":"2024-09-13T06:09:38.166681+0000","last_unstale":"2024-09-13T06:11:45.784945+0000","last_undegraded":"2024-09-13T06:11:45.784945+0000","last_fullsized":"2024-09-13T06:11:45.784945+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:55:43.635960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.942532+0000","last_change":"2024-09-13T06:09:40.179339+0000","last_active":"2024-09-13T06:10:10.942532+0000","last_peered":"2024-09-13T06:10:10.942532+0000","last_clean":"2024-09-13T06:10:10.942532+0000","last_became_active":"2024-09-13T06:09:40.178484+0000","last_became_peered":"2024-09-13T06:09:40.178484+0000","last_unstale":"2024-09-13T06:10:10.942532+0000","last_undegraded":"2024-09-13T06:10:10.942532+0000","last_fullsized":"2024-09-13T06:10:10.942532+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:45:32.317497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"35'4","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:02.607121+0000","last_change":"2024-09-13T06:09:42.201123+0000","last_active":"2024-09-13T06:11:02.607121+0000","last_peered":"2024-09-13T06:11:02.607121+0000","last_clean":"2024-09-13T06:11:02.607121+0000","last_became_active":"2024-09-13T06:09:42.199609+0000","last_became_peered":"2024-09-13T06:09:42.199609+0000","last_unstale":"2024-09-13T06:11:02.607121+0000","last_undegraded":"2024-09-13T06:11:02.607121+0000","last_fullsized":"2024-09-13T06:11:02.607121+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:30:15.851819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"35'5","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:06.802967+0000","last_change":"2024-09-13T06:09:34.100754+0000","last_active":"2024-09-13T06:12:06.802967+0000","last_peered":"2024-09-13T06:12:06.802967+0000","last_clean":"2024-09-13T06:12:06.802967+0000","last_became_active":"2024-09-13T06:09:34.100355+0000","last_became_peered":"2024-09-13T06:09:34.100355+0000","last_unstale":"2024-09-13T06:12:06.802967+0000","last_undegraded":"2024-09-13T06:12:06.802967+0000","last_fullsized":"2024-09-13T06:12:06.802967+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:09:45.564486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.812408+0000","last_change":"2024-09-13T06:09:32.133279+0000","last_active":"2024-09-13T06:10:10.812408+0000","last_peered":"2024-09-13T06:10:10.812408+0000","last_clean":"2024-09-13T06:10:10.812408+0000","last_became_active":"2024-09-13T06:09:32.125049+0000","last_became_peered":"2024-09-13T06:09:32.125049+0000","last_unstale":"2024-09-13T06:10:10.812408+0000","last_undegraded":"2024-09-13T06:10:10.812408+0000","last_fullsized":"2024-09-13T06:10:10.812408+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:46:21.627138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.803001+0000","last_change":"2024-09-13T06:09:36.128406+0000","last_active":"2024-09-13T06:10:10.803001+0000","last_peered":"2024-09-13T06:10:10.803001+0000","last_clean":"2024-09-13T06:10:10.803001+0000","last_became_active":"2024-09-13T06:09:36.127684+0000","last_became_peered":"2024-09-13T06:09:36.127684+0000","last_unstale":"2024-09-13T06:10:10.803001+0000","last_undegraded":"2024-09-13T06:10:10.803001+0000","last_fullsized":"2024-09-13T06:10:10.803001+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:19:14.299050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"35'31","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:05.803369+0000","last_change":"2024-09-13T06:09:38.158011+0000","last_active":"2024-09-13T06:12:05.803369+0000","last_peered":"2024-09-13T06:12:05.803369+0000","last_clean":"2024-09-13T06:12:05.803369+0000","last_became_active":"2024-09-13T06:09:38.157278+0000","last_became_peered":"2024-09-13T06:09:38.157278+0000","last_unstale":"2024-09-13T06:12:05.803369+0000","last_undegraded":"2024-09-13T06:12:05.803369+0000","last_fullsized":"2024-09-13T06:12:05.803369+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:38:47.813081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.801307+0000","last_change":"2024-09-13T06:09:40.189802+0000","last_active":"2024-09-13T06:10:10.801307+0000","last_peered":"2024-09-13T06:10:10.801307+0000","last_clean":"2024-09-13T06:10:10.801307+0000","last_became_active":"2024-09-13T06:09:40.189165+0000","last_became_peered":"2024-09-13T06:09:40.189165+0000","last_unstale":"2024-09-13T06:10:10.801307+0000","last_undegraded":"2024-09-13T06:10:10.801307+0000","last_fullsized":"2024-09-13T06:10:10.801307+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:46:51.067583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.817340+0000","last_change":"2024-09-13T06:09:42.214239+0000","last_active":"2024-09-13T06:10:10.817340+0000","last_peered":"2024-09-13T06:10:10.817340+0000","last_clean":"2024-09-13T06:10:10.817340+0000","last_became_active":"2024-09-13T06:09:42.213756+0000","last_became_peered":"2024-09-13T06:09:42.213756+0000","last_unstale":"2024-09-13T06:10:10.817340+0000","last_undegraded":"2024-09-13T06:10:10.817340+0000","last_fullsized":"2024-09-13T06:10:10.817340+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:18:10.840742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.802714+0000","last_change":"2024-09-13T06:09:34.118052+0000","last_active":"2024-09-13T06:10:10.802714+0000","last_peered":"2024-09-13T06:10:10.802714+0000","last_clean":"2024-09-13T06:10:10.802714+0000","last_became_active":"2024-09-13T06:09:34.117789+0000","last_became_peered":"2024-09-13T06:09:34.117789+0000","last_unstale":"2024-09-13T06:10:10.802714+0000","last_undegraded":"2024-09-13T06:10:10.802714+0000","last_fullsized":"2024-09-13T06:10:10.802714+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:20:33.360213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.948743+0000","last_change":"2024-09-13T06:09:32.135815+0000","last_active":"2024-09-13T06:10:10.948743+0000","last_peered":"2024-09-13T06:10:10.948743+0000","last_clean":"2024-09-13T06:10:10.948743+0000","last_became_active":"2024-09-13T06:09:32.134696+0000","last_became_peered":"2024-09-13T06:09:32.134696+0000","last_unstale":"2024-09-13T06:10:10.948743+0000","last_undegraded":"2024-09-13T06:10:10.948743+0000","last_fullsized":"2024-09-13T06:10:10.948743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:26:57.128770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.805495+0000","last_change":"2024-09-13T06:09:36.132556+0000","last_active":"2024-09-13T06:10:10.805495+0000","last_peered":"2024-09-13T06:10:10.805495+0000","last_clean":"2024-09-13T06:10:10.805495+0000","last_became_active":"2024-09-13T06:09:36.131976+0000","last_became_peered":"2024-09-13T06:09:36.131976+0000","last_unstale":"2024-09-13T06:10:10.805495+0000","last_undegraded":"2024-09-13T06:10:10.805495+0000","last_fullsized":"2024-09-13T06:10:10.805495+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:48:01.480885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"35'26","reported_seq":66,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:45.822287+0000","last_change":"2024-09-13T06:09:38.173782+0000","last_active":"2024-09-13T06:11:45.822287+0000","last_peered":"2024-09-13T06:11:45.822287+0000","last_clean":"2024-09-13T06:11:45.822287+0000","last_became_active":"2024-09-13T06:09:38.171538+0000","last_became_peered":"2024-09-13T06:09:38.171538+0000","last_unstale":"2024-09-13T06:11:45.822287+0000","last_undegraded":"2024-09-13T06:11:45.822287+0000","last_fullsized":"2024-09-13T06:11:45.822287+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:03:14.025680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.802940+0000","last_change":"2024-09-13T06:09:40.185942+0000","last_active":"2024-09-13T06:10:10.802940+0000","last_peered":"2024-09-13T06:10:10.802940+0000","last_clean":"2024-09-13T06:10:10.802940+0000","last_became_active":"2024-09-13T06:09:40.185277+0000","last_became_peered":"2024-09-13T06:09:40.185277+0000","last_unstale":"2024-09-13T06:10:10.802940+0000","last_undegraded":"2024-09-13T06:10:10.802940+0000","last_fullsized":"2024-09-13T06:10:10.802940+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:32:01.193186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"35'6","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.118315+0000","last_change":"2024-09-13T06:09:42.211802+0000","last_active":"2024-09-13T06:12:49.118315+0000","last_peered":"2024-09-13T06:12:49.118315+0000","last_clean":"2024-09-13T06:12:49.118315+0000","last_became_active":"2024-09-13T06:09:42.211176+0000","last_became_peered":"2024-09-13T06:09:42.211176+0000","last_unstale":"2024-09-13T06:12:49.118315+0000","last_undegraded":"2024-09-13T06:12:49.118315+0000","last_fullsized":"2024-09-13T06:12:49.118315+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:57:39.347061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"35'7","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:01.801830+0000","last_change":"2024-09-13T06:09:34.105846+0000","last_active":"2024-09-13T06:12:01.801830+0000","last_peered":"2024-09-13T06:12:01.801830+0000","last_clean":"2024-09-13T06:12:01.801830+0000","last_became_active":"2024-09-13T06:09:34.105494+0000","last_became_peered":"2024-09-13T06:09:34.105494+0000","last_unstale":"2024-09-13T06:12:01.801830+0000","last_undegraded":"2024-09-13T06:12:01.801830+0000","last_fullsized":"2024-09-13T06:12:01.801830+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:49:45.129882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:48.169232+0000","last_change":"2024-09-13T06:09:32.143211+0000","last_active":"2024-09-13T06:11:48.169232+0000","last_peered":"2024-09-13T06:11:48.169232+0000","last_clean":"2024-09-13T06:11:48.169232+0000","last_became_active":"2024-09-13T06:09:32.142726+0000","last_became_peered":"2024-09-13T06:09:32.142726+0000","last_unstale":"2024-09-13T06:11:48.169232+0000","last_undegraded":"2024-09-13T06:11:48.169232+0000","last_fullsized":"2024-09-13T06:11:48.169232+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:21:43.192771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"35'2","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:44.039922+0000","last_change":"2024-09-13T06:09:36.137208+0000","last_active":"2024-09-13T06:11:44.039922+0000","last_peered":"2024-09-13T06:11:44.039922+0000","last_clean":"2024-09-13T06:11:44.039922+0000","last_became_active":"2024-09-13T06:09:36.136792+0000","last_became_peered":"2024-09-13T06:09:36.136792+0000","last_unstale":"2024-09-13T06:11:44.039922+0000","last_undegraded":"2024-09-13T06:11:44.039922+0000","last_fullsized":"2024-09-13T06:11:44.039922+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:41.098706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"35'32","reported_seq":76,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:48.279549+0000","last_change":"2024-09-13T06:09:38.167295+0000","last_active":"2024-09-13T06:12:48.279549+0000","last_peered":"2024-09-13T06:12:48.279549+0000","last_clean":"2024-09-13T06:12:48.279549+0000","last_became_active":"2024-09-13T06:09:38.166333+0000","last_became_peered":"2024-09-13T06:09:38.166333+0000","last_unstale":"2024-09-13T06:12:48.279549+0000","last_undegraded":"2024-09-13T06:12:48.279549+0000","last_fullsized":"2024-09-13T06:12:48.279549+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:04:00.098517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.946008+0000","last_change":"2024-09-13T06:09:40.179631+0000","last_active":"2024-09-13T06:10:10.946008+0000","last_peered":"2024-09-13T06:10:10.946008+0000","last_clean":"2024-09-13T06:10:10.946008+0000","last_became_active":"2024-09-13T06:09:40.178392+0000","last_became_peered":"2024-09-13T06:09:40.178392+0000","last_unstale":"2024-09-13T06:10:10.946008+0000","last_undegraded":"2024-09-13T06:10:10.946008+0000","last_fullsized":"2024-09-13T06:10:10.946008+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:07:06.165239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"35'8","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:48.486283+0000","last_change":"2024-09-13T06:09:42.214258+0000","last_active":"2024-09-13T06:12:48.486283+0000","last_peered":"2024-09-13T06:12:48.486283+0000","last_clean":"2024-09-13T06:12:48.486283+0000","last_became_active":"2024-09-13T06:09:42.213809+0000","last_became_peered":"2024-09-13T06:09:42.213809+0000","last_unstale":"2024-09-13T06:12:48.486283+0000","last_undegraded":"2024-09-13T06:12:48.486283+0000","last_fullsized":"2024-09-13T06:12:48.486283+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:14:08.749509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"35'6","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:18.858941+0000","last_change":"2024-09-13T06:09:34.126954+0000","last_active":"2024-09-13T06:10:18.858941+0000","last_peered":"2024-09-13T06:10:18.858941+0000","last_clean":"2024-09-13T06:10:18.858941+0000","last_became_active":"2024-09-13T06:09:34.124044+0000","last_became_peered":"2024-09-13T06:09:34.124044+0000","last_unstale":"2024-09-13T06:10:18.858941+0000","last_undegraded":"2024-09-13T06:10:18.858941+0000","last_fullsized":"2024-09-13T06:10:18.858941+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:41:52.801670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.793841+0000","last_change":"2024-09-13T06:09:32.134687+0000","last_active":"2024-09-13T06:10:10.793841+0000","last_peered":"2024-09-13T06:10:10.793841+0000","last_clean":"2024-09-13T06:10:10.793841+0000","last_became_active":"2024-09-13T06:09:32.133972+0000","last_became_peered":"2024-09-13T06:09:32.133972+0000","last_unstale":"2024-09-13T06:10:10.793841+0000","last_undegraded":"2024-09-13T06:10:10.793841+0000","last_fullsized":"2024-09-13T06:10:10.793841+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:28:08.722107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"35'12","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.513040+0000","last_change":"2024-09-13T06:09:34.113604+0000","last_active":"2024-09-13T06:12:49.513040+0000","last_peered":"2024-09-13T06:12:49.513040+0000","last_clean":"2024-09-13T06:12:49.513040+0000","last_became_active":"2024-09-13T06:09:34.112805+0000","last_became_peered":"2024-09-13T06:09:34.112805+0000","last_unstale":"2024-09-13T06:12:49.513040+0000","last_undegraded":"2024-09-13T06:12:49.513040+0000","last_fullsized":"2024-09-13T06:12:49.513040+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:57:58.370368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:18.043879+0000","last_change":"2024-09-13T06:09:32.150318+0000","last_active":"2024-09-13T06:10:18.043879+0000","last_peered":"2024-09-13T06:10:18.043879+0000","last_clean":"2024-09-13T06:10:18.043879+0000","last_became_active":"2024-09-13T06:09:32.145941+0000","last_became_peered":"2024-09-13T06:09:32.145941+0000","last_unstale":"2024-09-13T06:10:18.043879+0000","last_undegraded":"2024-09-13T06:10:18.043879+0000","last_fullsized":"2024-09-13T06:10:18.043879+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:52:39.866148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"35'10","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.435817+0000","last_change":"2024-09-13T06:09:34.118956+0000","last_active":"2024-09-13T06:12:49.435817+0000","last_peered":"2024-09-13T06:12:49.435817+0000","last_clean":"2024-09-13T06:12:49.435817+0000","last_became_active":"2024-09-13T06:09:34.118325+0000","last_became_peered":"2024-09-13T06:09:34.118325+0000","last_unstale":"2024-09-13T06:12:49.435817+0000","last_undegraded":"2024-09-13T06:12:49.435817+0000","last_fullsized":"2024-09-13T06:12:49.435817+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:29:20.078139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:19.629629+0000","last_change":"2024-09-13T06:09:32.144168+0000","last_active":"2024-09-13T06:10:19.629629+0000","last_peered":"2024-09-13T06:10:19.629629+0000","last_clean":"2024-09-13T06:10:19.629629+0000","last_became_active":"2024-09-13T06:09:32.133230+0000","last_became_peered":"2024-09-13T06:09:32.133230+0000","last_unstale":"2024-09-13T06:10:19.629629+0000","last_undegraded":"2024-09-13T06:10:19.629629+0000","last_fullsized":"2024-09-13T06:10:19.629629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:30:40.767524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"35'4","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.512979+0000","last_change":"2024-09-13T06:09:34.117053+0000","last_active":"2024-09-13T06:12:49.512979+0000","last_peered":"2024-09-13T06:12:49.512979+0000","last_clean":"2024-09-13T06:12:49.512979+0000","last_became_active":"2024-09-13T06:09:34.115512+0000","last_became_peered":"2024-09-13T06:09:34.115512+0000","last_unstale":"2024-09-13T06:12:49.512979+0000","last_undegraded":"2024-09-13T06:12:49.512979+0000","last_fullsized":"2024-09-13T06:12:49.512979+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:41:07.174428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:48.905752+0000","last_change":"2024-09-13T06:09:32.153571+0000","last_active":"2024-09-13T06:12:48.905752+0000","last_peered":"2024-09-13T06:12:48.905752+0000","last_clean":"2024-09-13T06:12:48.905752+0000","last_became_active":"2024-09-13T06:09:32.150328+0000","last_became_peered":"2024-09-13T06:09:32.150328+0000","last_unstale":"2024-09-13T06:12:48.905752+0000","last_undegraded":"2024-09-13T06:12:48.905752+0000","last_fullsized":"2024-09-13T06:12:48.905752+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:42:54.943685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"35'12","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.109084+0000","last_change":"2024-09-13T06:09:34.115843+0000","last_active":"2024-09-13T06:12:49.109084+0000","last_peered":"2024-09-13T06:12:49.109084+0000","last_clean":"2024-09-13T06:12:49.109084+0000","last_became_active":"2024-09-13T06:09:34.113986+0000","last_became_peered":"2024-09-13T06:09:34.113986+0000","last_unstale":"2024-09-13T06:12:49.109084+0000","last_undegraded":"2024-09-13T06:12:49.109084+0000","last_fullsized":"2024-09-13T06:12:49.109084+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:03:45.932431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.948985+0000","last_change":"2024-09-13T06:09:32.137258+0000","last_active":"2024-09-13T06:10:10.948985+0000","last_peered":"2024-09-13T06:10:10.948985+0000","last_clean":"2024-09-13T06:10:10.948985+0000","last_became_active":"2024-09-13T06:09:32.136268+0000","last_became_peered":"2024-09-13T06:09:32.136268+0000","last_unstale":"2024-09-13T06:10:10.948985+0000","last_undegraded":"2024-09-13T06:10:10.948985+0000","last_fullsized":"2024-09-13T06:10:10.948985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:42:07.291597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"35'4","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:43.519164+0000","last_change":"2024-09-13T06:09:34.124112+0000","last_active":"2024-09-13T06:11:43.519164+0000","last_peered":"2024-09-13T06:11:43.519164+0000","last_clean":"2024-09-13T06:11:43.519164+0000","last_became_active":"2024-09-13T06:09:34.121261+0000","last_became_peered":"2024-09-13T06:09:34.121261+0000","last_unstale":"2024-09-13T06:11:43.519164+0000","last_undegraded":"2024-09-13T06:11:43.519164+0000","last_fullsized":"2024-09-13T06:11:43.519164+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:29:20.327517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.818014+0000","last_change":"2024-09-13T06:09:32.142747+0000","last_active":"2024-09-13T06:10:10.818014+0000","last_peered":"2024-09-13T06:10:10.818014+0000","last_clean":"2024-09-13T06:10:10.818014+0000","last_became_active":"2024-09-13T06:09:32.141602+0000","last_became_peered":"2024-09-13T06:09:32.141602+0000","last_unstale":"2024-09-13T06:10:10.818014+0000","last_undegraded":"2024-09-13T06:10:10.818014+0000","last_fullsized":"2024-09-13T06:10:10.818014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:12:22.491041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"35'6","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.512979+0000","last_change":"2024-09-13T06:09:34.123392+0000","last_active":"2024-09-13T06:12:49.512979+0000","last_peered":"2024-09-13T06:12:49.512979+0000","last_clean":"2024-09-13T06:12:49.512979+0000","last_became_active":"2024-09-13T06:09:34.122424+0000","last_became_peered":"2024-09-13T06:09:34.122424+0000","last_unstale":"2024-09-13T06:12:49.512979+0000","last_undegraded":"2024-09-13T06:12:49.512979+0000","last_fullsized":"2024-09-13T06:12:49.512979+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:32:59.845317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.803937+0000","last_change":"2024-09-13T06:09:32.120069+0000","last_active":"2024-09-13T06:10:10.803937+0000","last_peered":"2024-09-13T06:10:10.803937+0000","last_clean":"2024-09-13T06:10:10.803937+0000","last_became_active":"2024-09-13T06:09:32.119665+0000","last_became_peered":"2024-09-13T06:09:32.119665+0000","last_unstale":"2024-09-13T06:10:10.803937+0000","last_undegraded":"2024-09-13T06:10:10.803937+0000","last_fullsized":"2024-09-13T06:10:10.803937+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:12:38.569078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"35'9","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.454353+0000","last_change":"2024-09-13T06:09:34.121479+0000","last_active":"2024-09-13T06:12:49.454353+0000","last_peered":"2024-09-13T06:12:49.454353+0000","last_clean":"2024-09-13T06:12:49.454353+0000","last_became_active":"2024-09-13T06:09:34.114378+0000","last_became_peered":"2024-09-13T06:09:34.114378+0000","last_unstale":"2024-09-13T06:12:49.454353+0000","last_undegraded":"2024-09-13T06:12:49.454353+0000","last_fullsized":"2024-09-13T06:12:49.454353+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:48:00.341088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"35'3","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:45.798306+0000","last_change":"2024-09-13T06:09:32.147166+0000","last_active":"2024-09-13T06:11:45.798306+0000","last_peered":"2024-09-13T06:11:45.798306+0000","last_clean":"2024-09-13T06:11:45.798306+0000","last_became_active":"2024-09-13T06:09:32.146011+0000","last_became_peered":"2024-09-13T06:09:32.146011+0000","last_unstale":"2024-09-13T06:11:45.798306+0000","last_undegraded":"2024-09-13T06:11:45.798306+0000","last_fullsized":"2024-09-13T06:11:45.798306+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:56:46.777275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668544,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":11,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"35'2","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:43.532529+0000","last_change":"2024-09-13T06:09:34.118796+0000","last_active":"2024-09-13T06:11:43.532529+0000","last_peered":"2024-09-13T06:11:43.532529+0000","last_clean":"2024-09-13T06:11:43.532529+0000","last_became_active":"2024-09-13T06:09:34.117659+0000","last_became_peered":"2024-09-13T06:09:34.117659+0000","last_unstale":"2024-09-13T06:11:43.532529+0000","last_undegraded":"2024-09-13T06:11:43.532529+0000","last_fullsized":"2024-09-13T06:11:43.532529+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:26:28.789376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:47.850255+0000","last_change":"2024-09-13T06:09:32.124201+0000","last_active":"2024-09-13T06:11:47.850255+0000","last_peered":"2024-09-13T06:11:47.850255+0000","last_clean":"2024-09-13T06:11:47.850255+0000","last_became_active":"2024-09-13T06:09:32.121250+0000","last_became_peered":"2024-09-13T06:09:32.121250+0000","last_unstale":"2024-09-13T06:11:47.850255+0000","last_undegraded":"2024-09-13T06:11:47.850255+0000","last_fullsized":"2024-09-13T06:11:47.850255+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:52:58.934306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"35'5","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:57.810848+0000","last_change":"2024-09-13T06:09:34.118552+0000","last_active":"2024-09-13T06:11:57.810848+0000","last_peered":"2024-09-13T06:11:57.810848+0000","last_clean":"2024-09-13T06:11:57.810848+0000","last_became_active":"2024-09-13T06:09:34.118270+0000","last_became_peered":"2024-09-13T06:09:34.118270+0000","last_unstale":"2024-09-13T06:11:57.810848+0000","last_undegraded":"2024-09-13T06:11:57.810848+0000","last_fullsized":"2024-09-13T06:11:57.810848+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:36:12.584267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:18.044995+0000","last_change":"2024-09-13T06:09:32.151004+0000","last_active":"2024-09-13T06:10:18.044995+0000","last_peered":"2024-09-13T06:10:18.044995+0000","last_clean":"2024-09-13T06:10:18.044995+0000","last_became_active":"2024-09-13T06:09:32.145988+0000","last_became_peered":"2024-09-13T06:09:32.145988+0000","last_unstale":"2024-09-13T06:10:18.044995+0000","last_undegraded":"2024-09-13T06:10:18.044995+0000","last_fullsized":"2024-09-13T06:10:18.044995+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:56:32.022947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"33'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.951431+0000","last_change":"2024-09-13T06:09:34.118753+0000","last_active":"2024-09-13T06:10:10.951431+0000","last_peered":"2024-09-13T06:10:10.951431+0000","last_clean":"2024-09-13T06:10:10.951431+0000","last_became_active":"2024-09-13T06:09:34.117320+0000","last_became_peered":"2024-09-13T06:09:34.117320+0000","last_unstale":"2024-09-13T06:10:10.951431+0000","last_undegraded":"2024-09-13T06:10:10.951431+0000","last_fullsized":"2024-09-13T06:10:10.951431+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:09:45.564486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"35'1","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:47.803012+0000","last_change":"2024-09-13T06:09:32.141516+0000","last_active":"2024-09-13T06:11:47.803012+0000","last_peered":"2024-09-13T06:11:47.803012+0000","last_clean":"2024-09-13T06:11:47.803012+0000","last_became_active":"2024-09-13T06:09:32.141009+0000","last_became_peered":"2024-09-13T06:09:32.141009+0000","last_unstale":"2024-09-13T06:11:47.803012+0000","last_undegraded":"2024-09-13T06:11:47.803012+0000","last_fullsized":"2024-09-13T06:11:47.803012+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:33:27.853475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"35'12","reported_seq":82,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.436923+0000","last_change":"2024-09-13T06:09:34.124580+0000","last_active":"2024-09-13T06:12:49.436923+0000","last_peered":"2024-09-13T06:12:49.436923+0000","last_clean":"2024-09-13T06:12:49.436923+0000","last_became_active":"2024-09-13T06:09:34.124270+0000","last_became_peered":"2024-09-13T06:09:34.124270+0000","last_unstale":"2024-09-13T06:12:49.436923+0000","last_undegraded":"2024-09-13T06:12:49.436923+0000","last_fullsized":"2024-09-13T06:12:49.436923+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:54:14.588264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:47.918751+0000","last_change":"2024-09-13T06:09:32.143000+0000","last_active":"2024-09-13T06:11:47.918751+0000","last_peered":"2024-09-13T06:11:47.918751+0000","last_clean":"2024-09-13T06:11:47.918751+0000","last_became_active":"2024-09-13T06:09:32.142581+0000","last_became_peered":"2024-09-13T06:09:32.142581+0000","last_unstale":"2024-09-13T06:11:47.918751+0000","last_undegraded":"2024-09-13T06:11:47.918751+0000","last_fullsized":"2024-09-13T06:11:47.918751+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:04:11.910433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"35'16","reported_seq":76,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.437303+0000","last_change":"2024-09-13T06:09:34.118681+0000","last_active":"2024-09-13T06:12:49.437303+0000","last_peered":"2024-09-13T06:12:49.437303+0000","last_clean":"2024-09-13T06:12:49.437303+0000","last_became_active":"2024-09-13T06:09:34.118290+0000","last_became_peered":"2024-09-13T06:09:34.118290+0000","last_unstale":"2024-09-13T06:12:49.437303+0000","last_undegraded":"2024-09-13T06:12:49.437303+0000","last_fullsized":"2024-09-13T06:12:49.437303+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:00:27.052532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":58,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.809957+0000","last_change":"2024-09-13T06:09:32.124596+0000","last_active":"2024-09-13T06:10:10.809957+0000","last_peered":"2024-09-13T06:10:10.809957+0000","last_clean":"2024-09-13T06:10:10.809957+0000","last_became_active":"2024-09-13T06:09:32.121400+0000","last_became_peered":"2024-09-13T06:09:32.121400+0000","last_unstale":"2024-09-13T06:10:10.809957+0000","last_undegraded":"2024-09-13T06:10:10.809957+0000","last_fullsized":"2024-09-13T06:10:10.809957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:19:33.910739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"35'13","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.533331+0000","last_change":"2024-09-13T06:09:34.124551+0000","last_active":"2024-09-13T06:12:49.533331+0000","last_peered":"2024-09-13T06:12:49.533331+0000","last_clean":"2024-09-13T06:12:49.533331+0000","last_became_active":"2024-09-13T06:09:34.121743+0000","last_became_peered":"2024-09-13T06:09:34.121743+0000","last_unstale":"2024-09-13T06:12:49.533331+0000","last_undegraded":"2024-09-13T06:12:49.533331+0000","last_fullsized":"2024-09-13T06:12:49.533331+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:34:44.658759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.291785+0000","last_change":"2024-09-13T06:09:32.135724+0000","last_active":"2024-09-13T06:12:49.291785+0000","last_peered":"2024-09-13T06:12:49.291785+0000","last_clean":"2024-09-13T06:12:49.291785+0000","last_became_active":"2024-09-13T06:09:32.127830+0000","last_became_peered":"2024-09-13T06:09:32.127830+0000","last_unstale":"2024-09-13T06:12:49.291785+0000","last_undegraded":"2024-09-13T06:12:49.291785+0000","last_fullsized":"2024-09-13T06:12:49.291785+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:27:43.484419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"35'4","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:19.300831+0000","last_change":"2024-09-13T06:09:34.126475+0000","last_active":"2024-09-13T06:10:19.300831+0000","last_peered":"2024-09-13T06:10:19.300831+0000","last_clean":"2024-09-13T06:10:19.300831+0000","last_became_active":"2024-09-13T06:09:34.126020+0000","last_became_peered":"2024-09-13T06:09:34.126020+0000","last_unstale":"2024-09-13T06:10:19.300831+0000","last_undegraded":"2024-09-13T06:10:19.300831+0000","last_fullsized":"2024-09-13T06:10:19.300831+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:44:39.157280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"35'1","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:51.799858+0000","last_change":"2024-09-13T06:09:32.119928+0000","last_active":"2024-09-13T06:11:51.799858+0000","last_peered":"2024-09-13T06:11:51.799858+0000","last_clean":"2024-09-13T06:11:51.799858+0000","last_became_active":"2024-09-13T06:09:32.119542+0000","last_became_peered":"2024-09-13T06:09:32.119542+0000","last_unstale":"2024-09-13T06:11:51.799858+0000","last_undegraded":"2024-09-13T06:11:51.799858+0000","last_fullsized":"2024-09-13T06:11:51.799858+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:55:55.407168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"35'6","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.513282+0000","last_change":"2024-09-13T06:09:34.118722+0000","last_active":"2024-09-13T06:12:49.513282+0000","last_peered":"2024-09-13T06:12:49.513282+0000","last_clean":"2024-09-13T06:12:49.513282+0000","last_became_active":"2024-09-13T06:09:34.110506+0000","last_became_peered":"2024-09-13T06:09:34.110506+0000","last_unstale":"2024-09-13T06:12:49.513282+0000","last_undegraded":"2024-09-13T06:12:49.513282+0000","last_fullsized":"2024-09-13T06:12:49.513282+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:22:27.348511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.818133+0000","last_change":"2024-09-13T06:09:32.130216+0000","last_active":"2024-09-13T06:10:10.818133+0000","last_peered":"2024-09-13T06:10:10.818133+0000","last_clean":"2024-09-13T06:10:10.818133+0000","last_became_active":"2024-09-13T06:09:32.121895+0000","last_became_peered":"2024-09-13T06:09:32.121895+0000","last_unstale":"2024-09-13T06:10:10.818133+0000","last_undegraded":"2024-09-13T06:10:10.818133+0000","last_fullsized":"2024-09-13T06:10:10.818133+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:31:54.248100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.802008+0000","last_change":"2024-09-13T06:09:32.132716+0000","last_active":"2024-09-13T06:10:10.802008+0000","last_peered":"2024-09-13T06:10:10.802008+0000","last_clean":"2024-09-13T06:10:10.802008+0000","last_became_active":"2024-09-13T06:09:32.130056+0000","last_became_peered":"2024-09-13T06:09:32.130056+0000","last_unstale":"2024-09-13T06:10:10.802008+0000","last_undegraded":"2024-09-13T06:10:10.802008+0000","last_fullsized":"2024-09-13T06:10:10.802008+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:57:09.275474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"35'8","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:48.958693+0000","last_change":"2024-09-13T06:09:34.132050+0000","last_active":"2024-09-13T06:12:48.958693+0000","last_peered":"2024-09-13T06:12:48.958693+0000","last_clean":"2024-09-13T06:12:48.958693+0000","last_became_active":"2024-09-13T06:09:34.130980+0000","last_became_peered":"2024-09-13T06:09:34.130980+0000","last_unstale":"2024-09-13T06:12:48.958693+0000","last_undegraded":"2024-09-13T06:12:48.958693+0000","last_fullsized":"2024-09-13T06:12:48.958693+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:11:30.370585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"33'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.944159+0000","last_change":"2024-09-13T06:09:32.152088+0000","last_active":"2024-09-13T06:10:10.944159+0000","last_peered":"2024-09-13T06:10:10.944159+0000","last_clean":"2024-09-13T06:10:10.944159+0000","last_became_active":"2024-09-13T06:09:32.149426+0000","last_became_peered":"2024-09-13T06:09:32.149426+0000","last_unstale":"2024-09-13T06:10:10.944159+0000","last_undegraded":"2024-09-13T06:10:10.944159+0000","last_fullsized":"2024-09-13T06:10:10.944159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:53:16.188364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"35'3","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:02.807090+0000","last_change":"2024-09-13T06:09:34.118994+0000","last_active":"2024-09-13T06:12:02.807090+0000","last_peered":"2024-09-13T06:12:02.807090+0000","last_clean":"2024-09-13T06:12:02.807090+0000","last_became_active":"2024-09-13T06:09:34.111230+0000","last_became_peered":"2024-09-13T06:09:34.111230+0000","last_unstale":"2024-09-13T06:12:02.807090+0000","last_undegraded":"2024-09-13T06:12:02.807090+0000","last_fullsized":"2024-09-13T06:12:02.807090+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:48:17.434872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13384,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1618,"num_read_kb":1508,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25809792,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":34422784,"data_stored":34422784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640309,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48392,"kb_used_data":8888,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323448,"statfs":{"total":96636764160,"available":96587210752,"internally_reserved":0,"allocated":9101312,"data_stored":8762833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640309,"num_pgs":155,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44772,"kb_used_data":9428,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327068,"statfs":{"total":96636764160,"available":96590917632,"internally_reserved":0,"allocated":9654272,"data_stored":9351111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673013,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48904,"kb_used_data":9400,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94322936,"statfs":{"total":96636764160,"available":96586686464,"internally_reserved":0,"allocated":9625600,"data_stored":9349057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705714,"num_pgs":170,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48356,"kb_used_data":8852,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323484,"statfs":{"total":96636764160,"available":96587247616,"internally_reserved":0,"allocated":9064448,"data_stored":8760119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T06:13:21.840 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-13T06:13:21.840 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T06:13:21.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.988+0000 7f19d27d7640 1 Processor -- start 2024-09-13T06:13:21.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.988+0000 7f19d27d7640 1 -- start start 2024-09-13T06:13:21.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.992+0000 7f19d27d7640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f19cc06d0e0 0x7f19cc06d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:13:21.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.992+0000 7f19d27d7640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19cc071c10 con 0x7f19cc06da00 2024-09-13T06:13:21.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.992+0000 7f19d27d7640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f19cc072230 con 0x7f19cc06d0e0 2024-09-13T06:13:21.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.992+0000 7f19cbfff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f19cc06d0e0 0x7f19cc06d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:13:21.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.992+0000 7f19cb7fe640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f19cc06da00 0x7f19cc12ca10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:34304/0 (socket says 172.21.15.120:34304) 2024-09-13T06:13:21.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.992+0000 7f19cb7fe640 1 -- 172.21.15.120:0/3280819363 learned_addr learned my addr 172.21.15.120:0/3280819363 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-13T06:13:21.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.992+0000 7f19caffd640 1 -- 172.21.15.120:0/3280819363 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2154224613 0 0) 0x7f19cc071c10 con 0x7f19cc06da00 2024-09-13T06:13:21.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.992+0000 7f19caffd640 1 -- 172.21.15.120:0/3280819363 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f19b8003530 con 0x7f19cc06da00 2024-09-13T06:13:21.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.992+0000 7f19cbfff640 1 -- 172.21.15.120:0/3280819363 >> v1:172.21.15.120:6789/0 conn(0x7f19cc06da00 legacy=0x7f19cc12ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:21.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.992+0000 7f19cbfff640 1 -- 172.21.15.120:0/3280819363 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19cc0709e0 con 0x7f19cc06d0e0 2024-09-13T06:13:21.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.992+0000 7f19cbfff640 1 --2- 172.21.15.120:0/3280819363 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f19cc06d0e0 0x7f19cc06d4c0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f19c4009d90 tx=0x7f19c401c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=248a3dc8cd941e3c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:13:21.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.992+0000 7f19caffd640 1 -- 172.21.15.120:0/3280819363 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19c40a6560 con 0x7f19cc06d0e0 2024-09-13T06:13:21.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.992+0000 7f19caffd640 1 -- 172.21.15.120:0/3280819363 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19c40a6700 con 0x7f19cc06d0e0 2024-09-13T06:13:21.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.992+0000 7f19caffd640 1 -- 172.21.15.120:0/3280819363 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19c40a6a00 con 0x7f19cc06d0e0 2024-09-13T06:13:21.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.992+0000 7f19d27d7640 1 -- 172.21.15.120:0/3280819363 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f19cc06d0e0 msgr2=0x7f19cc06d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:21.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.992+0000 7f19d27d7640 1 --2- 172.21.15.120:0/3280819363 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f19cc06d0e0 0x7f19cc06d4c0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f19c4009d90 tx=0x7f19c401c8c0 comp rx=0 tx=0).stop 2024-09-13T06:13:21.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.992+0000 7f19d27d7640 1 -- 172.21.15.120:0/3280819363 shutdown_connections 2024-09-13T06:13:21.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.992+0000 7f19d27d7640 1 --2- 172.21.15.120:0/3280819363 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f19cc06d0e0 0x7f19cc06d4c0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:13:21.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.992+0000 7f19d27d7640 1 -- 172.21.15.120:0/3280819363 >> 172.21.15.120:0/3280819363 conn(0x7f19cc099a50 msgr2=0x7f19cc0972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:13:21.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.992+0000 7f19d27d7640 1 -- 172.21.15.120:0/3280819363 shutdown_connections 2024-09-13T06:13:21.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.992+0000 7f19d27d7640 1 -- 172.21.15.120:0/3280819363 wait complete. 2024-09-13T06:13:21.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.996+0000 7f19d27d7640 1 Processor -- start 2024-09-13T06:13:21.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.996+0000 7f19d27d7640 1 -- start start 2024-09-13T06:13:21.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.996+0000 7f19d27d7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f19cc06d0e0 0x7f19cc127980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:13:21.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.996+0000 7f19d27d7640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f19cc134e80 con 0x7f19cc06d0e0 2024-09-13T06:13:21.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.996+0000 7f19cbfff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f19cc06d0e0 0x7f19cc127980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:13:21.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.996+0000 7f19cbfff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f19cc06d0e0 0x7f19cc127980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:42796/0 (socket says 172.21.15.120:42796) 2024-09-13T06:13:21.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.996+0000 7f19cbfff640 1 -- 172.21.15.120:0/2883627817 learned_addr learned my addr 172.21.15.120:0/2883627817 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-13T06:13:21.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.996+0000 7f19cbfff640 1 -- 172.21.15.120:0/2883627817 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19cc072710 con 0x7f19cc06d0e0 2024-09-13T06:13:21.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.996+0000 7f19cbfff640 1 --2- 172.21.15.120:0/2883627817 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f19cc06d0e0 0x7f19cc127980 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f19c401a4f0 tx=0x7f19c4019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:13:21.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.996+0000 7f19c8ff9640 1 -- 172.21.15.120:0/2883627817 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19c40a7410 con 0x7f19cc06d0e0 2024-09-13T06:13:21.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.996+0000 7f19c8ff9640 1 -- 172.21.15.120:0/2883627817 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19c40a75b0 con 0x7f19cc06d0e0 2024-09-13T06:13:21.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.996+0000 7f19d27d7640 1 -- 172.21.15.120:0/2883627817 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19cc129ed0 con 0x7f19cc06d0e0 2024-09-13T06:13:21.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.996+0000 7f19c8ff9640 1 -- 172.21.15.120:0/2883627817 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19c40a78d0 con 0x7f19cc06d0e0 2024-09-13T06:13:21.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.996+0000 7f19d27d7640 1 -- 172.21.15.120:0/2883627817 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19cc12a560 con 0x7f19cc06d0e0 2024-09-13T06:13:21.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.996+0000 7f19c8ff9640 1 -- 172.21.15.120:0/2883627817 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f19c40c1030 con 0x7f19cc06d0e0 2024-09-13T06:13:21.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.996+0000 7f19d27d7640 1 -- 172.21.15.120:0/2883627817 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19cc06d4c0 con 0x7f19cc06d0e0 2024-09-13T06:13:21.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.996+0000 7f19c8ff9640 1 --2- 172.21.15.120:0/2883627817 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f19ac035db0 0x7f19ac038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:13:21.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.996+0000 7f19c8ff9640 1 -- 172.21.15.120:0/2883627817 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f19c40bf070 con 0x7f19cc06d0e0 2024-09-13T06:13:22.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.996+0000 7f19cb7fe640 1 --2- 172.21.15.120:0/2883627817 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f19ac035db0 0x7f19ac038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:13:22.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:21.996+0000 7f19cb7fe640 1 --2- 172.21.15.120:0/2883627817 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f19ac035db0 0x7f19ac038270 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f19b4007fd0 tx=0x7f19b4007980 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:13:22.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:22.000+0000 7f19c8ff9640 1 -- 172.21.15.120:0/2883627817 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f19c40c8020 con 0x7f19cc06d0e0 2024-09-13T06:13:22.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:22.160+0000 7f19d27d7640 1 -- 172.21.15.120:0/2883627817 --> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f19cc129260 con 0x7f19ac035db0 2024-09-13T06:13:22.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:22.208+0000 7f19c8ff9640 1 -- 172.21.15.120:0/2883627817 <== mgr.4100 v2:172.21.15.194:6824/3475680902 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666048 (secure 0 0 0) 0x7f19cc129260 con 0x7f19ac035db0 2024-09-13T06:13:22.216 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T06:13:22.222 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-09-13T06:13:22.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:22.216+0000 7f19d27d7640 1 -- 172.21.15.120:0/2883627817 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f19ac035db0 msgr2=0x7f19ac038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:22.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:22.216+0000 7f19d27d7640 1 --2- 172.21.15.120:0/2883627817 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f19ac035db0 0x7f19ac038270 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f19b4007fd0 tx=0x7f19b4007980 comp rx=0 tx=0).stop 2024-09-13T06:13:22.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:22.216+0000 7f19d27d7640 1 -- 172.21.15.120:0/2883627817 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f19cc06d0e0 msgr2=0x7f19cc127980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:22.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:22.216+0000 7f19d27d7640 1 --2- 172.21.15.120:0/2883627817 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f19cc06d0e0 0x7f19cc127980 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f19c401a4f0 tx=0x7f19c4019660 comp rx=0 tx=0).stop 2024-09-13T06:13:22.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:22.216+0000 7f19d27d7640 1 -- 172.21.15.120:0/2883627817 shutdown_connections 2024-09-13T06:13:22.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:22.216+0000 7f19d27d7640 1 --2- 172.21.15.120:0/2883627817 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f19ac035db0 0x7f19ac038270 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:13:22.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:22.216+0000 7f19d27d7640 1 --2- 172.21.15.120:0/2883627817 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f19cc06d0e0 0x7f19cc127980 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:13:22.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:22.216+0000 7f19d27d7640 1 -- 172.21.15.120:0/2883627817 >> 172.21.15.120:0/2883627817 conn(0x7f19cc099a50 msgr2=0x7f19cc131c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:13:22.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:22.216+0000 7f19d27d7640 1 -- 172.21.15.120:0/2883627817 shutdown_connections 2024-09-13T06:13:22.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:22.216+0000 7f19d27d7640 1 -- 172.21.15.120:0/2883627817 wait complete. 2024-09-13T06:13:22.234 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":155,"stamp":"2024-09-13T06:13:21.818354+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26416904,"num_objects":229,"num_object_clones":0,"num_object_copies":472,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":229,"num_whiteouts":0,"num_read":4905,"num_read_kb":4482,"num_write":2112,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4497,"ondisk_log_size":4497,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":190424,"kb_used_data":36568,"kb_used_omap":6,"kb_used_meta":153785,"kb_avail":377296936,"statfs":{"total":386547056640,"available":386352062464,"internally_reserved":0,"allocated":37445632,"data_stored":36223120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":157476630},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006765"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.802800+0000","last_change":"2024-09-13T06:09:32.142010+0000","last_active":"2024-09-13T06:10:10.802800+0000","last_peered":"2024-09-13T06:10:10.802800+0000","last_clean":"2024-09-13T06:10:10.802800+0000","last_became_active":"2024-09-13T06:09:32.140025+0000","last_became_peered":"2024-09-13T06:09:32.140025+0000","last_unstale":"2024-09-13T06:10:10.802800+0000","last_undegraded":"2024-09-13T06:10:10.802800+0000","last_fullsized":"2024-09-13T06:10:10.802800+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:15:48.717644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"35'22","reported_seq":94,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.323141+0000","last_change":"2024-09-13T06:09:34.126675+0000","last_active":"2024-09-13T06:12:49.323141+0000","last_peered":"2024-09-13T06:12:49.323141+0000","last_clean":"2024-09-13T06:12:49.323141+0000","last_became_active":"2024-09-13T06:09:34.122656+0000","last_became_peered":"2024-09-13T06:09:34.122656+0000","last_unstale":"2024-09-13T06:12:49.323141+0000","last_undegraded":"2024-09-13T06:12:49.323141+0000","last_fullsized":"2024-09-13T06:12:49.323141+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:04:23.927249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":88,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:18.044019+0000","last_change":"2024-09-13T06:09:32.135771+0000","last_active":"2024-09-13T06:10:18.044019+0000","last_peered":"2024-09-13T06:10:18.044019+0000","last_clean":"2024-09-13T06:10:18.044019+0000","last_became_active":"2024-09-13T06:09:32.134020+0000","last_became_peered":"2024-09-13T06:09:32.134020+0000","last_unstale":"2024-09-13T06:10:18.044019+0000","last_undegraded":"2024-09-13T06:10:18.044019+0000","last_fullsized":"2024-09-13T06:10:18.044019+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:24:08.865544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"35'4","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:02.877682+0000","last_change":"2024-09-13T06:09:34.117071+0000","last_active":"2024-09-13T06:11:02.877682+0000","last_peered":"2024-09-13T06:11:02.877682+0000","last_clean":"2024-09-13T06:11:02.877682+0000","last_became_active":"2024-09-13T06:09:34.116715+0000","last_became_peered":"2024-09-13T06:09:34.116715+0000","last_unstale":"2024-09-13T06:11:02.877682+0000","last_undegraded":"2024-09-13T06:11:02.877682+0000","last_fullsized":"2024-09-13T06:11:02.877682+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:06:01.417735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.813339+0000","last_change":"2024-09-13T06:09:32.130525+0000","last_active":"2024-09-13T06:10:10.813339+0000","last_peered":"2024-09-13T06:10:10.813339+0000","last_clean":"2024-09-13T06:10:10.813339+0000","last_became_active":"2024-09-13T06:09:32.116345+0000","last_became_peered":"2024-09-13T06:09:32.116345+0000","last_unstale":"2024-09-13T06:10:10.813339+0000","last_undegraded":"2024-09-13T06:10:10.813339+0000","last_fullsized":"2024-09-13T06:10:10.813339+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:47:58.332268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.805435+0000","last_change":"2024-09-13T06:09:34.118858+0000","last_active":"2024-09-13T06:10:10.805435+0000","last_peered":"2024-09-13T06:10:10.805435+0000","last_clean":"2024-09-13T06:10:10.805435+0000","last_became_active":"2024-09-13T06:09:34.117940+0000","last_became_peered":"2024-09-13T06:09:34.117940+0000","last_unstale":"2024-09-13T06:10:10.805435+0000","last_undegraded":"2024-09-13T06:10:10.805435+0000","last_fullsized":"2024-09-13T06:10:10.805435+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:31:13.005586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"35'4","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.308971+0000","last_change":"2024-09-13T06:09:32.120391+0000","last_active":"2024-09-13T06:12:49.308971+0000","last_peered":"2024-09-13T06:12:49.308971+0000","last_clean":"2024-09-13T06:12:49.308971+0000","last_became_active":"2024-09-13T06:09:32.119806+0000","last_became_peered":"2024-09-13T06:09:32.119806+0000","last_unstale":"2024-09-13T06:12:49.308971+0000","last_undegraded":"2024-09-13T06:12:49.308971+0000","last_fullsized":"2024-09-13T06:12:49.308971+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:16:11.746030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"35'4","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.110973+0000","last_change":"2024-09-13T06:09:34.123442+0000","last_active":"2024-09-13T06:12:49.110973+0000","last_peered":"2024-09-13T06:12:49.110973+0000","last_clean":"2024-09-13T06:12:49.110973+0000","last_became_active":"2024-09-13T06:09:34.122631+0000","last_became_peered":"2024-09-13T06:09:34.122631+0000","last_unstale":"2024-09-13T06:12:49.110973+0000","last_undegraded":"2024-09-13T06:12:49.110973+0000","last_fullsized":"2024-09-13T06:12:49.110973+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:05:27.025085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:18.043979+0000","last_change":"2024-09-13T06:09:32.129860+0000","last_active":"2024-09-13T06:10:18.043979+0000","last_peered":"2024-09-13T06:10:18.043979+0000","last_clean":"2024-09-13T06:10:18.043979+0000","last_became_active":"2024-09-13T06:09:32.121803+0000","last_became_peered":"2024-09-13T06:09:32.121803+0000","last_unstale":"2024-09-13T06:10:18.043979+0000","last_undegraded":"2024-09-13T06:10:18.043979+0000","last_fullsized":"2024-09-13T06:10:18.043979+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:35:53.036270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"35'4","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.112548+0000","last_change":"2024-09-13T06:09:34.127392+0000","last_active":"2024-09-13T06:12:49.112548+0000","last_peered":"2024-09-13T06:12:49.112548+0000","last_clean":"2024-09-13T06:12:49.112548+0000","last_became_active":"2024-09-13T06:09:34.124728+0000","last_became_peered":"2024-09-13T06:09:34.124728+0000","last_unstale":"2024-09-13T06:12:49.112548+0000","last_undegraded":"2024-09-13T06:12:49.112548+0000","last_fullsized":"2024-09-13T06:12:49.112548+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:16:25.577037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.300520+0000","last_change":"2024-09-13T06:09:32.117055+0000","last_active":"2024-09-13T06:12:49.300520+0000","last_peered":"2024-09-13T06:12:49.300520+0000","last_clean":"2024-09-13T06:12:49.300520+0000","last_became_active":"2024-09-13T06:09:32.116422+0000","last_became_peered":"2024-09-13T06:09:32.116422+0000","last_unstale":"2024-09-13T06:12:49.300520+0000","last_undegraded":"2024-09-13T06:12:49.300520+0000","last_fullsized":"2024-09-13T06:12:49.300520+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:42:30.526894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"35'4","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.513278+0000","last_change":"2024-09-13T06:10:10.823960+0000","last_active":"2024-09-13T06:12:49.513278+0000","last_peered":"2024-09-13T06:12:49.513278+0000","last_clean":"2024-09-13T06:12:49.513278+0000","last_became_active":"2024-09-13T06:10:10.810259+0000","last_became_peered":"2024-09-13T06:10:10.810259+0000","last_unstale":"2024-09-13T06:12:49.513278+0000","last_undegraded":"2024-09-13T06:12:49.513278+0000","last_fullsized":"2024-09-13T06:12:49.513278+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:20:38.364042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"35'4","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:19.634736+0000","last_change":"2024-09-13T06:09:32.130200+0000","last_active":"2024-09-13T06:10:19.634736+0000","last_peered":"2024-09-13T06:10:19.634736+0000","last_clean":"2024-09-13T06:10:19.634736+0000","last_became_active":"2024-09-13T06:09:32.122126+0000","last_became_peered":"2024-09-13T06:09:32.122126+0000","last_unstale":"2024-09-13T06:10:19.634736+0000","last_undegraded":"2024-09-13T06:10:19.634736+0000","last_fullsized":"2024-09-13T06:10:19.634736+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:26:21.113764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"35'10","reported_seq":59,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.436094+0000","last_change":"2024-09-13T06:09:34.120695+0000","last_active":"2024-09-13T06:12:49.436094+0000","last_peered":"2024-09-13T06:12:49.436094+0000","last_clean":"2024-09-13T06:12:49.436094+0000","last_became_active":"2024-09-13T06:09:34.120349+0000","last_became_peered":"2024-09-13T06:09:34.120349+0000","last_unstale":"2024-09-13T06:12:49.436094+0000","last_undegraded":"2024-09-13T06:12:49.436094+0000","last_fullsized":"2024-09-13T06:12:49.436094+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:11:30.370585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.943818+0000","last_change":"2024-09-13T06:09:32.149245+0000","last_active":"2024-09-13T06:10:10.943818+0000","last_peered":"2024-09-13T06:10:10.943818+0000","last_clean":"2024-09-13T06:10:10.943818+0000","last_became_active":"2024-09-13T06:09:32.147504+0000","last_became_peered":"2024-09-13T06:09:32.147504+0000","last_unstale":"2024-09-13T06:10:10.943818+0000","last_undegraded":"2024-09-13T06:10:10.943818+0000","last_fullsized":"2024-09-13T06:10:10.943818+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:06:35.186829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"35'9","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:41.798014+0000","last_change":"2024-09-13T06:09:34.104380+0000","last_active":"2024-09-13T06:11:41.798014+0000","last_peered":"2024-09-13T06:11:41.798014+0000","last_clean":"2024-09-13T06:11:41.798014+0000","last_became_active":"2024-09-13T06:09:34.104043+0000","last_became_peered":"2024-09-13T06:09:34.104043+0000","last_unstale":"2024-09-13T06:11:41.798014+0000","last_undegraded":"2024-09-13T06:11:41.798014+0000","last_fullsized":"2024-09-13T06:11:41.798014+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:57:58.370368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"35'4","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.513237+0000","last_change":"2024-09-13T06:09:34.116800+0000","last_active":"2024-09-13T06:12:49.513237+0000","last_peered":"2024-09-13T06:12:49.513237+0000","last_clean":"2024-09-13T06:12:49.513237+0000","last_became_active":"2024-09-13T06:09:34.116359+0000","last_became_peered":"2024-09-13T06:09:34.116359+0000","last_unstale":"2024-09-13T06:12:49.513237+0000","last_undegraded":"2024-09-13T06:12:49.513237+0000","last_fullsized":"2024-09-13T06:12:49.513237+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:45:39.768477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.282953+0000","last_change":"2024-09-13T06:09:32.135469+0000","last_active":"2024-09-13T06:12:49.282953+0000","last_peered":"2024-09-13T06:12:49.282953+0000","last_clean":"2024-09-13T06:12:49.282953+0000","last_became_active":"2024-09-13T06:09:32.134667+0000","last_became_peered":"2024-09-13T06:09:32.134667+0000","last_unstale":"2024-09-13T06:12:49.282953+0000","last_undegraded":"2024-09-13T06:12:49.282953+0000","last_fullsized":"2024-09-13T06:12:49.282953+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:48:22.672562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"35'18","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.437837+0000","last_change":"2024-09-13T06:09:34.118112+0000","last_active":"2024-09-13T06:12:49.437837+0000","last_peered":"2024-09-13T06:12:49.437837+0000","last_clean":"2024-09-13T06:12:49.437837+0000","last_became_active":"2024-09-13T06:09:34.115348+0000","last_became_peered":"2024-09-13T06:09:34.115348+0000","last_unstale":"2024-09-13T06:12:49.437837+0000","last_undegraded":"2024-09-13T06:12:49.437837+0000","last_fullsized":"2024-09-13T06:12:49.437837+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:27:45.493240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":45,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.804770+0000","last_change":"2024-09-13T06:09:32.137039+0000","last_active":"2024-09-13T06:10:10.804770+0000","last_peered":"2024-09-13T06:10:10.804770+0000","last_clean":"2024-09-13T06:10:10.804770+0000","last_became_active":"2024-09-13T06:09:32.135460+0000","last_became_peered":"2024-09-13T06:09:32.135460+0000","last_unstale":"2024-09-13T06:10:10.804770+0000","last_undegraded":"2024-09-13T06:10:10.804770+0000","last_fullsized":"2024-09-13T06:10:10.804770+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:11:15.868187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"35'2","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:19.300519+0000","last_change":"2024-09-13T06:09:34.115425+0000","last_active":"2024-09-13T06:10:19.300519+0000","last_peered":"2024-09-13T06:10:19.300519+0000","last_clean":"2024-09-13T06:10:19.300519+0000","last_became_active":"2024-09-13T06:09:34.115047+0000","last_became_peered":"2024-09-13T06:09:34.115047+0000","last_unstale":"2024-09-13T06:10:19.300519+0000","last_undegraded":"2024-09-13T06:10:19.300519+0000","last_fullsized":"2024-09-13T06:10:19.300519+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:46:23.635958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:18.040942+0000","last_change":"2024-09-13T06:09:32.143123+0000","last_active":"2024-09-13T06:10:18.040942+0000","last_peered":"2024-09-13T06:10:18.040942+0000","last_clean":"2024-09-13T06:10:18.040942+0000","last_became_active":"2024-09-13T06:09:32.141166+0000","last_became_peered":"2024-09-13T06:09:32.141166+0000","last_unstale":"2024-09-13T06:10:18.040942+0000","last_undegraded":"2024-09-13T06:10:18.040942+0000","last_fullsized":"2024-09-13T06:10:18.040942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:03:45.423034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"35'4","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.435819+0000","last_change":"2024-09-13T06:09:34.116108+0000","last_active":"2024-09-13T06:12:49.435819+0000","last_peered":"2024-09-13T06:12:49.435819+0000","last_clean":"2024-09-13T06:12:49.435819+0000","last_became_active":"2024-09-13T06:09:34.114242+0000","last_became_peered":"2024-09-13T06:09:34.114242+0000","last_unstale":"2024-09-13T06:12:49.435819+0000","last_undegraded":"2024-09-13T06:12:49.435819+0000","last_fullsized":"2024-09-13T06:12:49.435819+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:51:17.686447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.816928+0000","last_change":"2024-09-13T06:09:32.144134+0000","last_active":"2024-09-13T06:10:10.816928+0000","last_peered":"2024-09-13T06:10:10.816928+0000","last_clean":"2024-09-13T06:10:10.816928+0000","last_became_active":"2024-09-13T06:09:32.143746+0000","last_became_peered":"2024-09-13T06:09:32.143746+0000","last_unstale":"2024-09-13T06:10:10.816928+0000","last_undegraded":"2024-09-13T06:10:10.816928+0000","last_fullsized":"2024-09-13T06:10:10.816928+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:37:03.391739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"35'8","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.532750+0000","last_change":"2024-09-13T06:09:34.101552+0000","last_active":"2024-09-13T06:12:49.532750+0000","last_peered":"2024-09-13T06:12:49.532750+0000","last_clean":"2024-09-13T06:12:49.532750+0000","last_became_active":"2024-09-13T06:09:34.101167+0000","last_became_peered":"2024-09-13T06:09:34.101167+0000","last_unstale":"2024-09-13T06:12:49.532750+0000","last_undegraded":"2024-09-13T06:12:49.532750+0000","last_fullsized":"2024-09-13T06:12:49.532750+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:16:44.971572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.950455+0000","last_change":"2024-09-13T06:09:32.153552+0000","last_active":"2024-09-13T06:10:10.950455+0000","last_peered":"2024-09-13T06:10:10.950455+0000","last_clean":"2024-09-13T06:10:10.950455+0000","last_became_active":"2024-09-13T06:09:32.149885+0000","last_became_peered":"2024-09-13T06:09:32.149885+0000","last_unstale":"2024-09-13T06:10:10.950455+0000","last_undegraded":"2024-09-13T06:10:10.950455+0000","last_fullsized":"2024-09-13T06:10:10.950455+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:11:15.868187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"35'14","reported_seq":65,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.436750+0000","last_change":"2024-09-13T06:09:34.127656+0000","last_active":"2024-09-13T06:12:49.436750+0000","last_peered":"2024-09-13T06:12:49.436750+0000","last_clean":"2024-09-13T06:12:49.436750+0000","last_became_active":"2024-09-13T06:09:34.124299+0000","last_became_peered":"2024-09-13T06:09:34.124299+0000","last_unstale":"2024-09-13T06:12:49.436750+0000","last_undegraded":"2024-09-13T06:12:49.436750+0000","last_fullsized":"2024-09-13T06:12:49.436750+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:33:59.661744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.804400+0000","last_change":"2024-09-13T06:09:32.141692+0000","last_active":"2024-09-13T06:10:10.804400+0000","last_peered":"2024-09-13T06:10:10.804400+0000","last_clean":"2024-09-13T06:10:10.804400+0000","last_became_active":"2024-09-13T06:09:32.128376+0000","last_became_peered":"2024-09-13T06:09:32.128376+0000","last_unstale":"2024-09-13T06:10:10.804400+0000","last_undegraded":"2024-09-13T06:10:10.804400+0000","last_fullsized":"2024-09-13T06:10:10.804400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:45:45.430627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"35'43","reported_seq":124,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.385246+0000","last_change":"2024-09-13T06:09:42.187344+0000","last_active":"2024-09-13T06:12:49.385246+0000","last_peered":"2024-09-13T06:12:49.385246+0000","last_clean":"2024-09-13T06:12:49.385246+0000","last_became_active":"2024-09-13T06:09:42.186091+0000","last_became_peered":"2024-09-13T06:09:42.186091+0000","last_unstale":"2024-09-13T06:12:49.385246+0000","last_undegraded":"2024-09-13T06:12:49.385246+0000","last_fullsized":"2024-09-13T06:12:49.385246+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:11:39.558405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":246,"num_read_kb":228,"num_write":124,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"35'16","reported_seq":106,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:48.979007+0000","last_change":"2024-09-13T06:09:34.118780+0000","last_active":"2024-09-13T06:12:48.979007+0000","last_peered":"2024-09-13T06:12:48.979007+0000","last_clean":"2024-09-13T06:12:48.979007+0000","last_became_active":"2024-09-13T06:09:34.118393+0000","last_became_peered":"2024-09-13T06:09:34.118393+0000","last_unstale":"2024-09-13T06:12:48.979007+0000","last_undegraded":"2024-09-13T06:12:48.979007+0000","last_fullsized":"2024-09-13T06:12:48.979007+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:21:29.722330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":90,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"35'6","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:19.613864+0000","last_change":"2024-09-13T06:09:32.139342+0000","last_active":"2024-09-13T06:10:19.613864+0000","last_peered":"2024-09-13T06:10:19.613864+0000","last_clean":"2024-09-13T06:10:19.613864+0000","last_became_active":"2024-09-13T06:09:32.133545+0000","last_became_peered":"2024-09-13T06:09:32.133545+0000","last_unstale":"2024-09-13T06:10:19.613864+0000","last_undegraded":"2024-09-13T06:10:19.613864+0000","last_fullsized":"2024-09-13T06:10:19.613864+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:33:10.777679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.811858+0000","last_change":"2024-09-13T06:09:36.155061+0000","last_active":"2024-09-13T06:10:10.811858+0000","last_peered":"2024-09-13T06:10:10.811858+0000","last_clean":"2024-09-13T06:10:10.811858+0000","last_became_active":"2024-09-13T06:09:36.153420+0000","last_became_peered":"2024-09-13T06:09:36.153420+0000","last_unstale":"2024-09-13T06:10:10.811858+0000","last_undegraded":"2024-09-13T06:10:10.811858+0000","last_fullsized":"2024-09-13T06:10:10.811858+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:15:11.225972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"35'30","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:45.812130+0000","last_change":"2024-09-13T06:09:38.177058+0000","last_active":"2024-09-13T06:11:45.812130+0000","last_peered":"2024-09-13T06:11:45.812130+0000","last_clean":"2024-09-13T06:11:45.812130+0000","last_became_active":"2024-09-13T06:09:38.175393+0000","last_became_peered":"2024-09-13T06:09:38.175393+0000","last_unstale":"2024-09-13T06:11:45.812130+0000","last_undegraded":"2024-09-13T06:11:45.812130+0000","last_fullsized":"2024-09-13T06:11:45.812130+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:11:00.288447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.822023+0000","last_change":"2024-09-13T06:09:40.186286+0000","last_active":"2024-09-13T06:10:10.822023+0000","last_peered":"2024-09-13T06:10:10.822023+0000","last_clean":"2024-09-13T06:10:10.822023+0000","last_became_active":"2024-09-13T06:09:40.185574+0000","last_became_peered":"2024-09-13T06:09:40.185574+0000","last_unstale":"2024-09-13T06:10:10.822023+0000","last_undegraded":"2024-09-13T06:10:10.822023+0000","last_fullsized":"2024-09-13T06:10:10.822023+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:03:19.605623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"35'9","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:02.618334+0000","last_change":"2024-09-13T06:09:42.183906+0000","last_active":"2024-09-13T06:11:02.618334+0000","last_peered":"2024-09-13T06:11:02.618334+0000","last_clean":"2024-09-13T06:11:02.618334+0000","last_became_active":"2024-09-13T06:09:42.183162+0000","last_became_peered":"2024-09-13T06:09:42.183162+0000","last_unstale":"2024-09-13T06:11:02.618334+0000","last_undegraded":"2024-09-13T06:11:02.618334+0000","last_fullsized":"2024-09-13T06:11:02.618334+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:59:27.808952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":19,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"35'6","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.321683+0000","last_change":"2024-09-13T06:09:34.120990+0000","last_active":"2024-09-13T06:12:49.321683+0000","last_peered":"2024-09-13T06:12:49.321683+0000","last_clean":"2024-09-13T06:12:49.321683+0000","last_became_active":"2024-09-13T06:09:34.120600+0000","last_became_peered":"2024-09-13T06:09:34.120600+0000","last_unstale":"2024-09-13T06:12:49.321683+0000","last_undegraded":"2024-09-13T06:12:49.321683+0000","last_fullsized":"2024-09-13T06:12:49.321683+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:55:39.596421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.794741+0000","last_change":"2024-09-13T06:09:32.139993+0000","last_active":"2024-09-13T06:10:10.794741+0000","last_peered":"2024-09-13T06:10:10.794741+0000","last_clean":"2024-09-13T06:10:10.794741+0000","last_became_active":"2024-09-13T06:09:32.138643+0000","last_became_peered":"2024-09-13T06:09:32.138643+0000","last_unstale":"2024-09-13T06:10:10.794741+0000","last_undegraded":"2024-09-13T06:10:10.794741+0000","last_fullsized":"2024-09-13T06:10:10.794741+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:53:16.188364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.946255+0000","last_change":"2024-09-13T06:09:36.139879+0000","last_active":"2024-09-13T06:10:10.946255+0000","last_peered":"2024-09-13T06:10:10.946255+0000","last_clean":"2024-09-13T06:10:10.946255+0000","last_became_active":"2024-09-13T06:09:36.139235+0000","last_became_peered":"2024-09-13T06:09:36.139235+0000","last_unstale":"2024-09-13T06:10:10.946255+0000","last_undegraded":"2024-09-13T06:10:10.946255+0000","last_fullsized":"2024-09-13T06:10:10.946255+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:12:32.105314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"33'6","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.821659+0000","last_change":"2024-09-13T06:09:38.162297+0000","last_active":"2024-09-13T06:10:10.821659+0000","last_peered":"2024-09-13T06:10:10.821659+0000","last_clean":"2024-09-13T06:10:10.821659+0000","last_became_active":"2024-09-13T06:09:38.161539+0000","last_became_peered":"2024-09-13T06:09:38.161539+0000","last_unstale":"2024-09-13T06:10:10.821659+0000","last_undegraded":"2024-09-13T06:10:10.821659+0000","last_fullsized":"2024-09-13T06:10:10.821659+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:40:25.153315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.820538+0000","last_change":"2024-09-13T06:09:40.183211+0000","last_active":"2024-09-13T06:10:10.820538+0000","last_peered":"2024-09-13T06:10:10.820538+0000","last_clean":"2024-09-13T06:10:10.820538+0000","last_became_active":"2024-09-13T06:09:40.182436+0000","last_became_peered":"2024-09-13T06:09:40.182436+0000","last_unstale":"2024-09-13T06:10:10.820538+0000","last_undegraded":"2024-09-13T06:10:10.820538+0000","last_fullsized":"2024-09-13T06:10:10.820538+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:23:15.512719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"33'2","reported_seq":19,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.943536+0000","last_change":"2024-09-13T06:09:42.209170+0000","last_active":"2024-09-13T06:10:10.943536+0000","last_peered":"2024-09-13T06:10:10.943536+0000","last_clean":"2024-09-13T06:10:10.943536+0000","last_became_active":"2024-09-13T06:09:42.208430+0000","last_became_peered":"2024-09-13T06:09:42.208430+0000","last_unstale":"2024-09-13T06:10:10.943536+0000","last_undegraded":"2024-09-13T06:10:10.943536+0000","last_fullsized":"2024-09-13T06:10:10.943536+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:29:22.362293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"35'6","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.321687+0000","last_change":"2024-09-13T06:09:34.123289+0000","last_active":"2024-09-13T06:12:49.321687+0000","last_peered":"2024-09-13T06:12:49.321687+0000","last_clean":"2024-09-13T06:12:49.321687+0000","last_became_active":"2024-09-13T06:09:34.122001+0000","last_became_peered":"2024-09-13T06:09:34.122001+0000","last_unstale":"2024-09-13T06:12:49.321687+0000","last_undegraded":"2024-09-13T06:12:49.321687+0000","last_fullsized":"2024-09-13T06:12:49.321687+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:24:35.914145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"35'1","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:52.809110+0000","last_change":"2024-09-13T06:09:32.132575+0000","last_active":"2024-09-13T06:11:52.809110+0000","last_peered":"2024-09-13T06:11:52.809110+0000","last_clean":"2024-09-13T06:11:52.809110+0000","last_became_active":"2024-09-13T06:09:32.129739+0000","last_became_peered":"2024-09-13T06:09:32.129739+0000","last_unstale":"2024-09-13T06:11:52.809110+0000","last_undegraded":"2024-09-13T06:11:52.809110+0000","last_fullsized":"2024-09-13T06:11:52.809110+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:34:42.649939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.951834+0000","last_change":"2024-09-13T06:09:36.144172+0000","last_active":"2024-09-13T06:10:10.951834+0000","last_peered":"2024-09-13T06:10:10.951834+0000","last_clean":"2024-09-13T06:10:10.951834+0000","last_became_active":"2024-09-13T06:09:36.143405+0000","last_became_peered":"2024-09-13T06:09:36.143405+0000","last_unstale":"2024-09-13T06:10:10.951834+0000","last_undegraded":"2024-09-13T06:10:10.951834+0000","last_fullsized":"2024-09-13T06:10:10.951834+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:08:14.626902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"33'10","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.797420+0000","last_change":"2024-09-13T06:09:38.155433+0000","last_active":"2024-09-13T06:10:10.797420+0000","last_peered":"2024-09-13T06:10:10.797420+0000","last_clean":"2024-09-13T06:10:10.797420+0000","last_became_active":"2024-09-13T06:09:38.154654+0000","last_became_peered":"2024-09-13T06:09:38.154654+0000","last_unstale":"2024-09-13T06:10:10.797420+0000","last_undegraded":"2024-09-13T06:10:10.797420+0000","last_fullsized":"2024-09-13T06:10:10.797420+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:57:04.837597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"35'282","reported_seq":405,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:46.394775+0000","last_change":"2024-09-13T06:09:40.192039+0000","last_active":"2024-09-13T06:12:46.394775+0000","last_peered":"2024-09-13T06:12:46.394775+0000","last_clean":"2024-09-13T06:12:46.394775+0000","last_became_active":"2024-09-13T06:09:40.190377+0000","last_became_peered":"2024-09-13T06:09:40.190377+0000","last_unstale":"2024-09-13T06:12:46.394775+0000","last_undegraded":"2024-09-13T06:12:46.394775+0000","last_fullsized":"2024-09-13T06:12:46.394775+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:35:10.494464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.796286+0000","last_change":"2024-09-13T06:09:42.204612+0000","last_active":"2024-09-13T06:10:10.796286+0000","last_peered":"2024-09-13T06:10:10.796286+0000","last_clean":"2024-09-13T06:10:10.796286+0000","last_became_active":"2024-09-13T06:09:42.204083+0000","last_became_peered":"2024-09-13T06:09:42.204083+0000","last_unstale":"2024-09-13T06:10:10.796286+0000","last_undegraded":"2024-09-13T06:10:10.796286+0000","last_fullsized":"2024-09-13T06:10:10.796286+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:07:08.179083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"35'6","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:48.235953+0000","last_change":"2024-09-13T06:09:34.131719+0000","last_active":"2024-09-13T06:11:48.235953+0000","last_peered":"2024-09-13T06:11:48.235953+0000","last_clean":"2024-09-13T06:11:48.235953+0000","last_became_active":"2024-09-13T06:09:34.130815+0000","last_became_peered":"2024-09-13T06:09:34.130815+0000","last_unstale":"2024-09-13T06:11:48.235953+0000","last_undegraded":"2024-09-13T06:11:48.235953+0000","last_fullsized":"2024-09-13T06:11:48.235953+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:14:31.056024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.807240+0000","last_change":"2024-09-13T06:09:32.118707+0000","last_active":"2024-09-13T06:10:10.807240+0000","last_peered":"2024-09-13T06:10:10.807240+0000","last_clean":"2024-09-13T06:10:10.807240+0000","last_became_active":"2024-09-13T06:09:32.118278+0000","last_became_peered":"2024-09-13T06:09:32.118278+0000","last_unstale":"2024-09-13T06:10:10.807240+0000","last_undegraded":"2024-09-13T06:10:10.807240+0000","last_fullsized":"2024-09-13T06:10:10.807240+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:27:21.997161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.826255+0000","last_change":"2024-09-13T06:10:10.825317+0000","last_active":"2024-09-13T06:10:10.826255+0000","last_peered":"2024-09-13T06:10:10.826255+0000","last_clean":"2024-09-13T06:10:10.826255+0000","last_became_active":"2024-09-13T06:10:10.824420+0000","last_became_peered":"2024-09-13T06:10:10.824420+0000","last_unstale":"2024-09-13T06:10:10.826255+0000","last_undegraded":"2024-09-13T06:10:10.826255+0000","last_fullsized":"2024-09-13T06:10:10.826255+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:36:20.133257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"35'31","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:45.803977+0000","last_change":"2024-09-13T06:09:38.158195+0000","last_active":"2024-09-13T06:11:45.803977+0000","last_peered":"2024-09-13T06:11:45.803977+0000","last_clean":"2024-09-13T06:11:45.803977+0000","last_became_active":"2024-09-13T06:09:38.157430+0000","last_became_peered":"2024-09-13T06:09:38.157430+0000","last_unstale":"2024-09-13T06:11:45.803977+0000","last_undegraded":"2024-09-13T06:11:45.803977+0000","last_fullsized":"2024-09-13T06:11:45.803977+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:00:13.206413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"35'284","reported_seq":438,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:20.670964+0000","last_change":"2024-09-13T06:09:40.176671+0000","last_active":"2024-09-13T06:13:20.670964+0000","last_peered":"2024-09-13T06:13:20.670964+0000","last_clean":"2024-09-13T06:13:20.670964+0000","last_became_active":"2024-09-13T06:09:40.175871+0000","last_became_peered":"2024-09-13T06:09:40.175871+0000","last_unstale":"2024-09-13T06:13:20.670964+0000","last_undegraded":"2024-09-13T06:13:20.670964+0000","last_fullsized":"2024-09-13T06:13:20.670964+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:17:37.423986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"35'2","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:43.532992+0000","last_change":"2024-09-13T06:09:34.127109+0000","last_active":"2024-09-13T06:11:43.532992+0000","last_peered":"2024-09-13T06:11:43.532992+0000","last_clean":"2024-09-13T06:11:43.532992+0000","last_became_active":"2024-09-13T06:09:34.126374+0000","last_became_peered":"2024-09-13T06:09:34.126374+0000","last_unstale":"2024-09-13T06:11:43.532992+0000","last_undegraded":"2024-09-13T06:11:43.532992+0000","last_fullsized":"2024-09-13T06:11:43.532992+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:41:31.632632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.797517+0000","last_change":"2024-09-13T06:09:32.131764+0000","last_active":"2024-09-13T06:10:10.797517+0000","last_peered":"2024-09-13T06:10:10.797517+0000","last_clean":"2024-09-13T06:10:10.797517+0000","last_became_active":"2024-09-13T06:09:32.131373+0000","last_became_peered":"2024-09-13T06:09:32.131373+0000","last_unstale":"2024-09-13T06:10:10.797517+0000","last_undegraded":"2024-09-13T06:10:10.797517+0000","last_fullsized":"2024-09-13T06:10:10.797517+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:24:08.865544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.814065+0000","last_change":"2024-09-13T06:09:36.139927+0000","last_active":"2024-09-13T06:10:10.814065+0000","last_peered":"2024-09-13T06:10:10.814065+0000","last_clean":"2024-09-13T06:10:10.814065+0000","last_became_active":"2024-09-13T06:09:36.137016+0000","last_became_peered":"2024-09-13T06:09:36.137016+0000","last_unstale":"2024-09-13T06:10:10.814065+0000","last_undegraded":"2024-09-13T06:10:10.814065+0000","last_fullsized":"2024-09-13T06:10:10.814065+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:42:25.451374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"35'40","reported_seq":87,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:45.818460+0000","last_change":"2024-09-13T06:09:38.164413+0000","last_active":"2024-09-13T06:11:45.818460+0000","last_peered":"2024-09-13T06:11:45.818460+0000","last_clean":"2024-09-13T06:11:45.818460+0000","last_became_active":"2024-09-13T06:09:38.163472+0000","last_became_peered":"2024-09-13T06:09:38.163472+0000","last_unstale":"2024-09-13T06:11:45.818460+0000","last_undegraded":"2024-09-13T06:11:45.818460+0000","last_fullsized":"2024-09-13T06:11:45.818460+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:08:16.650346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.948584+0000","last_change":"2024-09-13T06:09:40.172425+0000","last_active":"2024-09-13T06:10:10.948584+0000","last_peered":"2024-09-13T06:10:10.948584+0000","last_clean":"2024-09-13T06:10:10.948584+0000","last_became_active":"2024-09-13T06:09:40.171609+0000","last_became_peered":"2024-09-13T06:09:40.171609+0000","last_unstale":"2024-09-13T06:10:10.948584+0000","last_undegraded":"2024-09-13T06:10:10.948584+0000","last_fullsized":"2024-09-13T06:10:10.948584+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:46:09.860554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"35'5","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.403220+0000","last_change":"2024-09-13T06:09:42.208317+0000","last_active":"2024-09-13T06:12:49.403220+0000","last_peered":"2024-09-13T06:12:49.403220+0000","last_clean":"2024-09-13T06:12:49.403220+0000","last_became_active":"2024-09-13T06:09:42.193426+0000","last_became_peered":"2024-09-13T06:09:42.193426+0000","last_unstale":"2024-09-13T06:12:49.403220+0000","last_undegraded":"2024-09-13T06:12:49.403220+0000","last_fullsized":"2024-09-13T06:12:49.403220+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:49:53.497381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"35'6","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.321762+0000","last_change":"2024-09-13T06:09:34.118017+0000","last_active":"2024-09-13T06:12:49.321762+0000","last_peered":"2024-09-13T06:12:49.321762+0000","last_clean":"2024-09-13T06:12:49.321762+0000","last_became_active":"2024-09-13T06:09:34.114999+0000","last_became_peered":"2024-09-13T06:09:34.114999+0000","last_unstale":"2024-09-13T06:12:49.321762+0000","last_undegraded":"2024-09-13T06:12:49.321762+0000","last_fullsized":"2024-09-13T06:12:49.321762+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:31:56.256920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.803293+0000","last_change":"2024-09-13T06:09:32.118402+0000","last_active":"2024-09-13T06:10:10.803293+0000","last_peered":"2024-09-13T06:10:10.803293+0000","last_clean":"2024-09-13T06:10:10.803293+0000","last_became_active":"2024-09-13T06:09:32.117779+0000","last_became_peered":"2024-09-13T06:09:32.117779+0000","last_unstale":"2024-09-13T06:10:10.803293+0000","last_undegraded":"2024-09-13T06:10:10.803293+0000","last_fullsized":"2024-09-13T06:10:10.803293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:42:54.943685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.943993+0000","last_change":"2024-09-13T06:09:36.136523+0000","last_active":"2024-09-13T06:10:10.943993+0000","last_peered":"2024-09-13T06:10:10.943993+0000","last_clean":"2024-09-13T06:10:10.943993+0000","last_became_active":"2024-09-13T06:09:36.135862+0000","last_became_peered":"2024-09-13T06:09:36.135862+0000","last_unstale":"2024-09-13T06:10:10.943993+0000","last_undegraded":"2024-09-13T06:10:10.943993+0000","last_fullsized":"2024-09-13T06:10:10.943993+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:48:51.597962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"35'31","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:45.788050+0000","last_change":"2024-09-13T06:09:38.173198+0000","last_active":"2024-09-13T06:11:45.788050+0000","last_peered":"2024-09-13T06:11:45.788050+0000","last_clean":"2024-09-13T06:11:45.788050+0000","last_became_active":"2024-09-13T06:09:38.171931+0000","last_became_peered":"2024-09-13T06:09:38.171931+0000","last_unstale":"2024-09-13T06:11:45.788050+0000","last_undegraded":"2024-09-13T06:11:45.788050+0000","last_fullsized":"2024-09-13T06:11:45.788050+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:38:56.011466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.945598+0000","last_change":"2024-09-13T06:09:40.179448+0000","last_active":"2024-09-13T06:10:10.945598+0000","last_peered":"2024-09-13T06:10:10.945598+0000","last_clean":"2024-09-13T06:10:10.945598+0000","last_became_active":"2024-09-13T06:09:40.178545+0000","last_became_peered":"2024-09-13T06:09:40.178545+0000","last_unstale":"2024-09-13T06:10:10.945598+0000","last_undegraded":"2024-09-13T06:10:10.945598+0000","last_fullsized":"2024-09-13T06:10:10.945598+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:54:35.378117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"35'5","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.000310+0000","last_change":"2024-09-13T06:09:42.206012+0000","last_active":"2024-09-13T06:12:49.000310+0000","last_peered":"2024-09-13T06:12:49.000310+0000","last_clean":"2024-09-13T06:12:49.000310+0000","last_became_active":"2024-09-13T06:09:42.204945+0000","last_became_peered":"2024-09-13T06:09:42.204945+0000","last_unstale":"2024-09-13T06:12:49.000310+0000","last_undegraded":"2024-09-13T06:12:49.000310+0000","last_fullsized":"2024-09-13T06:12:49.000310+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:32:49.081082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"33'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.799349+0000","last_change":"2024-09-13T06:09:34.104885+0000","last_active":"2024-09-13T06:10:10.799349+0000","last_peered":"2024-09-13T06:10:10.799349+0000","last_clean":"2024-09-13T06:10:10.799349+0000","last_became_active":"2024-09-13T06:09:34.102657+0000","last_became_peered":"2024-09-13T06:09:34.102657+0000","last_unstale":"2024-09-13T06:10:10.799349+0000","last_undegraded":"2024-09-13T06:10:10.799349+0000","last_fullsized":"2024-09-13T06:10:10.799349+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:18:18.221662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"35'5","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.500828+0000","last_change":"2024-09-13T06:09:32.136390+0000","last_active":"2024-09-13T06:12:49.500828+0000","last_peered":"2024-09-13T06:12:49.500828+0000","last_clean":"2024-09-13T06:12:49.500828+0000","last_became_active":"2024-09-13T06:09:32.133020+0000","last_became_peered":"2024-09-13T06:09:32.133020+0000","last_unstale":"2024-09-13T06:12:49.500828+0000","last_undegraded":"2024-09-13T06:12:49.500828+0000","last_fullsized":"2024-09-13T06:12:49.500828+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:29:18.318697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":21,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:11.778692+0000","last_change":"2024-09-13T06:10:10.810157+0000","last_active":"2024-09-13T06:10:11.778692+0000","last_peered":"2024-09-13T06:10:11.778692+0000","last_clean":"2024-09-13T06:10:11.778692+0000","last_became_active":"2024-09-13T06:10:10.809442+0000","last_became_peered":"2024-09-13T06:10:10.809442+0000","last_unstale":"2024-09-13T06:10:11.778692+0000","last_undegraded":"2024-09-13T06:10:11.778692+0000","last_fullsized":"2024-09-13T06:10:11.778692+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:15:18.836646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"35'36","reported_seq":81,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:45.821011+0000","last_change":"2024-09-13T06:09:38.155448+0000","last_active":"2024-09-13T06:11:45.821011+0000","last_peered":"2024-09-13T06:11:45.821011+0000","last_clean":"2024-09-13T06:11:45.821011+0000","last_became_active":"2024-09-13T06:09:38.154720+0000","last_became_peered":"2024-09-13T06:09:38.154720+0000","last_unstale":"2024-09-13T06:11:45.821011+0000","last_undegraded":"2024-09-13T06:11:45.821011+0000","last_fullsized":"2024-09-13T06:11:45.821011+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:23:45.584512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"35'284","reported_seq":400,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:20.673332+0000","last_change":"2024-09-13T06:09:40.187775+0000","last_active":"2024-09-13T06:13:20.673332+0000","last_peered":"2024-09-13T06:13:20.673332+0000","last_clean":"2024-09-13T06:13:20.673332+0000","last_became_active":"2024-09-13T06:09:40.186987+0000","last_became_peered":"2024-09-13T06:09:40.186987+0000","last_unstale":"2024-09-13T06:13:20.673332+0000","last_undegraded":"2024-09-13T06:13:20.673332+0000","last_fullsized":"2024-09-13T06:13:20.673332+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:05:45.705137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"35'2","reported_seq":19,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:48.226943+0000","last_change":"2024-09-13T06:09:42.202356+0000","last_active":"2024-09-13T06:11:48.226943+0000","last_peered":"2024-09-13T06:11:48.226943+0000","last_clean":"2024-09-13T06:11:48.226943+0000","last_became_active":"2024-09-13T06:09:42.201678+0000","last_became_peered":"2024-09-13T06:09:42.201678+0000","last_unstale":"2024-09-13T06:11:48.226943+0000","last_undegraded":"2024-09-13T06:11:48.226943+0000","last_fullsized":"2024-09-13T06:11:48.226943+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:44:32.357425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"35'14","reported_seq":69,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:48.237783+0000","last_change":"2024-09-13T06:09:34.103681+0000","last_active":"2024-09-13T06:11:48.237783+0000","last_peered":"2024-09-13T06:11:48.237783+0000","last_clean":"2024-09-13T06:11:48.237783+0000","last_became_active":"2024-09-13T06:09:34.103295+0000","last_became_peered":"2024-09-13T06:09:34.103295+0000","last_unstale":"2024-09-13T06:11:48.237783+0000","last_undegraded":"2024-09-13T06:11:48.237783+0000","last_fullsized":"2024-09-13T06:11:48.237783+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:12:41.439746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.809624+0000","last_change":"2024-09-13T06:09:32.128209+0000","last_active":"2024-09-13T06:10:10.809624+0000","last_peered":"2024-09-13T06:10:10.809624+0000","last_clean":"2024-09-13T06:10:10.809624+0000","last_became_active":"2024-09-13T06:09:32.125047+0000","last_became_peered":"2024-09-13T06:09:32.125047+0000","last_unstale":"2024-09-13T06:10:10.809624+0000","last_undegraded":"2024-09-13T06:10:10.809624+0000","last_fullsized":"2024-09-13T06:10:10.809624+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:22:25.339690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.946037+0000","last_change":"2024-09-13T06:09:36.136740+0000","last_active":"2024-09-13T06:10:10.946037+0000","last_peered":"2024-09-13T06:10:10.946037+0000","last_clean":"2024-09-13T06:10:10.946037+0000","last_became_active":"2024-09-13T06:09:36.135896+0000","last_became_peered":"2024-09-13T06:09:36.135896+0000","last_unstale":"2024-09-13T06:10:10.946037+0000","last_undegraded":"2024-09-13T06:10:10.946037+0000","last_fullsized":"2024-09-13T06:10:10.946037+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:38:41.311788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"35'56","reported_seq":112,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:47.807514+0000","last_change":"2024-09-13T06:09:38.176653+0000","last_active":"2024-09-13T06:11:47.807514+0000","last_peered":"2024-09-13T06:11:47.807514+0000","last_clean":"2024-09-13T06:11:47.807514+0000","last_became_active":"2024-09-13T06:09:38.175404+0000","last_became_peered":"2024-09-13T06:09:38.175404+0000","last_unstale":"2024-09-13T06:11:47.807514+0000","last_undegraded":"2024-09-13T06:11:47.807514+0000","last_fullsized":"2024-09-13T06:11:47.807514+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:20:41.974878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5916,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":51,"num_read_kb":42,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.943056+0000","last_change":"2024-09-13T06:09:40.178019+0000","last_active":"2024-09-13T06:10:10.943056+0000","last_peered":"2024-09-13T06:10:10.943056+0000","last_clean":"2024-09-13T06:10:10.943056+0000","last_became_active":"2024-09-13T06:09:40.177127+0000","last_became_peered":"2024-09-13T06:09:40.177127+0000","last_unstale":"2024-09-13T06:10:10.943056+0000","last_undegraded":"2024-09-13T06:10:10.943056+0000","last_fullsized":"2024-09-13T06:10:10.943056+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:03:59.282151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"35'18","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.796652+0000","last_change":"2024-09-13T06:09:42.177354+0000","last_active":"2024-09-13T06:12:49.796652+0000","last_peered":"2024-09-13T06:12:49.796652+0000","last_clean":"2024-09-13T06:12:49.796652+0000","last_became_active":"2024-09-13T06:09:42.176229+0000","last_became_peered":"2024-09-13T06:09:42.176229+0000","last_unstale":"2024-09-13T06:12:49.796652+0000","last_undegraded":"2024-09-13T06:12:49.796652+0000","last_fullsized":"2024-09-13T06:12:49.796652+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:00:06.521241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"35'16","reported_seq":77,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.114923+0000","last_change":"2024-09-13T06:09:34.121751+0000","last_active":"2024-09-13T06:12:49.114923+0000","last_peered":"2024-09-13T06:12:49.114923+0000","last_clean":"2024-09-13T06:12:49.114923+0000","last_became_active":"2024-09-13T06:09:34.119018+0000","last_became_peered":"2024-09-13T06:09:34.119018+0000","last_unstale":"2024-09-13T06:12:49.114923+0000","last_undegraded":"2024-09-13T06:12:49.114923+0000","last_fullsized":"2024-09-13T06:12:49.114923+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:43:00.917159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"35'1","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:50.799501+0000","last_change":"2024-09-13T06:09:32.151752+0000","last_active":"2024-09-13T06:11:50.799501+0000","last_peered":"2024-09-13T06:11:50.799501+0000","last_clean":"2024-09-13T06:11:50.799501+0000","last_became_active":"2024-09-13T06:09:32.148505+0000","last_became_peered":"2024-09-13T06:09:32.148505+0000","last_unstale":"2024-09-13T06:11:50.799501+0000","last_undegraded":"2024-09-13T06:11:50.799501+0000","last_fullsized":"2024-09-13T06:11:50.799501+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:15:48.717644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.807504+0000","last_change":"2024-09-13T06:09:36.132310+0000","last_active":"2024-09-13T06:10:10.807504+0000","last_peered":"2024-09-13T06:10:10.807504+0000","last_clean":"2024-09-13T06:10:10.807504+0000","last_became_active":"2024-09-13T06:09:36.131611+0000","last_became_peered":"2024-09-13T06:09:36.131611+0000","last_unstale":"2024-09-13T06:10:10.807504+0000","last_undegraded":"2024-09-13T06:10:10.807504+0000","last_fullsized":"2024-09-13T06:10:10.807504+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:13:56.015822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"35'33","reported_seq":76,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:48.241969+0000","last_change":"2024-09-13T06:09:38.166492+0000","last_active":"2024-09-13T06:11:48.241969+0000","last_peered":"2024-09-13T06:11:48.241969+0000","last_clean":"2024-09-13T06:11:48.241969+0000","last_became_active":"2024-09-13T06:09:38.165747+0000","last_became_peered":"2024-09-13T06:09:38.165747+0000","last_unstale":"2024-09-13T06:11:48.241969+0000","last_undegraded":"2024-09-13T06:11:48.241969+0000","last_fullsized":"2024-09-13T06:11:48.241969+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:11:40.651218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.816868+0000","last_change":"2024-09-13T06:09:40.190860+0000","last_active":"2024-09-13T06:10:10.816868+0000","last_peered":"2024-09-13T06:10:10.816868+0000","last_clean":"2024-09-13T06:10:10.816868+0000","last_became_active":"2024-09-13T06:09:40.190314+0000","last_became_peered":"2024-09-13T06:09:40.190314+0000","last_unstale":"2024-09-13T06:10:10.816868+0000","last_undegraded":"2024-09-13T06:10:10.816868+0000","last_fullsized":"2024-09-13T06:10:10.816868+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:52:35.906978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"35'3","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:45.410142+0000","last_change":"2024-09-13T06:09:42.202356+0000","last_active":"2024-09-13T06:11:45.410142+0000","last_peered":"2024-09-13T06:11:45.410142+0000","last_clean":"2024-09-13T06:11:45.410142+0000","last_became_active":"2024-09-13T06:09:42.201211+0000","last_became_peered":"2024-09-13T06:09:42.201211+0000","last_unstale":"2024-09-13T06:11:45.410142+0000","last_undegraded":"2024-09-13T06:11:45.410142+0000","last_fullsized":"2024-09-13T06:11:45.410142+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:35:04.349746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"35'5","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.455185+0000","last_change":"2024-09-13T06:09:34.132190+0000","last_active":"2024-09-13T06:12:49.455185+0000","last_peered":"2024-09-13T06:12:49.455185+0000","last_clean":"2024-09-13T06:12:49.455185+0000","last_became_active":"2024-09-13T06:09:34.131882+0000","last_became_peered":"2024-09-13T06:09:34.131882+0000","last_unstale":"2024-09-13T06:12:49.455185+0000","last_undegraded":"2024-09-13T06:12:49.455185+0000","last_fullsized":"2024-09-13T06:12:49.455185+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:12:40.844517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.805785+0000","last_change":"2024-09-13T06:09:32.143831+0000","last_active":"2024-09-13T06:10:10.805785+0000","last_peered":"2024-09-13T06:10:10.805785+0000","last_clean":"2024-09-13T06:10:10.805785+0000","last_became_active":"2024-09-13T06:09:32.138731+0000","last_became_peered":"2024-09-13T06:09:32.138731+0000","last_unstale":"2024-09-13T06:10:10.805785+0000","last_undegraded":"2024-09-13T06:10:10.805785+0000","last_fullsized":"2024-09-13T06:10:10.805785+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:23:59.928536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.946508+0000","last_change":"2024-09-13T06:09:36.136407+0000","last_active":"2024-09-13T06:10:10.946508+0000","last_peered":"2024-09-13T06:10:10.946508+0000","last_clean":"2024-09-13T06:10:10.946508+0000","last_became_active":"2024-09-13T06:09:36.135660+0000","last_became_peered":"2024-09-13T06:09:36.135660+0000","last_unstale":"2024-09-13T06:10:10.946508+0000","last_undegraded":"2024-09-13T06:10:10.946508+0000","last_fullsized":"2024-09-13T06:10:10.946508+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:13:54.253064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"35'37","reported_seq":82,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:45.837051+0000","last_change":"2024-09-13T06:09:38.144183+0000","last_active":"2024-09-13T06:11:45.837051+0000","last_peered":"2024-09-13T06:11:45.837051+0000","last_clean":"2024-09-13T06:11:45.837051+0000","last_became_active":"2024-09-13T06:09:38.143209+0000","last_became_peered":"2024-09-13T06:09:38.143209+0000","last_unstale":"2024-09-13T06:11:45.837051+0000","last_undegraded":"2024-09-13T06:11:45.837051+0000","last_fullsized":"2024-09-13T06:11:45.837051+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:50:01.265885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"35'282","reported_seq":404,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.808418+0000","last_change":"2024-09-13T06:09:40.188885+0000","last_active":"2024-09-13T06:12:49.808418+0000","last_peered":"2024-09-13T06:12:49.808418+0000","last_clean":"2024-09-13T06:12:49.808418+0000","last_became_active":"2024-09-13T06:09:40.188246+0000","last_became_peered":"2024-09-13T06:09:40.188246+0000","last_unstale":"2024-09-13T06:12:49.808418+0000","last_undegraded":"2024-09-13T06:12:49.808418+0000","last_fullsized":"2024-09-13T06:12:49.808418+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:10:07.607618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"35'16","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:50.799267+0000","last_change":"2024-09-13T06:09:42.201997+0000","last_active":"2024-09-13T06:11:50.799267+0000","last_peered":"2024-09-13T06:11:50.799267+0000","last_clean":"2024-09-13T06:11:50.799267+0000","last_became_active":"2024-09-13T06:09:42.201304+0000","last_became_peered":"2024-09-13T06:09:42.201304+0000","last_unstale":"2024-09-13T06:11:50.799267+0000","last_undegraded":"2024-09-13T06:11:50.799267+0000","last_fullsized":"2024-09-13T06:11:50.799267+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:45:43.763240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":29,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"35'4","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:48.236290+0000","last_change":"2024-09-13T06:09:34.102998+0000","last_active":"2024-09-13T06:11:48.236290+0000","last_peered":"2024-09-13T06:11:48.236290+0000","last_clean":"2024-09-13T06:11:48.236290+0000","last_became_active":"2024-09-13T06:09:34.102586+0000","last_became_peered":"2024-09-13T06:09:34.102586+0000","last_unstale":"2024-09-13T06:11:48.236290+0000","last_undegraded":"2024-09-13T06:11:48.236290+0000","last_fullsized":"2024-09-13T06:11:48.236290+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:03:45.932431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:48.859872+0000","last_change":"2024-09-13T06:09:32.125108+0000","last_active":"2024-09-13T06:12:48.859872+0000","last_peered":"2024-09-13T06:12:48.859872+0000","last_clean":"2024-09-13T06:12:48.859872+0000","last_became_active":"2024-09-13T06:09:32.122121+0000","last_became_peered":"2024-09-13T06:09:32.122121+0000","last_unstale":"2024-09-13T06:12:48.859872+0000","last_undegraded":"2024-09-13T06:12:48.859872+0000","last_fullsized":"2024-09-13T06:12:48.859872+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:04:21.918429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"35'3","reported_seq":413,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:47.370234+0000","last_change":"2024-09-13T06:09:36.143569+0000","last_active":"2024-09-13T06:11:47.370234+0000","last_peered":"2024-09-13T06:11:47.370234+0000","last_clean":"2024-09-13T06:11:47.370234+0000","last_became_active":"2024-09-13T06:09:36.141789+0000","last_became_peered":"2024-09-13T06:09:36.141789+0000","last_unstale":"2024-09-13T06:11:47.370234+0000","last_undegraded":"2024-09-13T06:11:47.370234+0000","last_fullsized":"2024-09-13T06:11:47.370234+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:45:41.784572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"33'10","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.811432+0000","last_change":"2024-09-13T06:09:38.177849+0000","last_active":"2024-09-13T06:10:10.811432+0000","last_peered":"2024-09-13T06:10:10.811432+0000","last_clean":"2024-09-13T06:10:10.811432+0000","last_became_active":"2024-09-13T06:09:38.177217+0000","last_became_peered":"2024-09-13T06:09:38.177217+0000","last_unstale":"2024-09-13T06:10:10.811432+0000","last_undegraded":"2024-09-13T06:10:10.811432+0000","last_fullsized":"2024-09-13T06:10:10.811432+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:10.962665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"35'282","reported_seq":460,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.674152+0000","last_change":"2024-09-13T06:09:40.181202+0000","last_active":"2024-09-13T06:12:49.674152+0000","last_peered":"2024-09-13T06:12:49.674152+0000","last_clean":"2024-09-13T06:12:49.674152+0000","last_became_active":"2024-09-13T06:09:40.179438+0000","last_became_peered":"2024-09-13T06:09:40.179438+0000","last_unstale":"2024-09-13T06:12:49.674152+0000","last_undegraded":"2024-09-13T06:12:49.674152+0000","last_fullsized":"2024-09-13T06:12:49.674152+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:27:07.073401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"35'6","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:47.594182+0000","last_change":"2024-09-13T06:09:42.204120+0000","last_active":"2024-09-13T06:11:47.594182+0000","last_peered":"2024-09-13T06:11:47.594182+0000","last_clean":"2024-09-13T06:11:47.594182+0000","last_became_active":"2024-09-13T06:09:42.181854+0000","last_became_peered":"2024-09-13T06:09:42.181854+0000","last_unstale":"2024-09-13T06:11:47.594182+0000","last_undegraded":"2024-09-13T06:11:47.594182+0000","last_fullsized":"2024-09-13T06:11:47.594182+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:16:33.568846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.822741+0000","last_change":"2024-09-13T06:09:34.127227+0000","last_active":"2024-09-13T06:10:10.822741+0000","last_peered":"2024-09-13T06:10:10.822741+0000","last_clean":"2024-09-13T06:10:10.822741+0000","last_became_active":"2024-09-13T06:09:34.126843+0000","last_became_peered":"2024-09-13T06:09:34.126843+0000","last_unstale":"2024-09-13T06:10:10.822741+0000","last_undegraded":"2024-09-13T06:10:10.822741+0000","last_fullsized":"2024-09-13T06:10:10.822741+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:44:57.098322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"35'5","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:02.598499+0000","last_change":"2024-09-13T06:09:32.133494+0000","last_active":"2024-09-13T06:11:02.598499+0000","last_peered":"2024-09-13T06:11:02.598499+0000","last_clean":"2024-09-13T06:11:02.598499+0000","last_became_active":"2024-09-13T06:09:32.129984+0000","last_became_peered":"2024-09-13T06:09:32.129984+0000","last_unstale":"2024-09-13T06:11:02.598499+0000","last_undegraded":"2024-09-13T06:11:02.598499+0000","last_fullsized":"2024-09-13T06:11:02.598499+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:45:08.493467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.818317+0000","last_change":"2024-09-13T06:09:36.155279+0000","last_active":"2024-09-13T06:10:10.818317+0000","last_peered":"2024-09-13T06:10:10.818317+0000","last_clean":"2024-09-13T06:10:10.818317+0000","last_became_active":"2024-09-13T06:09:36.153614+0000","last_became_peered":"2024-09-13T06:09:36.153614+0000","last_unstale":"2024-09-13T06:10:10.818317+0000","last_undegraded":"2024-09-13T06:10:10.818317+0000","last_fullsized":"2024-09-13T06:10:10.818317+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:27:07.877373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"35'38","reported_seq":84,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:45.813983+0000","last_change":"2024-09-13T06:09:38.158380+0000","last_active":"2024-09-13T06:11:45.813983+0000","last_peered":"2024-09-13T06:11:45.813983+0000","last_clean":"2024-09-13T06:11:45.813983+0000","last_became_active":"2024-09-13T06:09:38.155463+0000","last_became_peered":"2024-09-13T06:09:38.155463+0000","last_unstale":"2024-09-13T06:11:45.813983+0000","last_undegraded":"2024-09-13T06:11:45.813983+0000","last_fullsized":"2024-09-13T06:11:45.813983+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:24:39.953684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.796986+0000","last_change":"2024-09-13T06:09:40.169126+0000","last_active":"2024-09-13T06:10:10.796986+0000","last_peered":"2024-09-13T06:10:10.796986+0000","last_clean":"2024-09-13T06:10:10.796986+0000","last_became_active":"2024-09-13T06:09:40.167733+0000","last_became_peered":"2024-09-13T06:09:40.167733+0000","last_unstale":"2024-09-13T06:10:10.796986+0000","last_undegraded":"2024-09-13T06:10:10.796986+0000","last_fullsized":"2024-09-13T06:10:10.796986+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:10:42.824333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"35'6","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.608133+0000","last_change":"2024-09-13T06:09:42.177915+0000","last_active":"2024-09-13T06:12:49.608133+0000","last_peered":"2024-09-13T06:12:49.608133+0000","last_clean":"2024-09-13T06:12:49.608133+0000","last_became_active":"2024-09-13T06:09:42.172937+0000","last_became_peered":"2024-09-13T06:09:42.172937+0000","last_unstale":"2024-09-13T06:12:49.608133+0000","last_undegraded":"2024-09-13T06:12:49.608133+0000","last_fullsized":"2024-09-13T06:12:49.608133+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:30:04.561419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"35'12","reported_seq":77,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:18.855926+0000","last_change":"2024-09-13T06:09:34.131384+0000","last_active":"2024-09-13T06:10:18.855926+0000","last_peered":"2024-09-13T06:10:18.855926+0000","last_clean":"2024-09-13T06:10:18.855926+0000","last_became_active":"2024-09-13T06:09:34.131113+0000","last_became_peered":"2024-09-13T06:09:34.131113+0000","last_unstale":"2024-09-13T06:10:18.855926+0000","last_undegraded":"2024-09-13T06:10:18.855926+0000","last_fullsized":"2024-09-13T06:10:18.855926+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:51:08.067895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":60,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"14'117","reported_seq":205,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.805897+0000","last_change":"2024-09-13T06:09:19.565573+0000","last_active":"2024-09-13T06:10:10.805897+0000","last_peered":"2024-09-13T06:10:10.805897+0000","last_clean":"2024-09-13T06:10:10.805897+0000","last_became_active":"2024-09-13T06:09:19.561434+0000","last_became_peered":"2024-09-13T06:09:19.561434+0000","last_unstale":"2024-09-13T06:10:10.805897+0000","last_undegraded":"2024-09-13T06:10:10.805897+0000","last_fullsized":"2024-09-13T06:10:10.805897+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:18.163598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:18.163598+0000","last_clean_scrub_stamp":"2024-09-13T06:09:18.163598+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:04:43.437453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.809377+0000","last_change":"2024-09-13T06:09:24.220777+0000","last_active":"2024-09-13T06:10:10.809377+0000","last_peered":"2024-09-13T06:10:10.809377+0000","last_clean":"2024-09-13T06:10:10.809377+0000","last_became_active":"2024-09-13T06:09:22.217131+0000","last_became_peered":"2024-09-13T06:09:22.217131+0000","last_unstale":"2024-09-13T06:10:10.809377+0000","last_undegraded":"2024-09-13T06:10:10.809377+0000","last_fullsized":"2024-09-13T06:10:10.809377+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_clean_scrub_stamp":"2024-09-13T06:09:21.188659+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:58:05.578609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090967000000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"35'4","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:18.041669+0000","last_change":"2024-09-13T06:09:32.144633+0000","last_active":"2024-09-13T06:10:18.041669+0000","last_peered":"2024-09-13T06:10:18.041669+0000","last_clean":"2024-09-13T06:10:18.041669+0000","last_became_active":"2024-09-13T06:09:32.141646+0000","last_became_peered":"2024-09-13T06:09:32.141646+0000","last_unstale":"2024-09-13T06:10:18.041669+0000","last_undegraded":"2024-09-13T06:10:18.041669+0000","last_fullsized":"2024-09-13T06:10:18.041669+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:53:43.971322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.818078+0000","last_change":"2024-09-13T06:09:36.141123+0000","last_active":"2024-09-13T06:10:10.818078+0000","last_peered":"2024-09-13T06:10:10.818078+0000","last_clean":"2024-09-13T06:10:10.818078+0000","last_became_active":"2024-09-13T06:09:36.140417+0000","last_became_peered":"2024-09-13T06:09:36.140417+0000","last_unstale":"2024-09-13T06:10:10.818078+0000","last_undegraded":"2024-09-13T06:10:10.818078+0000","last_fullsized":"2024-09-13T06:10:10.818078+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:44:41.173375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"35'76","reported_seq":145,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:45.831796+0000","last_change":"2024-09-13T06:09:38.177538+0000","last_active":"2024-09-13T06:11:45.831796+0000","last_peered":"2024-09-13T06:11:45.831796+0000","last_clean":"2024-09-13T06:11:45.831796+0000","last_became_active":"2024-09-13T06:09:38.176365+0000","last_became_peered":"2024-09-13T06:09:38.176365+0000","last_unstale":"2024-09-13T06:11:45.831796+0000","last_undegraded":"2024-09-13T06:11:45.831796+0000","last_fullsized":"2024-09-13T06:11:45.831796+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:56:32.152357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.948040+0000","last_change":"2024-09-13T06:09:40.180407+0000","last_active":"2024-09-13T06:10:10.948040+0000","last_peered":"2024-09-13T06:10:10.948040+0000","last_clean":"2024-09-13T06:10:10.948040+0000","last_became_active":"2024-09-13T06:09:40.178872+0000","last_became_peered":"2024-09-13T06:09:40.178872+0000","last_unstale":"2024-09-13T06:10:10.948040+0000","last_undegraded":"2024-09-13T06:10:10.948040+0000","last_fullsized":"2024-09-13T06:10:10.948040+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:52:35.265077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"35'82","reported_seq":163,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.540178+0000","last_change":"2024-09-13T06:09:42.198530+0000","last_active":"2024-09-13T06:12:49.540178+0000","last_peered":"2024-09-13T06:12:49.540178+0000","last_clean":"2024-09-13T06:12:49.540178+0000","last_became_active":"2024-09-13T06:09:42.197803+0000","last_became_peered":"2024-09-13T06:09:42.197803+0000","last_unstale":"2024-09-13T06:12:49.540178+0000","last_undegraded":"2024-09-13T06:12:49.540178+0000","last_fullsized":"2024-09-13T06:12:49.540178+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:45:34.331341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"35'9","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.532885+0000","last_change":"2024-09-13T06:10:10.942337+0000","last_active":"2024-09-13T06:12:49.532885+0000","last_peered":"2024-09-13T06:12:49.532885+0000","last_clean":"2024-09-13T06:12:49.532885+0000","last_became_active":"2024-09-13T06:10:10.941771+0000","last_became_peered":"2024-09-13T06:10:10.941771+0000","last_unstale":"2024-09-13T06:12:49.532885+0000","last_undegraded":"2024-09-13T06:12:49.532885+0000","last_fullsized":"2024-09-13T06:12:49.532885+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:28:10.595005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.800700+0000","last_change":"2024-09-13T06:09:24.220722+0000","last_active":"2024-09-13T06:10:10.800700+0000","last_peered":"2024-09-13T06:10:10.800700+0000","last_clean":"2024-09-13T06:10:10.800700+0000","last_became_active":"2024-09-13T06:09:22.217643+0000","last_became_peered":"2024-09-13T06:09:22.217643+0000","last_unstale":"2024-09-13T06:10:10.800700+0000","last_undegraded":"2024-09-13T06:10:10.800700+0000","last_fullsized":"2024-09-13T06:10:10.800700+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_clean_scrub_stamp":"2024-09-13T06:09:21.188659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:44:20.577838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082521999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:48.095340+0000","last_change":"2024-09-13T06:09:32.151263+0000","last_active":"2024-09-13T06:11:48.095340+0000","last_peered":"2024-09-13T06:11:48.095340+0000","last_clean":"2024-09-13T06:11:48.095340+0000","last_became_active":"2024-09-13T06:09:32.147837+0000","last_became_peered":"2024-09-13T06:09:32.147837+0000","last_unstale":"2024-09-13T06:11:48.095340+0000","last_undegraded":"2024-09-13T06:11:48.095340+0000","last_fullsized":"2024-09-13T06:11:48.095340+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:55:55.407168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.817292+0000","last_change":"2024-09-13T06:09:36.154146+0000","last_active":"2024-09-13T06:10:10.817292+0000","last_peered":"2024-09-13T06:10:10.817292+0000","last_clean":"2024-09-13T06:10:10.817292+0000","last_became_active":"2024-09-13T06:09:36.153430+0000","last_became_peered":"2024-09-13T06:09:36.153430+0000","last_unstale":"2024-09-13T06:10:10.817292+0000","last_undegraded":"2024-09-13T06:10:10.817292+0000","last_fullsized":"2024-09-13T06:10:10.817292+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:50:22.555296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"35'274","reported_seq":478,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.347794+0000","last_change":"2024-09-13T06:09:38.160949+0000","last_active":"2024-09-13T06:12:49.347794+0000","last_peered":"2024-09-13T06:12:49.347794+0000","last_clean":"2024-09-13T06:12:49.347794+0000","last_became_active":"2024-09-13T06:09:38.160192+0000","last_became_peered":"2024-09-13T06:09:38.160192+0000","last_unstale":"2024-09-13T06:12:49.347794+0000","last_undegraded":"2024-09-13T06:12:49.347794+0000","last_fullsized":"2024-09-13T06:12:49.347794+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:36:16.623805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.810896+0000","last_change":"2024-09-13T06:09:40.189965+0000","last_active":"2024-09-13T06:10:10.810896+0000","last_peered":"2024-09-13T06:10:10.810896+0000","last_clean":"2024-09-13T06:10:10.810896+0000","last_became_active":"2024-09-13T06:09:40.188859+0000","last_became_peered":"2024-09-13T06:09:40.188859+0000","last_unstale":"2024-09-13T06:10:10.810896+0000","last_undegraded":"2024-09-13T06:10:10.810896+0000","last_fullsized":"2024-09-13T06:10:10.810896+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:09:59.010638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"35'5","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.668016+0000","last_change":"2024-09-13T06:09:42.205523+0000","last_active":"2024-09-13T06:12:49.668016+0000","last_peered":"2024-09-13T06:12:49.668016+0000","last_clean":"2024-09-13T06:12:49.668016+0000","last_became_active":"2024-09-13T06:09:42.204736+0000","last_became_peered":"2024-09-13T06:09:42.204736+0000","last_unstale":"2024-09-13T06:12:49.668016+0000","last_undegraded":"2024-09-13T06:12:49.668016+0000","last_fullsized":"2024-09-13T06:12:49.668016+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:13:21.283440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"35'8","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:02.611023+0000","last_change":"2024-09-13T06:09:34.132298+0000","last_active":"2024-09-13T06:11:02.611023+0000","last_peered":"2024-09-13T06:11:02.611023+0000","last_clean":"2024-09-13T06:11:02.611023+0000","last_became_active":"2024-09-13T06:09:34.131564+0000","last_became_peered":"2024-09-13T06:09:34.131564+0000","last_unstale":"2024-09-13T06:11:02.611023+0000","last_undegraded":"2024-09-13T06:11:02.611023+0000","last_fullsized":"2024-09-13T06:11:02.611023+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:50:10.277490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.795564+0000","last_change":"2024-09-13T06:09:24.565111+0000","last_active":"2024-09-13T06:10:10.795564+0000","last_peered":"2024-09-13T06:10:10.795564+0000","last_clean":"2024-09-13T06:10:10.795564+0000","last_became_active":"2024-09-13T06:09:22.214952+0000","last_became_peered":"2024-09-13T06:09:22.214952+0000","last_unstale":"2024-09-13T06:10:10.795564+0000","last_undegraded":"2024-09-13T06:10:10.795564+0000","last_fullsized":"2024-09-13T06:10:10.795564+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_clean_scrub_stamp":"2024-09-13T06:09:21.188659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:20:29.599784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097860299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.942408+0000","last_change":"2024-09-13T06:09:32.152695+0000","last_active":"2024-09-13T06:10:10.942408+0000","last_peered":"2024-09-13T06:10:10.942408+0000","last_clean":"2024-09-13T06:10:10.942408+0000","last_became_active":"2024-09-13T06:09:32.148803+0000","last_became_peered":"2024-09-13T06:09:32.148803+0000","last_unstale":"2024-09-13T06:10:10.942408+0000","last_undegraded":"2024-09-13T06:10:10.942408+0000","last_fullsized":"2024-09-13T06:10:10.942408+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:16:11.746030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"26'1","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.797255+0000","last_change":"2024-09-13T06:09:36.127208+0000","last_active":"2024-09-13T06:10:10.797255+0000","last_peered":"2024-09-13T06:10:10.797255+0000","last_clean":"2024-09-13T06:10:10.797255+0000","last_became_active":"2024-09-13T06:09:36.126497+0000","last_became_peered":"2024-09-13T06:09:36.126497+0000","last_unstale":"2024-09-13T06:10:10.797255+0000","last_undegraded":"2024-09-13T06:10:10.797255+0000","last_fullsized":"2024-09-13T06:10:10.797255+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:34:31.838383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"35'16","reported_seq":85,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:46.394535+0000","last_change":"2024-09-13T06:09:38.163577+0000","last_active":"2024-09-13T06:12:46.394535+0000","last_peered":"2024-09-13T06:12:46.394535+0000","last_clean":"2024-09-13T06:12:46.394535+0000","last_became_active":"2024-09-13T06:09:38.162358+0000","last_became_peered":"2024-09-13T06:09:38.162358+0000","last_unstale":"2024-09-13T06:12:46.394535+0000","last_undegraded":"2024-09-13T06:12:46.394535+0000","last_fullsized":"2024-09-13T06:12:46.394535+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:37:23.050896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.948281+0000","last_change":"2024-09-13T06:09:40.180051+0000","last_active":"2024-09-13T06:10:10.948281+0000","last_peered":"2024-09-13T06:10:10.948281+0000","last_clean":"2024-09-13T06:10:10.948281+0000","last_became_active":"2024-09-13T06:09:40.179250+0000","last_became_peered":"2024-09-13T06:09:40.179250+0000","last_unstale":"2024-09-13T06:10:10.948281+0000","last_undegraded":"2024-09-13T06:10:10.948281+0000","last_fullsized":"2024-09-13T06:10:10.948281+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:45:23.967679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"33'2","reported_seq":19,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.802883+0000","last_change":"2024-09-13T06:09:42.203843+0000","last_active":"2024-09-13T06:10:10.802883+0000","last_peered":"2024-09-13T06:10:10.802883+0000","last_clean":"2024-09-13T06:10:10.802883+0000","last_became_active":"2024-09-13T06:09:42.203232+0000","last_became_peered":"2024-09-13T06:09:42.203232+0000","last_unstale":"2024-09-13T06:10:10.802883+0000","last_undegraded":"2024-09-13T06:10:10.802883+0000","last_fullsized":"2024-09-13T06:10:10.802883+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:59:55.860934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"35'6","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:02.878771+0000","last_change":"2024-09-13T06:09:34.116295+0000","last_active":"2024-09-13T06:11:02.878771+0000","last_peered":"2024-09-13T06:11:02.878771+0000","last_clean":"2024-09-13T06:11:02.878771+0000","last_became_active":"2024-09-13T06:09:34.113002+0000","last_became_peered":"2024-09-13T06:09:34.113002+0000","last_unstale":"2024-09-13T06:11:02.878771+0000","last_undegraded":"2024-09-13T06:11:02.878771+0000","last_fullsized":"2024-09-13T06:11:02.878771+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:14:37.877574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.803179+0000","last_change":"2024-09-13T06:09:24.222172+0000","last_active":"2024-09-13T06:10:10.803179+0000","last_peered":"2024-09-13T06:10:10.803179+0000","last_clean":"2024-09-13T06:10:10.803179+0000","last_became_active":"2024-09-13T06:09:22.217581+0000","last_became_peered":"2024-09-13T06:09:22.217581+0000","last_unstale":"2024-09-13T06:10:10.803179+0000","last_undegraded":"2024-09-13T06:10:10.803179+0000","last_fullsized":"2024-09-13T06:10:10.803179+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_clean_scrub_stamp":"2024-09-13T06:09:21.188659+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:02:07.684980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022711580000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.798782+0000","last_change":"2024-09-13T06:09:32.139418+0000","last_active":"2024-09-13T06:10:10.798782+0000","last_peered":"2024-09-13T06:10:10.798782+0000","last_clean":"2024-09-13T06:10:10.798782+0000","last_became_active":"2024-09-13T06:09:32.138838+0000","last_became_peered":"2024-09-13T06:09:32.138838+0000","last_unstale":"2024-09-13T06:10:10.798782+0000","last_undegraded":"2024-09-13T06:10:10.798782+0000","last_fullsized":"2024-09-13T06:10:10.798782+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:06:35.186829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:11.778800+0000","last_change":"2024-09-13T06:10:10.810748+0000","last_active":"2024-09-13T06:10:11.778800+0000","last_peered":"2024-09-13T06:10:11.778800+0000","last_clean":"2024-09-13T06:10:11.778800+0000","last_became_active":"2024-09-13T06:10:10.809216+0000","last_became_peered":"2024-09-13T06:10:10.809216+0000","last_unstale":"2024-09-13T06:10:11.778800+0000","last_undegraded":"2024-09-13T06:10:11.778800+0000","last_fullsized":"2024-09-13T06:10:11.778800+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:31:29.839767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"35'13","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:48.267532+0000","last_change":"2024-09-13T06:09:38.179168+0000","last_active":"2024-09-13T06:12:48.267532+0000","last_peered":"2024-09-13T06:12:48.267532+0000","last_clean":"2024-09-13T06:12:48.267532+0000","last_became_active":"2024-09-13T06:09:38.176307+0000","last_became_peered":"2024-09-13T06:09:38.176307+0000","last_unstale":"2024-09-13T06:12:48.267532+0000","last_undegraded":"2024-09-13T06:12:48.267532+0000","last_fullsized":"2024-09-13T06:12:48.267532+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:48:06.539631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.817869+0000","last_change":"2024-09-13T06:09:40.189861+0000","last_active":"2024-09-13T06:10:10.817869+0000","last_peered":"2024-09-13T06:10:10.817869+0000","last_clean":"2024-09-13T06:10:10.817869+0000","last_became_active":"2024-09-13T06:09:40.189259+0000","last_became_peered":"2024-09-13T06:09:40.189259+0000","last_unstale":"2024-09-13T06:10:10.817869+0000","last_undegraded":"2024-09-13T06:10:10.817869+0000","last_fullsized":"2024-09-13T06:10:10.817869+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:50:40.590067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"35'4","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:47.623875+0000","last_change":"2024-09-13T06:09:42.186776+0000","last_active":"2024-09-13T06:11:47.623875+0000","last_peered":"2024-09-13T06:11:47.623875+0000","last_clean":"2024-09-13T06:11:47.623875+0000","last_became_active":"2024-09-13T06:09:42.185210+0000","last_became_peered":"2024-09-13T06:09:42.185210+0000","last_unstale":"2024-09-13T06:11:47.623875+0000","last_undegraded":"2024-09-13T06:11:47.623875+0000","last_fullsized":"2024-09-13T06:11:47.623875+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:46:22.560475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"35'3","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.344035+0000","last_change":"2024-09-13T06:09:34.122137+0000","last_active":"2024-09-13T06:12:49.344035+0000","last_peered":"2024-09-13T06:12:49.344035+0000","last_clean":"2024-09-13T06:12:49.344035+0000","last_became_active":"2024-09-13T06:09:34.119283+0000","last_became_peered":"2024-09-13T06:09:34.119283+0000","last_unstale":"2024-09-13T06:12:49.344035+0000","last_undegraded":"2024-09-13T06:12:49.344035+0000","last_fullsized":"2024-09-13T06:12:49.344035+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:10:47.867373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:18.820356+0000","last_change":"2024-09-13T06:09:32.139797+0000","last_active":"2024-09-13T06:10:18.820356+0000","last_peered":"2024-09-13T06:10:18.820356+0000","last_clean":"2024-09-13T06:10:18.820356+0000","last_became_active":"2024-09-13T06:09:32.139313+0000","last_became_peered":"2024-09-13T06:09:32.139313+0000","last_unstale":"2024-09-13T06:10:18.820356+0000","last_undegraded":"2024-09-13T06:10:18.820356+0000","last_fullsized":"2024-09-13T06:10:18.820356+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:52:39.866148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.948023+0000","last_change":"2024-09-13T06:09:24.227949+0000","last_active":"2024-09-13T06:10:10.948023+0000","last_peered":"2024-09-13T06:10:10.948023+0000","last_clean":"2024-09-13T06:10:10.948023+0000","last_became_active":"2024-09-13T06:09:22.216659+0000","last_became_peered":"2024-09-13T06:09:22.216659+0000","last_unstale":"2024-09-13T06:10:10.948023+0000","last_undegraded":"2024-09-13T06:10:10.948023+0000","last_fullsized":"2024-09-13T06:10:10.948023+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_clean_scrub_stamp":"2024-09-13T06:09:21.188659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:49:43.834788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010625330000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"35'1","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.866634+0000","last_change":"2024-09-13T06:09:36.133083+0000","last_active":"2024-09-13T06:12:49.866634+0000","last_peered":"2024-09-13T06:12:49.866634+0000","last_clean":"2024-09-13T06:12:49.866634+0000","last_became_active":"2024-09-13T06:09:36.132376+0000","last_became_peered":"2024-09-13T06:09:36.132376+0000","last_unstale":"2024-09-13T06:12:49.866634+0000","last_undegraded":"2024-09-13T06:12:49.866634+0000","last_fullsized":"2024-09-13T06:12:49.866634+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:33:42.194072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"35'65","reported_seq":128,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:20.776980+0000","last_change":"2024-09-13T06:09:38.158348+0000","last_active":"2024-09-13T06:13:20.776980+0000","last_peered":"2024-09-13T06:13:20.776980+0000","last_clean":"2024-09-13T06:13:20.776980+0000","last_became_active":"2024-09-13T06:09:38.157579+0000","last_became_peered":"2024-09-13T06:09:38.157579+0000","last_unstale":"2024-09-13T06:13:20.776980+0000","last_undegraded":"2024-09-13T06:13:20.776980+0000","last_fullsized":"2024-09-13T06:13:20.776980+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:10:00.668843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":65,"num_read_kb":53,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.793704+0000","last_change":"2024-09-13T06:09:40.185803+0000","last_active":"2024-09-13T06:10:10.793704+0000","last_peered":"2024-09-13T06:10:10.793704+0000","last_clean":"2024-09-13T06:10:10.793704+0000","last_became_active":"2024-09-13T06:09:40.185234+0000","last_became_peered":"2024-09-13T06:09:40.185234+0000","last_unstale":"2024-09-13T06:10:10.793704+0000","last_undegraded":"2024-09-13T06:10:10.793704+0000","last_fullsized":"2024-09-13T06:10:10.793704+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:15:00.667693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"35'11","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:48.059535+0000","last_change":"2024-09-13T06:09:42.176351+0000","last_active":"2024-09-13T06:11:48.059535+0000","last_peered":"2024-09-13T06:11:48.059535+0000","last_clean":"2024-09-13T06:11:48.059535+0000","last_became_active":"2024-09-13T06:09:42.170302+0000","last_became_peered":"2024-09-13T06:09:42.170302+0000","last_unstale":"2024-09-13T06:11:48.059535+0000","last_undegraded":"2024-09-13T06:11:48.059535+0000","last_fullsized":"2024-09-13T06:11:48.059535+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:18:04.598744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":25,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"35'10","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:20.342360+0000","last_change":"2024-09-13T06:09:34.122222+0000","last_active":"2024-09-13T06:10:20.342360+0000","last_peered":"2024-09-13T06:10:20.342360+0000","last_clean":"2024-09-13T06:10:20.342360+0000","last_became_active":"2024-09-13T06:09:34.121836+0000","last_became_peered":"2024-09-13T06:09:34.121836+0000","last_unstale":"2024-09-13T06:10:20.342360+0000","last_undegraded":"2024-09-13T06:10:20.342360+0000","last_fullsized":"2024-09-13T06:10:20.342360+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:33:26.123983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.950946+0000","last_change":"2024-09-13T06:09:32.137231+0000","last_active":"2024-09-13T06:10:10.950946+0000","last_peered":"2024-09-13T06:10:10.950946+0000","last_clean":"2024-09-13T06:10:10.950946+0000","last_became_active":"2024-09-13T06:09:32.136238+0000","last_became_peered":"2024-09-13T06:09:32.136238+0000","last_unstale":"2024-09-13T06:10:10.950946+0000","last_undegraded":"2024-09-13T06:10:10.950946+0000","last_fullsized":"2024-09-13T06:10:10.950946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:12:38.569078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.812165+0000","last_change":"2024-09-13T06:09:24.221355+0000","last_active":"2024-09-13T06:10:10.812165+0000","last_peered":"2024-09-13T06:10:10.812165+0000","last_clean":"2024-09-13T06:10:10.812165+0000","last_became_active":"2024-09-13T06:09:22.217809+0000","last_became_peered":"2024-09-13T06:09:22.217809+0000","last_unstale":"2024-09-13T06:10:10.812165+0000","last_undegraded":"2024-09-13T06:10:10.812165+0000","last_fullsized":"2024-09-13T06:10:10.812165+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_clean_scrub_stamp":"2024-09-13T06:09:21.188659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:16:27.098773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001447545,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.802066+0000","last_change":"2024-09-13T06:09:36.152257+0000","last_active":"2024-09-13T06:10:10.802066+0000","last_peered":"2024-09-13T06:10:10.802066+0000","last_clean":"2024-09-13T06:10:10.802066+0000","last_became_active":"2024-09-13T06:09:36.151605+0000","last_became_peered":"2024-09-13T06:09:36.151605+0000","last_unstale":"2024-09-13T06:10:10.802066+0000","last_undegraded":"2024-09-13T06:10:10.802066+0000","last_fullsized":"2024-09-13T06:10:10.802066+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:14:15.857728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"35'15","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:02.613378+0000","last_change":"2024-09-13T06:09:38.167368+0000","last_active":"2024-09-13T06:11:02.613378+0000","last_peered":"2024-09-13T06:11:02.613378+0000","last_clean":"2024-09-13T06:11:02.613378+0000","last_became_active":"2024-09-13T06:09:38.165916+0000","last_became_peered":"2024-09-13T06:09:38.165916+0000","last_unstale":"2024-09-13T06:11:02.613378+0000","last_undegraded":"2024-09-13T06:11:02.613378+0000","last_fullsized":"2024-09-13T06:11:02.613378+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:51:12.107434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"35'282","reported_seq":347,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:46.393919+0000","last_change":"2024-09-13T06:09:40.182289+0000","last_active":"2024-09-13T06:12:46.393919+0000","last_peered":"2024-09-13T06:12:46.393919+0000","last_clean":"2024-09-13T06:12:46.393919+0000","last_became_active":"2024-09-13T06:09:40.181415+0000","last_became_peered":"2024-09-13T06:09:40.181415+0000","last_unstale":"2024-09-13T06:12:46.393919+0000","last_undegraded":"2024-09-13T06:12:46.393919+0000","last_fullsized":"2024-09-13T06:12:46.393919+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:49:07.565350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.816311+0000","last_change":"2024-09-13T06:09:42.195360+0000","last_active":"2024-09-13T06:10:10.816311+0000","last_peered":"2024-09-13T06:10:10.816311+0000","last_clean":"2024-09-13T06:10:10.816311+0000","last_became_active":"2024-09-13T06:09:42.194558+0000","last_became_peered":"2024-09-13T06:09:42.194558+0000","last_unstale":"2024-09-13T06:10:10.816311+0000","last_undegraded":"2024-09-13T06:10:10.816311+0000","last_fullsized":"2024-09-13T06:10:10.816311+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:15:46.155508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"35'6","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.513665+0000","last_change":"2024-09-13T06:10:10.814500+0000","last_active":"2024-09-13T06:12:49.513665+0000","last_peered":"2024-09-13T06:12:49.513665+0000","last_clean":"2024-09-13T06:12:49.513665+0000","last_became_active":"2024-09-13T06:10:10.813656+0000","last_became_peered":"2024-09-13T06:10:10.813656+0000","last_unstale":"2024-09-13T06:12:49.513665+0000","last_undegraded":"2024-09-13T06:12:49.513665+0000","last_fullsized":"2024-09-13T06:12:49.513665+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:35:54.499508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.819500+0000","last_change":"2024-09-13T06:09:32.133206+0000","last_active":"2024-09-13T06:10:10.819500+0000","last_peered":"2024-09-13T06:10:10.819500+0000","last_clean":"2024-09-13T06:10:10.819500+0000","last_became_active":"2024-09-13T06:09:32.130385+0000","last_became_peered":"2024-09-13T06:09:32.130385+0000","last_unstale":"2024-09-13T06:10:10.819500+0000","last_undegraded":"2024-09-13T06:10:10.819500+0000","last_fullsized":"2024-09-13T06:10:10.819500+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:10:45.858553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.948419+0000","last_change":"2024-09-13T06:09:24.227867+0000","last_active":"2024-09-13T06:10:10.948419+0000","last_peered":"2024-09-13T06:10:10.948419+0000","last_clean":"2024-09-13T06:10:10.948419+0000","last_became_active":"2024-09-13T06:09:22.216905+0000","last_became_peered":"2024-09-13T06:09:22.216905+0000","last_unstale":"2024-09-13T06:10:10.948419+0000","last_undegraded":"2024-09-13T06:10:10.948419+0000","last_fullsized":"2024-09-13T06:10:10.948419+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_clean_scrub_stamp":"2024-09-13T06:09:21.188659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:24:00.674357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001005588,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.802233+0000","last_change":"2024-09-13T06:09:36.152413+0000","last_active":"2024-09-13T06:10:10.802233+0000","last_peered":"2024-09-13T06:10:10.802233+0000","last_clean":"2024-09-13T06:10:10.802233+0000","last_became_active":"2024-09-13T06:09:36.149051+0000","last_became_peered":"2024-09-13T06:09:36.149051+0000","last_unstale":"2024-09-13T06:10:10.802233+0000","last_undegraded":"2024-09-13T06:10:10.802233+0000","last_fullsized":"2024-09-13T06:10:10.802233+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:40:05.139581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"33'10","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.805068+0000","last_change":"2024-09-13T06:09:38.175171+0000","last_active":"2024-09-13T06:10:10.805068+0000","last_peered":"2024-09-13T06:10:10.805068+0000","last_clean":"2024-09-13T06:10:10.805068+0000","last_became_active":"2024-09-13T06:09:38.173017+0000","last_became_peered":"2024-09-13T06:09:38.173017+0000","last_unstale":"2024-09-13T06:10:10.805068+0000","last_undegraded":"2024-09-13T06:10:10.805068+0000","last_fullsized":"2024-09-13T06:10:10.805068+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:34:30.481224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"35'284","reported_seq":392,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:20.668273+0000","last_change":"2024-09-13T06:09:40.171525+0000","last_active":"2024-09-13T06:13:20.668273+0000","last_peered":"2024-09-13T06:13:20.668273+0000","last_clean":"2024-09-13T06:13:20.668273+0000","last_became_active":"2024-09-13T06:09:40.170879+0000","last_became_peered":"2024-09-13T06:09:40.170879+0000","last_unstale":"2024-09-13T06:13:20.668273+0000","last_undegraded":"2024-09-13T06:13:20.668273+0000","last_fullsized":"2024-09-13T06:13:20.668273+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:49:51.483537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"33'3","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.816551+0000","last_change":"2024-09-13T06:09:42.183057+0000","last_active":"2024-09-13T06:10:10.816551+0000","last_peered":"2024-09-13T06:10:10.816551+0000","last_clean":"2024-09-13T06:10:10.816551+0000","last_became_active":"2024-09-13T06:09:42.178890+0000","last_became_peered":"2024-09-13T06:09:42.178890+0000","last_unstale":"2024-09-13T06:10:10.816551+0000","last_undegraded":"2024-09-13T06:10:10.816551+0000","last_fullsized":"2024-09-13T06:10:10.816551+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:06:09.567725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"35'4","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.321911+0000","last_change":"2024-09-13T06:09:34.104607+0000","last_active":"2024-09-13T06:12:49.321911+0000","last_peered":"2024-09-13T06:12:49.321911+0000","last_clean":"2024-09-13T06:12:49.321911+0000","last_became_active":"2024-09-13T06:09:34.104194+0000","last_became_peered":"2024-09-13T06:09:34.104194+0000","last_unstale":"2024-09-13T06:12:49.321911+0000","last_undegraded":"2024-09-13T06:12:49.321911+0000","last_fullsized":"2024-09-13T06:12:49.321911+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:54:03.779728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.820560+0000","last_change":"2024-09-13T06:09:32.118940+0000","last_active":"2024-09-13T06:10:10.820560+0000","last_peered":"2024-09-13T06:10:10.820560+0000","last_clean":"2024-09-13T06:10:10.820560+0000","last_became_active":"2024-09-13T06:09:32.118386+0000","last_became_peered":"2024-09-13T06:09:32.118386+0000","last_unstale":"2024-09-13T06:10:10.820560+0000","last_undegraded":"2024-09-13T06:10:10.820560+0000","last_fullsized":"2024-09-13T06:10:10.820560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:49:16.214220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.819052+0000","last_change":"2024-09-13T06:09:24.222245+0000","last_active":"2024-09-13T06:10:10.819052+0000","last_peered":"2024-09-13T06:10:10.819052+0000","last_clean":"2024-09-13T06:10:10.819052+0000","last_became_active":"2024-09-13T06:09:22.495259+0000","last_became_peered":"2024-09-13T06:09:22.495259+0000","last_unstale":"2024-09-13T06:10:10.819052+0000","last_undegraded":"2024-09-13T06:10:10.819052+0000","last_fullsized":"2024-09-13T06:10:10.819052+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_clean_scrub_stamp":"2024-09-13T06:09:21.188659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:50:33.808976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002230409,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.800590+0000","last_change":"2024-09-13T06:09:36.148104+0000","last_active":"2024-09-13T06:10:10.800590+0000","last_peered":"2024-09-13T06:10:10.800590+0000","last_clean":"2024-09-13T06:10:10.800590+0000","last_became_active":"2024-09-13T06:09:36.144463+0000","last_became_peered":"2024-09-13T06:09:36.144463+0000","last_unstale":"2024-09-13T06:10:10.800590+0000","last_undegraded":"2024-09-13T06:10:10.800590+0000","last_fullsized":"2024-09-13T06:10:10.800590+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:03:15.568444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"35'82","reported_seq":154,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:45.810912+0000","last_change":"2024-09-13T06:09:38.159139+0000","last_active":"2024-09-13T06:11:45.810912+0000","last_peered":"2024-09-13T06:11:45.810912+0000","last_clean":"2024-09-13T06:11:45.810912+0000","last_became_active":"2024-09-13T06:09:38.158436+0000","last_became_peered":"2024-09-13T06:09:38.158436+0000","last_unstale":"2024-09-13T06:11:45.810912+0000","last_undegraded":"2024-09-13T06:11:45.810912+0000","last_fullsized":"2024-09-13T06:11:45.810912+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:59:31.499614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.944095+0000","last_change":"2024-09-13T06:09:40.177714+0000","last_active":"2024-09-13T06:10:10.944095+0000","last_peered":"2024-09-13T06:10:10.944095+0000","last_clean":"2024-09-13T06:10:10.944095+0000","last_became_active":"2024-09-13T06:09:40.176677+0000","last_became_peered":"2024-09-13T06:09:40.176677+0000","last_unstale":"2024-09-13T06:10:10.944095+0000","last_undegraded":"2024-09-13T06:10:10.944095+0000","last_fullsized":"2024-09-13T06:10:10.944095+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:16:31.555002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.807736+0000","last_change":"2024-09-13T06:09:42.205263+0000","last_active":"2024-09-13T06:10:10.807736+0000","last_peered":"2024-09-13T06:10:10.807736+0000","last_clean":"2024-09-13T06:10:10.807736+0000","last_became_active":"2024-09-13T06:09:42.204574+0000","last_became_peered":"2024-09-13T06:09:42.204574+0000","last_unstale":"2024-09-13T06:10:10.807736+0000","last_undegraded":"2024-09-13T06:10:10.807736+0000","last_fullsized":"2024-09-13T06:10:10.807736+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:05:47.718981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.797254+0000","last_change":"2024-09-13T06:09:42.198602+0000","last_active":"2024-09-13T06:10:10.797254+0000","last_peered":"2024-09-13T06:10:10.797254+0000","last_clean":"2024-09-13T06:10:10.797254+0000","last_became_active":"2024-09-13T06:09:42.197788+0000","last_became_peered":"2024-09-13T06:09:42.197788+0000","last_unstale":"2024-09-13T06:10:10.797254+0000","last_undegraded":"2024-09-13T06:10:10.797254+0000","last_fullsized":"2024-09-13T06:10:10.797254+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:04:01.295995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"35'8","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:18.855854+0000","last_change":"2024-09-13T06:09:34.104017+0000","last_active":"2024-09-13T06:10:18.855854+0000","last_peered":"2024-09-13T06:10:18.855854+0000","last_clean":"2024-09-13T06:10:18.855854+0000","last_became_active":"2024-09-13T06:09:34.101193+0000","last_became_peered":"2024-09-13T06:09:34.101193+0000","last_unstale":"2024-09-13T06:10:18.855854+0000","last_undegraded":"2024-09-13T06:10:18.855854+0000","last_fullsized":"2024-09-13T06:10:18.855854+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:51:17.686447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.809691+0000","last_change":"2024-09-13T06:09:32.125105+0000","last_active":"2024-09-13T06:10:10.809691+0000","last_peered":"2024-09-13T06:10:10.809691+0000","last_clean":"2024-09-13T06:10:10.809691+0000","last_became_active":"2024-09-13T06:09:32.124198+0000","last_became_peered":"2024-09-13T06:09:32.124198+0000","last_unstale":"2024-09-13T06:10:10.809691+0000","last_undegraded":"2024-09-13T06:10:10.809691+0000","last_fullsized":"2024-09-13T06:10:10.809691+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:34:37.470372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.813867+0000","last_change":"2024-09-13T06:09:36.134319+0000","last_active":"2024-09-13T06:10:10.813867+0000","last_peered":"2024-09-13T06:10:10.813867+0000","last_clean":"2024-09-13T06:10:10.813867+0000","last_became_active":"2024-09-13T06:09:36.133568+0000","last_became_peered":"2024-09-13T06:09:36.133568+0000","last_unstale":"2024-09-13T06:10:10.813867+0000","last_undegraded":"2024-09-13T06:10:10.813867+0000","last_fullsized":"2024-09-13T06:10:10.813867+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:20:35.376308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"35'32","reported_seq":75,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:45.819774+0000","last_change":"2024-09-13T06:09:38.172743+0000","last_active":"2024-09-13T06:11:45.819774+0000","last_peered":"2024-09-13T06:11:45.819774+0000","last_clean":"2024-09-13T06:11:45.819774+0000","last_became_active":"2024-09-13T06:09:38.172109+0000","last_became_peered":"2024-09-13T06:09:38.172109+0000","last_unstale":"2024-09-13T06:11:45.819774+0000","last_undegraded":"2024-09-13T06:11:45.819774+0000","last_fullsized":"2024-09-13T06:11:45.819774+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:28:50.103863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.802591+0000","last_change":"2024-09-13T06:09:40.189717+0000","last_active":"2024-09-13T06:10:10.802591+0000","last_peered":"2024-09-13T06:10:10.802591+0000","last_clean":"2024-09-13T06:10:10.802591+0000","last_became_active":"2024-09-13T06:09:40.189223+0000","last_became_peered":"2024-09-13T06:09:40.189223+0000","last_unstale":"2024-09-13T06:10:10.802591+0000","last_undegraded":"2024-09-13T06:10:10.802591+0000","last_fullsized":"2024-09-13T06:10:10.802591+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:33:39.326453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"35'5","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:45.415504+0000","last_change":"2024-09-13T06:09:42.179227+0000","last_active":"2024-09-13T06:11:45.415504+0000","last_peered":"2024-09-13T06:11:45.415504+0000","last_clean":"2024-09-13T06:11:45.415504+0000","last_became_active":"2024-09-13T06:09:42.177378+0000","last_became_peered":"2024-09-13T06:09:42.177378+0000","last_unstale":"2024-09-13T06:11:45.415504+0000","last_undegraded":"2024-09-13T06:11:45.415504+0000","last_fullsized":"2024-09-13T06:11:45.415504+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:40:05.274490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"35'18","reported_seq":75,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.343992+0000","last_change":"2024-09-13T06:09:34.119010+0000","last_active":"2024-09-13T06:12:49.343992+0000","last_peered":"2024-09-13T06:12:49.343992+0000","last_clean":"2024-09-13T06:12:49.343992+0000","last_became_active":"2024-09-13T06:09:34.118441+0000","last_became_peered":"2024-09-13T06:09:34.118441+0000","last_unstale":"2024-09-13T06:12:49.343992+0000","last_undegraded":"2024-09-13T06:12:49.343992+0000","last_fullsized":"2024-09-13T06:12:49.343992+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:34:39.479193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":59,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.796239+0000","last_change":"2024-09-13T06:09:32.139144+0000","last_active":"2024-09-13T06:10:10.796239+0000","last_peered":"2024-09-13T06:10:10.796239+0000","last_clean":"2024-09-13T06:10:10.796239+0000","last_became_active":"2024-09-13T06:09:32.138664+0000","last_became_peered":"2024-09-13T06:09:32.138664+0000","last_unstale":"2024-09-13T06:10:10.796239+0000","last_undegraded":"2024-09-13T06:10:10.796239+0000","last_fullsized":"2024-09-13T06:10:10.796239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:56:32.022947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"35'4","reported_seq":226,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:47.357736+0000","last_change":"2024-09-13T06:09:36.154113+0000","last_active":"2024-09-13T06:11:47.357736+0000","last_peered":"2024-09-13T06:11:47.357736+0000","last_clean":"2024-09-13T06:11:47.357736+0000","last_became_active":"2024-09-13T06:09:36.153526+0000","last_became_peered":"2024-09-13T06:09:36.153526+0000","last_unstale":"2024-09-13T06:11:47.357736+0000","last_undegraded":"2024-09-13T06:11:47.357736+0000","last_fullsized":"2024-09-13T06:11:47.357736+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:55:06.950934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"35'6","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:48.315866+0000","last_change":"2024-09-13T06:09:38.150778+0000","last_active":"2024-09-13T06:12:48.315866+0000","last_peered":"2024-09-13T06:12:48.315866+0000","last_clean":"2024-09-13T06:12:48.315866+0000","last_became_active":"2024-09-13T06:09:38.150063+0000","last_became_peered":"2024-09-13T06:09:38.150063+0000","last_unstale":"2024-09-13T06:12:48.315866+0000","last_undegraded":"2024-09-13T06:12:48.315866+0000","last_fullsized":"2024-09-13T06:12:48.315866+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:02:22.999686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.794330+0000","last_change":"2024-09-13T06:09:40.182455+0000","last_active":"2024-09-13T06:10:10.794330+0000","last_peered":"2024-09-13T06:10:10.794330+0000","last_clean":"2024-09-13T06:10:10.794330+0000","last_became_active":"2024-09-13T06:09:40.181807+0000","last_became_peered":"2024-09-13T06:09:40.181807+0000","last_unstale":"2024-09-13T06:10:10.794330+0000","last_undegraded":"2024-09-13T06:10:10.794330+0000","last_fullsized":"2024-09-13T06:10:10.794330+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:06:21.895535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"35'2","reported_seq":19,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.441035+0000","last_change":"2024-09-13T06:09:42.209380+0000","last_active":"2024-09-13T06:12:49.441035+0000","last_peered":"2024-09-13T06:12:49.441035+0000","last_clean":"2024-09-13T06:12:49.441035+0000","last_became_active":"2024-09-13T06:09:42.208567+0000","last_became_peered":"2024-09-13T06:09:42.208567+0000","last_unstale":"2024-09-13T06:12:49.441035+0000","last_undegraded":"2024-09-13T06:12:49.441035+0000","last_fullsized":"2024-09-13T06:12:49.441035+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:25:17.333516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"35'12","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.320978+0000","last_change":"2024-09-13T06:09:34.115480+0000","last_active":"2024-09-13T06:12:49.320978+0000","last_peered":"2024-09-13T06:12:49.320978+0000","last_clean":"2024-09-13T06:12:49.320978+0000","last_became_active":"2024-09-13T06:09:34.113455+0000","last_became_peered":"2024-09-13T06:09:34.113455+0000","last_unstale":"2024-09-13T06:12:49.320978+0000","last_undegraded":"2024-09-13T06:12:49.320978+0000","last_fullsized":"2024-09-13T06:12:49.320978+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:12:41.439746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:18.044718+0000","last_change":"2024-09-13T06:09:32.118643+0000","last_active":"2024-09-13T06:10:18.044718+0000","last_peered":"2024-09-13T06:10:18.044718+0000","last_clean":"2024-09-13T06:10:18.044718+0000","last_became_active":"2024-09-13T06:09:32.118235+0000","last_became_peered":"2024-09-13T06:09:32.118235+0000","last_unstale":"2024-09-13T06:10:18.044718+0000","last_undegraded":"2024-09-13T06:10:18.044718+0000","last_fullsized":"2024-09-13T06:10:18.044718+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:42:07.291597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"26'1","reported_seq":218,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:47.370504+0000","last_change":"2024-09-13T06:09:36.135737+0000","last_active":"2024-09-13T06:11:47.370504+0000","last_peered":"2024-09-13T06:11:47.370504+0000","last_clean":"2024-09-13T06:11:47.370504+0000","last_became_active":"2024-09-13T06:09:36.135184+0000","last_became_peered":"2024-09-13T06:09:36.135184+0000","last_unstale":"2024-09-13T06:11:47.370504+0000","last_undegraded":"2024-09-13T06:11:47.370504+0000","last_fullsized":"2024-09-13T06:11:47.370504+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:29:10.875574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"35'44","reported_seq":107,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:20.764127+0000","last_change":"2024-09-13T06:09:38.166891+0000","last_active":"2024-09-13T06:13:20.764127+0000","last_peered":"2024-09-13T06:13:20.764127+0000","last_clean":"2024-09-13T06:13:20.764127+0000","last_became_active":"2024-09-13T06:09:38.166381+0000","last_became_peered":"2024-09-13T06:09:38.166381+0000","last_unstale":"2024-09-13T06:13:20.764127+0000","last_undegraded":"2024-09-13T06:13:20.764127+0000","last_fullsized":"2024-09-13T06:13:20.764127+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:19:25.019683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.813101+0000","last_change":"2024-09-13T06:09:40.182185+0000","last_active":"2024-09-13T06:10:10.813101+0000","last_peered":"2024-09-13T06:10:10.813101+0000","last_clean":"2024-09-13T06:10:10.813101+0000","last_became_active":"2024-09-13T06:09:40.181329+0000","last_became_peered":"2024-09-13T06:09:40.181329+0000","last_unstale":"2024-09-13T06:10:10.813101+0000","last_undegraded":"2024-09-13T06:10:10.813101+0000","last_fullsized":"2024-09-13T06:10:10.813101+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:44:49.118858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.808748+0000","last_change":"2024-09-13T06:09:42.211550+0000","last_active":"2024-09-13T06:10:10.808748+0000","last_peered":"2024-09-13T06:10:10.808748+0000","last_clean":"2024-09-13T06:10:10.808748+0000","last_became_active":"2024-09-13T06:09:42.211005+0000","last_became_peered":"2024-09-13T06:09:42.211005+0000","last_unstale":"2024-09-13T06:10:10.808748+0000","last_undegraded":"2024-09-13T06:10:10.808748+0000","last_fullsized":"2024-09-13T06:10:10.808748+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:13:33.778909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"35'6","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:02.880093+0000","last_change":"2024-09-13T06:09:34.127109+0000","last_active":"2024-09-13T06:11:02.880093+0000","last_peered":"2024-09-13T06:11:02.880093+0000","last_clean":"2024-09-13T06:11:02.880093+0000","last_became_active":"2024-09-13T06:09:34.126798+0000","last_became_peered":"2024-09-13T06:09:34.126798+0000","last_unstale":"2024-09-13T06:11:02.880093+0000","last_undegraded":"2024-09-13T06:11:02.880093+0000","last_fullsized":"2024-09-13T06:11:02.880093+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:26:26.734970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.821879+0000","last_change":"2024-09-13T06:09:32.126749+0000","last_active":"2024-09-13T06:10:10.821879+0000","last_peered":"2024-09-13T06:10:10.821879+0000","last_clean":"2024-09-13T06:10:10.821879+0000","last_became_active":"2024-09-13T06:09:32.126213+0000","last_became_peered":"2024-09-13T06:09:32.126213+0000","last_unstale":"2024-09-13T06:10:10.821879+0000","last_undegraded":"2024-09-13T06:10:10.821879+0000","last_fullsized":"2024-09-13T06:10:10.821879+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:09.204807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.801959+0000","last_change":"2024-09-13T06:09:36.148938+0000","last_active":"2024-09-13T06:10:10.801959+0000","last_peered":"2024-09-13T06:10:10.801959+0000","last_clean":"2024-09-13T06:10:10.801959+0000","last_became_active":"2024-09-13T06:09:36.148016+0000","last_became_peered":"2024-09-13T06:09:36.148016+0000","last_unstale":"2024-09-13T06:10:10.801959+0000","last_undegraded":"2024-09-13T06:10:10.801959+0000","last_fullsized":"2024-09-13T06:10:10.801959+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:59:53.400572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"35'30","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:45.798259+0000","last_change":"2024-09-13T06:09:38.141951+0000","last_active":"2024-09-13T06:11:45.798259+0000","last_peered":"2024-09-13T06:11:45.798259+0000","last_clean":"2024-09-13T06:11:45.798259+0000","last_became_active":"2024-09-13T06:09:38.141182+0000","last_became_peered":"2024-09-13T06:09:38.141182+0000","last_unstale":"2024-09-13T06:11:45.798259+0000","last_undegraded":"2024-09-13T06:11:45.798259+0000","last_fullsized":"2024-09-13T06:11:45.798259+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:13:56.276508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.796907+0000","last_change":"2024-09-13T06:09:40.166939+0000","last_active":"2024-09-13T06:10:10.796907+0000","last_peered":"2024-09-13T06:10:10.796907+0000","last_clean":"2024-09-13T06:10:10.796907+0000","last_became_active":"2024-09-13T06:09:40.166229+0000","last_became_peered":"2024-09-13T06:09:40.166229+0000","last_unstale":"2024-09-13T06:10:10.796907+0000","last_undegraded":"2024-09-13T06:10:10.796907+0000","last_fullsized":"2024-09-13T06:10:10.796907+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:34:36.456263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"35'6","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.131054+0000","last_change":"2024-09-13T06:09:34.122302+0000","last_active":"2024-09-13T06:12:49.131054+0000","last_peered":"2024-09-13T06:12:49.131054+0000","last_clean":"2024-09-13T06:12:49.131054+0000","last_became_active":"2024-09-13T06:09:34.122034+0000","last_became_peered":"2024-09-13T06:09:34.122034+0000","last_unstale":"2024-09-13T06:12:49.131054+0000","last_undegraded":"2024-09-13T06:12:49.131054+0000","last_fullsized":"2024-09-13T06:12:49.131054+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:11:36.611679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"35'1","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:57.810367+0000","last_change":"2024-09-13T06:09:32.124543+0000","last_active":"2024-09-13T06:11:57.810367+0000","last_peered":"2024-09-13T06:11:57.810367+0000","last_clean":"2024-09-13T06:11:57.810367+0000","last_became_active":"2024-09-13T06:09:32.121948+0000","last_became_peered":"2024-09-13T06:09:32.121948+0000","last_unstale":"2024-09-13T06:11:57.810367+0000","last_undegraded":"2024-09-13T06:11:57.810367+0000","last_fullsized":"2024-09-13T06:11:57.810367+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:32:08.664673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.948430+0000","last_change":"2024-09-13T06:09:36.132935+0000","last_active":"2024-09-13T06:10:10.948430+0000","last_peered":"2024-09-13T06:10:10.948430+0000","last_clean":"2024-09-13T06:10:10.948430+0000","last_became_active":"2024-09-13T06:09:36.132227+0000","last_became_peered":"2024-09-13T06:09:36.132227+0000","last_unstale":"2024-09-13T06:10:10.948430+0000","last_undegraded":"2024-09-13T06:10:10.948430+0000","last_fullsized":"2024-09-13T06:10:10.948430+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:57:02.814153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"35'56","reported_seq":112,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:20.691893+0000","last_change":"2024-09-13T06:09:38.150760+0000","last_active":"2024-09-13T06:13:20.691893+0000","last_peered":"2024-09-13T06:13:20.691893+0000","last_clean":"2024-09-13T06:13:20.691893+0000","last_became_active":"2024-09-13T06:09:38.150070+0000","last_became_peered":"2024-09-13T06:09:38.150070+0000","last_unstale":"2024-09-13T06:13:20.691893+0000","last_undegraded":"2024-09-13T06:13:20.691893+0000","last_fullsized":"2024-09-13T06:13:20.691893+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:07:27.806351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.797513+0000","last_change":"2024-09-13T06:09:40.172438+0000","last_active":"2024-09-13T06:10:10.797513+0000","last_peered":"2024-09-13T06:10:10.797513+0000","last_clean":"2024-09-13T06:10:10.797513+0000","last_became_active":"2024-09-13T06:09:40.168550+0000","last_became_peered":"2024-09-13T06:09:40.168550+0000","last_unstale":"2024-09-13T06:10:10.797513+0000","last_undegraded":"2024-09-13T06:10:10.797513+0000","last_fullsized":"2024-09-13T06:10:10.797513+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:45:10.856259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"35'14","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:48.049705+0000","last_change":"2024-09-13T06:09:42.212051+0000","last_active":"2024-09-13T06:11:48.049705+0000","last_peered":"2024-09-13T06:11:48.049705+0000","last_clean":"2024-09-13T06:11:48.049705+0000","last_became_active":"2024-09-13T06:09:42.211508+0000","last_became_peered":"2024-09-13T06:09:42.211508+0000","last_unstale":"2024-09-13T06:11:48.049705+0000","last_undegraded":"2024-09-13T06:11:48.049705+0000","last_fullsized":"2024-09-13T06:11:48.049705+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:12:02.782157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"35'8","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:02.612403+0000","last_change":"2024-09-13T06:09:34.123413+0000","last_active":"2024-09-13T06:11:02.612403+0000","last_peered":"2024-09-13T06:11:02.612403+0000","last_clean":"2024-09-13T06:11:02.612403+0000","last_became_active":"2024-09-13T06:09:34.122881+0000","last_became_peered":"2024-09-13T06:09:34.122881+0000","last_unstale":"2024-09-13T06:11:02.612403+0000","last_undegraded":"2024-09-13T06:11:02.612403+0000","last_fullsized":"2024-09-13T06:11:02.612403+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:16:44.971572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":11,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.811694+0000","last_change":"2024-09-13T06:09:32.120176+0000","last_active":"2024-09-13T06:10:10.811694+0000","last_peered":"2024-09-13T06:10:10.811694+0000","last_clean":"2024-09-13T06:10:10.811694+0000","last_became_active":"2024-09-13T06:09:32.119573+0000","last_became_peered":"2024-09-13T06:09:32.119573+0000","last_unstale":"2024-09-13T06:10:10.811694+0000","last_undegraded":"2024-09-13T06:10:10.811694+0000","last_fullsized":"2024-09-13T06:10:10.811694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:40:56.947438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.799409+0000","last_change":"2024-09-13T06:09:36.128456+0000","last_active":"2024-09-13T06:10:10.799409+0000","last_peered":"2024-09-13T06:10:10.799409+0000","last_clean":"2024-09-13T06:10:10.799409+0000","last_became_active":"2024-09-13T06:09:36.127719+0000","last_became_peered":"2024-09-13T06:09:36.127719+0000","last_unstale":"2024-09-13T06:10:10.799409+0000","last_undegraded":"2024-09-13T06:10:10.799409+0000","last_fullsized":"2024-09-13T06:10:10.799409+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:41:36.178856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"35'37","reported_seq":82,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:45.799506+0000","last_change":"2024-09-13T06:09:38.176074+0000","last_active":"2024-09-13T06:11:45.799506+0000","last_peered":"2024-09-13T06:11:45.799506+0000","last_clean":"2024-09-13T06:11:45.799506+0000","last_became_active":"2024-09-13T06:09:38.175443+0000","last_became_peered":"2024-09-13T06:09:38.175443+0000","last_unstale":"2024-09-13T06:11:45.799506+0000","last_undegraded":"2024-09-13T06:11:45.799506+0000","last_fullsized":"2024-09-13T06:11:45.799506+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:17:36.487054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.817232+0000","last_change":"2024-09-13T06:09:40.185799+0000","last_active":"2024-09-13T06:10:10.817232+0000","last_peered":"2024-09-13T06:10:10.817232+0000","last_clean":"2024-09-13T06:10:10.817232+0000","last_became_active":"2024-09-13T06:09:40.185222+0000","last_became_peered":"2024-09-13T06:09:40.185222+0000","last_unstale":"2024-09-13T06:10:10.817232+0000","last_undegraded":"2024-09-13T06:10:10.817232+0000","last_fullsized":"2024-09-13T06:10:10.817232+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:05:13.593940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.801505+0000","last_change":"2024-09-13T06:09:42.197504+0000","last_active":"2024-09-13T06:10:10.801505+0000","last_peered":"2024-09-13T06:10:10.801505+0000","last_clean":"2024-09-13T06:10:10.801505+0000","last_became_active":"2024-09-13T06:09:42.196679+0000","last_became_peered":"2024-09-13T06:09:42.196679+0000","last_unstale":"2024-09-13T06:10:10.801505+0000","last_undegraded":"2024-09-13T06:10:10.801505+0000","last_fullsized":"2024-09-13T06:10:10.801505+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:50:54.126547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"35'15","reported_seq":76,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:48.978469+0000","last_change":"2024-09-13T06:09:34.133093+0000","last_active":"2024-09-13T06:12:48.978469+0000","last_peered":"2024-09-13T06:12:48.978469+0000","last_clean":"2024-09-13T06:12:48.978469+0000","last_became_active":"2024-09-13T06:09:34.132777+0000","last_became_peered":"2024-09-13T06:09:34.132777+0000","last_unstale":"2024-09-13T06:12:48.978469+0000","last_undegraded":"2024-09-13T06:12:48.978469+0000","last_fullsized":"2024-09-13T06:12:48.978469+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:22:38.070470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":57,"num_read_kb":53,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.814118+0000","last_change":"2024-09-13T06:09:32.118851+0000","last_active":"2024-09-13T06:10:10.814118+0000","last_peered":"2024-09-13T06:10:10.814118+0000","last_clean":"2024-09-13T06:10:10.814118+0000","last_became_active":"2024-09-13T06:09:32.117988+0000","last_became_peered":"2024-09-13T06:09:32.117988+0000","last_unstale":"2024-09-13T06:10:10.814118+0000","last_undegraded":"2024-09-13T06:10:10.814118+0000","last_fullsized":"2024-09-13T06:10:10.814118+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:23:34.478662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.799299+0000","last_change":"2024-09-13T06:09:36.130203+0000","last_active":"2024-09-13T06:10:10.799299+0000","last_peered":"2024-09-13T06:10:10.799299+0000","last_clean":"2024-09-13T06:10:10.799299+0000","last_became_active":"2024-09-13T06:09:36.129471+0000","last_became_peered":"2024-09-13T06:09:36.129471+0000","last_unstale":"2024-09-13T06:10:10.799299+0000","last_undegraded":"2024-09-13T06:10:10.799299+0000","last_fullsized":"2024-09-13T06:10:10.799299+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:24:11.325179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"35'35","reported_seq":78,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:45.825554+0000","last_change":"2024-09-13T06:09:38.154073+0000","last_active":"2024-09-13T06:11:45.825554+0000","last_peered":"2024-09-13T06:11:45.825554+0000","last_clean":"2024-09-13T06:11:45.825554+0000","last_became_active":"2024-09-13T06:09:38.153433+0000","last_became_peered":"2024-09-13T06:09:38.153433+0000","last_unstale":"2024-09-13T06:11:45.825554+0000","last_undegraded":"2024-09-13T06:11:45.825554+0000","last_fullsized":"2024-09-13T06:11:45.825554+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:14:58.653958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":46,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.947882+0000","last_change":"2024-09-13T06:09:40.172148+0000","last_active":"2024-09-13T06:10:10.947882+0000","last_peered":"2024-09-13T06:10:10.947882+0000","last_clean":"2024-09-13T06:10:10.947882+0000","last_became_active":"2024-09-13T06:09:40.171455+0000","last_became_peered":"2024-09-13T06:09:40.171455+0000","last_unstale":"2024-09-13T06:10:10.947882+0000","last_undegraded":"2024-09-13T06:10:10.947882+0000","last_fullsized":"2024-09-13T06:10:10.947882+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:14:59.315430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"35'5","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:48.222496+0000","last_change":"2024-09-13T06:09:42.202743+0000","last_active":"2024-09-13T06:11:48.222496+0000","last_peered":"2024-09-13T06:11:48.222496+0000","last_clean":"2024-09-13T06:11:48.222496+0000","last_became_active":"2024-09-13T06:09:42.202004+0000","last_became_peered":"2024-09-13T06:09:42.202004+0000","last_unstale":"2024-09-13T06:11:48.222496+0000","last_undegraded":"2024-09-13T06:11:48.222496+0000","last_fullsized":"2024-09-13T06:11:48.222496+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:46:50.902863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.951802+0000","last_change":"2024-09-13T06:09:34.117065+0000","last_active":"2024-09-13T06:10:10.951802+0000","last_peered":"2024-09-13T06:10:10.951802+0000","last_clean":"2024-09-13T06:10:10.951802+0000","last_became_active":"2024-09-13T06:09:34.116197+0000","last_became_peered":"2024-09-13T06:09:34.116197+0000","last_unstale":"2024-09-13T06:10:10.951802+0000","last_undegraded":"2024-09-13T06:10:10.951802+0000","last_fullsized":"2024-09-13T06:10:10.951802+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:56:27.933046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:43.515452+0000","last_change":"2024-09-13T06:09:32.132784+0000","last_active":"2024-09-13T06:11:43.515452+0000","last_peered":"2024-09-13T06:11:43.515452+0000","last_clean":"2024-09-13T06:11:43.515452+0000","last_became_active":"2024-09-13T06:09:32.124989+0000","last_became_peered":"2024-09-13T06:09:32.124989+0000","last_unstale":"2024-09-13T06:11:43.515452+0000","last_undegraded":"2024-09-13T06:11:43.515452+0000","last_fullsized":"2024-09-13T06:11:43.515452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:48:08.025389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.817750+0000","last_change":"2024-09-13T06:09:36.140817+0000","last_active":"2024-09-13T06:10:10.817750+0000","last_peered":"2024-09-13T06:10:10.817750+0000","last_clean":"2024-09-13T06:10:10.817750+0000","last_became_active":"2024-09-13T06:09:36.140149+0000","last_became_peered":"2024-09-13T06:09:36.140149+0000","last_unstale":"2024-09-13T06:10:10.817750+0000","last_undegraded":"2024-09-13T06:10:10.817750+0000","last_fullsized":"2024-09-13T06:10:10.817750+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:04:48.637365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'10","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.816866+0000","last_change":"2024-09-13T06:09:38.178539+0000","last_active":"2024-09-13T06:10:10.816866+0000","last_peered":"2024-09-13T06:10:10.816866+0000","last_clean":"2024-09-13T06:10:10.816866+0000","last_became_active":"2024-09-13T06:09:38.177699+0000","last_became_peered":"2024-09-13T06:09:38.177699+0000","last_unstale":"2024-09-13T06:10:10.816866+0000","last_undegraded":"2024-09-13T06:10:10.816866+0000","last_fullsized":"2024-09-13T06:10:10.816866+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:32:51.733389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"35'282","reported_seq":371,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.838611+0000","last_change":"2024-09-13T06:09:40.167569+0000","last_active":"2024-09-13T06:12:49.838611+0000","last_peered":"2024-09-13T06:12:49.838611+0000","last_clean":"2024-09-13T06:12:49.838611+0000","last_became_active":"2024-09-13T06:09:40.166780+0000","last_became_peered":"2024-09-13T06:09:40.166780+0000","last_unstale":"2024-09-13T06:12:49.838611+0000","last_undegraded":"2024-09-13T06:12:49.838611+0000","last_fullsized":"2024-09-13T06:12:49.838611+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:49:12.694438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"35'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:43.527859+0000","last_change":"2024-09-13T06:09:42.201112+0000","last_active":"2024-09-13T06:11:43.527859+0000","last_peered":"2024-09-13T06:11:43.527859+0000","last_clean":"2024-09-13T06:11:43.527859+0000","last_became_active":"2024-09-13T06:09:42.196063+0000","last_became_peered":"2024-09-13T06:09:42.196063+0000","last_unstale":"2024-09-13T06:11:43.527859+0000","last_undegraded":"2024-09-13T06:11:43.527859+0000","last_fullsized":"2024-09-13T06:11:43.527859+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:58:32.682955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"35'6","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:48.962756+0000","last_change":"2024-09-13T06:09:34.108198+0000","last_active":"2024-09-13T06:12:48.962756+0000","last_peered":"2024-09-13T06:12:48.962756+0000","last_clean":"2024-09-13T06:12:48.962756+0000","last_became_active":"2024-09-13T06:09:34.107821+0000","last_became_peered":"2024-09-13T06:09:34.107821+0000","last_unstale":"2024-09-13T06:12:48.962756+0000","last_undegraded":"2024-09-13T06:12:48.962756+0000","last_fullsized":"2024-09-13T06:12:48.962756+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:32:59.845317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:19.619406+0000","last_change":"2024-09-13T06:09:32.141297+0000","last_active":"2024-09-13T06:10:19.619406+0000","last_peered":"2024-09-13T06:10:19.619406+0000","last_clean":"2024-09-13T06:10:19.619406+0000","last_became_active":"2024-09-13T06:09:32.140816+0000","last_became_peered":"2024-09-13T06:09:32.140816+0000","last_unstale":"2024-09-13T06:10:19.619406+0000","last_undegraded":"2024-09-13T06:10:19.619406+0000","last_fullsized":"2024-09-13T06:10:19.619406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:40:42.202859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.813629+0000","last_change":"2024-09-13T06:09:36.141476+0000","last_active":"2024-09-13T06:10:10.813629+0000","last_peered":"2024-09-13T06:10:10.813629+0000","last_clean":"2024-09-13T06:10:10.813629+0000","last_became_active":"2024-09-13T06:09:36.140770+0000","last_became_peered":"2024-09-13T06:09:36.140770+0000","last_unstale":"2024-09-13T06:10:10.813629+0000","last_undegraded":"2024-09-13T06:10:10.813629+0000","last_fullsized":"2024-09-13T06:10:10.813629+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:26:28.751065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"35'37","reported_seq":82,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:45.784945+0000","last_change":"2024-09-13T06:09:38.167920+0000","last_active":"2024-09-13T06:11:45.784945+0000","last_peered":"2024-09-13T06:11:45.784945+0000","last_clean":"2024-09-13T06:11:45.784945+0000","last_became_active":"2024-09-13T06:09:38.166681+0000","last_became_peered":"2024-09-13T06:09:38.166681+0000","last_unstale":"2024-09-13T06:11:45.784945+0000","last_undegraded":"2024-09-13T06:11:45.784945+0000","last_fullsized":"2024-09-13T06:11:45.784945+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:55:43.635960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.942532+0000","last_change":"2024-09-13T06:09:40.179339+0000","last_active":"2024-09-13T06:10:10.942532+0000","last_peered":"2024-09-13T06:10:10.942532+0000","last_clean":"2024-09-13T06:10:10.942532+0000","last_became_active":"2024-09-13T06:09:40.178484+0000","last_became_peered":"2024-09-13T06:09:40.178484+0000","last_unstale":"2024-09-13T06:10:10.942532+0000","last_undegraded":"2024-09-13T06:10:10.942532+0000","last_fullsized":"2024-09-13T06:10:10.942532+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:45:32.317497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"35'4","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:02.607121+0000","last_change":"2024-09-13T06:09:42.201123+0000","last_active":"2024-09-13T06:11:02.607121+0000","last_peered":"2024-09-13T06:11:02.607121+0000","last_clean":"2024-09-13T06:11:02.607121+0000","last_became_active":"2024-09-13T06:09:42.199609+0000","last_became_peered":"2024-09-13T06:09:42.199609+0000","last_unstale":"2024-09-13T06:11:02.607121+0000","last_undegraded":"2024-09-13T06:11:02.607121+0000","last_fullsized":"2024-09-13T06:11:02.607121+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:30:15.851819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"35'5","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:06.802967+0000","last_change":"2024-09-13T06:09:34.100754+0000","last_active":"2024-09-13T06:12:06.802967+0000","last_peered":"2024-09-13T06:12:06.802967+0000","last_clean":"2024-09-13T06:12:06.802967+0000","last_became_active":"2024-09-13T06:09:34.100355+0000","last_became_peered":"2024-09-13T06:09:34.100355+0000","last_unstale":"2024-09-13T06:12:06.802967+0000","last_undegraded":"2024-09-13T06:12:06.802967+0000","last_fullsized":"2024-09-13T06:12:06.802967+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:09:45.564486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.812408+0000","last_change":"2024-09-13T06:09:32.133279+0000","last_active":"2024-09-13T06:10:10.812408+0000","last_peered":"2024-09-13T06:10:10.812408+0000","last_clean":"2024-09-13T06:10:10.812408+0000","last_became_active":"2024-09-13T06:09:32.125049+0000","last_became_peered":"2024-09-13T06:09:32.125049+0000","last_unstale":"2024-09-13T06:10:10.812408+0000","last_undegraded":"2024-09-13T06:10:10.812408+0000","last_fullsized":"2024-09-13T06:10:10.812408+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:46:21.627138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.803001+0000","last_change":"2024-09-13T06:09:36.128406+0000","last_active":"2024-09-13T06:10:10.803001+0000","last_peered":"2024-09-13T06:10:10.803001+0000","last_clean":"2024-09-13T06:10:10.803001+0000","last_became_active":"2024-09-13T06:09:36.127684+0000","last_became_peered":"2024-09-13T06:09:36.127684+0000","last_unstale":"2024-09-13T06:10:10.803001+0000","last_undegraded":"2024-09-13T06:10:10.803001+0000","last_fullsized":"2024-09-13T06:10:10.803001+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:19:14.299050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"35'32","reported_seq":74,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.536866+0000","last_change":"2024-09-13T06:09:38.158011+0000","last_active":"2024-09-13T06:12:49.536866+0000","last_peered":"2024-09-13T06:12:49.536866+0000","last_clean":"2024-09-13T06:12:49.536866+0000","last_became_active":"2024-09-13T06:09:38.157278+0000","last_became_peered":"2024-09-13T06:09:38.157278+0000","last_unstale":"2024-09-13T06:12:49.536866+0000","last_undegraded":"2024-09-13T06:12:49.536866+0000","last_fullsized":"2024-09-13T06:12:49.536866+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:38:47.813081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.801307+0000","last_change":"2024-09-13T06:09:40.189802+0000","last_active":"2024-09-13T06:10:10.801307+0000","last_peered":"2024-09-13T06:10:10.801307+0000","last_clean":"2024-09-13T06:10:10.801307+0000","last_became_active":"2024-09-13T06:09:40.189165+0000","last_became_peered":"2024-09-13T06:09:40.189165+0000","last_unstale":"2024-09-13T06:10:10.801307+0000","last_undegraded":"2024-09-13T06:10:10.801307+0000","last_fullsized":"2024-09-13T06:10:10.801307+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:46:51.067583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.817340+0000","last_change":"2024-09-13T06:09:42.214239+0000","last_active":"2024-09-13T06:10:10.817340+0000","last_peered":"2024-09-13T06:10:10.817340+0000","last_clean":"2024-09-13T06:10:10.817340+0000","last_became_active":"2024-09-13T06:09:42.213756+0000","last_became_peered":"2024-09-13T06:09:42.213756+0000","last_unstale":"2024-09-13T06:10:10.817340+0000","last_undegraded":"2024-09-13T06:10:10.817340+0000","last_fullsized":"2024-09-13T06:10:10.817340+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:18:10.840742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.802714+0000","last_change":"2024-09-13T06:09:34.118052+0000","last_active":"2024-09-13T06:10:10.802714+0000","last_peered":"2024-09-13T06:10:10.802714+0000","last_clean":"2024-09-13T06:10:10.802714+0000","last_became_active":"2024-09-13T06:09:34.117789+0000","last_became_peered":"2024-09-13T06:09:34.117789+0000","last_unstale":"2024-09-13T06:10:10.802714+0000","last_undegraded":"2024-09-13T06:10:10.802714+0000","last_fullsized":"2024-09-13T06:10:10.802714+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:20:33.360213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.948743+0000","last_change":"2024-09-13T06:09:32.135815+0000","last_active":"2024-09-13T06:10:10.948743+0000","last_peered":"2024-09-13T06:10:10.948743+0000","last_clean":"2024-09-13T06:10:10.948743+0000","last_became_active":"2024-09-13T06:09:32.134696+0000","last_became_peered":"2024-09-13T06:09:32.134696+0000","last_unstale":"2024-09-13T06:10:10.948743+0000","last_undegraded":"2024-09-13T06:10:10.948743+0000","last_fullsized":"2024-09-13T06:10:10.948743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:26:57.128770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.805495+0000","last_change":"2024-09-13T06:09:36.132556+0000","last_active":"2024-09-13T06:10:10.805495+0000","last_peered":"2024-09-13T06:10:10.805495+0000","last_clean":"2024-09-13T06:10:10.805495+0000","last_became_active":"2024-09-13T06:09:36.131976+0000","last_became_peered":"2024-09-13T06:09:36.131976+0000","last_unstale":"2024-09-13T06:10:10.805495+0000","last_undegraded":"2024-09-13T06:10:10.805495+0000","last_fullsized":"2024-09-13T06:10:10.805495+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:48:01.480885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"35'26","reported_seq":66,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:45.822287+0000","last_change":"2024-09-13T06:09:38.173782+0000","last_active":"2024-09-13T06:11:45.822287+0000","last_peered":"2024-09-13T06:11:45.822287+0000","last_clean":"2024-09-13T06:11:45.822287+0000","last_became_active":"2024-09-13T06:09:38.171538+0000","last_became_peered":"2024-09-13T06:09:38.171538+0000","last_unstale":"2024-09-13T06:11:45.822287+0000","last_undegraded":"2024-09-13T06:11:45.822287+0000","last_fullsized":"2024-09-13T06:11:45.822287+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:03:14.025680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.802940+0000","last_change":"2024-09-13T06:09:40.185942+0000","last_active":"2024-09-13T06:10:10.802940+0000","last_peered":"2024-09-13T06:10:10.802940+0000","last_clean":"2024-09-13T06:10:10.802940+0000","last_became_active":"2024-09-13T06:09:40.185277+0000","last_became_peered":"2024-09-13T06:09:40.185277+0000","last_unstale":"2024-09-13T06:10:10.802940+0000","last_undegraded":"2024-09-13T06:10:10.802940+0000","last_fullsized":"2024-09-13T06:10:10.802940+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:32:01.193186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"35'6","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.118315+0000","last_change":"2024-09-13T06:09:42.211802+0000","last_active":"2024-09-13T06:12:49.118315+0000","last_peered":"2024-09-13T06:12:49.118315+0000","last_clean":"2024-09-13T06:12:49.118315+0000","last_became_active":"2024-09-13T06:09:42.211176+0000","last_became_peered":"2024-09-13T06:09:42.211176+0000","last_unstale":"2024-09-13T06:12:49.118315+0000","last_undegraded":"2024-09-13T06:12:49.118315+0000","last_fullsized":"2024-09-13T06:12:49.118315+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:57:39.347061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"35'7","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:01.801830+0000","last_change":"2024-09-13T06:09:34.105846+0000","last_active":"2024-09-13T06:12:01.801830+0000","last_peered":"2024-09-13T06:12:01.801830+0000","last_clean":"2024-09-13T06:12:01.801830+0000","last_became_active":"2024-09-13T06:09:34.105494+0000","last_became_peered":"2024-09-13T06:09:34.105494+0000","last_unstale":"2024-09-13T06:12:01.801830+0000","last_undegraded":"2024-09-13T06:12:01.801830+0000","last_fullsized":"2024-09-13T06:12:01.801830+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:49:45.129882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:48.169232+0000","last_change":"2024-09-13T06:09:32.143211+0000","last_active":"2024-09-13T06:11:48.169232+0000","last_peered":"2024-09-13T06:11:48.169232+0000","last_clean":"2024-09-13T06:11:48.169232+0000","last_became_active":"2024-09-13T06:09:32.142726+0000","last_became_peered":"2024-09-13T06:09:32.142726+0000","last_unstale":"2024-09-13T06:11:48.169232+0000","last_undegraded":"2024-09-13T06:11:48.169232+0000","last_fullsized":"2024-09-13T06:11:48.169232+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:21:43.192771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"35'2","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:44.039922+0000","last_change":"2024-09-13T06:09:36.137208+0000","last_active":"2024-09-13T06:11:44.039922+0000","last_peered":"2024-09-13T06:11:44.039922+0000","last_clean":"2024-09-13T06:11:44.039922+0000","last_became_active":"2024-09-13T06:09:36.136792+0000","last_became_peered":"2024-09-13T06:09:36.136792+0000","last_unstale":"2024-09-13T06:11:44.039922+0000","last_undegraded":"2024-09-13T06:11:44.039922+0000","last_fullsized":"2024-09-13T06:11:44.039922+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:41.098706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"35'32","reported_seq":76,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:48.279549+0000","last_change":"2024-09-13T06:09:38.167295+0000","last_active":"2024-09-13T06:12:48.279549+0000","last_peered":"2024-09-13T06:12:48.279549+0000","last_clean":"2024-09-13T06:12:48.279549+0000","last_became_active":"2024-09-13T06:09:38.166333+0000","last_became_peered":"2024-09-13T06:09:38.166333+0000","last_unstale":"2024-09-13T06:12:48.279549+0000","last_undegraded":"2024-09-13T06:12:48.279549+0000","last_fullsized":"2024-09-13T06:12:48.279549+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:04:00.098517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.946008+0000","last_change":"2024-09-13T06:09:40.179631+0000","last_active":"2024-09-13T06:10:10.946008+0000","last_peered":"2024-09-13T06:10:10.946008+0000","last_clean":"2024-09-13T06:10:10.946008+0000","last_became_active":"2024-09-13T06:09:40.178392+0000","last_became_peered":"2024-09-13T06:09:40.178392+0000","last_unstale":"2024-09-13T06:10:10.946008+0000","last_undegraded":"2024-09-13T06:10:10.946008+0000","last_fullsized":"2024-09-13T06:10:10.946008+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:07:06.165239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"35'8","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:48.486283+0000","last_change":"2024-09-13T06:09:42.214258+0000","last_active":"2024-09-13T06:12:48.486283+0000","last_peered":"2024-09-13T06:12:48.486283+0000","last_clean":"2024-09-13T06:12:48.486283+0000","last_became_active":"2024-09-13T06:09:42.213809+0000","last_became_peered":"2024-09-13T06:09:42.213809+0000","last_unstale":"2024-09-13T06:12:48.486283+0000","last_undegraded":"2024-09-13T06:12:48.486283+0000","last_fullsized":"2024-09-13T06:12:48.486283+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:14:08.749509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"35'6","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:18.858941+0000","last_change":"2024-09-13T06:09:34.126954+0000","last_active":"2024-09-13T06:10:18.858941+0000","last_peered":"2024-09-13T06:10:18.858941+0000","last_clean":"2024-09-13T06:10:18.858941+0000","last_became_active":"2024-09-13T06:09:34.124044+0000","last_became_peered":"2024-09-13T06:09:34.124044+0000","last_unstale":"2024-09-13T06:10:18.858941+0000","last_undegraded":"2024-09-13T06:10:18.858941+0000","last_fullsized":"2024-09-13T06:10:18.858941+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:41:52.801670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.793841+0000","last_change":"2024-09-13T06:09:32.134687+0000","last_active":"2024-09-13T06:10:10.793841+0000","last_peered":"2024-09-13T06:10:10.793841+0000","last_clean":"2024-09-13T06:10:10.793841+0000","last_became_active":"2024-09-13T06:09:32.133972+0000","last_became_peered":"2024-09-13T06:09:32.133972+0000","last_unstale":"2024-09-13T06:10:10.793841+0000","last_undegraded":"2024-09-13T06:10:10.793841+0000","last_fullsized":"2024-09-13T06:10:10.793841+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:28:08.722107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"35'12","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.513040+0000","last_change":"2024-09-13T06:09:34.113604+0000","last_active":"2024-09-13T06:12:49.513040+0000","last_peered":"2024-09-13T06:12:49.513040+0000","last_clean":"2024-09-13T06:12:49.513040+0000","last_became_active":"2024-09-13T06:09:34.112805+0000","last_became_peered":"2024-09-13T06:09:34.112805+0000","last_unstale":"2024-09-13T06:12:49.513040+0000","last_undegraded":"2024-09-13T06:12:49.513040+0000","last_fullsized":"2024-09-13T06:12:49.513040+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:57:58.370368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:18.043879+0000","last_change":"2024-09-13T06:09:32.150318+0000","last_active":"2024-09-13T06:10:18.043879+0000","last_peered":"2024-09-13T06:10:18.043879+0000","last_clean":"2024-09-13T06:10:18.043879+0000","last_became_active":"2024-09-13T06:09:32.145941+0000","last_became_peered":"2024-09-13T06:09:32.145941+0000","last_unstale":"2024-09-13T06:10:18.043879+0000","last_undegraded":"2024-09-13T06:10:18.043879+0000","last_fullsized":"2024-09-13T06:10:18.043879+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:52:39.866148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"35'10","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.435817+0000","last_change":"2024-09-13T06:09:34.118956+0000","last_active":"2024-09-13T06:12:49.435817+0000","last_peered":"2024-09-13T06:12:49.435817+0000","last_clean":"2024-09-13T06:12:49.435817+0000","last_became_active":"2024-09-13T06:09:34.118325+0000","last_became_peered":"2024-09-13T06:09:34.118325+0000","last_unstale":"2024-09-13T06:12:49.435817+0000","last_undegraded":"2024-09-13T06:12:49.435817+0000","last_fullsized":"2024-09-13T06:12:49.435817+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:29:20.078139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:19.629629+0000","last_change":"2024-09-13T06:09:32.144168+0000","last_active":"2024-09-13T06:10:19.629629+0000","last_peered":"2024-09-13T06:10:19.629629+0000","last_clean":"2024-09-13T06:10:19.629629+0000","last_became_active":"2024-09-13T06:09:32.133230+0000","last_became_peered":"2024-09-13T06:09:32.133230+0000","last_unstale":"2024-09-13T06:10:19.629629+0000","last_undegraded":"2024-09-13T06:10:19.629629+0000","last_fullsized":"2024-09-13T06:10:19.629629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:30:40.767524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"35'4","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.512979+0000","last_change":"2024-09-13T06:09:34.117053+0000","last_active":"2024-09-13T06:12:49.512979+0000","last_peered":"2024-09-13T06:12:49.512979+0000","last_clean":"2024-09-13T06:12:49.512979+0000","last_became_active":"2024-09-13T06:09:34.115512+0000","last_became_peered":"2024-09-13T06:09:34.115512+0000","last_unstale":"2024-09-13T06:12:49.512979+0000","last_undegraded":"2024-09-13T06:12:49.512979+0000","last_fullsized":"2024-09-13T06:12:49.512979+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:41:07.174428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:48.905752+0000","last_change":"2024-09-13T06:09:32.153571+0000","last_active":"2024-09-13T06:12:48.905752+0000","last_peered":"2024-09-13T06:12:48.905752+0000","last_clean":"2024-09-13T06:12:48.905752+0000","last_became_active":"2024-09-13T06:09:32.150328+0000","last_became_peered":"2024-09-13T06:09:32.150328+0000","last_unstale":"2024-09-13T06:12:48.905752+0000","last_undegraded":"2024-09-13T06:12:48.905752+0000","last_fullsized":"2024-09-13T06:12:48.905752+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:42:54.943685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"35'12","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.109084+0000","last_change":"2024-09-13T06:09:34.115843+0000","last_active":"2024-09-13T06:12:49.109084+0000","last_peered":"2024-09-13T06:12:49.109084+0000","last_clean":"2024-09-13T06:12:49.109084+0000","last_became_active":"2024-09-13T06:09:34.113986+0000","last_became_peered":"2024-09-13T06:09:34.113986+0000","last_unstale":"2024-09-13T06:12:49.109084+0000","last_undegraded":"2024-09-13T06:12:49.109084+0000","last_fullsized":"2024-09-13T06:12:49.109084+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:03:45.932431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.948985+0000","last_change":"2024-09-13T06:09:32.137258+0000","last_active":"2024-09-13T06:10:10.948985+0000","last_peered":"2024-09-13T06:10:10.948985+0000","last_clean":"2024-09-13T06:10:10.948985+0000","last_became_active":"2024-09-13T06:09:32.136268+0000","last_became_peered":"2024-09-13T06:09:32.136268+0000","last_unstale":"2024-09-13T06:10:10.948985+0000","last_undegraded":"2024-09-13T06:10:10.948985+0000","last_fullsized":"2024-09-13T06:10:10.948985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:42:07.291597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"35'4","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:43.519164+0000","last_change":"2024-09-13T06:09:34.124112+0000","last_active":"2024-09-13T06:11:43.519164+0000","last_peered":"2024-09-13T06:11:43.519164+0000","last_clean":"2024-09-13T06:11:43.519164+0000","last_became_active":"2024-09-13T06:09:34.121261+0000","last_became_peered":"2024-09-13T06:09:34.121261+0000","last_unstale":"2024-09-13T06:11:43.519164+0000","last_undegraded":"2024-09-13T06:11:43.519164+0000","last_fullsized":"2024-09-13T06:11:43.519164+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:29:20.327517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.818014+0000","last_change":"2024-09-13T06:09:32.142747+0000","last_active":"2024-09-13T06:10:10.818014+0000","last_peered":"2024-09-13T06:10:10.818014+0000","last_clean":"2024-09-13T06:10:10.818014+0000","last_became_active":"2024-09-13T06:09:32.141602+0000","last_became_peered":"2024-09-13T06:09:32.141602+0000","last_unstale":"2024-09-13T06:10:10.818014+0000","last_undegraded":"2024-09-13T06:10:10.818014+0000","last_fullsized":"2024-09-13T06:10:10.818014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:12:22.491041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"35'6","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.512979+0000","last_change":"2024-09-13T06:09:34.123392+0000","last_active":"2024-09-13T06:12:49.512979+0000","last_peered":"2024-09-13T06:12:49.512979+0000","last_clean":"2024-09-13T06:12:49.512979+0000","last_became_active":"2024-09-13T06:09:34.122424+0000","last_became_peered":"2024-09-13T06:09:34.122424+0000","last_unstale":"2024-09-13T06:12:49.512979+0000","last_undegraded":"2024-09-13T06:12:49.512979+0000","last_fullsized":"2024-09-13T06:12:49.512979+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:32:59.845317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.803937+0000","last_change":"2024-09-13T06:09:32.120069+0000","last_active":"2024-09-13T06:10:10.803937+0000","last_peered":"2024-09-13T06:10:10.803937+0000","last_clean":"2024-09-13T06:10:10.803937+0000","last_became_active":"2024-09-13T06:09:32.119665+0000","last_became_peered":"2024-09-13T06:09:32.119665+0000","last_unstale":"2024-09-13T06:10:10.803937+0000","last_undegraded":"2024-09-13T06:10:10.803937+0000","last_fullsized":"2024-09-13T06:10:10.803937+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:12:38.569078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"35'9","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.454353+0000","last_change":"2024-09-13T06:09:34.121479+0000","last_active":"2024-09-13T06:12:49.454353+0000","last_peered":"2024-09-13T06:12:49.454353+0000","last_clean":"2024-09-13T06:12:49.454353+0000","last_became_active":"2024-09-13T06:09:34.114378+0000","last_became_peered":"2024-09-13T06:09:34.114378+0000","last_unstale":"2024-09-13T06:12:49.454353+0000","last_undegraded":"2024-09-13T06:12:49.454353+0000","last_fullsized":"2024-09-13T06:12:49.454353+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:48:00.341088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"35'3","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:45.798306+0000","last_change":"2024-09-13T06:09:32.147166+0000","last_active":"2024-09-13T06:11:45.798306+0000","last_peered":"2024-09-13T06:11:45.798306+0000","last_clean":"2024-09-13T06:11:45.798306+0000","last_became_active":"2024-09-13T06:09:32.146011+0000","last_became_peered":"2024-09-13T06:09:32.146011+0000","last_unstale":"2024-09-13T06:11:45.798306+0000","last_undegraded":"2024-09-13T06:11:45.798306+0000","last_fullsized":"2024-09-13T06:11:45.798306+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:56:46.777275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668544,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":11,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"35'2","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:43.532529+0000","last_change":"2024-09-13T06:09:34.118796+0000","last_active":"2024-09-13T06:11:43.532529+0000","last_peered":"2024-09-13T06:11:43.532529+0000","last_clean":"2024-09-13T06:11:43.532529+0000","last_became_active":"2024-09-13T06:09:34.117659+0000","last_became_peered":"2024-09-13T06:09:34.117659+0000","last_unstale":"2024-09-13T06:11:43.532529+0000","last_undegraded":"2024-09-13T06:11:43.532529+0000","last_fullsized":"2024-09-13T06:11:43.532529+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:26:28.789376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:47.850255+0000","last_change":"2024-09-13T06:09:32.124201+0000","last_active":"2024-09-13T06:11:47.850255+0000","last_peered":"2024-09-13T06:11:47.850255+0000","last_clean":"2024-09-13T06:11:47.850255+0000","last_became_active":"2024-09-13T06:09:32.121250+0000","last_became_peered":"2024-09-13T06:09:32.121250+0000","last_unstale":"2024-09-13T06:11:47.850255+0000","last_undegraded":"2024-09-13T06:11:47.850255+0000","last_fullsized":"2024-09-13T06:11:47.850255+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:52:58.934306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"35'5","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:57.810848+0000","last_change":"2024-09-13T06:09:34.118552+0000","last_active":"2024-09-13T06:11:57.810848+0000","last_peered":"2024-09-13T06:11:57.810848+0000","last_clean":"2024-09-13T06:11:57.810848+0000","last_became_active":"2024-09-13T06:09:34.118270+0000","last_became_peered":"2024-09-13T06:09:34.118270+0000","last_unstale":"2024-09-13T06:11:57.810848+0000","last_undegraded":"2024-09-13T06:11:57.810848+0000","last_fullsized":"2024-09-13T06:11:57.810848+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:36:12.584267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:18.044995+0000","last_change":"2024-09-13T06:09:32.151004+0000","last_active":"2024-09-13T06:10:18.044995+0000","last_peered":"2024-09-13T06:10:18.044995+0000","last_clean":"2024-09-13T06:10:18.044995+0000","last_became_active":"2024-09-13T06:09:32.145988+0000","last_became_peered":"2024-09-13T06:09:32.145988+0000","last_unstale":"2024-09-13T06:10:18.044995+0000","last_undegraded":"2024-09-13T06:10:18.044995+0000","last_fullsized":"2024-09-13T06:10:18.044995+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:56:32.022947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"33'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.951431+0000","last_change":"2024-09-13T06:09:34.118753+0000","last_active":"2024-09-13T06:10:10.951431+0000","last_peered":"2024-09-13T06:10:10.951431+0000","last_clean":"2024-09-13T06:10:10.951431+0000","last_became_active":"2024-09-13T06:09:34.117320+0000","last_became_peered":"2024-09-13T06:09:34.117320+0000","last_unstale":"2024-09-13T06:10:10.951431+0000","last_undegraded":"2024-09-13T06:10:10.951431+0000","last_fullsized":"2024-09-13T06:10:10.951431+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:09:45.564486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"35'1","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:47.803012+0000","last_change":"2024-09-13T06:09:32.141516+0000","last_active":"2024-09-13T06:11:47.803012+0000","last_peered":"2024-09-13T06:11:47.803012+0000","last_clean":"2024-09-13T06:11:47.803012+0000","last_became_active":"2024-09-13T06:09:32.141009+0000","last_became_peered":"2024-09-13T06:09:32.141009+0000","last_unstale":"2024-09-13T06:11:47.803012+0000","last_undegraded":"2024-09-13T06:11:47.803012+0000","last_fullsized":"2024-09-13T06:11:47.803012+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:33:27.853475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"35'12","reported_seq":82,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.436923+0000","last_change":"2024-09-13T06:09:34.124580+0000","last_active":"2024-09-13T06:12:49.436923+0000","last_peered":"2024-09-13T06:12:49.436923+0000","last_clean":"2024-09-13T06:12:49.436923+0000","last_became_active":"2024-09-13T06:09:34.124270+0000","last_became_peered":"2024-09-13T06:09:34.124270+0000","last_unstale":"2024-09-13T06:12:49.436923+0000","last_undegraded":"2024-09-13T06:12:49.436923+0000","last_fullsized":"2024-09-13T06:12:49.436923+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:54:14.588264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:47.918751+0000","last_change":"2024-09-13T06:09:32.143000+0000","last_active":"2024-09-13T06:11:47.918751+0000","last_peered":"2024-09-13T06:11:47.918751+0000","last_clean":"2024-09-13T06:11:47.918751+0000","last_became_active":"2024-09-13T06:09:32.142581+0000","last_became_peered":"2024-09-13T06:09:32.142581+0000","last_unstale":"2024-09-13T06:11:47.918751+0000","last_undegraded":"2024-09-13T06:11:47.918751+0000","last_fullsized":"2024-09-13T06:11:47.918751+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:04:11.910433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"35'16","reported_seq":76,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.437303+0000","last_change":"2024-09-13T06:09:34.118681+0000","last_active":"2024-09-13T06:12:49.437303+0000","last_peered":"2024-09-13T06:12:49.437303+0000","last_clean":"2024-09-13T06:12:49.437303+0000","last_became_active":"2024-09-13T06:09:34.118290+0000","last_became_peered":"2024-09-13T06:09:34.118290+0000","last_unstale":"2024-09-13T06:12:49.437303+0000","last_undegraded":"2024-09-13T06:12:49.437303+0000","last_fullsized":"2024-09-13T06:12:49.437303+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:00:27.052532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":58,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.809957+0000","last_change":"2024-09-13T06:09:32.124596+0000","last_active":"2024-09-13T06:10:10.809957+0000","last_peered":"2024-09-13T06:10:10.809957+0000","last_clean":"2024-09-13T06:10:10.809957+0000","last_became_active":"2024-09-13T06:09:32.121400+0000","last_became_peered":"2024-09-13T06:09:32.121400+0000","last_unstale":"2024-09-13T06:10:10.809957+0000","last_undegraded":"2024-09-13T06:10:10.809957+0000","last_fullsized":"2024-09-13T06:10:10.809957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:19:33.910739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"35'13","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.533331+0000","last_change":"2024-09-13T06:09:34.124551+0000","last_active":"2024-09-13T06:12:49.533331+0000","last_peered":"2024-09-13T06:12:49.533331+0000","last_clean":"2024-09-13T06:12:49.533331+0000","last_became_active":"2024-09-13T06:09:34.121743+0000","last_became_peered":"2024-09-13T06:09:34.121743+0000","last_unstale":"2024-09-13T06:12:49.533331+0000","last_undegraded":"2024-09-13T06:12:49.533331+0000","last_fullsized":"2024-09-13T06:12:49.533331+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:34:44.658759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.291785+0000","last_change":"2024-09-13T06:09:32.135724+0000","last_active":"2024-09-13T06:12:49.291785+0000","last_peered":"2024-09-13T06:12:49.291785+0000","last_clean":"2024-09-13T06:12:49.291785+0000","last_became_active":"2024-09-13T06:09:32.127830+0000","last_became_peered":"2024-09-13T06:09:32.127830+0000","last_unstale":"2024-09-13T06:12:49.291785+0000","last_undegraded":"2024-09-13T06:12:49.291785+0000","last_fullsized":"2024-09-13T06:12:49.291785+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:27:43.484419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"35'4","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:19.300831+0000","last_change":"2024-09-13T06:09:34.126475+0000","last_active":"2024-09-13T06:10:19.300831+0000","last_peered":"2024-09-13T06:10:19.300831+0000","last_clean":"2024-09-13T06:10:19.300831+0000","last_became_active":"2024-09-13T06:09:34.126020+0000","last_became_peered":"2024-09-13T06:09:34.126020+0000","last_unstale":"2024-09-13T06:10:19.300831+0000","last_undegraded":"2024-09-13T06:10:19.300831+0000","last_fullsized":"2024-09-13T06:10:19.300831+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:44:39.157280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"35'1","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:51.799858+0000","last_change":"2024-09-13T06:09:32.119928+0000","last_active":"2024-09-13T06:11:51.799858+0000","last_peered":"2024-09-13T06:11:51.799858+0000","last_clean":"2024-09-13T06:11:51.799858+0000","last_became_active":"2024-09-13T06:09:32.119542+0000","last_became_peered":"2024-09-13T06:09:32.119542+0000","last_unstale":"2024-09-13T06:11:51.799858+0000","last_undegraded":"2024-09-13T06:11:51.799858+0000","last_fullsized":"2024-09-13T06:11:51.799858+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:55:55.407168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"35'6","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.513282+0000","last_change":"2024-09-13T06:09:34.118722+0000","last_active":"2024-09-13T06:12:49.513282+0000","last_peered":"2024-09-13T06:12:49.513282+0000","last_clean":"2024-09-13T06:12:49.513282+0000","last_became_active":"2024-09-13T06:09:34.110506+0000","last_became_peered":"2024-09-13T06:09:34.110506+0000","last_unstale":"2024-09-13T06:12:49.513282+0000","last_undegraded":"2024-09-13T06:12:49.513282+0000","last_fullsized":"2024-09-13T06:12:49.513282+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:22:27.348511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.818133+0000","last_change":"2024-09-13T06:09:32.130216+0000","last_active":"2024-09-13T06:10:10.818133+0000","last_peered":"2024-09-13T06:10:10.818133+0000","last_clean":"2024-09-13T06:10:10.818133+0000","last_became_active":"2024-09-13T06:09:32.121895+0000","last_became_peered":"2024-09-13T06:09:32.121895+0000","last_unstale":"2024-09-13T06:10:10.818133+0000","last_undegraded":"2024-09-13T06:10:10.818133+0000","last_fullsized":"2024-09-13T06:10:10.818133+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:31:54.248100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.802008+0000","last_change":"2024-09-13T06:09:32.132716+0000","last_active":"2024-09-13T06:10:10.802008+0000","last_peered":"2024-09-13T06:10:10.802008+0000","last_clean":"2024-09-13T06:10:10.802008+0000","last_became_active":"2024-09-13T06:09:32.130056+0000","last_became_peered":"2024-09-13T06:09:32.130056+0000","last_unstale":"2024-09-13T06:10:10.802008+0000","last_undegraded":"2024-09-13T06:10:10.802008+0000","last_fullsized":"2024-09-13T06:10:10.802008+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:57:09.275474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"35'8","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:48.958693+0000","last_change":"2024-09-13T06:09:34.132050+0000","last_active":"2024-09-13T06:12:48.958693+0000","last_peered":"2024-09-13T06:12:48.958693+0000","last_clean":"2024-09-13T06:12:48.958693+0000","last_became_active":"2024-09-13T06:09:34.130980+0000","last_became_peered":"2024-09-13T06:09:34.130980+0000","last_unstale":"2024-09-13T06:12:48.958693+0000","last_undegraded":"2024-09-13T06:12:48.958693+0000","last_fullsized":"2024-09-13T06:12:48.958693+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:11:30.370585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"33'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.944159+0000","last_change":"2024-09-13T06:09:32.152088+0000","last_active":"2024-09-13T06:10:10.944159+0000","last_peered":"2024-09-13T06:10:10.944159+0000","last_clean":"2024-09-13T06:10:10.944159+0000","last_became_active":"2024-09-13T06:09:32.149426+0000","last_became_peered":"2024-09-13T06:09:32.149426+0000","last_unstale":"2024-09-13T06:10:10.944159+0000","last_undegraded":"2024-09-13T06:10:10.944159+0000","last_fullsized":"2024-09-13T06:10:10.944159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:53:16.188364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"35'3","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:02.807090+0000","last_change":"2024-09-13T06:09:34.118994+0000","last_active":"2024-09-13T06:12:02.807090+0000","last_peered":"2024-09-13T06:12:02.807090+0000","last_clean":"2024-09-13T06:12:02.807090+0000","last_became_active":"2024-09-13T06:09:34.111230+0000","last_became_peered":"2024-09-13T06:09:34.111230+0000","last_unstale":"2024-09-13T06:12:02.807090+0000","last_undegraded":"2024-09-13T06:12:02.807090+0000","last_fullsized":"2024-09-13T06:12:02.807090+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:48:17.434872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2262,"ondisk_log_size":2262,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13384,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1414,"num_read_kb":1200,"num_write":535,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1286,"ondisk_log_size":1286,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":962,"num_read_kb":962,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1618,"num_read_kb":1508,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25809792,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":34422784,"data_stored":34422784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640309,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48392,"kb_used_data":8888,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323448,"statfs":{"total":96636764160,"available":96587210752,"internally_reserved":0,"allocated":9101312,"data_stored":8762833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640309,"num_pgs":155,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44772,"kb_used_data":9428,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327068,"statfs":{"total":96636764160,"available":96590917632,"internally_reserved":0,"allocated":9654272,"data_stored":9351111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673013,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48904,"kb_used_data":9400,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94322936,"statfs":{"total":96636764160,"available":96586686464,"internally_reserved":0,"allocated":9625600,"data_stored":9349057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705715,"num_pgs":170,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48356,"kb_used_data":8852,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323484,"statfs":{"total":96636764160,"available":96587247616,"internally_reserved":0,"allocated":9064448,"data_stored":8760119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T06:13:22.243 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T06:13:22.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:22.400+0000 7f9ff01f5640 1 Processor -- start 2024-09-13T06:13:22.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:22.400+0000 7f9ff01f5640 1 -- start start 2024-09-13T06:13:22.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:22.400+0000 7f9ff01f5640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f9fe812f390 0x7f9fe8133a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:13:22.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:22.400+0000 7f9ff01f5640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fe80984f0 con 0x7f9fe812e760 2024-09-13T06:13:22.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:22.400+0000 7f9ff01f5640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f9fe8098dc0 con 0x7f9fe812f390 2024-09-13T06:13:22.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:22.400+0000 7f9fed790640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f9fe812f390 0x7f9fe8133a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:13:22.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:22.400+0000 7f9fedf91640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f9fe812e760 0x7f9fe812ec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:34320/0 (socket says 172.21.15.120:34320) 2024-09-13T06:13:22.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:22.400+0000 7f9fedf91640 1 -- 172.21.15.120:0/8045828 learned_addr learned my addr 172.21.15.120:0/8045828 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-13T06:13:22.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:22.400+0000 7f9fed790640 1 -- 172.21.15.120:0/8045828 >> v1:172.21.15.120:6789/0 conn(0x7f9fe812e760 legacy=0x7f9fe812ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:22.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:22.400+0000 7f9fed790640 1 -- 172.21.15.120:0/8045828 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fe80981a0 con 0x7f9fe812f390 2024-09-13T06:13:22.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:22.400+0000 7f9fecf8f640 1 -- 172.21.15.120:0/8045828 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2706289590 0 0) 0x7f9fe80984f0 con 0x7f9fe812e760 2024-09-13T06:13:22.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:22.400+0000 7f9fed790640 1 --2- 172.21.15.120:0/8045828 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9fe812f390 0x7f9fe8133a80 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f9fd8009740 tx=0x7f9fd801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80d6bd88a111f2a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:13:22.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:22.400+0000 7f9fecf8f640 1 -- 172.21.15.120:0/8045828 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fd80b1070 con 0x7f9fe812f390 2024-09-13T06:13:22.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:22.400+0000 7f9fecf8f640 1 -- 172.21.15.120:0/8045828 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fd80ac570 con 0x7f9fe812f390 2024-09-13T06:13:22.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:22.400+0000 7f9fecf8f640 1 -- 172.21.15.120:0/8045828 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fd80ac870 con 0x7f9fe812f390 2024-09-13T06:13:22.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:22.404+0000 7f9ff01f5640 1 -- 172.21.15.120:0/8045828 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9fe812f390 msgr2=0x7f9fe8133a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:22.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:22.404+0000 7f9ff01f5640 1 --2- 172.21.15.120:0/8045828 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9fe812f390 0x7f9fe8133a80 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f9fd8009740 tx=0x7f9fd801c400 comp rx=0 tx=0).stop 2024-09-13T06:13:22.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:22.404+0000 7f9ff01f5640 1 -- 172.21.15.120:0/8045828 shutdown_connections 2024-09-13T06:13:22.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:22.404+0000 7f9ff01f5640 1 --2- 172.21.15.120:0/8045828 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9fe812f390 0x7f9fe8133a80 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:13:22.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:22.404+0000 7f9ff01f5640 1 -- 172.21.15.120:0/8045828 >> 172.21.15.120:0/8045828 conn(0x7f9fe80a10a0 msgr2=0x7f9fe80a14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:13:22.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:22.404+0000 7f9ff01f5640 1 -- 172.21.15.120:0/8045828 shutdown_connections 2024-09-13T06:13:22.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:22.404+0000 7f9ff01f5640 1 -- 172.21.15.120:0/8045828 wait complete. 2024-09-13T06:13:22.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:22.404+0000 7f9ff01f5640 1 Processor -- start 2024-09-13T06:13:22.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:22.404+0000 7f9ff01f5640 1 -- start start 2024-09-13T06:13:22.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:22.404+0000 7f9ff01f5640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9fe812e760 0x7f9fe812fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:13:22.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:22.404+0000 7f9ff01f5640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe8136b70 con 0x7f9fe812e760 2024-09-13T06:13:22.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:22.404+0000 7f9fedf91640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9fe812e760 0x7f9fe812fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:13:22.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:22.404+0000 7f9fedf91640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9fe812e760 0x7f9fe812fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:42804/0 (socket says 172.21.15.120:42804) 2024-09-13T06:13:22.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:22.404+0000 7f9fedf91640 1 -- 172.21.15.120:0/1460802578 learned_addr learned my addr 172.21.15.120:0/1460802578 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-13T06:13:22.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:22.404+0000 7f9fedf91640 1 -- 172.21.15.120:0/1460802578 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fe8128f50 con 0x7f9fe812e760 2024-09-13T06:13:22.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:22.404+0000 7f9fedf91640 1 --2- 172.21.15.120:0/1460802578 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9fe812e760 0x7f9fe812fa60 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f9fe400c840 tx=0x7f9fe400cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:13:22.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:22.404+0000 7f9fde7fc640 1 -- 172.21.15.120:0/1460802578 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fe4018070 con 0x7f9fe812e760 2024-09-13T06:13:22.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:22.404+0000 7f9fde7fc640 1 -- 172.21.15.120:0/1460802578 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fe400a660 con 0x7f9fe812e760 2024-09-13T06:13:22.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:22.404+0000 7f9ff01f5640 1 -- 172.21.15.120:0/1460802578 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fe8133240 con 0x7f9fe812e760 2024-09-13T06:13:22.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:22.404+0000 7f9fde7fc640 1 -- 172.21.15.120:0/1460802578 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fe400a850 con 0x7f9fe812e760 2024-09-13T06:13:22.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:22.404+0000 7f9ff01f5640 1 -- 172.21.15.120:0/1460802578 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fe8132380 con 0x7f9fe812e760 2024-09-13T06:13:22.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:22.404+0000 7f9fde7fc640 1 -- 172.21.15.120:0/1460802578 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9fe401b070 con 0x7f9fe812e760 2024-09-13T06:13:22.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:22.404+0000 7f9ff01f5640 1 -- 172.21.15.120:0/1460802578 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fe8132670 con 0x7f9fe812e760 2024-09-13T06:13:22.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:22.404+0000 7f9fde7fc640 1 --2- 172.21.15.120:0/1460802578 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f9fcc035db0 0x7f9fcc038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:13:22.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:22.404+0000 7f9fde7fc640 1 -- 172.21.15.120:0/1460802578 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f9fe40488e0 con 0x7f9fe812e760 2024-09-13T06:13:22.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:22.408+0000 7f9fed790640 1 --2- 172.21.15.120:0/1460802578 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f9fcc035db0 0x7f9fcc038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:13:22.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:22.408+0000 7f9fed790640 1 --2- 172.21.15.120:0/1460802578 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f9fcc035db0 0x7f9fcc038270 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f9fd80ae000 tx=0x7f9fd8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:13:22.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:22.412+0000 7f9fde7fc640 1 -- 172.21.15.120:0/1460802578 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9fe8132670 con 0x7f9fe812e760 2024-09-13T06:13:22.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:22.572+0000 7f9ff01f5640 1 -- 172.21.15.120:0/1460802578 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9fe8132e90 con 0x7f9fe812e760 2024-09-13T06:13:22.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:22.576+0000 7f9fde7fc640 1 -- 172.21.15.120:0/1460802578 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) ==== 74+0+21138 (secure 0 0 0) 0x7f9fe4011360 con 0x7f9fe812e760 2024-09-13T06:13:22.577 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T06:13:22.578 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":35,"fsid":"b924da04-5ce7-4b88-90c8-d1e25fda89f0","created":"2024-09-13T06:09:05.102460+0000","modified":"2024-09-13T06:10:10.785260+0000","last_up_change":"2024-09-13T06:09:17.161802+0000","last_in_change":"2024-09-13T06:09:06.306194+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T06:09:17.772771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-13T06:09:20.938823+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":18,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-13T06:09:30.104500+0000","flags":1,"flags_names":"hashpspool","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":12288,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-13T06:09:32.476218+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-13T06:09:34.368299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-13T06:09:36.312422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-13T06:09:38.220837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-13T06:09:40.358890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d4134f4-6b9e-4fcd-bf7c-0938458a015f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1923744619},{"type":"v1","addr":"172.21.15.120:6801","nonce":1923744619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1923744619},{"type":"v1","addr":"172.21.15.120:6803","nonce":1923744619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1923744619},{"type":"v1","addr":"172.21.15.120:6807","nonce":1923744619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1923744619},{"type":"v1","addr":"172.21.15.120:6805","nonce":1923744619}]},"public_addr":"172.21.15.120:6801/1923744619","cluster_addr":"172.21.15.120:6803/1923744619","heartbeat_back_addr":"172.21.15.120:6807/1923744619","heartbeat_front_addr":"172.21.15.120:6805/1923744619","state":["exists","up"]},{"osd":1,"uuid":"aca83f02-0827-44d8-b4b9-2480cce86270","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3135444559},{"type":"v1","addr":"172.21.15.194:6809","nonce":3135444559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3135444559},{"type":"v1","addr":"172.21.15.194:6811","nonce":3135444559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3135444559},{"type":"v1","addr":"172.21.15.194:6815","nonce":3135444559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3135444559},{"type":"v1","addr":"172.21.15.194:6813","nonce":3135444559}]},"public_addr":"172.21.15.194:6809/3135444559","cluster_addr":"172.21.15.194:6811/3135444559","heartbeat_back_addr":"172.21.15.194:6815/3135444559","heartbeat_front_addr":"172.21.15.194:6813/3135444559","state":["exists","up"]},{"osd":2,"uuid":"2e1a73a0-26b9-4247-acbb-15ccd2478adb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":815615585},{"type":"v1","addr":"172.21.15.194:6801","nonce":815615585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":815615585},{"type":"v1","addr":"172.21.15.194:6803","nonce":815615585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":815615585},{"type":"v1","addr":"172.21.15.194:6807","nonce":815615585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":815615585},{"type":"v1","addr":"172.21.15.194:6805","nonce":815615585}]},"public_addr":"172.21.15.194:6801/815615585","cluster_addr":"172.21.15.194:6803/815615585","heartbeat_back_addr":"172.21.15.194:6807/815615585","heartbeat_front_addr":"172.21.15.194:6805/815615585","state":["exists","up"]},{"osd":3,"uuid":"afca1e17-ff25-4f0e-9639-a9a06385b8c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":96632515},{"type":"v1","addr":"172.21.15.194:6817","nonce":96632515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":96632515},{"type":"v1","addr":"172.21.15.194:6819","nonce":96632515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":96632515},{"type":"v1","addr":"172.21.15.194:6823","nonce":96632515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":96632515},{"type":"v1","addr":"172.21.15.194:6821","nonce":96632515}]},"public_addr":"172.21.15.194:6817/96632515","cluster_addr":"172.21.15.194:6819/96632515","heartbeat_back_addr":"172.21.15.194:6823/96632515","heartbeat_front_addr":"172.21.15.194:6821/96632515","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:09:13.701094+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:09:13.837131+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:09:13.550343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:09:14.173040+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":3,"to":2}]},{"pgid":"4.6","mappings":[{"from":3,"to":2}]},{"pgid":"4.3d","mappings":[{"from":3,"to":2}]},{"pgid":"5.5","mappings":[{"from":0,"to":2}]},{"pgid":"5.b","mappings":[{"from":0,"to":2}]},{"pgid":"5.16","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"3","m":"1","name":"testprofile","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T06:13:22.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:22.576+0000 7f9ff01f5640 1 -- 172.21.15.120:0/1460802578 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f9fcc035db0 msgr2=0x7f9fcc038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:22.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:22.576+0000 7f9ff01f5640 1 --2- 172.21.15.120:0/1460802578 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f9fcc035db0 0x7f9fcc038270 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f9fd80ae000 tx=0x7f9fd8008040 comp rx=0 tx=0).stop 2024-09-13T06:13:22.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:22.580+0000 7f9ff01f5640 1 -- 172.21.15.120:0/1460802578 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9fe812e760 msgr2=0x7f9fe812fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:22.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:22.580+0000 7f9ff01f5640 1 --2- 172.21.15.120:0/1460802578 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9fe812e760 0x7f9fe812fa60 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f9fe400c840 tx=0x7f9fe400cd00 comp rx=0 tx=0).stop 2024-09-13T06:13:22.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:22.580+0000 7f9ff01f5640 1 -- 172.21.15.120:0/1460802578 shutdown_connections 2024-09-13T06:13:22.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:22.580+0000 7f9ff01f5640 1 --2- 172.21.15.120:0/1460802578 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f9fcc035db0 0x7f9fcc038270 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:13:22.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:22.580+0000 7f9ff01f5640 1 --2- 172.21.15.120:0/1460802578 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9fe812e760 0x7f9fe812fa60 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:13:22.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:22.580+0000 7f9ff01f5640 1 -- 172.21.15.120:0/1460802578 >> 172.21.15.120:0/1460802578 conn(0x7f9fe80a10a0 msgr2=0x7f9fe812c560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:13:22.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:22.580+0000 7f9ff01f5640 1 -- 172.21.15.120:0/1460802578 shutdown_connections 2024-09-13T06:13:22.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:22.580+0000 7f9ff01f5640 1 -- 172.21.15.120:0/1460802578 wait complete. 2024-09-13T06:13:23.598 INFO:tasks.ceph:Scrubbing osd.0 2024-09-13T06:13:23.598 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-13T06:13:23.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.732+0000 7f2667611640 1 Processor -- start 2024-09-13T06:13:23.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.732+0000 7f2667611640 1 -- start start 2024-09-13T06:13:23.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.732+0000 7f2667611640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f2660132090 0x7f2660134480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:13:23.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.732+0000 7f2667611640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26600992b0 con 0x7f2660099c70 2024-09-13T06:13:23.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.732+0000 7f2667611640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f266009d270 con 0x7f2660132090 2024-09-13T06:13:23.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.732+0000 7f2664bac640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f2660132090 0x7f2660134480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:13:23.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.732+0000 7f26653ad640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f2660099c70 0x7f266009a050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:57608/0 (socket says 172.21.15.120:57608) 2024-09-13T06:13:23.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.732+0000 7f26653ad640 1 -- 172.21.15.120:0/1947309674 learned_addr learned my addr 172.21.15.120:0/1947309674 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-13T06:13:23.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.732+0000 7f2657fff640 1 -- 172.21.15.120:0/1947309674 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2067720935 0 0) 0x7f26600992b0 con 0x7f2660099c70 2024-09-13T06:13:23.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.732+0000 7f2657fff640 1 -- 172.21.15.120:0/1947309674 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f264c003530 con 0x7f2660099c70 2024-09-13T06:13:23.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.732+0000 7f2664bac640 1 -- 172.21.15.120:0/1947309674 >> v1:172.21.15.120:6789/0 conn(0x7f2660099c70 legacy=0x7f266009a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:23.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.732+0000 7f2664bac640 1 -- 172.21.15.120:0/1947309674 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f266009a760 con 0x7f2660132090 2024-09-13T06:13:23.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.736+0000 7f2664bac640 1 --2- 172.21.15.120:0/1947309674 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2660132090 0x7f2660134480 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f2650009740 tx=0x7f265001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb42352f625e71af server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:13:23.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.736+0000 7f2657fff640 1 -- 172.21.15.120:0/1947309674 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26500b1070 con 0x7f2660132090 2024-09-13T06:13:23.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.736+0000 7f2657fff640 1 -- 172.21.15.120:0/1947309674 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26500ac520 con 0x7f2660132090 2024-09-13T06:13:23.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.736+0000 7f2657fff640 1 -- 172.21.15.120:0/1947309674 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26500ac820 con 0x7f2660132090 2024-09-13T06:13:23.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.736+0000 7f2667611640 1 -- 172.21.15.120:0/1947309674 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2660132090 msgr2=0x7f2660134480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:23.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.736+0000 7f2667611640 1 --2- 172.21.15.120:0/1947309674 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2660132090 0x7f2660134480 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f2650009740 tx=0x7f265001c370 comp rx=0 tx=0).stop 2024-09-13T06:13:23.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.736+0000 7f2667611640 1 -- 172.21.15.120:0/1947309674 shutdown_connections 2024-09-13T06:13:23.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.736+0000 7f2667611640 1 --2- 172.21.15.120:0/1947309674 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2660132090 0x7f2660134480 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:13:23.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.736+0000 7f2667611640 1 -- 172.21.15.120:0/1947309674 >> 172.21.15.120:0/1947309674 conn(0x7f266006d570 msgr2=0x7f266006d980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:13:23.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.736+0000 7f2667611640 1 -- 172.21.15.120:0/1947309674 shutdown_connections 2024-09-13T06:13:23.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.736+0000 7f2667611640 1 -- 172.21.15.120:0/1947309674 wait complete. 2024-09-13T06:13:23.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.736+0000 7f2667611640 1 Processor -- start 2024-09-13T06:13:23.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.736+0000 7f2667611640 1 -- start start 2024-09-13T06:13:23.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.736+0000 7f2667611640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2660099c70 0x7f26600972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:13:23.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.736+0000 7f2667611640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f26601373f0 con 0x7f2660099c70 2024-09-13T06:13:23.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.736+0000 7f26653ad640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2660099c70 0x7f26600972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:13:23.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.736+0000 7f26653ad640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2660099c70 0x7f26600972f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52744/0 (socket says 172.21.15.120:52744) 2024-09-13T06:13:23.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.736+0000 7f26653ad640 1 -- 172.21.15.120:0/220424566 learned_addr learned my addr 172.21.15.120:0/220424566 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-13T06:13:23.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.736+0000 7f26653ad640 1 -- 172.21.15.120:0/220424566 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26601314b0 con 0x7f2660099c70 2024-09-13T06:13:23.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.736+0000 7f26653ad640 1 --2- 172.21.15.120:0/220424566 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2660099c70 0x7f26600972f0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f265c00c450 tx=0x7f265c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:13:23.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.736+0000 7f2655ffb640 1 -- 172.21.15.120:0/220424566 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f265c017070 con 0x7f2660099c70 2024-09-13T06:13:23.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.736+0000 7f2655ffb640 1 -- 172.21.15.120:0/220424566 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f265c005c20 con 0x7f2660099c70 2024-09-13T06:13:23.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.736+0000 7f2667611640 1 -- 172.21.15.120:0/220424566 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2660130a50 con 0x7f2660099c70 2024-09-13T06:13:23.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.736+0000 7f2655ffb640 1 -- 172.21.15.120:0/220424566 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f265c007070 con 0x7f2660099c70 2024-09-13T06:13:23.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.736+0000 7f2667611640 1 -- 172.21.15.120:0/220424566 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2660097830 con 0x7f2660099c70 2024-09-13T06:13:23.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.740+0000 7f2667611640 1 -- 172.21.15.120:0/220424566 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f266009a050 con 0x7f2660099c70 2024-09-13T06:13:23.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.740+0000 7f2655ffb640 1 -- 172.21.15.120:0/220424566 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f265c01a070 con 0x7f2660099c70 2024-09-13T06:13:23.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.740+0000 7f2655ffb640 1 --2- 172.21.15.120:0/220424566 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f2644035db0 0x7f2644038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:13:23.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.740+0000 7f2655ffb640 1 -- 172.21.15.120:0/220424566 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f265c048430 con 0x7f2660099c70 2024-09-13T06:13:23.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.740+0000 7f2655ffb640 1 --2- 172.21.15.120:0/220424566 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f2644042200 0x7f26440446a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:13:23.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.740+0000 7f2655ffb640 1 -- 172.21.15.120:0/220424566 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2644044d70 con 0x7f2644042200 2024-09-13T06:13:23.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.740+0000 7f2655ffb640 1 -- 172.21.15.120:0/220424566 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f265c04f050 con 0x7f2660099c70 2024-09-13T06:13:23.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.740+0000 7f2665bae640 1 --2- 172.21.15.120:0/220424566 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f2644042200 0x7f26440446a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:13:23.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.740+0000 7f2664bac640 1 --2- 172.21.15.120:0/220424566 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f2644035db0 0x7f2644038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:13:23.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.740+0000 7f2665bae640 1 --2- 172.21.15.120:0/220424566 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f2644042200 0x7f26440446a0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:13:23.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.740+0000 7f2664bac640 1 --2- 172.21.15.120:0/220424566 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f2644035db0 0x7f2644038270 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f2650009740 tx=0x7f26500a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:13:23.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.740+0000 7f2655ffb640 1 -- 172.21.15.120:0/220424566 <== osd.0 v2:172.21.15.120:6800/1923744619 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2644044d70 con 0x7f2644042200 2024-09-13T06:13:23.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.752+0000 7f2667611640 1 -- 172.21.15.120:0/220424566 --> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f26601300f0 con 0x7f2644042200 2024-09-13T06:13:23.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.752+0000 7f2655ffb640 1 -- 172.21.15.120:0/220424566 <== osd.0 v2:172.21.15.120:6800/1923744619 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f26601300f0 con 0x7f2644042200 2024-09-13T06:13:23.755 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T06:13:23.755 INFO:teuthology.orchestra.run.smithi120.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T06:13:23.755 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T06:13:23.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.752+0000 7f2667611640 1 -- 172.21.15.120:0/220424566 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f2644042200 msgr2=0x7f26440446a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:23.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.752+0000 7f2667611640 1 --2- 172.21.15.120:0/220424566 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f2644042200 0x7f26440446a0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:13:23.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.752+0000 7f2667611640 1 -- 172.21.15.120:0/220424566 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f2644035db0 msgr2=0x7f2644038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:23.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.752+0000 7f2667611640 1 --2- 172.21.15.120:0/220424566 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f2644035db0 0x7f2644038270 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f2650009740 tx=0x7f26500a7000 comp rx=0 tx=0).stop 2024-09-13T06:13:23.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.752+0000 7f2667611640 1 -- 172.21.15.120:0/220424566 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2660099c70 msgr2=0x7f26600972f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:23.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.752+0000 7f2667611640 1 --2- 172.21.15.120:0/220424566 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2660099c70 0x7f26600972f0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f265c00c450 tx=0x7f265c00c910 comp rx=0 tx=0).stop 2024-09-13T06:13:23.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.752+0000 7f2667611640 1 -- 172.21.15.120:0/220424566 shutdown_connections 2024-09-13T06:13:23.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.752+0000 7f2667611640 1 --2- 172.21.15.120:0/220424566 >> [v2:172.21.15.120:6800/1923744619,v1:172.21.15.120:6801/1923744619] conn(0x7f2644042200 0x7f26440446a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:13:23.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.752+0000 7f2667611640 1 --2- 172.21.15.120:0/220424566 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f2644035db0 0x7f2644038270 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:13:23.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.752+0000 7f2667611640 1 --2- 172.21.15.120:0/220424566 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2660099c70 0x7f26600972f0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:13:23.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.752+0000 7f2667611640 1 -- 172.21.15.120:0/220424566 >> 172.21.15.120:0/220424566 conn(0x7f266006d570 msgr2=0x7f2660132fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:13:23.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.752+0000 7f2667611640 1 -- 172.21.15.120:0/220424566 shutdown_connections 2024-09-13T06:13:23.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.752+0000 7f2667611640 1 -- 172.21.15.120:0/220424566 wait complete. 2024-09-13T06:13:23.770 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-13T06:13:23.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.884+0000 7f0181b84640 1 Processor -- start 2024-09-13T06:13:23.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.884+0000 7f0181b84640 1 -- start start 2024-09-13T06:13:23.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.884+0000 7f0181b84640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f017c12e760 0x7f017c12ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:13:23.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.884+0000 7f0181b84640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f017c0984f0 con 0x7f017c12f1c0 2024-09-13T06:13:23.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.884+0000 7f0181b84640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f017c098dc0 con 0x7f017c12e760 2024-09-13T06:13:23.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.884+0000 7f017b7fe640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f017c12e760 0x7f017c12ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:13:23.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.884+0000 7f017affd640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f017c12f1c0 0x7f017c12b260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:57618/0 (socket says 172.21.15.120:57618) 2024-09-13T06:13:23.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.884+0000 7f017affd640 1 -- 172.21.15.120:0/2677294416 learned_addr learned my addr 172.21.15.120:0/2677294416 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-13T06:13:23.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.884+0000 7f017b7fe640 1 -- 172.21.15.120:0/2677294416 >> v1:172.21.15.120:6789/0 conn(0x7f017c12f1c0 legacy=0x7f017c12b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:23.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.884+0000 7f017b7fe640 1 -- 172.21.15.120:0/2677294416 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f017c12f5a0 con 0x7f017c12e760 2024-09-13T06:13:23.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.888+0000 7f017b7fe640 1 --2- 172.21.15.120:0/2677294416 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f017c12e760 0x7f017c12ec80 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f016c009740 tx=0x7f016c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e376ca0089b8611a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:13:23.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.888+0000 7f017a7fc640 1 -- 172.21.15.120:0/2677294416 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f016c0b0070 con 0x7f017c12e760 2024-09-13T06:13:23.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.888+0000 7f017a7fc640 1 -- 172.21.15.120:0/2677294416 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f016c0ab530 con 0x7f017c12e760 2024-09-13T06:13:23.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.888+0000 7f017a7fc640 1 -- 172.21.15.120:0/2677294416 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f016c0ab830 con 0x7f017c12e760 2024-09-13T06:13:23.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.888+0000 7f0181b84640 1 -- 172.21.15.120:0/2677294416 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f017c12e760 msgr2=0x7f017c12ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:23.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.888+0000 7f0181b84640 1 --2- 172.21.15.120:0/2677294416 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f017c12e760 0x7f017c12ec80 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f016c009740 tx=0x7f016c01c400 comp rx=0 tx=0).stop 2024-09-13T06:13:23.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.888+0000 7f0181b84640 1 -- 172.21.15.120:0/2677294416 shutdown_connections 2024-09-13T06:13:23.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.888+0000 7f0181b84640 1 --2- 172.21.15.120:0/2677294416 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f017c12e760 0x7f017c12ec80 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:13:23.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.888+0000 7f0181b84640 1 -- 172.21.15.120:0/2677294416 >> 172.21.15.120:0/2677294416 conn(0x7f017c0a10a0 msgr2=0x7f017c0a14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:13:23.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.888+0000 7f0181b84640 1 -- 172.21.15.120:0/2677294416 shutdown_connections 2024-09-13T06:13:23.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.888+0000 7f0181b84640 1 -- 172.21.15.120:0/2677294416 wait complete. 2024-09-13T06:13:23.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.888+0000 7f0181b84640 1 Processor -- start 2024-09-13T06:13:23.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.888+0000 7f0181b84640 1 -- start start 2024-09-13T06:13:23.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.888+0000 7f0181b84640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f017c12e760 0x7f017c09c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:13:23.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.888+0000 7f0181b84640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f017c136e30 con 0x7f017c12e760 2024-09-13T06:13:23.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.888+0000 7f017b7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f017c12e760 0x7f017c09c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:13:23.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.888+0000 7f017b7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f017c12e760 0x7f017c09c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52762/0 (socket says 172.21.15.120:52762) 2024-09-13T06:13:23.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.888+0000 7f017b7fe640 1 -- 172.21.15.120:0/1124005982 learned_addr learned my addr 172.21.15.120:0/1124005982 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-13T06:13:23.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.888+0000 7f017b7fe640 1 -- 172.21.15.120:0/1124005982 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f017c130510 con 0x7f017c12e760 2024-09-13T06:13:23.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.888+0000 7f017b7fe640 1 --2- 172.21.15.120:0/1124005982 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f017c12e760 0x7f017c09c920 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f016c01a030 tx=0x7f016c01ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:13:23.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.888+0000 7f0173fff640 1 -- 172.21.15.120:0/1124005982 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f016c0b0050 con 0x7f017c12e760 2024-09-13T06:13:23.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.888+0000 7f0173fff640 1 -- 172.21.15.120:0/1124005982 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f016c0b1040 con 0x7f017c12e760 2024-09-13T06:13:23.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.888+0000 7f0181b84640 1 -- 172.21.15.120:0/1124005982 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f017c130c10 con 0x7f017c12e760 2024-09-13T06:13:23.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.888+0000 7f0173fff640 1 -- 172.21.15.120:0/1124005982 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f016c0b5740 con 0x7f017c12e760 2024-09-13T06:13:23.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.888+0000 7f0181b84640 1 -- 172.21.15.120:0/1124005982 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f017c09ce60 con 0x7f017c12e760 2024-09-13T06:13:23.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.892+0000 7f0173fff640 1 -- 172.21.15.120:0/1124005982 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f016c0be030 con 0x7f017c12e760 2024-09-13T06:13:23.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.892+0000 7f0181b84640 1 -- 172.21.15.120:0/1124005982 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f017c09e3a0 con 0x7f017c12e760 2024-09-13T06:13:23.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.892+0000 7f0173fff640 1 --2- 172.21.15.120:0/1124005982 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f015c035db0 0x7f015c038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:13:23.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.892+0000 7f0173fff640 1 -- 172.21.15.120:0/1124005982 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f016c0bc070 con 0x7f017c12e760 2024-09-13T06:13:23.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.892+0000 7f017affd640 1 --2- 172.21.15.120:0/1124005982 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f015c035db0 0x7f015c038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:13:23.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.892+0000 7f017affd640 1 --2- 172.21.15.120:0/1124005982 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f015c035db0 0x7f015c038270 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f0164005890 tx=0x7f0164007a90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:13:23.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:23.896+0000 7f0173fff640 1 -- 172.21.15.120:0/1124005982 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f016c0c5020 con 0x7f017c12e760 2024-09-13T06:13:24.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.052+0000 7f0181b84640 1 -- 172.21.15.120:0/1124005982 --> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f017c130780 con 0x7f015c035db0 2024-09-13T06:13:24.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.052+0000 7f0173fff640 1 -- 172.21.15.120:0/1124005982 <== mgr.4100 v2:172.21.15.194:6824/3475680902 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f0164001c00 con 0x7f015c035db0 2024-09-13T06:13:24.054 INFO:teuthology.orchestra.run.smithi120.stderr:instructed osd(s) 0 to deep-scrub 2024-09-13T06:13:24.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.056+0000 7f0181b84640 1 -- 172.21.15.120:0/1124005982 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f015c035db0 msgr2=0x7f015c038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:24.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.056+0000 7f0181b84640 1 --2- 172.21.15.120:0/1124005982 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f015c035db0 0x7f015c038270 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f0164005890 tx=0x7f0164007a90 comp rx=0 tx=0).stop 2024-09-13T06:13:24.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.056+0000 7f0181b84640 1 -- 172.21.15.120:0/1124005982 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f017c12e760 msgr2=0x7f017c09c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:24.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.056+0000 7f0181b84640 1 --2- 172.21.15.120:0/1124005982 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f017c12e760 0x7f017c09c920 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f016c01a030 tx=0x7f016c01ac40 comp rx=0 tx=0).stop 2024-09-13T06:13:24.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.056+0000 7f0181b84640 1 -- 172.21.15.120:0/1124005982 shutdown_connections 2024-09-13T06:13:24.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.056+0000 7f0181b84640 1 --2- 172.21.15.120:0/1124005982 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f015c035db0 0x7f015c038270 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:13:24.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.056+0000 7f0181b84640 1 --2- 172.21.15.120:0/1124005982 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f017c12e760 0x7f017c09c920 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:13:24.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.056+0000 7f0181b84640 1 -- 172.21.15.120:0/1124005982 >> 172.21.15.120:0/1124005982 conn(0x7f017c0a10a0 msgr2=0x7f017c095280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:13:24.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.056+0000 7f0181b84640 1 -- 172.21.15.120:0/1124005982 shutdown_connections 2024-09-13T06:13:24.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.056+0000 7f0181b84640 1 -- 172.21.15.120:0/1124005982 wait complete. 2024-09-13T06:13:24.071 INFO:tasks.ceph:Scrubbing osd.1 2024-09-13T06:13:24.071 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-13T06:13:24.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.192+0000 7fe1f035e640 1 Processor -- start 2024-09-13T06:13:24.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.192+0000 7fe1f035e640 1 -- start start 2024-09-13T06:13:24.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.192+0000 7fe1f035e640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe1e806dc60 0x7fe1e8131b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:13:24.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.192+0000 7fe1f035e640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1e8098840 con 0x7fe1e806d170 2024-09-13T06:13:24.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.192+0000 7fe1f035e640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fe1e80709c0 con 0x7fe1e806dc60 2024-09-13T06:13:24.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.192+0000 7fe1ee0fa640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fe1e806d170 0x7fe1e806d550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:57622/0 (socket says 172.21.15.120:57622) 2024-09-13T06:13:24.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.192+0000 7fe1ee0fa640 1 -- 172.21.15.120:0/274963499 learned_addr learned my addr 172.21.15.120:0/274963499 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-13T06:13:24.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.192+0000 7fe1ed8f9640 1 --2- 172.21.15.120:0/274963499 >> v2:172.21.15.120:3300/0 conn(0x7fe1e806dc60 0x7fe1e8131b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:13:24.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.192+0000 7fe1ed0f8640 1 -- 172.21.15.120:0/274963499 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2554536387 0 0) 0x7fe1e8098840 con 0x7fe1e806d170 2024-09-13T06:13:24.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.192+0000 7fe1ed0f8640 1 -- 172.21.15.120:0/274963499 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1d4003530 con 0x7fe1e806d170 2024-09-13T06:13:24.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.192+0000 7fe1ed8f9640 1 -- 172.21.15.120:0/274963499 >> v1:172.21.15.120:6789/0 conn(0x7fe1e806d170 legacy=0x7fe1e806d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:24.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.192+0000 7fe1ed8f9640 1 -- 172.21.15.120:0/274963499 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1e8071e20 con 0x7fe1e806dc60 2024-09-13T06:13:24.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.196+0000 7fe1ed8f9640 1 --2- 172.21.15.120:0/274963499 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1e806dc60 0x7fe1e8131b40 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fe1d8009740 tx=0x7fe1d801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5442c0f9840cd1a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:13:24.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.196+0000 7fe1ed0f8640 1 -- 172.21.15.120:0/274963499 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1d80b0070 con 0x7fe1e806dc60 2024-09-13T06:13:24.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.196+0000 7fe1ed0f8640 1 -- 172.21.15.120:0/274963499 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1d80ab530 con 0x7fe1e806dc60 2024-09-13T06:13:24.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.196+0000 7fe1ed0f8640 1 -- 172.21.15.120:0/274963499 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1d80ab830 con 0x7fe1e806dc60 2024-09-13T06:13:24.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.196+0000 7fe1f035e640 1 -- 172.21.15.120:0/274963499 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1e806dc60 msgr2=0x7fe1e8131b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:24.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.196+0000 7fe1f035e640 1 --2- 172.21.15.120:0/274963499 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1e806dc60 0x7fe1e8131b40 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fe1d8009740 tx=0x7fe1d801c370 comp rx=0 tx=0).stop 2024-09-13T06:13:24.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.196+0000 7fe1f035e640 1 -- 172.21.15.120:0/274963499 shutdown_connections 2024-09-13T06:13:24.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.196+0000 7fe1f035e640 1 --2- 172.21.15.120:0/274963499 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1e806dc60 0x7fe1e8131b40 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:13:24.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.196+0000 7fe1f035e640 1 -- 172.21.15.120:0/274963499 >> 172.21.15.120:0/274963499 conn(0x7fe1e80998a0 msgr2=0x7fe1e8099cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:13:24.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.196+0000 7fe1f035e640 1 -- 172.21.15.120:0/274963499 shutdown_connections 2024-09-13T06:13:24.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.196+0000 7fe1f035e640 1 -- 172.21.15.120:0/274963499 wait complete. 2024-09-13T06:13:24.197 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-09-13T06:13:24.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.196+0000 7fe1f035e640 1 Processor -- start 2024-09-13T06:13:24.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.196+0000 7fe1f035e640 1 -- start start 2024-09-13T06:13:24.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.196+0000 7fe1f035e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1e806d170 0x7fe1e812e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:13:24.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.196+0000 7fe1f035e640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e8134c30 con 0x7fe1e806d170 2024-09-13T06:13:24.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.196+0000 7fe1ee0fa640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1e806d170 0x7fe1e812e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:13:24.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.196+0000 7fe1ee0fa640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1e806d170 0x7fe1e812e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52780/0 (socket says 172.21.15.120:52780) 2024-09-13T06:13:24.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.196+0000 7fe1ee0fa640 1 -- 172.21.15.120:0/3217281362 learned_addr learned my addr 172.21.15.120:0/3217281362 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-13T06:13:24.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.196+0000 7fe1ee0fa640 1 -- 172.21.15.120:0/3217281362 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1e80723e0 con 0x7fe1e806d170 2024-09-13T06:13:24.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.196+0000 7fe1ee0fa640 1 --2- 172.21.15.120:0/3217281362 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1e806d170 0x7fe1e812e7d0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fe1e000c3d0 tx=0x7fe1e000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:13:24.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.196+0000 7fe1deffd640 1 -- 172.21.15.120:0/3217281362 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1e0017070 con 0x7fe1e806d170 2024-09-13T06:13:24.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.196+0000 7fe1deffd640 1 -- 172.21.15.120:0/3217281362 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1e0005ce0 con 0x7fe1e806d170 2024-09-13T06:13:24.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.196+0000 7fe1deffd640 1 -- 172.21.15.120:0/3217281362 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1e00070d0 con 0x7fe1e806d170 2024-09-13T06:13:24.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.196+0000 7fe1f035e640 1 -- 172.21.15.120:0/3217281362 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1e8095af0 con 0x7fe1e806d170 2024-09-13T06:13:24.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.196+0000 7fe1f035e640 1 -- 172.21.15.120:0/3217281362 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1e812ed10 con 0x7fe1e806d170 2024-09-13T06:13:24.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.200+0000 7fe1f035e640 1 -- 172.21.15.120:0/3217281362 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe1e806d550 con 0x7fe1e806d170 2024-09-13T06:13:24.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.200+0000 7fe1deffd640 1 -- 172.21.15.120:0/3217281362 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe1e001a070 con 0x7fe1e806d170 2024-09-13T06:13:24.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.200+0000 7fe1deffd640 1 --2- 172.21.15.120:0/3217281362 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fe1cc035db0 0x7fe1cc038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:13:24.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.200+0000 7fe1deffd640 1 -- 172.21.15.120:0/3217281362 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fe1e00485b0 con 0x7fe1e806d170 2024-09-13T06:13:24.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.200+0000 7fe1deffd640 1 --2- 172.21.15.120:0/3217281362 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x7fe1cc0421a0 0x7fe1cc044640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:13:24.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.200+0000 7fe1deffd640 1 -- 172.21.15.120:0/3217281362 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe1e0016ec0 con 0x7fe1cc0421a0 2024-09-13T06:13:24.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.200+0000 7fe1deffd640 1 -- 172.21.15.120:0/3217281362 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fe1e004f050 con 0x7fe1e806d170 2024-09-13T06:13:24.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.200+0000 7fe1ed8f9640 1 --2- 172.21.15.120:0/3217281362 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fe1cc035db0 0x7fe1cc038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:13:24.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.200+0000 7fe1ee8fb640 1 --2- 172.21.15.120:0/3217281362 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x7fe1cc0421a0 0x7fe1cc044640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:13:24.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.200+0000 7fe1ee8fb640 1 --2- 172.21.15.120:0/3217281362 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x7fe1cc0421a0 0x7fe1cc044640 crc :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:13:24.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.200+0000 7fe1ed8f9640 1 --2- 172.21.15.120:0/3217281362 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fe1cc035db0 0x7fe1cc038270 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fe1d80ad000 tx=0x7fe1d8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:13:24.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.200+0000 7fe1deffd640 1 -- 172.21.15.120:0/3217281362 <== osd.1 v2:172.21.15.194:6808/3135444559 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe1e0016ec0 con 0x7fe1cc0421a0 2024-09-13T06:13:24.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.216+0000 7fe1f035e640 1 -- 172.21.15.120:0/3217281362 --> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe1e8074a40 con 0x7fe1cc0421a0 2024-09-13T06:13:24.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.216+0000 7fe1deffd640 1 -- 172.21.15.120:0/3217281362 <== osd.1 v2:172.21.15.194:6808/3135444559 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fe1e8074a40 con 0x7fe1cc0421a0 2024-09-13T06:13:24.217 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T06:13:24.217 INFO:teuthology.orchestra.run.smithi120.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T06:13:24.217 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T06:13:24.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.216+0000 7fe1f035e640 1 -- 172.21.15.120:0/3217281362 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x7fe1cc0421a0 msgr2=0x7fe1cc044640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:24.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.216+0000 7fe1f035e640 1 --2- 172.21.15.120:0/3217281362 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x7fe1cc0421a0 0x7fe1cc044640 crc :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:13:24.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.216+0000 7fe1f035e640 1 -- 172.21.15.120:0/3217281362 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fe1cc035db0 msgr2=0x7fe1cc038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:24.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.216+0000 7fe1f035e640 1 --2- 172.21.15.120:0/3217281362 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fe1cc035db0 0x7fe1cc038270 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fe1d80ad000 tx=0x7fe1d8008040 comp rx=0 tx=0).stop 2024-09-13T06:13:24.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.216+0000 7fe1f035e640 1 -- 172.21.15.120:0/3217281362 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1e806d170 msgr2=0x7fe1e812e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:24.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.216+0000 7fe1f035e640 1 --2- 172.21.15.120:0/3217281362 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1e806d170 0x7fe1e812e7d0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fe1e000c3d0 tx=0x7fe1e000c890 comp rx=0 tx=0).stop 2024-09-13T06:13:24.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.216+0000 7fe1f035e640 1 -- 172.21.15.120:0/3217281362 shutdown_connections 2024-09-13T06:13:24.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.216+0000 7fe1f035e640 1 --2- 172.21.15.120:0/3217281362 >> [v2:172.21.15.194:6808/3135444559,v1:172.21.15.194:6809/3135444559] conn(0x7fe1cc0421a0 0x7fe1cc044640 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:13:24.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.216+0000 7fe1f035e640 1 --2- 172.21.15.120:0/3217281362 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fe1cc035db0 0x7fe1cc038270 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:13:24.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.216+0000 7fe1f035e640 1 --2- 172.21.15.120:0/3217281362 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1e806d170 0x7fe1e812e7d0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:13:24.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.216+0000 7fe1f035e640 1 -- 172.21.15.120:0/3217281362 >> 172.21.15.120:0/3217281362 conn(0x7fe1e80998a0 msgr2=0x7fe1e808cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:13:24.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.216+0000 7fe1f035e640 1 -- 172.21.15.120:0/3217281362 shutdown_connections 2024-09-13T06:13:24.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.216+0000 7fe1f035e640 1 -- 172.21.15.120:0/3217281362 wait complete. 2024-09-13T06:13:24.231 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-13T06:13:24.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.344+0000 7f44e7382640 1 Processor -- start 2024-09-13T06:13:24.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.344+0000 7f44e7382640 1 -- start start 2024-09-13T06:13:24.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.344+0000 7f44e7382640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f44e006f190 0x7f44e0072b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:13:24.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.344+0000 7f44e7382640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44e006fa30 con 0x7f44e0072760 2024-09-13T06:13:24.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.344+0000 7f44e7382640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f44e006e800 con 0x7f44e006f190 2024-09-13T06:13:24.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.344+0000 7f44e511e640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f44e0072760 0x7f44e006d0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:57636/0 (socket says 172.21.15.120:57636) 2024-09-13T06:13:24.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.344+0000 7f44e511e640 1 -- 172.21.15.120:0/2253560268 learned_addr learned my addr 172.21.15.120:0/2253560268 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-13T06:13:24.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.344+0000 7f44e491d640 1 --2- 172.21.15.120:0/2253560268 >> v2:172.21.15.120:3300/0 conn(0x7f44e006f190 0x7f44e0072b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:13:24.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.344+0000 7f44e491d640 1 -- 172.21.15.120:0/2253560268 >> v1:172.21.15.120:6789/0 conn(0x7f44e0072760 legacy=0x7f44e006d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:24.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.344+0000 7f44e491d640 1 -- 172.21.15.120:0/2253560268 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44e006fd40 con 0x7f44e006f190 2024-09-13T06:13:24.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.344+0000 7f44e491d640 1 --2- 172.21.15.120:0/2253560268 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44e006f190 0x7f44e0072b40 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f44dc009740 tx=0x7f44dc01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d30c4fad4e5839a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:13:24.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.344+0000 7f44d7fff640 1 -- 172.21.15.120:0/2253560268 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44dc0b0070 con 0x7f44e006f190 2024-09-13T06:13:24.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.348+0000 7f44d7fff640 1 -- 172.21.15.120:0/2253560268 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44dc0ab530 con 0x7f44e006f190 2024-09-13T06:13:24.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.348+0000 7f44d7fff640 1 -- 172.21.15.120:0/2253560268 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44dc0ab830 con 0x7f44e006f190 2024-09-13T06:13:24.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.348+0000 7f44e7382640 1 -- 172.21.15.120:0/2253560268 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44e006f190 msgr2=0x7f44e0072b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:24.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.348+0000 7f44e7382640 1 --2- 172.21.15.120:0/2253560268 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44e006f190 0x7f44e0072b40 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f44dc009740 tx=0x7f44dc01c370 comp rx=0 tx=0).stop 2024-09-13T06:13:24.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.348+0000 7f44e7382640 1 -- 172.21.15.120:0/2253560268 shutdown_connections 2024-09-13T06:13:24.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.348+0000 7f44e7382640 1 --2- 172.21.15.120:0/2253560268 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44e006f190 0x7f44e0072b40 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:13:24.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.348+0000 7f44e7382640 1 -- 172.21.15.120:0/2253560268 >> 172.21.15.120:0/2253560268 conn(0x7f44e0099a50 msgr2=0x7f44e00972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:13:24.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.348+0000 7f44e7382640 1 -- 172.21.15.120:0/2253560268 shutdown_connections 2024-09-13T06:13:24.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.348+0000 7f44e7382640 1 -- 172.21.15.120:0/2253560268 wait complete. 2024-09-13T06:13:24.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.348+0000 7f44e7382640 1 Processor -- start 2024-09-13T06:13:24.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.348+0000 7f44e7382640 1 -- start start 2024-09-13T06:13:24.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.348+0000 7f44e7382640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44e006f190 0x7f44e0121e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:13:24.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.348+0000 7f44e7382640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f44e0137620 con 0x7f44e006f190 2024-09-13T06:13:24.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.348+0000 7f44e511e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44e006f190 0x7f44e0121e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:13:24.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.348+0000 7f44e511e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44e006f190 0x7f44e0121e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52788/0 (socket says 172.21.15.120:52788) 2024-09-13T06:13:24.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.348+0000 7f44e511e640 1 -- 172.21.15.120:0/2421468798 learned_addr learned my addr 172.21.15.120:0/2421468798 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-13T06:13:24.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.348+0000 7f44e511e640 1 -- 172.21.15.120:0/2421468798 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44e0123ae0 con 0x7f44e006f190 2024-09-13T06:13:24.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.348+0000 7f44e511e640 1 --2- 172.21.15.120:0/2421468798 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44e006f190 0x7f44e0121e30 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f44d000c480 tx=0x7f44d000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:13:24.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.348+0000 7f44d5ffb640 1 -- 172.21.15.120:0/2421468798 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44d0017070 con 0x7f44e006f190 2024-09-13T06:13:24.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.348+0000 7f44d5ffb640 1 -- 172.21.15.120:0/2421468798 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44d0005c20 con 0x7f44e006f190 2024-09-13T06:13:24.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.348+0000 7f44e7382640 1 -- 172.21.15.120:0/2421468798 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44e0125010 con 0x7f44e006f190 2024-09-13T06:13:24.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.348+0000 7f44d5ffb640 1 -- 172.21.15.120:0/2421468798 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44d0007070 con 0x7f44e006f190 2024-09-13T06:13:24.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.348+0000 7f44e7382640 1 -- 172.21.15.120:0/2421468798 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44e0124770 con 0x7f44e006f190 2024-09-13T06:13:24.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.348+0000 7f44e7382640 1 -- 172.21.15.120:0/2421468798 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44e0073790 con 0x7f44e006f190 2024-09-13T06:13:24.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.348+0000 7f44d5ffb640 1 -- 172.21.15.120:0/2421468798 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f44d001a070 con 0x7f44e006f190 2024-09-13T06:13:24.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.348+0000 7f44d5ffb640 1 --2- 172.21.15.120:0/2421468798 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f44c4035db0 0x7f44c4038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:13:24.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.348+0000 7f44d5ffb640 1 -- 172.21.15.120:0/2421468798 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f44d0048460 con 0x7f44e006f190 2024-09-13T06:13:24.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.352+0000 7f44e491d640 1 --2- 172.21.15.120:0/2421468798 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f44c4035db0 0x7f44c4038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:13:24.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.352+0000 7f44e491d640 1 --2- 172.21.15.120:0/2421468798 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f44c4035db0 0x7f44c4038270 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f44dc0ad000 tx=0x7f44dc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:13:24.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.356+0000 7f44d5ffb640 1 -- 172.21.15.120:0/2421468798 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f44d0007210 con 0x7f44e006f190 2024-09-13T06:13:24.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.516+0000 7f44e7382640 1 -- 172.21.15.120:0/2421468798 --> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f44e006e3b0 con 0x7f44c4035db0 2024-09-13T06:13:24.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.516+0000 7f44d5ffb640 1 -- 172.21.15.120:0/2421468798 <== mgr.4100 v2:172.21.15.194:6824/3475680902 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f44e006e3b0 con 0x7f44c4035db0 2024-09-13T06:13:24.517 INFO:teuthology.orchestra.run.smithi120.stderr:instructed osd(s) 1 to deep-scrub 2024-09-13T06:13:24.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.520+0000 7f44e7382640 1 -- 172.21.15.120:0/2421468798 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f44c4035db0 msgr2=0x7f44c4038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:24.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.520+0000 7f44e7382640 1 --2- 172.21.15.120:0/2421468798 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f44c4035db0 0x7f44c4038270 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f44dc0ad000 tx=0x7f44dc008040 comp rx=0 tx=0).stop 2024-09-13T06:13:24.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.520+0000 7f44e7382640 1 -- 172.21.15.120:0/2421468798 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44e006f190 msgr2=0x7f44e0121e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:24.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.520+0000 7f44e7382640 1 --2- 172.21.15.120:0/2421468798 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44e006f190 0x7f44e0121e30 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f44d000c480 tx=0x7f44d000c940 comp rx=0 tx=0).stop 2024-09-13T06:13:24.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.520+0000 7f44e7382640 1 -- 172.21.15.120:0/2421468798 shutdown_connections 2024-09-13T06:13:24.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.520+0000 7f44e7382640 1 --2- 172.21.15.120:0/2421468798 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f44c4035db0 0x7f44c4038270 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:13:24.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.520+0000 7f44e7382640 1 --2- 172.21.15.120:0/2421468798 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44e006f190 0x7f44e0121e30 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:13:24.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.520+0000 7f44e7382640 1 -- 172.21.15.120:0/2421468798 >> 172.21.15.120:0/2421468798 conn(0x7f44e0099a50 msgr2=0x7f44e0070c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:13:24.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.520+0000 7f44e7382640 1 -- 172.21.15.120:0/2421468798 shutdown_connections 2024-09-13T06:13:24.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.520+0000 7f44e7382640 1 -- 172.21.15.120:0/2421468798 wait complete. 2024-09-13T06:13:24.536 INFO:tasks.ceph:Scrubbing osd.2 2024-09-13T06:13:24.536 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-13T06:13:24.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.656+0000 7f729563e640 1 Processor -- start 2024-09-13T06:13:24.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.656+0000 7f729563e640 1 -- start start 2024-09-13T06:13:24.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.660+0000 7f729563e640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f729006bc50 0x7f729006c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:13:24.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.660+0000 7f729563e640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7290073360 con 0x7f729006c570 2024-09-13T06:13:24.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.660+0000 7f729563e640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f7290072600 con 0x7f729006bc50 2024-09-13T06:13:24.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.660+0000 7f728effd640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f729006bc50 0x7f729006c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:13:24.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.660+0000 7f728effd640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f729006bc50 0x7f729006c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52790/0 (socket says 172.21.15.120:52790) 2024-09-13T06:13:24.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.660+0000 7f728e7fc640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f729006c570 0x7f729012ccd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:57652/0 (socket says 172.21.15.120:57652) 2024-09-13T06:13:24.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.660+0000 7f728effd640 1 -- 172.21.15.120:0/3465178905 learned_addr learned my addr 172.21.15.120:0/3465178905 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-13T06:13:24.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.660+0000 7f728effd640 1 -- 172.21.15.120:0/3465178905 >> v1:172.21.15.120:6789/0 conn(0x7f729006c570 legacy=0x7f729012ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:24.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.660+0000 7f728effd640 1 -- 172.21.15.120:0/3465178905 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f729009afe0 con 0x7f729006bc50 2024-09-13T06:13:24.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.660+0000 7f728effd640 1 --2- 172.21.15.120:0/3465178905 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f729006bc50 0x7f729006c030 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f7280009e50 tx=0x7f728001c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb412b69fa119e80 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:13:24.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.660+0000 7f728dffb640 1 -- 172.21.15.120:0/3465178905 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7280009200 con 0x7f729006bc50 2024-09-13T06:13:24.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.660+0000 7f728dffb640 1 -- 172.21.15.120:0/3465178905 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72800a55f0 con 0x7f729006bc50 2024-09-13T06:13:24.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.660+0000 7f728dffb640 1 -- 172.21.15.120:0/3465178905 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72800a58f0 con 0x7f729006bc50 2024-09-13T06:13:24.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.660+0000 7f729563e640 1 -- 172.21.15.120:0/3465178905 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f729006bc50 msgr2=0x7f729006c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:24.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.660+0000 7f729563e640 1 --2- 172.21.15.120:0/3465178905 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f729006bc50 0x7f729006c030 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f7280009e50 tx=0x7f728001c980 comp rx=0 tx=0).stop 2024-09-13T06:13:24.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.660+0000 7f729563e640 1 -- 172.21.15.120:0/3465178905 shutdown_connections 2024-09-13T06:13:24.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.660+0000 7f729563e640 1 --2- 172.21.15.120:0/3465178905 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f729006bc50 0x7f729006c030 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:13:24.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.660+0000 7f729563e640 1 -- 172.21.15.120:0/3465178905 >> 172.21.15.120:0/3465178905 conn(0x7f729009e170 msgr2=0x7f729009a670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:13:24.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.660+0000 7f729563e640 1 -- 172.21.15.120:0/3465178905 shutdown_connections 2024-09-13T06:13:24.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.660+0000 7f729563e640 1 -- 172.21.15.120:0/3465178905 wait complete. 2024-09-13T06:13:24.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.664+0000 7f729563e640 1 Processor -- start 2024-09-13T06:13:24.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.664+0000 7f729563e640 1 -- start start 2024-09-13T06:13:24.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.664+0000 7f729563e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f729006bc50 0x7f72901c65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:13:24.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.664+0000 7f729563e640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f72901352c0 con 0x7f729006bc50 2024-09-13T06:13:24.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.664+0000 7f728effd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f729006bc50 0x7f72901c65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:13:24.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.664+0000 7f728effd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f729006bc50 0x7f72901c65f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52796/0 (socket says 172.21.15.120:52796) 2024-09-13T06:13:24.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.664+0000 7f728effd640 1 -- 172.21.15.120:0/1626662741 learned_addr learned my addr 172.21.15.120:0/1626662741 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-13T06:13:24.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.664+0000 7f728effd640 1 -- 172.21.15.120:0/1626662741 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f729008b610 con 0x7f729006bc50 2024-09-13T06:13:24.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.664+0000 7f728effd640 1 --2- 172.21.15.120:0/1626662741 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f729006bc50 0x7f72901c65f0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f728001a5b0 tx=0x7f7280019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:13:24.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.664+0000 7f72777fe640 1 -- 172.21.15.120:0/1626662741 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72800bc030 con 0x7f729006bc50 2024-09-13T06:13:24.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.664+0000 7f72777fe640 1 -- 172.21.15.120:0/1626662741 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72800b8470 con 0x7f729006bc50 2024-09-13T06:13:24.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.664+0000 7f729563e640 1 -- 172.21.15.120:0/1626662741 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f729008c680 con 0x7f729006bc50 2024-09-13T06:13:24.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.664+0000 7f72777fe640 1 -- 172.21.15.120:0/1626662741 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7280009510 con 0x7f729006bc50 2024-09-13T06:13:24.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.664+0000 7f729563e640 1 -- 172.21.15.120:0/1626662741 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72901c6b30 con 0x7f729006bc50 2024-09-13T06:13:24.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.664+0000 7f729563e640 1 -- 172.21.15.120:0/1626662741 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7290070d40 con 0x7f729006bc50 2024-09-13T06:13:24.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.664+0000 7f72777fe640 1 -- 172.21.15.120:0/1626662741 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f72800bf070 con 0x7f729006bc50 2024-09-13T06:13:24.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.664+0000 7f72777fe640 1 --2- 172.21.15.120:0/1626662741 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f727c035db0 0x7f727c038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:13:24.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.664+0000 7f72777fe640 1 -- 172.21.15.120:0/1626662741 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f72800bd070 con 0x7f729006bc50 2024-09-13T06:13:24.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.664+0000 7f72777fe640 1 --2- 172.21.15.120:0/1626662741 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f727c042200 0x7f727c0446a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:13:24.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.664+0000 7f72777fe640 1 -- 172.21.15.120:0/1626662741 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f72800a55f0 con 0x7f727c042200 2024-09-13T06:13:24.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.664+0000 7f72777fe640 1 -- 172.21.15.120:0/1626662741 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f72800e6460 con 0x7f729006bc50 2024-09-13T06:13:24.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.664+0000 7f728e7fc640 1 --2- 172.21.15.120:0/1626662741 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f727c035db0 0x7f727c038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:13:24.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.664+0000 7f728f7fe640 1 --2- 172.21.15.120:0/1626662741 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f727c042200 0x7f727c0446a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:13:24.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.668+0000 7f728e7fc640 1 --2- 172.21.15.120:0/1626662741 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f727c035db0 0x7f727c038270 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7284001600 tx=0x7f7284007a50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:13:24.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.668+0000 7f728f7fe640 1 --2- 172.21.15.120:0/1626662741 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f727c042200 0x7f727c0446a0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:13:24.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.668+0000 7f72777fe640 1 -- 172.21.15.120:0/1626662741 <== osd.2 v2:172.21.15.194:6800/815615585 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f72800a55f0 con 0x7f727c042200 2024-09-13T06:13:24.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.680+0000 7f729563e640 1 -- 172.21.15.120:0/1626662741 --> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f729006c030 con 0x7f727c042200 2024-09-13T06:13:24.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.680+0000 7f72777fe640 1 -- 172.21.15.120:0/1626662741 <== osd.2 v2:172.21.15.194:6800/815615585 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f729006c030 con 0x7f727c042200 2024-09-13T06:13:24.683 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T06:13:24.684 INFO:teuthology.orchestra.run.smithi120.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T06:13:24.684 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T06:13:24.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.684+0000 7f729563e640 1 -- 172.21.15.120:0/1626662741 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f727c042200 msgr2=0x7f727c0446a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:24.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.684+0000 7f729563e640 1 --2- 172.21.15.120:0/1626662741 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f727c042200 0x7f727c0446a0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:13:24.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.684+0000 7f729563e640 1 -- 172.21.15.120:0/1626662741 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f727c035db0 msgr2=0x7f727c038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:24.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.684+0000 7f729563e640 1 --2- 172.21.15.120:0/1626662741 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f727c035db0 0x7f727c038270 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7284001600 tx=0x7f7284007a50 comp rx=0 tx=0).stop 2024-09-13T06:13:24.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.684+0000 7f729563e640 1 -- 172.21.15.120:0/1626662741 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f729006bc50 msgr2=0x7f72901c65f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:24.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.684+0000 7f729563e640 1 --2- 172.21.15.120:0/1626662741 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f729006bc50 0x7f72901c65f0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f728001a5b0 tx=0x7f7280019720 comp rx=0 tx=0).stop 2024-09-13T06:13:24.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.684+0000 7f729563e640 1 -- 172.21.15.120:0/1626662741 shutdown_connections 2024-09-13T06:13:24.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.684+0000 7f729563e640 1 --2- 172.21.15.120:0/1626662741 >> [v2:172.21.15.194:6800/815615585,v1:172.21.15.194:6801/815615585] conn(0x7f727c042200 0x7f727c0446a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:13:24.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.684+0000 7f729563e640 1 --2- 172.21.15.120:0/1626662741 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f727c035db0 0x7f727c038270 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:13:24.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.684+0000 7f729563e640 1 --2- 172.21.15.120:0/1626662741 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f729006bc50 0x7f72901c65f0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:13:24.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.684+0000 7f729563e640 1 -- 172.21.15.120:0/1626662741 >> 172.21.15.120:0/1626662741 conn(0x7f729009e170 msgr2=0x7f7290131bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:13:24.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.684+0000 7f729563e640 1 -- 172.21.15.120:0/1626662741 shutdown_connections 2024-09-13T06:13:24.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.684+0000 7f729563e640 1 -- 172.21.15.120:0/1626662741 wait complete. 2024-09-13T06:13:24.699 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-13T06:13:24.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.808+0000 7f0f16350640 1 Processor -- start 2024-09-13T06:13:24.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.808+0000 7f0f16350640 1 -- start start 2024-09-13T06:13:24.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.808+0000 7f0f16350640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f0f1006d0e0 0x7f0f1006d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:13:24.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.808+0000 7f0f16350640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f10071c10 con 0x7f0f1006da00 2024-09-13T06:13:24.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.808+0000 7f0f16350640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f0f10072230 con 0x7f0f1006d0e0 2024-09-13T06:13:24.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.808+0000 7f0f0ffff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f0f1006d0e0 0x7f0f1006d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:13:24.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.808+0000 7f0f0f7fe640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f0f1006da00 0x7f0f1012ca10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:57664/0 (socket says 172.21.15.120:57664) 2024-09-13T06:13:24.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.808+0000 7f0f0f7fe640 1 -- 172.21.15.120:0/1261233494 learned_addr learned my addr 172.21.15.120:0/1261233494 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-13T06:13:24.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.808+0000 7f0f0ffff640 1 -- 172.21.15.120:0/1261233494 >> v1:172.21.15.120:6789/0 conn(0x7f0f1006da00 legacy=0x7f0f1012ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:24.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.808+0000 7f0f0ffff640 1 -- 172.21.15.120:0/1261233494 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f100709e0 con 0x7f0f1006d0e0 2024-09-13T06:13:24.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.812+0000 7f0f0ffff640 1 --2- 172.21.15.120:0/1261233494 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f1006d0e0 0x7f0f1006d4c0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f0f04009740 tx=0x7f0f0401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11093a7b25982bae server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:13:24.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.812+0000 7f0f0effd640 1 -- 172.21.15.120:0/1261233494 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f040b0070 con 0x7f0f1006d0e0 2024-09-13T06:13:24.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.812+0000 7f0f0effd640 1 -- 172.21.15.120:0/1261233494 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f040ab530 con 0x7f0f1006d0e0 2024-09-13T06:13:24.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.812+0000 7f0f0effd640 1 -- 172.21.15.120:0/1261233494 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f040ab830 con 0x7f0f1006d0e0 2024-09-13T06:13:24.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.812+0000 7f0f16350640 1 -- 172.21.15.120:0/1261233494 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f1006d0e0 msgr2=0x7f0f1006d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:24.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.812+0000 7f0f16350640 1 --2- 172.21.15.120:0/1261233494 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f1006d0e0 0x7f0f1006d4c0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f0f04009740 tx=0x7f0f0401c370 comp rx=0 tx=0).stop 2024-09-13T06:13:24.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.812+0000 7f0f16350640 1 -- 172.21.15.120:0/1261233494 shutdown_connections 2024-09-13T06:13:24.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.812+0000 7f0f16350640 1 --2- 172.21.15.120:0/1261233494 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f1006d0e0 0x7f0f1006d4c0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:13:24.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.812+0000 7f0f16350640 1 -- 172.21.15.120:0/1261233494 >> 172.21.15.120:0/1261233494 conn(0x7f0f10099a50 msgr2=0x7f0f100972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:13:24.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.812+0000 7f0f16350640 1 -- 172.21.15.120:0/1261233494 shutdown_connections 2024-09-13T06:13:24.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.812+0000 7f0f16350640 1 -- 172.21.15.120:0/1261233494 wait complete. 2024-09-13T06:13:24.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.812+0000 7f0f16350640 1 Processor -- start 2024-09-13T06:13:24.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.812+0000 7f0f16350640 1 -- start start 2024-09-13T06:13:24.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.812+0000 7f0f16350640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f1006d0e0 0x7f0f101c6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:13:24.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.812+0000 7f0f16350640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f0f10134e80 con 0x7f0f1006d0e0 2024-09-13T06:13:24.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.812+0000 7f0f0ffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f1006d0e0 0x7f0f101c6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:13:24.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.812+0000 7f0f0ffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f1006d0e0 0x7f0f101c6360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52806/0 (socket says 172.21.15.120:52806) 2024-09-13T06:13:24.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.812+0000 7f0f0ffff640 1 -- 172.21.15.120:0/2712180958 learned_addr learned my addr 172.21.15.120:0/2712180958 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-13T06:13:24.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.812+0000 7f0f0ffff640 1 -- 172.21.15.120:0/2712180958 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f1012bfc0 con 0x7f0f1006d0e0 2024-09-13T06:13:24.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.812+0000 7f0f0ffff640 1 --2- 172.21.15.120:0/2712180958 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f1006d0e0 0x7f0f101c6360 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f0f040ae040 tx=0x7f0f0401abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:13:24.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.812+0000 7f0f0cff9640 1 -- 172.21.15.120:0/2712180958 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f040b0050 con 0x7f0f1006d0e0 2024-09-13T06:13:24.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.812+0000 7f0f0cff9640 1 -- 172.21.15.120:0/2712180958 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f040b1040 con 0x7f0f1006d0e0 2024-09-13T06:13:24.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.812+0000 7f0f16350640 1 -- 172.21.15.120:0/2712180958 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f1006f660 con 0x7f0f1006d0e0 2024-09-13T06:13:24.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.812+0000 7f0f0cff9640 1 -- 172.21.15.120:0/2712180958 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f040b5780 con 0x7f0f1006d0e0 2024-09-13T06:13:24.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.812+0000 7f0f16350640 1 -- 172.21.15.120:0/2712180958 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f101c68a0 con 0x7f0f1006d0e0 2024-09-13T06:13:24.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.812+0000 7f0f0cff9640 1 -- 172.21.15.120:0/2712180958 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0f040be030 con 0x7f0f1006d0e0 2024-09-13T06:13:24.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.816+0000 7f0f16350640 1 -- 172.21.15.120:0/2712180958 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f1006d4c0 con 0x7f0f1006d0e0 2024-09-13T06:13:24.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.816+0000 7f0f0cff9640 1 --2- 172.21.15.120:0/2712180958 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0efc035db0 0x7f0efc038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:13:24.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.816+0000 7f0f0cff9640 1 -- 172.21.15.120:0/2712180958 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f0f040bc070 con 0x7f0f1006d0e0 2024-09-13T06:13:24.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.816+0000 7f0f0f7fe640 1 --2- 172.21.15.120:0/2712180958 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0efc035db0 0x7f0efc038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:13:24.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.816+0000 7f0f0f7fe640 1 --2- 172.21.15.120:0/2712180958 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0efc035db0 0x7f0efc038270 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f0f00001610 tx=0x7f0f00007ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:13:24.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.820+0000 7f0f0cff9640 1 -- 172.21.15.120:0/2712180958 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0f040c5060 con 0x7f0f1006d0e0 2024-09-13T06:13:24.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.968+0000 7f0f16350640 1 -- 172.21.15.120:0/2712180958 --> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f0f10073790 con 0x7f0efc035db0 2024-09-13T06:13:24.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.968+0000 7f0f0cff9640 1 -- 172.21.15.120:0/2712180958 <== mgr.4100 v2:172.21.15.194:6824/3475680902 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f0f10073790 con 0x7f0efc035db0 2024-09-13T06:13:24.970 INFO:teuthology.orchestra.run.smithi120.stderr:instructed osd(s) 2 to deep-scrub 2024-09-13T06:13:24.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.972+0000 7f0f16350640 1 -- 172.21.15.120:0/2712180958 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0efc035db0 msgr2=0x7f0efc038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:24.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.972+0000 7f0f16350640 1 --2- 172.21.15.120:0/2712180958 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0efc035db0 0x7f0efc038270 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f0f00001610 tx=0x7f0f00007ad0 comp rx=0 tx=0).stop 2024-09-13T06:13:24.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.972+0000 7f0f16350640 1 -- 172.21.15.120:0/2712180958 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f1006d0e0 msgr2=0x7f0f101c6360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:24.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.972+0000 7f0f16350640 1 --2- 172.21.15.120:0/2712180958 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f1006d0e0 0x7f0f101c6360 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f0f040ae040 tx=0x7f0f0401abb0 comp rx=0 tx=0).stop 2024-09-13T06:13:24.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.972+0000 7f0f16350640 1 -- 172.21.15.120:0/2712180958 shutdown_connections 2024-09-13T06:13:24.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.972+0000 7f0f16350640 1 --2- 172.21.15.120:0/2712180958 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f0efc035db0 0x7f0efc038270 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:13:24.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.972+0000 7f0f16350640 1 --2- 172.21.15.120:0/2712180958 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f1006d0e0 0x7f0f101c6360 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:13:24.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.972+0000 7f0f16350640 1 -- 172.21.15.120:0/2712180958 >> 172.21.15.120:0/2712180958 conn(0x7f0f10099a50 msgr2=0x7f0f1009b260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:13:24.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.972+0000 7f0f16350640 1 -- 172.21.15.120:0/2712180958 shutdown_connections 2024-09-13T06:13:24.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:24.972+0000 7f0f16350640 1 -- 172.21.15.120:0/2712180958 wait complete. 2024-09-13T06:13:24.987 INFO:tasks.ceph:Scrubbing osd.3 2024-09-13T06:13:24.987 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-13T06:13:25.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.112+0000 7ff2f2d3d640 1 Processor -- start 2024-09-13T06:13:25.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.112+0000 7ff2f2d3d640 1 -- start start 2024-09-13T06:13:25.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.112+0000 7ff2f2d3d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff2ec099c70 0x7ff2ec09a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:13:25.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.112+0000 7ff2f2d3d640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2ec0992b0 con 0x7ff2ec09a590 2024-09-13T06:13:25.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.112+0000 7ff2f2d3d640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7ff2ec09d270 con 0x7ff2ec099c70 2024-09-13T06:13:25.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.112+0000 7ff2f0ad9640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff2ec099c70 0x7ff2ec09a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:13:25.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.112+0000 7ff2ebfff640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7ff2ec09a590 0x7ff2ec09be90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:57666/0 (socket says 172.21.15.120:57666) 2024-09-13T06:13:25.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.112+0000 7ff2ebfff640 1 -- 172.21.15.120:0/1664219315 learned_addr learned my addr 172.21.15.120:0/1664219315 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-13T06:13:25.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.112+0000 7ff2f0ad9640 1 -- 172.21.15.120:0/1664219315 >> v1:172.21.15.120:6789/0 conn(0x7ff2ec09a590 legacy=0x7ff2ec09be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:25.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.112+0000 7ff2f0ad9640 1 -- 172.21.15.120:0/1664219315 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2ec099790 con 0x7ff2ec099c70 2024-09-13T06:13:25.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.116+0000 7ff2f0ad9640 1 --2- 172.21.15.120:0/1664219315 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2ec099c70 0x7ff2ec09a050 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4009740 tx=0x7ff2d401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=236f25b41e6ca9ad server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:13:25.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.116+0000 7ff2eb7fe640 1 -- 172.21.15.120:0/1664219315 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2d40b0070 con 0x7ff2ec099c70 2024-09-13T06:13:25.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.116+0000 7ff2eb7fe640 1 -- 172.21.15.120:0/1664219315 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2d40ab530 con 0x7ff2ec099c70 2024-09-13T06:13:25.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.116+0000 7ff2eb7fe640 1 -- 172.21.15.120:0/1664219315 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2d40ab830 con 0x7ff2ec099c70 2024-09-13T06:13:25.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.116+0000 7ff2f2d3d640 1 -- 172.21.15.120:0/1664219315 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2ec099c70 msgr2=0x7ff2ec09a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:25.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.116+0000 7ff2f2d3d640 1 --2- 172.21.15.120:0/1664219315 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2ec099c70 0x7ff2ec09a050 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4009740 tx=0x7ff2d401c370 comp rx=0 tx=0).stop 2024-09-13T06:13:25.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.116+0000 7ff2f2d3d640 1 -- 172.21.15.120:0/1664219315 shutdown_connections 2024-09-13T06:13:25.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.116+0000 7ff2f2d3d640 1 --2- 172.21.15.120:0/1664219315 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2ec099c70 0x7ff2ec09a050 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:13:25.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.116+0000 7ff2f2d3d640 1 -- 172.21.15.120:0/1664219315 >> 172.21.15.120:0/1664219315 conn(0x7ff2ec06d570 msgr2=0x7ff2ec06d980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:13:25.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.116+0000 7ff2f2d3d640 1 -- 172.21.15.120:0/1664219315 shutdown_connections 2024-09-13T06:13:25.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.116+0000 7ff2f2d3d640 1 -- 172.21.15.120:0/1664219315 wait complete. 2024-09-13T06:13:25.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.116+0000 7ff2f2d3d640 1 Processor -- start 2024-09-13T06:13:25.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.116+0000 7ff2f2d3d640 1 -- start start 2024-09-13T06:13:25.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.116+0000 7ff2f2d3d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2ec099c70 0x7ff2ec1c73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:13:25.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.116+0000 7ff2f2d3d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ff2ec137ae0 con 0x7ff2ec099c70 2024-09-13T06:13:25.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.116+0000 7ff2f0ad9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2ec099c70 0x7ff2ec1c73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:13:25.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.116+0000 7ff2f0ad9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2ec099c70 0x7ff2ec1c73b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52816/0 (socket says 172.21.15.120:52816) 2024-09-13T06:13:25.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.116+0000 7ff2f0ad9640 1 -- 172.21.15.120:0/3011016780 learned_addr learned my addr 172.21.15.120:0/3011016780 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-13T06:13:25.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.116+0000 7ff2f0ad9640 1 -- 172.21.15.120:0/3011016780 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2ec095660 con 0x7ff2ec099c70 2024-09-13T06:13:25.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.116+0000 7ff2f0ad9640 1 --2- 172.21.15.120:0/3011016780 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2ec099c70 0x7ff2ec1c73b0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7ff2d40ae040 tx=0x7ff2d4019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:13:25.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.116+0000 7ff2e97fa640 1 -- 172.21.15.120:0/3011016780 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2d40b8020 con 0x7ff2ec099c70 2024-09-13T06:13:25.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.116+0000 7ff2e97fa640 1 -- 172.21.15.120:0/3011016780 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2d40b4560 con 0x7ff2ec099c70 2024-09-13T06:13:25.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.116+0000 7ff2f2d3d640 1 -- 172.21.15.120:0/3011016780 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2ec097340 con 0x7ff2ec099c70 2024-09-13T06:13:25.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.116+0000 7ff2e97fa640 1 -- 172.21.15.120:0/3011016780 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2d40b0040 con 0x7ff2ec099c70 2024-09-13T06:13:25.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.116+0000 7ff2f2d3d640 1 -- 172.21.15.120:0/3011016780 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2ec1c6d00 con 0x7ff2ec099c70 2024-09-13T06:13:25.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.116+0000 7ff2f2d3d640 1 -- 172.21.15.120:0/3011016780 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff2ec09a050 con 0x7ff2ec099c70 2024-09-13T06:13:25.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.116+0000 7ff2e97fa640 1 -- 172.21.15.120:0/3011016780 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff2d40bb020 con 0x7ff2ec099c70 2024-09-13T06:13:25.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.120+0000 7ff2e97fa640 1 --2- 172.21.15.120:0/3011016780 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff2cc035db0 0x7ff2cc038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:13:25.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.120+0000 7ff2e97fa640 1 -- 172.21.15.120:0/3011016780 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7ff2d40e2e20 con 0x7ff2ec099c70 2024-09-13T06:13:25.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.120+0000 7ff2e97fa640 1 --2- 172.21.15.120:0/3011016780 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x7ff2cc0421a0 0x7ff2cc044640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:13:25.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.120+0000 7ff2e97fa640 1 -- 172.21.15.120:0/3011016780 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff2d40bbec0 con 0x7ff2cc0421a0 2024-09-13T06:13:25.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.120+0000 7ff2e97fa640 1 -- 172.21.15.120:0/3011016780 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7ff2d40e5550 con 0x7ff2ec099c70 2024-09-13T06:13:25.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.120+0000 7ff2ebfff640 1 --2- 172.21.15.120:0/3011016780 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff2cc035db0 0x7ff2cc038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:13:25.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.120+0000 7ff2f12da640 1 --2- 172.21.15.120:0/3011016780 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x7ff2cc0421a0 0x7ff2cc044640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:13:25.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.120+0000 7ff2ebfff640 1 --2- 172.21.15.120:0/3011016780 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff2cc035db0 0x7ff2cc038270 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc002090 tx=0x7ff2dc001680 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:13:25.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.120+0000 7ff2f12da640 1 --2- 172.21.15.120:0/3011016780 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x7ff2cc0421a0 0x7ff2cc044640 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:13:25.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.120+0000 7ff2e97fa640 1 -- 172.21.15.120:0/3011016780 <== osd.3 v2:172.21.15.194:6816/96632515 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff2d40bbec0 con 0x7ff2cc0421a0 2024-09-13T06:13:25.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.136+0000 7ff2f2d3d640 1 -- 172.21.15.120:0/3011016780 --> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff2ec0970d0 con 0x7ff2cc0421a0 2024-09-13T06:13:25.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.136+0000 7ff2e97fa640 1 -- 172.21.15.120:0/3011016780 <== osd.3 v2:172.21.15.194:6816/96632515 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff2ec0970d0 con 0x7ff2cc0421a0 2024-09-13T06:13:25.136 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-13T06:13:25.137 INFO:teuthology.orchestra.run.smithi120.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T06:13:25.137 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-13T06:13:25.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.136+0000 7ff2f2d3d640 1 -- 172.21.15.120:0/3011016780 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x7ff2cc0421a0 msgr2=0x7ff2cc044640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:25.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.136+0000 7ff2f2d3d640 1 --2- 172.21.15.120:0/3011016780 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x7ff2cc0421a0 0x7ff2cc044640 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:13:25.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.136+0000 7ff2f2d3d640 1 -- 172.21.15.120:0/3011016780 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff2cc035db0 msgr2=0x7ff2cc038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:25.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.136+0000 7ff2f2d3d640 1 --2- 172.21.15.120:0/3011016780 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff2cc035db0 0x7ff2cc038270 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc002090 tx=0x7ff2dc001680 comp rx=0 tx=0).stop 2024-09-13T06:13:25.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.136+0000 7ff2f2d3d640 1 -- 172.21.15.120:0/3011016780 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2ec099c70 msgr2=0x7ff2ec1c73b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:25.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.136+0000 7ff2f2d3d640 1 --2- 172.21.15.120:0/3011016780 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2ec099c70 0x7ff2ec1c73b0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7ff2d40ae040 tx=0x7ff2d4019110 comp rx=0 tx=0).stop 2024-09-13T06:13:25.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.136+0000 7ff2f2d3d640 1 -- 172.21.15.120:0/3011016780 shutdown_connections 2024-09-13T06:13:25.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.136+0000 7ff2f2d3d640 1 --2- 172.21.15.120:0/3011016780 >> [v2:172.21.15.194:6816/96632515,v1:172.21.15.194:6817/96632515] conn(0x7ff2cc0421a0 0x7ff2cc044640 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:13:25.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.136+0000 7ff2f2d3d640 1 --2- 172.21.15.120:0/3011016780 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7ff2cc035db0 0x7ff2cc038270 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:13:25.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.136+0000 7ff2f2d3d640 1 --2- 172.21.15.120:0/3011016780 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2ec099c70 0x7ff2ec1c73b0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:13:25.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.136+0000 7ff2f2d3d640 1 -- 172.21.15.120:0/3011016780 >> 172.21.15.120:0/3011016780 conn(0x7ff2ec06d570 msgr2=0x7ff2ec133780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:13:25.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.136+0000 7ff2f2d3d640 1 -- 172.21.15.120:0/3011016780 shutdown_connections 2024-09-13T06:13:25.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.136+0000 7ff2f2d3d640 1 -- 172.21.15.120:0/3011016780 wait complete. 2024-09-13T06:13:25.153 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-13T06:13:25.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.260+0000 7fb52ef7c640 1 Processor -- start 2024-09-13T06:13:25.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.264+0000 7fb52ef7c640 1 -- start start 2024-09-13T06:13:25.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.264+0000 7fb52ef7c640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fb52806dbd0 0x7fb528131e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:13:25.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.264+0000 7fb52ef7c640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb528071c10 con 0x7fb52806d0e0 2024-09-13T06:13:25.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.264+0000 7fb52ef7c640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fb528072230 con 0x7fb52806dbd0 2024-09-13T06:13:25.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.264+0000 7fb52cd18640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fb52806d0e0 0x7fb52806d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:57678/0 (socket says 172.21.15.120:57678) 2024-09-13T06:13:25.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.264+0000 7fb52cd18640 1 -- 172.21.15.120:0/1420062524 learned_addr learned my addr 172.21.15.120:0/1420062524 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-13T06:13:25.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.264+0000 7fb527fff640 1 --2- 172.21.15.120:0/1420062524 >> v2:172.21.15.120:3300/0 conn(0x7fb52806dbd0 0x7fb528131e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:13:25.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.264+0000 7fb5277fe640 1 -- 172.21.15.120:0/1420062524 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 948309862 0 0) 0x7fb528071c10 con 0x7fb52806d0e0 2024-09-13T06:13:25.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.264+0000 7fb5277fe640 1 -- 172.21.15.120:0/1420062524 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb510003530 con 0x7fb52806d0e0 2024-09-13T06:13:25.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.264+0000 7fb527fff640 1 -- 172.21.15.120:0/1420062524 >> v1:172.21.15.120:6789/0 conn(0x7fb52806d0e0 legacy=0x7fb52806d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:25.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.264+0000 7fb527fff640 1 -- 172.21.15.120:0/1420062524 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5280709e0 con 0x7fb52806dbd0 2024-09-13T06:13:25.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.264+0000 7fb527fff640 1 --2- 172.21.15.120:0/1420062524 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb52806dbd0 0x7fb528131e60 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fb51c009740 tx=0x7fb51c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38676c4a3a502a31 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:13:25.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.264+0000 7fb5277fe640 1 -- 172.21.15.120:0/1420062524 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb51c0b0070 con 0x7fb52806dbd0 2024-09-13T06:13:25.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.264+0000 7fb5277fe640 1 -- 172.21.15.120:0/1420062524 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb51c0ab530 con 0x7fb52806dbd0 2024-09-13T06:13:25.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.264+0000 7fb5277fe640 1 -- 172.21.15.120:0/1420062524 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb51c0ab810 con 0x7fb52806dbd0 2024-09-13T06:13:25.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.264+0000 7fb52ef7c640 1 -- 172.21.15.120:0/1420062524 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb52806dbd0 msgr2=0x7fb528131e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:25.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.264+0000 7fb52ef7c640 1 --2- 172.21.15.120:0/1420062524 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb52806dbd0 0x7fb528131e60 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fb51c009740 tx=0x7fb51c01c370 comp rx=0 tx=0).stop 2024-09-13T06:13:25.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.268+0000 7fb52ef7c640 1 -- 172.21.15.120:0/1420062524 shutdown_connections 2024-09-13T06:13:25.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.268+0000 7fb52ef7c640 1 --2- 172.21.15.120:0/1420062524 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb52806dbd0 0x7fb528131e60 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:13:25.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.268+0000 7fb52ef7c640 1 -- 172.21.15.120:0/1420062524 >> 172.21.15.120:0/1420062524 conn(0x7fb528099a50 msgr2=0x7fb5280972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:13:25.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.268+0000 7fb52ef7c640 1 -- 172.21.15.120:0/1420062524 shutdown_connections 2024-09-13T06:13:25.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.268+0000 7fb52ef7c640 1 -- 172.21.15.120:0/1420062524 wait complete. 2024-09-13T06:13:25.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.268+0000 7fb52ef7c640 1 Processor -- start 2024-09-13T06:13:25.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.268+0000 7fb52ef7c640 1 -- start start 2024-09-13T06:13:25.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.268+0000 7fb52ef7c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb52806d0e0 0x7fb528092130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:13:25.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.268+0000 7fb52ef7c640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fb528134d40 con 0x7fb52806d0e0 2024-09-13T06:13:25.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.268+0000 7fb52cd18640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb52806d0e0 0x7fb528092130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:13:25.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.268+0000 7fb52cd18640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb52806d0e0 0x7fb528092130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52828/0 (socket says 172.21.15.120:52828) 2024-09-13T06:13:25.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.268+0000 7fb52cd18640 1 -- 172.21.15.120:0/1444083039 learned_addr learned my addr 172.21.15.120:0/1444083039 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-13T06:13:25.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.268+0000 7fb52cd18640 1 -- 172.21.15.120:0/1444083039 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb528093a50 con 0x7fb52806d0e0 2024-09-13T06:13:25.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.268+0000 7fb52cd18640 1 --2- 172.21.15.120:0/1444083039 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb52806d0e0 0x7fb528092130 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fb51800c3d0 tx=0x7fb51800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:13:25.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.268+0000 7fb5257fa640 1 -- 172.21.15.120:0/1444083039 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb518017070 con 0x7fb52806d0e0 2024-09-13T06:13:25.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.268+0000 7fb5257fa640 1 -- 172.21.15.120:0/1444083039 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb518005ce0 con 0x7fb52806d0e0 2024-09-13T06:13:25.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.268+0000 7fb52ef7c640 1 -- 172.21.15.120:0/1444083039 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb528095730 con 0x7fb52806d0e0 2024-09-13T06:13:25.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.268+0000 7fb5257fa640 1 -- 172.21.15.120:0/1444083039 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5180070d0 con 0x7fb52806d0e0 2024-09-13T06:13:25.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.268+0000 7fb52ef7c640 1 -- 172.21.15.120:0/1444083039 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb528094b80 con 0x7fb52806d0e0 2024-09-13T06:13:25.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.268+0000 7fb5257fa640 1 -- 172.21.15.120:0/1444083039 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb51801a070 con 0x7fb52806d0e0 2024-09-13T06:13:25.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.268+0000 7fb52ef7c640 1 -- 172.21.15.120:0/1444083039 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb528096a80 con 0x7fb52806d0e0 2024-09-13T06:13:25.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.268+0000 7fb5257fa640 1 --2- 172.21.15.120:0/1444083039 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fb514035db0 0x7fb514038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:13:25.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.268+0000 7fb5257fa640 1 -- 172.21.15.120:0/1444083039 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fb5180485b0 con 0x7fb52806d0e0 2024-09-13T06:13:25.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.272+0000 7fb527fff640 1 --2- 172.21.15.120:0/1444083039 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fb514035db0 0x7fb514038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:13:25.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.272+0000 7fb527fff640 1 --2- 172.21.15.120:0/1444083039 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fb514035db0 0x7fb514038270 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fb51c0ad000 tx=0x7fb51c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:13:25.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.276+0000 7fb5257fa640 1 -- 172.21.15.120:0/1444083039 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb518019e10 con 0x7fb52806d0e0 2024-09-13T06:13:25.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.436+0000 7fb52ef7c640 1 -- 172.21.15.120:0/1444083039 --> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fb528094e10 con 0x7fb514035db0 2024-09-13T06:13:25.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.436+0000 7fb5257fa640 1 -- 172.21.15.120:0/1444083039 <== mgr.4100 v2:172.21.15.194:6824/3475680902 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb51c0b1040 con 0x7fb514035db0 2024-09-13T06:13:25.438 INFO:teuthology.orchestra.run.smithi120.stderr:instructed osd(s) 3 to deep-scrub 2024-09-13T06:13:25.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.440+0000 7fb52ef7c640 1 -- 172.21.15.120:0/1444083039 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fb514035db0 msgr2=0x7fb514038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:25.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.440+0000 7fb52ef7c640 1 --2- 172.21.15.120:0/1444083039 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fb514035db0 0x7fb514038270 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fb51c0ad000 tx=0x7fb51c0a6000 comp rx=0 tx=0).stop 2024-09-13T06:13:25.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.440+0000 7fb52ef7c640 1 -- 172.21.15.120:0/1444083039 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb52806d0e0 msgr2=0x7fb528092130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:25.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.440+0000 7fb52ef7c640 1 --2- 172.21.15.120:0/1444083039 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb52806d0e0 0x7fb528092130 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fb51800c3d0 tx=0x7fb51800c890 comp rx=0 tx=0).stop 2024-09-13T06:13:25.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.440+0000 7fb52ef7c640 1 -- 172.21.15.120:0/1444083039 shutdown_connections 2024-09-13T06:13:25.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.440+0000 7fb52ef7c640 1 --2- 172.21.15.120:0/1444083039 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fb514035db0 0x7fb514038270 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:13:25.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.440+0000 7fb52ef7c640 1 --2- 172.21.15.120:0/1444083039 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb52806d0e0 0x7fb528092130 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:13:25.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.440+0000 7fb52ef7c640 1 -- 172.21.15.120:0/1444083039 >> 172.21.15.120:0/1444083039 conn(0x7fb528099a50 msgr2=0x7fb52808afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:13:25.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.440+0000 7fb52ef7c640 1 -- 172.21.15.120:0/1444083039 shutdown_connections 2024-09-13T06:13:25.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.440+0000 7fb52ef7c640 1 -- 172.21.15.120:0/1444083039 wait complete. 2024-09-13T06:13:25.456 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T06:13:25.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.564+0000 7fa9f1fde640 1 Processor -- start 2024-09-13T06:13:25.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.564+0000 7fa9f1fde640 1 -- start start 2024-09-13T06:13:25.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.564+0000 7fa9f1fde640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fa9ec06ece0 0x7fa9ec130e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:13:25.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.564+0000 7fa9f1fde640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9ec06f750 con 0x7fa9ec06e1f0 2024-09-13T06:13:25.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.564+0000 7fa9f1fde640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fa9ec070c10 con 0x7fa9ec06ece0 2024-09-13T06:13:25.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.564+0000 7fa9eaffd640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fa9ec06ece0 0x7fa9ec130e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:13:25.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.564+0000 7fa9eb7fe640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fa9ec06e1f0 0x7fa9ec06e5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:57686/0 (socket says 172.21.15.120:57686) 2024-09-13T06:13:25.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.564+0000 7fa9eb7fe640 1 -- 172.21.15.120:0/3450184513 learned_addr learned my addr 172.21.15.120:0/3450184513 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-13T06:13:25.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.568+0000 7fa9eaffd640 1 -- 172.21.15.120:0/3450184513 >> v1:172.21.15.120:6789/0 conn(0x7fa9ec06e1f0 legacy=0x7fa9ec06e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:25.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.568+0000 7fa9eaffd640 1 -- 172.21.15.120:0/3450184513 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9ec0703f0 con 0x7fa9ec06ece0 2024-09-13T06:13:25.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.568+0000 7fa9eaffd640 1 --2- 172.21.15.120:0/3450184513 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9ec06ece0 0x7fa9ec130e50 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc00b9e0 tx=0x7fa9dc01ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb53e05c9212042c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:13:25.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.568+0000 7fa9ea7fc640 1 -- 172.21.15.120:0/3450184513 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9dc0b4070 con 0x7fa9ec06ece0 2024-09-13T06:13:25.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.568+0000 7fa9ea7fc640 1 -- 172.21.15.120:0/3450184513 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9dc0a7850 con 0x7fa9ec06ece0 2024-09-13T06:13:25.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.568+0000 7fa9ea7fc640 1 -- 172.21.15.120:0/3450184513 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9dc0a7b50 con 0x7fa9ec06ece0 2024-09-13T06:13:25.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.568+0000 7fa9f1fde640 1 -- 172.21.15.120:0/3450184513 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9ec06ece0 msgr2=0x7fa9ec130e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:25.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.568+0000 7fa9f1fde640 1 --2- 172.21.15.120:0/3450184513 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9ec06ece0 0x7fa9ec130e50 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc00b9e0 tx=0x7fa9dc01ea40 comp rx=0 tx=0).stop 2024-09-13T06:13:25.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.568+0000 7fa9f1fde640 1 -- 172.21.15.120:0/3450184513 shutdown_connections 2024-09-13T06:13:25.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.568+0000 7fa9f1fde640 1 --2- 172.21.15.120:0/3450184513 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9ec06ece0 0x7fa9ec130e50 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:13:25.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.568+0000 7fa9f1fde640 1 -- 172.21.15.120:0/3450184513 >> 172.21.15.120:0/3450184513 conn(0x7fa9ec099a50 msgr2=0x7fa9ec0972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:13:25.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.568+0000 7fa9f1fde640 1 -- 172.21.15.120:0/3450184513 shutdown_connections 2024-09-13T06:13:25.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.568+0000 7fa9f1fde640 1 -- 172.21.15.120:0/3450184513 wait complete. 2024-09-13T06:13:25.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.568+0000 7fa9f1fde640 1 Processor -- start 2024-09-13T06:13:25.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.572+0000 7fa9f1fde640 1 -- start start 2024-09-13T06:13:25.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.572+0000 7fa9f1fde640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9ec06e1f0 0x7fa9ec1c6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:13:25.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.572+0000 7fa9f1fde640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fa9ec06da70 con 0x7fa9ec06e1f0 2024-09-13T06:13:25.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.572+0000 7fa9eb7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9ec06e1f0 0x7fa9ec1c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:13:25.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.572+0000 7fa9eb7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9ec06e1f0 0x7fa9ec1c6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52842/0 (socket says 172.21.15.120:52842) 2024-09-13T06:13:25.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.572+0000 7fa9eb7fe640 1 -- 172.21.15.120:0/667572865 learned_addr learned my addr 172.21.15.120:0/667572865 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-13T06:13:25.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.572+0000 7fa9eb7fe640 1 -- 172.21.15.120:0/667572865 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9ec12bca0 con 0x7fa9ec06e1f0 2024-09-13T06:13:25.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.572+0000 7fa9eb7fe640 1 --2- 172.21.15.120:0/667572865 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9ec06e1f0 0x7fa9ec1c6300 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fa9e000c3a0 tx=0x7fa9e000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:13:25.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.572+0000 7fa9d3fff640 1 -- 172.21.15.120:0/667572865 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9e0017070 con 0x7fa9ec06e1f0 2024-09-13T06:13:25.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.572+0000 7fa9d3fff640 1 -- 172.21.15.120:0/667572865 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9e0005c20 con 0x7fa9ec06e1f0 2024-09-13T06:13:25.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.572+0000 7fa9f1fde640 1 -- 172.21.15.120:0/667572865 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9ec08afd0 con 0x7fa9ec06e1f0 2024-09-13T06:13:25.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.572+0000 7fa9d3fff640 1 -- 172.21.15.120:0/667572865 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9e00070d0 con 0x7fa9ec06e1f0 2024-09-13T06:13:25.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.572+0000 7fa9f1fde640 1 -- 172.21.15.120:0/667572865 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9ec08d330 con 0x7fa9ec06e1f0 2024-09-13T06:13:25.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.572+0000 7fa9d3fff640 1 -- 172.21.15.120:0/667572865 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa9e001a070 con 0x7fa9ec06e1f0 2024-09-13T06:13:25.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.572+0000 7fa9f1fde640 1 -- 172.21.15.120:0/667572865 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9ec06e5d0 con 0x7fa9ec06e1f0 2024-09-13T06:13:25.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.572+0000 7fa9d3fff640 1 --2- 172.21.15.120:0/667572865 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa9d8035db0 0x7fa9d8038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:13:25.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.572+0000 7fa9d3fff640 1 -- 172.21.15.120:0/667572865 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fa9e0048500 con 0x7fa9ec06e1f0 2024-09-13T06:13:25.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.572+0000 7fa9eaffd640 1 --2- 172.21.15.120:0/667572865 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa9d8035db0 0x7fa9d8038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:13:25.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.572+0000 7fa9eaffd640 1 --2- 172.21.15.120:0/667572865 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa9d8035db0 0x7fa9d8038270 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc0b1000 tx=0x7fa9dc0a9070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:13:25.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.576+0000 7fa9d3fff640 1 -- 172.21.15.120:0/667572865 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa9e0007270 con 0x7fa9ec06e1f0 2024-09-13T06:13:25.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.732+0000 7fa9f1fde640 1 -- 172.21.15.120:0/667572865 --> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa9ec08d630 con 0x7fa9d8035db0 2024-09-13T06:13:25.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.776+0000 7fa9d3fff640 1 -- 172.21.15.120:0/667572865 <== mgr.4100 v2:172.21.15.194:6824/3475680902 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666033 (secure 0 0 0) 0x7fa9ec08d630 con 0x7fa9d8035db0 2024-09-13T06:13:25.782 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T06:13:25.789 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-09-13T06:13:25.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.784+0000 7fa9f1fde640 1 -- 172.21.15.120:0/667572865 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa9d8035db0 msgr2=0x7fa9d8038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:25.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.784+0000 7fa9f1fde640 1 --2- 172.21.15.120:0/667572865 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa9d8035db0 0x7fa9d8038270 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc0b1000 tx=0x7fa9dc0a9070 comp rx=0 tx=0).stop 2024-09-13T06:13:25.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.784+0000 7fa9f1fde640 1 -- 172.21.15.120:0/667572865 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9ec06e1f0 msgr2=0x7fa9ec1c6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:25.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.784+0000 7fa9f1fde640 1 --2- 172.21.15.120:0/667572865 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9ec06e1f0 0x7fa9ec1c6300 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fa9e000c3a0 tx=0x7fa9e000c860 comp rx=0 tx=0).stop 2024-09-13T06:13:25.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.784+0000 7fa9f1fde640 1 -- 172.21.15.120:0/667572865 shutdown_connections 2024-09-13T06:13:25.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.784+0000 7fa9f1fde640 1 --2- 172.21.15.120:0/667572865 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa9d8035db0 0x7fa9d8038270 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:13:25.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.784+0000 7fa9f1fde640 1 --2- 172.21.15.120:0/667572865 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9ec06e1f0 0x7fa9ec1c6300 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:13:25.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.784+0000 7fa9f1fde640 1 -- 172.21.15.120:0/667572865 >> 172.21.15.120:0/667572865 conn(0x7fa9ec099a50 msgr2=0x7fa9ec09a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:13:25.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.784+0000 7fa9f1fde640 1 -- 172.21.15.120:0/667572865 shutdown_connections 2024-09-13T06:13:25.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:25.784+0000 7fa9f1fde640 1 -- 172.21.15.120:0/667572865 wait complete. 2024-09-13T06:13:25.802 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":156,"stamp":"2024-09-13T06:13:23.819410+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5464154,"num_objects":224,"num_object_clones":0,"num_object_copies":452,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":224,"num_whiteouts":0,"num_read":5076,"num_read_kb":4656,"num_write":2169,"num_write_kb":61376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4595,"ondisk_log_size":4595,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":165212,"kb_used_data":11348,"kb_used_omap":6,"kb_used_meta":153785,"kb_avail":377322148,"statfs":{"total":386547056640,"available":386377879552,"internally_reserved":0,"allocated":11620352,"data_stored":10402612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":157476630},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-20952750,"num_objects":-5,"num_object_clones":0,"num_object_copies":-20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-5,"num_whiteouts":0,"num_read":184,"num_read_kb":187,"num_write":61,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006482"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.802800+0000","last_change":"2024-09-13T06:09:32.142010+0000","last_active":"2024-09-13T06:10:10.802800+0000","last_peered":"2024-09-13T06:10:10.802800+0000","last_clean":"2024-09-13T06:10:10.802800+0000","last_became_active":"2024-09-13T06:09:32.140025+0000","last_became_peered":"2024-09-13T06:09:32.140025+0000","last_unstale":"2024-09-13T06:10:10.802800+0000","last_undegraded":"2024-09-13T06:10:10.802800+0000","last_fullsized":"2024-09-13T06:10:10.802800+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:15:48.717644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"35'22","reported_seq":94,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.323141+0000","last_change":"2024-09-13T06:09:34.126675+0000","last_active":"2024-09-13T06:12:49.323141+0000","last_peered":"2024-09-13T06:12:49.323141+0000","last_clean":"2024-09-13T06:12:49.323141+0000","last_became_active":"2024-09-13T06:09:34.122656+0000","last_became_peered":"2024-09-13T06:09:34.122656+0000","last_unstale":"2024-09-13T06:12:49.323141+0000","last_undegraded":"2024-09-13T06:12:49.323141+0000","last_fullsized":"2024-09-13T06:12:49.323141+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:04:23.927249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":88,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:18.044019+0000","last_change":"2024-09-13T06:09:32.135771+0000","last_active":"2024-09-13T06:10:18.044019+0000","last_peered":"2024-09-13T06:10:18.044019+0000","last_clean":"2024-09-13T06:10:18.044019+0000","last_became_active":"2024-09-13T06:09:32.134020+0000","last_became_peered":"2024-09-13T06:09:32.134020+0000","last_unstale":"2024-09-13T06:10:18.044019+0000","last_undegraded":"2024-09-13T06:10:18.044019+0000","last_fullsized":"2024-09-13T06:10:18.044019+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:24:08.865544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"35'4","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:02.877682+0000","last_change":"2024-09-13T06:09:34.117071+0000","last_active":"2024-09-13T06:11:02.877682+0000","last_peered":"2024-09-13T06:11:02.877682+0000","last_clean":"2024-09-13T06:11:02.877682+0000","last_became_active":"2024-09-13T06:09:34.116715+0000","last_became_peered":"2024-09-13T06:09:34.116715+0000","last_unstale":"2024-09-13T06:11:02.877682+0000","last_undegraded":"2024-09-13T06:11:02.877682+0000","last_fullsized":"2024-09-13T06:11:02.877682+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:06:01.417735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.813339+0000","last_change":"2024-09-13T06:09:32.130525+0000","last_active":"2024-09-13T06:10:10.813339+0000","last_peered":"2024-09-13T06:10:10.813339+0000","last_clean":"2024-09-13T06:10:10.813339+0000","last_became_active":"2024-09-13T06:09:32.116345+0000","last_became_peered":"2024-09-13T06:09:32.116345+0000","last_unstale":"2024-09-13T06:10:10.813339+0000","last_undegraded":"2024-09-13T06:10:10.813339+0000","last_fullsized":"2024-09-13T06:10:10.813339+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:47:58.332268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.805435+0000","last_change":"2024-09-13T06:09:34.118858+0000","last_active":"2024-09-13T06:10:10.805435+0000","last_peered":"2024-09-13T06:10:10.805435+0000","last_clean":"2024-09-13T06:10:10.805435+0000","last_became_active":"2024-09-13T06:09:34.117940+0000","last_became_peered":"2024-09-13T06:09:34.117940+0000","last_unstale":"2024-09-13T06:10:10.805435+0000","last_undegraded":"2024-09-13T06:10:10.805435+0000","last_fullsized":"2024-09-13T06:10:10.805435+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:31:13.005586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"35'4","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.308971+0000","last_change":"2024-09-13T06:09:32.120391+0000","last_active":"2024-09-13T06:12:49.308971+0000","last_peered":"2024-09-13T06:12:49.308971+0000","last_clean":"2024-09-13T06:12:49.308971+0000","last_became_active":"2024-09-13T06:09:32.119806+0000","last_became_peered":"2024-09-13T06:09:32.119806+0000","last_unstale":"2024-09-13T06:12:49.308971+0000","last_undegraded":"2024-09-13T06:12:49.308971+0000","last_fullsized":"2024-09-13T06:12:49.308971+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:16:11.746030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"35'4","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.110973+0000","last_change":"2024-09-13T06:09:34.123442+0000","last_active":"2024-09-13T06:12:49.110973+0000","last_peered":"2024-09-13T06:12:49.110973+0000","last_clean":"2024-09-13T06:12:49.110973+0000","last_became_active":"2024-09-13T06:09:34.122631+0000","last_became_peered":"2024-09-13T06:09:34.122631+0000","last_unstale":"2024-09-13T06:12:49.110973+0000","last_undegraded":"2024-09-13T06:12:49.110973+0000","last_fullsized":"2024-09-13T06:12:49.110973+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:05:27.025085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:18.043979+0000","last_change":"2024-09-13T06:09:32.129860+0000","last_active":"2024-09-13T06:10:18.043979+0000","last_peered":"2024-09-13T06:10:18.043979+0000","last_clean":"2024-09-13T06:10:18.043979+0000","last_became_active":"2024-09-13T06:09:32.121803+0000","last_became_peered":"2024-09-13T06:09:32.121803+0000","last_unstale":"2024-09-13T06:10:18.043979+0000","last_undegraded":"2024-09-13T06:10:18.043979+0000","last_fullsized":"2024-09-13T06:10:18.043979+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:35:53.036270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"35'4","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.112548+0000","last_change":"2024-09-13T06:09:34.127392+0000","last_active":"2024-09-13T06:12:49.112548+0000","last_peered":"2024-09-13T06:12:49.112548+0000","last_clean":"2024-09-13T06:12:49.112548+0000","last_became_active":"2024-09-13T06:09:34.124728+0000","last_became_peered":"2024-09-13T06:09:34.124728+0000","last_unstale":"2024-09-13T06:12:49.112548+0000","last_undegraded":"2024-09-13T06:12:49.112548+0000","last_fullsized":"2024-09-13T06:12:49.112548+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:16:25.577037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.300520+0000","last_change":"2024-09-13T06:09:32.117055+0000","last_active":"2024-09-13T06:12:49.300520+0000","last_peered":"2024-09-13T06:12:49.300520+0000","last_clean":"2024-09-13T06:12:49.300520+0000","last_became_active":"2024-09-13T06:09:32.116422+0000","last_became_peered":"2024-09-13T06:09:32.116422+0000","last_unstale":"2024-09-13T06:12:49.300520+0000","last_undegraded":"2024-09-13T06:12:49.300520+0000","last_fullsized":"2024-09-13T06:12:49.300520+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:42:30.526894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"35'4","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.513278+0000","last_change":"2024-09-13T06:10:10.823960+0000","last_active":"2024-09-13T06:12:49.513278+0000","last_peered":"2024-09-13T06:12:49.513278+0000","last_clean":"2024-09-13T06:12:49.513278+0000","last_became_active":"2024-09-13T06:10:10.810259+0000","last_became_peered":"2024-09-13T06:10:10.810259+0000","last_unstale":"2024-09-13T06:12:49.513278+0000","last_undegraded":"2024-09-13T06:12:49.513278+0000","last_fullsized":"2024-09-13T06:12:49.513278+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:20:38.364042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"35'4","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:19.634736+0000","last_change":"2024-09-13T06:09:32.130200+0000","last_active":"2024-09-13T06:10:19.634736+0000","last_peered":"2024-09-13T06:10:19.634736+0000","last_clean":"2024-09-13T06:10:19.634736+0000","last_became_active":"2024-09-13T06:09:32.122126+0000","last_became_peered":"2024-09-13T06:09:32.122126+0000","last_unstale":"2024-09-13T06:10:19.634736+0000","last_undegraded":"2024-09-13T06:10:19.634736+0000","last_fullsized":"2024-09-13T06:10:19.634736+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:26:21.113764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"35'10","reported_seq":59,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.436094+0000","last_change":"2024-09-13T06:09:34.120695+0000","last_active":"2024-09-13T06:12:49.436094+0000","last_peered":"2024-09-13T06:12:49.436094+0000","last_clean":"2024-09-13T06:12:49.436094+0000","last_became_active":"2024-09-13T06:09:34.120349+0000","last_became_peered":"2024-09-13T06:09:34.120349+0000","last_unstale":"2024-09-13T06:12:49.436094+0000","last_undegraded":"2024-09-13T06:12:49.436094+0000","last_fullsized":"2024-09-13T06:12:49.436094+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:11:30.370585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.943818+0000","last_change":"2024-09-13T06:09:32.149245+0000","last_active":"2024-09-13T06:10:10.943818+0000","last_peered":"2024-09-13T06:10:10.943818+0000","last_clean":"2024-09-13T06:10:10.943818+0000","last_became_active":"2024-09-13T06:09:32.147504+0000","last_became_peered":"2024-09-13T06:09:32.147504+0000","last_unstale":"2024-09-13T06:10:10.943818+0000","last_undegraded":"2024-09-13T06:10:10.943818+0000","last_fullsized":"2024-09-13T06:10:10.943818+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:06:35.186829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"35'9","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:41.798014+0000","last_change":"2024-09-13T06:09:34.104380+0000","last_active":"2024-09-13T06:11:41.798014+0000","last_peered":"2024-09-13T06:11:41.798014+0000","last_clean":"2024-09-13T06:11:41.798014+0000","last_became_active":"2024-09-13T06:09:34.104043+0000","last_became_peered":"2024-09-13T06:09:34.104043+0000","last_unstale":"2024-09-13T06:11:41.798014+0000","last_undegraded":"2024-09-13T06:11:41.798014+0000","last_fullsized":"2024-09-13T06:11:41.798014+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:57:58.370368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"35'4","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.513237+0000","last_change":"2024-09-13T06:09:34.116800+0000","last_active":"2024-09-13T06:12:49.513237+0000","last_peered":"2024-09-13T06:12:49.513237+0000","last_clean":"2024-09-13T06:12:49.513237+0000","last_became_active":"2024-09-13T06:09:34.116359+0000","last_became_peered":"2024-09-13T06:09:34.116359+0000","last_unstale":"2024-09-13T06:12:49.513237+0000","last_undegraded":"2024-09-13T06:12:49.513237+0000","last_fullsized":"2024-09-13T06:12:49.513237+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:45:39.768477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.282953+0000","last_change":"2024-09-13T06:09:32.135469+0000","last_active":"2024-09-13T06:12:49.282953+0000","last_peered":"2024-09-13T06:12:49.282953+0000","last_clean":"2024-09-13T06:12:49.282953+0000","last_became_active":"2024-09-13T06:09:32.134667+0000","last_became_peered":"2024-09-13T06:09:32.134667+0000","last_unstale":"2024-09-13T06:12:49.282953+0000","last_undegraded":"2024-09-13T06:12:49.282953+0000","last_fullsized":"2024-09-13T06:12:49.282953+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:48:22.672562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"35'18","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.437837+0000","last_change":"2024-09-13T06:09:34.118112+0000","last_active":"2024-09-13T06:12:49.437837+0000","last_peered":"2024-09-13T06:12:49.437837+0000","last_clean":"2024-09-13T06:12:49.437837+0000","last_became_active":"2024-09-13T06:09:34.115348+0000","last_became_peered":"2024-09-13T06:09:34.115348+0000","last_unstale":"2024-09-13T06:12:49.437837+0000","last_undegraded":"2024-09-13T06:12:49.437837+0000","last_fullsized":"2024-09-13T06:12:49.437837+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:27:45.493240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":45,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.804770+0000","last_change":"2024-09-13T06:09:32.137039+0000","last_active":"2024-09-13T06:10:10.804770+0000","last_peered":"2024-09-13T06:10:10.804770+0000","last_clean":"2024-09-13T06:10:10.804770+0000","last_became_active":"2024-09-13T06:09:32.135460+0000","last_became_peered":"2024-09-13T06:09:32.135460+0000","last_unstale":"2024-09-13T06:10:10.804770+0000","last_undegraded":"2024-09-13T06:10:10.804770+0000","last_fullsized":"2024-09-13T06:10:10.804770+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:11:15.868187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"35'2","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:19.300519+0000","last_change":"2024-09-13T06:09:34.115425+0000","last_active":"2024-09-13T06:10:19.300519+0000","last_peered":"2024-09-13T06:10:19.300519+0000","last_clean":"2024-09-13T06:10:19.300519+0000","last_became_active":"2024-09-13T06:09:34.115047+0000","last_became_peered":"2024-09-13T06:09:34.115047+0000","last_unstale":"2024-09-13T06:10:19.300519+0000","last_undegraded":"2024-09-13T06:10:19.300519+0000","last_fullsized":"2024-09-13T06:10:19.300519+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:46:23.635958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:18.040942+0000","last_change":"2024-09-13T06:09:32.143123+0000","last_active":"2024-09-13T06:10:18.040942+0000","last_peered":"2024-09-13T06:10:18.040942+0000","last_clean":"2024-09-13T06:10:18.040942+0000","last_became_active":"2024-09-13T06:09:32.141166+0000","last_became_peered":"2024-09-13T06:09:32.141166+0000","last_unstale":"2024-09-13T06:10:18.040942+0000","last_undegraded":"2024-09-13T06:10:18.040942+0000","last_fullsized":"2024-09-13T06:10:18.040942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:03:45.423034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"35'4","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.435819+0000","last_change":"2024-09-13T06:09:34.116108+0000","last_active":"2024-09-13T06:12:49.435819+0000","last_peered":"2024-09-13T06:12:49.435819+0000","last_clean":"2024-09-13T06:12:49.435819+0000","last_became_active":"2024-09-13T06:09:34.114242+0000","last_became_peered":"2024-09-13T06:09:34.114242+0000","last_unstale":"2024-09-13T06:12:49.435819+0000","last_undegraded":"2024-09-13T06:12:49.435819+0000","last_fullsized":"2024-09-13T06:12:49.435819+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:51:17.686447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.816928+0000","last_change":"2024-09-13T06:09:32.144134+0000","last_active":"2024-09-13T06:10:10.816928+0000","last_peered":"2024-09-13T06:10:10.816928+0000","last_clean":"2024-09-13T06:10:10.816928+0000","last_became_active":"2024-09-13T06:09:32.143746+0000","last_became_peered":"2024-09-13T06:09:32.143746+0000","last_unstale":"2024-09-13T06:10:10.816928+0000","last_undegraded":"2024-09-13T06:10:10.816928+0000","last_fullsized":"2024-09-13T06:10:10.816928+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:37:03.391739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"35'8","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.532750+0000","last_change":"2024-09-13T06:09:34.101552+0000","last_active":"2024-09-13T06:12:49.532750+0000","last_peered":"2024-09-13T06:12:49.532750+0000","last_clean":"2024-09-13T06:12:49.532750+0000","last_became_active":"2024-09-13T06:09:34.101167+0000","last_became_peered":"2024-09-13T06:09:34.101167+0000","last_unstale":"2024-09-13T06:12:49.532750+0000","last_undegraded":"2024-09-13T06:12:49.532750+0000","last_fullsized":"2024-09-13T06:12:49.532750+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:16:44.971572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.950455+0000","last_change":"2024-09-13T06:09:32.153552+0000","last_active":"2024-09-13T06:10:10.950455+0000","last_peered":"2024-09-13T06:10:10.950455+0000","last_clean":"2024-09-13T06:10:10.950455+0000","last_became_active":"2024-09-13T06:09:32.149885+0000","last_became_peered":"2024-09-13T06:09:32.149885+0000","last_unstale":"2024-09-13T06:10:10.950455+0000","last_undegraded":"2024-09-13T06:10:10.950455+0000","last_fullsized":"2024-09-13T06:10:10.950455+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:11:15.868187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"35'14","reported_seq":65,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.436750+0000","last_change":"2024-09-13T06:09:34.127656+0000","last_active":"2024-09-13T06:12:49.436750+0000","last_peered":"2024-09-13T06:12:49.436750+0000","last_clean":"2024-09-13T06:12:49.436750+0000","last_became_active":"2024-09-13T06:09:34.124299+0000","last_became_peered":"2024-09-13T06:09:34.124299+0000","last_unstale":"2024-09-13T06:12:49.436750+0000","last_undegraded":"2024-09-13T06:12:49.436750+0000","last_fullsized":"2024-09-13T06:12:49.436750+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:33:59.661744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.804400+0000","last_change":"2024-09-13T06:09:32.141692+0000","last_active":"2024-09-13T06:10:10.804400+0000","last_peered":"2024-09-13T06:10:10.804400+0000","last_clean":"2024-09-13T06:10:10.804400+0000","last_became_active":"2024-09-13T06:09:32.128376+0000","last_became_peered":"2024-09-13T06:09:32.128376+0000","last_unstale":"2024-09-13T06:10:10.804400+0000","last_undegraded":"2024-09-13T06:10:10.804400+0000","last_fullsized":"2024-09-13T06:10:10.804400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:45:45.430627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"35'43","reported_seq":124,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.385246+0000","last_change":"2024-09-13T06:09:42.187344+0000","last_active":"2024-09-13T06:12:49.385246+0000","last_peered":"2024-09-13T06:12:49.385246+0000","last_clean":"2024-09-13T06:12:49.385246+0000","last_became_active":"2024-09-13T06:09:42.186091+0000","last_became_peered":"2024-09-13T06:09:42.186091+0000","last_unstale":"2024-09-13T06:12:49.385246+0000","last_undegraded":"2024-09-13T06:12:49.385246+0000","last_fullsized":"2024-09-13T06:12:49.385246+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:11:39.558405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":246,"num_read_kb":228,"num_write":124,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"35'16","reported_seq":106,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:48.979007+0000","last_change":"2024-09-13T06:09:34.118780+0000","last_active":"2024-09-13T06:12:48.979007+0000","last_peered":"2024-09-13T06:12:48.979007+0000","last_clean":"2024-09-13T06:12:48.979007+0000","last_became_active":"2024-09-13T06:09:34.118393+0000","last_became_peered":"2024-09-13T06:09:34.118393+0000","last_unstale":"2024-09-13T06:12:48.979007+0000","last_undegraded":"2024-09-13T06:12:48.979007+0000","last_fullsized":"2024-09-13T06:12:48.979007+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:21:29.722330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":90,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"35'6","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:19.613864+0000","last_change":"2024-09-13T06:09:32.139342+0000","last_active":"2024-09-13T06:10:19.613864+0000","last_peered":"2024-09-13T06:10:19.613864+0000","last_clean":"2024-09-13T06:10:19.613864+0000","last_became_active":"2024-09-13T06:09:32.133545+0000","last_became_peered":"2024-09-13T06:09:32.133545+0000","last_unstale":"2024-09-13T06:10:19.613864+0000","last_undegraded":"2024-09-13T06:10:19.613864+0000","last_fullsized":"2024-09-13T06:10:19.613864+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:33:10.777679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.811858+0000","last_change":"2024-09-13T06:09:36.155061+0000","last_active":"2024-09-13T06:10:10.811858+0000","last_peered":"2024-09-13T06:10:10.811858+0000","last_clean":"2024-09-13T06:10:10.811858+0000","last_became_active":"2024-09-13T06:09:36.153420+0000","last_became_peered":"2024-09-13T06:09:36.153420+0000","last_unstale":"2024-09-13T06:10:10.811858+0000","last_undegraded":"2024-09-13T06:10:10.811858+0000","last_fullsized":"2024-09-13T06:10:10.811858+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:15:11.225972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"35'33","reported_seq":79,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:20.799843+0000","last_change":"2024-09-13T06:09:38.177058+0000","last_active":"2024-09-13T06:13:20.799843+0000","last_peered":"2024-09-13T06:13:20.799843+0000","last_clean":"2024-09-13T06:13:20.799843+0000","last_became_active":"2024-09-13T06:09:38.175393+0000","last_became_peered":"2024-09-13T06:09:38.175393+0000","last_unstale":"2024-09-13T06:13:20.799843+0000","last_undegraded":"2024-09-13T06:13:20.799843+0000","last_fullsized":"2024-09-13T06:13:20.799843+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:11:00.288447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.822023+0000","last_change":"2024-09-13T06:09:40.186286+0000","last_active":"2024-09-13T06:10:10.822023+0000","last_peered":"2024-09-13T06:10:10.822023+0000","last_clean":"2024-09-13T06:10:10.822023+0000","last_became_active":"2024-09-13T06:09:40.185574+0000","last_became_peered":"2024-09-13T06:09:40.185574+0000","last_unstale":"2024-09-13T06:10:10.822023+0000","last_undegraded":"2024-09-13T06:10:10.822023+0000","last_fullsized":"2024-09-13T06:10:10.822023+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:03:19.605623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"35'9","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:02.618334+0000","last_change":"2024-09-13T06:09:42.183906+0000","last_active":"2024-09-13T06:11:02.618334+0000","last_peered":"2024-09-13T06:11:02.618334+0000","last_clean":"2024-09-13T06:11:02.618334+0000","last_became_active":"2024-09-13T06:09:42.183162+0000","last_became_peered":"2024-09-13T06:09:42.183162+0000","last_unstale":"2024-09-13T06:11:02.618334+0000","last_undegraded":"2024-09-13T06:11:02.618334+0000","last_fullsized":"2024-09-13T06:11:02.618334+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:59:27.808952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":19,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"35'6","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.321683+0000","last_change":"2024-09-13T06:09:34.120990+0000","last_active":"2024-09-13T06:12:49.321683+0000","last_peered":"2024-09-13T06:12:49.321683+0000","last_clean":"2024-09-13T06:12:49.321683+0000","last_became_active":"2024-09-13T06:09:34.120600+0000","last_became_peered":"2024-09-13T06:09:34.120600+0000","last_unstale":"2024-09-13T06:12:49.321683+0000","last_undegraded":"2024-09-13T06:12:49.321683+0000","last_fullsized":"2024-09-13T06:12:49.321683+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:55:39.596421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.794741+0000","last_change":"2024-09-13T06:09:32.139993+0000","last_active":"2024-09-13T06:10:10.794741+0000","last_peered":"2024-09-13T06:10:10.794741+0000","last_clean":"2024-09-13T06:10:10.794741+0000","last_became_active":"2024-09-13T06:09:32.138643+0000","last_became_peered":"2024-09-13T06:09:32.138643+0000","last_unstale":"2024-09-13T06:10:10.794741+0000","last_undegraded":"2024-09-13T06:10:10.794741+0000","last_fullsized":"2024-09-13T06:10:10.794741+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:53:16.188364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.946255+0000","last_change":"2024-09-13T06:09:36.139879+0000","last_active":"2024-09-13T06:10:10.946255+0000","last_peered":"2024-09-13T06:10:10.946255+0000","last_clean":"2024-09-13T06:10:10.946255+0000","last_became_active":"2024-09-13T06:09:36.139235+0000","last_became_peered":"2024-09-13T06:09:36.139235+0000","last_unstale":"2024-09-13T06:10:10.946255+0000","last_undegraded":"2024-09-13T06:10:10.946255+0000","last_fullsized":"2024-09-13T06:10:10.946255+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:12:32.105314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"33'6","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.821659+0000","last_change":"2024-09-13T06:09:38.162297+0000","last_active":"2024-09-13T06:10:10.821659+0000","last_peered":"2024-09-13T06:10:10.821659+0000","last_clean":"2024-09-13T06:10:10.821659+0000","last_became_active":"2024-09-13T06:09:38.161539+0000","last_became_peered":"2024-09-13T06:09:38.161539+0000","last_unstale":"2024-09-13T06:10:10.821659+0000","last_undegraded":"2024-09-13T06:10:10.821659+0000","last_fullsized":"2024-09-13T06:10:10.821659+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:40:25.153315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.820538+0000","last_change":"2024-09-13T06:09:40.183211+0000","last_active":"2024-09-13T06:10:10.820538+0000","last_peered":"2024-09-13T06:10:10.820538+0000","last_clean":"2024-09-13T06:10:10.820538+0000","last_became_active":"2024-09-13T06:09:40.182436+0000","last_became_peered":"2024-09-13T06:09:40.182436+0000","last_unstale":"2024-09-13T06:10:10.820538+0000","last_undegraded":"2024-09-13T06:10:10.820538+0000","last_fullsized":"2024-09-13T06:10:10.820538+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:23:15.512719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"33'2","reported_seq":19,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.943536+0000","last_change":"2024-09-13T06:09:42.209170+0000","last_active":"2024-09-13T06:10:10.943536+0000","last_peered":"2024-09-13T06:10:10.943536+0000","last_clean":"2024-09-13T06:10:10.943536+0000","last_became_active":"2024-09-13T06:09:42.208430+0000","last_became_peered":"2024-09-13T06:09:42.208430+0000","last_unstale":"2024-09-13T06:10:10.943536+0000","last_undegraded":"2024-09-13T06:10:10.943536+0000","last_fullsized":"2024-09-13T06:10:10.943536+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:29:22.362293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"35'6","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.321687+0000","last_change":"2024-09-13T06:09:34.123289+0000","last_active":"2024-09-13T06:12:49.321687+0000","last_peered":"2024-09-13T06:12:49.321687+0000","last_clean":"2024-09-13T06:12:49.321687+0000","last_became_active":"2024-09-13T06:09:34.122001+0000","last_became_peered":"2024-09-13T06:09:34.122001+0000","last_unstale":"2024-09-13T06:12:49.321687+0000","last_undegraded":"2024-09-13T06:12:49.321687+0000","last_fullsized":"2024-09-13T06:12:49.321687+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:24:35.914145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:48.752103+0000","last_change":"2024-09-13T06:09:32.132575+0000","last_active":"2024-09-13T06:12:48.752103+0000","last_peered":"2024-09-13T06:12:48.752103+0000","last_clean":"2024-09-13T06:12:48.752103+0000","last_became_active":"2024-09-13T06:09:32.129739+0000","last_became_peered":"2024-09-13T06:09:32.129739+0000","last_unstale":"2024-09-13T06:12:48.752103+0000","last_undegraded":"2024-09-13T06:12:48.752103+0000","last_fullsized":"2024-09-13T06:12:48.752103+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:34:42.649939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.951834+0000","last_change":"2024-09-13T06:09:36.144172+0000","last_active":"2024-09-13T06:10:10.951834+0000","last_peered":"2024-09-13T06:10:10.951834+0000","last_clean":"2024-09-13T06:10:10.951834+0000","last_became_active":"2024-09-13T06:09:36.143405+0000","last_became_peered":"2024-09-13T06:09:36.143405+0000","last_unstale":"2024-09-13T06:10:10.951834+0000","last_undegraded":"2024-09-13T06:10:10.951834+0000","last_fullsized":"2024-09-13T06:10:10.951834+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:08:14.626902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"33'10","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.797420+0000","last_change":"2024-09-13T06:09:38.155433+0000","last_active":"2024-09-13T06:10:10.797420+0000","last_peered":"2024-09-13T06:10:10.797420+0000","last_clean":"2024-09-13T06:10:10.797420+0000","last_became_active":"2024-09-13T06:09:38.154654+0000","last_became_peered":"2024-09-13T06:09:38.154654+0000","last_unstale":"2024-09-13T06:10:10.797420+0000","last_undegraded":"2024-09-13T06:10:10.797420+0000","last_fullsized":"2024-09-13T06:10:10.797420+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:57:04.837597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"35'285","reported_seq":408,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:20.664554+0000","last_change":"2024-09-13T06:09:40.192039+0000","last_active":"2024-09-13T06:13:20.664554+0000","last_peered":"2024-09-13T06:13:20.664554+0000","last_clean":"2024-09-13T06:13:20.664554+0000","last_became_active":"2024-09-13T06:09:40.190377+0000","last_became_peered":"2024-09-13T06:09:40.190377+0000","last_unstale":"2024-09-13T06:13:20.664554+0000","last_undegraded":"2024-09-13T06:13:20.664554+0000","last_fullsized":"2024-09-13T06:13:20.664554+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:35:10.494464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.796286+0000","last_change":"2024-09-13T06:09:42.204612+0000","last_active":"2024-09-13T06:10:10.796286+0000","last_peered":"2024-09-13T06:10:10.796286+0000","last_clean":"2024-09-13T06:10:10.796286+0000","last_became_active":"2024-09-13T06:09:42.204083+0000","last_became_peered":"2024-09-13T06:09:42.204083+0000","last_unstale":"2024-09-13T06:10:10.796286+0000","last_undegraded":"2024-09-13T06:10:10.796286+0000","last_fullsized":"2024-09-13T06:10:10.796286+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:07:08.179083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"35'6","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:48.235953+0000","last_change":"2024-09-13T06:09:34.131719+0000","last_active":"2024-09-13T06:11:48.235953+0000","last_peered":"2024-09-13T06:11:48.235953+0000","last_clean":"2024-09-13T06:11:48.235953+0000","last_became_active":"2024-09-13T06:09:34.130815+0000","last_became_peered":"2024-09-13T06:09:34.130815+0000","last_unstale":"2024-09-13T06:11:48.235953+0000","last_undegraded":"2024-09-13T06:11:48.235953+0000","last_fullsized":"2024-09-13T06:11:48.235953+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:14:31.056024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.807240+0000","last_change":"2024-09-13T06:09:32.118707+0000","last_active":"2024-09-13T06:10:10.807240+0000","last_peered":"2024-09-13T06:10:10.807240+0000","last_clean":"2024-09-13T06:10:10.807240+0000","last_became_active":"2024-09-13T06:09:32.118278+0000","last_became_peered":"2024-09-13T06:09:32.118278+0000","last_unstale":"2024-09-13T06:10:10.807240+0000","last_undegraded":"2024-09-13T06:10:10.807240+0000","last_fullsized":"2024-09-13T06:10:10.807240+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:27:21.997161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.826255+0000","last_change":"2024-09-13T06:10:10.825317+0000","last_active":"2024-09-13T06:10:10.826255+0000","last_peered":"2024-09-13T06:10:10.826255+0000","last_clean":"2024-09-13T06:10:10.826255+0000","last_became_active":"2024-09-13T06:10:10.824420+0000","last_became_peered":"2024-09-13T06:10:10.824420+0000","last_unstale":"2024-09-13T06:10:10.826255+0000","last_undegraded":"2024-09-13T06:10:10.826255+0000","last_fullsized":"2024-09-13T06:10:10.826255+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:36:20.133257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"35'34","reported_seq":80,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:20.770185+0000","last_change":"2024-09-13T06:09:38.158195+0000","last_active":"2024-09-13T06:13:20.770185+0000","last_peered":"2024-09-13T06:13:20.770185+0000","last_clean":"2024-09-13T06:13:20.770185+0000","last_became_active":"2024-09-13T06:09:38.157430+0000","last_became_peered":"2024-09-13T06:09:38.157430+0000","last_unstale":"2024-09-13T06:13:20.770185+0000","last_undegraded":"2024-09-13T06:13:20.770185+0000","last_fullsized":"2024-09-13T06:13:20.770185+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:00:13.206413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"35'284","reported_seq":438,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:20.670964+0000","last_change":"2024-09-13T06:09:40.176671+0000","last_active":"2024-09-13T06:13:20.670964+0000","last_peered":"2024-09-13T06:13:20.670964+0000","last_clean":"2024-09-13T06:13:20.670964+0000","last_became_active":"2024-09-13T06:09:40.175871+0000","last_became_peered":"2024-09-13T06:09:40.175871+0000","last_unstale":"2024-09-13T06:13:20.670964+0000","last_undegraded":"2024-09-13T06:13:20.670964+0000","last_fullsized":"2024-09-13T06:13:20.670964+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:17:37.423986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"35'2","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:43.532992+0000","last_change":"2024-09-13T06:09:34.127109+0000","last_active":"2024-09-13T06:11:43.532992+0000","last_peered":"2024-09-13T06:11:43.532992+0000","last_clean":"2024-09-13T06:11:43.532992+0000","last_became_active":"2024-09-13T06:09:34.126374+0000","last_became_peered":"2024-09-13T06:09:34.126374+0000","last_unstale":"2024-09-13T06:11:43.532992+0000","last_undegraded":"2024-09-13T06:11:43.532992+0000","last_fullsized":"2024-09-13T06:11:43.532992+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:41:31.632632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.797517+0000","last_change":"2024-09-13T06:09:32.131764+0000","last_active":"2024-09-13T06:10:10.797517+0000","last_peered":"2024-09-13T06:10:10.797517+0000","last_clean":"2024-09-13T06:10:10.797517+0000","last_became_active":"2024-09-13T06:09:32.131373+0000","last_became_peered":"2024-09-13T06:09:32.131373+0000","last_unstale":"2024-09-13T06:10:10.797517+0000","last_undegraded":"2024-09-13T06:10:10.797517+0000","last_fullsized":"2024-09-13T06:10:10.797517+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:24:08.865544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.814065+0000","last_change":"2024-09-13T06:09:36.139927+0000","last_active":"2024-09-13T06:10:10.814065+0000","last_peered":"2024-09-13T06:10:10.814065+0000","last_clean":"2024-09-13T06:10:10.814065+0000","last_became_active":"2024-09-13T06:09:36.137016+0000","last_became_peered":"2024-09-13T06:09:36.137016+0000","last_unstale":"2024-09-13T06:10:10.814065+0000","last_undegraded":"2024-09-13T06:10:10.814065+0000","last_fullsized":"2024-09-13T06:10:10.814065+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:42:25.451374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"35'43","reported_seq":94,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:20.824420+0000","last_change":"2024-09-13T06:09:38.164413+0000","last_active":"2024-09-13T06:13:20.824420+0000","last_peered":"2024-09-13T06:13:20.824420+0000","last_clean":"2024-09-13T06:13:20.824420+0000","last_became_active":"2024-09-13T06:09:38.163472+0000","last_became_peered":"2024-09-13T06:09:38.163472+0000","last_unstale":"2024-09-13T06:13:20.824420+0000","last_undegraded":"2024-09-13T06:13:20.824420+0000","last_fullsized":"2024-09-13T06:13:20.824420+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:08:16.650346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.948584+0000","last_change":"2024-09-13T06:09:40.172425+0000","last_active":"2024-09-13T06:10:10.948584+0000","last_peered":"2024-09-13T06:10:10.948584+0000","last_clean":"2024-09-13T06:10:10.948584+0000","last_became_active":"2024-09-13T06:09:40.171609+0000","last_became_peered":"2024-09-13T06:09:40.171609+0000","last_unstale":"2024-09-13T06:10:10.948584+0000","last_undegraded":"2024-09-13T06:10:10.948584+0000","last_fullsized":"2024-09-13T06:10:10.948584+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:46:09.860554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"35'5","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.403220+0000","last_change":"2024-09-13T06:09:42.208317+0000","last_active":"2024-09-13T06:12:49.403220+0000","last_peered":"2024-09-13T06:12:49.403220+0000","last_clean":"2024-09-13T06:12:49.403220+0000","last_became_active":"2024-09-13T06:09:42.193426+0000","last_became_peered":"2024-09-13T06:09:42.193426+0000","last_unstale":"2024-09-13T06:12:49.403220+0000","last_undegraded":"2024-09-13T06:12:49.403220+0000","last_fullsized":"2024-09-13T06:12:49.403220+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:49:53.497381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"35'6","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.321762+0000","last_change":"2024-09-13T06:09:34.118017+0000","last_active":"2024-09-13T06:12:49.321762+0000","last_peered":"2024-09-13T06:12:49.321762+0000","last_clean":"2024-09-13T06:12:49.321762+0000","last_became_active":"2024-09-13T06:09:34.114999+0000","last_became_peered":"2024-09-13T06:09:34.114999+0000","last_unstale":"2024-09-13T06:12:49.321762+0000","last_undegraded":"2024-09-13T06:12:49.321762+0000","last_fullsized":"2024-09-13T06:12:49.321762+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:31:56.256920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.803293+0000","last_change":"2024-09-13T06:09:32.118402+0000","last_active":"2024-09-13T06:10:10.803293+0000","last_peered":"2024-09-13T06:10:10.803293+0000","last_clean":"2024-09-13T06:10:10.803293+0000","last_became_active":"2024-09-13T06:09:32.117779+0000","last_became_peered":"2024-09-13T06:09:32.117779+0000","last_unstale":"2024-09-13T06:10:10.803293+0000","last_undegraded":"2024-09-13T06:10:10.803293+0000","last_fullsized":"2024-09-13T06:10:10.803293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:42:54.943685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.943993+0000","last_change":"2024-09-13T06:09:36.136523+0000","last_active":"2024-09-13T06:10:10.943993+0000","last_peered":"2024-09-13T06:10:10.943993+0000","last_clean":"2024-09-13T06:10:10.943993+0000","last_became_active":"2024-09-13T06:09:36.135862+0000","last_became_peered":"2024-09-13T06:09:36.135862+0000","last_unstale":"2024-09-13T06:10:10.943993+0000","last_undegraded":"2024-09-13T06:10:10.943993+0000","last_fullsized":"2024-09-13T06:10:10.943993+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:48:51.597962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"35'34","reported_seq":80,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:20.919189+0000","last_change":"2024-09-13T06:09:38.173198+0000","last_active":"2024-09-13T06:13:20.919189+0000","last_peered":"2024-09-13T06:13:20.919189+0000","last_clean":"2024-09-13T06:13:20.919189+0000","last_became_active":"2024-09-13T06:09:38.171931+0000","last_became_peered":"2024-09-13T06:09:38.171931+0000","last_unstale":"2024-09-13T06:13:20.919189+0000","last_undegraded":"2024-09-13T06:13:20.919189+0000","last_fullsized":"2024-09-13T06:13:20.919189+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:38:56.011466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.945598+0000","last_change":"2024-09-13T06:09:40.179448+0000","last_active":"2024-09-13T06:10:10.945598+0000","last_peered":"2024-09-13T06:10:10.945598+0000","last_clean":"2024-09-13T06:10:10.945598+0000","last_became_active":"2024-09-13T06:09:40.178545+0000","last_became_peered":"2024-09-13T06:09:40.178545+0000","last_unstale":"2024-09-13T06:10:10.945598+0000","last_undegraded":"2024-09-13T06:10:10.945598+0000","last_fullsized":"2024-09-13T06:10:10.945598+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:54:35.378117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"35'5","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.000310+0000","last_change":"2024-09-13T06:09:42.206012+0000","last_active":"2024-09-13T06:12:49.000310+0000","last_peered":"2024-09-13T06:12:49.000310+0000","last_clean":"2024-09-13T06:12:49.000310+0000","last_became_active":"2024-09-13T06:09:42.204945+0000","last_became_peered":"2024-09-13T06:09:42.204945+0000","last_unstale":"2024-09-13T06:12:49.000310+0000","last_undegraded":"2024-09-13T06:12:49.000310+0000","last_fullsized":"2024-09-13T06:12:49.000310+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:32:49.081082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"33'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.799349+0000","last_change":"2024-09-13T06:09:34.104885+0000","last_active":"2024-09-13T06:10:10.799349+0000","last_peered":"2024-09-13T06:10:10.799349+0000","last_clean":"2024-09-13T06:10:10.799349+0000","last_became_active":"2024-09-13T06:09:34.102657+0000","last_became_peered":"2024-09-13T06:09:34.102657+0000","last_unstale":"2024-09-13T06:10:10.799349+0000","last_undegraded":"2024-09-13T06:10:10.799349+0000","last_fullsized":"2024-09-13T06:10:10.799349+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:18:18.221662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"35'6","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.507628+0000","last_change":"2024-09-13T06:09:32.136390+0000","last_active":"2024-09-13T06:12:49.507628+0000","last_peered":"2024-09-13T06:12:49.507628+0000","last_clean":"2024-09-13T06:12:49.507628+0000","last_became_active":"2024-09-13T06:09:32.133020+0000","last_became_peered":"2024-09-13T06:09:32.133020+0000","last_unstale":"2024-09-13T06:12:49.507628+0000","last_undegraded":"2024-09-13T06:12:49.507628+0000","last_fullsized":"2024-09-13T06:12:49.507628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:29:18.318697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":22,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:11.778692+0000","last_change":"2024-09-13T06:10:10.810157+0000","last_active":"2024-09-13T06:10:11.778692+0000","last_peered":"2024-09-13T06:10:11.778692+0000","last_clean":"2024-09-13T06:10:11.778692+0000","last_became_active":"2024-09-13T06:10:10.809442+0000","last_became_peered":"2024-09-13T06:10:10.809442+0000","last_unstale":"2024-09-13T06:10:11.778692+0000","last_undegraded":"2024-09-13T06:10:11.778692+0000","last_fullsized":"2024-09-13T06:10:11.778692+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:15:18.836646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"35'39","reported_seq":88,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:20.835072+0000","last_change":"2024-09-13T06:09:38.155448+0000","last_active":"2024-09-13T06:13:20.835072+0000","last_peered":"2024-09-13T06:13:20.835072+0000","last_clean":"2024-09-13T06:13:20.835072+0000","last_became_active":"2024-09-13T06:09:38.154720+0000","last_became_peered":"2024-09-13T06:09:38.154720+0000","last_unstale":"2024-09-13T06:13:20.835072+0000","last_undegraded":"2024-09-13T06:13:20.835072+0000","last_fullsized":"2024-09-13T06:13:20.835072+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:23:45.584512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"35'284","reported_seq":400,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:20.673332+0000","last_change":"2024-09-13T06:09:40.187775+0000","last_active":"2024-09-13T06:13:20.673332+0000","last_peered":"2024-09-13T06:13:20.673332+0000","last_clean":"2024-09-13T06:13:20.673332+0000","last_became_active":"2024-09-13T06:09:40.186987+0000","last_became_peered":"2024-09-13T06:09:40.186987+0000","last_unstale":"2024-09-13T06:13:20.673332+0000","last_undegraded":"2024-09-13T06:13:20.673332+0000","last_fullsized":"2024-09-13T06:13:20.673332+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:05:45.705137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"35'2","reported_seq":19,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:48.226943+0000","last_change":"2024-09-13T06:09:42.202356+0000","last_active":"2024-09-13T06:11:48.226943+0000","last_peered":"2024-09-13T06:11:48.226943+0000","last_clean":"2024-09-13T06:11:48.226943+0000","last_became_active":"2024-09-13T06:09:42.201678+0000","last_became_peered":"2024-09-13T06:09:42.201678+0000","last_unstale":"2024-09-13T06:11:48.226943+0000","last_undegraded":"2024-09-13T06:11:48.226943+0000","last_fullsized":"2024-09-13T06:11:48.226943+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:44:32.357425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"35'14","reported_seq":69,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:48.237783+0000","last_change":"2024-09-13T06:09:34.103681+0000","last_active":"2024-09-13T06:11:48.237783+0000","last_peered":"2024-09-13T06:11:48.237783+0000","last_clean":"2024-09-13T06:11:48.237783+0000","last_became_active":"2024-09-13T06:09:34.103295+0000","last_became_peered":"2024-09-13T06:09:34.103295+0000","last_unstale":"2024-09-13T06:11:48.237783+0000","last_undegraded":"2024-09-13T06:11:48.237783+0000","last_fullsized":"2024-09-13T06:11:48.237783+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:12:41.439746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.809624+0000","last_change":"2024-09-13T06:09:32.128209+0000","last_active":"2024-09-13T06:10:10.809624+0000","last_peered":"2024-09-13T06:10:10.809624+0000","last_clean":"2024-09-13T06:10:10.809624+0000","last_became_active":"2024-09-13T06:09:32.125047+0000","last_became_peered":"2024-09-13T06:09:32.125047+0000","last_unstale":"2024-09-13T06:10:10.809624+0000","last_undegraded":"2024-09-13T06:10:10.809624+0000","last_fullsized":"2024-09-13T06:10:10.809624+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:22:25.339690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.946037+0000","last_change":"2024-09-13T06:09:36.136740+0000","last_active":"2024-09-13T06:10:10.946037+0000","last_peered":"2024-09-13T06:10:10.946037+0000","last_clean":"2024-09-13T06:10:10.946037+0000","last_became_active":"2024-09-13T06:09:36.135896+0000","last_became_peered":"2024-09-13T06:09:36.135896+0000","last_unstale":"2024-09-13T06:10:10.946037+0000","last_undegraded":"2024-09-13T06:10:10.946037+0000","last_fullsized":"2024-09-13T06:10:10.946037+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:38:41.311788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"35'63","reported_seq":127,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:20.966286+0000","last_change":"2024-09-13T06:09:38.176653+0000","last_active":"2024-09-13T06:13:20.966286+0000","last_peered":"2024-09-13T06:13:20.966286+0000","last_clean":"2024-09-13T06:13:20.966286+0000","last_became_active":"2024-09-13T06:09:38.175404+0000","last_became_peered":"2024-09-13T06:09:38.175404+0000","last_unstale":"2024-09-13T06:13:20.966286+0000","last_undegraded":"2024-09-13T06:13:20.966286+0000","last_fullsized":"2024-09-13T06:13:20.966286+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:20:41.974878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":65,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.943056+0000","last_change":"2024-09-13T06:09:40.178019+0000","last_active":"2024-09-13T06:10:10.943056+0000","last_peered":"2024-09-13T06:10:10.943056+0000","last_clean":"2024-09-13T06:10:10.943056+0000","last_became_active":"2024-09-13T06:09:40.177127+0000","last_became_peered":"2024-09-13T06:09:40.177127+0000","last_unstale":"2024-09-13T06:10:10.943056+0000","last_undegraded":"2024-09-13T06:10:10.943056+0000","last_fullsized":"2024-09-13T06:10:10.943056+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:03:59.282151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"35'18","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.796652+0000","last_change":"2024-09-13T06:09:42.177354+0000","last_active":"2024-09-13T06:12:49.796652+0000","last_peered":"2024-09-13T06:12:49.796652+0000","last_clean":"2024-09-13T06:12:49.796652+0000","last_became_active":"2024-09-13T06:09:42.176229+0000","last_became_peered":"2024-09-13T06:09:42.176229+0000","last_unstale":"2024-09-13T06:12:49.796652+0000","last_undegraded":"2024-09-13T06:12:49.796652+0000","last_fullsized":"2024-09-13T06:12:49.796652+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:00:06.521241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"35'16","reported_seq":77,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.114923+0000","last_change":"2024-09-13T06:09:34.121751+0000","last_active":"2024-09-13T06:12:49.114923+0000","last_peered":"2024-09-13T06:12:49.114923+0000","last_clean":"2024-09-13T06:12:49.114923+0000","last_became_active":"2024-09-13T06:09:34.119018+0000","last_became_peered":"2024-09-13T06:09:34.119018+0000","last_unstale":"2024-09-13T06:12:49.114923+0000","last_undegraded":"2024-09-13T06:12:49.114923+0000","last_fullsized":"2024-09-13T06:12:49.114923+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:43:00.917159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"35'1","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:50.799501+0000","last_change":"2024-09-13T06:09:32.151752+0000","last_active":"2024-09-13T06:11:50.799501+0000","last_peered":"2024-09-13T06:11:50.799501+0000","last_clean":"2024-09-13T06:11:50.799501+0000","last_became_active":"2024-09-13T06:09:32.148505+0000","last_became_peered":"2024-09-13T06:09:32.148505+0000","last_unstale":"2024-09-13T06:11:50.799501+0000","last_undegraded":"2024-09-13T06:11:50.799501+0000","last_fullsized":"2024-09-13T06:11:50.799501+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:15:48.717644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.807504+0000","last_change":"2024-09-13T06:09:36.132310+0000","last_active":"2024-09-13T06:10:10.807504+0000","last_peered":"2024-09-13T06:10:10.807504+0000","last_clean":"2024-09-13T06:10:10.807504+0000","last_became_active":"2024-09-13T06:09:36.131611+0000","last_became_peered":"2024-09-13T06:09:36.131611+0000","last_unstale":"2024-09-13T06:10:10.807504+0000","last_undegraded":"2024-09-13T06:10:10.807504+0000","last_fullsized":"2024-09-13T06:10:10.807504+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:13:56.015822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"35'36","reported_seq":83,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:20.974108+0000","last_change":"2024-09-13T06:09:38.166492+0000","last_active":"2024-09-13T06:13:20.974108+0000","last_peered":"2024-09-13T06:13:20.974108+0000","last_clean":"2024-09-13T06:13:20.974108+0000","last_became_active":"2024-09-13T06:09:38.165747+0000","last_became_peered":"2024-09-13T06:09:38.165747+0000","last_unstale":"2024-09-13T06:13:20.974108+0000","last_undegraded":"2024-09-13T06:13:20.974108+0000","last_fullsized":"2024-09-13T06:13:20.974108+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:11:40.651218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.816868+0000","last_change":"2024-09-13T06:09:40.190860+0000","last_active":"2024-09-13T06:10:10.816868+0000","last_peered":"2024-09-13T06:10:10.816868+0000","last_clean":"2024-09-13T06:10:10.816868+0000","last_became_active":"2024-09-13T06:09:40.190314+0000","last_became_peered":"2024-09-13T06:09:40.190314+0000","last_unstale":"2024-09-13T06:10:10.816868+0000","last_undegraded":"2024-09-13T06:10:10.816868+0000","last_fullsized":"2024-09-13T06:10:10.816868+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:52:35.906978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"35'3","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:45.410142+0000","last_change":"2024-09-13T06:09:42.202356+0000","last_active":"2024-09-13T06:11:45.410142+0000","last_peered":"2024-09-13T06:11:45.410142+0000","last_clean":"2024-09-13T06:11:45.410142+0000","last_became_active":"2024-09-13T06:09:42.201211+0000","last_became_peered":"2024-09-13T06:09:42.201211+0000","last_unstale":"2024-09-13T06:11:45.410142+0000","last_undegraded":"2024-09-13T06:11:45.410142+0000","last_fullsized":"2024-09-13T06:11:45.410142+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:35:04.349746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"35'5","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.455185+0000","last_change":"2024-09-13T06:09:34.132190+0000","last_active":"2024-09-13T06:12:49.455185+0000","last_peered":"2024-09-13T06:12:49.455185+0000","last_clean":"2024-09-13T06:12:49.455185+0000","last_became_active":"2024-09-13T06:09:34.131882+0000","last_became_peered":"2024-09-13T06:09:34.131882+0000","last_unstale":"2024-09-13T06:12:49.455185+0000","last_undegraded":"2024-09-13T06:12:49.455185+0000","last_fullsized":"2024-09-13T06:12:49.455185+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:12:40.844517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.805785+0000","last_change":"2024-09-13T06:09:32.143831+0000","last_active":"2024-09-13T06:10:10.805785+0000","last_peered":"2024-09-13T06:10:10.805785+0000","last_clean":"2024-09-13T06:10:10.805785+0000","last_became_active":"2024-09-13T06:09:32.138731+0000","last_became_peered":"2024-09-13T06:09:32.138731+0000","last_unstale":"2024-09-13T06:10:10.805785+0000","last_undegraded":"2024-09-13T06:10:10.805785+0000","last_fullsized":"2024-09-13T06:10:10.805785+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:23:59.928536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.946508+0000","last_change":"2024-09-13T06:09:36.136407+0000","last_active":"2024-09-13T06:10:10.946508+0000","last_peered":"2024-09-13T06:10:10.946508+0000","last_clean":"2024-09-13T06:10:10.946508+0000","last_became_active":"2024-09-13T06:09:36.135660+0000","last_became_peered":"2024-09-13T06:09:36.135660+0000","last_unstale":"2024-09-13T06:10:10.946508+0000","last_undegraded":"2024-09-13T06:10:10.946508+0000","last_fullsized":"2024-09-13T06:10:10.946508+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:13:54.253064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"35'40","reported_seq":89,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:20.893814+0000","last_change":"2024-09-13T06:09:38.144183+0000","last_active":"2024-09-13T06:13:20.893814+0000","last_peered":"2024-09-13T06:13:20.893814+0000","last_clean":"2024-09-13T06:13:20.893814+0000","last_became_active":"2024-09-13T06:09:38.143209+0000","last_became_peered":"2024-09-13T06:09:38.143209+0000","last_unstale":"2024-09-13T06:13:20.893814+0000","last_undegraded":"2024-09-13T06:13:20.893814+0000","last_fullsized":"2024-09-13T06:13:20.893814+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:50:01.265885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"35'285","reported_seq":407,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:20.665368+0000","last_change":"2024-09-13T06:09:40.188885+0000","last_active":"2024-09-13T06:13:20.665368+0000","last_peered":"2024-09-13T06:13:20.665368+0000","last_clean":"2024-09-13T06:13:20.665368+0000","last_became_active":"2024-09-13T06:09:40.188246+0000","last_became_peered":"2024-09-13T06:09:40.188246+0000","last_unstale":"2024-09-13T06:13:20.665368+0000","last_undegraded":"2024-09-13T06:13:20.665368+0000","last_fullsized":"2024-09-13T06:13:20.665368+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:10:07.607618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"35'16","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:50.799267+0000","last_change":"2024-09-13T06:09:42.201997+0000","last_active":"2024-09-13T06:11:50.799267+0000","last_peered":"2024-09-13T06:11:50.799267+0000","last_clean":"2024-09-13T06:11:50.799267+0000","last_became_active":"2024-09-13T06:09:42.201304+0000","last_became_peered":"2024-09-13T06:09:42.201304+0000","last_unstale":"2024-09-13T06:11:50.799267+0000","last_undegraded":"2024-09-13T06:11:50.799267+0000","last_fullsized":"2024-09-13T06:11:50.799267+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:45:43.763240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":29,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"35'4","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:48.236290+0000","last_change":"2024-09-13T06:09:34.102998+0000","last_active":"2024-09-13T06:11:48.236290+0000","last_peered":"2024-09-13T06:11:48.236290+0000","last_clean":"2024-09-13T06:11:48.236290+0000","last_became_active":"2024-09-13T06:09:34.102586+0000","last_became_peered":"2024-09-13T06:09:34.102586+0000","last_unstale":"2024-09-13T06:11:48.236290+0000","last_undegraded":"2024-09-13T06:11:48.236290+0000","last_fullsized":"2024-09-13T06:11:48.236290+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:03:45.932431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:48.859872+0000","last_change":"2024-09-13T06:09:32.125108+0000","last_active":"2024-09-13T06:12:48.859872+0000","last_peered":"2024-09-13T06:12:48.859872+0000","last_clean":"2024-09-13T06:12:48.859872+0000","last_became_active":"2024-09-13T06:09:32.122121+0000","last_became_peered":"2024-09-13T06:09:32.122121+0000","last_unstale":"2024-09-13T06:12:48.859872+0000","last_undegraded":"2024-09-13T06:12:48.859872+0000","last_fullsized":"2024-09-13T06:12:48.859872+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:04:21.918429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"35'3","reported_seq":417,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:20.638345+0000","last_change":"2024-09-13T06:09:36.143569+0000","last_active":"2024-09-13T06:13:20.638345+0000","last_peered":"2024-09-13T06:13:20.638345+0000","last_clean":"2024-09-13T06:13:20.638345+0000","last_became_active":"2024-09-13T06:09:36.141789+0000","last_became_peered":"2024-09-13T06:09:36.141789+0000","last_unstale":"2024-09-13T06:13:20.638345+0000","last_undegraded":"2024-09-13T06:13:20.638345+0000","last_fullsized":"2024-09-13T06:13:20.638345+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:45:41.784572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"33'10","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.811432+0000","last_change":"2024-09-13T06:09:38.177849+0000","last_active":"2024-09-13T06:10:10.811432+0000","last_peered":"2024-09-13T06:10:10.811432+0000","last_clean":"2024-09-13T06:10:10.811432+0000","last_became_active":"2024-09-13T06:09:38.177217+0000","last_became_peered":"2024-09-13T06:09:38.177217+0000","last_unstale":"2024-09-13T06:10:10.811432+0000","last_undegraded":"2024-09-13T06:10:10.811432+0000","last_fullsized":"2024-09-13T06:10:10.811432+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:10.962665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"35'285","reported_seq":463,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:20.668415+0000","last_change":"2024-09-13T06:09:40.181202+0000","last_active":"2024-09-13T06:13:20.668415+0000","last_peered":"2024-09-13T06:13:20.668415+0000","last_clean":"2024-09-13T06:13:20.668415+0000","last_became_active":"2024-09-13T06:09:40.179438+0000","last_became_peered":"2024-09-13T06:09:40.179438+0000","last_unstale":"2024-09-13T06:13:20.668415+0000","last_undegraded":"2024-09-13T06:13:20.668415+0000","last_fullsized":"2024-09-13T06:13:20.668415+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:27:07.073401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"35'6","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:47.594182+0000","last_change":"2024-09-13T06:09:42.204120+0000","last_active":"2024-09-13T06:11:47.594182+0000","last_peered":"2024-09-13T06:11:47.594182+0000","last_clean":"2024-09-13T06:11:47.594182+0000","last_became_active":"2024-09-13T06:09:42.181854+0000","last_became_peered":"2024-09-13T06:09:42.181854+0000","last_unstale":"2024-09-13T06:11:47.594182+0000","last_undegraded":"2024-09-13T06:11:47.594182+0000","last_fullsized":"2024-09-13T06:11:47.594182+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:16:33.568846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.822741+0000","last_change":"2024-09-13T06:09:34.127227+0000","last_active":"2024-09-13T06:10:10.822741+0000","last_peered":"2024-09-13T06:10:10.822741+0000","last_clean":"2024-09-13T06:10:10.822741+0000","last_became_active":"2024-09-13T06:09:34.126843+0000","last_became_peered":"2024-09-13T06:09:34.126843+0000","last_unstale":"2024-09-13T06:10:10.822741+0000","last_undegraded":"2024-09-13T06:10:10.822741+0000","last_fullsized":"2024-09-13T06:10:10.822741+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:44:57.098322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"35'5","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:02.598499+0000","last_change":"2024-09-13T06:09:32.133494+0000","last_active":"2024-09-13T06:11:02.598499+0000","last_peered":"2024-09-13T06:11:02.598499+0000","last_clean":"2024-09-13T06:11:02.598499+0000","last_became_active":"2024-09-13T06:09:32.129984+0000","last_became_peered":"2024-09-13T06:09:32.129984+0000","last_unstale":"2024-09-13T06:11:02.598499+0000","last_undegraded":"2024-09-13T06:11:02.598499+0000","last_fullsized":"2024-09-13T06:11:02.598499+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:45:08.493467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.818317+0000","last_change":"2024-09-13T06:09:36.155279+0000","last_active":"2024-09-13T06:10:10.818317+0000","last_peered":"2024-09-13T06:10:10.818317+0000","last_clean":"2024-09-13T06:10:10.818317+0000","last_became_active":"2024-09-13T06:09:36.153614+0000","last_became_peered":"2024-09-13T06:09:36.153614+0000","last_unstale":"2024-09-13T06:10:10.818317+0000","last_undegraded":"2024-09-13T06:10:10.818317+0000","last_fullsized":"2024-09-13T06:10:10.818317+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:27:07.877373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"35'41","reported_seq":91,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:20.805717+0000","last_change":"2024-09-13T06:09:38.158380+0000","last_active":"2024-09-13T06:13:20.805717+0000","last_peered":"2024-09-13T06:13:20.805717+0000","last_clean":"2024-09-13T06:13:20.805717+0000","last_became_active":"2024-09-13T06:09:38.155463+0000","last_became_peered":"2024-09-13T06:09:38.155463+0000","last_unstale":"2024-09-13T06:13:20.805717+0000","last_undegraded":"2024-09-13T06:13:20.805717+0000","last_fullsized":"2024-09-13T06:13:20.805717+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:24:39.953684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.796986+0000","last_change":"2024-09-13T06:09:40.169126+0000","last_active":"2024-09-13T06:10:10.796986+0000","last_peered":"2024-09-13T06:10:10.796986+0000","last_clean":"2024-09-13T06:10:10.796986+0000","last_became_active":"2024-09-13T06:09:40.167733+0000","last_became_peered":"2024-09-13T06:09:40.167733+0000","last_unstale":"2024-09-13T06:10:10.796986+0000","last_undegraded":"2024-09-13T06:10:10.796986+0000","last_fullsized":"2024-09-13T06:10:10.796986+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:10:42.824333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"35'6","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.608133+0000","last_change":"2024-09-13T06:09:42.177915+0000","last_active":"2024-09-13T06:12:49.608133+0000","last_peered":"2024-09-13T06:12:49.608133+0000","last_clean":"2024-09-13T06:12:49.608133+0000","last_became_active":"2024-09-13T06:09:42.172937+0000","last_became_peered":"2024-09-13T06:09:42.172937+0000","last_unstale":"2024-09-13T06:12:49.608133+0000","last_undegraded":"2024-09-13T06:12:49.608133+0000","last_fullsized":"2024-09-13T06:12:49.608133+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:30:04.561419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"35'12","reported_seq":77,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:18.855926+0000","last_change":"2024-09-13T06:09:34.131384+0000","last_active":"2024-09-13T06:10:18.855926+0000","last_peered":"2024-09-13T06:10:18.855926+0000","last_clean":"2024-09-13T06:10:18.855926+0000","last_became_active":"2024-09-13T06:09:34.131113+0000","last_became_peered":"2024-09-13T06:09:34.131113+0000","last_unstale":"2024-09-13T06:10:18.855926+0000","last_undegraded":"2024-09-13T06:10:18.855926+0000","last_fullsized":"2024-09-13T06:10:18.855926+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:51:08.067895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":60,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"14'117","reported_seq":206,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:22.797281+0000","last_change":"2024-09-13T06:09:19.565573+0000","last_active":"2024-09-13T06:11:22.797281+0000","last_peered":"2024-09-13T06:11:22.797281+0000","last_clean":"2024-09-13T06:11:22.797281+0000","last_became_active":"2024-09-13T06:09:19.561434+0000","last_became_peered":"2024-09-13T06:09:19.561434+0000","last_unstale":"2024-09-13T06:11:22.797281+0000","last_undegraded":"2024-09-13T06:11:22.797281+0000","last_fullsized":"2024-09-13T06:11:22.797281+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:18.163598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:18.163598+0000","last_clean_scrub_stamp":"2024-09-13T06:09:18.163598+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:04:43.437453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.809377+0000","last_change":"2024-09-13T06:09:24.220777+0000","last_active":"2024-09-13T06:10:10.809377+0000","last_peered":"2024-09-13T06:10:10.809377+0000","last_clean":"2024-09-13T06:10:10.809377+0000","last_became_active":"2024-09-13T06:09:22.217131+0000","last_became_peered":"2024-09-13T06:09:22.217131+0000","last_unstale":"2024-09-13T06:10:10.809377+0000","last_undegraded":"2024-09-13T06:10:10.809377+0000","last_fullsized":"2024-09-13T06:10:10.809377+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_clean_scrub_stamp":"2024-09-13T06:09:21.188659+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:58:05.578609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090967000000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"35'4","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:18.041669+0000","last_change":"2024-09-13T06:09:32.144633+0000","last_active":"2024-09-13T06:10:18.041669+0000","last_peered":"2024-09-13T06:10:18.041669+0000","last_clean":"2024-09-13T06:10:18.041669+0000","last_became_active":"2024-09-13T06:09:32.141646+0000","last_became_peered":"2024-09-13T06:09:32.141646+0000","last_unstale":"2024-09-13T06:10:18.041669+0000","last_undegraded":"2024-09-13T06:10:18.041669+0000","last_fullsized":"2024-09-13T06:10:18.041669+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:53:43.971322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.818078+0000","last_change":"2024-09-13T06:09:36.141123+0000","last_active":"2024-09-13T06:10:10.818078+0000","last_peered":"2024-09-13T06:10:10.818078+0000","last_clean":"2024-09-13T06:10:10.818078+0000","last_became_active":"2024-09-13T06:09:36.140417+0000","last_became_peered":"2024-09-13T06:09:36.140417+0000","last_unstale":"2024-09-13T06:10:10.818078+0000","last_undegraded":"2024-09-13T06:10:10.818078+0000","last_fullsized":"2024-09-13T06:10:10.818078+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:44:41.173375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"35'85","reported_seq":166,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:20.876178+0000","last_change":"2024-09-13T06:09:38.177538+0000","last_active":"2024-09-13T06:13:20.876178+0000","last_peered":"2024-09-13T06:13:20.876178+0000","last_clean":"2024-09-13T06:13:20.876178+0000","last_became_active":"2024-09-13T06:09:38.176365+0000","last_became_peered":"2024-09-13T06:09:38.176365+0000","last_unstale":"2024-09-13T06:13:20.876178+0000","last_undegraded":"2024-09-13T06:13:20.876178+0000","last_fullsized":"2024-09-13T06:13:20.876178+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:56:32.152357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.948040+0000","last_change":"2024-09-13T06:09:40.180407+0000","last_active":"2024-09-13T06:10:10.948040+0000","last_peered":"2024-09-13T06:10:10.948040+0000","last_clean":"2024-09-13T06:10:10.948040+0000","last_became_active":"2024-09-13T06:09:40.178872+0000","last_became_peered":"2024-09-13T06:09:40.178872+0000","last_unstale":"2024-09-13T06:10:10.948040+0000","last_undegraded":"2024-09-13T06:10:10.948040+0000","last_fullsized":"2024-09-13T06:10:10.948040+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:52:35.265077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"35'82","reported_seq":163,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.540178+0000","last_change":"2024-09-13T06:09:42.198530+0000","last_active":"2024-09-13T06:12:49.540178+0000","last_peered":"2024-09-13T06:12:49.540178+0000","last_clean":"2024-09-13T06:12:49.540178+0000","last_became_active":"2024-09-13T06:09:42.197803+0000","last_became_peered":"2024-09-13T06:09:42.197803+0000","last_unstale":"2024-09-13T06:12:49.540178+0000","last_undegraded":"2024-09-13T06:12:49.540178+0000","last_fullsized":"2024-09-13T06:12:49.540178+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:45:34.331341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"35'9","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.532885+0000","last_change":"2024-09-13T06:10:10.942337+0000","last_active":"2024-09-13T06:12:49.532885+0000","last_peered":"2024-09-13T06:12:49.532885+0000","last_clean":"2024-09-13T06:12:49.532885+0000","last_became_active":"2024-09-13T06:10:10.941771+0000","last_became_peered":"2024-09-13T06:10:10.941771+0000","last_unstale":"2024-09-13T06:12:49.532885+0000","last_undegraded":"2024-09-13T06:12:49.532885+0000","last_fullsized":"2024-09-13T06:12:49.532885+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:28:10.595005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:22.800377+0000","last_change":"2024-09-13T06:09:24.220722+0000","last_active":"2024-09-13T06:11:22.800377+0000","last_peered":"2024-09-13T06:11:22.800377+0000","last_clean":"2024-09-13T06:11:22.800377+0000","last_became_active":"2024-09-13T06:09:22.217643+0000","last_became_peered":"2024-09-13T06:09:22.217643+0000","last_unstale":"2024-09-13T06:11:22.800377+0000","last_undegraded":"2024-09-13T06:11:22.800377+0000","last_fullsized":"2024-09-13T06:11:22.800377+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_clean_scrub_stamp":"2024-09-13T06:09:21.188659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:44:20.577838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082521999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:48.095340+0000","last_change":"2024-09-13T06:09:32.151263+0000","last_active":"2024-09-13T06:11:48.095340+0000","last_peered":"2024-09-13T06:11:48.095340+0000","last_clean":"2024-09-13T06:11:48.095340+0000","last_became_active":"2024-09-13T06:09:32.147837+0000","last_became_peered":"2024-09-13T06:09:32.147837+0000","last_unstale":"2024-09-13T06:11:48.095340+0000","last_undegraded":"2024-09-13T06:11:48.095340+0000","last_fullsized":"2024-09-13T06:11:48.095340+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:55:55.407168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.817292+0000","last_change":"2024-09-13T06:09:36.154146+0000","last_active":"2024-09-13T06:10:10.817292+0000","last_peered":"2024-09-13T06:10:10.817292+0000","last_clean":"2024-09-13T06:10:10.817292+0000","last_became_active":"2024-09-13T06:09:36.153430+0000","last_became_peered":"2024-09-13T06:09:36.153430+0000","last_unstale":"2024-09-13T06:10:10.817292+0000","last_undegraded":"2024-09-13T06:10:10.817292+0000","last_fullsized":"2024-09-13T06:10:10.817292+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:50:22.555296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"35'285","reported_seq":502,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:20.930896+0000","last_change":"2024-09-13T06:09:38.160949+0000","last_active":"2024-09-13T06:13:20.930896+0000","last_peered":"2024-09-13T06:13:20.930896+0000","last_clean":"2024-09-13T06:13:20.930896+0000","last_became_active":"2024-09-13T06:09:38.160192+0000","last_became_peered":"2024-09-13T06:09:38.160192+0000","last_unstale":"2024-09-13T06:13:20.930896+0000","last_undegraded":"2024-09-13T06:13:20.930896+0000","last_fullsized":"2024-09-13T06:13:20.930896+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:36:16.623805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.810896+0000","last_change":"2024-09-13T06:09:40.189965+0000","last_active":"2024-09-13T06:10:10.810896+0000","last_peered":"2024-09-13T06:10:10.810896+0000","last_clean":"2024-09-13T06:10:10.810896+0000","last_became_active":"2024-09-13T06:09:40.188859+0000","last_became_peered":"2024-09-13T06:09:40.188859+0000","last_unstale":"2024-09-13T06:10:10.810896+0000","last_undegraded":"2024-09-13T06:10:10.810896+0000","last_fullsized":"2024-09-13T06:10:10.810896+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:09:59.010638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"35'5","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.668016+0000","last_change":"2024-09-13T06:09:42.205523+0000","last_active":"2024-09-13T06:12:49.668016+0000","last_peered":"2024-09-13T06:12:49.668016+0000","last_clean":"2024-09-13T06:12:49.668016+0000","last_became_active":"2024-09-13T06:09:42.204736+0000","last_became_peered":"2024-09-13T06:09:42.204736+0000","last_unstale":"2024-09-13T06:12:49.668016+0000","last_undegraded":"2024-09-13T06:12:49.668016+0000","last_fullsized":"2024-09-13T06:12:49.668016+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:13:21.283440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"35'8","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:02.611023+0000","last_change":"2024-09-13T06:09:34.132298+0000","last_active":"2024-09-13T06:11:02.611023+0000","last_peered":"2024-09-13T06:11:02.611023+0000","last_clean":"2024-09-13T06:11:02.611023+0000","last_became_active":"2024-09-13T06:09:34.131564+0000","last_became_peered":"2024-09-13T06:09:34.131564+0000","last_unstale":"2024-09-13T06:11:02.611023+0000","last_undegraded":"2024-09-13T06:11:02.611023+0000","last_fullsized":"2024-09-13T06:11:02.611023+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:50:10.277490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.795564+0000","last_change":"2024-09-13T06:09:24.565111+0000","last_active":"2024-09-13T06:10:10.795564+0000","last_peered":"2024-09-13T06:10:10.795564+0000","last_clean":"2024-09-13T06:10:10.795564+0000","last_became_active":"2024-09-13T06:09:22.214952+0000","last_became_peered":"2024-09-13T06:09:22.214952+0000","last_unstale":"2024-09-13T06:10:10.795564+0000","last_undegraded":"2024-09-13T06:10:10.795564+0000","last_fullsized":"2024-09-13T06:10:10.795564+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_clean_scrub_stamp":"2024-09-13T06:09:21.188659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:20:29.599784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097860299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.942408+0000","last_change":"2024-09-13T06:09:32.152695+0000","last_active":"2024-09-13T06:10:10.942408+0000","last_peered":"2024-09-13T06:10:10.942408+0000","last_clean":"2024-09-13T06:10:10.942408+0000","last_became_active":"2024-09-13T06:09:32.148803+0000","last_became_peered":"2024-09-13T06:09:32.148803+0000","last_unstale":"2024-09-13T06:10:10.942408+0000","last_undegraded":"2024-09-13T06:10:10.942408+0000","last_fullsized":"2024-09-13T06:10:10.942408+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:16:11.746030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"26'1","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.797255+0000","last_change":"2024-09-13T06:09:36.127208+0000","last_active":"2024-09-13T06:10:10.797255+0000","last_peered":"2024-09-13T06:10:10.797255+0000","last_clean":"2024-09-13T06:10:10.797255+0000","last_became_active":"2024-09-13T06:09:36.126497+0000","last_became_peered":"2024-09-13T06:09:36.126497+0000","last_unstale":"2024-09-13T06:10:10.797255+0000","last_undegraded":"2024-09-13T06:10:10.797255+0000","last_fullsized":"2024-09-13T06:10:10.797255+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:34:31.838383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"35'16","reported_seq":85,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:46.394535+0000","last_change":"2024-09-13T06:09:38.163577+0000","last_active":"2024-09-13T06:12:46.394535+0000","last_peered":"2024-09-13T06:12:46.394535+0000","last_clean":"2024-09-13T06:12:46.394535+0000","last_became_active":"2024-09-13T06:09:38.162358+0000","last_became_peered":"2024-09-13T06:09:38.162358+0000","last_unstale":"2024-09-13T06:12:46.394535+0000","last_undegraded":"2024-09-13T06:12:46.394535+0000","last_fullsized":"2024-09-13T06:12:46.394535+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:37:23.050896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.948281+0000","last_change":"2024-09-13T06:09:40.180051+0000","last_active":"2024-09-13T06:10:10.948281+0000","last_peered":"2024-09-13T06:10:10.948281+0000","last_clean":"2024-09-13T06:10:10.948281+0000","last_became_active":"2024-09-13T06:09:40.179250+0000","last_became_peered":"2024-09-13T06:09:40.179250+0000","last_unstale":"2024-09-13T06:10:10.948281+0000","last_undegraded":"2024-09-13T06:10:10.948281+0000","last_fullsized":"2024-09-13T06:10:10.948281+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:45:23.967679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"33'2","reported_seq":19,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.802883+0000","last_change":"2024-09-13T06:09:42.203843+0000","last_active":"2024-09-13T06:10:10.802883+0000","last_peered":"2024-09-13T06:10:10.802883+0000","last_clean":"2024-09-13T06:10:10.802883+0000","last_became_active":"2024-09-13T06:09:42.203232+0000","last_became_peered":"2024-09-13T06:09:42.203232+0000","last_unstale":"2024-09-13T06:10:10.802883+0000","last_undegraded":"2024-09-13T06:10:10.802883+0000","last_fullsized":"2024-09-13T06:10:10.802883+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:59:55.860934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"35'6","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:02.878771+0000","last_change":"2024-09-13T06:09:34.116295+0000","last_active":"2024-09-13T06:11:02.878771+0000","last_peered":"2024-09-13T06:11:02.878771+0000","last_clean":"2024-09-13T06:11:02.878771+0000","last_became_active":"2024-09-13T06:09:34.113002+0000","last_became_peered":"2024-09-13T06:09:34.113002+0000","last_unstale":"2024-09-13T06:11:02.878771+0000","last_undegraded":"2024-09-13T06:11:02.878771+0000","last_fullsized":"2024-09-13T06:11:02.878771+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:14:37.877574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.803179+0000","last_change":"2024-09-13T06:09:24.222172+0000","last_active":"2024-09-13T06:10:10.803179+0000","last_peered":"2024-09-13T06:10:10.803179+0000","last_clean":"2024-09-13T06:10:10.803179+0000","last_became_active":"2024-09-13T06:09:22.217581+0000","last_became_peered":"2024-09-13T06:09:22.217581+0000","last_unstale":"2024-09-13T06:10:10.803179+0000","last_undegraded":"2024-09-13T06:10:10.803179+0000","last_fullsized":"2024-09-13T06:10:10.803179+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_clean_scrub_stamp":"2024-09-13T06:09:21.188659+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:02:07.684980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022711580000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.798782+0000","last_change":"2024-09-13T06:09:32.139418+0000","last_active":"2024-09-13T06:10:10.798782+0000","last_peered":"2024-09-13T06:10:10.798782+0000","last_clean":"2024-09-13T06:10:10.798782+0000","last_became_active":"2024-09-13T06:09:32.138838+0000","last_became_peered":"2024-09-13T06:09:32.138838+0000","last_unstale":"2024-09-13T06:10:10.798782+0000","last_undegraded":"2024-09-13T06:10:10.798782+0000","last_fullsized":"2024-09-13T06:10:10.798782+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:06:35.186829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:11.778800+0000","last_change":"2024-09-13T06:10:10.810748+0000","last_active":"2024-09-13T06:10:11.778800+0000","last_peered":"2024-09-13T06:10:11.778800+0000","last_clean":"2024-09-13T06:10:11.778800+0000","last_became_active":"2024-09-13T06:10:10.809216+0000","last_became_peered":"2024-09-13T06:10:10.809216+0000","last_unstale":"2024-09-13T06:10:11.778800+0000","last_undegraded":"2024-09-13T06:10:11.778800+0000","last_fullsized":"2024-09-13T06:10:11.778800+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:31:29.839767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"35'13","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:48.267532+0000","last_change":"2024-09-13T06:09:38.179168+0000","last_active":"2024-09-13T06:12:48.267532+0000","last_peered":"2024-09-13T06:12:48.267532+0000","last_clean":"2024-09-13T06:12:48.267532+0000","last_became_active":"2024-09-13T06:09:38.176307+0000","last_became_peered":"2024-09-13T06:09:38.176307+0000","last_unstale":"2024-09-13T06:12:48.267532+0000","last_undegraded":"2024-09-13T06:12:48.267532+0000","last_fullsized":"2024-09-13T06:12:48.267532+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:48:06.539631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.817869+0000","last_change":"2024-09-13T06:09:40.189861+0000","last_active":"2024-09-13T06:10:10.817869+0000","last_peered":"2024-09-13T06:10:10.817869+0000","last_clean":"2024-09-13T06:10:10.817869+0000","last_became_active":"2024-09-13T06:09:40.189259+0000","last_became_peered":"2024-09-13T06:09:40.189259+0000","last_unstale":"2024-09-13T06:10:10.817869+0000","last_undegraded":"2024-09-13T06:10:10.817869+0000","last_fullsized":"2024-09-13T06:10:10.817869+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:50:40.590067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"35'4","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:47.623875+0000","last_change":"2024-09-13T06:09:42.186776+0000","last_active":"2024-09-13T06:11:47.623875+0000","last_peered":"2024-09-13T06:11:47.623875+0000","last_clean":"2024-09-13T06:11:47.623875+0000","last_became_active":"2024-09-13T06:09:42.185210+0000","last_became_peered":"2024-09-13T06:09:42.185210+0000","last_unstale":"2024-09-13T06:11:47.623875+0000","last_undegraded":"2024-09-13T06:11:47.623875+0000","last_fullsized":"2024-09-13T06:11:47.623875+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:46:22.560475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"35'3","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.344035+0000","last_change":"2024-09-13T06:09:34.122137+0000","last_active":"2024-09-13T06:12:49.344035+0000","last_peered":"2024-09-13T06:12:49.344035+0000","last_clean":"2024-09-13T06:12:49.344035+0000","last_became_active":"2024-09-13T06:09:34.119283+0000","last_became_peered":"2024-09-13T06:09:34.119283+0000","last_unstale":"2024-09-13T06:12:49.344035+0000","last_undegraded":"2024-09-13T06:12:49.344035+0000","last_fullsized":"2024-09-13T06:12:49.344035+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:10:47.867373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:18.820356+0000","last_change":"2024-09-13T06:09:32.139797+0000","last_active":"2024-09-13T06:10:18.820356+0000","last_peered":"2024-09-13T06:10:18.820356+0000","last_clean":"2024-09-13T06:10:18.820356+0000","last_became_active":"2024-09-13T06:09:32.139313+0000","last_became_peered":"2024-09-13T06:09:32.139313+0000","last_unstale":"2024-09-13T06:10:18.820356+0000","last_undegraded":"2024-09-13T06:10:18.820356+0000","last_fullsized":"2024-09-13T06:10:18.820356+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:52:39.866148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.948023+0000","last_change":"2024-09-13T06:09:24.227949+0000","last_active":"2024-09-13T06:10:10.948023+0000","last_peered":"2024-09-13T06:10:10.948023+0000","last_clean":"2024-09-13T06:10:10.948023+0000","last_became_active":"2024-09-13T06:09:22.216659+0000","last_became_peered":"2024-09-13T06:09:22.216659+0000","last_unstale":"2024-09-13T06:10:10.948023+0000","last_undegraded":"2024-09-13T06:10:10.948023+0000","last_fullsized":"2024-09-13T06:10:10.948023+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_clean_scrub_stamp":"2024-09-13T06:09:21.188659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:49:43.834788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010625330000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"35'1","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.866634+0000","last_change":"2024-09-13T06:09:36.133083+0000","last_active":"2024-09-13T06:12:49.866634+0000","last_peered":"2024-09-13T06:12:49.866634+0000","last_clean":"2024-09-13T06:12:49.866634+0000","last_became_active":"2024-09-13T06:09:36.132376+0000","last_became_peered":"2024-09-13T06:09:36.132376+0000","last_unstale":"2024-09-13T06:12:49.866634+0000","last_undegraded":"2024-09-13T06:12:49.866634+0000","last_fullsized":"2024-09-13T06:12:49.866634+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:33:42.194072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"35'65","reported_seq":128,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:20.776980+0000","last_change":"2024-09-13T06:09:38.158348+0000","last_active":"2024-09-13T06:13:20.776980+0000","last_peered":"2024-09-13T06:13:20.776980+0000","last_clean":"2024-09-13T06:13:20.776980+0000","last_became_active":"2024-09-13T06:09:38.157579+0000","last_became_peered":"2024-09-13T06:09:38.157579+0000","last_unstale":"2024-09-13T06:13:20.776980+0000","last_undegraded":"2024-09-13T06:13:20.776980+0000","last_fullsized":"2024-09-13T06:13:20.776980+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:10:00.668843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":65,"num_read_kb":53,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.793704+0000","last_change":"2024-09-13T06:09:40.185803+0000","last_active":"2024-09-13T06:10:10.793704+0000","last_peered":"2024-09-13T06:10:10.793704+0000","last_clean":"2024-09-13T06:10:10.793704+0000","last_became_active":"2024-09-13T06:09:40.185234+0000","last_became_peered":"2024-09-13T06:09:40.185234+0000","last_unstale":"2024-09-13T06:10:10.793704+0000","last_undegraded":"2024-09-13T06:10:10.793704+0000","last_fullsized":"2024-09-13T06:10:10.793704+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:15:00.667693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"35'11","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:48.059535+0000","last_change":"2024-09-13T06:09:42.176351+0000","last_active":"2024-09-13T06:11:48.059535+0000","last_peered":"2024-09-13T06:11:48.059535+0000","last_clean":"2024-09-13T06:11:48.059535+0000","last_became_active":"2024-09-13T06:09:42.170302+0000","last_became_peered":"2024-09-13T06:09:42.170302+0000","last_unstale":"2024-09-13T06:11:48.059535+0000","last_undegraded":"2024-09-13T06:11:48.059535+0000","last_fullsized":"2024-09-13T06:11:48.059535+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:18:04.598744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":25,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"35'10","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:20.342360+0000","last_change":"2024-09-13T06:09:34.122222+0000","last_active":"2024-09-13T06:10:20.342360+0000","last_peered":"2024-09-13T06:10:20.342360+0000","last_clean":"2024-09-13T06:10:20.342360+0000","last_became_active":"2024-09-13T06:09:34.121836+0000","last_became_peered":"2024-09-13T06:09:34.121836+0000","last_unstale":"2024-09-13T06:10:20.342360+0000","last_undegraded":"2024-09-13T06:10:20.342360+0000","last_fullsized":"2024-09-13T06:10:20.342360+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:33:26.123983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.950946+0000","last_change":"2024-09-13T06:09:32.137231+0000","last_active":"2024-09-13T06:10:10.950946+0000","last_peered":"2024-09-13T06:10:10.950946+0000","last_clean":"2024-09-13T06:10:10.950946+0000","last_became_active":"2024-09-13T06:09:32.136238+0000","last_became_peered":"2024-09-13T06:09:32.136238+0000","last_unstale":"2024-09-13T06:10:10.950946+0000","last_undegraded":"2024-09-13T06:10:10.950946+0000","last_fullsized":"2024-09-13T06:10:10.950946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:12:38.569078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.812165+0000","last_change":"2024-09-13T06:09:24.221355+0000","last_active":"2024-09-13T06:10:10.812165+0000","last_peered":"2024-09-13T06:10:10.812165+0000","last_clean":"2024-09-13T06:10:10.812165+0000","last_became_active":"2024-09-13T06:09:22.217809+0000","last_became_peered":"2024-09-13T06:09:22.217809+0000","last_unstale":"2024-09-13T06:10:10.812165+0000","last_undegraded":"2024-09-13T06:10:10.812165+0000","last_fullsized":"2024-09-13T06:10:10.812165+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_clean_scrub_stamp":"2024-09-13T06:09:21.188659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:16:27.098773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001447545,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.802066+0000","last_change":"2024-09-13T06:09:36.152257+0000","last_active":"2024-09-13T06:10:10.802066+0000","last_peered":"2024-09-13T06:10:10.802066+0000","last_clean":"2024-09-13T06:10:10.802066+0000","last_became_active":"2024-09-13T06:09:36.151605+0000","last_became_peered":"2024-09-13T06:09:36.151605+0000","last_unstale":"2024-09-13T06:10:10.802066+0000","last_undegraded":"2024-09-13T06:10:10.802066+0000","last_fullsized":"2024-09-13T06:10:10.802066+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:14:15.857728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"35'15","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:02.613378+0000","last_change":"2024-09-13T06:09:38.167368+0000","last_active":"2024-09-13T06:11:02.613378+0000","last_peered":"2024-09-13T06:11:02.613378+0000","last_clean":"2024-09-13T06:11:02.613378+0000","last_became_active":"2024-09-13T06:09:38.165916+0000","last_became_peered":"2024-09-13T06:09:38.165916+0000","last_unstale":"2024-09-13T06:11:02.613378+0000","last_undegraded":"2024-09-13T06:11:02.613378+0000","last_fullsized":"2024-09-13T06:11:02.613378+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:51:12.107434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"35'285","reported_seq":350,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:20.662255+0000","last_change":"2024-09-13T06:09:40.182289+0000","last_active":"2024-09-13T06:13:20.662255+0000","last_peered":"2024-09-13T06:13:20.662255+0000","last_clean":"2024-09-13T06:13:20.662255+0000","last_became_active":"2024-09-13T06:09:40.181415+0000","last_became_peered":"2024-09-13T06:09:40.181415+0000","last_unstale":"2024-09-13T06:13:20.662255+0000","last_undegraded":"2024-09-13T06:13:20.662255+0000","last_fullsized":"2024-09-13T06:13:20.662255+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:49:07.565350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.816311+0000","last_change":"2024-09-13T06:09:42.195360+0000","last_active":"2024-09-13T06:10:10.816311+0000","last_peered":"2024-09-13T06:10:10.816311+0000","last_clean":"2024-09-13T06:10:10.816311+0000","last_became_active":"2024-09-13T06:09:42.194558+0000","last_became_peered":"2024-09-13T06:09:42.194558+0000","last_unstale":"2024-09-13T06:10:10.816311+0000","last_undegraded":"2024-09-13T06:10:10.816311+0000","last_fullsized":"2024-09-13T06:10:10.816311+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:15:46.155508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"35'6","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.513665+0000","last_change":"2024-09-13T06:10:10.814500+0000","last_active":"2024-09-13T06:12:49.513665+0000","last_peered":"2024-09-13T06:12:49.513665+0000","last_clean":"2024-09-13T06:12:49.513665+0000","last_became_active":"2024-09-13T06:10:10.813656+0000","last_became_peered":"2024-09-13T06:10:10.813656+0000","last_unstale":"2024-09-13T06:12:49.513665+0000","last_undegraded":"2024-09-13T06:12:49.513665+0000","last_fullsized":"2024-09-13T06:12:49.513665+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:35:54.499508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.819500+0000","last_change":"2024-09-13T06:09:32.133206+0000","last_active":"2024-09-13T06:10:10.819500+0000","last_peered":"2024-09-13T06:10:10.819500+0000","last_clean":"2024-09-13T06:10:10.819500+0000","last_became_active":"2024-09-13T06:09:32.130385+0000","last_became_peered":"2024-09-13T06:09:32.130385+0000","last_unstale":"2024-09-13T06:10:10.819500+0000","last_undegraded":"2024-09-13T06:10:10.819500+0000","last_fullsized":"2024-09-13T06:10:10.819500+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:10:45.858553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.948419+0000","last_change":"2024-09-13T06:09:24.227867+0000","last_active":"2024-09-13T06:10:10.948419+0000","last_peered":"2024-09-13T06:10:10.948419+0000","last_clean":"2024-09-13T06:10:10.948419+0000","last_became_active":"2024-09-13T06:09:22.216905+0000","last_became_peered":"2024-09-13T06:09:22.216905+0000","last_unstale":"2024-09-13T06:10:10.948419+0000","last_undegraded":"2024-09-13T06:10:10.948419+0000","last_fullsized":"2024-09-13T06:10:10.948419+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_clean_scrub_stamp":"2024-09-13T06:09:21.188659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:24:00.674357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001005588,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.802233+0000","last_change":"2024-09-13T06:09:36.152413+0000","last_active":"2024-09-13T06:10:10.802233+0000","last_peered":"2024-09-13T06:10:10.802233+0000","last_clean":"2024-09-13T06:10:10.802233+0000","last_became_active":"2024-09-13T06:09:36.149051+0000","last_became_peered":"2024-09-13T06:09:36.149051+0000","last_unstale":"2024-09-13T06:10:10.802233+0000","last_undegraded":"2024-09-13T06:10:10.802233+0000","last_fullsized":"2024-09-13T06:10:10.802233+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:40:05.139581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"33'10","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.805068+0000","last_change":"2024-09-13T06:09:38.175171+0000","last_active":"2024-09-13T06:10:10.805068+0000","last_peered":"2024-09-13T06:10:10.805068+0000","last_clean":"2024-09-13T06:10:10.805068+0000","last_became_active":"2024-09-13T06:09:38.173017+0000","last_became_peered":"2024-09-13T06:09:38.173017+0000","last_unstale":"2024-09-13T06:10:10.805068+0000","last_undegraded":"2024-09-13T06:10:10.805068+0000","last_fullsized":"2024-09-13T06:10:10.805068+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:34:30.481224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"35'284","reported_seq":392,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:20.668273+0000","last_change":"2024-09-13T06:09:40.171525+0000","last_active":"2024-09-13T06:13:20.668273+0000","last_peered":"2024-09-13T06:13:20.668273+0000","last_clean":"2024-09-13T06:13:20.668273+0000","last_became_active":"2024-09-13T06:09:40.170879+0000","last_became_peered":"2024-09-13T06:09:40.170879+0000","last_unstale":"2024-09-13T06:13:20.668273+0000","last_undegraded":"2024-09-13T06:13:20.668273+0000","last_fullsized":"2024-09-13T06:13:20.668273+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:49:51.483537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"33'3","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.816551+0000","last_change":"2024-09-13T06:09:42.183057+0000","last_active":"2024-09-13T06:10:10.816551+0000","last_peered":"2024-09-13T06:10:10.816551+0000","last_clean":"2024-09-13T06:10:10.816551+0000","last_became_active":"2024-09-13T06:09:42.178890+0000","last_became_peered":"2024-09-13T06:09:42.178890+0000","last_unstale":"2024-09-13T06:10:10.816551+0000","last_undegraded":"2024-09-13T06:10:10.816551+0000","last_fullsized":"2024-09-13T06:10:10.816551+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:06:09.567725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"35'4","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.321911+0000","last_change":"2024-09-13T06:09:34.104607+0000","last_active":"2024-09-13T06:12:49.321911+0000","last_peered":"2024-09-13T06:12:49.321911+0000","last_clean":"2024-09-13T06:12:49.321911+0000","last_became_active":"2024-09-13T06:09:34.104194+0000","last_became_peered":"2024-09-13T06:09:34.104194+0000","last_unstale":"2024-09-13T06:12:49.321911+0000","last_undegraded":"2024-09-13T06:12:49.321911+0000","last_fullsized":"2024-09-13T06:12:49.321911+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:54:03.779728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.820560+0000","last_change":"2024-09-13T06:09:32.118940+0000","last_active":"2024-09-13T06:10:10.820560+0000","last_peered":"2024-09-13T06:10:10.820560+0000","last_clean":"2024-09-13T06:10:10.820560+0000","last_became_active":"2024-09-13T06:09:32.118386+0000","last_became_peered":"2024-09-13T06:09:32.118386+0000","last_unstale":"2024-09-13T06:10:10.820560+0000","last_undegraded":"2024-09-13T06:10:10.820560+0000","last_fullsized":"2024-09-13T06:10:10.820560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:49:16.214220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.819052+0000","last_change":"2024-09-13T06:09:24.222245+0000","last_active":"2024-09-13T06:10:10.819052+0000","last_peered":"2024-09-13T06:10:10.819052+0000","last_clean":"2024-09-13T06:10:10.819052+0000","last_became_active":"2024-09-13T06:09:22.495259+0000","last_became_peered":"2024-09-13T06:09:22.495259+0000","last_unstale":"2024-09-13T06:10:10.819052+0000","last_undegraded":"2024-09-13T06:10:10.819052+0000","last_fullsized":"2024-09-13T06:10:10.819052+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_clean_scrub_stamp":"2024-09-13T06:09:21.188659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:50:33.808976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002230409,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.800590+0000","last_change":"2024-09-13T06:09:36.148104+0000","last_active":"2024-09-13T06:10:10.800590+0000","last_peered":"2024-09-13T06:10:10.800590+0000","last_clean":"2024-09-13T06:10:10.800590+0000","last_became_active":"2024-09-13T06:09:36.144463+0000","last_became_peered":"2024-09-13T06:09:36.144463+0000","last_unstale":"2024-09-13T06:10:10.800590+0000","last_undegraded":"2024-09-13T06:10:10.800590+0000","last_fullsized":"2024-09-13T06:10:10.800590+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:03:15.568444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"35'91","reported_seq":175,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:20.936958+0000","last_change":"2024-09-13T06:09:38.159139+0000","last_active":"2024-09-13T06:13:20.936958+0000","last_peered":"2024-09-13T06:13:20.936958+0000","last_clean":"2024-09-13T06:13:20.936958+0000","last_became_active":"2024-09-13T06:09:38.158436+0000","last_became_peered":"2024-09-13T06:09:38.158436+0000","last_unstale":"2024-09-13T06:13:20.936958+0000","last_undegraded":"2024-09-13T06:13:20.936958+0000","last_fullsized":"2024-09-13T06:13:20.936958+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:59:31.499614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.944095+0000","last_change":"2024-09-13T06:09:40.177714+0000","last_active":"2024-09-13T06:10:10.944095+0000","last_peered":"2024-09-13T06:10:10.944095+0000","last_clean":"2024-09-13T06:10:10.944095+0000","last_became_active":"2024-09-13T06:09:40.176677+0000","last_became_peered":"2024-09-13T06:09:40.176677+0000","last_unstale":"2024-09-13T06:10:10.944095+0000","last_undegraded":"2024-09-13T06:10:10.944095+0000","last_fullsized":"2024-09-13T06:10:10.944095+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:16:31.555002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.807736+0000","last_change":"2024-09-13T06:09:42.205263+0000","last_active":"2024-09-13T06:10:10.807736+0000","last_peered":"2024-09-13T06:10:10.807736+0000","last_clean":"2024-09-13T06:10:10.807736+0000","last_became_active":"2024-09-13T06:09:42.204574+0000","last_became_peered":"2024-09-13T06:09:42.204574+0000","last_unstale":"2024-09-13T06:10:10.807736+0000","last_undegraded":"2024-09-13T06:10:10.807736+0000","last_fullsized":"2024-09-13T06:10:10.807736+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:05:47.718981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.797254+0000","last_change":"2024-09-13T06:09:42.198602+0000","last_active":"2024-09-13T06:10:10.797254+0000","last_peered":"2024-09-13T06:10:10.797254+0000","last_clean":"2024-09-13T06:10:10.797254+0000","last_became_active":"2024-09-13T06:09:42.197788+0000","last_became_peered":"2024-09-13T06:09:42.197788+0000","last_unstale":"2024-09-13T06:10:10.797254+0000","last_undegraded":"2024-09-13T06:10:10.797254+0000","last_fullsized":"2024-09-13T06:10:10.797254+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:04:01.295995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"35'8","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:18.855854+0000","last_change":"2024-09-13T06:09:34.104017+0000","last_active":"2024-09-13T06:10:18.855854+0000","last_peered":"2024-09-13T06:10:18.855854+0000","last_clean":"2024-09-13T06:10:18.855854+0000","last_became_active":"2024-09-13T06:09:34.101193+0000","last_became_peered":"2024-09-13T06:09:34.101193+0000","last_unstale":"2024-09-13T06:10:18.855854+0000","last_undegraded":"2024-09-13T06:10:18.855854+0000","last_fullsized":"2024-09-13T06:10:18.855854+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:51:17.686447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.809691+0000","last_change":"2024-09-13T06:09:32.125105+0000","last_active":"2024-09-13T06:10:10.809691+0000","last_peered":"2024-09-13T06:10:10.809691+0000","last_clean":"2024-09-13T06:10:10.809691+0000","last_became_active":"2024-09-13T06:09:32.124198+0000","last_became_peered":"2024-09-13T06:09:32.124198+0000","last_unstale":"2024-09-13T06:10:10.809691+0000","last_undegraded":"2024-09-13T06:10:10.809691+0000","last_fullsized":"2024-09-13T06:10:10.809691+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:34:37.470372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.813867+0000","last_change":"2024-09-13T06:09:36.134319+0000","last_active":"2024-09-13T06:10:10.813867+0000","last_peered":"2024-09-13T06:10:10.813867+0000","last_clean":"2024-09-13T06:10:10.813867+0000","last_became_active":"2024-09-13T06:09:36.133568+0000","last_became_peered":"2024-09-13T06:09:36.133568+0000","last_unstale":"2024-09-13T06:10:10.813867+0000","last_undegraded":"2024-09-13T06:10:10.813867+0000","last_fullsized":"2024-09-13T06:10:10.813867+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:20:35.376308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"35'35","reported_seq":82,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:20.829528+0000","last_change":"2024-09-13T06:09:38.172743+0000","last_active":"2024-09-13T06:13:20.829528+0000","last_peered":"2024-09-13T06:13:20.829528+0000","last_clean":"2024-09-13T06:13:20.829528+0000","last_became_active":"2024-09-13T06:09:38.172109+0000","last_became_peered":"2024-09-13T06:09:38.172109+0000","last_unstale":"2024-09-13T06:13:20.829528+0000","last_undegraded":"2024-09-13T06:13:20.829528+0000","last_fullsized":"2024-09-13T06:13:20.829528+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:28:50.103863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.802591+0000","last_change":"2024-09-13T06:09:40.189717+0000","last_active":"2024-09-13T06:10:10.802591+0000","last_peered":"2024-09-13T06:10:10.802591+0000","last_clean":"2024-09-13T06:10:10.802591+0000","last_became_active":"2024-09-13T06:09:40.189223+0000","last_became_peered":"2024-09-13T06:09:40.189223+0000","last_unstale":"2024-09-13T06:10:10.802591+0000","last_undegraded":"2024-09-13T06:10:10.802591+0000","last_fullsized":"2024-09-13T06:10:10.802591+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:33:39.326453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"35'5","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:45.415504+0000","last_change":"2024-09-13T06:09:42.179227+0000","last_active":"2024-09-13T06:11:45.415504+0000","last_peered":"2024-09-13T06:11:45.415504+0000","last_clean":"2024-09-13T06:11:45.415504+0000","last_became_active":"2024-09-13T06:09:42.177378+0000","last_became_peered":"2024-09-13T06:09:42.177378+0000","last_unstale":"2024-09-13T06:11:45.415504+0000","last_undegraded":"2024-09-13T06:11:45.415504+0000","last_fullsized":"2024-09-13T06:11:45.415504+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:40:05.274490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"35'18","reported_seq":75,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.343992+0000","last_change":"2024-09-13T06:09:34.119010+0000","last_active":"2024-09-13T06:12:49.343992+0000","last_peered":"2024-09-13T06:12:49.343992+0000","last_clean":"2024-09-13T06:12:49.343992+0000","last_became_active":"2024-09-13T06:09:34.118441+0000","last_became_peered":"2024-09-13T06:09:34.118441+0000","last_unstale":"2024-09-13T06:12:49.343992+0000","last_undegraded":"2024-09-13T06:12:49.343992+0000","last_fullsized":"2024-09-13T06:12:49.343992+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:34:39.479193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":59,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.796239+0000","last_change":"2024-09-13T06:09:32.139144+0000","last_active":"2024-09-13T06:10:10.796239+0000","last_peered":"2024-09-13T06:10:10.796239+0000","last_clean":"2024-09-13T06:10:10.796239+0000","last_became_active":"2024-09-13T06:09:32.138664+0000","last_became_peered":"2024-09-13T06:09:32.138664+0000","last_unstale":"2024-09-13T06:10:10.796239+0000","last_undegraded":"2024-09-13T06:10:10.796239+0000","last_fullsized":"2024-09-13T06:10:10.796239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:56:32.022947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"35'4","reported_seq":228,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:20.624338+0000","last_change":"2024-09-13T06:09:36.154113+0000","last_active":"2024-09-13T06:13:20.624338+0000","last_peered":"2024-09-13T06:13:20.624338+0000","last_clean":"2024-09-13T06:13:20.624338+0000","last_became_active":"2024-09-13T06:09:36.153526+0000","last_became_peered":"2024-09-13T06:09:36.153526+0000","last_unstale":"2024-09-13T06:13:20.624338+0000","last_undegraded":"2024-09-13T06:13:20.624338+0000","last_fullsized":"2024-09-13T06:13:20.624338+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:55:06.950934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"35'6","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:48.315866+0000","last_change":"2024-09-13T06:09:38.150778+0000","last_active":"2024-09-13T06:12:48.315866+0000","last_peered":"2024-09-13T06:12:48.315866+0000","last_clean":"2024-09-13T06:12:48.315866+0000","last_became_active":"2024-09-13T06:09:38.150063+0000","last_became_peered":"2024-09-13T06:09:38.150063+0000","last_unstale":"2024-09-13T06:12:48.315866+0000","last_undegraded":"2024-09-13T06:12:48.315866+0000","last_fullsized":"2024-09-13T06:12:48.315866+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:02:22.999686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.794330+0000","last_change":"2024-09-13T06:09:40.182455+0000","last_active":"2024-09-13T06:10:10.794330+0000","last_peered":"2024-09-13T06:10:10.794330+0000","last_clean":"2024-09-13T06:10:10.794330+0000","last_became_active":"2024-09-13T06:09:40.181807+0000","last_became_peered":"2024-09-13T06:09:40.181807+0000","last_unstale":"2024-09-13T06:10:10.794330+0000","last_undegraded":"2024-09-13T06:10:10.794330+0000","last_fullsized":"2024-09-13T06:10:10.794330+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:06:21.895535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"35'2","reported_seq":19,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.441035+0000","last_change":"2024-09-13T06:09:42.209380+0000","last_active":"2024-09-13T06:12:49.441035+0000","last_peered":"2024-09-13T06:12:49.441035+0000","last_clean":"2024-09-13T06:12:49.441035+0000","last_became_active":"2024-09-13T06:09:42.208567+0000","last_became_peered":"2024-09-13T06:09:42.208567+0000","last_unstale":"2024-09-13T06:12:49.441035+0000","last_undegraded":"2024-09-13T06:12:49.441035+0000","last_fullsized":"2024-09-13T06:12:49.441035+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:25:17.333516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"35'12","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.320978+0000","last_change":"2024-09-13T06:09:34.115480+0000","last_active":"2024-09-13T06:12:49.320978+0000","last_peered":"2024-09-13T06:12:49.320978+0000","last_clean":"2024-09-13T06:12:49.320978+0000","last_became_active":"2024-09-13T06:09:34.113455+0000","last_became_peered":"2024-09-13T06:09:34.113455+0000","last_unstale":"2024-09-13T06:12:49.320978+0000","last_undegraded":"2024-09-13T06:12:49.320978+0000","last_fullsized":"2024-09-13T06:12:49.320978+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:12:41.439746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:18.044718+0000","last_change":"2024-09-13T06:09:32.118643+0000","last_active":"2024-09-13T06:10:18.044718+0000","last_peered":"2024-09-13T06:10:18.044718+0000","last_clean":"2024-09-13T06:10:18.044718+0000","last_became_active":"2024-09-13T06:09:32.118235+0000","last_became_peered":"2024-09-13T06:09:32.118235+0000","last_unstale":"2024-09-13T06:10:18.044718+0000","last_undegraded":"2024-09-13T06:10:18.044718+0000","last_fullsized":"2024-09-13T06:10:18.044718+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:42:07.291597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"26'1","reported_seq":220,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:20.625633+0000","last_change":"2024-09-13T06:09:36.135737+0000","last_active":"2024-09-13T06:13:20.625633+0000","last_peered":"2024-09-13T06:13:20.625633+0000","last_clean":"2024-09-13T06:13:20.625633+0000","last_became_active":"2024-09-13T06:09:36.135184+0000","last_became_peered":"2024-09-13T06:09:36.135184+0000","last_unstale":"2024-09-13T06:13:20.625633+0000","last_undegraded":"2024-09-13T06:13:20.625633+0000","last_fullsized":"2024-09-13T06:13:20.625633+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:29:10.875574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"35'44","reported_seq":107,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:20.764127+0000","last_change":"2024-09-13T06:09:38.166891+0000","last_active":"2024-09-13T06:13:20.764127+0000","last_peered":"2024-09-13T06:13:20.764127+0000","last_clean":"2024-09-13T06:13:20.764127+0000","last_became_active":"2024-09-13T06:09:38.166381+0000","last_became_peered":"2024-09-13T06:09:38.166381+0000","last_unstale":"2024-09-13T06:13:20.764127+0000","last_undegraded":"2024-09-13T06:13:20.764127+0000","last_fullsized":"2024-09-13T06:13:20.764127+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:19:25.019683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.813101+0000","last_change":"2024-09-13T06:09:40.182185+0000","last_active":"2024-09-13T06:10:10.813101+0000","last_peered":"2024-09-13T06:10:10.813101+0000","last_clean":"2024-09-13T06:10:10.813101+0000","last_became_active":"2024-09-13T06:09:40.181329+0000","last_became_peered":"2024-09-13T06:09:40.181329+0000","last_unstale":"2024-09-13T06:10:10.813101+0000","last_undegraded":"2024-09-13T06:10:10.813101+0000","last_fullsized":"2024-09-13T06:10:10.813101+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:44:49.118858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.808748+0000","last_change":"2024-09-13T06:09:42.211550+0000","last_active":"2024-09-13T06:10:10.808748+0000","last_peered":"2024-09-13T06:10:10.808748+0000","last_clean":"2024-09-13T06:10:10.808748+0000","last_became_active":"2024-09-13T06:09:42.211005+0000","last_became_peered":"2024-09-13T06:09:42.211005+0000","last_unstale":"2024-09-13T06:10:10.808748+0000","last_undegraded":"2024-09-13T06:10:10.808748+0000","last_fullsized":"2024-09-13T06:10:10.808748+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:13:33.778909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"35'6","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:02.880093+0000","last_change":"2024-09-13T06:09:34.127109+0000","last_active":"2024-09-13T06:11:02.880093+0000","last_peered":"2024-09-13T06:11:02.880093+0000","last_clean":"2024-09-13T06:11:02.880093+0000","last_became_active":"2024-09-13T06:09:34.126798+0000","last_became_peered":"2024-09-13T06:09:34.126798+0000","last_unstale":"2024-09-13T06:11:02.880093+0000","last_undegraded":"2024-09-13T06:11:02.880093+0000","last_fullsized":"2024-09-13T06:11:02.880093+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:26:26.734970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.821879+0000","last_change":"2024-09-13T06:09:32.126749+0000","last_active":"2024-09-13T06:10:10.821879+0000","last_peered":"2024-09-13T06:10:10.821879+0000","last_clean":"2024-09-13T06:10:10.821879+0000","last_became_active":"2024-09-13T06:09:32.126213+0000","last_became_peered":"2024-09-13T06:09:32.126213+0000","last_unstale":"2024-09-13T06:10:10.821879+0000","last_undegraded":"2024-09-13T06:10:10.821879+0000","last_fullsized":"2024-09-13T06:10:10.821879+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:09.204807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.801959+0000","last_change":"2024-09-13T06:09:36.148938+0000","last_active":"2024-09-13T06:10:10.801959+0000","last_peered":"2024-09-13T06:10:10.801959+0000","last_clean":"2024-09-13T06:10:10.801959+0000","last_became_active":"2024-09-13T06:09:36.148016+0000","last_became_peered":"2024-09-13T06:09:36.148016+0000","last_unstale":"2024-09-13T06:10:10.801959+0000","last_undegraded":"2024-09-13T06:10:10.801959+0000","last_fullsized":"2024-09-13T06:10:10.801959+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:59:53.400572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"35'33","reported_seq":79,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:20.748025+0000","last_change":"2024-09-13T06:09:38.141951+0000","last_active":"2024-09-13T06:13:20.748025+0000","last_peered":"2024-09-13T06:13:20.748025+0000","last_clean":"2024-09-13T06:13:20.748025+0000","last_became_active":"2024-09-13T06:09:38.141182+0000","last_became_peered":"2024-09-13T06:09:38.141182+0000","last_unstale":"2024-09-13T06:13:20.748025+0000","last_undegraded":"2024-09-13T06:13:20.748025+0000","last_fullsized":"2024-09-13T06:13:20.748025+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:13:56.276508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.796907+0000","last_change":"2024-09-13T06:09:40.166939+0000","last_active":"2024-09-13T06:10:10.796907+0000","last_peered":"2024-09-13T06:10:10.796907+0000","last_clean":"2024-09-13T06:10:10.796907+0000","last_became_active":"2024-09-13T06:09:40.166229+0000","last_became_peered":"2024-09-13T06:09:40.166229+0000","last_unstale":"2024-09-13T06:10:10.796907+0000","last_undegraded":"2024-09-13T06:10:10.796907+0000","last_fullsized":"2024-09-13T06:10:10.796907+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:34:36.456263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"35'6","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.131054+0000","last_change":"2024-09-13T06:09:34.122302+0000","last_active":"2024-09-13T06:12:49.131054+0000","last_peered":"2024-09-13T06:12:49.131054+0000","last_clean":"2024-09-13T06:12:49.131054+0000","last_became_active":"2024-09-13T06:09:34.122034+0000","last_became_peered":"2024-09-13T06:09:34.122034+0000","last_unstale":"2024-09-13T06:12:49.131054+0000","last_undegraded":"2024-09-13T06:12:49.131054+0000","last_fullsized":"2024-09-13T06:12:49.131054+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:11:36.611679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:48.693435+0000","last_change":"2024-09-13T06:09:32.124543+0000","last_active":"2024-09-13T06:12:48.693435+0000","last_peered":"2024-09-13T06:12:48.693435+0000","last_clean":"2024-09-13T06:12:48.693435+0000","last_became_active":"2024-09-13T06:09:32.121948+0000","last_became_peered":"2024-09-13T06:09:32.121948+0000","last_unstale":"2024-09-13T06:12:48.693435+0000","last_undegraded":"2024-09-13T06:12:48.693435+0000","last_fullsized":"2024-09-13T06:12:48.693435+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:32:08.664673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.948430+0000","last_change":"2024-09-13T06:09:36.132935+0000","last_active":"2024-09-13T06:10:10.948430+0000","last_peered":"2024-09-13T06:10:10.948430+0000","last_clean":"2024-09-13T06:10:10.948430+0000","last_became_active":"2024-09-13T06:09:36.132227+0000","last_became_peered":"2024-09-13T06:09:36.132227+0000","last_unstale":"2024-09-13T06:10:10.948430+0000","last_undegraded":"2024-09-13T06:10:10.948430+0000","last_fullsized":"2024-09-13T06:10:10.948430+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:57:02.814153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"35'56","reported_seq":112,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:20.691893+0000","last_change":"2024-09-13T06:09:38.150760+0000","last_active":"2024-09-13T06:13:20.691893+0000","last_peered":"2024-09-13T06:13:20.691893+0000","last_clean":"2024-09-13T06:13:20.691893+0000","last_became_active":"2024-09-13T06:09:38.150070+0000","last_became_peered":"2024-09-13T06:09:38.150070+0000","last_unstale":"2024-09-13T06:13:20.691893+0000","last_undegraded":"2024-09-13T06:13:20.691893+0000","last_fullsized":"2024-09-13T06:13:20.691893+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:07:27.806351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.797513+0000","last_change":"2024-09-13T06:09:40.172438+0000","last_active":"2024-09-13T06:10:10.797513+0000","last_peered":"2024-09-13T06:10:10.797513+0000","last_clean":"2024-09-13T06:10:10.797513+0000","last_became_active":"2024-09-13T06:09:40.168550+0000","last_became_peered":"2024-09-13T06:09:40.168550+0000","last_unstale":"2024-09-13T06:10:10.797513+0000","last_undegraded":"2024-09-13T06:10:10.797513+0000","last_fullsized":"2024-09-13T06:10:10.797513+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:45:10.856259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"35'14","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:48.049705+0000","last_change":"2024-09-13T06:09:42.212051+0000","last_active":"2024-09-13T06:11:48.049705+0000","last_peered":"2024-09-13T06:11:48.049705+0000","last_clean":"2024-09-13T06:11:48.049705+0000","last_became_active":"2024-09-13T06:09:42.211508+0000","last_became_peered":"2024-09-13T06:09:42.211508+0000","last_unstale":"2024-09-13T06:11:48.049705+0000","last_undegraded":"2024-09-13T06:11:48.049705+0000","last_fullsized":"2024-09-13T06:11:48.049705+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:12:02.782157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"35'8","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:02.612403+0000","last_change":"2024-09-13T06:09:34.123413+0000","last_active":"2024-09-13T06:11:02.612403+0000","last_peered":"2024-09-13T06:11:02.612403+0000","last_clean":"2024-09-13T06:11:02.612403+0000","last_became_active":"2024-09-13T06:09:34.122881+0000","last_became_peered":"2024-09-13T06:09:34.122881+0000","last_unstale":"2024-09-13T06:11:02.612403+0000","last_undegraded":"2024-09-13T06:11:02.612403+0000","last_fullsized":"2024-09-13T06:11:02.612403+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:16:44.971572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":11,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.811694+0000","last_change":"2024-09-13T06:09:32.120176+0000","last_active":"2024-09-13T06:10:10.811694+0000","last_peered":"2024-09-13T06:10:10.811694+0000","last_clean":"2024-09-13T06:10:10.811694+0000","last_became_active":"2024-09-13T06:09:32.119573+0000","last_became_peered":"2024-09-13T06:09:32.119573+0000","last_unstale":"2024-09-13T06:10:10.811694+0000","last_undegraded":"2024-09-13T06:10:10.811694+0000","last_fullsized":"2024-09-13T06:10:10.811694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:40:56.947438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.799409+0000","last_change":"2024-09-13T06:09:36.128456+0000","last_active":"2024-09-13T06:10:10.799409+0000","last_peered":"2024-09-13T06:10:10.799409+0000","last_clean":"2024-09-13T06:10:10.799409+0000","last_became_active":"2024-09-13T06:09:36.127719+0000","last_became_peered":"2024-09-13T06:09:36.127719+0000","last_unstale":"2024-09-13T06:10:10.799409+0000","last_undegraded":"2024-09-13T06:10:10.799409+0000","last_fullsized":"2024-09-13T06:10:10.799409+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:41:36.178856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"35'40","reported_seq":89,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:20.752981+0000","last_change":"2024-09-13T06:09:38.176074+0000","last_active":"2024-09-13T06:13:20.752981+0000","last_peered":"2024-09-13T06:13:20.752981+0000","last_clean":"2024-09-13T06:13:20.752981+0000","last_became_active":"2024-09-13T06:09:38.175443+0000","last_became_peered":"2024-09-13T06:09:38.175443+0000","last_unstale":"2024-09-13T06:13:20.752981+0000","last_undegraded":"2024-09-13T06:13:20.752981+0000","last_fullsized":"2024-09-13T06:13:20.752981+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:17:36.487054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.817232+0000","last_change":"2024-09-13T06:09:40.185799+0000","last_active":"2024-09-13T06:10:10.817232+0000","last_peered":"2024-09-13T06:10:10.817232+0000","last_clean":"2024-09-13T06:10:10.817232+0000","last_became_active":"2024-09-13T06:09:40.185222+0000","last_became_peered":"2024-09-13T06:09:40.185222+0000","last_unstale":"2024-09-13T06:10:10.817232+0000","last_undegraded":"2024-09-13T06:10:10.817232+0000","last_fullsized":"2024-09-13T06:10:10.817232+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:05:13.593940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.801505+0000","last_change":"2024-09-13T06:09:42.197504+0000","last_active":"2024-09-13T06:10:10.801505+0000","last_peered":"2024-09-13T06:10:10.801505+0000","last_clean":"2024-09-13T06:10:10.801505+0000","last_became_active":"2024-09-13T06:09:42.196679+0000","last_became_peered":"2024-09-13T06:09:42.196679+0000","last_unstale":"2024-09-13T06:10:10.801505+0000","last_undegraded":"2024-09-13T06:10:10.801505+0000","last_fullsized":"2024-09-13T06:10:10.801505+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:50:54.126547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"35'15","reported_seq":76,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:48.978469+0000","last_change":"2024-09-13T06:09:34.133093+0000","last_active":"2024-09-13T06:12:48.978469+0000","last_peered":"2024-09-13T06:12:48.978469+0000","last_clean":"2024-09-13T06:12:48.978469+0000","last_became_active":"2024-09-13T06:09:34.132777+0000","last_became_peered":"2024-09-13T06:09:34.132777+0000","last_unstale":"2024-09-13T06:12:48.978469+0000","last_undegraded":"2024-09-13T06:12:48.978469+0000","last_fullsized":"2024-09-13T06:12:48.978469+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:22:38.070470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":57,"num_read_kb":53,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.814118+0000","last_change":"2024-09-13T06:09:32.118851+0000","last_active":"2024-09-13T06:10:10.814118+0000","last_peered":"2024-09-13T06:10:10.814118+0000","last_clean":"2024-09-13T06:10:10.814118+0000","last_became_active":"2024-09-13T06:09:32.117988+0000","last_became_peered":"2024-09-13T06:09:32.117988+0000","last_unstale":"2024-09-13T06:10:10.814118+0000","last_undegraded":"2024-09-13T06:10:10.814118+0000","last_fullsized":"2024-09-13T06:10:10.814118+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:23:34.478662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.799299+0000","last_change":"2024-09-13T06:09:36.130203+0000","last_active":"2024-09-13T06:10:10.799299+0000","last_peered":"2024-09-13T06:10:10.799299+0000","last_clean":"2024-09-13T06:10:10.799299+0000","last_became_active":"2024-09-13T06:09:36.129471+0000","last_became_peered":"2024-09-13T06:09:36.129471+0000","last_unstale":"2024-09-13T06:10:10.799299+0000","last_undegraded":"2024-09-13T06:10:10.799299+0000","last_fullsized":"2024-09-13T06:10:10.799299+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:24:11.325179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"35'35","reported_seq":78,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:45.825554+0000","last_change":"2024-09-13T06:09:38.154073+0000","last_active":"2024-09-13T06:11:45.825554+0000","last_peered":"2024-09-13T06:11:45.825554+0000","last_clean":"2024-09-13T06:11:45.825554+0000","last_became_active":"2024-09-13T06:09:38.153433+0000","last_became_peered":"2024-09-13T06:09:38.153433+0000","last_unstale":"2024-09-13T06:11:45.825554+0000","last_undegraded":"2024-09-13T06:11:45.825554+0000","last_fullsized":"2024-09-13T06:11:45.825554+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:14:58.653958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":46,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.947882+0000","last_change":"2024-09-13T06:09:40.172148+0000","last_active":"2024-09-13T06:10:10.947882+0000","last_peered":"2024-09-13T06:10:10.947882+0000","last_clean":"2024-09-13T06:10:10.947882+0000","last_became_active":"2024-09-13T06:09:40.171455+0000","last_became_peered":"2024-09-13T06:09:40.171455+0000","last_unstale":"2024-09-13T06:10:10.947882+0000","last_undegraded":"2024-09-13T06:10:10.947882+0000","last_fullsized":"2024-09-13T06:10:10.947882+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:14:59.315430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"35'5","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:48.222496+0000","last_change":"2024-09-13T06:09:42.202743+0000","last_active":"2024-09-13T06:11:48.222496+0000","last_peered":"2024-09-13T06:11:48.222496+0000","last_clean":"2024-09-13T06:11:48.222496+0000","last_became_active":"2024-09-13T06:09:42.202004+0000","last_became_peered":"2024-09-13T06:09:42.202004+0000","last_unstale":"2024-09-13T06:11:48.222496+0000","last_undegraded":"2024-09-13T06:11:48.222496+0000","last_fullsized":"2024-09-13T06:11:48.222496+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:46:50.902863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.951802+0000","last_change":"2024-09-13T06:09:34.117065+0000","last_active":"2024-09-13T06:10:10.951802+0000","last_peered":"2024-09-13T06:10:10.951802+0000","last_clean":"2024-09-13T06:10:10.951802+0000","last_became_active":"2024-09-13T06:09:34.116197+0000","last_became_peered":"2024-09-13T06:09:34.116197+0000","last_unstale":"2024-09-13T06:10:10.951802+0000","last_undegraded":"2024-09-13T06:10:10.951802+0000","last_fullsized":"2024-09-13T06:10:10.951802+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:56:27.933046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:43.515452+0000","last_change":"2024-09-13T06:09:32.132784+0000","last_active":"2024-09-13T06:11:43.515452+0000","last_peered":"2024-09-13T06:11:43.515452+0000","last_clean":"2024-09-13T06:11:43.515452+0000","last_became_active":"2024-09-13T06:09:32.124989+0000","last_became_peered":"2024-09-13T06:09:32.124989+0000","last_unstale":"2024-09-13T06:11:43.515452+0000","last_undegraded":"2024-09-13T06:11:43.515452+0000","last_fullsized":"2024-09-13T06:11:43.515452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:48:08.025389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.817750+0000","last_change":"2024-09-13T06:09:36.140817+0000","last_active":"2024-09-13T06:10:10.817750+0000","last_peered":"2024-09-13T06:10:10.817750+0000","last_clean":"2024-09-13T06:10:10.817750+0000","last_became_active":"2024-09-13T06:09:36.140149+0000","last_became_peered":"2024-09-13T06:09:36.140149+0000","last_unstale":"2024-09-13T06:10:10.817750+0000","last_undegraded":"2024-09-13T06:10:10.817750+0000","last_fullsized":"2024-09-13T06:10:10.817750+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:04:48.637365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'10","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.816866+0000","last_change":"2024-09-13T06:09:38.178539+0000","last_active":"2024-09-13T06:10:10.816866+0000","last_peered":"2024-09-13T06:10:10.816866+0000","last_clean":"2024-09-13T06:10:10.816866+0000","last_became_active":"2024-09-13T06:09:38.177699+0000","last_became_peered":"2024-09-13T06:09:38.177699+0000","last_unstale":"2024-09-13T06:10:10.816866+0000","last_undegraded":"2024-09-13T06:10:10.816866+0000","last_fullsized":"2024-09-13T06:10:10.816866+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:32:51.733389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"35'285","reported_seq":374,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:20.659214+0000","last_change":"2024-09-13T06:09:40.167569+0000","last_active":"2024-09-13T06:13:20.659214+0000","last_peered":"2024-09-13T06:13:20.659214+0000","last_clean":"2024-09-13T06:13:20.659214+0000","last_became_active":"2024-09-13T06:09:40.166780+0000","last_became_peered":"2024-09-13T06:09:40.166780+0000","last_unstale":"2024-09-13T06:13:20.659214+0000","last_undegraded":"2024-09-13T06:13:20.659214+0000","last_fullsized":"2024-09-13T06:13:20.659214+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:49:12.694438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"35'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:43.527859+0000","last_change":"2024-09-13T06:09:42.201112+0000","last_active":"2024-09-13T06:11:43.527859+0000","last_peered":"2024-09-13T06:11:43.527859+0000","last_clean":"2024-09-13T06:11:43.527859+0000","last_became_active":"2024-09-13T06:09:42.196063+0000","last_became_peered":"2024-09-13T06:09:42.196063+0000","last_unstale":"2024-09-13T06:11:43.527859+0000","last_undegraded":"2024-09-13T06:11:43.527859+0000","last_fullsized":"2024-09-13T06:11:43.527859+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:58:32.682955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"35'6","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:48.962756+0000","last_change":"2024-09-13T06:09:34.108198+0000","last_active":"2024-09-13T06:12:48.962756+0000","last_peered":"2024-09-13T06:12:48.962756+0000","last_clean":"2024-09-13T06:12:48.962756+0000","last_became_active":"2024-09-13T06:09:34.107821+0000","last_became_peered":"2024-09-13T06:09:34.107821+0000","last_unstale":"2024-09-13T06:12:48.962756+0000","last_undegraded":"2024-09-13T06:12:48.962756+0000","last_fullsized":"2024-09-13T06:12:48.962756+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:32:59.845317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:19.619406+0000","last_change":"2024-09-13T06:09:32.141297+0000","last_active":"2024-09-13T06:10:19.619406+0000","last_peered":"2024-09-13T06:10:19.619406+0000","last_clean":"2024-09-13T06:10:19.619406+0000","last_became_active":"2024-09-13T06:09:32.140816+0000","last_became_peered":"2024-09-13T06:09:32.140816+0000","last_unstale":"2024-09-13T06:10:19.619406+0000","last_undegraded":"2024-09-13T06:10:19.619406+0000","last_fullsized":"2024-09-13T06:10:19.619406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:40:42.202859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.813629+0000","last_change":"2024-09-13T06:09:36.141476+0000","last_active":"2024-09-13T06:10:10.813629+0000","last_peered":"2024-09-13T06:10:10.813629+0000","last_clean":"2024-09-13T06:10:10.813629+0000","last_became_active":"2024-09-13T06:09:36.140770+0000","last_became_peered":"2024-09-13T06:09:36.140770+0000","last_unstale":"2024-09-13T06:10:10.813629+0000","last_undegraded":"2024-09-13T06:10:10.813629+0000","last_fullsized":"2024-09-13T06:10:10.813629+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:26:28.751065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"35'40","reported_seq":89,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:20.902112+0000","last_change":"2024-09-13T06:09:38.167920+0000","last_active":"2024-09-13T06:13:20.902112+0000","last_peered":"2024-09-13T06:13:20.902112+0000","last_clean":"2024-09-13T06:13:20.902112+0000","last_became_active":"2024-09-13T06:09:38.166681+0000","last_became_peered":"2024-09-13T06:09:38.166681+0000","last_unstale":"2024-09-13T06:13:20.902112+0000","last_undegraded":"2024-09-13T06:13:20.902112+0000","last_fullsized":"2024-09-13T06:13:20.902112+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:55:43.635960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.942532+0000","last_change":"2024-09-13T06:09:40.179339+0000","last_active":"2024-09-13T06:10:10.942532+0000","last_peered":"2024-09-13T06:10:10.942532+0000","last_clean":"2024-09-13T06:10:10.942532+0000","last_became_active":"2024-09-13T06:09:40.178484+0000","last_became_peered":"2024-09-13T06:09:40.178484+0000","last_unstale":"2024-09-13T06:10:10.942532+0000","last_undegraded":"2024-09-13T06:10:10.942532+0000","last_fullsized":"2024-09-13T06:10:10.942532+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:45:32.317497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"35'4","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:02.607121+0000","last_change":"2024-09-13T06:09:42.201123+0000","last_active":"2024-09-13T06:11:02.607121+0000","last_peered":"2024-09-13T06:11:02.607121+0000","last_clean":"2024-09-13T06:11:02.607121+0000","last_became_active":"2024-09-13T06:09:42.199609+0000","last_became_peered":"2024-09-13T06:09:42.199609+0000","last_unstale":"2024-09-13T06:11:02.607121+0000","last_undegraded":"2024-09-13T06:11:02.607121+0000","last_fullsized":"2024-09-13T06:11:02.607121+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:30:15.851819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"35'5","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:06.802967+0000","last_change":"2024-09-13T06:09:34.100754+0000","last_active":"2024-09-13T06:12:06.802967+0000","last_peered":"2024-09-13T06:12:06.802967+0000","last_clean":"2024-09-13T06:12:06.802967+0000","last_became_active":"2024-09-13T06:09:34.100355+0000","last_became_peered":"2024-09-13T06:09:34.100355+0000","last_unstale":"2024-09-13T06:12:06.802967+0000","last_undegraded":"2024-09-13T06:12:06.802967+0000","last_fullsized":"2024-09-13T06:12:06.802967+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:09:45.564486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.812408+0000","last_change":"2024-09-13T06:09:32.133279+0000","last_active":"2024-09-13T06:10:10.812408+0000","last_peered":"2024-09-13T06:10:10.812408+0000","last_clean":"2024-09-13T06:10:10.812408+0000","last_became_active":"2024-09-13T06:09:32.125049+0000","last_became_peered":"2024-09-13T06:09:32.125049+0000","last_unstale":"2024-09-13T06:10:10.812408+0000","last_undegraded":"2024-09-13T06:10:10.812408+0000","last_fullsized":"2024-09-13T06:10:10.812408+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:46:21.627138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.803001+0000","last_change":"2024-09-13T06:09:36.128406+0000","last_active":"2024-09-13T06:10:10.803001+0000","last_peered":"2024-09-13T06:10:10.803001+0000","last_clean":"2024-09-13T06:10:10.803001+0000","last_became_active":"2024-09-13T06:09:36.127684+0000","last_became_peered":"2024-09-13T06:09:36.127684+0000","last_unstale":"2024-09-13T06:10:10.803001+0000","last_undegraded":"2024-09-13T06:10:10.803001+0000","last_fullsized":"2024-09-13T06:10:10.803001+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:19:14.299050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"35'32","reported_seq":74,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.536866+0000","last_change":"2024-09-13T06:09:38.158011+0000","last_active":"2024-09-13T06:12:49.536866+0000","last_peered":"2024-09-13T06:12:49.536866+0000","last_clean":"2024-09-13T06:12:49.536866+0000","last_became_active":"2024-09-13T06:09:38.157278+0000","last_became_peered":"2024-09-13T06:09:38.157278+0000","last_unstale":"2024-09-13T06:12:49.536866+0000","last_undegraded":"2024-09-13T06:12:49.536866+0000","last_fullsized":"2024-09-13T06:12:49.536866+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:38:47.813081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.801307+0000","last_change":"2024-09-13T06:09:40.189802+0000","last_active":"2024-09-13T06:10:10.801307+0000","last_peered":"2024-09-13T06:10:10.801307+0000","last_clean":"2024-09-13T06:10:10.801307+0000","last_became_active":"2024-09-13T06:09:40.189165+0000","last_became_peered":"2024-09-13T06:09:40.189165+0000","last_unstale":"2024-09-13T06:10:10.801307+0000","last_undegraded":"2024-09-13T06:10:10.801307+0000","last_fullsized":"2024-09-13T06:10:10.801307+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:46:51.067583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.817340+0000","last_change":"2024-09-13T06:09:42.214239+0000","last_active":"2024-09-13T06:10:10.817340+0000","last_peered":"2024-09-13T06:10:10.817340+0000","last_clean":"2024-09-13T06:10:10.817340+0000","last_became_active":"2024-09-13T06:09:42.213756+0000","last_became_peered":"2024-09-13T06:09:42.213756+0000","last_unstale":"2024-09-13T06:10:10.817340+0000","last_undegraded":"2024-09-13T06:10:10.817340+0000","last_fullsized":"2024-09-13T06:10:10.817340+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:18:10.840742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.802714+0000","last_change":"2024-09-13T06:09:34.118052+0000","last_active":"2024-09-13T06:10:10.802714+0000","last_peered":"2024-09-13T06:10:10.802714+0000","last_clean":"2024-09-13T06:10:10.802714+0000","last_became_active":"2024-09-13T06:09:34.117789+0000","last_became_peered":"2024-09-13T06:09:34.117789+0000","last_unstale":"2024-09-13T06:10:10.802714+0000","last_undegraded":"2024-09-13T06:10:10.802714+0000","last_fullsized":"2024-09-13T06:10:10.802714+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:20:33.360213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.948743+0000","last_change":"2024-09-13T06:09:32.135815+0000","last_active":"2024-09-13T06:10:10.948743+0000","last_peered":"2024-09-13T06:10:10.948743+0000","last_clean":"2024-09-13T06:10:10.948743+0000","last_became_active":"2024-09-13T06:09:32.134696+0000","last_became_peered":"2024-09-13T06:09:32.134696+0000","last_unstale":"2024-09-13T06:10:10.948743+0000","last_undegraded":"2024-09-13T06:10:10.948743+0000","last_fullsized":"2024-09-13T06:10:10.948743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:26:57.128770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.805495+0000","last_change":"2024-09-13T06:09:36.132556+0000","last_active":"2024-09-13T06:10:10.805495+0000","last_peered":"2024-09-13T06:10:10.805495+0000","last_clean":"2024-09-13T06:10:10.805495+0000","last_became_active":"2024-09-13T06:09:36.131976+0000","last_became_peered":"2024-09-13T06:09:36.131976+0000","last_unstale":"2024-09-13T06:10:10.805495+0000","last_undegraded":"2024-09-13T06:10:10.805495+0000","last_fullsized":"2024-09-13T06:10:10.805495+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:48:01.480885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"35'29","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:20.840778+0000","last_change":"2024-09-13T06:09:38.173782+0000","last_active":"2024-09-13T06:13:20.840778+0000","last_peered":"2024-09-13T06:13:20.840778+0000","last_clean":"2024-09-13T06:13:20.840778+0000","last_became_active":"2024-09-13T06:09:38.171538+0000","last_became_peered":"2024-09-13T06:09:38.171538+0000","last_unstale":"2024-09-13T06:13:20.840778+0000","last_undegraded":"2024-09-13T06:13:20.840778+0000","last_fullsized":"2024-09-13T06:13:20.840778+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:03:14.025680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.802940+0000","last_change":"2024-09-13T06:09:40.185942+0000","last_active":"2024-09-13T06:10:10.802940+0000","last_peered":"2024-09-13T06:10:10.802940+0000","last_clean":"2024-09-13T06:10:10.802940+0000","last_became_active":"2024-09-13T06:09:40.185277+0000","last_became_peered":"2024-09-13T06:09:40.185277+0000","last_unstale":"2024-09-13T06:10:10.802940+0000","last_undegraded":"2024-09-13T06:10:10.802940+0000","last_fullsized":"2024-09-13T06:10:10.802940+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:32:01.193186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"35'6","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.118315+0000","last_change":"2024-09-13T06:09:42.211802+0000","last_active":"2024-09-13T06:12:49.118315+0000","last_peered":"2024-09-13T06:12:49.118315+0000","last_clean":"2024-09-13T06:12:49.118315+0000","last_became_active":"2024-09-13T06:09:42.211176+0000","last_became_peered":"2024-09-13T06:09:42.211176+0000","last_unstale":"2024-09-13T06:12:49.118315+0000","last_undegraded":"2024-09-13T06:12:49.118315+0000","last_fullsized":"2024-09-13T06:12:49.118315+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:57:39.347061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"35'7","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:01.801830+0000","last_change":"2024-09-13T06:09:34.105846+0000","last_active":"2024-09-13T06:12:01.801830+0000","last_peered":"2024-09-13T06:12:01.801830+0000","last_clean":"2024-09-13T06:12:01.801830+0000","last_became_active":"2024-09-13T06:09:34.105494+0000","last_became_peered":"2024-09-13T06:09:34.105494+0000","last_unstale":"2024-09-13T06:12:01.801830+0000","last_undegraded":"2024-09-13T06:12:01.801830+0000","last_fullsized":"2024-09-13T06:12:01.801830+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:49:45.129882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:48.169232+0000","last_change":"2024-09-13T06:09:32.143211+0000","last_active":"2024-09-13T06:11:48.169232+0000","last_peered":"2024-09-13T06:11:48.169232+0000","last_clean":"2024-09-13T06:11:48.169232+0000","last_became_active":"2024-09-13T06:09:32.142726+0000","last_became_peered":"2024-09-13T06:09:32.142726+0000","last_unstale":"2024-09-13T06:11:48.169232+0000","last_undegraded":"2024-09-13T06:11:48.169232+0000","last_fullsized":"2024-09-13T06:11:48.169232+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:21:43.192771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"35'2","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:44.039922+0000","last_change":"2024-09-13T06:09:36.137208+0000","last_active":"2024-09-13T06:11:44.039922+0000","last_peered":"2024-09-13T06:11:44.039922+0000","last_clean":"2024-09-13T06:11:44.039922+0000","last_became_active":"2024-09-13T06:09:36.136792+0000","last_became_peered":"2024-09-13T06:09:36.136792+0000","last_unstale":"2024-09-13T06:11:44.039922+0000","last_undegraded":"2024-09-13T06:11:44.039922+0000","last_fullsized":"2024-09-13T06:11:44.039922+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:41.098706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"35'35","reported_seq":83,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:20.861038+0000","last_change":"2024-09-13T06:09:38.167295+0000","last_active":"2024-09-13T06:13:20.861038+0000","last_peered":"2024-09-13T06:13:20.861038+0000","last_clean":"2024-09-13T06:13:20.861038+0000","last_became_active":"2024-09-13T06:09:38.166333+0000","last_became_peered":"2024-09-13T06:09:38.166333+0000","last_unstale":"2024-09-13T06:13:20.861038+0000","last_undegraded":"2024-09-13T06:13:20.861038+0000","last_fullsized":"2024-09-13T06:13:20.861038+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:04:00.098517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.946008+0000","last_change":"2024-09-13T06:09:40.179631+0000","last_active":"2024-09-13T06:10:10.946008+0000","last_peered":"2024-09-13T06:10:10.946008+0000","last_clean":"2024-09-13T06:10:10.946008+0000","last_became_active":"2024-09-13T06:09:40.178392+0000","last_became_peered":"2024-09-13T06:09:40.178392+0000","last_unstale":"2024-09-13T06:10:10.946008+0000","last_undegraded":"2024-09-13T06:10:10.946008+0000","last_fullsized":"2024-09-13T06:10:10.946008+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:07:06.165239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"35'8","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:48.486283+0000","last_change":"2024-09-13T06:09:42.214258+0000","last_active":"2024-09-13T06:12:48.486283+0000","last_peered":"2024-09-13T06:12:48.486283+0000","last_clean":"2024-09-13T06:12:48.486283+0000","last_became_active":"2024-09-13T06:09:42.213809+0000","last_became_peered":"2024-09-13T06:09:42.213809+0000","last_unstale":"2024-09-13T06:12:48.486283+0000","last_undegraded":"2024-09-13T06:12:48.486283+0000","last_fullsized":"2024-09-13T06:12:48.486283+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:14:08.749509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"35'6","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:18.858941+0000","last_change":"2024-09-13T06:09:34.126954+0000","last_active":"2024-09-13T06:10:18.858941+0000","last_peered":"2024-09-13T06:10:18.858941+0000","last_clean":"2024-09-13T06:10:18.858941+0000","last_became_active":"2024-09-13T06:09:34.124044+0000","last_became_peered":"2024-09-13T06:09:34.124044+0000","last_unstale":"2024-09-13T06:10:18.858941+0000","last_undegraded":"2024-09-13T06:10:18.858941+0000","last_fullsized":"2024-09-13T06:10:18.858941+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:41:52.801670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.793841+0000","last_change":"2024-09-13T06:09:32.134687+0000","last_active":"2024-09-13T06:10:10.793841+0000","last_peered":"2024-09-13T06:10:10.793841+0000","last_clean":"2024-09-13T06:10:10.793841+0000","last_became_active":"2024-09-13T06:09:32.133972+0000","last_became_peered":"2024-09-13T06:09:32.133972+0000","last_unstale":"2024-09-13T06:10:10.793841+0000","last_undegraded":"2024-09-13T06:10:10.793841+0000","last_fullsized":"2024-09-13T06:10:10.793841+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:28:08.722107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"35'12","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.513040+0000","last_change":"2024-09-13T06:09:34.113604+0000","last_active":"2024-09-13T06:12:49.513040+0000","last_peered":"2024-09-13T06:12:49.513040+0000","last_clean":"2024-09-13T06:12:49.513040+0000","last_became_active":"2024-09-13T06:09:34.112805+0000","last_became_peered":"2024-09-13T06:09:34.112805+0000","last_unstale":"2024-09-13T06:12:49.513040+0000","last_undegraded":"2024-09-13T06:12:49.513040+0000","last_fullsized":"2024-09-13T06:12:49.513040+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:57:58.370368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:18.043879+0000","last_change":"2024-09-13T06:09:32.150318+0000","last_active":"2024-09-13T06:10:18.043879+0000","last_peered":"2024-09-13T06:10:18.043879+0000","last_clean":"2024-09-13T06:10:18.043879+0000","last_became_active":"2024-09-13T06:09:32.145941+0000","last_became_peered":"2024-09-13T06:09:32.145941+0000","last_unstale":"2024-09-13T06:10:18.043879+0000","last_undegraded":"2024-09-13T06:10:18.043879+0000","last_fullsized":"2024-09-13T06:10:18.043879+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:52:39.866148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"35'10","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.435817+0000","last_change":"2024-09-13T06:09:34.118956+0000","last_active":"2024-09-13T06:12:49.435817+0000","last_peered":"2024-09-13T06:12:49.435817+0000","last_clean":"2024-09-13T06:12:49.435817+0000","last_became_active":"2024-09-13T06:09:34.118325+0000","last_became_peered":"2024-09-13T06:09:34.118325+0000","last_unstale":"2024-09-13T06:12:49.435817+0000","last_undegraded":"2024-09-13T06:12:49.435817+0000","last_fullsized":"2024-09-13T06:12:49.435817+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:29:20.078139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:19.629629+0000","last_change":"2024-09-13T06:09:32.144168+0000","last_active":"2024-09-13T06:10:19.629629+0000","last_peered":"2024-09-13T06:10:19.629629+0000","last_clean":"2024-09-13T06:10:19.629629+0000","last_became_active":"2024-09-13T06:09:32.133230+0000","last_became_peered":"2024-09-13T06:09:32.133230+0000","last_unstale":"2024-09-13T06:10:19.629629+0000","last_undegraded":"2024-09-13T06:10:19.629629+0000","last_fullsized":"2024-09-13T06:10:19.629629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:30:40.767524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"35'4","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.512979+0000","last_change":"2024-09-13T06:09:34.117053+0000","last_active":"2024-09-13T06:12:49.512979+0000","last_peered":"2024-09-13T06:12:49.512979+0000","last_clean":"2024-09-13T06:12:49.512979+0000","last_became_active":"2024-09-13T06:09:34.115512+0000","last_became_peered":"2024-09-13T06:09:34.115512+0000","last_unstale":"2024-09-13T06:12:49.512979+0000","last_undegraded":"2024-09-13T06:12:49.512979+0000","last_fullsized":"2024-09-13T06:12:49.512979+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:41:07.174428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:48.905752+0000","last_change":"2024-09-13T06:09:32.153571+0000","last_active":"2024-09-13T06:12:48.905752+0000","last_peered":"2024-09-13T06:12:48.905752+0000","last_clean":"2024-09-13T06:12:48.905752+0000","last_became_active":"2024-09-13T06:09:32.150328+0000","last_became_peered":"2024-09-13T06:09:32.150328+0000","last_unstale":"2024-09-13T06:12:48.905752+0000","last_undegraded":"2024-09-13T06:12:48.905752+0000","last_fullsized":"2024-09-13T06:12:48.905752+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:42:54.943685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"35'12","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.109084+0000","last_change":"2024-09-13T06:09:34.115843+0000","last_active":"2024-09-13T06:12:49.109084+0000","last_peered":"2024-09-13T06:12:49.109084+0000","last_clean":"2024-09-13T06:12:49.109084+0000","last_became_active":"2024-09-13T06:09:34.113986+0000","last_became_peered":"2024-09-13T06:09:34.113986+0000","last_unstale":"2024-09-13T06:12:49.109084+0000","last_undegraded":"2024-09-13T06:12:49.109084+0000","last_fullsized":"2024-09-13T06:12:49.109084+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:03:45.932431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.948985+0000","last_change":"2024-09-13T06:09:32.137258+0000","last_active":"2024-09-13T06:10:10.948985+0000","last_peered":"2024-09-13T06:10:10.948985+0000","last_clean":"2024-09-13T06:10:10.948985+0000","last_became_active":"2024-09-13T06:09:32.136268+0000","last_became_peered":"2024-09-13T06:09:32.136268+0000","last_unstale":"2024-09-13T06:10:10.948985+0000","last_undegraded":"2024-09-13T06:10:10.948985+0000","last_fullsized":"2024-09-13T06:10:10.948985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:42:07.291597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"35'4","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:43.519164+0000","last_change":"2024-09-13T06:09:34.124112+0000","last_active":"2024-09-13T06:11:43.519164+0000","last_peered":"2024-09-13T06:11:43.519164+0000","last_clean":"2024-09-13T06:11:43.519164+0000","last_became_active":"2024-09-13T06:09:34.121261+0000","last_became_peered":"2024-09-13T06:09:34.121261+0000","last_unstale":"2024-09-13T06:11:43.519164+0000","last_undegraded":"2024-09-13T06:11:43.519164+0000","last_fullsized":"2024-09-13T06:11:43.519164+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:29:20.327517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.818014+0000","last_change":"2024-09-13T06:09:32.142747+0000","last_active":"2024-09-13T06:10:10.818014+0000","last_peered":"2024-09-13T06:10:10.818014+0000","last_clean":"2024-09-13T06:10:10.818014+0000","last_became_active":"2024-09-13T06:09:32.141602+0000","last_became_peered":"2024-09-13T06:09:32.141602+0000","last_unstale":"2024-09-13T06:10:10.818014+0000","last_undegraded":"2024-09-13T06:10:10.818014+0000","last_fullsized":"2024-09-13T06:10:10.818014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:12:22.491041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"35'6","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.512979+0000","last_change":"2024-09-13T06:09:34.123392+0000","last_active":"2024-09-13T06:12:49.512979+0000","last_peered":"2024-09-13T06:12:49.512979+0000","last_clean":"2024-09-13T06:12:49.512979+0000","last_became_active":"2024-09-13T06:09:34.122424+0000","last_became_peered":"2024-09-13T06:09:34.122424+0000","last_unstale":"2024-09-13T06:12:49.512979+0000","last_undegraded":"2024-09-13T06:12:49.512979+0000","last_fullsized":"2024-09-13T06:12:49.512979+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:32:59.845317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.803937+0000","last_change":"2024-09-13T06:09:32.120069+0000","last_active":"2024-09-13T06:10:10.803937+0000","last_peered":"2024-09-13T06:10:10.803937+0000","last_clean":"2024-09-13T06:10:10.803937+0000","last_became_active":"2024-09-13T06:09:32.119665+0000","last_became_peered":"2024-09-13T06:09:32.119665+0000","last_unstale":"2024-09-13T06:10:10.803937+0000","last_undegraded":"2024-09-13T06:10:10.803937+0000","last_fullsized":"2024-09-13T06:10:10.803937+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:12:38.569078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"35'9","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.454353+0000","last_change":"2024-09-13T06:09:34.121479+0000","last_active":"2024-09-13T06:12:49.454353+0000","last_peered":"2024-09-13T06:12:49.454353+0000","last_clean":"2024-09-13T06:12:49.454353+0000","last_became_active":"2024-09-13T06:09:34.114378+0000","last_became_peered":"2024-09-13T06:09:34.114378+0000","last_unstale":"2024-09-13T06:12:49.454353+0000","last_undegraded":"2024-09-13T06:12:49.454353+0000","last_fullsized":"2024-09-13T06:12:49.454353+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:48:00.341088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"35'3","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:45.798306+0000","last_change":"2024-09-13T06:09:32.147166+0000","last_active":"2024-09-13T06:11:45.798306+0000","last_peered":"2024-09-13T06:11:45.798306+0000","last_clean":"2024-09-13T06:11:45.798306+0000","last_became_active":"2024-09-13T06:09:32.146011+0000","last_became_peered":"2024-09-13T06:09:32.146011+0000","last_unstale":"2024-09-13T06:11:45.798306+0000","last_undegraded":"2024-09-13T06:11:45.798306+0000","last_fullsized":"2024-09-13T06:11:45.798306+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:56:46.777275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668544,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":11,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"35'2","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:43.532529+0000","last_change":"2024-09-13T06:09:34.118796+0000","last_active":"2024-09-13T06:11:43.532529+0000","last_peered":"2024-09-13T06:11:43.532529+0000","last_clean":"2024-09-13T06:11:43.532529+0000","last_became_active":"2024-09-13T06:09:34.117659+0000","last_became_peered":"2024-09-13T06:09:34.117659+0000","last_unstale":"2024-09-13T06:11:43.532529+0000","last_undegraded":"2024-09-13T06:11:43.532529+0000","last_fullsized":"2024-09-13T06:11:43.532529+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:26:28.789376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:47.850255+0000","last_change":"2024-09-13T06:09:32.124201+0000","last_active":"2024-09-13T06:11:47.850255+0000","last_peered":"2024-09-13T06:11:47.850255+0000","last_clean":"2024-09-13T06:11:47.850255+0000","last_became_active":"2024-09-13T06:09:32.121250+0000","last_became_peered":"2024-09-13T06:09:32.121250+0000","last_unstale":"2024-09-13T06:11:47.850255+0000","last_undegraded":"2024-09-13T06:11:47.850255+0000","last_fullsized":"2024-09-13T06:11:47.850255+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:52:58.934306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"35'5","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:57.810848+0000","last_change":"2024-09-13T06:09:34.118552+0000","last_active":"2024-09-13T06:11:57.810848+0000","last_peered":"2024-09-13T06:11:57.810848+0000","last_clean":"2024-09-13T06:11:57.810848+0000","last_became_active":"2024-09-13T06:09:34.118270+0000","last_became_peered":"2024-09-13T06:09:34.118270+0000","last_unstale":"2024-09-13T06:11:57.810848+0000","last_undegraded":"2024-09-13T06:11:57.810848+0000","last_fullsized":"2024-09-13T06:11:57.810848+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:36:12.584267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:18.044995+0000","last_change":"2024-09-13T06:09:32.151004+0000","last_active":"2024-09-13T06:10:18.044995+0000","last_peered":"2024-09-13T06:10:18.044995+0000","last_clean":"2024-09-13T06:10:18.044995+0000","last_became_active":"2024-09-13T06:09:32.145988+0000","last_became_peered":"2024-09-13T06:09:32.145988+0000","last_unstale":"2024-09-13T06:10:18.044995+0000","last_undegraded":"2024-09-13T06:10:18.044995+0000","last_fullsized":"2024-09-13T06:10:18.044995+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:56:32.022947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"33'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.951431+0000","last_change":"2024-09-13T06:09:34.118753+0000","last_active":"2024-09-13T06:10:10.951431+0000","last_peered":"2024-09-13T06:10:10.951431+0000","last_clean":"2024-09-13T06:10:10.951431+0000","last_became_active":"2024-09-13T06:09:34.117320+0000","last_became_peered":"2024-09-13T06:09:34.117320+0000","last_unstale":"2024-09-13T06:10:10.951431+0000","last_undegraded":"2024-09-13T06:10:10.951431+0000","last_fullsized":"2024-09-13T06:10:10.951431+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:09:45.564486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:48.718604+0000","last_change":"2024-09-13T06:09:32.141516+0000","last_active":"2024-09-13T06:12:48.718604+0000","last_peered":"2024-09-13T06:12:48.718604+0000","last_clean":"2024-09-13T06:12:48.718604+0000","last_became_active":"2024-09-13T06:09:32.141009+0000","last_became_peered":"2024-09-13T06:09:32.141009+0000","last_unstale":"2024-09-13T06:12:48.718604+0000","last_undegraded":"2024-09-13T06:12:48.718604+0000","last_fullsized":"2024-09-13T06:12:48.718604+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:33:27.853475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"35'12","reported_seq":82,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.436923+0000","last_change":"2024-09-13T06:09:34.124580+0000","last_active":"2024-09-13T06:12:49.436923+0000","last_peered":"2024-09-13T06:12:49.436923+0000","last_clean":"2024-09-13T06:12:49.436923+0000","last_became_active":"2024-09-13T06:09:34.124270+0000","last_became_peered":"2024-09-13T06:09:34.124270+0000","last_unstale":"2024-09-13T06:12:49.436923+0000","last_undegraded":"2024-09-13T06:12:49.436923+0000","last_fullsized":"2024-09-13T06:12:49.436923+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:54:14.588264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:47.918751+0000","last_change":"2024-09-13T06:09:32.143000+0000","last_active":"2024-09-13T06:11:47.918751+0000","last_peered":"2024-09-13T06:11:47.918751+0000","last_clean":"2024-09-13T06:11:47.918751+0000","last_became_active":"2024-09-13T06:09:32.142581+0000","last_became_peered":"2024-09-13T06:09:32.142581+0000","last_unstale":"2024-09-13T06:11:47.918751+0000","last_undegraded":"2024-09-13T06:11:47.918751+0000","last_fullsized":"2024-09-13T06:11:47.918751+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:04:11.910433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"35'16","reported_seq":76,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.437303+0000","last_change":"2024-09-13T06:09:34.118681+0000","last_active":"2024-09-13T06:12:49.437303+0000","last_peered":"2024-09-13T06:12:49.437303+0000","last_clean":"2024-09-13T06:12:49.437303+0000","last_became_active":"2024-09-13T06:09:34.118290+0000","last_became_peered":"2024-09-13T06:09:34.118290+0000","last_unstale":"2024-09-13T06:12:49.437303+0000","last_undegraded":"2024-09-13T06:12:49.437303+0000","last_fullsized":"2024-09-13T06:12:49.437303+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:00:27.052532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":58,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.809957+0000","last_change":"2024-09-13T06:09:32.124596+0000","last_active":"2024-09-13T06:10:10.809957+0000","last_peered":"2024-09-13T06:10:10.809957+0000","last_clean":"2024-09-13T06:10:10.809957+0000","last_became_active":"2024-09-13T06:09:32.121400+0000","last_became_peered":"2024-09-13T06:09:32.121400+0000","last_unstale":"2024-09-13T06:10:10.809957+0000","last_undegraded":"2024-09-13T06:10:10.809957+0000","last_fullsized":"2024-09-13T06:10:10.809957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:19:33.910739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"35'13","reported_seq":72,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.533331+0000","last_change":"2024-09-13T06:09:34.124551+0000","last_active":"2024-09-13T06:12:49.533331+0000","last_peered":"2024-09-13T06:12:49.533331+0000","last_clean":"2024-09-13T06:12:49.533331+0000","last_became_active":"2024-09-13T06:09:34.121743+0000","last_became_peered":"2024-09-13T06:09:34.121743+0000","last_unstale":"2024-09-13T06:12:49.533331+0000","last_undegraded":"2024-09-13T06:12:49.533331+0000","last_fullsized":"2024-09-13T06:12:49.533331+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:34:44.658759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.291785+0000","last_change":"2024-09-13T06:09:32.135724+0000","last_active":"2024-09-13T06:12:49.291785+0000","last_peered":"2024-09-13T06:12:49.291785+0000","last_clean":"2024-09-13T06:12:49.291785+0000","last_became_active":"2024-09-13T06:09:32.127830+0000","last_became_peered":"2024-09-13T06:09:32.127830+0000","last_unstale":"2024-09-13T06:12:49.291785+0000","last_undegraded":"2024-09-13T06:12:49.291785+0000","last_fullsized":"2024-09-13T06:12:49.291785+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:27:43.484419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"35'4","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:19.300831+0000","last_change":"2024-09-13T06:09:34.126475+0000","last_active":"2024-09-13T06:10:19.300831+0000","last_peered":"2024-09-13T06:10:19.300831+0000","last_clean":"2024-09-13T06:10:19.300831+0000","last_became_active":"2024-09-13T06:09:34.126020+0000","last_became_peered":"2024-09-13T06:09:34.126020+0000","last_unstale":"2024-09-13T06:10:19.300831+0000","last_undegraded":"2024-09-13T06:10:19.300831+0000","last_fullsized":"2024-09-13T06:10:19.300831+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:44:39.157280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:48.830019+0000","last_change":"2024-09-13T06:09:32.119928+0000","last_active":"2024-09-13T06:12:48.830019+0000","last_peered":"2024-09-13T06:12:48.830019+0000","last_clean":"2024-09-13T06:12:48.830019+0000","last_became_active":"2024-09-13T06:09:32.119542+0000","last_became_peered":"2024-09-13T06:09:32.119542+0000","last_unstale":"2024-09-13T06:12:48.830019+0000","last_undegraded":"2024-09-13T06:12:48.830019+0000","last_fullsized":"2024-09-13T06:12:48.830019+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:55:55.407168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"35'6","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.513282+0000","last_change":"2024-09-13T06:09:34.118722+0000","last_active":"2024-09-13T06:12:49.513282+0000","last_peered":"2024-09-13T06:12:49.513282+0000","last_clean":"2024-09-13T06:12:49.513282+0000","last_became_active":"2024-09-13T06:09:34.110506+0000","last_became_peered":"2024-09-13T06:09:34.110506+0000","last_unstale":"2024-09-13T06:12:49.513282+0000","last_undegraded":"2024-09-13T06:12:49.513282+0000","last_fullsized":"2024-09-13T06:12:49.513282+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:22:27.348511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.818133+0000","last_change":"2024-09-13T06:09:32.130216+0000","last_active":"2024-09-13T06:10:10.818133+0000","last_peered":"2024-09-13T06:10:10.818133+0000","last_clean":"2024-09-13T06:10:10.818133+0000","last_became_active":"2024-09-13T06:09:32.121895+0000","last_became_peered":"2024-09-13T06:09:32.121895+0000","last_unstale":"2024-09-13T06:10:10.818133+0000","last_undegraded":"2024-09-13T06:10:10.818133+0000","last_fullsized":"2024-09-13T06:10:10.818133+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:31:54.248100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.802008+0000","last_change":"2024-09-13T06:09:32.132716+0000","last_active":"2024-09-13T06:10:10.802008+0000","last_peered":"2024-09-13T06:10:10.802008+0000","last_clean":"2024-09-13T06:10:10.802008+0000","last_became_active":"2024-09-13T06:09:32.130056+0000","last_became_peered":"2024-09-13T06:09:32.130056+0000","last_unstale":"2024-09-13T06:10:10.802008+0000","last_undegraded":"2024-09-13T06:10:10.802008+0000","last_fullsized":"2024-09-13T06:10:10.802008+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:57:09.275474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"35'8","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:48.958693+0000","last_change":"2024-09-13T06:09:34.132050+0000","last_active":"2024-09-13T06:12:48.958693+0000","last_peered":"2024-09-13T06:12:48.958693+0000","last_clean":"2024-09-13T06:12:48.958693+0000","last_became_active":"2024-09-13T06:09:34.130980+0000","last_became_peered":"2024-09-13T06:09:34.130980+0000","last_unstale":"2024-09-13T06:12:48.958693+0000","last_undegraded":"2024-09-13T06:12:48.958693+0000","last_fullsized":"2024-09-13T06:12:48.958693+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:11:30.370585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"33'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:10:10.944159+0000","last_change":"2024-09-13T06:09:32.152088+0000","last_active":"2024-09-13T06:10:10.944159+0000","last_peered":"2024-09-13T06:10:10.944159+0000","last_clean":"2024-09-13T06:10:10.944159+0000","last_became_active":"2024-09-13T06:09:32.149426+0000","last_became_peered":"2024-09-13T06:09:32.149426+0000","last_unstale":"2024-09-13T06:10:10.944159+0000","last_undegraded":"2024-09-13T06:10:10.944159+0000","last_fullsized":"2024-09-13T06:10:10.944159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:53:16.188364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"35'3","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:02.807090+0000","last_change":"2024-09-13T06:09:34.118994+0000","last_active":"2024-09-13T06:12:02.807090+0000","last_peered":"2024-09-13T06:12:02.807090+0000","last_clean":"2024-09-13T06:12:02.807090+0000","last_became_active":"2024-09-13T06:09:34.111230+0000","last_became_peered":"2024-09-13T06:09:34.111230+0000","last_unstale":"2024-09-13T06:12:02.807090+0000","last_undegraded":"2024-09-13T06:12:02.807090+0000","last_fullsized":"2024-09-13T06:12:02.807090+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:48:17.434872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2277,"ondisk_log_size":2277,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1570,"num_read_kb":1364,"num_write":587,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1364,"ondisk_log_size":1364,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1618,"num_read_kb":1508,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":4858752,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":143,"num_read_kb":87,"num_write":314,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":81,"ondisk_log_size":81,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640310,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39988,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331852,"statfs":{"total":96636764160,"available":96595816448,"internally_reserved":0,"allocated":491520,"data_stored":155427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640310,"num_pgs":155,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36368,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335472,"statfs":{"total":96636764160,"available":96599523328,"internally_reserved":0,"allocated":1044480,"data_stored":743705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673014,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40500,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331340,"statfs":{"total":96636764160,"available":96595292160,"internally_reserved":0,"allocated":1019904,"data_stored":743361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705715,"num_pgs":170,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48356,"kb_used_data":8852,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323484,"statfs":{"total":96636764160,"available":96587247616,"internally_reserved":0,"allocated":9064448,"data_stored":8760119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T06:13:25.813 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.813 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.813 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.813 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.813 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.814 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.814 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.814 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.814 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.814 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.814 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.814 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.814 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.814 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.815 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.815 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.815 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.815 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.815 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.815 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.815 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.815 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.815 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.816 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.816 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.816 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.816 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.816 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.816 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.816 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.816 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.817 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-13T06:09:35.087004+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=35, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.817 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-13T06:09:37.110448+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=37, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.817 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-13T06:09:39.124182+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=39, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.817 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.817 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.817 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.817 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-13T06:09:35.087004+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=35, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.817 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-13T06:09:37.110448+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=37, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.818 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-13T06:09:39.124182+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=39, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.818 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.818 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.818 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.818 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-13T06:09:35.087004+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=35, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.818 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-13T06:09:37.110448+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=37, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.818 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-13T06:09:39.124182+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=39, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.818 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.818 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.819 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.819 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-13T06:09:35.087004+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=35, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.819 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-13T06:09:37.110448+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=37, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.819 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-13T06:09:39.124182+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=39, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.819 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.819 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.819 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-13T06:09:35.087004+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=35, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.819 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-13T06:09:37.110448+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=37, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.819 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-13T06:09:39.124182+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=39, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.819 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.820 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.820 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.820 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-13T06:09:35.087004+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=35, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.820 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-13T06:09:37.110448+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=37, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.820 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-13T06:09:39.124182+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=39, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.820 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.820 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.820 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.820 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-13T06:09:35.087004+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=35, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.821 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-13T06:09:37.110448+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=37, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.821 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-13T06:09:39.124182+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=39, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.821 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.821 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.821 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.821 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-13T06:09:35.087004+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=35, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.821 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-13T06:09:37.110448+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=37, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.821 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-13T06:09:39.124182+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=39, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.821 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.822 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.822 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.822 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-13T06:09:35.087004+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=35, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.822 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-13T06:09:37.110448+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=37, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.822 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-13T06:09:39.124182+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=39, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.822 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.822 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.822 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.822 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-13T06:09:35.087004+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=35, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.822 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-13T06:09:37.110448+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=37, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.823 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-13T06:09:39.124182+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=39, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.823 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.823 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.823 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.823 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-13T06:09:35.087004+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=35, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.823 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-13T06:09:37.110448+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=37, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.823 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-13T06:09:39.124182+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=39, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.823 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.823 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.824 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.824 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-13T06:09:35.087004+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=35, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.824 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-13T06:09:37.110448+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=37, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.824 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-13T06:09:39.124182+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=39, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.824 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.824 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.824 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-13T06:09:18.163598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.824 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-13T06:09:21.188659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.825 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.825 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-13T06:09:35.087004+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=35, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.825 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-13T06:09:37.110448+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=37, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.825 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-13T06:09:39.124182+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=39, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.825 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.825 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.825 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-13T06:09:21.188659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.825 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.825 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-13T06:09:35.087004+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=35, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.825 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-13T06:09:37.110448+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=37, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.826 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-13T06:09:39.124182+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=39, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.826 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.826 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.826 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-13T06:09:21.188659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.826 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.826 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-13T06:09:35.087004+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=35, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.826 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-13T06:09:37.110448+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=37, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.826 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-13T06:09:39.124182+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=39, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.826 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.826 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.827 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-13T06:09:21.188659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.827 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.827 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-13T06:09:35.087004+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=35, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.827 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-13T06:09:37.110448+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=37, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.827 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-13T06:09:39.124182+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=39, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.827 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.827 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.827 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.827 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-13T06:09:21.188659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.828 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-13T06:09:35.087004+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=35, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.828 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-13T06:09:37.110448+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=37, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.828 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-13T06:09:39.124182+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=39, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.828 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.828 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.828 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.828 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-13T06:09:21.188659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.828 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-13T06:09:35.087004+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=35, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.829 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-13T06:09:37.110448+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=37, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.829 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-13T06:09:39.124182+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=39, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.829 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.829 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.829 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.829 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-13T06:09:21.188659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.829 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-13T06:09:35.087004+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=35, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.829 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-13T06:09:37.110448+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=37, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.829 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-13T06:09:39.124182+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=39, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.830 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.830 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.830 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.830 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-13T06:09:21.188659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.830 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-13T06:09:35.087004+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=35, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.830 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-13T06:09:37.110448+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=37, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.830 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-13T06:09:39.124182+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=39, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.830 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.830 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.831 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.831 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.831 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-13T06:09:35.087004+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=35, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.831 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-13T06:09:37.110448+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=37, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.831 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-13T06:09:39.124182+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=39, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.831 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.831 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.831 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.831 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-13T06:09:35.087004+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=35, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.832 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-13T06:09:37.110448+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=37, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.832 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-13T06:09:39.124182+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=39, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.832 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.832 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.832 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.832 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-13T06:09:35.087004+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=35, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.832 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-13T06:09:37.110448+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=37, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.832 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-13T06:09:39.124182+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=39, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.833 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.833 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.833 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.833 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-13T06:09:35.087004+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=35, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.833 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-13T06:09:37.110448+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=37, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.833 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-13T06:09:39.124182+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=39, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.833 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.833 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.833 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-13T06:09:35.087004+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=35, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.834 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-13T06:09:37.110448+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=37, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.834 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-13T06:09:39.124182+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=39, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.834 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.834 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.834 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.834 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-13T06:09:35.087004+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=35, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.834 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-13T06:09:37.110448+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=37, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.834 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-13T06:09:39.124182+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=39, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.834 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.835 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.835 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.835 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-13T06:09:35.087004+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=35, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.835 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-13T06:09:37.110448+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=37, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.835 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-13T06:09:39.124182+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=39, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.835 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.835 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.835 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.835 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-13T06:09:35.087004+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=35, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.835 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-13T06:09:37.110448+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=37, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.836 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-13T06:09:39.124182+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=39, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.836 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.836 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.836 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.836 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-13T06:09:35.087004+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=35, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.836 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-13T06:09:37.110448+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=37, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.836 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-13T06:09:39.124182+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=39, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.836 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.837 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.837 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.837 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-13T06:09:35.087004+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=35, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.837 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-13T06:09:37.110448+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=37, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.837 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-13T06:09:39.124182+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=39, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.837 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.837 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.837 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.837 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-13T06:09:35.087004+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=35, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.838 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-13T06:09:37.110448+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=37, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.838 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-13T06:09:39.124182+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=39, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.838 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.838 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.838 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.838 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-13T06:09:35.087004+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=35, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.838 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-13T06:09:37.110448+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=37, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.838 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-13T06:09:39.124182+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=39, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.838 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.839 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.839 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.839 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.839 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.839 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.839 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.839 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.839 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.839 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.839 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.840 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.840 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.840 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.840 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.840 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.840 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.840 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.840 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.840 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.841 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.841 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.841 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.841 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.841 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.841 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.841 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.841 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.841 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.841 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.842 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.842 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.842 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.842 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.842 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.842 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.842 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:25.842 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T06:13:45.843 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T06:13:45.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:45.972+0000 7f7fbb16b640 1 Processor -- start 2024-09-13T06:13:45.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:45.972+0000 7f7fbb16b640 1 -- start start 2024-09-13T06:13:45.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:45.972+0000 7f7fbb16b640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f7fb406d0e0 0x7f7fb406d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:13:45.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:45.972+0000 7f7fbb16b640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fb4071c10 con 0x7f7fb406da00 2024-09-13T06:13:45.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:45.972+0000 7f7fbb16b640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f7fb4072230 con 0x7f7fb406d0e0 2024-09-13T06:13:45.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:45.972+0000 7f7fb8f07640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f7fb406d0e0 0x7f7fb406d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:13:45.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:45.972+0000 7f7fb3fff640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f7fb406da00 0x7f7fb412ca10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:55206/0 (socket says 172.21.15.120:55206) 2024-09-13T06:13:45.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:45.972+0000 7f7fb3fff640 1 -- 172.21.15.120:0/3877996232 learned_addr learned my addr 172.21.15.120:0/3877996232 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-13T06:13:45.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:45.972+0000 7f7fb37fe640 1 -- 172.21.15.120:0/3877996232 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1613378126 0 0) 0x7f7fb4071c10 con 0x7f7fb406da00 2024-09-13T06:13:45.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:45.972+0000 7f7fb37fe640 1 -- 172.21.15.120:0/3877996232 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7fa0003530 con 0x7f7fb406da00 2024-09-13T06:13:45.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:45.972+0000 7f7fb8f07640 1 -- 172.21.15.120:0/3877996232 >> v1:172.21.15.120:6789/0 conn(0x7f7fb406da00 legacy=0x7f7fb412ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:45.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:45.972+0000 7f7fb8f07640 1 -- 172.21.15.120:0/3877996232 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fb40709e0 con 0x7f7fb406d0e0 2024-09-13T06:13:45.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:45.976+0000 7f7fb8f07640 1 --2- 172.21.15.120:0/3877996232 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7fb406d0e0 0x7f7fb406d4c0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f7fac009d90 tx=0x7f7fac01c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25cb35a8e933a7eb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:13:45.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:45.976+0000 7f7fb37fe640 1 -- 172.21.15.120:0/3877996232 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fac0a6560 con 0x7f7fb406d0e0 2024-09-13T06:13:45.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:45.976+0000 7f7fb37fe640 1 -- 172.21.15.120:0/3877996232 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fac0a6700 con 0x7f7fb406d0e0 2024-09-13T06:13:45.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:45.976+0000 7f7fb37fe640 1 -- 172.21.15.120:0/3877996232 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fac0a69e0 con 0x7f7fb406d0e0 2024-09-13T06:13:45.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:45.976+0000 7f7fbb16b640 1 -- 172.21.15.120:0/3877996232 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7fb406d0e0 msgr2=0x7f7fb406d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:45.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:45.976+0000 7f7fbb16b640 1 --2- 172.21.15.120:0/3877996232 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7fb406d0e0 0x7f7fb406d4c0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f7fac009d90 tx=0x7f7fac01c8c0 comp rx=0 tx=0).stop 2024-09-13T06:13:45.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:45.976+0000 7f7fbb16b640 1 -- 172.21.15.120:0/3877996232 shutdown_connections 2024-09-13T06:13:45.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:45.976+0000 7f7fbb16b640 1 --2- 172.21.15.120:0/3877996232 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7fb406d0e0 0x7f7fb406d4c0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:13:45.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:45.976+0000 7f7fbb16b640 1 -- 172.21.15.120:0/3877996232 >> 172.21.15.120:0/3877996232 conn(0x7f7fb4099a50 msgr2=0x7f7fb40972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:13:45.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:45.976+0000 7f7fbb16b640 1 -- 172.21.15.120:0/3877996232 shutdown_connections 2024-09-13T06:13:45.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:45.976+0000 7f7fbb16b640 1 -- 172.21.15.120:0/3877996232 wait complete. 2024-09-13T06:13:45.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:45.976+0000 7f7fbb16b640 1 Processor -- start 2024-09-13T06:13:45.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:45.976+0000 7f7fbb16b640 1 -- start start 2024-09-13T06:13:45.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:45.976+0000 7f7fbb16b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7fb406d0e0 0x7f7fb4127960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:13:45.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:45.976+0000 7f7fbb16b640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb4134e80 con 0x7f7fb406d0e0 2024-09-13T06:13:45.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:45.976+0000 7f7fb8f07640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7fb406d0e0 0x7f7fb4127960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:13:45.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:45.976+0000 7f7fb8f07640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7fb406d0e0 0x7f7fb4127960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34266/0 (socket says 172.21.15.120:34266) 2024-09-13T06:13:45.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:45.976+0000 7f7fb8f07640 1 -- 172.21.15.120:0/2184860587 learned_addr learned my addr 172.21.15.120:0/2184860587 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-13T06:13:45.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:45.976+0000 7f7fb8f07640 1 -- 172.21.15.120:0/2184860587 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fb4129600 con 0x7f7fb406d0e0 2024-09-13T06:13:45.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:45.976+0000 7f7fb8f07640 1 --2- 172.21.15.120:0/2184860587 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7fb406d0e0 0x7f7fb4127960 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f7fac01a4f0 tx=0x7f7fac019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:13:45.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:45.976+0000 7f7fb17fa640 1 -- 172.21.15.120:0/2184860587 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fac0c0070 con 0x7f7fb406d0e0 2024-09-13T06:13:45.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:45.976+0000 7f7fbb16b640 1 -- 172.21.15.120:0/2184860587 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fb412ae40 con 0x7f7fb406d0e0 2024-09-13T06:13:45.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:45.976+0000 7f7fb17fa640 1 -- 172.21.15.120:0/2184860587 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fac0a69e0 con 0x7f7fb406d0e0 2024-09-13T06:13:45.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:45.976+0000 7f7fb17fa640 1 -- 172.21.15.120:0/2184860587 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fac0a6cc0 con 0x7f7fb406d0e0 2024-09-13T06:13:45.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:45.976+0000 7f7fbb16b640 1 -- 172.21.15.120:0/2184860587 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fb4128070 con 0x7f7fb406d0e0 2024-09-13T06:13:45.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:45.980+0000 7f7fbb16b640 1 -- 172.21.15.120:0/2184860587 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fb4129dd0 con 0x7f7fb406d0e0 2024-09-13T06:13:45.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:45.980+0000 7f7fb17fa640 1 -- 172.21.15.120:0/2184860587 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7fac0c3070 con 0x7f7fb406d0e0 2024-09-13T06:13:45.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:45.980+0000 7f7fb17fa640 1 --2- 172.21.15.120:0/2184860587 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7f94035d60 0x7f7f94038220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:13:45.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:45.980+0000 7f7fb17fa640 1 -- 172.21.15.120:0/2184860587 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f7fac0b8070 con 0x7f7fb406d0e0 2024-09-13T06:13:45.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:45.980+0000 7f7fb3fff640 1 --2- 172.21.15.120:0/2184860587 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7f94035d60 0x7f7f94038220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:13:45.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:45.980+0000 7f7fb3fff640 1 --2- 172.21.15.120:0/2184860587 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7f94035d60 0x7f7f94038220 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c000f70 tx=0x7f7f9c0010b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:13:45.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:45.984+0000 7f7fb17fa640 1 -- 172.21.15.120:0/2184860587 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7fac0ac030 con 0x7f7fb406d0e0 2024-09-13T06:13:46.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:46.144+0000 7f7fbb16b640 1 -- 172.21.15.120:0/2184860587 --> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7fb4072710 con 0x7f7f94035d60 2024-09-13T06:13:46.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:46.192+0000 7f7fb17fa640 1 -- 172.21.15.120:0/2184860587 <== mgr.4100 v2:172.21.15.194:6824/3475680902 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+659086 (secure 0 0 0) 0x7f7f9c0058e0 con 0x7f7f94035d60 2024-09-13T06:13:46.202 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T06:13:46.209 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-09-13T06:13:46.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:46.204+0000 7f7fbb16b640 1 -- 172.21.15.120:0/2184860587 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7f94035d60 msgr2=0x7f7f94038220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:46.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:46.204+0000 7f7fbb16b640 1 --2- 172.21.15.120:0/2184860587 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7f94035d60 0x7f7f94038220 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c000f70 tx=0x7f7f9c0010b0 comp rx=0 tx=0).stop 2024-09-13T06:13:46.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:46.204+0000 7f7fbb16b640 1 -- 172.21.15.120:0/2184860587 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7fb406d0e0 msgr2=0x7f7fb4127960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:13:46.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:46.204+0000 7f7fbb16b640 1 --2- 172.21.15.120:0/2184860587 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7fb406d0e0 0x7f7fb4127960 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f7fac01a4f0 tx=0x7f7fac019660 comp rx=0 tx=0).stop 2024-09-13T06:13:46.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:46.204+0000 7f7fbb16b640 1 -- 172.21.15.120:0/2184860587 shutdown_connections 2024-09-13T06:13:46.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:46.204+0000 7f7fbb16b640 1 --2- 172.21.15.120:0/2184860587 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f7f94035d60 0x7f7f94038220 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:13:46.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:46.204+0000 7f7fbb16b640 1 --2- 172.21.15.120:0/2184860587 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7fb406d0e0 0x7f7fb4127960 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:13:46.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:46.204+0000 7f7fbb16b640 1 -- 172.21.15.120:0/2184860587 >> 172.21.15.120:0/2184860587 conn(0x7f7fb4099a50 msgr2=0x7f7fb4131be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:13:46.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:46.204+0000 7f7fbb16b640 1 -- 172.21.15.120:0/2184860587 shutdown_connections 2024-09-13T06:13:46.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:13:46.204+0000 7f7fbb16b640 1 -- 172.21.15.120:0/2184860587 wait complete. 2024-09-13T06:13:46.222 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":167,"stamp":"2024-09-13T06:13:45.832548+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605402,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5108,"num_read_kb":4689,"num_write":2181,"num_write_kb":61376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2342,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4736,"ondisk_log_size":4736,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":160960,"kb_used_data":2944,"kb_used_omap":6,"kb_used_meta":157945,"kb_avail":377326400,"statfs":{"total":386547056640,"available":386382233600,"internally_reserved":0,"allocated":3014656,"data_stored":1796916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":161736470},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1204,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007265"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:24.972275+0000","last_change":"2024-09-13T06:09:32.142010+0000","last_active":"2024-09-13T06:13:24.972275+0000","last_peered":"2024-09-13T06:13:24.972275+0000","last_clean":"2024-09-13T06:13:24.972275+0000","last_became_active":"2024-09-13T06:09:32.140025+0000","last_became_peered":"2024-09-13T06:09:32.140025+0000","last_unstale":"2024-09-13T06:13:24.972275+0000","last_undegraded":"2024-09-13T06:13:24.972275+0000","last_fullsized":"2024-09-13T06:13:24.972275+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"35'22","reported_seq":95,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.342981+0000","last_change":"2024-09-13T06:09:34.126675+0000","last_active":"2024-09-13T06:12:49.342981+0000","last_peered":"2024-09-13T06:12:49.342981+0000","last_clean":"2024-09-13T06:12:49.342981+0000","last_became_active":"2024-09-13T06:09:34.122656+0000","last_became_peered":"2024-09-13T06:09:34.122656+0000","last_unstale":"2024-09-13T06:12:49.342981+0000","last_undegraded":"2024-09-13T06:12:49.342981+0000","last_fullsized":"2024-09-13T06:12:49.342981+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":88,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"35'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:24.055361+0000","last_change":"2024-09-13T06:09:32.135771+0000","last_active":"2024-09-13T06:13:24.055361+0000","last_peered":"2024-09-13T06:13:24.055361+0000","last_clean":"2024-09-13T06:13:24.055361+0000","last_became_active":"2024-09-13T06:09:32.134020+0000","last_became_peered":"2024-09-13T06:09:32.134020+0000","last_unstale":"2024-09-13T06:13:24.055361+0000","last_undegraded":"2024-09-13T06:13:24.055361+0000","last_fullsized":"2024-09-13T06:13:24.055361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"35'4","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:07.813336+0000","last_change":"2024-09-13T06:09:34.117071+0000","last_active":"2024-09-13T06:12:07.813336+0000","last_peered":"2024-09-13T06:12:07.813336+0000","last_clean":"2024-09-13T06:12:07.813336+0000","last_became_active":"2024-09-13T06:09:34.116715+0000","last_became_peered":"2024-09-13T06:09:34.116715+0000","last_unstale":"2024-09-13T06:12:07.813336+0000","last_undegraded":"2024-09-13T06:12:07.813336+0000","last_fullsized":"2024-09-13T06:12:07.813336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.441189+0000","last_change":"2024-09-13T06:09:32.130525+0000","last_active":"2024-09-13T06:13:25.441189+0000","last_peered":"2024-09-13T06:13:25.441189+0000","last_clean":"2024-09-13T06:13:25.441189+0000","last_became_active":"2024-09-13T06:09:32.116345+0000","last_became_peered":"2024-09-13T06:09:32.116345+0000","last_unstale":"2024-09-13T06:13:25.441189+0000","last_undegraded":"2024-09-13T06:13:25.441189+0000","last_fullsized":"2024-09-13T06:13:25.441189+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:07.813417+0000","last_change":"2024-09-13T06:09:34.118858+0000","last_active":"2024-09-13T06:12:07.813417+0000","last_peered":"2024-09-13T06:12:07.813417+0000","last_clean":"2024-09-13T06:12:07.813417+0000","last_became_active":"2024-09-13T06:09:34.117940+0000","last_became_peered":"2024-09-13T06:09:34.117940+0000","last_unstale":"2024-09-13T06:12:07.813417+0000","last_undegraded":"2024-09-13T06:12:07.813417+0000","last_fullsized":"2024-09-13T06:12:07.813417+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"35'4","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:24.972231+0000","last_change":"2024-09-13T06:09:32.120391+0000","last_active":"2024-09-13T06:13:24.972231+0000","last_peered":"2024-09-13T06:13:24.972231+0000","last_clean":"2024-09-13T06:13:24.972231+0000","last_became_active":"2024-09-13T06:09:32.119806+0000","last_became_peered":"2024-09-13T06:09:32.119806+0000","last_unstale":"2024-09-13T06:13:24.972231+0000","last_undegraded":"2024-09-13T06:13:24.972231+0000","last_fullsized":"2024-09-13T06:13:24.972231+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"35'4","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.131043+0000","last_change":"2024-09-13T06:09:34.123442+0000","last_active":"2024-09-13T06:12:49.131043+0000","last_peered":"2024-09-13T06:12:49.131043+0000","last_clean":"2024-09-13T06:12:49.131043+0000","last_became_active":"2024-09-13T06:09:34.122631+0000","last_became_peered":"2024-09-13T06:09:34.122631+0000","last_unstale":"2024-09-13T06:12:49.131043+0000","last_undegraded":"2024-09-13T06:12:49.131043+0000","last_fullsized":"2024-09-13T06:12:49.131043+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:02.812029+0000","last_change":"2024-09-13T06:09:32.129860+0000","last_active":"2024-09-13T06:12:02.812029+0000","last_peered":"2024-09-13T06:12:02.812029+0000","last_clean":"2024-09-13T06:12:02.812029+0000","last_became_active":"2024-09-13T06:09:32.121803+0000","last_became_peered":"2024-09-13T06:09:32.121803+0000","last_unstale":"2024-09-13T06:12:02.812029+0000","last_undegraded":"2024-09-13T06:12:02.812029+0000","last_fullsized":"2024-09-13T06:12:02.812029+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"35'4","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:24.520773+0000","last_change":"2024-09-13T06:09:34.127392+0000","last_active":"2024-09-13T06:13:24.520773+0000","last_peered":"2024-09-13T06:13:24.520773+0000","last_clean":"2024-09-13T06:13:24.520773+0000","last_became_active":"2024-09-13T06:09:34.124728+0000","last_became_peered":"2024-09-13T06:09:34.124728+0000","last_unstale":"2024-09-13T06:13:24.520773+0000","last_undegraded":"2024-09-13T06:13:24.520773+0000","last_fullsized":"2024-09-13T06:13:24.520773+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"35'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.307732+0000","last_change":"2024-09-13T06:09:32.117055+0000","last_active":"2024-09-13T06:12:49.307732+0000","last_peered":"2024-09-13T06:12:49.307732+0000","last_clean":"2024-09-13T06:12:49.307732+0000","last_became_active":"2024-09-13T06:09:32.116422+0000","last_became_peered":"2024-09-13T06:09:32.116422+0000","last_unstale":"2024-09-13T06:12:49.307732+0000","last_undegraded":"2024-09-13T06:12:49.307732+0000","last_fullsized":"2024-09-13T06:12:49.307732+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"35'4","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.531504+0000","last_change":"2024-09-13T06:10:10.823960+0000","last_active":"2024-09-13T06:12:49.531504+0000","last_peered":"2024-09-13T06:12:49.531504+0000","last_clean":"2024-09-13T06:12:49.531504+0000","last_became_active":"2024-09-13T06:10:10.810259+0000","last_became_peered":"2024-09-13T06:10:10.810259+0000","last_unstale":"2024-09-13T06:12:49.531504+0000","last_undegraded":"2024-09-13T06:12:49.531504+0000","last_fullsized":"2024-09-13T06:12:49.531504+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"35'4","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:02.811881+0000","last_change":"2024-09-13T06:09:32.130200+0000","last_active":"2024-09-13T06:12:02.811881+0000","last_peered":"2024-09-13T06:12:02.811881+0000","last_clean":"2024-09-13T06:12:02.811881+0000","last_became_active":"2024-09-13T06:09:32.122126+0000","last_became_peered":"2024-09-13T06:09:32.122126+0000","last_unstale":"2024-09-13T06:12:02.811881+0000","last_undegraded":"2024-09-13T06:12:02.811881+0000","last_fullsized":"2024-09-13T06:12:02.811881+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"35'10","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.453329+0000","last_change":"2024-09-13T06:09:34.120695+0000","last_active":"2024-09-13T06:12:49.453329+0000","last_peered":"2024-09-13T06:12:49.453329+0000","last_clean":"2024-09-13T06:12:49.453329+0000","last_became_active":"2024-09-13T06:09:34.120349+0000","last_became_peered":"2024-09-13T06:09:34.120349+0000","last_unstale":"2024-09-13T06:12:49.453329+0000","last_undegraded":"2024-09-13T06:12:49.453329+0000","last_fullsized":"2024-09-13T06:12:49.453329+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:05.803447+0000","last_change":"2024-09-13T06:09:32.149245+0000","last_active":"2024-09-13T06:12:05.803447+0000","last_peered":"2024-09-13T06:12:05.803447+0000","last_clean":"2024-09-13T06:12:05.803447+0000","last_became_active":"2024-09-13T06:09:32.147504+0000","last_became_peered":"2024-09-13T06:09:32.147504+0000","last_unstale":"2024-09-13T06:12:05.803447+0000","last_undegraded":"2024-09-13T06:12:05.803447+0000","last_fullsized":"2024-09-13T06:12:05.803447+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"35'9","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.664077+0000","last_change":"2024-09-13T06:09:34.104380+0000","last_active":"2024-09-13T06:12:49.664077+0000","last_peered":"2024-09-13T06:12:49.664077+0000","last_clean":"2024-09-13T06:12:49.664077+0000","last_became_active":"2024-09-13T06:09:34.104043+0000","last_became_peered":"2024-09-13T06:09:34.104043+0000","last_unstale":"2024-09-13T06:12:49.664077+0000","last_undegraded":"2024-09-13T06:12:49.664077+0000","last_fullsized":"2024-09-13T06:12:49.664077+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"35'4","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.533595+0000","last_change":"2024-09-13T06:09:34.116800+0000","last_active":"2024-09-13T06:12:49.533595+0000","last_peered":"2024-09-13T06:12:49.533595+0000","last_clean":"2024-09-13T06:12:49.533595+0000","last_became_active":"2024-09-13T06:09:34.116359+0000","last_became_peered":"2024-09-13T06:09:34.116359+0000","last_unstale":"2024-09-13T06:12:49.533595+0000","last_undegraded":"2024-09-13T06:12:49.533595+0000","last_fullsized":"2024-09-13T06:12:49.533595+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"35'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.290271+0000","last_change":"2024-09-13T06:09:32.135469+0000","last_active":"2024-09-13T06:12:49.290271+0000","last_peered":"2024-09-13T06:12:49.290271+0000","last_clean":"2024-09-13T06:12:49.290271+0000","last_became_active":"2024-09-13T06:09:32.134667+0000","last_became_peered":"2024-09-13T06:09:32.134667+0000","last_unstale":"2024-09-13T06:12:49.290271+0000","last_undegraded":"2024-09-13T06:12:49.290271+0000","last_fullsized":"2024-09-13T06:12:49.290271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"35'18","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.454864+0000","last_change":"2024-09-13T06:09:34.118112+0000","last_active":"2024-09-13T06:12:49.454864+0000","last_peered":"2024-09-13T06:12:49.454864+0000","last_clean":"2024-09-13T06:12:49.454864+0000","last_became_active":"2024-09-13T06:09:34.115348+0000","last_became_peered":"2024-09-13T06:09:34.115348+0000","last_unstale":"2024-09-13T06:12:49.454864+0000","last_undegraded":"2024-09-13T06:12:49.454864+0000","last_fullsized":"2024-09-13T06:12:49.454864+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":45,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:56.801034+0000","last_change":"2024-09-13T06:09:32.137039+0000","last_active":"2024-09-13T06:11:56.801034+0000","last_peered":"2024-09-13T06:11:56.801034+0000","last_clean":"2024-09-13T06:11:56.801034+0000","last_became_active":"2024-09-13T06:09:32.135460+0000","last_became_peered":"2024-09-13T06:09:32.135460+0000","last_unstale":"2024-09-13T06:11:56.801034+0000","last_undegraded":"2024-09-13T06:11:56.801034+0000","last_fullsized":"2024-09-13T06:11:56.801034+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"35'2","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:57.805709+0000","last_change":"2024-09-13T06:09:34.115425+0000","last_active":"2024-09-13T06:11:57.805709+0000","last_peered":"2024-09-13T06:11:57.805709+0000","last_clean":"2024-09-13T06:11:57.805709+0000","last_became_active":"2024-09-13T06:09:34.115047+0000","last_became_peered":"2024-09-13T06:09:34.115047+0000","last_unstale":"2024-09-13T06:11:57.805709+0000","last_undegraded":"2024-09-13T06:11:57.805709+0000","last_fullsized":"2024-09-13T06:11:57.805709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:57.805845+0000","last_change":"2024-09-13T06:09:32.143123+0000","last_active":"2024-09-13T06:11:57.805845+0000","last_peered":"2024-09-13T06:11:57.805845+0000","last_clean":"2024-09-13T06:11:57.805845+0000","last_became_active":"2024-09-13T06:09:32.141166+0000","last_became_peered":"2024-09-13T06:09:32.141166+0000","last_unstale":"2024-09-13T06:11:57.805845+0000","last_undegraded":"2024-09-13T06:11:57.805845+0000","last_fullsized":"2024-09-13T06:11:57.805845+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"35'4","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.451554+0000","last_change":"2024-09-13T06:09:34.116108+0000","last_active":"2024-09-13T06:12:49.451554+0000","last_peered":"2024-09-13T06:12:49.451554+0000","last_clean":"2024-09-13T06:12:49.451554+0000","last_became_active":"2024-09-13T06:09:34.114242+0000","last_became_peered":"2024-09-13T06:09:34.114242+0000","last_unstale":"2024-09-13T06:12:49.451554+0000","last_undegraded":"2024-09-13T06:12:49.451554+0000","last_fullsized":"2024-09-13T06:12:49.451554+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:57.805776+0000","last_change":"2024-09-13T06:09:32.144134+0000","last_active":"2024-09-13T06:11:57.805776+0000","last_peered":"2024-09-13T06:11:57.805776+0000","last_clean":"2024-09-13T06:11:57.805776+0000","last_became_active":"2024-09-13T06:09:32.143746+0000","last_became_peered":"2024-09-13T06:09:32.143746+0000","last_unstale":"2024-09-13T06:11:57.805776+0000","last_undegraded":"2024-09-13T06:11:57.805776+0000","last_fullsized":"2024-09-13T06:11:57.805776+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"35'8","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.533142+0000","last_change":"2024-09-13T06:09:34.101552+0000","last_active":"2024-09-13T06:12:49.533142+0000","last_peered":"2024-09-13T06:12:49.533142+0000","last_clean":"2024-09-13T06:12:49.533142+0000","last_became_active":"2024-09-13T06:09:34.101167+0000","last_became_peered":"2024-09-13T06:09:34.101167+0000","last_unstale":"2024-09-13T06:12:49.533142+0000","last_undegraded":"2024-09-13T06:12:49.533142+0000","last_fullsized":"2024-09-13T06:12:49.533142+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:00.802308+0000","last_change":"2024-09-13T06:09:32.153552+0000","last_active":"2024-09-13T06:12:00.802308+0000","last_peered":"2024-09-13T06:12:00.802308+0000","last_clean":"2024-09-13T06:12:00.802308+0000","last_became_active":"2024-09-13T06:09:32.149885+0000","last_became_peered":"2024-09-13T06:09:32.149885+0000","last_unstale":"2024-09-13T06:12:00.802308+0000","last_undegraded":"2024-09-13T06:12:00.802308+0000","last_fullsized":"2024-09-13T06:12:00.802308+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"35'14","reported_seq":66,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.454501+0000","last_change":"2024-09-13T06:09:34.127656+0000","last_active":"2024-09-13T06:12:49.454501+0000","last_peered":"2024-09-13T06:12:49.454501+0000","last_clean":"2024-09-13T06:12:49.454501+0000","last_became_active":"2024-09-13T06:09:34.124299+0000","last_became_peered":"2024-09-13T06:09:34.124299+0000","last_unstale":"2024-09-13T06:12:49.454501+0000","last_undegraded":"2024-09-13T06:12:49.454501+0000","last_fullsized":"2024-09-13T06:12:49.454501+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:52.809195+0000","last_change":"2024-09-13T06:09:32.141692+0000","last_active":"2024-09-13T06:11:52.809195+0000","last_peered":"2024-09-13T06:11:52.809195+0000","last_clean":"2024-09-13T06:11:52.809195+0000","last_became_active":"2024-09-13T06:09:32.128376+0000","last_became_peered":"2024-09-13T06:09:32.128376+0000","last_unstale":"2024-09-13T06:11:52.809195+0000","last_undegraded":"2024-09-13T06:11:52.809195+0000","last_fullsized":"2024-09-13T06:11:52.809195+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"35'43","reported_seq":125,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.556471+0000","last_change":"2024-09-13T06:09:42.187344+0000","last_active":"2024-09-13T06:12:49.556471+0000","last_peered":"2024-09-13T06:12:49.556471+0000","last_clean":"2024-09-13T06:12:49.556471+0000","last_became_active":"2024-09-13T06:09:42.186091+0000","last_became_peered":"2024-09-13T06:09:42.186091+0000","last_unstale":"2024-09-13T06:12:49.556471+0000","last_undegraded":"2024-09-13T06:12:49.556471+0000","last_fullsized":"2024-09-13T06:12:49.556471+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":246,"num_read_kb":228,"num_write":124,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"35'16","reported_seq":107,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:48.979744+0000","last_change":"2024-09-13T06:09:34.118780+0000","last_active":"2024-09-13T06:12:48.979744+0000","last_peered":"2024-09-13T06:12:48.979744+0000","last_clean":"2024-09-13T06:12:48.979744+0000","last_became_active":"2024-09-13T06:09:34.118393+0000","last_became_peered":"2024-09-13T06:09:34.118393+0000","last_unstale":"2024-09-13T06:12:48.979744+0000","last_undegraded":"2024-09-13T06:12:48.979744+0000","last_fullsized":"2024-09-13T06:12:48.979744+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":90,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"35'6","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:52.809283+0000","last_change":"2024-09-13T06:09:32.139342+0000","last_active":"2024-09-13T06:11:52.809283+0000","last_peered":"2024-09-13T06:11:52.809283+0000","last_clean":"2024-09-13T06:11:52.809283+0000","last_became_active":"2024-09-13T06:09:32.133545+0000","last_became_peered":"2024-09-13T06:09:32.133545+0000","last_unstale":"2024-09-13T06:11:52.809283+0000","last_undegraded":"2024-09-13T06:11:52.809283+0000","last_fullsized":"2024-09-13T06:11:52.809283+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:26.893123+0000","last_change":"2024-09-13T06:13:26.893183+0000","last_active":"2024-09-13T06:13:26.893123+0000","last_peered":"2024-09-13T06:13:26.893123+0000","last_clean":"2024-09-13T06:13:26.893123+0000","last_became_active":"2024-09-13T06:09:36.153420+0000","last_became_peered":"2024-09-13T06:09:36.153420+0000","last_unstale":"2024-09-13T06:13:26.893123+0000","last_undegraded":"2024-09-13T06:13:26.893123+0000","last_fullsized":"2024-09-13T06:13:26.893123+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:26.892934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:26.892934+0000","last_clean_scrub_stamp":"2024-09-13T06:13:26.892934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:12:45.761321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"35'33","reported_seq":80,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:20.801321+0000","last_change":"2024-09-13T06:09:38.177058+0000","last_active":"2024-09-13T06:13:20.801321+0000","last_peered":"2024-09-13T06:13:20.801321+0000","last_clean":"2024-09-13T06:13:20.801321+0000","last_became_active":"2024-09-13T06:09:38.175393+0000","last_became_peered":"2024-09-13T06:09:38.175393+0000","last_unstale":"2024-09-13T06:13:20.801321+0000","last_undegraded":"2024-09-13T06:13:20.801321+0000","last_fullsized":"2024-09-13T06:13:20.801321+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:07.808263+0000","last_change":"2024-09-13T06:09:40.186286+0000","last_active":"2024-09-13T06:12:07.808263+0000","last_peered":"2024-09-13T06:12:07.808263+0000","last_clean":"2024-09-13T06:12:07.808263+0000","last_became_active":"2024-09-13T06:09:40.185574+0000","last_became_peered":"2024-09-13T06:09:40.185574+0000","last_unstale":"2024-09-13T06:12:07.808263+0000","last_undegraded":"2024-09-13T06:12:07.808263+0000","last_fullsized":"2024-09-13T06:12:07.808263+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"35'9","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:07.808057+0000","last_change":"2024-09-13T06:09:42.183906+0000","last_active":"2024-09-13T06:12:07.808057+0000","last_peered":"2024-09-13T06:12:07.808057+0000","last_clean":"2024-09-13T06:12:07.808057+0000","last_became_active":"2024-09-13T06:09:42.183162+0000","last_became_peered":"2024-09-13T06:09:42.183162+0000","last_unstale":"2024-09-13T06:12:07.808057+0000","last_undegraded":"2024-09-13T06:12:07.808057+0000","last_fullsized":"2024-09-13T06:12:07.808057+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":19,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"35'6","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.339992+0000","last_change":"2024-09-13T06:09:34.120990+0000","last_active":"2024-09-13T06:12:49.339992+0000","last_peered":"2024-09-13T06:12:49.339992+0000","last_clean":"2024-09-13T06:12:49.339992+0000","last_became_active":"2024-09-13T06:09:34.120600+0000","last_became_peered":"2024-09-13T06:09:34.120600+0000","last_unstale":"2024-09-13T06:12:49.339992+0000","last_undegraded":"2024-09-13T06:12:49.339992+0000","last_fullsized":"2024-09-13T06:12:49.339992+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:51.799661+0000","last_change":"2024-09-13T06:09:32.139993+0000","last_active":"2024-09-13T06:11:51.799661+0000","last_peered":"2024-09-13T06:11:51.799661+0000","last_clean":"2024-09-13T06:11:51.799661+0000","last_became_active":"2024-09-13T06:09:32.138643+0000","last_became_peered":"2024-09-13T06:09:32.138643+0000","last_unstale":"2024-09-13T06:11:51.799661+0000","last_undegraded":"2024-09-13T06:11:51.799661+0000","last_fullsized":"2024-09-13T06:11:51.799661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:41.236180+0000","last_change":"2024-09-13T06:13:41.236284+0000","last_active":"2024-09-13T06:13:41.236180+0000","last_peered":"2024-09-13T06:13:41.236180+0000","last_clean":"2024-09-13T06:13:41.236180+0000","last_became_active":"2024-09-13T06:09:36.139235+0000","last_became_peered":"2024-09-13T06:09:36.139235+0000","last_unstale":"2024-09-13T06:13:41.236180+0000","last_undegraded":"2024-09-13T06:13:41.236180+0000","last_fullsized":"2024-09-13T06:13:41.236180+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:41.235958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:41.235958+0000","last_clean_scrub_stamp":"2024-09-13T06:13:41.235958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:48:26.407496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"35'9","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:28.250353+0000","last_change":"2024-09-13T06:13:28.250424+0000","last_active":"2024-09-13T06:13:28.250353+0000","last_peered":"2024-09-13T06:13:28.250353+0000","last_clean":"2024-09-13T06:13:28.250353+0000","last_became_active":"2024-09-13T06:09:38.161539+0000","last_became_peered":"2024-09-13T06:09:38.161539+0000","last_unstale":"2024-09-13T06:13:28.250353+0000","last_undegraded":"2024-09-13T06:13:28.250353+0000","last_fullsized":"2024-09-13T06:13:28.250353+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'9","last_scrub_stamp":"2024-09-13T06:13:28.250177+0000","last_deep_scrub":"35'9","last_deep_scrub_stamp":"2024-09-13T06:13:28.250177+0000","last_clean_scrub_stamp":"2024-09-13T06:13:28.250177+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:10:57.549533+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:41.143373+0000","last_change":"2024-09-13T06:13:41.143426+0000","last_active":"2024-09-13T06:13:41.143373+0000","last_peered":"2024-09-13T06:13:41.143373+0000","last_clean":"2024-09-13T06:13:41.143373+0000","last_became_active":"2024-09-13T06:09:40.182436+0000","last_became_peered":"2024-09-13T06:09:40.182436+0000","last_unstale":"2024-09-13T06:13:41.143373+0000","last_undegraded":"2024-09-13T06:13:41.143373+0000","last_fullsized":"2024-09-13T06:13:41.143373+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:41.143167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:41.143167+0000","last_clean_scrub_stamp":"2024-09-13T06:13:41.143167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:15:32.092602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"33'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:15.805719+0000","last_change":"2024-09-13T06:09:42.209170+0000","last_active":"2024-09-13T06:12:15.805719+0000","last_peered":"2024-09-13T06:12:15.805719+0000","last_clean":"2024-09-13T06:12:15.805719+0000","last_became_active":"2024-09-13T06:09:42.208430+0000","last_became_peered":"2024-09-13T06:09:42.208430+0000","last_unstale":"2024-09-13T06:12:15.805719+0000","last_undegraded":"2024-09-13T06:12:15.805719+0000","last_fullsized":"2024-09-13T06:12:15.805719+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"35'6","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.340573+0000","last_change":"2024-09-13T06:09:34.123289+0000","last_active":"2024-09-13T06:12:49.340573+0000","last_peered":"2024-09-13T06:12:49.340573+0000","last_clean":"2024-09-13T06:12:49.340573+0000","last_became_active":"2024-09-13T06:09:34.122001+0000","last_became_peered":"2024-09-13T06:09:34.122001+0000","last_unstale":"2024-09-13T06:12:49.340573+0000","last_undegraded":"2024-09-13T06:12:49.340573+0000","last_fullsized":"2024-09-13T06:12:49.340573+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:20.953830+0000","last_change":"2024-09-13T06:09:32.132575+0000","last_active":"2024-09-13T06:13:20.953830+0000","last_peered":"2024-09-13T06:13:20.953830+0000","last_clean":"2024-09-13T06:13:20.953830+0000","last_became_active":"2024-09-13T06:09:32.129739+0000","last_became_peered":"2024-09-13T06:09:32.129739+0000","last_unstale":"2024-09-13T06:13:20.953830+0000","last_undegraded":"2024-09-13T06:13:20.953830+0000","last_fullsized":"2024-09-13T06:13:20.953830+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:39.268543+0000","last_change":"2024-09-13T06:13:39.268600+0000","last_active":"2024-09-13T06:13:39.268543+0000","last_peered":"2024-09-13T06:13:39.268543+0000","last_clean":"2024-09-13T06:13:39.268543+0000","last_became_active":"2024-09-13T06:09:36.143405+0000","last_became_peered":"2024-09-13T06:09:36.143405+0000","last_unstale":"2024-09-13T06:13:39.268543+0000","last_undegraded":"2024-09-13T06:13:39.268543+0000","last_fullsized":"2024-09-13T06:13:39.268543+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:39.268339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:39.268339+0000","last_clean_scrub_stamp":"2024-09-13T06:13:39.268339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:08:53.766496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"35'15","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:37.488221+0000","last_change":"2024-09-13T06:13:37.488304+0000","last_active":"2024-09-13T06:13:37.488221+0000","last_peered":"2024-09-13T06:13:37.488221+0000","last_clean":"2024-09-13T06:13:37.488221+0000","last_became_active":"2024-09-13T06:09:38.154654+0000","last_became_peered":"2024-09-13T06:09:38.154654+0000","last_unstale":"2024-09-13T06:13:37.488221+0000","last_undegraded":"2024-09-13T06:13:37.488221+0000","last_fullsized":"2024-09-13T06:13:37.488221+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'15","last_scrub_stamp":"2024-09-13T06:13:37.488029+0000","last_deep_scrub":"35'15","last_deep_scrub_stamp":"2024-09-13T06:13:37.488029+0000","last_clean_scrub_stamp":"2024-09-13T06:13:37.488029+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:59:42.866540+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"35'285","reported_seq":409,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:20.997705+0000","last_change":"2024-09-13T06:09:40.192039+0000","last_active":"2024-09-13T06:13:20.997705+0000","last_peered":"2024-09-13T06:13:20.997705+0000","last_clean":"2024-09-13T06:13:20.997705+0000","last_became_active":"2024-09-13T06:09:40.190377+0000","last_became_peered":"2024-09-13T06:09:40.190377+0000","last_unstale":"2024-09-13T06:13:20.997705+0000","last_undegraded":"2024-09-13T06:13:20.997705+0000","last_fullsized":"2024-09-13T06:13:20.997705+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:11.804232+0000","last_change":"2024-09-13T06:09:42.204612+0000","last_active":"2024-09-13T06:12:11.804232+0000","last_peered":"2024-09-13T06:12:11.804232+0000","last_clean":"2024-09-13T06:12:11.804232+0000","last_became_active":"2024-09-13T06:09:42.204083+0000","last_became_peered":"2024-09-13T06:09:42.204083+0000","last_unstale":"2024-09-13T06:12:11.804232+0000","last_undegraded":"2024-09-13T06:12:11.804232+0000","last_fullsized":"2024-09-13T06:12:11.804232+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"35'6","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:00.802542+0000","last_change":"2024-09-13T06:09:34.131719+0000","last_active":"2024-09-13T06:12:00.802542+0000","last_peered":"2024-09-13T06:12:00.802542+0000","last_clean":"2024-09-13T06:12:00.802542+0000","last_became_active":"2024-09-13T06:09:34.130815+0000","last_became_peered":"2024-09-13T06:09:34.130815+0000","last_unstale":"2024-09-13T06:12:00.802542+0000","last_undegraded":"2024-09-13T06:12:00.802542+0000","last_fullsized":"2024-09-13T06:12:00.802542+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:52.804083+0000","last_change":"2024-09-13T06:09:32.118707+0000","last_active":"2024-09-13T06:11:52.804083+0000","last_peered":"2024-09-13T06:11:52.804083+0000","last_clean":"2024-09-13T06:11:52.804083+0000","last_became_active":"2024-09-13T06:09:32.118278+0000","last_became_peered":"2024-09-13T06:09:32.118278+0000","last_unstale":"2024-09-13T06:11:52.804083+0000","last_undegraded":"2024-09-13T06:11:52.804083+0000","last_fullsized":"2024-09-13T06:11:52.804083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:02.812230+0000","last_change":"2024-09-13T06:10:10.825317+0000","last_active":"2024-09-13T06:12:02.812230+0000","last_peered":"2024-09-13T06:12:02.812230+0000","last_clean":"2024-09-13T06:12:02.812230+0000","last_became_active":"2024-09-13T06:10:10.824420+0000","last_became_peered":"2024-09-13T06:10:10.824420+0000","last_unstale":"2024-09-13T06:12:02.812230+0000","last_undegraded":"2024-09-13T06:12:02.812230+0000","last_fullsized":"2024-09-13T06:12:02.812230+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"35'37","reported_seq":92,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:35.449293+0000","last_change":"2024-09-13T06:13:35.449374+0000","last_active":"2024-09-13T06:13:35.449293+0000","last_peered":"2024-09-13T06:13:35.449293+0000","last_clean":"2024-09-13T06:13:35.449293+0000","last_became_active":"2024-09-13T06:09:38.157430+0000","last_became_peered":"2024-09-13T06:09:38.157430+0000","last_unstale":"2024-09-13T06:13:35.449293+0000","last_undegraded":"2024-09-13T06:13:35.449293+0000","last_fullsized":"2024-09-13T06:13:35.449293+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'37","last_scrub_stamp":"2024-09-13T06:13:35.449087+0000","last_deep_scrub":"35'37","last_deep_scrub_stamp":"2024-09-13T06:13:35.449087+0000","last_clean_scrub_stamp":"2024-09-13T06:13:35.449087+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:28:30.698850+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"35'285","reported_seq":448,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:26.281413+0000","last_change":"2024-09-13T06:13:26.281485+0000","last_active":"2024-09-13T06:13:26.281413+0000","last_peered":"2024-09-13T06:13:26.281413+0000","last_clean":"2024-09-13T06:13:26.281413+0000","last_became_active":"2024-09-13T06:09:40.175871+0000","last_became_peered":"2024-09-13T06:09:40.175871+0000","last_unstale":"2024-09-13T06:13:26.281413+0000","last_undegraded":"2024-09-13T06:13:26.281413+0000","last_fullsized":"2024-09-13T06:13:26.281413+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-13T06:13:26.281223+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-13T06:13:26.281223+0000","last_clean_scrub_stamp":"2024-09-13T06:13:26.281223+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:05:30.880244+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"35'2","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:47.807465+0000","last_change":"2024-09-13T06:09:34.127109+0000","last_active":"2024-09-13T06:11:47.807465+0000","last_peered":"2024-09-13T06:11:47.807465+0000","last_clean":"2024-09-13T06:11:47.807465+0000","last_became_active":"2024-09-13T06:09:34.126374+0000","last_became_peered":"2024-09-13T06:09:34.126374+0000","last_unstale":"2024-09-13T06:11:47.807465+0000","last_undegraded":"2024-09-13T06:11:47.807465+0000","last_fullsized":"2024-09-13T06:11:47.807465+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:46.798810+0000","last_change":"2024-09-13T06:09:32.131764+0000","last_active":"2024-09-13T06:11:46.798810+0000","last_peered":"2024-09-13T06:11:46.798810+0000","last_clean":"2024-09-13T06:11:46.798810+0000","last_became_active":"2024-09-13T06:09:32.131373+0000","last_became_peered":"2024-09-13T06:09:32.131373+0000","last_unstale":"2024-09-13T06:11:46.798810+0000","last_undegraded":"2024-09-13T06:11:46.798810+0000","last_fullsized":"2024-09-13T06:11:46.798810+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:38.094086+0000","last_change":"2024-09-13T06:13:38.094138+0000","last_active":"2024-09-13T06:13:38.094086+0000","last_peered":"2024-09-13T06:13:38.094086+0000","last_clean":"2024-09-13T06:13:38.094086+0000","last_became_active":"2024-09-13T06:09:36.137016+0000","last_became_peered":"2024-09-13T06:09:36.137016+0000","last_unstale":"2024-09-13T06:13:38.094086+0000","last_undegraded":"2024-09-13T06:13:38.094086+0000","last_fullsized":"2024-09-13T06:13:38.094086+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:38.093864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:38.093864+0000","last_clean_scrub_stamp":"2024-09-13T06:13:38.093864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:18:03.005466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"35'51","reported_seq":111,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:31.369657+0000","last_change":"2024-09-13T06:13:31.369768+0000","last_active":"2024-09-13T06:13:31.369657+0000","last_peered":"2024-09-13T06:13:31.369657+0000","last_clean":"2024-09-13T06:13:31.369657+0000","last_became_active":"2024-09-13T06:09:38.163472+0000","last_became_peered":"2024-09-13T06:09:38.163472+0000","last_unstale":"2024-09-13T06:13:31.369657+0000","last_undegraded":"2024-09-13T06:13:31.369657+0000","last_fullsized":"2024-09-13T06:13:31.369657+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'51","last_scrub_stamp":"2024-09-13T06:13:31.369476+0000","last_deep_scrub":"35'51","last_deep_scrub_stamp":"2024-09-13T06:13:31.369476+0000","last_clean_scrub_stamp":"2024-09-13T06:13:31.369476+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:44:16.358341+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:27.325548+0000","last_change":"2024-09-13T06:13:27.325602+0000","last_active":"2024-09-13T06:13:27.325548+0000","last_peered":"2024-09-13T06:13:27.325548+0000","last_clean":"2024-09-13T06:13:27.325548+0000","last_became_active":"2024-09-13T06:09:40.171609+0000","last_became_peered":"2024-09-13T06:09:40.171609+0000","last_unstale":"2024-09-13T06:13:27.325548+0000","last_undegraded":"2024-09-13T06:13:27.325548+0000","last_fullsized":"2024-09-13T06:13:27.325548+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:27.325358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:27.325358+0000","last_clean_scrub_stamp":"2024-09-13T06:13:27.325358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:15:24.519986+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"35'5","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.524548+0000","last_change":"2024-09-13T06:09:42.208317+0000","last_active":"2024-09-13T06:12:49.524548+0000","last_peered":"2024-09-13T06:12:49.524548+0000","last_clean":"2024-09-13T06:12:49.524548+0000","last_became_active":"2024-09-13T06:09:42.193426+0000","last_became_peered":"2024-09-13T06:09:42.193426+0000","last_unstale":"2024-09-13T06:12:49.524548+0000","last_undegraded":"2024-09-13T06:12:49.524548+0000","last_fullsized":"2024-09-13T06:12:49.524548+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"35'6","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.340573+0000","last_change":"2024-09-13T06:09:34.118017+0000","last_active":"2024-09-13T06:12:49.340573+0000","last_peered":"2024-09-13T06:12:49.340573+0000","last_clean":"2024-09-13T06:12:49.340573+0000","last_became_active":"2024-09-13T06:09:34.114999+0000","last_became_peered":"2024-09-13T06:09:34.114999+0000","last_unstale":"2024-09-13T06:12:49.340573+0000","last_undegraded":"2024-09-13T06:12:49.340573+0000","last_fullsized":"2024-09-13T06:12:49.340573+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:46.798780+0000","last_change":"2024-09-13T06:09:32.118402+0000","last_active":"2024-09-13T06:11:46.798780+0000","last_peered":"2024-09-13T06:11:46.798780+0000","last_clean":"2024-09-13T06:11:46.798780+0000","last_became_active":"2024-09-13T06:09:32.117779+0000","last_became_peered":"2024-09-13T06:09:32.117779+0000","last_unstale":"2024-09-13T06:11:46.798780+0000","last_undegraded":"2024-09-13T06:11:46.798780+0000","last_fullsized":"2024-09-13T06:11:46.798780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:43.192713+0000","last_change":"2024-09-13T06:13:43.192766+0000","last_active":"2024-09-13T06:13:43.192713+0000","last_peered":"2024-09-13T06:13:43.192713+0000","last_clean":"2024-09-13T06:13:43.192713+0000","last_became_active":"2024-09-13T06:09:36.135862+0000","last_became_peered":"2024-09-13T06:09:36.135862+0000","last_unstale":"2024-09-13T06:13:43.192713+0000","last_undegraded":"2024-09-13T06:13:43.192713+0000","last_fullsized":"2024-09-13T06:13:43.192713+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:43.192506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:43.192506+0000","last_clean_scrub_stamp":"2024-09-13T06:13:43.192506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:16:55.055009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"35'37","reported_seq":92,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:35.787076+0000","last_change":"2024-09-13T06:13:35.787233+0000","last_active":"2024-09-13T06:13:35.787076+0000","last_peered":"2024-09-13T06:13:35.787076+0000","last_clean":"2024-09-13T06:13:35.787076+0000","last_became_active":"2024-09-13T06:09:38.171931+0000","last_became_peered":"2024-09-13T06:09:38.171931+0000","last_unstale":"2024-09-13T06:13:35.787076+0000","last_undegraded":"2024-09-13T06:13:35.787076+0000","last_fullsized":"2024-09-13T06:13:35.787076+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'37","last_scrub_stamp":"2024-09-13T06:13:35.786837+0000","last_deep_scrub":"35'37","last_deep_scrub_stamp":"2024-09-13T06:13:35.786837+0000","last_clean_scrub_stamp":"2024-09-13T06:13:35.786837+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:50:05.816319+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:32.280833+0000","last_change":"2024-09-13T06:13:32.280888+0000","last_active":"2024-09-13T06:13:32.280833+0000","last_peered":"2024-09-13T06:13:32.280833+0000","last_clean":"2024-09-13T06:13:32.280833+0000","last_became_active":"2024-09-13T06:09:40.178545+0000","last_became_peered":"2024-09-13T06:09:40.178545+0000","last_unstale":"2024-09-13T06:13:32.280833+0000","last_undegraded":"2024-09-13T06:13:32.280833+0000","last_fullsized":"2024-09-13T06:13:32.280833+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:32.280631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:32.280631+0000","last_clean_scrub_stamp":"2024-09-13T06:13:32.280631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:40:09.829593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"35'5","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.333792+0000","last_change":"2024-09-13T06:09:42.206012+0000","last_active":"2024-09-13T06:12:49.333792+0000","last_peered":"2024-09-13T06:12:49.333792+0000","last_clean":"2024-09-13T06:12:49.333792+0000","last_became_active":"2024-09-13T06:09:42.204945+0000","last_became_peered":"2024-09-13T06:09:42.204945+0000","last_unstale":"2024-09-13T06:12:49.333792+0000","last_undegraded":"2024-09-13T06:12:49.333792+0000","last_fullsized":"2024-09-13T06:12:49.333792+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"33'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:46.798686+0000","last_change":"2024-09-13T06:09:34.104885+0000","last_active":"2024-09-13T06:11:46.798686+0000","last_peered":"2024-09-13T06:11:46.798686+0000","last_clean":"2024-09-13T06:11:46.798686+0000","last_became_active":"2024-09-13T06:09:34.102657+0000","last_became_peered":"2024-09-13T06:09:34.102657+0000","last_unstale":"2024-09-13T06:11:46.798686+0000","last_undegraded":"2024-09-13T06:11:46.798686+0000","last_fullsized":"2024-09-13T06:11:46.798686+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"35'6","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:20.960242+0000","last_change":"2024-09-13T06:09:32.136390+0000","last_active":"2024-09-13T06:13:20.960242+0000","last_peered":"2024-09-13T06:13:20.960242+0000","last_clean":"2024-09-13T06:13:20.960242+0000","last_became_active":"2024-09-13T06:09:32.133020+0000","last_became_peered":"2024-09-13T06:09:32.133020+0000","last_unstale":"2024-09-13T06:13:20.960242+0000","last_undegraded":"2024-09-13T06:13:20.960242+0000","last_fullsized":"2024-09-13T06:13:20.960242+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":22,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:26.807560+0000","last_change":"2024-09-13T06:10:10.810157+0000","last_active":"2024-09-13T06:12:26.807560+0000","last_peered":"2024-09-13T06:12:26.807560+0000","last_clean":"2024-09-13T06:12:26.807560+0000","last_became_active":"2024-09-13T06:10:10.809442+0000","last_became_peered":"2024-09-13T06:10:10.809442+0000","last_unstale":"2024-09-13T06:12:26.807560+0000","last_undegraded":"2024-09-13T06:12:26.807560+0000","last_fullsized":"2024-09-13T06:12:26.807560+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"35'45","reported_seq":103,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:27.901372+0000","last_change":"2024-09-13T06:13:27.901555+0000","last_active":"2024-09-13T06:13:27.901372+0000","last_peered":"2024-09-13T06:13:27.901372+0000","last_clean":"2024-09-13T06:13:27.901372+0000","last_became_active":"2024-09-13T06:09:38.154720+0000","last_became_peered":"2024-09-13T06:09:38.154720+0000","last_unstale":"2024-09-13T06:13:27.901372+0000","last_undegraded":"2024-09-13T06:13:27.901372+0000","last_fullsized":"2024-09-13T06:13:27.901372+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'45","last_scrub_stamp":"2024-09-13T06:13:27.901155+0000","last_deep_scrub":"35'45","last_deep_scrub_stamp":"2024-09-13T06:13:27.901155+0000","last_clean_scrub_stamp":"2024-09-13T06:13:27.901155+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:38:20.916120+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"35'285","reported_seq":402,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:21.010470+0000","last_change":"2024-09-13T06:09:40.187775+0000","last_active":"2024-09-13T06:13:21.010470+0000","last_peered":"2024-09-13T06:13:21.010470+0000","last_clean":"2024-09-13T06:13:21.010470+0000","last_became_active":"2024-09-13T06:09:40.186987+0000","last_became_peered":"2024-09-13T06:09:40.186987+0000","last_unstale":"2024-09-13T06:13:21.010470+0000","last_undegraded":"2024-09-13T06:13:21.010470+0000","last_fullsized":"2024-09-13T06:13:21.010470+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"35'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:55.801089+0000","last_change":"2024-09-13T06:09:42.202356+0000","last_active":"2024-09-13T06:11:55.801089+0000","last_peered":"2024-09-13T06:11:55.801089+0000","last_clean":"2024-09-13T06:11:55.801089+0000","last_became_active":"2024-09-13T06:09:42.201678+0000","last_became_peered":"2024-09-13T06:09:42.201678+0000","last_unstale":"2024-09-13T06:11:55.801089+0000","last_undegraded":"2024-09-13T06:11:55.801089+0000","last_fullsized":"2024-09-13T06:11:55.801089+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"35'14","reported_seq":70,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:51.799713+0000","last_change":"2024-09-13T06:09:34.103681+0000","last_active":"2024-09-13T06:11:51.799713+0000","last_peered":"2024-09-13T06:11:51.799713+0000","last_clean":"2024-09-13T06:11:51.799713+0000","last_became_active":"2024-09-13T06:09:34.103295+0000","last_became_peered":"2024-09-13T06:09:34.103295+0000","last_unstale":"2024-09-13T06:11:51.799713+0000","last_undegraded":"2024-09-13T06:11:51.799713+0000","last_fullsized":"2024-09-13T06:11:51.799713+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:47.807660+0000","last_change":"2024-09-13T06:09:32.128209+0000","last_active":"2024-09-13T06:11:47.807660+0000","last_peered":"2024-09-13T06:11:47.807660+0000","last_clean":"2024-09-13T06:11:47.807660+0000","last_became_active":"2024-09-13T06:09:32.125047+0000","last_became_peered":"2024-09-13T06:09:32.125047+0000","last_unstale":"2024-09-13T06:11:47.807660+0000","last_undegraded":"2024-09-13T06:11:47.807660+0000","last_fullsized":"2024-09-13T06:11:47.807660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:42.241842+0000","last_change":"2024-09-13T06:13:42.241894+0000","last_active":"2024-09-13T06:13:42.241842+0000","last_peered":"2024-09-13T06:13:42.241842+0000","last_clean":"2024-09-13T06:13:42.241842+0000","last_became_active":"2024-09-13T06:09:36.135896+0000","last_became_peered":"2024-09-13T06:09:36.135896+0000","last_unstale":"2024-09-13T06:13:42.241842+0000","last_undegraded":"2024-09-13T06:13:42.241842+0000","last_fullsized":"2024-09-13T06:13:42.241842+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:42.241654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:42.241654+0000","last_clean_scrub_stamp":"2024-09-13T06:13:42.241654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:30:48.725646+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"35'63","reported_seq":128,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:20.968819+0000","last_change":"2024-09-13T06:09:38.176653+0000","last_active":"2024-09-13T06:13:20.968819+0000","last_peered":"2024-09-13T06:13:20.968819+0000","last_clean":"2024-09-13T06:13:20.968819+0000","last_became_active":"2024-09-13T06:09:38.175404+0000","last_became_peered":"2024-09-13T06:09:38.175404+0000","last_unstale":"2024-09-13T06:13:20.968819+0000","last_undegraded":"2024-09-13T06:13:20.968819+0000","last_fullsized":"2024-09-13T06:13:20.968819+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":65,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:24.260986+0000","last_change":"2024-09-13T06:13:24.261010+0000","last_active":"2024-09-13T06:13:24.260986+0000","last_peered":"2024-09-13T06:13:24.260986+0000","last_clean":"2024-09-13T06:13:24.260986+0000","last_became_active":"2024-09-13T06:09:40.177127+0000","last_became_peered":"2024-09-13T06:09:40.177127+0000","last_unstale":"2024-09-13T06:13:24.260986+0000","last_undegraded":"2024-09-13T06:13:24.260986+0000","last_fullsized":"2024-09-13T06:13:24.260986+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:24.260874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:24.260874+0000","last_clean_scrub_stamp":"2024-09-13T06:13:24.260874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:44:50.272386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"35'18","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.806467+0000","last_change":"2024-09-13T06:09:42.177354+0000","last_active":"2024-09-13T06:12:49.806467+0000","last_peered":"2024-09-13T06:12:49.806467+0000","last_clean":"2024-09-13T06:12:49.806467+0000","last_became_active":"2024-09-13T06:09:42.176229+0000","last_became_peered":"2024-09-13T06:09:42.176229+0000","last_unstale":"2024-09-13T06:12:49.806467+0000","last_undegraded":"2024-09-13T06:12:49.806467+0000","last_fullsized":"2024-09-13T06:12:49.806467+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"35'16","reported_seq":78,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.132395+0000","last_change":"2024-09-13T06:09:34.121751+0000","last_active":"2024-09-13T06:12:49.132395+0000","last_peered":"2024-09-13T06:12:49.132395+0000","last_clean":"2024-09-13T06:12:49.132395+0000","last_became_active":"2024-09-13T06:09:34.119018+0000","last_became_peered":"2024-09-13T06:09:34.119018+0000","last_unstale":"2024-09-13T06:12:49.132395+0000","last_undegraded":"2024-09-13T06:12:49.132395+0000","last_fullsized":"2024-09-13T06:12:49.132395+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:20.953521+0000","last_change":"2024-09-13T06:09:32.151752+0000","last_active":"2024-09-13T06:13:20.953521+0000","last_peered":"2024-09-13T06:13:20.953521+0000","last_clean":"2024-09-13T06:13:20.953521+0000","last_became_active":"2024-09-13T06:09:32.148505+0000","last_became_peered":"2024-09-13T06:09:32.148505+0000","last_unstale":"2024-09-13T06:13:20.953521+0000","last_undegraded":"2024-09-13T06:13:20.953521+0000","last_fullsized":"2024-09-13T06:13:20.953521+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:51.799791+0000","last_change":"2024-09-13T06:09:36.132310+0000","last_active":"2024-09-13T06:11:51.799791+0000","last_peered":"2024-09-13T06:11:51.799791+0000","last_clean":"2024-09-13T06:11:51.799791+0000","last_became_active":"2024-09-13T06:09:36.131611+0000","last_became_peered":"2024-09-13T06:09:36.131611+0000","last_unstale":"2024-09-13T06:11:51.799791+0000","last_undegraded":"2024-09-13T06:11:51.799791+0000","last_fullsized":"2024-09-13T06:11:51.799791+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"35'40","reported_seq":96,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:27.295684+0000","last_change":"2024-09-13T06:13:27.295757+0000","last_active":"2024-09-13T06:13:27.295684+0000","last_peered":"2024-09-13T06:13:27.295684+0000","last_clean":"2024-09-13T06:13:27.295684+0000","last_became_active":"2024-09-13T06:09:38.165747+0000","last_became_peered":"2024-09-13T06:09:38.165747+0000","last_unstale":"2024-09-13T06:13:27.295684+0000","last_undegraded":"2024-09-13T06:13:27.295684+0000","last_fullsized":"2024-09-13T06:13:27.295684+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'40","last_scrub_stamp":"2024-09-13T06:13:27.295462+0000","last_deep_scrub":"35'40","last_deep_scrub_stamp":"2024-09-13T06:13:27.295462+0000","last_clean_scrub_stamp":"2024-09-13T06:13:27.295462+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:22:05.049909+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:57.810890+0000","last_change":"2024-09-13T06:09:40.190860+0000","last_active":"2024-09-13T06:11:57.810890+0000","last_peered":"2024-09-13T06:11:57.810890+0000","last_clean":"2024-09-13T06:11:57.810890+0000","last_became_active":"2024-09-13T06:09:40.190314+0000","last_became_peered":"2024-09-13T06:09:40.190314+0000","last_unstale":"2024-09-13T06:11:57.810890+0000","last_undegraded":"2024-09-13T06:11:57.810890+0000","last_fullsized":"2024-09-13T06:11:57.810890+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"35'3","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.443077+0000","last_change":"2024-09-13T06:09:42.202356+0000","last_active":"2024-09-13T06:13:25.443077+0000","last_peered":"2024-09-13T06:13:25.443077+0000","last_clean":"2024-09-13T06:13:25.443077+0000","last_became_active":"2024-09-13T06:09:42.201211+0000","last_became_peered":"2024-09-13T06:09:42.201211+0000","last_unstale":"2024-09-13T06:13:25.443077+0000","last_undegraded":"2024-09-13T06:13:25.443077+0000","last_fullsized":"2024-09-13T06:13:25.443077+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"35'6","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:40.785597+0000","last_change":"2024-09-13T06:13:40.785766+0000","last_active":"2024-09-13T06:13:40.785597+0000","last_peered":"2024-09-13T06:13:40.785597+0000","last_clean":"2024-09-13T06:13:40.785597+0000","last_became_active":"2024-09-13T06:09:34.131882+0000","last_became_peered":"2024-09-13T06:09:34.131882+0000","last_unstale":"2024-09-13T06:13:40.785597+0000","last_undegraded":"2024-09-13T06:13:40.785597+0000","last_fullsized":"2024-09-13T06:13:40.785597+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:13:40.785378+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:13:40.785378+0000","last_clean_scrub_stamp":"2024-09-13T06:13:40.785378+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:31:15.240641+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:42.805449+0000","last_change":"2024-09-13T06:09:32.143831+0000","last_active":"2024-09-13T06:11:42.805449+0000","last_peered":"2024-09-13T06:11:42.805449+0000","last_clean":"2024-09-13T06:11:42.805449+0000","last_became_active":"2024-09-13T06:09:32.138731+0000","last_became_peered":"2024-09-13T06:09:32.138731+0000","last_unstale":"2024-09-13T06:11:42.805449+0000","last_undegraded":"2024-09-13T06:11:42.805449+0000","last_fullsized":"2024-09-13T06:11:42.805449+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:45.169144+0000","last_change":"2024-09-13T06:13:45.169252+0000","last_active":"2024-09-13T06:13:45.169144+0000","last_peered":"2024-09-13T06:13:45.169144+0000","last_clean":"2024-09-13T06:13:45.169144+0000","last_became_active":"2024-09-13T06:09:36.135660+0000","last_became_peered":"2024-09-13T06:09:36.135660+0000","last_unstale":"2024-09-13T06:13:45.169144+0000","last_undegraded":"2024-09-13T06:13:45.169144+0000","last_fullsized":"2024-09-13T06:13:45.169144+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:45.168902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:45.168902+0000","last_clean_scrub_stamp":"2024-09-13T06:13:45.168902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:17:37.777327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"35'46","reported_seq":104,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:38.444335+0000","last_change":"2024-09-13T06:13:38.444422+0000","last_active":"2024-09-13T06:13:38.444335+0000","last_peered":"2024-09-13T06:13:38.444335+0000","last_clean":"2024-09-13T06:13:38.444335+0000","last_became_active":"2024-09-13T06:09:38.143209+0000","last_became_peered":"2024-09-13T06:09:38.143209+0000","last_unstale":"2024-09-13T06:13:38.444335+0000","last_undegraded":"2024-09-13T06:13:38.444335+0000","last_fullsized":"2024-09-13T06:13:38.444335+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'46","last_scrub_stamp":"2024-09-13T06:13:38.444138+0000","last_deep_scrub":"35'46","last_deep_scrub_stamp":"2024-09-13T06:13:38.444138+0000","last_clean_scrub_stamp":"2024-09-13T06:13:38.444138+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:49:28.085814+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"35'285","reported_seq":416,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:32.368055+0000","last_change":"2024-09-13T06:13:32.368124+0000","last_active":"2024-09-13T06:13:32.368055+0000","last_peered":"2024-09-13T06:13:32.368055+0000","last_clean":"2024-09-13T06:13:32.368055+0000","last_became_active":"2024-09-13T06:09:40.188246+0000","last_became_peered":"2024-09-13T06:09:40.188246+0000","last_unstale":"2024-09-13T06:13:32.368055+0000","last_undegraded":"2024-09-13T06:13:32.368055+0000","last_fullsized":"2024-09-13T06:13:32.368055+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-13T06:13:32.367867+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-13T06:13:32.367867+0000","last_clean_scrub_stamp":"2024-09-13T06:13:32.367867+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:44:58.379379+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"35'16","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.677088+0000","last_change":"2024-09-13T06:09:42.201997+0000","last_active":"2024-09-13T06:12:49.677088+0000","last_peered":"2024-09-13T06:12:49.677088+0000","last_clean":"2024-09-13T06:12:49.677088+0000","last_became_active":"2024-09-13T06:09:42.201304+0000","last_became_peered":"2024-09-13T06:09:42.201304+0000","last_unstale":"2024-09-13T06:12:49.677088+0000","last_undegraded":"2024-09-13T06:12:49.677088+0000","last_fullsized":"2024-09-13T06:12:49.677088+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":29,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"35'4","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:51.799839+0000","last_change":"2024-09-13T06:09:34.102998+0000","last_active":"2024-09-13T06:11:51.799839+0000","last_peered":"2024-09-13T06:11:51.799839+0000","last_clean":"2024-09-13T06:11:51.799839+0000","last_became_active":"2024-09-13T06:09:34.102586+0000","last_became_peered":"2024-09-13T06:09:34.102586+0000","last_unstale":"2024-09-13T06:11:51.799839+0000","last_undegraded":"2024-09-13T06:11:51.799839+0000","last_fullsized":"2024-09-13T06:11:51.799839+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"35'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:48.866645+0000","last_change":"2024-09-13T06:09:32.125108+0000","last_active":"2024-09-13T06:12:48.866645+0000","last_peered":"2024-09-13T06:12:48.866645+0000","last_clean":"2024-09-13T06:12:48.866645+0000","last_became_active":"2024-09-13T06:09:32.122121+0000","last_became_peered":"2024-09-13T06:09:32.122121+0000","last_unstale":"2024-09-13T06:12:48.866645+0000","last_undegraded":"2024-09-13T06:12:48.866645+0000","last_fullsized":"2024-09-13T06:12:48.866645+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"35'5","reported_seq":428,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:32.185723+0000","last_change":"2024-09-13T06:13:32.185845+0000","last_active":"2024-09-13T06:13:32.185723+0000","last_peered":"2024-09-13T06:13:32.185723+0000","last_clean":"2024-09-13T06:13:32.185723+0000","last_became_active":"2024-09-13T06:09:36.141789+0000","last_became_peered":"2024-09-13T06:09:36.141789+0000","last_unstale":"2024-09-13T06:13:32.185723+0000","last_undegraded":"2024-09-13T06:13:32.185723+0000","last_fullsized":"2024-09-13T06:13:32.185723+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'5","last_scrub_stamp":"2024-09-13T06:13:32.185488+0000","last_deep_scrub":"35'5","last_deep_scrub_stamp":"2024-09-13T06:13:32.185488+0000","last_clean_scrub_stamp":"2024-09-13T06:13:32.185488+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:56:51.767002+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"33'10","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:52.809392+0000","last_change":"2024-09-13T06:09:38.177849+0000","last_active":"2024-09-13T06:11:52.809392+0000","last_peered":"2024-09-13T06:11:52.809392+0000","last_clean":"2024-09-13T06:11:52.809392+0000","last_became_active":"2024-09-13T06:09:38.177217+0000","last_became_peered":"2024-09-13T06:09:38.177217+0000","last_unstale":"2024-09-13T06:11:52.809392+0000","last_undegraded":"2024-09-13T06:11:52.809392+0000","last_fullsized":"2024-09-13T06:11:52.809392+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"35'285","reported_seq":472,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:29.237136+0000","last_change":"2024-09-13T06:13:29.237199+0000","last_active":"2024-09-13T06:13:29.237136+0000","last_peered":"2024-09-13T06:13:29.237136+0000","last_clean":"2024-09-13T06:13:29.237136+0000","last_became_active":"2024-09-13T06:09:40.179438+0000","last_became_peered":"2024-09-13T06:09:40.179438+0000","last_unstale":"2024-09-13T06:13:29.237136+0000","last_undegraded":"2024-09-13T06:13:29.237136+0000","last_fullsized":"2024-09-13T06:13:29.237136+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-13T06:13:29.236948+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-13T06:13:29.236948+0000","last_clean_scrub_stamp":"2024-09-13T06:13:29.236948+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:34:12.529343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"35'6","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:47.688910+0000","last_change":"2024-09-13T06:09:42.204120+0000","last_active":"2024-09-13T06:11:47.688910+0000","last_peered":"2024-09-13T06:11:47.688910+0000","last_clean":"2024-09-13T06:11:47.688910+0000","last_became_active":"2024-09-13T06:09:42.181854+0000","last_became_peered":"2024-09-13T06:09:42.181854+0000","last_unstale":"2024-09-13T06:11:47.688910+0000","last_undegraded":"2024-09-13T06:11:47.688910+0000","last_fullsized":"2024-09-13T06:11:47.688910+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:52.804637+0000","last_change":"2024-09-13T06:09:34.127227+0000","last_active":"2024-09-13T06:11:52.804637+0000","last_peered":"2024-09-13T06:11:52.804637+0000","last_clean":"2024-09-13T06:11:52.804637+0000","last_became_active":"2024-09-13T06:09:34.126843+0000","last_became_peered":"2024-09-13T06:09:34.126843+0000","last_unstale":"2024-09-13T06:11:52.804637+0000","last_undegraded":"2024-09-13T06:11:52.804637+0000","last_fullsized":"2024-09-13T06:11:52.804637+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"35'5","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:42.805211+0000","last_change":"2024-09-13T06:09:32.133494+0000","last_active":"2024-09-13T06:11:42.805211+0000","last_peered":"2024-09-13T06:11:42.805211+0000","last_clean":"2024-09-13T06:11:42.805211+0000","last_became_active":"2024-09-13T06:09:32.129984+0000","last_became_peered":"2024-09-13T06:09:32.129984+0000","last_unstale":"2024-09-13T06:11:42.805211+0000","last_undegraded":"2024-09-13T06:11:42.805211+0000","last_fullsized":"2024-09-13T06:11:42.805211+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.906948+0000","last_change":"2024-09-13T06:13:25.907022+0000","last_active":"2024-09-13T06:13:25.906948+0000","last_peered":"2024-09-13T06:13:25.906948+0000","last_clean":"2024-09-13T06:13:25.906948+0000","last_became_active":"2024-09-13T06:09:36.153614+0000","last_became_peered":"2024-09-13T06:09:36.153614+0000","last_unstale":"2024-09-13T06:13:25.906948+0000","last_undegraded":"2024-09-13T06:13:25.906948+0000","last_fullsized":"2024-09-13T06:13:25.906948+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:25.906744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:25.906744+0000","last_clean_scrub_stamp":"2024-09-13T06:13:25.906744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:08:19.863549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"35'48","reported_seq":107,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:31.203173+0000","last_change":"2024-09-13T06:13:31.203250+0000","last_active":"2024-09-13T06:13:31.203173+0000","last_peered":"2024-09-13T06:13:31.203173+0000","last_clean":"2024-09-13T06:13:31.203173+0000","last_became_active":"2024-09-13T06:09:38.155463+0000","last_became_peered":"2024-09-13T06:09:38.155463+0000","last_unstale":"2024-09-13T06:13:31.203173+0000","last_undegraded":"2024-09-13T06:13:31.203173+0000","last_fullsized":"2024-09-13T06:13:31.203173+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'48","last_scrub_stamp":"2024-09-13T06:13:31.202979+0000","last_deep_scrub":"35'48","last_deep_scrub_stamp":"2024-09-13T06:13:31.202979+0000","last_clean_scrub_stamp":"2024-09-13T06:13:31.202979+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:07:14.216978+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:27.404797+0000","last_change":"2024-09-13T06:13:27.404848+0000","last_active":"2024-09-13T06:13:27.404797+0000","last_peered":"2024-09-13T06:13:27.404797+0000","last_clean":"2024-09-13T06:13:27.404797+0000","last_became_active":"2024-09-13T06:09:40.167733+0000","last_became_peered":"2024-09-13T06:09:40.167733+0000","last_unstale":"2024-09-13T06:13:27.404797+0000","last_undegraded":"2024-09-13T06:13:27.404797+0000","last_fullsized":"2024-09-13T06:13:27.404797+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:27.404612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:27.404612+0000","last_clean_scrub_stamp":"2024-09-13T06:13:27.404612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:53:51.661686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"35'6","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.802095+0000","last_change":"2024-09-13T06:09:42.177915+0000","last_active":"2024-09-13T06:12:49.802095+0000","last_peered":"2024-09-13T06:12:49.802095+0000","last_clean":"2024-09-13T06:12:49.802095+0000","last_became_active":"2024-09-13T06:09:42.172937+0000","last_became_peered":"2024-09-13T06:09:42.172937+0000","last_unstale":"2024-09-13T06:12:49.802095+0000","last_undegraded":"2024-09-13T06:12:49.802095+0000","last_fullsized":"2024-09-13T06:12:49.802095+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"35'12","reported_seq":86,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:41.783881+0000","last_change":"2024-09-13T06:13:41.783938+0000","last_active":"2024-09-13T06:13:41.783881+0000","last_peered":"2024-09-13T06:13:41.783881+0000","last_clean":"2024-09-13T06:13:41.783881+0000","last_became_active":"2024-09-13T06:09:34.131113+0000","last_became_peered":"2024-09-13T06:09:34.131113+0000","last_unstale":"2024-09-13T06:13:41.783881+0000","last_undegraded":"2024-09-13T06:13:41.783881+0000","last_fullsized":"2024-09-13T06:13:41.783881+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'12","last_scrub_stamp":"2024-09-13T06:13:41.783695+0000","last_deep_scrub":"35'12","last_deep_scrub_stamp":"2024-09-13T06:13:41.783695+0000","last_clean_scrub_stamp":"2024-09-13T06:13:41.783695+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:56:08.039276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":60,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"14'117","reported_seq":207,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:22.824596+0000","last_change":"2024-09-13T06:09:19.565573+0000","last_active":"2024-09-13T06:13:22.824596+0000","last_peered":"2024-09-13T06:13:22.824596+0000","last_clean":"2024-09-13T06:13:22.824596+0000","last_became_active":"2024-09-13T06:09:19.561434+0000","last_became_peered":"2024-09-13T06:09:19.561434+0000","last_unstale":"2024-09-13T06:13:22.824596+0000","last_undegraded":"2024-09-13T06:13:22.824596+0000","last_fullsized":"2024-09-13T06:13:22.824596+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:18.163598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:18.163598+0000","last_clean_scrub_stamp":"2024-09-13T06:09:18.163598+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.440124+0000","last_change":"2024-09-13T06:09:24.220777+0000","last_active":"2024-09-13T06:13:25.440124+0000","last_peered":"2024-09-13T06:13:25.440124+0000","last_clean":"2024-09-13T06:13:25.440124+0000","last_became_active":"2024-09-13T06:09:22.217131+0000","last_became_peered":"2024-09-13T06:09:22.217131+0000","last_unstale":"2024-09-13T06:13:25.440124+0000","last_undegraded":"2024-09-13T06:13:25.440124+0000","last_fullsized":"2024-09-13T06:13:25.440124+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_clean_scrub_stamp":"2024-09-13T06:09:21.188659+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090967000000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"35'4","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.440206+0000","last_change":"2024-09-13T06:09:32.144633+0000","last_active":"2024-09-13T06:13:25.440206+0000","last_peered":"2024-09-13T06:13:25.440206+0000","last_clean":"2024-09-13T06:13:25.440206+0000","last_became_active":"2024-09-13T06:09:32.141646+0000","last_became_peered":"2024-09-13T06:09:32.141646+0000","last_unstale":"2024-09-13T06:13:25.440206+0000","last_undegraded":"2024-09-13T06:13:25.440206+0000","last_fullsized":"2024-09-13T06:13:25.440206+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:35.101561+0000","last_change":"2024-09-13T06:13:35.101614+0000","last_active":"2024-09-13T06:13:35.101561+0000","last_peered":"2024-09-13T06:13:35.101561+0000","last_clean":"2024-09-13T06:13:35.101561+0000","last_became_active":"2024-09-13T06:09:36.140417+0000","last_became_peered":"2024-09-13T06:09:36.140417+0000","last_unstale":"2024-09-13T06:13:35.101561+0000","last_undegraded":"2024-09-13T06:13:35.101561+0000","last_fullsized":"2024-09-13T06:13:35.101561+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:35.101340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:35.101340+0000","last_clean_scrub_stamp":"2024-09-13T06:13:35.101340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:29:39.130402+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"35'85","reported_seq":167,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:20.878770+0000","last_change":"2024-09-13T06:09:38.177538+0000","last_active":"2024-09-13T06:13:20.878770+0000","last_peered":"2024-09-13T06:13:20.878770+0000","last_clean":"2024-09-13T06:13:20.878770+0000","last_became_active":"2024-09-13T06:09:38.176365+0000","last_became_peered":"2024-09-13T06:09:38.176365+0000","last_unstale":"2024-09-13T06:13:20.878770+0000","last_undegraded":"2024-09-13T06:13:20.878770+0000","last_fullsized":"2024-09-13T06:13:20.878770+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:44.206903+0000","last_change":"2024-09-13T06:13:44.206956+0000","last_active":"2024-09-13T06:13:44.206903+0000","last_peered":"2024-09-13T06:13:44.206903+0000","last_clean":"2024-09-13T06:13:44.206903+0000","last_became_active":"2024-09-13T06:09:40.178872+0000","last_became_peered":"2024-09-13T06:09:40.178872+0000","last_unstale":"2024-09-13T06:13:44.206903+0000","last_undegraded":"2024-09-13T06:13:44.206903+0000","last_fullsized":"2024-09-13T06:13:44.206903+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:44.206706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:44.206706+0000","last_clean_scrub_stamp":"2024-09-13T06:13:44.206706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:34:21.273218+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"35'82","reported_seq":172,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:36.470713+0000","last_change":"2024-09-13T06:13:36.470775+0000","last_active":"2024-09-13T06:13:36.470713+0000","last_peered":"2024-09-13T06:13:36.470713+0000","last_clean":"2024-09-13T06:13:36.470713+0000","last_became_active":"2024-09-13T06:09:42.197803+0000","last_became_peered":"2024-09-13T06:09:42.197803+0000","last_unstale":"2024-09-13T06:13:36.470713+0000","last_undegraded":"2024-09-13T06:13:36.470713+0000","last_fullsized":"2024-09-13T06:13:36.470713+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'82","last_scrub_stamp":"2024-09-13T06:13:36.470522+0000","last_deep_scrub":"35'82","last_deep_scrub_stamp":"2024-09-13T06:13:36.470522+0000","last_clean_scrub_stamp":"2024-09-13T06:13:36.470522+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:55:18.490378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"35'9","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.663016+0000","last_change":"2024-09-13T06:10:10.942337+0000","last_active":"2024-09-13T06:12:49.663016+0000","last_peered":"2024-09-13T06:12:49.663016+0000","last_clean":"2024-09-13T06:12:49.663016+0000","last_became_active":"2024-09-13T06:10:10.941771+0000","last_became_peered":"2024-09-13T06:10:10.941771+0000","last_unstale":"2024-09-13T06:12:49.663016+0000","last_undegraded":"2024-09-13T06:12:49.663016+0000","last_fullsized":"2024-09-13T06:12:49.663016+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:22.830335+0000","last_change":"2024-09-13T06:09:24.220722+0000","last_active":"2024-09-13T06:13:22.830335+0000","last_peered":"2024-09-13T06:13:22.830335+0000","last_clean":"2024-09-13T06:13:22.830335+0000","last_became_active":"2024-09-13T06:09:22.217643+0000","last_became_peered":"2024-09-13T06:09:22.217643+0000","last_unstale":"2024-09-13T06:13:22.830335+0000","last_undegraded":"2024-09-13T06:13:22.830335+0000","last_fullsized":"2024-09-13T06:13:22.830335+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_clean_scrub_stamp":"2024-09-13T06:09:21.188659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082521999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"35'2","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:24.055337+0000","last_change":"2024-09-13T06:09:32.151263+0000","last_active":"2024-09-13T06:13:24.055337+0000","last_peered":"2024-09-13T06:13:24.055337+0000","last_clean":"2024-09-13T06:13:24.055337+0000","last_became_active":"2024-09-13T06:09:32.147837+0000","last_became_peered":"2024-09-13T06:09:32.147837+0000","last_unstale":"2024-09-13T06:13:24.055337+0000","last_undegraded":"2024-09-13T06:13:24.055337+0000","last_fullsized":"2024-09-13T06:13:24.055337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:28.911067+0000","last_change":"2024-09-13T06:13:28.911118+0000","last_active":"2024-09-13T06:13:28.911067+0000","last_peered":"2024-09-13T06:13:28.911067+0000","last_clean":"2024-09-13T06:13:28.911067+0000","last_became_active":"2024-09-13T06:09:36.153430+0000","last_became_peered":"2024-09-13T06:09:36.153430+0000","last_unstale":"2024-09-13T06:13:28.911067+0000","last_undegraded":"2024-09-13T06:13:28.911067+0000","last_fullsized":"2024-09-13T06:13:28.911067+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:28.910878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:28.910878+0000","last_clean_scrub_stamp":"2024-09-13T06:13:28.910878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:38:20.711196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"35'291","reported_seq":517,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:30.250227+0000","last_change":"2024-09-13T06:13:30.250325+0000","last_active":"2024-09-13T06:13:30.250227+0000","last_peered":"2024-09-13T06:13:30.250227+0000","last_clean":"2024-09-13T06:13:30.250227+0000","last_became_active":"2024-09-13T06:09:38.160192+0000","last_became_peered":"2024-09-13T06:09:38.160192+0000","last_unstale":"2024-09-13T06:13:30.250227+0000","last_undegraded":"2024-09-13T06:13:30.250227+0000","last_fullsized":"2024-09-13T06:13:30.250227+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'291","last_scrub_stamp":"2024-09-13T06:13:30.250026+0000","last_deep_scrub":"35'291","last_deep_scrub_stamp":"2024-09-13T06:13:30.250026+0000","last_clean_scrub_stamp":"2024-09-13T06:13:30.250026+0000","objects_scrubbed":10,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:19:15.055011+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:47.807921+0000","last_change":"2024-09-13T06:09:40.189965+0000","last_active":"2024-09-13T06:11:47.807921+0000","last_peered":"2024-09-13T06:11:47.807921+0000","last_clean":"2024-09-13T06:11:47.807921+0000","last_became_active":"2024-09-13T06:09:40.188859+0000","last_became_peered":"2024-09-13T06:09:40.188859+0000","last_unstale":"2024-09-13T06:11:47.807921+0000","last_undegraded":"2024-09-13T06:11:47.807921+0000","last_fullsized":"2024-09-13T06:11:47.807921+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"35'5","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.837095+0000","last_change":"2024-09-13T06:09:42.205523+0000","last_active":"2024-09-13T06:12:49.837095+0000","last_peered":"2024-09-13T06:12:49.837095+0000","last_clean":"2024-09-13T06:12:49.837095+0000","last_became_active":"2024-09-13T06:09:42.204736+0000","last_became_peered":"2024-09-13T06:09:42.204736+0000","last_unstale":"2024-09-13T06:12:49.837095+0000","last_undegraded":"2024-09-13T06:12:49.837095+0000","last_fullsized":"2024-09-13T06:12:49.837095+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"35'8","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:45.798330+0000","last_change":"2024-09-13T06:09:34.132298+0000","last_active":"2024-09-13T06:11:45.798330+0000","last_peered":"2024-09-13T06:11:45.798330+0000","last_clean":"2024-09-13T06:11:45.798330+0000","last_became_active":"2024-09-13T06:09:34.131564+0000","last_became_peered":"2024-09-13T06:09:34.131564+0000","last_unstale":"2024-09-13T06:11:45.798330+0000","last_undegraded":"2024-09-13T06:11:45.798330+0000","last_fullsized":"2024-09-13T06:11:45.798330+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:24.971741+0000","last_change":"2024-09-13T06:09:24.565111+0000","last_active":"2024-09-13T06:13:24.971741+0000","last_peered":"2024-09-13T06:13:24.971741+0000","last_clean":"2024-09-13T06:13:24.971741+0000","last_became_active":"2024-09-13T06:09:22.214952+0000","last_became_peered":"2024-09-13T06:09:22.214952+0000","last_unstale":"2024-09-13T06:13:24.971741+0000","last_undegraded":"2024-09-13T06:13:24.971741+0000","last_fullsized":"2024-09-13T06:13:24.971741+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_clean_scrub_stamp":"2024-09-13T06:09:21.188659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097860299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:24.055185+0000","last_change":"2024-09-13T06:09:32.152695+0000","last_active":"2024-09-13T06:13:24.055185+0000","last_peered":"2024-09-13T06:13:24.055185+0000","last_clean":"2024-09-13T06:13:24.055185+0000","last_became_active":"2024-09-13T06:09:32.148803+0000","last_became_peered":"2024-09-13T06:09:32.148803+0000","last_unstale":"2024-09-13T06:13:24.055185+0000","last_undegraded":"2024-09-13T06:13:24.055185+0000","last_fullsized":"2024-09-13T06:13:24.055185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"26'1","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:46.798767+0000","last_change":"2024-09-13T06:09:36.127208+0000","last_active":"2024-09-13T06:11:46.798767+0000","last_peered":"2024-09-13T06:11:46.798767+0000","last_clean":"2024-09-13T06:11:46.798767+0000","last_became_active":"2024-09-13T06:09:36.126497+0000","last_became_peered":"2024-09-13T06:09:36.126497+0000","last_unstale":"2024-09-13T06:11:46.798767+0000","last_undegraded":"2024-09-13T06:11:46.798767+0000","last_fullsized":"2024-09-13T06:11:46.798767+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"35'24","reported_seq":102,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:33.428646+0000","last_change":"2024-09-13T06:13:33.428736+0000","last_active":"2024-09-13T06:13:33.428646+0000","last_peered":"2024-09-13T06:13:33.428646+0000","last_clean":"2024-09-13T06:13:33.428646+0000","last_became_active":"2024-09-13T06:09:38.162358+0000","last_became_peered":"2024-09-13T06:09:38.162358+0000","last_unstale":"2024-09-13T06:13:33.428646+0000","last_undegraded":"2024-09-13T06:13:33.428646+0000","last_fullsized":"2024-09-13T06:13:33.428646+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'24","last_scrub_stamp":"2024-09-13T06:13:33.428464+0000","last_deep_scrub":"35'24","last_deep_scrub_stamp":"2024-09-13T06:13:33.428464+0000","last_clean_scrub_stamp":"2024-09-13T06:13:33.428464+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:54:34.152803+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:40.255070+0000","last_change":"2024-09-13T06:13:40.255183+0000","last_active":"2024-09-13T06:13:40.255070+0000","last_peered":"2024-09-13T06:13:40.255070+0000","last_clean":"2024-09-13T06:13:40.255070+0000","last_became_active":"2024-09-13T06:09:40.179250+0000","last_became_peered":"2024-09-13T06:09:40.179250+0000","last_unstale":"2024-09-13T06:13:40.255070+0000","last_undegraded":"2024-09-13T06:13:40.255070+0000","last_fullsized":"2024-09-13T06:13:40.255070+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:40.254851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:40.254851+0000","last_clean_scrub_stamp":"2024-09-13T06:13:40.254851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:54:39.886202+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"33'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:57.810608+0000","last_change":"2024-09-13T06:09:42.203843+0000","last_active":"2024-09-13T06:11:57.810608+0000","last_peered":"2024-09-13T06:11:57.810608+0000","last_clean":"2024-09-13T06:11:57.810608+0000","last_became_active":"2024-09-13T06:09:42.203232+0000","last_became_peered":"2024-09-13T06:09:42.203232+0000","last_unstale":"2024-09-13T06:11:57.810608+0000","last_undegraded":"2024-09-13T06:11:57.810608+0000","last_fullsized":"2024-09-13T06:11:57.810608+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"35'6","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:24.055831+0000","last_change":"2024-09-13T06:09:34.116295+0000","last_active":"2024-09-13T06:13:24.055831+0000","last_peered":"2024-09-13T06:13:24.055831+0000","last_clean":"2024-09-13T06:13:24.055831+0000","last_became_active":"2024-09-13T06:09:34.113002+0000","last_became_peered":"2024-09-13T06:09:34.113002+0000","last_unstale":"2024-09-13T06:13:24.055831+0000","last_undegraded":"2024-09-13T06:13:24.055831+0000","last_fullsized":"2024-09-13T06:13:24.055831+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.440093+0000","last_change":"2024-09-13T06:09:24.222172+0000","last_active":"2024-09-13T06:13:25.440093+0000","last_peered":"2024-09-13T06:13:25.440093+0000","last_clean":"2024-09-13T06:13:25.440093+0000","last_became_active":"2024-09-13T06:09:22.217581+0000","last_became_peered":"2024-09-13T06:09:22.217581+0000","last_unstale":"2024-09-13T06:13:25.440093+0000","last_undegraded":"2024-09-13T06:13:25.440093+0000","last_fullsized":"2024-09-13T06:13:25.440093+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_clean_scrub_stamp":"2024-09-13T06:09:21.188659+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022711580000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:24.971746+0000","last_change":"2024-09-13T06:09:32.139418+0000","last_active":"2024-09-13T06:13:24.971746+0000","last_peered":"2024-09-13T06:13:24.971746+0000","last_clean":"2024-09-13T06:13:24.971746+0000","last_became_active":"2024-09-13T06:09:32.138838+0000","last_became_peered":"2024-09-13T06:09:32.138838+0000","last_unstale":"2024-09-13T06:13:24.971746+0000","last_undegraded":"2024-09-13T06:13:24.971746+0000","last_fullsized":"2024-09-13T06:13:24.971746+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:16.805502+0000","last_change":"2024-09-13T06:10:10.810748+0000","last_active":"2024-09-13T06:12:16.805502+0000","last_peered":"2024-09-13T06:12:16.805502+0000","last_clean":"2024-09-13T06:12:16.805502+0000","last_became_active":"2024-09-13T06:10:10.809216+0000","last_became_peered":"2024-09-13T06:10:10.809216+0000","last_unstale":"2024-09-13T06:12:16.805502+0000","last_undegraded":"2024-09-13T06:12:16.805502+0000","last_fullsized":"2024-09-13T06:12:16.805502+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"35'13","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:48.306241+0000","last_change":"2024-09-13T06:09:38.179168+0000","last_active":"2024-09-13T06:12:48.306241+0000","last_peered":"2024-09-13T06:12:48.306241+0000","last_clean":"2024-09-13T06:12:48.306241+0000","last_became_active":"2024-09-13T06:09:38.176307+0000","last_became_peered":"2024-09-13T06:09:38.176307+0000","last_unstale":"2024-09-13T06:12:48.306241+0000","last_undegraded":"2024-09-13T06:12:48.306241+0000","last_fullsized":"2024-09-13T06:12:48.306241+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:52.809552+0000","last_change":"2024-09-13T06:09:40.189861+0000","last_active":"2024-09-13T06:11:52.809552+0000","last_peered":"2024-09-13T06:11:52.809552+0000","last_clean":"2024-09-13T06:11:52.809552+0000","last_became_active":"2024-09-13T06:09:40.189259+0000","last_became_peered":"2024-09-13T06:09:40.189259+0000","last_unstale":"2024-09-13T06:11:52.809552+0000","last_undegraded":"2024-09-13T06:11:52.809552+0000","last_fullsized":"2024-09-13T06:11:52.809552+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"35'4","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:52.804010+0000","last_change":"2024-09-13T06:09:42.186776+0000","last_active":"2024-09-13T06:11:52.804010+0000","last_peered":"2024-09-13T06:11:52.804010+0000","last_clean":"2024-09-13T06:11:52.804010+0000","last_became_active":"2024-09-13T06:09:42.185210+0000","last_became_peered":"2024-09-13T06:09:42.185210+0000","last_unstale":"2024-09-13T06:11:52.804010+0000","last_undegraded":"2024-09-13T06:11:52.804010+0000","last_fullsized":"2024-09-13T06:11:52.804010+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"35'3","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.664879+0000","last_change":"2024-09-13T06:09:34.122137+0000","last_active":"2024-09-13T06:12:49.664879+0000","last_peered":"2024-09-13T06:12:49.664879+0000","last_clean":"2024-09-13T06:12:49.664879+0000","last_became_active":"2024-09-13T06:09:34.119283+0000","last_became_peered":"2024-09-13T06:09:34.119283+0000","last_unstale":"2024-09-13T06:12:49.664879+0000","last_undegraded":"2024-09-13T06:12:49.664879+0000","last_fullsized":"2024-09-13T06:12:49.664879+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"35'2","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:24.971792+0000","last_change":"2024-09-13T06:09:32.139797+0000","last_active":"2024-09-13T06:13:24.971792+0000","last_peered":"2024-09-13T06:13:24.971792+0000","last_clean":"2024-09-13T06:13:24.971792+0000","last_became_active":"2024-09-13T06:09:32.139313+0000","last_became_peered":"2024-09-13T06:09:32.139313+0000","last_unstale":"2024-09-13T06:13:24.971792+0000","last_undegraded":"2024-09-13T06:13:24.971792+0000","last_fullsized":"2024-09-13T06:13:24.971792+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:24.055153+0000","last_change":"2024-09-13T06:09:24.227949+0000","last_active":"2024-09-13T06:13:24.055153+0000","last_peered":"2024-09-13T06:13:24.055153+0000","last_clean":"2024-09-13T06:13:24.055153+0000","last_became_active":"2024-09-13T06:09:22.216659+0000","last_became_peered":"2024-09-13T06:09:22.216659+0000","last_unstale":"2024-09-13T06:13:24.055153+0000","last_undegraded":"2024-09-13T06:13:24.055153+0000","last_fullsized":"2024-09-13T06:13:24.055153+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_clean_scrub_stamp":"2024-09-13T06:09:21.188659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010625330000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"35'1","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:24.055723+0000","last_change":"2024-09-13T06:09:36.133083+0000","last_active":"2024-09-13T06:13:24.055723+0000","last_peered":"2024-09-13T06:13:24.055723+0000","last_clean":"2024-09-13T06:13:24.055723+0000","last_became_active":"2024-09-13T06:09:36.132376+0000","last_became_peered":"2024-09-13T06:09:36.132376+0000","last_unstale":"2024-09-13T06:13:24.055723+0000","last_undegraded":"2024-09-13T06:13:24.055723+0000","last_fullsized":"2024-09-13T06:13:24.055723+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"35'74","reported_seq":151,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:33.324338+0000","last_change":"2024-09-13T06:13:33.324338+0000","last_active":"2024-09-13T06:13:33.324338+0000","last_peered":"2024-09-13T06:13:33.324338+0000","last_clean":"2024-09-13T06:13:33.324338+0000","last_became_active":"2024-09-13T06:09:38.157579+0000","last_became_peered":"2024-09-13T06:09:38.157579+0000","last_unstale":"2024-09-13T06:13:33.324338+0000","last_undegraded":"2024-09-13T06:13:33.324338+0000","last_fullsized":"2024-09-13T06:13:33.324338+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'74","last_scrub_stamp":"2024-09-13T06:13:33.324060+0000","last_deep_scrub":"35'74","last_deep_scrub_stamp":"2024-09-13T06:13:33.324060+0000","last_clean_scrub_stamp":"2024-09-13T06:13:33.324060+0000","objects_scrubbed":9,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:44:12.725129+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:28.380130+0000","last_change":"2024-09-13T06:13:28.380182+0000","last_active":"2024-09-13T06:13:28.380130+0000","last_peered":"2024-09-13T06:13:28.380130+0000","last_clean":"2024-09-13T06:13:28.380130+0000","last_became_active":"2024-09-13T06:09:40.185234+0000","last_became_peered":"2024-09-13T06:09:40.185234+0000","last_unstale":"2024-09-13T06:13:28.380130+0000","last_undegraded":"2024-09-13T06:13:28.380130+0000","last_fullsized":"2024-09-13T06:13:28.380130+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:28.379942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:28.379942+0000","last_clean_scrub_stamp":"2024-09-13T06:13:28.379942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:42:49.566445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"35'11","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:00.802470+0000","last_change":"2024-09-13T06:09:42.176351+0000","last_active":"2024-09-13T06:12:00.802470+0000","last_peered":"2024-09-13T06:12:00.802470+0000","last_clean":"2024-09-13T06:12:00.802470+0000","last_became_active":"2024-09-13T06:09:42.170302+0000","last_became_peered":"2024-09-13T06:09:42.170302+0000","last_unstale":"2024-09-13T06:12:00.802470+0000","last_undegraded":"2024-09-13T06:12:00.802470+0000","last_fullsized":"2024-09-13T06:12:00.802470+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":25,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"35'10","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:42.801707+0000","last_change":"2024-09-13T06:09:34.122222+0000","last_active":"2024-09-13T06:11:42.801707+0000","last_peered":"2024-09-13T06:11:42.801707+0000","last_clean":"2024-09-13T06:11:42.801707+0000","last_became_active":"2024-09-13T06:09:34.121836+0000","last_became_peered":"2024-09-13T06:09:34.121836+0000","last_unstale":"2024-09-13T06:11:42.801707+0000","last_undegraded":"2024-09-13T06:11:42.801707+0000","last_fullsized":"2024-09-13T06:11:42.801707+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:24.055617+0000","last_change":"2024-09-13T06:09:32.137231+0000","last_active":"2024-09-13T06:13:24.055617+0000","last_peered":"2024-09-13T06:13:24.055617+0000","last_clean":"2024-09-13T06:13:24.055617+0000","last_became_active":"2024-09-13T06:09:32.136238+0000","last_became_peered":"2024-09-13T06:09:32.136238+0000","last_unstale":"2024-09-13T06:13:24.055617+0000","last_undegraded":"2024-09-13T06:13:24.055617+0000","last_fullsized":"2024-09-13T06:13:24.055617+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.440104+0000","last_change":"2024-09-13T06:09:24.221355+0000","last_active":"2024-09-13T06:13:25.440104+0000","last_peered":"2024-09-13T06:13:25.440104+0000","last_clean":"2024-09-13T06:13:25.440104+0000","last_became_active":"2024-09-13T06:09:22.217809+0000","last_became_peered":"2024-09-13T06:09:22.217809+0000","last_unstale":"2024-09-13T06:13:25.440104+0000","last_undegraded":"2024-09-13T06:13:25.440104+0000","last_fullsized":"2024-09-13T06:13:25.440104+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_clean_scrub_stamp":"2024-09-13T06:09:21.188659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001447545,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:33.855800+0000","last_change":"2024-09-13T06:13:33.855853+0000","last_active":"2024-09-13T06:13:33.855800+0000","last_peered":"2024-09-13T06:13:33.855800+0000","last_clean":"2024-09-13T06:13:33.855800+0000","last_became_active":"2024-09-13T06:09:36.151605+0000","last_became_peered":"2024-09-13T06:09:36.151605+0000","last_unstale":"2024-09-13T06:13:33.855800+0000","last_undegraded":"2024-09-13T06:13:33.855800+0000","last_fullsized":"2024-09-13T06:13:33.855800+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:33.855604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:33.855604+0000","last_clean_scrub_stamp":"2024-09-13T06:13:33.855604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:30:58.639342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"35'22","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:26.303751+0000","last_change":"2024-09-13T06:13:26.304189+0000","last_active":"2024-09-13T06:13:26.303751+0000","last_peered":"2024-09-13T06:13:26.303751+0000","last_clean":"2024-09-13T06:13:26.303751+0000","last_became_active":"2024-09-13T06:09:38.165916+0000","last_became_peered":"2024-09-13T06:09:38.165916+0000","last_unstale":"2024-09-13T06:13:26.303751+0000","last_undegraded":"2024-09-13T06:13:26.303751+0000","last_fullsized":"2024-09-13T06:13:26.303751+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'22","last_scrub_stamp":"2024-09-13T06:13:26.303565+0000","last_deep_scrub":"35'22","last_deep_scrub_stamp":"2024-09-13T06:13:26.303565+0000","last_clean_scrub_stamp":"2024-09-13T06:13:26.303565+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:32:31.420814+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"35'285","reported_seq":360,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:37.090244+0000","last_change":"2024-09-13T06:13:37.090244+0000","last_active":"2024-09-13T06:13:37.090244+0000","last_peered":"2024-09-13T06:13:37.090244+0000","last_clean":"2024-09-13T06:13:37.090244+0000","last_became_active":"2024-09-13T06:09:40.181415+0000","last_became_peered":"2024-09-13T06:09:40.181415+0000","last_unstale":"2024-09-13T06:13:37.090244+0000","last_undegraded":"2024-09-13T06:13:37.090244+0000","last_fullsized":"2024-09-13T06:13:37.090244+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-13T06:13:37.089987+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-13T06:13:37.089987+0000","last_clean_scrub_stamp":"2024-09-13T06:13:37.089987+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:47:34.898773+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:57.810873+0000","last_change":"2024-09-13T06:09:42.195360+0000","last_active":"2024-09-13T06:11:57.810873+0000","last_peered":"2024-09-13T06:11:57.810873+0000","last_clean":"2024-09-13T06:11:57.810873+0000","last_became_active":"2024-09-13T06:09:42.194558+0000","last_became_peered":"2024-09-13T06:09:42.194558+0000","last_unstale":"2024-09-13T06:11:57.810873+0000","last_undegraded":"2024-09-13T06:11:57.810873+0000","last_fullsized":"2024-09-13T06:11:57.810873+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"35'6","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.532877+0000","last_change":"2024-09-13T06:10:10.814500+0000","last_active":"2024-09-13T06:12:49.532877+0000","last_peered":"2024-09-13T06:12:49.532877+0000","last_clean":"2024-09-13T06:12:49.532877+0000","last_became_active":"2024-09-13T06:10:10.813656+0000","last_became_peered":"2024-09-13T06:10:10.813656+0000","last_unstale":"2024-09-13T06:12:49.532877+0000","last_undegraded":"2024-09-13T06:12:49.532877+0000","last_fullsized":"2024-09-13T06:12:49.532877+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:42.805772+0000","last_change":"2024-09-13T06:09:32.133206+0000","last_active":"2024-09-13T06:11:42.805772+0000","last_peered":"2024-09-13T06:11:42.805772+0000","last_clean":"2024-09-13T06:11:42.805772+0000","last_became_active":"2024-09-13T06:09:32.130385+0000","last_became_peered":"2024-09-13T06:09:32.130385+0000","last_unstale":"2024-09-13T06:11:42.805772+0000","last_undegraded":"2024-09-13T06:11:42.805772+0000","last_fullsized":"2024-09-13T06:11:42.805772+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:24.055153+0000","last_change":"2024-09-13T06:09:24.227867+0000","last_active":"2024-09-13T06:13:24.055153+0000","last_peered":"2024-09-13T06:13:24.055153+0000","last_clean":"2024-09-13T06:13:24.055153+0000","last_became_active":"2024-09-13T06:09:22.216905+0000","last_became_peered":"2024-09-13T06:09:22.216905+0000","last_unstale":"2024-09-13T06:13:24.055153+0000","last_undegraded":"2024-09-13T06:13:24.055153+0000","last_fullsized":"2024-09-13T06:13:24.055153+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_clean_scrub_stamp":"2024-09-13T06:09:21.188659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001005588,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:32.824531+0000","last_change":"2024-09-13T06:13:32.824584+0000","last_active":"2024-09-13T06:13:32.824531+0000","last_peered":"2024-09-13T06:13:32.824531+0000","last_clean":"2024-09-13T06:13:32.824531+0000","last_became_active":"2024-09-13T06:09:36.149051+0000","last_became_peered":"2024-09-13T06:09:36.149051+0000","last_unstale":"2024-09-13T06:13:32.824531+0000","last_undegraded":"2024-09-13T06:13:32.824531+0000","last_fullsized":"2024-09-13T06:13:32.824531+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:32.824332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:32.824332+0000","last_clean_scrub_stamp":"2024-09-13T06:13:32.824332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:49:10.096883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"35'15","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:39.760068+0000","last_change":"2024-09-13T06:13:39.760213+0000","last_active":"2024-09-13T06:13:39.760068+0000","last_peered":"2024-09-13T06:13:39.760068+0000","last_clean":"2024-09-13T06:13:39.760068+0000","last_became_active":"2024-09-13T06:09:38.173017+0000","last_became_peered":"2024-09-13T06:09:38.173017+0000","last_unstale":"2024-09-13T06:13:39.760068+0000","last_undegraded":"2024-09-13T06:13:39.760068+0000","last_fullsized":"2024-09-13T06:13:39.760068+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'15","last_scrub_stamp":"2024-09-13T06:13:39.759783+0000","last_deep_scrub":"35'15","last_deep_scrub_stamp":"2024-09-13T06:13:39.759783+0000","last_clean_scrub_stamp":"2024-09-13T06:13:39.759783+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:53:57.061723+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"35'285","reported_seq":402,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:30.299466+0000","last_change":"2024-09-13T06:13:30.299531+0000","last_active":"2024-09-13T06:13:30.299466+0000","last_peered":"2024-09-13T06:13:30.299466+0000","last_clean":"2024-09-13T06:13:30.299466+0000","last_became_active":"2024-09-13T06:09:40.170879+0000","last_became_peered":"2024-09-13T06:09:40.170879+0000","last_unstale":"2024-09-13T06:13:30.299466+0000","last_undegraded":"2024-09-13T06:13:30.299466+0000","last_fullsized":"2024-09-13T06:13:30.299466+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-13T06:13:30.299279+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-13T06:13:30.299279+0000","last_clean_scrub_stamp":"2024-09-13T06:13:30.299279+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:49:19.940955+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"33'3","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:57.805754+0000","last_change":"2024-09-13T06:09:42.183057+0000","last_active":"2024-09-13T06:11:57.805754+0000","last_peered":"2024-09-13T06:11:57.805754+0000","last_clean":"2024-09-13T06:11:57.805754+0000","last_became_active":"2024-09-13T06:09:42.178890+0000","last_became_peered":"2024-09-13T06:09:42.178890+0000","last_unstale":"2024-09-13T06:11:57.805754+0000","last_undegraded":"2024-09-13T06:11:57.805754+0000","last_fullsized":"2024-09-13T06:11:57.805754+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"35'4","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.343127+0000","last_change":"2024-09-13T06:09:34.104607+0000","last_active":"2024-09-13T06:12:49.343127+0000","last_peered":"2024-09-13T06:12:49.343127+0000","last_clean":"2024-09-13T06:12:49.343127+0000","last_became_active":"2024-09-13T06:09:34.104194+0000","last_became_peered":"2024-09-13T06:09:34.104194+0000","last_unstale":"2024-09-13T06:12:49.343127+0000","last_undegraded":"2024-09-13T06:12:49.343127+0000","last_fullsized":"2024-09-13T06:12:49.343127+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:42.801845+0000","last_change":"2024-09-13T06:09:32.118940+0000","last_active":"2024-09-13T06:11:42.801845+0000","last_peered":"2024-09-13T06:11:42.801845+0000","last_clean":"2024-09-13T06:11:42.801845+0000","last_became_active":"2024-09-13T06:09:32.118386+0000","last_became_peered":"2024-09-13T06:09:32.118386+0000","last_unstale":"2024-09-13T06:11:42.801845+0000","last_undegraded":"2024-09-13T06:11:42.801845+0000","last_fullsized":"2024-09-13T06:11:42.801845+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.440131+0000","last_change":"2024-09-13T06:09:24.222245+0000","last_active":"2024-09-13T06:13:25.440131+0000","last_peered":"2024-09-13T06:13:25.440131+0000","last_clean":"2024-09-13T06:13:25.440131+0000","last_became_active":"2024-09-13T06:09:22.495259+0000","last_became_peered":"2024-09-13T06:09:22.495259+0000","last_unstale":"2024-09-13T06:13:25.440131+0000","last_undegraded":"2024-09-13T06:13:25.440131+0000","last_fullsized":"2024-09-13T06:13:25.440131+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_clean_scrub_stamp":"2024-09-13T06:09:21.188659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002230409,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:36.776310+0000","last_change":"2024-09-13T06:13:36.776310+0000","last_active":"2024-09-13T06:13:36.776310+0000","last_peered":"2024-09-13T06:13:36.776310+0000","last_clean":"2024-09-13T06:13:36.776310+0000","last_became_active":"2024-09-13T06:09:36.144463+0000","last_became_peered":"2024-09-13T06:09:36.144463+0000","last_unstale":"2024-09-13T06:13:36.776310+0000","last_undegraded":"2024-09-13T06:13:36.776310+0000","last_fullsized":"2024-09-13T06:13:36.776310+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:36.776068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:36.776068+0000","last_clean_scrub_stamp":"2024-09-13T06:13:36.776068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:07:56.568181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"35'96","reported_seq":189,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:34.414417+0000","last_change":"2024-09-13T06:13:34.414511+0000","last_active":"2024-09-13T06:13:34.414417+0000","last_peered":"2024-09-13T06:13:34.414417+0000","last_clean":"2024-09-13T06:13:34.414417+0000","last_became_active":"2024-09-13T06:09:38.158436+0000","last_became_peered":"2024-09-13T06:09:38.158436+0000","last_unstale":"2024-09-13T06:13:34.414417+0000","last_undegraded":"2024-09-13T06:13:34.414417+0000","last_fullsized":"2024-09-13T06:13:34.414417+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'96","last_scrub_stamp":"2024-09-13T06:13:34.414208+0000","last_deep_scrub":"35'96","last_deep_scrub_stamp":"2024-09-13T06:13:34.414208+0000","last_clean_scrub_stamp":"2024-09-13T06:13:34.414208+0000","objects_scrubbed":8,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:05:39.013229+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.290861+0000","last_change":"2024-09-13T06:13:25.290882+0000","last_active":"2024-09-13T06:13:25.290861+0000","last_peered":"2024-09-13T06:13:25.290861+0000","last_clean":"2024-09-13T06:13:25.290861+0000","last_became_active":"2024-09-13T06:09:40.176677+0000","last_became_peered":"2024-09-13T06:09:40.176677+0000","last_unstale":"2024-09-13T06:13:25.290861+0000","last_undegraded":"2024-09-13T06:13:25.290861+0000","last_fullsized":"2024-09-13T06:13:25.290861+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:25.290780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:25.290780+0000","last_clean_scrub_stamp":"2024-09-13T06:13:25.290780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:27:24.453678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:56.800958+0000","last_change":"2024-09-13T06:09:42.205263+0000","last_active":"2024-09-13T06:11:56.800958+0000","last_peered":"2024-09-13T06:11:56.800958+0000","last_clean":"2024-09-13T06:11:56.800958+0000","last_became_active":"2024-09-13T06:09:42.204574+0000","last_became_peered":"2024-09-13T06:09:42.204574+0000","last_unstale":"2024-09-13T06:11:56.800958+0000","last_undegraded":"2024-09-13T06:11:56.800958+0000","last_fullsized":"2024-09-13T06:11:56.800958+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:40.425528+0000","last_change":"2024-09-13T06:13:40.425637+0000","last_active":"2024-09-13T06:13:40.425528+0000","last_peered":"2024-09-13T06:13:40.425528+0000","last_clean":"2024-09-13T06:13:40.425528+0000","last_became_active":"2024-09-13T06:09:42.197788+0000","last_became_peered":"2024-09-13T06:09:42.197788+0000","last_unstale":"2024-09-13T06:13:40.425528+0000","last_undegraded":"2024-09-13T06:13:40.425528+0000","last_fullsized":"2024-09-13T06:13:40.425528+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:40.425298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:40.425298+0000","last_clean_scrub_stamp":"2024-09-13T06:13:40.425298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:01:43.246247+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"35'8","reported_seq":62,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:56.800821+0000","last_change":"2024-09-13T06:09:34.104017+0000","last_active":"2024-09-13T06:11:56.800821+0000","last_peered":"2024-09-13T06:11:56.800821+0000","last_clean":"2024-09-13T06:11:56.800821+0000","last_became_active":"2024-09-13T06:09:34.101193+0000","last_became_peered":"2024-09-13T06:09:34.101193+0000","last_unstale":"2024-09-13T06:11:56.800821+0000","last_undegraded":"2024-09-13T06:11:56.800821+0000","last_fullsized":"2024-09-13T06:11:56.800821+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:52.809358+0000","last_change":"2024-09-13T06:09:32.125105+0000","last_active":"2024-09-13T06:11:52.809358+0000","last_peered":"2024-09-13T06:11:52.809358+0000","last_clean":"2024-09-13T06:11:52.809358+0000","last_became_active":"2024-09-13T06:09:32.124198+0000","last_became_peered":"2024-09-13T06:09:32.124198+0000","last_unstale":"2024-09-13T06:11:52.809358+0000","last_undegraded":"2024-09-13T06:11:52.809358+0000","last_fullsized":"2024-09-13T06:11:52.809358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:40.103866+0000","last_change":"2024-09-13T06:13:40.103927+0000","last_active":"2024-09-13T06:13:40.103866+0000","last_peered":"2024-09-13T06:13:40.103866+0000","last_clean":"2024-09-13T06:13:40.103866+0000","last_became_active":"2024-09-13T06:09:36.133568+0000","last_became_peered":"2024-09-13T06:09:36.133568+0000","last_unstale":"2024-09-13T06:13:40.103866+0000","last_undegraded":"2024-09-13T06:13:40.103866+0000","last_fullsized":"2024-09-13T06:13:40.103866+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:40.103666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:40.103666+0000","last_clean_scrub_stamp":"2024-09-13T06:13:40.103666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:14:26.486674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"35'39","reported_seq":95,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:31.841559+0000","last_change":"2024-09-13T06:13:31.841640+0000","last_active":"2024-09-13T06:13:31.841559+0000","last_peered":"2024-09-13T06:13:31.841559+0000","last_clean":"2024-09-13T06:13:31.841559+0000","last_became_active":"2024-09-13T06:09:38.172109+0000","last_became_peered":"2024-09-13T06:09:38.172109+0000","last_unstale":"2024-09-13T06:13:31.841559+0000","last_undegraded":"2024-09-13T06:13:31.841559+0000","last_fullsized":"2024-09-13T06:13:31.841559+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'39","last_scrub_stamp":"2024-09-13T06:13:31.841369+0000","last_deep_scrub":"35'39","last_deep_scrub_stamp":"2024-09-13T06:13:31.841369+0000","last_clean_scrub_stamp":"2024-09-13T06:13:31.841369+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:43:03.426580+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:02.811811+0000","last_change":"2024-09-13T06:09:40.189717+0000","last_active":"2024-09-13T06:12:02.811811+0000","last_peered":"2024-09-13T06:12:02.811811+0000","last_clean":"2024-09-13T06:12:02.811811+0000","last_became_active":"2024-09-13T06:09:40.189223+0000","last_became_peered":"2024-09-13T06:09:40.189223+0000","last_unstale":"2024-09-13T06:12:02.811811+0000","last_undegraded":"2024-09-13T06:12:02.811811+0000","last_fullsized":"2024-09-13T06:12:02.811811+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"35'5","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:24.056204+0000","last_change":"2024-09-13T06:09:42.179227+0000","last_active":"2024-09-13T06:13:24.056204+0000","last_peered":"2024-09-13T06:13:24.056204+0000","last_clean":"2024-09-13T06:13:24.056204+0000","last_became_active":"2024-09-13T06:09:42.177378+0000","last_became_peered":"2024-09-13T06:09:42.177378+0000","last_unstale":"2024-09-13T06:13:24.056204+0000","last_undegraded":"2024-09-13T06:13:24.056204+0000","last_fullsized":"2024-09-13T06:13:24.056204+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"35'18","reported_seq":76,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.344275+0000","last_change":"2024-09-13T06:09:34.119010+0000","last_active":"2024-09-13T06:12:49.344275+0000","last_peered":"2024-09-13T06:12:49.344275+0000","last_clean":"2024-09-13T06:12:49.344275+0000","last_became_active":"2024-09-13T06:09:34.118441+0000","last_became_peered":"2024-09-13T06:09:34.118441+0000","last_unstale":"2024-09-13T06:12:49.344275+0000","last_undegraded":"2024-09-13T06:12:49.344275+0000","last_fullsized":"2024-09-13T06:12:49.344275+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":59,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:56.800919+0000","last_change":"2024-09-13T06:09:32.139144+0000","last_active":"2024-09-13T06:11:56.800919+0000","last_peered":"2024-09-13T06:11:56.800919+0000","last_clean":"2024-09-13T06:11:56.800919+0000","last_became_active":"2024-09-13T06:09:32.138664+0000","last_became_peered":"2024-09-13T06:09:32.138664+0000","last_unstale":"2024-09-13T06:11:56.800919+0000","last_undegraded":"2024-09-13T06:11:56.800919+0000","last_fullsized":"2024-09-13T06:11:56.800919+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"35'5","reported_seq":238,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:30.836275+0000","last_change":"2024-09-13T06:13:30.836350+0000","last_active":"2024-09-13T06:13:30.836275+0000","last_peered":"2024-09-13T06:13:30.836275+0000","last_clean":"2024-09-13T06:13:30.836275+0000","last_became_active":"2024-09-13T06:09:36.153526+0000","last_became_peered":"2024-09-13T06:09:36.153526+0000","last_unstale":"2024-09-13T06:13:30.836275+0000","last_undegraded":"2024-09-13T06:13:30.836275+0000","last_fullsized":"2024-09-13T06:13:30.836275+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'5","last_scrub_stamp":"2024-09-13T06:13:30.836096+0000","last_deep_scrub":"35'5","last_deep_scrub_stamp":"2024-09-13T06:13:30.836096+0000","last_clean_scrub_stamp":"2024-09-13T06:13:30.836096+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:12:49.323535+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"35'9","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:37.292860+0000","last_change":"2024-09-13T06:13:37.292929+0000","last_active":"2024-09-13T06:13:37.292860+0000","last_peered":"2024-09-13T06:13:37.292860+0000","last_clean":"2024-09-13T06:13:37.292860+0000","last_became_active":"2024-09-13T06:09:38.150063+0000","last_became_peered":"2024-09-13T06:09:38.150063+0000","last_unstale":"2024-09-13T06:13:37.292860+0000","last_undegraded":"2024-09-13T06:13:37.292860+0000","last_fullsized":"2024-09-13T06:13:37.292860+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'9","last_scrub_stamp":"2024-09-13T06:13:37.292678+0000","last_deep_scrub":"35'9","last_deep_scrub_stamp":"2024-09-13T06:13:37.292678+0000","last_clean_scrub_stamp":"2024-09-13T06:13:37.292678+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:13:04.527644+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.383297+0000","last_change":"2024-09-13T06:13:25.383351+0000","last_active":"2024-09-13T06:13:25.383297+0000","last_peered":"2024-09-13T06:13:25.383297+0000","last_clean":"2024-09-13T06:13:25.383297+0000","last_became_active":"2024-09-13T06:09:40.181807+0000","last_became_peered":"2024-09-13T06:09:40.181807+0000","last_unstale":"2024-09-13T06:13:25.383297+0000","last_undegraded":"2024-09-13T06:13:25.383297+0000","last_fullsized":"2024-09-13T06:13:25.383297+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:25.383101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:25.383101+0000","last_clean_scrub_stamp":"2024-09-13T06:13:25.383101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:45:24.271310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"35'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.457558+0000","last_change":"2024-09-13T06:09:42.209380+0000","last_active":"2024-09-13T06:12:49.457558+0000","last_peered":"2024-09-13T06:12:49.457558+0000","last_clean":"2024-09-13T06:12:49.457558+0000","last_became_active":"2024-09-13T06:09:42.208567+0000","last_became_peered":"2024-09-13T06:09:42.208567+0000","last_unstale":"2024-09-13T06:12:49.457558+0000","last_undegraded":"2024-09-13T06:12:49.457558+0000","last_fullsized":"2024-09-13T06:12:49.457558+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"35'12","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.340208+0000","last_change":"2024-09-13T06:09:34.115480+0000","last_active":"2024-09-13T06:12:49.340208+0000","last_peered":"2024-09-13T06:12:49.340208+0000","last_clean":"2024-09-13T06:12:49.340208+0000","last_became_active":"2024-09-13T06:09:34.113455+0000","last_became_peered":"2024-09-13T06:09:34.113455+0000","last_unstale":"2024-09-13T06:12:49.340208+0000","last_undegraded":"2024-09-13T06:12:49.340208+0000","last_fullsized":"2024-09-13T06:12:49.340208+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:56.801004+0000","last_change":"2024-09-13T06:09:32.118643+0000","last_active":"2024-09-13T06:11:56.801004+0000","last_peered":"2024-09-13T06:11:56.801004+0000","last_clean":"2024-09-13T06:11:56.801004+0000","last_became_active":"2024-09-13T06:09:32.118235+0000","last_became_peered":"2024-09-13T06:09:32.118235+0000","last_unstale":"2024-09-13T06:11:56.801004+0000","last_undegraded":"2024-09-13T06:11:56.801004+0000","last_fullsized":"2024-09-13T06:11:56.801004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"35'2","reported_seq":230,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:41.478800+0000","last_change":"2024-09-13T06:13:41.478861+0000","last_active":"2024-09-13T06:13:41.478800+0000","last_peered":"2024-09-13T06:13:41.478800+0000","last_clean":"2024-09-13T06:13:41.478800+0000","last_became_active":"2024-09-13T06:09:36.135184+0000","last_became_peered":"2024-09-13T06:09:36.135184+0000","last_unstale":"2024-09-13T06:13:41.478800+0000","last_undegraded":"2024-09-13T06:13:41.478800+0000","last_fullsized":"2024-09-13T06:13:41.478800+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:13:41.478609+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:13:41.478609+0000","last_clean_scrub_stamp":"2024-09-13T06:13:41.478609+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:20:43.284625+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"35'49","reported_seq":121,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:31.284234+0000","last_change":"2024-09-13T06:13:31.284327+0000","last_active":"2024-09-13T06:13:31.284234+0000","last_peered":"2024-09-13T06:13:31.284234+0000","last_clean":"2024-09-13T06:13:31.284234+0000","last_became_active":"2024-09-13T06:09:38.166381+0000","last_became_peered":"2024-09-13T06:09:38.166381+0000","last_unstale":"2024-09-13T06:13:31.284234+0000","last_undegraded":"2024-09-13T06:13:31.284234+0000","last_fullsized":"2024-09-13T06:13:31.284234+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'49","last_scrub_stamp":"2024-09-13T06:13:31.283995+0000","last_deep_scrub":"35'49","last_deep_scrub_stamp":"2024-09-13T06:13:31.283995+0000","last_clean_scrub_stamp":"2024-09-13T06:13:31.283995+0000","objects_scrubbed":6,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:53:13.436645+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:33.140501+0000","last_change":"2024-09-13T06:13:33.140552+0000","last_active":"2024-09-13T06:13:33.140501+0000","last_peered":"2024-09-13T06:13:33.140501+0000","last_clean":"2024-09-13T06:13:33.140501+0000","last_became_active":"2024-09-13T06:09:40.181329+0000","last_became_peered":"2024-09-13T06:09:40.181329+0000","last_unstale":"2024-09-13T06:13:33.140501+0000","last_undegraded":"2024-09-13T06:13:33.140501+0000","last_fullsized":"2024-09-13T06:13:33.140501+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:33.140310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:33.140310+0000","last_clean_scrub_stamp":"2024-09-13T06:13:33.140310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:08:31.071212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:12.814732+0000","last_change":"2024-09-13T06:09:42.211550+0000","last_active":"2024-09-13T06:12:12.814732+0000","last_peered":"2024-09-13T06:12:12.814732+0000","last_clean":"2024-09-13T06:12:12.814732+0000","last_became_active":"2024-09-13T06:09:42.211005+0000","last_became_peered":"2024-09-13T06:09:42.211005+0000","last_unstale":"2024-09-13T06:12:12.814732+0000","last_undegraded":"2024-09-13T06:12:12.814732+0000","last_fullsized":"2024-09-13T06:12:12.814732+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"35'6","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:42.783312+0000","last_change":"2024-09-13T06:13:42.783373+0000","last_active":"2024-09-13T06:13:42.783312+0000","last_peered":"2024-09-13T06:13:42.783312+0000","last_clean":"2024-09-13T06:13:42.783312+0000","last_became_active":"2024-09-13T06:09:34.126798+0000","last_became_peered":"2024-09-13T06:09:34.126798+0000","last_unstale":"2024-09-13T06:13:42.783312+0000","last_undegraded":"2024-09-13T06:13:42.783312+0000","last_fullsized":"2024-09-13T06:13:42.783312+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:13:42.783125+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:13:42.783125+0000","last_clean_scrub_stamp":"2024-09-13T06:13:42.783125+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:22:51.788479+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:57.805897+0000","last_change":"2024-09-13T06:09:32.126749+0000","last_active":"2024-09-13T06:11:57.805897+0000","last_peered":"2024-09-13T06:11:57.805897+0000","last_clean":"2024-09-13T06:11:57.805897+0000","last_became_active":"2024-09-13T06:09:32.126213+0000","last_became_peered":"2024-09-13T06:09:32.126213+0000","last_unstale":"2024-09-13T06:11:57.805897+0000","last_undegraded":"2024-09-13T06:11:57.805897+0000","last_fullsized":"2024-09-13T06:11:57.805897+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:34.825358+0000","last_change":"2024-09-13T06:13:34.825411+0000","last_active":"2024-09-13T06:13:34.825358+0000","last_peered":"2024-09-13T06:13:34.825358+0000","last_clean":"2024-09-13T06:13:34.825358+0000","last_became_active":"2024-09-13T06:09:36.148016+0000","last_became_peered":"2024-09-13T06:09:36.148016+0000","last_unstale":"2024-09-13T06:13:34.825358+0000","last_undegraded":"2024-09-13T06:13:34.825358+0000","last_fullsized":"2024-09-13T06:13:34.825358+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:34.825172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:34.825172+0000","last_clean_scrub_stamp":"2024-09-13T06:13:34.825172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:35:11.379450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"35'36","reported_seq":91,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:39.479724+0000","last_change":"2024-09-13T06:13:39.479798+0000","last_active":"2024-09-13T06:13:39.479724+0000","last_peered":"2024-09-13T06:13:39.479724+0000","last_clean":"2024-09-13T06:13:39.479724+0000","last_became_active":"2024-09-13T06:09:38.141182+0000","last_became_peered":"2024-09-13T06:09:38.141182+0000","last_unstale":"2024-09-13T06:13:39.479724+0000","last_undegraded":"2024-09-13T06:13:39.479724+0000","last_fullsized":"2024-09-13T06:13:39.479724+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'36","last_scrub_stamp":"2024-09-13T06:13:39.479521+0000","last_deep_scrub":"35'36","last_deep_scrub_stamp":"2024-09-13T06:13:39.479521+0000","last_clean_scrub_stamp":"2024-09-13T06:13:39.479521+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:51:47.667173+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:30.363101+0000","last_change":"2024-09-13T06:13:30.363157+0000","last_active":"2024-09-13T06:13:30.363101+0000","last_peered":"2024-09-13T06:13:30.363101+0000","last_clean":"2024-09-13T06:13:30.363101+0000","last_became_active":"2024-09-13T06:09:40.166229+0000","last_became_peered":"2024-09-13T06:09:40.166229+0000","last_unstale":"2024-09-13T06:13:30.363101+0000","last_undegraded":"2024-09-13T06:13:30.363101+0000","last_fullsized":"2024-09-13T06:13:30.363101+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:30.362905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:30.362905+0000","last_clean_scrub_stamp":"2024-09-13T06:13:30.362905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:24:17.255873+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"35'6","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.131417+0000","last_change":"2024-09-13T06:09:34.122302+0000","last_active":"2024-09-13T06:12:49.131417+0000","last_peered":"2024-09-13T06:12:49.131417+0000","last_clean":"2024-09-13T06:12:49.131417+0000","last_became_active":"2024-09-13T06:09:34.122034+0000","last_became_peered":"2024-09-13T06:09:34.122034+0000","last_unstale":"2024-09-13T06:12:49.131417+0000","last_undegraded":"2024-09-13T06:12:49.131417+0000","last_fullsized":"2024-09-13T06:12:49.131417+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:20.953616+0000","last_change":"2024-09-13T06:09:32.124543+0000","last_active":"2024-09-13T06:13:20.953616+0000","last_peered":"2024-09-13T06:13:20.953616+0000","last_clean":"2024-09-13T06:13:20.953616+0000","last_became_active":"2024-09-13T06:09:32.121948+0000","last_became_peered":"2024-09-13T06:09:32.121948+0000","last_unstale":"2024-09-13T06:13:20.953616+0000","last_undegraded":"2024-09-13T06:13:20.953616+0000","last_fullsized":"2024-09-13T06:13:20.953616+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:24.055577+0000","last_change":"2024-09-13T06:09:36.132935+0000","last_active":"2024-09-13T06:13:24.055577+0000","last_peered":"2024-09-13T06:13:24.055577+0000","last_clean":"2024-09-13T06:13:24.055577+0000","last_became_active":"2024-09-13T06:09:36.132227+0000","last_became_peered":"2024-09-13T06:09:36.132227+0000","last_unstale":"2024-09-13T06:13:24.055577+0000","last_undegraded":"2024-09-13T06:13:24.055577+0000","last_fullsized":"2024-09-13T06:13:24.055577+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"35'63","reported_seq":136,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:38.262967+0000","last_change":"2024-09-13T06:13:38.263042+0000","last_active":"2024-09-13T06:13:38.262967+0000","last_peered":"2024-09-13T06:13:38.262967+0000","last_clean":"2024-09-13T06:13:38.262967+0000","last_became_active":"2024-09-13T06:09:38.150070+0000","last_became_peered":"2024-09-13T06:09:38.150070+0000","last_unstale":"2024-09-13T06:13:38.262967+0000","last_undegraded":"2024-09-13T06:13:38.262967+0000","last_fullsized":"2024-09-13T06:13:38.262967+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'63","last_scrub_stamp":"2024-09-13T06:13:38.262747+0000","last_deep_scrub":"35'63","last_deep_scrub_stamp":"2024-09-13T06:13:38.262747+0000","last_clean_scrub_stamp":"2024-09-13T06:13:38.262747+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:56:34.974972+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:26.401270+0000","last_change":"2024-09-13T06:13:26.401325+0000","last_active":"2024-09-13T06:13:26.401270+0000","last_peered":"2024-09-13T06:13:26.401270+0000","last_clean":"2024-09-13T06:13:26.401270+0000","last_became_active":"2024-09-13T06:09:40.168550+0000","last_became_peered":"2024-09-13T06:09:40.168550+0000","last_unstale":"2024-09-13T06:13:26.401270+0000","last_undegraded":"2024-09-13T06:13:26.401270+0000","last_fullsized":"2024-09-13T06:13:26.401270+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:26.401059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:26.401059+0000","last_clean_scrub_stamp":"2024-09-13T06:13:26.401059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:03:36.749162+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"35'14","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:05.803513+0000","last_change":"2024-09-13T06:09:42.212051+0000","last_active":"2024-09-13T06:12:05.803513+0000","last_peered":"2024-09-13T06:12:05.803513+0000","last_clean":"2024-09-13T06:12:05.803513+0000","last_became_active":"2024-09-13T06:09:42.211508+0000","last_became_peered":"2024-09-13T06:09:42.211508+0000","last_unstale":"2024-09-13T06:12:05.803513+0000","last_undegraded":"2024-09-13T06:12:05.803513+0000","last_fullsized":"2024-09-13T06:12:05.803513+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"35'8","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:24.055460+0000","last_change":"2024-09-13T06:09:34.123413+0000","last_active":"2024-09-13T06:13:24.055460+0000","last_peered":"2024-09-13T06:13:24.055460+0000","last_clean":"2024-09-13T06:13:24.055460+0000","last_became_active":"2024-09-13T06:09:34.122881+0000","last_became_peered":"2024-09-13T06:09:34.122881+0000","last_unstale":"2024-09-13T06:13:24.055460+0000","last_undegraded":"2024-09-13T06:13:24.055460+0000","last_fullsized":"2024-09-13T06:13:24.055460+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":11,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:57.805580+0000","last_change":"2024-09-13T06:09:32.120176+0000","last_active":"2024-09-13T06:11:57.805580+0000","last_peered":"2024-09-13T06:11:57.805580+0000","last_clean":"2024-09-13T06:11:57.805580+0000","last_became_active":"2024-09-13T06:09:32.119573+0000","last_became_peered":"2024-09-13T06:09:32.119573+0000","last_unstale":"2024-09-13T06:11:57.805580+0000","last_undegraded":"2024-09-13T06:11:57.805580+0000","last_fullsized":"2024-09-13T06:11:57.805580+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:41.797981+0000","last_change":"2024-09-13T06:09:36.128456+0000","last_active":"2024-09-13T06:11:41.797981+0000","last_peered":"2024-09-13T06:11:41.797981+0000","last_clean":"2024-09-13T06:11:41.797981+0000","last_became_active":"2024-09-13T06:09:36.127719+0000","last_became_peered":"2024-09-13T06:09:36.127719+0000","last_unstale":"2024-09-13T06:11:41.797981+0000","last_undegraded":"2024-09-13T06:11:41.797981+0000","last_fullsized":"2024-09-13T06:11:41.797981+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"35'40","reported_seq":90,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:20.754182+0000","last_change":"2024-09-13T06:09:38.176074+0000","last_active":"2024-09-13T06:13:20.754182+0000","last_peered":"2024-09-13T06:13:20.754182+0000","last_clean":"2024-09-13T06:13:20.754182+0000","last_became_active":"2024-09-13T06:09:38.175443+0000","last_became_peered":"2024-09-13T06:09:38.175443+0000","last_unstale":"2024-09-13T06:13:20.754182+0000","last_undegraded":"2024-09-13T06:13:20.754182+0000","last_fullsized":"2024-09-13T06:13:20.754182+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:12.809281+0000","last_change":"2024-09-13T06:09:40.185799+0000","last_active":"2024-09-13T06:12:12.809281+0000","last_peered":"2024-09-13T06:12:12.809281+0000","last_clean":"2024-09-13T06:12:12.809281+0000","last_became_active":"2024-09-13T06:09:40.185222+0000","last_became_peered":"2024-09-13T06:09:40.185222+0000","last_unstale":"2024-09-13T06:12:12.809281+0000","last_undegraded":"2024-09-13T06:12:12.809281+0000","last_fullsized":"2024-09-13T06:12:12.809281+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:02.811935+0000","last_change":"2024-09-13T06:09:42.197504+0000","last_active":"2024-09-13T06:12:02.811935+0000","last_peered":"2024-09-13T06:12:02.811935+0000","last_clean":"2024-09-13T06:12:02.811935+0000","last_became_active":"2024-09-13T06:09:42.196679+0000","last_became_peered":"2024-09-13T06:09:42.196679+0000","last_unstale":"2024-09-13T06:12:02.811935+0000","last_undegraded":"2024-09-13T06:12:02.811935+0000","last_fullsized":"2024-09-13T06:12:02.811935+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"35'16","reported_seq":86,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:38.804179+0000","last_change":"2024-09-13T06:13:38.804245+0000","last_active":"2024-09-13T06:13:38.804179+0000","last_peered":"2024-09-13T06:13:38.804179+0000","last_clean":"2024-09-13T06:13:38.804179+0000","last_became_active":"2024-09-13T06:09:34.132777+0000","last_became_peered":"2024-09-13T06:09:34.132777+0000","last_unstale":"2024-09-13T06:13:38.804179+0000","last_undegraded":"2024-09-13T06:13:38.804179+0000","last_fullsized":"2024-09-13T06:13:38.804179+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'16","last_scrub_stamp":"2024-09-13T06:13:38.803976+0000","last_deep_scrub":"35'16","last_deep_scrub_stamp":"2024-09-13T06:13:38.803976+0000","last_clean_scrub_stamp":"2024-09-13T06:13:38.803976+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:52:39.806244+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":57,"num_read_kb":53,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:02.806927+0000","last_change":"2024-09-13T06:09:32.118851+0000","last_active":"2024-09-13T06:12:02.806927+0000","last_peered":"2024-09-13T06:12:02.806927+0000","last_clean":"2024-09-13T06:12:02.806927+0000","last_became_active":"2024-09-13T06:09:32.117988+0000","last_became_peered":"2024-09-13T06:09:32.117988+0000","last_unstale":"2024-09-13T06:12:02.806927+0000","last_undegraded":"2024-09-13T06:12:02.806927+0000","last_fullsized":"2024-09-13T06:12:02.806927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:06.803100+0000","last_change":"2024-09-13T06:09:36.130203+0000","last_active":"2024-09-13T06:12:06.803100+0000","last_peered":"2024-09-13T06:12:06.803100+0000","last_clean":"2024-09-13T06:12:06.803100+0000","last_became_active":"2024-09-13T06:09:36.129471+0000","last_became_peered":"2024-09-13T06:09:36.129471+0000","last_unstale":"2024-09-13T06:12:06.803100+0000","last_undegraded":"2024-09-13T06:12:06.803100+0000","last_fullsized":"2024-09-13T06:12:06.803100+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"35'41","reported_seq":97,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:35.293601+0000","last_change":"2024-09-13T06:13:35.293684+0000","last_active":"2024-09-13T06:13:35.293601+0000","last_peered":"2024-09-13T06:13:35.293601+0000","last_clean":"2024-09-13T06:13:35.293601+0000","last_became_active":"2024-09-13T06:09:38.153433+0000","last_became_peered":"2024-09-13T06:09:38.153433+0000","last_unstale":"2024-09-13T06:13:35.293601+0000","last_undegraded":"2024-09-13T06:13:35.293601+0000","last_fullsized":"2024-09-13T06:13:35.293601+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'41","last_scrub_stamp":"2024-09-13T06:13:35.293395+0000","last_deep_scrub":"35'41","last_deep_scrub_stamp":"2024-09-13T06:13:35.293395+0000","last_clean_scrub_stamp":"2024-09-13T06:13:35.293395+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:48:31.286025+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":55,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:29.307769+0000","last_change":"2024-09-13T06:13:29.307769+0000","last_active":"2024-09-13T06:13:29.307769+0000","last_peered":"2024-09-13T06:13:29.307769+0000","last_clean":"2024-09-13T06:13:29.307769+0000","last_became_active":"2024-09-13T06:09:40.171455+0000","last_became_peered":"2024-09-13T06:09:40.171455+0000","last_unstale":"2024-09-13T06:13:29.307769+0000","last_undegraded":"2024-09-13T06:13:29.307769+0000","last_fullsized":"2024-09-13T06:13:29.307769+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:29.307405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:29.307405+0000","last_clean_scrub_stamp":"2024-09-13T06:13:29.307405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:02:21.851168+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"35'5","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:02.811905+0000","last_change":"2024-09-13T06:09:42.202743+0000","last_active":"2024-09-13T06:12:02.811905+0000","last_peered":"2024-09-13T06:12:02.811905+0000","last_clean":"2024-09-13T06:12:02.811905+0000","last_became_active":"2024-09-13T06:09:42.202004+0000","last_became_peered":"2024-09-13T06:09:42.202004+0000","last_unstale":"2024-09-13T06:12:02.811905+0000","last_undegraded":"2024-09-13T06:12:02.811905+0000","last_fullsized":"2024-09-13T06:12:02.811905+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:05.803617+0000","last_change":"2024-09-13T06:09:34.117065+0000","last_active":"2024-09-13T06:12:05.803617+0000","last_peered":"2024-09-13T06:12:05.803617+0000","last_clean":"2024-09-13T06:12:05.803617+0000","last_became_active":"2024-09-13T06:09:34.116197+0000","last_became_peered":"2024-09-13T06:09:34.116197+0000","last_unstale":"2024-09-13T06:12:05.803617+0000","last_undegraded":"2024-09-13T06:12:05.803617+0000","last_fullsized":"2024-09-13T06:12:05.803617+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"35'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:02.812005+0000","last_change":"2024-09-13T06:09:32.132784+0000","last_active":"2024-09-13T06:12:02.812005+0000","last_peered":"2024-09-13T06:12:02.812005+0000","last_clean":"2024-09-13T06:12:02.812005+0000","last_became_active":"2024-09-13T06:09:32.124989+0000","last_became_peered":"2024-09-13T06:09:32.124989+0000","last_unstale":"2024-09-13T06:12:02.812005+0000","last_undegraded":"2024-09-13T06:12:02.812005+0000","last_fullsized":"2024-09-13T06:12:02.812005+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:36.119134+0000","last_change":"2024-09-13T06:13:36.119188+0000","last_active":"2024-09-13T06:13:36.119134+0000","last_peered":"2024-09-13T06:13:36.119134+0000","last_clean":"2024-09-13T06:13:36.119134+0000","last_became_active":"2024-09-13T06:09:36.140149+0000","last_became_peered":"2024-09-13T06:09:36.140149+0000","last_unstale":"2024-09-13T06:13:36.119134+0000","last_undegraded":"2024-09-13T06:13:36.119134+0000","last_fullsized":"2024-09-13T06:13:36.119134+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:36.118904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:36.118904+0000","last_clean_scrub_stamp":"2024-09-13T06:13:36.118904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:21:56.564481+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'10","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.442757+0000","last_change":"2024-09-13T06:09:38.178539+0000","last_active":"2024-09-13T06:13:25.442757+0000","last_peered":"2024-09-13T06:13:25.442757+0000","last_clean":"2024-09-13T06:13:25.442757+0000","last_became_active":"2024-09-13T06:09:38.177699+0000","last_became_peered":"2024-09-13T06:09:38.177699+0000","last_unstale":"2024-09-13T06:13:25.442757+0000","last_undegraded":"2024-09-13T06:13:25.442757+0000","last_fullsized":"2024-09-13T06:13:25.442757+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:37.110448+0000","last_clean_scrub_stamp":"2024-09-13T06:09:37.110448+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"35'285","reported_seq":383,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:29.354619+0000","last_change":"2024-09-13T06:13:29.354681+0000","last_active":"2024-09-13T06:13:29.354619+0000","last_peered":"2024-09-13T06:13:29.354619+0000","last_clean":"2024-09-13T06:13:29.354619+0000","last_became_active":"2024-09-13T06:09:40.166780+0000","last_became_peered":"2024-09-13T06:09:40.166780+0000","last_unstale":"2024-09-13T06:13:29.354619+0000","last_undegraded":"2024-09-13T06:13:29.354619+0000","last_fullsized":"2024-09-13T06:13:29.354619+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-13T06:13:29.354428+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-13T06:13:29.354428+0000","last_clean_scrub_stamp":"2024-09-13T06:13:29.354428+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:07:16.616986+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"35'2","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:02.811733+0000","last_change":"2024-09-13T06:09:42.201112+0000","last_active":"2024-09-13T06:12:02.811733+0000","last_peered":"2024-09-13T06:12:02.811733+0000","last_clean":"2024-09-13T06:12:02.811733+0000","last_became_active":"2024-09-13T06:09:42.196063+0000","last_became_peered":"2024-09-13T06:09:42.196063+0000","last_unstale":"2024-09-13T06:12:02.811733+0000","last_undegraded":"2024-09-13T06:12:02.811733+0000","last_fullsized":"2024-09-13T06:12:02.811733+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"35'6","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:48.977388+0000","last_change":"2024-09-13T06:09:34.108198+0000","last_active":"2024-09-13T06:12:48.977388+0000","last_peered":"2024-09-13T06:12:48.977388+0000","last_clean":"2024-09-13T06:12:48.977388+0000","last_became_active":"2024-09-13T06:09:34.107821+0000","last_became_peered":"2024-09-13T06:09:34.107821+0000","last_unstale":"2024-09-13T06:12:48.977388+0000","last_undegraded":"2024-09-13T06:12:48.977388+0000","last_fullsized":"2024-09-13T06:12:48.977388+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"35'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:02.807006+0000","last_change":"2024-09-13T06:09:32.141297+0000","last_active":"2024-09-13T06:12:02.807006+0000","last_peered":"2024-09-13T06:12:02.807006+0000","last_clean":"2024-09-13T06:12:02.807006+0000","last_became_active":"2024-09-13T06:09:32.140816+0000","last_became_peered":"2024-09-13T06:09:32.140816+0000","last_unstale":"2024-09-13T06:12:02.807006+0000","last_undegraded":"2024-09-13T06:12:02.807006+0000","last_fullsized":"2024-09-13T06:12:02.807006+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:34.100074+0000","last_change":"2024-09-13T06:13:34.100128+0000","last_active":"2024-09-13T06:13:34.100074+0000","last_peered":"2024-09-13T06:13:34.100074+0000","last_clean":"2024-09-13T06:13:34.100074+0000","last_became_active":"2024-09-13T06:09:36.140770+0000","last_became_peered":"2024-09-13T06:09:36.140770+0000","last_unstale":"2024-09-13T06:13:34.100074+0000","last_undegraded":"2024-09-13T06:13:34.100074+0000","last_fullsized":"2024-09-13T06:13:34.100074+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:34.099877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:34.099877+0000","last_clean_scrub_stamp":"2024-09-13T06:13:34.099877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:24:15.804560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"35'46","reported_seq":104,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.335560+0000","last_change":"2024-09-13T06:13:25.335732+0000","last_active":"2024-09-13T06:13:25.335560+0000","last_peered":"2024-09-13T06:13:25.335560+0000","last_clean":"2024-09-13T06:13:25.335560+0000","last_became_active":"2024-09-13T06:09:38.166681+0000","last_became_peered":"2024-09-13T06:09:38.166681+0000","last_unstale":"2024-09-13T06:13:25.335560+0000","last_undegraded":"2024-09-13T06:13:25.335560+0000","last_fullsized":"2024-09-13T06:13:25.335560+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'46","last_scrub_stamp":"2024-09-13T06:13:25.335323+0000","last_deep_scrub":"35'46","last_deep_scrub_stamp":"2024-09-13T06:13:25.335323+0000","last_clean_scrub_stamp":"2024-09-13T06:13:25.335323+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:32:30.737347+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:28.331282+0000","last_change":"2024-09-13T06:13:28.331392+0000","last_active":"2024-09-13T06:13:28.331282+0000","last_peered":"2024-09-13T06:13:28.331282+0000","last_clean":"2024-09-13T06:13:28.331282+0000","last_became_active":"2024-09-13T06:09:40.178484+0000","last_became_peered":"2024-09-13T06:09:40.178484+0000","last_unstale":"2024-09-13T06:13:28.331282+0000","last_undegraded":"2024-09-13T06:13:28.331282+0000","last_fullsized":"2024-09-13T06:13:28.331282+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:28.331050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:28.331050+0000","last_clean_scrub_stamp":"2024-09-13T06:13:28.331050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:53:24.217481+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"35'4","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:07.808288+0000","last_change":"2024-09-13T06:09:42.201123+0000","last_active":"2024-09-13T06:12:07.808288+0000","last_peered":"2024-09-13T06:12:07.808288+0000","last_clean":"2024-09-13T06:12:07.808288+0000","last_became_active":"2024-09-13T06:09:42.199609+0000","last_became_peered":"2024-09-13T06:09:42.199609+0000","last_unstale":"2024-09-13T06:12:07.808288+0000","last_undegraded":"2024-09-13T06:12:07.808288+0000","last_fullsized":"2024-09-13T06:12:07.808288+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"35'5","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.662895+0000","last_change":"2024-09-13T06:09:34.100754+0000","last_active":"2024-09-13T06:12:49.662895+0000","last_peered":"2024-09-13T06:12:49.662895+0000","last_clean":"2024-09-13T06:12:49.662895+0000","last_became_active":"2024-09-13T06:09:34.100355+0000","last_became_peered":"2024-09-13T06:09:34.100355+0000","last_unstale":"2024-09-13T06:12:49.662895+0000","last_undegraded":"2024-09-13T06:12:49.662895+0000","last_fullsized":"2024-09-13T06:12:49.662895+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:02.812140+0000","last_change":"2024-09-13T06:09:32.133279+0000","last_active":"2024-09-13T06:12:02.812140+0000","last_peered":"2024-09-13T06:12:02.812140+0000","last_clean":"2024-09-13T06:12:02.812140+0000","last_became_active":"2024-09-13T06:09:32.125049+0000","last_became_peered":"2024-09-13T06:09:32.125049+0000","last_unstale":"2024-09-13T06:12:02.812140+0000","last_undegraded":"2024-09-13T06:12:02.812140+0000","last_fullsized":"2024-09-13T06:12:02.812140+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:06.803061+0000","last_change":"2024-09-13T06:09:36.128406+0000","last_active":"2024-09-13T06:12:06.803061+0000","last_peered":"2024-09-13T06:12:06.803061+0000","last_clean":"2024-09-13T06:12:06.803061+0000","last_became_active":"2024-09-13T06:09:36.127684+0000","last_became_peered":"2024-09-13T06:09:36.127684+0000","last_unstale":"2024-09-13T06:12:06.803061+0000","last_undegraded":"2024-09-13T06:12:06.803061+0000","last_fullsized":"2024-09-13T06:12:06.803061+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"35'37","reported_seq":92,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:34.298374+0000","last_change":"2024-09-13T06:13:34.298450+0000","last_active":"2024-09-13T06:13:34.298374+0000","last_peered":"2024-09-13T06:13:34.298374+0000","last_clean":"2024-09-13T06:13:34.298374+0000","last_became_active":"2024-09-13T06:09:38.157278+0000","last_became_peered":"2024-09-13T06:09:38.157278+0000","last_unstale":"2024-09-13T06:13:34.298374+0000","last_undegraded":"2024-09-13T06:13:34.298374+0000","last_fullsized":"2024-09-13T06:13:34.298374+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'37","last_scrub_stamp":"2024-09-13T06:13:34.298176+0000","last_deep_scrub":"35'37","last_deep_scrub_stamp":"2024-09-13T06:13:34.298176+0000","last_clean_scrub_stamp":"2024-09-13T06:13:34.298176+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:13:34.885749+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:07.813256+0000","last_change":"2024-09-13T06:09:40.189802+0000","last_active":"2024-09-13T06:12:07.813256+0000","last_peered":"2024-09-13T06:12:07.813256+0000","last_clean":"2024-09-13T06:12:07.813256+0000","last_became_active":"2024-09-13T06:09:40.189165+0000","last_became_peered":"2024-09-13T06:09:40.189165+0000","last_unstale":"2024-09-13T06:12:07.813256+0000","last_undegraded":"2024-09-13T06:12:07.813256+0000","last_fullsized":"2024-09-13T06:12:07.813256+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:07.813661+0000","last_change":"2024-09-13T06:09:42.214239+0000","last_active":"2024-09-13T06:12:07.813661+0000","last_peered":"2024-09-13T06:12:07.813661+0000","last_clean":"2024-09-13T06:12:07.813661+0000","last_became_active":"2024-09-13T06:09:42.213756+0000","last_became_peered":"2024-09-13T06:09:42.213756+0000","last_unstale":"2024-09-13T06:12:07.813661+0000","last_undegraded":"2024-09-13T06:12:07.813661+0000","last_fullsized":"2024-09-13T06:12:07.813661+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:02.811853+0000","last_change":"2024-09-13T06:09:34.118052+0000","last_active":"2024-09-13T06:12:02.811853+0000","last_peered":"2024-09-13T06:12:02.811853+0000","last_clean":"2024-09-13T06:12:02.811853+0000","last_became_active":"2024-09-13T06:09:34.117789+0000","last_became_peered":"2024-09-13T06:09:34.117789+0000","last_unstale":"2024-09-13T06:12:02.811853+0000","last_undegraded":"2024-09-13T06:12:02.811853+0000","last_fullsized":"2024-09-13T06:12:02.811853+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:24.055218+0000","last_change":"2024-09-13T06:09:32.135815+0000","last_active":"2024-09-13T06:13:24.055218+0000","last_peered":"2024-09-13T06:13:24.055218+0000","last_clean":"2024-09-13T06:13:24.055218+0000","last_became_active":"2024-09-13T06:09:32.134696+0000","last_became_peered":"2024-09-13T06:09:32.134696+0000","last_unstale":"2024-09-13T06:13:24.055218+0000","last_undegraded":"2024-09-13T06:13:24.055218+0000","last_fullsized":"2024-09-13T06:13:24.055218+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:42.137324+0000","last_change":"2024-09-13T06:13:42.137375+0000","last_active":"2024-09-13T06:13:42.137324+0000","last_peered":"2024-09-13T06:13:42.137324+0000","last_clean":"2024-09-13T06:13:42.137324+0000","last_became_active":"2024-09-13T06:09:36.131976+0000","last_became_peered":"2024-09-13T06:09:36.131976+0000","last_unstale":"2024-09-13T06:13:42.137324+0000","last_undegraded":"2024-09-13T06:13:42.137324+0000","last_fullsized":"2024-09-13T06:13:42.137324+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:42.137148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:42.137148+0000","last_clean_scrub_stamp":"2024-09-13T06:13:42.137148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:12:22.095929+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"35'30","reported_seq":83,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:37.757579+0000","last_change":"2024-09-13T06:13:37.757650+0000","last_active":"2024-09-13T06:13:37.757579+0000","last_peered":"2024-09-13T06:13:37.757579+0000","last_clean":"2024-09-13T06:13:37.757579+0000","last_became_active":"2024-09-13T06:09:38.171538+0000","last_became_peered":"2024-09-13T06:09:38.171538+0000","last_unstale":"2024-09-13T06:13:37.757579+0000","last_undegraded":"2024-09-13T06:13:37.757579+0000","last_fullsized":"2024-09-13T06:13:37.757579+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'30","last_scrub_stamp":"2024-09-13T06:13:37.757382+0000","last_deep_scrub":"35'30","last_deep_scrub_stamp":"2024-09-13T06:13:37.757382+0000","last_clean_scrub_stamp":"2024-09-13T06:13:37.757382+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:21:11.687429+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:12.814635+0000","last_change":"2024-09-13T06:09:40.185942+0000","last_active":"2024-09-13T06:12:12.814635+0000","last_peered":"2024-09-13T06:12:12.814635+0000","last_clean":"2024-09-13T06:12:12.814635+0000","last_became_active":"2024-09-13T06:09:40.185277+0000","last_became_peered":"2024-09-13T06:09:40.185277+0000","last_unstale":"2024-09-13T06:12:12.814635+0000","last_undegraded":"2024-09-13T06:12:12.814635+0000","last_fullsized":"2024-09-13T06:12:12.814635+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:39.124182+0000","last_clean_scrub_stamp":"2024-09-13T06:09:39.124182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"35'6","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.135982+0000","last_change":"2024-09-13T06:09:42.211802+0000","last_active":"2024-09-13T06:12:49.135982+0000","last_peered":"2024-09-13T06:12:49.135982+0000","last_clean":"2024-09-13T06:12:49.135982+0000","last_became_active":"2024-09-13T06:09:42.211176+0000","last_became_peered":"2024-09-13T06:09:42.211176+0000","last_unstale":"2024-09-13T06:12:49.135982+0000","last_undegraded":"2024-09-13T06:12:49.135982+0000","last_fullsized":"2024-09-13T06:12:49.135982+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"35'7","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.662961+0000","last_change":"2024-09-13T06:09:34.105846+0000","last_active":"2024-09-13T06:12:49.662961+0000","last_peered":"2024-09-13T06:12:49.662961+0000","last_clean":"2024-09-13T06:12:49.662961+0000","last_became_active":"2024-09-13T06:09:34.105494+0000","last_became_peered":"2024-09-13T06:09:34.105494+0000","last_unstale":"2024-09-13T06:12:49.662961+0000","last_undegraded":"2024-09-13T06:12:49.662961+0000","last_fullsized":"2024-09-13T06:12:49.662961+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"35'2","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:24.519522+0000","last_change":"2024-09-13T06:09:32.143211+0000","last_active":"2024-09-13T06:13:24.519522+0000","last_peered":"2024-09-13T06:13:24.519522+0000","last_clean":"2024-09-13T06:13:24.519522+0000","last_became_active":"2024-09-13T06:09:32.142726+0000","last_became_peered":"2024-09-13T06:09:32.142726+0000","last_unstale":"2024-09-13T06:13:24.519522+0000","last_undegraded":"2024-09-13T06:13:24.519522+0000","last_fullsized":"2024-09-13T06:13:24.519522+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"35'3","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:39.117575+0000","last_change":"2024-09-13T06:13:39.117641+0000","last_active":"2024-09-13T06:13:39.117575+0000","last_peered":"2024-09-13T06:13:39.117575+0000","last_clean":"2024-09-13T06:13:39.117575+0000","last_became_active":"2024-09-13T06:09:36.136792+0000","last_became_peered":"2024-09-13T06:09:36.136792+0000","last_unstale":"2024-09-13T06:13:39.117575+0000","last_undegraded":"2024-09-13T06:13:39.117575+0000","last_fullsized":"2024-09-13T06:13:39.117575+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3","last_scrub_stamp":"2024-09-13T06:13:39.117394+0000","last_deep_scrub":"35'3","last_deep_scrub_stamp":"2024-09-13T06:13:39.117394+0000","last_clean_scrub_stamp":"2024-09-13T06:13:39.117394+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:34:55.196548+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"35'39","reported_seq":96,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:29.877488+0000","last_change":"2024-09-13T06:13:29.877565+0000","last_active":"2024-09-13T06:13:29.877488+0000","last_peered":"2024-09-13T06:13:29.877488+0000","last_clean":"2024-09-13T06:13:29.877488+0000","last_became_active":"2024-09-13T06:09:38.166333+0000","last_became_peered":"2024-09-13T06:09:38.166333+0000","last_unstale":"2024-09-13T06:13:29.877488+0000","last_undegraded":"2024-09-13T06:13:29.877488+0000","last_fullsized":"2024-09-13T06:13:29.877488+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'39","last_scrub_stamp":"2024-09-13T06:13:29.877300+0000","last_deep_scrub":"35'39","last_deep_scrub_stamp":"2024-09-13T06:13:29.877300+0000","last_clean_scrub_stamp":"2024-09-13T06:13:29.877300+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:40:12.627053+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:36.323225+0000","last_change":"2024-09-13T06:13:36.323280+0000","last_active":"2024-09-13T06:13:36.323225+0000","last_peered":"2024-09-13T06:13:36.323225+0000","last_clean":"2024-09-13T06:13:36.323225+0000","last_became_active":"2024-09-13T06:09:40.178392+0000","last_became_peered":"2024-09-13T06:09:40.178392+0000","last_unstale":"2024-09-13T06:13:36.323225+0000","last_undegraded":"2024-09-13T06:13:36.323225+0000","last_fullsized":"2024-09-13T06:13:36.323225+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:36.323029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:36.323029+0000","last_clean_scrub_stamp":"2024-09-13T06:13:36.323029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:56:23.983741+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"35'8","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:48.971074+0000","last_change":"2024-09-13T06:09:42.214258+0000","last_active":"2024-09-13T06:12:48.971074+0000","last_peered":"2024-09-13T06:12:48.971074+0000","last_clean":"2024-09-13T06:12:48.971074+0000","last_became_active":"2024-09-13T06:09:42.213809+0000","last_became_peered":"2024-09-13T06:09:42.213809+0000","last_unstale":"2024-09-13T06:12:48.971074+0000","last_undegraded":"2024-09-13T06:12:48.971074+0000","last_fullsized":"2024-09-13T06:12:48.971074+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"35'6","reported_seq":74,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:47.803206+0000","last_change":"2024-09-13T06:09:34.126954+0000","last_active":"2024-09-13T06:11:47.803206+0000","last_peered":"2024-09-13T06:11:47.803206+0000","last_clean":"2024-09-13T06:11:47.803206+0000","last_became_active":"2024-09-13T06:09:34.124044+0000","last_became_peered":"2024-09-13T06:09:34.124044+0000","last_unstale":"2024-09-13T06:11:47.803206+0000","last_undegraded":"2024-09-13T06:11:47.803206+0000","last_fullsized":"2024-09-13T06:11:47.803206+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:24.972065+0000","last_change":"2024-09-13T06:09:32.134687+0000","last_active":"2024-09-13T06:13:24.972065+0000","last_peered":"2024-09-13T06:13:24.972065+0000","last_clean":"2024-09-13T06:13:24.972065+0000","last_became_active":"2024-09-13T06:09:32.133972+0000","last_became_peered":"2024-09-13T06:09:32.133972+0000","last_unstale":"2024-09-13T06:13:24.972065+0000","last_undegraded":"2024-09-13T06:13:24.972065+0000","last_fullsized":"2024-09-13T06:13:24.972065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"35'12","reported_seq":62,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.533099+0000","last_change":"2024-09-13T06:09:34.113604+0000","last_active":"2024-09-13T06:12:49.533099+0000","last_peered":"2024-09-13T06:12:49.533099+0000","last_clean":"2024-09-13T06:12:49.533099+0000","last_became_active":"2024-09-13T06:09:34.112805+0000","last_became_peered":"2024-09-13T06:09:34.112805+0000","last_unstale":"2024-09-13T06:12:49.533099+0000","last_undegraded":"2024-09-13T06:12:49.533099+0000","last_fullsized":"2024-09-13T06:12:49.533099+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"35'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:24.055302+0000","last_change":"2024-09-13T06:09:32.150318+0000","last_active":"2024-09-13T06:13:24.055302+0000","last_peered":"2024-09-13T06:13:24.055302+0000","last_clean":"2024-09-13T06:13:24.055302+0000","last_became_active":"2024-09-13T06:09:32.145941+0000","last_became_peered":"2024-09-13T06:09:32.145941+0000","last_unstale":"2024-09-13T06:13:24.055302+0000","last_undegraded":"2024-09-13T06:13:24.055302+0000","last_fullsized":"2024-09-13T06:13:24.055302+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"35'10","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.452462+0000","last_change":"2024-09-13T06:09:34.118956+0000","last_active":"2024-09-13T06:12:49.452462+0000","last_peered":"2024-09-13T06:12:49.452462+0000","last_clean":"2024-09-13T06:12:49.452462+0000","last_became_active":"2024-09-13T06:09:34.118325+0000","last_became_peered":"2024-09-13T06:09:34.118325+0000","last_unstale":"2024-09-13T06:12:49.452462+0000","last_undegraded":"2024-09-13T06:12:49.452462+0000","last_fullsized":"2024-09-13T06:12:49.452462+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"35'2","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.440626+0000","last_change":"2024-09-13T06:09:32.144168+0000","last_active":"2024-09-13T06:13:25.440626+0000","last_peered":"2024-09-13T06:13:25.440626+0000","last_clean":"2024-09-13T06:13:25.440626+0000","last_became_active":"2024-09-13T06:09:32.133230+0000","last_became_peered":"2024-09-13T06:09:32.133230+0000","last_unstale":"2024-09-13T06:13:25.440626+0000","last_undegraded":"2024-09-13T06:13:25.440626+0000","last_fullsized":"2024-09-13T06:13:25.440626+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"35'4","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.533072+0000","last_change":"2024-09-13T06:09:34.117053+0000","last_active":"2024-09-13T06:12:49.533072+0000","last_peered":"2024-09-13T06:12:49.533072+0000","last_clean":"2024-09-13T06:12:49.533072+0000","last_became_active":"2024-09-13T06:09:34.115512+0000","last_became_peered":"2024-09-13T06:09:34.115512+0000","last_unstale":"2024-09-13T06:12:49.533072+0000","last_undegraded":"2024-09-13T06:12:49.533072+0000","last_fullsized":"2024-09-13T06:12:49.533072+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"35'2","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:24.055263+0000","last_change":"2024-09-13T06:09:32.153571+0000","last_active":"2024-09-13T06:13:24.055263+0000","last_peered":"2024-09-13T06:13:24.055263+0000","last_clean":"2024-09-13T06:13:24.055263+0000","last_became_active":"2024-09-13T06:09:32.150328+0000","last_became_peered":"2024-09-13T06:09:32.150328+0000","last_unstale":"2024-09-13T06:13:24.055263+0000","last_undegraded":"2024-09-13T06:13:24.055263+0000","last_fullsized":"2024-09-13T06:13:24.055263+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"35'12","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:24.055388+0000","last_change":"2024-09-13T06:09:34.115843+0000","last_active":"2024-09-13T06:13:24.055388+0000","last_peered":"2024-09-13T06:13:24.055388+0000","last_clean":"2024-09-13T06:13:24.055388+0000","last_became_active":"2024-09-13T06:09:34.113986+0000","last_became_peered":"2024-09-13T06:09:34.113986+0000","last_unstale":"2024-09-13T06:13:24.055388+0000","last_undegraded":"2024-09-13T06:13:24.055388+0000","last_fullsized":"2024-09-13T06:13:24.055388+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:45.798164+0000","last_change":"2024-09-13T06:09:32.137258+0000","last_active":"2024-09-13T06:11:45.798164+0000","last_peered":"2024-09-13T06:11:45.798164+0000","last_clean":"2024-09-13T06:11:45.798164+0000","last_became_active":"2024-09-13T06:09:32.136268+0000","last_became_peered":"2024-09-13T06:09:32.136268+0000","last_unstale":"2024-09-13T06:11:45.798164+0000","last_undegraded":"2024-09-13T06:11:45.798164+0000","last_fullsized":"2024-09-13T06:11:45.798164+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"35'4","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:43.533852+0000","last_change":"2024-09-13T06:09:34.124112+0000","last_active":"2024-09-13T06:11:43.533852+0000","last_peered":"2024-09-13T06:11:43.533852+0000","last_clean":"2024-09-13T06:11:43.533852+0000","last_became_active":"2024-09-13T06:09:34.121261+0000","last_became_peered":"2024-09-13T06:09:34.121261+0000","last_unstale":"2024-09-13T06:11:43.533852+0000","last_undegraded":"2024-09-13T06:11:43.533852+0000","last_fullsized":"2024-09-13T06:11:43.533852+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:42.801805+0000","last_change":"2024-09-13T06:09:32.142747+0000","last_active":"2024-09-13T06:11:42.801805+0000","last_peered":"2024-09-13T06:11:42.801805+0000","last_clean":"2024-09-13T06:11:42.801805+0000","last_became_active":"2024-09-13T06:09:32.141602+0000","last_became_peered":"2024-09-13T06:09:32.141602+0000","last_unstale":"2024-09-13T06:11:42.801805+0000","last_undegraded":"2024-09-13T06:11:42.801805+0000","last_fullsized":"2024-09-13T06:11:42.801805+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"35'6","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:24.055627+0000","last_change":"2024-09-13T06:09:34.123392+0000","last_active":"2024-09-13T06:13:24.055627+0000","last_peered":"2024-09-13T06:13:24.055627+0000","last_clean":"2024-09-13T06:13:24.055627+0000","last_became_active":"2024-09-13T06:09:34.122424+0000","last_became_peered":"2024-09-13T06:09:34.122424+0000","last_unstale":"2024-09-13T06:13:24.055627+0000","last_undegraded":"2024-09-13T06:13:24.055627+0000","last_fullsized":"2024-09-13T06:13:24.055627+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:41.797865+0000","last_change":"2024-09-13T06:09:32.120069+0000","last_active":"2024-09-13T06:11:41.797865+0000","last_peered":"2024-09-13T06:11:41.797865+0000","last_clean":"2024-09-13T06:11:41.797865+0000","last_became_active":"2024-09-13T06:09:32.119665+0000","last_became_peered":"2024-09-13T06:09:32.119665+0000","last_unstale":"2024-09-13T06:11:41.797865+0000","last_undegraded":"2024-09-13T06:11:41.797865+0000","last_fullsized":"2024-09-13T06:11:41.797865+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"35'9","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.662289+0000","last_change":"2024-09-13T06:09:34.121479+0000","last_active":"2024-09-13T06:12:49.662289+0000","last_peered":"2024-09-13T06:12:49.662289+0000","last_clean":"2024-09-13T06:12:49.662289+0000","last_became_active":"2024-09-13T06:09:34.114378+0000","last_became_peered":"2024-09-13T06:09:34.114378+0000","last_unstale":"2024-09-13T06:12:49.662289+0000","last_undegraded":"2024-09-13T06:12:49.662289+0000","last_fullsized":"2024-09-13T06:12:49.662289+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"35'4","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:20.953082+0000","last_change":"2024-09-13T06:09:32.147166+0000","last_active":"2024-09-13T06:13:20.953082+0000","last_peered":"2024-09-13T06:13:20.953082+0000","last_clean":"2024-09-13T06:13:20.953082+0000","last_became_active":"2024-09-13T06:09:32.146011+0000","last_became_peered":"2024-09-13T06:09:32.146011+0000","last_unstale":"2024-09-13T06:13:20.953082+0000","last_undegraded":"2024-09-13T06:13:20.953082+0000","last_fullsized":"2024-09-13T06:13:20.953082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"35'2","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:57.805959+0000","last_change":"2024-09-13T06:09:34.118796+0000","last_active":"2024-09-13T06:11:57.805959+0000","last_peered":"2024-09-13T06:11:57.805959+0000","last_clean":"2024-09-13T06:11:57.805959+0000","last_became_active":"2024-09-13T06:09:34.117659+0000","last_became_peered":"2024-09-13T06:09:34.117659+0000","last_unstale":"2024-09-13T06:11:57.805959+0000","last_undegraded":"2024-09-13T06:11:57.805959+0000","last_fullsized":"2024-09-13T06:11:57.805959+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"35'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:47.858145+0000","last_change":"2024-09-13T06:09:32.124201+0000","last_active":"2024-09-13T06:11:47.858145+0000","last_peered":"2024-09-13T06:11:47.858145+0000","last_clean":"2024-09-13T06:11:47.858145+0000","last_became_active":"2024-09-13T06:09:32.121250+0000","last_became_peered":"2024-09-13T06:09:32.121250+0000","last_unstale":"2024-09-13T06:11:47.858145+0000","last_undegraded":"2024-09-13T06:11:47.858145+0000","last_fullsized":"2024-09-13T06:11:47.858145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"35'5","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.663844+0000","last_change":"2024-09-13T06:09:34.118552+0000","last_active":"2024-09-13T06:12:49.663844+0000","last_peered":"2024-09-13T06:12:49.663844+0000","last_clean":"2024-09-13T06:12:49.663844+0000","last_became_active":"2024-09-13T06:09:34.118270+0000","last_became_peered":"2024-09-13T06:09:34.118270+0000","last_unstale":"2024-09-13T06:12:49.663844+0000","last_undegraded":"2024-09-13T06:12:49.663844+0000","last_fullsized":"2024-09-13T06:12:49.663844+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:50.799323+0000","last_change":"2024-09-13T06:09:32.151004+0000","last_active":"2024-09-13T06:11:50.799323+0000","last_peered":"2024-09-13T06:11:50.799323+0000","last_clean":"2024-09-13T06:11:50.799323+0000","last_became_active":"2024-09-13T06:09:32.145988+0000","last_became_peered":"2024-09-13T06:09:32.145988+0000","last_unstale":"2024-09-13T06:11:50.799323+0000","last_undegraded":"2024-09-13T06:11:50.799323+0000","last_fullsized":"2024-09-13T06:11:50.799323+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"33'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:50.799651+0000","last_change":"2024-09-13T06:09:34.118753+0000","last_active":"2024-09-13T06:11:50.799651+0000","last_peered":"2024-09-13T06:11:50.799651+0000","last_clean":"2024-09-13T06:11:50.799651+0000","last_became_active":"2024-09-13T06:09:34.117320+0000","last_became_peered":"2024-09-13T06:09:34.117320+0000","last_unstale":"2024-09-13T06:11:50.799651+0000","last_undegraded":"2024-09-13T06:11:50.799651+0000","last_fullsized":"2024-09-13T06:11:50.799651+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:20.955370+0000","last_change":"2024-09-13T06:09:32.141516+0000","last_active":"2024-09-13T06:13:20.955370+0000","last_peered":"2024-09-13T06:13:20.955370+0000","last_clean":"2024-09-13T06:13:20.955370+0000","last_became_active":"2024-09-13T06:09:32.141009+0000","last_became_peered":"2024-09-13T06:09:32.141009+0000","last_unstale":"2024-09-13T06:13:20.955370+0000","last_undegraded":"2024-09-13T06:13:20.955370+0000","last_fullsized":"2024-09-13T06:13:20.955370+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"35'12","reported_seq":83,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.454426+0000","last_change":"2024-09-13T06:09:34.124580+0000","last_active":"2024-09-13T06:12:49.454426+0000","last_peered":"2024-09-13T06:12:49.454426+0000","last_clean":"2024-09-13T06:12:49.454426+0000","last_became_active":"2024-09-13T06:09:34.124270+0000","last_became_peered":"2024-09-13T06:09:34.124270+0000","last_unstale":"2024-09-13T06:12:49.454426+0000","last_undegraded":"2024-09-13T06:12:49.454426+0000","last_fullsized":"2024-09-13T06:12:49.454426+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"35'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:47.925854+0000","last_change":"2024-09-13T06:09:32.143000+0000","last_active":"2024-09-13T06:11:47.925854+0000","last_peered":"2024-09-13T06:11:47.925854+0000","last_clean":"2024-09-13T06:11:47.925854+0000","last_became_active":"2024-09-13T06:09:32.142581+0000","last_became_peered":"2024-09-13T06:09:32.142581+0000","last_unstale":"2024-09-13T06:11:47.925854+0000","last_undegraded":"2024-09-13T06:11:47.925854+0000","last_fullsized":"2024-09-13T06:11:47.925854+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"35'16","reported_seq":77,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.454613+0000","last_change":"2024-09-13T06:09:34.118681+0000","last_active":"2024-09-13T06:12:49.454613+0000","last_peered":"2024-09-13T06:12:49.454613+0000","last_clean":"2024-09-13T06:12:49.454613+0000","last_became_active":"2024-09-13T06:09:34.118290+0000","last_became_peered":"2024-09-13T06:09:34.118290+0000","last_unstale":"2024-09-13T06:12:49.454613+0000","last_undegraded":"2024-09-13T06:12:49.454613+0000","last_fullsized":"2024-09-13T06:12:49.454613+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":58,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:47.807688+0000","last_change":"2024-09-13T06:09:32.124596+0000","last_active":"2024-09-13T06:11:47.807688+0000","last_peered":"2024-09-13T06:11:47.807688+0000","last_clean":"2024-09-13T06:11:47.807688+0000","last_became_active":"2024-09-13T06:09:32.121400+0000","last_became_peered":"2024-09-13T06:09:32.121400+0000","last_unstale":"2024-09-13T06:11:47.807688+0000","last_undegraded":"2024-09-13T06:11:47.807688+0000","last_fullsized":"2024-09-13T06:11:47.807688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"35'13","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.664006+0000","last_change":"2024-09-13T06:09:34.124551+0000","last_active":"2024-09-13T06:12:49.664006+0000","last_peered":"2024-09-13T06:12:49.664006+0000","last_clean":"2024-09-13T06:12:49.664006+0000","last_became_active":"2024-09-13T06:09:34.121743+0000","last_became_peered":"2024-09-13T06:09:34.121743+0000","last_unstale":"2024-09-13T06:12:49.664006+0000","last_undegraded":"2024-09-13T06:12:49.664006+0000","last_fullsized":"2024-09-13T06:12:49.664006+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"35'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.299194+0000","last_change":"2024-09-13T06:09:32.135724+0000","last_active":"2024-09-13T06:12:49.299194+0000","last_peered":"2024-09-13T06:12:49.299194+0000","last_clean":"2024-09-13T06:12:49.299194+0000","last_became_active":"2024-09-13T06:09:32.127830+0000","last_became_peered":"2024-09-13T06:09:32.127830+0000","last_unstale":"2024-09-13T06:12:49.299194+0000","last_undegraded":"2024-09-13T06:12:49.299194+0000","last_fullsized":"2024-09-13T06:12:49.299194+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"35'4","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:52.809136+0000","last_change":"2024-09-13T06:09:34.126475+0000","last_active":"2024-09-13T06:11:52.809136+0000","last_peered":"2024-09-13T06:11:52.809136+0000","last_clean":"2024-09-13T06:11:52.809136+0000","last_became_active":"2024-09-13T06:09:34.126020+0000","last_became_peered":"2024-09-13T06:09:34.126020+0000","last_unstale":"2024-09-13T06:11:52.809136+0000","last_undegraded":"2024-09-13T06:11:52.809136+0000","last_fullsized":"2024-09-13T06:11:52.809136+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:20.954155+0000","last_change":"2024-09-13T06:09:32.119928+0000","last_active":"2024-09-13T06:13:20.954155+0000","last_peered":"2024-09-13T06:13:20.954155+0000","last_clean":"2024-09-13T06:13:20.954155+0000","last_became_active":"2024-09-13T06:09:32.119542+0000","last_became_peered":"2024-09-13T06:09:32.119542+0000","last_unstale":"2024-09-13T06:13:20.954155+0000","last_undegraded":"2024-09-13T06:13:20.954155+0000","last_fullsized":"2024-09-13T06:13:20.954155+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"35'6","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.531911+0000","last_change":"2024-09-13T06:09:34.118722+0000","last_active":"2024-09-13T06:12:49.531911+0000","last_peered":"2024-09-13T06:12:49.531911+0000","last_clean":"2024-09-13T06:12:49.531911+0000","last_became_active":"2024-09-13T06:09:34.110506+0000","last_became_peered":"2024-09-13T06:09:34.110506+0000","last_unstale":"2024-09-13T06:12:49.531911+0000","last_undegraded":"2024-09-13T06:12:49.531911+0000","last_fullsized":"2024-09-13T06:12:49.531911+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:52.809573+0000","last_change":"2024-09-13T06:09:32.130216+0000","last_active":"2024-09-13T06:11:52.809573+0000","last_peered":"2024-09-13T06:11:52.809573+0000","last_clean":"2024-09-13T06:11:52.809573+0000","last_became_active":"2024-09-13T06:09:32.121895+0000","last_became_peered":"2024-09-13T06:09:32.121895+0000","last_unstale":"2024-09-13T06:11:52.809573+0000","last_undegraded":"2024-09-13T06:11:52.809573+0000","last_fullsized":"2024-09-13T06:11:52.809573+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:52.809048+0000","last_change":"2024-09-13T06:09:32.132716+0000","last_active":"2024-09-13T06:11:52.809048+0000","last_peered":"2024-09-13T06:11:52.809048+0000","last_clean":"2024-09-13T06:11:52.809048+0000","last_became_active":"2024-09-13T06:09:32.130056+0000","last_became_peered":"2024-09-13T06:09:32.130056+0000","last_unstale":"2024-09-13T06:11:52.809048+0000","last_undegraded":"2024-09-13T06:11:52.809048+0000","last_fullsized":"2024-09-13T06:11:52.809048+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"35'8","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:48.978239+0000","last_change":"2024-09-13T06:09:34.132050+0000","last_active":"2024-09-13T06:12:48.978239+0000","last_peered":"2024-09-13T06:12:48.978239+0000","last_clean":"2024-09-13T06:12:48.978239+0000","last_became_active":"2024-09-13T06:09:34.130980+0000","last_became_peered":"2024-09-13T06:09:34.130980+0000","last_unstale":"2024-09-13T06:12:48.978239+0000","last_undegraded":"2024-09-13T06:12:48.978239+0000","last_fullsized":"2024-09-13T06:12:48.978239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"33'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:55.800747+0000","last_change":"2024-09-13T06:09:32.152088+0000","last_active":"2024-09-13T06:11:55.800747+0000","last_peered":"2024-09-13T06:11:55.800747+0000","last_clean":"2024-09-13T06:11:55.800747+0000","last_became_active":"2024-09-13T06:09:32.149426+0000","last_became_peered":"2024-09-13T06:09:32.149426+0000","last_unstale":"2024-09-13T06:11:55.800747+0000","last_undegraded":"2024-09-13T06:11:55.800747+0000","last_fullsized":"2024-09-13T06:11:55.800747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"35'3","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.664611+0000","last_change":"2024-09-13T06:09:34.118994+0000","last_active":"2024-09-13T06:12:49.664611+0000","last_peered":"2024-09-13T06:12:49.664611+0000","last_clean":"2024-09-13T06:12:49.664611+0000","last_became_active":"2024-09-13T06:09:34.111230+0000","last_became_peered":"2024-09-13T06:09:34.111230+0000","last_unstale":"2024-09-13T06:12:49.664611+0000","last_undegraded":"2024-09-13T06:12:49.664611+0000","last_fullsized":"2024-09-13T06:12:49.664611+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2342,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1493,"ondisk_log_size":1493,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1618,"num_read_kb":1508,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":475,"ondisk_log_size":475,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640314,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39984,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331856,"statfs":{"total":96636764160,"available":96595820544,"internally_reserved":0,"allocated":491520,"data_stored":155427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640314,"num_pgs":155,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40524,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331316,"statfs":{"total":96636764160,"available":96595267584,"internally_reserved":0,"allocated":1044480,"data_stored":743705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673018,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40500,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331340,"statfs":{"total":96636764160,"available":96595292160,"internally_reserved":0,"allocated":1019904,"data_stored":743361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705720,"num_pgs":170,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39952,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331888,"statfs":{"total":96636764160,"available":96595853312,"internally_reserved":0,"allocated":458752,"data_stored":154423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T06:13:46.232 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.233 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.233 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.233 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.233 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.233 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.233 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.233 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.234 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.234 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.234 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.234 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.234 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.234 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.234 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.234 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.234 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.235 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.235 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.235 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.235 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.235 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.235 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.235 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.235 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.236 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.236 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.236 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.236 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.236 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.236 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.236 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-13T06:09:37.110448+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=37, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.237 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-13T06:09:39.124182+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=39, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.237 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.237 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.237 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.237 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.237 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.237 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.238 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-13T06:09:39.124182+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=39, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.238 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.238 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.238 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.238 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-13T06:09:35.087004+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=35, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.238 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.238 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.239 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.239 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.239 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.239 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.239 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.239 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.239 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-13T06:09:35.087004+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=35, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.239 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-13T06:09:39.124182+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=39, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.240 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.240 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.240 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.240 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-13T06:09:37.110448+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=37, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.240 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.240 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.241 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.241 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-13T06:09:35.087004+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=35, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.241 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-13T06:09:39.124182+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=39, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.241 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.241 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.242 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.242 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.242 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.242 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-13T06:09:37.110448+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=37, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.242 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.242 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.242 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.243 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.243 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-13T06:09:18.163598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.243 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-13T06:09:21.188659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.243 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.243 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-13T06:09:37.110448+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=37, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.243 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.244 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-13T06:09:21.188659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.244 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.244 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-13T06:09:39.124182+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=39, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.244 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.244 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.244 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-13T06:09:21.188659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.244 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.245 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-13T06:09:35.087004+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=35, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.245 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.245 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.245 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-13T06:09:21.188659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.245 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.245 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-13T06:09:35.087004+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=35, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.245 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-13T06:09:37.110448+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=37, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.245 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-13T06:09:39.124182+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=39, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.246 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.246 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.246 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.246 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-13T06:09:21.188659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.246 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-13T06:09:35.087004+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=35, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.246 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.246 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.246 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.247 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-13T06:09:21.188659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.247 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.247 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.247 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.247 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-13T06:09:21.188659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.247 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.247 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.248 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.248 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-13T06:09:21.188659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.248 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.248 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.248 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.248 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-13T06:09:39.124182+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=39, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.249 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.249 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.249 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.249 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.249 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.249 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.249 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.249 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.250 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.250 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.250 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-13T06:09:35.087004+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=35, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.250 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.250 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.250 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.250 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-13T06:09:35.087004+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=35, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.250 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-13T06:09:37.110448+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=37, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.251 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-13T06:09:39.124182+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=39, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.251 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.251 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.251 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-13T06:09:35.087004+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=35, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.251 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.251 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.251 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.251 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-13T06:09:37.110448+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=37, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.252 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.252 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.252 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.252 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.252 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.252 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.252 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-13T06:09:35.087004+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=35, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.252 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-13T06:09:39.124182+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=39, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.253 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.253 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.253 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.253 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-13T06:09:39.124182+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=39, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.253 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.253 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.253 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.253 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.254 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.254 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.254 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.254 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.254 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.254 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.254 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.254 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.255 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.255 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.255 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.255 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.255 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.255 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.255 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.255 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.255 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.256 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.256 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.256 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.256 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.256 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.256 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.256 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.256 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.257 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.257 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.257 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.257 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.257 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.257 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.257 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.257 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.257 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.258 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.258 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:13:46.258 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T06:14:06.259 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T06:14:06.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:06.387+0000 7fea7d358640 1 Processor -- start 2024-09-13T06:14:06.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:06.387+0000 7fea7d358640 1 -- start start 2024-09-13T06:14:06.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:06.387+0000 7fea7d358640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fea7812d000 0x7fea78131a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:14:06.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:06.387+0000 7fea7d358640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea780927a0 con 0x7fea7812c510 2024-09-13T06:14:06.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:06.387+0000 7fea7d358640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fea78096e80 con 0x7fea7812d000 2024-09-13T06:14:06.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:06.387+0000 7fea767fc640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fea7812d000 0x7fea78131a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:14:06.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:06.387+0000 7fea76ffd640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fea7812c510 0x7fea7812c8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:49152/0 (socket says 172.21.15.120:49152) 2024-09-13T06:14:06.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:06.387+0000 7fea76ffd640 1 -- 172.21.15.120:0/2118335619 learned_addr learned my addr 172.21.15.120:0/2118335619 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-13T06:14:06.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:06.387+0000 7fea767fc640 1 -- 172.21.15.120:0/2118335619 >> v1:172.21.15.120:6789/0 conn(0x7fea7812c510 legacy=0x7fea7812c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:14:06.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:06.387+0000 7fea75ffb640 1 -- 172.21.15.120:0/2118335619 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3826699615 0 0) 0x7fea780927a0 con 0x7fea7812c510 2024-09-13T06:14:06.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:06.387+0000 7fea767fc640 1 -- 172.21.15.120:0/2118335619 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea78074ef0 con 0x7fea7812d000 2024-09-13T06:14:06.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:06.391+0000 7fea767fc640 1 --2- 172.21.15.120:0/2118335619 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fea7812d000 0x7fea78131a40 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fea68009740 tx=0x7fea6801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8db67028d223c3c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:14:06.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:06.391+0000 7fea75ffb640 1 -- 172.21.15.120:0/2118335619 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea680b0070 con 0x7fea7812d000 2024-09-13T06:14:06.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:06.391+0000 7fea75ffb640 1 -- 172.21.15.120:0/2118335619 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea680ab530 con 0x7fea7812d000 2024-09-13T06:14:06.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:06.391+0000 7fea75ffb640 1 -- 172.21.15.120:0/2118335619 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea680ab830 con 0x7fea7812d000 2024-09-13T06:14:06.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:06.391+0000 7fea7d358640 1 -- 172.21.15.120:0/2118335619 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fea7812d000 msgr2=0x7fea78131a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:14:06.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:06.391+0000 7fea7d358640 1 --2- 172.21.15.120:0/2118335619 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fea7812d000 0x7fea78131a40 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fea68009740 tx=0x7fea6801c370 comp rx=0 tx=0).stop 2024-09-13T06:14:06.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:06.391+0000 7fea7d358640 1 -- 172.21.15.120:0/2118335619 shutdown_connections 2024-09-13T06:14:06.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:06.391+0000 7fea7d358640 1 --2- 172.21.15.120:0/2118335619 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fea7812d000 0x7fea78131a40 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:14:06.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:06.391+0000 7fea7d358640 1 -- 172.21.15.120:0/2118335619 >> 172.21.15.120:0/2118335619 conn(0x7fea7809d4c0 msgr2=0x7fea7809d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:14:06.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:06.391+0000 7fea7d358640 1 -- 172.21.15.120:0/2118335619 shutdown_connections 2024-09-13T06:14:06.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:06.391+0000 7fea7d358640 1 -- 172.21.15.120:0/2118335619 wait complete. 2024-09-13T06:14:06.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:06.391+0000 7fea7d358640 1 Processor -- start 2024-09-13T06:14:06.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:06.391+0000 7fea7d358640 1 -- start start 2024-09-13T06:14:06.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:06.391+0000 7fea7d358640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fea7812c510 0x7fea781c5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:14:06.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:06.391+0000 7fea7d358640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fea78134b30 con 0x7fea7812c510 2024-09-13T06:14:06.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:06.391+0000 7fea76ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fea7812c510 0x7fea781c5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:14:06.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:06.391+0000 7fea76ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fea7812c510 0x7fea781c5e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:44448/0 (socket says 172.21.15.120:44448) 2024-09-13T06:14:06.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:06.391+0000 7fea76ffd640 1 -- 172.21.15.120:0/1336750376 learned_addr learned my addr 172.21.15.120:0/1336750376 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-13T06:14:06.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:06.391+0000 7fea76ffd640 1 -- 172.21.15.120:0/1336750376 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea78095280 con 0x7fea7812c510 2024-09-13T06:14:06.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:06.391+0000 7fea76ffd640 1 --2- 172.21.15.120:0/1336750376 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fea7812c510 0x7fea781c5e60 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fea6c00c390 tx=0x7fea6c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:14:06.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:06.391+0000 7fea5f7fe640 1 -- 172.21.15.120:0/1336750376 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea6c007410 con 0x7fea7812c510 2024-09-13T06:14:06.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:06.391+0000 7fea7d358640 1 -- 172.21.15.120:0/1336750376 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea78095500 con 0x7fea7812c510 2024-09-13T06:14:06.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:06.391+0000 7fea5f7fe640 1 -- 172.21.15.120:0/1336750376 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea6c0075d0 con 0x7fea7812c510 2024-09-13T06:14:06.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:06.391+0000 7fea5f7fe640 1 -- 172.21.15.120:0/1336750376 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea6c004960 con 0x7fea7812c510 2024-09-13T06:14:06.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:06.391+0000 7fea7d358640 1 -- 172.21.15.120:0/1336750376 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea781c6570 con 0x7fea7812c510 2024-09-13T06:14:06.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:06.395+0000 7fea5f7fe640 1 -- 172.21.15.120:0/1336750376 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fea6c011070 con 0x7fea7812c510 2024-09-13T06:14:06.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:06.395+0000 7fea7d358640 1 -- 172.21.15.120:0/1336750376 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea78094870 con 0x7fea7812c510 2024-09-13T06:14:06.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:06.395+0000 7fea5f7fe640 1 --2- 172.21.15.120:0/1336750376 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fea64035d60 0x7fea64038220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:14:06.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:06.395+0000 7fea5f7fe640 1 -- 172.21.15.120:0/1336750376 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fea6c048d60 con 0x7fea7812c510 2024-09-13T06:14:06.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:06.395+0000 7fea767fc640 1 --2- 172.21.15.120:0/1336750376 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fea64035d60 0x7fea64038220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:14:06.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:06.395+0000 7fea767fc640 1 --2- 172.21.15.120:0/1336750376 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fea64035d60 0x7fea64038220 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fea680ad000 tx=0x7fea68008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:14:06.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:06.399+0000 7fea5f7fe640 1 -- 172.21.15.120:0/1336750376 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fea78095280 con 0x7fea7812c510 2024-09-13T06:14:06.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:06.559+0000 7fea7d358640 1 -- 172.21.15.120:0/1336750376 --> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fea7812c8f0 con 0x7fea64035d60 2024-09-13T06:14:06.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:06.603+0000 7fea5f7fe640 1 -- 172.21.15.120:0/1336750376 <== mgr.4100 v2:172.21.15.194:6824/3475680902 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+662176 (secure 0 0 0) 0x7fea7812c8f0 con 0x7fea64035d60 2024-09-13T06:14:06.611 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T06:14:06.617 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-09-13T06:14:06.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:06.607+0000 7fea7d358640 1 -- 172.21.15.120:0/1336750376 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fea64035d60 msgr2=0x7fea64038220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:14:06.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:06.607+0000 7fea7d358640 1 --2- 172.21.15.120:0/1336750376 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fea64035d60 0x7fea64038220 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fea680ad000 tx=0x7fea68008040 comp rx=0 tx=0).stop 2024-09-13T06:14:06.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:06.611+0000 7fea7d358640 1 -- 172.21.15.120:0/1336750376 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fea7812c510 msgr2=0x7fea781c5e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:14:06.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:06.611+0000 7fea7d358640 1 --2- 172.21.15.120:0/1336750376 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fea7812c510 0x7fea781c5e60 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fea6c00c390 tx=0x7fea6c00c850 comp rx=0 tx=0).stop 2024-09-13T06:14:06.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:06.611+0000 7fea7d358640 1 -- 172.21.15.120:0/1336750376 shutdown_connections 2024-09-13T06:14:06.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:06.611+0000 7fea7d358640 1 --2- 172.21.15.120:0/1336750376 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fea64035d60 0x7fea64038220 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:14:06.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:06.611+0000 7fea7d358640 1 --2- 172.21.15.120:0/1336750376 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fea7812c510 0x7fea781c5e60 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:14:06.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:06.611+0000 7fea7d358640 1 -- 172.21.15.120:0/1336750376 >> 172.21.15.120:0/1336750376 conn(0x7fea7809d4c0 msgr2=0x7fea7809a340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:14:06.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:06.611+0000 7fea7d358640 1 -- 172.21.15.120:0/1336750376 shutdown_connections 2024-09-13T06:14:06.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:06.611+0000 7fea7d358640 1 -- 172.21.15.120:0/1336750376 wait complete. 2024-09-13T06:14:06.627 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":177,"stamp":"2024-09-13T06:14:05.844106+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605402,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5108,"num_read_kb":4689,"num_write":2181,"num_write_kb":61376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4781,"ondisk_log_size":4781,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":160960,"kb_used_data":2944,"kb_used_omap":6,"kb_used_meta":157945,"kb_avail":377326400,"statfs":{"total":386547056640,"available":386382233600,"internally_reserved":0,"allocated":3014656,"data_stored":1796916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":161736470},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007069"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:53.451160+0000","last_change":"2024-09-13T06:13:53.451223+0000","last_active":"2024-09-13T06:13:53.451160+0000","last_peered":"2024-09-13T06:13:53.451160+0000","last_clean":"2024-09-13T06:13:53.451160+0000","last_became_active":"2024-09-13T06:09:32.140025+0000","last_became_peered":"2024-09-13T06:09:32.140025+0000","last_unstale":"2024-09-13T06:13:53.451160+0000","last_undegraded":"2024-09-13T06:13:53.451160+0000","last_fullsized":"2024-09-13T06:13:53.451160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:53.450946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:53.450946+0000","last_clean_scrub_stamp":"2024-09-13T06:13:53.450946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:05:48.880319+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"35'22","reported_seq":103,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:48.092554+0000","last_change":"2024-09-13T06:13:48.092625+0000","last_active":"2024-09-13T06:13:48.092554+0000","last_peered":"2024-09-13T06:13:48.092554+0000","last_clean":"2024-09-13T06:13:48.092554+0000","last_became_active":"2024-09-13T06:09:34.122656+0000","last_became_peered":"2024-09-13T06:09:34.122656+0000","last_unstale":"2024-09-13T06:13:48.092554+0000","last_undegraded":"2024-09-13T06:13:48.092554+0000","last_fullsized":"2024-09-13T06:13:48.092554+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'22","last_scrub_stamp":"2024-09-13T06:13:48.092347+0000","last_deep_scrub":"35'22","last_deep_scrub_stamp":"2024-09-13T06:13:48.092347+0000","last_clean_scrub_stamp":"2024-09-13T06:13:48.092347+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:02:26.113000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":88,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"35'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:24.055361+0000","last_change":"2024-09-13T06:09:32.135771+0000","last_active":"2024-09-13T06:13:24.055361+0000","last_peered":"2024-09-13T06:13:24.055361+0000","last_clean":"2024-09-13T06:13:24.055361+0000","last_became_active":"2024-09-13T06:09:32.134020+0000","last_became_peered":"2024-09-13T06:09:32.134020+0000","last_unstale":"2024-09-13T06:13:24.055361+0000","last_undegraded":"2024-09-13T06:13:24.055361+0000","last_fullsized":"2024-09-13T06:13:24.055361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"35'4","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:07.813336+0000","last_change":"2024-09-13T06:09:34.117071+0000","last_active":"2024-09-13T06:12:07.813336+0000","last_peered":"2024-09-13T06:12:07.813336+0000","last_clean":"2024-09-13T06:12:07.813336+0000","last_became_active":"2024-09-13T06:09:34.116715+0000","last_became_peered":"2024-09-13T06:09:34.116715+0000","last_unstale":"2024-09-13T06:12:07.813336+0000","last_undegraded":"2024-09-13T06:12:07.813336+0000","last_fullsized":"2024-09-13T06:12:07.813336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.441189+0000","last_change":"2024-09-13T06:09:32.130525+0000","last_active":"2024-09-13T06:13:25.441189+0000","last_peered":"2024-09-13T06:13:25.441189+0000","last_clean":"2024-09-13T06:13:25.441189+0000","last_became_active":"2024-09-13T06:09:32.116345+0000","last_became_peered":"2024-09-13T06:09:32.116345+0000","last_unstale":"2024-09-13T06:13:25.441189+0000","last_undegraded":"2024-09-13T06:13:25.441189+0000","last_fullsized":"2024-09-13T06:13:25.441189+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:07.813417+0000","last_change":"2024-09-13T06:09:34.118858+0000","last_active":"2024-09-13T06:12:07.813417+0000","last_peered":"2024-09-13T06:12:07.813417+0000","last_clean":"2024-09-13T06:12:07.813417+0000","last_became_active":"2024-09-13T06:09:34.117940+0000","last_became_peered":"2024-09-13T06:09:34.117940+0000","last_unstale":"2024-09-13T06:12:07.813417+0000","last_undegraded":"2024-09-13T06:12:07.813417+0000","last_fullsized":"2024-09-13T06:12:07.813417+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"35'4","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:24.972231+0000","last_change":"2024-09-13T06:09:32.120391+0000","last_active":"2024-09-13T06:13:24.972231+0000","last_peered":"2024-09-13T06:13:24.972231+0000","last_clean":"2024-09-13T06:13:24.972231+0000","last_became_active":"2024-09-13T06:09:32.119806+0000","last_became_peered":"2024-09-13T06:09:32.119806+0000","last_unstale":"2024-09-13T06:13:24.972231+0000","last_undegraded":"2024-09-13T06:13:24.972231+0000","last_fullsized":"2024-09-13T06:13:24.972231+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"35'4","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:58.946151+0000","last_change":"2024-09-13T06:13:58.946209+0000","last_active":"2024-09-13T06:13:58.946151+0000","last_peered":"2024-09-13T06:13:58.946151+0000","last_clean":"2024-09-13T06:13:58.946151+0000","last_became_active":"2024-09-13T06:09:34.122631+0000","last_became_peered":"2024-09-13T06:09:34.122631+0000","last_unstale":"2024-09-13T06:13:58.946151+0000","last_undegraded":"2024-09-13T06:13:58.946151+0000","last_fullsized":"2024-09-13T06:13:58.946151+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:13:58.945955+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:13:58.945955+0000","last_clean_scrub_stamp":"2024-09-13T06:13:58.945955+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:33:44.383904+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:02.812029+0000","last_change":"2024-09-13T06:09:32.129860+0000","last_active":"2024-09-13T06:12:02.812029+0000","last_peered":"2024-09-13T06:12:02.812029+0000","last_clean":"2024-09-13T06:12:02.812029+0000","last_became_active":"2024-09-13T06:09:32.121803+0000","last_became_peered":"2024-09-13T06:09:32.121803+0000","last_unstale":"2024-09-13T06:12:02.812029+0000","last_undegraded":"2024-09-13T06:12:02.812029+0000","last_fullsized":"2024-09-13T06:12:02.812029+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"35'4","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:44.126938+0000","last_change":"2024-09-13T06:13:44.126999+0000","last_active":"2024-09-13T06:13:44.126938+0000","last_peered":"2024-09-13T06:13:44.126938+0000","last_clean":"2024-09-13T06:13:44.126938+0000","last_became_active":"2024-09-13T06:09:34.124728+0000","last_became_peered":"2024-09-13T06:09:34.124728+0000","last_unstale":"2024-09-13T06:13:44.126938+0000","last_undegraded":"2024-09-13T06:13:44.126938+0000","last_fullsized":"2024-09-13T06:13:44.126938+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:13:44.126745+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:13:44.126745+0000","last_clean_scrub_stamp":"2024-09-13T06:13:44.126745+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:34:05.312578+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"35'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.307732+0000","last_change":"2024-09-13T06:09:32.117055+0000","last_active":"2024-09-13T06:12:49.307732+0000","last_peered":"2024-09-13T06:12:49.307732+0000","last_clean":"2024-09-13T06:12:49.307732+0000","last_became_active":"2024-09-13T06:09:32.116422+0000","last_became_peered":"2024-09-13T06:09:32.116422+0000","last_unstale":"2024-09-13T06:12:49.307732+0000","last_undegraded":"2024-09-13T06:12:49.307732+0000","last_fullsized":"2024-09-13T06:12:49.307732+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"35'4","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.531504+0000","last_change":"2024-09-13T06:10:10.823960+0000","last_active":"2024-09-13T06:12:49.531504+0000","last_peered":"2024-09-13T06:12:49.531504+0000","last_clean":"2024-09-13T06:12:49.531504+0000","last_became_active":"2024-09-13T06:10:10.810259+0000","last_became_peered":"2024-09-13T06:10:10.810259+0000","last_unstale":"2024-09-13T06:12:49.531504+0000","last_undegraded":"2024-09-13T06:12:49.531504+0000","last_fullsized":"2024-09-13T06:12:49.531504+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"35'4","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:02.811881+0000","last_change":"2024-09-13T06:09:32.130200+0000","last_active":"2024-09-13T06:12:02.811881+0000","last_peered":"2024-09-13T06:12:02.811881+0000","last_clean":"2024-09-13T06:12:02.811881+0000","last_became_active":"2024-09-13T06:09:32.122126+0000","last_became_peered":"2024-09-13T06:09:32.122126+0000","last_unstale":"2024-09-13T06:12:02.811881+0000","last_undegraded":"2024-09-13T06:12:02.811881+0000","last_fullsized":"2024-09-13T06:12:02.811881+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"35'10","reported_seq":69,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:49.549277+0000","last_change":"2024-09-13T06:13:49.549338+0000","last_active":"2024-09-13T06:13:49.549277+0000","last_peered":"2024-09-13T06:13:49.549277+0000","last_clean":"2024-09-13T06:13:49.549277+0000","last_became_active":"2024-09-13T06:09:34.120349+0000","last_became_peered":"2024-09-13T06:09:34.120349+0000","last_unstale":"2024-09-13T06:13:49.549277+0000","last_undegraded":"2024-09-13T06:13:49.549277+0000","last_fullsized":"2024-09-13T06:13:49.549277+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-09-13T06:13:49.549086+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-09-13T06:13:49.549086+0000","last_clean_scrub_stamp":"2024-09-13T06:13:49.549086+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:30:16.740460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:05.803447+0000","last_change":"2024-09-13T06:09:32.149245+0000","last_active":"2024-09-13T06:12:05.803447+0000","last_peered":"2024-09-13T06:12:05.803447+0000","last_clean":"2024-09-13T06:12:05.803447+0000","last_became_active":"2024-09-13T06:09:32.147504+0000","last_became_peered":"2024-09-13T06:09:32.147504+0000","last_unstale":"2024-09-13T06:12:05.803447+0000","last_undegraded":"2024-09-13T06:12:05.803447+0000","last_fullsized":"2024-09-13T06:12:05.803447+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"35'10","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:56.394555+0000","last_change":"2024-09-13T06:13:56.394630+0000","last_active":"2024-09-13T06:13:56.394555+0000","last_peered":"2024-09-13T06:13:56.394555+0000","last_clean":"2024-09-13T06:13:56.394555+0000","last_became_active":"2024-09-13T06:09:34.104043+0000","last_became_peered":"2024-09-13T06:09:34.104043+0000","last_unstale":"2024-09-13T06:13:56.394555+0000","last_undegraded":"2024-09-13T06:13:56.394555+0000","last_fullsized":"2024-09-13T06:13:56.394555+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-09-13T06:13:56.394368+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-09-13T06:13:56.394368+0000","last_clean_scrub_stamp":"2024-09-13T06:13:56.394368+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:12:03.883275+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"35'4","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.533595+0000","last_change":"2024-09-13T06:09:34.116800+0000","last_active":"2024-09-13T06:12:49.533595+0000","last_peered":"2024-09-13T06:12:49.533595+0000","last_clean":"2024-09-13T06:12:49.533595+0000","last_became_active":"2024-09-13T06:09:34.116359+0000","last_became_peered":"2024-09-13T06:09:34.116359+0000","last_unstale":"2024-09-13T06:12:49.533595+0000","last_undegraded":"2024-09-13T06:12:49.533595+0000","last_fullsized":"2024-09-13T06:12:49.533595+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"35'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.290271+0000","last_change":"2024-09-13T06:09:32.135469+0000","last_active":"2024-09-13T06:12:49.290271+0000","last_peered":"2024-09-13T06:12:49.290271+0000","last_clean":"2024-09-13T06:12:49.290271+0000","last_became_active":"2024-09-13T06:09:32.134667+0000","last_became_peered":"2024-09-13T06:09:32.134667+0000","last_unstale":"2024-09-13T06:12:49.290271+0000","last_undegraded":"2024-09-13T06:12:49.290271+0000","last_fullsized":"2024-09-13T06:12:49.290271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"35'18","reported_seq":69,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:55.152170+0000","last_change":"2024-09-13T06:13:55.152233+0000","last_active":"2024-09-13T06:13:55.152170+0000","last_peered":"2024-09-13T06:13:55.152170+0000","last_clean":"2024-09-13T06:13:55.152170+0000","last_became_active":"2024-09-13T06:09:34.115348+0000","last_became_peered":"2024-09-13T06:09:34.115348+0000","last_unstale":"2024-09-13T06:13:55.152170+0000","last_undegraded":"2024-09-13T06:13:55.152170+0000","last_fullsized":"2024-09-13T06:13:55.152170+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'18","last_scrub_stamp":"2024-09-13T06:13:55.151980+0000","last_deep_scrub":"35'18","last_deep_scrub_stamp":"2024-09-13T06:13:55.151980+0000","last_clean_scrub_stamp":"2024-09-13T06:13:55.151980+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:13:13.639419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":45,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:56.801034+0000","last_change":"2024-09-13T06:09:32.137039+0000","last_active":"2024-09-13T06:11:56.801034+0000","last_peered":"2024-09-13T06:11:56.801034+0000","last_clean":"2024-09-13T06:11:56.801034+0000","last_became_active":"2024-09-13T06:09:32.135460+0000","last_became_peered":"2024-09-13T06:09:32.135460+0000","last_unstale":"2024-09-13T06:11:56.801034+0000","last_undegraded":"2024-09-13T06:11:56.801034+0000","last_fullsized":"2024-09-13T06:11:56.801034+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"35'2","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:58.121718+0000","last_change":"2024-09-13T06:13:58.121860+0000","last_active":"2024-09-13T06:13:58.121718+0000","last_peered":"2024-09-13T06:13:58.121718+0000","last_clean":"2024-09-13T06:13:58.121718+0000","last_became_active":"2024-09-13T06:09:34.115047+0000","last_became_peered":"2024-09-13T06:09:34.115047+0000","last_unstale":"2024-09-13T06:13:58.121718+0000","last_undegraded":"2024-09-13T06:13:58.121718+0000","last_fullsized":"2024-09-13T06:13:58.121718+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:13:58.121478+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:13:58.121478+0000","last_clean_scrub_stamp":"2024-09-13T06:13:58.121478+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:31:22.905217+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:57.805845+0000","last_change":"2024-09-13T06:09:32.143123+0000","last_active":"2024-09-13T06:11:57.805845+0000","last_peered":"2024-09-13T06:11:57.805845+0000","last_clean":"2024-09-13T06:11:57.805845+0000","last_became_active":"2024-09-13T06:09:32.141166+0000","last_became_peered":"2024-09-13T06:09:32.141166+0000","last_unstale":"2024-09-13T06:11:57.805845+0000","last_undegraded":"2024-09-13T06:11:57.805845+0000","last_fullsized":"2024-09-13T06:11:57.805845+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"35'4","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:00.061316+0000","last_change":"2024-09-13T06:14:00.061453+0000","last_active":"2024-09-13T06:14:00.061316+0000","last_peered":"2024-09-13T06:14:00.061316+0000","last_clean":"2024-09-13T06:14:00.061316+0000","last_became_active":"2024-09-13T06:09:34.114242+0000","last_became_peered":"2024-09-13T06:09:34.114242+0000","last_unstale":"2024-09-13T06:14:00.061316+0000","last_undegraded":"2024-09-13T06:14:00.061316+0000","last_fullsized":"2024-09-13T06:14:00.061316+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:14:00.061127+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:14:00.061127+0000","last_clean_scrub_stamp":"2024-09-13T06:14:00.061127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:16:26.722813+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:00.064757+0000","last_change":"2024-09-13T06:14:00.064927+0000","last_active":"2024-09-13T06:14:00.064757+0000","last_peered":"2024-09-13T06:14:00.064757+0000","last_clean":"2024-09-13T06:14:00.064757+0000","last_became_active":"2024-09-13T06:09:32.143746+0000","last_became_peered":"2024-09-13T06:09:32.143746+0000","last_unstale":"2024-09-13T06:14:00.064757+0000","last_undegraded":"2024-09-13T06:14:00.064757+0000","last_fullsized":"2024-09-13T06:14:00.064757+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:00.064492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:00.064492+0000","last_clean_scrub_stamp":"2024-09-13T06:14:00.064492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:19:41.835952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"35'8","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:50.515822+0000","last_change":"2024-09-13T06:13:50.515884+0000","last_active":"2024-09-13T06:13:50.515822+0000","last_peered":"2024-09-13T06:13:50.515822+0000","last_clean":"2024-09-13T06:13:50.515822+0000","last_became_active":"2024-09-13T06:09:34.101167+0000","last_became_peered":"2024-09-13T06:09:34.101167+0000","last_unstale":"2024-09-13T06:13:50.515822+0000","last_undegraded":"2024-09-13T06:13:50.515822+0000","last_fullsized":"2024-09-13T06:13:50.515822+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-13T06:13:50.515623+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-13T06:13:50.515623+0000","last_clean_scrub_stamp":"2024-09-13T06:13:50.515623+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:17:02.378126+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:57.177257+0000","last_change":"2024-09-13T06:13:57.177314+0000","last_active":"2024-09-13T06:13:57.177257+0000","last_peered":"2024-09-13T06:13:57.177257+0000","last_clean":"2024-09-13T06:13:57.177257+0000","last_became_active":"2024-09-13T06:09:32.149885+0000","last_became_peered":"2024-09-13T06:09:32.149885+0000","last_unstale":"2024-09-13T06:13:57.177257+0000","last_undegraded":"2024-09-13T06:13:57.177257+0000","last_fullsized":"2024-09-13T06:13:57.177257+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:57.177058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:57.177058+0000","last_clean_scrub_stamp":"2024-09-13T06:13:57.177058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:42:39.408712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"35'14","reported_seq":74,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:43.162864+0000","last_change":"2024-09-13T06:13:43.162922+0000","last_active":"2024-09-13T06:13:43.162864+0000","last_peered":"2024-09-13T06:13:43.162864+0000","last_clean":"2024-09-13T06:13:43.162864+0000","last_became_active":"2024-09-13T06:09:34.124299+0000","last_became_peered":"2024-09-13T06:09:34.124299+0000","last_unstale":"2024-09-13T06:13:43.162864+0000","last_undegraded":"2024-09-13T06:13:43.162864+0000","last_fullsized":"2024-09-13T06:13:43.162864+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'14","last_scrub_stamp":"2024-09-13T06:13:43.162673+0000","last_deep_scrub":"35'14","last_deep_scrub_stamp":"2024-09-13T06:13:43.162673+0000","last_clean_scrub_stamp":"2024-09-13T06:13:43.162673+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:37:16.908533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:52.809195+0000","last_change":"2024-09-13T06:09:32.141692+0000","last_active":"2024-09-13T06:11:52.809195+0000","last_peered":"2024-09-13T06:11:52.809195+0000","last_clean":"2024-09-13T06:11:52.809195+0000","last_became_active":"2024-09-13T06:09:32.128376+0000","last_became_peered":"2024-09-13T06:09:32.128376+0000","last_unstale":"2024-09-13T06:11:52.809195+0000","last_undegraded":"2024-09-13T06:11:52.809195+0000","last_fullsized":"2024-09-13T06:11:52.809195+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"35'43","reported_seq":125,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.556471+0000","last_change":"2024-09-13T06:09:42.187344+0000","last_active":"2024-09-13T06:12:49.556471+0000","last_peered":"2024-09-13T06:12:49.556471+0000","last_clean":"2024-09-13T06:12:49.556471+0000","last_became_active":"2024-09-13T06:09:42.186091+0000","last_became_peered":"2024-09-13T06:09:42.186091+0000","last_unstale":"2024-09-13T06:12:49.556471+0000","last_undegraded":"2024-09-13T06:12:49.556471+0000","last_fullsized":"2024-09-13T06:12:49.556471+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":246,"num_read_kb":228,"num_write":124,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"35'16","reported_seq":107,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:48.979744+0000","last_change":"2024-09-13T06:09:34.118780+0000","last_active":"2024-09-13T06:12:48.979744+0000","last_peered":"2024-09-13T06:12:48.979744+0000","last_clean":"2024-09-13T06:12:48.979744+0000","last_became_active":"2024-09-13T06:09:34.118393+0000","last_became_peered":"2024-09-13T06:09:34.118393+0000","last_unstale":"2024-09-13T06:12:48.979744+0000","last_undegraded":"2024-09-13T06:12:48.979744+0000","last_fullsized":"2024-09-13T06:12:48.979744+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":90,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"35'6","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:52.809283+0000","last_change":"2024-09-13T06:09:32.139342+0000","last_active":"2024-09-13T06:11:52.809283+0000","last_peered":"2024-09-13T06:11:52.809283+0000","last_clean":"2024-09-13T06:11:52.809283+0000","last_became_active":"2024-09-13T06:09:32.133545+0000","last_became_peered":"2024-09-13T06:09:32.133545+0000","last_unstale":"2024-09-13T06:11:52.809283+0000","last_undegraded":"2024-09-13T06:11:52.809283+0000","last_fullsized":"2024-09-13T06:11:52.809283+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:26.893123+0000","last_change":"2024-09-13T06:13:26.893183+0000","last_active":"2024-09-13T06:13:26.893123+0000","last_peered":"2024-09-13T06:13:26.893123+0000","last_clean":"2024-09-13T06:13:26.893123+0000","last_became_active":"2024-09-13T06:09:36.153420+0000","last_became_peered":"2024-09-13T06:09:36.153420+0000","last_unstale":"2024-09-13T06:13:26.893123+0000","last_undegraded":"2024-09-13T06:13:26.893123+0000","last_fullsized":"2024-09-13T06:13:26.893123+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:26.892934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:26.892934+0000","last_clean_scrub_stamp":"2024-09-13T06:13:26.892934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:12:45.761321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"35'37","reported_seq":92,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:54.897190+0000","last_change":"2024-09-13T06:13:54.897267+0000","last_active":"2024-09-13T06:13:54.897190+0000","last_peered":"2024-09-13T06:13:54.897190+0000","last_clean":"2024-09-13T06:13:54.897190+0000","last_became_active":"2024-09-13T06:09:38.175393+0000","last_became_peered":"2024-09-13T06:09:38.175393+0000","last_unstale":"2024-09-13T06:13:54.897190+0000","last_undegraded":"2024-09-13T06:13:54.897190+0000","last_fullsized":"2024-09-13T06:13:54.897190+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'37","last_scrub_stamp":"2024-09-13T06:13:54.896963+0000","last_deep_scrub":"35'37","last_deep_scrub_stamp":"2024-09-13T06:13:54.896963+0000","last_clean_scrub_stamp":"2024-09-13T06:13:54.896963+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:27:41.104876+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:49.056142+0000","last_change":"2024-09-13T06:13:49.056194+0000","last_active":"2024-09-13T06:13:49.056142+0000","last_peered":"2024-09-13T06:13:49.056142+0000","last_clean":"2024-09-13T06:13:49.056142+0000","last_became_active":"2024-09-13T06:09:40.185574+0000","last_became_peered":"2024-09-13T06:09:40.185574+0000","last_unstale":"2024-09-13T06:13:49.056142+0000","last_undegraded":"2024-09-13T06:13:49.056142+0000","last_fullsized":"2024-09-13T06:13:49.056142+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:49.055950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:49.055950+0000","last_clean_scrub_stamp":"2024-09-13T06:13:49.055950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:11:18.319386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"35'9","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:07.808057+0000","last_change":"2024-09-13T06:09:42.183906+0000","last_active":"2024-09-13T06:12:07.808057+0000","last_peered":"2024-09-13T06:12:07.808057+0000","last_clean":"2024-09-13T06:12:07.808057+0000","last_became_active":"2024-09-13T06:09:42.183162+0000","last_became_peered":"2024-09-13T06:09:42.183162+0000","last_unstale":"2024-09-13T06:12:07.808057+0000","last_undegraded":"2024-09-13T06:12:07.808057+0000","last_fullsized":"2024-09-13T06:12:07.808057+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":19,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"35'6","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.339992+0000","last_change":"2024-09-13T06:09:34.120990+0000","last_active":"2024-09-13T06:12:49.339992+0000","last_peered":"2024-09-13T06:12:49.339992+0000","last_clean":"2024-09-13T06:12:49.339992+0000","last_became_active":"2024-09-13T06:09:34.120600+0000","last_became_peered":"2024-09-13T06:09:34.120600+0000","last_unstale":"2024-09-13T06:12:49.339992+0000","last_undegraded":"2024-09-13T06:12:49.339992+0000","last_fullsized":"2024-09-13T06:12:49.339992+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:55.430952+0000","last_change":"2024-09-13T06:13:55.431016+0000","last_active":"2024-09-13T06:13:55.430952+0000","last_peered":"2024-09-13T06:13:55.430952+0000","last_clean":"2024-09-13T06:13:55.430952+0000","last_became_active":"2024-09-13T06:09:32.138643+0000","last_became_peered":"2024-09-13T06:09:32.138643+0000","last_unstale":"2024-09-13T06:13:55.430952+0000","last_undegraded":"2024-09-13T06:13:55.430952+0000","last_fullsized":"2024-09-13T06:13:55.430952+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:55.430747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:55.430747+0000","last_clean_scrub_stamp":"2024-09-13T06:13:55.430747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:59:14.616769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:41.236180+0000","last_change":"2024-09-13T06:13:41.236284+0000","last_active":"2024-09-13T06:13:41.236180+0000","last_peered":"2024-09-13T06:13:41.236180+0000","last_clean":"2024-09-13T06:13:41.236180+0000","last_became_active":"2024-09-13T06:09:36.139235+0000","last_became_peered":"2024-09-13T06:09:36.139235+0000","last_unstale":"2024-09-13T06:13:41.236180+0000","last_undegraded":"2024-09-13T06:13:41.236180+0000","last_fullsized":"2024-09-13T06:13:41.236180+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:41.235958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:41.235958+0000","last_clean_scrub_stamp":"2024-09-13T06:13:41.235958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:48:26.407496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"35'9","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:28.250353+0000","last_change":"2024-09-13T06:13:28.250424+0000","last_active":"2024-09-13T06:13:28.250353+0000","last_peered":"2024-09-13T06:13:28.250353+0000","last_clean":"2024-09-13T06:13:28.250353+0000","last_became_active":"2024-09-13T06:09:38.161539+0000","last_became_peered":"2024-09-13T06:09:38.161539+0000","last_unstale":"2024-09-13T06:13:28.250353+0000","last_undegraded":"2024-09-13T06:13:28.250353+0000","last_fullsized":"2024-09-13T06:13:28.250353+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'9","last_scrub_stamp":"2024-09-13T06:13:28.250177+0000","last_deep_scrub":"35'9","last_deep_scrub_stamp":"2024-09-13T06:13:28.250177+0000","last_clean_scrub_stamp":"2024-09-13T06:13:28.250177+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:10:57.549533+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:41.143373+0000","last_change":"2024-09-13T06:13:41.143426+0000","last_active":"2024-09-13T06:13:41.143373+0000","last_peered":"2024-09-13T06:13:41.143373+0000","last_clean":"2024-09-13T06:13:41.143373+0000","last_became_active":"2024-09-13T06:09:40.182436+0000","last_became_peered":"2024-09-13T06:09:40.182436+0000","last_unstale":"2024-09-13T06:13:41.143373+0000","last_undegraded":"2024-09-13T06:13:41.143373+0000","last_fullsized":"2024-09-13T06:13:41.143373+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:41.143167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:41.143167+0000","last_clean_scrub_stamp":"2024-09-13T06:13:41.143167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:15:32.092602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"33'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:15.805719+0000","last_change":"2024-09-13T06:09:42.209170+0000","last_active":"2024-09-13T06:12:15.805719+0000","last_peered":"2024-09-13T06:12:15.805719+0000","last_clean":"2024-09-13T06:12:15.805719+0000","last_became_active":"2024-09-13T06:09:42.208430+0000","last_became_peered":"2024-09-13T06:09:42.208430+0000","last_unstale":"2024-09-13T06:12:15.805719+0000","last_undegraded":"2024-09-13T06:12:15.805719+0000","last_fullsized":"2024-09-13T06:12:15.805719+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"35'6","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:00.919501+0000","last_change":"2024-09-13T06:14:00.919560+0000","last_active":"2024-09-13T06:14:00.919501+0000","last_peered":"2024-09-13T06:14:00.919501+0000","last_clean":"2024-09-13T06:14:00.919501+0000","last_became_active":"2024-09-13T06:09:34.122001+0000","last_became_peered":"2024-09-13T06:09:34.122001+0000","last_unstale":"2024-09-13T06:14:00.919501+0000","last_undegraded":"2024-09-13T06:14:00.919501+0000","last_fullsized":"2024-09-13T06:14:00.919501+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:14:00.919310+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:14:00.919310+0000","last_clean_scrub_stamp":"2024-09-13T06:14:00.919310+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:25:53.623575+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:20.953830+0000","last_change":"2024-09-13T06:09:32.132575+0000","last_active":"2024-09-13T06:13:20.953830+0000","last_peered":"2024-09-13T06:13:20.953830+0000","last_clean":"2024-09-13T06:13:20.953830+0000","last_became_active":"2024-09-13T06:09:32.129739+0000","last_became_peered":"2024-09-13T06:09:32.129739+0000","last_unstale":"2024-09-13T06:13:20.953830+0000","last_undegraded":"2024-09-13T06:13:20.953830+0000","last_fullsized":"2024-09-13T06:13:20.953830+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:39.268543+0000","last_change":"2024-09-13T06:13:39.268600+0000","last_active":"2024-09-13T06:13:39.268543+0000","last_peered":"2024-09-13T06:13:39.268543+0000","last_clean":"2024-09-13T06:13:39.268543+0000","last_became_active":"2024-09-13T06:09:36.143405+0000","last_became_peered":"2024-09-13T06:09:36.143405+0000","last_unstale":"2024-09-13T06:13:39.268543+0000","last_undegraded":"2024-09-13T06:13:39.268543+0000","last_fullsized":"2024-09-13T06:13:39.268543+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:39.268339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:39.268339+0000","last_clean_scrub_stamp":"2024-09-13T06:13:39.268339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:08:53.766496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"35'15","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:37.488221+0000","last_change":"2024-09-13T06:13:37.488304+0000","last_active":"2024-09-13T06:13:37.488221+0000","last_peered":"2024-09-13T06:13:37.488221+0000","last_clean":"2024-09-13T06:13:37.488221+0000","last_became_active":"2024-09-13T06:09:38.154654+0000","last_became_peered":"2024-09-13T06:09:38.154654+0000","last_unstale":"2024-09-13T06:13:37.488221+0000","last_undegraded":"2024-09-13T06:13:37.488221+0000","last_fullsized":"2024-09-13T06:13:37.488221+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'15","last_scrub_stamp":"2024-09-13T06:13:37.488029+0000","last_deep_scrub":"35'15","last_deep_scrub_stamp":"2024-09-13T06:13:37.488029+0000","last_clean_scrub_stamp":"2024-09-13T06:13:37.488029+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:59:42.866540+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"35'286","reported_seq":418,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:59.900958+0000","last_change":"2024-09-13T06:13:59.901028+0000","last_active":"2024-09-13T06:13:59.900958+0000","last_peered":"2024-09-13T06:13:59.900958+0000","last_clean":"2024-09-13T06:13:59.900958+0000","last_became_active":"2024-09-13T06:09:40.190377+0000","last_became_peered":"2024-09-13T06:09:40.190377+0000","last_unstale":"2024-09-13T06:13:59.900958+0000","last_undegraded":"2024-09-13T06:13:59.900958+0000","last_fullsized":"2024-09-13T06:13:59.900958+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'286","last_scrub_stamp":"2024-09-13T06:13:59.900745+0000","last_deep_scrub":"35'286","last_deep_scrub_stamp":"2024-09-13T06:13:59.900745+0000","last_clean_scrub_stamp":"2024-09-13T06:13:59.900745+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:29:32.530047+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:48.547957+0000","last_change":"2024-09-13T06:13:48.548016+0000","last_active":"2024-09-13T06:13:48.547957+0000","last_peered":"2024-09-13T06:13:48.547957+0000","last_clean":"2024-09-13T06:13:48.547957+0000","last_became_active":"2024-09-13T06:09:42.204083+0000","last_became_peered":"2024-09-13T06:09:42.204083+0000","last_unstale":"2024-09-13T06:13:48.547957+0000","last_undegraded":"2024-09-13T06:13:48.547957+0000","last_fullsized":"2024-09-13T06:13:48.547957+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:48.547749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:48.547749+0000","last_clean_scrub_stamp":"2024-09-13T06:13:48.547749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:09:43.428843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"35'6","reported_seq":66,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:51.108156+0000","last_change":"2024-09-13T06:13:51.108220+0000","last_active":"2024-09-13T06:13:51.108156+0000","last_peered":"2024-09-13T06:13:51.108156+0000","last_clean":"2024-09-13T06:13:51.108156+0000","last_became_active":"2024-09-13T06:09:34.130815+0000","last_became_peered":"2024-09-13T06:09:34.130815+0000","last_unstale":"2024-09-13T06:13:51.108156+0000","last_undegraded":"2024-09-13T06:13:51.108156+0000","last_fullsized":"2024-09-13T06:13:51.108156+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:13:51.107946+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:13:51.107946+0000","last_clean_scrub_stamp":"2024-09-13T06:13:51.107946+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:16:53.824111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:52.804083+0000","last_change":"2024-09-13T06:09:32.118707+0000","last_active":"2024-09-13T06:11:52.804083+0000","last_peered":"2024-09-13T06:11:52.804083+0000","last_clean":"2024-09-13T06:11:52.804083+0000","last_became_active":"2024-09-13T06:09:32.118278+0000","last_became_peered":"2024-09-13T06:09:32.118278+0000","last_unstale":"2024-09-13T06:11:52.804083+0000","last_undegraded":"2024-09-13T06:11:52.804083+0000","last_fullsized":"2024-09-13T06:11:52.804083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:02.812230+0000","last_change":"2024-09-13T06:10:10.825317+0000","last_active":"2024-09-13T06:12:02.812230+0000","last_peered":"2024-09-13T06:12:02.812230+0000","last_clean":"2024-09-13T06:12:02.812230+0000","last_became_active":"2024-09-13T06:10:10.824420+0000","last_became_peered":"2024-09-13T06:10:10.824420+0000","last_unstale":"2024-09-13T06:12:02.812230+0000","last_undegraded":"2024-09-13T06:12:02.812230+0000","last_fullsized":"2024-09-13T06:12:02.812230+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"35'37","reported_seq":92,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:35.449293+0000","last_change":"2024-09-13T06:13:35.449374+0000","last_active":"2024-09-13T06:13:35.449293+0000","last_peered":"2024-09-13T06:13:35.449293+0000","last_clean":"2024-09-13T06:13:35.449293+0000","last_became_active":"2024-09-13T06:09:38.157430+0000","last_became_peered":"2024-09-13T06:09:38.157430+0000","last_unstale":"2024-09-13T06:13:35.449293+0000","last_undegraded":"2024-09-13T06:13:35.449293+0000","last_fullsized":"2024-09-13T06:13:35.449293+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'37","last_scrub_stamp":"2024-09-13T06:13:35.449087+0000","last_deep_scrub":"35'37","last_deep_scrub_stamp":"2024-09-13T06:13:35.449087+0000","last_clean_scrub_stamp":"2024-09-13T06:13:35.449087+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:28:30.698850+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"35'285","reported_seq":448,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:26.281413+0000","last_change":"2024-09-13T06:13:26.281485+0000","last_active":"2024-09-13T06:13:26.281413+0000","last_peered":"2024-09-13T06:13:26.281413+0000","last_clean":"2024-09-13T06:13:26.281413+0000","last_became_active":"2024-09-13T06:09:40.175871+0000","last_became_peered":"2024-09-13T06:09:40.175871+0000","last_unstale":"2024-09-13T06:13:26.281413+0000","last_undegraded":"2024-09-13T06:13:26.281413+0000","last_fullsized":"2024-09-13T06:13:26.281413+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-13T06:13:26.281223+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-13T06:13:26.281223+0000","last_clean_scrub_stamp":"2024-09-13T06:13:26.281223+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:05:30.880244+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"35'2","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:44.821803+0000","last_change":"2024-09-13T06:13:44.821803+0000","last_active":"2024-09-13T06:13:44.821803+0000","last_peered":"2024-09-13T06:13:44.821803+0000","last_clean":"2024-09-13T06:13:44.821803+0000","last_became_active":"2024-09-13T06:09:34.126374+0000","last_became_peered":"2024-09-13T06:09:34.126374+0000","last_unstale":"2024-09-13T06:13:44.821803+0000","last_undegraded":"2024-09-13T06:13:44.821803+0000","last_fullsized":"2024-09-13T06:13:44.821803+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:13:44.821554+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:13:44.821554+0000","last_clean_scrub_stamp":"2024-09-13T06:13:44.821554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:48:20.992725+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:24.971749+0000","last_change":"2024-09-13T06:09:32.131764+0000","last_active":"2024-09-13T06:13:24.971749+0000","last_peered":"2024-09-13T06:13:24.971749+0000","last_clean":"2024-09-13T06:13:24.971749+0000","last_became_active":"2024-09-13T06:09:32.131373+0000","last_became_peered":"2024-09-13T06:09:32.131373+0000","last_unstale":"2024-09-13T06:13:24.971749+0000","last_undegraded":"2024-09-13T06:13:24.971749+0000","last_fullsized":"2024-09-13T06:13:24.971749+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:38.094138+0000","last_change":"2024-09-13T06:13:38.094138+0000","last_active":"2024-09-13T06:13:38.094138+0000","last_peered":"2024-09-13T06:13:38.094138+0000","last_clean":"2024-09-13T06:13:38.094138+0000","last_became_active":"2024-09-13T06:09:36.137016+0000","last_became_peered":"2024-09-13T06:09:36.137016+0000","last_unstale":"2024-09-13T06:13:38.094138+0000","last_undegraded":"2024-09-13T06:13:38.094138+0000","last_fullsized":"2024-09-13T06:13:38.094138+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:38.093864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:38.093864+0000","last_clean_scrub_stamp":"2024-09-13T06:13:38.093864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:18:03.005466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"35'51","reported_seq":112,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:31.369768+0000","last_change":"2024-09-13T06:13:31.369768+0000","last_active":"2024-09-13T06:13:31.369768+0000","last_peered":"2024-09-13T06:13:31.369768+0000","last_clean":"2024-09-13T06:13:31.369768+0000","last_became_active":"2024-09-13T06:09:38.163472+0000","last_became_peered":"2024-09-13T06:09:38.163472+0000","last_unstale":"2024-09-13T06:13:31.369768+0000","last_undegraded":"2024-09-13T06:13:31.369768+0000","last_fullsized":"2024-09-13T06:13:31.369768+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'51","last_scrub_stamp":"2024-09-13T06:13:31.369476+0000","last_deep_scrub":"35'51","last_deep_scrub_stamp":"2024-09-13T06:13:31.369476+0000","last_clean_scrub_stamp":"2024-09-13T06:13:31.369476+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:44:16.358341+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:27.325548+0000","last_change":"2024-09-13T06:13:27.325602+0000","last_active":"2024-09-13T06:13:27.325548+0000","last_peered":"2024-09-13T06:13:27.325548+0000","last_clean":"2024-09-13T06:13:27.325548+0000","last_became_active":"2024-09-13T06:09:40.171609+0000","last_became_peered":"2024-09-13T06:09:40.171609+0000","last_unstale":"2024-09-13T06:13:27.325548+0000","last_undegraded":"2024-09-13T06:13:27.325548+0000","last_fullsized":"2024-09-13T06:13:27.325548+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:27.325358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:27.325358+0000","last_clean_scrub_stamp":"2024-09-13T06:13:27.325358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:15:24.519986+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"35'5","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:24.973947+0000","last_change":"2024-09-13T06:09:42.208317+0000","last_active":"2024-09-13T06:13:24.973947+0000","last_peered":"2024-09-13T06:13:24.973947+0000","last_clean":"2024-09-13T06:13:24.973947+0000","last_became_active":"2024-09-13T06:09:42.193426+0000","last_became_peered":"2024-09-13T06:09:42.193426+0000","last_unstale":"2024-09-13T06:13:24.973947+0000","last_undegraded":"2024-09-13T06:13:24.973947+0000","last_fullsized":"2024-09-13T06:13:24.973947+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"35'6","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:56.130563+0000","last_change":"2024-09-13T06:13:56.130563+0000","last_active":"2024-09-13T06:13:56.130563+0000","last_peered":"2024-09-13T06:13:56.130563+0000","last_clean":"2024-09-13T06:13:56.130563+0000","last_became_active":"2024-09-13T06:09:34.114999+0000","last_became_peered":"2024-09-13T06:09:34.114999+0000","last_unstale":"2024-09-13T06:13:56.130563+0000","last_undegraded":"2024-09-13T06:13:56.130563+0000","last_fullsized":"2024-09-13T06:13:56.130563+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:13:56.130180+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:13:56.130180+0000","last_clean_scrub_stamp":"2024-09-13T06:13:56.130180+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:43:27.715392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:24.971760+0000","last_change":"2024-09-13T06:09:32.118402+0000","last_active":"2024-09-13T06:13:24.971760+0000","last_peered":"2024-09-13T06:13:24.971760+0000","last_clean":"2024-09-13T06:13:24.971760+0000","last_became_active":"2024-09-13T06:09:32.117779+0000","last_became_peered":"2024-09-13T06:09:32.117779+0000","last_unstale":"2024-09-13T06:13:24.971760+0000","last_undegraded":"2024-09-13T06:13:24.971760+0000","last_fullsized":"2024-09-13T06:13:24.971760+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:43.192766+0000","last_change":"2024-09-13T06:13:43.192766+0000","last_active":"2024-09-13T06:13:43.192766+0000","last_peered":"2024-09-13T06:13:43.192766+0000","last_clean":"2024-09-13T06:13:43.192766+0000","last_became_active":"2024-09-13T06:09:36.135862+0000","last_became_peered":"2024-09-13T06:09:36.135862+0000","last_unstale":"2024-09-13T06:13:43.192766+0000","last_undegraded":"2024-09-13T06:13:43.192766+0000","last_fullsized":"2024-09-13T06:13:43.192766+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:43.192506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:43.192506+0000","last_clean_scrub_stamp":"2024-09-13T06:13:43.192506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:16:55.055009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"35'37","reported_seq":92,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:35.787076+0000","last_change":"2024-09-13T06:13:35.787233+0000","last_active":"2024-09-13T06:13:35.787076+0000","last_peered":"2024-09-13T06:13:35.787076+0000","last_clean":"2024-09-13T06:13:35.787076+0000","last_became_active":"2024-09-13T06:09:38.171931+0000","last_became_peered":"2024-09-13T06:09:38.171931+0000","last_unstale":"2024-09-13T06:13:35.787076+0000","last_undegraded":"2024-09-13T06:13:35.787076+0000","last_fullsized":"2024-09-13T06:13:35.787076+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'37","last_scrub_stamp":"2024-09-13T06:13:35.786837+0000","last_deep_scrub":"35'37","last_deep_scrub_stamp":"2024-09-13T06:13:35.786837+0000","last_clean_scrub_stamp":"2024-09-13T06:13:35.786837+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:50:05.816319+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:32.280888+0000","last_change":"2024-09-13T06:13:32.280888+0000","last_active":"2024-09-13T06:13:32.280888+0000","last_peered":"2024-09-13T06:13:32.280888+0000","last_clean":"2024-09-13T06:13:32.280888+0000","last_became_active":"2024-09-13T06:09:40.178545+0000","last_became_peered":"2024-09-13T06:09:40.178545+0000","last_unstale":"2024-09-13T06:13:32.280888+0000","last_undegraded":"2024-09-13T06:13:32.280888+0000","last_fullsized":"2024-09-13T06:13:32.280888+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:32.280631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:32.280631+0000","last_clean_scrub_stamp":"2024-09-13T06:13:32.280631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:40:09.829593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"35'5","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:24.521642+0000","last_change":"2024-09-13T06:09:42.206012+0000","last_active":"2024-09-13T06:13:24.521642+0000","last_peered":"2024-09-13T06:13:24.521642+0000","last_clean":"2024-09-13T06:13:24.521642+0000","last_became_active":"2024-09-13T06:09:42.204945+0000","last_became_peered":"2024-09-13T06:09:42.204945+0000","last_unstale":"2024-09-13T06:13:24.521642+0000","last_undegraded":"2024-09-13T06:13:24.521642+0000","last_fullsized":"2024-09-13T06:13:24.521642+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"33'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:24.972385+0000","last_change":"2024-09-13T06:09:34.104885+0000","last_active":"2024-09-13T06:13:24.972385+0000","last_peered":"2024-09-13T06:13:24.972385+0000","last_clean":"2024-09-13T06:13:24.972385+0000","last_became_active":"2024-09-13T06:09:34.102657+0000","last_became_peered":"2024-09-13T06:09:34.102657+0000","last_unstale":"2024-09-13T06:13:24.972385+0000","last_undegraded":"2024-09-13T06:13:24.972385+0000","last_fullsized":"2024-09-13T06:13:24.972385+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"35'6","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.440495+0000","last_change":"2024-09-13T06:09:32.136390+0000","last_active":"2024-09-13T06:13:25.440495+0000","last_peered":"2024-09-13T06:13:25.440495+0000","last_clean":"2024-09-13T06:13:25.440495+0000","last_became_active":"2024-09-13T06:09:32.133020+0000","last_became_peered":"2024-09-13T06:09:32.133020+0000","last_unstale":"2024-09-13T06:13:25.440495+0000","last_undegraded":"2024-09-13T06:13:25.440495+0000","last_fullsized":"2024-09-13T06:13:25.440495+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":22,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:26.807560+0000","last_change":"2024-09-13T06:10:10.810157+0000","last_active":"2024-09-13T06:12:26.807560+0000","last_peered":"2024-09-13T06:12:26.807560+0000","last_clean":"2024-09-13T06:12:26.807560+0000","last_became_active":"2024-09-13T06:10:10.809442+0000","last_became_peered":"2024-09-13T06:10:10.809442+0000","last_unstale":"2024-09-13T06:12:26.807560+0000","last_undegraded":"2024-09-13T06:12:26.807560+0000","last_fullsized":"2024-09-13T06:12:26.807560+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"35'45","reported_seq":104,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:27.901555+0000","last_change":"2024-09-13T06:13:27.901555+0000","last_active":"2024-09-13T06:13:27.901555+0000","last_peered":"2024-09-13T06:13:27.901555+0000","last_clean":"2024-09-13T06:13:27.901555+0000","last_became_active":"2024-09-13T06:09:38.154720+0000","last_became_peered":"2024-09-13T06:09:38.154720+0000","last_unstale":"2024-09-13T06:13:27.901555+0000","last_undegraded":"2024-09-13T06:13:27.901555+0000","last_fullsized":"2024-09-13T06:13:27.901555+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'45","last_scrub_stamp":"2024-09-13T06:13:27.901155+0000","last_deep_scrub":"35'45","last_deep_scrub_stamp":"2024-09-13T06:13:27.901155+0000","last_clean_scrub_stamp":"2024-09-13T06:13:27.901155+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:38:20.916120+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"35'285","reported_seq":411,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:48.184617+0000","last_change":"2024-09-13T06:13:48.184617+0000","last_active":"2024-09-13T06:13:48.184617+0000","last_peered":"2024-09-13T06:13:48.184617+0000","last_clean":"2024-09-13T06:13:48.184617+0000","last_became_active":"2024-09-13T06:09:40.186987+0000","last_became_peered":"2024-09-13T06:09:40.186987+0000","last_unstale":"2024-09-13T06:13:48.184617+0000","last_undegraded":"2024-09-13T06:13:48.184617+0000","last_fullsized":"2024-09-13T06:13:48.184617+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-13T06:13:48.184284+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-13T06:13:48.184284+0000","last_clean_scrub_stamp":"2024-09-13T06:13:48.184284+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:59:07.370306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"35'2","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:24.056011+0000","last_change":"2024-09-13T06:09:42.202356+0000","last_active":"2024-09-13T06:13:24.056011+0000","last_peered":"2024-09-13T06:13:24.056011+0000","last_clean":"2024-09-13T06:13:24.056011+0000","last_became_active":"2024-09-13T06:09:42.201678+0000","last_became_peered":"2024-09-13T06:09:42.201678+0000","last_unstale":"2024-09-13T06:13:24.056011+0000","last_undegraded":"2024-09-13T06:13:24.056011+0000","last_fullsized":"2024-09-13T06:13:24.056011+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"35'14","reported_seq":78,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:52.484077+0000","last_change":"2024-09-13T06:13:52.484137+0000","last_active":"2024-09-13T06:13:52.484077+0000","last_peered":"2024-09-13T06:13:52.484077+0000","last_clean":"2024-09-13T06:13:52.484077+0000","last_became_active":"2024-09-13T06:09:34.103295+0000","last_became_peered":"2024-09-13T06:09:34.103295+0000","last_unstale":"2024-09-13T06:13:52.484077+0000","last_undegraded":"2024-09-13T06:13:52.484077+0000","last_fullsized":"2024-09-13T06:13:52.484077+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'14","last_scrub_stamp":"2024-09-13T06:13:52.483880+0000","last_deep_scrub":"35'14","last_deep_scrub_stamp":"2024-09-13T06:13:52.483880+0000","last_clean_scrub_stamp":"2024-09-13T06:13:52.483880+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:12:37.738064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.440523+0000","last_change":"2024-09-13T06:09:32.128209+0000","last_active":"2024-09-13T06:13:25.440523+0000","last_peered":"2024-09-13T06:13:25.440523+0000","last_clean":"2024-09-13T06:13:25.440523+0000","last_became_active":"2024-09-13T06:09:32.125047+0000","last_became_peered":"2024-09-13T06:09:32.125047+0000","last_unstale":"2024-09-13T06:13:25.440523+0000","last_undegraded":"2024-09-13T06:13:25.440523+0000","last_fullsized":"2024-09-13T06:13:25.440523+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:42.241894+0000","last_change":"2024-09-13T06:13:42.241894+0000","last_active":"2024-09-13T06:13:42.241894+0000","last_peered":"2024-09-13T06:13:42.241894+0000","last_clean":"2024-09-13T06:13:42.241894+0000","last_became_active":"2024-09-13T06:09:36.135896+0000","last_became_peered":"2024-09-13T06:09:36.135896+0000","last_unstale":"2024-09-13T06:13:42.241894+0000","last_undegraded":"2024-09-13T06:13:42.241894+0000","last_fullsized":"2024-09-13T06:13:42.241894+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:42.241654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:42.241654+0000","last_clean_scrub_stamp":"2024-09-13T06:13:42.241654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:30:48.725646+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"35'68","reported_seq":142,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:56.931891+0000","last_change":"2024-09-13T06:13:56.931891+0000","last_active":"2024-09-13T06:13:56.931891+0000","last_peered":"2024-09-13T06:13:56.931891+0000","last_clean":"2024-09-13T06:13:56.931891+0000","last_became_active":"2024-09-13T06:09:38.175404+0000","last_became_peered":"2024-09-13T06:09:38.175404+0000","last_unstale":"2024-09-13T06:13:56.931891+0000","last_undegraded":"2024-09-13T06:13:56.931891+0000","last_fullsized":"2024-09-13T06:13:56.931891+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'68","last_scrub_stamp":"2024-09-13T06:13:56.931599+0000","last_deep_scrub":"35'68","last_deep_scrub_stamp":"2024-09-13T06:13:56.931599+0000","last_clean_scrub_stamp":"2024-09-13T06:13:56.931599+0000","objects_scrubbed":5,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:48:12.141585+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":65,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:24.261010+0000","last_change":"2024-09-13T06:13:24.261010+0000","last_active":"2024-09-13T06:13:24.261010+0000","last_peered":"2024-09-13T06:13:24.261010+0000","last_clean":"2024-09-13T06:13:24.261010+0000","last_became_active":"2024-09-13T06:09:40.177127+0000","last_became_peered":"2024-09-13T06:09:40.177127+0000","last_unstale":"2024-09-13T06:13:24.261010+0000","last_undegraded":"2024-09-13T06:13:24.261010+0000","last_fullsized":"2024-09-13T06:13:24.261010+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:24.260874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:24.260874+0000","last_clean_scrub_stamp":"2024-09-13T06:13:24.260874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:44:50.272386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"35'18","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:24.055901+0000","last_change":"2024-09-13T06:09:42.177354+0000","last_active":"2024-09-13T06:13:24.055901+0000","last_peered":"2024-09-13T06:13:24.055901+0000","last_clean":"2024-09-13T06:13:24.055901+0000","last_became_active":"2024-09-13T06:09:42.176229+0000","last_became_peered":"2024-09-13T06:09:42.176229+0000","last_unstale":"2024-09-13T06:13:24.055901+0000","last_undegraded":"2024-09-13T06:13:24.055901+0000","last_fullsized":"2024-09-13T06:13:24.055901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"35'16","reported_seq":78,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.132395+0000","last_change":"2024-09-13T06:09:34.121751+0000","last_active":"2024-09-13T06:12:49.132395+0000","last_peered":"2024-09-13T06:12:49.132395+0000","last_clean":"2024-09-13T06:12:49.132395+0000","last_became_active":"2024-09-13T06:09:34.119018+0000","last_became_peered":"2024-09-13T06:09:34.119018+0000","last_unstale":"2024-09-13T06:12:49.132395+0000","last_undegraded":"2024-09-13T06:12:49.132395+0000","last_fullsized":"2024-09-13T06:12:49.132395+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:02.994130+0000","last_change":"2024-09-13T06:14:02.994130+0000","last_active":"2024-09-13T06:14:02.994130+0000","last_peered":"2024-09-13T06:14:02.994130+0000","last_clean":"2024-09-13T06:14:02.994130+0000","last_became_active":"2024-09-13T06:09:32.148505+0000","last_became_peered":"2024-09-13T06:09:32.148505+0000","last_unstale":"2024-09-13T06:14:02.994130+0000","last_undegraded":"2024-09-13T06:14:02.994130+0000","last_fullsized":"2024-09-13T06:14:02.994130+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:02.993832+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:02.993832+0000","last_clean_scrub_stamp":"2024-09-13T06:14:02.993832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:44:02.387231+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:42.465274+0000","last_change":"2024-09-13T06:13:42.465330+0000","last_active":"2024-09-13T06:13:42.465274+0000","last_peered":"2024-09-13T06:13:42.465274+0000","last_clean":"2024-09-13T06:13:42.465274+0000","last_became_active":"2024-09-13T06:09:36.131611+0000","last_became_peered":"2024-09-13T06:09:36.131611+0000","last_unstale":"2024-09-13T06:13:42.465274+0000","last_undegraded":"2024-09-13T06:13:42.465274+0000","last_fullsized":"2024-09-13T06:13:42.465274+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:42.465072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:42.465072+0000","last_clean_scrub_stamp":"2024-09-13T06:13:42.465072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:13:43.052645+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"35'40","reported_seq":96,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:27.295684+0000","last_change":"2024-09-13T06:13:27.295757+0000","last_active":"2024-09-13T06:13:27.295684+0000","last_peered":"2024-09-13T06:13:27.295684+0000","last_clean":"2024-09-13T06:13:27.295684+0000","last_became_active":"2024-09-13T06:09:38.165747+0000","last_became_peered":"2024-09-13T06:09:38.165747+0000","last_unstale":"2024-09-13T06:13:27.295684+0000","last_undegraded":"2024-09-13T06:13:27.295684+0000","last_fullsized":"2024-09-13T06:13:27.295684+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'40","last_scrub_stamp":"2024-09-13T06:13:27.295462+0000","last_deep_scrub":"35'40","last_deep_scrub_stamp":"2024-09-13T06:13:27.295462+0000","last_clean_scrub_stamp":"2024-09-13T06:13:27.295462+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:22:05.049909+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:55.906750+0000","last_change":"2024-09-13T06:13:55.906807+0000","last_active":"2024-09-13T06:13:55.906750+0000","last_peered":"2024-09-13T06:13:55.906750+0000","last_clean":"2024-09-13T06:13:55.906750+0000","last_became_active":"2024-09-13T06:09:40.190314+0000","last_became_peered":"2024-09-13T06:09:40.190314+0000","last_unstale":"2024-09-13T06:13:55.906750+0000","last_undegraded":"2024-09-13T06:13:55.906750+0000","last_fullsized":"2024-09-13T06:13:55.906750+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:55.906553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:55.906553+0000","last_clean_scrub_stamp":"2024-09-13T06:13:55.906553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:32:46.700425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"35'3","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.443077+0000","last_change":"2024-09-13T06:09:42.202356+0000","last_active":"2024-09-13T06:13:25.443077+0000","last_peered":"2024-09-13T06:13:25.443077+0000","last_clean":"2024-09-13T06:13:25.443077+0000","last_became_active":"2024-09-13T06:09:42.201211+0000","last_became_peered":"2024-09-13T06:09:42.201211+0000","last_unstale":"2024-09-13T06:13:25.443077+0000","last_undegraded":"2024-09-13T06:13:25.443077+0000","last_fullsized":"2024-09-13T06:13:25.443077+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"35'6","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:40.785597+0000","last_change":"2024-09-13T06:13:40.785766+0000","last_active":"2024-09-13T06:13:40.785597+0000","last_peered":"2024-09-13T06:13:40.785597+0000","last_clean":"2024-09-13T06:13:40.785597+0000","last_became_active":"2024-09-13T06:09:34.131882+0000","last_became_peered":"2024-09-13T06:09:34.131882+0000","last_unstale":"2024-09-13T06:13:40.785597+0000","last_undegraded":"2024-09-13T06:13:40.785597+0000","last_fullsized":"2024-09-13T06:13:40.785597+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:13:40.785378+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:13:40.785378+0000","last_clean_scrub_stamp":"2024-09-13T06:13:40.785378+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:31:15.240641+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.440416+0000","last_change":"2024-09-13T06:09:32.143831+0000","last_active":"2024-09-13T06:13:25.440416+0000","last_peered":"2024-09-13T06:13:25.440416+0000","last_clean":"2024-09-13T06:13:25.440416+0000","last_became_active":"2024-09-13T06:09:32.138731+0000","last_became_peered":"2024-09-13T06:09:32.138731+0000","last_unstale":"2024-09-13T06:13:25.440416+0000","last_undegraded":"2024-09-13T06:13:25.440416+0000","last_fullsized":"2024-09-13T06:13:25.440416+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:45.169252+0000","last_change":"2024-09-13T06:13:45.169252+0000","last_active":"2024-09-13T06:13:45.169252+0000","last_peered":"2024-09-13T06:13:45.169252+0000","last_clean":"2024-09-13T06:13:45.169252+0000","last_became_active":"2024-09-13T06:09:36.135660+0000","last_became_peered":"2024-09-13T06:09:36.135660+0000","last_unstale":"2024-09-13T06:13:45.169252+0000","last_undegraded":"2024-09-13T06:13:45.169252+0000","last_fullsized":"2024-09-13T06:13:45.169252+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:45.168902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:45.168902+0000","last_clean_scrub_stamp":"2024-09-13T06:13:45.168902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:17:37.777327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"35'46","reported_seq":104,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:38.444335+0000","last_change":"2024-09-13T06:13:38.444422+0000","last_active":"2024-09-13T06:13:38.444335+0000","last_peered":"2024-09-13T06:13:38.444335+0000","last_clean":"2024-09-13T06:13:38.444335+0000","last_became_active":"2024-09-13T06:09:38.143209+0000","last_became_peered":"2024-09-13T06:09:38.143209+0000","last_unstale":"2024-09-13T06:13:38.444335+0000","last_undegraded":"2024-09-13T06:13:38.444335+0000","last_fullsized":"2024-09-13T06:13:38.444335+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'46","last_scrub_stamp":"2024-09-13T06:13:38.444138+0000","last_deep_scrub":"35'46","last_deep_scrub_stamp":"2024-09-13T06:13:38.444138+0000","last_clean_scrub_stamp":"2024-09-13T06:13:38.444138+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:49:28.085814+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"35'285","reported_seq":416,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:32.368055+0000","last_change":"2024-09-13T06:13:32.368124+0000","last_active":"2024-09-13T06:13:32.368055+0000","last_peered":"2024-09-13T06:13:32.368055+0000","last_clean":"2024-09-13T06:13:32.368055+0000","last_became_active":"2024-09-13T06:09:40.188246+0000","last_became_peered":"2024-09-13T06:09:40.188246+0000","last_unstale":"2024-09-13T06:13:32.368055+0000","last_undegraded":"2024-09-13T06:13:32.368055+0000","last_fullsized":"2024-09-13T06:13:32.368055+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-13T06:13:32.367867+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-13T06:13:32.367867+0000","last_clean_scrub_stamp":"2024-09-13T06:13:32.367867+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:44:58.379379+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"35'16","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:24.056082+0000","last_change":"2024-09-13T06:09:42.201997+0000","last_active":"2024-09-13T06:13:24.056082+0000","last_peered":"2024-09-13T06:13:24.056082+0000","last_clean":"2024-09-13T06:13:24.056082+0000","last_became_active":"2024-09-13T06:09:42.201304+0000","last_became_peered":"2024-09-13T06:09:42.201304+0000","last_unstale":"2024-09-13T06:13:24.056082+0000","last_undegraded":"2024-09-13T06:13:24.056082+0000","last_fullsized":"2024-09-13T06:13:24.056082+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":29,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"35'4","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:00.426265+0000","last_change":"2024-09-13T06:14:00.426330+0000","last_active":"2024-09-13T06:14:00.426265+0000","last_peered":"2024-09-13T06:14:00.426265+0000","last_clean":"2024-09-13T06:14:00.426265+0000","last_became_active":"2024-09-13T06:09:34.102586+0000","last_became_peered":"2024-09-13T06:09:34.102586+0000","last_unstale":"2024-09-13T06:14:00.426265+0000","last_undegraded":"2024-09-13T06:14:00.426265+0000","last_fullsized":"2024-09-13T06:14:00.426265+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:14:00.426064+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:14:00.426064+0000","last_clean_scrub_stamp":"2024-09-13T06:14:00.426064+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:46:57.805890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"35'2","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.440543+0000","last_change":"2024-09-13T06:09:32.125108+0000","last_active":"2024-09-13T06:13:25.440543+0000","last_peered":"2024-09-13T06:13:25.440543+0000","last_clean":"2024-09-13T06:13:25.440543+0000","last_became_active":"2024-09-13T06:09:32.122121+0000","last_became_peered":"2024-09-13T06:09:32.122121+0000","last_unstale":"2024-09-13T06:13:25.440543+0000","last_undegraded":"2024-09-13T06:13:25.440543+0000","last_fullsized":"2024-09-13T06:13:25.440543+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"35'5","reported_seq":428,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:32.185723+0000","last_change":"2024-09-13T06:13:32.185845+0000","last_active":"2024-09-13T06:13:32.185723+0000","last_peered":"2024-09-13T06:13:32.185723+0000","last_clean":"2024-09-13T06:13:32.185723+0000","last_became_active":"2024-09-13T06:09:36.141789+0000","last_became_peered":"2024-09-13T06:09:36.141789+0000","last_unstale":"2024-09-13T06:13:32.185723+0000","last_undegraded":"2024-09-13T06:13:32.185723+0000","last_fullsized":"2024-09-13T06:13:32.185723+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'5","last_scrub_stamp":"2024-09-13T06:13:32.185488+0000","last_deep_scrub":"35'5","last_deep_scrub_stamp":"2024-09-13T06:13:32.185488+0000","last_clean_scrub_stamp":"2024-09-13T06:13:32.185488+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:56:51.767002+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"35'15","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:52.922259+0000","last_change":"2024-09-13T06:13:52.922425+0000","last_active":"2024-09-13T06:13:52.922259+0000","last_peered":"2024-09-13T06:13:52.922259+0000","last_clean":"2024-09-13T06:13:52.922259+0000","last_became_active":"2024-09-13T06:09:38.177217+0000","last_became_peered":"2024-09-13T06:09:38.177217+0000","last_unstale":"2024-09-13T06:13:52.922259+0000","last_undegraded":"2024-09-13T06:13:52.922259+0000","last_fullsized":"2024-09-13T06:13:52.922259+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'15","last_scrub_stamp":"2024-09-13T06:13:52.922012+0000","last_deep_scrub":"35'15","last_deep_scrub_stamp":"2024-09-13T06:13:52.922012+0000","last_clean_scrub_stamp":"2024-09-13T06:13:52.922012+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:05:01.785924+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"35'285","reported_seq":472,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:29.237136+0000","last_change":"2024-09-13T06:13:29.237199+0000","last_active":"2024-09-13T06:13:29.237136+0000","last_peered":"2024-09-13T06:13:29.237136+0000","last_clean":"2024-09-13T06:13:29.237136+0000","last_became_active":"2024-09-13T06:09:40.179438+0000","last_became_peered":"2024-09-13T06:09:40.179438+0000","last_unstale":"2024-09-13T06:13:29.237136+0000","last_undegraded":"2024-09-13T06:13:29.237136+0000","last_fullsized":"2024-09-13T06:13:29.237136+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-13T06:13:29.236948+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-13T06:13:29.236948+0000","last_clean_scrub_stamp":"2024-09-13T06:13:29.236948+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:34:12.529343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"35'6","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:44.457830+0000","last_change":"2024-09-13T06:13:44.457830+0000","last_active":"2024-09-13T06:13:44.457830+0000","last_peered":"2024-09-13T06:13:44.457830+0000","last_clean":"2024-09-13T06:13:44.457830+0000","last_became_active":"2024-09-13T06:09:42.181854+0000","last_became_peered":"2024-09-13T06:09:42.181854+0000","last_unstale":"2024-09-13T06:13:44.457830+0000","last_undegraded":"2024-09-13T06:13:44.457830+0000","last_fullsized":"2024-09-13T06:13:44.457830+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:13:44.457577+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:13:44.457577+0000","last_clean_scrub_stamp":"2024-09-13T06:13:44.457577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:56:32.118289+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:46.140462+0000","last_change":"2024-09-13T06:13:46.140515+0000","last_active":"2024-09-13T06:13:46.140462+0000","last_peered":"2024-09-13T06:13:46.140462+0000","last_clean":"2024-09-13T06:13:46.140462+0000","last_became_active":"2024-09-13T06:09:34.126843+0000","last_became_peered":"2024-09-13T06:09:34.126843+0000","last_unstale":"2024-09-13T06:13:46.140462+0000","last_undegraded":"2024-09-13T06:13:46.140462+0000","last_fullsized":"2024-09-13T06:13:46.140462+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:46.140243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:46.140243+0000","last_clean_scrub_stamp":"2024-09-13T06:13:46.140243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:17:57.910783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"35'5","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.440378+0000","last_change":"2024-09-13T06:09:32.133494+0000","last_active":"2024-09-13T06:13:25.440378+0000","last_peered":"2024-09-13T06:13:25.440378+0000","last_clean":"2024-09-13T06:13:25.440378+0000","last_became_active":"2024-09-13T06:09:32.129984+0000","last_became_peered":"2024-09-13T06:09:32.129984+0000","last_unstale":"2024-09-13T06:13:25.440378+0000","last_undegraded":"2024-09-13T06:13:25.440378+0000","last_fullsized":"2024-09-13T06:13:25.440378+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.906948+0000","last_change":"2024-09-13T06:13:25.907022+0000","last_active":"2024-09-13T06:13:25.906948+0000","last_peered":"2024-09-13T06:13:25.906948+0000","last_clean":"2024-09-13T06:13:25.906948+0000","last_became_active":"2024-09-13T06:09:36.153614+0000","last_became_peered":"2024-09-13T06:09:36.153614+0000","last_unstale":"2024-09-13T06:13:25.906948+0000","last_undegraded":"2024-09-13T06:13:25.906948+0000","last_fullsized":"2024-09-13T06:13:25.906948+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:25.906744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:25.906744+0000","last_clean_scrub_stamp":"2024-09-13T06:13:25.906744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:08:19.863549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"35'48","reported_seq":107,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:31.203173+0000","last_change":"2024-09-13T06:13:31.203250+0000","last_active":"2024-09-13T06:13:31.203173+0000","last_peered":"2024-09-13T06:13:31.203173+0000","last_clean":"2024-09-13T06:13:31.203173+0000","last_became_active":"2024-09-13T06:09:38.155463+0000","last_became_peered":"2024-09-13T06:09:38.155463+0000","last_unstale":"2024-09-13T06:13:31.203173+0000","last_undegraded":"2024-09-13T06:13:31.203173+0000","last_fullsized":"2024-09-13T06:13:31.203173+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'48","last_scrub_stamp":"2024-09-13T06:13:31.202979+0000","last_deep_scrub":"35'48","last_deep_scrub_stamp":"2024-09-13T06:13:31.202979+0000","last_clean_scrub_stamp":"2024-09-13T06:13:31.202979+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:07:14.216978+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:27.404797+0000","last_change":"2024-09-13T06:13:27.404848+0000","last_active":"2024-09-13T06:13:27.404797+0000","last_peered":"2024-09-13T06:13:27.404797+0000","last_clean":"2024-09-13T06:13:27.404797+0000","last_became_active":"2024-09-13T06:09:40.167733+0000","last_became_peered":"2024-09-13T06:09:40.167733+0000","last_unstale":"2024-09-13T06:13:27.404797+0000","last_undegraded":"2024-09-13T06:13:27.404797+0000","last_fullsized":"2024-09-13T06:13:27.404797+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:27.404612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:27.404612+0000","last_clean_scrub_stamp":"2024-09-13T06:13:27.404612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:53:51.661686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"35'7","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:53.145831+0000","last_change":"2024-09-13T06:13:53.145895+0000","last_active":"2024-09-13T06:13:53.145831+0000","last_peered":"2024-09-13T06:13:53.145831+0000","last_clean":"2024-09-13T06:13:53.145831+0000","last_became_active":"2024-09-13T06:09:42.172937+0000","last_became_peered":"2024-09-13T06:09:42.172937+0000","last_unstale":"2024-09-13T06:13:53.145831+0000","last_undegraded":"2024-09-13T06:13:53.145831+0000","last_fullsized":"2024-09-13T06:13:53.145831+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'7","last_scrub_stamp":"2024-09-13T06:13:53.145587+0000","last_deep_scrub":"35'7","last_deep_scrub_stamp":"2024-09-13T06:13:53.145587+0000","last_clean_scrub_stamp":"2024-09-13T06:13:53.145587+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:03:35.737707+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"35'12","reported_seq":87,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:41.783938+0000","last_change":"2024-09-13T06:13:41.783938+0000","last_active":"2024-09-13T06:13:41.783938+0000","last_peered":"2024-09-13T06:13:41.783938+0000","last_clean":"2024-09-13T06:13:41.783938+0000","last_became_active":"2024-09-13T06:09:34.131113+0000","last_became_peered":"2024-09-13T06:09:34.131113+0000","last_unstale":"2024-09-13T06:13:41.783938+0000","last_undegraded":"2024-09-13T06:13:41.783938+0000","last_fullsized":"2024-09-13T06:13:41.783938+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'12","last_scrub_stamp":"2024-09-13T06:13:41.783695+0000","last_deep_scrub":"35'12","last_deep_scrub_stamp":"2024-09-13T06:13:41.783695+0000","last_clean_scrub_stamp":"2024-09-13T06:13:41.783695+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:56:08.039276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":60,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"14'117","reported_seq":207,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:22.824596+0000","last_change":"2024-09-13T06:09:19.565573+0000","last_active":"2024-09-13T06:13:22.824596+0000","last_peered":"2024-09-13T06:13:22.824596+0000","last_clean":"2024-09-13T06:13:22.824596+0000","last_became_active":"2024-09-13T06:09:19.561434+0000","last_became_peered":"2024-09-13T06:09:19.561434+0000","last_unstale":"2024-09-13T06:13:22.824596+0000","last_undegraded":"2024-09-13T06:13:22.824596+0000","last_fullsized":"2024-09-13T06:13:22.824596+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:18.163598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:18.163598+0000","last_clean_scrub_stamp":"2024-09-13T06:09:18.163598+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.440124+0000","last_change":"2024-09-13T06:09:24.220777+0000","last_active":"2024-09-13T06:13:25.440124+0000","last_peered":"2024-09-13T06:13:25.440124+0000","last_clean":"2024-09-13T06:13:25.440124+0000","last_became_active":"2024-09-13T06:09:22.217131+0000","last_became_peered":"2024-09-13T06:09:22.217131+0000","last_unstale":"2024-09-13T06:13:25.440124+0000","last_undegraded":"2024-09-13T06:13:25.440124+0000","last_fullsized":"2024-09-13T06:13:25.440124+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_clean_scrub_stamp":"2024-09-13T06:09:21.188659+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090967000000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"35'4","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.440206+0000","last_change":"2024-09-13T06:09:32.144633+0000","last_active":"2024-09-13T06:13:25.440206+0000","last_peered":"2024-09-13T06:13:25.440206+0000","last_clean":"2024-09-13T06:13:25.440206+0000","last_became_active":"2024-09-13T06:09:32.141646+0000","last_became_peered":"2024-09-13T06:09:32.141646+0000","last_unstale":"2024-09-13T06:13:25.440206+0000","last_undegraded":"2024-09-13T06:13:25.440206+0000","last_fullsized":"2024-09-13T06:13:25.440206+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:35.101614+0000","last_change":"2024-09-13T06:13:35.101614+0000","last_active":"2024-09-13T06:13:35.101614+0000","last_peered":"2024-09-13T06:13:35.101614+0000","last_clean":"2024-09-13T06:13:35.101614+0000","last_became_active":"2024-09-13T06:09:36.140417+0000","last_became_peered":"2024-09-13T06:09:36.140417+0000","last_unstale":"2024-09-13T06:13:35.101614+0000","last_undegraded":"2024-09-13T06:13:35.101614+0000","last_fullsized":"2024-09-13T06:13:35.101614+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:35.101340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:35.101340+0000","last_clean_scrub_stamp":"2024-09-13T06:13:35.101340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:29:39.130402+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"35'90","reported_seq":181,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:53.943462+0000","last_change":"2024-09-13T06:13:53.943462+0000","last_active":"2024-09-13T06:13:53.943462+0000","last_peered":"2024-09-13T06:13:53.943462+0000","last_clean":"2024-09-13T06:13:53.943462+0000","last_became_active":"2024-09-13T06:09:38.176365+0000","last_became_peered":"2024-09-13T06:09:38.176365+0000","last_unstale":"2024-09-13T06:13:53.943462+0000","last_undegraded":"2024-09-13T06:13:53.943462+0000","last_fullsized":"2024-09-13T06:13:53.943462+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'90","last_scrub_stamp":"2024-09-13T06:13:53.943088+0000","last_deep_scrub":"35'90","last_deep_scrub_stamp":"2024-09-13T06:13:53.943088+0000","last_clean_scrub_stamp":"2024-09-13T06:13:53.943088+0000","objects_scrubbed":5,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:10:02.356345+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:44.206956+0000","last_change":"2024-09-13T06:13:44.206956+0000","last_active":"2024-09-13T06:13:44.206956+0000","last_peered":"2024-09-13T06:13:44.206956+0000","last_clean":"2024-09-13T06:13:44.206956+0000","last_became_active":"2024-09-13T06:09:40.178872+0000","last_became_peered":"2024-09-13T06:09:40.178872+0000","last_unstale":"2024-09-13T06:13:44.206956+0000","last_undegraded":"2024-09-13T06:13:44.206956+0000","last_fullsized":"2024-09-13T06:13:44.206956+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:44.206706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:44.206706+0000","last_clean_scrub_stamp":"2024-09-13T06:13:44.206706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:34:21.273218+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"35'82","reported_seq":173,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:36.470775+0000","last_change":"2024-09-13T06:13:36.470775+0000","last_active":"2024-09-13T06:13:36.470775+0000","last_peered":"2024-09-13T06:13:36.470775+0000","last_clean":"2024-09-13T06:13:36.470775+0000","last_became_active":"2024-09-13T06:09:42.197803+0000","last_became_peered":"2024-09-13T06:09:42.197803+0000","last_unstale":"2024-09-13T06:13:36.470775+0000","last_undegraded":"2024-09-13T06:13:36.470775+0000","last_fullsized":"2024-09-13T06:13:36.470775+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'82","last_scrub_stamp":"2024-09-13T06:13:36.470522+0000","last_deep_scrub":"35'82","last_deep_scrub_stamp":"2024-09-13T06:13:36.470522+0000","last_clean_scrub_stamp":"2024-09-13T06:13:36.470522+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:55:18.490378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"35'9","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.663016+0000","last_change":"2024-09-13T06:10:10.942337+0000","last_active":"2024-09-13T06:12:49.663016+0000","last_peered":"2024-09-13T06:12:49.663016+0000","last_clean":"2024-09-13T06:12:49.663016+0000","last_became_active":"2024-09-13T06:10:10.941771+0000","last_became_peered":"2024-09-13T06:10:10.941771+0000","last_unstale":"2024-09-13T06:12:49.663016+0000","last_undegraded":"2024-09-13T06:12:49.663016+0000","last_fullsized":"2024-09-13T06:12:49.663016+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:22.830335+0000","last_change":"2024-09-13T06:09:24.220722+0000","last_active":"2024-09-13T06:13:22.830335+0000","last_peered":"2024-09-13T06:13:22.830335+0000","last_clean":"2024-09-13T06:13:22.830335+0000","last_became_active":"2024-09-13T06:09:22.217643+0000","last_became_peered":"2024-09-13T06:09:22.217643+0000","last_unstale":"2024-09-13T06:13:22.830335+0000","last_undegraded":"2024-09-13T06:13:22.830335+0000","last_fullsized":"2024-09-13T06:13:22.830335+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_clean_scrub_stamp":"2024-09-13T06:09:21.188659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082521999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"35'2","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:04.995337+0000","last_change":"2024-09-13T06:14:04.995517+0000","last_active":"2024-09-13T06:14:04.995337+0000","last_peered":"2024-09-13T06:14:04.995337+0000","last_clean":"2024-09-13T06:14:04.995337+0000","last_became_active":"2024-09-13T06:09:32.147837+0000","last_became_peered":"2024-09-13T06:09:32.147837+0000","last_unstale":"2024-09-13T06:14:04.995337+0000","last_undegraded":"2024-09-13T06:14:04.995337+0000","last_fullsized":"2024-09-13T06:14:04.995337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:04.995114+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:04.995114+0000","last_clean_scrub_stamp":"2024-09-13T06:14:04.995114+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:15:29.178549+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:28.911118+0000","last_change":"2024-09-13T06:13:28.911118+0000","last_active":"2024-09-13T06:13:28.911118+0000","last_peered":"2024-09-13T06:13:28.911118+0000","last_clean":"2024-09-13T06:13:28.911118+0000","last_became_active":"2024-09-13T06:09:36.153430+0000","last_became_peered":"2024-09-13T06:09:36.153430+0000","last_unstale":"2024-09-13T06:13:28.911118+0000","last_undegraded":"2024-09-13T06:13:28.911118+0000","last_fullsized":"2024-09-13T06:13:28.911118+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:28.910878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:28.910878+0000","last_clean_scrub_stamp":"2024-09-13T06:13:28.910878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:38:20.711196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"35'291","reported_seq":518,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:30.250325+0000","last_change":"2024-09-13T06:13:30.250325+0000","last_active":"2024-09-13T06:13:30.250325+0000","last_peered":"2024-09-13T06:13:30.250325+0000","last_clean":"2024-09-13T06:13:30.250325+0000","last_became_active":"2024-09-13T06:09:38.160192+0000","last_became_peered":"2024-09-13T06:09:38.160192+0000","last_unstale":"2024-09-13T06:13:30.250325+0000","last_undegraded":"2024-09-13T06:13:30.250325+0000","last_fullsized":"2024-09-13T06:13:30.250325+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'291","last_scrub_stamp":"2024-09-13T06:13:30.250026+0000","last_deep_scrub":"35'291","last_deep_scrub_stamp":"2024-09-13T06:13:30.250026+0000","last_clean_scrub_stamp":"2024-09-13T06:13:30.250026+0000","objects_scrubbed":10,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:19:15.055011+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:51.890848+0000","last_change":"2024-09-13T06:13:51.890848+0000","last_active":"2024-09-13T06:13:51.890848+0000","last_peered":"2024-09-13T06:13:51.890848+0000","last_clean":"2024-09-13T06:13:51.890848+0000","last_became_active":"2024-09-13T06:09:40.188859+0000","last_became_peered":"2024-09-13T06:09:40.188859+0000","last_unstale":"2024-09-13T06:13:51.890848+0000","last_undegraded":"2024-09-13T06:13:51.890848+0000","last_fullsized":"2024-09-13T06:13:51.890848+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:51.890601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:51.890601+0000","last_clean_scrub_stamp":"2024-09-13T06:13:51.890601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:55:29.874902+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"35'5","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:24.521719+0000","last_change":"2024-09-13T06:09:42.205523+0000","last_active":"2024-09-13T06:13:24.521719+0000","last_peered":"2024-09-13T06:13:24.521719+0000","last_clean":"2024-09-13T06:13:24.521719+0000","last_became_active":"2024-09-13T06:09:42.204736+0000","last_became_peered":"2024-09-13T06:09:42.204736+0000","last_unstale":"2024-09-13T06:13:24.521719+0000","last_undegraded":"2024-09-13T06:13:24.521719+0000","last_fullsized":"2024-09-13T06:13:24.521719+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"35'8","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:49.136585+0000","last_change":"2024-09-13T06:13:49.136585+0000","last_active":"2024-09-13T06:13:49.136585+0000","last_peered":"2024-09-13T06:13:49.136585+0000","last_clean":"2024-09-13T06:13:49.136585+0000","last_became_active":"2024-09-13T06:09:34.131564+0000","last_became_peered":"2024-09-13T06:09:34.131564+0000","last_unstale":"2024-09-13T06:13:49.136585+0000","last_undegraded":"2024-09-13T06:13:49.136585+0000","last_fullsized":"2024-09-13T06:13:49.136585+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-13T06:13:49.136299+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-13T06:13:49.136299+0000","last_clean_scrub_stamp":"2024-09-13T06:13:49.136299+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:11:56.625206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:24.971741+0000","last_change":"2024-09-13T06:09:24.565111+0000","last_active":"2024-09-13T06:13:24.971741+0000","last_peered":"2024-09-13T06:13:24.971741+0000","last_clean":"2024-09-13T06:13:24.971741+0000","last_became_active":"2024-09-13T06:09:22.214952+0000","last_became_peered":"2024-09-13T06:09:22.214952+0000","last_unstale":"2024-09-13T06:13:24.971741+0000","last_undegraded":"2024-09-13T06:13:24.971741+0000","last_fullsized":"2024-09-13T06:13:24.971741+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_clean_scrub_stamp":"2024-09-13T06:09:21.188659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097860299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:59.106249+0000","last_change":"2024-09-13T06:13:59.106380+0000","last_active":"2024-09-13T06:13:59.106249+0000","last_peered":"2024-09-13T06:13:59.106249+0000","last_clean":"2024-09-13T06:13:59.106249+0000","last_became_active":"2024-09-13T06:09:32.148803+0000","last_became_peered":"2024-09-13T06:09:32.148803+0000","last_unstale":"2024-09-13T06:13:59.106249+0000","last_undegraded":"2024-09-13T06:13:59.106249+0000","last_fullsized":"2024-09-13T06:13:59.106249+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:59.105957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:59.105957+0000","last_clean_scrub_stamp":"2024-09-13T06:13:59.105957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:47:01.112409+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:47.511185+0000","last_change":"2024-09-13T06:13:47.511185+0000","last_active":"2024-09-13T06:13:47.511185+0000","last_peered":"2024-09-13T06:13:47.511185+0000","last_clean":"2024-09-13T06:13:47.511185+0000","last_became_active":"2024-09-13T06:09:36.126497+0000","last_became_peered":"2024-09-13T06:09:36.126497+0000","last_unstale":"2024-09-13T06:13:47.511185+0000","last_undegraded":"2024-09-13T06:13:47.511185+0000","last_fullsized":"2024-09-13T06:13:47.511185+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:13:47.510914+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:13:47.510914+0000","last_clean_scrub_stamp":"2024-09-13T06:13:47.510914+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:50:58.108495+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"35'24","reported_seq":103,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:33.428736+0000","last_change":"2024-09-13T06:13:33.428736+0000","last_active":"2024-09-13T06:13:33.428736+0000","last_peered":"2024-09-13T06:13:33.428736+0000","last_clean":"2024-09-13T06:13:33.428736+0000","last_became_active":"2024-09-13T06:09:38.162358+0000","last_became_peered":"2024-09-13T06:09:38.162358+0000","last_unstale":"2024-09-13T06:13:33.428736+0000","last_undegraded":"2024-09-13T06:13:33.428736+0000","last_fullsized":"2024-09-13T06:13:33.428736+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'24","last_scrub_stamp":"2024-09-13T06:13:33.428464+0000","last_deep_scrub":"35'24","last_deep_scrub_stamp":"2024-09-13T06:13:33.428464+0000","last_clean_scrub_stamp":"2024-09-13T06:13:33.428464+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:54:34.152803+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:40.255183+0000","last_change":"2024-09-13T06:13:40.255183+0000","last_active":"2024-09-13T06:13:40.255183+0000","last_peered":"2024-09-13T06:13:40.255183+0000","last_clean":"2024-09-13T06:13:40.255183+0000","last_became_active":"2024-09-13T06:09:40.179250+0000","last_became_peered":"2024-09-13T06:09:40.179250+0000","last_unstale":"2024-09-13T06:13:40.255183+0000","last_undegraded":"2024-09-13T06:13:40.255183+0000","last_fullsized":"2024-09-13T06:13:40.255183+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:40.254851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:40.254851+0000","last_clean_scrub_stamp":"2024-09-13T06:13:40.254851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:54:39.886202+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"33'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:57.810608+0000","last_change":"2024-09-13T06:09:42.203843+0000","last_active":"2024-09-13T06:11:57.810608+0000","last_peered":"2024-09-13T06:11:57.810608+0000","last_clean":"2024-09-13T06:11:57.810608+0000","last_became_active":"2024-09-13T06:09:42.203232+0000","last_became_peered":"2024-09-13T06:09:42.203232+0000","last_unstale":"2024-09-13T06:11:57.810608+0000","last_undegraded":"2024-09-13T06:11:57.810608+0000","last_fullsized":"2024-09-13T06:11:57.810608+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"35'6","reported_seq":59,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:02.039645+0000","last_change":"2024-09-13T06:14:02.039712+0000","last_active":"2024-09-13T06:14:02.039645+0000","last_peered":"2024-09-13T06:14:02.039645+0000","last_clean":"2024-09-13T06:14:02.039645+0000","last_became_active":"2024-09-13T06:09:34.113002+0000","last_became_peered":"2024-09-13T06:09:34.113002+0000","last_unstale":"2024-09-13T06:14:02.039645+0000","last_undegraded":"2024-09-13T06:14:02.039645+0000","last_fullsized":"2024-09-13T06:14:02.039645+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:14:02.039450+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:14:02.039450+0000","last_clean_scrub_stamp":"2024-09-13T06:14:02.039450+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:56:20.449806+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.440093+0000","last_change":"2024-09-13T06:09:24.222172+0000","last_active":"2024-09-13T06:13:25.440093+0000","last_peered":"2024-09-13T06:13:25.440093+0000","last_clean":"2024-09-13T06:13:25.440093+0000","last_became_active":"2024-09-13T06:09:22.217581+0000","last_became_peered":"2024-09-13T06:09:22.217581+0000","last_unstale":"2024-09-13T06:13:25.440093+0000","last_undegraded":"2024-09-13T06:13:25.440093+0000","last_fullsized":"2024-09-13T06:13:25.440093+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_clean_scrub_stamp":"2024-09-13T06:09:21.188659+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022711580000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:59.389088+0000","last_change":"2024-09-13T06:13:59.389148+0000","last_active":"2024-09-13T06:13:59.389088+0000","last_peered":"2024-09-13T06:13:59.389088+0000","last_clean":"2024-09-13T06:13:59.389088+0000","last_became_active":"2024-09-13T06:09:32.138838+0000","last_became_peered":"2024-09-13T06:09:32.138838+0000","last_unstale":"2024-09-13T06:13:59.389088+0000","last_undegraded":"2024-09-13T06:13:59.389088+0000","last_fullsized":"2024-09-13T06:13:59.389088+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:59.388824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:59.388824+0000","last_clean_scrub_stamp":"2024-09-13T06:13:59.388824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:54:30.824903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:16.805502+0000","last_change":"2024-09-13T06:10:10.810748+0000","last_active":"2024-09-13T06:12:16.805502+0000","last_peered":"2024-09-13T06:12:16.805502+0000","last_clean":"2024-09-13T06:12:16.805502+0000","last_became_active":"2024-09-13T06:10:10.809216+0000","last_became_peered":"2024-09-13T06:10:10.809216+0000","last_unstale":"2024-09-13T06:12:16.805502+0000","last_undegraded":"2024-09-13T06:12:16.805502+0000","last_fullsized":"2024-09-13T06:12:16.805502+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"35'20","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:49.867101+0000","last_change":"2024-09-13T06:13:49.867101+0000","last_active":"2024-09-13T06:13:49.867101+0000","last_peered":"2024-09-13T06:13:49.867101+0000","last_clean":"2024-09-13T06:13:49.867101+0000","last_became_active":"2024-09-13T06:09:38.176307+0000","last_became_peered":"2024-09-13T06:09:38.176307+0000","last_unstale":"2024-09-13T06:13:49.867101+0000","last_undegraded":"2024-09-13T06:13:49.867101+0000","last_fullsized":"2024-09-13T06:13:49.867101+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'20","last_scrub_stamp":"2024-09-13T06:13:49.866714+0000","last_deep_scrub":"35'20","last_deep_scrub_stamp":"2024-09-13T06:13:49.866714+0000","last_clean_scrub_stamp":"2024-09-13T06:13:49.866714+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:43:14.509705+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:47.833648+0000","last_change":"2024-09-13T06:13:47.833648+0000","last_active":"2024-09-13T06:13:47.833648+0000","last_peered":"2024-09-13T06:13:47.833648+0000","last_clean":"2024-09-13T06:13:47.833648+0000","last_became_active":"2024-09-13T06:09:40.189259+0000","last_became_peered":"2024-09-13T06:09:40.189259+0000","last_unstale":"2024-09-13T06:13:47.833648+0000","last_undegraded":"2024-09-13T06:13:47.833648+0000","last_fullsized":"2024-09-13T06:13:47.833648+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:47.833278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:47.833278+0000","last_clean_scrub_stamp":"2024-09-13T06:13:47.833278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:53:00.141037+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"35'4","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:24.521778+0000","last_change":"2024-09-13T06:09:42.186776+0000","last_active":"2024-09-13T06:13:24.521778+0000","last_peered":"2024-09-13T06:13:24.521778+0000","last_clean":"2024-09-13T06:13:24.521778+0000","last_became_active":"2024-09-13T06:09:42.185210+0000","last_became_peered":"2024-09-13T06:09:42.185210+0000","last_unstale":"2024-09-13T06:13:24.521778+0000","last_undegraded":"2024-09-13T06:13:24.521778+0000","last_fullsized":"2024-09-13T06:13:24.521778+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"35'4","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:54.120718+0000","last_change":"2024-09-13T06:13:54.120789+0000","last_active":"2024-09-13T06:13:54.120718+0000","last_peered":"2024-09-13T06:13:54.120718+0000","last_clean":"2024-09-13T06:13:54.120718+0000","last_became_active":"2024-09-13T06:09:34.119283+0000","last_became_peered":"2024-09-13T06:09:34.119283+0000","last_unstale":"2024-09-13T06:13:54.120718+0000","last_undegraded":"2024-09-13T06:13:54.120718+0000","last_fullsized":"2024-09-13T06:13:54.120718+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:13:54.120527+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:13:54.120527+0000","last_clean_scrub_stamp":"2024-09-13T06:13:54.120527+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:35:15.451075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"35'2","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:57.405089+0000","last_change":"2024-09-13T06:13:57.405153+0000","last_active":"2024-09-13T06:13:57.405089+0000","last_peered":"2024-09-13T06:13:57.405089+0000","last_clean":"2024-09-13T06:13:57.405089+0000","last_became_active":"2024-09-13T06:09:32.139313+0000","last_became_peered":"2024-09-13T06:09:32.139313+0000","last_unstale":"2024-09-13T06:13:57.405089+0000","last_undegraded":"2024-09-13T06:13:57.405089+0000","last_fullsized":"2024-09-13T06:13:57.405089+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:13:57.404830+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:13:57.404830+0000","last_clean_scrub_stamp":"2024-09-13T06:13:57.404830+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:04:45.319192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:24.055153+0000","last_change":"2024-09-13T06:09:24.227949+0000","last_active":"2024-09-13T06:13:24.055153+0000","last_peered":"2024-09-13T06:13:24.055153+0000","last_clean":"2024-09-13T06:13:24.055153+0000","last_became_active":"2024-09-13T06:09:22.216659+0000","last_became_peered":"2024-09-13T06:09:22.216659+0000","last_unstale":"2024-09-13T06:13:24.055153+0000","last_undegraded":"2024-09-13T06:13:24.055153+0000","last_fullsized":"2024-09-13T06:13:24.055153+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_clean_scrub_stamp":"2024-09-13T06:09:21.188659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010625330000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:46.126854+0000","last_change":"2024-09-13T06:13:46.126916+0000","last_active":"2024-09-13T06:13:46.126854+0000","last_peered":"2024-09-13T06:13:46.126854+0000","last_clean":"2024-09-13T06:13:46.126854+0000","last_became_active":"2024-09-13T06:09:36.132376+0000","last_became_peered":"2024-09-13T06:09:36.132376+0000","last_unstale":"2024-09-13T06:13:46.126854+0000","last_undegraded":"2024-09-13T06:13:46.126854+0000","last_fullsized":"2024-09-13T06:13:46.126854+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:13:46.126675+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:13:46.126675+0000","last_clean_scrub_stamp":"2024-09-13T06:13:46.126675+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:05:41.556048+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"35'74","reported_seq":151,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:33.324338+0000","last_change":"2024-09-13T06:13:33.324338+0000","last_active":"2024-09-13T06:13:33.324338+0000","last_peered":"2024-09-13T06:13:33.324338+0000","last_clean":"2024-09-13T06:13:33.324338+0000","last_became_active":"2024-09-13T06:09:38.157579+0000","last_became_peered":"2024-09-13T06:09:38.157579+0000","last_unstale":"2024-09-13T06:13:33.324338+0000","last_undegraded":"2024-09-13T06:13:33.324338+0000","last_fullsized":"2024-09-13T06:13:33.324338+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'74","last_scrub_stamp":"2024-09-13T06:13:33.324060+0000","last_deep_scrub":"35'74","last_deep_scrub_stamp":"2024-09-13T06:13:33.324060+0000","last_clean_scrub_stamp":"2024-09-13T06:13:33.324060+0000","objects_scrubbed":9,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:44:12.725129+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:28.380182+0000","last_change":"2024-09-13T06:13:28.380182+0000","last_active":"2024-09-13T06:13:28.380182+0000","last_peered":"2024-09-13T06:13:28.380182+0000","last_clean":"2024-09-13T06:13:28.380182+0000","last_became_active":"2024-09-13T06:09:40.185234+0000","last_became_peered":"2024-09-13T06:09:40.185234+0000","last_unstale":"2024-09-13T06:13:28.380182+0000","last_undegraded":"2024-09-13T06:13:28.380182+0000","last_fullsized":"2024-09-13T06:13:28.380182+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:28.379942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:28.379942+0000","last_clean_scrub_stamp":"2024-09-13T06:13:28.379942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:42:49.566445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"35'11","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:52.119717+0000","last_change":"2024-09-13T06:13:52.119845+0000","last_active":"2024-09-13T06:13:52.119717+0000","last_peered":"2024-09-13T06:13:52.119717+0000","last_clean":"2024-09-13T06:13:52.119717+0000","last_became_active":"2024-09-13T06:09:42.170302+0000","last_became_peered":"2024-09-13T06:09:42.170302+0000","last_unstale":"2024-09-13T06:13:52.119717+0000","last_undegraded":"2024-09-13T06:13:52.119717+0000","last_fullsized":"2024-09-13T06:13:52.119717+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'11","last_scrub_stamp":"2024-09-13T06:13:52.119492+0000","last_deep_scrub":"35'11","last_deep_scrub_stamp":"2024-09-13T06:13:52.119492+0000","last_clean_scrub_stamp":"2024-09-13T06:13:52.119492+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:05:49.867986+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":25,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"35'10","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:52.096124+0000","last_change":"2024-09-13T06:13:52.096242+0000","last_active":"2024-09-13T06:13:52.096124+0000","last_peered":"2024-09-13T06:13:52.096124+0000","last_clean":"2024-09-13T06:13:52.096124+0000","last_became_active":"2024-09-13T06:09:34.121836+0000","last_became_peered":"2024-09-13T06:09:34.121836+0000","last_unstale":"2024-09-13T06:13:52.096124+0000","last_undegraded":"2024-09-13T06:13:52.096124+0000","last_fullsized":"2024-09-13T06:13:52.096124+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-09-13T06:13:52.095831+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-09-13T06:13:52.095831+0000","last_clean_scrub_stamp":"2024-09-13T06:13:52.095831+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:38:45.110796+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:24.055617+0000","last_change":"2024-09-13T06:09:32.137231+0000","last_active":"2024-09-13T06:13:24.055617+0000","last_peered":"2024-09-13T06:13:24.055617+0000","last_clean":"2024-09-13T06:13:24.055617+0000","last_became_active":"2024-09-13T06:09:32.136238+0000","last_became_peered":"2024-09-13T06:09:32.136238+0000","last_unstale":"2024-09-13T06:13:24.055617+0000","last_undegraded":"2024-09-13T06:13:24.055617+0000","last_fullsized":"2024-09-13T06:13:24.055617+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.440104+0000","last_change":"2024-09-13T06:09:24.221355+0000","last_active":"2024-09-13T06:13:25.440104+0000","last_peered":"2024-09-13T06:13:25.440104+0000","last_clean":"2024-09-13T06:13:25.440104+0000","last_became_active":"2024-09-13T06:09:22.217809+0000","last_became_peered":"2024-09-13T06:09:22.217809+0000","last_unstale":"2024-09-13T06:13:25.440104+0000","last_undegraded":"2024-09-13T06:13:25.440104+0000","last_fullsized":"2024-09-13T06:13:25.440104+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_clean_scrub_stamp":"2024-09-13T06:09:21.188659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001447545,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:33.855853+0000","last_change":"2024-09-13T06:13:33.855853+0000","last_active":"2024-09-13T06:13:33.855853+0000","last_peered":"2024-09-13T06:13:33.855853+0000","last_clean":"2024-09-13T06:13:33.855853+0000","last_became_active":"2024-09-13T06:09:36.151605+0000","last_became_peered":"2024-09-13T06:09:36.151605+0000","last_unstale":"2024-09-13T06:13:33.855853+0000","last_undegraded":"2024-09-13T06:13:33.855853+0000","last_fullsized":"2024-09-13T06:13:33.855853+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:33.855604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:33.855604+0000","last_clean_scrub_stamp":"2024-09-13T06:13:33.855604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:30:58.639342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"35'22","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:26.304189+0000","last_change":"2024-09-13T06:13:26.304189+0000","last_active":"2024-09-13T06:13:26.304189+0000","last_peered":"2024-09-13T06:13:26.304189+0000","last_clean":"2024-09-13T06:13:26.304189+0000","last_became_active":"2024-09-13T06:09:38.165916+0000","last_became_peered":"2024-09-13T06:09:38.165916+0000","last_unstale":"2024-09-13T06:13:26.304189+0000","last_undegraded":"2024-09-13T06:13:26.304189+0000","last_fullsized":"2024-09-13T06:13:26.304189+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'22","last_scrub_stamp":"2024-09-13T06:13:26.303565+0000","last_deep_scrub":"35'22","last_deep_scrub_stamp":"2024-09-13T06:13:26.303565+0000","last_clean_scrub_stamp":"2024-09-13T06:13:26.303565+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:32:31.420814+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"35'285","reported_seq":360,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:37.090244+0000","last_change":"2024-09-13T06:13:37.090244+0000","last_active":"2024-09-13T06:13:37.090244+0000","last_peered":"2024-09-13T06:13:37.090244+0000","last_clean":"2024-09-13T06:13:37.090244+0000","last_became_active":"2024-09-13T06:09:40.181415+0000","last_became_peered":"2024-09-13T06:09:40.181415+0000","last_unstale":"2024-09-13T06:13:37.090244+0000","last_undegraded":"2024-09-13T06:13:37.090244+0000","last_fullsized":"2024-09-13T06:13:37.090244+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-13T06:13:37.089987+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-13T06:13:37.089987+0000","last_clean_scrub_stamp":"2024-09-13T06:13:37.089987+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:47:34.898773+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:57.810873+0000","last_change":"2024-09-13T06:09:42.195360+0000","last_active":"2024-09-13T06:11:57.810873+0000","last_peered":"2024-09-13T06:11:57.810873+0000","last_clean":"2024-09-13T06:11:57.810873+0000","last_became_active":"2024-09-13T06:09:42.194558+0000","last_became_peered":"2024-09-13T06:09:42.194558+0000","last_unstale":"2024-09-13T06:11:57.810873+0000","last_undegraded":"2024-09-13T06:11:57.810873+0000","last_fullsized":"2024-09-13T06:11:57.810873+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"35'6","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.532877+0000","last_change":"2024-09-13T06:10:10.814500+0000","last_active":"2024-09-13T06:12:49.532877+0000","last_peered":"2024-09-13T06:12:49.532877+0000","last_clean":"2024-09-13T06:12:49.532877+0000","last_became_active":"2024-09-13T06:10:10.813656+0000","last_became_peered":"2024-09-13T06:10:10.813656+0000","last_unstale":"2024-09-13T06:12:49.532877+0000","last_undegraded":"2024-09-13T06:12:49.532877+0000","last_fullsized":"2024-09-13T06:12:49.532877+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.440334+0000","last_change":"2024-09-13T06:09:32.133206+0000","last_active":"2024-09-13T06:13:25.440334+0000","last_peered":"2024-09-13T06:13:25.440334+0000","last_clean":"2024-09-13T06:13:25.440334+0000","last_became_active":"2024-09-13T06:09:32.130385+0000","last_became_peered":"2024-09-13T06:09:32.130385+0000","last_unstale":"2024-09-13T06:13:25.440334+0000","last_undegraded":"2024-09-13T06:13:25.440334+0000","last_fullsized":"2024-09-13T06:13:25.440334+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:24.055153+0000","last_change":"2024-09-13T06:09:24.227867+0000","last_active":"2024-09-13T06:13:24.055153+0000","last_peered":"2024-09-13T06:13:24.055153+0000","last_clean":"2024-09-13T06:13:24.055153+0000","last_became_active":"2024-09-13T06:09:22.216905+0000","last_became_peered":"2024-09-13T06:09:22.216905+0000","last_unstale":"2024-09-13T06:13:24.055153+0000","last_undegraded":"2024-09-13T06:13:24.055153+0000","last_fullsized":"2024-09-13T06:13:24.055153+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_clean_scrub_stamp":"2024-09-13T06:09:21.188659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001005588,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:32.824584+0000","last_change":"2024-09-13T06:13:32.824584+0000","last_active":"2024-09-13T06:13:32.824584+0000","last_peered":"2024-09-13T06:13:32.824584+0000","last_clean":"2024-09-13T06:13:32.824584+0000","last_became_active":"2024-09-13T06:09:36.149051+0000","last_became_peered":"2024-09-13T06:09:36.149051+0000","last_unstale":"2024-09-13T06:13:32.824584+0000","last_undegraded":"2024-09-13T06:13:32.824584+0000","last_fullsized":"2024-09-13T06:13:32.824584+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:32.824332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:32.824332+0000","last_clean_scrub_stamp":"2024-09-13T06:13:32.824332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:49:10.096883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"35'15","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:39.760213+0000","last_change":"2024-09-13T06:13:39.760213+0000","last_active":"2024-09-13T06:13:39.760213+0000","last_peered":"2024-09-13T06:13:39.760213+0000","last_clean":"2024-09-13T06:13:39.760213+0000","last_became_active":"2024-09-13T06:09:38.173017+0000","last_became_peered":"2024-09-13T06:09:38.173017+0000","last_unstale":"2024-09-13T06:13:39.760213+0000","last_undegraded":"2024-09-13T06:13:39.760213+0000","last_fullsized":"2024-09-13T06:13:39.760213+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'15","last_scrub_stamp":"2024-09-13T06:13:39.759783+0000","last_deep_scrub":"35'15","last_deep_scrub_stamp":"2024-09-13T06:13:39.759783+0000","last_clean_scrub_stamp":"2024-09-13T06:13:39.759783+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:53:57.061723+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"35'285","reported_seq":403,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:30.299531+0000","last_change":"2024-09-13T06:13:30.299531+0000","last_active":"2024-09-13T06:13:30.299531+0000","last_peered":"2024-09-13T06:13:30.299531+0000","last_clean":"2024-09-13T06:13:30.299531+0000","last_became_active":"2024-09-13T06:09:40.170879+0000","last_became_peered":"2024-09-13T06:09:40.170879+0000","last_unstale":"2024-09-13T06:13:30.299531+0000","last_undegraded":"2024-09-13T06:13:30.299531+0000","last_fullsized":"2024-09-13T06:13:30.299531+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-13T06:13:30.299279+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-13T06:13:30.299279+0000","last_clean_scrub_stamp":"2024-09-13T06:13:30.299279+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:49:19.940955+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"33'3","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:57.805754+0000","last_change":"2024-09-13T06:09:42.183057+0000","last_active":"2024-09-13T06:11:57.805754+0000","last_peered":"2024-09-13T06:11:57.805754+0000","last_clean":"2024-09-13T06:11:57.805754+0000","last_became_active":"2024-09-13T06:09:42.178890+0000","last_became_peered":"2024-09-13T06:09:42.178890+0000","last_unstale":"2024-09-13T06:11:57.805754+0000","last_undegraded":"2024-09-13T06:11:57.805754+0000","last_fullsized":"2024-09-13T06:11:57.805754+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"35'4","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:58.403221+0000","last_change":"2024-09-13T06:13:58.403253+0000","last_active":"2024-09-13T06:13:58.403221+0000","last_peered":"2024-09-13T06:13:58.403221+0000","last_clean":"2024-09-13T06:13:58.403221+0000","last_became_active":"2024-09-13T06:09:34.104194+0000","last_became_peered":"2024-09-13T06:09:34.104194+0000","last_unstale":"2024-09-13T06:13:58.403221+0000","last_undegraded":"2024-09-13T06:13:58.403221+0000","last_fullsized":"2024-09-13T06:13:58.403221+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:13:58.403115+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:13:58.403115+0000","last_clean_scrub_stamp":"2024-09-13T06:13:58.403115+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:17:01.119280+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:24.519265+0000","last_change":"2024-09-13T06:09:32.118940+0000","last_active":"2024-09-13T06:13:24.519265+0000","last_peered":"2024-09-13T06:13:24.519265+0000","last_clean":"2024-09-13T06:13:24.519265+0000","last_became_active":"2024-09-13T06:09:32.118386+0000","last_became_peered":"2024-09-13T06:09:32.118386+0000","last_unstale":"2024-09-13T06:13:24.519265+0000","last_undegraded":"2024-09-13T06:13:24.519265+0000","last_fullsized":"2024-09-13T06:13:24.519265+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.440131+0000","last_change":"2024-09-13T06:09:24.222245+0000","last_active":"2024-09-13T06:13:25.440131+0000","last_peered":"2024-09-13T06:13:25.440131+0000","last_clean":"2024-09-13T06:13:25.440131+0000","last_became_active":"2024-09-13T06:09:22.495259+0000","last_became_peered":"2024-09-13T06:09:22.495259+0000","last_unstale":"2024-09-13T06:13:25.440131+0000","last_undegraded":"2024-09-13T06:13:25.440131+0000","last_fullsized":"2024-09-13T06:13:25.440131+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_clean_scrub_stamp":"2024-09-13T06:09:21.188659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002230409,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:36.776310+0000","last_change":"2024-09-13T06:13:36.776310+0000","last_active":"2024-09-13T06:13:36.776310+0000","last_peered":"2024-09-13T06:13:36.776310+0000","last_clean":"2024-09-13T06:13:36.776310+0000","last_became_active":"2024-09-13T06:09:36.144463+0000","last_became_peered":"2024-09-13T06:09:36.144463+0000","last_unstale":"2024-09-13T06:13:36.776310+0000","last_undegraded":"2024-09-13T06:13:36.776310+0000","last_fullsized":"2024-09-13T06:13:36.776310+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:36.776068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:36.776068+0000","last_clean_scrub_stamp":"2024-09-13T06:13:36.776068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:07:56.568181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"35'96","reported_seq":190,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:34.414511+0000","last_change":"2024-09-13T06:13:34.414511+0000","last_active":"2024-09-13T06:13:34.414511+0000","last_peered":"2024-09-13T06:13:34.414511+0000","last_clean":"2024-09-13T06:13:34.414511+0000","last_became_active":"2024-09-13T06:09:38.158436+0000","last_became_peered":"2024-09-13T06:09:38.158436+0000","last_unstale":"2024-09-13T06:13:34.414511+0000","last_undegraded":"2024-09-13T06:13:34.414511+0000","last_fullsized":"2024-09-13T06:13:34.414511+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'96","last_scrub_stamp":"2024-09-13T06:13:34.414208+0000","last_deep_scrub":"35'96","last_deep_scrub_stamp":"2024-09-13T06:13:34.414208+0000","last_clean_scrub_stamp":"2024-09-13T06:13:34.414208+0000","objects_scrubbed":8,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:05:39.013229+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.290882+0000","last_change":"2024-09-13T06:13:25.290882+0000","last_active":"2024-09-13T06:13:25.290882+0000","last_peered":"2024-09-13T06:13:25.290882+0000","last_clean":"2024-09-13T06:13:25.290882+0000","last_became_active":"2024-09-13T06:09:40.176677+0000","last_became_peered":"2024-09-13T06:09:40.176677+0000","last_unstale":"2024-09-13T06:13:25.290882+0000","last_undegraded":"2024-09-13T06:13:25.290882+0000","last_fullsized":"2024-09-13T06:13:25.290882+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:25.290780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:25.290780+0000","last_clean_scrub_stamp":"2024-09-13T06:13:25.290780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:27:24.453678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:56.800958+0000","last_change":"2024-09-13T06:09:42.205263+0000","last_active":"2024-09-13T06:11:56.800958+0000","last_peered":"2024-09-13T06:11:56.800958+0000","last_clean":"2024-09-13T06:11:56.800958+0000","last_became_active":"2024-09-13T06:09:42.204574+0000","last_became_peered":"2024-09-13T06:09:42.204574+0000","last_unstale":"2024-09-13T06:11:56.800958+0000","last_undegraded":"2024-09-13T06:11:56.800958+0000","last_fullsized":"2024-09-13T06:11:56.800958+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:40.425637+0000","last_change":"2024-09-13T06:13:40.425637+0000","last_active":"2024-09-13T06:13:40.425637+0000","last_peered":"2024-09-13T06:13:40.425637+0000","last_clean":"2024-09-13T06:13:40.425637+0000","last_became_active":"2024-09-13T06:09:42.197788+0000","last_became_peered":"2024-09-13T06:09:42.197788+0000","last_unstale":"2024-09-13T06:13:40.425637+0000","last_undegraded":"2024-09-13T06:13:40.425637+0000","last_fullsized":"2024-09-13T06:13:40.425637+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:40.425298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:40.425298+0000","last_clean_scrub_stamp":"2024-09-13T06:13:40.425298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:01:43.246247+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"35'8","reported_seq":70,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:54.474645+0000","last_change":"2024-09-13T06:13:54.474712+0000","last_active":"2024-09-13T06:13:54.474645+0000","last_peered":"2024-09-13T06:13:54.474645+0000","last_clean":"2024-09-13T06:13:54.474645+0000","last_became_active":"2024-09-13T06:09:34.101193+0000","last_became_peered":"2024-09-13T06:09:34.101193+0000","last_unstale":"2024-09-13T06:13:54.474645+0000","last_undegraded":"2024-09-13T06:13:54.474645+0000","last_fullsized":"2024-09-13T06:13:54.474645+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-13T06:13:54.474414+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-13T06:13:54.474414+0000","last_clean_scrub_stamp":"2024-09-13T06:13:54.474414+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:46:58.633819+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:52.809358+0000","last_change":"2024-09-13T06:09:32.125105+0000","last_active":"2024-09-13T06:11:52.809358+0000","last_peered":"2024-09-13T06:11:52.809358+0000","last_clean":"2024-09-13T06:11:52.809358+0000","last_became_active":"2024-09-13T06:09:32.124198+0000","last_became_peered":"2024-09-13T06:09:32.124198+0000","last_unstale":"2024-09-13T06:11:52.809358+0000","last_undegraded":"2024-09-13T06:11:52.809358+0000","last_fullsized":"2024-09-13T06:11:52.809358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:40.103866+0000","last_change":"2024-09-13T06:13:40.103927+0000","last_active":"2024-09-13T06:13:40.103866+0000","last_peered":"2024-09-13T06:13:40.103866+0000","last_clean":"2024-09-13T06:13:40.103866+0000","last_became_active":"2024-09-13T06:09:36.133568+0000","last_became_peered":"2024-09-13T06:09:36.133568+0000","last_unstale":"2024-09-13T06:13:40.103866+0000","last_undegraded":"2024-09-13T06:13:40.103866+0000","last_fullsized":"2024-09-13T06:13:40.103866+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:40.103666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:40.103666+0000","last_clean_scrub_stamp":"2024-09-13T06:13:40.103666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:14:26.486674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"35'39","reported_seq":95,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:31.841559+0000","last_change":"2024-09-13T06:13:31.841640+0000","last_active":"2024-09-13T06:13:31.841559+0000","last_peered":"2024-09-13T06:13:31.841559+0000","last_clean":"2024-09-13T06:13:31.841559+0000","last_became_active":"2024-09-13T06:09:38.172109+0000","last_became_peered":"2024-09-13T06:09:38.172109+0000","last_unstale":"2024-09-13T06:13:31.841559+0000","last_undegraded":"2024-09-13T06:13:31.841559+0000","last_fullsized":"2024-09-13T06:13:31.841559+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'39","last_scrub_stamp":"2024-09-13T06:13:31.841369+0000","last_deep_scrub":"35'39","last_deep_scrub_stamp":"2024-09-13T06:13:31.841369+0000","last_clean_scrub_stamp":"2024-09-13T06:13:31.841369+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:43:03.426580+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:46.795884+0000","last_change":"2024-09-13T06:13:46.795936+0000","last_active":"2024-09-13T06:13:46.795884+0000","last_peered":"2024-09-13T06:13:46.795884+0000","last_clean":"2024-09-13T06:13:46.795884+0000","last_became_active":"2024-09-13T06:09:40.189223+0000","last_became_peered":"2024-09-13T06:09:40.189223+0000","last_unstale":"2024-09-13T06:13:46.795884+0000","last_undegraded":"2024-09-13T06:13:46.795884+0000","last_fullsized":"2024-09-13T06:13:46.795884+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:46.795688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:46.795688+0000","last_clean_scrub_stamp":"2024-09-13T06:13:46.795688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:53:07.200189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"35'5","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:24.056204+0000","last_change":"2024-09-13T06:09:42.179227+0000","last_active":"2024-09-13T06:13:24.056204+0000","last_peered":"2024-09-13T06:13:24.056204+0000","last_clean":"2024-09-13T06:13:24.056204+0000","last_became_active":"2024-09-13T06:09:42.177378+0000","last_became_peered":"2024-09-13T06:09:42.177378+0000","last_unstale":"2024-09-13T06:13:24.056204+0000","last_undegraded":"2024-09-13T06:13:24.056204+0000","last_fullsized":"2024-09-13T06:13:24.056204+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"35'18","reported_seq":76,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.344275+0000","last_change":"2024-09-13T06:09:34.119010+0000","last_active":"2024-09-13T06:12:49.344275+0000","last_peered":"2024-09-13T06:12:49.344275+0000","last_clean":"2024-09-13T06:12:49.344275+0000","last_became_active":"2024-09-13T06:09:34.118441+0000","last_became_peered":"2024-09-13T06:09:34.118441+0000","last_unstale":"2024-09-13T06:12:49.344275+0000","last_undegraded":"2024-09-13T06:12:49.344275+0000","last_fullsized":"2024-09-13T06:12:49.344275+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":59,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:01.442392+0000","last_change":"2024-09-13T06:14:01.442453+0000","last_active":"2024-09-13T06:14:01.442392+0000","last_peered":"2024-09-13T06:14:01.442392+0000","last_clean":"2024-09-13T06:14:01.442392+0000","last_became_active":"2024-09-13T06:09:32.138664+0000","last_became_peered":"2024-09-13T06:09:32.138664+0000","last_unstale":"2024-09-13T06:14:01.442392+0000","last_undegraded":"2024-09-13T06:14:01.442392+0000","last_fullsized":"2024-09-13T06:14:01.442392+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:01.442196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:01.442196+0000","last_clean_scrub_stamp":"2024-09-13T06:14:01.442196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:02:06.026722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"35'5","reported_seq":238,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:30.836275+0000","last_change":"2024-09-13T06:13:30.836350+0000","last_active":"2024-09-13T06:13:30.836275+0000","last_peered":"2024-09-13T06:13:30.836275+0000","last_clean":"2024-09-13T06:13:30.836275+0000","last_became_active":"2024-09-13T06:09:36.153526+0000","last_became_peered":"2024-09-13T06:09:36.153526+0000","last_unstale":"2024-09-13T06:13:30.836275+0000","last_undegraded":"2024-09-13T06:13:30.836275+0000","last_fullsized":"2024-09-13T06:13:30.836275+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'5","last_scrub_stamp":"2024-09-13T06:13:30.836096+0000","last_deep_scrub":"35'5","last_deep_scrub_stamp":"2024-09-13T06:13:30.836096+0000","last_clean_scrub_stamp":"2024-09-13T06:13:30.836096+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:12:49.323535+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"35'9","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:37.292860+0000","last_change":"2024-09-13T06:13:37.292929+0000","last_active":"2024-09-13T06:13:37.292860+0000","last_peered":"2024-09-13T06:13:37.292860+0000","last_clean":"2024-09-13T06:13:37.292860+0000","last_became_active":"2024-09-13T06:09:38.150063+0000","last_became_peered":"2024-09-13T06:09:38.150063+0000","last_unstale":"2024-09-13T06:13:37.292860+0000","last_undegraded":"2024-09-13T06:13:37.292860+0000","last_fullsized":"2024-09-13T06:13:37.292860+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'9","last_scrub_stamp":"2024-09-13T06:13:37.292678+0000","last_deep_scrub":"35'9","last_deep_scrub_stamp":"2024-09-13T06:13:37.292678+0000","last_clean_scrub_stamp":"2024-09-13T06:13:37.292678+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:13:04.527644+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.383297+0000","last_change":"2024-09-13T06:13:25.383351+0000","last_active":"2024-09-13T06:13:25.383297+0000","last_peered":"2024-09-13T06:13:25.383297+0000","last_clean":"2024-09-13T06:13:25.383297+0000","last_became_active":"2024-09-13T06:09:40.181807+0000","last_became_peered":"2024-09-13T06:09:40.181807+0000","last_unstale":"2024-09-13T06:13:25.383297+0000","last_undegraded":"2024-09-13T06:13:25.383297+0000","last_fullsized":"2024-09-13T06:13:25.383297+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:25.383101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:25.383101+0000","last_clean_scrub_stamp":"2024-09-13T06:13:25.383101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:45:24.271310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"35'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.457558+0000","last_change":"2024-09-13T06:09:42.209380+0000","last_active":"2024-09-13T06:12:49.457558+0000","last_peered":"2024-09-13T06:12:49.457558+0000","last_clean":"2024-09-13T06:12:49.457558+0000","last_became_active":"2024-09-13T06:09:42.208567+0000","last_became_peered":"2024-09-13T06:09:42.208567+0000","last_unstale":"2024-09-13T06:12:49.457558+0000","last_undegraded":"2024-09-13T06:12:49.457558+0000","last_fullsized":"2024-09-13T06:12:49.457558+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"35'12","reported_seq":69,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:56.168936+0000","last_change":"2024-09-13T06:13:56.169020+0000","last_active":"2024-09-13T06:13:56.168936+0000","last_peered":"2024-09-13T06:13:56.168936+0000","last_clean":"2024-09-13T06:13:56.168936+0000","last_became_active":"2024-09-13T06:09:34.113455+0000","last_became_peered":"2024-09-13T06:09:34.113455+0000","last_unstale":"2024-09-13T06:13:56.168936+0000","last_undegraded":"2024-09-13T06:13:56.168936+0000","last_fullsized":"2024-09-13T06:13:56.168936+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'12","last_scrub_stamp":"2024-09-13T06:13:56.168729+0000","last_deep_scrub":"35'12","last_deep_scrub_stamp":"2024-09-13T06:13:56.168729+0000","last_clean_scrub_stamp":"2024-09-13T06:13:56.168729+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:18:27.944609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:56.801004+0000","last_change":"2024-09-13T06:09:32.118643+0000","last_active":"2024-09-13T06:11:56.801004+0000","last_peered":"2024-09-13T06:11:56.801004+0000","last_clean":"2024-09-13T06:11:56.801004+0000","last_became_active":"2024-09-13T06:09:32.118235+0000","last_became_peered":"2024-09-13T06:09:32.118235+0000","last_unstale":"2024-09-13T06:11:56.801004+0000","last_undegraded":"2024-09-13T06:11:56.801004+0000","last_fullsized":"2024-09-13T06:11:56.801004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"35'2","reported_seq":230,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:41.478800+0000","last_change":"2024-09-13T06:13:41.478861+0000","last_active":"2024-09-13T06:13:41.478800+0000","last_peered":"2024-09-13T06:13:41.478800+0000","last_clean":"2024-09-13T06:13:41.478800+0000","last_became_active":"2024-09-13T06:09:36.135184+0000","last_became_peered":"2024-09-13T06:09:36.135184+0000","last_unstale":"2024-09-13T06:13:41.478800+0000","last_undegraded":"2024-09-13T06:13:41.478800+0000","last_fullsized":"2024-09-13T06:13:41.478800+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:13:41.478609+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:13:41.478609+0000","last_clean_scrub_stamp":"2024-09-13T06:13:41.478609+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:20:43.284625+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"35'49","reported_seq":121,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:31.284234+0000","last_change":"2024-09-13T06:13:31.284327+0000","last_active":"2024-09-13T06:13:31.284234+0000","last_peered":"2024-09-13T06:13:31.284234+0000","last_clean":"2024-09-13T06:13:31.284234+0000","last_became_active":"2024-09-13T06:09:38.166381+0000","last_became_peered":"2024-09-13T06:09:38.166381+0000","last_unstale":"2024-09-13T06:13:31.284234+0000","last_undegraded":"2024-09-13T06:13:31.284234+0000","last_fullsized":"2024-09-13T06:13:31.284234+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'49","last_scrub_stamp":"2024-09-13T06:13:31.283995+0000","last_deep_scrub":"35'49","last_deep_scrub_stamp":"2024-09-13T06:13:31.283995+0000","last_clean_scrub_stamp":"2024-09-13T06:13:31.283995+0000","objects_scrubbed":6,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:53:13.436645+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:33.140501+0000","last_change":"2024-09-13T06:13:33.140552+0000","last_active":"2024-09-13T06:13:33.140501+0000","last_peered":"2024-09-13T06:13:33.140501+0000","last_clean":"2024-09-13T06:13:33.140501+0000","last_became_active":"2024-09-13T06:09:40.181329+0000","last_became_peered":"2024-09-13T06:09:40.181329+0000","last_unstale":"2024-09-13T06:13:33.140501+0000","last_undegraded":"2024-09-13T06:13:33.140501+0000","last_fullsized":"2024-09-13T06:13:33.140501+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:33.140310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:33.140310+0000","last_clean_scrub_stamp":"2024-09-13T06:13:33.140310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:08:31.071212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:12.814732+0000","last_change":"2024-09-13T06:09:42.211550+0000","last_active":"2024-09-13T06:12:12.814732+0000","last_peered":"2024-09-13T06:12:12.814732+0000","last_clean":"2024-09-13T06:12:12.814732+0000","last_became_active":"2024-09-13T06:09:42.211005+0000","last_became_peered":"2024-09-13T06:09:42.211005+0000","last_unstale":"2024-09-13T06:12:12.814732+0000","last_undegraded":"2024-09-13T06:12:12.814732+0000","last_fullsized":"2024-09-13T06:12:12.814732+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"35'6","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:42.783312+0000","last_change":"2024-09-13T06:13:42.783373+0000","last_active":"2024-09-13T06:13:42.783312+0000","last_peered":"2024-09-13T06:13:42.783312+0000","last_clean":"2024-09-13T06:13:42.783312+0000","last_became_active":"2024-09-13T06:09:34.126798+0000","last_became_peered":"2024-09-13T06:09:34.126798+0000","last_unstale":"2024-09-13T06:13:42.783312+0000","last_undegraded":"2024-09-13T06:13:42.783312+0000","last_fullsized":"2024-09-13T06:13:42.783312+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:13:42.783125+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:13:42.783125+0000","last_clean_scrub_stamp":"2024-09-13T06:13:42.783125+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:22:51.788479+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:57.805897+0000","last_change":"2024-09-13T06:09:32.126749+0000","last_active":"2024-09-13T06:11:57.805897+0000","last_peered":"2024-09-13T06:11:57.805897+0000","last_clean":"2024-09-13T06:11:57.805897+0000","last_became_active":"2024-09-13T06:09:32.126213+0000","last_became_peered":"2024-09-13T06:09:32.126213+0000","last_unstale":"2024-09-13T06:11:57.805897+0000","last_undegraded":"2024-09-13T06:11:57.805897+0000","last_fullsized":"2024-09-13T06:11:57.805897+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:34.825358+0000","last_change":"2024-09-13T06:13:34.825411+0000","last_active":"2024-09-13T06:13:34.825358+0000","last_peered":"2024-09-13T06:13:34.825358+0000","last_clean":"2024-09-13T06:13:34.825358+0000","last_became_active":"2024-09-13T06:09:36.148016+0000","last_became_peered":"2024-09-13T06:09:36.148016+0000","last_unstale":"2024-09-13T06:13:34.825358+0000","last_undegraded":"2024-09-13T06:13:34.825358+0000","last_fullsized":"2024-09-13T06:13:34.825358+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:34.825172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:34.825172+0000","last_clean_scrub_stamp":"2024-09-13T06:13:34.825172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:35:11.379450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"35'36","reported_seq":91,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:39.479724+0000","last_change":"2024-09-13T06:13:39.479798+0000","last_active":"2024-09-13T06:13:39.479724+0000","last_peered":"2024-09-13T06:13:39.479724+0000","last_clean":"2024-09-13T06:13:39.479724+0000","last_became_active":"2024-09-13T06:09:38.141182+0000","last_became_peered":"2024-09-13T06:09:38.141182+0000","last_unstale":"2024-09-13T06:13:39.479724+0000","last_undegraded":"2024-09-13T06:13:39.479724+0000","last_fullsized":"2024-09-13T06:13:39.479724+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'36","last_scrub_stamp":"2024-09-13T06:13:39.479521+0000","last_deep_scrub":"35'36","last_deep_scrub_stamp":"2024-09-13T06:13:39.479521+0000","last_clean_scrub_stamp":"2024-09-13T06:13:39.479521+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:51:47.667173+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:30.363101+0000","last_change":"2024-09-13T06:13:30.363157+0000","last_active":"2024-09-13T06:13:30.363101+0000","last_peered":"2024-09-13T06:13:30.363101+0000","last_clean":"2024-09-13T06:13:30.363101+0000","last_became_active":"2024-09-13T06:09:40.166229+0000","last_became_peered":"2024-09-13T06:09:40.166229+0000","last_unstale":"2024-09-13T06:13:30.363101+0000","last_undegraded":"2024-09-13T06:13:30.363101+0000","last_fullsized":"2024-09-13T06:13:30.363101+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:30.362905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:30.362905+0000","last_clean_scrub_stamp":"2024-09-13T06:13:30.362905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:24:17.255873+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"35'6","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:01.922629+0000","last_change":"2024-09-13T06:14:01.922787+0000","last_active":"2024-09-13T06:14:01.922629+0000","last_peered":"2024-09-13T06:14:01.922629+0000","last_clean":"2024-09-13T06:14:01.922629+0000","last_became_active":"2024-09-13T06:09:34.122034+0000","last_became_peered":"2024-09-13T06:09:34.122034+0000","last_unstale":"2024-09-13T06:14:01.922629+0000","last_undegraded":"2024-09-13T06:14:01.922629+0000","last_fullsized":"2024-09-13T06:14:01.922629+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:14:01.922410+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:14:01.922410+0000","last_clean_scrub_stamp":"2024-09-13T06:14:01.922410+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:23:57.663402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:20.953616+0000","last_change":"2024-09-13T06:09:32.124543+0000","last_active":"2024-09-13T06:13:20.953616+0000","last_peered":"2024-09-13T06:13:20.953616+0000","last_clean":"2024-09-13T06:13:20.953616+0000","last_became_active":"2024-09-13T06:09:32.121948+0000","last_became_peered":"2024-09-13T06:09:32.121948+0000","last_unstale":"2024-09-13T06:13:20.953616+0000","last_undegraded":"2024-09-13T06:13:20.953616+0000","last_fullsized":"2024-09-13T06:13:20.953616+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:47.139074+0000","last_change":"2024-09-13T06:13:47.139128+0000","last_active":"2024-09-13T06:13:47.139074+0000","last_peered":"2024-09-13T06:13:47.139074+0000","last_clean":"2024-09-13T06:13:47.139074+0000","last_became_active":"2024-09-13T06:09:36.132227+0000","last_became_peered":"2024-09-13T06:09:36.132227+0000","last_unstale":"2024-09-13T06:13:47.139074+0000","last_undegraded":"2024-09-13T06:13:47.139074+0000","last_fullsized":"2024-09-13T06:13:47.139074+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:47.138875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:47.138875+0000","last_clean_scrub_stamp":"2024-09-13T06:13:47.138875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:46:51.298281+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"35'63","reported_seq":136,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:38.262967+0000","last_change":"2024-09-13T06:13:38.263042+0000","last_active":"2024-09-13T06:13:38.262967+0000","last_peered":"2024-09-13T06:13:38.262967+0000","last_clean":"2024-09-13T06:13:38.262967+0000","last_became_active":"2024-09-13T06:09:38.150070+0000","last_became_peered":"2024-09-13T06:09:38.150070+0000","last_unstale":"2024-09-13T06:13:38.262967+0000","last_undegraded":"2024-09-13T06:13:38.262967+0000","last_fullsized":"2024-09-13T06:13:38.262967+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'63","last_scrub_stamp":"2024-09-13T06:13:38.262747+0000","last_deep_scrub":"35'63","last_deep_scrub_stamp":"2024-09-13T06:13:38.262747+0000","last_clean_scrub_stamp":"2024-09-13T06:13:38.262747+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:56:34.974972+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:26.401270+0000","last_change":"2024-09-13T06:13:26.401325+0000","last_active":"2024-09-13T06:13:26.401270+0000","last_peered":"2024-09-13T06:13:26.401270+0000","last_clean":"2024-09-13T06:13:26.401270+0000","last_became_active":"2024-09-13T06:09:40.168550+0000","last_became_peered":"2024-09-13T06:09:40.168550+0000","last_unstale":"2024-09-13T06:13:26.401270+0000","last_undegraded":"2024-09-13T06:13:26.401270+0000","last_fullsized":"2024-09-13T06:13:26.401270+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:26.401059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:26.401059+0000","last_clean_scrub_stamp":"2024-09-13T06:13:26.401059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:03:36.749162+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"35'14","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:05.803513+0000","last_change":"2024-09-13T06:09:42.212051+0000","last_active":"2024-09-13T06:12:05.803513+0000","last_peered":"2024-09-13T06:12:05.803513+0000","last_clean":"2024-09-13T06:12:05.803513+0000","last_became_active":"2024-09-13T06:09:42.211508+0000","last_became_peered":"2024-09-13T06:09:42.211508+0000","last_unstale":"2024-09-13T06:12:05.803513+0000","last_undegraded":"2024-09-13T06:12:05.803513+0000","last_fullsized":"2024-09-13T06:12:05.803513+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"35'8","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:53.158421+0000","last_change":"2024-09-13T06:13:53.158479+0000","last_active":"2024-09-13T06:13:53.158421+0000","last_peered":"2024-09-13T06:13:53.158421+0000","last_clean":"2024-09-13T06:13:53.158421+0000","last_became_active":"2024-09-13T06:09:34.122881+0000","last_became_peered":"2024-09-13T06:09:34.122881+0000","last_unstale":"2024-09-13T06:13:53.158421+0000","last_undegraded":"2024-09-13T06:13:53.158421+0000","last_fullsized":"2024-09-13T06:13:53.158421+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-13T06:13:53.158235+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-13T06:13:53.158235+0000","last_clean_scrub_stamp":"2024-09-13T06:13:53.158235+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:27:12.571243+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":11,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:57.805580+0000","last_change":"2024-09-13T06:09:32.120176+0000","last_active":"2024-09-13T06:11:57.805580+0000","last_peered":"2024-09-13T06:11:57.805580+0000","last_clean":"2024-09-13T06:11:57.805580+0000","last_became_active":"2024-09-13T06:09:32.119573+0000","last_became_peered":"2024-09-13T06:09:32.119573+0000","last_unstale":"2024-09-13T06:11:57.805580+0000","last_undegraded":"2024-09-13T06:11:57.805580+0000","last_fullsized":"2024-09-13T06:11:57.805580+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:45.482486+0000","last_change":"2024-09-13T06:13:45.482486+0000","last_active":"2024-09-13T06:13:45.482486+0000","last_peered":"2024-09-13T06:13:45.482486+0000","last_clean":"2024-09-13T06:13:45.482486+0000","last_became_active":"2024-09-13T06:09:36.127719+0000","last_became_peered":"2024-09-13T06:09:36.127719+0000","last_unstale":"2024-09-13T06:13:45.482486+0000","last_undegraded":"2024-09-13T06:13:45.482486+0000","last_fullsized":"2024-09-13T06:13:45.482486+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:45.482236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:45.482236+0000","last_clean_scrub_stamp":"2024-09-13T06:13:45.482236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:48:41.351667+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"35'46","reported_seq":104,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:43.807725+0000","last_change":"2024-09-13T06:13:43.807814+0000","last_active":"2024-09-13T06:13:43.807725+0000","last_peered":"2024-09-13T06:13:43.807725+0000","last_clean":"2024-09-13T06:13:43.807725+0000","last_became_active":"2024-09-13T06:09:38.175443+0000","last_became_peered":"2024-09-13T06:09:38.175443+0000","last_unstale":"2024-09-13T06:13:43.807725+0000","last_undegraded":"2024-09-13T06:13:43.807725+0000","last_fullsized":"2024-09-13T06:13:43.807725+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'46","last_scrub_stamp":"2024-09-13T06:13:43.807524+0000","last_deep_scrub":"35'46","last_deep_scrub_stamp":"2024-09-13T06:13:43.807524+0000","last_clean_scrub_stamp":"2024-09-13T06:13:43.807524+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:18:40.372988+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:45.156724+0000","last_change":"2024-09-13T06:13:45.156776+0000","last_active":"2024-09-13T06:13:45.156724+0000","last_peered":"2024-09-13T06:13:45.156724+0000","last_clean":"2024-09-13T06:13:45.156724+0000","last_became_active":"2024-09-13T06:09:40.185222+0000","last_became_peered":"2024-09-13T06:09:40.185222+0000","last_unstale":"2024-09-13T06:13:45.156724+0000","last_undegraded":"2024-09-13T06:13:45.156724+0000","last_fullsized":"2024-09-13T06:13:45.156724+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:45.156528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:45.156528+0000","last_clean_scrub_stamp":"2024-09-13T06:13:45.156528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:58:23.506441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:02.811935+0000","last_change":"2024-09-13T06:09:42.197504+0000","last_active":"2024-09-13T06:12:02.811935+0000","last_peered":"2024-09-13T06:12:02.811935+0000","last_clean":"2024-09-13T06:12:02.811935+0000","last_became_active":"2024-09-13T06:09:42.196679+0000","last_became_peered":"2024-09-13T06:09:42.196679+0000","last_unstale":"2024-09-13T06:12:02.811935+0000","last_undegraded":"2024-09-13T06:12:02.811935+0000","last_fullsized":"2024-09-13T06:12:02.811935+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"35'16","reported_seq":86,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:38.804179+0000","last_change":"2024-09-13T06:13:38.804245+0000","last_active":"2024-09-13T06:13:38.804179+0000","last_peered":"2024-09-13T06:13:38.804179+0000","last_clean":"2024-09-13T06:13:38.804179+0000","last_became_active":"2024-09-13T06:09:34.132777+0000","last_became_peered":"2024-09-13T06:09:34.132777+0000","last_unstale":"2024-09-13T06:13:38.804179+0000","last_undegraded":"2024-09-13T06:13:38.804179+0000","last_fullsized":"2024-09-13T06:13:38.804179+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'16","last_scrub_stamp":"2024-09-13T06:13:38.803976+0000","last_deep_scrub":"35'16","last_deep_scrub_stamp":"2024-09-13T06:13:38.803976+0000","last_clean_scrub_stamp":"2024-09-13T06:13:38.803976+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:52:39.806244+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":57,"num_read_kb":53,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:02.806927+0000","last_change":"2024-09-13T06:09:32.118851+0000","last_active":"2024-09-13T06:12:02.806927+0000","last_peered":"2024-09-13T06:12:02.806927+0000","last_clean":"2024-09-13T06:12:02.806927+0000","last_became_active":"2024-09-13T06:09:32.117988+0000","last_became_peered":"2024-09-13T06:09:32.117988+0000","last_unstale":"2024-09-13T06:12:02.806927+0000","last_undegraded":"2024-09-13T06:12:02.806927+0000","last_fullsized":"2024-09-13T06:12:02.806927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:43.472927+0000","last_change":"2024-09-13T06:13:43.472981+0000","last_active":"2024-09-13T06:13:43.472927+0000","last_peered":"2024-09-13T06:13:43.472927+0000","last_clean":"2024-09-13T06:13:43.472927+0000","last_became_active":"2024-09-13T06:09:36.129471+0000","last_became_peered":"2024-09-13T06:09:36.129471+0000","last_unstale":"2024-09-13T06:13:43.472927+0000","last_undegraded":"2024-09-13T06:13:43.472927+0000","last_fullsized":"2024-09-13T06:13:43.472927+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:43.472711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:43.472711+0000","last_clean_scrub_stamp":"2024-09-13T06:13:43.472711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:48:39.465341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"35'41","reported_seq":98,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:35.293684+0000","last_change":"2024-09-13T06:13:35.293684+0000","last_active":"2024-09-13T06:13:35.293684+0000","last_peered":"2024-09-13T06:13:35.293684+0000","last_clean":"2024-09-13T06:13:35.293684+0000","last_became_active":"2024-09-13T06:09:38.153433+0000","last_became_peered":"2024-09-13T06:09:38.153433+0000","last_unstale":"2024-09-13T06:13:35.293684+0000","last_undegraded":"2024-09-13T06:13:35.293684+0000","last_fullsized":"2024-09-13T06:13:35.293684+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'41","last_scrub_stamp":"2024-09-13T06:13:35.293395+0000","last_deep_scrub":"35'41","last_deep_scrub_stamp":"2024-09-13T06:13:35.293395+0000","last_clean_scrub_stamp":"2024-09-13T06:13:35.293395+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:48:31.286025+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":55,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:29.307769+0000","last_change":"2024-09-13T06:13:29.307769+0000","last_active":"2024-09-13T06:13:29.307769+0000","last_peered":"2024-09-13T06:13:29.307769+0000","last_clean":"2024-09-13T06:13:29.307769+0000","last_became_active":"2024-09-13T06:09:40.171455+0000","last_became_peered":"2024-09-13T06:09:40.171455+0000","last_unstale":"2024-09-13T06:13:29.307769+0000","last_undegraded":"2024-09-13T06:13:29.307769+0000","last_fullsized":"2024-09-13T06:13:29.307769+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:29.307405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:29.307405+0000","last_clean_scrub_stamp":"2024-09-13T06:13:29.307405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:02:21.851168+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"35'5","reported_seq":23,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:02.811905+0000","last_change":"2024-09-13T06:09:42.202743+0000","last_active":"2024-09-13T06:12:02.811905+0000","last_peered":"2024-09-13T06:12:02.811905+0000","last_clean":"2024-09-13T06:12:02.811905+0000","last_became_active":"2024-09-13T06:09:42.202004+0000","last_became_peered":"2024-09-13T06:09:42.202004+0000","last_unstale":"2024-09-13T06:12:02.811905+0000","last_undegraded":"2024-09-13T06:12:02.811905+0000","last_fullsized":"2024-09-13T06:12:02.811905+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:04.027577+0000","last_change":"2024-09-13T06:14:04.027730+0000","last_active":"2024-09-13T06:14:04.027577+0000","last_peered":"2024-09-13T06:14:04.027577+0000","last_clean":"2024-09-13T06:14:04.027577+0000","last_became_active":"2024-09-13T06:09:34.116197+0000","last_became_peered":"2024-09-13T06:09:34.116197+0000","last_unstale":"2024-09-13T06:14:04.027577+0000","last_undegraded":"2024-09-13T06:14:04.027577+0000","last_fullsized":"2024-09-13T06:14:04.027577+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:04.027357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:04.027357+0000","last_clean_scrub_stamp":"2024-09-13T06:14:04.027357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:41:38.144650+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"35'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:02.812005+0000","last_change":"2024-09-13T06:09:32.132784+0000","last_active":"2024-09-13T06:12:02.812005+0000","last_peered":"2024-09-13T06:12:02.812005+0000","last_clean":"2024-09-13T06:12:02.812005+0000","last_became_active":"2024-09-13T06:09:32.124989+0000","last_became_peered":"2024-09-13T06:09:32.124989+0000","last_unstale":"2024-09-13T06:12:02.812005+0000","last_undegraded":"2024-09-13T06:12:02.812005+0000","last_fullsized":"2024-09-13T06:12:02.812005+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:36.119134+0000","last_change":"2024-09-13T06:13:36.119188+0000","last_active":"2024-09-13T06:13:36.119134+0000","last_peered":"2024-09-13T06:13:36.119134+0000","last_clean":"2024-09-13T06:13:36.119134+0000","last_became_active":"2024-09-13T06:09:36.140149+0000","last_became_peered":"2024-09-13T06:09:36.140149+0000","last_unstale":"2024-09-13T06:13:36.119134+0000","last_undegraded":"2024-09-13T06:13:36.119134+0000","last_fullsized":"2024-09-13T06:13:36.119134+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:36.118904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:36.118904+0000","last_clean_scrub_stamp":"2024-09-13T06:13:36.118904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:21:56.564481+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"35'15","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:50.851940+0000","last_change":"2024-09-13T06:13:50.852014+0000","last_active":"2024-09-13T06:13:50.851940+0000","last_peered":"2024-09-13T06:13:50.851940+0000","last_clean":"2024-09-13T06:13:50.851940+0000","last_became_active":"2024-09-13T06:09:38.177699+0000","last_became_peered":"2024-09-13T06:09:38.177699+0000","last_unstale":"2024-09-13T06:13:50.851940+0000","last_undegraded":"2024-09-13T06:13:50.851940+0000","last_fullsized":"2024-09-13T06:13:50.851940+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'15","last_scrub_stamp":"2024-09-13T06:13:50.851744+0000","last_deep_scrub":"35'15","last_deep_scrub_stamp":"2024-09-13T06:13:50.851744+0000","last_clean_scrub_stamp":"2024-09-13T06:13:50.851744+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:02:47.395746+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"35'285","reported_seq":384,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:29.354681+0000","last_change":"2024-09-13T06:13:29.354681+0000","last_active":"2024-09-13T06:13:29.354681+0000","last_peered":"2024-09-13T06:13:29.354681+0000","last_clean":"2024-09-13T06:13:29.354681+0000","last_became_active":"2024-09-13T06:09:40.166780+0000","last_became_peered":"2024-09-13T06:09:40.166780+0000","last_unstale":"2024-09-13T06:13:29.354681+0000","last_undegraded":"2024-09-13T06:13:29.354681+0000","last_fullsized":"2024-09-13T06:13:29.354681+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-13T06:13:29.354428+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-13T06:13:29.354428+0000","last_clean_scrub_stamp":"2024-09-13T06:13:29.354428+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:07:16.616986+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"35'2","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:02.811733+0000","last_change":"2024-09-13T06:09:42.201112+0000","last_active":"2024-09-13T06:12:02.811733+0000","last_peered":"2024-09-13T06:12:02.811733+0000","last_clean":"2024-09-13T06:12:02.811733+0000","last_became_active":"2024-09-13T06:09:42.196063+0000","last_became_peered":"2024-09-13T06:09:42.196063+0000","last_unstale":"2024-09-13T06:12:02.811733+0000","last_undegraded":"2024-09-13T06:12:02.811733+0000","last_fullsized":"2024-09-13T06:12:02.811733+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"35'6","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:48.977388+0000","last_change":"2024-09-13T06:09:34.108198+0000","last_active":"2024-09-13T06:12:48.977388+0000","last_peered":"2024-09-13T06:12:48.977388+0000","last_clean":"2024-09-13T06:12:48.977388+0000","last_became_active":"2024-09-13T06:09:34.107821+0000","last_became_peered":"2024-09-13T06:09:34.107821+0000","last_unstale":"2024-09-13T06:12:48.977388+0000","last_undegraded":"2024-09-13T06:12:48.977388+0000","last_fullsized":"2024-09-13T06:12:48.977388+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"35'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:02.807006+0000","last_change":"2024-09-13T06:09:32.141297+0000","last_active":"2024-09-13T06:12:02.807006+0000","last_peered":"2024-09-13T06:12:02.807006+0000","last_clean":"2024-09-13T06:12:02.807006+0000","last_became_active":"2024-09-13T06:09:32.140816+0000","last_became_peered":"2024-09-13T06:09:32.140816+0000","last_unstale":"2024-09-13T06:12:02.807006+0000","last_undegraded":"2024-09-13T06:12:02.807006+0000","last_fullsized":"2024-09-13T06:12:02.807006+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:34.100074+0000","last_change":"2024-09-13T06:13:34.100128+0000","last_active":"2024-09-13T06:13:34.100074+0000","last_peered":"2024-09-13T06:13:34.100074+0000","last_clean":"2024-09-13T06:13:34.100074+0000","last_became_active":"2024-09-13T06:09:36.140770+0000","last_became_peered":"2024-09-13T06:09:36.140770+0000","last_unstale":"2024-09-13T06:13:34.100074+0000","last_undegraded":"2024-09-13T06:13:34.100074+0000","last_fullsized":"2024-09-13T06:13:34.100074+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:34.099877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:34.099877+0000","last_clean_scrub_stamp":"2024-09-13T06:13:34.099877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:24:15.804560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"35'46","reported_seq":104,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.335560+0000","last_change":"2024-09-13T06:13:25.335732+0000","last_active":"2024-09-13T06:13:25.335560+0000","last_peered":"2024-09-13T06:13:25.335560+0000","last_clean":"2024-09-13T06:13:25.335560+0000","last_became_active":"2024-09-13T06:09:38.166681+0000","last_became_peered":"2024-09-13T06:09:38.166681+0000","last_unstale":"2024-09-13T06:13:25.335560+0000","last_undegraded":"2024-09-13T06:13:25.335560+0000","last_fullsized":"2024-09-13T06:13:25.335560+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'46","last_scrub_stamp":"2024-09-13T06:13:25.335323+0000","last_deep_scrub":"35'46","last_deep_scrub_stamp":"2024-09-13T06:13:25.335323+0000","last_clean_scrub_stamp":"2024-09-13T06:13:25.335323+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:32:30.737347+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:28.331282+0000","last_change":"2024-09-13T06:13:28.331392+0000","last_active":"2024-09-13T06:13:28.331282+0000","last_peered":"2024-09-13T06:13:28.331282+0000","last_clean":"2024-09-13T06:13:28.331282+0000","last_became_active":"2024-09-13T06:09:40.178484+0000","last_became_peered":"2024-09-13T06:09:40.178484+0000","last_unstale":"2024-09-13T06:13:28.331282+0000","last_undegraded":"2024-09-13T06:13:28.331282+0000","last_fullsized":"2024-09-13T06:13:28.331282+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:28.331050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:28.331050+0000","last_clean_scrub_stamp":"2024-09-13T06:13:28.331050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:53:24.217481+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"35'4","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:07.808288+0000","last_change":"2024-09-13T06:09:42.201123+0000","last_active":"2024-09-13T06:12:07.808288+0000","last_peered":"2024-09-13T06:12:07.808288+0000","last_clean":"2024-09-13T06:12:07.808288+0000","last_became_active":"2024-09-13T06:09:42.199609+0000","last_became_peered":"2024-09-13T06:09:42.199609+0000","last_unstale":"2024-09-13T06:12:07.808288+0000","last_undegraded":"2024-09-13T06:12:07.808288+0000","last_fullsized":"2024-09-13T06:12:07.808288+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"35'6","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:51.506179+0000","last_change":"2024-09-13T06:13:51.506348+0000","last_active":"2024-09-13T06:13:51.506179+0000","last_peered":"2024-09-13T06:13:51.506179+0000","last_clean":"2024-09-13T06:13:51.506179+0000","last_became_active":"2024-09-13T06:09:34.100355+0000","last_became_peered":"2024-09-13T06:09:34.100355+0000","last_unstale":"2024-09-13T06:13:51.506179+0000","last_undegraded":"2024-09-13T06:13:51.506179+0000","last_fullsized":"2024-09-13T06:13:51.506179+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:13:51.505951+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:13:51.505951+0000","last_clean_scrub_stamp":"2024-09-13T06:13:51.505951+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:34:28.572463+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:02.812140+0000","last_change":"2024-09-13T06:09:32.133279+0000","last_active":"2024-09-13T06:12:02.812140+0000","last_peered":"2024-09-13T06:12:02.812140+0000","last_clean":"2024-09-13T06:12:02.812140+0000","last_became_active":"2024-09-13T06:09:32.125049+0000","last_became_peered":"2024-09-13T06:09:32.125049+0000","last_unstale":"2024-09-13T06:12:02.812140+0000","last_undegraded":"2024-09-13T06:12:02.812140+0000","last_fullsized":"2024-09-13T06:12:02.812140+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:46.483099+0000","last_change":"2024-09-13T06:13:46.483155+0000","last_active":"2024-09-13T06:13:46.483099+0000","last_peered":"2024-09-13T06:13:46.483099+0000","last_clean":"2024-09-13T06:13:46.483099+0000","last_became_active":"2024-09-13T06:09:36.127684+0000","last_became_peered":"2024-09-13T06:09:36.127684+0000","last_unstale":"2024-09-13T06:13:46.483099+0000","last_undegraded":"2024-09-13T06:13:46.483099+0000","last_fullsized":"2024-09-13T06:13:46.483099+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:46.482894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:46.482894+0000","last_clean_scrub_stamp":"2024-09-13T06:13:46.482894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:09:00.981051+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"35'37","reported_seq":92,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:34.298374+0000","last_change":"2024-09-13T06:13:34.298450+0000","last_active":"2024-09-13T06:13:34.298374+0000","last_peered":"2024-09-13T06:13:34.298374+0000","last_clean":"2024-09-13T06:13:34.298374+0000","last_became_active":"2024-09-13T06:09:38.157278+0000","last_became_peered":"2024-09-13T06:09:38.157278+0000","last_unstale":"2024-09-13T06:13:34.298374+0000","last_undegraded":"2024-09-13T06:13:34.298374+0000","last_fullsized":"2024-09-13T06:13:34.298374+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'37","last_scrub_stamp":"2024-09-13T06:13:34.298176+0000","last_deep_scrub":"35'37","last_deep_scrub_stamp":"2024-09-13T06:13:34.298176+0000","last_clean_scrub_stamp":"2024-09-13T06:13:34.298176+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:13:34.885749+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:45.813476+0000","last_change":"2024-09-13T06:13:45.813575+0000","last_active":"2024-09-13T06:13:45.813476+0000","last_peered":"2024-09-13T06:13:45.813476+0000","last_clean":"2024-09-13T06:13:45.813476+0000","last_became_active":"2024-09-13T06:09:40.189165+0000","last_became_peered":"2024-09-13T06:09:40.189165+0000","last_unstale":"2024-09-13T06:13:45.813476+0000","last_undegraded":"2024-09-13T06:13:45.813476+0000","last_fullsized":"2024-09-13T06:13:45.813476+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:45.813202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:45.813202+0000","last_clean_scrub_stamp":"2024-09-13T06:13:45.813202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:32:50.595240+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:07.813661+0000","last_change":"2024-09-13T06:09:42.214239+0000","last_active":"2024-09-13T06:12:07.813661+0000","last_peered":"2024-09-13T06:12:07.813661+0000","last_clean":"2024-09-13T06:12:07.813661+0000","last_became_active":"2024-09-13T06:09:42.213756+0000","last_became_peered":"2024-09-13T06:09:42.213756+0000","last_unstale":"2024-09-13T06:12:07.813661+0000","last_undegraded":"2024-09-13T06:12:07.813661+0000","last_fullsized":"2024-09-13T06:12:07.813661+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:02.811853+0000","last_change":"2024-09-13T06:09:34.118052+0000","last_active":"2024-09-13T06:12:02.811853+0000","last_peered":"2024-09-13T06:12:02.811853+0000","last_clean":"2024-09-13T06:12:02.811853+0000","last_became_active":"2024-09-13T06:09:34.117789+0000","last_became_peered":"2024-09-13T06:09:34.117789+0000","last_unstale":"2024-09-13T06:12:02.811853+0000","last_undegraded":"2024-09-13T06:12:02.811853+0000","last_fullsized":"2024-09-13T06:12:02.811853+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:24.055218+0000","last_change":"2024-09-13T06:09:32.135815+0000","last_active":"2024-09-13T06:13:24.055218+0000","last_peered":"2024-09-13T06:13:24.055218+0000","last_clean":"2024-09-13T06:13:24.055218+0000","last_became_active":"2024-09-13T06:09:32.134696+0000","last_became_peered":"2024-09-13T06:09:32.134696+0000","last_unstale":"2024-09-13T06:13:24.055218+0000","last_undegraded":"2024-09-13T06:13:24.055218+0000","last_fullsized":"2024-09-13T06:13:24.055218+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:42.137324+0000","last_change":"2024-09-13T06:13:42.137375+0000","last_active":"2024-09-13T06:13:42.137324+0000","last_peered":"2024-09-13T06:13:42.137324+0000","last_clean":"2024-09-13T06:13:42.137324+0000","last_became_active":"2024-09-13T06:09:36.131976+0000","last_became_peered":"2024-09-13T06:09:36.131976+0000","last_unstale":"2024-09-13T06:13:42.137324+0000","last_undegraded":"2024-09-13T06:13:42.137324+0000","last_fullsized":"2024-09-13T06:13:42.137324+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:42.137148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:42.137148+0000","last_clean_scrub_stamp":"2024-09-13T06:13:42.137148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:12:22.095929+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"35'30","reported_seq":83,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:37.757579+0000","last_change":"2024-09-13T06:13:37.757650+0000","last_active":"2024-09-13T06:13:37.757579+0000","last_peered":"2024-09-13T06:13:37.757579+0000","last_clean":"2024-09-13T06:13:37.757579+0000","last_became_active":"2024-09-13T06:09:38.171538+0000","last_became_peered":"2024-09-13T06:09:38.171538+0000","last_unstale":"2024-09-13T06:13:37.757579+0000","last_undegraded":"2024-09-13T06:13:37.757579+0000","last_fullsized":"2024-09-13T06:13:37.757579+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'30","last_scrub_stamp":"2024-09-13T06:13:37.757382+0000","last_deep_scrub":"35'30","last_deep_scrub_stamp":"2024-09-13T06:13:37.757382+0000","last_clean_scrub_stamp":"2024-09-13T06:13:37.757382+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:21:11.687429+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:48.835977+0000","last_change":"2024-09-13T06:13:48.836037+0000","last_active":"2024-09-13T06:13:48.835977+0000","last_peered":"2024-09-13T06:13:48.835977+0000","last_clean":"2024-09-13T06:13:48.835977+0000","last_became_active":"2024-09-13T06:09:40.185277+0000","last_became_peered":"2024-09-13T06:09:40.185277+0000","last_unstale":"2024-09-13T06:13:48.835977+0000","last_undegraded":"2024-09-13T06:13:48.835977+0000","last_fullsized":"2024-09-13T06:13:48.835977+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:48.835791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:48.835791+0000","last_clean_scrub_stamp":"2024-09-13T06:13:48.835791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:03:05.810181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"35'6","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.135982+0000","last_change":"2024-09-13T06:09:42.211802+0000","last_active":"2024-09-13T06:12:49.135982+0000","last_peered":"2024-09-13T06:12:49.135982+0000","last_clean":"2024-09-13T06:12:49.135982+0000","last_became_active":"2024-09-13T06:09:42.211176+0000","last_became_peered":"2024-09-13T06:09:42.211176+0000","last_unstale":"2024-09-13T06:12:49.135982+0000","last_undegraded":"2024-09-13T06:12:49.135982+0000","last_fullsized":"2024-09-13T06:12:49.135982+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"35'7","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.662961+0000","last_change":"2024-09-13T06:09:34.105846+0000","last_active":"2024-09-13T06:12:49.662961+0000","last_peered":"2024-09-13T06:12:49.662961+0000","last_clean":"2024-09-13T06:12:49.662961+0000","last_became_active":"2024-09-13T06:09:34.105494+0000","last_became_peered":"2024-09-13T06:09:34.105494+0000","last_unstale":"2024-09-13T06:12:49.662961+0000","last_undegraded":"2024-09-13T06:12:49.662961+0000","last_fullsized":"2024-09-13T06:12:49.662961+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"35'2","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:02.083459+0000","last_change":"2024-09-13T06:14:02.083524+0000","last_active":"2024-09-13T06:14:02.083459+0000","last_peered":"2024-09-13T06:14:02.083459+0000","last_clean":"2024-09-13T06:14:02.083459+0000","last_became_active":"2024-09-13T06:09:32.142726+0000","last_became_peered":"2024-09-13T06:09:32.142726+0000","last_unstale":"2024-09-13T06:14:02.083459+0000","last_undegraded":"2024-09-13T06:14:02.083459+0000","last_fullsized":"2024-09-13T06:14:02.083459+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:02.083238+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:02.083238+0000","last_clean_scrub_stamp":"2024-09-13T06:14:02.083238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:00:06.559987+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"35'3","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:39.117575+0000","last_change":"2024-09-13T06:13:39.117641+0000","last_active":"2024-09-13T06:13:39.117575+0000","last_peered":"2024-09-13T06:13:39.117575+0000","last_clean":"2024-09-13T06:13:39.117575+0000","last_became_active":"2024-09-13T06:09:36.136792+0000","last_became_peered":"2024-09-13T06:09:36.136792+0000","last_unstale":"2024-09-13T06:13:39.117575+0000","last_undegraded":"2024-09-13T06:13:39.117575+0000","last_fullsized":"2024-09-13T06:13:39.117575+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3","last_scrub_stamp":"2024-09-13T06:13:39.117394+0000","last_deep_scrub":"35'3","last_deep_scrub_stamp":"2024-09-13T06:13:39.117394+0000","last_clean_scrub_stamp":"2024-09-13T06:13:39.117394+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:34:55.196548+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"35'39","reported_seq":96,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:29.877488+0000","last_change":"2024-09-13T06:13:29.877565+0000","last_active":"2024-09-13T06:13:29.877488+0000","last_peered":"2024-09-13T06:13:29.877488+0000","last_clean":"2024-09-13T06:13:29.877488+0000","last_became_active":"2024-09-13T06:09:38.166333+0000","last_became_peered":"2024-09-13T06:09:38.166333+0000","last_unstale":"2024-09-13T06:13:29.877488+0000","last_undegraded":"2024-09-13T06:13:29.877488+0000","last_fullsized":"2024-09-13T06:13:29.877488+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'39","last_scrub_stamp":"2024-09-13T06:13:29.877300+0000","last_deep_scrub":"35'39","last_deep_scrub_stamp":"2024-09-13T06:13:29.877300+0000","last_clean_scrub_stamp":"2024-09-13T06:13:29.877300+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:40:12.627053+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:36.323225+0000","last_change":"2024-09-13T06:13:36.323280+0000","last_active":"2024-09-13T06:13:36.323225+0000","last_peered":"2024-09-13T06:13:36.323225+0000","last_clean":"2024-09-13T06:13:36.323225+0000","last_became_active":"2024-09-13T06:09:40.178392+0000","last_became_peered":"2024-09-13T06:09:40.178392+0000","last_unstale":"2024-09-13T06:13:36.323225+0000","last_undegraded":"2024-09-13T06:13:36.323225+0000","last_fullsized":"2024-09-13T06:13:36.323225+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:36.323029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:36.323029+0000","last_clean_scrub_stamp":"2024-09-13T06:13:36.323029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:56:23.983741+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"35'8","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:48.971074+0000","last_change":"2024-09-13T06:09:42.214258+0000","last_active":"2024-09-13T06:12:48.971074+0000","last_peered":"2024-09-13T06:12:48.971074+0000","last_clean":"2024-09-13T06:12:48.971074+0000","last_became_active":"2024-09-13T06:09:42.213809+0000","last_became_peered":"2024-09-13T06:09:42.213809+0000","last_unstale":"2024-09-13T06:12:48.971074+0000","last_undegraded":"2024-09-13T06:12:48.971074+0000","last_fullsized":"2024-09-13T06:12:48.971074+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"35'6","reported_seq":83,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:47.104386+0000","last_change":"2024-09-13T06:13:47.104386+0000","last_active":"2024-09-13T06:13:47.104386+0000","last_peered":"2024-09-13T06:13:47.104386+0000","last_clean":"2024-09-13T06:13:47.104386+0000","last_became_active":"2024-09-13T06:09:34.124044+0000","last_became_peered":"2024-09-13T06:09:34.124044+0000","last_unstale":"2024-09-13T06:13:47.104386+0000","last_undegraded":"2024-09-13T06:13:47.104386+0000","last_fullsized":"2024-09-13T06:13:47.104386+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:13:47.104098+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:13:47.104098+0000","last_clean_scrub_stamp":"2024-09-13T06:13:47.104098+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:28:40.579321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:24.972065+0000","last_change":"2024-09-13T06:09:32.134687+0000","last_active":"2024-09-13T06:13:24.972065+0000","last_peered":"2024-09-13T06:13:24.972065+0000","last_clean":"2024-09-13T06:13:24.972065+0000","last_became_active":"2024-09-13T06:09:32.133972+0000","last_became_peered":"2024-09-13T06:09:32.133972+0000","last_unstale":"2024-09-13T06:13:24.972065+0000","last_undegraded":"2024-09-13T06:13:24.972065+0000","last_fullsized":"2024-09-13T06:13:24.972065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"35'12","reported_seq":71,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:54.184427+0000","last_change":"2024-09-13T06:13:54.184427+0000","last_active":"2024-09-13T06:13:54.184427+0000","last_peered":"2024-09-13T06:13:54.184427+0000","last_clean":"2024-09-13T06:13:54.184427+0000","last_became_active":"2024-09-13T06:09:34.112805+0000","last_became_peered":"2024-09-13T06:09:34.112805+0000","last_unstale":"2024-09-13T06:13:54.184427+0000","last_undegraded":"2024-09-13T06:13:54.184427+0000","last_fullsized":"2024-09-13T06:13:54.184427+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'12","last_scrub_stamp":"2024-09-13T06:13:54.184142+0000","last_deep_scrub":"35'12","last_deep_scrub_stamp":"2024-09-13T06:13:54.184142+0000","last_clean_scrub_stamp":"2024-09-13T06:13:54.184142+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:51:20.968060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"35'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:24.055302+0000","last_change":"2024-09-13T06:09:32.150318+0000","last_active":"2024-09-13T06:13:24.055302+0000","last_peered":"2024-09-13T06:13:24.055302+0000","last_clean":"2024-09-13T06:13:24.055302+0000","last_became_active":"2024-09-13T06:09:32.145941+0000","last_became_peered":"2024-09-13T06:09:32.145941+0000","last_unstale":"2024-09-13T06:13:24.055302+0000","last_undegraded":"2024-09-13T06:13:24.055302+0000","last_fullsized":"2024-09-13T06:13:24.055302+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"35'10","reported_seq":74,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.441640+0000","last_change":"2024-09-13T06:09:34.118956+0000","last_active":"2024-09-13T06:13:25.441640+0000","last_peered":"2024-09-13T06:13:25.441640+0000","last_clean":"2024-09-13T06:13:25.441640+0000","last_became_active":"2024-09-13T06:09:34.118325+0000","last_became_peered":"2024-09-13T06:09:34.118325+0000","last_unstale":"2024-09-13T06:13:25.441640+0000","last_undegraded":"2024-09-13T06:13:25.441640+0000","last_fullsized":"2024-09-13T06:13:25.441640+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"35'2","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.440626+0000","last_change":"2024-09-13T06:09:32.144168+0000","last_active":"2024-09-13T06:13:25.440626+0000","last_peered":"2024-09-13T06:13:25.440626+0000","last_clean":"2024-09-13T06:13:25.440626+0000","last_became_active":"2024-09-13T06:09:32.133230+0000","last_became_peered":"2024-09-13T06:09:32.133230+0000","last_unstale":"2024-09-13T06:13:25.440626+0000","last_undegraded":"2024-09-13T06:13:25.440626+0000","last_fullsized":"2024-09-13T06:13:25.440626+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"35'4","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:24.055838+0000","last_change":"2024-09-13T06:09:34.117053+0000","last_active":"2024-09-13T06:13:24.055838+0000","last_peered":"2024-09-13T06:13:24.055838+0000","last_clean":"2024-09-13T06:13:24.055838+0000","last_became_active":"2024-09-13T06:09:34.115512+0000","last_became_peered":"2024-09-13T06:09:34.115512+0000","last_unstale":"2024-09-13T06:13:24.055838+0000","last_undegraded":"2024-09-13T06:13:24.055838+0000","last_fullsized":"2024-09-13T06:13:24.055838+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"35'2","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:55.188916+0000","last_change":"2024-09-13T06:13:55.188996+0000","last_active":"2024-09-13T06:13:55.188916+0000","last_peered":"2024-09-13T06:13:55.188916+0000","last_clean":"2024-09-13T06:13:55.188916+0000","last_became_active":"2024-09-13T06:09:32.150328+0000","last_became_peered":"2024-09-13T06:09:32.150328+0000","last_unstale":"2024-09-13T06:13:55.188916+0000","last_undegraded":"2024-09-13T06:13:55.188916+0000","last_fullsized":"2024-09-13T06:13:55.188916+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:13:55.188727+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:13:55.188727+0000","last_clean_scrub_stamp":"2024-09-13T06:13:55.188727+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:42:47.449646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"35'12","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:58.146481+0000","last_change":"2024-09-13T06:13:58.146634+0000","last_active":"2024-09-13T06:13:58.146481+0000","last_peered":"2024-09-13T06:13:58.146481+0000","last_clean":"2024-09-13T06:13:58.146481+0000","last_became_active":"2024-09-13T06:09:34.113986+0000","last_became_peered":"2024-09-13T06:09:34.113986+0000","last_unstale":"2024-09-13T06:13:58.146481+0000","last_undegraded":"2024-09-13T06:13:58.146481+0000","last_fullsized":"2024-09-13T06:13:58.146481+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'12","last_scrub_stamp":"2024-09-13T06:13:58.146265+0000","last_deep_scrub":"35'12","last_deep_scrub_stamp":"2024-09-13T06:13:58.146265+0000","last_clean_scrub_stamp":"2024-09-13T06:13:58.146265+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:51:22.340040+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:24.055684+0000","last_change":"2024-09-13T06:09:32.137258+0000","last_active":"2024-09-13T06:13:24.055684+0000","last_peered":"2024-09-13T06:13:24.055684+0000","last_clean":"2024-09-13T06:13:24.055684+0000","last_became_active":"2024-09-13T06:09:32.136268+0000","last_became_peered":"2024-09-13T06:09:32.136268+0000","last_unstale":"2024-09-13T06:13:24.055684+0000","last_undegraded":"2024-09-13T06:13:24.055684+0000","last_fullsized":"2024-09-13T06:13:24.055684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"35'4","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:24.520187+0000","last_change":"2024-09-13T06:09:34.124112+0000","last_active":"2024-09-13T06:13:24.520187+0000","last_peered":"2024-09-13T06:13:24.520187+0000","last_clean":"2024-09-13T06:13:24.520187+0000","last_became_active":"2024-09-13T06:09:34.121261+0000","last_became_peered":"2024-09-13T06:09:34.121261+0000","last_unstale":"2024-09-13T06:13:24.520187+0000","last_undegraded":"2024-09-13T06:13:24.520187+0000","last_fullsized":"2024-09-13T06:13:24.520187+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:24.519440+0000","last_change":"2024-09-13T06:09:32.142747+0000","last_active":"2024-09-13T06:13:24.519440+0000","last_peered":"2024-09-13T06:13:24.519440+0000","last_clean":"2024-09-13T06:13:24.519440+0000","last_became_active":"2024-09-13T06:09:32.141602+0000","last_became_peered":"2024-09-13T06:09:32.141602+0000","last_unstale":"2024-09-13T06:13:24.519440+0000","last_undegraded":"2024-09-13T06:13:24.519440+0000","last_fullsized":"2024-09-13T06:13:24.519440+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"35'6","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:24.055627+0000","last_change":"2024-09-13T06:09:34.123392+0000","last_active":"2024-09-13T06:13:24.055627+0000","last_peered":"2024-09-13T06:13:24.055627+0000","last_clean":"2024-09-13T06:13:24.055627+0000","last_became_active":"2024-09-13T06:09:34.122424+0000","last_became_peered":"2024-09-13T06:09:34.122424+0000","last_unstale":"2024-09-13T06:13:24.055627+0000","last_undegraded":"2024-09-13T06:13:24.055627+0000","last_fullsized":"2024-09-13T06:13:24.055627+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:24.972097+0000","last_change":"2024-09-13T06:09:32.120069+0000","last_active":"2024-09-13T06:13:24.972097+0000","last_peered":"2024-09-13T06:13:24.972097+0000","last_clean":"2024-09-13T06:13:24.972097+0000","last_became_active":"2024-09-13T06:09:32.119665+0000","last_became_peered":"2024-09-13T06:09:32.119665+0000","last_unstale":"2024-09-13T06:13:24.972097+0000","last_undegraded":"2024-09-13T06:13:24.972097+0000","last_fullsized":"2024-09-13T06:13:24.972097+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"35'9","reported_seq":59,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:24.520184+0000","last_change":"2024-09-13T06:09:34.121479+0000","last_active":"2024-09-13T06:13:24.520184+0000","last_peered":"2024-09-13T06:13:24.520184+0000","last_clean":"2024-09-13T06:13:24.520184+0000","last_became_active":"2024-09-13T06:09:34.114378+0000","last_became_peered":"2024-09-13T06:09:34.114378+0000","last_unstale":"2024-09-13T06:13:24.520184+0000","last_undegraded":"2024-09-13T06:13:24.520184+0000","last_fullsized":"2024-09-13T06:13:24.520184+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"35'4","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:24.055230+0000","last_change":"2024-09-13T06:09:32.147166+0000","last_active":"2024-09-13T06:13:24.055230+0000","last_peered":"2024-09-13T06:13:24.055230+0000","last_clean":"2024-09-13T06:13:24.055230+0000","last_became_active":"2024-09-13T06:09:32.146011+0000","last_became_peered":"2024-09-13T06:09:32.146011+0000","last_unstale":"2024-09-13T06:13:24.055230+0000","last_undegraded":"2024-09-13T06:13:24.055230+0000","last_fullsized":"2024-09-13T06:13:24.055230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"35'2","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:01.041085+0000","last_change":"2024-09-13T06:14:01.041151+0000","last_active":"2024-09-13T06:14:01.041085+0000","last_peered":"2024-09-13T06:14:01.041085+0000","last_clean":"2024-09-13T06:14:01.041085+0000","last_became_active":"2024-09-13T06:09:34.117659+0000","last_became_peered":"2024-09-13T06:09:34.117659+0000","last_unstale":"2024-09-13T06:14:01.041085+0000","last_undegraded":"2024-09-13T06:14:01.041085+0000","last_fullsized":"2024-09-13T06:14:01.041085+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:01.040862+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:01.040862+0000","last_clean_scrub_stamp":"2024-09-13T06:14:01.040862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:24:05.707493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"35'2","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.440687+0000","last_change":"2024-09-13T06:09:32.124201+0000","last_active":"2024-09-13T06:13:25.440687+0000","last_peered":"2024-09-13T06:13:25.440687+0000","last_clean":"2024-09-13T06:13:25.440687+0000","last_became_active":"2024-09-13T06:09:32.121250+0000","last_became_peered":"2024-09-13T06:09:32.121250+0000","last_unstale":"2024-09-13T06:13:25.440687+0000","last_undegraded":"2024-09-13T06:13:25.440687+0000","last_fullsized":"2024-09-13T06:13:25.440687+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"35'5","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.663844+0000","last_change":"2024-09-13T06:09:34.118552+0000","last_active":"2024-09-13T06:12:49.663844+0000","last_peered":"2024-09-13T06:12:49.663844+0000","last_clean":"2024-09-13T06:12:49.663844+0000","last_became_active":"2024-09-13T06:09:34.118270+0000","last_became_peered":"2024-09-13T06:09:34.118270+0000","last_unstale":"2024-09-13T06:12:49.663844+0000","last_undegraded":"2024-09-13T06:12:49.663844+0000","last_fullsized":"2024-09-13T06:12:49.663844+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"35'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:24.055369+0000","last_change":"2024-09-13T06:09:32.151004+0000","last_active":"2024-09-13T06:13:24.055369+0000","last_peered":"2024-09-13T06:13:24.055369+0000","last_clean":"2024-09-13T06:13:24.055369+0000","last_became_active":"2024-09-13T06:09:32.145988+0000","last_became_peered":"2024-09-13T06:09:32.145988+0000","last_unstale":"2024-09-13T06:13:24.055369+0000","last_undegraded":"2024-09-13T06:13:24.055369+0000","last_fullsized":"2024-09-13T06:13:24.055369+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"33'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:24.055701+0000","last_change":"2024-09-13T06:09:34.118753+0000","last_active":"2024-09-13T06:13:24.055701+0000","last_peered":"2024-09-13T06:13:24.055701+0000","last_clean":"2024-09-13T06:13:24.055701+0000","last_became_active":"2024-09-13T06:09:34.117320+0000","last_became_peered":"2024-09-13T06:09:34.117320+0000","last_unstale":"2024-09-13T06:13:24.055701+0000","last_undegraded":"2024-09-13T06:13:24.055701+0000","last_fullsized":"2024-09-13T06:13:24.055701+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"35'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:24.519604+0000","last_change":"2024-09-13T06:09:32.141516+0000","last_active":"2024-09-13T06:13:24.519604+0000","last_peered":"2024-09-13T06:13:24.519604+0000","last_clean":"2024-09-13T06:13:24.519604+0000","last_became_active":"2024-09-13T06:09:32.141009+0000","last_became_peered":"2024-09-13T06:09:32.141009+0000","last_unstale":"2024-09-13T06:13:24.519604+0000","last_undegraded":"2024-09-13T06:13:24.519604+0000","last_fullsized":"2024-09-13T06:13:24.519604+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"35'12","reported_seq":91,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:50.099581+0000","last_change":"2024-09-13T06:13:50.099644+0000","last_active":"2024-09-13T06:13:50.099581+0000","last_peered":"2024-09-13T06:13:50.099581+0000","last_clean":"2024-09-13T06:13:50.099581+0000","last_became_active":"2024-09-13T06:09:34.124270+0000","last_became_peered":"2024-09-13T06:09:34.124270+0000","last_unstale":"2024-09-13T06:13:50.099581+0000","last_undegraded":"2024-09-13T06:13:50.099581+0000","last_fullsized":"2024-09-13T06:13:50.099581+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'12","last_scrub_stamp":"2024-09-13T06:13:50.099391+0000","last_deep_scrub":"35'12","last_deep_scrub_stamp":"2024-09-13T06:13:50.099391+0000","last_clean_scrub_stamp":"2024-09-13T06:13:50.099391+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:45:17.171613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"35'2","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:24.519545+0000","last_change":"2024-09-13T06:09:32.143000+0000","last_active":"2024-09-13T06:13:24.519545+0000","last_peered":"2024-09-13T06:13:24.519545+0000","last_clean":"2024-09-13T06:13:24.519545+0000","last_became_active":"2024-09-13T06:09:32.142581+0000","last_became_peered":"2024-09-13T06:09:32.142581+0000","last_unstale":"2024-09-13T06:13:24.519545+0000","last_undegraded":"2024-09-13T06:13:24.519545+0000","last_fullsized":"2024-09-13T06:13:24.519545+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"35'16","reported_seq":85,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:57.087087+0000","last_change":"2024-09-13T06:13:57.087154+0000","last_active":"2024-09-13T06:13:57.087087+0000","last_peered":"2024-09-13T06:13:57.087087+0000","last_clean":"2024-09-13T06:13:57.087087+0000","last_became_active":"2024-09-13T06:09:34.118290+0000","last_became_peered":"2024-09-13T06:09:34.118290+0000","last_unstale":"2024-09-13T06:13:57.087087+0000","last_undegraded":"2024-09-13T06:13:57.087087+0000","last_fullsized":"2024-09-13T06:13:57.087087+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'16","last_scrub_stamp":"2024-09-13T06:13:57.086869+0000","last_deep_scrub":"35'16","last_deep_scrub_stamp":"2024-09-13T06:13:57.086869+0000","last_clean_scrub_stamp":"2024-09-13T06:13:57.086869+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:49:34.359420+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":58,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.440753+0000","last_change":"2024-09-13T06:09:32.124596+0000","last_active":"2024-09-13T06:13:25.440753+0000","last_peered":"2024-09-13T06:13:25.440753+0000","last_clean":"2024-09-13T06:13:25.440753+0000","last_became_active":"2024-09-13T06:09:32.121400+0000","last_became_peered":"2024-09-13T06:09:32.121400+0000","last_unstale":"2024-09-13T06:13:25.440753+0000","last_undegraded":"2024-09-13T06:13:25.440753+0000","last_fullsized":"2024-09-13T06:13:25.440753+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"35'14","reported_seq":82,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:51.115013+0000","last_change":"2024-09-13T06:13:51.115078+0000","last_active":"2024-09-13T06:13:51.115013+0000","last_peered":"2024-09-13T06:13:51.115013+0000","last_clean":"2024-09-13T06:13:51.115013+0000","last_became_active":"2024-09-13T06:09:34.121743+0000","last_became_peered":"2024-09-13T06:09:34.121743+0000","last_unstale":"2024-09-13T06:13:51.115013+0000","last_undegraded":"2024-09-13T06:13:51.115013+0000","last_fullsized":"2024-09-13T06:13:51.115013+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'14","last_scrub_stamp":"2024-09-13T06:13:51.114821+0000","last_deep_scrub":"35'14","last_deep_scrub_stamp":"2024-09-13T06:13:51.114821+0000","last_clean_scrub_stamp":"2024-09-13T06:13:51.114821+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:13:09.983207+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"35'2","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.440935+0000","last_change":"2024-09-13T06:09:32.135724+0000","last_active":"2024-09-13T06:13:25.440935+0000","last_peered":"2024-09-13T06:13:25.440935+0000","last_clean":"2024-09-13T06:13:25.440935+0000","last_became_active":"2024-09-13T06:09:32.127830+0000","last_became_peered":"2024-09-13T06:09:32.127830+0000","last_unstale":"2024-09-13T06:13:25.440935+0000","last_undegraded":"2024-09-13T06:13:25.440935+0000","last_fullsized":"2024-09-13T06:13:25.440935+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"35'4","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:57.955972+0000","last_change":"2024-09-13T06:13:57.956132+0000","last_active":"2024-09-13T06:13:57.955972+0000","last_peered":"2024-09-13T06:13:57.955972+0000","last_clean":"2024-09-13T06:13:57.955972+0000","last_became_active":"2024-09-13T06:09:34.126020+0000","last_became_peered":"2024-09-13T06:09:34.126020+0000","last_unstale":"2024-09-13T06:13:57.955972+0000","last_undegraded":"2024-09-13T06:13:57.955972+0000","last_fullsized":"2024-09-13T06:13:57.955972+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:13:57.955748+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:13:57.955748+0000","last_clean_scrub_stamp":"2024-09-13T06:13:57.955748+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:48:29.811216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:20.954155+0000","last_change":"2024-09-13T06:09:32.119928+0000","last_active":"2024-09-13T06:13:20.954155+0000","last_peered":"2024-09-13T06:13:20.954155+0000","last_clean":"2024-09-13T06:13:20.954155+0000","last_became_active":"2024-09-13T06:09:32.119542+0000","last_became_peered":"2024-09-13T06:09:32.119542+0000","last_unstale":"2024-09-13T06:13:20.954155+0000","last_undegraded":"2024-09-13T06:13:20.954155+0000","last_fullsized":"2024-09-13T06:13:20.954155+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"35'6","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:59.089157+0000","last_change":"2024-09-13T06:13:59.089218+0000","last_active":"2024-09-13T06:13:59.089157+0000","last_peered":"2024-09-13T06:13:59.089157+0000","last_clean":"2024-09-13T06:13:59.089157+0000","last_became_active":"2024-09-13T06:09:34.110506+0000","last_became_peered":"2024-09-13T06:09:34.110506+0000","last_unstale":"2024-09-13T06:13:59.089157+0000","last_undegraded":"2024-09-13T06:13:59.089157+0000","last_fullsized":"2024-09-13T06:13:59.089157+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:13:59.088967+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:13:59.088967+0000","last_clean_scrub_stamp":"2024-09-13T06:13:59.088967+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:47:06.868835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:52.809573+0000","last_change":"2024-09-13T06:09:32.130216+0000","last_active":"2024-09-13T06:11:52.809573+0000","last_peered":"2024-09-13T06:11:52.809573+0000","last_clean":"2024-09-13T06:11:52.809573+0000","last_became_active":"2024-09-13T06:09:32.121895+0000","last_became_peered":"2024-09-13T06:09:32.121895+0000","last_unstale":"2024-09-13T06:11:52.809573+0000","last_undegraded":"2024-09-13T06:11:52.809573+0000","last_fullsized":"2024-09-13T06:11:52.809573+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:11:52.809048+0000","last_change":"2024-09-13T06:09:32.132716+0000","last_active":"2024-09-13T06:11:52.809048+0000","last_peered":"2024-09-13T06:11:52.809048+0000","last_clean":"2024-09-13T06:11:52.809048+0000","last_became_active":"2024-09-13T06:09:32.130056+0000","last_became_peered":"2024-09-13T06:09:32.130056+0000","last_unstale":"2024-09-13T06:11:52.809048+0000","last_undegraded":"2024-09-13T06:11:52.809048+0000","last_fullsized":"2024-09-13T06:11:52.809048+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"35'8","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:50.089447+0000","last_change":"2024-09-13T06:13:50.089510+0000","last_active":"2024-09-13T06:13:50.089447+0000","last_peered":"2024-09-13T06:13:50.089447+0000","last_clean":"2024-09-13T06:13:50.089447+0000","last_became_active":"2024-09-13T06:09:34.130980+0000","last_became_peered":"2024-09-13T06:09:34.130980+0000","last_unstale":"2024-09-13T06:13:50.089447+0000","last_undegraded":"2024-09-13T06:13:50.089447+0000","last_fullsized":"2024-09-13T06:13:50.089447+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-13T06:13:50.089259+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-13T06:13:50.089259+0000","last_clean_scrub_stamp":"2024-09-13T06:13:50.089259+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:04:38.003620+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"33'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:01.059344+0000","last_change":"2024-09-13T06:14:01.059413+0000","last_active":"2024-09-13T06:14:01.059344+0000","last_peered":"2024-09-13T06:14:01.059344+0000","last_clean":"2024-09-13T06:14:01.059344+0000","last_became_active":"2024-09-13T06:09:32.149426+0000","last_became_peered":"2024-09-13T06:09:32.149426+0000","last_unstale":"2024-09-13T06:14:01.059344+0000","last_undegraded":"2024-09-13T06:14:01.059344+0000","last_fullsized":"2024-09-13T06:14:01.059344+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T06:14:01.059140+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T06:14:01.059140+0000","last_clean_scrub_stamp":"2024-09-13T06:14:01.059140+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:11:35.487998+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"35'3","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.664611+0000","last_change":"2024-09-13T06:09:34.118994+0000","last_active":"2024-09-13T06:12:49.664611+0000","last_peered":"2024-09-13T06:12:49.664611+0000","last_clean":"2024-09-13T06:12:49.664611+0000","last_became_active":"2024-09-13T06:09:34.111230+0000","last_became_peered":"2024-09-13T06:09:34.111230+0000","last_unstale":"2024-09-13T06:12:49.664611+0000","last_undegraded":"2024-09-13T06:12:49.664611+0000","last_fullsized":"2024-09-13T06:12:49.664611+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:33.070909+0000","last_clean_scrub_stamp":"2024-09-13T06:09:33.070909+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":269,"ondisk_log_size":269,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2281,"ondisk_log_size":2281,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1530,"ondisk_log_size":1530,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1618,"num_read_kb":1508,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":479,"ondisk_log_size":479,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640318,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39984,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331856,"statfs":{"total":96636764160,"available":96595820544,"internally_reserved":0,"allocated":491520,"data_stored":155427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640318,"num_pgs":155,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40524,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331316,"statfs":{"total":96636764160,"available":96595267584,"internally_reserved":0,"allocated":1044480,"data_stored":743705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673022,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40500,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331340,"statfs":{"total":96636764160,"available":96595292160,"internally_reserved":0,"allocated":1019904,"data_stored":743361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705724,"num_pgs":170,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39952,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331888,"statfs":{"total":96636764160,"available":96595853312,"internally_reserved":0,"allocated":458752,"data_stored":154423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T06:14:06.637 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.637 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.637 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.637 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.638 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.638 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.638 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.638 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.638 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.638 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.638 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.638 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.638 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.639 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.639 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.639 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.639 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.639 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.639 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.639 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.639 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.640 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.640 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.640 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-13T06:09:35.087004+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=35, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.640 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.640 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.640 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.640 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.641 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.641 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.641 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-13T06:09:35.087004+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=35, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.641 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.641 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.641 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.641 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.642 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.642 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.642 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.642 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.642 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.642 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-13T06:09:18.163598+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.642 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-13T06:09:21.188659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.642 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.643 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.643 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-13T06:09:21.188659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.643 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.643 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-13T06:09:21.188659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.643 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.643 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-13T06:09:21.188659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.643 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-13T06:09:35.087004+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=35, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.644 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.644 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-13T06:09:21.188659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.644 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.644 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-13T06:09:21.188659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.644 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.644 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.644 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.644 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-13T06:09:21.188659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.645 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.645 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.645 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-13T06:09:21.188659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.645 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.645 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.645 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.645 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.645 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.646 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.646 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.646 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.646 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.646 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.646 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.647 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.647 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.647 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.647 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.647 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.647 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.647 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.647 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.648 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.648 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.648 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.648 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.648 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.648 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.648 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.649 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.649 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.649 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.649 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.649 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.649 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.649 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.649 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.649 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.650 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.650 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.650 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.650 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.650 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.650 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.650 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.650 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.651 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.651 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.651 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.651 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.651 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.651 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.651 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-13T06:09:33.070909+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:06.651 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T06:14:26.652 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T06:14:26.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:26.779+0000 7fa41f4d9640 1 Processor -- start 2024-09-13T06:14:26.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:26.779+0000 7fa41f4d9640 1 -- start start 2024-09-13T06:14:26.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:26.783+0000 7fa41f4d9640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fa41806dbd0 0x7fa418131e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:14:26.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:26.783+0000 7fa41f4d9640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa418071c10 con 0x7fa41806d0e0 2024-09-13T06:14:26.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:26.783+0000 7fa41f4d9640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fa418072230 con 0x7fa41806dbd0 2024-09-13T06:14:26.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:26.783+0000 7fa41ca74640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fa41806dbd0 0x7fa418131e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:14:26.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:26.783+0000 7fa41d275640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fa41806d0e0 0x7fa41806d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:37530/0 (socket says 172.21.15.120:37530) 2024-09-13T06:14:26.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:26.783+0000 7fa41d275640 1 -- 172.21.15.120:0/3454722013 learned_addr learned my addr 172.21.15.120:0/3454722013 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-13T06:14:26.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:26.783+0000 7fa40ffff640 1 -- 172.21.15.120:0/3454722013 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1390287380 0 0) 0x7fa418071c10 con 0x7fa41806d0e0 2024-09-13T06:14:26.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:26.783+0000 7fa40ffff640 1 -- 172.21.15.120:0/3454722013 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa404003530 con 0x7fa41806d0e0 2024-09-13T06:14:26.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:26.783+0000 7fa41ca74640 1 -- 172.21.15.120:0/3454722013 >> v1:172.21.15.120:6789/0 conn(0x7fa41806d0e0 legacy=0x7fa41806d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:14:26.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:26.783+0000 7fa41ca74640 1 -- 172.21.15.120:0/3454722013 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4180709e0 con 0x7fa41806dbd0 2024-09-13T06:14:26.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:26.783+0000 7fa41ca74640 1 --2- 172.21.15.120:0/3454722013 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa41806dbd0 0x7fa418131e60 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fa414009740 tx=0x7fa41401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf8f55865835f1c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:14:26.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:26.783+0000 7fa40ffff640 1 -- 172.21.15.120:0/3454722013 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4140b0070 con 0x7fa41806dbd0 2024-09-13T06:14:26.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:26.783+0000 7fa40ffff640 1 -- 172.21.15.120:0/3454722013 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4140ab530 con 0x7fa41806dbd0 2024-09-13T06:14:26.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:26.783+0000 7fa40ffff640 1 -- 172.21.15.120:0/3454722013 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4140ab830 con 0x7fa41806dbd0 2024-09-13T06:14:26.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:26.783+0000 7fa41f4d9640 1 -- 172.21.15.120:0/3454722013 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa41806dbd0 msgr2=0x7fa418131e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:14:26.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:26.783+0000 7fa41f4d9640 1 --2- 172.21.15.120:0/3454722013 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa41806dbd0 0x7fa418131e60 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fa414009740 tx=0x7fa41401c370 comp rx=0 tx=0).stop 2024-09-13T06:14:26.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:26.783+0000 7fa41f4d9640 1 -- 172.21.15.120:0/3454722013 shutdown_connections 2024-09-13T06:14:26.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:26.783+0000 7fa41f4d9640 1 --2- 172.21.15.120:0/3454722013 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa41806dbd0 0x7fa418131e60 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:14:26.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:26.783+0000 7fa41f4d9640 1 -- 172.21.15.120:0/3454722013 >> 172.21.15.120:0/3454722013 conn(0x7fa418099a50 msgr2=0x7fa4180972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:14:26.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:26.783+0000 7fa41f4d9640 1 -- 172.21.15.120:0/3454722013 shutdown_connections 2024-09-13T06:14:26.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:26.783+0000 7fa41f4d9640 1 -- 172.21.15.120:0/3454722013 wait complete. 2024-09-13T06:14:26.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:26.787+0000 7fa41f4d9640 1 Processor -- start 2024-09-13T06:14:26.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:26.787+0000 7fa41f4d9640 1 -- start start 2024-09-13T06:14:26.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:26.787+0000 7fa41f4d9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa41806d0e0 0x7fa418092090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:14:26.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:26.787+0000 7fa41f4d9640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fa418134d40 con 0x7fa41806d0e0 2024-09-13T06:14:26.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:26.787+0000 7fa41d275640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa41806d0e0 0x7fa418092090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:14:26.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:26.787+0000 7fa41d275640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa41806d0e0 0x7fa418092090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47262/0 (socket says 172.21.15.120:47262) 2024-09-13T06:14:26.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:26.787+0000 7fa41d275640 1 -- 172.21.15.120:0/346076698 learned_addr learned my addr 172.21.15.120:0/346076698 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-13T06:14:26.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:26.787+0000 7fa41d275640 1 -- 172.21.15.120:0/346076698 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa418094290 con 0x7fa41806d0e0 2024-09-13T06:14:26.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:26.787+0000 7fa41d275640 1 --2- 172.21.15.120:0/346076698 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa41806d0e0 0x7fa418092090 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fa40800c450 tx=0x7fa40800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:14:26.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:26.787+0000 7fa40dffb640 1 -- 172.21.15.120:0/346076698 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa408017070 con 0x7fa41806d0e0 2024-09-13T06:14:26.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:26.787+0000 7fa40dffb640 1 -- 172.21.15.120:0/346076698 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa408005c20 con 0x7fa41806d0e0 2024-09-13T06:14:26.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:26.787+0000 7fa41f4d9640 1 -- 172.21.15.120:0/346076698 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa418095250 con 0x7fa41806d0e0 2024-09-13T06:14:26.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:26.787+0000 7fa40dffb640 1 -- 172.21.15.120:0/346076698 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa408007070 con 0x7fa41806d0e0 2024-09-13T06:14:26.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:26.787+0000 7fa41f4d9640 1 -- 172.21.15.120:0/346076698 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa418095690 con 0x7fa41806d0e0 2024-09-13T06:14:26.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:26.787+0000 7fa41f4d9640 1 -- 172.21.15.120:0/346076698 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa41806d4c0 con 0x7fa41806d0e0 2024-09-13T06:14:26.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:26.787+0000 7fa40dffb640 1 -- 172.21.15.120:0/346076698 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa40801a070 con 0x7fa41806d0e0 2024-09-13T06:14:26.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:26.787+0000 7fa40dffb640 1 --2- 172.21.15.120:0/346076698 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa3fc035db0 0x7fa3fc038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:14:26.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:26.787+0000 7fa40dffb640 1 -- 172.21.15.120:0/346076698 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fa408048430 con 0x7fa41806d0e0 2024-09-13T06:14:26.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:26.787+0000 7fa41ca74640 1 --2- 172.21.15.120:0/346076698 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa3fc035db0 0x7fa3fc038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:14:26.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:26.791+0000 7fa41ca74640 1 --2- 172.21.15.120:0/346076698 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa3fc035db0 0x7fa3fc038270 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa4140ad000 tx=0x7fa4140a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:14:26.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:26.791+0000 7fa40dffb640 1 -- 172.21.15.120:0/346076698 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa408012400 con 0x7fa41806d0e0 2024-09-13T06:14:26.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:26.951+0000 7fa41f4d9640 1 -- 172.21.15.120:0/346076698 --> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa418073790 con 0x7fa3fc035db0 2024-09-13T06:14:26.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:26.995+0000 7fa40dffb640 1 -- 172.21.15.120:0/346076698 <== mgr.4100 v2:172.21.15.194:6824/3475680902 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665272 (secure 0 0 0) 0x7fa418073790 con 0x7fa3fc035db0 2024-09-13T06:14:27.004 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T06:14:27.010 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-09-13T06:14:27.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:27.003+0000 7fa41f4d9640 1 -- 172.21.15.120:0/346076698 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa3fc035db0 msgr2=0x7fa3fc038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:14:27.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:27.003+0000 7fa41f4d9640 1 --2- 172.21.15.120:0/346076698 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa3fc035db0 0x7fa3fc038270 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa4140ad000 tx=0x7fa4140a6000 comp rx=0 tx=0).stop 2024-09-13T06:14:27.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:27.003+0000 7fa41f4d9640 1 -- 172.21.15.120:0/346076698 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa41806d0e0 msgr2=0x7fa418092090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:14:27.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:27.003+0000 7fa41f4d9640 1 --2- 172.21.15.120:0/346076698 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa41806d0e0 0x7fa418092090 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fa40800c450 tx=0x7fa40800c910 comp rx=0 tx=0).stop 2024-09-13T06:14:27.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:27.003+0000 7fa41f4d9640 1 -- 172.21.15.120:0/346076698 shutdown_connections 2024-09-13T06:14:27.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:27.003+0000 7fa41f4d9640 1 --2- 172.21.15.120:0/346076698 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fa3fc035db0 0x7fa3fc038270 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:14:27.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:27.003+0000 7fa41f4d9640 1 --2- 172.21.15.120:0/346076698 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa41806d0e0 0x7fa418092090 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:14:27.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:27.003+0000 7fa41f4d9640 1 -- 172.21.15.120:0/346076698 >> 172.21.15.120:0/346076698 conn(0x7fa418099a50 msgr2=0x7fa41808afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:14:27.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:27.003+0000 7fa41f4d9640 1 -- 172.21.15.120:0/346076698 shutdown_connections 2024-09-13T06:14:27.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:27.003+0000 7fa41f4d9640 1 -- 172.21.15.120:0/346076698 wait complete. 2024-09-13T06:14:27.022 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":187,"stamp":"2024-09-13T06:14:25.855177+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605402,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5108,"num_read_kb":4689,"num_write":2181,"num_write_kb":61376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2872,"num_omap_keys":15,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4793,"ondisk_log_size":4793,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":160960,"kb_used_data":2944,"kb_used_omap":6,"kb_used_meta":157945,"kb_avail":377326400,"statfs":{"total":386547056640,"available":386382233600,"internally_reserved":0,"allocated":3014656,"data_stored":1796916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":161736470},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006930"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:53.451160+0000","last_change":"2024-09-13T06:13:53.451223+0000","last_active":"2024-09-13T06:13:53.451160+0000","last_peered":"2024-09-13T06:13:53.451160+0000","last_clean":"2024-09-13T06:13:53.451160+0000","last_became_active":"2024-09-13T06:09:32.140025+0000","last_became_peered":"2024-09-13T06:09:32.140025+0000","last_unstale":"2024-09-13T06:13:53.451160+0000","last_undegraded":"2024-09-13T06:13:53.451160+0000","last_fullsized":"2024-09-13T06:13:53.451160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:53.450946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:53.450946+0000","last_clean_scrub_stamp":"2024-09-13T06:13:53.450946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:05:48.880319+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"35'22","reported_seq":103,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:48.092554+0000","last_change":"2024-09-13T06:13:48.092625+0000","last_active":"2024-09-13T06:13:48.092554+0000","last_peered":"2024-09-13T06:13:48.092554+0000","last_clean":"2024-09-13T06:13:48.092554+0000","last_became_active":"2024-09-13T06:09:34.122656+0000","last_became_peered":"2024-09-13T06:09:34.122656+0000","last_unstale":"2024-09-13T06:13:48.092554+0000","last_undegraded":"2024-09-13T06:13:48.092554+0000","last_fullsized":"2024-09-13T06:13:48.092554+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'22","last_scrub_stamp":"2024-09-13T06:13:48.092347+0000","last_deep_scrub":"35'22","last_deep_scrub_stamp":"2024-09-13T06:13:48.092347+0000","last_clean_scrub_stamp":"2024-09-13T06:13:48.092347+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:02:26.113000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":88,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:11.954244+0000","last_change":"2024-09-13T06:14:11.954310+0000","last_active":"2024-09-13T06:14:11.954244+0000","last_peered":"2024-09-13T06:14:11.954244+0000","last_clean":"2024-09-13T06:14:11.954244+0000","last_became_active":"2024-09-13T06:09:32.134020+0000","last_became_peered":"2024-09-13T06:09:32.134020+0000","last_unstale":"2024-09-13T06:14:11.954244+0000","last_undegraded":"2024-09-13T06:14:11.954244+0000","last_fullsized":"2024-09-13T06:14:11.954244+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:11.954043+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:11.954043+0000","last_clean_scrub_stamp":"2024-09-13T06:14:11.954043+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:29:30.352540+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"35'4","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:10.943942+0000","last_change":"2024-09-13T06:14:10.944002+0000","last_active":"2024-09-13T06:14:10.943942+0000","last_peered":"2024-09-13T06:14:10.943942+0000","last_clean":"2024-09-13T06:14:10.943942+0000","last_became_active":"2024-09-13T06:09:34.116715+0000","last_became_peered":"2024-09-13T06:09:34.116715+0000","last_unstale":"2024-09-13T06:14:10.943942+0000","last_undegraded":"2024-09-13T06:14:10.943942+0000","last_fullsized":"2024-09-13T06:14:10.943942+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:14:10.943755+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:14:10.943755+0000","last_clean_scrub_stamp":"2024-09-13T06:14:10.943755+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:12:11.377459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:20.881767+0000","last_change":"2024-09-13T06:14:20.881823+0000","last_active":"2024-09-13T06:14:20.881767+0000","last_peered":"2024-09-13T06:14:20.881767+0000","last_clean":"2024-09-13T06:14:20.881767+0000","last_became_active":"2024-09-13T06:09:32.116345+0000","last_became_peered":"2024-09-13T06:09:32.116345+0000","last_unstale":"2024-09-13T06:14:20.881767+0000","last_undegraded":"2024-09-13T06:14:20.881767+0000","last_fullsized":"2024-09-13T06:14:20.881767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:20.881557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:20.881557+0000","last_clean_scrub_stamp":"2024-09-13T06:14:20.881557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:27:51.720278+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:05.961031+0000","last_change":"2024-09-13T06:14:05.961088+0000","last_active":"2024-09-13T06:14:05.961031+0000","last_peered":"2024-09-13T06:14:05.961031+0000","last_clean":"2024-09-13T06:14:05.961031+0000","last_became_active":"2024-09-13T06:09:34.117940+0000","last_became_peered":"2024-09-13T06:09:34.117940+0000","last_unstale":"2024-09-13T06:14:05.961031+0000","last_undegraded":"2024-09-13T06:14:05.961031+0000","last_fullsized":"2024-09-13T06:14:05.961031+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:05.960824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:05.960824+0000","last_clean_scrub_stamp":"2024-09-13T06:14:05.960824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:39:07.314473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"35'4","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:12.529051+0000","last_change":"2024-09-13T06:14:12.529209+0000","last_active":"2024-09-13T06:14:12.529051+0000","last_peered":"2024-09-13T06:14:12.529051+0000","last_clean":"2024-09-13T06:14:12.529051+0000","last_became_active":"2024-09-13T06:09:32.119806+0000","last_became_peered":"2024-09-13T06:09:32.119806+0000","last_unstale":"2024-09-13T06:14:12.529051+0000","last_undegraded":"2024-09-13T06:14:12.529051+0000","last_fullsized":"2024-09-13T06:14:12.529051+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:14:12.528786+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:14:12.528786+0000","last_clean_scrub_stamp":"2024-09-13T06:14:12.528786+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:22:18.082137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"35'4","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:58.946151+0000","last_change":"2024-09-13T06:13:58.946209+0000","last_active":"2024-09-13T06:13:58.946151+0000","last_peered":"2024-09-13T06:13:58.946151+0000","last_clean":"2024-09-13T06:13:58.946151+0000","last_became_active":"2024-09-13T06:09:34.122631+0000","last_became_peered":"2024-09-13T06:09:34.122631+0000","last_unstale":"2024-09-13T06:13:58.946151+0000","last_undegraded":"2024-09-13T06:13:58.946151+0000","last_fullsized":"2024-09-13T06:13:58.946151+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:13:58.945955+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:13:58.945955+0000","last_clean_scrub_stamp":"2024-09-13T06:13:58.945955+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:33:44.383904+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:02.812029+0000","last_change":"2024-09-13T06:09:32.129860+0000","last_active":"2024-09-13T06:12:02.812029+0000","last_peered":"2024-09-13T06:12:02.812029+0000","last_clean":"2024-09-13T06:12:02.812029+0000","last_became_active":"2024-09-13T06:09:32.121803+0000","last_became_peered":"2024-09-13T06:09:32.121803+0000","last_unstale":"2024-09-13T06:12:02.812029+0000","last_undegraded":"2024-09-13T06:12:02.812029+0000","last_fullsized":"2024-09-13T06:12:02.812029+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"35'4","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:44.126938+0000","last_change":"2024-09-13T06:13:44.126999+0000","last_active":"2024-09-13T06:13:44.126938+0000","last_peered":"2024-09-13T06:13:44.126938+0000","last_clean":"2024-09-13T06:13:44.126938+0000","last_became_active":"2024-09-13T06:09:34.124728+0000","last_became_peered":"2024-09-13T06:09:34.124728+0000","last_unstale":"2024-09-13T06:13:44.126938+0000","last_undegraded":"2024-09-13T06:13:44.126938+0000","last_fullsized":"2024-09-13T06:13:44.126938+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:13:44.126745+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:13:44.126745+0000","last_clean_scrub_stamp":"2024-09-13T06:13:44.126745+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:34:05.312578+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:07.443540+0000","last_change":"2024-09-13T06:14:07.443616+0000","last_active":"2024-09-13T06:14:07.443540+0000","last_peered":"2024-09-13T06:14:07.443540+0000","last_clean":"2024-09-13T06:14:07.443540+0000","last_became_active":"2024-09-13T06:09:32.116422+0000","last_became_peered":"2024-09-13T06:09:32.116422+0000","last_unstale":"2024-09-13T06:14:07.443540+0000","last_undegraded":"2024-09-13T06:14:07.443540+0000","last_fullsized":"2024-09-13T06:14:07.443540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:07.443341+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:07.443341+0000","last_clean_scrub_stamp":"2024-09-13T06:14:07.443341+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:11:06.667675+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"35'4","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:20.637599+0000","last_change":"2024-09-13T06:14:20.637599+0000","last_active":"2024-09-13T06:14:20.637599+0000","last_peered":"2024-09-13T06:14:20.637599+0000","last_clean":"2024-09-13T06:14:20.637599+0000","last_became_active":"2024-09-13T06:10:10.810259+0000","last_became_peered":"2024-09-13T06:10:10.810259+0000","last_unstale":"2024-09-13T06:14:20.637599+0000","last_undegraded":"2024-09-13T06:14:20.637599+0000","last_fullsized":"2024-09-13T06:14:20.637599+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:14:20.637249+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:14:20.637249+0000","last_clean_scrub_stamp":"2024-09-13T06:14:20.637249+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:03:50.413388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"35'4","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:02.811881+0000","last_change":"2024-09-13T06:09:32.130200+0000","last_active":"2024-09-13T06:12:02.811881+0000","last_peered":"2024-09-13T06:12:02.811881+0000","last_clean":"2024-09-13T06:12:02.811881+0000","last_became_active":"2024-09-13T06:09:32.122126+0000","last_became_peered":"2024-09-13T06:09:32.122126+0000","last_unstale":"2024-09-13T06:12:02.811881+0000","last_undegraded":"2024-09-13T06:12:02.811881+0000","last_fullsized":"2024-09-13T06:12:02.811881+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"35'10","reported_seq":69,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:49.549277+0000","last_change":"2024-09-13T06:13:49.549338+0000","last_active":"2024-09-13T06:13:49.549277+0000","last_peered":"2024-09-13T06:13:49.549277+0000","last_clean":"2024-09-13T06:13:49.549277+0000","last_became_active":"2024-09-13T06:09:34.120349+0000","last_became_peered":"2024-09-13T06:09:34.120349+0000","last_unstale":"2024-09-13T06:13:49.549277+0000","last_undegraded":"2024-09-13T06:13:49.549277+0000","last_fullsized":"2024-09-13T06:13:49.549277+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-09-13T06:13:49.549086+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-09-13T06:13:49.549086+0000","last_clean_scrub_stamp":"2024-09-13T06:13:49.549086+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:30:16.740460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:17.036802+0000","last_change":"2024-09-13T06:14:17.036924+0000","last_active":"2024-09-13T06:14:17.036802+0000","last_peered":"2024-09-13T06:14:17.036802+0000","last_clean":"2024-09-13T06:14:17.036802+0000","last_became_active":"2024-09-13T06:09:32.147504+0000","last_became_peered":"2024-09-13T06:09:32.147504+0000","last_unstale":"2024-09-13T06:14:17.036802+0000","last_undegraded":"2024-09-13T06:14:17.036802+0000","last_fullsized":"2024-09-13T06:14:17.036802+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:17.036578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:17.036578+0000","last_clean_scrub_stamp":"2024-09-13T06:14:17.036578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:53:37.209513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"35'10","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:56.394555+0000","last_change":"2024-09-13T06:13:56.394630+0000","last_active":"2024-09-13T06:13:56.394555+0000","last_peered":"2024-09-13T06:13:56.394555+0000","last_clean":"2024-09-13T06:13:56.394555+0000","last_became_active":"2024-09-13T06:09:34.104043+0000","last_became_peered":"2024-09-13T06:09:34.104043+0000","last_unstale":"2024-09-13T06:13:56.394555+0000","last_undegraded":"2024-09-13T06:13:56.394555+0000","last_fullsized":"2024-09-13T06:13:56.394555+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-09-13T06:13:56.394368+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-09-13T06:13:56.394368+0000","last_clean_scrub_stamp":"2024-09-13T06:13:56.394368+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:12:03.883275+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"35'4","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:12.918343+0000","last_change":"2024-09-13T06:14:12.918343+0000","last_active":"2024-09-13T06:14:12.918343+0000","last_peered":"2024-09-13T06:14:12.918343+0000","last_clean":"2024-09-13T06:14:12.918343+0000","last_became_active":"2024-09-13T06:09:34.116359+0000","last_became_peered":"2024-09-13T06:09:34.116359+0000","last_unstale":"2024-09-13T06:14:12.918343+0000","last_undegraded":"2024-09-13T06:14:12.918343+0000","last_fullsized":"2024-09-13T06:14:12.918343+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:14:12.918090+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:14:12.918090+0000","last_clean_scrub_stamp":"2024-09-13T06:14:12.918090+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:33:11.288623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"35'2","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:17.109420+0000","last_change":"2024-09-13T06:14:17.109420+0000","last_active":"2024-09-13T06:14:17.109420+0000","last_peered":"2024-09-13T06:14:17.109420+0000","last_clean":"2024-09-13T06:14:17.109420+0000","last_became_active":"2024-09-13T06:09:32.134667+0000","last_became_peered":"2024-09-13T06:09:32.134667+0000","last_unstale":"2024-09-13T06:14:17.109420+0000","last_undegraded":"2024-09-13T06:14:17.109420+0000","last_fullsized":"2024-09-13T06:14:17.109420+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:17.108958+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:17.108958+0000","last_clean_scrub_stamp":"2024-09-13T06:14:17.108958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:24:40.185482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"35'18","reported_seq":70,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:55.152233+0000","last_change":"2024-09-13T06:13:55.152233+0000","last_active":"2024-09-13T06:13:55.152233+0000","last_peered":"2024-09-13T06:13:55.152233+0000","last_clean":"2024-09-13T06:13:55.152233+0000","last_became_active":"2024-09-13T06:09:34.115348+0000","last_became_peered":"2024-09-13T06:09:34.115348+0000","last_unstale":"2024-09-13T06:13:55.152233+0000","last_undegraded":"2024-09-13T06:13:55.152233+0000","last_fullsized":"2024-09-13T06:13:55.152233+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'18","last_scrub_stamp":"2024-09-13T06:13:55.151980+0000","last_deep_scrub":"35'18","last_deep_scrub_stamp":"2024-09-13T06:13:55.151980+0000","last_clean_scrub_stamp":"2024-09-13T06:13:55.151980+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:13:13.639419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":45,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:03.432130+0000","last_change":"2024-09-13T06:14:03.432130+0000","last_active":"2024-09-13T06:14:03.432130+0000","last_peered":"2024-09-13T06:14:03.432130+0000","last_clean":"2024-09-13T06:14:03.432130+0000","last_became_active":"2024-09-13T06:09:32.135460+0000","last_became_peered":"2024-09-13T06:09:32.135460+0000","last_unstale":"2024-09-13T06:14:03.432130+0000","last_undegraded":"2024-09-13T06:14:03.432130+0000","last_fullsized":"2024-09-13T06:14:03.432130+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:03.431859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:03.431859+0000","last_clean_scrub_stamp":"2024-09-13T06:14:03.431859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:11:48.562273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"35'2","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:58.121860+0000","last_change":"2024-09-13T06:13:58.121860+0000","last_active":"2024-09-13T06:13:58.121860+0000","last_peered":"2024-09-13T06:13:58.121860+0000","last_clean":"2024-09-13T06:13:58.121860+0000","last_became_active":"2024-09-13T06:09:34.115047+0000","last_became_peered":"2024-09-13T06:09:34.115047+0000","last_unstale":"2024-09-13T06:13:58.121860+0000","last_undegraded":"2024-09-13T06:13:58.121860+0000","last_fullsized":"2024-09-13T06:13:58.121860+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:13:58.121478+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:13:58.121478+0000","last_clean_scrub_stamp":"2024-09-13T06:13:58.121478+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:31:22.905217+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:04.099929+0000","last_change":"2024-09-13T06:14:04.099929+0000","last_active":"2024-09-13T06:14:04.099929+0000","last_peered":"2024-09-13T06:14:04.099929+0000","last_clean":"2024-09-13T06:14:04.099929+0000","last_became_active":"2024-09-13T06:09:32.141166+0000","last_became_peered":"2024-09-13T06:09:32.141166+0000","last_unstale":"2024-09-13T06:14:04.099929+0000","last_undegraded":"2024-09-13T06:14:04.099929+0000","last_fullsized":"2024-09-13T06:14:04.099929+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:04.099667+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:04.099667+0000","last_clean_scrub_stamp":"2024-09-13T06:14:04.099667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:53:05.101935+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"35'4","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:00.061453+0000","last_change":"2024-09-13T06:14:00.061453+0000","last_active":"2024-09-13T06:14:00.061453+0000","last_peered":"2024-09-13T06:14:00.061453+0000","last_clean":"2024-09-13T06:14:00.061453+0000","last_became_active":"2024-09-13T06:09:34.114242+0000","last_became_peered":"2024-09-13T06:09:34.114242+0000","last_unstale":"2024-09-13T06:14:00.061453+0000","last_undegraded":"2024-09-13T06:14:00.061453+0000","last_fullsized":"2024-09-13T06:14:00.061453+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:14:00.061127+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:14:00.061127+0000","last_clean_scrub_stamp":"2024-09-13T06:14:00.061127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:16:26.722813+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:00.064927+0000","last_change":"2024-09-13T06:14:00.064927+0000","last_active":"2024-09-13T06:14:00.064927+0000","last_peered":"2024-09-13T06:14:00.064927+0000","last_clean":"2024-09-13T06:14:00.064927+0000","last_became_active":"2024-09-13T06:09:32.143746+0000","last_became_peered":"2024-09-13T06:09:32.143746+0000","last_unstale":"2024-09-13T06:14:00.064927+0000","last_undegraded":"2024-09-13T06:14:00.064927+0000","last_fullsized":"2024-09-13T06:14:00.064927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:00.064492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:00.064492+0000","last_clean_scrub_stamp":"2024-09-13T06:14:00.064492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:19:41.835952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"35'8","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:50.515822+0000","last_change":"2024-09-13T06:13:50.515884+0000","last_active":"2024-09-13T06:13:50.515822+0000","last_peered":"2024-09-13T06:13:50.515822+0000","last_clean":"2024-09-13T06:13:50.515822+0000","last_became_active":"2024-09-13T06:09:34.101167+0000","last_became_peered":"2024-09-13T06:09:34.101167+0000","last_unstale":"2024-09-13T06:13:50.515822+0000","last_undegraded":"2024-09-13T06:13:50.515822+0000","last_fullsized":"2024-09-13T06:13:50.515822+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-13T06:13:50.515623+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-13T06:13:50.515623+0000","last_clean_scrub_stamp":"2024-09-13T06:13:50.515623+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:17:02.378126+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:57.177314+0000","last_change":"2024-09-13T06:13:57.177314+0000","last_active":"2024-09-13T06:13:57.177314+0000","last_peered":"2024-09-13T06:13:57.177314+0000","last_clean":"2024-09-13T06:13:57.177314+0000","last_became_active":"2024-09-13T06:09:32.149885+0000","last_became_peered":"2024-09-13T06:09:32.149885+0000","last_unstale":"2024-09-13T06:13:57.177314+0000","last_undegraded":"2024-09-13T06:13:57.177314+0000","last_fullsized":"2024-09-13T06:13:57.177314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:57.177058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:57.177058+0000","last_clean_scrub_stamp":"2024-09-13T06:13:57.177058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:42:39.408712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"35'14","reported_seq":74,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:43.162864+0000","last_change":"2024-09-13T06:13:43.162922+0000","last_active":"2024-09-13T06:13:43.162864+0000","last_peered":"2024-09-13T06:13:43.162864+0000","last_clean":"2024-09-13T06:13:43.162864+0000","last_became_active":"2024-09-13T06:09:34.124299+0000","last_became_peered":"2024-09-13T06:09:34.124299+0000","last_unstale":"2024-09-13T06:13:43.162864+0000","last_undegraded":"2024-09-13T06:13:43.162864+0000","last_fullsized":"2024-09-13T06:13:43.162864+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'14","last_scrub_stamp":"2024-09-13T06:13:43.162673+0000","last_deep_scrub":"35'14","last_deep_scrub_stamp":"2024-09-13T06:13:43.162673+0000","last_clean_scrub_stamp":"2024-09-13T06:13:43.162673+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:37:16.908533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.440873+0000","last_change":"2024-09-13T06:09:32.141692+0000","last_active":"2024-09-13T06:13:25.440873+0000","last_peered":"2024-09-13T06:13:25.440873+0000","last_clean":"2024-09-13T06:13:25.440873+0000","last_became_active":"2024-09-13T06:09:32.128376+0000","last_became_peered":"2024-09-13T06:09:32.128376+0000","last_unstale":"2024-09-13T06:13:25.440873+0000","last_undegraded":"2024-09-13T06:13:25.440873+0000","last_fullsized":"2024-09-13T06:13:25.440873+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"35'43","reported_seq":125,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.556471+0000","last_change":"2024-09-13T06:09:42.187344+0000","last_active":"2024-09-13T06:12:49.556471+0000","last_peered":"2024-09-13T06:12:49.556471+0000","last_clean":"2024-09-13T06:12:49.556471+0000","last_became_active":"2024-09-13T06:09:42.186091+0000","last_became_peered":"2024-09-13T06:09:42.186091+0000","last_unstale":"2024-09-13T06:12:49.556471+0000","last_undegraded":"2024-09-13T06:12:49.556471+0000","last_fullsized":"2024-09-13T06:12:49.556471+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":246,"num_read_kb":228,"num_write":124,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"35'16","reported_seq":116,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:06.989989+0000","last_change":"2024-09-13T06:14:06.989989+0000","last_active":"2024-09-13T06:14:06.989989+0000","last_peered":"2024-09-13T06:14:06.989989+0000","last_clean":"2024-09-13T06:14:06.989989+0000","last_became_active":"2024-09-13T06:09:34.118393+0000","last_became_peered":"2024-09-13T06:09:34.118393+0000","last_unstale":"2024-09-13T06:14:06.989989+0000","last_undegraded":"2024-09-13T06:14:06.989989+0000","last_fullsized":"2024-09-13T06:14:06.989989+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'16","last_scrub_stamp":"2024-09-13T06:14:06.989589+0000","last_deep_scrub":"35'16","last_deep_scrub_stamp":"2024-09-13T06:14:06.989589+0000","last_clean_scrub_stamp":"2024-09-13T06:14:06.989589+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:35:16.756495+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":90,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"35'6","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.440858+0000","last_change":"2024-09-13T06:09:32.139342+0000","last_active":"2024-09-13T06:13:25.440858+0000","last_peered":"2024-09-13T06:13:25.440858+0000","last_clean":"2024-09-13T06:13:25.440858+0000","last_became_active":"2024-09-13T06:09:32.133545+0000","last_became_peered":"2024-09-13T06:09:32.133545+0000","last_unstale":"2024-09-13T06:13:25.440858+0000","last_undegraded":"2024-09-13T06:13:25.440858+0000","last_fullsized":"2024-09-13T06:13:25.440858+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:26.893123+0000","last_change":"2024-09-13T06:13:26.893183+0000","last_active":"2024-09-13T06:13:26.893123+0000","last_peered":"2024-09-13T06:13:26.893123+0000","last_clean":"2024-09-13T06:13:26.893123+0000","last_became_active":"2024-09-13T06:09:36.153420+0000","last_became_peered":"2024-09-13T06:09:36.153420+0000","last_unstale":"2024-09-13T06:13:26.893123+0000","last_undegraded":"2024-09-13T06:13:26.893123+0000","last_fullsized":"2024-09-13T06:13:26.893123+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:26.892934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:26.892934+0000","last_clean_scrub_stamp":"2024-09-13T06:13:26.892934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:12:45.761321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"35'37","reported_seq":92,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:54.897190+0000","last_change":"2024-09-13T06:13:54.897267+0000","last_active":"2024-09-13T06:13:54.897190+0000","last_peered":"2024-09-13T06:13:54.897190+0000","last_clean":"2024-09-13T06:13:54.897190+0000","last_became_active":"2024-09-13T06:09:38.175393+0000","last_became_peered":"2024-09-13T06:09:38.175393+0000","last_unstale":"2024-09-13T06:13:54.897190+0000","last_undegraded":"2024-09-13T06:13:54.897190+0000","last_fullsized":"2024-09-13T06:13:54.897190+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'37","last_scrub_stamp":"2024-09-13T06:13:54.896963+0000","last_deep_scrub":"35'37","last_deep_scrub_stamp":"2024-09-13T06:13:54.896963+0000","last_clean_scrub_stamp":"2024-09-13T06:13:54.896963+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:27:41.104876+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:49.056142+0000","last_change":"2024-09-13T06:13:49.056194+0000","last_active":"2024-09-13T06:13:49.056142+0000","last_peered":"2024-09-13T06:13:49.056142+0000","last_clean":"2024-09-13T06:13:49.056142+0000","last_became_active":"2024-09-13T06:09:40.185574+0000","last_became_peered":"2024-09-13T06:09:40.185574+0000","last_unstale":"2024-09-13T06:13:49.056142+0000","last_undegraded":"2024-09-13T06:13:49.056142+0000","last_fullsized":"2024-09-13T06:13:49.056142+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:49.055950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:49.055950+0000","last_clean_scrub_stamp":"2024-09-13T06:13:49.055950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:11:18.319386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"35'9","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:21.108391+0000","last_change":"2024-09-13T06:14:21.108452+0000","last_active":"2024-09-13T06:14:21.108391+0000","last_peered":"2024-09-13T06:14:21.108391+0000","last_clean":"2024-09-13T06:14:21.108391+0000","last_became_active":"2024-09-13T06:09:42.183162+0000","last_became_peered":"2024-09-13T06:09:42.183162+0000","last_unstale":"2024-09-13T06:14:21.108391+0000","last_undegraded":"2024-09-13T06:14:21.108391+0000","last_fullsized":"2024-09-13T06:14:21.108391+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'9","last_scrub_stamp":"2024-09-13T06:14:21.108188+0000","last_deep_scrub":"35'9","last_deep_scrub_stamp":"2024-09-13T06:14:21.108188+0000","last_clean_scrub_stamp":"2024-09-13T06:14:21.108188+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:28:07.316101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":19,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"35'6","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:02.899527+0000","last_change":"2024-09-13T06:14:02.899591+0000","last_active":"2024-09-13T06:14:02.899527+0000","last_peered":"2024-09-13T06:14:02.899527+0000","last_clean":"2024-09-13T06:14:02.899527+0000","last_became_active":"2024-09-13T06:09:34.120600+0000","last_became_peered":"2024-09-13T06:09:34.120600+0000","last_unstale":"2024-09-13T06:14:02.899527+0000","last_undegraded":"2024-09-13T06:14:02.899527+0000","last_fullsized":"2024-09-13T06:14:02.899527+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:14:02.899339+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:14:02.899339+0000","last_clean_scrub_stamp":"2024-09-13T06:14:02.899339+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:30:32.307843+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:55.431016+0000","last_change":"2024-09-13T06:13:55.431016+0000","last_active":"2024-09-13T06:13:55.431016+0000","last_peered":"2024-09-13T06:13:55.431016+0000","last_clean":"2024-09-13T06:13:55.431016+0000","last_became_active":"2024-09-13T06:09:32.138643+0000","last_became_peered":"2024-09-13T06:09:32.138643+0000","last_unstale":"2024-09-13T06:13:55.431016+0000","last_undegraded":"2024-09-13T06:13:55.431016+0000","last_fullsized":"2024-09-13T06:13:55.431016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:55.430747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:55.430747+0000","last_clean_scrub_stamp":"2024-09-13T06:13:55.430747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:59:14.616769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:41.236284+0000","last_change":"2024-09-13T06:13:41.236284+0000","last_active":"2024-09-13T06:13:41.236284+0000","last_peered":"2024-09-13T06:13:41.236284+0000","last_clean":"2024-09-13T06:13:41.236284+0000","last_became_active":"2024-09-13T06:09:36.139235+0000","last_became_peered":"2024-09-13T06:09:36.139235+0000","last_unstale":"2024-09-13T06:13:41.236284+0000","last_undegraded":"2024-09-13T06:13:41.236284+0000","last_fullsized":"2024-09-13T06:13:41.236284+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:41.235958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:41.235958+0000","last_clean_scrub_stamp":"2024-09-13T06:13:41.235958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:48:26.407496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"35'9","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:28.250353+0000","last_change":"2024-09-13T06:13:28.250424+0000","last_active":"2024-09-13T06:13:28.250353+0000","last_peered":"2024-09-13T06:13:28.250353+0000","last_clean":"2024-09-13T06:13:28.250353+0000","last_became_active":"2024-09-13T06:09:38.161539+0000","last_became_peered":"2024-09-13T06:09:38.161539+0000","last_unstale":"2024-09-13T06:13:28.250353+0000","last_undegraded":"2024-09-13T06:13:28.250353+0000","last_fullsized":"2024-09-13T06:13:28.250353+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'9","last_scrub_stamp":"2024-09-13T06:13:28.250177+0000","last_deep_scrub":"35'9","last_deep_scrub_stamp":"2024-09-13T06:13:28.250177+0000","last_clean_scrub_stamp":"2024-09-13T06:13:28.250177+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:10:57.549533+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:41.143373+0000","last_change":"2024-09-13T06:13:41.143426+0000","last_active":"2024-09-13T06:13:41.143373+0000","last_peered":"2024-09-13T06:13:41.143373+0000","last_clean":"2024-09-13T06:13:41.143373+0000","last_became_active":"2024-09-13T06:09:40.182436+0000","last_became_peered":"2024-09-13T06:09:40.182436+0000","last_unstale":"2024-09-13T06:13:41.143373+0000","last_undegraded":"2024-09-13T06:13:41.143373+0000","last_fullsized":"2024-09-13T06:13:41.143373+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:41.143167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:41.143167+0000","last_clean_scrub_stamp":"2024-09-13T06:13:41.143167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:15:32.092602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"33'2","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:22.936389+0000","last_change":"2024-09-13T06:14:22.936454+0000","last_active":"2024-09-13T06:14:22.936389+0000","last_peered":"2024-09-13T06:14:22.936389+0000","last_clean":"2024-09-13T06:14:22.936389+0000","last_became_active":"2024-09-13T06:09:42.208430+0000","last_became_peered":"2024-09-13T06:09:42.208430+0000","last_unstale":"2024-09-13T06:14:22.936389+0000","last_undegraded":"2024-09-13T06:14:22.936389+0000","last_fullsized":"2024-09-13T06:14:22.936389+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T06:14:22.936197+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T06:14:22.936197+0000","last_clean_scrub_stamp":"2024-09-13T06:14:22.936197+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:07:30.217358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"35'6","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:00.919501+0000","last_change":"2024-09-13T06:14:00.919560+0000","last_active":"2024-09-13T06:14:00.919501+0000","last_peered":"2024-09-13T06:14:00.919501+0000","last_clean":"2024-09-13T06:14:00.919501+0000","last_became_active":"2024-09-13T06:09:34.122001+0000","last_became_peered":"2024-09-13T06:09:34.122001+0000","last_unstale":"2024-09-13T06:14:00.919501+0000","last_undegraded":"2024-09-13T06:14:00.919501+0000","last_fullsized":"2024-09-13T06:14:00.919501+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:14:00.919310+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:14:00.919310+0000","last_clean_scrub_stamp":"2024-09-13T06:14:00.919310+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:25:53.623575+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:18.848294+0000","last_change":"2024-09-13T06:14:18.848356+0000","last_active":"2024-09-13T06:14:18.848294+0000","last_peered":"2024-09-13T06:14:18.848294+0000","last_clean":"2024-09-13T06:14:18.848294+0000","last_became_active":"2024-09-13T06:09:32.129739+0000","last_became_peered":"2024-09-13T06:09:32.129739+0000","last_unstale":"2024-09-13T06:14:18.848294+0000","last_undegraded":"2024-09-13T06:14:18.848294+0000","last_fullsized":"2024-09-13T06:14:18.848294+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:18.848074+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:18.848074+0000","last_clean_scrub_stamp":"2024-09-13T06:14:18.848074+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:13:38.238905+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:39.268600+0000","last_change":"2024-09-13T06:13:39.268600+0000","last_active":"2024-09-13T06:13:39.268600+0000","last_peered":"2024-09-13T06:13:39.268600+0000","last_clean":"2024-09-13T06:13:39.268600+0000","last_became_active":"2024-09-13T06:09:36.143405+0000","last_became_peered":"2024-09-13T06:09:36.143405+0000","last_unstale":"2024-09-13T06:13:39.268600+0000","last_undegraded":"2024-09-13T06:13:39.268600+0000","last_fullsized":"2024-09-13T06:13:39.268600+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:39.268339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:39.268339+0000","last_clean_scrub_stamp":"2024-09-13T06:13:39.268339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:08:53.766496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"35'15","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:37.488304+0000","last_change":"2024-09-13T06:13:37.488304+0000","last_active":"2024-09-13T06:13:37.488304+0000","last_peered":"2024-09-13T06:13:37.488304+0000","last_clean":"2024-09-13T06:13:37.488304+0000","last_became_active":"2024-09-13T06:09:38.154654+0000","last_became_peered":"2024-09-13T06:09:38.154654+0000","last_unstale":"2024-09-13T06:13:37.488304+0000","last_undegraded":"2024-09-13T06:13:37.488304+0000","last_fullsized":"2024-09-13T06:13:37.488304+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'15","last_scrub_stamp":"2024-09-13T06:13:37.488029+0000","last_deep_scrub":"35'15","last_deep_scrub_stamp":"2024-09-13T06:13:37.488029+0000","last_clean_scrub_stamp":"2024-09-13T06:13:37.488029+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:59:42.866540+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"35'286","reported_seq":418,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:59.900958+0000","last_change":"2024-09-13T06:13:59.901028+0000","last_active":"2024-09-13T06:13:59.900958+0000","last_peered":"2024-09-13T06:13:59.900958+0000","last_clean":"2024-09-13T06:13:59.900958+0000","last_became_active":"2024-09-13T06:09:40.190377+0000","last_became_peered":"2024-09-13T06:09:40.190377+0000","last_unstale":"2024-09-13T06:13:59.900958+0000","last_undegraded":"2024-09-13T06:13:59.900958+0000","last_fullsized":"2024-09-13T06:13:59.900958+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'286","last_scrub_stamp":"2024-09-13T06:13:59.900745+0000","last_deep_scrub":"35'286","last_deep_scrub_stamp":"2024-09-13T06:13:59.900745+0000","last_clean_scrub_stamp":"2024-09-13T06:13:59.900745+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:29:32.530047+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:48.547957+0000","last_change":"2024-09-13T06:13:48.548016+0000","last_active":"2024-09-13T06:13:48.547957+0000","last_peered":"2024-09-13T06:13:48.547957+0000","last_clean":"2024-09-13T06:13:48.547957+0000","last_became_active":"2024-09-13T06:09:42.204083+0000","last_became_peered":"2024-09-13T06:09:42.204083+0000","last_unstale":"2024-09-13T06:13:48.547957+0000","last_undegraded":"2024-09-13T06:13:48.547957+0000","last_fullsized":"2024-09-13T06:13:48.547957+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:48.547749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:48.547749+0000","last_clean_scrub_stamp":"2024-09-13T06:13:48.547749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:09:43.428843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"35'6","reported_seq":67,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:51.108220+0000","last_change":"2024-09-13T06:13:51.108220+0000","last_active":"2024-09-13T06:13:51.108220+0000","last_peered":"2024-09-13T06:13:51.108220+0000","last_clean":"2024-09-13T06:13:51.108220+0000","last_became_active":"2024-09-13T06:09:34.130815+0000","last_became_peered":"2024-09-13T06:09:34.130815+0000","last_unstale":"2024-09-13T06:13:51.108220+0000","last_undegraded":"2024-09-13T06:13:51.108220+0000","last_fullsized":"2024-09-13T06:13:51.108220+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:13:51.107946+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:13:51.107946+0000","last_clean_scrub_stamp":"2024-09-13T06:13:51.107946+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:16:53.824111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:12.075110+0000","last_change":"2024-09-13T06:14:12.075110+0000","last_active":"2024-09-13T06:14:12.075110+0000","last_peered":"2024-09-13T06:14:12.075110+0000","last_clean":"2024-09-13T06:14:12.075110+0000","last_became_active":"2024-09-13T06:09:32.118278+0000","last_became_peered":"2024-09-13T06:09:32.118278+0000","last_unstale":"2024-09-13T06:14:12.075110+0000","last_undegraded":"2024-09-13T06:14:12.075110+0000","last_fullsized":"2024-09-13T06:14:12.075110+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:12.074849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:12.074849+0000","last_clean_scrub_stamp":"2024-09-13T06:14:12.074849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:59:25.657351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:02.812230+0000","last_change":"2024-09-13T06:10:10.825317+0000","last_active":"2024-09-13T06:12:02.812230+0000","last_peered":"2024-09-13T06:12:02.812230+0000","last_clean":"2024-09-13T06:12:02.812230+0000","last_became_active":"2024-09-13T06:10:10.824420+0000","last_became_peered":"2024-09-13T06:10:10.824420+0000","last_unstale":"2024-09-13T06:12:02.812230+0000","last_undegraded":"2024-09-13T06:12:02.812230+0000","last_fullsized":"2024-09-13T06:12:02.812230+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"35'37","reported_seq":92,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:35.449293+0000","last_change":"2024-09-13T06:13:35.449374+0000","last_active":"2024-09-13T06:13:35.449293+0000","last_peered":"2024-09-13T06:13:35.449293+0000","last_clean":"2024-09-13T06:13:35.449293+0000","last_became_active":"2024-09-13T06:09:38.157430+0000","last_became_peered":"2024-09-13T06:09:38.157430+0000","last_unstale":"2024-09-13T06:13:35.449293+0000","last_undegraded":"2024-09-13T06:13:35.449293+0000","last_fullsized":"2024-09-13T06:13:35.449293+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'37","last_scrub_stamp":"2024-09-13T06:13:35.449087+0000","last_deep_scrub":"35'37","last_deep_scrub_stamp":"2024-09-13T06:13:35.449087+0000","last_clean_scrub_stamp":"2024-09-13T06:13:35.449087+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:28:30.698850+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"35'285","reported_seq":449,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:26.281485+0000","last_change":"2024-09-13T06:13:26.281485+0000","last_active":"2024-09-13T06:13:26.281485+0000","last_peered":"2024-09-13T06:13:26.281485+0000","last_clean":"2024-09-13T06:13:26.281485+0000","last_became_active":"2024-09-13T06:09:40.175871+0000","last_became_peered":"2024-09-13T06:09:40.175871+0000","last_unstale":"2024-09-13T06:13:26.281485+0000","last_undegraded":"2024-09-13T06:13:26.281485+0000","last_fullsized":"2024-09-13T06:13:26.281485+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-13T06:13:26.281223+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-13T06:13:26.281223+0000","last_clean_scrub_stamp":"2024-09-13T06:13:26.281223+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:05:30.880244+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"35'2","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:44.821803+0000","last_change":"2024-09-13T06:13:44.821803+0000","last_active":"2024-09-13T06:13:44.821803+0000","last_peered":"2024-09-13T06:13:44.821803+0000","last_clean":"2024-09-13T06:13:44.821803+0000","last_became_active":"2024-09-13T06:09:34.126374+0000","last_became_peered":"2024-09-13T06:09:34.126374+0000","last_unstale":"2024-09-13T06:13:44.821803+0000","last_undegraded":"2024-09-13T06:13:44.821803+0000","last_fullsized":"2024-09-13T06:13:44.821803+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:13:44.821554+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:13:44.821554+0000","last_clean_scrub_stamp":"2024-09-13T06:13:44.821554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:48:20.992725+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:13.500678+0000","last_change":"2024-09-13T06:14:13.500738+0000","last_active":"2024-09-13T06:14:13.500678+0000","last_peered":"2024-09-13T06:14:13.500678+0000","last_clean":"2024-09-13T06:14:13.500678+0000","last_became_active":"2024-09-13T06:09:32.131373+0000","last_became_peered":"2024-09-13T06:09:32.131373+0000","last_unstale":"2024-09-13T06:14:13.500678+0000","last_undegraded":"2024-09-13T06:14:13.500678+0000","last_fullsized":"2024-09-13T06:14:13.500678+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:13.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:13.500482+0000","last_clean_scrub_stamp":"2024-09-13T06:14:13.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:15:53.870254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:38.094138+0000","last_change":"2024-09-13T06:13:38.094138+0000","last_active":"2024-09-13T06:13:38.094138+0000","last_peered":"2024-09-13T06:13:38.094138+0000","last_clean":"2024-09-13T06:13:38.094138+0000","last_became_active":"2024-09-13T06:09:36.137016+0000","last_became_peered":"2024-09-13T06:09:36.137016+0000","last_unstale":"2024-09-13T06:13:38.094138+0000","last_undegraded":"2024-09-13T06:13:38.094138+0000","last_fullsized":"2024-09-13T06:13:38.094138+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:38.093864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:38.093864+0000","last_clean_scrub_stamp":"2024-09-13T06:13:38.093864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:18:03.005466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"35'51","reported_seq":112,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:31.369768+0000","last_change":"2024-09-13T06:13:31.369768+0000","last_active":"2024-09-13T06:13:31.369768+0000","last_peered":"2024-09-13T06:13:31.369768+0000","last_clean":"2024-09-13T06:13:31.369768+0000","last_became_active":"2024-09-13T06:09:38.163472+0000","last_became_peered":"2024-09-13T06:09:38.163472+0000","last_unstale":"2024-09-13T06:13:31.369768+0000","last_undegraded":"2024-09-13T06:13:31.369768+0000","last_fullsized":"2024-09-13T06:13:31.369768+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'51","last_scrub_stamp":"2024-09-13T06:13:31.369476+0000","last_deep_scrub":"35'51","last_deep_scrub_stamp":"2024-09-13T06:13:31.369476+0000","last_clean_scrub_stamp":"2024-09-13T06:13:31.369476+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:44:16.358341+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:27.325602+0000","last_change":"2024-09-13T06:13:27.325602+0000","last_active":"2024-09-13T06:13:27.325602+0000","last_peered":"2024-09-13T06:13:27.325602+0000","last_clean":"2024-09-13T06:13:27.325602+0000","last_became_active":"2024-09-13T06:09:40.171609+0000","last_became_peered":"2024-09-13T06:09:40.171609+0000","last_unstale":"2024-09-13T06:13:27.325602+0000","last_undegraded":"2024-09-13T06:13:27.325602+0000","last_fullsized":"2024-09-13T06:13:27.325602+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:27.325358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:27.325358+0000","last_clean_scrub_stamp":"2024-09-13T06:13:27.325358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:15:24.519986+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"35'5","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:16.551788+0000","last_change":"2024-09-13T06:14:16.551854+0000","last_active":"2024-09-13T06:14:16.551788+0000","last_peered":"2024-09-13T06:14:16.551788+0000","last_clean":"2024-09-13T06:14:16.551788+0000","last_became_active":"2024-09-13T06:09:42.193426+0000","last_became_peered":"2024-09-13T06:09:42.193426+0000","last_unstale":"2024-09-13T06:14:16.551788+0000","last_undegraded":"2024-09-13T06:14:16.551788+0000","last_fullsized":"2024-09-13T06:14:16.551788+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'5","last_scrub_stamp":"2024-09-13T06:14:16.551562+0000","last_deep_scrub":"35'5","last_deep_scrub_stamp":"2024-09-13T06:14:16.551562+0000","last_clean_scrub_stamp":"2024-09-13T06:14:16.551562+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:45:42.103577+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"35'6","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:56.130563+0000","last_change":"2024-09-13T06:13:56.130563+0000","last_active":"2024-09-13T06:13:56.130563+0000","last_peered":"2024-09-13T06:13:56.130563+0000","last_clean":"2024-09-13T06:13:56.130563+0000","last_became_active":"2024-09-13T06:09:34.114999+0000","last_became_peered":"2024-09-13T06:09:34.114999+0000","last_unstale":"2024-09-13T06:13:56.130563+0000","last_undegraded":"2024-09-13T06:13:56.130563+0000","last_fullsized":"2024-09-13T06:13:56.130563+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:13:56.130180+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:13:56.130180+0000","last_clean_scrub_stamp":"2024-09-13T06:13:56.130180+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:43:27.715392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:08.485550+0000","last_change":"2024-09-13T06:14:08.485661+0000","last_active":"2024-09-13T06:14:08.485550+0000","last_peered":"2024-09-13T06:14:08.485550+0000","last_clean":"2024-09-13T06:14:08.485550+0000","last_became_active":"2024-09-13T06:09:32.117779+0000","last_became_peered":"2024-09-13T06:09:32.117779+0000","last_unstale":"2024-09-13T06:14:08.485550+0000","last_undegraded":"2024-09-13T06:14:08.485550+0000","last_fullsized":"2024-09-13T06:14:08.485550+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:08.485235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:08.485235+0000","last_clean_scrub_stamp":"2024-09-13T06:14:08.485235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:46:00.389747+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:43.192766+0000","last_change":"2024-09-13T06:13:43.192766+0000","last_active":"2024-09-13T06:13:43.192766+0000","last_peered":"2024-09-13T06:13:43.192766+0000","last_clean":"2024-09-13T06:13:43.192766+0000","last_became_active":"2024-09-13T06:09:36.135862+0000","last_became_peered":"2024-09-13T06:09:36.135862+0000","last_unstale":"2024-09-13T06:13:43.192766+0000","last_undegraded":"2024-09-13T06:13:43.192766+0000","last_fullsized":"2024-09-13T06:13:43.192766+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:43.192506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:43.192506+0000","last_clean_scrub_stamp":"2024-09-13T06:13:43.192506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:16:55.055009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"35'37","reported_seq":93,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:35.787233+0000","last_change":"2024-09-13T06:13:35.787233+0000","last_active":"2024-09-13T06:13:35.787233+0000","last_peered":"2024-09-13T06:13:35.787233+0000","last_clean":"2024-09-13T06:13:35.787233+0000","last_became_active":"2024-09-13T06:09:38.171931+0000","last_became_peered":"2024-09-13T06:09:38.171931+0000","last_unstale":"2024-09-13T06:13:35.787233+0000","last_undegraded":"2024-09-13T06:13:35.787233+0000","last_fullsized":"2024-09-13T06:13:35.787233+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'37","last_scrub_stamp":"2024-09-13T06:13:35.786837+0000","last_deep_scrub":"35'37","last_deep_scrub_stamp":"2024-09-13T06:13:35.786837+0000","last_clean_scrub_stamp":"2024-09-13T06:13:35.786837+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:50:05.816319+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:32.280888+0000","last_change":"2024-09-13T06:13:32.280888+0000","last_active":"2024-09-13T06:13:32.280888+0000","last_peered":"2024-09-13T06:13:32.280888+0000","last_clean":"2024-09-13T06:13:32.280888+0000","last_became_active":"2024-09-13T06:09:40.178545+0000","last_became_peered":"2024-09-13T06:09:40.178545+0000","last_unstale":"2024-09-13T06:13:32.280888+0000","last_undegraded":"2024-09-13T06:13:32.280888+0000","last_fullsized":"2024-09-13T06:13:32.280888+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:32.280631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:32.280631+0000","last_clean_scrub_stamp":"2024-09-13T06:13:32.280631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:40:09.829593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"35'5","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:24.521642+0000","last_change":"2024-09-13T06:09:42.206012+0000","last_active":"2024-09-13T06:13:24.521642+0000","last_peered":"2024-09-13T06:13:24.521642+0000","last_clean":"2024-09-13T06:13:24.521642+0000","last_became_active":"2024-09-13T06:09:42.204945+0000","last_became_peered":"2024-09-13T06:09:42.204945+0000","last_unstale":"2024-09-13T06:13:24.521642+0000","last_undegraded":"2024-09-13T06:13:24.521642+0000","last_fullsized":"2024-09-13T06:13:24.521642+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"33'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:02.463798+0000","last_change":"2024-09-13T06:14:02.463861+0000","last_active":"2024-09-13T06:14:02.463798+0000","last_peered":"2024-09-13T06:14:02.463798+0000","last_clean":"2024-09-13T06:14:02.463798+0000","last_became_active":"2024-09-13T06:09:34.102657+0000","last_became_peered":"2024-09-13T06:09:34.102657+0000","last_unstale":"2024-09-13T06:14:02.463798+0000","last_undegraded":"2024-09-13T06:14:02.463798+0000","last_fullsized":"2024-09-13T06:14:02.463798+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T06:14:02.463588+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T06:14:02.463588+0000","last_clean_scrub_stamp":"2024-09-13T06:14:02.463588+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:08:35.731519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"35'6","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.440495+0000","last_change":"2024-09-13T06:09:32.136390+0000","last_active":"2024-09-13T06:13:25.440495+0000","last_peered":"2024-09-13T06:13:25.440495+0000","last_clean":"2024-09-13T06:13:25.440495+0000","last_became_active":"2024-09-13T06:09:32.133020+0000","last_became_peered":"2024-09-13T06:09:32.133020+0000","last_unstale":"2024-09-13T06:13:25.440495+0000","last_undegraded":"2024-09-13T06:13:25.440495+0000","last_fullsized":"2024-09-13T06:13:25.440495+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":22,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:17.598408+0000","last_change":"2024-09-13T06:14:17.598463+0000","last_active":"2024-09-13T06:14:17.598408+0000","last_peered":"2024-09-13T06:14:17.598408+0000","last_clean":"2024-09-13T06:14:17.598408+0000","last_became_active":"2024-09-13T06:10:10.809442+0000","last_became_peered":"2024-09-13T06:10:10.809442+0000","last_unstale":"2024-09-13T06:14:17.598408+0000","last_undegraded":"2024-09-13T06:14:17.598408+0000","last_fullsized":"2024-09-13T06:14:17.598408+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:17.598224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:17.598224+0000","last_clean_scrub_stamp":"2024-09-13T06:14:17.598224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:09:29.398763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"35'45","reported_seq":104,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:27.901555+0000","last_change":"2024-09-13T06:13:27.901555+0000","last_active":"2024-09-13T06:13:27.901555+0000","last_peered":"2024-09-13T06:13:27.901555+0000","last_clean":"2024-09-13T06:13:27.901555+0000","last_became_active":"2024-09-13T06:09:38.154720+0000","last_became_peered":"2024-09-13T06:09:38.154720+0000","last_unstale":"2024-09-13T06:13:27.901555+0000","last_undegraded":"2024-09-13T06:13:27.901555+0000","last_fullsized":"2024-09-13T06:13:27.901555+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'45","last_scrub_stamp":"2024-09-13T06:13:27.901155+0000","last_deep_scrub":"35'45","last_deep_scrub_stamp":"2024-09-13T06:13:27.901155+0000","last_clean_scrub_stamp":"2024-09-13T06:13:27.901155+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:38:20.916120+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"35'285","reported_seq":411,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:48.184617+0000","last_change":"2024-09-13T06:13:48.184617+0000","last_active":"2024-09-13T06:13:48.184617+0000","last_peered":"2024-09-13T06:13:48.184617+0000","last_clean":"2024-09-13T06:13:48.184617+0000","last_became_active":"2024-09-13T06:09:40.186987+0000","last_became_peered":"2024-09-13T06:09:40.186987+0000","last_unstale":"2024-09-13T06:13:48.184617+0000","last_undegraded":"2024-09-13T06:13:48.184617+0000","last_fullsized":"2024-09-13T06:13:48.184617+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-13T06:13:48.184284+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-13T06:13:48.184284+0000","last_clean_scrub_stamp":"2024-09-13T06:13:48.184284+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:59:07.370306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"35'2","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:21.968175+0000","last_change":"2024-09-13T06:14:21.968236+0000","last_active":"2024-09-13T06:14:21.968175+0000","last_peered":"2024-09-13T06:14:21.968175+0000","last_clean":"2024-09-13T06:14:21.968175+0000","last_became_active":"2024-09-13T06:09:42.201678+0000","last_became_peered":"2024-09-13T06:09:42.201678+0000","last_unstale":"2024-09-13T06:14:21.968175+0000","last_undegraded":"2024-09-13T06:14:21.968175+0000","last_fullsized":"2024-09-13T06:14:21.968175+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:21.967952+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:21.967952+0000","last_clean_scrub_stamp":"2024-09-13T06:14:21.967952+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:01:07.570633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"35'14","reported_seq":79,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:52.484137+0000","last_change":"2024-09-13T06:13:52.484137+0000","last_active":"2024-09-13T06:13:52.484137+0000","last_peered":"2024-09-13T06:13:52.484137+0000","last_clean":"2024-09-13T06:13:52.484137+0000","last_became_active":"2024-09-13T06:09:34.103295+0000","last_became_peered":"2024-09-13T06:09:34.103295+0000","last_unstale":"2024-09-13T06:13:52.484137+0000","last_undegraded":"2024-09-13T06:13:52.484137+0000","last_fullsized":"2024-09-13T06:13:52.484137+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'14","last_scrub_stamp":"2024-09-13T06:13:52.483880+0000","last_deep_scrub":"35'14","last_deep_scrub_stamp":"2024-09-13T06:13:52.483880+0000","last_clean_scrub_stamp":"2024-09-13T06:13:52.483880+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:12:37.738064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.440523+0000","last_change":"2024-09-13T06:09:32.128209+0000","last_active":"2024-09-13T06:13:25.440523+0000","last_peered":"2024-09-13T06:13:25.440523+0000","last_clean":"2024-09-13T06:13:25.440523+0000","last_became_active":"2024-09-13T06:09:32.125047+0000","last_became_peered":"2024-09-13T06:09:32.125047+0000","last_unstale":"2024-09-13T06:13:25.440523+0000","last_undegraded":"2024-09-13T06:13:25.440523+0000","last_fullsized":"2024-09-13T06:13:25.440523+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:42.241894+0000","last_change":"2024-09-13T06:13:42.241894+0000","last_active":"2024-09-13T06:13:42.241894+0000","last_peered":"2024-09-13T06:13:42.241894+0000","last_clean":"2024-09-13T06:13:42.241894+0000","last_became_active":"2024-09-13T06:09:36.135896+0000","last_became_peered":"2024-09-13T06:09:36.135896+0000","last_unstale":"2024-09-13T06:13:42.241894+0000","last_undegraded":"2024-09-13T06:13:42.241894+0000","last_fullsized":"2024-09-13T06:13:42.241894+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:42.241654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:42.241654+0000","last_clean_scrub_stamp":"2024-09-13T06:13:42.241654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:30:48.725646+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"35'68","reported_seq":142,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:56.931891+0000","last_change":"2024-09-13T06:13:56.931891+0000","last_active":"2024-09-13T06:13:56.931891+0000","last_peered":"2024-09-13T06:13:56.931891+0000","last_clean":"2024-09-13T06:13:56.931891+0000","last_became_active":"2024-09-13T06:09:38.175404+0000","last_became_peered":"2024-09-13T06:09:38.175404+0000","last_unstale":"2024-09-13T06:13:56.931891+0000","last_undegraded":"2024-09-13T06:13:56.931891+0000","last_fullsized":"2024-09-13T06:13:56.931891+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'68","last_scrub_stamp":"2024-09-13T06:13:56.931599+0000","last_deep_scrub":"35'68","last_deep_scrub_stamp":"2024-09-13T06:13:56.931599+0000","last_clean_scrub_stamp":"2024-09-13T06:13:56.931599+0000","objects_scrubbed":5,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:48:12.141585+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":65,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:24.261010+0000","last_change":"2024-09-13T06:13:24.261010+0000","last_active":"2024-09-13T06:13:24.261010+0000","last_peered":"2024-09-13T06:13:24.261010+0000","last_clean":"2024-09-13T06:13:24.261010+0000","last_became_active":"2024-09-13T06:09:40.177127+0000","last_became_peered":"2024-09-13T06:09:40.177127+0000","last_unstale":"2024-09-13T06:13:24.261010+0000","last_undegraded":"2024-09-13T06:13:24.261010+0000","last_fullsized":"2024-09-13T06:13:24.261010+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:24.260874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:24.260874+0000","last_clean_scrub_stamp":"2024-09-13T06:13:24.260874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:44:50.272386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"35'21","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:19.053841+0000","last_change":"2024-09-13T06:14:19.053918+0000","last_active":"2024-09-13T06:14:19.053841+0000","last_peered":"2024-09-13T06:14:19.053841+0000","last_clean":"2024-09-13T06:14:19.053841+0000","last_became_active":"2024-09-13T06:09:42.176229+0000","last_became_peered":"2024-09-13T06:09:42.176229+0000","last_unstale":"2024-09-13T06:14:19.053841+0000","last_undegraded":"2024-09-13T06:14:19.053841+0000","last_fullsized":"2024-09-13T06:14:19.053841+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'21","last_scrub_stamp":"2024-09-13T06:14:19.053655+0000","last_deep_scrub":"35'21","last_deep_scrub_stamp":"2024-09-13T06:14:19.053655+0000","last_clean_scrub_stamp":"2024-09-13T06:14:19.053655+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:22:30.490846+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"35'16","reported_seq":87,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:09.100307+0000","last_change":"2024-09-13T06:14:09.100465+0000","last_active":"2024-09-13T06:14:09.100307+0000","last_peered":"2024-09-13T06:14:09.100307+0000","last_clean":"2024-09-13T06:14:09.100307+0000","last_became_active":"2024-09-13T06:09:34.119018+0000","last_became_peered":"2024-09-13T06:09:34.119018+0000","last_unstale":"2024-09-13T06:14:09.100307+0000","last_undegraded":"2024-09-13T06:14:09.100307+0000","last_fullsized":"2024-09-13T06:14:09.100307+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'16","last_scrub_stamp":"2024-09-13T06:14:09.100069+0000","last_deep_scrub":"35'16","last_deep_scrub_stamp":"2024-09-13T06:14:09.100069+0000","last_clean_scrub_stamp":"2024-09-13T06:14:09.100069+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:19:13.686028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:02.994130+0000","last_change":"2024-09-13T06:14:02.994130+0000","last_active":"2024-09-13T06:14:02.994130+0000","last_peered":"2024-09-13T06:14:02.994130+0000","last_clean":"2024-09-13T06:14:02.994130+0000","last_became_active":"2024-09-13T06:09:32.148505+0000","last_became_peered":"2024-09-13T06:09:32.148505+0000","last_unstale":"2024-09-13T06:14:02.994130+0000","last_undegraded":"2024-09-13T06:14:02.994130+0000","last_fullsized":"2024-09-13T06:14:02.994130+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:02.993832+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:02.993832+0000","last_clean_scrub_stamp":"2024-09-13T06:14:02.993832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:44:02.387231+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:42.465330+0000","last_change":"2024-09-13T06:13:42.465330+0000","last_active":"2024-09-13T06:13:42.465330+0000","last_peered":"2024-09-13T06:13:42.465330+0000","last_clean":"2024-09-13T06:13:42.465330+0000","last_became_active":"2024-09-13T06:09:36.131611+0000","last_became_peered":"2024-09-13T06:09:36.131611+0000","last_unstale":"2024-09-13T06:13:42.465330+0000","last_undegraded":"2024-09-13T06:13:42.465330+0000","last_fullsized":"2024-09-13T06:13:42.465330+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:42.465072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:42.465072+0000","last_clean_scrub_stamp":"2024-09-13T06:13:42.465072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:13:43.052645+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"35'40","reported_seq":97,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:27.295757+0000","last_change":"2024-09-13T06:13:27.295757+0000","last_active":"2024-09-13T06:13:27.295757+0000","last_peered":"2024-09-13T06:13:27.295757+0000","last_clean":"2024-09-13T06:13:27.295757+0000","last_became_active":"2024-09-13T06:09:38.165747+0000","last_became_peered":"2024-09-13T06:09:38.165747+0000","last_unstale":"2024-09-13T06:13:27.295757+0000","last_undegraded":"2024-09-13T06:13:27.295757+0000","last_fullsized":"2024-09-13T06:13:27.295757+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'40","last_scrub_stamp":"2024-09-13T06:13:27.295462+0000","last_deep_scrub":"35'40","last_deep_scrub_stamp":"2024-09-13T06:13:27.295462+0000","last_clean_scrub_stamp":"2024-09-13T06:13:27.295462+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:22:05.049909+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:55.906807+0000","last_change":"2024-09-13T06:13:55.906807+0000","last_active":"2024-09-13T06:13:55.906807+0000","last_peered":"2024-09-13T06:13:55.906807+0000","last_clean":"2024-09-13T06:13:55.906807+0000","last_became_active":"2024-09-13T06:09:40.190314+0000","last_became_peered":"2024-09-13T06:09:40.190314+0000","last_unstale":"2024-09-13T06:13:55.906807+0000","last_undegraded":"2024-09-13T06:13:55.906807+0000","last_fullsized":"2024-09-13T06:13:55.906807+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:55.906553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:55.906553+0000","last_clean_scrub_stamp":"2024-09-13T06:13:55.906553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:32:46.700425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"35'4","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:15.915445+0000","last_change":"2024-09-13T06:14:15.915519+0000","last_active":"2024-09-13T06:14:15.915445+0000","last_peered":"2024-09-13T06:14:15.915445+0000","last_clean":"2024-09-13T06:14:15.915445+0000","last_became_active":"2024-09-13T06:09:42.201211+0000","last_became_peered":"2024-09-13T06:09:42.201211+0000","last_unstale":"2024-09-13T06:14:15.915445+0000","last_undegraded":"2024-09-13T06:14:15.915445+0000","last_fullsized":"2024-09-13T06:14:15.915445+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:14:15.915230+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:14:15.915230+0000","last_clean_scrub_stamp":"2024-09-13T06:14:15.915230+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:21:05.416806+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"35'6","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:40.785766+0000","last_change":"2024-09-13T06:13:40.785766+0000","last_active":"2024-09-13T06:13:40.785766+0000","last_peered":"2024-09-13T06:13:40.785766+0000","last_clean":"2024-09-13T06:13:40.785766+0000","last_became_active":"2024-09-13T06:09:34.131882+0000","last_became_peered":"2024-09-13T06:09:34.131882+0000","last_unstale":"2024-09-13T06:13:40.785766+0000","last_undegraded":"2024-09-13T06:13:40.785766+0000","last_fullsized":"2024-09-13T06:13:40.785766+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:13:40.785378+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:13:40.785378+0000","last_clean_scrub_stamp":"2024-09-13T06:13:40.785378+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:31:15.240641+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:16.931589+0000","last_change":"2024-09-13T06:14:16.931648+0000","last_active":"2024-09-13T06:14:16.931589+0000","last_peered":"2024-09-13T06:14:16.931589+0000","last_clean":"2024-09-13T06:14:16.931589+0000","last_became_active":"2024-09-13T06:09:32.138731+0000","last_became_peered":"2024-09-13T06:09:32.138731+0000","last_unstale":"2024-09-13T06:14:16.931589+0000","last_undegraded":"2024-09-13T06:14:16.931589+0000","last_fullsized":"2024-09-13T06:14:16.931589+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:16.931376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:16.931376+0000","last_clean_scrub_stamp":"2024-09-13T06:14:16.931376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:44:18.267821+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:45.169252+0000","last_change":"2024-09-13T06:13:45.169252+0000","last_active":"2024-09-13T06:13:45.169252+0000","last_peered":"2024-09-13T06:13:45.169252+0000","last_clean":"2024-09-13T06:13:45.169252+0000","last_became_active":"2024-09-13T06:09:36.135660+0000","last_became_peered":"2024-09-13T06:09:36.135660+0000","last_unstale":"2024-09-13T06:13:45.169252+0000","last_undegraded":"2024-09-13T06:13:45.169252+0000","last_fullsized":"2024-09-13T06:13:45.169252+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:45.168902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:45.168902+0000","last_clean_scrub_stamp":"2024-09-13T06:13:45.168902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:17:37.777327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"35'46","reported_seq":105,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:38.444422+0000","last_change":"2024-09-13T06:13:38.444422+0000","last_active":"2024-09-13T06:13:38.444422+0000","last_peered":"2024-09-13T06:13:38.444422+0000","last_clean":"2024-09-13T06:13:38.444422+0000","last_became_active":"2024-09-13T06:09:38.143209+0000","last_became_peered":"2024-09-13T06:09:38.143209+0000","last_unstale":"2024-09-13T06:13:38.444422+0000","last_undegraded":"2024-09-13T06:13:38.444422+0000","last_fullsized":"2024-09-13T06:13:38.444422+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'46","last_scrub_stamp":"2024-09-13T06:13:38.444138+0000","last_deep_scrub":"35'46","last_deep_scrub_stamp":"2024-09-13T06:13:38.444138+0000","last_clean_scrub_stamp":"2024-09-13T06:13:38.444138+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:49:28.085814+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"35'285","reported_seq":417,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:32.368124+0000","last_change":"2024-09-13T06:13:32.368124+0000","last_active":"2024-09-13T06:13:32.368124+0000","last_peered":"2024-09-13T06:13:32.368124+0000","last_clean":"2024-09-13T06:13:32.368124+0000","last_became_active":"2024-09-13T06:09:40.188246+0000","last_became_peered":"2024-09-13T06:09:40.188246+0000","last_unstale":"2024-09-13T06:13:32.368124+0000","last_undegraded":"2024-09-13T06:13:32.368124+0000","last_fullsized":"2024-09-13T06:13:32.368124+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-13T06:13:32.367867+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-13T06:13:32.367867+0000","last_clean_scrub_stamp":"2024-09-13T06:13:32.367867+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:44:58.379379+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"35'17","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:21.015822+0000","last_change":"2024-09-13T06:14:21.015889+0000","last_active":"2024-09-13T06:14:21.015822+0000","last_peered":"2024-09-13T06:14:21.015822+0000","last_clean":"2024-09-13T06:14:21.015822+0000","last_became_active":"2024-09-13T06:09:42.201304+0000","last_became_peered":"2024-09-13T06:09:42.201304+0000","last_unstale":"2024-09-13T06:14:21.015822+0000","last_undegraded":"2024-09-13T06:14:21.015822+0000","last_fullsized":"2024-09-13T06:14:21.015822+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'17","last_scrub_stamp":"2024-09-13T06:14:21.015634+0000","last_deep_scrub":"35'17","last_deep_scrub_stamp":"2024-09-13T06:14:21.015634+0000","last_clean_scrub_stamp":"2024-09-13T06:14:21.015634+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:35:52.895466+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":29,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"35'4","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:00.426330+0000","last_change":"2024-09-13T06:14:00.426330+0000","last_active":"2024-09-13T06:14:00.426330+0000","last_peered":"2024-09-13T06:14:00.426330+0000","last_clean":"2024-09-13T06:14:00.426330+0000","last_became_active":"2024-09-13T06:09:34.102586+0000","last_became_peered":"2024-09-13T06:09:34.102586+0000","last_unstale":"2024-09-13T06:14:00.426330+0000","last_undegraded":"2024-09-13T06:14:00.426330+0000","last_fullsized":"2024-09-13T06:14:00.426330+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:14:00.426064+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:14:00.426064+0000","last_clean_scrub_stamp":"2024-09-13T06:14:00.426064+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:46:57.805890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"35'2","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.440543+0000","last_change":"2024-09-13T06:09:32.125108+0000","last_active":"2024-09-13T06:13:25.440543+0000","last_peered":"2024-09-13T06:13:25.440543+0000","last_clean":"2024-09-13T06:13:25.440543+0000","last_became_active":"2024-09-13T06:09:32.122121+0000","last_became_peered":"2024-09-13T06:09:32.122121+0000","last_unstale":"2024-09-13T06:13:25.440543+0000","last_undegraded":"2024-09-13T06:13:25.440543+0000","last_fullsized":"2024-09-13T06:13:25.440543+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"35'5","reported_seq":429,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:32.185845+0000","last_change":"2024-09-13T06:13:32.185845+0000","last_active":"2024-09-13T06:13:32.185845+0000","last_peered":"2024-09-13T06:13:32.185845+0000","last_clean":"2024-09-13T06:13:32.185845+0000","last_became_active":"2024-09-13T06:09:36.141789+0000","last_became_peered":"2024-09-13T06:09:36.141789+0000","last_unstale":"2024-09-13T06:13:32.185845+0000","last_undegraded":"2024-09-13T06:13:32.185845+0000","last_fullsized":"2024-09-13T06:13:32.185845+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'5","last_scrub_stamp":"2024-09-13T06:13:32.185488+0000","last_deep_scrub":"35'5","last_deep_scrub_stamp":"2024-09-13T06:13:32.185488+0000","last_clean_scrub_stamp":"2024-09-13T06:13:32.185488+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:56:51.767002+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"35'15","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:52.922425+0000","last_change":"2024-09-13T06:13:52.922425+0000","last_active":"2024-09-13T06:13:52.922425+0000","last_peered":"2024-09-13T06:13:52.922425+0000","last_clean":"2024-09-13T06:13:52.922425+0000","last_became_active":"2024-09-13T06:09:38.177217+0000","last_became_peered":"2024-09-13T06:09:38.177217+0000","last_unstale":"2024-09-13T06:13:52.922425+0000","last_undegraded":"2024-09-13T06:13:52.922425+0000","last_fullsized":"2024-09-13T06:13:52.922425+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'15","last_scrub_stamp":"2024-09-13T06:13:52.922012+0000","last_deep_scrub":"35'15","last_deep_scrub_stamp":"2024-09-13T06:13:52.922012+0000","last_clean_scrub_stamp":"2024-09-13T06:13:52.922012+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:05:01.785924+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"35'285","reported_seq":473,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:29.237199+0000","last_change":"2024-09-13T06:13:29.237199+0000","last_active":"2024-09-13T06:13:29.237199+0000","last_peered":"2024-09-13T06:13:29.237199+0000","last_clean":"2024-09-13T06:13:29.237199+0000","last_became_active":"2024-09-13T06:09:40.179438+0000","last_became_peered":"2024-09-13T06:09:40.179438+0000","last_unstale":"2024-09-13T06:13:29.237199+0000","last_undegraded":"2024-09-13T06:13:29.237199+0000","last_fullsized":"2024-09-13T06:13:29.237199+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-13T06:13:29.236948+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-13T06:13:29.236948+0000","last_clean_scrub_stamp":"2024-09-13T06:13:29.236948+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:34:12.529343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"35'6","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:44.457830+0000","last_change":"2024-09-13T06:13:44.457830+0000","last_active":"2024-09-13T06:13:44.457830+0000","last_peered":"2024-09-13T06:13:44.457830+0000","last_clean":"2024-09-13T06:13:44.457830+0000","last_became_active":"2024-09-13T06:09:42.181854+0000","last_became_peered":"2024-09-13T06:09:42.181854+0000","last_unstale":"2024-09-13T06:13:44.457830+0000","last_undegraded":"2024-09-13T06:13:44.457830+0000","last_fullsized":"2024-09-13T06:13:44.457830+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:13:44.457577+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:13:44.457577+0000","last_clean_scrub_stamp":"2024-09-13T06:13:44.457577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:56:32.118289+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:46.140515+0000","last_change":"2024-09-13T06:13:46.140515+0000","last_active":"2024-09-13T06:13:46.140515+0000","last_peered":"2024-09-13T06:13:46.140515+0000","last_clean":"2024-09-13T06:13:46.140515+0000","last_became_active":"2024-09-13T06:09:34.126843+0000","last_became_peered":"2024-09-13T06:09:34.126843+0000","last_unstale":"2024-09-13T06:13:46.140515+0000","last_undegraded":"2024-09-13T06:13:46.140515+0000","last_fullsized":"2024-09-13T06:13:46.140515+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:46.140243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:46.140243+0000","last_clean_scrub_stamp":"2024-09-13T06:13:46.140243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:17:57.910783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"35'5","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.440378+0000","last_change":"2024-09-13T06:09:32.133494+0000","last_active":"2024-09-13T06:13:25.440378+0000","last_peered":"2024-09-13T06:13:25.440378+0000","last_clean":"2024-09-13T06:13:25.440378+0000","last_became_active":"2024-09-13T06:09:32.129984+0000","last_became_peered":"2024-09-13T06:09:32.129984+0000","last_unstale":"2024-09-13T06:13:25.440378+0000","last_undegraded":"2024-09-13T06:13:25.440378+0000","last_fullsized":"2024-09-13T06:13:25.440378+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.907022+0000","last_change":"2024-09-13T06:13:25.907022+0000","last_active":"2024-09-13T06:13:25.907022+0000","last_peered":"2024-09-13T06:13:25.907022+0000","last_clean":"2024-09-13T06:13:25.907022+0000","last_became_active":"2024-09-13T06:09:36.153614+0000","last_became_peered":"2024-09-13T06:09:36.153614+0000","last_unstale":"2024-09-13T06:13:25.907022+0000","last_undegraded":"2024-09-13T06:13:25.907022+0000","last_fullsized":"2024-09-13T06:13:25.907022+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:25.906744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:25.906744+0000","last_clean_scrub_stamp":"2024-09-13T06:13:25.906744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:08:19.863549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"35'48","reported_seq":108,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:31.203250+0000","last_change":"2024-09-13T06:13:31.203250+0000","last_active":"2024-09-13T06:13:31.203250+0000","last_peered":"2024-09-13T06:13:31.203250+0000","last_clean":"2024-09-13T06:13:31.203250+0000","last_became_active":"2024-09-13T06:09:38.155463+0000","last_became_peered":"2024-09-13T06:09:38.155463+0000","last_unstale":"2024-09-13T06:13:31.203250+0000","last_undegraded":"2024-09-13T06:13:31.203250+0000","last_fullsized":"2024-09-13T06:13:31.203250+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'48","last_scrub_stamp":"2024-09-13T06:13:31.202979+0000","last_deep_scrub":"35'48","last_deep_scrub_stamp":"2024-09-13T06:13:31.202979+0000","last_clean_scrub_stamp":"2024-09-13T06:13:31.202979+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:07:14.216978+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:27.404848+0000","last_change":"2024-09-13T06:13:27.404848+0000","last_active":"2024-09-13T06:13:27.404848+0000","last_peered":"2024-09-13T06:13:27.404848+0000","last_clean":"2024-09-13T06:13:27.404848+0000","last_became_active":"2024-09-13T06:09:40.167733+0000","last_became_peered":"2024-09-13T06:09:40.167733+0000","last_unstale":"2024-09-13T06:13:27.404848+0000","last_undegraded":"2024-09-13T06:13:27.404848+0000","last_fullsized":"2024-09-13T06:13:27.404848+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:27.404612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:27.404612+0000","last_clean_scrub_stamp":"2024-09-13T06:13:27.404612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:53:51.661686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"35'7","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:53.145831+0000","last_change":"2024-09-13T06:13:53.145895+0000","last_active":"2024-09-13T06:13:53.145831+0000","last_peered":"2024-09-13T06:13:53.145831+0000","last_clean":"2024-09-13T06:13:53.145831+0000","last_became_active":"2024-09-13T06:09:42.172937+0000","last_became_peered":"2024-09-13T06:09:42.172937+0000","last_unstale":"2024-09-13T06:13:53.145831+0000","last_undegraded":"2024-09-13T06:13:53.145831+0000","last_fullsized":"2024-09-13T06:13:53.145831+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'7","last_scrub_stamp":"2024-09-13T06:13:53.145587+0000","last_deep_scrub":"35'7","last_deep_scrub_stamp":"2024-09-13T06:13:53.145587+0000","last_clean_scrub_stamp":"2024-09-13T06:13:53.145587+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:03:35.737707+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"35'12","reported_seq":87,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:41.783938+0000","last_change":"2024-09-13T06:13:41.783938+0000","last_active":"2024-09-13T06:13:41.783938+0000","last_peered":"2024-09-13T06:13:41.783938+0000","last_clean":"2024-09-13T06:13:41.783938+0000","last_became_active":"2024-09-13T06:09:34.131113+0000","last_became_peered":"2024-09-13T06:09:34.131113+0000","last_unstale":"2024-09-13T06:13:41.783938+0000","last_undegraded":"2024-09-13T06:13:41.783938+0000","last_fullsized":"2024-09-13T06:13:41.783938+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'12","last_scrub_stamp":"2024-09-13T06:13:41.783695+0000","last_deep_scrub":"35'12","last_deep_scrub_stamp":"2024-09-13T06:13:41.783695+0000","last_clean_scrub_stamp":"2024-09-13T06:13:41.783695+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:56:08.039276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":60,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"35'119","reported_seq":217,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:11.124120+0000","last_change":"2024-09-13T06:14:11.124200+0000","last_active":"2024-09-13T06:14:11.124120+0000","last_peered":"2024-09-13T06:14:11.124120+0000","last_clean":"2024-09-13T06:14:11.124120+0000","last_became_active":"2024-09-13T06:09:19.561434+0000","last_became_peered":"2024-09-13T06:09:19.561434+0000","last_unstale":"2024-09-13T06:14:11.124120+0000","last_undegraded":"2024-09-13T06:14:11.124120+0000","last_fullsized":"2024-09-13T06:14:11.124120+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'119","last_scrub_stamp":"2024-09-13T06:14:11.123931+0000","last_deep_scrub":"35'119","last_deep_scrub_stamp":"2024-09-13T06:14:11.123931+0000","last_clean_scrub_stamp":"2024-09-13T06:14:11.123931+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:33:15.905969+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.440124+0000","last_change":"2024-09-13T06:09:24.220777+0000","last_active":"2024-09-13T06:13:25.440124+0000","last_peered":"2024-09-13T06:13:25.440124+0000","last_clean":"2024-09-13T06:13:25.440124+0000","last_became_active":"2024-09-13T06:09:22.217131+0000","last_became_peered":"2024-09-13T06:09:22.217131+0000","last_unstale":"2024-09-13T06:13:25.440124+0000","last_undegraded":"2024-09-13T06:13:25.440124+0000","last_fullsized":"2024-09-13T06:13:25.440124+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_clean_scrub_stamp":"2024-09-13T06:09:21.188659+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090967000000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"35'4","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:13.937126+0000","last_change":"2024-09-13T06:14:13.937187+0000","last_active":"2024-09-13T06:14:13.937126+0000","last_peered":"2024-09-13T06:14:13.937126+0000","last_clean":"2024-09-13T06:14:13.937126+0000","last_became_active":"2024-09-13T06:09:32.141646+0000","last_became_peered":"2024-09-13T06:09:32.141646+0000","last_unstale":"2024-09-13T06:14:13.937126+0000","last_undegraded":"2024-09-13T06:14:13.937126+0000","last_fullsized":"2024-09-13T06:14:13.937126+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:14:13.936858+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:14:13.936858+0000","last_clean_scrub_stamp":"2024-09-13T06:14:13.936858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:04:46.119839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:35.101614+0000","last_change":"2024-09-13T06:13:35.101614+0000","last_active":"2024-09-13T06:13:35.101614+0000","last_peered":"2024-09-13T06:13:35.101614+0000","last_clean":"2024-09-13T06:13:35.101614+0000","last_became_active":"2024-09-13T06:09:36.140417+0000","last_became_peered":"2024-09-13T06:09:36.140417+0000","last_unstale":"2024-09-13T06:13:35.101614+0000","last_undegraded":"2024-09-13T06:13:35.101614+0000","last_fullsized":"2024-09-13T06:13:35.101614+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:35.101340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:35.101340+0000","last_clean_scrub_stamp":"2024-09-13T06:13:35.101340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:29:39.130402+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"35'90","reported_seq":181,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:53.943462+0000","last_change":"2024-09-13T06:13:53.943462+0000","last_active":"2024-09-13T06:13:53.943462+0000","last_peered":"2024-09-13T06:13:53.943462+0000","last_clean":"2024-09-13T06:13:53.943462+0000","last_became_active":"2024-09-13T06:09:38.176365+0000","last_became_peered":"2024-09-13T06:09:38.176365+0000","last_unstale":"2024-09-13T06:13:53.943462+0000","last_undegraded":"2024-09-13T06:13:53.943462+0000","last_fullsized":"2024-09-13T06:13:53.943462+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'90","last_scrub_stamp":"2024-09-13T06:13:53.943088+0000","last_deep_scrub":"35'90","last_deep_scrub_stamp":"2024-09-13T06:13:53.943088+0000","last_clean_scrub_stamp":"2024-09-13T06:13:53.943088+0000","objects_scrubbed":5,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:10:02.356345+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:44.206956+0000","last_change":"2024-09-13T06:13:44.206956+0000","last_active":"2024-09-13T06:13:44.206956+0000","last_peered":"2024-09-13T06:13:44.206956+0000","last_clean":"2024-09-13T06:13:44.206956+0000","last_became_active":"2024-09-13T06:09:40.178872+0000","last_became_peered":"2024-09-13T06:09:40.178872+0000","last_unstale":"2024-09-13T06:13:44.206956+0000","last_undegraded":"2024-09-13T06:13:44.206956+0000","last_fullsized":"2024-09-13T06:13:44.206956+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:44.206706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:44.206706+0000","last_clean_scrub_stamp":"2024-09-13T06:13:44.206706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:34:21.273218+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"35'82","reported_seq":173,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:36.470775+0000","last_change":"2024-09-13T06:13:36.470775+0000","last_active":"2024-09-13T06:13:36.470775+0000","last_peered":"2024-09-13T06:13:36.470775+0000","last_clean":"2024-09-13T06:13:36.470775+0000","last_became_active":"2024-09-13T06:09:42.197803+0000","last_became_peered":"2024-09-13T06:09:42.197803+0000","last_unstale":"2024-09-13T06:13:36.470775+0000","last_undegraded":"2024-09-13T06:13:36.470775+0000","last_fullsized":"2024-09-13T06:13:36.470775+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'82","last_scrub_stamp":"2024-09-13T06:13:36.470522+0000","last_deep_scrub":"35'82","last_deep_scrub_stamp":"2024-09-13T06:13:36.470522+0000","last_clean_scrub_stamp":"2024-09-13T06:13:36.470522+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:55:18.490378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"35'10","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:21.656738+0000","last_change":"2024-09-13T06:14:21.656806+0000","last_active":"2024-09-13T06:14:21.656738+0000","last_peered":"2024-09-13T06:14:21.656738+0000","last_clean":"2024-09-13T06:14:21.656738+0000","last_became_active":"2024-09-13T06:10:10.941771+0000","last_became_peered":"2024-09-13T06:10:10.941771+0000","last_unstale":"2024-09-13T06:14:21.656738+0000","last_undegraded":"2024-09-13T06:14:21.656738+0000","last_fullsized":"2024-09-13T06:14:21.656738+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-09-13T06:14:21.656523+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-09-13T06:14:21.656523+0000","last_clean_scrub_stamp":"2024-09-13T06:14:21.656523+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:16:54.029670+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:22.830335+0000","last_change":"2024-09-13T06:09:24.220722+0000","last_active":"2024-09-13T06:13:22.830335+0000","last_peered":"2024-09-13T06:13:22.830335+0000","last_clean":"2024-09-13T06:13:22.830335+0000","last_became_active":"2024-09-13T06:09:22.217643+0000","last_became_peered":"2024-09-13T06:09:22.217643+0000","last_unstale":"2024-09-13T06:13:22.830335+0000","last_undegraded":"2024-09-13T06:13:22.830335+0000","last_fullsized":"2024-09-13T06:13:22.830335+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_clean_scrub_stamp":"2024-09-13T06:09:21.188659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082521999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"35'2","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:04.995337+0000","last_change":"2024-09-13T06:14:04.995517+0000","last_active":"2024-09-13T06:14:04.995337+0000","last_peered":"2024-09-13T06:14:04.995337+0000","last_clean":"2024-09-13T06:14:04.995337+0000","last_became_active":"2024-09-13T06:09:32.147837+0000","last_became_peered":"2024-09-13T06:09:32.147837+0000","last_unstale":"2024-09-13T06:14:04.995337+0000","last_undegraded":"2024-09-13T06:14:04.995337+0000","last_fullsized":"2024-09-13T06:14:04.995337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:04.995114+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:04.995114+0000","last_clean_scrub_stamp":"2024-09-13T06:14:04.995114+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:15:29.178549+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:28.911118+0000","last_change":"2024-09-13T06:13:28.911118+0000","last_active":"2024-09-13T06:13:28.911118+0000","last_peered":"2024-09-13T06:13:28.911118+0000","last_clean":"2024-09-13T06:13:28.911118+0000","last_became_active":"2024-09-13T06:09:36.153430+0000","last_became_peered":"2024-09-13T06:09:36.153430+0000","last_unstale":"2024-09-13T06:13:28.911118+0000","last_undegraded":"2024-09-13T06:13:28.911118+0000","last_fullsized":"2024-09-13T06:13:28.911118+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:28.910878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:28.910878+0000","last_clean_scrub_stamp":"2024-09-13T06:13:28.910878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:38:20.711196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"35'291","reported_seq":518,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:30.250325+0000","last_change":"2024-09-13T06:13:30.250325+0000","last_active":"2024-09-13T06:13:30.250325+0000","last_peered":"2024-09-13T06:13:30.250325+0000","last_clean":"2024-09-13T06:13:30.250325+0000","last_became_active":"2024-09-13T06:09:38.160192+0000","last_became_peered":"2024-09-13T06:09:38.160192+0000","last_unstale":"2024-09-13T06:13:30.250325+0000","last_undegraded":"2024-09-13T06:13:30.250325+0000","last_fullsized":"2024-09-13T06:13:30.250325+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'291","last_scrub_stamp":"2024-09-13T06:13:30.250026+0000","last_deep_scrub":"35'291","last_deep_scrub_stamp":"2024-09-13T06:13:30.250026+0000","last_clean_scrub_stamp":"2024-09-13T06:13:30.250026+0000","objects_scrubbed":10,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:19:15.055011+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:51.890848+0000","last_change":"2024-09-13T06:13:51.890848+0000","last_active":"2024-09-13T06:13:51.890848+0000","last_peered":"2024-09-13T06:13:51.890848+0000","last_clean":"2024-09-13T06:13:51.890848+0000","last_became_active":"2024-09-13T06:09:40.188859+0000","last_became_peered":"2024-09-13T06:09:40.188859+0000","last_unstale":"2024-09-13T06:13:51.890848+0000","last_undegraded":"2024-09-13T06:13:51.890848+0000","last_fullsized":"2024-09-13T06:13:51.890848+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:51.890601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:51.890601+0000","last_clean_scrub_stamp":"2024-09-13T06:13:51.890601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:55:29.874902+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"35'5","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:24.521719+0000","last_change":"2024-09-13T06:09:42.205523+0000","last_active":"2024-09-13T06:13:24.521719+0000","last_peered":"2024-09-13T06:13:24.521719+0000","last_clean":"2024-09-13T06:13:24.521719+0000","last_became_active":"2024-09-13T06:09:42.204736+0000","last_became_peered":"2024-09-13T06:09:42.204736+0000","last_unstale":"2024-09-13T06:13:24.521719+0000","last_undegraded":"2024-09-13T06:13:24.521719+0000","last_fullsized":"2024-09-13T06:13:24.521719+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"35'8","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:49.136585+0000","last_change":"2024-09-13T06:13:49.136585+0000","last_active":"2024-09-13T06:13:49.136585+0000","last_peered":"2024-09-13T06:13:49.136585+0000","last_clean":"2024-09-13T06:13:49.136585+0000","last_became_active":"2024-09-13T06:09:34.131564+0000","last_became_peered":"2024-09-13T06:09:34.131564+0000","last_unstale":"2024-09-13T06:13:49.136585+0000","last_undegraded":"2024-09-13T06:13:49.136585+0000","last_fullsized":"2024-09-13T06:13:49.136585+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-13T06:13:49.136299+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-13T06:13:49.136299+0000","last_clean_scrub_stamp":"2024-09-13T06:13:49.136299+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:11:56.625206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":62,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:06.429945+0000","last_change":"2024-09-13T06:14:06.429996+0000","last_active":"2024-09-13T06:14:06.429945+0000","last_peered":"2024-09-13T06:14:06.429945+0000","last_clean":"2024-09-13T06:14:06.429945+0000","last_became_active":"2024-09-13T06:09:22.214952+0000","last_became_peered":"2024-09-13T06:09:22.214952+0000","last_unstale":"2024-09-13T06:14:06.429945+0000","last_undegraded":"2024-09-13T06:14:06.429945+0000","last_fullsized":"2024-09-13T06:14:06.429945+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:06.429751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:06.429751+0000","last_clean_scrub_stamp":"2024-09-13T06:14:06.429751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:38:36.699202+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00097860299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:59.106249+0000","last_change":"2024-09-13T06:13:59.106380+0000","last_active":"2024-09-13T06:13:59.106249+0000","last_peered":"2024-09-13T06:13:59.106249+0000","last_clean":"2024-09-13T06:13:59.106249+0000","last_became_active":"2024-09-13T06:09:32.148803+0000","last_became_peered":"2024-09-13T06:09:32.148803+0000","last_unstale":"2024-09-13T06:13:59.106249+0000","last_undegraded":"2024-09-13T06:13:59.106249+0000","last_fullsized":"2024-09-13T06:13:59.106249+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:59.105957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:59.105957+0000","last_clean_scrub_stamp":"2024-09-13T06:13:59.105957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:47:01.112409+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:47.511185+0000","last_change":"2024-09-13T06:13:47.511185+0000","last_active":"2024-09-13T06:13:47.511185+0000","last_peered":"2024-09-13T06:13:47.511185+0000","last_clean":"2024-09-13T06:13:47.511185+0000","last_became_active":"2024-09-13T06:09:36.126497+0000","last_became_peered":"2024-09-13T06:09:36.126497+0000","last_unstale":"2024-09-13T06:13:47.511185+0000","last_undegraded":"2024-09-13T06:13:47.511185+0000","last_fullsized":"2024-09-13T06:13:47.511185+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:13:47.510914+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:13:47.510914+0000","last_clean_scrub_stamp":"2024-09-13T06:13:47.510914+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:50:58.108495+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"35'24","reported_seq":103,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:33.428736+0000","last_change":"2024-09-13T06:13:33.428736+0000","last_active":"2024-09-13T06:13:33.428736+0000","last_peered":"2024-09-13T06:13:33.428736+0000","last_clean":"2024-09-13T06:13:33.428736+0000","last_became_active":"2024-09-13T06:09:38.162358+0000","last_became_peered":"2024-09-13T06:09:38.162358+0000","last_unstale":"2024-09-13T06:13:33.428736+0000","last_undegraded":"2024-09-13T06:13:33.428736+0000","last_fullsized":"2024-09-13T06:13:33.428736+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'24","last_scrub_stamp":"2024-09-13T06:13:33.428464+0000","last_deep_scrub":"35'24","last_deep_scrub_stamp":"2024-09-13T06:13:33.428464+0000","last_clean_scrub_stamp":"2024-09-13T06:13:33.428464+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:54:34.152803+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:40.255183+0000","last_change":"2024-09-13T06:13:40.255183+0000","last_active":"2024-09-13T06:13:40.255183+0000","last_peered":"2024-09-13T06:13:40.255183+0000","last_clean":"2024-09-13T06:13:40.255183+0000","last_became_active":"2024-09-13T06:09:40.179250+0000","last_became_peered":"2024-09-13T06:09:40.179250+0000","last_unstale":"2024-09-13T06:13:40.255183+0000","last_undegraded":"2024-09-13T06:13:40.255183+0000","last_fullsized":"2024-09-13T06:13:40.255183+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:40.254851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:40.254851+0000","last_clean_scrub_stamp":"2024-09-13T06:13:40.254851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:54:39.886202+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"33'2","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.443108+0000","last_change":"2024-09-13T06:09:42.203843+0000","last_active":"2024-09-13T06:13:25.443108+0000","last_peered":"2024-09-13T06:13:25.443108+0000","last_clean":"2024-09-13T06:13:25.443108+0000","last_became_active":"2024-09-13T06:09:42.203232+0000","last_became_peered":"2024-09-13T06:09:42.203232+0000","last_unstale":"2024-09-13T06:13:25.443108+0000","last_undegraded":"2024-09-13T06:13:25.443108+0000","last_fullsized":"2024-09-13T06:13:25.443108+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"35'6","reported_seq":59,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:02.039645+0000","last_change":"2024-09-13T06:14:02.039712+0000","last_active":"2024-09-13T06:14:02.039645+0000","last_peered":"2024-09-13T06:14:02.039645+0000","last_clean":"2024-09-13T06:14:02.039645+0000","last_became_active":"2024-09-13T06:09:34.113002+0000","last_became_peered":"2024-09-13T06:09:34.113002+0000","last_unstale":"2024-09-13T06:14:02.039645+0000","last_undegraded":"2024-09-13T06:14:02.039645+0000","last_fullsized":"2024-09-13T06:14:02.039645+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:14:02.039450+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:14:02.039450+0000","last_clean_scrub_stamp":"2024-09-13T06:14:02.039450+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:56:20.449806+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.440093+0000","last_change":"2024-09-13T06:09:24.222172+0000","last_active":"2024-09-13T06:13:25.440093+0000","last_peered":"2024-09-13T06:13:25.440093+0000","last_clean":"2024-09-13T06:13:25.440093+0000","last_became_active":"2024-09-13T06:09:22.217581+0000","last_became_peered":"2024-09-13T06:09:22.217581+0000","last_unstale":"2024-09-13T06:13:25.440093+0000","last_undegraded":"2024-09-13T06:13:25.440093+0000","last_fullsized":"2024-09-13T06:13:25.440093+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_clean_scrub_stamp":"2024-09-13T06:09:21.188659+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022711580000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:59.389088+0000","last_change":"2024-09-13T06:13:59.389148+0000","last_active":"2024-09-13T06:13:59.389088+0000","last_peered":"2024-09-13T06:13:59.389088+0000","last_clean":"2024-09-13T06:13:59.389088+0000","last_became_active":"2024-09-13T06:09:32.138838+0000","last_became_peered":"2024-09-13T06:09:32.138838+0000","last_unstale":"2024-09-13T06:13:59.389088+0000","last_undegraded":"2024-09-13T06:13:59.389088+0000","last_fullsized":"2024-09-13T06:13:59.389088+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:59.388824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:59.388824+0000","last_clean_scrub_stamp":"2024-09-13T06:13:59.388824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:54:30.824903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:18.615698+0000","last_change":"2024-09-13T06:14:18.615698+0000","last_active":"2024-09-13T06:14:18.615698+0000","last_peered":"2024-09-13T06:14:18.615698+0000","last_clean":"2024-09-13T06:14:18.615698+0000","last_became_active":"2024-09-13T06:10:10.809216+0000","last_became_peered":"2024-09-13T06:10:10.809216+0000","last_unstale":"2024-09-13T06:14:18.615698+0000","last_undegraded":"2024-09-13T06:14:18.615698+0000","last_fullsized":"2024-09-13T06:14:18.615698+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:18.615450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:18.615450+0000","last_clean_scrub_stamp":"2024-09-13T06:14:18.615450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:29:37.013948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"35'20","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:49.867101+0000","last_change":"2024-09-13T06:13:49.867101+0000","last_active":"2024-09-13T06:13:49.867101+0000","last_peered":"2024-09-13T06:13:49.867101+0000","last_clean":"2024-09-13T06:13:49.867101+0000","last_became_active":"2024-09-13T06:09:38.176307+0000","last_became_peered":"2024-09-13T06:09:38.176307+0000","last_unstale":"2024-09-13T06:13:49.867101+0000","last_undegraded":"2024-09-13T06:13:49.867101+0000","last_fullsized":"2024-09-13T06:13:49.867101+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'20","last_scrub_stamp":"2024-09-13T06:13:49.866714+0000","last_deep_scrub":"35'20","last_deep_scrub_stamp":"2024-09-13T06:13:49.866714+0000","last_clean_scrub_stamp":"2024-09-13T06:13:49.866714+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:43:14.509705+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:47.833648+0000","last_change":"2024-09-13T06:13:47.833648+0000","last_active":"2024-09-13T06:13:47.833648+0000","last_peered":"2024-09-13T06:13:47.833648+0000","last_clean":"2024-09-13T06:13:47.833648+0000","last_became_active":"2024-09-13T06:09:40.189259+0000","last_became_peered":"2024-09-13T06:09:40.189259+0000","last_unstale":"2024-09-13T06:13:47.833648+0000","last_undegraded":"2024-09-13T06:13:47.833648+0000","last_fullsized":"2024-09-13T06:13:47.833648+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:47.833278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:47.833278+0000","last_clean_scrub_stamp":"2024-09-13T06:13:47.833278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:53:00.141037+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"35'4","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:22.099848+0000","last_change":"2024-09-13T06:14:22.099980+0000","last_active":"2024-09-13T06:14:22.099848+0000","last_peered":"2024-09-13T06:14:22.099848+0000","last_clean":"2024-09-13T06:14:22.099848+0000","last_became_active":"2024-09-13T06:09:42.185210+0000","last_became_peered":"2024-09-13T06:09:42.185210+0000","last_unstale":"2024-09-13T06:14:22.099848+0000","last_undegraded":"2024-09-13T06:14:22.099848+0000","last_fullsized":"2024-09-13T06:14:22.099848+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:14:22.099618+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:14:22.099618+0000","last_clean_scrub_stamp":"2024-09-13T06:14:22.099618+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:33:12.893491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"35'4","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:54.120718+0000","last_change":"2024-09-13T06:13:54.120789+0000","last_active":"2024-09-13T06:13:54.120718+0000","last_peered":"2024-09-13T06:13:54.120718+0000","last_clean":"2024-09-13T06:13:54.120718+0000","last_became_active":"2024-09-13T06:09:34.119283+0000","last_became_peered":"2024-09-13T06:09:34.119283+0000","last_unstale":"2024-09-13T06:13:54.120718+0000","last_undegraded":"2024-09-13T06:13:54.120718+0000","last_fullsized":"2024-09-13T06:13:54.120718+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:13:54.120527+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:13:54.120527+0000","last_clean_scrub_stamp":"2024-09-13T06:13:54.120527+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:35:15.451075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"35'2","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:57.405089+0000","last_change":"2024-09-13T06:13:57.405153+0000","last_active":"2024-09-13T06:13:57.405089+0000","last_peered":"2024-09-13T06:13:57.405089+0000","last_clean":"2024-09-13T06:13:57.405089+0000","last_became_active":"2024-09-13T06:09:32.139313+0000","last_became_peered":"2024-09-13T06:09:32.139313+0000","last_unstale":"2024-09-13T06:13:57.405089+0000","last_undegraded":"2024-09-13T06:13:57.405089+0000","last_fullsized":"2024-09-13T06:13:57.405089+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:13:57.404830+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:13:57.404830+0000","last_clean_scrub_stamp":"2024-09-13T06:13:57.404830+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:04:45.319192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:09.975877+0000","last_change":"2024-09-13T06:14:09.975989+0000","last_active":"2024-09-13T06:14:09.975877+0000","last_peered":"2024-09-13T06:14:09.975877+0000","last_clean":"2024-09-13T06:14:09.975877+0000","last_became_active":"2024-09-13T06:09:22.216659+0000","last_became_peered":"2024-09-13T06:09:22.216659+0000","last_unstale":"2024-09-13T06:14:09.975877+0000","last_undegraded":"2024-09-13T06:14:09.975877+0000","last_fullsized":"2024-09-13T06:14:09.975877+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:09.975665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:09.975665+0000","last_clean_scrub_stamp":"2024-09-13T06:14:09.975665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:35:05.023936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010625330000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:46.126854+0000","last_change":"2024-09-13T06:13:46.126916+0000","last_active":"2024-09-13T06:13:46.126854+0000","last_peered":"2024-09-13T06:13:46.126854+0000","last_clean":"2024-09-13T06:13:46.126854+0000","last_became_active":"2024-09-13T06:09:36.132376+0000","last_became_peered":"2024-09-13T06:09:36.132376+0000","last_unstale":"2024-09-13T06:13:46.126854+0000","last_undegraded":"2024-09-13T06:13:46.126854+0000","last_fullsized":"2024-09-13T06:13:46.126854+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:13:46.126675+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:13:46.126675+0000","last_clean_scrub_stamp":"2024-09-13T06:13:46.126675+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:05:41.556048+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"35'74","reported_seq":151,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:33.324338+0000","last_change":"2024-09-13T06:13:33.324338+0000","last_active":"2024-09-13T06:13:33.324338+0000","last_peered":"2024-09-13T06:13:33.324338+0000","last_clean":"2024-09-13T06:13:33.324338+0000","last_became_active":"2024-09-13T06:09:38.157579+0000","last_became_peered":"2024-09-13T06:09:38.157579+0000","last_unstale":"2024-09-13T06:13:33.324338+0000","last_undegraded":"2024-09-13T06:13:33.324338+0000","last_fullsized":"2024-09-13T06:13:33.324338+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'74","last_scrub_stamp":"2024-09-13T06:13:33.324060+0000","last_deep_scrub":"35'74","last_deep_scrub_stamp":"2024-09-13T06:13:33.324060+0000","last_clean_scrub_stamp":"2024-09-13T06:13:33.324060+0000","objects_scrubbed":9,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:44:12.725129+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:28.380182+0000","last_change":"2024-09-13T06:13:28.380182+0000","last_active":"2024-09-13T06:13:28.380182+0000","last_peered":"2024-09-13T06:13:28.380182+0000","last_clean":"2024-09-13T06:13:28.380182+0000","last_became_active":"2024-09-13T06:09:40.185234+0000","last_became_peered":"2024-09-13T06:09:40.185234+0000","last_unstale":"2024-09-13T06:13:28.380182+0000","last_undegraded":"2024-09-13T06:13:28.380182+0000","last_fullsized":"2024-09-13T06:13:28.380182+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:28.379942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:28.379942+0000","last_clean_scrub_stamp":"2024-09-13T06:13:28.379942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:42:49.566445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"35'11","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:52.119845+0000","last_change":"2024-09-13T06:13:52.119845+0000","last_active":"2024-09-13T06:13:52.119845+0000","last_peered":"2024-09-13T06:13:52.119845+0000","last_clean":"2024-09-13T06:13:52.119845+0000","last_became_active":"2024-09-13T06:09:42.170302+0000","last_became_peered":"2024-09-13T06:09:42.170302+0000","last_unstale":"2024-09-13T06:13:52.119845+0000","last_undegraded":"2024-09-13T06:13:52.119845+0000","last_fullsized":"2024-09-13T06:13:52.119845+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'11","last_scrub_stamp":"2024-09-13T06:13:52.119492+0000","last_deep_scrub":"35'11","last_deep_scrub_stamp":"2024-09-13T06:13:52.119492+0000","last_clean_scrub_stamp":"2024-09-13T06:13:52.119492+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:05:49.867986+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":25,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"35'10","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:52.096124+0000","last_change":"2024-09-13T06:13:52.096242+0000","last_active":"2024-09-13T06:13:52.096124+0000","last_peered":"2024-09-13T06:13:52.096124+0000","last_clean":"2024-09-13T06:13:52.096124+0000","last_became_active":"2024-09-13T06:09:34.121836+0000","last_became_peered":"2024-09-13T06:09:34.121836+0000","last_unstale":"2024-09-13T06:13:52.096124+0000","last_undegraded":"2024-09-13T06:13:52.096124+0000","last_fullsized":"2024-09-13T06:13:52.096124+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-09-13T06:13:52.095831+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-09-13T06:13:52.095831+0000","last_clean_scrub_stamp":"2024-09-13T06:13:52.095831+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:38:45.110796+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:14.961334+0000","last_change":"2024-09-13T06:14:14.961395+0000","last_active":"2024-09-13T06:14:14.961334+0000","last_peered":"2024-09-13T06:14:14.961334+0000","last_clean":"2024-09-13T06:14:14.961334+0000","last_became_active":"2024-09-13T06:09:32.136238+0000","last_became_peered":"2024-09-13T06:09:32.136238+0000","last_unstale":"2024-09-13T06:14:14.961334+0000","last_undegraded":"2024-09-13T06:14:14.961334+0000","last_fullsized":"2024-09-13T06:14:14.961334+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:14.961141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:14.961141+0000","last_clean_scrub_stamp":"2024-09-13T06:14:14.961141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:51:38.057927+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.440104+0000","last_change":"2024-09-13T06:09:24.221355+0000","last_active":"2024-09-13T06:13:25.440104+0000","last_peered":"2024-09-13T06:13:25.440104+0000","last_clean":"2024-09-13T06:13:25.440104+0000","last_became_active":"2024-09-13T06:09:22.217809+0000","last_became_peered":"2024-09-13T06:09:22.217809+0000","last_unstale":"2024-09-13T06:13:25.440104+0000","last_undegraded":"2024-09-13T06:13:25.440104+0000","last_fullsized":"2024-09-13T06:13:25.440104+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_clean_scrub_stamp":"2024-09-13T06:09:21.188659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001447545,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:33.855853+0000","last_change":"2024-09-13T06:13:33.855853+0000","last_active":"2024-09-13T06:13:33.855853+0000","last_peered":"2024-09-13T06:13:33.855853+0000","last_clean":"2024-09-13T06:13:33.855853+0000","last_became_active":"2024-09-13T06:09:36.151605+0000","last_became_peered":"2024-09-13T06:09:36.151605+0000","last_unstale":"2024-09-13T06:13:33.855853+0000","last_undegraded":"2024-09-13T06:13:33.855853+0000","last_fullsized":"2024-09-13T06:13:33.855853+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:33.855604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:33.855604+0000","last_clean_scrub_stamp":"2024-09-13T06:13:33.855604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:30:58.639342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"35'22","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:26.304189+0000","last_change":"2024-09-13T06:13:26.304189+0000","last_active":"2024-09-13T06:13:26.304189+0000","last_peered":"2024-09-13T06:13:26.304189+0000","last_clean":"2024-09-13T06:13:26.304189+0000","last_became_active":"2024-09-13T06:09:38.165916+0000","last_became_peered":"2024-09-13T06:09:38.165916+0000","last_unstale":"2024-09-13T06:13:26.304189+0000","last_undegraded":"2024-09-13T06:13:26.304189+0000","last_fullsized":"2024-09-13T06:13:26.304189+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'22","last_scrub_stamp":"2024-09-13T06:13:26.303565+0000","last_deep_scrub":"35'22","last_deep_scrub_stamp":"2024-09-13T06:13:26.303565+0000","last_clean_scrub_stamp":"2024-09-13T06:13:26.303565+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:32:31.420814+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"35'285","reported_seq":360,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:37.090244+0000","last_change":"2024-09-13T06:13:37.090244+0000","last_active":"2024-09-13T06:13:37.090244+0000","last_peered":"2024-09-13T06:13:37.090244+0000","last_clean":"2024-09-13T06:13:37.090244+0000","last_became_active":"2024-09-13T06:09:40.181415+0000","last_became_peered":"2024-09-13T06:09:40.181415+0000","last_unstale":"2024-09-13T06:13:37.090244+0000","last_undegraded":"2024-09-13T06:13:37.090244+0000","last_fullsized":"2024-09-13T06:13:37.090244+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-13T06:13:37.089987+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-13T06:13:37.089987+0000","last_clean_scrub_stamp":"2024-09-13T06:13:37.089987+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:47:34.898773+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:03.940309+0000","last_change":"2024-09-13T06:14:03.940309+0000","last_active":"2024-09-13T06:14:03.940309+0000","last_peered":"2024-09-13T06:14:03.940309+0000","last_clean":"2024-09-13T06:14:03.940309+0000","last_became_active":"2024-09-13T06:09:42.194558+0000","last_became_peered":"2024-09-13T06:09:42.194558+0000","last_unstale":"2024-09-13T06:14:03.940309+0000","last_undegraded":"2024-09-13T06:14:03.940309+0000","last_fullsized":"2024-09-13T06:14:03.940309+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:03.940064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:03.940064+0000","last_clean_scrub_stamp":"2024-09-13T06:14:03.940064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:19:29.892551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"35'6","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:19.625931+0000","last_change":"2024-09-13T06:14:19.626067+0000","last_active":"2024-09-13T06:14:19.625931+0000","last_peered":"2024-09-13T06:14:19.625931+0000","last_clean":"2024-09-13T06:14:19.625931+0000","last_became_active":"2024-09-13T06:10:10.813656+0000","last_became_peered":"2024-09-13T06:10:10.813656+0000","last_unstale":"2024-09-13T06:14:19.625931+0000","last_undegraded":"2024-09-13T06:14:19.625931+0000","last_fullsized":"2024-09-13T06:14:19.625931+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:14:19.625685+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:14:19.625685+0000","last_clean_scrub_stamp":"2024-09-13T06:14:19.625685+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:06:50.177490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:21.892437+0000","last_change":"2024-09-13T06:14:21.892499+0000","last_active":"2024-09-13T06:14:21.892437+0000","last_peered":"2024-09-13T06:14:21.892437+0000","last_clean":"2024-09-13T06:14:21.892437+0000","last_became_active":"2024-09-13T06:09:32.130385+0000","last_became_peered":"2024-09-13T06:09:32.130385+0000","last_unstale":"2024-09-13T06:14:21.892437+0000","last_undegraded":"2024-09-13T06:14:21.892437+0000","last_fullsized":"2024-09-13T06:14:21.892437+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:21.892222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:21.892222+0000","last_clean_scrub_stamp":"2024-09-13T06:14:21.892222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:46:35.502960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:10.929954+0000","last_change":"2024-09-13T06:14:10.930007+0000","last_active":"2024-09-13T06:14:10.929954+0000","last_peered":"2024-09-13T06:14:10.929954+0000","last_clean":"2024-09-13T06:14:10.929954+0000","last_became_active":"2024-09-13T06:09:22.216905+0000","last_became_peered":"2024-09-13T06:09:22.216905+0000","last_unstale":"2024-09-13T06:14:10.929954+0000","last_undegraded":"2024-09-13T06:14:10.929954+0000","last_fullsized":"2024-09-13T06:14:10.929954+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:10.929727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:10.929727+0000","last_clean_scrub_stamp":"2024-09-13T06:14:10.929727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:09:22.730266+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001005588,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:32.824584+0000","last_change":"2024-09-13T06:13:32.824584+0000","last_active":"2024-09-13T06:13:32.824584+0000","last_peered":"2024-09-13T06:13:32.824584+0000","last_clean":"2024-09-13T06:13:32.824584+0000","last_became_active":"2024-09-13T06:09:36.149051+0000","last_became_peered":"2024-09-13T06:09:36.149051+0000","last_unstale":"2024-09-13T06:13:32.824584+0000","last_undegraded":"2024-09-13T06:13:32.824584+0000","last_fullsized":"2024-09-13T06:13:32.824584+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:32.824332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:32.824332+0000","last_clean_scrub_stamp":"2024-09-13T06:13:32.824332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:49:10.096883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"35'15","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:39.760213+0000","last_change":"2024-09-13T06:13:39.760213+0000","last_active":"2024-09-13T06:13:39.760213+0000","last_peered":"2024-09-13T06:13:39.760213+0000","last_clean":"2024-09-13T06:13:39.760213+0000","last_became_active":"2024-09-13T06:09:38.173017+0000","last_became_peered":"2024-09-13T06:09:38.173017+0000","last_unstale":"2024-09-13T06:13:39.760213+0000","last_undegraded":"2024-09-13T06:13:39.760213+0000","last_fullsized":"2024-09-13T06:13:39.760213+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'15","last_scrub_stamp":"2024-09-13T06:13:39.759783+0000","last_deep_scrub":"35'15","last_deep_scrub_stamp":"2024-09-13T06:13:39.759783+0000","last_clean_scrub_stamp":"2024-09-13T06:13:39.759783+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:53:57.061723+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"35'285","reported_seq":403,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:30.299531+0000","last_change":"2024-09-13T06:13:30.299531+0000","last_active":"2024-09-13T06:13:30.299531+0000","last_peered":"2024-09-13T06:13:30.299531+0000","last_clean":"2024-09-13T06:13:30.299531+0000","last_became_active":"2024-09-13T06:09:40.170879+0000","last_became_peered":"2024-09-13T06:09:40.170879+0000","last_unstale":"2024-09-13T06:13:30.299531+0000","last_undegraded":"2024-09-13T06:13:30.299531+0000","last_fullsized":"2024-09-13T06:13:30.299531+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-13T06:13:30.299279+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-13T06:13:30.299279+0000","last_clean_scrub_stamp":"2024-09-13T06:13:30.299279+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:49:19.940955+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"33'3","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:20.142740+0000","last_change":"2024-09-13T06:14:20.142848+0000","last_active":"2024-09-13T06:14:20.142740+0000","last_peered":"2024-09-13T06:14:20.142740+0000","last_clean":"2024-09-13T06:14:20.142740+0000","last_became_active":"2024-09-13T06:09:42.178890+0000","last_became_peered":"2024-09-13T06:09:42.178890+0000","last_unstale":"2024-09-13T06:14:20.142740+0000","last_undegraded":"2024-09-13T06:14:20.142740+0000","last_fullsized":"2024-09-13T06:14:20.142740+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-09-13T06:14:20.142460+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-09-13T06:14:20.142460+0000","last_clean_scrub_stamp":"2024-09-13T06:14:20.142460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:10:28.555717+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"35'4","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:58.403221+0000","last_change":"2024-09-13T06:13:58.403253+0000","last_active":"2024-09-13T06:13:58.403221+0000","last_peered":"2024-09-13T06:13:58.403221+0000","last_clean":"2024-09-13T06:13:58.403221+0000","last_became_active":"2024-09-13T06:09:34.104194+0000","last_became_peered":"2024-09-13T06:09:34.104194+0000","last_unstale":"2024-09-13T06:13:58.403221+0000","last_undegraded":"2024-09-13T06:13:58.403221+0000","last_fullsized":"2024-09-13T06:13:58.403221+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:13:58.403115+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:13:58.403115+0000","last_clean_scrub_stamp":"2024-09-13T06:13:58.403115+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:17:01.119280+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:14.077504+0000","last_change":"2024-09-13T06:14:14.077563+0000","last_active":"2024-09-13T06:14:14.077504+0000","last_peered":"2024-09-13T06:14:14.077504+0000","last_clean":"2024-09-13T06:14:14.077504+0000","last_became_active":"2024-09-13T06:09:32.118386+0000","last_became_peered":"2024-09-13T06:09:32.118386+0000","last_unstale":"2024-09-13T06:14:14.077504+0000","last_undegraded":"2024-09-13T06:14:14.077504+0000","last_fullsized":"2024-09-13T06:14:14.077504+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:14.077297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:14.077297+0000","last_clean_scrub_stamp":"2024-09-13T06:14:14.077297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:17:32.570841+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.440131+0000","last_change":"2024-09-13T06:09:24.222245+0000","last_active":"2024-09-13T06:13:25.440131+0000","last_peered":"2024-09-13T06:13:25.440131+0000","last_clean":"2024-09-13T06:13:25.440131+0000","last_became_active":"2024-09-13T06:09:22.495259+0000","last_became_peered":"2024-09-13T06:09:22.495259+0000","last_unstale":"2024-09-13T06:13:25.440131+0000","last_undegraded":"2024-09-13T06:13:25.440131+0000","last_fullsized":"2024-09-13T06:13:25.440131+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:21.188659+0000","last_clean_scrub_stamp":"2024-09-13T06:09:21.188659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002230409,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:36.776310+0000","last_change":"2024-09-13T06:13:36.776310+0000","last_active":"2024-09-13T06:13:36.776310+0000","last_peered":"2024-09-13T06:13:36.776310+0000","last_clean":"2024-09-13T06:13:36.776310+0000","last_became_active":"2024-09-13T06:09:36.144463+0000","last_became_peered":"2024-09-13T06:09:36.144463+0000","last_unstale":"2024-09-13T06:13:36.776310+0000","last_undegraded":"2024-09-13T06:13:36.776310+0000","last_fullsized":"2024-09-13T06:13:36.776310+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:36.776068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:36.776068+0000","last_clean_scrub_stamp":"2024-09-13T06:13:36.776068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:07:56.568181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"35'96","reported_seq":190,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:34.414511+0000","last_change":"2024-09-13T06:13:34.414511+0000","last_active":"2024-09-13T06:13:34.414511+0000","last_peered":"2024-09-13T06:13:34.414511+0000","last_clean":"2024-09-13T06:13:34.414511+0000","last_became_active":"2024-09-13T06:09:38.158436+0000","last_became_peered":"2024-09-13T06:09:38.158436+0000","last_unstale":"2024-09-13T06:13:34.414511+0000","last_undegraded":"2024-09-13T06:13:34.414511+0000","last_fullsized":"2024-09-13T06:13:34.414511+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'96","last_scrub_stamp":"2024-09-13T06:13:34.414208+0000","last_deep_scrub":"35'96","last_deep_scrub_stamp":"2024-09-13T06:13:34.414208+0000","last_clean_scrub_stamp":"2024-09-13T06:13:34.414208+0000","objects_scrubbed":8,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:05:39.013229+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.290882+0000","last_change":"2024-09-13T06:13:25.290882+0000","last_active":"2024-09-13T06:13:25.290882+0000","last_peered":"2024-09-13T06:13:25.290882+0000","last_clean":"2024-09-13T06:13:25.290882+0000","last_became_active":"2024-09-13T06:09:40.176677+0000","last_became_peered":"2024-09-13T06:09:40.176677+0000","last_unstale":"2024-09-13T06:13:25.290882+0000","last_undegraded":"2024-09-13T06:13:25.290882+0000","last_fullsized":"2024-09-13T06:13:25.290882+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:25.290780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:25.290780+0000","last_clean_scrub_stamp":"2024-09-13T06:13:25.290780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:27:24.453678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:15.505254+0000","last_change":"2024-09-13T06:14:15.505311+0000","last_active":"2024-09-13T06:14:15.505254+0000","last_peered":"2024-09-13T06:14:15.505254+0000","last_clean":"2024-09-13T06:14:15.505254+0000","last_became_active":"2024-09-13T06:09:42.204574+0000","last_became_peered":"2024-09-13T06:09:42.204574+0000","last_unstale":"2024-09-13T06:14:15.505254+0000","last_undegraded":"2024-09-13T06:14:15.505254+0000","last_fullsized":"2024-09-13T06:14:15.505254+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:15.505057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:15.505057+0000","last_clean_scrub_stamp":"2024-09-13T06:14:15.505057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:28:16.831802+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:40.425637+0000","last_change":"2024-09-13T06:13:40.425637+0000","last_active":"2024-09-13T06:13:40.425637+0000","last_peered":"2024-09-13T06:13:40.425637+0000","last_clean":"2024-09-13T06:13:40.425637+0000","last_became_active":"2024-09-13T06:09:42.197788+0000","last_became_peered":"2024-09-13T06:09:42.197788+0000","last_unstale":"2024-09-13T06:13:40.425637+0000","last_undegraded":"2024-09-13T06:13:40.425637+0000","last_fullsized":"2024-09-13T06:13:40.425637+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:40.425298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:40.425298+0000","last_clean_scrub_stamp":"2024-09-13T06:13:40.425298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:01:43.246247+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"35'8","reported_seq":71,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:54.474712+0000","last_change":"2024-09-13T06:13:54.474712+0000","last_active":"2024-09-13T06:13:54.474712+0000","last_peered":"2024-09-13T06:13:54.474712+0000","last_clean":"2024-09-13T06:13:54.474712+0000","last_became_active":"2024-09-13T06:09:34.101193+0000","last_became_peered":"2024-09-13T06:09:34.101193+0000","last_unstale":"2024-09-13T06:13:54.474712+0000","last_undegraded":"2024-09-13T06:13:54.474712+0000","last_fullsized":"2024-09-13T06:13:54.474712+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-13T06:13:54.474414+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-13T06:13:54.474414+0000","last_clean_scrub_stamp":"2024-09-13T06:13:54.474414+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:46:58.633819+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.440724+0000","last_change":"2024-09-13T06:09:32.125105+0000","last_active":"2024-09-13T06:13:25.440724+0000","last_peered":"2024-09-13T06:13:25.440724+0000","last_clean":"2024-09-13T06:13:25.440724+0000","last_became_active":"2024-09-13T06:09:32.124198+0000","last_became_peered":"2024-09-13T06:09:32.124198+0000","last_unstale":"2024-09-13T06:13:25.440724+0000","last_undegraded":"2024-09-13T06:13:25.440724+0000","last_fullsized":"2024-09-13T06:13:25.440724+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:40.103927+0000","last_change":"2024-09-13T06:13:40.103927+0000","last_active":"2024-09-13T06:13:40.103927+0000","last_peered":"2024-09-13T06:13:40.103927+0000","last_clean":"2024-09-13T06:13:40.103927+0000","last_became_active":"2024-09-13T06:09:36.133568+0000","last_became_peered":"2024-09-13T06:09:36.133568+0000","last_unstale":"2024-09-13T06:13:40.103927+0000","last_undegraded":"2024-09-13T06:13:40.103927+0000","last_fullsized":"2024-09-13T06:13:40.103927+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:40.103666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:40.103666+0000","last_clean_scrub_stamp":"2024-09-13T06:13:40.103666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:14:26.486674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"35'39","reported_seq":96,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:31.841640+0000","last_change":"2024-09-13T06:13:31.841640+0000","last_active":"2024-09-13T06:13:31.841640+0000","last_peered":"2024-09-13T06:13:31.841640+0000","last_clean":"2024-09-13T06:13:31.841640+0000","last_became_active":"2024-09-13T06:09:38.172109+0000","last_became_peered":"2024-09-13T06:09:38.172109+0000","last_unstale":"2024-09-13T06:13:31.841640+0000","last_undegraded":"2024-09-13T06:13:31.841640+0000","last_fullsized":"2024-09-13T06:13:31.841640+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'39","last_scrub_stamp":"2024-09-13T06:13:31.841369+0000","last_deep_scrub":"35'39","last_deep_scrub_stamp":"2024-09-13T06:13:31.841369+0000","last_clean_scrub_stamp":"2024-09-13T06:13:31.841369+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:43:03.426580+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:46.795936+0000","last_change":"2024-09-13T06:13:46.795936+0000","last_active":"2024-09-13T06:13:46.795936+0000","last_peered":"2024-09-13T06:13:46.795936+0000","last_clean":"2024-09-13T06:13:46.795936+0000","last_became_active":"2024-09-13T06:09:40.189223+0000","last_became_peered":"2024-09-13T06:09:40.189223+0000","last_unstale":"2024-09-13T06:13:46.795936+0000","last_undegraded":"2024-09-13T06:13:46.795936+0000","last_fullsized":"2024-09-13T06:13:46.795936+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:46.795688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:46.795688+0000","last_clean_scrub_stamp":"2024-09-13T06:13:46.795688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:53:07.200189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"35'5","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:20.040519+0000","last_change":"2024-09-13T06:14:20.040580+0000","last_active":"2024-09-13T06:14:20.040519+0000","last_peered":"2024-09-13T06:14:20.040519+0000","last_clean":"2024-09-13T06:14:20.040519+0000","last_became_active":"2024-09-13T06:09:42.177378+0000","last_became_peered":"2024-09-13T06:09:42.177378+0000","last_unstale":"2024-09-13T06:14:20.040519+0000","last_undegraded":"2024-09-13T06:14:20.040519+0000","last_fullsized":"2024-09-13T06:14:20.040519+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'5","last_scrub_stamp":"2024-09-13T06:14:20.040302+0000","last_deep_scrub":"35'5","last_deep_scrub_stamp":"2024-09-13T06:14:20.040302+0000","last_clean_scrub_stamp":"2024-09-13T06:14:20.040302+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:43:56.443852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"35'18","reported_seq":85,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:05.144068+0000","last_change":"2024-09-13T06:14:05.144068+0000","last_active":"2024-09-13T06:14:05.144068+0000","last_peered":"2024-09-13T06:14:05.144068+0000","last_clean":"2024-09-13T06:14:05.144068+0000","last_became_active":"2024-09-13T06:09:34.118441+0000","last_became_peered":"2024-09-13T06:09:34.118441+0000","last_unstale":"2024-09-13T06:14:05.144068+0000","last_undegraded":"2024-09-13T06:14:05.144068+0000","last_fullsized":"2024-09-13T06:14:05.144068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'18","last_scrub_stamp":"2024-09-13T06:14:05.143689+0000","last_deep_scrub":"35'18","last_deep_scrub_stamp":"2024-09-13T06:14:05.143689+0000","last_clean_scrub_stamp":"2024-09-13T06:14:05.143689+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:29:22.100915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":59,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:01.442453+0000","last_change":"2024-09-13T06:14:01.442453+0000","last_active":"2024-09-13T06:14:01.442453+0000","last_peered":"2024-09-13T06:14:01.442453+0000","last_clean":"2024-09-13T06:14:01.442453+0000","last_became_active":"2024-09-13T06:09:32.138664+0000","last_became_peered":"2024-09-13T06:09:32.138664+0000","last_unstale":"2024-09-13T06:14:01.442453+0000","last_undegraded":"2024-09-13T06:14:01.442453+0000","last_fullsized":"2024-09-13T06:14:01.442453+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:01.442196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:01.442196+0000","last_clean_scrub_stamp":"2024-09-13T06:14:01.442196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:02:06.026722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"35'5","reported_seq":239,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:30.836350+0000","last_change":"2024-09-13T06:13:30.836350+0000","last_active":"2024-09-13T06:13:30.836350+0000","last_peered":"2024-09-13T06:13:30.836350+0000","last_clean":"2024-09-13T06:13:30.836350+0000","last_became_active":"2024-09-13T06:09:36.153526+0000","last_became_peered":"2024-09-13T06:09:36.153526+0000","last_unstale":"2024-09-13T06:13:30.836350+0000","last_undegraded":"2024-09-13T06:13:30.836350+0000","last_fullsized":"2024-09-13T06:13:30.836350+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'5","last_scrub_stamp":"2024-09-13T06:13:30.836096+0000","last_deep_scrub":"35'5","last_deep_scrub_stamp":"2024-09-13T06:13:30.836096+0000","last_clean_scrub_stamp":"2024-09-13T06:13:30.836096+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:12:49.323535+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"35'9","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:37.292929+0000","last_change":"2024-09-13T06:13:37.292929+0000","last_active":"2024-09-13T06:13:37.292929+0000","last_peered":"2024-09-13T06:13:37.292929+0000","last_clean":"2024-09-13T06:13:37.292929+0000","last_became_active":"2024-09-13T06:09:38.150063+0000","last_became_peered":"2024-09-13T06:09:38.150063+0000","last_unstale":"2024-09-13T06:13:37.292929+0000","last_undegraded":"2024-09-13T06:13:37.292929+0000","last_fullsized":"2024-09-13T06:13:37.292929+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'9","last_scrub_stamp":"2024-09-13T06:13:37.292678+0000","last_deep_scrub":"35'9","last_deep_scrub_stamp":"2024-09-13T06:13:37.292678+0000","last_clean_scrub_stamp":"2024-09-13T06:13:37.292678+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:13:04.527644+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.383351+0000","last_change":"2024-09-13T06:13:25.383351+0000","last_active":"2024-09-13T06:13:25.383351+0000","last_peered":"2024-09-13T06:13:25.383351+0000","last_clean":"2024-09-13T06:13:25.383351+0000","last_became_active":"2024-09-13T06:09:40.181807+0000","last_became_peered":"2024-09-13T06:09:40.181807+0000","last_unstale":"2024-09-13T06:13:25.383351+0000","last_undegraded":"2024-09-13T06:13:25.383351+0000","last_fullsized":"2024-09-13T06:13:25.383351+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:25.383101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:25.383101+0000","last_clean_scrub_stamp":"2024-09-13T06:13:25.383101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:45:24.271310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"35'2","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:23.910297+0000","last_change":"2024-09-13T06:14:23.910357+0000","last_active":"2024-09-13T06:14:23.910297+0000","last_peered":"2024-09-13T06:14:23.910297+0000","last_clean":"2024-09-13T06:14:23.910297+0000","last_became_active":"2024-09-13T06:09:42.208567+0000","last_became_peered":"2024-09-13T06:09:42.208567+0000","last_unstale":"2024-09-13T06:14:23.910297+0000","last_undegraded":"2024-09-13T06:14:23.910297+0000","last_fullsized":"2024-09-13T06:14:23.910297+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:23.910090+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:23.910090+0000","last_clean_scrub_stamp":"2024-09-13T06:14:23.910090+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:41:01.763518+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"35'12","reported_seq":70,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:56.169020+0000","last_change":"2024-09-13T06:13:56.169020+0000","last_active":"2024-09-13T06:13:56.169020+0000","last_peered":"2024-09-13T06:13:56.169020+0000","last_clean":"2024-09-13T06:13:56.169020+0000","last_became_active":"2024-09-13T06:09:34.113455+0000","last_became_peered":"2024-09-13T06:09:34.113455+0000","last_unstale":"2024-09-13T06:13:56.169020+0000","last_undegraded":"2024-09-13T06:13:56.169020+0000","last_fullsized":"2024-09-13T06:13:56.169020+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'12","last_scrub_stamp":"2024-09-13T06:13:56.168729+0000","last_deep_scrub":"35'12","last_deep_scrub_stamp":"2024-09-13T06:13:56.168729+0000","last_clean_scrub_stamp":"2024-09-13T06:13:56.168729+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:18:27.944609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:09.534380+0000","last_change":"2024-09-13T06:14:09.534380+0000","last_active":"2024-09-13T06:14:09.534380+0000","last_peered":"2024-09-13T06:14:09.534380+0000","last_clean":"2024-09-13T06:14:09.534380+0000","last_became_active":"2024-09-13T06:09:32.118235+0000","last_became_peered":"2024-09-13T06:09:32.118235+0000","last_unstale":"2024-09-13T06:14:09.534380+0000","last_undegraded":"2024-09-13T06:14:09.534380+0000","last_fullsized":"2024-09-13T06:14:09.534380+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:09.534088+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:09.534088+0000","last_clean_scrub_stamp":"2024-09-13T06:14:09.534088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:19:44.114982+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"35'2","reported_seq":231,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:41.478861+0000","last_change":"2024-09-13T06:13:41.478861+0000","last_active":"2024-09-13T06:13:41.478861+0000","last_peered":"2024-09-13T06:13:41.478861+0000","last_clean":"2024-09-13T06:13:41.478861+0000","last_became_active":"2024-09-13T06:09:36.135184+0000","last_became_peered":"2024-09-13T06:09:36.135184+0000","last_unstale":"2024-09-13T06:13:41.478861+0000","last_undegraded":"2024-09-13T06:13:41.478861+0000","last_fullsized":"2024-09-13T06:13:41.478861+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:13:41.478609+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:13:41.478609+0000","last_clean_scrub_stamp":"2024-09-13T06:13:41.478609+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:20:43.284625+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"35'49","reported_seq":122,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:31.284327+0000","last_change":"2024-09-13T06:13:31.284327+0000","last_active":"2024-09-13T06:13:31.284327+0000","last_peered":"2024-09-13T06:13:31.284327+0000","last_clean":"2024-09-13T06:13:31.284327+0000","last_became_active":"2024-09-13T06:09:38.166381+0000","last_became_peered":"2024-09-13T06:09:38.166381+0000","last_unstale":"2024-09-13T06:13:31.284327+0000","last_undegraded":"2024-09-13T06:13:31.284327+0000","last_fullsized":"2024-09-13T06:13:31.284327+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'49","last_scrub_stamp":"2024-09-13T06:13:31.283995+0000","last_deep_scrub":"35'49","last_deep_scrub_stamp":"2024-09-13T06:13:31.283995+0000","last_clean_scrub_stamp":"2024-09-13T06:13:31.283995+0000","objects_scrubbed":6,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:53:13.436645+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:33.140552+0000","last_change":"2024-09-13T06:13:33.140552+0000","last_active":"2024-09-13T06:13:33.140552+0000","last_peered":"2024-09-13T06:13:33.140552+0000","last_clean":"2024-09-13T06:13:33.140552+0000","last_became_active":"2024-09-13T06:09:40.181329+0000","last_became_peered":"2024-09-13T06:09:40.181329+0000","last_unstale":"2024-09-13T06:13:33.140552+0000","last_undegraded":"2024-09-13T06:13:33.140552+0000","last_fullsized":"2024-09-13T06:13:33.140552+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:33.140310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:33.140310+0000","last_clean_scrub_stamp":"2024-09-13T06:13:33.140310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:08:31.071212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:12.814732+0000","last_change":"2024-09-13T06:09:42.211550+0000","last_active":"2024-09-13T06:12:12.814732+0000","last_peered":"2024-09-13T06:12:12.814732+0000","last_clean":"2024-09-13T06:12:12.814732+0000","last_became_active":"2024-09-13T06:09:42.211005+0000","last_became_peered":"2024-09-13T06:09:42.211005+0000","last_unstale":"2024-09-13T06:12:12.814732+0000","last_undegraded":"2024-09-13T06:12:12.814732+0000","last_fullsized":"2024-09-13T06:12:12.814732+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"35'6","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:42.783373+0000","last_change":"2024-09-13T06:13:42.783373+0000","last_active":"2024-09-13T06:13:42.783373+0000","last_peered":"2024-09-13T06:13:42.783373+0000","last_clean":"2024-09-13T06:13:42.783373+0000","last_became_active":"2024-09-13T06:09:34.126798+0000","last_became_peered":"2024-09-13T06:09:34.126798+0000","last_unstale":"2024-09-13T06:13:42.783373+0000","last_undegraded":"2024-09-13T06:13:42.783373+0000","last_fullsized":"2024-09-13T06:13:42.783373+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:13:42.783125+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:13:42.783125+0000","last_clean_scrub_stamp":"2024-09-13T06:13:42.783125+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:22:51.788479+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:16.077566+0000","last_change":"2024-09-13T06:14:16.077566+0000","last_active":"2024-09-13T06:14:16.077566+0000","last_peered":"2024-09-13T06:14:16.077566+0000","last_clean":"2024-09-13T06:14:16.077566+0000","last_became_active":"2024-09-13T06:09:32.126213+0000","last_became_peered":"2024-09-13T06:09:32.126213+0000","last_unstale":"2024-09-13T06:14:16.077566+0000","last_undegraded":"2024-09-13T06:14:16.077566+0000","last_fullsized":"2024-09-13T06:14:16.077566+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:16.077312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:16.077312+0000","last_clean_scrub_stamp":"2024-09-13T06:14:16.077312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:43:40.720303+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:34.825411+0000","last_change":"2024-09-13T06:13:34.825411+0000","last_active":"2024-09-13T06:13:34.825411+0000","last_peered":"2024-09-13T06:13:34.825411+0000","last_clean":"2024-09-13T06:13:34.825411+0000","last_became_active":"2024-09-13T06:09:36.148016+0000","last_became_peered":"2024-09-13T06:09:36.148016+0000","last_unstale":"2024-09-13T06:13:34.825411+0000","last_undegraded":"2024-09-13T06:13:34.825411+0000","last_fullsized":"2024-09-13T06:13:34.825411+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:34.825172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:34.825172+0000","last_clean_scrub_stamp":"2024-09-13T06:13:34.825172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:35:11.379450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"35'36","reported_seq":92,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:39.479798+0000","last_change":"2024-09-13T06:13:39.479798+0000","last_active":"2024-09-13T06:13:39.479798+0000","last_peered":"2024-09-13T06:13:39.479798+0000","last_clean":"2024-09-13T06:13:39.479798+0000","last_became_active":"2024-09-13T06:09:38.141182+0000","last_became_peered":"2024-09-13T06:09:38.141182+0000","last_unstale":"2024-09-13T06:13:39.479798+0000","last_undegraded":"2024-09-13T06:13:39.479798+0000","last_fullsized":"2024-09-13T06:13:39.479798+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'36","last_scrub_stamp":"2024-09-13T06:13:39.479521+0000","last_deep_scrub":"35'36","last_deep_scrub_stamp":"2024-09-13T06:13:39.479521+0000","last_clean_scrub_stamp":"2024-09-13T06:13:39.479521+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:51:47.667173+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:30.363157+0000","last_change":"2024-09-13T06:13:30.363157+0000","last_active":"2024-09-13T06:13:30.363157+0000","last_peered":"2024-09-13T06:13:30.363157+0000","last_clean":"2024-09-13T06:13:30.363157+0000","last_became_active":"2024-09-13T06:09:40.166229+0000","last_became_peered":"2024-09-13T06:09:40.166229+0000","last_unstale":"2024-09-13T06:13:30.363157+0000","last_undegraded":"2024-09-13T06:13:30.363157+0000","last_fullsized":"2024-09-13T06:13:30.363157+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:30.362905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:30.362905+0000","last_clean_scrub_stamp":"2024-09-13T06:13:30.362905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:24:17.255873+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"35'6","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:01.922629+0000","last_change":"2024-09-13T06:14:01.922787+0000","last_active":"2024-09-13T06:14:01.922629+0000","last_peered":"2024-09-13T06:14:01.922629+0000","last_clean":"2024-09-13T06:14:01.922629+0000","last_became_active":"2024-09-13T06:09:34.122034+0000","last_became_peered":"2024-09-13T06:09:34.122034+0000","last_unstale":"2024-09-13T06:14:01.922629+0000","last_undegraded":"2024-09-13T06:14:01.922629+0000","last_fullsized":"2024-09-13T06:14:01.922629+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:14:01.922410+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:14:01.922410+0000","last_clean_scrub_stamp":"2024-09-13T06:14:01.922410+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:23:57.663402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"35'2","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.440558+0000","last_change":"2024-09-13T06:09:32.124543+0000","last_active":"2024-09-13T06:13:25.440558+0000","last_peered":"2024-09-13T06:13:25.440558+0000","last_clean":"2024-09-13T06:13:25.440558+0000","last_became_active":"2024-09-13T06:09:32.121948+0000","last_became_peered":"2024-09-13T06:09:32.121948+0000","last_unstale":"2024-09-13T06:13:25.440558+0000","last_undegraded":"2024-09-13T06:13:25.440558+0000","last_fullsized":"2024-09-13T06:13:25.440558+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:47.139074+0000","last_change":"2024-09-13T06:13:47.139128+0000","last_active":"2024-09-13T06:13:47.139074+0000","last_peered":"2024-09-13T06:13:47.139074+0000","last_clean":"2024-09-13T06:13:47.139074+0000","last_became_active":"2024-09-13T06:09:36.132227+0000","last_became_peered":"2024-09-13T06:09:36.132227+0000","last_unstale":"2024-09-13T06:13:47.139074+0000","last_undegraded":"2024-09-13T06:13:47.139074+0000","last_fullsized":"2024-09-13T06:13:47.139074+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:47.138875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:47.138875+0000","last_clean_scrub_stamp":"2024-09-13T06:13:47.138875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:46:51.298281+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"35'63","reported_seq":136,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:38.262967+0000","last_change":"2024-09-13T06:13:38.263042+0000","last_active":"2024-09-13T06:13:38.262967+0000","last_peered":"2024-09-13T06:13:38.262967+0000","last_clean":"2024-09-13T06:13:38.262967+0000","last_became_active":"2024-09-13T06:09:38.150070+0000","last_became_peered":"2024-09-13T06:09:38.150070+0000","last_unstale":"2024-09-13T06:13:38.262967+0000","last_undegraded":"2024-09-13T06:13:38.262967+0000","last_fullsized":"2024-09-13T06:13:38.262967+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'63","last_scrub_stamp":"2024-09-13T06:13:38.262747+0000","last_deep_scrub":"35'63","last_deep_scrub_stamp":"2024-09-13T06:13:38.262747+0000","last_clean_scrub_stamp":"2024-09-13T06:13:38.262747+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:56:34.974972+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:26.401270+0000","last_change":"2024-09-13T06:13:26.401325+0000","last_active":"2024-09-13T06:13:26.401270+0000","last_peered":"2024-09-13T06:13:26.401270+0000","last_clean":"2024-09-13T06:13:26.401270+0000","last_became_active":"2024-09-13T06:09:40.168550+0000","last_became_peered":"2024-09-13T06:09:40.168550+0000","last_unstale":"2024-09-13T06:13:26.401270+0000","last_undegraded":"2024-09-13T06:13:26.401270+0000","last_fullsized":"2024-09-13T06:13:26.401270+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:26.401059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:26.401059+0000","last_clean_scrub_stamp":"2024-09-13T06:13:26.401059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:03:36.749162+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"35'14","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:24.907423+0000","last_change":"2024-09-13T06:14:24.907423+0000","last_active":"2024-09-13T06:14:24.907423+0000","last_peered":"2024-09-13T06:14:24.907423+0000","last_clean":"2024-09-13T06:14:24.907423+0000","last_became_active":"2024-09-13T06:09:42.211508+0000","last_became_peered":"2024-09-13T06:09:42.211508+0000","last_unstale":"2024-09-13T06:14:24.907423+0000","last_undegraded":"2024-09-13T06:14:24.907423+0000","last_fullsized":"2024-09-13T06:14:24.907423+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'14","last_scrub_stamp":"2024-09-13T06:14:24.907133+0000","last_deep_scrub":"35'14","last_deep_scrub_stamp":"2024-09-13T06:14:24.907133+0000","last_clean_scrub_stamp":"2024-09-13T06:14:24.907133+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:17:17.358604+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"35'8","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:53.158421+0000","last_change":"2024-09-13T06:13:53.158479+0000","last_active":"2024-09-13T06:13:53.158421+0000","last_peered":"2024-09-13T06:13:53.158421+0000","last_clean":"2024-09-13T06:13:53.158421+0000","last_became_active":"2024-09-13T06:09:34.122881+0000","last_became_peered":"2024-09-13T06:09:34.122881+0000","last_unstale":"2024-09-13T06:13:53.158421+0000","last_undegraded":"2024-09-13T06:13:53.158421+0000","last_fullsized":"2024-09-13T06:13:53.158421+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-13T06:13:53.158235+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-13T06:13:53.158235+0000","last_clean_scrub_stamp":"2024-09-13T06:13:53.158235+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:27:12.571243+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":11,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:15.032945+0000","last_change":"2024-09-13T06:14:15.032945+0000","last_active":"2024-09-13T06:14:15.032945+0000","last_peered":"2024-09-13T06:14:15.032945+0000","last_clean":"2024-09-13T06:14:15.032945+0000","last_became_active":"2024-09-13T06:09:32.119573+0000","last_became_peered":"2024-09-13T06:09:32.119573+0000","last_unstale":"2024-09-13T06:14:15.032945+0000","last_undegraded":"2024-09-13T06:14:15.032945+0000","last_fullsized":"2024-09-13T06:14:15.032945+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:15.032656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:15.032656+0000","last_clean_scrub_stamp":"2024-09-13T06:14:15.032656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:03:32.007047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:45.482486+0000","last_change":"2024-09-13T06:13:45.482486+0000","last_active":"2024-09-13T06:13:45.482486+0000","last_peered":"2024-09-13T06:13:45.482486+0000","last_clean":"2024-09-13T06:13:45.482486+0000","last_became_active":"2024-09-13T06:09:36.127719+0000","last_became_peered":"2024-09-13T06:09:36.127719+0000","last_unstale":"2024-09-13T06:13:45.482486+0000","last_undegraded":"2024-09-13T06:13:45.482486+0000","last_fullsized":"2024-09-13T06:13:45.482486+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:45.482236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:45.482236+0000","last_clean_scrub_stamp":"2024-09-13T06:13:45.482236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:48:41.351667+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"35'46","reported_seq":104,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:43.807725+0000","last_change":"2024-09-13T06:13:43.807814+0000","last_active":"2024-09-13T06:13:43.807725+0000","last_peered":"2024-09-13T06:13:43.807725+0000","last_clean":"2024-09-13T06:13:43.807725+0000","last_became_active":"2024-09-13T06:09:38.175443+0000","last_became_peered":"2024-09-13T06:09:38.175443+0000","last_unstale":"2024-09-13T06:13:43.807725+0000","last_undegraded":"2024-09-13T06:13:43.807725+0000","last_fullsized":"2024-09-13T06:13:43.807725+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'46","last_scrub_stamp":"2024-09-13T06:13:43.807524+0000","last_deep_scrub":"35'46","last_deep_scrub_stamp":"2024-09-13T06:13:43.807524+0000","last_clean_scrub_stamp":"2024-09-13T06:13:43.807524+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:18:40.372988+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:45.156724+0000","last_change":"2024-09-13T06:13:45.156776+0000","last_active":"2024-09-13T06:13:45.156724+0000","last_peered":"2024-09-13T06:13:45.156724+0000","last_clean":"2024-09-13T06:13:45.156724+0000","last_became_active":"2024-09-13T06:09:40.185222+0000","last_became_peered":"2024-09-13T06:09:40.185222+0000","last_unstale":"2024-09-13T06:13:45.156724+0000","last_undegraded":"2024-09-13T06:13:45.156724+0000","last_fullsized":"2024-09-13T06:13:45.156724+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:45.156528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:45.156528+0000","last_clean_scrub_stamp":"2024-09-13T06:13:45.156528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:58:23.506441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:07.968141+0000","last_change":"2024-09-13T06:14:07.968141+0000","last_active":"2024-09-13T06:14:07.968141+0000","last_peered":"2024-09-13T06:14:07.968141+0000","last_clean":"2024-09-13T06:14:07.968141+0000","last_became_active":"2024-09-13T06:09:42.196679+0000","last_became_peered":"2024-09-13T06:09:42.196679+0000","last_unstale":"2024-09-13T06:14:07.968141+0000","last_undegraded":"2024-09-13T06:14:07.968141+0000","last_fullsized":"2024-09-13T06:14:07.968141+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:07.967902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:07.967902+0000","last_clean_scrub_stamp":"2024-09-13T06:14:07.967902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:59:50.642710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"35'16","reported_seq":86,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:38.804179+0000","last_change":"2024-09-13T06:13:38.804245+0000","last_active":"2024-09-13T06:13:38.804179+0000","last_peered":"2024-09-13T06:13:38.804179+0000","last_clean":"2024-09-13T06:13:38.804179+0000","last_became_active":"2024-09-13T06:09:34.132777+0000","last_became_peered":"2024-09-13T06:09:34.132777+0000","last_unstale":"2024-09-13T06:13:38.804179+0000","last_undegraded":"2024-09-13T06:13:38.804179+0000","last_fullsized":"2024-09-13T06:13:38.804179+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'16","last_scrub_stamp":"2024-09-13T06:13:38.803976+0000","last_deep_scrub":"35'16","last_deep_scrub_stamp":"2024-09-13T06:13:38.803976+0000","last_clean_scrub_stamp":"2024-09-13T06:13:38.803976+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:52:39.806244+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":57,"num_read_kb":53,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:13.111165+0000","last_change":"2024-09-13T06:14:13.111219+0000","last_active":"2024-09-13T06:14:13.111165+0000","last_peered":"2024-09-13T06:14:13.111165+0000","last_clean":"2024-09-13T06:14:13.111165+0000","last_became_active":"2024-09-13T06:09:32.117988+0000","last_became_peered":"2024-09-13T06:09:32.117988+0000","last_unstale":"2024-09-13T06:14:13.111165+0000","last_undegraded":"2024-09-13T06:14:13.111165+0000","last_fullsized":"2024-09-13T06:14:13.111165+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:13.110979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:13.110979+0000","last_clean_scrub_stamp":"2024-09-13T06:14:13.110979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:11:49.833063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:43.472927+0000","last_change":"2024-09-13T06:13:43.472981+0000","last_active":"2024-09-13T06:13:43.472927+0000","last_peered":"2024-09-13T06:13:43.472927+0000","last_clean":"2024-09-13T06:13:43.472927+0000","last_became_active":"2024-09-13T06:09:36.129471+0000","last_became_peered":"2024-09-13T06:09:36.129471+0000","last_unstale":"2024-09-13T06:13:43.472927+0000","last_undegraded":"2024-09-13T06:13:43.472927+0000","last_fullsized":"2024-09-13T06:13:43.472927+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:43.472711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:43.472711+0000","last_clean_scrub_stamp":"2024-09-13T06:13:43.472711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:48:39.465341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"35'41","reported_seq":98,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:35.293684+0000","last_change":"2024-09-13T06:13:35.293684+0000","last_active":"2024-09-13T06:13:35.293684+0000","last_peered":"2024-09-13T06:13:35.293684+0000","last_clean":"2024-09-13T06:13:35.293684+0000","last_became_active":"2024-09-13T06:09:38.153433+0000","last_became_peered":"2024-09-13T06:09:38.153433+0000","last_unstale":"2024-09-13T06:13:35.293684+0000","last_undegraded":"2024-09-13T06:13:35.293684+0000","last_fullsized":"2024-09-13T06:13:35.293684+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'41","last_scrub_stamp":"2024-09-13T06:13:35.293395+0000","last_deep_scrub":"35'41","last_deep_scrub_stamp":"2024-09-13T06:13:35.293395+0000","last_clean_scrub_stamp":"2024-09-13T06:13:35.293395+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:48:31.286025+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":55,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:29.307769+0000","last_change":"2024-09-13T06:13:29.307769+0000","last_active":"2024-09-13T06:13:29.307769+0000","last_peered":"2024-09-13T06:13:29.307769+0000","last_clean":"2024-09-13T06:13:29.307769+0000","last_became_active":"2024-09-13T06:09:40.171455+0000","last_became_peered":"2024-09-13T06:09:40.171455+0000","last_unstale":"2024-09-13T06:13:29.307769+0000","last_undegraded":"2024-09-13T06:13:29.307769+0000","last_fullsized":"2024-09-13T06:13:29.307769+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:29.307405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:29.307405+0000","last_clean_scrub_stamp":"2024-09-13T06:13:29.307405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:02:21.851168+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"35'5","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.443180+0000","last_change":"2024-09-13T06:09:42.202743+0000","last_active":"2024-09-13T06:13:25.443180+0000","last_peered":"2024-09-13T06:13:25.443180+0000","last_clean":"2024-09-13T06:13:25.443180+0000","last_became_active":"2024-09-13T06:09:42.202004+0000","last_became_peered":"2024-09-13T06:09:42.202004+0000","last_unstale":"2024-09-13T06:13:25.443180+0000","last_undegraded":"2024-09-13T06:13:25.443180+0000","last_fullsized":"2024-09-13T06:13:25.443180+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:04.027577+0000","last_change":"2024-09-13T06:14:04.027730+0000","last_active":"2024-09-13T06:14:04.027577+0000","last_peered":"2024-09-13T06:14:04.027577+0000","last_clean":"2024-09-13T06:14:04.027577+0000","last_became_active":"2024-09-13T06:09:34.116197+0000","last_became_peered":"2024-09-13T06:09:34.116197+0000","last_unstale":"2024-09-13T06:14:04.027577+0000","last_undegraded":"2024-09-13T06:14:04.027577+0000","last_fullsized":"2024-09-13T06:14:04.027577+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:04.027357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:04.027357+0000","last_clean_scrub_stamp":"2024-09-13T06:14:04.027357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:41:38.144650+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:19.870774+0000","last_change":"2024-09-13T06:14:19.870843+0000","last_active":"2024-09-13T06:14:19.870774+0000","last_peered":"2024-09-13T06:14:19.870774+0000","last_clean":"2024-09-13T06:14:19.870774+0000","last_became_active":"2024-09-13T06:09:32.124989+0000","last_became_peered":"2024-09-13T06:09:32.124989+0000","last_unstale":"2024-09-13T06:14:19.870774+0000","last_undegraded":"2024-09-13T06:14:19.870774+0000","last_fullsized":"2024-09-13T06:14:19.870774+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:19.870574+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:19.870574+0000","last_clean_scrub_stamp":"2024-09-13T06:14:19.870574+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:59:55.637777+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:36.119134+0000","last_change":"2024-09-13T06:13:36.119188+0000","last_active":"2024-09-13T06:13:36.119134+0000","last_peered":"2024-09-13T06:13:36.119134+0000","last_clean":"2024-09-13T06:13:36.119134+0000","last_became_active":"2024-09-13T06:09:36.140149+0000","last_became_peered":"2024-09-13T06:09:36.140149+0000","last_unstale":"2024-09-13T06:13:36.119134+0000","last_undegraded":"2024-09-13T06:13:36.119134+0000","last_fullsized":"2024-09-13T06:13:36.119134+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:36.118904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:36.118904+0000","last_clean_scrub_stamp":"2024-09-13T06:13:36.118904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:21:56.564481+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"35'15","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:50.851940+0000","last_change":"2024-09-13T06:13:50.852014+0000","last_active":"2024-09-13T06:13:50.851940+0000","last_peered":"2024-09-13T06:13:50.851940+0000","last_clean":"2024-09-13T06:13:50.851940+0000","last_became_active":"2024-09-13T06:09:38.177699+0000","last_became_peered":"2024-09-13T06:09:38.177699+0000","last_unstale":"2024-09-13T06:13:50.851940+0000","last_undegraded":"2024-09-13T06:13:50.851940+0000","last_fullsized":"2024-09-13T06:13:50.851940+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'15","last_scrub_stamp":"2024-09-13T06:13:50.851744+0000","last_deep_scrub":"35'15","last_deep_scrub_stamp":"2024-09-13T06:13:50.851744+0000","last_clean_scrub_stamp":"2024-09-13T06:13:50.851744+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:02:47.395746+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"35'285","reported_seq":384,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:29.354681+0000","last_change":"2024-09-13T06:13:29.354681+0000","last_active":"2024-09-13T06:13:29.354681+0000","last_peered":"2024-09-13T06:13:29.354681+0000","last_clean":"2024-09-13T06:13:29.354681+0000","last_became_active":"2024-09-13T06:09:40.166780+0000","last_became_peered":"2024-09-13T06:09:40.166780+0000","last_unstale":"2024-09-13T06:13:29.354681+0000","last_undegraded":"2024-09-13T06:13:29.354681+0000","last_fullsized":"2024-09-13T06:13:29.354681+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-13T06:13:29.354428+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-13T06:13:29.354428+0000","last_clean_scrub_stamp":"2024-09-13T06:13:29.354428+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:07:16.616986+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"35'2","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:11.928509+0000","last_change":"2024-09-13T06:14:11.928509+0000","last_active":"2024-09-13T06:14:11.928509+0000","last_peered":"2024-09-13T06:14:11.928509+0000","last_clean":"2024-09-13T06:14:11.928509+0000","last_became_active":"2024-09-13T06:09:42.196063+0000","last_became_peered":"2024-09-13T06:09:42.196063+0000","last_unstale":"2024-09-13T06:14:11.928509+0000","last_undegraded":"2024-09-13T06:14:11.928509+0000","last_fullsized":"2024-09-13T06:14:11.928509+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:11.928231+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:11.928231+0000","last_clean_scrub_stamp":"2024-09-13T06:14:11.928231+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:30:08.269153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"35'6","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:14.519127+0000","last_change":"2024-09-13T06:14:14.519190+0000","last_active":"2024-09-13T06:14:14.519127+0000","last_peered":"2024-09-13T06:14:14.519127+0000","last_clean":"2024-09-13T06:14:14.519127+0000","last_became_active":"2024-09-13T06:09:34.107821+0000","last_became_peered":"2024-09-13T06:09:34.107821+0000","last_unstale":"2024-09-13T06:14:14.519127+0000","last_undegraded":"2024-09-13T06:14:14.519127+0000","last_fullsized":"2024-09-13T06:14:14.519127+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:14:14.518930+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:14:14.518930+0000","last_clean_scrub_stamp":"2024-09-13T06:14:14.518930+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:53:21.672620+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:18.142572+0000","last_change":"2024-09-13T06:14:18.142644+0000","last_active":"2024-09-13T06:14:18.142572+0000","last_peered":"2024-09-13T06:14:18.142572+0000","last_clean":"2024-09-13T06:14:18.142572+0000","last_became_active":"2024-09-13T06:09:32.140816+0000","last_became_peered":"2024-09-13T06:09:32.140816+0000","last_unstale":"2024-09-13T06:14:18.142572+0000","last_undegraded":"2024-09-13T06:14:18.142572+0000","last_fullsized":"2024-09-13T06:14:18.142572+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:18.142373+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:18.142373+0000","last_clean_scrub_stamp":"2024-09-13T06:14:18.142373+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:55:56.126674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:34.100074+0000","last_change":"2024-09-13T06:13:34.100128+0000","last_active":"2024-09-13T06:13:34.100074+0000","last_peered":"2024-09-13T06:13:34.100074+0000","last_clean":"2024-09-13T06:13:34.100074+0000","last_became_active":"2024-09-13T06:09:36.140770+0000","last_became_peered":"2024-09-13T06:09:36.140770+0000","last_unstale":"2024-09-13T06:13:34.100074+0000","last_undegraded":"2024-09-13T06:13:34.100074+0000","last_fullsized":"2024-09-13T06:13:34.100074+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:34.099877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:34.099877+0000","last_clean_scrub_stamp":"2024-09-13T06:13:34.099877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:24:15.804560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"35'46","reported_seq":104,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.335560+0000","last_change":"2024-09-13T06:13:25.335732+0000","last_active":"2024-09-13T06:13:25.335560+0000","last_peered":"2024-09-13T06:13:25.335560+0000","last_clean":"2024-09-13T06:13:25.335560+0000","last_became_active":"2024-09-13T06:09:38.166681+0000","last_became_peered":"2024-09-13T06:09:38.166681+0000","last_unstale":"2024-09-13T06:13:25.335560+0000","last_undegraded":"2024-09-13T06:13:25.335560+0000","last_fullsized":"2024-09-13T06:13:25.335560+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'46","last_scrub_stamp":"2024-09-13T06:13:25.335323+0000","last_deep_scrub":"35'46","last_deep_scrub_stamp":"2024-09-13T06:13:25.335323+0000","last_clean_scrub_stamp":"2024-09-13T06:13:25.335323+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:32:30.737347+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:28.331282+0000","last_change":"2024-09-13T06:13:28.331392+0000","last_active":"2024-09-13T06:13:28.331282+0000","last_peered":"2024-09-13T06:13:28.331282+0000","last_clean":"2024-09-13T06:13:28.331282+0000","last_became_active":"2024-09-13T06:09:40.178484+0000","last_became_peered":"2024-09-13T06:09:40.178484+0000","last_unstale":"2024-09-13T06:13:28.331282+0000","last_undegraded":"2024-09-13T06:13:28.331282+0000","last_fullsized":"2024-09-13T06:13:28.331282+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:28.331050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:28.331050+0000","last_clean_scrub_stamp":"2024-09-13T06:13:28.331050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:53:24.217481+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"35'4","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:07.808288+0000","last_change":"2024-09-13T06:09:42.201123+0000","last_active":"2024-09-13T06:12:07.808288+0000","last_peered":"2024-09-13T06:12:07.808288+0000","last_clean":"2024-09-13T06:12:07.808288+0000","last_became_active":"2024-09-13T06:09:42.199609+0000","last_became_peered":"2024-09-13T06:09:42.199609+0000","last_unstale":"2024-09-13T06:12:07.808288+0000","last_undegraded":"2024-09-13T06:12:07.808288+0000","last_fullsized":"2024-09-13T06:12:07.808288+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"35'6","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:51.506179+0000","last_change":"2024-09-13T06:13:51.506348+0000","last_active":"2024-09-13T06:13:51.506179+0000","last_peered":"2024-09-13T06:13:51.506179+0000","last_clean":"2024-09-13T06:13:51.506179+0000","last_became_active":"2024-09-13T06:09:34.100355+0000","last_became_peered":"2024-09-13T06:09:34.100355+0000","last_unstale":"2024-09-13T06:13:51.506179+0000","last_undegraded":"2024-09-13T06:13:51.506179+0000","last_fullsized":"2024-09-13T06:13:51.506179+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:13:51.505951+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:13:51.505951+0000","last_clean_scrub_stamp":"2024-09-13T06:13:51.505951+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:34:28.572463+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:02.812140+0000","last_change":"2024-09-13T06:09:32.133279+0000","last_active":"2024-09-13T06:12:02.812140+0000","last_peered":"2024-09-13T06:12:02.812140+0000","last_clean":"2024-09-13T06:12:02.812140+0000","last_became_active":"2024-09-13T06:09:32.125049+0000","last_became_peered":"2024-09-13T06:09:32.125049+0000","last_unstale":"2024-09-13T06:12:02.812140+0000","last_undegraded":"2024-09-13T06:12:02.812140+0000","last_fullsized":"2024-09-13T06:12:02.812140+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:46.483099+0000","last_change":"2024-09-13T06:13:46.483155+0000","last_active":"2024-09-13T06:13:46.483099+0000","last_peered":"2024-09-13T06:13:46.483099+0000","last_clean":"2024-09-13T06:13:46.483099+0000","last_became_active":"2024-09-13T06:09:36.127684+0000","last_became_peered":"2024-09-13T06:09:36.127684+0000","last_unstale":"2024-09-13T06:13:46.483099+0000","last_undegraded":"2024-09-13T06:13:46.483099+0000","last_fullsized":"2024-09-13T06:13:46.483099+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:46.482894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:46.482894+0000","last_clean_scrub_stamp":"2024-09-13T06:13:46.482894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:09:00.981051+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"35'37","reported_seq":92,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:34.298374+0000","last_change":"2024-09-13T06:13:34.298450+0000","last_active":"2024-09-13T06:13:34.298374+0000","last_peered":"2024-09-13T06:13:34.298374+0000","last_clean":"2024-09-13T06:13:34.298374+0000","last_became_active":"2024-09-13T06:09:38.157278+0000","last_became_peered":"2024-09-13T06:09:38.157278+0000","last_unstale":"2024-09-13T06:13:34.298374+0000","last_undegraded":"2024-09-13T06:13:34.298374+0000","last_fullsized":"2024-09-13T06:13:34.298374+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'37","last_scrub_stamp":"2024-09-13T06:13:34.298176+0000","last_deep_scrub":"35'37","last_deep_scrub_stamp":"2024-09-13T06:13:34.298176+0000","last_clean_scrub_stamp":"2024-09-13T06:13:34.298176+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:13:34.885749+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:45.813476+0000","last_change":"2024-09-13T06:13:45.813575+0000","last_active":"2024-09-13T06:13:45.813476+0000","last_peered":"2024-09-13T06:13:45.813476+0000","last_clean":"2024-09-13T06:13:45.813476+0000","last_became_active":"2024-09-13T06:09:40.189165+0000","last_became_peered":"2024-09-13T06:09:40.189165+0000","last_unstale":"2024-09-13T06:13:45.813476+0000","last_undegraded":"2024-09-13T06:13:45.813476+0000","last_fullsized":"2024-09-13T06:13:45.813476+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:45.813202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:45.813202+0000","last_clean_scrub_stamp":"2024-09-13T06:13:45.813202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:32:50.595240+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:07.813661+0000","last_change":"2024-09-13T06:09:42.214239+0000","last_active":"2024-09-13T06:12:07.813661+0000","last_peered":"2024-09-13T06:12:07.813661+0000","last_clean":"2024-09-13T06:12:07.813661+0000","last_became_active":"2024-09-13T06:09:42.213756+0000","last_became_peered":"2024-09-13T06:09:42.213756+0000","last_unstale":"2024-09-13T06:12:07.813661+0000","last_undegraded":"2024-09-13T06:12:07.813661+0000","last_fullsized":"2024-09-13T06:12:07.813661+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:09.970757+0000","last_change":"2024-09-13T06:14:09.970812+0000","last_active":"2024-09-13T06:14:09.970757+0000","last_peered":"2024-09-13T06:14:09.970757+0000","last_clean":"2024-09-13T06:14:09.970757+0000","last_became_active":"2024-09-13T06:09:34.117789+0000","last_became_peered":"2024-09-13T06:09:34.117789+0000","last_unstale":"2024-09-13T06:14:09.970757+0000","last_undegraded":"2024-09-13T06:14:09.970757+0000","last_fullsized":"2024-09-13T06:14:09.970757+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:09.970560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:09.970560+0000","last_clean_scrub_stamp":"2024-09-13T06:14:09.970560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:43:49.285414+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:12.973494+0000","last_change":"2024-09-13T06:14:12.973611+0000","last_active":"2024-09-13T06:14:12.973494+0000","last_peered":"2024-09-13T06:14:12.973494+0000","last_clean":"2024-09-13T06:14:12.973494+0000","last_became_active":"2024-09-13T06:09:32.134696+0000","last_became_peered":"2024-09-13T06:09:32.134696+0000","last_unstale":"2024-09-13T06:14:12.973494+0000","last_undegraded":"2024-09-13T06:14:12.973494+0000","last_fullsized":"2024-09-13T06:14:12.973494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:12.973262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:12.973262+0000","last_clean_scrub_stamp":"2024-09-13T06:14:12.973262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:06:43.525067+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:42.137324+0000","last_change":"2024-09-13T06:13:42.137375+0000","last_active":"2024-09-13T06:13:42.137324+0000","last_peered":"2024-09-13T06:13:42.137324+0000","last_clean":"2024-09-13T06:13:42.137324+0000","last_became_active":"2024-09-13T06:09:36.131976+0000","last_became_peered":"2024-09-13T06:09:36.131976+0000","last_unstale":"2024-09-13T06:13:42.137324+0000","last_undegraded":"2024-09-13T06:13:42.137324+0000","last_fullsized":"2024-09-13T06:13:42.137324+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:42.137148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:42.137148+0000","last_clean_scrub_stamp":"2024-09-13T06:13:42.137148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:12:22.095929+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"35'30","reported_seq":83,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:37.757579+0000","last_change":"2024-09-13T06:13:37.757650+0000","last_active":"2024-09-13T06:13:37.757579+0000","last_peered":"2024-09-13T06:13:37.757579+0000","last_clean":"2024-09-13T06:13:37.757579+0000","last_became_active":"2024-09-13T06:09:38.171538+0000","last_became_peered":"2024-09-13T06:09:38.171538+0000","last_unstale":"2024-09-13T06:13:37.757579+0000","last_undegraded":"2024-09-13T06:13:37.757579+0000","last_fullsized":"2024-09-13T06:13:37.757579+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'30","last_scrub_stamp":"2024-09-13T06:13:37.757382+0000","last_deep_scrub":"35'30","last_deep_scrub_stamp":"2024-09-13T06:13:37.757382+0000","last_clean_scrub_stamp":"2024-09-13T06:13:37.757382+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:21:11.687429+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:48.835977+0000","last_change":"2024-09-13T06:13:48.836037+0000","last_active":"2024-09-13T06:13:48.835977+0000","last_peered":"2024-09-13T06:13:48.835977+0000","last_clean":"2024-09-13T06:13:48.835977+0000","last_became_active":"2024-09-13T06:09:40.185277+0000","last_became_peered":"2024-09-13T06:09:40.185277+0000","last_unstale":"2024-09-13T06:13:48.835977+0000","last_undegraded":"2024-09-13T06:13:48.835977+0000","last_fullsized":"2024-09-13T06:13:48.835977+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:48.835791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:48.835791+0000","last_clean_scrub_stamp":"2024-09-13T06:13:48.835791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:03:05.810181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"35'6","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:12:49.135982+0000","last_change":"2024-09-13T06:09:42.211802+0000","last_active":"2024-09-13T06:12:49.135982+0000","last_peered":"2024-09-13T06:12:49.135982+0000","last_clean":"2024-09-13T06:12:49.135982+0000","last_became_active":"2024-09-13T06:09:42.211176+0000","last_became_peered":"2024-09-13T06:09:42.211176+0000","last_unstale":"2024-09-13T06:12:49.135982+0000","last_undegraded":"2024-09-13T06:12:49.135982+0000","last_fullsized":"2024-09-13T06:12:49.135982+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"35'8","reported_seq":65,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:04.458520+0000","last_change":"2024-09-13T06:14:04.458704+0000","last_active":"2024-09-13T06:14:04.458520+0000","last_peered":"2024-09-13T06:14:04.458520+0000","last_clean":"2024-09-13T06:14:04.458520+0000","last_became_active":"2024-09-13T06:09:34.105494+0000","last_became_peered":"2024-09-13T06:09:34.105494+0000","last_unstale":"2024-09-13T06:14:04.458520+0000","last_undegraded":"2024-09-13T06:14:04.458520+0000","last_fullsized":"2024-09-13T06:14:04.458520+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-13T06:14:04.458293+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-13T06:14:04.458293+0000","last_clean_scrub_stamp":"2024-09-13T06:14:04.458293+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:48:21.210581+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"35'2","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:02.083459+0000","last_change":"2024-09-13T06:14:02.083524+0000","last_active":"2024-09-13T06:14:02.083459+0000","last_peered":"2024-09-13T06:14:02.083459+0000","last_clean":"2024-09-13T06:14:02.083459+0000","last_became_active":"2024-09-13T06:09:32.142726+0000","last_became_peered":"2024-09-13T06:09:32.142726+0000","last_unstale":"2024-09-13T06:14:02.083459+0000","last_undegraded":"2024-09-13T06:14:02.083459+0000","last_fullsized":"2024-09-13T06:14:02.083459+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:02.083238+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:02.083238+0000","last_clean_scrub_stamp":"2024-09-13T06:14:02.083238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:00:06.559987+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"35'3","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:39.117575+0000","last_change":"2024-09-13T06:13:39.117641+0000","last_active":"2024-09-13T06:13:39.117575+0000","last_peered":"2024-09-13T06:13:39.117575+0000","last_clean":"2024-09-13T06:13:39.117575+0000","last_became_active":"2024-09-13T06:09:36.136792+0000","last_became_peered":"2024-09-13T06:09:36.136792+0000","last_unstale":"2024-09-13T06:13:39.117575+0000","last_undegraded":"2024-09-13T06:13:39.117575+0000","last_fullsized":"2024-09-13T06:13:39.117575+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3","last_scrub_stamp":"2024-09-13T06:13:39.117394+0000","last_deep_scrub":"35'3","last_deep_scrub_stamp":"2024-09-13T06:13:39.117394+0000","last_clean_scrub_stamp":"2024-09-13T06:13:39.117394+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:34:55.196548+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"35'39","reported_seq":96,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:29.877488+0000","last_change":"2024-09-13T06:13:29.877565+0000","last_active":"2024-09-13T06:13:29.877488+0000","last_peered":"2024-09-13T06:13:29.877488+0000","last_clean":"2024-09-13T06:13:29.877488+0000","last_became_active":"2024-09-13T06:09:38.166333+0000","last_became_peered":"2024-09-13T06:09:38.166333+0000","last_unstale":"2024-09-13T06:13:29.877488+0000","last_undegraded":"2024-09-13T06:13:29.877488+0000","last_fullsized":"2024-09-13T06:13:29.877488+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'39","last_scrub_stamp":"2024-09-13T06:13:29.877300+0000","last_deep_scrub":"35'39","last_deep_scrub_stamp":"2024-09-13T06:13:29.877300+0000","last_clean_scrub_stamp":"2024-09-13T06:13:29.877300+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:40:12.627053+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:36.323225+0000","last_change":"2024-09-13T06:13:36.323280+0000","last_active":"2024-09-13T06:13:36.323225+0000","last_peered":"2024-09-13T06:13:36.323225+0000","last_clean":"2024-09-13T06:13:36.323225+0000","last_became_active":"2024-09-13T06:09:40.178392+0000","last_became_peered":"2024-09-13T06:09:40.178392+0000","last_unstale":"2024-09-13T06:13:36.323225+0000","last_undegraded":"2024-09-13T06:13:36.323225+0000","last_fullsized":"2024-09-13T06:13:36.323225+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:36.323029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:36.323029+0000","last_clean_scrub_stamp":"2024-09-13T06:13:36.323029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:56:23.983741+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"35'8","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.443209+0000","last_change":"2024-09-13T06:09:42.214258+0000","last_active":"2024-09-13T06:13:25.443209+0000","last_peered":"2024-09-13T06:13:25.443209+0000","last_clean":"2024-09-13T06:13:25.443209+0000","last_became_active":"2024-09-13T06:09:42.213809+0000","last_became_peered":"2024-09-13T06:09:42.213809+0000","last_unstale":"2024-09-13T06:13:25.443209+0000","last_undegraded":"2024-09-13T06:13:25.443209+0000","last_fullsized":"2024-09-13T06:13:25.443209+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"35'6","reported_seq":83,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:47.104386+0000","last_change":"2024-09-13T06:13:47.104386+0000","last_active":"2024-09-13T06:13:47.104386+0000","last_peered":"2024-09-13T06:13:47.104386+0000","last_clean":"2024-09-13T06:13:47.104386+0000","last_became_active":"2024-09-13T06:09:34.124044+0000","last_became_peered":"2024-09-13T06:09:34.124044+0000","last_unstale":"2024-09-13T06:13:47.104386+0000","last_undegraded":"2024-09-13T06:13:47.104386+0000","last_fullsized":"2024-09-13T06:13:47.104386+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:13:47.104098+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:13:47.104098+0000","last_clean_scrub_stamp":"2024-09-13T06:13:47.104098+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:28:40.579321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:05.457710+0000","last_change":"2024-09-13T06:14:05.457846+0000","last_active":"2024-09-13T06:14:05.457710+0000","last_peered":"2024-09-13T06:14:05.457710+0000","last_clean":"2024-09-13T06:14:05.457710+0000","last_became_active":"2024-09-13T06:09:32.133972+0000","last_became_peered":"2024-09-13T06:09:32.133972+0000","last_unstale":"2024-09-13T06:14:05.457710+0000","last_undegraded":"2024-09-13T06:14:05.457710+0000","last_fullsized":"2024-09-13T06:14:05.457710+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:05.457422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:05.457422+0000","last_clean_scrub_stamp":"2024-09-13T06:14:05.457422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:46:40.297521+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"35'12","reported_seq":71,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:54.184427+0000","last_change":"2024-09-13T06:13:54.184427+0000","last_active":"2024-09-13T06:13:54.184427+0000","last_peered":"2024-09-13T06:13:54.184427+0000","last_clean":"2024-09-13T06:13:54.184427+0000","last_became_active":"2024-09-13T06:09:34.112805+0000","last_became_peered":"2024-09-13T06:09:34.112805+0000","last_unstale":"2024-09-13T06:13:54.184427+0000","last_undegraded":"2024-09-13T06:13:54.184427+0000","last_fullsized":"2024-09-13T06:13:54.184427+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'12","last_scrub_stamp":"2024-09-13T06:13:54.184142+0000","last_deep_scrub":"35'12","last_deep_scrub_stamp":"2024-09-13T06:13:54.184142+0000","last_clean_scrub_stamp":"2024-09-13T06:13:54.184142+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:51:20.968060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:08.975226+0000","last_change":"2024-09-13T06:14:08.975415+0000","last_active":"2024-09-13T06:14:08.975226+0000","last_peered":"2024-09-13T06:14:08.975226+0000","last_clean":"2024-09-13T06:14:08.975226+0000","last_became_active":"2024-09-13T06:09:32.145941+0000","last_became_peered":"2024-09-13T06:09:32.145941+0000","last_unstale":"2024-09-13T06:14:08.975226+0000","last_undegraded":"2024-09-13T06:14:08.975226+0000","last_fullsized":"2024-09-13T06:14:08.975226+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:08.974987+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:08.974987+0000","last_clean_scrub_stamp":"2024-09-13T06:14:08.974987+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:47:49.396587+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"35'10","reported_seq":82,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:04.932958+0000","last_change":"2024-09-13T06:14:04.933134+0000","last_active":"2024-09-13T06:14:04.932958+0000","last_peered":"2024-09-13T06:14:04.932958+0000","last_clean":"2024-09-13T06:14:04.932958+0000","last_became_active":"2024-09-13T06:09:34.118325+0000","last_became_peered":"2024-09-13T06:09:34.118325+0000","last_unstale":"2024-09-13T06:14:04.932958+0000","last_undegraded":"2024-09-13T06:14:04.932958+0000","last_fullsized":"2024-09-13T06:14:04.932958+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-09-13T06:14:04.932682+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-09-13T06:14:04.932682+0000","last_clean_scrub_stamp":"2024-09-13T06:14:04.932682+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:01:08.869470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"35'2","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:14.902552+0000","last_change":"2024-09-13T06:14:14.902614+0000","last_active":"2024-09-13T06:14:14.902552+0000","last_peered":"2024-09-13T06:14:14.902552+0000","last_clean":"2024-09-13T06:14:14.902552+0000","last_became_active":"2024-09-13T06:09:32.133230+0000","last_became_peered":"2024-09-13T06:09:32.133230+0000","last_unstale":"2024-09-13T06:14:14.902552+0000","last_undegraded":"2024-09-13T06:14:14.902552+0000","last_fullsized":"2024-09-13T06:14:14.902552+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:14.902345+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:14.902345+0000","last_clean_scrub_stamp":"2024-09-13T06:14:14.902345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:14:42.826299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"35'4","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:05.970204+0000","last_change":"2024-09-13T06:14:05.970361+0000","last_active":"2024-09-13T06:14:05.970204+0000","last_peered":"2024-09-13T06:14:05.970204+0000","last_clean":"2024-09-13T06:14:05.970204+0000","last_became_active":"2024-09-13T06:09:34.115512+0000","last_became_peered":"2024-09-13T06:09:34.115512+0000","last_unstale":"2024-09-13T06:14:05.970204+0000","last_undegraded":"2024-09-13T06:14:05.970204+0000","last_fullsized":"2024-09-13T06:14:05.970204+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:14:05.969984+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:14:05.969984+0000","last_clean_scrub_stamp":"2024-09-13T06:14:05.969984+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:15:46.339756+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"35'2","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:55.188916+0000","last_change":"2024-09-13T06:13:55.188996+0000","last_active":"2024-09-13T06:13:55.188916+0000","last_peered":"2024-09-13T06:13:55.188916+0000","last_clean":"2024-09-13T06:13:55.188916+0000","last_became_active":"2024-09-13T06:09:32.150328+0000","last_became_peered":"2024-09-13T06:09:32.150328+0000","last_unstale":"2024-09-13T06:13:55.188916+0000","last_undegraded":"2024-09-13T06:13:55.188916+0000","last_fullsized":"2024-09-13T06:13:55.188916+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:13:55.188727+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:13:55.188727+0000","last_clean_scrub_stamp":"2024-09-13T06:13:55.188727+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:42:47.449646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"35'12","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:58.146481+0000","last_change":"2024-09-13T06:13:58.146634+0000","last_active":"2024-09-13T06:13:58.146481+0000","last_peered":"2024-09-13T06:13:58.146481+0000","last_clean":"2024-09-13T06:13:58.146481+0000","last_became_active":"2024-09-13T06:09:34.113986+0000","last_became_peered":"2024-09-13T06:09:34.113986+0000","last_unstale":"2024-09-13T06:13:58.146481+0000","last_undegraded":"2024-09-13T06:13:58.146481+0000","last_fullsized":"2024-09-13T06:13:58.146481+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'12","last_scrub_stamp":"2024-09-13T06:13:58.146265+0000","last_deep_scrub":"35'12","last_deep_scrub_stamp":"2024-09-13T06:13:58.146265+0000","last_clean_scrub_stamp":"2024-09-13T06:13:58.146265+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:51:22.340040+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:13.944371+0000","last_change":"2024-09-13T06:14:13.944480+0000","last_active":"2024-09-13T06:14:13.944371+0000","last_peered":"2024-09-13T06:14:13.944371+0000","last_clean":"2024-09-13T06:14:13.944371+0000","last_became_active":"2024-09-13T06:09:32.136268+0000","last_became_peered":"2024-09-13T06:09:32.136268+0000","last_unstale":"2024-09-13T06:14:13.944371+0000","last_undegraded":"2024-09-13T06:14:13.944371+0000","last_fullsized":"2024-09-13T06:14:13.944371+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:13.944088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:13.944088+0000","last_clean_scrub_stamp":"2024-09-13T06:14:13.944088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:44:54.412744+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"35'4","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:19.128998+0000","last_change":"2024-09-13T06:14:19.129062+0000","last_active":"2024-09-13T06:14:19.128998+0000","last_peered":"2024-09-13T06:14:19.128998+0000","last_clean":"2024-09-13T06:14:19.128998+0000","last_became_active":"2024-09-13T06:09:34.121261+0000","last_became_peered":"2024-09-13T06:09:34.121261+0000","last_unstale":"2024-09-13T06:14:19.128998+0000","last_undegraded":"2024-09-13T06:14:19.128998+0000","last_fullsized":"2024-09-13T06:14:19.128998+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:14:19.128789+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:14:19.128789+0000","last_clean_scrub_stamp":"2024-09-13T06:14:19.128789+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:05:27.992700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:08.105829+0000","last_change":"2024-09-13T06:14:08.105893+0000","last_active":"2024-09-13T06:14:08.105829+0000","last_peered":"2024-09-13T06:14:08.105829+0000","last_clean":"2024-09-13T06:14:08.105829+0000","last_became_active":"2024-09-13T06:09:32.141602+0000","last_became_peered":"2024-09-13T06:09:32.141602+0000","last_unstale":"2024-09-13T06:14:08.105829+0000","last_undegraded":"2024-09-13T06:14:08.105829+0000","last_fullsized":"2024-09-13T06:14:08.105829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:08.105610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:08.105610+0000","last_clean_scrub_stamp":"2024-09-13T06:14:08.105610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:19:46.183614+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"35'6","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:18.072373+0000","last_change":"2024-09-13T06:14:18.072506+0000","last_active":"2024-09-13T06:14:18.072373+0000","last_peered":"2024-09-13T06:14:18.072373+0000","last_clean":"2024-09-13T06:14:18.072373+0000","last_became_active":"2024-09-13T06:09:34.122424+0000","last_became_peered":"2024-09-13T06:09:34.122424+0000","last_unstale":"2024-09-13T06:14:18.072373+0000","last_undegraded":"2024-09-13T06:14:18.072373+0000","last_fullsized":"2024-09-13T06:14:18.072373+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:14:18.072146+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:14:18.072146+0000","last_clean_scrub_stamp":"2024-09-13T06:14:18.072146+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:09:59.488966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:11.491383+0000","last_change":"2024-09-13T06:14:11.491442+0000","last_active":"2024-09-13T06:14:11.491383+0000","last_peered":"2024-09-13T06:14:11.491383+0000","last_clean":"2024-09-13T06:14:11.491383+0000","last_became_active":"2024-09-13T06:09:32.119665+0000","last_became_peered":"2024-09-13T06:09:32.119665+0000","last_unstale":"2024-09-13T06:14:11.491383+0000","last_undegraded":"2024-09-13T06:14:11.491383+0000","last_fullsized":"2024-09-13T06:14:11.491383+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:11.491173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:11.491173+0000","last_clean_scrub_stamp":"2024-09-13T06:14:11.491173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:27:39.464448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"35'10","reported_seq":68,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:07.156771+0000","last_change":"2024-09-13T06:14:07.156840+0000","last_active":"2024-09-13T06:14:07.156771+0000","last_peered":"2024-09-13T06:14:07.156771+0000","last_clean":"2024-09-13T06:14:07.156771+0000","last_became_active":"2024-09-13T06:09:34.114378+0000","last_became_peered":"2024-09-13T06:09:34.114378+0000","last_unstale":"2024-09-13T06:14:07.156771+0000","last_undegraded":"2024-09-13T06:14:07.156771+0000","last_fullsized":"2024-09-13T06:14:07.156771+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-09-13T06:14:07.156555+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-09-13T06:14:07.156555+0000","last_clean_scrub_stamp":"2024-09-13T06:14:07.156555+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:56:33.412136+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"35'4","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:15.998938+0000","last_change":"2024-09-13T06:14:15.999004+0000","last_active":"2024-09-13T06:14:15.998938+0000","last_peered":"2024-09-13T06:14:15.998938+0000","last_clean":"2024-09-13T06:14:15.998938+0000","last_became_active":"2024-09-13T06:09:32.146011+0000","last_became_peered":"2024-09-13T06:09:32.146011+0000","last_unstale":"2024-09-13T06:14:15.998938+0000","last_undegraded":"2024-09-13T06:14:15.998938+0000","last_fullsized":"2024-09-13T06:14:15.998938+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:14:15.998743+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:14:15.998743+0000","last_clean_scrub_stamp":"2024-09-13T06:14:15.998743+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:57:13.676423+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"35'2","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:01.041151+0000","last_change":"2024-09-13T06:14:01.041151+0000","last_active":"2024-09-13T06:14:01.041151+0000","last_peered":"2024-09-13T06:14:01.041151+0000","last_clean":"2024-09-13T06:14:01.041151+0000","last_became_active":"2024-09-13T06:09:34.117659+0000","last_became_peered":"2024-09-13T06:09:34.117659+0000","last_unstale":"2024-09-13T06:14:01.041151+0000","last_undegraded":"2024-09-13T06:14:01.041151+0000","last_fullsized":"2024-09-13T06:14:01.041151+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:01.040862+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:01.040862+0000","last_clean_scrub_stamp":"2024-09-13T06:14:01.040862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:24:05.707493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"35'2","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.440687+0000","last_change":"2024-09-13T06:09:32.124201+0000","last_active":"2024-09-13T06:13:25.440687+0000","last_peered":"2024-09-13T06:13:25.440687+0000","last_clean":"2024-09-13T06:13:25.440687+0000","last_became_active":"2024-09-13T06:09:32.121250+0000","last_became_peered":"2024-09-13T06:09:32.121250+0000","last_unstale":"2024-09-13T06:13:25.440687+0000","last_undegraded":"2024-09-13T06:13:25.440687+0000","last_fullsized":"2024-09-13T06:13:25.440687+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"35'6","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:08.927366+0000","last_change":"2024-09-13T06:14:08.927366+0000","last_active":"2024-09-13T06:14:08.927366+0000","last_peered":"2024-09-13T06:14:08.927366+0000","last_clean":"2024-09-13T06:14:08.927366+0000","last_became_active":"2024-09-13T06:09:34.118270+0000","last_became_peered":"2024-09-13T06:09:34.118270+0000","last_unstale":"2024-09-13T06:14:08.927366+0000","last_undegraded":"2024-09-13T06:14:08.927366+0000","last_fullsized":"2024-09-13T06:14:08.927366+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:14:08.926982+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:14:08.926982+0000","last_clean_scrub_stamp":"2024-09-13T06:14:08.926982+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:32:51.698999+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:07.008210+0000","last_change":"2024-09-13T06:14:07.008276+0000","last_active":"2024-09-13T06:14:07.008210+0000","last_peered":"2024-09-13T06:14:07.008210+0000","last_clean":"2024-09-13T06:14:07.008210+0000","last_became_active":"2024-09-13T06:09:32.145988+0000","last_became_peered":"2024-09-13T06:09:32.145988+0000","last_unstale":"2024-09-13T06:14:07.008210+0000","last_undegraded":"2024-09-13T06:14:07.008210+0000","last_fullsized":"2024-09-13T06:14:07.008210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:07.008017+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:07.008017+0000","last_clean_scrub_stamp":"2024-09-13T06:14:07.008017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:52:30.109612+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"33'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:07.967599+0000","last_change":"2024-09-13T06:14:07.967667+0000","last_active":"2024-09-13T06:14:07.967599+0000","last_peered":"2024-09-13T06:14:07.967599+0000","last_clean":"2024-09-13T06:14:07.967599+0000","last_became_active":"2024-09-13T06:09:34.117320+0000","last_became_peered":"2024-09-13T06:09:34.117320+0000","last_unstale":"2024-09-13T06:14:07.967599+0000","last_undegraded":"2024-09-13T06:14:07.967599+0000","last_fullsized":"2024-09-13T06:14:07.967599+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T06:14:07.967409+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T06:14:07.967409+0000","last_clean_scrub_stamp":"2024-09-13T06:14:07.967409+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:23:37.518274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:10.151581+0000","last_change":"2024-09-13T06:14:10.151647+0000","last_active":"2024-09-13T06:14:10.151581+0000","last_peered":"2024-09-13T06:14:10.151581+0000","last_clean":"2024-09-13T06:14:10.151581+0000","last_became_active":"2024-09-13T06:09:32.141009+0000","last_became_peered":"2024-09-13T06:09:32.141009+0000","last_unstale":"2024-09-13T06:14:10.151581+0000","last_undegraded":"2024-09-13T06:14:10.151581+0000","last_fullsized":"2024-09-13T06:14:10.151581+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:10.151382+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:10.151382+0000","last_clean_scrub_stamp":"2024-09-13T06:14:10.151382+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:48:46.322553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"35'12","reported_seq":92,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:50.099644+0000","last_change":"2024-09-13T06:13:50.099644+0000","last_active":"2024-09-13T06:13:50.099644+0000","last_peered":"2024-09-13T06:13:50.099644+0000","last_clean":"2024-09-13T06:13:50.099644+0000","last_became_active":"2024-09-13T06:09:34.124270+0000","last_became_peered":"2024-09-13T06:09:34.124270+0000","last_unstale":"2024-09-13T06:13:50.099644+0000","last_undegraded":"2024-09-13T06:13:50.099644+0000","last_fullsized":"2024-09-13T06:13:50.099644+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'12","last_scrub_stamp":"2024-09-13T06:13:50.099391+0000","last_deep_scrub":"35'12","last_deep_scrub_stamp":"2024-09-13T06:13:50.099391+0000","last_clean_scrub_stamp":"2024-09-13T06:13:50.099391+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:45:17.171613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"35'2","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:06.105644+0000","last_change":"2024-09-13T06:14:06.105715+0000","last_active":"2024-09-13T06:14:06.105644+0000","last_peered":"2024-09-13T06:14:06.105644+0000","last_clean":"2024-09-13T06:14:06.105644+0000","last_became_active":"2024-09-13T06:09:32.142581+0000","last_became_peered":"2024-09-13T06:09:32.142581+0000","last_unstale":"2024-09-13T06:14:06.105644+0000","last_undegraded":"2024-09-13T06:14:06.105644+0000","last_fullsized":"2024-09-13T06:14:06.105644+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:06.105415+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:06.105415+0000","last_clean_scrub_stamp":"2024-09-13T06:14:06.105415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:14:58.354875+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"35'16","reported_seq":86,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:57.087154+0000","last_change":"2024-09-13T06:13:57.087154+0000","last_active":"2024-09-13T06:13:57.087154+0000","last_peered":"2024-09-13T06:13:57.087154+0000","last_clean":"2024-09-13T06:13:57.087154+0000","last_became_active":"2024-09-13T06:09:34.118290+0000","last_became_peered":"2024-09-13T06:09:34.118290+0000","last_unstale":"2024-09-13T06:13:57.087154+0000","last_undegraded":"2024-09-13T06:13:57.087154+0000","last_fullsized":"2024-09-13T06:13:57.087154+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'16","last_scrub_stamp":"2024-09-13T06:13:57.086869+0000","last_deep_scrub":"35'16","last_deep_scrub_stamp":"2024-09-13T06:13:57.086869+0000","last_clean_scrub_stamp":"2024-09-13T06:13:57.086869+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:49:34.359420+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":58,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.440753+0000","last_change":"2024-09-13T06:09:32.124596+0000","last_active":"2024-09-13T06:13:25.440753+0000","last_peered":"2024-09-13T06:13:25.440753+0000","last_clean":"2024-09-13T06:13:25.440753+0000","last_became_active":"2024-09-13T06:09:32.121400+0000","last_became_peered":"2024-09-13T06:09:32.121400+0000","last_unstale":"2024-09-13T06:13:25.440753+0000","last_undegraded":"2024-09-13T06:13:25.440753+0000","last_fullsized":"2024-09-13T06:13:25.440753+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"35'14","reported_seq":83,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:51.115078+0000","last_change":"2024-09-13T06:13:51.115078+0000","last_active":"2024-09-13T06:13:51.115078+0000","last_peered":"2024-09-13T06:13:51.115078+0000","last_clean":"2024-09-13T06:13:51.115078+0000","last_became_active":"2024-09-13T06:09:34.121743+0000","last_became_peered":"2024-09-13T06:09:34.121743+0000","last_unstale":"2024-09-13T06:13:51.115078+0000","last_undegraded":"2024-09-13T06:13:51.115078+0000","last_fullsized":"2024-09-13T06:13:51.115078+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'14","last_scrub_stamp":"2024-09-13T06:13:51.114821+0000","last_deep_scrub":"35'14","last_deep_scrub_stamp":"2024-09-13T06:13:51.114821+0000","last_clean_scrub_stamp":"2024-09-13T06:13:51.114821+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:13:09.983207+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"35'2","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.440935+0000","last_change":"2024-09-13T06:09:32.135724+0000","last_active":"2024-09-13T06:13:25.440935+0000","last_peered":"2024-09-13T06:13:25.440935+0000","last_clean":"2024-09-13T06:13:25.440935+0000","last_became_active":"2024-09-13T06:09:32.127830+0000","last_became_peered":"2024-09-13T06:09:32.127830+0000","last_unstale":"2024-09-13T06:13:25.440935+0000","last_undegraded":"2024-09-13T06:13:25.440935+0000","last_fullsized":"2024-09-13T06:13:25.440935+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"35'4","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:57.956132+0000","last_change":"2024-09-13T06:13:57.956132+0000","last_active":"2024-09-13T06:13:57.956132+0000","last_peered":"2024-09-13T06:13:57.956132+0000","last_clean":"2024-09-13T06:13:57.956132+0000","last_became_active":"2024-09-13T06:09:34.126020+0000","last_became_peered":"2024-09-13T06:09:34.126020+0000","last_unstale":"2024-09-13T06:13:57.956132+0000","last_undegraded":"2024-09-13T06:13:57.956132+0000","last_fullsized":"2024-09-13T06:13:57.956132+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:13:57.955748+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:13:57.955748+0000","last_clean_scrub_stamp":"2024-09-13T06:13:57.955748+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:48:29.811216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:10.525305+0000","last_change":"2024-09-13T06:14:10.525305+0000","last_active":"2024-09-13T06:14:10.525305+0000","last_peered":"2024-09-13T06:14:10.525305+0000","last_clean":"2024-09-13T06:14:10.525305+0000","last_became_active":"2024-09-13T06:09:32.119542+0000","last_became_peered":"2024-09-13T06:09:32.119542+0000","last_unstale":"2024-09-13T06:14:10.525305+0000","last_undegraded":"2024-09-13T06:14:10.525305+0000","last_fullsized":"2024-09-13T06:14:10.525305+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:10.524864+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:10.524864+0000","last_clean_scrub_stamp":"2024-09-13T06:14:10.524864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:24:35.781954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"35'6","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:59.089157+0000","last_change":"2024-09-13T06:13:59.089218+0000","last_active":"2024-09-13T06:13:59.089157+0000","last_peered":"2024-09-13T06:13:59.089157+0000","last_clean":"2024-09-13T06:13:59.089157+0000","last_became_active":"2024-09-13T06:09:34.110506+0000","last_became_peered":"2024-09-13T06:09:34.110506+0000","last_unstale":"2024-09-13T06:13:59.089157+0000","last_undegraded":"2024-09-13T06:13:59.089157+0000","last_fullsized":"2024-09-13T06:13:59.089157+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:13:59.088967+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:13:59.088967+0000","last_clean_scrub_stamp":"2024-09-13T06:13:59.088967+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:47:06.868835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.440984+0000","last_change":"2024-09-13T06:09:32.130216+0000","last_active":"2024-09-13T06:13:25.440984+0000","last_peered":"2024-09-13T06:13:25.440984+0000","last_clean":"2024-09-13T06:13:25.440984+0000","last_became_active":"2024-09-13T06:09:32.121895+0000","last_became_peered":"2024-09-13T06:09:32.121895+0000","last_unstale":"2024-09-13T06:13:25.440984+0000","last_undegraded":"2024-09-13T06:13:25.440984+0000","last_fullsized":"2024-09-13T06:13:25.440984+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:31.062089+0000","last_clean_scrub_stamp":"2024-09-13T06:09:31.062089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:17.885220+0000","last_change":"2024-09-13T06:14:17.885278+0000","last_active":"2024-09-13T06:14:17.885220+0000","last_peered":"2024-09-13T06:14:17.885220+0000","last_clean":"2024-09-13T06:14:17.885220+0000","last_became_active":"2024-09-13T06:09:32.130056+0000","last_became_peered":"2024-09-13T06:09:32.130056+0000","last_unstale":"2024-09-13T06:14:17.885220+0000","last_undegraded":"2024-09-13T06:14:17.885220+0000","last_fullsized":"2024-09-13T06:14:17.885220+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:17.885008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:17.885008+0000","last_clean_scrub_stamp":"2024-09-13T06:14:17.885008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:43:49.653431+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"35'8","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:50.089510+0000","last_change":"2024-09-13T06:13:50.089510+0000","last_active":"2024-09-13T06:13:50.089510+0000","last_peered":"2024-09-13T06:13:50.089510+0000","last_clean":"2024-09-13T06:13:50.089510+0000","last_became_active":"2024-09-13T06:09:34.130980+0000","last_became_peered":"2024-09-13T06:09:34.130980+0000","last_unstale":"2024-09-13T06:13:50.089510+0000","last_undegraded":"2024-09-13T06:13:50.089510+0000","last_fullsized":"2024-09-13T06:13:50.089510+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-13T06:13:50.089259+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-13T06:13:50.089259+0000","last_clean_scrub_stamp":"2024-09-13T06:13:50.089259+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:04:38.003620+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"33'2","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:01.059413+0000","last_change":"2024-09-13T06:14:01.059413+0000","last_active":"2024-09-13T06:14:01.059413+0000","last_peered":"2024-09-13T06:14:01.059413+0000","last_clean":"2024-09-13T06:14:01.059413+0000","last_became_active":"2024-09-13T06:09:32.149426+0000","last_became_peered":"2024-09-13T06:09:32.149426+0000","last_unstale":"2024-09-13T06:14:01.059413+0000","last_undegraded":"2024-09-13T06:14:01.059413+0000","last_fullsized":"2024-09-13T06:14:01.059413+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T06:14:01.059140+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T06:14:01.059140+0000","last_clean_scrub_stamp":"2024-09-13T06:14:01.059140+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:11:35.487998+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"35'4","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:03.116753+0000","last_change":"2024-09-13T06:14:03.116819+0000","last_active":"2024-09-13T06:14:03.116753+0000","last_peered":"2024-09-13T06:14:03.116753+0000","last_clean":"2024-09-13T06:14:03.116753+0000","last_became_active":"2024-09-13T06:09:34.111230+0000","last_became_peered":"2024-09-13T06:09:34.111230+0000","last_unstale":"2024-09-13T06:14:03.116753+0000","last_undegraded":"2024-09-13T06:14:03.116753+0000","last_fullsized":"2024-09-13T06:14:03.116753+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:14:03.116583+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:14:03.116583+0000","last_clean_scrub_stamp":"2024-09-13T06:14:03.116583+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:05:21.374929+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":274,"ondisk_log_size":274,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2281,"ondisk_log_size":2281,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1530,"ondisk_log_size":1530,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1618,"num_read_kb":1508,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640322,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39984,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331856,"statfs":{"total":96636764160,"available":96595820544,"internally_reserved":0,"allocated":491520,"data_stored":155427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640322,"num_pgs":155,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40524,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331316,"statfs":{"total":96636764160,"available":96595267584,"internally_reserved":0,"allocated":1044480,"data_stored":743705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673026,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40500,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331340,"statfs":{"total":96636764160,"available":96595292160,"internally_reserved":0,"allocated":1019904,"data_stored":743361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705728,"num_pgs":170,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39952,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331888,"statfs":{"total":96636764160,"available":96595853312,"internally_reserved":0,"allocated":458752,"data_stored":154423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T06:14:27.031 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:27.032 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:27.032 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:27.032 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:27.032 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:27.033 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-13T06:09:35.087004+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=35, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:27.033 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:27.033 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:27.033 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:27.034 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:27.034 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:27.034 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-13T06:09:21.188659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:27.035 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-13T06:09:21.188659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:27.035 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:27.035 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:27.035 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-13T06:09:21.188659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:27.035 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-13T06:09:21.188659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:27.036 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-13T06:09:21.188659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=21, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:27.036 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:27.036 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:27.036 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:27.037 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:27.037 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:27.037 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:27.037 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:27.037 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:27.038 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:27.038 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:27.038 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:27.038 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:27.038 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-13T06:09:31.062089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:27.039 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T06:14:47.040 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T06:14:47.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:47.167+0000 7f96fd519640 1 Processor -- start 2024-09-13T06:14:47.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:47.167+0000 7f96fd519640 1 -- start start 2024-09-13T06:14:47.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:47.167+0000 7f96fd519640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f96f806ece0 0x7f96f8130e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:14:47.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:47.167+0000 7f96fd519640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96f806f750 con 0x7f96f806e1f0 2024-09-13T06:14:47.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:47.167+0000 7f96fd519640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f96f8070c10 con 0x7f96f806ece0 2024-09-13T06:14:47.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:47.167+0000 7f96f67fc640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f96f806ece0 0x7f96f8130e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:14:47.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:47.167+0000 7f96f67fc640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f96f806ece0 0x7f96f8130e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:40256/0 (socket says 172.21.15.120:40256) 2024-09-13T06:14:47.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:47.167+0000 7f96f67fc640 1 -- 172.21.15.120:0/543258837 learned_addr learned my addr 172.21.15.120:0/543258837 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-13T06:14:47.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:47.167+0000 7f96f6ffd640 1 --1- 172.21.15.120:0/543258837 >> v1:172.21.15.120:6789/0 conn(0x7f96f806e1f0 0x7f96f806e5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:46838/0 (socket says 172.21.15.120:46838) 2024-09-13T06:14:47.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:47.167+0000 7f96f67fc640 1 -- 172.21.15.120:0/543258837 >> v1:172.21.15.120:6789/0 conn(0x7f96f806e1f0 legacy=0x7f96f806e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:14:47.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:47.167+0000 7f96f5ffb640 1 -- 172.21.15.120:0/543258837 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2642292076 0 0) 0x7f96f806f750 con 0x7f96f806e1f0 2024-09-13T06:14:47.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:47.167+0000 7f96f67fc640 1 -- 172.21.15.120:0/543258837 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96f80703f0 con 0x7f96f806ece0 2024-09-13T06:14:47.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:47.167+0000 7f96f67fc640 1 --2- 172.21.15.120:0/543258837 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f96f806ece0 0x7f96f8130e50 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f96e80097f0 tx=0x7f96e801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8b1e9bdce0d4a19 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:14:47.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:47.167+0000 7f96f5ffb640 1 -- 172.21.15.120:0/543258837 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96e80b0070 con 0x7f96f806ece0 2024-09-13T06:14:47.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:47.167+0000 7f96f5ffb640 1 -- 172.21.15.120:0/543258837 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96e80ab530 con 0x7f96f806ece0 2024-09-13T06:14:47.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:47.171+0000 7f96f5ffb640 1 -- 172.21.15.120:0/543258837 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96e80ab830 con 0x7f96f806ece0 2024-09-13T06:14:47.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:47.171+0000 7f96fd519640 1 -- 172.21.15.120:0/543258837 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f96f806ece0 msgr2=0x7f96f8130e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:14:47.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:47.171+0000 7f96fd519640 1 --2- 172.21.15.120:0/543258837 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f96f806ece0 0x7f96f8130e50 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f96e80097f0 tx=0x7f96e801c430 comp rx=0 tx=0).stop 2024-09-13T06:14:47.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:47.171+0000 7f96fd519640 1 -- 172.21.15.120:0/543258837 shutdown_connections 2024-09-13T06:14:47.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:47.171+0000 7f96fd519640 1 --2- 172.21.15.120:0/543258837 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f96f806ece0 0x7f96f8130e50 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:14:47.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:47.171+0000 7f96fd519640 1 -- 172.21.15.120:0/543258837 >> 172.21.15.120:0/543258837 conn(0x7f96f8099a50 msgr2=0x7f96f80972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:14:47.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:47.171+0000 7f96fd519640 1 -- 172.21.15.120:0/543258837 shutdown_connections 2024-09-13T06:14:47.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:47.171+0000 7f96fd519640 1 -- 172.21.15.120:0/543258837 wait complete. 2024-09-13T06:14:47.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:47.171+0000 7f96fd519640 1 Processor -- start 2024-09-13T06:14:47.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:47.171+0000 7f96fd519640 1 -- start start 2024-09-13T06:14:47.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:47.171+0000 7f96fd519640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f96f806e1f0 0x7f96f8127ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:14:47.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:47.171+0000 7f96fd519640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f96f8133d30 con 0x7f96f806e1f0 2024-09-13T06:14:47.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:47.171+0000 7f96f6ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f96f806e1f0 0x7f96f8127ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:14:47.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:47.171+0000 7f96f6ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f96f806e1f0 0x7f96f8127ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:40272/0 (socket says 172.21.15.120:40272) 2024-09-13T06:14:47.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:47.171+0000 7f96f6ffd640 1 -- 172.21.15.120:0/1741778285 learned_addr learned my addr 172.21.15.120:0/1741778285 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-13T06:14:47.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:47.171+0000 7f96f6ffd640 1 -- 172.21.15.120:0/1741778285 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96f812aa90 con 0x7f96f806e1f0 2024-09-13T06:14:47.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:47.171+0000 7f96f6ffd640 1 --2- 172.21.15.120:0/1741778285 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f96f806e1f0 0x7f96f8127ae0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f96ec00c420 tx=0x7f96ec00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:14:47.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:47.171+0000 7f96df7fe640 1 -- 172.21.15.120:0/1741778285 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96ec018070 con 0x7f96f806e1f0 2024-09-13T06:14:47.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:47.171+0000 7f96df7fe640 1 -- 172.21.15.120:0/1741778285 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96ec0074d0 con 0x7f96f806e1f0 2024-09-13T06:14:47.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:47.171+0000 7f96df7fe640 1 -- 172.21.15.120:0/1741778285 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96ec004960 con 0x7f96f806e1f0 2024-09-13T06:14:47.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:47.171+0000 7f96fd519640 1 -- 172.21.15.120:0/1741778285 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96f8129e60 con 0x7f96f806e1f0 2024-09-13T06:14:47.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:47.171+0000 7f96fd519640 1 -- 172.21.15.120:0/1741778285 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96f812a560 con 0x7f96f806e1f0 2024-09-13T06:14:47.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:47.175+0000 7f96df7fe640 1 -- 172.21.15.120:0/1741778285 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f96ec01b070 con 0x7f96f806e1f0 2024-09-13T06:14:47.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:47.175+0000 7f96fd519640 1 -- 172.21.15.120:0/1741778285 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96f806e5d0 con 0x7f96f806e1f0 2024-09-13T06:14:47.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:47.175+0000 7f96df7fe640 1 --2- 172.21.15.120:0/1741778285 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f96e4035db0 0x7f96e4038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:14:47.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:47.175+0000 7f96df7fe640 1 -- 172.21.15.120:0/1741778285 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f96ec048570 con 0x7f96f806e1f0 2024-09-13T06:14:47.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:47.175+0000 7f96f67fc640 1 --2- 172.21.15.120:0/1741778285 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f96e4035db0 0x7f96e4038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:14:47.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:47.175+0000 7f96f67fc640 1 --2- 172.21.15.120:0/1741778285 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f96e4035db0 0x7f96e4038270 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f96f80992d0 tx=0x7f96e80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:14:47.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:47.179+0000 7f96df7fe640 1 -- 172.21.15.120:0/1741778285 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f96ec01ae10 con 0x7f96f806e1f0 2024-09-13T06:14:47.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:47.335+0000 7f96fd519640 1 -- 172.21.15.120:0/1741778285 --> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f96f80726e0 con 0x7f96e4035db0 2024-09-13T06:14:47.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:47.379+0000 7f96df7fe640 1 -- 172.21.15.120:0/1741778285 <== mgr.4100 v2:172.21.15.194:6824/3475680902 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666231 (secure 0 0 0) 0x7f96e80b1040 con 0x7f96e4035db0 2024-09-13T06:14:47.389 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T06:14:47.396 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-09-13T06:14:47.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:47.391+0000 7f96fd519640 1 -- 172.21.15.120:0/1741778285 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f96e4035db0 msgr2=0x7f96e4038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:14:47.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:47.391+0000 7f96fd519640 1 --2- 172.21.15.120:0/1741778285 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f96e4035db0 0x7f96e4038270 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f96f80992d0 tx=0x7f96e80a6000 comp rx=0 tx=0).stop 2024-09-13T06:14:47.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:47.391+0000 7f96fd519640 1 -- 172.21.15.120:0/1741778285 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f96f806e1f0 msgr2=0x7f96f8127ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:14:47.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:47.391+0000 7f96fd519640 1 --2- 172.21.15.120:0/1741778285 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f96f806e1f0 0x7f96f8127ae0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f96ec00c420 tx=0x7f96ec00c8e0 comp rx=0 tx=0).stop 2024-09-13T06:14:47.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:47.391+0000 7f96fd519640 1 -- 172.21.15.120:0/1741778285 shutdown_connections 2024-09-13T06:14:47.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:47.391+0000 7f96fd519640 1 --2- 172.21.15.120:0/1741778285 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f96e4035db0 0x7f96e4038270 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:14:47.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:47.391+0000 7f96fd519640 1 --2- 172.21.15.120:0/1741778285 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f96f806e1f0 0x7f96f8127ae0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:14:47.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:47.391+0000 7f96fd519640 1 -- 172.21.15.120:0/1741778285 >> 172.21.15.120:0/1741778285 conn(0x7f96f8099a50 msgr2=0x7f96f809a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:14:47.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:47.391+0000 7f96fd519640 1 -- 172.21.15.120:0/1741778285 shutdown_connections 2024-09-13T06:14:47.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:14:47.391+0000 7f96fd519640 1 -- 172.21.15.120:0/1741778285 wait complete. 2024-09-13T06:14:47.410 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":197,"stamp":"2024-09-13T06:14:45.866953+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605402,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5108,"num_read_kb":4689,"num_write":2181,"num_write_kb":61376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3041,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4798,"ondisk_log_size":4798,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":160960,"kb_used_data":2944,"kb_used_omap":6,"kb_used_meta":157945,"kb_avail":377326400,"statfs":{"total":386547056640,"available":386382233600,"internally_reserved":0,"allocated":3014656,"data_stored":1796916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":161736470},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007220"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:53.451160+0000","last_change":"2024-09-13T06:13:53.451223+0000","last_active":"2024-09-13T06:13:53.451160+0000","last_peered":"2024-09-13T06:13:53.451160+0000","last_clean":"2024-09-13T06:13:53.451160+0000","last_became_active":"2024-09-13T06:09:32.140025+0000","last_became_peered":"2024-09-13T06:09:32.140025+0000","last_unstale":"2024-09-13T06:13:53.451160+0000","last_undegraded":"2024-09-13T06:13:53.451160+0000","last_fullsized":"2024-09-13T06:13:53.451160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:53.450946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:53.450946+0000","last_clean_scrub_stamp":"2024-09-13T06:13:53.450946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:05:48.880319+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"35'22","reported_seq":104,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:48.092625+0000","last_change":"2024-09-13T06:13:48.092625+0000","last_active":"2024-09-13T06:13:48.092625+0000","last_peered":"2024-09-13T06:13:48.092625+0000","last_clean":"2024-09-13T06:13:48.092625+0000","last_became_active":"2024-09-13T06:09:34.122656+0000","last_became_peered":"2024-09-13T06:09:34.122656+0000","last_unstale":"2024-09-13T06:13:48.092625+0000","last_undegraded":"2024-09-13T06:13:48.092625+0000","last_fullsized":"2024-09-13T06:13:48.092625+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'22","last_scrub_stamp":"2024-09-13T06:13:48.092347+0000","last_deep_scrub":"35'22","last_deep_scrub_stamp":"2024-09-13T06:13:48.092347+0000","last_clean_scrub_stamp":"2024-09-13T06:13:48.092347+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:02:26.113000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":88,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:11.954244+0000","last_change":"2024-09-13T06:14:11.954310+0000","last_active":"2024-09-13T06:14:11.954244+0000","last_peered":"2024-09-13T06:14:11.954244+0000","last_clean":"2024-09-13T06:14:11.954244+0000","last_became_active":"2024-09-13T06:09:32.134020+0000","last_became_peered":"2024-09-13T06:09:32.134020+0000","last_unstale":"2024-09-13T06:14:11.954244+0000","last_undegraded":"2024-09-13T06:14:11.954244+0000","last_fullsized":"2024-09-13T06:14:11.954244+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:11.954043+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:11.954043+0000","last_clean_scrub_stamp":"2024-09-13T06:14:11.954043+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:29:30.352540+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"35'4","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:10.944002+0000","last_change":"2024-09-13T06:14:10.944002+0000","last_active":"2024-09-13T06:14:10.944002+0000","last_peered":"2024-09-13T06:14:10.944002+0000","last_clean":"2024-09-13T06:14:10.944002+0000","last_became_active":"2024-09-13T06:09:34.116715+0000","last_became_peered":"2024-09-13T06:09:34.116715+0000","last_unstale":"2024-09-13T06:14:10.944002+0000","last_undegraded":"2024-09-13T06:14:10.944002+0000","last_fullsized":"2024-09-13T06:14:10.944002+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:14:10.943755+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:14:10.943755+0000","last_clean_scrub_stamp":"2024-09-13T06:14:10.943755+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:12:11.377459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:20.881767+0000","last_change":"2024-09-13T06:14:20.881823+0000","last_active":"2024-09-13T06:14:20.881767+0000","last_peered":"2024-09-13T06:14:20.881767+0000","last_clean":"2024-09-13T06:14:20.881767+0000","last_became_active":"2024-09-13T06:09:32.116345+0000","last_became_peered":"2024-09-13T06:09:32.116345+0000","last_unstale":"2024-09-13T06:14:20.881767+0000","last_undegraded":"2024-09-13T06:14:20.881767+0000","last_fullsized":"2024-09-13T06:14:20.881767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:20.881557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:20.881557+0000","last_clean_scrub_stamp":"2024-09-13T06:14:20.881557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:27:51.720278+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:05.961088+0000","last_change":"2024-09-13T06:14:05.961088+0000","last_active":"2024-09-13T06:14:05.961088+0000","last_peered":"2024-09-13T06:14:05.961088+0000","last_clean":"2024-09-13T06:14:05.961088+0000","last_became_active":"2024-09-13T06:09:34.117940+0000","last_became_peered":"2024-09-13T06:09:34.117940+0000","last_unstale":"2024-09-13T06:14:05.961088+0000","last_undegraded":"2024-09-13T06:14:05.961088+0000","last_fullsized":"2024-09-13T06:14:05.961088+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:05.960824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:05.960824+0000","last_clean_scrub_stamp":"2024-09-13T06:14:05.960824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:39:07.314473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"35'4","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:12.529051+0000","last_change":"2024-09-13T06:14:12.529209+0000","last_active":"2024-09-13T06:14:12.529051+0000","last_peered":"2024-09-13T06:14:12.529051+0000","last_clean":"2024-09-13T06:14:12.529051+0000","last_became_active":"2024-09-13T06:09:32.119806+0000","last_became_peered":"2024-09-13T06:09:32.119806+0000","last_unstale":"2024-09-13T06:14:12.529051+0000","last_undegraded":"2024-09-13T06:14:12.529051+0000","last_fullsized":"2024-09-13T06:14:12.529051+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:14:12.528786+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:14:12.528786+0000","last_clean_scrub_stamp":"2024-09-13T06:14:12.528786+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:22:18.082137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"35'4","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:58.946209+0000","last_change":"2024-09-13T06:13:58.946209+0000","last_active":"2024-09-13T06:13:58.946209+0000","last_peered":"2024-09-13T06:13:58.946209+0000","last_clean":"2024-09-13T06:13:58.946209+0000","last_became_active":"2024-09-13T06:09:34.122631+0000","last_became_peered":"2024-09-13T06:09:34.122631+0000","last_unstale":"2024-09-13T06:13:58.946209+0000","last_undegraded":"2024-09-13T06:13:58.946209+0000","last_fullsized":"2024-09-13T06:13:58.946209+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:13:58.945955+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:13:58.945955+0000","last_clean_scrub_stamp":"2024-09-13T06:13:58.945955+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:33:44.383904+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:22.921170+0000","last_change":"2024-09-13T06:14:22.921170+0000","last_active":"2024-09-13T06:14:22.921170+0000","last_peered":"2024-09-13T06:14:22.921170+0000","last_clean":"2024-09-13T06:14:22.921170+0000","last_became_active":"2024-09-13T06:09:32.121803+0000","last_became_peered":"2024-09-13T06:09:32.121803+0000","last_unstale":"2024-09-13T06:14:22.921170+0000","last_undegraded":"2024-09-13T06:14:22.921170+0000","last_fullsized":"2024-09-13T06:14:22.921170+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:22.920848+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:22.920848+0000","last_clean_scrub_stamp":"2024-09-13T06:14:22.920848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:57:03.440588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"35'4","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:44.126938+0000","last_change":"2024-09-13T06:13:44.126999+0000","last_active":"2024-09-13T06:13:44.126938+0000","last_peered":"2024-09-13T06:13:44.126938+0000","last_clean":"2024-09-13T06:13:44.126938+0000","last_became_active":"2024-09-13T06:09:34.124728+0000","last_became_peered":"2024-09-13T06:09:34.124728+0000","last_unstale":"2024-09-13T06:13:44.126938+0000","last_undegraded":"2024-09-13T06:13:44.126938+0000","last_fullsized":"2024-09-13T06:13:44.126938+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:13:44.126745+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:13:44.126745+0000","last_clean_scrub_stamp":"2024-09-13T06:13:44.126745+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:34:05.312578+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"35'2","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:07.443616+0000","last_change":"2024-09-13T06:14:07.443616+0000","last_active":"2024-09-13T06:14:07.443616+0000","last_peered":"2024-09-13T06:14:07.443616+0000","last_clean":"2024-09-13T06:14:07.443616+0000","last_became_active":"2024-09-13T06:09:32.116422+0000","last_became_peered":"2024-09-13T06:09:32.116422+0000","last_unstale":"2024-09-13T06:14:07.443616+0000","last_undegraded":"2024-09-13T06:14:07.443616+0000","last_fullsized":"2024-09-13T06:14:07.443616+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:07.443341+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:07.443341+0000","last_clean_scrub_stamp":"2024-09-13T06:14:07.443341+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:11:06.667675+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"35'4","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:20.637599+0000","last_change":"2024-09-13T06:14:20.637599+0000","last_active":"2024-09-13T06:14:20.637599+0000","last_peered":"2024-09-13T06:14:20.637599+0000","last_clean":"2024-09-13T06:14:20.637599+0000","last_became_active":"2024-09-13T06:10:10.810259+0000","last_became_peered":"2024-09-13T06:10:10.810259+0000","last_unstale":"2024-09-13T06:14:20.637599+0000","last_undegraded":"2024-09-13T06:14:20.637599+0000","last_fullsized":"2024-09-13T06:14:20.637599+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:14:20.637249+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:14:20.637249+0000","last_clean_scrub_stamp":"2024-09-13T06:14:20.637249+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:03:50.413388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"35'4","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:26.863750+0000","last_change":"2024-09-13T06:14:26.863750+0000","last_active":"2024-09-13T06:14:26.863750+0000","last_peered":"2024-09-13T06:14:26.863750+0000","last_clean":"2024-09-13T06:14:26.863750+0000","last_became_active":"2024-09-13T06:09:32.122126+0000","last_became_peered":"2024-09-13T06:09:32.122126+0000","last_unstale":"2024-09-13T06:14:26.863750+0000","last_undegraded":"2024-09-13T06:14:26.863750+0000","last_fullsized":"2024-09-13T06:14:26.863750+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:14:26.863467+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:14:26.863467+0000","last_clean_scrub_stamp":"2024-09-13T06:14:26.863467+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:15:47.344721+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"35'10","reported_seq":69,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:49.549277+0000","last_change":"2024-09-13T06:13:49.549338+0000","last_active":"2024-09-13T06:13:49.549277+0000","last_peered":"2024-09-13T06:13:49.549277+0000","last_clean":"2024-09-13T06:13:49.549277+0000","last_became_active":"2024-09-13T06:09:34.120349+0000","last_became_peered":"2024-09-13T06:09:34.120349+0000","last_unstale":"2024-09-13T06:13:49.549277+0000","last_undegraded":"2024-09-13T06:13:49.549277+0000","last_fullsized":"2024-09-13T06:13:49.549277+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-09-13T06:13:49.549086+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-09-13T06:13:49.549086+0000","last_clean_scrub_stamp":"2024-09-13T06:13:49.549086+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:30:16.740460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:17.036924+0000","last_change":"2024-09-13T06:14:17.036924+0000","last_active":"2024-09-13T06:14:17.036924+0000","last_peered":"2024-09-13T06:14:17.036924+0000","last_clean":"2024-09-13T06:14:17.036924+0000","last_became_active":"2024-09-13T06:09:32.147504+0000","last_became_peered":"2024-09-13T06:09:32.147504+0000","last_unstale":"2024-09-13T06:14:17.036924+0000","last_undegraded":"2024-09-13T06:14:17.036924+0000","last_fullsized":"2024-09-13T06:14:17.036924+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:17.036578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:17.036578+0000","last_clean_scrub_stamp":"2024-09-13T06:14:17.036578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:53:37.209513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"35'10","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:56.394555+0000","last_change":"2024-09-13T06:13:56.394630+0000","last_active":"2024-09-13T06:13:56.394555+0000","last_peered":"2024-09-13T06:13:56.394555+0000","last_clean":"2024-09-13T06:13:56.394555+0000","last_became_active":"2024-09-13T06:09:34.104043+0000","last_became_peered":"2024-09-13T06:09:34.104043+0000","last_unstale":"2024-09-13T06:13:56.394555+0000","last_undegraded":"2024-09-13T06:13:56.394555+0000","last_fullsized":"2024-09-13T06:13:56.394555+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-09-13T06:13:56.394368+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-09-13T06:13:56.394368+0000","last_clean_scrub_stamp":"2024-09-13T06:13:56.394368+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:12:03.883275+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"35'4","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:12.918343+0000","last_change":"2024-09-13T06:14:12.918343+0000","last_active":"2024-09-13T06:14:12.918343+0000","last_peered":"2024-09-13T06:14:12.918343+0000","last_clean":"2024-09-13T06:14:12.918343+0000","last_became_active":"2024-09-13T06:09:34.116359+0000","last_became_peered":"2024-09-13T06:09:34.116359+0000","last_unstale":"2024-09-13T06:14:12.918343+0000","last_undegraded":"2024-09-13T06:14:12.918343+0000","last_fullsized":"2024-09-13T06:14:12.918343+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:14:12.918090+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:14:12.918090+0000","last_clean_scrub_stamp":"2024-09-13T06:14:12.918090+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:33:11.288623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"35'2","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:17.109420+0000","last_change":"2024-09-13T06:14:17.109420+0000","last_active":"2024-09-13T06:14:17.109420+0000","last_peered":"2024-09-13T06:14:17.109420+0000","last_clean":"2024-09-13T06:14:17.109420+0000","last_became_active":"2024-09-13T06:09:32.134667+0000","last_became_peered":"2024-09-13T06:09:32.134667+0000","last_unstale":"2024-09-13T06:14:17.109420+0000","last_undegraded":"2024-09-13T06:14:17.109420+0000","last_fullsized":"2024-09-13T06:14:17.109420+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:17.108958+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:17.108958+0000","last_clean_scrub_stamp":"2024-09-13T06:14:17.108958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:24:40.185482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"35'18","reported_seq":70,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:55.152233+0000","last_change":"2024-09-13T06:13:55.152233+0000","last_active":"2024-09-13T06:13:55.152233+0000","last_peered":"2024-09-13T06:13:55.152233+0000","last_clean":"2024-09-13T06:13:55.152233+0000","last_became_active":"2024-09-13T06:09:34.115348+0000","last_became_peered":"2024-09-13T06:09:34.115348+0000","last_unstale":"2024-09-13T06:13:55.152233+0000","last_undegraded":"2024-09-13T06:13:55.152233+0000","last_fullsized":"2024-09-13T06:13:55.152233+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'18","last_scrub_stamp":"2024-09-13T06:13:55.151980+0000","last_deep_scrub":"35'18","last_deep_scrub_stamp":"2024-09-13T06:13:55.151980+0000","last_clean_scrub_stamp":"2024-09-13T06:13:55.151980+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:13:13.639419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":45,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:03.432130+0000","last_change":"2024-09-13T06:14:03.432130+0000","last_active":"2024-09-13T06:14:03.432130+0000","last_peered":"2024-09-13T06:14:03.432130+0000","last_clean":"2024-09-13T06:14:03.432130+0000","last_became_active":"2024-09-13T06:09:32.135460+0000","last_became_peered":"2024-09-13T06:09:32.135460+0000","last_unstale":"2024-09-13T06:14:03.432130+0000","last_undegraded":"2024-09-13T06:14:03.432130+0000","last_fullsized":"2024-09-13T06:14:03.432130+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:03.431859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:03.431859+0000","last_clean_scrub_stamp":"2024-09-13T06:14:03.431859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:11:48.562273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"35'2","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:58.121860+0000","last_change":"2024-09-13T06:13:58.121860+0000","last_active":"2024-09-13T06:13:58.121860+0000","last_peered":"2024-09-13T06:13:58.121860+0000","last_clean":"2024-09-13T06:13:58.121860+0000","last_became_active":"2024-09-13T06:09:34.115047+0000","last_became_peered":"2024-09-13T06:09:34.115047+0000","last_unstale":"2024-09-13T06:13:58.121860+0000","last_undegraded":"2024-09-13T06:13:58.121860+0000","last_fullsized":"2024-09-13T06:13:58.121860+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:13:58.121478+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:13:58.121478+0000","last_clean_scrub_stamp":"2024-09-13T06:13:58.121478+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:31:22.905217+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:04.099929+0000","last_change":"2024-09-13T06:14:04.099929+0000","last_active":"2024-09-13T06:14:04.099929+0000","last_peered":"2024-09-13T06:14:04.099929+0000","last_clean":"2024-09-13T06:14:04.099929+0000","last_became_active":"2024-09-13T06:09:32.141166+0000","last_became_peered":"2024-09-13T06:09:32.141166+0000","last_unstale":"2024-09-13T06:14:04.099929+0000","last_undegraded":"2024-09-13T06:14:04.099929+0000","last_fullsized":"2024-09-13T06:14:04.099929+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:04.099667+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:04.099667+0000","last_clean_scrub_stamp":"2024-09-13T06:14:04.099667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:53:05.101935+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"35'4","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:00.061453+0000","last_change":"2024-09-13T06:14:00.061453+0000","last_active":"2024-09-13T06:14:00.061453+0000","last_peered":"2024-09-13T06:14:00.061453+0000","last_clean":"2024-09-13T06:14:00.061453+0000","last_became_active":"2024-09-13T06:09:34.114242+0000","last_became_peered":"2024-09-13T06:09:34.114242+0000","last_unstale":"2024-09-13T06:14:00.061453+0000","last_undegraded":"2024-09-13T06:14:00.061453+0000","last_fullsized":"2024-09-13T06:14:00.061453+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:14:00.061127+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:14:00.061127+0000","last_clean_scrub_stamp":"2024-09-13T06:14:00.061127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:16:26.722813+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:00.064927+0000","last_change":"2024-09-13T06:14:00.064927+0000","last_active":"2024-09-13T06:14:00.064927+0000","last_peered":"2024-09-13T06:14:00.064927+0000","last_clean":"2024-09-13T06:14:00.064927+0000","last_became_active":"2024-09-13T06:09:32.143746+0000","last_became_peered":"2024-09-13T06:09:32.143746+0000","last_unstale":"2024-09-13T06:14:00.064927+0000","last_undegraded":"2024-09-13T06:14:00.064927+0000","last_fullsized":"2024-09-13T06:14:00.064927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:00.064492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:00.064492+0000","last_clean_scrub_stamp":"2024-09-13T06:14:00.064492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:19:41.835952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"35'8","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:50.515884+0000","last_change":"2024-09-13T06:13:50.515884+0000","last_active":"2024-09-13T06:13:50.515884+0000","last_peered":"2024-09-13T06:13:50.515884+0000","last_clean":"2024-09-13T06:13:50.515884+0000","last_became_active":"2024-09-13T06:09:34.101167+0000","last_became_peered":"2024-09-13T06:09:34.101167+0000","last_unstale":"2024-09-13T06:13:50.515884+0000","last_undegraded":"2024-09-13T06:13:50.515884+0000","last_fullsized":"2024-09-13T06:13:50.515884+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-13T06:13:50.515623+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-13T06:13:50.515623+0000","last_clean_scrub_stamp":"2024-09-13T06:13:50.515623+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:17:02.378126+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:57.177314+0000","last_change":"2024-09-13T06:13:57.177314+0000","last_active":"2024-09-13T06:13:57.177314+0000","last_peered":"2024-09-13T06:13:57.177314+0000","last_clean":"2024-09-13T06:13:57.177314+0000","last_became_active":"2024-09-13T06:09:32.149885+0000","last_became_peered":"2024-09-13T06:09:32.149885+0000","last_unstale":"2024-09-13T06:13:57.177314+0000","last_undegraded":"2024-09-13T06:13:57.177314+0000","last_fullsized":"2024-09-13T06:13:57.177314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:57.177058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:57.177058+0000","last_clean_scrub_stamp":"2024-09-13T06:13:57.177058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:42:39.408712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"35'14","reported_seq":75,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:43.162922+0000","last_change":"2024-09-13T06:13:43.162922+0000","last_active":"2024-09-13T06:13:43.162922+0000","last_peered":"2024-09-13T06:13:43.162922+0000","last_clean":"2024-09-13T06:13:43.162922+0000","last_became_active":"2024-09-13T06:09:34.124299+0000","last_became_peered":"2024-09-13T06:09:34.124299+0000","last_unstale":"2024-09-13T06:13:43.162922+0000","last_undegraded":"2024-09-13T06:13:43.162922+0000","last_fullsized":"2024-09-13T06:13:43.162922+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'14","last_scrub_stamp":"2024-09-13T06:13:43.162673+0000","last_deep_scrub":"35'14","last_deep_scrub_stamp":"2024-09-13T06:13:43.162673+0000","last_clean_scrub_stamp":"2024-09-13T06:13:43.162673+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:37:16.908533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:41.840514+0000","last_change":"2024-09-13T06:14:41.840574+0000","last_active":"2024-09-13T06:14:41.840514+0000","last_peered":"2024-09-13T06:14:41.840514+0000","last_clean":"2024-09-13T06:14:41.840514+0000","last_became_active":"2024-09-13T06:09:32.128376+0000","last_became_peered":"2024-09-13T06:09:32.128376+0000","last_unstale":"2024-09-13T06:14:41.840514+0000","last_undegraded":"2024-09-13T06:14:41.840514+0000","last_fullsized":"2024-09-13T06:14:41.840514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:41.840315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:41.840315+0000","last_clean_scrub_stamp":"2024-09-13T06:14:41.840315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:37:27.494343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"35'44","reported_seq":135,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:23.143992+0000","last_change":"2024-09-13T06:14:23.143992+0000","last_active":"2024-09-13T06:14:23.143992+0000","last_peered":"2024-09-13T06:14:23.143992+0000","last_clean":"2024-09-13T06:14:23.143992+0000","last_became_active":"2024-09-13T06:09:42.186091+0000","last_became_peered":"2024-09-13T06:09:42.186091+0000","last_unstale":"2024-09-13T06:14:23.143992+0000","last_undegraded":"2024-09-13T06:14:23.143992+0000","last_fullsized":"2024-09-13T06:14:23.143992+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'44","last_scrub_stamp":"2024-09-13T06:14:23.143692+0000","last_deep_scrub":"35'44","last_deep_scrub_stamp":"2024-09-13T06:14:23.143692+0000","last_clean_scrub_stamp":"2024-09-13T06:14:23.143692+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:48:38.353678+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":246,"num_read_kb":228,"num_write":124,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"35'16","reported_seq":116,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:06.989989+0000","last_change":"2024-09-13T06:14:06.989989+0000","last_active":"2024-09-13T06:14:06.989989+0000","last_peered":"2024-09-13T06:14:06.989989+0000","last_clean":"2024-09-13T06:14:06.989989+0000","last_became_active":"2024-09-13T06:09:34.118393+0000","last_became_peered":"2024-09-13T06:09:34.118393+0000","last_unstale":"2024-09-13T06:14:06.989989+0000","last_undegraded":"2024-09-13T06:14:06.989989+0000","last_fullsized":"2024-09-13T06:14:06.989989+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'16","last_scrub_stamp":"2024-09-13T06:14:06.989589+0000","last_deep_scrub":"35'16","last_deep_scrub_stamp":"2024-09-13T06:14:06.989589+0000","last_clean_scrub_stamp":"2024-09-13T06:14:06.989589+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:35:16.756495+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":90,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"35'6","reported_seq":59,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:31.742907+0000","last_change":"2024-09-13T06:14:31.743066+0000","last_active":"2024-09-13T06:14:31.742907+0000","last_peered":"2024-09-13T06:14:31.742907+0000","last_clean":"2024-09-13T06:14:31.742907+0000","last_became_active":"2024-09-13T06:09:32.133545+0000","last_became_peered":"2024-09-13T06:09:32.133545+0000","last_unstale":"2024-09-13T06:14:31.742907+0000","last_undegraded":"2024-09-13T06:14:31.742907+0000","last_fullsized":"2024-09-13T06:14:31.742907+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:14:31.742648+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:14:31.742648+0000","last_clean_scrub_stamp":"2024-09-13T06:14:31.742648+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:35:35.831610+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:26.893183+0000","last_change":"2024-09-13T06:13:26.893183+0000","last_active":"2024-09-13T06:13:26.893183+0000","last_peered":"2024-09-13T06:13:26.893183+0000","last_clean":"2024-09-13T06:13:26.893183+0000","last_became_active":"2024-09-13T06:09:36.153420+0000","last_became_peered":"2024-09-13T06:09:36.153420+0000","last_unstale":"2024-09-13T06:13:26.893183+0000","last_undegraded":"2024-09-13T06:13:26.893183+0000","last_fullsized":"2024-09-13T06:13:26.893183+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:26.892934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:26.892934+0000","last_clean_scrub_stamp":"2024-09-13T06:13:26.892934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:12:45.761321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"35'37","reported_seq":93,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:54.897267+0000","last_change":"2024-09-13T06:13:54.897267+0000","last_active":"2024-09-13T06:13:54.897267+0000","last_peered":"2024-09-13T06:13:54.897267+0000","last_clean":"2024-09-13T06:13:54.897267+0000","last_became_active":"2024-09-13T06:09:38.175393+0000","last_became_peered":"2024-09-13T06:09:38.175393+0000","last_unstale":"2024-09-13T06:13:54.897267+0000","last_undegraded":"2024-09-13T06:13:54.897267+0000","last_fullsized":"2024-09-13T06:13:54.897267+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'37","last_scrub_stamp":"2024-09-13T06:13:54.896963+0000","last_deep_scrub":"35'37","last_deep_scrub_stamp":"2024-09-13T06:13:54.896963+0000","last_clean_scrub_stamp":"2024-09-13T06:13:54.896963+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:27:41.104876+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:49.056194+0000","last_change":"2024-09-13T06:13:49.056194+0000","last_active":"2024-09-13T06:13:49.056194+0000","last_peered":"2024-09-13T06:13:49.056194+0000","last_clean":"2024-09-13T06:13:49.056194+0000","last_became_active":"2024-09-13T06:09:40.185574+0000","last_became_peered":"2024-09-13T06:09:40.185574+0000","last_unstale":"2024-09-13T06:13:49.056194+0000","last_undegraded":"2024-09-13T06:13:49.056194+0000","last_fullsized":"2024-09-13T06:13:49.056194+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:49.055950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:49.055950+0000","last_clean_scrub_stamp":"2024-09-13T06:13:49.055950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:11:18.319386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"35'9","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:21.108452+0000","last_change":"2024-09-13T06:14:21.108452+0000","last_active":"2024-09-13T06:14:21.108452+0000","last_peered":"2024-09-13T06:14:21.108452+0000","last_clean":"2024-09-13T06:14:21.108452+0000","last_became_active":"2024-09-13T06:09:42.183162+0000","last_became_peered":"2024-09-13T06:09:42.183162+0000","last_unstale":"2024-09-13T06:14:21.108452+0000","last_undegraded":"2024-09-13T06:14:21.108452+0000","last_fullsized":"2024-09-13T06:14:21.108452+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'9","last_scrub_stamp":"2024-09-13T06:14:21.108188+0000","last_deep_scrub":"35'9","last_deep_scrub_stamp":"2024-09-13T06:14:21.108188+0000","last_clean_scrub_stamp":"2024-09-13T06:14:21.108188+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:28:07.316101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":19,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"35'6","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:02.899591+0000","last_change":"2024-09-13T06:14:02.899591+0000","last_active":"2024-09-13T06:14:02.899591+0000","last_peered":"2024-09-13T06:14:02.899591+0000","last_clean":"2024-09-13T06:14:02.899591+0000","last_became_active":"2024-09-13T06:09:34.120600+0000","last_became_peered":"2024-09-13T06:09:34.120600+0000","last_unstale":"2024-09-13T06:14:02.899591+0000","last_undegraded":"2024-09-13T06:14:02.899591+0000","last_fullsized":"2024-09-13T06:14:02.899591+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:14:02.899339+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:14:02.899339+0000","last_clean_scrub_stamp":"2024-09-13T06:14:02.899339+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:30:32.307843+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:55.431016+0000","last_change":"2024-09-13T06:13:55.431016+0000","last_active":"2024-09-13T06:13:55.431016+0000","last_peered":"2024-09-13T06:13:55.431016+0000","last_clean":"2024-09-13T06:13:55.431016+0000","last_became_active":"2024-09-13T06:09:32.138643+0000","last_became_peered":"2024-09-13T06:09:32.138643+0000","last_unstale":"2024-09-13T06:13:55.431016+0000","last_undegraded":"2024-09-13T06:13:55.431016+0000","last_fullsized":"2024-09-13T06:13:55.431016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:55.430747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:55.430747+0000","last_clean_scrub_stamp":"2024-09-13T06:13:55.430747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:59:14.616769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:41.236284+0000","last_change":"2024-09-13T06:13:41.236284+0000","last_active":"2024-09-13T06:13:41.236284+0000","last_peered":"2024-09-13T06:13:41.236284+0000","last_clean":"2024-09-13T06:13:41.236284+0000","last_became_active":"2024-09-13T06:09:36.139235+0000","last_became_peered":"2024-09-13T06:09:36.139235+0000","last_unstale":"2024-09-13T06:13:41.236284+0000","last_undegraded":"2024-09-13T06:13:41.236284+0000","last_fullsized":"2024-09-13T06:13:41.236284+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:41.235958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:41.235958+0000","last_clean_scrub_stamp":"2024-09-13T06:13:41.235958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:48:26.407496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"35'9","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:28.250424+0000","last_change":"2024-09-13T06:13:28.250424+0000","last_active":"2024-09-13T06:13:28.250424+0000","last_peered":"2024-09-13T06:13:28.250424+0000","last_clean":"2024-09-13T06:13:28.250424+0000","last_became_active":"2024-09-13T06:09:38.161539+0000","last_became_peered":"2024-09-13T06:09:38.161539+0000","last_unstale":"2024-09-13T06:13:28.250424+0000","last_undegraded":"2024-09-13T06:13:28.250424+0000","last_fullsized":"2024-09-13T06:13:28.250424+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'9","last_scrub_stamp":"2024-09-13T06:13:28.250177+0000","last_deep_scrub":"35'9","last_deep_scrub_stamp":"2024-09-13T06:13:28.250177+0000","last_clean_scrub_stamp":"2024-09-13T06:13:28.250177+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:10:57.549533+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:41.143426+0000","last_change":"2024-09-13T06:13:41.143426+0000","last_active":"2024-09-13T06:13:41.143426+0000","last_peered":"2024-09-13T06:13:41.143426+0000","last_clean":"2024-09-13T06:13:41.143426+0000","last_became_active":"2024-09-13T06:09:40.182436+0000","last_became_peered":"2024-09-13T06:09:40.182436+0000","last_unstale":"2024-09-13T06:13:41.143426+0000","last_undegraded":"2024-09-13T06:13:41.143426+0000","last_fullsized":"2024-09-13T06:13:41.143426+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:41.143167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:41.143167+0000","last_clean_scrub_stamp":"2024-09-13T06:13:41.143167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:15:32.092602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"33'2","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:22.936454+0000","last_change":"2024-09-13T06:14:22.936454+0000","last_active":"2024-09-13T06:14:22.936454+0000","last_peered":"2024-09-13T06:14:22.936454+0000","last_clean":"2024-09-13T06:14:22.936454+0000","last_became_active":"2024-09-13T06:09:42.208430+0000","last_became_peered":"2024-09-13T06:09:42.208430+0000","last_unstale":"2024-09-13T06:14:22.936454+0000","last_undegraded":"2024-09-13T06:14:22.936454+0000","last_fullsized":"2024-09-13T06:14:22.936454+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T06:14:22.936197+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T06:14:22.936197+0000","last_clean_scrub_stamp":"2024-09-13T06:14:22.936197+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:07:30.217358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"35'6","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:00.919560+0000","last_change":"2024-09-13T06:14:00.919560+0000","last_active":"2024-09-13T06:14:00.919560+0000","last_peered":"2024-09-13T06:14:00.919560+0000","last_clean":"2024-09-13T06:14:00.919560+0000","last_became_active":"2024-09-13T06:09:34.122001+0000","last_became_peered":"2024-09-13T06:09:34.122001+0000","last_unstale":"2024-09-13T06:14:00.919560+0000","last_undegraded":"2024-09-13T06:14:00.919560+0000","last_fullsized":"2024-09-13T06:14:00.919560+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:14:00.919310+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:14:00.919310+0000","last_clean_scrub_stamp":"2024-09-13T06:14:00.919310+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:25:53.623575+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:18.848294+0000","last_change":"2024-09-13T06:14:18.848356+0000","last_active":"2024-09-13T06:14:18.848294+0000","last_peered":"2024-09-13T06:14:18.848294+0000","last_clean":"2024-09-13T06:14:18.848294+0000","last_became_active":"2024-09-13T06:09:32.129739+0000","last_became_peered":"2024-09-13T06:09:32.129739+0000","last_unstale":"2024-09-13T06:14:18.848294+0000","last_undegraded":"2024-09-13T06:14:18.848294+0000","last_fullsized":"2024-09-13T06:14:18.848294+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:18.848074+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:18.848074+0000","last_clean_scrub_stamp":"2024-09-13T06:14:18.848074+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:13:38.238905+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:39.268600+0000","last_change":"2024-09-13T06:13:39.268600+0000","last_active":"2024-09-13T06:13:39.268600+0000","last_peered":"2024-09-13T06:13:39.268600+0000","last_clean":"2024-09-13T06:13:39.268600+0000","last_became_active":"2024-09-13T06:09:36.143405+0000","last_became_peered":"2024-09-13T06:09:36.143405+0000","last_unstale":"2024-09-13T06:13:39.268600+0000","last_undegraded":"2024-09-13T06:13:39.268600+0000","last_fullsized":"2024-09-13T06:13:39.268600+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:39.268339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:39.268339+0000","last_clean_scrub_stamp":"2024-09-13T06:13:39.268339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:08:53.766496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"35'15","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:37.488304+0000","last_change":"2024-09-13T06:13:37.488304+0000","last_active":"2024-09-13T06:13:37.488304+0000","last_peered":"2024-09-13T06:13:37.488304+0000","last_clean":"2024-09-13T06:13:37.488304+0000","last_became_active":"2024-09-13T06:09:38.154654+0000","last_became_peered":"2024-09-13T06:09:38.154654+0000","last_unstale":"2024-09-13T06:13:37.488304+0000","last_undegraded":"2024-09-13T06:13:37.488304+0000","last_fullsized":"2024-09-13T06:13:37.488304+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'15","last_scrub_stamp":"2024-09-13T06:13:37.488029+0000","last_deep_scrub":"35'15","last_deep_scrub_stamp":"2024-09-13T06:13:37.488029+0000","last_clean_scrub_stamp":"2024-09-13T06:13:37.488029+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:59:42.866540+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"35'286","reported_seq":419,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:59.901028+0000","last_change":"2024-09-13T06:13:59.901028+0000","last_active":"2024-09-13T06:13:59.901028+0000","last_peered":"2024-09-13T06:13:59.901028+0000","last_clean":"2024-09-13T06:13:59.901028+0000","last_became_active":"2024-09-13T06:09:40.190377+0000","last_became_peered":"2024-09-13T06:09:40.190377+0000","last_unstale":"2024-09-13T06:13:59.901028+0000","last_undegraded":"2024-09-13T06:13:59.901028+0000","last_fullsized":"2024-09-13T06:13:59.901028+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'286","last_scrub_stamp":"2024-09-13T06:13:59.900745+0000","last_deep_scrub":"35'286","last_deep_scrub_stamp":"2024-09-13T06:13:59.900745+0000","last_clean_scrub_stamp":"2024-09-13T06:13:59.900745+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:29:32.530047+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:48.548016+0000","last_change":"2024-09-13T06:13:48.548016+0000","last_active":"2024-09-13T06:13:48.548016+0000","last_peered":"2024-09-13T06:13:48.548016+0000","last_clean":"2024-09-13T06:13:48.548016+0000","last_became_active":"2024-09-13T06:09:42.204083+0000","last_became_peered":"2024-09-13T06:09:42.204083+0000","last_unstale":"2024-09-13T06:13:48.548016+0000","last_undegraded":"2024-09-13T06:13:48.548016+0000","last_fullsized":"2024-09-13T06:13:48.548016+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:48.547749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:48.547749+0000","last_clean_scrub_stamp":"2024-09-13T06:13:48.547749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:09:43.428843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"35'6","reported_seq":67,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:51.108220+0000","last_change":"2024-09-13T06:13:51.108220+0000","last_active":"2024-09-13T06:13:51.108220+0000","last_peered":"2024-09-13T06:13:51.108220+0000","last_clean":"2024-09-13T06:13:51.108220+0000","last_became_active":"2024-09-13T06:09:34.130815+0000","last_became_peered":"2024-09-13T06:09:34.130815+0000","last_unstale":"2024-09-13T06:13:51.108220+0000","last_undegraded":"2024-09-13T06:13:51.108220+0000","last_fullsized":"2024-09-13T06:13:51.108220+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:13:51.107946+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:13:51.107946+0000","last_clean_scrub_stamp":"2024-09-13T06:13:51.107946+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:16:53.824111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:12.075110+0000","last_change":"2024-09-13T06:14:12.075110+0000","last_active":"2024-09-13T06:14:12.075110+0000","last_peered":"2024-09-13T06:14:12.075110+0000","last_clean":"2024-09-13T06:14:12.075110+0000","last_became_active":"2024-09-13T06:09:32.118278+0000","last_became_peered":"2024-09-13T06:09:32.118278+0000","last_unstale":"2024-09-13T06:14:12.075110+0000","last_undegraded":"2024-09-13T06:14:12.075110+0000","last_fullsized":"2024-09-13T06:14:12.075110+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:12.074849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:12.074849+0000","last_clean_scrub_stamp":"2024-09-13T06:14:12.074849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:59:25.657351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.442131+0000","last_change":"2024-09-13T06:10:10.825317+0000","last_active":"2024-09-13T06:13:25.442131+0000","last_peered":"2024-09-13T06:13:25.442131+0000","last_clean":"2024-09-13T06:13:25.442131+0000","last_became_active":"2024-09-13T06:10:10.824420+0000","last_became_peered":"2024-09-13T06:10:10.824420+0000","last_unstale":"2024-09-13T06:13:25.442131+0000","last_undegraded":"2024-09-13T06:13:25.442131+0000","last_fullsized":"2024-09-13T06:13:25.442131+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:35.087004+0000","last_clean_scrub_stamp":"2024-09-13T06:09:35.087004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"35'37","reported_seq":93,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:35.449374+0000","last_change":"2024-09-13T06:13:35.449374+0000","last_active":"2024-09-13T06:13:35.449374+0000","last_peered":"2024-09-13T06:13:35.449374+0000","last_clean":"2024-09-13T06:13:35.449374+0000","last_became_active":"2024-09-13T06:09:38.157430+0000","last_became_peered":"2024-09-13T06:09:38.157430+0000","last_unstale":"2024-09-13T06:13:35.449374+0000","last_undegraded":"2024-09-13T06:13:35.449374+0000","last_fullsized":"2024-09-13T06:13:35.449374+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'37","last_scrub_stamp":"2024-09-13T06:13:35.449087+0000","last_deep_scrub":"35'37","last_deep_scrub_stamp":"2024-09-13T06:13:35.449087+0000","last_clean_scrub_stamp":"2024-09-13T06:13:35.449087+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:28:30.698850+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"35'285","reported_seq":449,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:26.281485+0000","last_change":"2024-09-13T06:13:26.281485+0000","last_active":"2024-09-13T06:13:26.281485+0000","last_peered":"2024-09-13T06:13:26.281485+0000","last_clean":"2024-09-13T06:13:26.281485+0000","last_became_active":"2024-09-13T06:09:40.175871+0000","last_became_peered":"2024-09-13T06:09:40.175871+0000","last_unstale":"2024-09-13T06:13:26.281485+0000","last_undegraded":"2024-09-13T06:13:26.281485+0000","last_fullsized":"2024-09-13T06:13:26.281485+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-13T06:13:26.281223+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-13T06:13:26.281223+0000","last_clean_scrub_stamp":"2024-09-13T06:13:26.281223+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:05:30.880244+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"35'2","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:44.821803+0000","last_change":"2024-09-13T06:13:44.821803+0000","last_active":"2024-09-13T06:13:44.821803+0000","last_peered":"2024-09-13T06:13:44.821803+0000","last_clean":"2024-09-13T06:13:44.821803+0000","last_became_active":"2024-09-13T06:09:34.126374+0000","last_became_peered":"2024-09-13T06:09:34.126374+0000","last_unstale":"2024-09-13T06:13:44.821803+0000","last_undegraded":"2024-09-13T06:13:44.821803+0000","last_fullsized":"2024-09-13T06:13:44.821803+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:13:44.821554+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:13:44.821554+0000","last_clean_scrub_stamp":"2024-09-13T06:13:44.821554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:48:20.992725+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:13.500678+0000","last_change":"2024-09-13T06:14:13.500738+0000","last_active":"2024-09-13T06:14:13.500678+0000","last_peered":"2024-09-13T06:14:13.500678+0000","last_clean":"2024-09-13T06:14:13.500678+0000","last_became_active":"2024-09-13T06:09:32.131373+0000","last_became_peered":"2024-09-13T06:09:32.131373+0000","last_unstale":"2024-09-13T06:14:13.500678+0000","last_undegraded":"2024-09-13T06:14:13.500678+0000","last_fullsized":"2024-09-13T06:14:13.500678+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:13.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:13.500482+0000","last_clean_scrub_stamp":"2024-09-13T06:14:13.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:15:53.870254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:38.094138+0000","last_change":"2024-09-13T06:13:38.094138+0000","last_active":"2024-09-13T06:13:38.094138+0000","last_peered":"2024-09-13T06:13:38.094138+0000","last_clean":"2024-09-13T06:13:38.094138+0000","last_became_active":"2024-09-13T06:09:36.137016+0000","last_became_peered":"2024-09-13T06:09:36.137016+0000","last_unstale":"2024-09-13T06:13:38.094138+0000","last_undegraded":"2024-09-13T06:13:38.094138+0000","last_fullsized":"2024-09-13T06:13:38.094138+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:38.093864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:38.093864+0000","last_clean_scrub_stamp":"2024-09-13T06:13:38.093864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:18:03.005466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"35'51","reported_seq":112,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:31.369768+0000","last_change":"2024-09-13T06:13:31.369768+0000","last_active":"2024-09-13T06:13:31.369768+0000","last_peered":"2024-09-13T06:13:31.369768+0000","last_clean":"2024-09-13T06:13:31.369768+0000","last_became_active":"2024-09-13T06:09:38.163472+0000","last_became_peered":"2024-09-13T06:09:38.163472+0000","last_unstale":"2024-09-13T06:13:31.369768+0000","last_undegraded":"2024-09-13T06:13:31.369768+0000","last_fullsized":"2024-09-13T06:13:31.369768+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'51","last_scrub_stamp":"2024-09-13T06:13:31.369476+0000","last_deep_scrub":"35'51","last_deep_scrub_stamp":"2024-09-13T06:13:31.369476+0000","last_clean_scrub_stamp":"2024-09-13T06:13:31.369476+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:44:16.358341+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:27.325602+0000","last_change":"2024-09-13T06:13:27.325602+0000","last_active":"2024-09-13T06:13:27.325602+0000","last_peered":"2024-09-13T06:13:27.325602+0000","last_clean":"2024-09-13T06:13:27.325602+0000","last_became_active":"2024-09-13T06:09:40.171609+0000","last_became_peered":"2024-09-13T06:09:40.171609+0000","last_unstale":"2024-09-13T06:13:27.325602+0000","last_undegraded":"2024-09-13T06:13:27.325602+0000","last_fullsized":"2024-09-13T06:13:27.325602+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:27.325358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:27.325358+0000","last_clean_scrub_stamp":"2024-09-13T06:13:27.325358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:15:24.519986+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"35'5","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:16.551788+0000","last_change":"2024-09-13T06:14:16.551854+0000","last_active":"2024-09-13T06:14:16.551788+0000","last_peered":"2024-09-13T06:14:16.551788+0000","last_clean":"2024-09-13T06:14:16.551788+0000","last_became_active":"2024-09-13T06:09:42.193426+0000","last_became_peered":"2024-09-13T06:09:42.193426+0000","last_unstale":"2024-09-13T06:14:16.551788+0000","last_undegraded":"2024-09-13T06:14:16.551788+0000","last_fullsized":"2024-09-13T06:14:16.551788+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'5","last_scrub_stamp":"2024-09-13T06:14:16.551562+0000","last_deep_scrub":"35'5","last_deep_scrub_stamp":"2024-09-13T06:14:16.551562+0000","last_clean_scrub_stamp":"2024-09-13T06:14:16.551562+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:45:42.103577+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"35'6","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:56.130563+0000","last_change":"2024-09-13T06:13:56.130563+0000","last_active":"2024-09-13T06:13:56.130563+0000","last_peered":"2024-09-13T06:13:56.130563+0000","last_clean":"2024-09-13T06:13:56.130563+0000","last_became_active":"2024-09-13T06:09:34.114999+0000","last_became_peered":"2024-09-13T06:09:34.114999+0000","last_unstale":"2024-09-13T06:13:56.130563+0000","last_undegraded":"2024-09-13T06:13:56.130563+0000","last_fullsized":"2024-09-13T06:13:56.130563+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:13:56.130180+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:13:56.130180+0000","last_clean_scrub_stamp":"2024-09-13T06:13:56.130180+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:43:27.715392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:08.485550+0000","last_change":"2024-09-13T06:14:08.485661+0000","last_active":"2024-09-13T06:14:08.485550+0000","last_peered":"2024-09-13T06:14:08.485550+0000","last_clean":"2024-09-13T06:14:08.485550+0000","last_became_active":"2024-09-13T06:09:32.117779+0000","last_became_peered":"2024-09-13T06:09:32.117779+0000","last_unstale":"2024-09-13T06:14:08.485550+0000","last_undegraded":"2024-09-13T06:14:08.485550+0000","last_fullsized":"2024-09-13T06:14:08.485550+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:08.485235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:08.485235+0000","last_clean_scrub_stamp":"2024-09-13T06:14:08.485235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:46:00.389747+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:43.192766+0000","last_change":"2024-09-13T06:13:43.192766+0000","last_active":"2024-09-13T06:13:43.192766+0000","last_peered":"2024-09-13T06:13:43.192766+0000","last_clean":"2024-09-13T06:13:43.192766+0000","last_became_active":"2024-09-13T06:09:36.135862+0000","last_became_peered":"2024-09-13T06:09:36.135862+0000","last_unstale":"2024-09-13T06:13:43.192766+0000","last_undegraded":"2024-09-13T06:13:43.192766+0000","last_fullsized":"2024-09-13T06:13:43.192766+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:43.192506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:43.192506+0000","last_clean_scrub_stamp":"2024-09-13T06:13:43.192506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:16:55.055009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"35'37","reported_seq":93,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:35.787233+0000","last_change":"2024-09-13T06:13:35.787233+0000","last_active":"2024-09-13T06:13:35.787233+0000","last_peered":"2024-09-13T06:13:35.787233+0000","last_clean":"2024-09-13T06:13:35.787233+0000","last_became_active":"2024-09-13T06:09:38.171931+0000","last_became_peered":"2024-09-13T06:09:38.171931+0000","last_unstale":"2024-09-13T06:13:35.787233+0000","last_undegraded":"2024-09-13T06:13:35.787233+0000","last_fullsized":"2024-09-13T06:13:35.787233+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'37","last_scrub_stamp":"2024-09-13T06:13:35.786837+0000","last_deep_scrub":"35'37","last_deep_scrub_stamp":"2024-09-13T06:13:35.786837+0000","last_clean_scrub_stamp":"2024-09-13T06:13:35.786837+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:50:05.816319+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:32.280888+0000","last_change":"2024-09-13T06:13:32.280888+0000","last_active":"2024-09-13T06:13:32.280888+0000","last_peered":"2024-09-13T06:13:32.280888+0000","last_clean":"2024-09-13T06:13:32.280888+0000","last_became_active":"2024-09-13T06:09:40.178545+0000","last_became_peered":"2024-09-13T06:09:40.178545+0000","last_unstale":"2024-09-13T06:13:32.280888+0000","last_undegraded":"2024-09-13T06:13:32.280888+0000","last_fullsized":"2024-09-13T06:13:32.280888+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:32.280631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:32.280631+0000","last_clean_scrub_stamp":"2024-09-13T06:13:32.280631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:40:09.829593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"35'6","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:26.191567+0000","last_change":"2024-09-13T06:14:26.191645+0000","last_active":"2024-09-13T06:14:26.191567+0000","last_peered":"2024-09-13T06:14:26.191567+0000","last_clean":"2024-09-13T06:14:26.191567+0000","last_became_active":"2024-09-13T06:09:42.204945+0000","last_became_peered":"2024-09-13T06:09:42.204945+0000","last_unstale":"2024-09-13T06:14:26.191567+0000","last_undegraded":"2024-09-13T06:14:26.191567+0000","last_fullsized":"2024-09-13T06:14:26.191567+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:14:26.191375+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:14:26.191375+0000","last_clean_scrub_stamp":"2024-09-13T06:14:26.191375+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:29:58.820678+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"33'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:02.463798+0000","last_change":"2024-09-13T06:14:02.463861+0000","last_active":"2024-09-13T06:14:02.463798+0000","last_peered":"2024-09-13T06:14:02.463798+0000","last_clean":"2024-09-13T06:14:02.463798+0000","last_became_active":"2024-09-13T06:09:34.102657+0000","last_became_peered":"2024-09-13T06:09:34.102657+0000","last_unstale":"2024-09-13T06:14:02.463798+0000","last_undegraded":"2024-09-13T06:14:02.463798+0000","last_fullsized":"2024-09-13T06:14:02.463798+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T06:14:02.463588+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T06:14:02.463588+0000","last_clean_scrub_stamp":"2024-09-13T06:14:02.463588+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:08:35.731519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"35'6","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:29.773452+0000","last_change":"2024-09-13T06:14:29.773519+0000","last_active":"2024-09-13T06:14:29.773452+0000","last_peered":"2024-09-13T06:14:29.773452+0000","last_clean":"2024-09-13T06:14:29.773452+0000","last_became_active":"2024-09-13T06:09:32.133020+0000","last_became_peered":"2024-09-13T06:09:32.133020+0000","last_unstale":"2024-09-13T06:14:29.773452+0000","last_undegraded":"2024-09-13T06:14:29.773452+0000","last_fullsized":"2024-09-13T06:14:29.773452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:14:29.773238+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:14:29.773238+0000","last_clean_scrub_stamp":"2024-09-13T06:14:29.773238+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:56:06.486361+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":22,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:17.598463+0000","last_change":"2024-09-13T06:14:17.598463+0000","last_active":"2024-09-13T06:14:17.598463+0000","last_peered":"2024-09-13T06:14:17.598463+0000","last_clean":"2024-09-13T06:14:17.598463+0000","last_became_active":"2024-09-13T06:10:10.809442+0000","last_became_peered":"2024-09-13T06:10:10.809442+0000","last_unstale":"2024-09-13T06:14:17.598463+0000","last_undegraded":"2024-09-13T06:14:17.598463+0000","last_fullsized":"2024-09-13T06:14:17.598463+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:17.598224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:17.598224+0000","last_clean_scrub_stamp":"2024-09-13T06:14:17.598224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:09:29.398763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"35'45","reported_seq":104,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:27.901555+0000","last_change":"2024-09-13T06:13:27.901555+0000","last_active":"2024-09-13T06:13:27.901555+0000","last_peered":"2024-09-13T06:13:27.901555+0000","last_clean":"2024-09-13T06:13:27.901555+0000","last_became_active":"2024-09-13T06:09:38.154720+0000","last_became_peered":"2024-09-13T06:09:38.154720+0000","last_unstale":"2024-09-13T06:13:27.901555+0000","last_undegraded":"2024-09-13T06:13:27.901555+0000","last_fullsized":"2024-09-13T06:13:27.901555+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'45","last_scrub_stamp":"2024-09-13T06:13:27.901155+0000","last_deep_scrub":"35'45","last_deep_scrub_stamp":"2024-09-13T06:13:27.901155+0000","last_clean_scrub_stamp":"2024-09-13T06:13:27.901155+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:38:20.916120+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"35'285","reported_seq":411,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:48.184617+0000","last_change":"2024-09-13T06:13:48.184617+0000","last_active":"2024-09-13T06:13:48.184617+0000","last_peered":"2024-09-13T06:13:48.184617+0000","last_clean":"2024-09-13T06:13:48.184617+0000","last_became_active":"2024-09-13T06:09:40.186987+0000","last_became_peered":"2024-09-13T06:09:40.186987+0000","last_unstale":"2024-09-13T06:13:48.184617+0000","last_undegraded":"2024-09-13T06:13:48.184617+0000","last_fullsized":"2024-09-13T06:13:48.184617+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-13T06:13:48.184284+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-13T06:13:48.184284+0000","last_clean_scrub_stamp":"2024-09-13T06:13:48.184284+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:59:07.370306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"35'2","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:21.968175+0000","last_change":"2024-09-13T06:14:21.968236+0000","last_active":"2024-09-13T06:14:21.968175+0000","last_peered":"2024-09-13T06:14:21.968175+0000","last_clean":"2024-09-13T06:14:21.968175+0000","last_became_active":"2024-09-13T06:09:42.201678+0000","last_became_peered":"2024-09-13T06:09:42.201678+0000","last_unstale":"2024-09-13T06:14:21.968175+0000","last_undegraded":"2024-09-13T06:14:21.968175+0000","last_fullsized":"2024-09-13T06:14:21.968175+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:21.967952+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:21.967952+0000","last_clean_scrub_stamp":"2024-09-13T06:14:21.967952+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:01:07.570633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"35'14","reported_seq":79,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:52.484137+0000","last_change":"2024-09-13T06:13:52.484137+0000","last_active":"2024-09-13T06:13:52.484137+0000","last_peered":"2024-09-13T06:13:52.484137+0000","last_clean":"2024-09-13T06:13:52.484137+0000","last_became_active":"2024-09-13T06:09:34.103295+0000","last_became_peered":"2024-09-13T06:09:34.103295+0000","last_unstale":"2024-09-13T06:13:52.484137+0000","last_undegraded":"2024-09-13T06:13:52.484137+0000","last_fullsized":"2024-09-13T06:13:52.484137+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'14","last_scrub_stamp":"2024-09-13T06:13:52.483880+0000","last_deep_scrub":"35'14","last_deep_scrub_stamp":"2024-09-13T06:13:52.483880+0000","last_clean_scrub_stamp":"2024-09-13T06:13:52.483880+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:12:37.738064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:28.787505+0000","last_change":"2024-09-13T06:14:28.787562+0000","last_active":"2024-09-13T06:14:28.787505+0000","last_peered":"2024-09-13T06:14:28.787505+0000","last_clean":"2024-09-13T06:14:28.787505+0000","last_became_active":"2024-09-13T06:09:32.125047+0000","last_became_peered":"2024-09-13T06:09:32.125047+0000","last_unstale":"2024-09-13T06:14:28.787505+0000","last_undegraded":"2024-09-13T06:14:28.787505+0000","last_fullsized":"2024-09-13T06:14:28.787505+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:28.787307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:28.787307+0000","last_clean_scrub_stamp":"2024-09-13T06:14:28.787307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:47:48.552757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:42.241894+0000","last_change":"2024-09-13T06:13:42.241894+0000","last_active":"2024-09-13T06:13:42.241894+0000","last_peered":"2024-09-13T06:13:42.241894+0000","last_clean":"2024-09-13T06:13:42.241894+0000","last_became_active":"2024-09-13T06:09:36.135896+0000","last_became_peered":"2024-09-13T06:09:36.135896+0000","last_unstale":"2024-09-13T06:13:42.241894+0000","last_undegraded":"2024-09-13T06:13:42.241894+0000","last_fullsized":"2024-09-13T06:13:42.241894+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:42.241654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:42.241654+0000","last_clean_scrub_stamp":"2024-09-13T06:13:42.241654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:30:48.725646+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"35'68","reported_seq":142,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:56.931891+0000","last_change":"2024-09-13T06:13:56.931891+0000","last_active":"2024-09-13T06:13:56.931891+0000","last_peered":"2024-09-13T06:13:56.931891+0000","last_clean":"2024-09-13T06:13:56.931891+0000","last_became_active":"2024-09-13T06:09:38.175404+0000","last_became_peered":"2024-09-13T06:09:38.175404+0000","last_unstale":"2024-09-13T06:13:56.931891+0000","last_undegraded":"2024-09-13T06:13:56.931891+0000","last_fullsized":"2024-09-13T06:13:56.931891+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'68","last_scrub_stamp":"2024-09-13T06:13:56.931599+0000","last_deep_scrub":"35'68","last_deep_scrub_stamp":"2024-09-13T06:13:56.931599+0000","last_clean_scrub_stamp":"2024-09-13T06:13:56.931599+0000","objects_scrubbed":5,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:48:12.141585+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":65,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:24.261010+0000","last_change":"2024-09-13T06:13:24.261010+0000","last_active":"2024-09-13T06:13:24.261010+0000","last_peered":"2024-09-13T06:13:24.261010+0000","last_clean":"2024-09-13T06:13:24.261010+0000","last_became_active":"2024-09-13T06:09:40.177127+0000","last_became_peered":"2024-09-13T06:09:40.177127+0000","last_unstale":"2024-09-13T06:13:24.261010+0000","last_undegraded":"2024-09-13T06:13:24.261010+0000","last_fullsized":"2024-09-13T06:13:24.261010+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:24.260874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:24.260874+0000","last_clean_scrub_stamp":"2024-09-13T06:13:24.260874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:44:50.272386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"35'21","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:19.053841+0000","last_change":"2024-09-13T06:14:19.053918+0000","last_active":"2024-09-13T06:14:19.053841+0000","last_peered":"2024-09-13T06:14:19.053841+0000","last_clean":"2024-09-13T06:14:19.053841+0000","last_became_active":"2024-09-13T06:09:42.176229+0000","last_became_peered":"2024-09-13T06:09:42.176229+0000","last_unstale":"2024-09-13T06:14:19.053841+0000","last_undegraded":"2024-09-13T06:14:19.053841+0000","last_fullsized":"2024-09-13T06:14:19.053841+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'21","last_scrub_stamp":"2024-09-13T06:14:19.053655+0000","last_deep_scrub":"35'21","last_deep_scrub_stamp":"2024-09-13T06:14:19.053655+0000","last_clean_scrub_stamp":"2024-09-13T06:14:19.053655+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:22:30.490846+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"35'16","reported_seq":87,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:09.100307+0000","last_change":"2024-09-13T06:14:09.100465+0000","last_active":"2024-09-13T06:14:09.100307+0000","last_peered":"2024-09-13T06:14:09.100307+0000","last_clean":"2024-09-13T06:14:09.100307+0000","last_became_active":"2024-09-13T06:09:34.119018+0000","last_became_peered":"2024-09-13T06:09:34.119018+0000","last_unstale":"2024-09-13T06:14:09.100307+0000","last_undegraded":"2024-09-13T06:14:09.100307+0000","last_fullsized":"2024-09-13T06:14:09.100307+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'16","last_scrub_stamp":"2024-09-13T06:14:09.100069+0000","last_deep_scrub":"35'16","last_deep_scrub_stamp":"2024-09-13T06:14:09.100069+0000","last_clean_scrub_stamp":"2024-09-13T06:14:09.100069+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:19:13.686028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:02.994130+0000","last_change":"2024-09-13T06:14:02.994130+0000","last_active":"2024-09-13T06:14:02.994130+0000","last_peered":"2024-09-13T06:14:02.994130+0000","last_clean":"2024-09-13T06:14:02.994130+0000","last_became_active":"2024-09-13T06:09:32.148505+0000","last_became_peered":"2024-09-13T06:09:32.148505+0000","last_unstale":"2024-09-13T06:14:02.994130+0000","last_undegraded":"2024-09-13T06:14:02.994130+0000","last_fullsized":"2024-09-13T06:14:02.994130+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:02.993832+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:02.993832+0000","last_clean_scrub_stamp":"2024-09-13T06:14:02.993832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:44:02.387231+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:42.465330+0000","last_change":"2024-09-13T06:13:42.465330+0000","last_active":"2024-09-13T06:13:42.465330+0000","last_peered":"2024-09-13T06:13:42.465330+0000","last_clean":"2024-09-13T06:13:42.465330+0000","last_became_active":"2024-09-13T06:09:36.131611+0000","last_became_peered":"2024-09-13T06:09:36.131611+0000","last_unstale":"2024-09-13T06:13:42.465330+0000","last_undegraded":"2024-09-13T06:13:42.465330+0000","last_fullsized":"2024-09-13T06:13:42.465330+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:42.465072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:42.465072+0000","last_clean_scrub_stamp":"2024-09-13T06:13:42.465072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:13:43.052645+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"35'40","reported_seq":97,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:27.295757+0000","last_change":"2024-09-13T06:13:27.295757+0000","last_active":"2024-09-13T06:13:27.295757+0000","last_peered":"2024-09-13T06:13:27.295757+0000","last_clean":"2024-09-13T06:13:27.295757+0000","last_became_active":"2024-09-13T06:09:38.165747+0000","last_became_peered":"2024-09-13T06:09:38.165747+0000","last_unstale":"2024-09-13T06:13:27.295757+0000","last_undegraded":"2024-09-13T06:13:27.295757+0000","last_fullsized":"2024-09-13T06:13:27.295757+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'40","last_scrub_stamp":"2024-09-13T06:13:27.295462+0000","last_deep_scrub":"35'40","last_deep_scrub_stamp":"2024-09-13T06:13:27.295462+0000","last_clean_scrub_stamp":"2024-09-13T06:13:27.295462+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:22:05.049909+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:55.906807+0000","last_change":"2024-09-13T06:13:55.906807+0000","last_active":"2024-09-13T06:13:55.906807+0000","last_peered":"2024-09-13T06:13:55.906807+0000","last_clean":"2024-09-13T06:13:55.906807+0000","last_became_active":"2024-09-13T06:09:40.190314+0000","last_became_peered":"2024-09-13T06:09:40.190314+0000","last_unstale":"2024-09-13T06:13:55.906807+0000","last_undegraded":"2024-09-13T06:13:55.906807+0000","last_fullsized":"2024-09-13T06:13:55.906807+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:55.906553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:55.906553+0000","last_clean_scrub_stamp":"2024-09-13T06:13:55.906553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:32:46.700425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"35'4","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:15.915445+0000","last_change":"2024-09-13T06:14:15.915519+0000","last_active":"2024-09-13T06:14:15.915445+0000","last_peered":"2024-09-13T06:14:15.915445+0000","last_clean":"2024-09-13T06:14:15.915445+0000","last_became_active":"2024-09-13T06:09:42.201211+0000","last_became_peered":"2024-09-13T06:09:42.201211+0000","last_unstale":"2024-09-13T06:14:15.915445+0000","last_undegraded":"2024-09-13T06:14:15.915445+0000","last_fullsized":"2024-09-13T06:14:15.915445+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:14:15.915230+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:14:15.915230+0000","last_clean_scrub_stamp":"2024-09-13T06:14:15.915230+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:21:05.416806+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"35'6","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:40.785766+0000","last_change":"2024-09-13T06:13:40.785766+0000","last_active":"2024-09-13T06:13:40.785766+0000","last_peered":"2024-09-13T06:13:40.785766+0000","last_clean":"2024-09-13T06:13:40.785766+0000","last_became_active":"2024-09-13T06:09:34.131882+0000","last_became_peered":"2024-09-13T06:09:34.131882+0000","last_unstale":"2024-09-13T06:13:40.785766+0000","last_undegraded":"2024-09-13T06:13:40.785766+0000","last_fullsized":"2024-09-13T06:13:40.785766+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:13:40.785378+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:13:40.785378+0000","last_clean_scrub_stamp":"2024-09-13T06:13:40.785378+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:31:15.240641+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:16.931589+0000","last_change":"2024-09-13T06:14:16.931648+0000","last_active":"2024-09-13T06:14:16.931589+0000","last_peered":"2024-09-13T06:14:16.931589+0000","last_clean":"2024-09-13T06:14:16.931589+0000","last_became_active":"2024-09-13T06:09:32.138731+0000","last_became_peered":"2024-09-13T06:09:32.138731+0000","last_unstale":"2024-09-13T06:14:16.931589+0000","last_undegraded":"2024-09-13T06:14:16.931589+0000","last_fullsized":"2024-09-13T06:14:16.931589+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:16.931376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:16.931376+0000","last_clean_scrub_stamp":"2024-09-13T06:14:16.931376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:44:18.267821+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:45.169252+0000","last_change":"2024-09-13T06:13:45.169252+0000","last_active":"2024-09-13T06:13:45.169252+0000","last_peered":"2024-09-13T06:13:45.169252+0000","last_clean":"2024-09-13T06:13:45.169252+0000","last_became_active":"2024-09-13T06:09:36.135660+0000","last_became_peered":"2024-09-13T06:09:36.135660+0000","last_unstale":"2024-09-13T06:13:45.169252+0000","last_undegraded":"2024-09-13T06:13:45.169252+0000","last_fullsized":"2024-09-13T06:13:45.169252+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:45.168902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:45.168902+0000","last_clean_scrub_stamp":"2024-09-13T06:13:45.168902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:17:37.777327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"35'46","reported_seq":105,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:38.444422+0000","last_change":"2024-09-13T06:13:38.444422+0000","last_active":"2024-09-13T06:13:38.444422+0000","last_peered":"2024-09-13T06:13:38.444422+0000","last_clean":"2024-09-13T06:13:38.444422+0000","last_became_active":"2024-09-13T06:09:38.143209+0000","last_became_peered":"2024-09-13T06:09:38.143209+0000","last_unstale":"2024-09-13T06:13:38.444422+0000","last_undegraded":"2024-09-13T06:13:38.444422+0000","last_fullsized":"2024-09-13T06:13:38.444422+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'46","last_scrub_stamp":"2024-09-13T06:13:38.444138+0000","last_deep_scrub":"35'46","last_deep_scrub_stamp":"2024-09-13T06:13:38.444138+0000","last_clean_scrub_stamp":"2024-09-13T06:13:38.444138+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:49:28.085814+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"35'285","reported_seq":417,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:32.368124+0000","last_change":"2024-09-13T06:13:32.368124+0000","last_active":"2024-09-13T06:13:32.368124+0000","last_peered":"2024-09-13T06:13:32.368124+0000","last_clean":"2024-09-13T06:13:32.368124+0000","last_became_active":"2024-09-13T06:09:40.188246+0000","last_became_peered":"2024-09-13T06:09:40.188246+0000","last_unstale":"2024-09-13T06:13:32.368124+0000","last_undegraded":"2024-09-13T06:13:32.368124+0000","last_fullsized":"2024-09-13T06:13:32.368124+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-13T06:13:32.367867+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-13T06:13:32.367867+0000","last_clean_scrub_stamp":"2024-09-13T06:13:32.367867+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:44:58.379379+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"35'17","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:21.015822+0000","last_change":"2024-09-13T06:14:21.015889+0000","last_active":"2024-09-13T06:14:21.015822+0000","last_peered":"2024-09-13T06:14:21.015822+0000","last_clean":"2024-09-13T06:14:21.015822+0000","last_became_active":"2024-09-13T06:09:42.201304+0000","last_became_peered":"2024-09-13T06:09:42.201304+0000","last_unstale":"2024-09-13T06:14:21.015822+0000","last_undegraded":"2024-09-13T06:14:21.015822+0000","last_fullsized":"2024-09-13T06:14:21.015822+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'17","last_scrub_stamp":"2024-09-13T06:14:21.015634+0000","last_deep_scrub":"35'17","last_deep_scrub_stamp":"2024-09-13T06:14:21.015634+0000","last_clean_scrub_stamp":"2024-09-13T06:14:21.015634+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:35:52.895466+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":29,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"35'4","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:00.426330+0000","last_change":"2024-09-13T06:14:00.426330+0000","last_active":"2024-09-13T06:14:00.426330+0000","last_peered":"2024-09-13T06:14:00.426330+0000","last_clean":"2024-09-13T06:14:00.426330+0000","last_became_active":"2024-09-13T06:09:34.102586+0000","last_became_peered":"2024-09-13T06:09:34.102586+0000","last_unstale":"2024-09-13T06:14:00.426330+0000","last_undegraded":"2024-09-13T06:14:00.426330+0000","last_fullsized":"2024-09-13T06:14:00.426330+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:14:00.426064+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:14:00.426064+0000","last_clean_scrub_stamp":"2024-09-13T06:14:00.426064+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:46:57.805890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"35'2","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:30.786818+0000","last_change":"2024-09-13T06:14:30.786888+0000","last_active":"2024-09-13T06:14:30.786818+0000","last_peered":"2024-09-13T06:14:30.786818+0000","last_clean":"2024-09-13T06:14:30.786818+0000","last_became_active":"2024-09-13T06:09:32.122121+0000","last_became_peered":"2024-09-13T06:09:32.122121+0000","last_unstale":"2024-09-13T06:14:30.786818+0000","last_undegraded":"2024-09-13T06:14:30.786818+0000","last_fullsized":"2024-09-13T06:14:30.786818+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:30.786593+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:30.786593+0000","last_clean_scrub_stamp":"2024-09-13T06:14:30.786593+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:21:45.714671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"35'5","reported_seq":429,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:32.185845+0000","last_change":"2024-09-13T06:13:32.185845+0000","last_active":"2024-09-13T06:13:32.185845+0000","last_peered":"2024-09-13T06:13:32.185845+0000","last_clean":"2024-09-13T06:13:32.185845+0000","last_became_active":"2024-09-13T06:09:36.141789+0000","last_became_peered":"2024-09-13T06:09:36.141789+0000","last_unstale":"2024-09-13T06:13:32.185845+0000","last_undegraded":"2024-09-13T06:13:32.185845+0000","last_fullsized":"2024-09-13T06:13:32.185845+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'5","last_scrub_stamp":"2024-09-13T06:13:32.185488+0000","last_deep_scrub":"35'5","last_deep_scrub_stamp":"2024-09-13T06:13:32.185488+0000","last_clean_scrub_stamp":"2024-09-13T06:13:32.185488+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:56:51.767002+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"35'15","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:52.922425+0000","last_change":"2024-09-13T06:13:52.922425+0000","last_active":"2024-09-13T06:13:52.922425+0000","last_peered":"2024-09-13T06:13:52.922425+0000","last_clean":"2024-09-13T06:13:52.922425+0000","last_became_active":"2024-09-13T06:09:38.177217+0000","last_became_peered":"2024-09-13T06:09:38.177217+0000","last_unstale":"2024-09-13T06:13:52.922425+0000","last_undegraded":"2024-09-13T06:13:52.922425+0000","last_fullsized":"2024-09-13T06:13:52.922425+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'15","last_scrub_stamp":"2024-09-13T06:13:52.922012+0000","last_deep_scrub":"35'15","last_deep_scrub_stamp":"2024-09-13T06:13:52.922012+0000","last_clean_scrub_stamp":"2024-09-13T06:13:52.922012+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:05:01.785924+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"35'285","reported_seq":473,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:29.237199+0000","last_change":"2024-09-13T06:13:29.237199+0000","last_active":"2024-09-13T06:13:29.237199+0000","last_peered":"2024-09-13T06:13:29.237199+0000","last_clean":"2024-09-13T06:13:29.237199+0000","last_became_active":"2024-09-13T06:09:40.179438+0000","last_became_peered":"2024-09-13T06:09:40.179438+0000","last_unstale":"2024-09-13T06:13:29.237199+0000","last_undegraded":"2024-09-13T06:13:29.237199+0000","last_fullsized":"2024-09-13T06:13:29.237199+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-13T06:13:29.236948+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-13T06:13:29.236948+0000","last_clean_scrub_stamp":"2024-09-13T06:13:29.236948+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:34:12.529343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"35'6","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:44.457830+0000","last_change":"2024-09-13T06:13:44.457830+0000","last_active":"2024-09-13T06:13:44.457830+0000","last_peered":"2024-09-13T06:13:44.457830+0000","last_clean":"2024-09-13T06:13:44.457830+0000","last_became_active":"2024-09-13T06:09:42.181854+0000","last_became_peered":"2024-09-13T06:09:42.181854+0000","last_unstale":"2024-09-13T06:13:44.457830+0000","last_undegraded":"2024-09-13T06:13:44.457830+0000","last_fullsized":"2024-09-13T06:13:44.457830+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:13:44.457577+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:13:44.457577+0000","last_clean_scrub_stamp":"2024-09-13T06:13:44.457577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:56:32.118289+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:46.140515+0000","last_change":"2024-09-13T06:13:46.140515+0000","last_active":"2024-09-13T06:13:46.140515+0000","last_peered":"2024-09-13T06:13:46.140515+0000","last_clean":"2024-09-13T06:13:46.140515+0000","last_became_active":"2024-09-13T06:09:34.126843+0000","last_became_peered":"2024-09-13T06:09:34.126843+0000","last_unstale":"2024-09-13T06:13:46.140515+0000","last_undegraded":"2024-09-13T06:13:46.140515+0000","last_fullsized":"2024-09-13T06:13:46.140515+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:46.140243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:46.140243+0000","last_clean_scrub_stamp":"2024-09-13T06:13:46.140243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:17:57.910783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"35'5","reported_seq":59,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:25.852388+0000","last_change":"2024-09-13T06:14:25.852541+0000","last_active":"2024-09-13T06:14:25.852388+0000","last_peered":"2024-09-13T06:14:25.852388+0000","last_clean":"2024-09-13T06:14:25.852388+0000","last_became_active":"2024-09-13T06:09:32.129984+0000","last_became_peered":"2024-09-13T06:09:32.129984+0000","last_unstale":"2024-09-13T06:14:25.852388+0000","last_undegraded":"2024-09-13T06:14:25.852388+0000","last_fullsized":"2024-09-13T06:14:25.852388+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'5","last_scrub_stamp":"2024-09-13T06:14:25.852168+0000","last_deep_scrub":"35'5","last_deep_scrub_stamp":"2024-09-13T06:14:25.852168+0000","last_clean_scrub_stamp":"2024-09-13T06:14:25.852168+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:44:53.789448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.907022+0000","last_change":"2024-09-13T06:13:25.907022+0000","last_active":"2024-09-13T06:13:25.907022+0000","last_peered":"2024-09-13T06:13:25.907022+0000","last_clean":"2024-09-13T06:13:25.907022+0000","last_became_active":"2024-09-13T06:09:36.153614+0000","last_became_peered":"2024-09-13T06:09:36.153614+0000","last_unstale":"2024-09-13T06:13:25.907022+0000","last_undegraded":"2024-09-13T06:13:25.907022+0000","last_fullsized":"2024-09-13T06:13:25.907022+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:25.906744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:25.906744+0000","last_clean_scrub_stamp":"2024-09-13T06:13:25.906744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:08:19.863549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"35'48","reported_seq":108,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:31.203250+0000","last_change":"2024-09-13T06:13:31.203250+0000","last_active":"2024-09-13T06:13:31.203250+0000","last_peered":"2024-09-13T06:13:31.203250+0000","last_clean":"2024-09-13T06:13:31.203250+0000","last_became_active":"2024-09-13T06:09:38.155463+0000","last_became_peered":"2024-09-13T06:09:38.155463+0000","last_unstale":"2024-09-13T06:13:31.203250+0000","last_undegraded":"2024-09-13T06:13:31.203250+0000","last_fullsized":"2024-09-13T06:13:31.203250+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'48","last_scrub_stamp":"2024-09-13T06:13:31.202979+0000","last_deep_scrub":"35'48","last_deep_scrub_stamp":"2024-09-13T06:13:31.202979+0000","last_clean_scrub_stamp":"2024-09-13T06:13:31.202979+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:07:14.216978+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:27.404848+0000","last_change":"2024-09-13T06:13:27.404848+0000","last_active":"2024-09-13T06:13:27.404848+0000","last_peered":"2024-09-13T06:13:27.404848+0000","last_clean":"2024-09-13T06:13:27.404848+0000","last_became_active":"2024-09-13T06:09:40.167733+0000","last_became_peered":"2024-09-13T06:09:40.167733+0000","last_unstale":"2024-09-13T06:13:27.404848+0000","last_undegraded":"2024-09-13T06:13:27.404848+0000","last_fullsized":"2024-09-13T06:13:27.404848+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:27.404612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:27.404612+0000","last_clean_scrub_stamp":"2024-09-13T06:13:27.404612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:53:51.661686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"35'7","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:53.145831+0000","last_change":"2024-09-13T06:13:53.145895+0000","last_active":"2024-09-13T06:13:53.145831+0000","last_peered":"2024-09-13T06:13:53.145831+0000","last_clean":"2024-09-13T06:13:53.145831+0000","last_became_active":"2024-09-13T06:09:42.172937+0000","last_became_peered":"2024-09-13T06:09:42.172937+0000","last_unstale":"2024-09-13T06:13:53.145831+0000","last_undegraded":"2024-09-13T06:13:53.145831+0000","last_fullsized":"2024-09-13T06:13:53.145831+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'7","last_scrub_stamp":"2024-09-13T06:13:53.145587+0000","last_deep_scrub":"35'7","last_deep_scrub_stamp":"2024-09-13T06:13:53.145587+0000","last_clean_scrub_stamp":"2024-09-13T06:13:53.145587+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:03:35.737707+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"35'12","reported_seq":87,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:41.783938+0000","last_change":"2024-09-13T06:13:41.783938+0000","last_active":"2024-09-13T06:13:41.783938+0000","last_peered":"2024-09-13T06:13:41.783938+0000","last_clean":"2024-09-13T06:13:41.783938+0000","last_became_active":"2024-09-13T06:09:34.131113+0000","last_became_peered":"2024-09-13T06:09:34.131113+0000","last_unstale":"2024-09-13T06:13:41.783938+0000","last_undegraded":"2024-09-13T06:13:41.783938+0000","last_fullsized":"2024-09-13T06:13:41.783938+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'12","last_scrub_stamp":"2024-09-13T06:13:41.783695+0000","last_deep_scrub":"35'12","last_deep_scrub_stamp":"2024-09-13T06:13:41.783695+0000","last_clean_scrub_stamp":"2024-09-13T06:13:41.783695+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:56:08.039276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":60,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"35'119","reported_seq":217,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:11.124120+0000","last_change":"2024-09-13T06:14:11.124200+0000","last_active":"2024-09-13T06:14:11.124120+0000","last_peered":"2024-09-13T06:14:11.124120+0000","last_clean":"2024-09-13T06:14:11.124120+0000","last_became_active":"2024-09-13T06:09:19.561434+0000","last_became_peered":"2024-09-13T06:09:19.561434+0000","last_unstale":"2024-09-13T06:14:11.124120+0000","last_undegraded":"2024-09-13T06:14:11.124120+0000","last_fullsized":"2024-09-13T06:14:11.124120+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'119","last_scrub_stamp":"2024-09-13T06:14:11.123931+0000","last_deep_scrub":"35'119","last_deep_scrub_stamp":"2024-09-13T06:14:11.123931+0000","last_clean_scrub_stamp":"2024-09-13T06:14:11.123931+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:33:15.905969+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"35'2","reported_seq":66,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:33.750973+0000","last_change":"2024-09-13T06:14:33.751124+0000","last_active":"2024-09-13T06:14:33.750973+0000","last_peered":"2024-09-13T06:14:33.750973+0000","last_clean":"2024-09-13T06:14:33.750973+0000","last_became_active":"2024-09-13T06:09:22.217131+0000","last_became_peered":"2024-09-13T06:09:22.217131+0000","last_unstale":"2024-09-13T06:14:33.750973+0000","last_undegraded":"2024-09-13T06:14:33.750973+0000","last_fullsized":"2024-09-13T06:14:33.750973+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:33.750761+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:33.750761+0000","last_clean_scrub_stamp":"2024-09-13T06:14:33.750761+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:40:48.805428+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00090967000000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"35'4","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:13.937126+0000","last_change":"2024-09-13T06:14:13.937187+0000","last_active":"2024-09-13T06:14:13.937126+0000","last_peered":"2024-09-13T06:14:13.937126+0000","last_clean":"2024-09-13T06:14:13.937126+0000","last_became_active":"2024-09-13T06:09:32.141646+0000","last_became_peered":"2024-09-13T06:09:32.141646+0000","last_unstale":"2024-09-13T06:14:13.937126+0000","last_undegraded":"2024-09-13T06:14:13.937126+0000","last_fullsized":"2024-09-13T06:14:13.937126+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:14:13.936858+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:14:13.936858+0000","last_clean_scrub_stamp":"2024-09-13T06:14:13.936858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:04:46.119839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:35.101614+0000","last_change":"2024-09-13T06:13:35.101614+0000","last_active":"2024-09-13T06:13:35.101614+0000","last_peered":"2024-09-13T06:13:35.101614+0000","last_clean":"2024-09-13T06:13:35.101614+0000","last_became_active":"2024-09-13T06:09:36.140417+0000","last_became_peered":"2024-09-13T06:09:36.140417+0000","last_unstale":"2024-09-13T06:13:35.101614+0000","last_undegraded":"2024-09-13T06:13:35.101614+0000","last_fullsized":"2024-09-13T06:13:35.101614+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:35.101340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:35.101340+0000","last_clean_scrub_stamp":"2024-09-13T06:13:35.101340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:29:39.130402+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"35'90","reported_seq":181,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:53.943462+0000","last_change":"2024-09-13T06:13:53.943462+0000","last_active":"2024-09-13T06:13:53.943462+0000","last_peered":"2024-09-13T06:13:53.943462+0000","last_clean":"2024-09-13T06:13:53.943462+0000","last_became_active":"2024-09-13T06:09:38.176365+0000","last_became_peered":"2024-09-13T06:09:38.176365+0000","last_unstale":"2024-09-13T06:13:53.943462+0000","last_undegraded":"2024-09-13T06:13:53.943462+0000","last_fullsized":"2024-09-13T06:13:53.943462+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'90","last_scrub_stamp":"2024-09-13T06:13:53.943088+0000","last_deep_scrub":"35'90","last_deep_scrub_stamp":"2024-09-13T06:13:53.943088+0000","last_clean_scrub_stamp":"2024-09-13T06:13:53.943088+0000","objects_scrubbed":5,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:10:02.356345+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:44.206956+0000","last_change":"2024-09-13T06:13:44.206956+0000","last_active":"2024-09-13T06:13:44.206956+0000","last_peered":"2024-09-13T06:13:44.206956+0000","last_clean":"2024-09-13T06:13:44.206956+0000","last_became_active":"2024-09-13T06:09:40.178872+0000","last_became_peered":"2024-09-13T06:09:40.178872+0000","last_unstale":"2024-09-13T06:13:44.206956+0000","last_undegraded":"2024-09-13T06:13:44.206956+0000","last_fullsized":"2024-09-13T06:13:44.206956+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:44.206706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:44.206706+0000","last_clean_scrub_stamp":"2024-09-13T06:13:44.206706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:34:21.273218+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"35'82","reported_seq":173,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:36.470775+0000","last_change":"2024-09-13T06:13:36.470775+0000","last_active":"2024-09-13T06:13:36.470775+0000","last_peered":"2024-09-13T06:13:36.470775+0000","last_clean":"2024-09-13T06:13:36.470775+0000","last_became_active":"2024-09-13T06:09:42.197803+0000","last_became_peered":"2024-09-13T06:09:42.197803+0000","last_unstale":"2024-09-13T06:13:36.470775+0000","last_undegraded":"2024-09-13T06:13:36.470775+0000","last_fullsized":"2024-09-13T06:13:36.470775+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'82","last_scrub_stamp":"2024-09-13T06:13:36.470522+0000","last_deep_scrub":"35'82","last_deep_scrub_stamp":"2024-09-13T06:13:36.470522+0000","last_clean_scrub_stamp":"2024-09-13T06:13:36.470522+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:55:18.490378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"35'10","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:21.656806+0000","last_change":"2024-09-13T06:14:21.656806+0000","last_active":"2024-09-13T06:14:21.656806+0000","last_peered":"2024-09-13T06:14:21.656806+0000","last_clean":"2024-09-13T06:14:21.656806+0000","last_became_active":"2024-09-13T06:10:10.941771+0000","last_became_peered":"2024-09-13T06:10:10.941771+0000","last_unstale":"2024-09-13T06:14:21.656806+0000","last_undegraded":"2024-09-13T06:14:21.656806+0000","last_fullsized":"2024-09-13T06:14:21.656806+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-09-13T06:14:21.656523+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-09-13T06:14:21.656523+0000","last_clean_scrub_stamp":"2024-09-13T06:14:21.656523+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:16:54.029670+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:36.799773+0000","last_change":"2024-09-13T06:14:36.799830+0000","last_active":"2024-09-13T06:14:36.799773+0000","last_peered":"2024-09-13T06:14:36.799773+0000","last_clean":"2024-09-13T06:14:36.799773+0000","last_became_active":"2024-09-13T06:09:22.217643+0000","last_became_peered":"2024-09-13T06:09:22.217643+0000","last_unstale":"2024-09-13T06:14:36.799773+0000","last_undegraded":"2024-09-13T06:14:36.799773+0000","last_fullsized":"2024-09-13T06:14:36.799773+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:36.799576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:36.799576+0000","last_clean_scrub_stamp":"2024-09-13T06:14:36.799576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:37:27.011049+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00082521999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"35'2","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:04.995337+0000","last_change":"2024-09-13T06:14:04.995517+0000","last_active":"2024-09-13T06:14:04.995337+0000","last_peered":"2024-09-13T06:14:04.995337+0000","last_clean":"2024-09-13T06:14:04.995337+0000","last_became_active":"2024-09-13T06:09:32.147837+0000","last_became_peered":"2024-09-13T06:09:32.147837+0000","last_unstale":"2024-09-13T06:14:04.995337+0000","last_undegraded":"2024-09-13T06:14:04.995337+0000","last_fullsized":"2024-09-13T06:14:04.995337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:04.995114+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:04.995114+0000","last_clean_scrub_stamp":"2024-09-13T06:14:04.995114+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:15:29.178549+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:28.911118+0000","last_change":"2024-09-13T06:13:28.911118+0000","last_active":"2024-09-13T06:13:28.911118+0000","last_peered":"2024-09-13T06:13:28.911118+0000","last_clean":"2024-09-13T06:13:28.911118+0000","last_became_active":"2024-09-13T06:09:36.153430+0000","last_became_peered":"2024-09-13T06:09:36.153430+0000","last_unstale":"2024-09-13T06:13:28.911118+0000","last_undegraded":"2024-09-13T06:13:28.911118+0000","last_fullsized":"2024-09-13T06:13:28.911118+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:28.910878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:28.910878+0000","last_clean_scrub_stamp":"2024-09-13T06:13:28.910878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:38:20.711196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"35'291","reported_seq":518,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:30.250325+0000","last_change":"2024-09-13T06:13:30.250325+0000","last_active":"2024-09-13T06:13:30.250325+0000","last_peered":"2024-09-13T06:13:30.250325+0000","last_clean":"2024-09-13T06:13:30.250325+0000","last_became_active":"2024-09-13T06:09:38.160192+0000","last_became_peered":"2024-09-13T06:09:38.160192+0000","last_unstale":"2024-09-13T06:13:30.250325+0000","last_undegraded":"2024-09-13T06:13:30.250325+0000","last_fullsized":"2024-09-13T06:13:30.250325+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'291","last_scrub_stamp":"2024-09-13T06:13:30.250026+0000","last_deep_scrub":"35'291","last_deep_scrub_stamp":"2024-09-13T06:13:30.250026+0000","last_clean_scrub_stamp":"2024-09-13T06:13:30.250026+0000","objects_scrubbed":10,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:19:15.055011+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:51.890848+0000","last_change":"2024-09-13T06:13:51.890848+0000","last_active":"2024-09-13T06:13:51.890848+0000","last_peered":"2024-09-13T06:13:51.890848+0000","last_clean":"2024-09-13T06:13:51.890848+0000","last_became_active":"2024-09-13T06:09:40.188859+0000","last_became_peered":"2024-09-13T06:09:40.188859+0000","last_unstale":"2024-09-13T06:13:51.890848+0000","last_undegraded":"2024-09-13T06:13:51.890848+0000","last_fullsized":"2024-09-13T06:13:51.890848+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:51.890601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:51.890601+0000","last_clean_scrub_stamp":"2024-09-13T06:13:51.890601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:55:29.874902+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"35'6","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:25.168319+0000","last_change":"2024-09-13T06:14:25.168387+0000","last_active":"2024-09-13T06:14:25.168319+0000","last_peered":"2024-09-13T06:14:25.168319+0000","last_clean":"2024-09-13T06:14:25.168319+0000","last_became_active":"2024-09-13T06:09:42.204736+0000","last_became_peered":"2024-09-13T06:09:42.204736+0000","last_unstale":"2024-09-13T06:14:25.168319+0000","last_undegraded":"2024-09-13T06:14:25.168319+0000","last_fullsized":"2024-09-13T06:14:25.168319+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:14:25.168119+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:14:25.168119+0000","last_clean_scrub_stamp":"2024-09-13T06:14:25.168119+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:34:10.606069+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"35'8","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:49.136585+0000","last_change":"2024-09-13T06:13:49.136585+0000","last_active":"2024-09-13T06:13:49.136585+0000","last_peered":"2024-09-13T06:13:49.136585+0000","last_clean":"2024-09-13T06:13:49.136585+0000","last_became_active":"2024-09-13T06:09:34.131564+0000","last_became_peered":"2024-09-13T06:09:34.131564+0000","last_unstale":"2024-09-13T06:13:49.136585+0000","last_undegraded":"2024-09-13T06:13:49.136585+0000","last_fullsized":"2024-09-13T06:13:49.136585+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-13T06:13:49.136299+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-13T06:13:49.136299+0000","last_clean_scrub_stamp":"2024-09-13T06:13:49.136299+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:11:56.625206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":62,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:06.429945+0000","last_change":"2024-09-13T06:14:06.429996+0000","last_active":"2024-09-13T06:14:06.429945+0000","last_peered":"2024-09-13T06:14:06.429945+0000","last_clean":"2024-09-13T06:14:06.429945+0000","last_became_active":"2024-09-13T06:09:22.214952+0000","last_became_peered":"2024-09-13T06:09:22.214952+0000","last_unstale":"2024-09-13T06:14:06.429945+0000","last_undegraded":"2024-09-13T06:14:06.429945+0000","last_fullsized":"2024-09-13T06:14:06.429945+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:06.429751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:06.429751+0000","last_clean_scrub_stamp":"2024-09-13T06:14:06.429751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:38:36.699202+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00097860299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:59.106249+0000","last_change":"2024-09-13T06:13:59.106380+0000","last_active":"2024-09-13T06:13:59.106249+0000","last_peered":"2024-09-13T06:13:59.106249+0000","last_clean":"2024-09-13T06:13:59.106249+0000","last_became_active":"2024-09-13T06:09:32.148803+0000","last_became_peered":"2024-09-13T06:09:32.148803+0000","last_unstale":"2024-09-13T06:13:59.106249+0000","last_undegraded":"2024-09-13T06:13:59.106249+0000","last_fullsized":"2024-09-13T06:13:59.106249+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:59.105957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:59.105957+0000","last_clean_scrub_stamp":"2024-09-13T06:13:59.105957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:47:01.112409+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:47.511185+0000","last_change":"2024-09-13T06:13:47.511185+0000","last_active":"2024-09-13T06:13:47.511185+0000","last_peered":"2024-09-13T06:13:47.511185+0000","last_clean":"2024-09-13T06:13:47.511185+0000","last_became_active":"2024-09-13T06:09:36.126497+0000","last_became_peered":"2024-09-13T06:09:36.126497+0000","last_unstale":"2024-09-13T06:13:47.511185+0000","last_undegraded":"2024-09-13T06:13:47.511185+0000","last_fullsized":"2024-09-13T06:13:47.511185+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:13:47.510914+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:13:47.510914+0000","last_clean_scrub_stamp":"2024-09-13T06:13:47.510914+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:50:58.108495+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"35'24","reported_seq":103,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:33.428736+0000","last_change":"2024-09-13T06:13:33.428736+0000","last_active":"2024-09-13T06:13:33.428736+0000","last_peered":"2024-09-13T06:13:33.428736+0000","last_clean":"2024-09-13T06:13:33.428736+0000","last_became_active":"2024-09-13T06:09:38.162358+0000","last_became_peered":"2024-09-13T06:09:38.162358+0000","last_unstale":"2024-09-13T06:13:33.428736+0000","last_undegraded":"2024-09-13T06:13:33.428736+0000","last_fullsized":"2024-09-13T06:13:33.428736+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'24","last_scrub_stamp":"2024-09-13T06:13:33.428464+0000","last_deep_scrub":"35'24","last_deep_scrub_stamp":"2024-09-13T06:13:33.428464+0000","last_clean_scrub_stamp":"2024-09-13T06:13:33.428464+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:54:34.152803+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:40.255183+0000","last_change":"2024-09-13T06:13:40.255183+0000","last_active":"2024-09-13T06:13:40.255183+0000","last_peered":"2024-09-13T06:13:40.255183+0000","last_clean":"2024-09-13T06:13:40.255183+0000","last_became_active":"2024-09-13T06:09:40.179250+0000","last_became_peered":"2024-09-13T06:09:40.179250+0000","last_unstale":"2024-09-13T06:13:40.255183+0000","last_undegraded":"2024-09-13T06:13:40.255183+0000","last_fullsized":"2024-09-13T06:13:40.255183+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:40.254851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:40.254851+0000","last_clean_scrub_stamp":"2024-09-13T06:13:40.254851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:54:39.886202+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"33'2","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.443108+0000","last_change":"2024-09-13T06:09:42.203843+0000","last_active":"2024-09-13T06:13:25.443108+0000","last_peered":"2024-09-13T06:13:25.443108+0000","last_clean":"2024-09-13T06:13:25.443108+0000","last_became_active":"2024-09-13T06:09:42.203232+0000","last_became_peered":"2024-09-13T06:09:42.203232+0000","last_unstale":"2024-09-13T06:13:25.443108+0000","last_undegraded":"2024-09-13T06:13:25.443108+0000","last_fullsized":"2024-09-13T06:13:25.443108+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"35'6","reported_seq":59,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:02.039645+0000","last_change":"2024-09-13T06:14:02.039712+0000","last_active":"2024-09-13T06:14:02.039645+0000","last_peered":"2024-09-13T06:14:02.039645+0000","last_clean":"2024-09-13T06:14:02.039645+0000","last_became_active":"2024-09-13T06:09:34.113002+0000","last_became_peered":"2024-09-13T06:09:34.113002+0000","last_unstale":"2024-09-13T06:14:02.039645+0000","last_undegraded":"2024-09-13T06:14:02.039645+0000","last_fullsized":"2024-09-13T06:14:02.039645+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:14:02.039450+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:14:02.039450+0000","last_clean_scrub_stamp":"2024-09-13T06:14:02.039450+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:56:20.449806+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"35'3","reported_seq":67,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:35.773731+0000","last_change":"2024-09-13T06:14:35.773796+0000","last_active":"2024-09-13T06:14:35.773731+0000","last_peered":"2024-09-13T06:14:35.773731+0000","last_clean":"2024-09-13T06:14:35.773731+0000","last_became_active":"2024-09-13T06:09:22.217581+0000","last_became_peered":"2024-09-13T06:09:22.217581+0000","last_unstale":"2024-09-13T06:14:35.773731+0000","last_undegraded":"2024-09-13T06:14:35.773731+0000","last_fullsized":"2024-09-13T06:14:35.773731+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3","last_scrub_stamp":"2024-09-13T06:14:35.773555+0000","last_deep_scrub":"35'3","last_deep_scrub_stamp":"2024-09-13T06:14:35.773555+0000","last_clean_scrub_stamp":"2024-09-13T06:14:35.773555+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:17:14.903564+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.0022711580000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:59.389088+0000","last_change":"2024-09-13T06:13:59.389148+0000","last_active":"2024-09-13T06:13:59.389088+0000","last_peered":"2024-09-13T06:13:59.389088+0000","last_clean":"2024-09-13T06:13:59.389088+0000","last_became_active":"2024-09-13T06:09:32.138838+0000","last_became_peered":"2024-09-13T06:09:32.138838+0000","last_unstale":"2024-09-13T06:13:59.389088+0000","last_undegraded":"2024-09-13T06:13:59.389088+0000","last_fullsized":"2024-09-13T06:13:59.389088+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:59.388824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:59.388824+0000","last_clean_scrub_stamp":"2024-09-13T06:13:59.388824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:54:30.824903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:18.615698+0000","last_change":"2024-09-13T06:14:18.615698+0000","last_active":"2024-09-13T06:14:18.615698+0000","last_peered":"2024-09-13T06:14:18.615698+0000","last_clean":"2024-09-13T06:14:18.615698+0000","last_became_active":"2024-09-13T06:10:10.809216+0000","last_became_peered":"2024-09-13T06:10:10.809216+0000","last_unstale":"2024-09-13T06:14:18.615698+0000","last_undegraded":"2024-09-13T06:14:18.615698+0000","last_fullsized":"2024-09-13T06:14:18.615698+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:18.615450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:18.615450+0000","last_clean_scrub_stamp":"2024-09-13T06:14:18.615450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:29:37.013948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"35'20","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:49.867101+0000","last_change":"2024-09-13T06:13:49.867101+0000","last_active":"2024-09-13T06:13:49.867101+0000","last_peered":"2024-09-13T06:13:49.867101+0000","last_clean":"2024-09-13T06:13:49.867101+0000","last_became_active":"2024-09-13T06:09:38.176307+0000","last_became_peered":"2024-09-13T06:09:38.176307+0000","last_unstale":"2024-09-13T06:13:49.867101+0000","last_undegraded":"2024-09-13T06:13:49.867101+0000","last_fullsized":"2024-09-13T06:13:49.867101+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'20","last_scrub_stamp":"2024-09-13T06:13:49.866714+0000","last_deep_scrub":"35'20","last_deep_scrub_stamp":"2024-09-13T06:13:49.866714+0000","last_clean_scrub_stamp":"2024-09-13T06:13:49.866714+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:43:14.509705+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:47.833648+0000","last_change":"2024-09-13T06:13:47.833648+0000","last_active":"2024-09-13T06:13:47.833648+0000","last_peered":"2024-09-13T06:13:47.833648+0000","last_clean":"2024-09-13T06:13:47.833648+0000","last_became_active":"2024-09-13T06:09:40.189259+0000","last_became_peered":"2024-09-13T06:09:40.189259+0000","last_unstale":"2024-09-13T06:13:47.833648+0000","last_undegraded":"2024-09-13T06:13:47.833648+0000","last_fullsized":"2024-09-13T06:13:47.833648+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:47.833278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:47.833278+0000","last_clean_scrub_stamp":"2024-09-13T06:13:47.833278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:53:00.141037+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"35'4","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:22.099848+0000","last_change":"2024-09-13T06:14:22.099980+0000","last_active":"2024-09-13T06:14:22.099848+0000","last_peered":"2024-09-13T06:14:22.099848+0000","last_clean":"2024-09-13T06:14:22.099848+0000","last_became_active":"2024-09-13T06:09:42.185210+0000","last_became_peered":"2024-09-13T06:09:42.185210+0000","last_unstale":"2024-09-13T06:14:22.099848+0000","last_undegraded":"2024-09-13T06:14:22.099848+0000","last_fullsized":"2024-09-13T06:14:22.099848+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:14:22.099618+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:14:22.099618+0000","last_clean_scrub_stamp":"2024-09-13T06:14:22.099618+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:33:12.893491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"35'4","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:54.120718+0000","last_change":"2024-09-13T06:13:54.120789+0000","last_active":"2024-09-13T06:13:54.120718+0000","last_peered":"2024-09-13T06:13:54.120718+0000","last_clean":"2024-09-13T06:13:54.120718+0000","last_became_active":"2024-09-13T06:09:34.119283+0000","last_became_peered":"2024-09-13T06:09:34.119283+0000","last_unstale":"2024-09-13T06:13:54.120718+0000","last_undegraded":"2024-09-13T06:13:54.120718+0000","last_fullsized":"2024-09-13T06:13:54.120718+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:13:54.120527+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:13:54.120527+0000","last_clean_scrub_stamp":"2024-09-13T06:13:54.120527+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:35:15.451075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"35'2","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:57.405089+0000","last_change":"2024-09-13T06:13:57.405153+0000","last_active":"2024-09-13T06:13:57.405089+0000","last_peered":"2024-09-13T06:13:57.405089+0000","last_clean":"2024-09-13T06:13:57.405089+0000","last_became_active":"2024-09-13T06:09:32.139313+0000","last_became_peered":"2024-09-13T06:09:32.139313+0000","last_unstale":"2024-09-13T06:13:57.405089+0000","last_undegraded":"2024-09-13T06:13:57.405089+0000","last_fullsized":"2024-09-13T06:13:57.405089+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:13:57.404830+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:13:57.404830+0000","last_clean_scrub_stamp":"2024-09-13T06:13:57.404830+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:04:45.319192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:09.975877+0000","last_change":"2024-09-13T06:14:09.975989+0000","last_active":"2024-09-13T06:14:09.975877+0000","last_peered":"2024-09-13T06:14:09.975877+0000","last_clean":"2024-09-13T06:14:09.975877+0000","last_became_active":"2024-09-13T06:09:22.216659+0000","last_became_peered":"2024-09-13T06:09:22.216659+0000","last_unstale":"2024-09-13T06:14:09.975877+0000","last_undegraded":"2024-09-13T06:14:09.975877+0000","last_fullsized":"2024-09-13T06:14:09.975877+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:09.975665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:09.975665+0000","last_clean_scrub_stamp":"2024-09-13T06:14:09.975665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:35:05.023936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010625330000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:46.126854+0000","last_change":"2024-09-13T06:13:46.126916+0000","last_active":"2024-09-13T06:13:46.126854+0000","last_peered":"2024-09-13T06:13:46.126854+0000","last_clean":"2024-09-13T06:13:46.126854+0000","last_became_active":"2024-09-13T06:09:36.132376+0000","last_became_peered":"2024-09-13T06:09:36.132376+0000","last_unstale":"2024-09-13T06:13:46.126854+0000","last_undegraded":"2024-09-13T06:13:46.126854+0000","last_fullsized":"2024-09-13T06:13:46.126854+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:13:46.126675+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:13:46.126675+0000","last_clean_scrub_stamp":"2024-09-13T06:13:46.126675+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:05:41.556048+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"35'74","reported_seq":151,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:33.324338+0000","last_change":"2024-09-13T06:13:33.324338+0000","last_active":"2024-09-13T06:13:33.324338+0000","last_peered":"2024-09-13T06:13:33.324338+0000","last_clean":"2024-09-13T06:13:33.324338+0000","last_became_active":"2024-09-13T06:09:38.157579+0000","last_became_peered":"2024-09-13T06:09:38.157579+0000","last_unstale":"2024-09-13T06:13:33.324338+0000","last_undegraded":"2024-09-13T06:13:33.324338+0000","last_fullsized":"2024-09-13T06:13:33.324338+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'74","last_scrub_stamp":"2024-09-13T06:13:33.324060+0000","last_deep_scrub":"35'74","last_deep_scrub_stamp":"2024-09-13T06:13:33.324060+0000","last_clean_scrub_stamp":"2024-09-13T06:13:33.324060+0000","objects_scrubbed":9,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:44:12.725129+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:28.380182+0000","last_change":"2024-09-13T06:13:28.380182+0000","last_active":"2024-09-13T06:13:28.380182+0000","last_peered":"2024-09-13T06:13:28.380182+0000","last_clean":"2024-09-13T06:13:28.380182+0000","last_became_active":"2024-09-13T06:09:40.185234+0000","last_became_peered":"2024-09-13T06:09:40.185234+0000","last_unstale":"2024-09-13T06:13:28.380182+0000","last_undegraded":"2024-09-13T06:13:28.380182+0000","last_fullsized":"2024-09-13T06:13:28.380182+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:28.379942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:28.379942+0000","last_clean_scrub_stamp":"2024-09-13T06:13:28.379942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:42:49.566445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"35'11","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:52.119845+0000","last_change":"2024-09-13T06:13:52.119845+0000","last_active":"2024-09-13T06:13:52.119845+0000","last_peered":"2024-09-13T06:13:52.119845+0000","last_clean":"2024-09-13T06:13:52.119845+0000","last_became_active":"2024-09-13T06:09:42.170302+0000","last_became_peered":"2024-09-13T06:09:42.170302+0000","last_unstale":"2024-09-13T06:13:52.119845+0000","last_undegraded":"2024-09-13T06:13:52.119845+0000","last_fullsized":"2024-09-13T06:13:52.119845+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'11","last_scrub_stamp":"2024-09-13T06:13:52.119492+0000","last_deep_scrub":"35'11","last_deep_scrub_stamp":"2024-09-13T06:13:52.119492+0000","last_clean_scrub_stamp":"2024-09-13T06:13:52.119492+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:05:49.867986+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":25,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"35'10","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:52.096124+0000","last_change":"2024-09-13T06:13:52.096242+0000","last_active":"2024-09-13T06:13:52.096124+0000","last_peered":"2024-09-13T06:13:52.096124+0000","last_clean":"2024-09-13T06:13:52.096124+0000","last_became_active":"2024-09-13T06:09:34.121836+0000","last_became_peered":"2024-09-13T06:09:34.121836+0000","last_unstale":"2024-09-13T06:13:52.096124+0000","last_undegraded":"2024-09-13T06:13:52.096124+0000","last_fullsized":"2024-09-13T06:13:52.096124+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-09-13T06:13:52.095831+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-09-13T06:13:52.095831+0000","last_clean_scrub_stamp":"2024-09-13T06:13:52.095831+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:38:45.110796+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:14.961334+0000","last_change":"2024-09-13T06:14:14.961395+0000","last_active":"2024-09-13T06:14:14.961334+0000","last_peered":"2024-09-13T06:14:14.961334+0000","last_clean":"2024-09-13T06:14:14.961334+0000","last_became_active":"2024-09-13T06:09:32.136238+0000","last_became_peered":"2024-09-13T06:09:32.136238+0000","last_unstale":"2024-09-13T06:14:14.961334+0000","last_undegraded":"2024-09-13T06:14:14.961334+0000","last_fullsized":"2024-09-13T06:14:14.961334+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:14.961141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:14.961141+0000","last_clean_scrub_stamp":"2024-09-13T06:14:14.961141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:51:38.057927+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:34.757409+0000","last_change":"2024-09-13T06:14:34.757465+0000","last_active":"2024-09-13T06:14:34.757409+0000","last_peered":"2024-09-13T06:14:34.757409+0000","last_clean":"2024-09-13T06:14:34.757409+0000","last_became_active":"2024-09-13T06:09:22.217809+0000","last_became_peered":"2024-09-13T06:09:22.217809+0000","last_unstale":"2024-09-13T06:14:34.757409+0000","last_undegraded":"2024-09-13T06:14:34.757409+0000","last_fullsized":"2024-09-13T06:14:34.757409+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:34.757206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:34.757206+0000","last_clean_scrub_stamp":"2024-09-13T06:14:34.757206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:45:05.669516+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001447545,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:33.855853+0000","last_change":"2024-09-13T06:13:33.855853+0000","last_active":"2024-09-13T06:13:33.855853+0000","last_peered":"2024-09-13T06:13:33.855853+0000","last_clean":"2024-09-13T06:13:33.855853+0000","last_became_active":"2024-09-13T06:09:36.151605+0000","last_became_peered":"2024-09-13T06:09:36.151605+0000","last_unstale":"2024-09-13T06:13:33.855853+0000","last_undegraded":"2024-09-13T06:13:33.855853+0000","last_fullsized":"2024-09-13T06:13:33.855853+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:33.855604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:33.855604+0000","last_clean_scrub_stamp":"2024-09-13T06:13:33.855604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:30:58.639342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"35'22","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:26.304189+0000","last_change":"2024-09-13T06:13:26.304189+0000","last_active":"2024-09-13T06:13:26.304189+0000","last_peered":"2024-09-13T06:13:26.304189+0000","last_clean":"2024-09-13T06:13:26.304189+0000","last_became_active":"2024-09-13T06:09:38.165916+0000","last_became_peered":"2024-09-13T06:09:38.165916+0000","last_unstale":"2024-09-13T06:13:26.304189+0000","last_undegraded":"2024-09-13T06:13:26.304189+0000","last_fullsized":"2024-09-13T06:13:26.304189+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'22","last_scrub_stamp":"2024-09-13T06:13:26.303565+0000","last_deep_scrub":"35'22","last_deep_scrub_stamp":"2024-09-13T06:13:26.303565+0000","last_clean_scrub_stamp":"2024-09-13T06:13:26.303565+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:32:31.420814+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"35'285","reported_seq":360,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:37.090244+0000","last_change":"2024-09-13T06:13:37.090244+0000","last_active":"2024-09-13T06:13:37.090244+0000","last_peered":"2024-09-13T06:13:37.090244+0000","last_clean":"2024-09-13T06:13:37.090244+0000","last_became_active":"2024-09-13T06:09:40.181415+0000","last_became_peered":"2024-09-13T06:09:40.181415+0000","last_unstale":"2024-09-13T06:13:37.090244+0000","last_undegraded":"2024-09-13T06:13:37.090244+0000","last_fullsized":"2024-09-13T06:13:37.090244+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-13T06:13:37.089987+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-13T06:13:37.089987+0000","last_clean_scrub_stamp":"2024-09-13T06:13:37.089987+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:47:34.898773+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:03.940309+0000","last_change":"2024-09-13T06:14:03.940309+0000","last_active":"2024-09-13T06:14:03.940309+0000","last_peered":"2024-09-13T06:14:03.940309+0000","last_clean":"2024-09-13T06:14:03.940309+0000","last_became_active":"2024-09-13T06:09:42.194558+0000","last_became_peered":"2024-09-13T06:09:42.194558+0000","last_unstale":"2024-09-13T06:14:03.940309+0000","last_undegraded":"2024-09-13T06:14:03.940309+0000","last_fullsized":"2024-09-13T06:14:03.940309+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:03.940064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:03.940064+0000","last_clean_scrub_stamp":"2024-09-13T06:14:03.940064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:19:29.892551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"35'6","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:19.625931+0000","last_change":"2024-09-13T06:14:19.626067+0000","last_active":"2024-09-13T06:14:19.625931+0000","last_peered":"2024-09-13T06:14:19.625931+0000","last_clean":"2024-09-13T06:14:19.625931+0000","last_became_active":"2024-09-13T06:10:10.813656+0000","last_became_peered":"2024-09-13T06:10:10.813656+0000","last_unstale":"2024-09-13T06:14:19.625931+0000","last_undegraded":"2024-09-13T06:14:19.625931+0000","last_fullsized":"2024-09-13T06:14:19.625931+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:14:19.625685+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:14:19.625685+0000","last_clean_scrub_stamp":"2024-09-13T06:14:19.625685+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:06:50.177490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:21.892437+0000","last_change":"2024-09-13T06:14:21.892499+0000","last_active":"2024-09-13T06:14:21.892437+0000","last_peered":"2024-09-13T06:14:21.892437+0000","last_clean":"2024-09-13T06:14:21.892437+0000","last_became_active":"2024-09-13T06:09:32.130385+0000","last_became_peered":"2024-09-13T06:09:32.130385+0000","last_unstale":"2024-09-13T06:14:21.892437+0000","last_undegraded":"2024-09-13T06:14:21.892437+0000","last_fullsized":"2024-09-13T06:14:21.892437+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:21.892222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:21.892222+0000","last_clean_scrub_stamp":"2024-09-13T06:14:21.892222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:46:35.502960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:10.929954+0000","last_change":"2024-09-13T06:14:10.930007+0000","last_active":"2024-09-13T06:14:10.929954+0000","last_peered":"2024-09-13T06:14:10.929954+0000","last_clean":"2024-09-13T06:14:10.929954+0000","last_became_active":"2024-09-13T06:09:22.216905+0000","last_became_peered":"2024-09-13T06:09:22.216905+0000","last_unstale":"2024-09-13T06:14:10.929954+0000","last_undegraded":"2024-09-13T06:14:10.929954+0000","last_fullsized":"2024-09-13T06:14:10.929954+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:10.929727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:10.929727+0000","last_clean_scrub_stamp":"2024-09-13T06:14:10.929727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:09:22.730266+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001005588,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:32.824584+0000","last_change":"2024-09-13T06:13:32.824584+0000","last_active":"2024-09-13T06:13:32.824584+0000","last_peered":"2024-09-13T06:13:32.824584+0000","last_clean":"2024-09-13T06:13:32.824584+0000","last_became_active":"2024-09-13T06:09:36.149051+0000","last_became_peered":"2024-09-13T06:09:36.149051+0000","last_unstale":"2024-09-13T06:13:32.824584+0000","last_undegraded":"2024-09-13T06:13:32.824584+0000","last_fullsized":"2024-09-13T06:13:32.824584+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:32.824332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:32.824332+0000","last_clean_scrub_stamp":"2024-09-13T06:13:32.824332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:49:10.096883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"35'15","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:39.760213+0000","last_change":"2024-09-13T06:13:39.760213+0000","last_active":"2024-09-13T06:13:39.760213+0000","last_peered":"2024-09-13T06:13:39.760213+0000","last_clean":"2024-09-13T06:13:39.760213+0000","last_became_active":"2024-09-13T06:09:38.173017+0000","last_became_peered":"2024-09-13T06:09:38.173017+0000","last_unstale":"2024-09-13T06:13:39.760213+0000","last_undegraded":"2024-09-13T06:13:39.760213+0000","last_fullsized":"2024-09-13T06:13:39.760213+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'15","last_scrub_stamp":"2024-09-13T06:13:39.759783+0000","last_deep_scrub":"35'15","last_deep_scrub_stamp":"2024-09-13T06:13:39.759783+0000","last_clean_scrub_stamp":"2024-09-13T06:13:39.759783+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:53:57.061723+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"35'285","reported_seq":403,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:30.299531+0000","last_change":"2024-09-13T06:13:30.299531+0000","last_active":"2024-09-13T06:13:30.299531+0000","last_peered":"2024-09-13T06:13:30.299531+0000","last_clean":"2024-09-13T06:13:30.299531+0000","last_became_active":"2024-09-13T06:09:40.170879+0000","last_became_peered":"2024-09-13T06:09:40.170879+0000","last_unstale":"2024-09-13T06:13:30.299531+0000","last_undegraded":"2024-09-13T06:13:30.299531+0000","last_fullsized":"2024-09-13T06:13:30.299531+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-13T06:13:30.299279+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-13T06:13:30.299279+0000","last_clean_scrub_stamp":"2024-09-13T06:13:30.299279+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:49:19.940955+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"33'3","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:20.142740+0000","last_change":"2024-09-13T06:14:20.142848+0000","last_active":"2024-09-13T06:14:20.142740+0000","last_peered":"2024-09-13T06:14:20.142740+0000","last_clean":"2024-09-13T06:14:20.142740+0000","last_became_active":"2024-09-13T06:09:42.178890+0000","last_became_peered":"2024-09-13T06:09:42.178890+0000","last_unstale":"2024-09-13T06:14:20.142740+0000","last_undegraded":"2024-09-13T06:14:20.142740+0000","last_fullsized":"2024-09-13T06:14:20.142740+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-09-13T06:14:20.142460+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-09-13T06:14:20.142460+0000","last_clean_scrub_stamp":"2024-09-13T06:14:20.142460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:10:28.555717+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"35'4","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:58.403221+0000","last_change":"2024-09-13T06:13:58.403253+0000","last_active":"2024-09-13T06:13:58.403221+0000","last_peered":"2024-09-13T06:13:58.403221+0000","last_clean":"2024-09-13T06:13:58.403221+0000","last_became_active":"2024-09-13T06:09:34.104194+0000","last_became_peered":"2024-09-13T06:09:34.104194+0000","last_unstale":"2024-09-13T06:13:58.403221+0000","last_undegraded":"2024-09-13T06:13:58.403221+0000","last_fullsized":"2024-09-13T06:13:58.403221+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:13:58.403115+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:13:58.403115+0000","last_clean_scrub_stamp":"2024-09-13T06:13:58.403115+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:17:01.119280+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:14.077504+0000","last_change":"2024-09-13T06:14:14.077563+0000","last_active":"2024-09-13T06:14:14.077504+0000","last_peered":"2024-09-13T06:14:14.077504+0000","last_clean":"2024-09-13T06:14:14.077504+0000","last_became_active":"2024-09-13T06:09:32.118386+0000","last_became_peered":"2024-09-13T06:09:32.118386+0000","last_unstale":"2024-09-13T06:14:14.077504+0000","last_undegraded":"2024-09-13T06:14:14.077504+0000","last_fullsized":"2024-09-13T06:14:14.077504+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:14.077297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:14.077297+0000","last_clean_scrub_stamp":"2024-09-13T06:14:14.077297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:17:32.570841+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:37.793048+0000","last_change":"2024-09-13T06:14:37.793101+0000","last_active":"2024-09-13T06:14:37.793048+0000","last_peered":"2024-09-13T06:14:37.793048+0000","last_clean":"2024-09-13T06:14:37.793048+0000","last_became_active":"2024-09-13T06:09:22.495259+0000","last_became_peered":"2024-09-13T06:09:22.495259+0000","last_unstale":"2024-09-13T06:14:37.793048+0000","last_undegraded":"2024-09-13T06:14:37.793048+0000","last_fullsized":"2024-09-13T06:14:37.793048+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:37.792835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:37.792835+0000","last_clean_scrub_stamp":"2024-09-13T06:14:37.792835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:23:26.262129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002230409,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:36.776310+0000","last_change":"2024-09-13T06:13:36.776310+0000","last_active":"2024-09-13T06:13:36.776310+0000","last_peered":"2024-09-13T06:13:36.776310+0000","last_clean":"2024-09-13T06:13:36.776310+0000","last_became_active":"2024-09-13T06:09:36.144463+0000","last_became_peered":"2024-09-13T06:09:36.144463+0000","last_unstale":"2024-09-13T06:13:36.776310+0000","last_undegraded":"2024-09-13T06:13:36.776310+0000","last_fullsized":"2024-09-13T06:13:36.776310+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:36.776068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:36.776068+0000","last_clean_scrub_stamp":"2024-09-13T06:13:36.776068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:07:56.568181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"35'96","reported_seq":190,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:34.414511+0000","last_change":"2024-09-13T06:13:34.414511+0000","last_active":"2024-09-13T06:13:34.414511+0000","last_peered":"2024-09-13T06:13:34.414511+0000","last_clean":"2024-09-13T06:13:34.414511+0000","last_became_active":"2024-09-13T06:09:38.158436+0000","last_became_peered":"2024-09-13T06:09:38.158436+0000","last_unstale":"2024-09-13T06:13:34.414511+0000","last_undegraded":"2024-09-13T06:13:34.414511+0000","last_fullsized":"2024-09-13T06:13:34.414511+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'96","last_scrub_stamp":"2024-09-13T06:13:34.414208+0000","last_deep_scrub":"35'96","last_deep_scrub_stamp":"2024-09-13T06:13:34.414208+0000","last_clean_scrub_stamp":"2024-09-13T06:13:34.414208+0000","objects_scrubbed":8,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:05:39.013229+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.290882+0000","last_change":"2024-09-13T06:13:25.290882+0000","last_active":"2024-09-13T06:13:25.290882+0000","last_peered":"2024-09-13T06:13:25.290882+0000","last_clean":"2024-09-13T06:13:25.290882+0000","last_became_active":"2024-09-13T06:09:40.176677+0000","last_became_peered":"2024-09-13T06:09:40.176677+0000","last_unstale":"2024-09-13T06:13:25.290882+0000","last_undegraded":"2024-09-13T06:13:25.290882+0000","last_fullsized":"2024-09-13T06:13:25.290882+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:25.290780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:25.290780+0000","last_clean_scrub_stamp":"2024-09-13T06:13:25.290780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:27:24.453678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:15.505254+0000","last_change":"2024-09-13T06:14:15.505311+0000","last_active":"2024-09-13T06:14:15.505254+0000","last_peered":"2024-09-13T06:14:15.505254+0000","last_clean":"2024-09-13T06:14:15.505254+0000","last_became_active":"2024-09-13T06:09:42.204574+0000","last_became_peered":"2024-09-13T06:09:42.204574+0000","last_unstale":"2024-09-13T06:14:15.505254+0000","last_undegraded":"2024-09-13T06:14:15.505254+0000","last_fullsized":"2024-09-13T06:14:15.505254+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:15.505057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:15.505057+0000","last_clean_scrub_stamp":"2024-09-13T06:14:15.505057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:28:16.831802+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:40.425637+0000","last_change":"2024-09-13T06:13:40.425637+0000","last_active":"2024-09-13T06:13:40.425637+0000","last_peered":"2024-09-13T06:13:40.425637+0000","last_clean":"2024-09-13T06:13:40.425637+0000","last_became_active":"2024-09-13T06:09:42.197788+0000","last_became_peered":"2024-09-13T06:09:42.197788+0000","last_unstale":"2024-09-13T06:13:40.425637+0000","last_undegraded":"2024-09-13T06:13:40.425637+0000","last_fullsized":"2024-09-13T06:13:40.425637+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:40.425298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:40.425298+0000","last_clean_scrub_stamp":"2024-09-13T06:13:40.425298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:01:43.246247+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"35'8","reported_seq":71,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:54.474712+0000","last_change":"2024-09-13T06:13:54.474712+0000","last_active":"2024-09-13T06:13:54.474712+0000","last_peered":"2024-09-13T06:13:54.474712+0000","last_clean":"2024-09-13T06:13:54.474712+0000","last_became_active":"2024-09-13T06:09:34.101193+0000","last_became_peered":"2024-09-13T06:09:34.101193+0000","last_unstale":"2024-09-13T06:13:54.474712+0000","last_undegraded":"2024-09-13T06:13:54.474712+0000","last_fullsized":"2024-09-13T06:13:54.474712+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-13T06:13:54.474414+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-13T06:13:54.474414+0000","last_clean_scrub_stamp":"2024-09-13T06:13:54.474414+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:46:58.633819+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:32.741083+0000","last_change":"2024-09-13T06:14:32.741148+0000","last_active":"2024-09-13T06:14:32.741083+0000","last_peered":"2024-09-13T06:14:32.741083+0000","last_clean":"2024-09-13T06:14:32.741083+0000","last_became_active":"2024-09-13T06:09:32.124198+0000","last_became_peered":"2024-09-13T06:09:32.124198+0000","last_unstale":"2024-09-13T06:14:32.741083+0000","last_undegraded":"2024-09-13T06:14:32.741083+0000","last_fullsized":"2024-09-13T06:14:32.741083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:32.740843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:32.740843+0000","last_clean_scrub_stamp":"2024-09-13T06:14:32.740843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:26:26.910117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:40.103927+0000","last_change":"2024-09-13T06:13:40.103927+0000","last_active":"2024-09-13T06:13:40.103927+0000","last_peered":"2024-09-13T06:13:40.103927+0000","last_clean":"2024-09-13T06:13:40.103927+0000","last_became_active":"2024-09-13T06:09:36.133568+0000","last_became_peered":"2024-09-13T06:09:36.133568+0000","last_unstale":"2024-09-13T06:13:40.103927+0000","last_undegraded":"2024-09-13T06:13:40.103927+0000","last_fullsized":"2024-09-13T06:13:40.103927+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:40.103666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:40.103666+0000","last_clean_scrub_stamp":"2024-09-13T06:13:40.103666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:14:26.486674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"35'39","reported_seq":96,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:31.841640+0000","last_change":"2024-09-13T06:13:31.841640+0000","last_active":"2024-09-13T06:13:31.841640+0000","last_peered":"2024-09-13T06:13:31.841640+0000","last_clean":"2024-09-13T06:13:31.841640+0000","last_became_active":"2024-09-13T06:09:38.172109+0000","last_became_peered":"2024-09-13T06:09:38.172109+0000","last_unstale":"2024-09-13T06:13:31.841640+0000","last_undegraded":"2024-09-13T06:13:31.841640+0000","last_fullsized":"2024-09-13T06:13:31.841640+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'39","last_scrub_stamp":"2024-09-13T06:13:31.841369+0000","last_deep_scrub":"35'39","last_deep_scrub_stamp":"2024-09-13T06:13:31.841369+0000","last_clean_scrub_stamp":"2024-09-13T06:13:31.841369+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:43:03.426580+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:46.795936+0000","last_change":"2024-09-13T06:13:46.795936+0000","last_active":"2024-09-13T06:13:46.795936+0000","last_peered":"2024-09-13T06:13:46.795936+0000","last_clean":"2024-09-13T06:13:46.795936+0000","last_became_active":"2024-09-13T06:09:40.189223+0000","last_became_peered":"2024-09-13T06:09:40.189223+0000","last_unstale":"2024-09-13T06:13:46.795936+0000","last_undegraded":"2024-09-13T06:13:46.795936+0000","last_fullsized":"2024-09-13T06:13:46.795936+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:46.795688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:46.795688+0000","last_clean_scrub_stamp":"2024-09-13T06:13:46.795688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:53:07.200189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"35'5","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:20.040519+0000","last_change":"2024-09-13T06:14:20.040580+0000","last_active":"2024-09-13T06:14:20.040519+0000","last_peered":"2024-09-13T06:14:20.040519+0000","last_clean":"2024-09-13T06:14:20.040519+0000","last_became_active":"2024-09-13T06:09:42.177378+0000","last_became_peered":"2024-09-13T06:09:42.177378+0000","last_unstale":"2024-09-13T06:14:20.040519+0000","last_undegraded":"2024-09-13T06:14:20.040519+0000","last_fullsized":"2024-09-13T06:14:20.040519+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'5","last_scrub_stamp":"2024-09-13T06:14:20.040302+0000","last_deep_scrub":"35'5","last_deep_scrub_stamp":"2024-09-13T06:14:20.040302+0000","last_clean_scrub_stamp":"2024-09-13T06:14:20.040302+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:43:56.443852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"35'18","reported_seq":85,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:05.144068+0000","last_change":"2024-09-13T06:14:05.144068+0000","last_active":"2024-09-13T06:14:05.144068+0000","last_peered":"2024-09-13T06:14:05.144068+0000","last_clean":"2024-09-13T06:14:05.144068+0000","last_became_active":"2024-09-13T06:09:34.118441+0000","last_became_peered":"2024-09-13T06:09:34.118441+0000","last_unstale":"2024-09-13T06:14:05.144068+0000","last_undegraded":"2024-09-13T06:14:05.144068+0000","last_fullsized":"2024-09-13T06:14:05.144068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'18","last_scrub_stamp":"2024-09-13T06:14:05.143689+0000","last_deep_scrub":"35'18","last_deep_scrub_stamp":"2024-09-13T06:14:05.143689+0000","last_clean_scrub_stamp":"2024-09-13T06:14:05.143689+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:29:22.100915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":59,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:01.442453+0000","last_change":"2024-09-13T06:14:01.442453+0000","last_active":"2024-09-13T06:14:01.442453+0000","last_peered":"2024-09-13T06:14:01.442453+0000","last_clean":"2024-09-13T06:14:01.442453+0000","last_became_active":"2024-09-13T06:09:32.138664+0000","last_became_peered":"2024-09-13T06:09:32.138664+0000","last_unstale":"2024-09-13T06:14:01.442453+0000","last_undegraded":"2024-09-13T06:14:01.442453+0000","last_fullsized":"2024-09-13T06:14:01.442453+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:01.442196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:01.442196+0000","last_clean_scrub_stamp":"2024-09-13T06:14:01.442196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:02:06.026722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"35'5","reported_seq":239,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:30.836350+0000","last_change":"2024-09-13T06:13:30.836350+0000","last_active":"2024-09-13T06:13:30.836350+0000","last_peered":"2024-09-13T06:13:30.836350+0000","last_clean":"2024-09-13T06:13:30.836350+0000","last_became_active":"2024-09-13T06:09:36.153526+0000","last_became_peered":"2024-09-13T06:09:36.153526+0000","last_unstale":"2024-09-13T06:13:30.836350+0000","last_undegraded":"2024-09-13T06:13:30.836350+0000","last_fullsized":"2024-09-13T06:13:30.836350+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'5","last_scrub_stamp":"2024-09-13T06:13:30.836096+0000","last_deep_scrub":"35'5","last_deep_scrub_stamp":"2024-09-13T06:13:30.836096+0000","last_clean_scrub_stamp":"2024-09-13T06:13:30.836096+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:12:49.323535+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"35'9","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:37.292929+0000","last_change":"2024-09-13T06:13:37.292929+0000","last_active":"2024-09-13T06:13:37.292929+0000","last_peered":"2024-09-13T06:13:37.292929+0000","last_clean":"2024-09-13T06:13:37.292929+0000","last_became_active":"2024-09-13T06:09:38.150063+0000","last_became_peered":"2024-09-13T06:09:38.150063+0000","last_unstale":"2024-09-13T06:13:37.292929+0000","last_undegraded":"2024-09-13T06:13:37.292929+0000","last_fullsized":"2024-09-13T06:13:37.292929+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'9","last_scrub_stamp":"2024-09-13T06:13:37.292678+0000","last_deep_scrub":"35'9","last_deep_scrub_stamp":"2024-09-13T06:13:37.292678+0000","last_clean_scrub_stamp":"2024-09-13T06:13:37.292678+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:13:04.527644+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.383351+0000","last_change":"2024-09-13T06:13:25.383351+0000","last_active":"2024-09-13T06:13:25.383351+0000","last_peered":"2024-09-13T06:13:25.383351+0000","last_clean":"2024-09-13T06:13:25.383351+0000","last_became_active":"2024-09-13T06:09:40.181807+0000","last_became_peered":"2024-09-13T06:09:40.181807+0000","last_unstale":"2024-09-13T06:13:25.383351+0000","last_undegraded":"2024-09-13T06:13:25.383351+0000","last_fullsized":"2024-09-13T06:13:25.383351+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:25.383101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:25.383101+0000","last_clean_scrub_stamp":"2024-09-13T06:13:25.383101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:45:24.271310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"35'2","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:23.910357+0000","last_change":"2024-09-13T06:14:23.910357+0000","last_active":"2024-09-13T06:14:23.910357+0000","last_peered":"2024-09-13T06:14:23.910357+0000","last_clean":"2024-09-13T06:14:23.910357+0000","last_became_active":"2024-09-13T06:09:42.208567+0000","last_became_peered":"2024-09-13T06:09:42.208567+0000","last_unstale":"2024-09-13T06:14:23.910357+0000","last_undegraded":"2024-09-13T06:14:23.910357+0000","last_fullsized":"2024-09-13T06:14:23.910357+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:23.910090+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:23.910090+0000","last_clean_scrub_stamp":"2024-09-13T06:14:23.910090+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:41:01.763518+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"35'12","reported_seq":70,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:56.169020+0000","last_change":"2024-09-13T06:13:56.169020+0000","last_active":"2024-09-13T06:13:56.169020+0000","last_peered":"2024-09-13T06:13:56.169020+0000","last_clean":"2024-09-13T06:13:56.169020+0000","last_became_active":"2024-09-13T06:09:34.113455+0000","last_became_peered":"2024-09-13T06:09:34.113455+0000","last_unstale":"2024-09-13T06:13:56.169020+0000","last_undegraded":"2024-09-13T06:13:56.169020+0000","last_fullsized":"2024-09-13T06:13:56.169020+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'12","last_scrub_stamp":"2024-09-13T06:13:56.168729+0000","last_deep_scrub":"35'12","last_deep_scrub_stamp":"2024-09-13T06:13:56.168729+0000","last_clean_scrub_stamp":"2024-09-13T06:13:56.168729+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:18:27.944609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:09.534380+0000","last_change":"2024-09-13T06:14:09.534380+0000","last_active":"2024-09-13T06:14:09.534380+0000","last_peered":"2024-09-13T06:14:09.534380+0000","last_clean":"2024-09-13T06:14:09.534380+0000","last_became_active":"2024-09-13T06:09:32.118235+0000","last_became_peered":"2024-09-13T06:09:32.118235+0000","last_unstale":"2024-09-13T06:14:09.534380+0000","last_undegraded":"2024-09-13T06:14:09.534380+0000","last_fullsized":"2024-09-13T06:14:09.534380+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:09.534088+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:09.534088+0000","last_clean_scrub_stamp":"2024-09-13T06:14:09.534088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:19:44.114982+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"35'2","reported_seq":231,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:41.478861+0000","last_change":"2024-09-13T06:13:41.478861+0000","last_active":"2024-09-13T06:13:41.478861+0000","last_peered":"2024-09-13T06:13:41.478861+0000","last_clean":"2024-09-13T06:13:41.478861+0000","last_became_active":"2024-09-13T06:09:36.135184+0000","last_became_peered":"2024-09-13T06:09:36.135184+0000","last_unstale":"2024-09-13T06:13:41.478861+0000","last_undegraded":"2024-09-13T06:13:41.478861+0000","last_fullsized":"2024-09-13T06:13:41.478861+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:13:41.478609+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:13:41.478609+0000","last_clean_scrub_stamp":"2024-09-13T06:13:41.478609+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:20:43.284625+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"35'49","reported_seq":122,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:31.284327+0000","last_change":"2024-09-13T06:13:31.284327+0000","last_active":"2024-09-13T06:13:31.284327+0000","last_peered":"2024-09-13T06:13:31.284327+0000","last_clean":"2024-09-13T06:13:31.284327+0000","last_became_active":"2024-09-13T06:09:38.166381+0000","last_became_peered":"2024-09-13T06:09:38.166381+0000","last_unstale":"2024-09-13T06:13:31.284327+0000","last_undegraded":"2024-09-13T06:13:31.284327+0000","last_fullsized":"2024-09-13T06:13:31.284327+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'49","last_scrub_stamp":"2024-09-13T06:13:31.283995+0000","last_deep_scrub":"35'49","last_deep_scrub_stamp":"2024-09-13T06:13:31.283995+0000","last_clean_scrub_stamp":"2024-09-13T06:13:31.283995+0000","objects_scrubbed":6,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:53:13.436645+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:33.140552+0000","last_change":"2024-09-13T06:13:33.140552+0000","last_active":"2024-09-13T06:13:33.140552+0000","last_peered":"2024-09-13T06:13:33.140552+0000","last_clean":"2024-09-13T06:13:33.140552+0000","last_became_active":"2024-09-13T06:09:40.181329+0000","last_became_peered":"2024-09-13T06:09:40.181329+0000","last_unstale":"2024-09-13T06:13:33.140552+0000","last_undegraded":"2024-09-13T06:13:33.140552+0000","last_fullsized":"2024-09-13T06:13:33.140552+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:33.140310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:33.140310+0000","last_clean_scrub_stamp":"2024-09-13T06:13:33.140310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:08:31.071212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":19,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.443333+0000","last_change":"2024-09-13T06:09:42.211550+0000","last_active":"2024-09-13T06:13:25.443333+0000","last_peered":"2024-09-13T06:13:25.443333+0000","last_clean":"2024-09-13T06:13:25.443333+0000","last_became_active":"2024-09-13T06:09:42.211005+0000","last_became_peered":"2024-09-13T06:09:42.211005+0000","last_unstale":"2024-09-13T06:13:25.443333+0000","last_undegraded":"2024-09-13T06:13:25.443333+0000","last_fullsized":"2024-09-13T06:13:25.443333+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"35'6","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:42.783373+0000","last_change":"2024-09-13T06:13:42.783373+0000","last_active":"2024-09-13T06:13:42.783373+0000","last_peered":"2024-09-13T06:13:42.783373+0000","last_clean":"2024-09-13T06:13:42.783373+0000","last_became_active":"2024-09-13T06:09:34.126798+0000","last_became_peered":"2024-09-13T06:09:34.126798+0000","last_unstale":"2024-09-13T06:13:42.783373+0000","last_undegraded":"2024-09-13T06:13:42.783373+0000","last_fullsized":"2024-09-13T06:13:42.783373+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:13:42.783125+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:13:42.783125+0000","last_clean_scrub_stamp":"2024-09-13T06:13:42.783125+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:22:51.788479+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:16.077566+0000","last_change":"2024-09-13T06:14:16.077566+0000","last_active":"2024-09-13T06:14:16.077566+0000","last_peered":"2024-09-13T06:14:16.077566+0000","last_clean":"2024-09-13T06:14:16.077566+0000","last_became_active":"2024-09-13T06:09:32.126213+0000","last_became_peered":"2024-09-13T06:09:32.126213+0000","last_unstale":"2024-09-13T06:14:16.077566+0000","last_undegraded":"2024-09-13T06:14:16.077566+0000","last_fullsized":"2024-09-13T06:14:16.077566+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:16.077312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:16.077312+0000","last_clean_scrub_stamp":"2024-09-13T06:14:16.077312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:43:40.720303+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:34.825411+0000","last_change":"2024-09-13T06:13:34.825411+0000","last_active":"2024-09-13T06:13:34.825411+0000","last_peered":"2024-09-13T06:13:34.825411+0000","last_clean":"2024-09-13T06:13:34.825411+0000","last_became_active":"2024-09-13T06:09:36.148016+0000","last_became_peered":"2024-09-13T06:09:36.148016+0000","last_unstale":"2024-09-13T06:13:34.825411+0000","last_undegraded":"2024-09-13T06:13:34.825411+0000","last_fullsized":"2024-09-13T06:13:34.825411+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:34.825172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:34.825172+0000","last_clean_scrub_stamp":"2024-09-13T06:13:34.825172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:35:11.379450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"35'36","reported_seq":92,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:39.479798+0000","last_change":"2024-09-13T06:13:39.479798+0000","last_active":"2024-09-13T06:13:39.479798+0000","last_peered":"2024-09-13T06:13:39.479798+0000","last_clean":"2024-09-13T06:13:39.479798+0000","last_became_active":"2024-09-13T06:09:38.141182+0000","last_became_peered":"2024-09-13T06:09:38.141182+0000","last_unstale":"2024-09-13T06:13:39.479798+0000","last_undegraded":"2024-09-13T06:13:39.479798+0000","last_fullsized":"2024-09-13T06:13:39.479798+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'36","last_scrub_stamp":"2024-09-13T06:13:39.479521+0000","last_deep_scrub":"35'36","last_deep_scrub_stamp":"2024-09-13T06:13:39.479521+0000","last_clean_scrub_stamp":"2024-09-13T06:13:39.479521+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:51:47.667173+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:30.363157+0000","last_change":"2024-09-13T06:13:30.363157+0000","last_active":"2024-09-13T06:13:30.363157+0000","last_peered":"2024-09-13T06:13:30.363157+0000","last_clean":"2024-09-13T06:13:30.363157+0000","last_became_active":"2024-09-13T06:09:40.166229+0000","last_became_peered":"2024-09-13T06:09:40.166229+0000","last_unstale":"2024-09-13T06:13:30.363157+0000","last_undegraded":"2024-09-13T06:13:30.363157+0000","last_fullsized":"2024-09-13T06:13:30.363157+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:30.362905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:30.362905+0000","last_clean_scrub_stamp":"2024-09-13T06:13:30.362905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:24:17.255873+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"35'6","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:01.922629+0000","last_change":"2024-09-13T06:14:01.922787+0000","last_active":"2024-09-13T06:14:01.922629+0000","last_peered":"2024-09-13T06:14:01.922629+0000","last_clean":"2024-09-13T06:14:01.922629+0000","last_became_active":"2024-09-13T06:09:34.122034+0000","last_became_peered":"2024-09-13T06:09:34.122034+0000","last_unstale":"2024-09-13T06:14:01.922629+0000","last_undegraded":"2024-09-13T06:14:01.922629+0000","last_fullsized":"2024-09-13T06:14:01.922629+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:14:01.922410+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:14:01.922410+0000","last_clean_scrub_stamp":"2024-09-13T06:14:01.922410+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:23:57.663402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:39.867317+0000","last_change":"2024-09-13T06:14:39.867379+0000","last_active":"2024-09-13T06:14:39.867317+0000","last_peered":"2024-09-13T06:14:39.867317+0000","last_clean":"2024-09-13T06:14:39.867317+0000","last_became_active":"2024-09-13T06:09:32.121948+0000","last_became_peered":"2024-09-13T06:09:32.121948+0000","last_unstale":"2024-09-13T06:14:39.867317+0000","last_undegraded":"2024-09-13T06:14:39.867317+0000","last_fullsized":"2024-09-13T06:14:39.867317+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:39.867116+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:39.867116+0000","last_clean_scrub_stamp":"2024-09-13T06:14:39.867116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:19:27.582636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:47.139074+0000","last_change":"2024-09-13T06:13:47.139128+0000","last_active":"2024-09-13T06:13:47.139074+0000","last_peered":"2024-09-13T06:13:47.139074+0000","last_clean":"2024-09-13T06:13:47.139074+0000","last_became_active":"2024-09-13T06:09:36.132227+0000","last_became_peered":"2024-09-13T06:09:36.132227+0000","last_unstale":"2024-09-13T06:13:47.139074+0000","last_undegraded":"2024-09-13T06:13:47.139074+0000","last_fullsized":"2024-09-13T06:13:47.139074+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:47.138875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:47.138875+0000","last_clean_scrub_stamp":"2024-09-13T06:13:47.138875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:46:51.298281+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"35'63","reported_seq":137,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:38.263042+0000","last_change":"2024-09-13T06:13:38.263042+0000","last_active":"2024-09-13T06:13:38.263042+0000","last_peered":"2024-09-13T06:13:38.263042+0000","last_clean":"2024-09-13T06:13:38.263042+0000","last_became_active":"2024-09-13T06:09:38.150070+0000","last_became_peered":"2024-09-13T06:09:38.150070+0000","last_unstale":"2024-09-13T06:13:38.263042+0000","last_undegraded":"2024-09-13T06:13:38.263042+0000","last_fullsized":"2024-09-13T06:13:38.263042+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'63","last_scrub_stamp":"2024-09-13T06:13:38.262747+0000","last_deep_scrub":"35'63","last_deep_scrub_stamp":"2024-09-13T06:13:38.262747+0000","last_clean_scrub_stamp":"2024-09-13T06:13:38.262747+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:56:34.974972+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:26.401325+0000","last_change":"2024-09-13T06:13:26.401325+0000","last_active":"2024-09-13T06:13:26.401325+0000","last_peered":"2024-09-13T06:13:26.401325+0000","last_clean":"2024-09-13T06:13:26.401325+0000","last_became_active":"2024-09-13T06:09:40.168550+0000","last_became_peered":"2024-09-13T06:09:40.168550+0000","last_unstale":"2024-09-13T06:13:26.401325+0000","last_undegraded":"2024-09-13T06:13:26.401325+0000","last_fullsized":"2024-09-13T06:13:26.401325+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:26.401059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:26.401059+0000","last_clean_scrub_stamp":"2024-09-13T06:13:26.401059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:03:36.749162+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"35'14","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:24.907423+0000","last_change":"2024-09-13T06:14:24.907423+0000","last_active":"2024-09-13T06:14:24.907423+0000","last_peered":"2024-09-13T06:14:24.907423+0000","last_clean":"2024-09-13T06:14:24.907423+0000","last_became_active":"2024-09-13T06:09:42.211508+0000","last_became_peered":"2024-09-13T06:09:42.211508+0000","last_unstale":"2024-09-13T06:14:24.907423+0000","last_undegraded":"2024-09-13T06:14:24.907423+0000","last_fullsized":"2024-09-13T06:14:24.907423+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'14","last_scrub_stamp":"2024-09-13T06:14:24.907133+0000","last_deep_scrub":"35'14","last_deep_scrub_stamp":"2024-09-13T06:14:24.907133+0000","last_clean_scrub_stamp":"2024-09-13T06:14:24.907133+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:17:17.358604+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"35'8","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:53.158421+0000","last_change":"2024-09-13T06:13:53.158479+0000","last_active":"2024-09-13T06:13:53.158421+0000","last_peered":"2024-09-13T06:13:53.158421+0000","last_clean":"2024-09-13T06:13:53.158421+0000","last_became_active":"2024-09-13T06:09:34.122881+0000","last_became_peered":"2024-09-13T06:09:34.122881+0000","last_unstale":"2024-09-13T06:13:53.158421+0000","last_undegraded":"2024-09-13T06:13:53.158421+0000","last_fullsized":"2024-09-13T06:13:53.158421+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-13T06:13:53.158235+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-13T06:13:53.158235+0000","last_clean_scrub_stamp":"2024-09-13T06:13:53.158235+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:27:12.571243+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":11,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:15.032945+0000","last_change":"2024-09-13T06:14:15.032945+0000","last_active":"2024-09-13T06:14:15.032945+0000","last_peered":"2024-09-13T06:14:15.032945+0000","last_clean":"2024-09-13T06:14:15.032945+0000","last_became_active":"2024-09-13T06:09:32.119573+0000","last_became_peered":"2024-09-13T06:09:32.119573+0000","last_unstale":"2024-09-13T06:14:15.032945+0000","last_undegraded":"2024-09-13T06:14:15.032945+0000","last_fullsized":"2024-09-13T06:14:15.032945+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:15.032656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:15.032656+0000","last_clean_scrub_stamp":"2024-09-13T06:14:15.032656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:03:32.007047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:45.482486+0000","last_change":"2024-09-13T06:13:45.482486+0000","last_active":"2024-09-13T06:13:45.482486+0000","last_peered":"2024-09-13T06:13:45.482486+0000","last_clean":"2024-09-13T06:13:45.482486+0000","last_became_active":"2024-09-13T06:09:36.127719+0000","last_became_peered":"2024-09-13T06:09:36.127719+0000","last_unstale":"2024-09-13T06:13:45.482486+0000","last_undegraded":"2024-09-13T06:13:45.482486+0000","last_fullsized":"2024-09-13T06:13:45.482486+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:45.482236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:45.482236+0000","last_clean_scrub_stamp":"2024-09-13T06:13:45.482236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:48:41.351667+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"35'46","reported_seq":105,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:43.807814+0000","last_change":"2024-09-13T06:13:43.807814+0000","last_active":"2024-09-13T06:13:43.807814+0000","last_peered":"2024-09-13T06:13:43.807814+0000","last_clean":"2024-09-13T06:13:43.807814+0000","last_became_active":"2024-09-13T06:09:38.175443+0000","last_became_peered":"2024-09-13T06:09:38.175443+0000","last_unstale":"2024-09-13T06:13:43.807814+0000","last_undegraded":"2024-09-13T06:13:43.807814+0000","last_fullsized":"2024-09-13T06:13:43.807814+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'46","last_scrub_stamp":"2024-09-13T06:13:43.807524+0000","last_deep_scrub":"35'46","last_deep_scrub_stamp":"2024-09-13T06:13:43.807524+0000","last_clean_scrub_stamp":"2024-09-13T06:13:43.807524+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:18:40.372988+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:45.156776+0000","last_change":"2024-09-13T06:13:45.156776+0000","last_active":"2024-09-13T06:13:45.156776+0000","last_peered":"2024-09-13T06:13:45.156776+0000","last_clean":"2024-09-13T06:13:45.156776+0000","last_became_active":"2024-09-13T06:09:40.185222+0000","last_became_peered":"2024-09-13T06:09:40.185222+0000","last_unstale":"2024-09-13T06:13:45.156776+0000","last_undegraded":"2024-09-13T06:13:45.156776+0000","last_fullsized":"2024-09-13T06:13:45.156776+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:45.156528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:45.156528+0000","last_clean_scrub_stamp":"2024-09-13T06:13:45.156528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:58:23.506441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:07.968141+0000","last_change":"2024-09-13T06:14:07.968141+0000","last_active":"2024-09-13T06:14:07.968141+0000","last_peered":"2024-09-13T06:14:07.968141+0000","last_clean":"2024-09-13T06:14:07.968141+0000","last_became_active":"2024-09-13T06:09:42.196679+0000","last_became_peered":"2024-09-13T06:09:42.196679+0000","last_unstale":"2024-09-13T06:14:07.968141+0000","last_undegraded":"2024-09-13T06:14:07.968141+0000","last_fullsized":"2024-09-13T06:14:07.968141+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:07.967902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:07.967902+0000","last_clean_scrub_stamp":"2024-09-13T06:14:07.967902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:59:50.642710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"35'16","reported_seq":87,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:38.804245+0000","last_change":"2024-09-13T06:13:38.804245+0000","last_active":"2024-09-13T06:13:38.804245+0000","last_peered":"2024-09-13T06:13:38.804245+0000","last_clean":"2024-09-13T06:13:38.804245+0000","last_became_active":"2024-09-13T06:09:34.132777+0000","last_became_peered":"2024-09-13T06:09:34.132777+0000","last_unstale":"2024-09-13T06:13:38.804245+0000","last_undegraded":"2024-09-13T06:13:38.804245+0000","last_fullsized":"2024-09-13T06:13:38.804245+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'16","last_scrub_stamp":"2024-09-13T06:13:38.803976+0000","last_deep_scrub":"35'16","last_deep_scrub_stamp":"2024-09-13T06:13:38.803976+0000","last_clean_scrub_stamp":"2024-09-13T06:13:38.803976+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:52:39.806244+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":57,"num_read_kb":53,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:13.111219+0000","last_change":"2024-09-13T06:14:13.111219+0000","last_active":"2024-09-13T06:14:13.111219+0000","last_peered":"2024-09-13T06:14:13.111219+0000","last_clean":"2024-09-13T06:14:13.111219+0000","last_became_active":"2024-09-13T06:09:32.117988+0000","last_became_peered":"2024-09-13T06:09:32.117988+0000","last_unstale":"2024-09-13T06:14:13.111219+0000","last_undegraded":"2024-09-13T06:14:13.111219+0000","last_fullsized":"2024-09-13T06:14:13.111219+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:13.110979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:13.110979+0000","last_clean_scrub_stamp":"2024-09-13T06:14:13.110979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:11:49.833063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:43.472981+0000","last_change":"2024-09-13T06:13:43.472981+0000","last_active":"2024-09-13T06:13:43.472981+0000","last_peered":"2024-09-13T06:13:43.472981+0000","last_clean":"2024-09-13T06:13:43.472981+0000","last_became_active":"2024-09-13T06:09:36.129471+0000","last_became_peered":"2024-09-13T06:09:36.129471+0000","last_unstale":"2024-09-13T06:13:43.472981+0000","last_undegraded":"2024-09-13T06:13:43.472981+0000","last_fullsized":"2024-09-13T06:13:43.472981+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:43.472711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:43.472711+0000","last_clean_scrub_stamp":"2024-09-13T06:13:43.472711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:48:39.465341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"35'41","reported_seq":98,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:35.293684+0000","last_change":"2024-09-13T06:13:35.293684+0000","last_active":"2024-09-13T06:13:35.293684+0000","last_peered":"2024-09-13T06:13:35.293684+0000","last_clean":"2024-09-13T06:13:35.293684+0000","last_became_active":"2024-09-13T06:09:38.153433+0000","last_became_peered":"2024-09-13T06:09:38.153433+0000","last_unstale":"2024-09-13T06:13:35.293684+0000","last_undegraded":"2024-09-13T06:13:35.293684+0000","last_fullsized":"2024-09-13T06:13:35.293684+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'41","last_scrub_stamp":"2024-09-13T06:13:35.293395+0000","last_deep_scrub":"35'41","last_deep_scrub_stamp":"2024-09-13T06:13:35.293395+0000","last_clean_scrub_stamp":"2024-09-13T06:13:35.293395+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:48:31.286025+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":55,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:29.307769+0000","last_change":"2024-09-13T06:13:29.307769+0000","last_active":"2024-09-13T06:13:29.307769+0000","last_peered":"2024-09-13T06:13:29.307769+0000","last_clean":"2024-09-13T06:13:29.307769+0000","last_became_active":"2024-09-13T06:09:40.171455+0000","last_became_peered":"2024-09-13T06:09:40.171455+0000","last_unstale":"2024-09-13T06:13:29.307769+0000","last_undegraded":"2024-09-13T06:13:29.307769+0000","last_fullsized":"2024-09-13T06:13:29.307769+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:29.307405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:29.307405+0000","last_clean_scrub_stamp":"2024-09-13T06:13:29.307405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:02:21.851168+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"35'5","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:42.824642+0000","last_change":"2024-09-13T06:14:42.824805+0000","last_active":"2024-09-13T06:14:42.824642+0000","last_peered":"2024-09-13T06:14:42.824642+0000","last_clean":"2024-09-13T06:14:42.824642+0000","last_became_active":"2024-09-13T06:09:42.202004+0000","last_became_peered":"2024-09-13T06:09:42.202004+0000","last_unstale":"2024-09-13T06:14:42.824642+0000","last_undegraded":"2024-09-13T06:14:42.824642+0000","last_fullsized":"2024-09-13T06:14:42.824642+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'5","last_scrub_stamp":"2024-09-13T06:14:42.824405+0000","last_deep_scrub":"35'5","last_deep_scrub_stamp":"2024-09-13T06:14:42.824405+0000","last_clean_scrub_stamp":"2024-09-13T06:14:42.824405+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:13:47.173550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:04.027730+0000","last_change":"2024-09-13T06:14:04.027730+0000","last_active":"2024-09-13T06:14:04.027730+0000","last_peered":"2024-09-13T06:14:04.027730+0000","last_clean":"2024-09-13T06:14:04.027730+0000","last_became_active":"2024-09-13T06:09:34.116197+0000","last_became_peered":"2024-09-13T06:09:34.116197+0000","last_unstale":"2024-09-13T06:14:04.027730+0000","last_undegraded":"2024-09-13T06:14:04.027730+0000","last_fullsized":"2024-09-13T06:14:04.027730+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:04.027357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:04.027357+0000","last_clean_scrub_stamp":"2024-09-13T06:14:04.027357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:41:38.144650+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"35'2","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:19.870843+0000","last_change":"2024-09-13T06:14:19.870843+0000","last_active":"2024-09-13T06:14:19.870843+0000","last_peered":"2024-09-13T06:14:19.870843+0000","last_clean":"2024-09-13T06:14:19.870843+0000","last_became_active":"2024-09-13T06:09:32.124989+0000","last_became_peered":"2024-09-13T06:09:32.124989+0000","last_unstale":"2024-09-13T06:14:19.870843+0000","last_undegraded":"2024-09-13T06:14:19.870843+0000","last_fullsized":"2024-09-13T06:14:19.870843+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:19.870574+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:19.870574+0000","last_clean_scrub_stamp":"2024-09-13T06:14:19.870574+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:59:55.637777+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:36.119188+0000","last_change":"2024-09-13T06:13:36.119188+0000","last_active":"2024-09-13T06:13:36.119188+0000","last_peered":"2024-09-13T06:13:36.119188+0000","last_clean":"2024-09-13T06:13:36.119188+0000","last_became_active":"2024-09-13T06:09:36.140149+0000","last_became_peered":"2024-09-13T06:09:36.140149+0000","last_unstale":"2024-09-13T06:13:36.119188+0000","last_undegraded":"2024-09-13T06:13:36.119188+0000","last_fullsized":"2024-09-13T06:13:36.119188+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:36.118904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:36.118904+0000","last_clean_scrub_stamp":"2024-09-13T06:13:36.118904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:21:56.564481+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"35'15","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:50.851940+0000","last_change":"2024-09-13T06:13:50.852014+0000","last_active":"2024-09-13T06:13:50.851940+0000","last_peered":"2024-09-13T06:13:50.851940+0000","last_clean":"2024-09-13T06:13:50.851940+0000","last_became_active":"2024-09-13T06:09:38.177699+0000","last_became_peered":"2024-09-13T06:09:38.177699+0000","last_unstale":"2024-09-13T06:13:50.851940+0000","last_undegraded":"2024-09-13T06:13:50.851940+0000","last_fullsized":"2024-09-13T06:13:50.851940+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'15","last_scrub_stamp":"2024-09-13T06:13:50.851744+0000","last_deep_scrub":"35'15","last_deep_scrub_stamp":"2024-09-13T06:13:50.851744+0000","last_clean_scrub_stamp":"2024-09-13T06:13:50.851744+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:02:47.395746+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"35'285","reported_seq":384,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:29.354681+0000","last_change":"2024-09-13T06:13:29.354681+0000","last_active":"2024-09-13T06:13:29.354681+0000","last_peered":"2024-09-13T06:13:29.354681+0000","last_clean":"2024-09-13T06:13:29.354681+0000","last_became_active":"2024-09-13T06:09:40.166780+0000","last_became_peered":"2024-09-13T06:09:40.166780+0000","last_unstale":"2024-09-13T06:13:29.354681+0000","last_undegraded":"2024-09-13T06:13:29.354681+0000","last_fullsized":"2024-09-13T06:13:29.354681+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-13T06:13:29.354428+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-13T06:13:29.354428+0000","last_clean_scrub_stamp":"2024-09-13T06:13:29.354428+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:07:16.616986+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"35'2","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:11.928509+0000","last_change":"2024-09-13T06:14:11.928509+0000","last_active":"2024-09-13T06:14:11.928509+0000","last_peered":"2024-09-13T06:14:11.928509+0000","last_clean":"2024-09-13T06:14:11.928509+0000","last_became_active":"2024-09-13T06:09:42.196063+0000","last_became_peered":"2024-09-13T06:09:42.196063+0000","last_unstale":"2024-09-13T06:14:11.928509+0000","last_undegraded":"2024-09-13T06:14:11.928509+0000","last_fullsized":"2024-09-13T06:14:11.928509+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:11.928231+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:11.928231+0000","last_clean_scrub_stamp":"2024-09-13T06:14:11.928231+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:30:08.269153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"35'6","reported_seq":62,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:14.519190+0000","last_change":"2024-09-13T06:14:14.519190+0000","last_active":"2024-09-13T06:14:14.519190+0000","last_peered":"2024-09-13T06:14:14.519190+0000","last_clean":"2024-09-13T06:14:14.519190+0000","last_became_active":"2024-09-13T06:09:34.107821+0000","last_became_peered":"2024-09-13T06:09:34.107821+0000","last_unstale":"2024-09-13T06:14:14.519190+0000","last_undegraded":"2024-09-13T06:14:14.519190+0000","last_fullsized":"2024-09-13T06:14:14.519190+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:14:14.518930+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:14:14.518930+0000","last_clean_scrub_stamp":"2024-09-13T06:14:14.518930+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:53:21.672620+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"35'2","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:18.142644+0000","last_change":"2024-09-13T06:14:18.142644+0000","last_active":"2024-09-13T06:14:18.142644+0000","last_peered":"2024-09-13T06:14:18.142644+0000","last_clean":"2024-09-13T06:14:18.142644+0000","last_became_active":"2024-09-13T06:09:32.140816+0000","last_became_peered":"2024-09-13T06:09:32.140816+0000","last_unstale":"2024-09-13T06:14:18.142644+0000","last_undegraded":"2024-09-13T06:14:18.142644+0000","last_fullsized":"2024-09-13T06:14:18.142644+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:18.142373+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:18.142373+0000","last_clean_scrub_stamp":"2024-09-13T06:14:18.142373+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:55:56.126674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:34.100128+0000","last_change":"2024-09-13T06:13:34.100128+0000","last_active":"2024-09-13T06:13:34.100128+0000","last_peered":"2024-09-13T06:13:34.100128+0000","last_clean":"2024-09-13T06:13:34.100128+0000","last_became_active":"2024-09-13T06:09:36.140770+0000","last_became_peered":"2024-09-13T06:09:36.140770+0000","last_unstale":"2024-09-13T06:13:34.100128+0000","last_undegraded":"2024-09-13T06:13:34.100128+0000","last_fullsized":"2024-09-13T06:13:34.100128+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:34.099877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:34.099877+0000","last_clean_scrub_stamp":"2024-09-13T06:13:34.099877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:24:15.804560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"35'46","reported_seq":105,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.335732+0000","last_change":"2024-09-13T06:13:25.335732+0000","last_active":"2024-09-13T06:13:25.335732+0000","last_peered":"2024-09-13T06:13:25.335732+0000","last_clean":"2024-09-13T06:13:25.335732+0000","last_became_active":"2024-09-13T06:09:38.166681+0000","last_became_peered":"2024-09-13T06:09:38.166681+0000","last_unstale":"2024-09-13T06:13:25.335732+0000","last_undegraded":"2024-09-13T06:13:25.335732+0000","last_fullsized":"2024-09-13T06:13:25.335732+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'46","last_scrub_stamp":"2024-09-13T06:13:25.335323+0000","last_deep_scrub":"35'46","last_deep_scrub_stamp":"2024-09-13T06:13:25.335323+0000","last_clean_scrub_stamp":"2024-09-13T06:13:25.335323+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:32:30.737347+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:28.331392+0000","last_change":"2024-09-13T06:13:28.331392+0000","last_active":"2024-09-13T06:13:28.331392+0000","last_peered":"2024-09-13T06:13:28.331392+0000","last_clean":"2024-09-13T06:13:28.331392+0000","last_became_active":"2024-09-13T06:09:40.178484+0000","last_became_peered":"2024-09-13T06:09:40.178484+0000","last_unstale":"2024-09-13T06:13:28.331392+0000","last_undegraded":"2024-09-13T06:13:28.331392+0000","last_fullsized":"2024-09-13T06:13:28.331392+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:28.331050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:28.331050+0000","last_clean_scrub_stamp":"2024-09-13T06:13:28.331050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:53:24.217481+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"35'4","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:24.176941+0000","last_change":"2024-09-13T06:14:24.176941+0000","last_active":"2024-09-13T06:14:24.176941+0000","last_peered":"2024-09-13T06:14:24.176941+0000","last_clean":"2024-09-13T06:14:24.176941+0000","last_became_active":"2024-09-13T06:09:42.199609+0000","last_became_peered":"2024-09-13T06:09:42.199609+0000","last_unstale":"2024-09-13T06:14:24.176941+0000","last_undegraded":"2024-09-13T06:14:24.176941+0000","last_fullsized":"2024-09-13T06:14:24.176941+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:14:24.176488+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:14:24.176488+0000","last_clean_scrub_stamp":"2024-09-13T06:14:24.176488+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:48:56.031957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"35'6","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:51.506348+0000","last_change":"2024-09-13T06:13:51.506348+0000","last_active":"2024-09-13T06:13:51.506348+0000","last_peered":"2024-09-13T06:13:51.506348+0000","last_clean":"2024-09-13T06:13:51.506348+0000","last_became_active":"2024-09-13T06:09:34.100355+0000","last_became_peered":"2024-09-13T06:09:34.100355+0000","last_unstale":"2024-09-13T06:13:51.506348+0000","last_undegraded":"2024-09-13T06:13:51.506348+0000","last_fullsized":"2024-09-13T06:13:51.506348+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:13:51.505951+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:13:51.505951+0000","last_clean_scrub_stamp":"2024-09-13T06:13:51.505951+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:34:28.572463+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:23.886321+0000","last_change":"2024-09-13T06:14:23.886321+0000","last_active":"2024-09-13T06:14:23.886321+0000","last_peered":"2024-09-13T06:14:23.886321+0000","last_clean":"2024-09-13T06:14:23.886321+0000","last_became_active":"2024-09-13T06:09:32.125049+0000","last_became_peered":"2024-09-13T06:09:32.125049+0000","last_unstale":"2024-09-13T06:14:23.886321+0000","last_undegraded":"2024-09-13T06:14:23.886321+0000","last_fullsized":"2024-09-13T06:14:23.886321+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:23.885878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:23.885878+0000","last_clean_scrub_stamp":"2024-09-13T06:14:23.885878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:44:32.537280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:46.483155+0000","last_change":"2024-09-13T06:13:46.483155+0000","last_active":"2024-09-13T06:13:46.483155+0000","last_peered":"2024-09-13T06:13:46.483155+0000","last_clean":"2024-09-13T06:13:46.483155+0000","last_became_active":"2024-09-13T06:09:36.127684+0000","last_became_peered":"2024-09-13T06:09:36.127684+0000","last_unstale":"2024-09-13T06:13:46.483155+0000","last_undegraded":"2024-09-13T06:13:46.483155+0000","last_fullsized":"2024-09-13T06:13:46.483155+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:46.482894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:46.482894+0000","last_clean_scrub_stamp":"2024-09-13T06:13:46.482894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:09:00.981051+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"35'37","reported_seq":93,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:34.298450+0000","last_change":"2024-09-13T06:13:34.298450+0000","last_active":"2024-09-13T06:13:34.298450+0000","last_peered":"2024-09-13T06:13:34.298450+0000","last_clean":"2024-09-13T06:13:34.298450+0000","last_became_active":"2024-09-13T06:09:38.157278+0000","last_became_peered":"2024-09-13T06:09:38.157278+0000","last_unstale":"2024-09-13T06:13:34.298450+0000","last_undegraded":"2024-09-13T06:13:34.298450+0000","last_fullsized":"2024-09-13T06:13:34.298450+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'37","last_scrub_stamp":"2024-09-13T06:13:34.298176+0000","last_deep_scrub":"35'37","last_deep_scrub_stamp":"2024-09-13T06:13:34.298176+0000","last_clean_scrub_stamp":"2024-09-13T06:13:34.298176+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:13:34.885749+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:45.813575+0000","last_change":"2024-09-13T06:13:45.813575+0000","last_active":"2024-09-13T06:13:45.813575+0000","last_peered":"2024-09-13T06:13:45.813575+0000","last_clean":"2024-09-13T06:13:45.813575+0000","last_became_active":"2024-09-13T06:09:40.189165+0000","last_became_peered":"2024-09-13T06:09:40.189165+0000","last_unstale":"2024-09-13T06:13:45.813575+0000","last_undegraded":"2024-09-13T06:13:45.813575+0000","last_fullsized":"2024-09-13T06:13:45.813575+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:45.813202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:45.813202+0000","last_clean_scrub_stamp":"2024-09-13T06:13:45.813202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:32:50.595240+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":19,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.443321+0000","last_change":"2024-09-13T06:09:42.214239+0000","last_active":"2024-09-13T06:13:25.443321+0000","last_peered":"2024-09-13T06:13:25.443321+0000","last_clean":"2024-09-13T06:13:25.443321+0000","last_became_active":"2024-09-13T06:09:42.213756+0000","last_became_peered":"2024-09-13T06:09:42.213756+0000","last_unstale":"2024-09-13T06:13:25.443321+0000","last_undegraded":"2024-09-13T06:13:25.443321+0000","last_fullsized":"2024-09-13T06:13:25.443321+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:09.970812+0000","last_change":"2024-09-13T06:14:09.970812+0000","last_active":"2024-09-13T06:14:09.970812+0000","last_peered":"2024-09-13T06:14:09.970812+0000","last_clean":"2024-09-13T06:14:09.970812+0000","last_became_active":"2024-09-13T06:09:34.117789+0000","last_became_peered":"2024-09-13T06:09:34.117789+0000","last_unstale":"2024-09-13T06:14:09.970812+0000","last_undegraded":"2024-09-13T06:14:09.970812+0000","last_fullsized":"2024-09-13T06:14:09.970812+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:09.970560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:09.970560+0000","last_clean_scrub_stamp":"2024-09-13T06:14:09.970560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:43:49.285414+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:12.973494+0000","last_change":"2024-09-13T06:14:12.973611+0000","last_active":"2024-09-13T06:14:12.973494+0000","last_peered":"2024-09-13T06:14:12.973494+0000","last_clean":"2024-09-13T06:14:12.973494+0000","last_became_active":"2024-09-13T06:09:32.134696+0000","last_became_peered":"2024-09-13T06:09:32.134696+0000","last_unstale":"2024-09-13T06:14:12.973494+0000","last_undegraded":"2024-09-13T06:14:12.973494+0000","last_fullsized":"2024-09-13T06:14:12.973494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:12.973262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:12.973262+0000","last_clean_scrub_stamp":"2024-09-13T06:14:12.973262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:06:43.525067+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:42.137375+0000","last_change":"2024-09-13T06:13:42.137375+0000","last_active":"2024-09-13T06:13:42.137375+0000","last_peered":"2024-09-13T06:13:42.137375+0000","last_clean":"2024-09-13T06:13:42.137375+0000","last_became_active":"2024-09-13T06:09:36.131976+0000","last_became_peered":"2024-09-13T06:09:36.131976+0000","last_unstale":"2024-09-13T06:13:42.137375+0000","last_undegraded":"2024-09-13T06:13:42.137375+0000","last_fullsized":"2024-09-13T06:13:42.137375+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:42.137148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:42.137148+0000","last_clean_scrub_stamp":"2024-09-13T06:13:42.137148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:12:22.095929+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"35'30","reported_seq":84,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:37.757650+0000","last_change":"2024-09-13T06:13:37.757650+0000","last_active":"2024-09-13T06:13:37.757650+0000","last_peered":"2024-09-13T06:13:37.757650+0000","last_clean":"2024-09-13T06:13:37.757650+0000","last_became_active":"2024-09-13T06:09:38.171538+0000","last_became_peered":"2024-09-13T06:09:38.171538+0000","last_unstale":"2024-09-13T06:13:37.757650+0000","last_undegraded":"2024-09-13T06:13:37.757650+0000","last_fullsized":"2024-09-13T06:13:37.757650+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'30","last_scrub_stamp":"2024-09-13T06:13:37.757382+0000","last_deep_scrub":"35'30","last_deep_scrub_stamp":"2024-09-13T06:13:37.757382+0000","last_clean_scrub_stamp":"2024-09-13T06:13:37.757382+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:21:11.687429+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:48.836037+0000","last_change":"2024-09-13T06:13:48.836037+0000","last_active":"2024-09-13T06:13:48.836037+0000","last_peered":"2024-09-13T06:13:48.836037+0000","last_clean":"2024-09-13T06:13:48.836037+0000","last_became_active":"2024-09-13T06:09:40.185277+0000","last_became_peered":"2024-09-13T06:09:40.185277+0000","last_unstale":"2024-09-13T06:13:48.836037+0000","last_undegraded":"2024-09-13T06:13:48.836037+0000","last_fullsized":"2024-09-13T06:13:48.836037+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:48.835791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:48.835791+0000","last_clean_scrub_stamp":"2024-09-13T06:13:48.835791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:03:05.810181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"35'6","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.443244+0000","last_change":"2024-09-13T06:09:42.211802+0000","last_active":"2024-09-13T06:13:25.443244+0000","last_peered":"2024-09-13T06:13:25.443244+0000","last_clean":"2024-09-13T06:13:25.443244+0000","last_became_active":"2024-09-13T06:09:42.211176+0000","last_became_peered":"2024-09-13T06:09:42.211176+0000","last_unstale":"2024-09-13T06:13:25.443244+0000","last_undegraded":"2024-09-13T06:13:25.443244+0000","last_fullsized":"2024-09-13T06:13:25.443244+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"35'8","reported_seq":66,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:04.458704+0000","last_change":"2024-09-13T06:14:04.458704+0000","last_active":"2024-09-13T06:14:04.458704+0000","last_peered":"2024-09-13T06:14:04.458704+0000","last_clean":"2024-09-13T06:14:04.458704+0000","last_became_active":"2024-09-13T06:09:34.105494+0000","last_became_peered":"2024-09-13T06:09:34.105494+0000","last_unstale":"2024-09-13T06:14:04.458704+0000","last_undegraded":"2024-09-13T06:14:04.458704+0000","last_fullsized":"2024-09-13T06:14:04.458704+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-13T06:14:04.458293+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-13T06:14:04.458293+0000","last_clean_scrub_stamp":"2024-09-13T06:14:04.458293+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:48:21.210581+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"35'2","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:02.083459+0000","last_change":"2024-09-13T06:14:02.083524+0000","last_active":"2024-09-13T06:14:02.083459+0000","last_peered":"2024-09-13T06:14:02.083459+0000","last_clean":"2024-09-13T06:14:02.083459+0000","last_became_active":"2024-09-13T06:09:32.142726+0000","last_became_peered":"2024-09-13T06:09:32.142726+0000","last_unstale":"2024-09-13T06:14:02.083459+0000","last_undegraded":"2024-09-13T06:14:02.083459+0000","last_fullsized":"2024-09-13T06:14:02.083459+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:02.083238+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:02.083238+0000","last_clean_scrub_stamp":"2024-09-13T06:14:02.083238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:00:06.559987+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"35'3","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:39.117641+0000","last_change":"2024-09-13T06:13:39.117641+0000","last_active":"2024-09-13T06:13:39.117641+0000","last_peered":"2024-09-13T06:13:39.117641+0000","last_clean":"2024-09-13T06:13:39.117641+0000","last_became_active":"2024-09-13T06:09:36.136792+0000","last_became_peered":"2024-09-13T06:09:36.136792+0000","last_unstale":"2024-09-13T06:13:39.117641+0000","last_undegraded":"2024-09-13T06:13:39.117641+0000","last_fullsized":"2024-09-13T06:13:39.117641+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3","last_scrub_stamp":"2024-09-13T06:13:39.117394+0000","last_deep_scrub":"35'3","last_deep_scrub_stamp":"2024-09-13T06:13:39.117394+0000","last_clean_scrub_stamp":"2024-09-13T06:13:39.117394+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:34:55.196548+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"35'39","reported_seq":97,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:29.877565+0000","last_change":"2024-09-13T06:13:29.877565+0000","last_active":"2024-09-13T06:13:29.877565+0000","last_peered":"2024-09-13T06:13:29.877565+0000","last_clean":"2024-09-13T06:13:29.877565+0000","last_became_active":"2024-09-13T06:09:38.166333+0000","last_became_peered":"2024-09-13T06:09:38.166333+0000","last_unstale":"2024-09-13T06:13:29.877565+0000","last_undegraded":"2024-09-13T06:13:29.877565+0000","last_fullsized":"2024-09-13T06:13:29.877565+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'39","last_scrub_stamp":"2024-09-13T06:13:29.877300+0000","last_deep_scrub":"35'39","last_deep_scrub_stamp":"2024-09-13T06:13:29.877300+0000","last_clean_scrub_stamp":"2024-09-13T06:13:29.877300+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:40:12.627053+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:36.323280+0000","last_change":"2024-09-13T06:13:36.323280+0000","last_active":"2024-09-13T06:13:36.323280+0000","last_peered":"2024-09-13T06:13:36.323280+0000","last_clean":"2024-09-13T06:13:36.323280+0000","last_became_active":"2024-09-13T06:09:40.178392+0000","last_became_peered":"2024-09-13T06:09:40.178392+0000","last_unstale":"2024-09-13T06:13:36.323280+0000","last_undegraded":"2024-09-13T06:13:36.323280+0000","last_fullsized":"2024-09-13T06:13:36.323280+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:36.323029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:36.323029+0000","last_clean_scrub_stamp":"2024-09-13T06:13:36.323029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:56:23.983741+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"35'8","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.443209+0000","last_change":"2024-09-13T06:09:42.214258+0000","last_active":"2024-09-13T06:13:25.443209+0000","last_peered":"2024-09-13T06:13:25.443209+0000","last_clean":"2024-09-13T06:13:25.443209+0000","last_became_active":"2024-09-13T06:09:42.213809+0000","last_became_peered":"2024-09-13T06:09:42.213809+0000","last_unstale":"2024-09-13T06:13:25.443209+0000","last_undegraded":"2024-09-13T06:13:25.443209+0000","last_fullsized":"2024-09-13T06:13:25.443209+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:09:41.138027+0000","last_clean_scrub_stamp":"2024-09-13T06:09:41.138027+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"35'6","reported_seq":83,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:47.104386+0000","last_change":"2024-09-13T06:13:47.104386+0000","last_active":"2024-09-13T06:13:47.104386+0000","last_peered":"2024-09-13T06:13:47.104386+0000","last_clean":"2024-09-13T06:13:47.104386+0000","last_became_active":"2024-09-13T06:09:34.124044+0000","last_became_peered":"2024-09-13T06:09:34.124044+0000","last_unstale":"2024-09-13T06:13:47.104386+0000","last_undegraded":"2024-09-13T06:13:47.104386+0000","last_fullsized":"2024-09-13T06:13:47.104386+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:13:47.104098+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:13:47.104098+0000","last_clean_scrub_stamp":"2024-09-13T06:13:47.104098+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:28:40.579321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:05.457710+0000","last_change":"2024-09-13T06:14:05.457846+0000","last_active":"2024-09-13T06:14:05.457710+0000","last_peered":"2024-09-13T06:14:05.457710+0000","last_clean":"2024-09-13T06:14:05.457710+0000","last_became_active":"2024-09-13T06:09:32.133972+0000","last_became_peered":"2024-09-13T06:09:32.133972+0000","last_unstale":"2024-09-13T06:14:05.457710+0000","last_undegraded":"2024-09-13T06:14:05.457710+0000","last_fullsized":"2024-09-13T06:14:05.457710+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:05.457422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:05.457422+0000","last_clean_scrub_stamp":"2024-09-13T06:14:05.457422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:46:40.297521+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"35'12","reported_seq":71,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:54.184427+0000","last_change":"2024-09-13T06:13:54.184427+0000","last_active":"2024-09-13T06:13:54.184427+0000","last_peered":"2024-09-13T06:13:54.184427+0000","last_clean":"2024-09-13T06:13:54.184427+0000","last_became_active":"2024-09-13T06:09:34.112805+0000","last_became_peered":"2024-09-13T06:09:34.112805+0000","last_unstale":"2024-09-13T06:13:54.184427+0000","last_undegraded":"2024-09-13T06:13:54.184427+0000","last_fullsized":"2024-09-13T06:13:54.184427+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'12","last_scrub_stamp":"2024-09-13T06:13:54.184142+0000","last_deep_scrub":"35'12","last_deep_scrub_stamp":"2024-09-13T06:13:54.184142+0000","last_clean_scrub_stamp":"2024-09-13T06:13:54.184142+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:51:20.968060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:08.975226+0000","last_change":"2024-09-13T06:14:08.975415+0000","last_active":"2024-09-13T06:14:08.975226+0000","last_peered":"2024-09-13T06:14:08.975226+0000","last_clean":"2024-09-13T06:14:08.975226+0000","last_became_active":"2024-09-13T06:09:32.145941+0000","last_became_peered":"2024-09-13T06:09:32.145941+0000","last_unstale":"2024-09-13T06:14:08.975226+0000","last_undegraded":"2024-09-13T06:14:08.975226+0000","last_fullsized":"2024-09-13T06:14:08.975226+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:08.974987+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:08.974987+0000","last_clean_scrub_stamp":"2024-09-13T06:14:08.974987+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:47:49.396587+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"35'10","reported_seq":82,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:04.932958+0000","last_change":"2024-09-13T06:14:04.933134+0000","last_active":"2024-09-13T06:14:04.932958+0000","last_peered":"2024-09-13T06:14:04.932958+0000","last_clean":"2024-09-13T06:14:04.932958+0000","last_became_active":"2024-09-13T06:09:34.118325+0000","last_became_peered":"2024-09-13T06:09:34.118325+0000","last_unstale":"2024-09-13T06:14:04.932958+0000","last_undegraded":"2024-09-13T06:14:04.932958+0000","last_fullsized":"2024-09-13T06:14:04.932958+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-09-13T06:14:04.932682+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-09-13T06:14:04.932682+0000","last_clean_scrub_stamp":"2024-09-13T06:14:04.932682+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:01:08.869470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"35'2","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:14.902552+0000","last_change":"2024-09-13T06:14:14.902614+0000","last_active":"2024-09-13T06:14:14.902552+0000","last_peered":"2024-09-13T06:14:14.902552+0000","last_clean":"2024-09-13T06:14:14.902552+0000","last_became_active":"2024-09-13T06:09:32.133230+0000","last_became_peered":"2024-09-13T06:09:32.133230+0000","last_unstale":"2024-09-13T06:14:14.902552+0000","last_undegraded":"2024-09-13T06:14:14.902552+0000","last_fullsized":"2024-09-13T06:14:14.902552+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:14.902345+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:14.902345+0000","last_clean_scrub_stamp":"2024-09-13T06:14:14.902345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:14:42.826299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"35'4","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:05.970204+0000","last_change":"2024-09-13T06:14:05.970361+0000","last_active":"2024-09-13T06:14:05.970204+0000","last_peered":"2024-09-13T06:14:05.970204+0000","last_clean":"2024-09-13T06:14:05.970204+0000","last_became_active":"2024-09-13T06:09:34.115512+0000","last_became_peered":"2024-09-13T06:09:34.115512+0000","last_unstale":"2024-09-13T06:14:05.970204+0000","last_undegraded":"2024-09-13T06:14:05.970204+0000","last_fullsized":"2024-09-13T06:14:05.970204+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:14:05.969984+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:14:05.969984+0000","last_clean_scrub_stamp":"2024-09-13T06:14:05.969984+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:15:46.339756+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"35'2","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:55.188916+0000","last_change":"2024-09-13T06:13:55.188996+0000","last_active":"2024-09-13T06:13:55.188916+0000","last_peered":"2024-09-13T06:13:55.188916+0000","last_clean":"2024-09-13T06:13:55.188916+0000","last_became_active":"2024-09-13T06:09:32.150328+0000","last_became_peered":"2024-09-13T06:09:32.150328+0000","last_unstale":"2024-09-13T06:13:55.188916+0000","last_undegraded":"2024-09-13T06:13:55.188916+0000","last_fullsized":"2024-09-13T06:13:55.188916+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:13:55.188727+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:13:55.188727+0000","last_clean_scrub_stamp":"2024-09-13T06:13:55.188727+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:42:47.449646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"35'12","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:58.146481+0000","last_change":"2024-09-13T06:13:58.146634+0000","last_active":"2024-09-13T06:13:58.146481+0000","last_peered":"2024-09-13T06:13:58.146481+0000","last_clean":"2024-09-13T06:13:58.146481+0000","last_became_active":"2024-09-13T06:09:34.113986+0000","last_became_peered":"2024-09-13T06:09:34.113986+0000","last_unstale":"2024-09-13T06:13:58.146481+0000","last_undegraded":"2024-09-13T06:13:58.146481+0000","last_fullsized":"2024-09-13T06:13:58.146481+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'12","last_scrub_stamp":"2024-09-13T06:13:58.146265+0000","last_deep_scrub":"35'12","last_deep_scrub_stamp":"2024-09-13T06:13:58.146265+0000","last_clean_scrub_stamp":"2024-09-13T06:13:58.146265+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:51:22.340040+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:13.944371+0000","last_change":"2024-09-13T06:14:13.944480+0000","last_active":"2024-09-13T06:14:13.944371+0000","last_peered":"2024-09-13T06:14:13.944371+0000","last_clean":"2024-09-13T06:14:13.944371+0000","last_became_active":"2024-09-13T06:09:32.136268+0000","last_became_peered":"2024-09-13T06:09:32.136268+0000","last_unstale":"2024-09-13T06:14:13.944371+0000","last_undegraded":"2024-09-13T06:14:13.944371+0000","last_fullsized":"2024-09-13T06:14:13.944371+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:13.944088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:13.944088+0000","last_clean_scrub_stamp":"2024-09-13T06:14:13.944088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:44:54.412744+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"35'4","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:19.128998+0000","last_change":"2024-09-13T06:14:19.129062+0000","last_active":"2024-09-13T06:14:19.128998+0000","last_peered":"2024-09-13T06:14:19.128998+0000","last_clean":"2024-09-13T06:14:19.128998+0000","last_became_active":"2024-09-13T06:09:34.121261+0000","last_became_peered":"2024-09-13T06:09:34.121261+0000","last_unstale":"2024-09-13T06:14:19.128998+0000","last_undegraded":"2024-09-13T06:14:19.128998+0000","last_fullsized":"2024-09-13T06:14:19.128998+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:14:19.128789+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:14:19.128789+0000","last_clean_scrub_stamp":"2024-09-13T06:14:19.128789+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:05:27.992700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:08.105829+0000","last_change":"2024-09-13T06:14:08.105893+0000","last_active":"2024-09-13T06:14:08.105829+0000","last_peered":"2024-09-13T06:14:08.105829+0000","last_clean":"2024-09-13T06:14:08.105829+0000","last_became_active":"2024-09-13T06:09:32.141602+0000","last_became_peered":"2024-09-13T06:09:32.141602+0000","last_unstale":"2024-09-13T06:14:08.105829+0000","last_undegraded":"2024-09-13T06:14:08.105829+0000","last_fullsized":"2024-09-13T06:14:08.105829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:08.105610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:08.105610+0000","last_clean_scrub_stamp":"2024-09-13T06:14:08.105610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:19:46.183614+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"35'6","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:18.072373+0000","last_change":"2024-09-13T06:14:18.072506+0000","last_active":"2024-09-13T06:14:18.072373+0000","last_peered":"2024-09-13T06:14:18.072373+0000","last_clean":"2024-09-13T06:14:18.072373+0000","last_became_active":"2024-09-13T06:09:34.122424+0000","last_became_peered":"2024-09-13T06:09:34.122424+0000","last_unstale":"2024-09-13T06:14:18.072373+0000","last_undegraded":"2024-09-13T06:14:18.072373+0000","last_fullsized":"2024-09-13T06:14:18.072373+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:14:18.072146+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:14:18.072146+0000","last_clean_scrub_stamp":"2024-09-13T06:14:18.072146+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:09:59.488966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:11.491383+0000","last_change":"2024-09-13T06:14:11.491442+0000","last_active":"2024-09-13T06:14:11.491383+0000","last_peered":"2024-09-13T06:14:11.491383+0000","last_clean":"2024-09-13T06:14:11.491383+0000","last_became_active":"2024-09-13T06:09:32.119665+0000","last_became_peered":"2024-09-13T06:09:32.119665+0000","last_unstale":"2024-09-13T06:14:11.491383+0000","last_undegraded":"2024-09-13T06:14:11.491383+0000","last_fullsized":"2024-09-13T06:14:11.491383+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:11.491173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:11.491173+0000","last_clean_scrub_stamp":"2024-09-13T06:14:11.491173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:27:39.464448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"35'10","reported_seq":68,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:07.156771+0000","last_change":"2024-09-13T06:14:07.156840+0000","last_active":"2024-09-13T06:14:07.156771+0000","last_peered":"2024-09-13T06:14:07.156771+0000","last_clean":"2024-09-13T06:14:07.156771+0000","last_became_active":"2024-09-13T06:09:34.114378+0000","last_became_peered":"2024-09-13T06:09:34.114378+0000","last_unstale":"2024-09-13T06:14:07.156771+0000","last_undegraded":"2024-09-13T06:14:07.156771+0000","last_fullsized":"2024-09-13T06:14:07.156771+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-09-13T06:14:07.156555+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-09-13T06:14:07.156555+0000","last_clean_scrub_stamp":"2024-09-13T06:14:07.156555+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:56:33.412136+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"35'4","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:15.998938+0000","last_change":"2024-09-13T06:14:15.999004+0000","last_active":"2024-09-13T06:14:15.998938+0000","last_peered":"2024-09-13T06:14:15.998938+0000","last_clean":"2024-09-13T06:14:15.998938+0000","last_became_active":"2024-09-13T06:09:32.146011+0000","last_became_peered":"2024-09-13T06:09:32.146011+0000","last_unstale":"2024-09-13T06:14:15.998938+0000","last_undegraded":"2024-09-13T06:14:15.998938+0000","last_fullsized":"2024-09-13T06:14:15.998938+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:14:15.998743+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:14:15.998743+0000","last_clean_scrub_stamp":"2024-09-13T06:14:15.998743+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:57:13.676423+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"35'2","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:01.041151+0000","last_change":"2024-09-13T06:14:01.041151+0000","last_active":"2024-09-13T06:14:01.041151+0000","last_peered":"2024-09-13T06:14:01.041151+0000","last_clean":"2024-09-13T06:14:01.041151+0000","last_became_active":"2024-09-13T06:09:34.117659+0000","last_became_peered":"2024-09-13T06:09:34.117659+0000","last_unstale":"2024-09-13T06:14:01.041151+0000","last_undegraded":"2024-09-13T06:14:01.041151+0000","last_fullsized":"2024-09-13T06:14:01.041151+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:01.040862+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:01.040862+0000","last_clean_scrub_stamp":"2024-09-13T06:14:01.040862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:24:05.707493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"35'2","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:38.822673+0000","last_change":"2024-09-13T06:14:38.822741+0000","last_active":"2024-09-13T06:14:38.822673+0000","last_peered":"2024-09-13T06:14:38.822673+0000","last_clean":"2024-09-13T06:14:38.822673+0000","last_became_active":"2024-09-13T06:09:32.121250+0000","last_became_peered":"2024-09-13T06:09:32.121250+0000","last_unstale":"2024-09-13T06:14:38.822673+0000","last_undegraded":"2024-09-13T06:14:38.822673+0000","last_fullsized":"2024-09-13T06:14:38.822673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:38.822439+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:38.822439+0000","last_clean_scrub_stamp":"2024-09-13T06:14:38.822439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:33:31.596195+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"35'6","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:08.927366+0000","last_change":"2024-09-13T06:14:08.927366+0000","last_active":"2024-09-13T06:14:08.927366+0000","last_peered":"2024-09-13T06:14:08.927366+0000","last_clean":"2024-09-13T06:14:08.927366+0000","last_became_active":"2024-09-13T06:09:34.118270+0000","last_became_peered":"2024-09-13T06:09:34.118270+0000","last_unstale":"2024-09-13T06:14:08.927366+0000","last_undegraded":"2024-09-13T06:14:08.927366+0000","last_fullsized":"2024-09-13T06:14:08.927366+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:14:08.926982+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:14:08.926982+0000","last_clean_scrub_stamp":"2024-09-13T06:14:08.926982+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:32:51.698999+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:07.008210+0000","last_change":"2024-09-13T06:14:07.008276+0000","last_active":"2024-09-13T06:14:07.008210+0000","last_peered":"2024-09-13T06:14:07.008210+0000","last_clean":"2024-09-13T06:14:07.008210+0000","last_became_active":"2024-09-13T06:09:32.145988+0000","last_became_peered":"2024-09-13T06:09:32.145988+0000","last_unstale":"2024-09-13T06:14:07.008210+0000","last_undegraded":"2024-09-13T06:14:07.008210+0000","last_fullsized":"2024-09-13T06:14:07.008210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:07.008017+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:07.008017+0000","last_clean_scrub_stamp":"2024-09-13T06:14:07.008017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:52:30.109612+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"33'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:07.967599+0000","last_change":"2024-09-13T06:14:07.967667+0000","last_active":"2024-09-13T06:14:07.967599+0000","last_peered":"2024-09-13T06:14:07.967599+0000","last_clean":"2024-09-13T06:14:07.967599+0000","last_became_active":"2024-09-13T06:09:34.117320+0000","last_became_peered":"2024-09-13T06:09:34.117320+0000","last_unstale":"2024-09-13T06:14:07.967599+0000","last_undegraded":"2024-09-13T06:14:07.967599+0000","last_fullsized":"2024-09-13T06:14:07.967599+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T06:14:07.967409+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T06:14:07.967409+0000","last_clean_scrub_stamp":"2024-09-13T06:14:07.967409+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:23:37.518274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:10.151581+0000","last_change":"2024-09-13T06:14:10.151647+0000","last_active":"2024-09-13T06:14:10.151581+0000","last_peered":"2024-09-13T06:14:10.151581+0000","last_clean":"2024-09-13T06:14:10.151581+0000","last_became_active":"2024-09-13T06:09:32.141009+0000","last_became_peered":"2024-09-13T06:09:32.141009+0000","last_unstale":"2024-09-13T06:14:10.151581+0000","last_undegraded":"2024-09-13T06:14:10.151581+0000","last_fullsized":"2024-09-13T06:14:10.151581+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:10.151382+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:10.151382+0000","last_clean_scrub_stamp":"2024-09-13T06:14:10.151382+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:48:46.322553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"35'12","reported_seq":92,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:50.099644+0000","last_change":"2024-09-13T06:13:50.099644+0000","last_active":"2024-09-13T06:13:50.099644+0000","last_peered":"2024-09-13T06:13:50.099644+0000","last_clean":"2024-09-13T06:13:50.099644+0000","last_became_active":"2024-09-13T06:09:34.124270+0000","last_became_peered":"2024-09-13T06:09:34.124270+0000","last_unstale":"2024-09-13T06:13:50.099644+0000","last_undegraded":"2024-09-13T06:13:50.099644+0000","last_fullsized":"2024-09-13T06:13:50.099644+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'12","last_scrub_stamp":"2024-09-13T06:13:50.099391+0000","last_deep_scrub":"35'12","last_deep_scrub_stamp":"2024-09-13T06:13:50.099391+0000","last_clean_scrub_stamp":"2024-09-13T06:13:50.099391+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:45:17.171613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"35'2","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:06.105644+0000","last_change":"2024-09-13T06:14:06.105715+0000","last_active":"2024-09-13T06:14:06.105644+0000","last_peered":"2024-09-13T06:14:06.105644+0000","last_clean":"2024-09-13T06:14:06.105644+0000","last_became_active":"2024-09-13T06:09:32.142581+0000","last_became_peered":"2024-09-13T06:09:32.142581+0000","last_unstale":"2024-09-13T06:14:06.105644+0000","last_undegraded":"2024-09-13T06:14:06.105644+0000","last_fullsized":"2024-09-13T06:14:06.105644+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:06.105415+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:06.105415+0000","last_clean_scrub_stamp":"2024-09-13T06:14:06.105415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:14:58.354875+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"35'16","reported_seq":86,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:57.087154+0000","last_change":"2024-09-13T06:13:57.087154+0000","last_active":"2024-09-13T06:13:57.087154+0000","last_peered":"2024-09-13T06:13:57.087154+0000","last_clean":"2024-09-13T06:13:57.087154+0000","last_became_active":"2024-09-13T06:09:34.118290+0000","last_became_peered":"2024-09-13T06:09:34.118290+0000","last_unstale":"2024-09-13T06:13:57.087154+0000","last_undegraded":"2024-09-13T06:13:57.087154+0000","last_fullsized":"2024-09-13T06:13:57.087154+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'16","last_scrub_stamp":"2024-09-13T06:13:57.086869+0000","last_deep_scrub":"35'16","last_deep_scrub_stamp":"2024-09-13T06:13:57.086869+0000","last_clean_scrub_stamp":"2024-09-13T06:13:57.086869+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:49:34.359420+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":58,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:40.825386+0000","last_change":"2024-09-13T06:14:40.825445+0000","last_active":"2024-09-13T06:14:40.825386+0000","last_peered":"2024-09-13T06:14:40.825386+0000","last_clean":"2024-09-13T06:14:40.825386+0000","last_became_active":"2024-09-13T06:09:32.121400+0000","last_became_peered":"2024-09-13T06:09:32.121400+0000","last_unstale":"2024-09-13T06:14:40.825386+0000","last_undegraded":"2024-09-13T06:14:40.825386+0000","last_fullsized":"2024-09-13T06:14:40.825386+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:40.825185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:40.825185+0000","last_clean_scrub_stamp":"2024-09-13T06:14:40.825185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:35:38.074006+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"35'14","reported_seq":83,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:51.115078+0000","last_change":"2024-09-13T06:13:51.115078+0000","last_active":"2024-09-13T06:13:51.115078+0000","last_peered":"2024-09-13T06:13:51.115078+0000","last_clean":"2024-09-13T06:13:51.115078+0000","last_became_active":"2024-09-13T06:09:34.121743+0000","last_became_peered":"2024-09-13T06:09:34.121743+0000","last_unstale":"2024-09-13T06:13:51.115078+0000","last_undegraded":"2024-09-13T06:13:51.115078+0000","last_fullsized":"2024-09-13T06:13:51.115078+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'14","last_scrub_stamp":"2024-09-13T06:13:51.114821+0000","last_deep_scrub":"35'14","last_deep_scrub_stamp":"2024-09-13T06:13:51.114821+0000","last_clean_scrub_stamp":"2024-09-13T06:13:51.114821+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:13:09.983207+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"35'2","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:27.822613+0000","last_change":"2024-09-13T06:14:27.822750+0000","last_active":"2024-09-13T06:14:27.822613+0000","last_peered":"2024-09-13T06:14:27.822613+0000","last_clean":"2024-09-13T06:14:27.822613+0000","last_became_active":"2024-09-13T06:09:32.127830+0000","last_became_peered":"2024-09-13T06:09:32.127830+0000","last_unstale":"2024-09-13T06:14:27.822613+0000","last_undegraded":"2024-09-13T06:14:27.822613+0000","last_fullsized":"2024-09-13T06:14:27.822613+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:27.822361+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:27.822361+0000","last_clean_scrub_stamp":"2024-09-13T06:14:27.822361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:22:21.878003+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"35'4","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:57.956132+0000","last_change":"2024-09-13T06:13:57.956132+0000","last_active":"2024-09-13T06:13:57.956132+0000","last_peered":"2024-09-13T06:13:57.956132+0000","last_clean":"2024-09-13T06:13:57.956132+0000","last_became_active":"2024-09-13T06:09:34.126020+0000","last_became_peered":"2024-09-13T06:09:34.126020+0000","last_unstale":"2024-09-13T06:13:57.956132+0000","last_undegraded":"2024-09-13T06:13:57.956132+0000","last_fullsized":"2024-09-13T06:13:57.956132+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:13:57.955748+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:13:57.955748+0000","last_clean_scrub_stamp":"2024-09-13T06:13:57.955748+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:48:29.811216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:10.525305+0000","last_change":"2024-09-13T06:14:10.525305+0000","last_active":"2024-09-13T06:14:10.525305+0000","last_peered":"2024-09-13T06:14:10.525305+0000","last_clean":"2024-09-13T06:14:10.525305+0000","last_became_active":"2024-09-13T06:09:32.119542+0000","last_became_peered":"2024-09-13T06:09:32.119542+0000","last_unstale":"2024-09-13T06:14:10.525305+0000","last_undegraded":"2024-09-13T06:14:10.525305+0000","last_fullsized":"2024-09-13T06:14:10.525305+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:10.524864+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:10.524864+0000","last_clean_scrub_stamp":"2024-09-13T06:14:10.524864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:24:35.781954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"35'6","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:59.089157+0000","last_change":"2024-09-13T06:13:59.089218+0000","last_active":"2024-09-13T06:13:59.089157+0000","last_peered":"2024-09-13T06:13:59.089157+0000","last_clean":"2024-09-13T06:13:59.089157+0000","last_became_active":"2024-09-13T06:09:34.110506+0000","last_became_peered":"2024-09-13T06:09:34.110506+0000","last_unstale":"2024-09-13T06:13:59.089157+0000","last_undegraded":"2024-09-13T06:13:59.089157+0000","last_fullsized":"2024-09-13T06:13:59.089157+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:13:59.088967+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:13:59.088967+0000","last_clean_scrub_stamp":"2024-09-13T06:13:59.088967+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:47:06.868835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:24.898869+0000","last_change":"2024-09-13T06:14:24.898931+0000","last_active":"2024-09-13T06:14:24.898869+0000","last_peered":"2024-09-13T06:14:24.898869+0000","last_clean":"2024-09-13T06:14:24.898869+0000","last_became_active":"2024-09-13T06:09:32.121895+0000","last_became_peered":"2024-09-13T06:09:32.121895+0000","last_unstale":"2024-09-13T06:14:24.898869+0000","last_undegraded":"2024-09-13T06:14:24.898869+0000","last_fullsized":"2024-09-13T06:14:24.898869+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:24.898655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:24.898655+0000","last_clean_scrub_stamp":"2024-09-13T06:14:24.898655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:00:29.891000+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:17.885220+0000","last_change":"2024-09-13T06:14:17.885278+0000","last_active":"2024-09-13T06:14:17.885220+0000","last_peered":"2024-09-13T06:14:17.885220+0000","last_clean":"2024-09-13T06:14:17.885220+0000","last_became_active":"2024-09-13T06:09:32.130056+0000","last_became_peered":"2024-09-13T06:09:32.130056+0000","last_unstale":"2024-09-13T06:14:17.885220+0000","last_undegraded":"2024-09-13T06:14:17.885220+0000","last_fullsized":"2024-09-13T06:14:17.885220+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:17.885008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:17.885008+0000","last_clean_scrub_stamp":"2024-09-13T06:14:17.885008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:43:49.653431+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"35'8","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:50.089510+0000","last_change":"2024-09-13T06:13:50.089510+0000","last_active":"2024-09-13T06:13:50.089510+0000","last_peered":"2024-09-13T06:13:50.089510+0000","last_clean":"2024-09-13T06:13:50.089510+0000","last_became_active":"2024-09-13T06:09:34.130980+0000","last_became_peered":"2024-09-13T06:09:34.130980+0000","last_unstale":"2024-09-13T06:13:50.089510+0000","last_undegraded":"2024-09-13T06:13:50.089510+0000","last_fullsized":"2024-09-13T06:13:50.089510+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-13T06:13:50.089259+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-13T06:13:50.089259+0000","last_clean_scrub_stamp":"2024-09-13T06:13:50.089259+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:04:38.003620+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"33'2","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:01.059413+0000","last_change":"2024-09-13T06:14:01.059413+0000","last_active":"2024-09-13T06:14:01.059413+0000","last_peered":"2024-09-13T06:14:01.059413+0000","last_clean":"2024-09-13T06:14:01.059413+0000","last_became_active":"2024-09-13T06:09:32.149426+0000","last_became_peered":"2024-09-13T06:09:32.149426+0000","last_unstale":"2024-09-13T06:14:01.059413+0000","last_undegraded":"2024-09-13T06:14:01.059413+0000","last_fullsized":"2024-09-13T06:14:01.059413+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T06:14:01.059140+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T06:14:01.059140+0000","last_clean_scrub_stamp":"2024-09-13T06:14:01.059140+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:11:35.487998+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"35'4","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:03.116819+0000","last_change":"2024-09-13T06:14:03.116819+0000","last_active":"2024-09-13T06:14:03.116819+0000","last_peered":"2024-09-13T06:14:03.116819+0000","last_clean":"2024-09-13T06:14:03.116819+0000","last_became_active":"2024-09-13T06:09:34.111230+0000","last_became_peered":"2024-09-13T06:09:34.111230+0000","last_unstale":"2024-09-13T06:14:03.116819+0000","last_undegraded":"2024-09-13T06:14:03.116819+0000","last_fullsized":"2024-09-13T06:14:03.116819+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:14:03.116583+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:14:03.116583+0000","last_clean_scrub_stamp":"2024-09-13T06:14:03.116583+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:05:21.374929+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":277,"ondisk_log_size":277,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2281,"ondisk_log_size":2281,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1530,"ondisk_log_size":1530,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1618,"num_read_kb":1508,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640326,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39984,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331856,"statfs":{"total":96636764160,"available":96595820544,"internally_reserved":0,"allocated":491520,"data_stored":155427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640326,"num_pgs":155,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40524,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331316,"statfs":{"total":96636764160,"available":96595267584,"internally_reserved":0,"allocated":1044480,"data_stored":743705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673030,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40500,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331340,"statfs":{"total":96636764160,"available":96595292160,"internally_reserved":0,"allocated":1019904,"data_stored":743361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705732,"num_pgs":170,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39952,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331888,"statfs":{"total":96636764160,"available":96595853312,"internally_reserved":0,"allocated":458752,"data_stored":154423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T06:14:47.422 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-13T06:09:35.087004+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=35, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:47.423 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:47.424 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:47.424 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:47.424 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:47.425 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-13T06:09:41.138027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=9, tm_sec=41, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=13, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:14:47.425 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T06:15:07.426 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T06:15:07.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.555+0000 7f5b7c145640 1 Processor -- start 2024-09-13T06:15:07.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.555+0000 7f5b7c145640 1 -- start start 2024-09-13T06:15:07.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.559+0000 7f5b7c145640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f5b7406d0e0 0x7f5b7406d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:15:07.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.559+0000 7f5b7c145640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b74071c10 con 0x7f5b7406da00 2024-09-13T06:15:07.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.559+0000 7f5b7c145640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f5b74072230 con 0x7f5b7406d0e0 2024-09-13T06:15:07.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.559+0000 7f5b79ee1640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f5b7406d0e0 0x7f5b7406d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:15:07.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.559+0000 7f5b79ee1640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f5b7406d0e0 0x7f5b7406d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34124/0 (socket says 172.21.15.120:34124) 2024-09-13T06:15:07.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.559+0000 7f5b79ee1640 1 -- 172.21.15.120:0/1186271671 learned_addr learned my addr 172.21.15.120:0/1186271671 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-13T06:15:07.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.559+0000 7f5b796e0640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f5b7406da00 0x7f5b7412ca10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:46240/0 (socket says 172.21.15.120:46240) 2024-09-13T06:15:07.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.559+0000 7f5b79ee1640 1 -- 172.21.15.120:0/1186271671 >> v1:172.21.15.120:6789/0 conn(0x7f5b7406da00 legacy=0x7f5b7412ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:15:07.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.559+0000 7f5b79ee1640 1 -- 172.21.15.120:0/1186271671 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b740709e0 con 0x7f5b7406d0e0 2024-09-13T06:15:07.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.559+0000 7f5b79ee1640 1 --2- 172.21.15.120:0/1186271671 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b7406d0e0 0x7f5b7406d4c0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f5b640097f0 tx=0x7f5b6401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f15174927036739 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:15:07.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.559+0000 7f5b78edf640 1 -- 172.21.15.120:0/1186271671 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b640b0070 con 0x7f5b7406d0e0 2024-09-13T06:15:07.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.559+0000 7f5b78edf640 1 -- 172.21.15.120:0/1186271671 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b640ab530 con 0x7f5b7406d0e0 2024-09-13T06:15:07.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.559+0000 7f5b78edf640 1 -- 172.21.15.120:0/1186271671 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b640ab830 con 0x7f5b7406d0e0 2024-09-13T06:15:07.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.563+0000 7f5b7c145640 1 -- 172.21.15.120:0/1186271671 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b7406d0e0 msgr2=0x7f5b7406d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:15:07.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.563+0000 7f5b7c145640 1 --2- 172.21.15.120:0/1186271671 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b7406d0e0 0x7f5b7406d4c0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f5b640097f0 tx=0x7f5b6401c430 comp rx=0 tx=0).stop 2024-09-13T06:15:07.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.563+0000 7f5b7c145640 1 -- 172.21.15.120:0/1186271671 shutdown_connections 2024-09-13T06:15:07.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.563+0000 7f5b7c145640 1 --2- 172.21.15.120:0/1186271671 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b7406d0e0 0x7f5b7406d4c0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:15:07.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.563+0000 7f5b7c145640 1 -- 172.21.15.120:0/1186271671 >> 172.21.15.120:0/1186271671 conn(0x7f5b74099a50 msgr2=0x7f5b740972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:15:07.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.563+0000 7f5b7c145640 1 -- 172.21.15.120:0/1186271671 shutdown_connections 2024-09-13T06:15:07.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.563+0000 7f5b7c145640 1 -- 172.21.15.120:0/1186271671 wait complete. 2024-09-13T06:15:07.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.563+0000 7f5b7c145640 1 Processor -- start 2024-09-13T06:15:07.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.563+0000 7f5b7c145640 1 -- start start 2024-09-13T06:15:07.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.563+0000 7f5b7c145640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b7406d0e0 0x7f5b74128c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:15:07.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.563+0000 7f5b7c145640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f5b74134e80 con 0x7f5b7406d0e0 2024-09-13T06:15:07.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.563+0000 7f5b79ee1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b7406d0e0 0x7f5b74128c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:15:07.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.563+0000 7f5b79ee1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b7406d0e0 0x7f5b74128c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34136/0 (socket says 172.21.15.120:34136) 2024-09-13T06:15:07.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.563+0000 7f5b79ee1640 1 -- 172.21.15.120:0/3546172667 learned_addr learned my addr 172.21.15.120:0/3546172667 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-13T06:15:07.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.563+0000 7f5b79ee1640 1 -- 172.21.15.120:0/3546172667 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b7412a3a0 con 0x7f5b7406d0e0 2024-09-13T06:15:07.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.563+0000 7f5b79ee1640 1 --2- 172.21.15.120:0/3546172667 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b7406d0e0 0x7f5b74128c50 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f5b6401a060 tx=0x7f5b6401ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:15:07.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.563+0000 7f5b6a7fc640 1 -- 172.21.15.120:0/3546172667 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b640ba020 con 0x7f5b7406d0e0 2024-09-13T06:15:07.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.563+0000 7f5b6a7fc640 1 -- 172.21.15.120:0/3546172667 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b640b6420 con 0x7f5b7406d0e0 2024-09-13T06:15:07.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.563+0000 7f5b6a7fc640 1 -- 172.21.15.120:0/3546172667 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b640b0040 con 0x7f5b7406d0e0 2024-09-13T06:15:07.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.563+0000 7f5b7c145640 1 -- 172.21.15.120:0/3546172667 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b7412b010 con 0x7f5b7406d0e0 2024-09-13T06:15:07.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.563+0000 7f5b7c145640 1 -- 172.21.15.120:0/3546172667 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b7412b6a0 con 0x7f5b7406d0e0 2024-09-13T06:15:07.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.563+0000 7f5b6a7fc640 1 -- 172.21.15.120:0/3546172667 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5b640bd020 con 0x7f5b7406d0e0 2024-09-13T06:15:07.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.563+0000 7f5b7c145640 1 -- 172.21.15.120:0/3546172667 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b7406d4c0 con 0x7f5b7406d0e0 2024-09-13T06:15:07.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.563+0000 7f5b6a7fc640 1 --2- 172.21.15.120:0/3546172667 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f5b58035db0 0x7f5b58038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:15:07.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.563+0000 7f5b6a7fc640 1 -- 172.21.15.120:0/3546172667 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7f5b640e34b0 con 0x7f5b7406d0e0 2024-09-13T06:15:07.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.567+0000 7f5b796e0640 1 --2- 172.21.15.120:0/3546172667 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f5b58035db0 0x7f5b58038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:15:07.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.567+0000 7f5b796e0640 1 --2- 172.21.15.120:0/3546172667 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f5b58035db0 0x7f5b58038270 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5b70001600 tx=0x7f5b70007a50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:15:07.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.571+0000 7f5b6a7fc640 1 -- 172.21.15.120:0/3546172667 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5b640c4030 con 0x7f5b7406d0e0 2024-09-13T06:15:07.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.723+0000 7f5b7c145640 1 -- 172.21.15.120:0/3546172667 --> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5b74073790 con 0x7f5b58035db0 2024-09-13T06:15:07.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.767+0000 7f5b6a7fc640 1 -- 172.21.15.120:0/3546172667 <== mgr.4100 v2:172.21.15.194:6824/3475680902 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666459 (secure 0 0 0) 0x7f5b74073790 con 0x7f5b58035db0 2024-09-13T06:15:07.772 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-13T06:15:07.780 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-09-13T06:15:07.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.775+0000 7f5b7c145640 1 -- 172.21.15.120:0/3546172667 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f5b58035db0 msgr2=0x7f5b58038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:15:07.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.775+0000 7f5b7c145640 1 --2- 172.21.15.120:0/3546172667 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f5b58035db0 0x7f5b58038270 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5b70001600 tx=0x7f5b70007a50 comp rx=0 tx=0).stop 2024-09-13T06:15:07.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.775+0000 7f5b7c145640 1 -- 172.21.15.120:0/3546172667 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b7406d0e0 msgr2=0x7f5b74128c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:15:07.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.775+0000 7f5b7c145640 1 --2- 172.21.15.120:0/3546172667 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b7406d0e0 0x7f5b74128c50 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f5b6401a060 tx=0x7f5b6401ac70 comp rx=0 tx=0).stop 2024-09-13T06:15:07.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.775+0000 7f5b7c145640 1 -- 172.21.15.120:0/3546172667 shutdown_connections 2024-09-13T06:15:07.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.775+0000 7f5b7c145640 1 --2- 172.21.15.120:0/3546172667 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7f5b58035db0 0x7f5b58038270 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:15:07.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.775+0000 7f5b7c145640 1 --2- 172.21.15.120:0/3546172667 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5b7406d0e0 0x7f5b74128c50 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:15:07.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.775+0000 7f5b7c145640 1 -- 172.21.15.120:0/3546172667 >> 172.21.15.120:0/3546172667 conn(0x7f5b74099a50 msgr2=0x7f5b741b9f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:15:07.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.775+0000 7f5b7c145640 1 -- 172.21.15.120:0/3546172667 shutdown_connections 2024-09-13T06:15:07.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.775+0000 7f5b7c145640 1 -- 172.21.15.120:0/3546172667 wait complete. 2024-09-13T06:15:07.796 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":207,"stamp":"2024-09-13T06:15:05.877806+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605402,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5108,"num_read_kb":4689,"num_write":2181,"num_write_kb":61376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3041,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4798,"ondisk_log_size":4798,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":160960,"kb_used_data":2944,"kb_used_omap":6,"kb_used_meta":157945,"kb_avail":377326400,"statfs":{"total":386547056640,"available":386382233600,"internally_reserved":0,"allocated":3014656,"data_stored":1796916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":161736470},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006545"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:53.451160+0000","last_change":"2024-09-13T06:13:53.451223+0000","last_active":"2024-09-13T06:13:53.451160+0000","last_peered":"2024-09-13T06:13:53.451160+0000","last_clean":"2024-09-13T06:13:53.451160+0000","last_became_active":"2024-09-13T06:09:32.140025+0000","last_became_peered":"2024-09-13T06:09:32.140025+0000","last_unstale":"2024-09-13T06:13:53.451160+0000","last_undegraded":"2024-09-13T06:13:53.451160+0000","last_fullsized":"2024-09-13T06:13:53.451160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:53.450946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:53.450946+0000","last_clean_scrub_stamp":"2024-09-13T06:13:53.450946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:05:48.880319+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"35'22","reported_seq":104,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:48.092625+0000","last_change":"2024-09-13T06:13:48.092625+0000","last_active":"2024-09-13T06:13:48.092625+0000","last_peered":"2024-09-13T06:13:48.092625+0000","last_clean":"2024-09-13T06:13:48.092625+0000","last_became_active":"2024-09-13T06:09:34.122656+0000","last_became_peered":"2024-09-13T06:09:34.122656+0000","last_unstale":"2024-09-13T06:13:48.092625+0000","last_undegraded":"2024-09-13T06:13:48.092625+0000","last_fullsized":"2024-09-13T06:13:48.092625+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'22","last_scrub_stamp":"2024-09-13T06:13:48.092347+0000","last_deep_scrub":"35'22","last_deep_scrub_stamp":"2024-09-13T06:13:48.092347+0000","last_clean_scrub_stamp":"2024-09-13T06:13:48.092347+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:02:26.113000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":88,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:11.954244+0000","last_change":"2024-09-13T06:14:11.954310+0000","last_active":"2024-09-13T06:14:11.954244+0000","last_peered":"2024-09-13T06:14:11.954244+0000","last_clean":"2024-09-13T06:14:11.954244+0000","last_became_active":"2024-09-13T06:09:32.134020+0000","last_became_peered":"2024-09-13T06:09:32.134020+0000","last_unstale":"2024-09-13T06:14:11.954244+0000","last_undegraded":"2024-09-13T06:14:11.954244+0000","last_fullsized":"2024-09-13T06:14:11.954244+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:11.954043+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:11.954043+0000","last_clean_scrub_stamp":"2024-09-13T06:14:11.954043+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:29:30.352540+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"35'4","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:10.944002+0000","last_change":"2024-09-13T06:14:10.944002+0000","last_active":"2024-09-13T06:14:10.944002+0000","last_peered":"2024-09-13T06:14:10.944002+0000","last_clean":"2024-09-13T06:14:10.944002+0000","last_became_active":"2024-09-13T06:09:34.116715+0000","last_became_peered":"2024-09-13T06:09:34.116715+0000","last_unstale":"2024-09-13T06:14:10.944002+0000","last_undegraded":"2024-09-13T06:14:10.944002+0000","last_fullsized":"2024-09-13T06:14:10.944002+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:14:10.943755+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:14:10.943755+0000","last_clean_scrub_stamp":"2024-09-13T06:14:10.943755+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:12:11.377459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:20.881767+0000","last_change":"2024-09-13T06:14:20.881823+0000","last_active":"2024-09-13T06:14:20.881767+0000","last_peered":"2024-09-13T06:14:20.881767+0000","last_clean":"2024-09-13T06:14:20.881767+0000","last_became_active":"2024-09-13T06:09:32.116345+0000","last_became_peered":"2024-09-13T06:09:32.116345+0000","last_unstale":"2024-09-13T06:14:20.881767+0000","last_undegraded":"2024-09-13T06:14:20.881767+0000","last_fullsized":"2024-09-13T06:14:20.881767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:20.881557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:20.881557+0000","last_clean_scrub_stamp":"2024-09-13T06:14:20.881557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:27:51.720278+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:05.961088+0000","last_change":"2024-09-13T06:14:05.961088+0000","last_active":"2024-09-13T06:14:05.961088+0000","last_peered":"2024-09-13T06:14:05.961088+0000","last_clean":"2024-09-13T06:14:05.961088+0000","last_became_active":"2024-09-13T06:09:34.117940+0000","last_became_peered":"2024-09-13T06:09:34.117940+0000","last_unstale":"2024-09-13T06:14:05.961088+0000","last_undegraded":"2024-09-13T06:14:05.961088+0000","last_fullsized":"2024-09-13T06:14:05.961088+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:05.960824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:05.960824+0000","last_clean_scrub_stamp":"2024-09-13T06:14:05.960824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:39:07.314473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"35'4","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:12.529051+0000","last_change":"2024-09-13T06:14:12.529209+0000","last_active":"2024-09-13T06:14:12.529051+0000","last_peered":"2024-09-13T06:14:12.529051+0000","last_clean":"2024-09-13T06:14:12.529051+0000","last_became_active":"2024-09-13T06:09:32.119806+0000","last_became_peered":"2024-09-13T06:09:32.119806+0000","last_unstale":"2024-09-13T06:14:12.529051+0000","last_undegraded":"2024-09-13T06:14:12.529051+0000","last_fullsized":"2024-09-13T06:14:12.529051+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:14:12.528786+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:14:12.528786+0000","last_clean_scrub_stamp":"2024-09-13T06:14:12.528786+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:22:18.082137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"35'4","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:58.946209+0000","last_change":"2024-09-13T06:13:58.946209+0000","last_active":"2024-09-13T06:13:58.946209+0000","last_peered":"2024-09-13T06:13:58.946209+0000","last_clean":"2024-09-13T06:13:58.946209+0000","last_became_active":"2024-09-13T06:09:34.122631+0000","last_became_peered":"2024-09-13T06:09:34.122631+0000","last_unstale":"2024-09-13T06:13:58.946209+0000","last_undegraded":"2024-09-13T06:13:58.946209+0000","last_fullsized":"2024-09-13T06:13:58.946209+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:13:58.945955+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:13:58.945955+0000","last_clean_scrub_stamp":"2024-09-13T06:13:58.945955+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:33:44.383904+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:22.921170+0000","last_change":"2024-09-13T06:14:22.921170+0000","last_active":"2024-09-13T06:14:22.921170+0000","last_peered":"2024-09-13T06:14:22.921170+0000","last_clean":"2024-09-13T06:14:22.921170+0000","last_became_active":"2024-09-13T06:09:32.121803+0000","last_became_peered":"2024-09-13T06:09:32.121803+0000","last_unstale":"2024-09-13T06:14:22.921170+0000","last_undegraded":"2024-09-13T06:14:22.921170+0000","last_fullsized":"2024-09-13T06:14:22.921170+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:22.920848+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:22.920848+0000","last_clean_scrub_stamp":"2024-09-13T06:14:22.920848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:57:03.440588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"35'4","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:44.126938+0000","last_change":"2024-09-13T06:13:44.126999+0000","last_active":"2024-09-13T06:13:44.126938+0000","last_peered":"2024-09-13T06:13:44.126938+0000","last_clean":"2024-09-13T06:13:44.126938+0000","last_became_active":"2024-09-13T06:09:34.124728+0000","last_became_peered":"2024-09-13T06:09:34.124728+0000","last_unstale":"2024-09-13T06:13:44.126938+0000","last_undegraded":"2024-09-13T06:13:44.126938+0000","last_fullsized":"2024-09-13T06:13:44.126938+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:13:44.126745+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:13:44.126745+0000","last_clean_scrub_stamp":"2024-09-13T06:13:44.126745+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:34:05.312578+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"35'2","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:07.443616+0000","last_change":"2024-09-13T06:14:07.443616+0000","last_active":"2024-09-13T06:14:07.443616+0000","last_peered":"2024-09-13T06:14:07.443616+0000","last_clean":"2024-09-13T06:14:07.443616+0000","last_became_active":"2024-09-13T06:09:32.116422+0000","last_became_peered":"2024-09-13T06:09:32.116422+0000","last_unstale":"2024-09-13T06:14:07.443616+0000","last_undegraded":"2024-09-13T06:14:07.443616+0000","last_fullsized":"2024-09-13T06:14:07.443616+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:07.443341+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:07.443341+0000","last_clean_scrub_stamp":"2024-09-13T06:14:07.443341+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:11:06.667675+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"35'4","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:20.637599+0000","last_change":"2024-09-13T06:14:20.637599+0000","last_active":"2024-09-13T06:14:20.637599+0000","last_peered":"2024-09-13T06:14:20.637599+0000","last_clean":"2024-09-13T06:14:20.637599+0000","last_became_active":"2024-09-13T06:10:10.810259+0000","last_became_peered":"2024-09-13T06:10:10.810259+0000","last_unstale":"2024-09-13T06:14:20.637599+0000","last_undegraded":"2024-09-13T06:14:20.637599+0000","last_fullsized":"2024-09-13T06:14:20.637599+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:14:20.637249+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:14:20.637249+0000","last_clean_scrub_stamp":"2024-09-13T06:14:20.637249+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:03:50.413388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"35'4","reported_seq":60,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:26.863750+0000","last_change":"2024-09-13T06:14:26.863750+0000","last_active":"2024-09-13T06:14:26.863750+0000","last_peered":"2024-09-13T06:14:26.863750+0000","last_clean":"2024-09-13T06:14:26.863750+0000","last_became_active":"2024-09-13T06:09:32.122126+0000","last_became_peered":"2024-09-13T06:09:32.122126+0000","last_unstale":"2024-09-13T06:14:26.863750+0000","last_undegraded":"2024-09-13T06:14:26.863750+0000","last_fullsized":"2024-09-13T06:14:26.863750+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:14:26.863467+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:14:26.863467+0000","last_clean_scrub_stamp":"2024-09-13T06:14:26.863467+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:15:47.344721+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"35'10","reported_seq":69,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:49.549277+0000","last_change":"2024-09-13T06:13:49.549338+0000","last_active":"2024-09-13T06:13:49.549277+0000","last_peered":"2024-09-13T06:13:49.549277+0000","last_clean":"2024-09-13T06:13:49.549277+0000","last_became_active":"2024-09-13T06:09:34.120349+0000","last_became_peered":"2024-09-13T06:09:34.120349+0000","last_unstale":"2024-09-13T06:13:49.549277+0000","last_undegraded":"2024-09-13T06:13:49.549277+0000","last_fullsized":"2024-09-13T06:13:49.549277+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-09-13T06:13:49.549086+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-09-13T06:13:49.549086+0000","last_clean_scrub_stamp":"2024-09-13T06:13:49.549086+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:30:16.740460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:17.036924+0000","last_change":"2024-09-13T06:14:17.036924+0000","last_active":"2024-09-13T06:14:17.036924+0000","last_peered":"2024-09-13T06:14:17.036924+0000","last_clean":"2024-09-13T06:14:17.036924+0000","last_became_active":"2024-09-13T06:09:32.147504+0000","last_became_peered":"2024-09-13T06:09:32.147504+0000","last_unstale":"2024-09-13T06:14:17.036924+0000","last_undegraded":"2024-09-13T06:14:17.036924+0000","last_fullsized":"2024-09-13T06:14:17.036924+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:17.036578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:17.036578+0000","last_clean_scrub_stamp":"2024-09-13T06:14:17.036578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:53:37.209513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"35'10","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:56.394555+0000","last_change":"2024-09-13T06:13:56.394630+0000","last_active":"2024-09-13T06:13:56.394555+0000","last_peered":"2024-09-13T06:13:56.394555+0000","last_clean":"2024-09-13T06:13:56.394555+0000","last_became_active":"2024-09-13T06:09:34.104043+0000","last_became_peered":"2024-09-13T06:09:34.104043+0000","last_unstale":"2024-09-13T06:13:56.394555+0000","last_undegraded":"2024-09-13T06:13:56.394555+0000","last_fullsized":"2024-09-13T06:13:56.394555+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-09-13T06:13:56.394368+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-09-13T06:13:56.394368+0000","last_clean_scrub_stamp":"2024-09-13T06:13:56.394368+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:12:03.883275+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"35'4","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:12.918343+0000","last_change":"2024-09-13T06:14:12.918343+0000","last_active":"2024-09-13T06:14:12.918343+0000","last_peered":"2024-09-13T06:14:12.918343+0000","last_clean":"2024-09-13T06:14:12.918343+0000","last_became_active":"2024-09-13T06:09:34.116359+0000","last_became_peered":"2024-09-13T06:09:34.116359+0000","last_unstale":"2024-09-13T06:14:12.918343+0000","last_undegraded":"2024-09-13T06:14:12.918343+0000","last_fullsized":"2024-09-13T06:14:12.918343+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:14:12.918090+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:14:12.918090+0000","last_clean_scrub_stamp":"2024-09-13T06:14:12.918090+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:33:11.288623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"35'2","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:17.109420+0000","last_change":"2024-09-13T06:14:17.109420+0000","last_active":"2024-09-13T06:14:17.109420+0000","last_peered":"2024-09-13T06:14:17.109420+0000","last_clean":"2024-09-13T06:14:17.109420+0000","last_became_active":"2024-09-13T06:09:32.134667+0000","last_became_peered":"2024-09-13T06:09:32.134667+0000","last_unstale":"2024-09-13T06:14:17.109420+0000","last_undegraded":"2024-09-13T06:14:17.109420+0000","last_fullsized":"2024-09-13T06:14:17.109420+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:17.108958+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:17.108958+0000","last_clean_scrub_stamp":"2024-09-13T06:14:17.108958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:24:40.185482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"35'18","reported_seq":70,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:55.152233+0000","last_change":"2024-09-13T06:13:55.152233+0000","last_active":"2024-09-13T06:13:55.152233+0000","last_peered":"2024-09-13T06:13:55.152233+0000","last_clean":"2024-09-13T06:13:55.152233+0000","last_became_active":"2024-09-13T06:09:34.115348+0000","last_became_peered":"2024-09-13T06:09:34.115348+0000","last_unstale":"2024-09-13T06:13:55.152233+0000","last_undegraded":"2024-09-13T06:13:55.152233+0000","last_fullsized":"2024-09-13T06:13:55.152233+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'18","last_scrub_stamp":"2024-09-13T06:13:55.151980+0000","last_deep_scrub":"35'18","last_deep_scrub_stamp":"2024-09-13T06:13:55.151980+0000","last_clean_scrub_stamp":"2024-09-13T06:13:55.151980+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:13:13.639419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":45,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:03.432130+0000","last_change":"2024-09-13T06:14:03.432130+0000","last_active":"2024-09-13T06:14:03.432130+0000","last_peered":"2024-09-13T06:14:03.432130+0000","last_clean":"2024-09-13T06:14:03.432130+0000","last_became_active":"2024-09-13T06:09:32.135460+0000","last_became_peered":"2024-09-13T06:09:32.135460+0000","last_unstale":"2024-09-13T06:14:03.432130+0000","last_undegraded":"2024-09-13T06:14:03.432130+0000","last_fullsized":"2024-09-13T06:14:03.432130+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:03.431859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:03.431859+0000","last_clean_scrub_stamp":"2024-09-13T06:14:03.431859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:11:48.562273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"35'2","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:58.121860+0000","last_change":"2024-09-13T06:13:58.121860+0000","last_active":"2024-09-13T06:13:58.121860+0000","last_peered":"2024-09-13T06:13:58.121860+0000","last_clean":"2024-09-13T06:13:58.121860+0000","last_became_active":"2024-09-13T06:09:34.115047+0000","last_became_peered":"2024-09-13T06:09:34.115047+0000","last_unstale":"2024-09-13T06:13:58.121860+0000","last_undegraded":"2024-09-13T06:13:58.121860+0000","last_fullsized":"2024-09-13T06:13:58.121860+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:13:58.121478+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:13:58.121478+0000","last_clean_scrub_stamp":"2024-09-13T06:13:58.121478+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:31:22.905217+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:04.099929+0000","last_change":"2024-09-13T06:14:04.099929+0000","last_active":"2024-09-13T06:14:04.099929+0000","last_peered":"2024-09-13T06:14:04.099929+0000","last_clean":"2024-09-13T06:14:04.099929+0000","last_became_active":"2024-09-13T06:09:32.141166+0000","last_became_peered":"2024-09-13T06:09:32.141166+0000","last_unstale":"2024-09-13T06:14:04.099929+0000","last_undegraded":"2024-09-13T06:14:04.099929+0000","last_fullsized":"2024-09-13T06:14:04.099929+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:04.099667+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:04.099667+0000","last_clean_scrub_stamp":"2024-09-13T06:14:04.099667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:53:05.101935+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"35'4","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:00.061453+0000","last_change":"2024-09-13T06:14:00.061453+0000","last_active":"2024-09-13T06:14:00.061453+0000","last_peered":"2024-09-13T06:14:00.061453+0000","last_clean":"2024-09-13T06:14:00.061453+0000","last_became_active":"2024-09-13T06:09:34.114242+0000","last_became_peered":"2024-09-13T06:09:34.114242+0000","last_unstale":"2024-09-13T06:14:00.061453+0000","last_undegraded":"2024-09-13T06:14:00.061453+0000","last_fullsized":"2024-09-13T06:14:00.061453+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:14:00.061127+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:14:00.061127+0000","last_clean_scrub_stamp":"2024-09-13T06:14:00.061127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:16:26.722813+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:00.064927+0000","last_change":"2024-09-13T06:14:00.064927+0000","last_active":"2024-09-13T06:14:00.064927+0000","last_peered":"2024-09-13T06:14:00.064927+0000","last_clean":"2024-09-13T06:14:00.064927+0000","last_became_active":"2024-09-13T06:09:32.143746+0000","last_became_peered":"2024-09-13T06:09:32.143746+0000","last_unstale":"2024-09-13T06:14:00.064927+0000","last_undegraded":"2024-09-13T06:14:00.064927+0000","last_fullsized":"2024-09-13T06:14:00.064927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:00.064492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:00.064492+0000","last_clean_scrub_stamp":"2024-09-13T06:14:00.064492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:19:41.835952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"35'8","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:50.515884+0000","last_change":"2024-09-13T06:13:50.515884+0000","last_active":"2024-09-13T06:13:50.515884+0000","last_peered":"2024-09-13T06:13:50.515884+0000","last_clean":"2024-09-13T06:13:50.515884+0000","last_became_active":"2024-09-13T06:09:34.101167+0000","last_became_peered":"2024-09-13T06:09:34.101167+0000","last_unstale":"2024-09-13T06:13:50.515884+0000","last_undegraded":"2024-09-13T06:13:50.515884+0000","last_fullsized":"2024-09-13T06:13:50.515884+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-13T06:13:50.515623+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-13T06:13:50.515623+0000","last_clean_scrub_stamp":"2024-09-13T06:13:50.515623+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:17:02.378126+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:57.177314+0000","last_change":"2024-09-13T06:13:57.177314+0000","last_active":"2024-09-13T06:13:57.177314+0000","last_peered":"2024-09-13T06:13:57.177314+0000","last_clean":"2024-09-13T06:13:57.177314+0000","last_became_active":"2024-09-13T06:09:32.149885+0000","last_became_peered":"2024-09-13T06:09:32.149885+0000","last_unstale":"2024-09-13T06:13:57.177314+0000","last_undegraded":"2024-09-13T06:13:57.177314+0000","last_fullsized":"2024-09-13T06:13:57.177314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:57.177058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:57.177058+0000","last_clean_scrub_stamp":"2024-09-13T06:13:57.177058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:42:39.408712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"35'14","reported_seq":75,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:43.162922+0000","last_change":"2024-09-13T06:13:43.162922+0000","last_active":"2024-09-13T06:13:43.162922+0000","last_peered":"2024-09-13T06:13:43.162922+0000","last_clean":"2024-09-13T06:13:43.162922+0000","last_became_active":"2024-09-13T06:09:34.124299+0000","last_became_peered":"2024-09-13T06:09:34.124299+0000","last_unstale":"2024-09-13T06:13:43.162922+0000","last_undegraded":"2024-09-13T06:13:43.162922+0000","last_fullsized":"2024-09-13T06:13:43.162922+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'14","last_scrub_stamp":"2024-09-13T06:13:43.162673+0000","last_deep_scrub":"35'14","last_deep_scrub_stamp":"2024-09-13T06:13:43.162673+0000","last_clean_scrub_stamp":"2024-09-13T06:13:43.162673+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:37:16.908533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:41.840514+0000","last_change":"2024-09-13T06:14:41.840574+0000","last_active":"2024-09-13T06:14:41.840514+0000","last_peered":"2024-09-13T06:14:41.840514+0000","last_clean":"2024-09-13T06:14:41.840514+0000","last_became_active":"2024-09-13T06:09:32.128376+0000","last_became_peered":"2024-09-13T06:09:32.128376+0000","last_unstale":"2024-09-13T06:14:41.840514+0000","last_undegraded":"2024-09-13T06:14:41.840514+0000","last_fullsized":"2024-09-13T06:14:41.840514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:41.840315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:41.840315+0000","last_clean_scrub_stamp":"2024-09-13T06:14:41.840315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:37:27.494343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"35'44","reported_seq":135,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:23.143992+0000","last_change":"2024-09-13T06:14:23.143992+0000","last_active":"2024-09-13T06:14:23.143992+0000","last_peered":"2024-09-13T06:14:23.143992+0000","last_clean":"2024-09-13T06:14:23.143992+0000","last_became_active":"2024-09-13T06:09:42.186091+0000","last_became_peered":"2024-09-13T06:09:42.186091+0000","last_unstale":"2024-09-13T06:14:23.143992+0000","last_undegraded":"2024-09-13T06:14:23.143992+0000","last_fullsized":"2024-09-13T06:14:23.143992+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'44","last_scrub_stamp":"2024-09-13T06:14:23.143692+0000","last_deep_scrub":"35'44","last_deep_scrub_stamp":"2024-09-13T06:14:23.143692+0000","last_clean_scrub_stamp":"2024-09-13T06:14:23.143692+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:48:38.353678+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":246,"num_read_kb":228,"num_write":124,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"35'16","reported_seq":116,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:06.989989+0000","last_change":"2024-09-13T06:14:06.989989+0000","last_active":"2024-09-13T06:14:06.989989+0000","last_peered":"2024-09-13T06:14:06.989989+0000","last_clean":"2024-09-13T06:14:06.989989+0000","last_became_active":"2024-09-13T06:09:34.118393+0000","last_became_peered":"2024-09-13T06:09:34.118393+0000","last_unstale":"2024-09-13T06:14:06.989989+0000","last_undegraded":"2024-09-13T06:14:06.989989+0000","last_fullsized":"2024-09-13T06:14:06.989989+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'16","last_scrub_stamp":"2024-09-13T06:14:06.989589+0000","last_deep_scrub":"35'16","last_deep_scrub_stamp":"2024-09-13T06:14:06.989589+0000","last_clean_scrub_stamp":"2024-09-13T06:14:06.989589+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:35:16.756495+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":90,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"35'6","reported_seq":59,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:31.742907+0000","last_change":"2024-09-13T06:14:31.743066+0000","last_active":"2024-09-13T06:14:31.742907+0000","last_peered":"2024-09-13T06:14:31.742907+0000","last_clean":"2024-09-13T06:14:31.742907+0000","last_became_active":"2024-09-13T06:09:32.133545+0000","last_became_peered":"2024-09-13T06:09:32.133545+0000","last_unstale":"2024-09-13T06:14:31.742907+0000","last_undegraded":"2024-09-13T06:14:31.742907+0000","last_fullsized":"2024-09-13T06:14:31.742907+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:14:31.742648+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:14:31.742648+0000","last_clean_scrub_stamp":"2024-09-13T06:14:31.742648+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:35:35.831610+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:26.893183+0000","last_change":"2024-09-13T06:13:26.893183+0000","last_active":"2024-09-13T06:13:26.893183+0000","last_peered":"2024-09-13T06:13:26.893183+0000","last_clean":"2024-09-13T06:13:26.893183+0000","last_became_active":"2024-09-13T06:09:36.153420+0000","last_became_peered":"2024-09-13T06:09:36.153420+0000","last_unstale":"2024-09-13T06:13:26.893183+0000","last_undegraded":"2024-09-13T06:13:26.893183+0000","last_fullsized":"2024-09-13T06:13:26.893183+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:26.892934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:26.892934+0000","last_clean_scrub_stamp":"2024-09-13T06:13:26.892934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:12:45.761321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"35'37","reported_seq":93,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:54.897267+0000","last_change":"2024-09-13T06:13:54.897267+0000","last_active":"2024-09-13T06:13:54.897267+0000","last_peered":"2024-09-13T06:13:54.897267+0000","last_clean":"2024-09-13T06:13:54.897267+0000","last_became_active":"2024-09-13T06:09:38.175393+0000","last_became_peered":"2024-09-13T06:09:38.175393+0000","last_unstale":"2024-09-13T06:13:54.897267+0000","last_undegraded":"2024-09-13T06:13:54.897267+0000","last_fullsized":"2024-09-13T06:13:54.897267+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'37","last_scrub_stamp":"2024-09-13T06:13:54.896963+0000","last_deep_scrub":"35'37","last_deep_scrub_stamp":"2024-09-13T06:13:54.896963+0000","last_clean_scrub_stamp":"2024-09-13T06:13:54.896963+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:27:41.104876+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:49.056194+0000","last_change":"2024-09-13T06:13:49.056194+0000","last_active":"2024-09-13T06:13:49.056194+0000","last_peered":"2024-09-13T06:13:49.056194+0000","last_clean":"2024-09-13T06:13:49.056194+0000","last_became_active":"2024-09-13T06:09:40.185574+0000","last_became_peered":"2024-09-13T06:09:40.185574+0000","last_unstale":"2024-09-13T06:13:49.056194+0000","last_undegraded":"2024-09-13T06:13:49.056194+0000","last_fullsized":"2024-09-13T06:13:49.056194+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:49.055950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:49.055950+0000","last_clean_scrub_stamp":"2024-09-13T06:13:49.055950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:11:18.319386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"35'9","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:21.108452+0000","last_change":"2024-09-13T06:14:21.108452+0000","last_active":"2024-09-13T06:14:21.108452+0000","last_peered":"2024-09-13T06:14:21.108452+0000","last_clean":"2024-09-13T06:14:21.108452+0000","last_became_active":"2024-09-13T06:09:42.183162+0000","last_became_peered":"2024-09-13T06:09:42.183162+0000","last_unstale":"2024-09-13T06:14:21.108452+0000","last_undegraded":"2024-09-13T06:14:21.108452+0000","last_fullsized":"2024-09-13T06:14:21.108452+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'9","last_scrub_stamp":"2024-09-13T06:14:21.108188+0000","last_deep_scrub":"35'9","last_deep_scrub_stamp":"2024-09-13T06:14:21.108188+0000","last_clean_scrub_stamp":"2024-09-13T06:14:21.108188+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:28:07.316101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":19,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"35'6","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:02.899591+0000","last_change":"2024-09-13T06:14:02.899591+0000","last_active":"2024-09-13T06:14:02.899591+0000","last_peered":"2024-09-13T06:14:02.899591+0000","last_clean":"2024-09-13T06:14:02.899591+0000","last_became_active":"2024-09-13T06:09:34.120600+0000","last_became_peered":"2024-09-13T06:09:34.120600+0000","last_unstale":"2024-09-13T06:14:02.899591+0000","last_undegraded":"2024-09-13T06:14:02.899591+0000","last_fullsized":"2024-09-13T06:14:02.899591+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:14:02.899339+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:14:02.899339+0000","last_clean_scrub_stamp":"2024-09-13T06:14:02.899339+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:30:32.307843+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:55.431016+0000","last_change":"2024-09-13T06:13:55.431016+0000","last_active":"2024-09-13T06:13:55.431016+0000","last_peered":"2024-09-13T06:13:55.431016+0000","last_clean":"2024-09-13T06:13:55.431016+0000","last_became_active":"2024-09-13T06:09:32.138643+0000","last_became_peered":"2024-09-13T06:09:32.138643+0000","last_unstale":"2024-09-13T06:13:55.431016+0000","last_undegraded":"2024-09-13T06:13:55.431016+0000","last_fullsized":"2024-09-13T06:13:55.431016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:55.430747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:55.430747+0000","last_clean_scrub_stamp":"2024-09-13T06:13:55.430747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:59:14.616769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:41.236284+0000","last_change":"2024-09-13T06:13:41.236284+0000","last_active":"2024-09-13T06:13:41.236284+0000","last_peered":"2024-09-13T06:13:41.236284+0000","last_clean":"2024-09-13T06:13:41.236284+0000","last_became_active":"2024-09-13T06:09:36.139235+0000","last_became_peered":"2024-09-13T06:09:36.139235+0000","last_unstale":"2024-09-13T06:13:41.236284+0000","last_undegraded":"2024-09-13T06:13:41.236284+0000","last_fullsized":"2024-09-13T06:13:41.236284+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:41.235958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:41.235958+0000","last_clean_scrub_stamp":"2024-09-13T06:13:41.235958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:48:26.407496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"35'9","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:28.250424+0000","last_change":"2024-09-13T06:13:28.250424+0000","last_active":"2024-09-13T06:13:28.250424+0000","last_peered":"2024-09-13T06:13:28.250424+0000","last_clean":"2024-09-13T06:13:28.250424+0000","last_became_active":"2024-09-13T06:09:38.161539+0000","last_became_peered":"2024-09-13T06:09:38.161539+0000","last_unstale":"2024-09-13T06:13:28.250424+0000","last_undegraded":"2024-09-13T06:13:28.250424+0000","last_fullsized":"2024-09-13T06:13:28.250424+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'9","last_scrub_stamp":"2024-09-13T06:13:28.250177+0000","last_deep_scrub":"35'9","last_deep_scrub_stamp":"2024-09-13T06:13:28.250177+0000","last_clean_scrub_stamp":"2024-09-13T06:13:28.250177+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:10:57.549533+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:41.143426+0000","last_change":"2024-09-13T06:13:41.143426+0000","last_active":"2024-09-13T06:13:41.143426+0000","last_peered":"2024-09-13T06:13:41.143426+0000","last_clean":"2024-09-13T06:13:41.143426+0000","last_became_active":"2024-09-13T06:09:40.182436+0000","last_became_peered":"2024-09-13T06:09:40.182436+0000","last_unstale":"2024-09-13T06:13:41.143426+0000","last_undegraded":"2024-09-13T06:13:41.143426+0000","last_fullsized":"2024-09-13T06:13:41.143426+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:41.143167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:41.143167+0000","last_clean_scrub_stamp":"2024-09-13T06:13:41.143167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:15:32.092602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"33'2","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:22.936454+0000","last_change":"2024-09-13T06:14:22.936454+0000","last_active":"2024-09-13T06:14:22.936454+0000","last_peered":"2024-09-13T06:14:22.936454+0000","last_clean":"2024-09-13T06:14:22.936454+0000","last_became_active":"2024-09-13T06:09:42.208430+0000","last_became_peered":"2024-09-13T06:09:42.208430+0000","last_unstale":"2024-09-13T06:14:22.936454+0000","last_undegraded":"2024-09-13T06:14:22.936454+0000","last_fullsized":"2024-09-13T06:14:22.936454+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T06:14:22.936197+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T06:14:22.936197+0000","last_clean_scrub_stamp":"2024-09-13T06:14:22.936197+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:07:30.217358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"35'6","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:00.919560+0000","last_change":"2024-09-13T06:14:00.919560+0000","last_active":"2024-09-13T06:14:00.919560+0000","last_peered":"2024-09-13T06:14:00.919560+0000","last_clean":"2024-09-13T06:14:00.919560+0000","last_became_active":"2024-09-13T06:09:34.122001+0000","last_became_peered":"2024-09-13T06:09:34.122001+0000","last_unstale":"2024-09-13T06:14:00.919560+0000","last_undegraded":"2024-09-13T06:14:00.919560+0000","last_fullsized":"2024-09-13T06:14:00.919560+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:14:00.919310+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:14:00.919310+0000","last_clean_scrub_stamp":"2024-09-13T06:14:00.919310+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:25:53.623575+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:18.848294+0000","last_change":"2024-09-13T06:14:18.848356+0000","last_active":"2024-09-13T06:14:18.848294+0000","last_peered":"2024-09-13T06:14:18.848294+0000","last_clean":"2024-09-13T06:14:18.848294+0000","last_became_active":"2024-09-13T06:09:32.129739+0000","last_became_peered":"2024-09-13T06:09:32.129739+0000","last_unstale":"2024-09-13T06:14:18.848294+0000","last_undegraded":"2024-09-13T06:14:18.848294+0000","last_fullsized":"2024-09-13T06:14:18.848294+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:18.848074+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:18.848074+0000","last_clean_scrub_stamp":"2024-09-13T06:14:18.848074+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:13:38.238905+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:39.268600+0000","last_change":"2024-09-13T06:13:39.268600+0000","last_active":"2024-09-13T06:13:39.268600+0000","last_peered":"2024-09-13T06:13:39.268600+0000","last_clean":"2024-09-13T06:13:39.268600+0000","last_became_active":"2024-09-13T06:09:36.143405+0000","last_became_peered":"2024-09-13T06:09:36.143405+0000","last_unstale":"2024-09-13T06:13:39.268600+0000","last_undegraded":"2024-09-13T06:13:39.268600+0000","last_fullsized":"2024-09-13T06:13:39.268600+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:39.268339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:39.268339+0000","last_clean_scrub_stamp":"2024-09-13T06:13:39.268339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:08:53.766496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"35'15","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:37.488304+0000","last_change":"2024-09-13T06:13:37.488304+0000","last_active":"2024-09-13T06:13:37.488304+0000","last_peered":"2024-09-13T06:13:37.488304+0000","last_clean":"2024-09-13T06:13:37.488304+0000","last_became_active":"2024-09-13T06:09:38.154654+0000","last_became_peered":"2024-09-13T06:09:38.154654+0000","last_unstale":"2024-09-13T06:13:37.488304+0000","last_undegraded":"2024-09-13T06:13:37.488304+0000","last_fullsized":"2024-09-13T06:13:37.488304+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'15","last_scrub_stamp":"2024-09-13T06:13:37.488029+0000","last_deep_scrub":"35'15","last_deep_scrub_stamp":"2024-09-13T06:13:37.488029+0000","last_clean_scrub_stamp":"2024-09-13T06:13:37.488029+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:59:42.866540+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"35'286","reported_seq":419,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:59.901028+0000","last_change":"2024-09-13T06:13:59.901028+0000","last_active":"2024-09-13T06:13:59.901028+0000","last_peered":"2024-09-13T06:13:59.901028+0000","last_clean":"2024-09-13T06:13:59.901028+0000","last_became_active":"2024-09-13T06:09:40.190377+0000","last_became_peered":"2024-09-13T06:09:40.190377+0000","last_unstale":"2024-09-13T06:13:59.901028+0000","last_undegraded":"2024-09-13T06:13:59.901028+0000","last_fullsized":"2024-09-13T06:13:59.901028+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'286","last_scrub_stamp":"2024-09-13T06:13:59.900745+0000","last_deep_scrub":"35'286","last_deep_scrub_stamp":"2024-09-13T06:13:59.900745+0000","last_clean_scrub_stamp":"2024-09-13T06:13:59.900745+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:29:32.530047+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:48.548016+0000","last_change":"2024-09-13T06:13:48.548016+0000","last_active":"2024-09-13T06:13:48.548016+0000","last_peered":"2024-09-13T06:13:48.548016+0000","last_clean":"2024-09-13T06:13:48.548016+0000","last_became_active":"2024-09-13T06:09:42.204083+0000","last_became_peered":"2024-09-13T06:09:42.204083+0000","last_unstale":"2024-09-13T06:13:48.548016+0000","last_undegraded":"2024-09-13T06:13:48.548016+0000","last_fullsized":"2024-09-13T06:13:48.548016+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:48.547749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:48.547749+0000","last_clean_scrub_stamp":"2024-09-13T06:13:48.547749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:09:43.428843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"35'6","reported_seq":67,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:51.108220+0000","last_change":"2024-09-13T06:13:51.108220+0000","last_active":"2024-09-13T06:13:51.108220+0000","last_peered":"2024-09-13T06:13:51.108220+0000","last_clean":"2024-09-13T06:13:51.108220+0000","last_became_active":"2024-09-13T06:09:34.130815+0000","last_became_peered":"2024-09-13T06:09:34.130815+0000","last_unstale":"2024-09-13T06:13:51.108220+0000","last_undegraded":"2024-09-13T06:13:51.108220+0000","last_fullsized":"2024-09-13T06:13:51.108220+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:13:51.107946+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:13:51.107946+0000","last_clean_scrub_stamp":"2024-09-13T06:13:51.107946+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:16:53.824111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:12.075110+0000","last_change":"2024-09-13T06:14:12.075110+0000","last_active":"2024-09-13T06:14:12.075110+0000","last_peered":"2024-09-13T06:14:12.075110+0000","last_clean":"2024-09-13T06:14:12.075110+0000","last_became_active":"2024-09-13T06:09:32.118278+0000","last_became_peered":"2024-09-13T06:09:32.118278+0000","last_unstale":"2024-09-13T06:14:12.075110+0000","last_undegraded":"2024-09-13T06:14:12.075110+0000","last_fullsized":"2024-09-13T06:14:12.075110+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:12.074849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:12.074849+0000","last_clean_scrub_stamp":"2024-09-13T06:14:12.074849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:59:25.657351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:48.805772+0000","last_change":"2024-09-13T06:14:48.805825+0000","last_active":"2024-09-13T06:14:48.805772+0000","last_peered":"2024-09-13T06:14:48.805772+0000","last_clean":"2024-09-13T06:14:48.805772+0000","last_became_active":"2024-09-13T06:10:10.824420+0000","last_became_peered":"2024-09-13T06:10:10.824420+0000","last_unstale":"2024-09-13T06:14:48.805772+0000","last_undegraded":"2024-09-13T06:14:48.805772+0000","last_fullsized":"2024-09-13T06:14:48.805772+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:48.805588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:48.805588+0000","last_clean_scrub_stamp":"2024-09-13T06:14:48.805588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:42:08.363986+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"35'37","reported_seq":93,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:35.449374+0000","last_change":"2024-09-13T06:13:35.449374+0000","last_active":"2024-09-13T06:13:35.449374+0000","last_peered":"2024-09-13T06:13:35.449374+0000","last_clean":"2024-09-13T06:13:35.449374+0000","last_became_active":"2024-09-13T06:09:38.157430+0000","last_became_peered":"2024-09-13T06:09:38.157430+0000","last_unstale":"2024-09-13T06:13:35.449374+0000","last_undegraded":"2024-09-13T06:13:35.449374+0000","last_fullsized":"2024-09-13T06:13:35.449374+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'37","last_scrub_stamp":"2024-09-13T06:13:35.449087+0000","last_deep_scrub":"35'37","last_deep_scrub_stamp":"2024-09-13T06:13:35.449087+0000","last_clean_scrub_stamp":"2024-09-13T06:13:35.449087+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:28:30.698850+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"35'285","reported_seq":449,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:26.281485+0000","last_change":"2024-09-13T06:13:26.281485+0000","last_active":"2024-09-13T06:13:26.281485+0000","last_peered":"2024-09-13T06:13:26.281485+0000","last_clean":"2024-09-13T06:13:26.281485+0000","last_became_active":"2024-09-13T06:09:40.175871+0000","last_became_peered":"2024-09-13T06:09:40.175871+0000","last_unstale":"2024-09-13T06:13:26.281485+0000","last_undegraded":"2024-09-13T06:13:26.281485+0000","last_fullsized":"2024-09-13T06:13:26.281485+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-13T06:13:26.281223+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-13T06:13:26.281223+0000","last_clean_scrub_stamp":"2024-09-13T06:13:26.281223+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:05:30.880244+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"35'2","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:44.821803+0000","last_change":"2024-09-13T06:13:44.821803+0000","last_active":"2024-09-13T06:13:44.821803+0000","last_peered":"2024-09-13T06:13:44.821803+0000","last_clean":"2024-09-13T06:13:44.821803+0000","last_became_active":"2024-09-13T06:09:34.126374+0000","last_became_peered":"2024-09-13T06:09:34.126374+0000","last_unstale":"2024-09-13T06:13:44.821803+0000","last_undegraded":"2024-09-13T06:13:44.821803+0000","last_fullsized":"2024-09-13T06:13:44.821803+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:13:44.821554+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:13:44.821554+0000","last_clean_scrub_stamp":"2024-09-13T06:13:44.821554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:48:20.992725+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:13.500678+0000","last_change":"2024-09-13T06:14:13.500738+0000","last_active":"2024-09-13T06:14:13.500678+0000","last_peered":"2024-09-13T06:14:13.500678+0000","last_clean":"2024-09-13T06:14:13.500678+0000","last_became_active":"2024-09-13T06:09:32.131373+0000","last_became_peered":"2024-09-13T06:09:32.131373+0000","last_unstale":"2024-09-13T06:14:13.500678+0000","last_undegraded":"2024-09-13T06:14:13.500678+0000","last_fullsized":"2024-09-13T06:14:13.500678+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:13.500482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:13.500482+0000","last_clean_scrub_stamp":"2024-09-13T06:14:13.500482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:15:53.870254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:38.094138+0000","last_change":"2024-09-13T06:13:38.094138+0000","last_active":"2024-09-13T06:13:38.094138+0000","last_peered":"2024-09-13T06:13:38.094138+0000","last_clean":"2024-09-13T06:13:38.094138+0000","last_became_active":"2024-09-13T06:09:36.137016+0000","last_became_peered":"2024-09-13T06:09:36.137016+0000","last_unstale":"2024-09-13T06:13:38.094138+0000","last_undegraded":"2024-09-13T06:13:38.094138+0000","last_fullsized":"2024-09-13T06:13:38.094138+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:38.093864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:38.093864+0000","last_clean_scrub_stamp":"2024-09-13T06:13:38.093864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:18:03.005466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"35'51","reported_seq":112,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:31.369768+0000","last_change":"2024-09-13T06:13:31.369768+0000","last_active":"2024-09-13T06:13:31.369768+0000","last_peered":"2024-09-13T06:13:31.369768+0000","last_clean":"2024-09-13T06:13:31.369768+0000","last_became_active":"2024-09-13T06:09:38.163472+0000","last_became_peered":"2024-09-13T06:09:38.163472+0000","last_unstale":"2024-09-13T06:13:31.369768+0000","last_undegraded":"2024-09-13T06:13:31.369768+0000","last_fullsized":"2024-09-13T06:13:31.369768+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'51","last_scrub_stamp":"2024-09-13T06:13:31.369476+0000","last_deep_scrub":"35'51","last_deep_scrub_stamp":"2024-09-13T06:13:31.369476+0000","last_clean_scrub_stamp":"2024-09-13T06:13:31.369476+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:44:16.358341+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:27.325602+0000","last_change":"2024-09-13T06:13:27.325602+0000","last_active":"2024-09-13T06:13:27.325602+0000","last_peered":"2024-09-13T06:13:27.325602+0000","last_clean":"2024-09-13T06:13:27.325602+0000","last_became_active":"2024-09-13T06:09:40.171609+0000","last_became_peered":"2024-09-13T06:09:40.171609+0000","last_unstale":"2024-09-13T06:13:27.325602+0000","last_undegraded":"2024-09-13T06:13:27.325602+0000","last_fullsized":"2024-09-13T06:13:27.325602+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:27.325358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:27.325358+0000","last_clean_scrub_stamp":"2024-09-13T06:13:27.325358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:15:24.519986+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"35'5","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:16.551788+0000","last_change":"2024-09-13T06:14:16.551854+0000","last_active":"2024-09-13T06:14:16.551788+0000","last_peered":"2024-09-13T06:14:16.551788+0000","last_clean":"2024-09-13T06:14:16.551788+0000","last_became_active":"2024-09-13T06:09:42.193426+0000","last_became_peered":"2024-09-13T06:09:42.193426+0000","last_unstale":"2024-09-13T06:14:16.551788+0000","last_undegraded":"2024-09-13T06:14:16.551788+0000","last_fullsized":"2024-09-13T06:14:16.551788+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'5","last_scrub_stamp":"2024-09-13T06:14:16.551562+0000","last_deep_scrub":"35'5","last_deep_scrub_stamp":"2024-09-13T06:14:16.551562+0000","last_clean_scrub_stamp":"2024-09-13T06:14:16.551562+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:45:42.103577+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"35'6","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:56.130563+0000","last_change":"2024-09-13T06:13:56.130563+0000","last_active":"2024-09-13T06:13:56.130563+0000","last_peered":"2024-09-13T06:13:56.130563+0000","last_clean":"2024-09-13T06:13:56.130563+0000","last_became_active":"2024-09-13T06:09:34.114999+0000","last_became_peered":"2024-09-13T06:09:34.114999+0000","last_unstale":"2024-09-13T06:13:56.130563+0000","last_undegraded":"2024-09-13T06:13:56.130563+0000","last_fullsized":"2024-09-13T06:13:56.130563+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:13:56.130180+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:13:56.130180+0000","last_clean_scrub_stamp":"2024-09-13T06:13:56.130180+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:43:27.715392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:08.485550+0000","last_change":"2024-09-13T06:14:08.485661+0000","last_active":"2024-09-13T06:14:08.485550+0000","last_peered":"2024-09-13T06:14:08.485550+0000","last_clean":"2024-09-13T06:14:08.485550+0000","last_became_active":"2024-09-13T06:09:32.117779+0000","last_became_peered":"2024-09-13T06:09:32.117779+0000","last_unstale":"2024-09-13T06:14:08.485550+0000","last_undegraded":"2024-09-13T06:14:08.485550+0000","last_fullsized":"2024-09-13T06:14:08.485550+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:08.485235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:08.485235+0000","last_clean_scrub_stamp":"2024-09-13T06:14:08.485235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:46:00.389747+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:43.192766+0000","last_change":"2024-09-13T06:13:43.192766+0000","last_active":"2024-09-13T06:13:43.192766+0000","last_peered":"2024-09-13T06:13:43.192766+0000","last_clean":"2024-09-13T06:13:43.192766+0000","last_became_active":"2024-09-13T06:09:36.135862+0000","last_became_peered":"2024-09-13T06:09:36.135862+0000","last_unstale":"2024-09-13T06:13:43.192766+0000","last_undegraded":"2024-09-13T06:13:43.192766+0000","last_fullsized":"2024-09-13T06:13:43.192766+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:43.192506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:43.192506+0000","last_clean_scrub_stamp":"2024-09-13T06:13:43.192506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:16:55.055009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"35'37","reported_seq":93,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:35.787233+0000","last_change":"2024-09-13T06:13:35.787233+0000","last_active":"2024-09-13T06:13:35.787233+0000","last_peered":"2024-09-13T06:13:35.787233+0000","last_clean":"2024-09-13T06:13:35.787233+0000","last_became_active":"2024-09-13T06:09:38.171931+0000","last_became_peered":"2024-09-13T06:09:38.171931+0000","last_unstale":"2024-09-13T06:13:35.787233+0000","last_undegraded":"2024-09-13T06:13:35.787233+0000","last_fullsized":"2024-09-13T06:13:35.787233+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'37","last_scrub_stamp":"2024-09-13T06:13:35.786837+0000","last_deep_scrub":"35'37","last_deep_scrub_stamp":"2024-09-13T06:13:35.786837+0000","last_clean_scrub_stamp":"2024-09-13T06:13:35.786837+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:50:05.816319+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:32.280888+0000","last_change":"2024-09-13T06:13:32.280888+0000","last_active":"2024-09-13T06:13:32.280888+0000","last_peered":"2024-09-13T06:13:32.280888+0000","last_clean":"2024-09-13T06:13:32.280888+0000","last_became_active":"2024-09-13T06:09:40.178545+0000","last_became_peered":"2024-09-13T06:09:40.178545+0000","last_unstale":"2024-09-13T06:13:32.280888+0000","last_undegraded":"2024-09-13T06:13:32.280888+0000","last_fullsized":"2024-09-13T06:13:32.280888+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:32.280631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:32.280631+0000","last_clean_scrub_stamp":"2024-09-13T06:13:32.280631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:40:09.829593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"35'6","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:26.191567+0000","last_change":"2024-09-13T06:14:26.191645+0000","last_active":"2024-09-13T06:14:26.191567+0000","last_peered":"2024-09-13T06:14:26.191567+0000","last_clean":"2024-09-13T06:14:26.191567+0000","last_became_active":"2024-09-13T06:09:42.204945+0000","last_became_peered":"2024-09-13T06:09:42.204945+0000","last_unstale":"2024-09-13T06:14:26.191567+0000","last_undegraded":"2024-09-13T06:14:26.191567+0000","last_fullsized":"2024-09-13T06:14:26.191567+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:14:26.191375+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:14:26.191375+0000","last_clean_scrub_stamp":"2024-09-13T06:14:26.191375+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:29:58.820678+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"33'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:02.463798+0000","last_change":"2024-09-13T06:14:02.463861+0000","last_active":"2024-09-13T06:14:02.463798+0000","last_peered":"2024-09-13T06:14:02.463798+0000","last_clean":"2024-09-13T06:14:02.463798+0000","last_became_active":"2024-09-13T06:09:34.102657+0000","last_became_peered":"2024-09-13T06:09:34.102657+0000","last_unstale":"2024-09-13T06:14:02.463798+0000","last_undegraded":"2024-09-13T06:14:02.463798+0000","last_fullsized":"2024-09-13T06:14:02.463798+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T06:14:02.463588+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T06:14:02.463588+0000","last_clean_scrub_stamp":"2024-09-13T06:14:02.463588+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:08:35.731519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"35'6","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:29.773452+0000","last_change":"2024-09-13T06:14:29.773519+0000","last_active":"2024-09-13T06:14:29.773452+0000","last_peered":"2024-09-13T06:14:29.773452+0000","last_clean":"2024-09-13T06:14:29.773452+0000","last_became_active":"2024-09-13T06:09:32.133020+0000","last_became_peered":"2024-09-13T06:09:32.133020+0000","last_unstale":"2024-09-13T06:14:29.773452+0000","last_undegraded":"2024-09-13T06:14:29.773452+0000","last_fullsized":"2024-09-13T06:14:29.773452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:14:29.773238+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:14:29.773238+0000","last_clean_scrub_stamp":"2024-09-13T06:14:29.773238+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:56:06.486361+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":22,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:17.598463+0000","last_change":"2024-09-13T06:14:17.598463+0000","last_active":"2024-09-13T06:14:17.598463+0000","last_peered":"2024-09-13T06:14:17.598463+0000","last_clean":"2024-09-13T06:14:17.598463+0000","last_became_active":"2024-09-13T06:10:10.809442+0000","last_became_peered":"2024-09-13T06:10:10.809442+0000","last_unstale":"2024-09-13T06:14:17.598463+0000","last_undegraded":"2024-09-13T06:14:17.598463+0000","last_fullsized":"2024-09-13T06:14:17.598463+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:17.598224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:17.598224+0000","last_clean_scrub_stamp":"2024-09-13T06:14:17.598224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:09:29.398763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"35'45","reported_seq":104,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:27.901555+0000","last_change":"2024-09-13T06:13:27.901555+0000","last_active":"2024-09-13T06:13:27.901555+0000","last_peered":"2024-09-13T06:13:27.901555+0000","last_clean":"2024-09-13T06:13:27.901555+0000","last_became_active":"2024-09-13T06:09:38.154720+0000","last_became_peered":"2024-09-13T06:09:38.154720+0000","last_unstale":"2024-09-13T06:13:27.901555+0000","last_undegraded":"2024-09-13T06:13:27.901555+0000","last_fullsized":"2024-09-13T06:13:27.901555+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'45","last_scrub_stamp":"2024-09-13T06:13:27.901155+0000","last_deep_scrub":"35'45","last_deep_scrub_stamp":"2024-09-13T06:13:27.901155+0000","last_clean_scrub_stamp":"2024-09-13T06:13:27.901155+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:38:20.916120+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"35'285","reported_seq":411,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:48.184617+0000","last_change":"2024-09-13T06:13:48.184617+0000","last_active":"2024-09-13T06:13:48.184617+0000","last_peered":"2024-09-13T06:13:48.184617+0000","last_clean":"2024-09-13T06:13:48.184617+0000","last_became_active":"2024-09-13T06:09:40.186987+0000","last_became_peered":"2024-09-13T06:09:40.186987+0000","last_unstale":"2024-09-13T06:13:48.184617+0000","last_undegraded":"2024-09-13T06:13:48.184617+0000","last_fullsized":"2024-09-13T06:13:48.184617+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-13T06:13:48.184284+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-13T06:13:48.184284+0000","last_clean_scrub_stamp":"2024-09-13T06:13:48.184284+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:59:07.370306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"35'2","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:21.968175+0000","last_change":"2024-09-13T06:14:21.968236+0000","last_active":"2024-09-13T06:14:21.968175+0000","last_peered":"2024-09-13T06:14:21.968175+0000","last_clean":"2024-09-13T06:14:21.968175+0000","last_became_active":"2024-09-13T06:09:42.201678+0000","last_became_peered":"2024-09-13T06:09:42.201678+0000","last_unstale":"2024-09-13T06:14:21.968175+0000","last_undegraded":"2024-09-13T06:14:21.968175+0000","last_fullsized":"2024-09-13T06:14:21.968175+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:21.967952+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:21.967952+0000","last_clean_scrub_stamp":"2024-09-13T06:14:21.967952+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:01:07.570633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"35'14","reported_seq":79,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:52.484137+0000","last_change":"2024-09-13T06:13:52.484137+0000","last_active":"2024-09-13T06:13:52.484137+0000","last_peered":"2024-09-13T06:13:52.484137+0000","last_clean":"2024-09-13T06:13:52.484137+0000","last_became_active":"2024-09-13T06:09:34.103295+0000","last_became_peered":"2024-09-13T06:09:34.103295+0000","last_unstale":"2024-09-13T06:13:52.484137+0000","last_undegraded":"2024-09-13T06:13:52.484137+0000","last_fullsized":"2024-09-13T06:13:52.484137+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'14","last_scrub_stamp":"2024-09-13T06:13:52.483880+0000","last_deep_scrub":"35'14","last_deep_scrub_stamp":"2024-09-13T06:13:52.483880+0000","last_clean_scrub_stamp":"2024-09-13T06:13:52.483880+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:12:37.738064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:28.787505+0000","last_change":"2024-09-13T06:14:28.787562+0000","last_active":"2024-09-13T06:14:28.787505+0000","last_peered":"2024-09-13T06:14:28.787505+0000","last_clean":"2024-09-13T06:14:28.787505+0000","last_became_active":"2024-09-13T06:09:32.125047+0000","last_became_peered":"2024-09-13T06:09:32.125047+0000","last_unstale":"2024-09-13T06:14:28.787505+0000","last_undegraded":"2024-09-13T06:14:28.787505+0000","last_fullsized":"2024-09-13T06:14:28.787505+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:28.787307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:28.787307+0000","last_clean_scrub_stamp":"2024-09-13T06:14:28.787307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:47:48.552757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:42.241894+0000","last_change":"2024-09-13T06:13:42.241894+0000","last_active":"2024-09-13T06:13:42.241894+0000","last_peered":"2024-09-13T06:13:42.241894+0000","last_clean":"2024-09-13T06:13:42.241894+0000","last_became_active":"2024-09-13T06:09:36.135896+0000","last_became_peered":"2024-09-13T06:09:36.135896+0000","last_unstale":"2024-09-13T06:13:42.241894+0000","last_undegraded":"2024-09-13T06:13:42.241894+0000","last_fullsized":"2024-09-13T06:13:42.241894+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:42.241654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:42.241654+0000","last_clean_scrub_stamp":"2024-09-13T06:13:42.241654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:30:48.725646+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"35'68","reported_seq":142,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:56.931891+0000","last_change":"2024-09-13T06:13:56.931891+0000","last_active":"2024-09-13T06:13:56.931891+0000","last_peered":"2024-09-13T06:13:56.931891+0000","last_clean":"2024-09-13T06:13:56.931891+0000","last_became_active":"2024-09-13T06:09:38.175404+0000","last_became_peered":"2024-09-13T06:09:38.175404+0000","last_unstale":"2024-09-13T06:13:56.931891+0000","last_undegraded":"2024-09-13T06:13:56.931891+0000","last_fullsized":"2024-09-13T06:13:56.931891+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'68","last_scrub_stamp":"2024-09-13T06:13:56.931599+0000","last_deep_scrub":"35'68","last_deep_scrub_stamp":"2024-09-13T06:13:56.931599+0000","last_clean_scrub_stamp":"2024-09-13T06:13:56.931599+0000","objects_scrubbed":5,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:48:12.141585+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":65,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:24.261010+0000","last_change":"2024-09-13T06:13:24.261010+0000","last_active":"2024-09-13T06:13:24.261010+0000","last_peered":"2024-09-13T06:13:24.261010+0000","last_clean":"2024-09-13T06:13:24.261010+0000","last_became_active":"2024-09-13T06:09:40.177127+0000","last_became_peered":"2024-09-13T06:09:40.177127+0000","last_unstale":"2024-09-13T06:13:24.261010+0000","last_undegraded":"2024-09-13T06:13:24.261010+0000","last_fullsized":"2024-09-13T06:13:24.261010+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:24.260874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:24.260874+0000","last_clean_scrub_stamp":"2024-09-13T06:13:24.260874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:44:50.272386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"35'21","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:19.053841+0000","last_change":"2024-09-13T06:14:19.053918+0000","last_active":"2024-09-13T06:14:19.053841+0000","last_peered":"2024-09-13T06:14:19.053841+0000","last_clean":"2024-09-13T06:14:19.053841+0000","last_became_active":"2024-09-13T06:09:42.176229+0000","last_became_peered":"2024-09-13T06:09:42.176229+0000","last_unstale":"2024-09-13T06:14:19.053841+0000","last_undegraded":"2024-09-13T06:14:19.053841+0000","last_fullsized":"2024-09-13T06:14:19.053841+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'21","last_scrub_stamp":"2024-09-13T06:14:19.053655+0000","last_deep_scrub":"35'21","last_deep_scrub_stamp":"2024-09-13T06:14:19.053655+0000","last_clean_scrub_stamp":"2024-09-13T06:14:19.053655+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:22:30.490846+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"35'16","reported_seq":87,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:09.100307+0000","last_change":"2024-09-13T06:14:09.100465+0000","last_active":"2024-09-13T06:14:09.100307+0000","last_peered":"2024-09-13T06:14:09.100307+0000","last_clean":"2024-09-13T06:14:09.100307+0000","last_became_active":"2024-09-13T06:09:34.119018+0000","last_became_peered":"2024-09-13T06:09:34.119018+0000","last_unstale":"2024-09-13T06:14:09.100307+0000","last_undegraded":"2024-09-13T06:14:09.100307+0000","last_fullsized":"2024-09-13T06:14:09.100307+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'16","last_scrub_stamp":"2024-09-13T06:14:09.100069+0000","last_deep_scrub":"35'16","last_deep_scrub_stamp":"2024-09-13T06:14:09.100069+0000","last_clean_scrub_stamp":"2024-09-13T06:14:09.100069+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:19:13.686028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:02.994130+0000","last_change":"2024-09-13T06:14:02.994130+0000","last_active":"2024-09-13T06:14:02.994130+0000","last_peered":"2024-09-13T06:14:02.994130+0000","last_clean":"2024-09-13T06:14:02.994130+0000","last_became_active":"2024-09-13T06:09:32.148505+0000","last_became_peered":"2024-09-13T06:09:32.148505+0000","last_unstale":"2024-09-13T06:14:02.994130+0000","last_undegraded":"2024-09-13T06:14:02.994130+0000","last_fullsized":"2024-09-13T06:14:02.994130+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:02.993832+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:02.993832+0000","last_clean_scrub_stamp":"2024-09-13T06:14:02.993832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:44:02.387231+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:42.465330+0000","last_change":"2024-09-13T06:13:42.465330+0000","last_active":"2024-09-13T06:13:42.465330+0000","last_peered":"2024-09-13T06:13:42.465330+0000","last_clean":"2024-09-13T06:13:42.465330+0000","last_became_active":"2024-09-13T06:09:36.131611+0000","last_became_peered":"2024-09-13T06:09:36.131611+0000","last_unstale":"2024-09-13T06:13:42.465330+0000","last_undegraded":"2024-09-13T06:13:42.465330+0000","last_fullsized":"2024-09-13T06:13:42.465330+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:42.465072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:42.465072+0000","last_clean_scrub_stamp":"2024-09-13T06:13:42.465072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:13:43.052645+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"35'40","reported_seq":97,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:27.295757+0000","last_change":"2024-09-13T06:13:27.295757+0000","last_active":"2024-09-13T06:13:27.295757+0000","last_peered":"2024-09-13T06:13:27.295757+0000","last_clean":"2024-09-13T06:13:27.295757+0000","last_became_active":"2024-09-13T06:09:38.165747+0000","last_became_peered":"2024-09-13T06:09:38.165747+0000","last_unstale":"2024-09-13T06:13:27.295757+0000","last_undegraded":"2024-09-13T06:13:27.295757+0000","last_fullsized":"2024-09-13T06:13:27.295757+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'40","last_scrub_stamp":"2024-09-13T06:13:27.295462+0000","last_deep_scrub":"35'40","last_deep_scrub_stamp":"2024-09-13T06:13:27.295462+0000","last_clean_scrub_stamp":"2024-09-13T06:13:27.295462+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:22:05.049909+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:55.906807+0000","last_change":"2024-09-13T06:13:55.906807+0000","last_active":"2024-09-13T06:13:55.906807+0000","last_peered":"2024-09-13T06:13:55.906807+0000","last_clean":"2024-09-13T06:13:55.906807+0000","last_became_active":"2024-09-13T06:09:40.190314+0000","last_became_peered":"2024-09-13T06:09:40.190314+0000","last_unstale":"2024-09-13T06:13:55.906807+0000","last_undegraded":"2024-09-13T06:13:55.906807+0000","last_fullsized":"2024-09-13T06:13:55.906807+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:55.906553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:55.906553+0000","last_clean_scrub_stamp":"2024-09-13T06:13:55.906553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:32:46.700425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"35'4","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:15.915445+0000","last_change":"2024-09-13T06:14:15.915519+0000","last_active":"2024-09-13T06:14:15.915445+0000","last_peered":"2024-09-13T06:14:15.915445+0000","last_clean":"2024-09-13T06:14:15.915445+0000","last_became_active":"2024-09-13T06:09:42.201211+0000","last_became_peered":"2024-09-13T06:09:42.201211+0000","last_unstale":"2024-09-13T06:14:15.915445+0000","last_undegraded":"2024-09-13T06:14:15.915445+0000","last_fullsized":"2024-09-13T06:14:15.915445+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:14:15.915230+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:14:15.915230+0000","last_clean_scrub_stamp":"2024-09-13T06:14:15.915230+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:21:05.416806+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"35'6","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:40.785766+0000","last_change":"2024-09-13T06:13:40.785766+0000","last_active":"2024-09-13T06:13:40.785766+0000","last_peered":"2024-09-13T06:13:40.785766+0000","last_clean":"2024-09-13T06:13:40.785766+0000","last_became_active":"2024-09-13T06:09:34.131882+0000","last_became_peered":"2024-09-13T06:09:34.131882+0000","last_unstale":"2024-09-13T06:13:40.785766+0000","last_undegraded":"2024-09-13T06:13:40.785766+0000","last_fullsized":"2024-09-13T06:13:40.785766+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:13:40.785378+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:13:40.785378+0000","last_clean_scrub_stamp":"2024-09-13T06:13:40.785378+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:31:15.240641+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:16.931589+0000","last_change":"2024-09-13T06:14:16.931648+0000","last_active":"2024-09-13T06:14:16.931589+0000","last_peered":"2024-09-13T06:14:16.931589+0000","last_clean":"2024-09-13T06:14:16.931589+0000","last_became_active":"2024-09-13T06:09:32.138731+0000","last_became_peered":"2024-09-13T06:09:32.138731+0000","last_unstale":"2024-09-13T06:14:16.931589+0000","last_undegraded":"2024-09-13T06:14:16.931589+0000","last_fullsized":"2024-09-13T06:14:16.931589+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:16.931376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:16.931376+0000","last_clean_scrub_stamp":"2024-09-13T06:14:16.931376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:44:18.267821+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:45.169252+0000","last_change":"2024-09-13T06:13:45.169252+0000","last_active":"2024-09-13T06:13:45.169252+0000","last_peered":"2024-09-13T06:13:45.169252+0000","last_clean":"2024-09-13T06:13:45.169252+0000","last_became_active":"2024-09-13T06:09:36.135660+0000","last_became_peered":"2024-09-13T06:09:36.135660+0000","last_unstale":"2024-09-13T06:13:45.169252+0000","last_undegraded":"2024-09-13T06:13:45.169252+0000","last_fullsized":"2024-09-13T06:13:45.169252+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:45.168902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:45.168902+0000","last_clean_scrub_stamp":"2024-09-13T06:13:45.168902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:17:37.777327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"35'46","reported_seq":105,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:38.444422+0000","last_change":"2024-09-13T06:13:38.444422+0000","last_active":"2024-09-13T06:13:38.444422+0000","last_peered":"2024-09-13T06:13:38.444422+0000","last_clean":"2024-09-13T06:13:38.444422+0000","last_became_active":"2024-09-13T06:09:38.143209+0000","last_became_peered":"2024-09-13T06:09:38.143209+0000","last_unstale":"2024-09-13T06:13:38.444422+0000","last_undegraded":"2024-09-13T06:13:38.444422+0000","last_fullsized":"2024-09-13T06:13:38.444422+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'46","last_scrub_stamp":"2024-09-13T06:13:38.444138+0000","last_deep_scrub":"35'46","last_deep_scrub_stamp":"2024-09-13T06:13:38.444138+0000","last_clean_scrub_stamp":"2024-09-13T06:13:38.444138+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:49:28.085814+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"35'285","reported_seq":417,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:32.368124+0000","last_change":"2024-09-13T06:13:32.368124+0000","last_active":"2024-09-13T06:13:32.368124+0000","last_peered":"2024-09-13T06:13:32.368124+0000","last_clean":"2024-09-13T06:13:32.368124+0000","last_became_active":"2024-09-13T06:09:40.188246+0000","last_became_peered":"2024-09-13T06:09:40.188246+0000","last_unstale":"2024-09-13T06:13:32.368124+0000","last_undegraded":"2024-09-13T06:13:32.368124+0000","last_fullsized":"2024-09-13T06:13:32.368124+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-13T06:13:32.367867+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-13T06:13:32.367867+0000","last_clean_scrub_stamp":"2024-09-13T06:13:32.367867+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:44:58.379379+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"35'17","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:21.015822+0000","last_change":"2024-09-13T06:14:21.015889+0000","last_active":"2024-09-13T06:14:21.015822+0000","last_peered":"2024-09-13T06:14:21.015822+0000","last_clean":"2024-09-13T06:14:21.015822+0000","last_became_active":"2024-09-13T06:09:42.201304+0000","last_became_peered":"2024-09-13T06:09:42.201304+0000","last_unstale":"2024-09-13T06:14:21.015822+0000","last_undegraded":"2024-09-13T06:14:21.015822+0000","last_fullsized":"2024-09-13T06:14:21.015822+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'17","last_scrub_stamp":"2024-09-13T06:14:21.015634+0000","last_deep_scrub":"35'17","last_deep_scrub_stamp":"2024-09-13T06:14:21.015634+0000","last_clean_scrub_stamp":"2024-09-13T06:14:21.015634+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:35:52.895466+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":29,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"35'4","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:00.426330+0000","last_change":"2024-09-13T06:14:00.426330+0000","last_active":"2024-09-13T06:14:00.426330+0000","last_peered":"2024-09-13T06:14:00.426330+0000","last_clean":"2024-09-13T06:14:00.426330+0000","last_became_active":"2024-09-13T06:09:34.102586+0000","last_became_peered":"2024-09-13T06:09:34.102586+0000","last_unstale":"2024-09-13T06:14:00.426330+0000","last_undegraded":"2024-09-13T06:14:00.426330+0000","last_fullsized":"2024-09-13T06:14:00.426330+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:14:00.426064+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:14:00.426064+0000","last_clean_scrub_stamp":"2024-09-13T06:14:00.426064+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:46:57.805890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"35'2","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:30.786818+0000","last_change":"2024-09-13T06:14:30.786888+0000","last_active":"2024-09-13T06:14:30.786818+0000","last_peered":"2024-09-13T06:14:30.786818+0000","last_clean":"2024-09-13T06:14:30.786818+0000","last_became_active":"2024-09-13T06:09:32.122121+0000","last_became_peered":"2024-09-13T06:09:32.122121+0000","last_unstale":"2024-09-13T06:14:30.786818+0000","last_undegraded":"2024-09-13T06:14:30.786818+0000","last_fullsized":"2024-09-13T06:14:30.786818+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:30.786593+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:30.786593+0000","last_clean_scrub_stamp":"2024-09-13T06:14:30.786593+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:21:45.714671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"35'5","reported_seq":429,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:32.185845+0000","last_change":"2024-09-13T06:13:32.185845+0000","last_active":"2024-09-13T06:13:32.185845+0000","last_peered":"2024-09-13T06:13:32.185845+0000","last_clean":"2024-09-13T06:13:32.185845+0000","last_became_active":"2024-09-13T06:09:36.141789+0000","last_became_peered":"2024-09-13T06:09:36.141789+0000","last_unstale":"2024-09-13T06:13:32.185845+0000","last_undegraded":"2024-09-13T06:13:32.185845+0000","last_fullsized":"2024-09-13T06:13:32.185845+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'5","last_scrub_stamp":"2024-09-13T06:13:32.185488+0000","last_deep_scrub":"35'5","last_deep_scrub_stamp":"2024-09-13T06:13:32.185488+0000","last_clean_scrub_stamp":"2024-09-13T06:13:32.185488+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:56:51.767002+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"35'15","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:52.922425+0000","last_change":"2024-09-13T06:13:52.922425+0000","last_active":"2024-09-13T06:13:52.922425+0000","last_peered":"2024-09-13T06:13:52.922425+0000","last_clean":"2024-09-13T06:13:52.922425+0000","last_became_active":"2024-09-13T06:09:38.177217+0000","last_became_peered":"2024-09-13T06:09:38.177217+0000","last_unstale":"2024-09-13T06:13:52.922425+0000","last_undegraded":"2024-09-13T06:13:52.922425+0000","last_fullsized":"2024-09-13T06:13:52.922425+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'15","last_scrub_stamp":"2024-09-13T06:13:52.922012+0000","last_deep_scrub":"35'15","last_deep_scrub_stamp":"2024-09-13T06:13:52.922012+0000","last_clean_scrub_stamp":"2024-09-13T06:13:52.922012+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:05:01.785924+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"35'285","reported_seq":473,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:29.237199+0000","last_change":"2024-09-13T06:13:29.237199+0000","last_active":"2024-09-13T06:13:29.237199+0000","last_peered":"2024-09-13T06:13:29.237199+0000","last_clean":"2024-09-13T06:13:29.237199+0000","last_became_active":"2024-09-13T06:09:40.179438+0000","last_became_peered":"2024-09-13T06:09:40.179438+0000","last_unstale":"2024-09-13T06:13:29.237199+0000","last_undegraded":"2024-09-13T06:13:29.237199+0000","last_fullsized":"2024-09-13T06:13:29.237199+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-13T06:13:29.236948+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-13T06:13:29.236948+0000","last_clean_scrub_stamp":"2024-09-13T06:13:29.236948+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:34:12.529343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"35'6","reported_seq":34,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:44.457830+0000","last_change":"2024-09-13T06:13:44.457830+0000","last_active":"2024-09-13T06:13:44.457830+0000","last_peered":"2024-09-13T06:13:44.457830+0000","last_clean":"2024-09-13T06:13:44.457830+0000","last_became_active":"2024-09-13T06:09:42.181854+0000","last_became_peered":"2024-09-13T06:09:42.181854+0000","last_unstale":"2024-09-13T06:13:44.457830+0000","last_undegraded":"2024-09-13T06:13:44.457830+0000","last_fullsized":"2024-09-13T06:13:44.457830+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:13:44.457577+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:13:44.457577+0000","last_clean_scrub_stamp":"2024-09-13T06:13:44.457577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:56:32.118289+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:46.140515+0000","last_change":"2024-09-13T06:13:46.140515+0000","last_active":"2024-09-13T06:13:46.140515+0000","last_peered":"2024-09-13T06:13:46.140515+0000","last_clean":"2024-09-13T06:13:46.140515+0000","last_became_active":"2024-09-13T06:09:34.126843+0000","last_became_peered":"2024-09-13T06:09:34.126843+0000","last_unstale":"2024-09-13T06:13:46.140515+0000","last_undegraded":"2024-09-13T06:13:46.140515+0000","last_fullsized":"2024-09-13T06:13:46.140515+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:46.140243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:46.140243+0000","last_clean_scrub_stamp":"2024-09-13T06:13:46.140243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:17:57.910783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"35'5","reported_seq":59,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:25.852388+0000","last_change":"2024-09-13T06:14:25.852541+0000","last_active":"2024-09-13T06:14:25.852388+0000","last_peered":"2024-09-13T06:14:25.852388+0000","last_clean":"2024-09-13T06:14:25.852388+0000","last_became_active":"2024-09-13T06:09:32.129984+0000","last_became_peered":"2024-09-13T06:09:32.129984+0000","last_unstale":"2024-09-13T06:14:25.852388+0000","last_undegraded":"2024-09-13T06:14:25.852388+0000","last_fullsized":"2024-09-13T06:14:25.852388+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'5","last_scrub_stamp":"2024-09-13T06:14:25.852168+0000","last_deep_scrub":"35'5","last_deep_scrub_stamp":"2024-09-13T06:14:25.852168+0000","last_clean_scrub_stamp":"2024-09-13T06:14:25.852168+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:44:53.789448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.907022+0000","last_change":"2024-09-13T06:13:25.907022+0000","last_active":"2024-09-13T06:13:25.907022+0000","last_peered":"2024-09-13T06:13:25.907022+0000","last_clean":"2024-09-13T06:13:25.907022+0000","last_became_active":"2024-09-13T06:09:36.153614+0000","last_became_peered":"2024-09-13T06:09:36.153614+0000","last_unstale":"2024-09-13T06:13:25.907022+0000","last_undegraded":"2024-09-13T06:13:25.907022+0000","last_fullsized":"2024-09-13T06:13:25.907022+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:25.906744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:25.906744+0000","last_clean_scrub_stamp":"2024-09-13T06:13:25.906744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:08:19.863549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"35'48","reported_seq":108,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:31.203250+0000","last_change":"2024-09-13T06:13:31.203250+0000","last_active":"2024-09-13T06:13:31.203250+0000","last_peered":"2024-09-13T06:13:31.203250+0000","last_clean":"2024-09-13T06:13:31.203250+0000","last_became_active":"2024-09-13T06:09:38.155463+0000","last_became_peered":"2024-09-13T06:09:38.155463+0000","last_unstale":"2024-09-13T06:13:31.203250+0000","last_undegraded":"2024-09-13T06:13:31.203250+0000","last_fullsized":"2024-09-13T06:13:31.203250+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'48","last_scrub_stamp":"2024-09-13T06:13:31.202979+0000","last_deep_scrub":"35'48","last_deep_scrub_stamp":"2024-09-13T06:13:31.202979+0000","last_clean_scrub_stamp":"2024-09-13T06:13:31.202979+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:07:14.216978+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:27.404848+0000","last_change":"2024-09-13T06:13:27.404848+0000","last_active":"2024-09-13T06:13:27.404848+0000","last_peered":"2024-09-13T06:13:27.404848+0000","last_clean":"2024-09-13T06:13:27.404848+0000","last_became_active":"2024-09-13T06:09:40.167733+0000","last_became_peered":"2024-09-13T06:09:40.167733+0000","last_unstale":"2024-09-13T06:13:27.404848+0000","last_undegraded":"2024-09-13T06:13:27.404848+0000","last_fullsized":"2024-09-13T06:13:27.404848+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:27.404612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:27.404612+0000","last_clean_scrub_stamp":"2024-09-13T06:13:27.404612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:53:51.661686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"35'7","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:53.145831+0000","last_change":"2024-09-13T06:13:53.145895+0000","last_active":"2024-09-13T06:13:53.145831+0000","last_peered":"2024-09-13T06:13:53.145831+0000","last_clean":"2024-09-13T06:13:53.145831+0000","last_became_active":"2024-09-13T06:09:42.172937+0000","last_became_peered":"2024-09-13T06:09:42.172937+0000","last_unstale":"2024-09-13T06:13:53.145831+0000","last_undegraded":"2024-09-13T06:13:53.145831+0000","last_fullsized":"2024-09-13T06:13:53.145831+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'7","last_scrub_stamp":"2024-09-13T06:13:53.145587+0000","last_deep_scrub":"35'7","last_deep_scrub_stamp":"2024-09-13T06:13:53.145587+0000","last_clean_scrub_stamp":"2024-09-13T06:13:53.145587+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:03:35.737707+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"35'12","reported_seq":87,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:41.783938+0000","last_change":"2024-09-13T06:13:41.783938+0000","last_active":"2024-09-13T06:13:41.783938+0000","last_peered":"2024-09-13T06:13:41.783938+0000","last_clean":"2024-09-13T06:13:41.783938+0000","last_became_active":"2024-09-13T06:09:34.131113+0000","last_became_peered":"2024-09-13T06:09:34.131113+0000","last_unstale":"2024-09-13T06:13:41.783938+0000","last_undegraded":"2024-09-13T06:13:41.783938+0000","last_fullsized":"2024-09-13T06:13:41.783938+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'12","last_scrub_stamp":"2024-09-13T06:13:41.783695+0000","last_deep_scrub":"35'12","last_deep_scrub_stamp":"2024-09-13T06:13:41.783695+0000","last_clean_scrub_stamp":"2024-09-13T06:13:41.783695+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:56:08.039276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":60,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"35'119","reported_seq":217,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:11.124120+0000","last_change":"2024-09-13T06:14:11.124200+0000","last_active":"2024-09-13T06:14:11.124120+0000","last_peered":"2024-09-13T06:14:11.124120+0000","last_clean":"2024-09-13T06:14:11.124120+0000","last_became_active":"2024-09-13T06:09:19.561434+0000","last_became_peered":"2024-09-13T06:09:19.561434+0000","last_unstale":"2024-09-13T06:14:11.124120+0000","last_undegraded":"2024-09-13T06:14:11.124120+0000","last_fullsized":"2024-09-13T06:14:11.124120+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'119","last_scrub_stamp":"2024-09-13T06:14:11.123931+0000","last_deep_scrub":"35'119","last_deep_scrub_stamp":"2024-09-13T06:14:11.123931+0000","last_clean_scrub_stamp":"2024-09-13T06:14:11.123931+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:33:15.905969+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"35'2","reported_seq":66,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:33.750973+0000","last_change":"2024-09-13T06:14:33.751124+0000","last_active":"2024-09-13T06:14:33.750973+0000","last_peered":"2024-09-13T06:14:33.750973+0000","last_clean":"2024-09-13T06:14:33.750973+0000","last_became_active":"2024-09-13T06:09:22.217131+0000","last_became_peered":"2024-09-13T06:09:22.217131+0000","last_unstale":"2024-09-13T06:14:33.750973+0000","last_undegraded":"2024-09-13T06:14:33.750973+0000","last_fullsized":"2024-09-13T06:14:33.750973+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:33.750761+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:33.750761+0000","last_clean_scrub_stamp":"2024-09-13T06:14:33.750761+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:40:48.805428+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00090967000000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"35'4","reported_seq":54,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:13.937126+0000","last_change":"2024-09-13T06:14:13.937187+0000","last_active":"2024-09-13T06:14:13.937126+0000","last_peered":"2024-09-13T06:14:13.937126+0000","last_clean":"2024-09-13T06:14:13.937126+0000","last_became_active":"2024-09-13T06:09:32.141646+0000","last_became_peered":"2024-09-13T06:09:32.141646+0000","last_unstale":"2024-09-13T06:14:13.937126+0000","last_undegraded":"2024-09-13T06:14:13.937126+0000","last_fullsized":"2024-09-13T06:14:13.937126+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:14:13.936858+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:14:13.936858+0000","last_clean_scrub_stamp":"2024-09-13T06:14:13.936858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:04:46.119839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:35.101614+0000","last_change":"2024-09-13T06:13:35.101614+0000","last_active":"2024-09-13T06:13:35.101614+0000","last_peered":"2024-09-13T06:13:35.101614+0000","last_clean":"2024-09-13T06:13:35.101614+0000","last_became_active":"2024-09-13T06:09:36.140417+0000","last_became_peered":"2024-09-13T06:09:36.140417+0000","last_unstale":"2024-09-13T06:13:35.101614+0000","last_undegraded":"2024-09-13T06:13:35.101614+0000","last_fullsized":"2024-09-13T06:13:35.101614+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:35.101340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:35.101340+0000","last_clean_scrub_stamp":"2024-09-13T06:13:35.101340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:29:39.130402+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"35'90","reported_seq":181,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:53.943462+0000","last_change":"2024-09-13T06:13:53.943462+0000","last_active":"2024-09-13T06:13:53.943462+0000","last_peered":"2024-09-13T06:13:53.943462+0000","last_clean":"2024-09-13T06:13:53.943462+0000","last_became_active":"2024-09-13T06:09:38.176365+0000","last_became_peered":"2024-09-13T06:09:38.176365+0000","last_unstale":"2024-09-13T06:13:53.943462+0000","last_undegraded":"2024-09-13T06:13:53.943462+0000","last_fullsized":"2024-09-13T06:13:53.943462+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'90","last_scrub_stamp":"2024-09-13T06:13:53.943088+0000","last_deep_scrub":"35'90","last_deep_scrub_stamp":"2024-09-13T06:13:53.943088+0000","last_clean_scrub_stamp":"2024-09-13T06:13:53.943088+0000","objects_scrubbed":5,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:10:02.356345+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:44.206956+0000","last_change":"2024-09-13T06:13:44.206956+0000","last_active":"2024-09-13T06:13:44.206956+0000","last_peered":"2024-09-13T06:13:44.206956+0000","last_clean":"2024-09-13T06:13:44.206956+0000","last_became_active":"2024-09-13T06:09:40.178872+0000","last_became_peered":"2024-09-13T06:09:40.178872+0000","last_unstale":"2024-09-13T06:13:44.206956+0000","last_undegraded":"2024-09-13T06:13:44.206956+0000","last_fullsized":"2024-09-13T06:13:44.206956+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:44.206706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:44.206706+0000","last_clean_scrub_stamp":"2024-09-13T06:13:44.206706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:34:21.273218+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"35'82","reported_seq":173,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:36.470775+0000","last_change":"2024-09-13T06:13:36.470775+0000","last_active":"2024-09-13T06:13:36.470775+0000","last_peered":"2024-09-13T06:13:36.470775+0000","last_clean":"2024-09-13T06:13:36.470775+0000","last_became_active":"2024-09-13T06:09:42.197803+0000","last_became_peered":"2024-09-13T06:09:42.197803+0000","last_unstale":"2024-09-13T06:13:36.470775+0000","last_undegraded":"2024-09-13T06:13:36.470775+0000","last_fullsized":"2024-09-13T06:13:36.470775+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'82","last_scrub_stamp":"2024-09-13T06:13:36.470522+0000","last_deep_scrub":"35'82","last_deep_scrub_stamp":"2024-09-13T06:13:36.470522+0000","last_clean_scrub_stamp":"2024-09-13T06:13:36.470522+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:55:18.490378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"35'10","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:21.656806+0000","last_change":"2024-09-13T06:14:21.656806+0000","last_active":"2024-09-13T06:14:21.656806+0000","last_peered":"2024-09-13T06:14:21.656806+0000","last_clean":"2024-09-13T06:14:21.656806+0000","last_became_active":"2024-09-13T06:10:10.941771+0000","last_became_peered":"2024-09-13T06:10:10.941771+0000","last_unstale":"2024-09-13T06:14:21.656806+0000","last_undegraded":"2024-09-13T06:14:21.656806+0000","last_fullsized":"2024-09-13T06:14:21.656806+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-09-13T06:14:21.656523+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-09-13T06:14:21.656523+0000","last_clean_scrub_stamp":"2024-09-13T06:14:21.656523+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:16:54.029670+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:36.799773+0000","last_change":"2024-09-13T06:14:36.799830+0000","last_active":"2024-09-13T06:14:36.799773+0000","last_peered":"2024-09-13T06:14:36.799773+0000","last_clean":"2024-09-13T06:14:36.799773+0000","last_became_active":"2024-09-13T06:09:22.217643+0000","last_became_peered":"2024-09-13T06:09:22.217643+0000","last_unstale":"2024-09-13T06:14:36.799773+0000","last_undegraded":"2024-09-13T06:14:36.799773+0000","last_fullsized":"2024-09-13T06:14:36.799773+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:36.799576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:36.799576+0000","last_clean_scrub_stamp":"2024-09-13T06:14:36.799576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:37:27.011049+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00082521999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"35'2","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:04.995337+0000","last_change":"2024-09-13T06:14:04.995517+0000","last_active":"2024-09-13T06:14:04.995337+0000","last_peered":"2024-09-13T06:14:04.995337+0000","last_clean":"2024-09-13T06:14:04.995337+0000","last_became_active":"2024-09-13T06:09:32.147837+0000","last_became_peered":"2024-09-13T06:09:32.147837+0000","last_unstale":"2024-09-13T06:14:04.995337+0000","last_undegraded":"2024-09-13T06:14:04.995337+0000","last_fullsized":"2024-09-13T06:14:04.995337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:04.995114+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:04.995114+0000","last_clean_scrub_stamp":"2024-09-13T06:14:04.995114+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:15:29.178549+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:28.911118+0000","last_change":"2024-09-13T06:13:28.911118+0000","last_active":"2024-09-13T06:13:28.911118+0000","last_peered":"2024-09-13T06:13:28.911118+0000","last_clean":"2024-09-13T06:13:28.911118+0000","last_became_active":"2024-09-13T06:09:36.153430+0000","last_became_peered":"2024-09-13T06:09:36.153430+0000","last_unstale":"2024-09-13T06:13:28.911118+0000","last_undegraded":"2024-09-13T06:13:28.911118+0000","last_fullsized":"2024-09-13T06:13:28.911118+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:28.910878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:28.910878+0000","last_clean_scrub_stamp":"2024-09-13T06:13:28.910878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:38:20.711196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"35'291","reported_seq":518,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:30.250325+0000","last_change":"2024-09-13T06:13:30.250325+0000","last_active":"2024-09-13T06:13:30.250325+0000","last_peered":"2024-09-13T06:13:30.250325+0000","last_clean":"2024-09-13T06:13:30.250325+0000","last_became_active":"2024-09-13T06:09:38.160192+0000","last_became_peered":"2024-09-13T06:09:38.160192+0000","last_unstale":"2024-09-13T06:13:30.250325+0000","last_undegraded":"2024-09-13T06:13:30.250325+0000","last_fullsized":"2024-09-13T06:13:30.250325+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'291","last_scrub_stamp":"2024-09-13T06:13:30.250026+0000","last_deep_scrub":"35'291","last_deep_scrub_stamp":"2024-09-13T06:13:30.250026+0000","last_clean_scrub_stamp":"2024-09-13T06:13:30.250026+0000","objects_scrubbed":10,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:19:15.055011+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:51.890848+0000","last_change":"2024-09-13T06:13:51.890848+0000","last_active":"2024-09-13T06:13:51.890848+0000","last_peered":"2024-09-13T06:13:51.890848+0000","last_clean":"2024-09-13T06:13:51.890848+0000","last_became_active":"2024-09-13T06:09:40.188859+0000","last_became_peered":"2024-09-13T06:09:40.188859+0000","last_unstale":"2024-09-13T06:13:51.890848+0000","last_undegraded":"2024-09-13T06:13:51.890848+0000","last_fullsized":"2024-09-13T06:13:51.890848+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:51.890601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:51.890601+0000","last_clean_scrub_stamp":"2024-09-13T06:13:51.890601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:55:29.874902+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"35'6","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:25.168319+0000","last_change":"2024-09-13T06:14:25.168387+0000","last_active":"2024-09-13T06:14:25.168319+0000","last_peered":"2024-09-13T06:14:25.168319+0000","last_clean":"2024-09-13T06:14:25.168319+0000","last_became_active":"2024-09-13T06:09:42.204736+0000","last_became_peered":"2024-09-13T06:09:42.204736+0000","last_unstale":"2024-09-13T06:14:25.168319+0000","last_undegraded":"2024-09-13T06:14:25.168319+0000","last_fullsized":"2024-09-13T06:14:25.168319+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:14:25.168119+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:14:25.168119+0000","last_clean_scrub_stamp":"2024-09-13T06:14:25.168119+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:34:10.606069+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"35'8","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:49.136585+0000","last_change":"2024-09-13T06:13:49.136585+0000","last_active":"2024-09-13T06:13:49.136585+0000","last_peered":"2024-09-13T06:13:49.136585+0000","last_clean":"2024-09-13T06:13:49.136585+0000","last_became_active":"2024-09-13T06:09:34.131564+0000","last_became_peered":"2024-09-13T06:09:34.131564+0000","last_unstale":"2024-09-13T06:13:49.136585+0000","last_undegraded":"2024-09-13T06:13:49.136585+0000","last_fullsized":"2024-09-13T06:13:49.136585+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-13T06:13:49.136299+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-13T06:13:49.136299+0000","last_clean_scrub_stamp":"2024-09-13T06:13:49.136299+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:11:56.625206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":62,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:06.429945+0000","last_change":"2024-09-13T06:14:06.429996+0000","last_active":"2024-09-13T06:14:06.429945+0000","last_peered":"2024-09-13T06:14:06.429945+0000","last_clean":"2024-09-13T06:14:06.429945+0000","last_became_active":"2024-09-13T06:09:22.214952+0000","last_became_peered":"2024-09-13T06:09:22.214952+0000","last_unstale":"2024-09-13T06:14:06.429945+0000","last_undegraded":"2024-09-13T06:14:06.429945+0000","last_fullsized":"2024-09-13T06:14:06.429945+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:06.429751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:06.429751+0000","last_clean_scrub_stamp":"2024-09-13T06:14:06.429751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:38:36.699202+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00097860299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:59.106249+0000","last_change":"2024-09-13T06:13:59.106380+0000","last_active":"2024-09-13T06:13:59.106249+0000","last_peered":"2024-09-13T06:13:59.106249+0000","last_clean":"2024-09-13T06:13:59.106249+0000","last_became_active":"2024-09-13T06:09:32.148803+0000","last_became_peered":"2024-09-13T06:09:32.148803+0000","last_unstale":"2024-09-13T06:13:59.106249+0000","last_undegraded":"2024-09-13T06:13:59.106249+0000","last_fullsized":"2024-09-13T06:13:59.106249+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:59.105957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:59.105957+0000","last_clean_scrub_stamp":"2024-09-13T06:13:59.105957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:47:01.112409+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"35'2","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:47.511185+0000","last_change":"2024-09-13T06:13:47.511185+0000","last_active":"2024-09-13T06:13:47.511185+0000","last_peered":"2024-09-13T06:13:47.511185+0000","last_clean":"2024-09-13T06:13:47.511185+0000","last_became_active":"2024-09-13T06:09:36.126497+0000","last_became_peered":"2024-09-13T06:09:36.126497+0000","last_unstale":"2024-09-13T06:13:47.511185+0000","last_undegraded":"2024-09-13T06:13:47.511185+0000","last_fullsized":"2024-09-13T06:13:47.511185+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:13:47.510914+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:13:47.510914+0000","last_clean_scrub_stamp":"2024-09-13T06:13:47.510914+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:50:58.108495+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"35'24","reported_seq":103,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:33.428736+0000","last_change":"2024-09-13T06:13:33.428736+0000","last_active":"2024-09-13T06:13:33.428736+0000","last_peered":"2024-09-13T06:13:33.428736+0000","last_clean":"2024-09-13T06:13:33.428736+0000","last_became_active":"2024-09-13T06:09:38.162358+0000","last_became_peered":"2024-09-13T06:09:38.162358+0000","last_unstale":"2024-09-13T06:13:33.428736+0000","last_undegraded":"2024-09-13T06:13:33.428736+0000","last_fullsized":"2024-09-13T06:13:33.428736+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'24","last_scrub_stamp":"2024-09-13T06:13:33.428464+0000","last_deep_scrub":"35'24","last_deep_scrub_stamp":"2024-09-13T06:13:33.428464+0000","last_clean_scrub_stamp":"2024-09-13T06:13:33.428464+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:54:34.152803+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:40.255183+0000","last_change":"2024-09-13T06:13:40.255183+0000","last_active":"2024-09-13T06:13:40.255183+0000","last_peered":"2024-09-13T06:13:40.255183+0000","last_clean":"2024-09-13T06:13:40.255183+0000","last_became_active":"2024-09-13T06:09:40.179250+0000","last_became_peered":"2024-09-13T06:09:40.179250+0000","last_unstale":"2024-09-13T06:13:40.255183+0000","last_undegraded":"2024-09-13T06:13:40.255183+0000","last_fullsized":"2024-09-13T06:13:40.255183+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:40.254851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:40.254851+0000","last_clean_scrub_stamp":"2024-09-13T06:13:40.254851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:54:39.886202+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"33'2","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:43.818645+0000","last_change":"2024-09-13T06:14:43.818708+0000","last_active":"2024-09-13T06:14:43.818645+0000","last_peered":"2024-09-13T06:14:43.818645+0000","last_clean":"2024-09-13T06:14:43.818645+0000","last_became_active":"2024-09-13T06:09:42.203232+0000","last_became_peered":"2024-09-13T06:09:42.203232+0000","last_unstale":"2024-09-13T06:14:43.818645+0000","last_undegraded":"2024-09-13T06:14:43.818645+0000","last_fullsized":"2024-09-13T06:14:43.818645+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T06:14:43.818433+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T06:14:43.818433+0000","last_clean_scrub_stamp":"2024-09-13T06:14:43.818433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:40:47.178798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"35'6","reported_seq":59,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:02.039645+0000","last_change":"2024-09-13T06:14:02.039712+0000","last_active":"2024-09-13T06:14:02.039645+0000","last_peered":"2024-09-13T06:14:02.039645+0000","last_clean":"2024-09-13T06:14:02.039645+0000","last_became_active":"2024-09-13T06:09:34.113002+0000","last_became_peered":"2024-09-13T06:09:34.113002+0000","last_unstale":"2024-09-13T06:14:02.039645+0000","last_undegraded":"2024-09-13T06:14:02.039645+0000","last_fullsized":"2024-09-13T06:14:02.039645+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:14:02.039450+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:14:02.039450+0000","last_clean_scrub_stamp":"2024-09-13T06:14:02.039450+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:56:20.449806+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"35'3","reported_seq":67,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:35.773731+0000","last_change":"2024-09-13T06:14:35.773796+0000","last_active":"2024-09-13T06:14:35.773731+0000","last_peered":"2024-09-13T06:14:35.773731+0000","last_clean":"2024-09-13T06:14:35.773731+0000","last_became_active":"2024-09-13T06:09:22.217581+0000","last_became_peered":"2024-09-13T06:09:22.217581+0000","last_unstale":"2024-09-13T06:14:35.773731+0000","last_undegraded":"2024-09-13T06:14:35.773731+0000","last_fullsized":"2024-09-13T06:14:35.773731+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3","last_scrub_stamp":"2024-09-13T06:14:35.773555+0000","last_deep_scrub":"35'3","last_deep_scrub_stamp":"2024-09-13T06:14:35.773555+0000","last_clean_scrub_stamp":"2024-09-13T06:14:35.773555+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:17:14.903564+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.0022711580000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:59.389088+0000","last_change":"2024-09-13T06:13:59.389148+0000","last_active":"2024-09-13T06:13:59.389088+0000","last_peered":"2024-09-13T06:13:59.389088+0000","last_clean":"2024-09-13T06:13:59.389088+0000","last_became_active":"2024-09-13T06:09:32.138838+0000","last_became_peered":"2024-09-13T06:09:32.138838+0000","last_unstale":"2024-09-13T06:13:59.389088+0000","last_undegraded":"2024-09-13T06:13:59.389088+0000","last_fullsized":"2024-09-13T06:13:59.389088+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:59.388824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:59.388824+0000","last_clean_scrub_stamp":"2024-09-13T06:13:59.388824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:54:30.824903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:18.615698+0000","last_change":"2024-09-13T06:14:18.615698+0000","last_active":"2024-09-13T06:14:18.615698+0000","last_peered":"2024-09-13T06:14:18.615698+0000","last_clean":"2024-09-13T06:14:18.615698+0000","last_became_active":"2024-09-13T06:10:10.809216+0000","last_became_peered":"2024-09-13T06:10:10.809216+0000","last_unstale":"2024-09-13T06:14:18.615698+0000","last_undegraded":"2024-09-13T06:14:18.615698+0000","last_fullsized":"2024-09-13T06:14:18.615698+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:18.615450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:18.615450+0000","last_clean_scrub_stamp":"2024-09-13T06:14:18.615450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:29:37.013948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"35'20","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:49.867101+0000","last_change":"2024-09-13T06:13:49.867101+0000","last_active":"2024-09-13T06:13:49.867101+0000","last_peered":"2024-09-13T06:13:49.867101+0000","last_clean":"2024-09-13T06:13:49.867101+0000","last_became_active":"2024-09-13T06:09:38.176307+0000","last_became_peered":"2024-09-13T06:09:38.176307+0000","last_unstale":"2024-09-13T06:13:49.867101+0000","last_undegraded":"2024-09-13T06:13:49.867101+0000","last_fullsized":"2024-09-13T06:13:49.867101+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'20","last_scrub_stamp":"2024-09-13T06:13:49.866714+0000","last_deep_scrub":"35'20","last_deep_scrub_stamp":"2024-09-13T06:13:49.866714+0000","last_clean_scrub_stamp":"2024-09-13T06:13:49.866714+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:43:14.509705+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:47.833648+0000","last_change":"2024-09-13T06:13:47.833648+0000","last_active":"2024-09-13T06:13:47.833648+0000","last_peered":"2024-09-13T06:13:47.833648+0000","last_clean":"2024-09-13T06:13:47.833648+0000","last_became_active":"2024-09-13T06:09:40.189259+0000","last_became_peered":"2024-09-13T06:09:40.189259+0000","last_unstale":"2024-09-13T06:13:47.833648+0000","last_undegraded":"2024-09-13T06:13:47.833648+0000","last_fullsized":"2024-09-13T06:13:47.833648+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:47.833278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:47.833278+0000","last_clean_scrub_stamp":"2024-09-13T06:13:47.833278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:53:00.141037+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"35'4","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:22.099848+0000","last_change":"2024-09-13T06:14:22.099980+0000","last_active":"2024-09-13T06:14:22.099848+0000","last_peered":"2024-09-13T06:14:22.099848+0000","last_clean":"2024-09-13T06:14:22.099848+0000","last_became_active":"2024-09-13T06:09:42.185210+0000","last_became_peered":"2024-09-13T06:09:42.185210+0000","last_unstale":"2024-09-13T06:14:22.099848+0000","last_undegraded":"2024-09-13T06:14:22.099848+0000","last_fullsized":"2024-09-13T06:14:22.099848+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:14:22.099618+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:14:22.099618+0000","last_clean_scrub_stamp":"2024-09-13T06:14:22.099618+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:33:12.893491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"35'4","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:54.120718+0000","last_change":"2024-09-13T06:13:54.120789+0000","last_active":"2024-09-13T06:13:54.120718+0000","last_peered":"2024-09-13T06:13:54.120718+0000","last_clean":"2024-09-13T06:13:54.120718+0000","last_became_active":"2024-09-13T06:09:34.119283+0000","last_became_peered":"2024-09-13T06:09:34.119283+0000","last_unstale":"2024-09-13T06:13:54.120718+0000","last_undegraded":"2024-09-13T06:13:54.120718+0000","last_fullsized":"2024-09-13T06:13:54.120718+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:13:54.120527+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:13:54.120527+0000","last_clean_scrub_stamp":"2024-09-13T06:13:54.120527+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:35:15.451075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"35'2","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:57.405089+0000","last_change":"2024-09-13T06:13:57.405153+0000","last_active":"2024-09-13T06:13:57.405089+0000","last_peered":"2024-09-13T06:13:57.405089+0000","last_clean":"2024-09-13T06:13:57.405089+0000","last_became_active":"2024-09-13T06:09:32.139313+0000","last_became_peered":"2024-09-13T06:09:32.139313+0000","last_unstale":"2024-09-13T06:13:57.405089+0000","last_undegraded":"2024-09-13T06:13:57.405089+0000","last_fullsized":"2024-09-13T06:13:57.405089+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:13:57.404830+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:13:57.404830+0000","last_clean_scrub_stamp":"2024-09-13T06:13:57.404830+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:04:45.319192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:09.975877+0000","last_change":"2024-09-13T06:14:09.975989+0000","last_active":"2024-09-13T06:14:09.975877+0000","last_peered":"2024-09-13T06:14:09.975877+0000","last_clean":"2024-09-13T06:14:09.975877+0000","last_became_active":"2024-09-13T06:09:22.216659+0000","last_became_peered":"2024-09-13T06:09:22.216659+0000","last_unstale":"2024-09-13T06:14:09.975877+0000","last_undegraded":"2024-09-13T06:14:09.975877+0000","last_fullsized":"2024-09-13T06:14:09.975877+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:09.975665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:09.975665+0000","last_clean_scrub_stamp":"2024-09-13T06:14:09.975665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:35:05.023936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010625330000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"35'2","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:46.126854+0000","last_change":"2024-09-13T06:13:46.126916+0000","last_active":"2024-09-13T06:13:46.126854+0000","last_peered":"2024-09-13T06:13:46.126854+0000","last_clean":"2024-09-13T06:13:46.126854+0000","last_became_active":"2024-09-13T06:09:36.132376+0000","last_became_peered":"2024-09-13T06:09:36.132376+0000","last_unstale":"2024-09-13T06:13:46.126854+0000","last_undegraded":"2024-09-13T06:13:46.126854+0000","last_fullsized":"2024-09-13T06:13:46.126854+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:13:46.126675+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:13:46.126675+0000","last_clean_scrub_stamp":"2024-09-13T06:13:46.126675+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:05:41.556048+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"35'74","reported_seq":151,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:33.324338+0000","last_change":"2024-09-13T06:13:33.324338+0000","last_active":"2024-09-13T06:13:33.324338+0000","last_peered":"2024-09-13T06:13:33.324338+0000","last_clean":"2024-09-13T06:13:33.324338+0000","last_became_active":"2024-09-13T06:09:38.157579+0000","last_became_peered":"2024-09-13T06:09:38.157579+0000","last_unstale":"2024-09-13T06:13:33.324338+0000","last_undegraded":"2024-09-13T06:13:33.324338+0000","last_fullsized":"2024-09-13T06:13:33.324338+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'74","last_scrub_stamp":"2024-09-13T06:13:33.324060+0000","last_deep_scrub":"35'74","last_deep_scrub_stamp":"2024-09-13T06:13:33.324060+0000","last_clean_scrub_stamp":"2024-09-13T06:13:33.324060+0000","objects_scrubbed":9,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:44:12.725129+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:28.380182+0000","last_change":"2024-09-13T06:13:28.380182+0000","last_active":"2024-09-13T06:13:28.380182+0000","last_peered":"2024-09-13T06:13:28.380182+0000","last_clean":"2024-09-13T06:13:28.380182+0000","last_became_active":"2024-09-13T06:09:40.185234+0000","last_became_peered":"2024-09-13T06:09:40.185234+0000","last_unstale":"2024-09-13T06:13:28.380182+0000","last_undegraded":"2024-09-13T06:13:28.380182+0000","last_fullsized":"2024-09-13T06:13:28.380182+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:28.379942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:28.379942+0000","last_clean_scrub_stamp":"2024-09-13T06:13:28.379942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:42:49.566445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"35'11","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:52.119845+0000","last_change":"2024-09-13T06:13:52.119845+0000","last_active":"2024-09-13T06:13:52.119845+0000","last_peered":"2024-09-13T06:13:52.119845+0000","last_clean":"2024-09-13T06:13:52.119845+0000","last_became_active":"2024-09-13T06:09:42.170302+0000","last_became_peered":"2024-09-13T06:09:42.170302+0000","last_unstale":"2024-09-13T06:13:52.119845+0000","last_undegraded":"2024-09-13T06:13:52.119845+0000","last_fullsized":"2024-09-13T06:13:52.119845+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'11","last_scrub_stamp":"2024-09-13T06:13:52.119492+0000","last_deep_scrub":"35'11","last_deep_scrub_stamp":"2024-09-13T06:13:52.119492+0000","last_clean_scrub_stamp":"2024-09-13T06:13:52.119492+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:05:49.867986+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":25,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"35'10","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:52.096124+0000","last_change":"2024-09-13T06:13:52.096242+0000","last_active":"2024-09-13T06:13:52.096124+0000","last_peered":"2024-09-13T06:13:52.096124+0000","last_clean":"2024-09-13T06:13:52.096124+0000","last_became_active":"2024-09-13T06:09:34.121836+0000","last_became_peered":"2024-09-13T06:09:34.121836+0000","last_unstale":"2024-09-13T06:13:52.096124+0000","last_undegraded":"2024-09-13T06:13:52.096124+0000","last_fullsized":"2024-09-13T06:13:52.096124+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-09-13T06:13:52.095831+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-09-13T06:13:52.095831+0000","last_clean_scrub_stamp":"2024-09-13T06:13:52.095831+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:38:45.110796+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:14.961334+0000","last_change":"2024-09-13T06:14:14.961395+0000","last_active":"2024-09-13T06:14:14.961334+0000","last_peered":"2024-09-13T06:14:14.961334+0000","last_clean":"2024-09-13T06:14:14.961334+0000","last_became_active":"2024-09-13T06:09:32.136238+0000","last_became_peered":"2024-09-13T06:09:32.136238+0000","last_unstale":"2024-09-13T06:14:14.961334+0000","last_undegraded":"2024-09-13T06:14:14.961334+0000","last_fullsized":"2024-09-13T06:14:14.961334+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:14.961141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:14.961141+0000","last_clean_scrub_stamp":"2024-09-13T06:14:14.961141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:51:38.057927+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:34.757409+0000","last_change":"2024-09-13T06:14:34.757465+0000","last_active":"2024-09-13T06:14:34.757409+0000","last_peered":"2024-09-13T06:14:34.757409+0000","last_clean":"2024-09-13T06:14:34.757409+0000","last_became_active":"2024-09-13T06:09:22.217809+0000","last_became_peered":"2024-09-13T06:09:22.217809+0000","last_unstale":"2024-09-13T06:14:34.757409+0000","last_undegraded":"2024-09-13T06:14:34.757409+0000","last_fullsized":"2024-09-13T06:14:34.757409+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:34.757206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:34.757206+0000","last_clean_scrub_stamp":"2024-09-13T06:14:34.757206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:45:05.669516+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001447545,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:33.855853+0000","last_change":"2024-09-13T06:13:33.855853+0000","last_active":"2024-09-13T06:13:33.855853+0000","last_peered":"2024-09-13T06:13:33.855853+0000","last_clean":"2024-09-13T06:13:33.855853+0000","last_became_active":"2024-09-13T06:09:36.151605+0000","last_became_peered":"2024-09-13T06:09:36.151605+0000","last_unstale":"2024-09-13T06:13:33.855853+0000","last_undegraded":"2024-09-13T06:13:33.855853+0000","last_fullsized":"2024-09-13T06:13:33.855853+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:33.855604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:33.855604+0000","last_clean_scrub_stamp":"2024-09-13T06:13:33.855604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:30:58.639342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"35'22","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:26.304189+0000","last_change":"2024-09-13T06:13:26.304189+0000","last_active":"2024-09-13T06:13:26.304189+0000","last_peered":"2024-09-13T06:13:26.304189+0000","last_clean":"2024-09-13T06:13:26.304189+0000","last_became_active":"2024-09-13T06:09:38.165916+0000","last_became_peered":"2024-09-13T06:09:38.165916+0000","last_unstale":"2024-09-13T06:13:26.304189+0000","last_undegraded":"2024-09-13T06:13:26.304189+0000","last_fullsized":"2024-09-13T06:13:26.304189+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'22","last_scrub_stamp":"2024-09-13T06:13:26.303565+0000","last_deep_scrub":"35'22","last_deep_scrub_stamp":"2024-09-13T06:13:26.303565+0000","last_clean_scrub_stamp":"2024-09-13T06:13:26.303565+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:32:31.420814+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"35'285","reported_seq":360,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:37.090244+0000","last_change":"2024-09-13T06:13:37.090244+0000","last_active":"2024-09-13T06:13:37.090244+0000","last_peered":"2024-09-13T06:13:37.090244+0000","last_clean":"2024-09-13T06:13:37.090244+0000","last_became_active":"2024-09-13T06:09:40.181415+0000","last_became_peered":"2024-09-13T06:09:40.181415+0000","last_unstale":"2024-09-13T06:13:37.090244+0000","last_undegraded":"2024-09-13T06:13:37.090244+0000","last_fullsized":"2024-09-13T06:13:37.090244+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-13T06:13:37.089987+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-13T06:13:37.089987+0000","last_clean_scrub_stamp":"2024-09-13T06:13:37.089987+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:47:34.898773+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:03.940309+0000","last_change":"2024-09-13T06:14:03.940309+0000","last_active":"2024-09-13T06:14:03.940309+0000","last_peered":"2024-09-13T06:14:03.940309+0000","last_clean":"2024-09-13T06:14:03.940309+0000","last_became_active":"2024-09-13T06:09:42.194558+0000","last_became_peered":"2024-09-13T06:09:42.194558+0000","last_unstale":"2024-09-13T06:14:03.940309+0000","last_undegraded":"2024-09-13T06:14:03.940309+0000","last_fullsized":"2024-09-13T06:14:03.940309+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:03.940064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:03.940064+0000","last_clean_scrub_stamp":"2024-09-13T06:14:03.940064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:19:29.892551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"35'6","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:19.625931+0000","last_change":"2024-09-13T06:14:19.626067+0000","last_active":"2024-09-13T06:14:19.625931+0000","last_peered":"2024-09-13T06:14:19.625931+0000","last_clean":"2024-09-13T06:14:19.625931+0000","last_became_active":"2024-09-13T06:10:10.813656+0000","last_became_peered":"2024-09-13T06:10:10.813656+0000","last_unstale":"2024-09-13T06:14:19.625931+0000","last_undegraded":"2024-09-13T06:14:19.625931+0000","last_fullsized":"2024-09-13T06:14:19.625931+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:14:19.625685+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:14:19.625685+0000","last_clean_scrub_stamp":"2024-09-13T06:14:19.625685+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:06:50.177490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:21.892437+0000","last_change":"2024-09-13T06:14:21.892499+0000","last_active":"2024-09-13T06:14:21.892437+0000","last_peered":"2024-09-13T06:14:21.892437+0000","last_clean":"2024-09-13T06:14:21.892437+0000","last_became_active":"2024-09-13T06:09:32.130385+0000","last_became_peered":"2024-09-13T06:09:32.130385+0000","last_unstale":"2024-09-13T06:14:21.892437+0000","last_undegraded":"2024-09-13T06:14:21.892437+0000","last_fullsized":"2024-09-13T06:14:21.892437+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:21.892222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:21.892222+0000","last_clean_scrub_stamp":"2024-09-13T06:14:21.892222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:46:35.502960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:10.929954+0000","last_change":"2024-09-13T06:14:10.930007+0000","last_active":"2024-09-13T06:14:10.929954+0000","last_peered":"2024-09-13T06:14:10.929954+0000","last_clean":"2024-09-13T06:14:10.929954+0000","last_became_active":"2024-09-13T06:09:22.216905+0000","last_became_peered":"2024-09-13T06:09:22.216905+0000","last_unstale":"2024-09-13T06:14:10.929954+0000","last_undegraded":"2024-09-13T06:14:10.929954+0000","last_fullsized":"2024-09-13T06:14:10.929954+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:10.929727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:10.929727+0000","last_clean_scrub_stamp":"2024-09-13T06:14:10.929727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:09:22.730266+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001005588,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:32.824584+0000","last_change":"2024-09-13T06:13:32.824584+0000","last_active":"2024-09-13T06:13:32.824584+0000","last_peered":"2024-09-13T06:13:32.824584+0000","last_clean":"2024-09-13T06:13:32.824584+0000","last_became_active":"2024-09-13T06:09:36.149051+0000","last_became_peered":"2024-09-13T06:09:36.149051+0000","last_unstale":"2024-09-13T06:13:32.824584+0000","last_undegraded":"2024-09-13T06:13:32.824584+0000","last_fullsized":"2024-09-13T06:13:32.824584+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:32.824332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:32.824332+0000","last_clean_scrub_stamp":"2024-09-13T06:13:32.824332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:49:10.096883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"35'15","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:39.760213+0000","last_change":"2024-09-13T06:13:39.760213+0000","last_active":"2024-09-13T06:13:39.760213+0000","last_peered":"2024-09-13T06:13:39.760213+0000","last_clean":"2024-09-13T06:13:39.760213+0000","last_became_active":"2024-09-13T06:09:38.173017+0000","last_became_peered":"2024-09-13T06:09:38.173017+0000","last_unstale":"2024-09-13T06:13:39.760213+0000","last_undegraded":"2024-09-13T06:13:39.760213+0000","last_fullsized":"2024-09-13T06:13:39.760213+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'15","last_scrub_stamp":"2024-09-13T06:13:39.759783+0000","last_deep_scrub":"35'15","last_deep_scrub_stamp":"2024-09-13T06:13:39.759783+0000","last_clean_scrub_stamp":"2024-09-13T06:13:39.759783+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:53:57.061723+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"35'285","reported_seq":403,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:30.299531+0000","last_change":"2024-09-13T06:13:30.299531+0000","last_active":"2024-09-13T06:13:30.299531+0000","last_peered":"2024-09-13T06:13:30.299531+0000","last_clean":"2024-09-13T06:13:30.299531+0000","last_became_active":"2024-09-13T06:09:40.170879+0000","last_became_peered":"2024-09-13T06:09:40.170879+0000","last_unstale":"2024-09-13T06:13:30.299531+0000","last_undegraded":"2024-09-13T06:13:30.299531+0000","last_fullsized":"2024-09-13T06:13:30.299531+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-13T06:13:30.299279+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-13T06:13:30.299279+0000","last_clean_scrub_stamp":"2024-09-13T06:13:30.299279+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:49:19.940955+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"33'3","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:20.142740+0000","last_change":"2024-09-13T06:14:20.142848+0000","last_active":"2024-09-13T06:14:20.142740+0000","last_peered":"2024-09-13T06:14:20.142740+0000","last_clean":"2024-09-13T06:14:20.142740+0000","last_became_active":"2024-09-13T06:09:42.178890+0000","last_became_peered":"2024-09-13T06:09:42.178890+0000","last_unstale":"2024-09-13T06:14:20.142740+0000","last_undegraded":"2024-09-13T06:14:20.142740+0000","last_fullsized":"2024-09-13T06:14:20.142740+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-09-13T06:14:20.142460+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-09-13T06:14:20.142460+0000","last_clean_scrub_stamp":"2024-09-13T06:14:20.142460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:10:28.555717+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"35'4","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:58.403221+0000","last_change":"2024-09-13T06:13:58.403253+0000","last_active":"2024-09-13T06:13:58.403221+0000","last_peered":"2024-09-13T06:13:58.403221+0000","last_clean":"2024-09-13T06:13:58.403221+0000","last_became_active":"2024-09-13T06:09:34.104194+0000","last_became_peered":"2024-09-13T06:09:34.104194+0000","last_unstale":"2024-09-13T06:13:58.403221+0000","last_undegraded":"2024-09-13T06:13:58.403221+0000","last_fullsized":"2024-09-13T06:13:58.403221+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:13:58.403115+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:13:58.403115+0000","last_clean_scrub_stamp":"2024-09-13T06:13:58.403115+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:17:01.119280+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:14.077504+0000","last_change":"2024-09-13T06:14:14.077563+0000","last_active":"2024-09-13T06:14:14.077504+0000","last_peered":"2024-09-13T06:14:14.077504+0000","last_clean":"2024-09-13T06:14:14.077504+0000","last_became_active":"2024-09-13T06:09:32.118386+0000","last_became_peered":"2024-09-13T06:09:32.118386+0000","last_unstale":"2024-09-13T06:14:14.077504+0000","last_undegraded":"2024-09-13T06:14:14.077504+0000","last_fullsized":"2024-09-13T06:14:14.077504+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:14.077297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:14.077297+0000","last_clean_scrub_stamp":"2024-09-13T06:14:14.077297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:17:32.570841+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:37.793048+0000","last_change":"2024-09-13T06:14:37.793101+0000","last_active":"2024-09-13T06:14:37.793048+0000","last_peered":"2024-09-13T06:14:37.793048+0000","last_clean":"2024-09-13T06:14:37.793048+0000","last_became_active":"2024-09-13T06:09:22.495259+0000","last_became_peered":"2024-09-13T06:09:22.495259+0000","last_unstale":"2024-09-13T06:14:37.793048+0000","last_undegraded":"2024-09-13T06:14:37.793048+0000","last_fullsized":"2024-09-13T06:14:37.793048+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:37.792835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:37.792835+0000","last_clean_scrub_stamp":"2024-09-13T06:14:37.792835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:23:26.262129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002230409,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:36.776310+0000","last_change":"2024-09-13T06:13:36.776310+0000","last_active":"2024-09-13T06:13:36.776310+0000","last_peered":"2024-09-13T06:13:36.776310+0000","last_clean":"2024-09-13T06:13:36.776310+0000","last_became_active":"2024-09-13T06:09:36.144463+0000","last_became_peered":"2024-09-13T06:09:36.144463+0000","last_unstale":"2024-09-13T06:13:36.776310+0000","last_undegraded":"2024-09-13T06:13:36.776310+0000","last_fullsized":"2024-09-13T06:13:36.776310+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:36.776068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:36.776068+0000","last_clean_scrub_stamp":"2024-09-13T06:13:36.776068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:07:56.568181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"35'96","reported_seq":190,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:34.414511+0000","last_change":"2024-09-13T06:13:34.414511+0000","last_active":"2024-09-13T06:13:34.414511+0000","last_peered":"2024-09-13T06:13:34.414511+0000","last_clean":"2024-09-13T06:13:34.414511+0000","last_became_active":"2024-09-13T06:09:38.158436+0000","last_became_peered":"2024-09-13T06:09:38.158436+0000","last_unstale":"2024-09-13T06:13:34.414511+0000","last_undegraded":"2024-09-13T06:13:34.414511+0000","last_fullsized":"2024-09-13T06:13:34.414511+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'96","last_scrub_stamp":"2024-09-13T06:13:34.414208+0000","last_deep_scrub":"35'96","last_deep_scrub_stamp":"2024-09-13T06:13:34.414208+0000","last_clean_scrub_stamp":"2024-09-13T06:13:34.414208+0000","objects_scrubbed":8,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:05:39.013229+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.290882+0000","last_change":"2024-09-13T06:13:25.290882+0000","last_active":"2024-09-13T06:13:25.290882+0000","last_peered":"2024-09-13T06:13:25.290882+0000","last_clean":"2024-09-13T06:13:25.290882+0000","last_became_active":"2024-09-13T06:09:40.176677+0000","last_became_peered":"2024-09-13T06:09:40.176677+0000","last_unstale":"2024-09-13T06:13:25.290882+0000","last_undegraded":"2024-09-13T06:13:25.290882+0000","last_fullsized":"2024-09-13T06:13:25.290882+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:25.290780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:25.290780+0000","last_clean_scrub_stamp":"2024-09-13T06:13:25.290780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:27:24.453678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:15.505254+0000","last_change":"2024-09-13T06:14:15.505311+0000","last_active":"2024-09-13T06:14:15.505254+0000","last_peered":"2024-09-13T06:14:15.505254+0000","last_clean":"2024-09-13T06:14:15.505254+0000","last_became_active":"2024-09-13T06:09:42.204574+0000","last_became_peered":"2024-09-13T06:09:42.204574+0000","last_unstale":"2024-09-13T06:14:15.505254+0000","last_undegraded":"2024-09-13T06:14:15.505254+0000","last_fullsized":"2024-09-13T06:14:15.505254+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:15.505057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:15.505057+0000","last_clean_scrub_stamp":"2024-09-13T06:14:15.505057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:28:16.831802+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:40.425637+0000","last_change":"2024-09-13T06:13:40.425637+0000","last_active":"2024-09-13T06:13:40.425637+0000","last_peered":"2024-09-13T06:13:40.425637+0000","last_clean":"2024-09-13T06:13:40.425637+0000","last_became_active":"2024-09-13T06:09:42.197788+0000","last_became_peered":"2024-09-13T06:09:42.197788+0000","last_unstale":"2024-09-13T06:13:40.425637+0000","last_undegraded":"2024-09-13T06:13:40.425637+0000","last_fullsized":"2024-09-13T06:13:40.425637+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:40.425298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:40.425298+0000","last_clean_scrub_stamp":"2024-09-13T06:13:40.425298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:01:43.246247+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"35'8","reported_seq":71,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:54.474712+0000","last_change":"2024-09-13T06:13:54.474712+0000","last_active":"2024-09-13T06:13:54.474712+0000","last_peered":"2024-09-13T06:13:54.474712+0000","last_clean":"2024-09-13T06:13:54.474712+0000","last_became_active":"2024-09-13T06:09:34.101193+0000","last_became_peered":"2024-09-13T06:09:34.101193+0000","last_unstale":"2024-09-13T06:13:54.474712+0000","last_undegraded":"2024-09-13T06:13:54.474712+0000","last_fullsized":"2024-09-13T06:13:54.474712+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-13T06:13:54.474414+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-13T06:13:54.474414+0000","last_clean_scrub_stamp":"2024-09-13T06:13:54.474414+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:46:58.633819+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:32.741083+0000","last_change":"2024-09-13T06:14:32.741148+0000","last_active":"2024-09-13T06:14:32.741083+0000","last_peered":"2024-09-13T06:14:32.741083+0000","last_clean":"2024-09-13T06:14:32.741083+0000","last_became_active":"2024-09-13T06:09:32.124198+0000","last_became_peered":"2024-09-13T06:09:32.124198+0000","last_unstale":"2024-09-13T06:14:32.741083+0000","last_undegraded":"2024-09-13T06:14:32.741083+0000","last_fullsized":"2024-09-13T06:14:32.741083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:32.740843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:32.740843+0000","last_clean_scrub_stamp":"2024-09-13T06:14:32.740843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:26:26.910117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:40.103927+0000","last_change":"2024-09-13T06:13:40.103927+0000","last_active":"2024-09-13T06:13:40.103927+0000","last_peered":"2024-09-13T06:13:40.103927+0000","last_clean":"2024-09-13T06:13:40.103927+0000","last_became_active":"2024-09-13T06:09:36.133568+0000","last_became_peered":"2024-09-13T06:09:36.133568+0000","last_unstale":"2024-09-13T06:13:40.103927+0000","last_undegraded":"2024-09-13T06:13:40.103927+0000","last_fullsized":"2024-09-13T06:13:40.103927+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:40.103666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:40.103666+0000","last_clean_scrub_stamp":"2024-09-13T06:13:40.103666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:14:26.486674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"35'39","reported_seq":96,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:31.841640+0000","last_change":"2024-09-13T06:13:31.841640+0000","last_active":"2024-09-13T06:13:31.841640+0000","last_peered":"2024-09-13T06:13:31.841640+0000","last_clean":"2024-09-13T06:13:31.841640+0000","last_became_active":"2024-09-13T06:09:38.172109+0000","last_became_peered":"2024-09-13T06:09:38.172109+0000","last_unstale":"2024-09-13T06:13:31.841640+0000","last_undegraded":"2024-09-13T06:13:31.841640+0000","last_fullsized":"2024-09-13T06:13:31.841640+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'39","last_scrub_stamp":"2024-09-13T06:13:31.841369+0000","last_deep_scrub":"35'39","last_deep_scrub_stamp":"2024-09-13T06:13:31.841369+0000","last_clean_scrub_stamp":"2024-09-13T06:13:31.841369+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:43:03.426580+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:46.795936+0000","last_change":"2024-09-13T06:13:46.795936+0000","last_active":"2024-09-13T06:13:46.795936+0000","last_peered":"2024-09-13T06:13:46.795936+0000","last_clean":"2024-09-13T06:13:46.795936+0000","last_became_active":"2024-09-13T06:09:40.189223+0000","last_became_peered":"2024-09-13T06:09:40.189223+0000","last_unstale":"2024-09-13T06:13:46.795936+0000","last_undegraded":"2024-09-13T06:13:46.795936+0000","last_fullsized":"2024-09-13T06:13:46.795936+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:46.795688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:46.795688+0000","last_clean_scrub_stamp":"2024-09-13T06:13:46.795688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:53:07.200189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"35'5","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:20.040519+0000","last_change":"2024-09-13T06:14:20.040580+0000","last_active":"2024-09-13T06:14:20.040519+0000","last_peered":"2024-09-13T06:14:20.040519+0000","last_clean":"2024-09-13T06:14:20.040519+0000","last_became_active":"2024-09-13T06:09:42.177378+0000","last_became_peered":"2024-09-13T06:09:42.177378+0000","last_unstale":"2024-09-13T06:14:20.040519+0000","last_undegraded":"2024-09-13T06:14:20.040519+0000","last_fullsized":"2024-09-13T06:14:20.040519+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'5","last_scrub_stamp":"2024-09-13T06:14:20.040302+0000","last_deep_scrub":"35'5","last_deep_scrub_stamp":"2024-09-13T06:14:20.040302+0000","last_clean_scrub_stamp":"2024-09-13T06:14:20.040302+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:43:56.443852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"35'18","reported_seq":85,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:05.144068+0000","last_change":"2024-09-13T06:14:05.144068+0000","last_active":"2024-09-13T06:14:05.144068+0000","last_peered":"2024-09-13T06:14:05.144068+0000","last_clean":"2024-09-13T06:14:05.144068+0000","last_became_active":"2024-09-13T06:09:34.118441+0000","last_became_peered":"2024-09-13T06:09:34.118441+0000","last_unstale":"2024-09-13T06:14:05.144068+0000","last_undegraded":"2024-09-13T06:14:05.144068+0000","last_fullsized":"2024-09-13T06:14:05.144068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'18","last_scrub_stamp":"2024-09-13T06:14:05.143689+0000","last_deep_scrub":"35'18","last_deep_scrub_stamp":"2024-09-13T06:14:05.143689+0000","last_clean_scrub_stamp":"2024-09-13T06:14:05.143689+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:29:22.100915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":59,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:01.442453+0000","last_change":"2024-09-13T06:14:01.442453+0000","last_active":"2024-09-13T06:14:01.442453+0000","last_peered":"2024-09-13T06:14:01.442453+0000","last_clean":"2024-09-13T06:14:01.442453+0000","last_became_active":"2024-09-13T06:09:32.138664+0000","last_became_peered":"2024-09-13T06:09:32.138664+0000","last_unstale":"2024-09-13T06:14:01.442453+0000","last_undegraded":"2024-09-13T06:14:01.442453+0000","last_fullsized":"2024-09-13T06:14:01.442453+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:01.442196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:01.442196+0000","last_clean_scrub_stamp":"2024-09-13T06:14:01.442196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:02:06.026722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"35'5","reported_seq":239,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:30.836350+0000","last_change":"2024-09-13T06:13:30.836350+0000","last_active":"2024-09-13T06:13:30.836350+0000","last_peered":"2024-09-13T06:13:30.836350+0000","last_clean":"2024-09-13T06:13:30.836350+0000","last_became_active":"2024-09-13T06:09:36.153526+0000","last_became_peered":"2024-09-13T06:09:36.153526+0000","last_unstale":"2024-09-13T06:13:30.836350+0000","last_undegraded":"2024-09-13T06:13:30.836350+0000","last_fullsized":"2024-09-13T06:13:30.836350+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'5","last_scrub_stamp":"2024-09-13T06:13:30.836096+0000","last_deep_scrub":"35'5","last_deep_scrub_stamp":"2024-09-13T06:13:30.836096+0000","last_clean_scrub_stamp":"2024-09-13T06:13:30.836096+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:12:49.323535+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"35'9","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:37.292929+0000","last_change":"2024-09-13T06:13:37.292929+0000","last_active":"2024-09-13T06:13:37.292929+0000","last_peered":"2024-09-13T06:13:37.292929+0000","last_clean":"2024-09-13T06:13:37.292929+0000","last_became_active":"2024-09-13T06:09:38.150063+0000","last_became_peered":"2024-09-13T06:09:38.150063+0000","last_unstale":"2024-09-13T06:13:37.292929+0000","last_undegraded":"2024-09-13T06:13:37.292929+0000","last_fullsized":"2024-09-13T06:13:37.292929+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'9","last_scrub_stamp":"2024-09-13T06:13:37.292678+0000","last_deep_scrub":"35'9","last_deep_scrub_stamp":"2024-09-13T06:13:37.292678+0000","last_clean_scrub_stamp":"2024-09-13T06:13:37.292678+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:13:04.527644+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.383351+0000","last_change":"2024-09-13T06:13:25.383351+0000","last_active":"2024-09-13T06:13:25.383351+0000","last_peered":"2024-09-13T06:13:25.383351+0000","last_clean":"2024-09-13T06:13:25.383351+0000","last_became_active":"2024-09-13T06:09:40.181807+0000","last_became_peered":"2024-09-13T06:09:40.181807+0000","last_unstale":"2024-09-13T06:13:25.383351+0000","last_undegraded":"2024-09-13T06:13:25.383351+0000","last_fullsized":"2024-09-13T06:13:25.383351+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:25.383101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:25.383101+0000","last_clean_scrub_stamp":"2024-09-13T06:13:25.383101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:45:24.271310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"35'2","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:23.910357+0000","last_change":"2024-09-13T06:14:23.910357+0000","last_active":"2024-09-13T06:14:23.910357+0000","last_peered":"2024-09-13T06:14:23.910357+0000","last_clean":"2024-09-13T06:14:23.910357+0000","last_became_active":"2024-09-13T06:09:42.208567+0000","last_became_peered":"2024-09-13T06:09:42.208567+0000","last_unstale":"2024-09-13T06:14:23.910357+0000","last_undegraded":"2024-09-13T06:14:23.910357+0000","last_fullsized":"2024-09-13T06:14:23.910357+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:23.910090+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:23.910090+0000","last_clean_scrub_stamp":"2024-09-13T06:14:23.910090+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:41:01.763518+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"35'12","reported_seq":70,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:56.169020+0000","last_change":"2024-09-13T06:13:56.169020+0000","last_active":"2024-09-13T06:13:56.169020+0000","last_peered":"2024-09-13T06:13:56.169020+0000","last_clean":"2024-09-13T06:13:56.169020+0000","last_became_active":"2024-09-13T06:09:34.113455+0000","last_became_peered":"2024-09-13T06:09:34.113455+0000","last_unstale":"2024-09-13T06:13:56.169020+0000","last_undegraded":"2024-09-13T06:13:56.169020+0000","last_fullsized":"2024-09-13T06:13:56.169020+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'12","last_scrub_stamp":"2024-09-13T06:13:56.168729+0000","last_deep_scrub":"35'12","last_deep_scrub_stamp":"2024-09-13T06:13:56.168729+0000","last_clean_scrub_stamp":"2024-09-13T06:13:56.168729+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:18:27.944609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:09.534380+0000","last_change":"2024-09-13T06:14:09.534380+0000","last_active":"2024-09-13T06:14:09.534380+0000","last_peered":"2024-09-13T06:14:09.534380+0000","last_clean":"2024-09-13T06:14:09.534380+0000","last_became_active":"2024-09-13T06:09:32.118235+0000","last_became_peered":"2024-09-13T06:09:32.118235+0000","last_unstale":"2024-09-13T06:14:09.534380+0000","last_undegraded":"2024-09-13T06:14:09.534380+0000","last_fullsized":"2024-09-13T06:14:09.534380+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:09.534088+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:09.534088+0000","last_clean_scrub_stamp":"2024-09-13T06:14:09.534088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:19:44.114982+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"35'2","reported_seq":231,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:41.478861+0000","last_change":"2024-09-13T06:13:41.478861+0000","last_active":"2024-09-13T06:13:41.478861+0000","last_peered":"2024-09-13T06:13:41.478861+0000","last_clean":"2024-09-13T06:13:41.478861+0000","last_became_active":"2024-09-13T06:09:36.135184+0000","last_became_peered":"2024-09-13T06:09:36.135184+0000","last_unstale":"2024-09-13T06:13:41.478861+0000","last_undegraded":"2024-09-13T06:13:41.478861+0000","last_fullsized":"2024-09-13T06:13:41.478861+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:13:41.478609+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:13:41.478609+0000","last_clean_scrub_stamp":"2024-09-13T06:13:41.478609+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:20:43.284625+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"35'49","reported_seq":122,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:31.284327+0000","last_change":"2024-09-13T06:13:31.284327+0000","last_active":"2024-09-13T06:13:31.284327+0000","last_peered":"2024-09-13T06:13:31.284327+0000","last_clean":"2024-09-13T06:13:31.284327+0000","last_became_active":"2024-09-13T06:09:38.166381+0000","last_became_peered":"2024-09-13T06:09:38.166381+0000","last_unstale":"2024-09-13T06:13:31.284327+0000","last_undegraded":"2024-09-13T06:13:31.284327+0000","last_fullsized":"2024-09-13T06:13:31.284327+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'49","last_scrub_stamp":"2024-09-13T06:13:31.283995+0000","last_deep_scrub":"35'49","last_deep_scrub_stamp":"2024-09-13T06:13:31.283995+0000","last_clean_scrub_stamp":"2024-09-13T06:13:31.283995+0000","objects_scrubbed":6,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:53:13.436645+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:33.140552+0000","last_change":"2024-09-13T06:13:33.140552+0000","last_active":"2024-09-13T06:13:33.140552+0000","last_peered":"2024-09-13T06:13:33.140552+0000","last_clean":"2024-09-13T06:13:33.140552+0000","last_became_active":"2024-09-13T06:09:40.181329+0000","last_became_peered":"2024-09-13T06:09:40.181329+0000","last_unstale":"2024-09-13T06:13:33.140552+0000","last_undegraded":"2024-09-13T06:13:33.140552+0000","last_fullsized":"2024-09-13T06:13:33.140552+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:33.140310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:33.140310+0000","last_clean_scrub_stamp":"2024-09-13T06:13:33.140310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:08:31.071212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:44.807830+0000","last_change":"2024-09-13T06:14:44.807927+0000","last_active":"2024-09-13T06:14:44.807830+0000","last_peered":"2024-09-13T06:14:44.807830+0000","last_clean":"2024-09-13T06:14:44.807830+0000","last_became_active":"2024-09-13T06:09:42.211005+0000","last_became_peered":"2024-09-13T06:09:42.211005+0000","last_unstale":"2024-09-13T06:14:44.807830+0000","last_undegraded":"2024-09-13T06:14:44.807830+0000","last_fullsized":"2024-09-13T06:14:44.807830+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:44.807524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:44.807524+0000","last_clean_scrub_stamp":"2024-09-13T06:14:44.807524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:04:47.330524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"35'6","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:42.783373+0000","last_change":"2024-09-13T06:13:42.783373+0000","last_active":"2024-09-13T06:13:42.783373+0000","last_peered":"2024-09-13T06:13:42.783373+0000","last_clean":"2024-09-13T06:13:42.783373+0000","last_became_active":"2024-09-13T06:09:34.126798+0000","last_became_peered":"2024-09-13T06:09:34.126798+0000","last_unstale":"2024-09-13T06:13:42.783373+0000","last_undegraded":"2024-09-13T06:13:42.783373+0000","last_fullsized":"2024-09-13T06:13:42.783373+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:13:42.783125+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:13:42.783125+0000","last_clean_scrub_stamp":"2024-09-13T06:13:42.783125+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:22:51.788479+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:16.077566+0000","last_change":"2024-09-13T06:14:16.077566+0000","last_active":"2024-09-13T06:14:16.077566+0000","last_peered":"2024-09-13T06:14:16.077566+0000","last_clean":"2024-09-13T06:14:16.077566+0000","last_became_active":"2024-09-13T06:09:32.126213+0000","last_became_peered":"2024-09-13T06:09:32.126213+0000","last_unstale":"2024-09-13T06:14:16.077566+0000","last_undegraded":"2024-09-13T06:14:16.077566+0000","last_fullsized":"2024-09-13T06:14:16.077566+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:16.077312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:16.077312+0000","last_clean_scrub_stamp":"2024-09-13T06:14:16.077312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:43:40.720303+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:34.825411+0000","last_change":"2024-09-13T06:13:34.825411+0000","last_active":"2024-09-13T06:13:34.825411+0000","last_peered":"2024-09-13T06:13:34.825411+0000","last_clean":"2024-09-13T06:13:34.825411+0000","last_became_active":"2024-09-13T06:09:36.148016+0000","last_became_peered":"2024-09-13T06:09:36.148016+0000","last_unstale":"2024-09-13T06:13:34.825411+0000","last_undegraded":"2024-09-13T06:13:34.825411+0000","last_fullsized":"2024-09-13T06:13:34.825411+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:34.825172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:34.825172+0000","last_clean_scrub_stamp":"2024-09-13T06:13:34.825172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:35:11.379450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"35'36","reported_seq":92,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:39.479798+0000","last_change":"2024-09-13T06:13:39.479798+0000","last_active":"2024-09-13T06:13:39.479798+0000","last_peered":"2024-09-13T06:13:39.479798+0000","last_clean":"2024-09-13T06:13:39.479798+0000","last_became_active":"2024-09-13T06:09:38.141182+0000","last_became_peered":"2024-09-13T06:09:38.141182+0000","last_unstale":"2024-09-13T06:13:39.479798+0000","last_undegraded":"2024-09-13T06:13:39.479798+0000","last_fullsized":"2024-09-13T06:13:39.479798+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'36","last_scrub_stamp":"2024-09-13T06:13:39.479521+0000","last_deep_scrub":"35'36","last_deep_scrub_stamp":"2024-09-13T06:13:39.479521+0000","last_clean_scrub_stamp":"2024-09-13T06:13:39.479521+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:51:47.667173+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:30.363157+0000","last_change":"2024-09-13T06:13:30.363157+0000","last_active":"2024-09-13T06:13:30.363157+0000","last_peered":"2024-09-13T06:13:30.363157+0000","last_clean":"2024-09-13T06:13:30.363157+0000","last_became_active":"2024-09-13T06:09:40.166229+0000","last_became_peered":"2024-09-13T06:09:40.166229+0000","last_unstale":"2024-09-13T06:13:30.363157+0000","last_undegraded":"2024-09-13T06:13:30.363157+0000","last_fullsized":"2024-09-13T06:13:30.363157+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:30.362905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:30.362905+0000","last_clean_scrub_stamp":"2024-09-13T06:13:30.362905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:24:17.255873+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"35'6","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:01.922629+0000","last_change":"2024-09-13T06:14:01.922787+0000","last_active":"2024-09-13T06:14:01.922629+0000","last_peered":"2024-09-13T06:14:01.922629+0000","last_clean":"2024-09-13T06:14:01.922629+0000","last_became_active":"2024-09-13T06:09:34.122034+0000","last_became_peered":"2024-09-13T06:09:34.122034+0000","last_unstale":"2024-09-13T06:14:01.922629+0000","last_undegraded":"2024-09-13T06:14:01.922629+0000","last_fullsized":"2024-09-13T06:14:01.922629+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:14:01.922410+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:14:01.922410+0000","last_clean_scrub_stamp":"2024-09-13T06:14:01.922410+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:23:57.663402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:39.867317+0000","last_change":"2024-09-13T06:14:39.867379+0000","last_active":"2024-09-13T06:14:39.867317+0000","last_peered":"2024-09-13T06:14:39.867317+0000","last_clean":"2024-09-13T06:14:39.867317+0000","last_became_active":"2024-09-13T06:09:32.121948+0000","last_became_peered":"2024-09-13T06:09:32.121948+0000","last_unstale":"2024-09-13T06:14:39.867317+0000","last_undegraded":"2024-09-13T06:14:39.867317+0000","last_fullsized":"2024-09-13T06:14:39.867317+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:39.867116+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:39.867116+0000","last_clean_scrub_stamp":"2024-09-13T06:14:39.867116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:19:27.582636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:47.139074+0000","last_change":"2024-09-13T06:13:47.139128+0000","last_active":"2024-09-13T06:13:47.139074+0000","last_peered":"2024-09-13T06:13:47.139074+0000","last_clean":"2024-09-13T06:13:47.139074+0000","last_became_active":"2024-09-13T06:09:36.132227+0000","last_became_peered":"2024-09-13T06:09:36.132227+0000","last_unstale":"2024-09-13T06:13:47.139074+0000","last_undegraded":"2024-09-13T06:13:47.139074+0000","last_fullsized":"2024-09-13T06:13:47.139074+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:47.138875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:47.138875+0000","last_clean_scrub_stamp":"2024-09-13T06:13:47.138875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:46:51.298281+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"35'63","reported_seq":137,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:38.263042+0000","last_change":"2024-09-13T06:13:38.263042+0000","last_active":"2024-09-13T06:13:38.263042+0000","last_peered":"2024-09-13T06:13:38.263042+0000","last_clean":"2024-09-13T06:13:38.263042+0000","last_became_active":"2024-09-13T06:09:38.150070+0000","last_became_peered":"2024-09-13T06:09:38.150070+0000","last_unstale":"2024-09-13T06:13:38.263042+0000","last_undegraded":"2024-09-13T06:13:38.263042+0000","last_fullsized":"2024-09-13T06:13:38.263042+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'63","last_scrub_stamp":"2024-09-13T06:13:38.262747+0000","last_deep_scrub":"35'63","last_deep_scrub_stamp":"2024-09-13T06:13:38.262747+0000","last_clean_scrub_stamp":"2024-09-13T06:13:38.262747+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:56:34.974972+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:26.401325+0000","last_change":"2024-09-13T06:13:26.401325+0000","last_active":"2024-09-13T06:13:26.401325+0000","last_peered":"2024-09-13T06:13:26.401325+0000","last_clean":"2024-09-13T06:13:26.401325+0000","last_became_active":"2024-09-13T06:09:40.168550+0000","last_became_peered":"2024-09-13T06:09:40.168550+0000","last_unstale":"2024-09-13T06:13:26.401325+0000","last_undegraded":"2024-09-13T06:13:26.401325+0000","last_fullsized":"2024-09-13T06:13:26.401325+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:26.401059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:26.401059+0000","last_clean_scrub_stamp":"2024-09-13T06:13:26.401059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:03:36.749162+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"35'14","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:24.907423+0000","last_change":"2024-09-13T06:14:24.907423+0000","last_active":"2024-09-13T06:14:24.907423+0000","last_peered":"2024-09-13T06:14:24.907423+0000","last_clean":"2024-09-13T06:14:24.907423+0000","last_became_active":"2024-09-13T06:09:42.211508+0000","last_became_peered":"2024-09-13T06:09:42.211508+0000","last_unstale":"2024-09-13T06:14:24.907423+0000","last_undegraded":"2024-09-13T06:14:24.907423+0000","last_fullsized":"2024-09-13T06:14:24.907423+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'14","last_scrub_stamp":"2024-09-13T06:14:24.907133+0000","last_deep_scrub":"35'14","last_deep_scrub_stamp":"2024-09-13T06:14:24.907133+0000","last_clean_scrub_stamp":"2024-09-13T06:14:24.907133+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:17:17.358604+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"35'8","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:53.158421+0000","last_change":"2024-09-13T06:13:53.158479+0000","last_active":"2024-09-13T06:13:53.158421+0000","last_peered":"2024-09-13T06:13:53.158421+0000","last_clean":"2024-09-13T06:13:53.158421+0000","last_became_active":"2024-09-13T06:09:34.122881+0000","last_became_peered":"2024-09-13T06:09:34.122881+0000","last_unstale":"2024-09-13T06:13:53.158421+0000","last_undegraded":"2024-09-13T06:13:53.158421+0000","last_fullsized":"2024-09-13T06:13:53.158421+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-13T06:13:53.158235+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-13T06:13:53.158235+0000","last_clean_scrub_stamp":"2024-09-13T06:13:53.158235+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:27:12.571243+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":11,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:15.032945+0000","last_change":"2024-09-13T06:14:15.032945+0000","last_active":"2024-09-13T06:14:15.032945+0000","last_peered":"2024-09-13T06:14:15.032945+0000","last_clean":"2024-09-13T06:14:15.032945+0000","last_became_active":"2024-09-13T06:09:32.119573+0000","last_became_peered":"2024-09-13T06:09:32.119573+0000","last_unstale":"2024-09-13T06:14:15.032945+0000","last_undegraded":"2024-09-13T06:14:15.032945+0000","last_fullsized":"2024-09-13T06:14:15.032945+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:15.032656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:15.032656+0000","last_clean_scrub_stamp":"2024-09-13T06:14:15.032656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:03:32.007047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:45.482486+0000","last_change":"2024-09-13T06:13:45.482486+0000","last_active":"2024-09-13T06:13:45.482486+0000","last_peered":"2024-09-13T06:13:45.482486+0000","last_clean":"2024-09-13T06:13:45.482486+0000","last_became_active":"2024-09-13T06:09:36.127719+0000","last_became_peered":"2024-09-13T06:09:36.127719+0000","last_unstale":"2024-09-13T06:13:45.482486+0000","last_undegraded":"2024-09-13T06:13:45.482486+0000","last_fullsized":"2024-09-13T06:13:45.482486+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:45.482236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:45.482236+0000","last_clean_scrub_stamp":"2024-09-13T06:13:45.482236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:48:41.351667+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"35'46","reported_seq":105,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:43.807814+0000","last_change":"2024-09-13T06:13:43.807814+0000","last_active":"2024-09-13T06:13:43.807814+0000","last_peered":"2024-09-13T06:13:43.807814+0000","last_clean":"2024-09-13T06:13:43.807814+0000","last_became_active":"2024-09-13T06:09:38.175443+0000","last_became_peered":"2024-09-13T06:09:38.175443+0000","last_unstale":"2024-09-13T06:13:43.807814+0000","last_undegraded":"2024-09-13T06:13:43.807814+0000","last_fullsized":"2024-09-13T06:13:43.807814+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'46","last_scrub_stamp":"2024-09-13T06:13:43.807524+0000","last_deep_scrub":"35'46","last_deep_scrub_stamp":"2024-09-13T06:13:43.807524+0000","last_clean_scrub_stamp":"2024-09-13T06:13:43.807524+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:18:40.372988+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:45.156776+0000","last_change":"2024-09-13T06:13:45.156776+0000","last_active":"2024-09-13T06:13:45.156776+0000","last_peered":"2024-09-13T06:13:45.156776+0000","last_clean":"2024-09-13T06:13:45.156776+0000","last_became_active":"2024-09-13T06:09:40.185222+0000","last_became_peered":"2024-09-13T06:09:40.185222+0000","last_unstale":"2024-09-13T06:13:45.156776+0000","last_undegraded":"2024-09-13T06:13:45.156776+0000","last_fullsized":"2024-09-13T06:13:45.156776+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:45.156528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:45.156528+0000","last_clean_scrub_stamp":"2024-09-13T06:13:45.156528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:58:23.506441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:07.968141+0000","last_change":"2024-09-13T06:14:07.968141+0000","last_active":"2024-09-13T06:14:07.968141+0000","last_peered":"2024-09-13T06:14:07.968141+0000","last_clean":"2024-09-13T06:14:07.968141+0000","last_became_active":"2024-09-13T06:09:42.196679+0000","last_became_peered":"2024-09-13T06:09:42.196679+0000","last_unstale":"2024-09-13T06:14:07.968141+0000","last_undegraded":"2024-09-13T06:14:07.968141+0000","last_fullsized":"2024-09-13T06:14:07.968141+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:07.967902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:07.967902+0000","last_clean_scrub_stamp":"2024-09-13T06:14:07.967902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:59:50.642710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"35'16","reported_seq":87,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:38.804245+0000","last_change":"2024-09-13T06:13:38.804245+0000","last_active":"2024-09-13T06:13:38.804245+0000","last_peered":"2024-09-13T06:13:38.804245+0000","last_clean":"2024-09-13T06:13:38.804245+0000","last_became_active":"2024-09-13T06:09:34.132777+0000","last_became_peered":"2024-09-13T06:09:34.132777+0000","last_unstale":"2024-09-13T06:13:38.804245+0000","last_undegraded":"2024-09-13T06:13:38.804245+0000","last_fullsized":"2024-09-13T06:13:38.804245+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'16","last_scrub_stamp":"2024-09-13T06:13:38.803976+0000","last_deep_scrub":"35'16","last_deep_scrub_stamp":"2024-09-13T06:13:38.803976+0000","last_clean_scrub_stamp":"2024-09-13T06:13:38.803976+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:52:39.806244+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":57,"num_read_kb":53,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:13.111219+0000","last_change":"2024-09-13T06:14:13.111219+0000","last_active":"2024-09-13T06:14:13.111219+0000","last_peered":"2024-09-13T06:14:13.111219+0000","last_clean":"2024-09-13T06:14:13.111219+0000","last_became_active":"2024-09-13T06:09:32.117988+0000","last_became_peered":"2024-09-13T06:09:32.117988+0000","last_unstale":"2024-09-13T06:14:13.111219+0000","last_undegraded":"2024-09-13T06:14:13.111219+0000","last_fullsized":"2024-09-13T06:14:13.111219+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:13.110979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:13.110979+0000","last_clean_scrub_stamp":"2024-09-13T06:14:13.110979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:11:49.833063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:43.472981+0000","last_change":"2024-09-13T06:13:43.472981+0000","last_active":"2024-09-13T06:13:43.472981+0000","last_peered":"2024-09-13T06:13:43.472981+0000","last_clean":"2024-09-13T06:13:43.472981+0000","last_became_active":"2024-09-13T06:09:36.129471+0000","last_became_peered":"2024-09-13T06:09:36.129471+0000","last_unstale":"2024-09-13T06:13:43.472981+0000","last_undegraded":"2024-09-13T06:13:43.472981+0000","last_fullsized":"2024-09-13T06:13:43.472981+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:43.472711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:43.472711+0000","last_clean_scrub_stamp":"2024-09-13T06:13:43.472711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:48:39.465341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"35'41","reported_seq":98,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:35.293684+0000","last_change":"2024-09-13T06:13:35.293684+0000","last_active":"2024-09-13T06:13:35.293684+0000","last_peered":"2024-09-13T06:13:35.293684+0000","last_clean":"2024-09-13T06:13:35.293684+0000","last_became_active":"2024-09-13T06:09:38.153433+0000","last_became_peered":"2024-09-13T06:09:38.153433+0000","last_unstale":"2024-09-13T06:13:35.293684+0000","last_undegraded":"2024-09-13T06:13:35.293684+0000","last_fullsized":"2024-09-13T06:13:35.293684+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'41","last_scrub_stamp":"2024-09-13T06:13:35.293395+0000","last_deep_scrub":"35'41","last_deep_scrub_stamp":"2024-09-13T06:13:35.293395+0000","last_clean_scrub_stamp":"2024-09-13T06:13:35.293395+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:48:31.286025+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":55,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:29.307769+0000","last_change":"2024-09-13T06:13:29.307769+0000","last_active":"2024-09-13T06:13:29.307769+0000","last_peered":"2024-09-13T06:13:29.307769+0000","last_clean":"2024-09-13T06:13:29.307769+0000","last_became_active":"2024-09-13T06:09:40.171455+0000","last_became_peered":"2024-09-13T06:09:40.171455+0000","last_unstale":"2024-09-13T06:13:29.307769+0000","last_undegraded":"2024-09-13T06:13:29.307769+0000","last_fullsized":"2024-09-13T06:13:29.307769+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:29.307405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:29.307405+0000","last_clean_scrub_stamp":"2024-09-13T06:13:29.307405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:02:21.851168+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"35'5","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:42.824642+0000","last_change":"2024-09-13T06:14:42.824805+0000","last_active":"2024-09-13T06:14:42.824642+0000","last_peered":"2024-09-13T06:14:42.824642+0000","last_clean":"2024-09-13T06:14:42.824642+0000","last_became_active":"2024-09-13T06:09:42.202004+0000","last_became_peered":"2024-09-13T06:09:42.202004+0000","last_unstale":"2024-09-13T06:14:42.824642+0000","last_undegraded":"2024-09-13T06:14:42.824642+0000","last_fullsized":"2024-09-13T06:14:42.824642+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'5","last_scrub_stamp":"2024-09-13T06:14:42.824405+0000","last_deep_scrub":"35'5","last_deep_scrub_stamp":"2024-09-13T06:14:42.824405+0000","last_clean_scrub_stamp":"2024-09-13T06:14:42.824405+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:13:47.173550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:04.027730+0000","last_change":"2024-09-13T06:14:04.027730+0000","last_active":"2024-09-13T06:14:04.027730+0000","last_peered":"2024-09-13T06:14:04.027730+0000","last_clean":"2024-09-13T06:14:04.027730+0000","last_became_active":"2024-09-13T06:09:34.116197+0000","last_became_peered":"2024-09-13T06:09:34.116197+0000","last_unstale":"2024-09-13T06:14:04.027730+0000","last_undegraded":"2024-09-13T06:14:04.027730+0000","last_fullsized":"2024-09-13T06:14:04.027730+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:04.027357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:04.027357+0000","last_clean_scrub_stamp":"2024-09-13T06:14:04.027357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:41:38.144650+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"35'2","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:19.870843+0000","last_change":"2024-09-13T06:14:19.870843+0000","last_active":"2024-09-13T06:14:19.870843+0000","last_peered":"2024-09-13T06:14:19.870843+0000","last_clean":"2024-09-13T06:14:19.870843+0000","last_became_active":"2024-09-13T06:09:32.124989+0000","last_became_peered":"2024-09-13T06:09:32.124989+0000","last_unstale":"2024-09-13T06:14:19.870843+0000","last_undegraded":"2024-09-13T06:14:19.870843+0000","last_fullsized":"2024-09-13T06:14:19.870843+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:19.870574+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:19.870574+0000","last_clean_scrub_stamp":"2024-09-13T06:14:19.870574+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:59:55.637777+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:36.119188+0000","last_change":"2024-09-13T06:13:36.119188+0000","last_active":"2024-09-13T06:13:36.119188+0000","last_peered":"2024-09-13T06:13:36.119188+0000","last_clean":"2024-09-13T06:13:36.119188+0000","last_became_active":"2024-09-13T06:09:36.140149+0000","last_became_peered":"2024-09-13T06:09:36.140149+0000","last_unstale":"2024-09-13T06:13:36.119188+0000","last_undegraded":"2024-09-13T06:13:36.119188+0000","last_fullsized":"2024-09-13T06:13:36.119188+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:36.118904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:36.118904+0000","last_clean_scrub_stamp":"2024-09-13T06:13:36.118904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:21:56.564481+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"35'15","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:50.851940+0000","last_change":"2024-09-13T06:13:50.852014+0000","last_active":"2024-09-13T06:13:50.851940+0000","last_peered":"2024-09-13T06:13:50.851940+0000","last_clean":"2024-09-13T06:13:50.851940+0000","last_became_active":"2024-09-13T06:09:38.177699+0000","last_became_peered":"2024-09-13T06:09:38.177699+0000","last_unstale":"2024-09-13T06:13:50.851940+0000","last_undegraded":"2024-09-13T06:13:50.851940+0000","last_fullsized":"2024-09-13T06:13:50.851940+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'15","last_scrub_stamp":"2024-09-13T06:13:50.851744+0000","last_deep_scrub":"35'15","last_deep_scrub_stamp":"2024-09-13T06:13:50.851744+0000","last_clean_scrub_stamp":"2024-09-13T06:13:50.851744+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:02:47.395746+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"35'285","reported_seq":384,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:29.354681+0000","last_change":"2024-09-13T06:13:29.354681+0000","last_active":"2024-09-13T06:13:29.354681+0000","last_peered":"2024-09-13T06:13:29.354681+0000","last_clean":"2024-09-13T06:13:29.354681+0000","last_became_active":"2024-09-13T06:09:40.166780+0000","last_became_peered":"2024-09-13T06:09:40.166780+0000","last_unstale":"2024-09-13T06:13:29.354681+0000","last_undegraded":"2024-09-13T06:13:29.354681+0000","last_fullsized":"2024-09-13T06:13:29.354681+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'285","last_scrub_stamp":"2024-09-13T06:13:29.354428+0000","last_deep_scrub":"35'285","last_deep_scrub_stamp":"2024-09-13T06:13:29.354428+0000","last_clean_scrub_stamp":"2024-09-13T06:13:29.354428+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:07:16.616986+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"35'2","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:11.928509+0000","last_change":"2024-09-13T06:14:11.928509+0000","last_active":"2024-09-13T06:14:11.928509+0000","last_peered":"2024-09-13T06:14:11.928509+0000","last_clean":"2024-09-13T06:14:11.928509+0000","last_became_active":"2024-09-13T06:09:42.196063+0000","last_became_peered":"2024-09-13T06:09:42.196063+0000","last_unstale":"2024-09-13T06:14:11.928509+0000","last_undegraded":"2024-09-13T06:14:11.928509+0000","last_fullsized":"2024-09-13T06:14:11.928509+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:11.928231+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:11.928231+0000","last_clean_scrub_stamp":"2024-09-13T06:14:11.928231+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:30:08.269153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"35'6","reported_seq":62,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:14.519190+0000","last_change":"2024-09-13T06:14:14.519190+0000","last_active":"2024-09-13T06:14:14.519190+0000","last_peered":"2024-09-13T06:14:14.519190+0000","last_clean":"2024-09-13T06:14:14.519190+0000","last_became_active":"2024-09-13T06:09:34.107821+0000","last_became_peered":"2024-09-13T06:09:34.107821+0000","last_unstale":"2024-09-13T06:14:14.519190+0000","last_undegraded":"2024-09-13T06:14:14.519190+0000","last_fullsized":"2024-09-13T06:14:14.519190+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:14:14.518930+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:14:14.518930+0000","last_clean_scrub_stamp":"2024-09-13T06:14:14.518930+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:53:21.672620+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"35'2","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:18.142644+0000","last_change":"2024-09-13T06:14:18.142644+0000","last_active":"2024-09-13T06:14:18.142644+0000","last_peered":"2024-09-13T06:14:18.142644+0000","last_clean":"2024-09-13T06:14:18.142644+0000","last_became_active":"2024-09-13T06:09:32.140816+0000","last_became_peered":"2024-09-13T06:09:32.140816+0000","last_unstale":"2024-09-13T06:14:18.142644+0000","last_undegraded":"2024-09-13T06:14:18.142644+0000","last_fullsized":"2024-09-13T06:14:18.142644+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:18.142373+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:18.142373+0000","last_clean_scrub_stamp":"2024-09-13T06:14:18.142373+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:55:56.126674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:34.100128+0000","last_change":"2024-09-13T06:13:34.100128+0000","last_active":"2024-09-13T06:13:34.100128+0000","last_peered":"2024-09-13T06:13:34.100128+0000","last_clean":"2024-09-13T06:13:34.100128+0000","last_became_active":"2024-09-13T06:09:36.140770+0000","last_became_peered":"2024-09-13T06:09:36.140770+0000","last_unstale":"2024-09-13T06:13:34.100128+0000","last_undegraded":"2024-09-13T06:13:34.100128+0000","last_fullsized":"2024-09-13T06:13:34.100128+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:34.099877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:34.099877+0000","last_clean_scrub_stamp":"2024-09-13T06:13:34.099877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:24:15.804560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"35'46","reported_seq":105,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:25.335732+0000","last_change":"2024-09-13T06:13:25.335732+0000","last_active":"2024-09-13T06:13:25.335732+0000","last_peered":"2024-09-13T06:13:25.335732+0000","last_clean":"2024-09-13T06:13:25.335732+0000","last_became_active":"2024-09-13T06:09:38.166681+0000","last_became_peered":"2024-09-13T06:09:38.166681+0000","last_unstale":"2024-09-13T06:13:25.335732+0000","last_undegraded":"2024-09-13T06:13:25.335732+0000","last_fullsized":"2024-09-13T06:13:25.335732+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'46","last_scrub_stamp":"2024-09-13T06:13:25.335323+0000","last_deep_scrub":"35'46","last_deep_scrub_stamp":"2024-09-13T06:13:25.335323+0000","last_clean_scrub_stamp":"2024-09-13T06:13:25.335323+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:32:30.737347+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:28.331392+0000","last_change":"2024-09-13T06:13:28.331392+0000","last_active":"2024-09-13T06:13:28.331392+0000","last_peered":"2024-09-13T06:13:28.331392+0000","last_clean":"2024-09-13T06:13:28.331392+0000","last_became_active":"2024-09-13T06:09:40.178484+0000","last_became_peered":"2024-09-13T06:09:40.178484+0000","last_unstale":"2024-09-13T06:13:28.331392+0000","last_undegraded":"2024-09-13T06:13:28.331392+0000","last_fullsized":"2024-09-13T06:13:28.331392+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:28.331050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:28.331050+0000","last_clean_scrub_stamp":"2024-09-13T06:13:28.331050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:53:24.217481+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"35'4","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:24.176941+0000","last_change":"2024-09-13T06:14:24.176941+0000","last_active":"2024-09-13T06:14:24.176941+0000","last_peered":"2024-09-13T06:14:24.176941+0000","last_clean":"2024-09-13T06:14:24.176941+0000","last_became_active":"2024-09-13T06:09:42.199609+0000","last_became_peered":"2024-09-13T06:09:42.199609+0000","last_unstale":"2024-09-13T06:14:24.176941+0000","last_undegraded":"2024-09-13T06:14:24.176941+0000","last_fullsized":"2024-09-13T06:14:24.176941+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:14:24.176488+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:14:24.176488+0000","last_clean_scrub_stamp":"2024-09-13T06:14:24.176488+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:48:56.031957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"35'6","reported_seq":58,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:51.506348+0000","last_change":"2024-09-13T06:13:51.506348+0000","last_active":"2024-09-13T06:13:51.506348+0000","last_peered":"2024-09-13T06:13:51.506348+0000","last_clean":"2024-09-13T06:13:51.506348+0000","last_became_active":"2024-09-13T06:09:34.100355+0000","last_became_peered":"2024-09-13T06:09:34.100355+0000","last_unstale":"2024-09-13T06:13:51.506348+0000","last_undegraded":"2024-09-13T06:13:51.506348+0000","last_fullsized":"2024-09-13T06:13:51.506348+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:13:51.505951+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:13:51.505951+0000","last_clean_scrub_stamp":"2024-09-13T06:13:51.505951+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:34:28.572463+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:23.886321+0000","last_change":"2024-09-13T06:14:23.886321+0000","last_active":"2024-09-13T06:14:23.886321+0000","last_peered":"2024-09-13T06:14:23.886321+0000","last_clean":"2024-09-13T06:14:23.886321+0000","last_became_active":"2024-09-13T06:09:32.125049+0000","last_became_peered":"2024-09-13T06:09:32.125049+0000","last_unstale":"2024-09-13T06:14:23.886321+0000","last_undegraded":"2024-09-13T06:14:23.886321+0000","last_fullsized":"2024-09-13T06:14:23.886321+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:23.885878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:23.885878+0000","last_clean_scrub_stamp":"2024-09-13T06:14:23.885878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:44:32.537280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:46.483155+0000","last_change":"2024-09-13T06:13:46.483155+0000","last_active":"2024-09-13T06:13:46.483155+0000","last_peered":"2024-09-13T06:13:46.483155+0000","last_clean":"2024-09-13T06:13:46.483155+0000","last_became_active":"2024-09-13T06:09:36.127684+0000","last_became_peered":"2024-09-13T06:09:36.127684+0000","last_unstale":"2024-09-13T06:13:46.483155+0000","last_undegraded":"2024-09-13T06:13:46.483155+0000","last_fullsized":"2024-09-13T06:13:46.483155+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:46.482894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:46.482894+0000","last_clean_scrub_stamp":"2024-09-13T06:13:46.482894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:09:00.981051+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"35'37","reported_seq":93,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:34.298450+0000","last_change":"2024-09-13T06:13:34.298450+0000","last_active":"2024-09-13T06:13:34.298450+0000","last_peered":"2024-09-13T06:13:34.298450+0000","last_clean":"2024-09-13T06:13:34.298450+0000","last_became_active":"2024-09-13T06:09:38.157278+0000","last_became_peered":"2024-09-13T06:09:38.157278+0000","last_unstale":"2024-09-13T06:13:34.298450+0000","last_undegraded":"2024-09-13T06:13:34.298450+0000","last_fullsized":"2024-09-13T06:13:34.298450+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'37","last_scrub_stamp":"2024-09-13T06:13:34.298176+0000","last_deep_scrub":"35'37","last_deep_scrub_stamp":"2024-09-13T06:13:34.298176+0000","last_clean_scrub_stamp":"2024-09-13T06:13:34.298176+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:13:34.885749+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:45.813575+0000","last_change":"2024-09-13T06:13:45.813575+0000","last_active":"2024-09-13T06:13:45.813575+0000","last_peered":"2024-09-13T06:13:45.813575+0000","last_clean":"2024-09-13T06:13:45.813575+0000","last_became_active":"2024-09-13T06:09:40.189165+0000","last_became_peered":"2024-09-13T06:09:40.189165+0000","last_unstale":"2024-09-13T06:13:45.813575+0000","last_undegraded":"2024-09-13T06:13:45.813575+0000","last_fullsized":"2024-09-13T06:13:45.813575+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:45.813202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:45.813202+0000","last_clean_scrub_stamp":"2024-09-13T06:13:45.813202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:32:50.595240+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":27,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:46.847733+0000","last_change":"2024-09-13T06:14:46.847796+0000","last_active":"2024-09-13T06:14:46.847733+0000","last_peered":"2024-09-13T06:14:46.847733+0000","last_clean":"2024-09-13T06:14:46.847733+0000","last_became_active":"2024-09-13T06:09:42.213756+0000","last_became_peered":"2024-09-13T06:09:42.213756+0000","last_unstale":"2024-09-13T06:14:46.847733+0000","last_undegraded":"2024-09-13T06:14:46.847733+0000","last_fullsized":"2024-09-13T06:14:46.847733+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:46.847510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:46.847510+0000","last_clean_scrub_stamp":"2024-09-13T06:14:46.847510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:54:17.948401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:09.970812+0000","last_change":"2024-09-13T06:14:09.970812+0000","last_active":"2024-09-13T06:14:09.970812+0000","last_peered":"2024-09-13T06:14:09.970812+0000","last_clean":"2024-09-13T06:14:09.970812+0000","last_became_active":"2024-09-13T06:09:34.117789+0000","last_became_peered":"2024-09-13T06:09:34.117789+0000","last_unstale":"2024-09-13T06:14:09.970812+0000","last_undegraded":"2024-09-13T06:14:09.970812+0000","last_fullsized":"2024-09-13T06:14:09.970812+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:09.970560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:09.970560+0000","last_clean_scrub_stamp":"2024-09-13T06:14:09.970560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:43:49.285414+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:12.973494+0000","last_change":"2024-09-13T06:14:12.973611+0000","last_active":"2024-09-13T06:14:12.973494+0000","last_peered":"2024-09-13T06:14:12.973494+0000","last_clean":"2024-09-13T06:14:12.973494+0000","last_became_active":"2024-09-13T06:09:32.134696+0000","last_became_peered":"2024-09-13T06:09:32.134696+0000","last_unstale":"2024-09-13T06:14:12.973494+0000","last_undegraded":"2024-09-13T06:14:12.973494+0000","last_fullsized":"2024-09-13T06:14:12.973494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:12.973262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:12.973262+0000","last_clean_scrub_stamp":"2024-09-13T06:14:12.973262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:06:43.525067+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:42.137375+0000","last_change":"2024-09-13T06:13:42.137375+0000","last_active":"2024-09-13T06:13:42.137375+0000","last_peered":"2024-09-13T06:13:42.137375+0000","last_clean":"2024-09-13T06:13:42.137375+0000","last_became_active":"2024-09-13T06:09:36.131976+0000","last_became_peered":"2024-09-13T06:09:36.131976+0000","last_unstale":"2024-09-13T06:13:42.137375+0000","last_undegraded":"2024-09-13T06:13:42.137375+0000","last_fullsized":"2024-09-13T06:13:42.137375+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:42.137148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:42.137148+0000","last_clean_scrub_stamp":"2024-09-13T06:13:42.137148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:12:22.095929+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"35'30","reported_seq":84,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:37.757650+0000","last_change":"2024-09-13T06:13:37.757650+0000","last_active":"2024-09-13T06:13:37.757650+0000","last_peered":"2024-09-13T06:13:37.757650+0000","last_clean":"2024-09-13T06:13:37.757650+0000","last_became_active":"2024-09-13T06:09:38.171538+0000","last_became_peered":"2024-09-13T06:09:38.171538+0000","last_unstale":"2024-09-13T06:13:37.757650+0000","last_undegraded":"2024-09-13T06:13:37.757650+0000","last_fullsized":"2024-09-13T06:13:37.757650+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'30","last_scrub_stamp":"2024-09-13T06:13:37.757382+0000","last_deep_scrub":"35'30","last_deep_scrub_stamp":"2024-09-13T06:13:37.757382+0000","last_clean_scrub_stamp":"2024-09-13T06:13:37.757382+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:21:11.687429+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:48.836037+0000","last_change":"2024-09-13T06:13:48.836037+0000","last_active":"2024-09-13T06:13:48.836037+0000","last_peered":"2024-09-13T06:13:48.836037+0000","last_clean":"2024-09-13T06:13:48.836037+0000","last_became_active":"2024-09-13T06:09:40.185277+0000","last_became_peered":"2024-09-13T06:09:40.185277+0000","last_unstale":"2024-09-13T06:13:48.836037+0000","last_undegraded":"2024-09-13T06:13:48.836037+0000","last_fullsized":"2024-09-13T06:13:48.836037+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:48.835791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:48.835791+0000","last_clean_scrub_stamp":"2024-09-13T06:13:48.835791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:03:05.810181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"35'6","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:45.804433+0000","last_change":"2024-09-13T06:14:45.804496+0000","last_active":"2024-09-13T06:14:45.804433+0000","last_peered":"2024-09-13T06:14:45.804433+0000","last_clean":"2024-09-13T06:14:45.804433+0000","last_became_active":"2024-09-13T06:09:42.211176+0000","last_became_peered":"2024-09-13T06:09:42.211176+0000","last_unstale":"2024-09-13T06:14:45.804433+0000","last_undegraded":"2024-09-13T06:14:45.804433+0000","last_fullsized":"2024-09-13T06:14:45.804433+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:14:45.804250+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:14:45.804250+0000","last_clean_scrub_stamp":"2024-09-13T06:14:45.804250+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:40:58.435179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"35'8","reported_seq":66,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:04.458704+0000","last_change":"2024-09-13T06:14:04.458704+0000","last_active":"2024-09-13T06:14:04.458704+0000","last_peered":"2024-09-13T06:14:04.458704+0000","last_clean":"2024-09-13T06:14:04.458704+0000","last_became_active":"2024-09-13T06:09:34.105494+0000","last_became_peered":"2024-09-13T06:09:34.105494+0000","last_unstale":"2024-09-13T06:14:04.458704+0000","last_undegraded":"2024-09-13T06:14:04.458704+0000","last_fullsized":"2024-09-13T06:14:04.458704+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-13T06:14:04.458293+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-13T06:14:04.458293+0000","last_clean_scrub_stamp":"2024-09-13T06:14:04.458293+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:48:21.210581+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"35'2","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:02.083459+0000","last_change":"2024-09-13T06:14:02.083524+0000","last_active":"2024-09-13T06:14:02.083459+0000","last_peered":"2024-09-13T06:14:02.083459+0000","last_clean":"2024-09-13T06:14:02.083459+0000","last_became_active":"2024-09-13T06:09:32.142726+0000","last_became_peered":"2024-09-13T06:09:32.142726+0000","last_unstale":"2024-09-13T06:14:02.083459+0000","last_undegraded":"2024-09-13T06:14:02.083459+0000","last_fullsized":"2024-09-13T06:14:02.083459+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:02.083238+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:02.083238+0000","last_clean_scrub_stamp":"2024-09-13T06:14:02.083238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:00:06.559987+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"35'3","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:39.117641+0000","last_change":"2024-09-13T06:13:39.117641+0000","last_active":"2024-09-13T06:13:39.117641+0000","last_peered":"2024-09-13T06:13:39.117641+0000","last_clean":"2024-09-13T06:13:39.117641+0000","last_became_active":"2024-09-13T06:09:36.136792+0000","last_became_peered":"2024-09-13T06:09:36.136792+0000","last_unstale":"2024-09-13T06:13:39.117641+0000","last_undegraded":"2024-09-13T06:13:39.117641+0000","last_fullsized":"2024-09-13T06:13:39.117641+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'3","last_scrub_stamp":"2024-09-13T06:13:39.117394+0000","last_deep_scrub":"35'3","last_deep_scrub_stamp":"2024-09-13T06:13:39.117394+0000","last_clean_scrub_stamp":"2024-09-13T06:13:39.117394+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:34:55.196548+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"35'39","reported_seq":97,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:29.877565+0000","last_change":"2024-09-13T06:13:29.877565+0000","last_active":"2024-09-13T06:13:29.877565+0000","last_peered":"2024-09-13T06:13:29.877565+0000","last_clean":"2024-09-13T06:13:29.877565+0000","last_became_active":"2024-09-13T06:09:38.166333+0000","last_became_peered":"2024-09-13T06:09:38.166333+0000","last_unstale":"2024-09-13T06:13:29.877565+0000","last_undegraded":"2024-09-13T06:13:29.877565+0000","last_fullsized":"2024-09-13T06:13:29.877565+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'39","last_scrub_stamp":"2024-09-13T06:13:29.877300+0000","last_deep_scrub":"35'39","last_deep_scrub_stamp":"2024-09-13T06:13:29.877300+0000","last_clean_scrub_stamp":"2024-09-13T06:13:29.877300+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:40:12.627053+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:36.323280+0000","last_change":"2024-09-13T06:13:36.323280+0000","last_active":"2024-09-13T06:13:36.323280+0000","last_peered":"2024-09-13T06:13:36.323280+0000","last_clean":"2024-09-13T06:13:36.323280+0000","last_became_active":"2024-09-13T06:09:40.178392+0000","last_became_peered":"2024-09-13T06:09:40.178392+0000","last_unstale":"2024-09-13T06:13:36.323280+0000","last_undegraded":"2024-09-13T06:13:36.323280+0000","last_fullsized":"2024-09-13T06:13:36.323280+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:13:36.323029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:13:36.323029+0000","last_clean_scrub_stamp":"2024-09-13T06:13:36.323029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:56:23.983741+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"35'8","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:47.799388+0000","last_change":"2024-09-13T06:14:47.799512+0000","last_active":"2024-09-13T06:14:47.799388+0000","last_peered":"2024-09-13T06:14:47.799388+0000","last_clean":"2024-09-13T06:14:47.799388+0000","last_became_active":"2024-09-13T06:09:42.213809+0000","last_became_peered":"2024-09-13T06:09:42.213809+0000","last_unstale":"2024-09-13T06:14:47.799388+0000","last_undegraded":"2024-09-13T06:14:47.799388+0000","last_fullsized":"2024-09-13T06:14:47.799388+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-13T06:14:47.799143+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-13T06:14:47.799143+0000","last_clean_scrub_stamp":"2024-09-13T06:14:47.799143+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:44:28.738828+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"35'6","reported_seq":83,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:47.104386+0000","last_change":"2024-09-13T06:13:47.104386+0000","last_active":"2024-09-13T06:13:47.104386+0000","last_peered":"2024-09-13T06:13:47.104386+0000","last_clean":"2024-09-13T06:13:47.104386+0000","last_became_active":"2024-09-13T06:09:34.124044+0000","last_became_peered":"2024-09-13T06:09:34.124044+0000","last_unstale":"2024-09-13T06:13:47.104386+0000","last_undegraded":"2024-09-13T06:13:47.104386+0000","last_fullsized":"2024-09-13T06:13:47.104386+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:13:47.104098+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:13:47.104098+0000","last_clean_scrub_stamp":"2024-09-13T06:13:47.104098+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:28:40.579321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:05.457710+0000","last_change":"2024-09-13T06:14:05.457846+0000","last_active":"2024-09-13T06:14:05.457710+0000","last_peered":"2024-09-13T06:14:05.457710+0000","last_clean":"2024-09-13T06:14:05.457710+0000","last_became_active":"2024-09-13T06:09:32.133972+0000","last_became_peered":"2024-09-13T06:09:32.133972+0000","last_unstale":"2024-09-13T06:14:05.457710+0000","last_undegraded":"2024-09-13T06:14:05.457710+0000","last_fullsized":"2024-09-13T06:14:05.457710+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:05.457422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:05.457422+0000","last_clean_scrub_stamp":"2024-09-13T06:14:05.457422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:46:40.297521+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"35'12","reported_seq":71,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:54.184427+0000","last_change":"2024-09-13T06:13:54.184427+0000","last_active":"2024-09-13T06:13:54.184427+0000","last_peered":"2024-09-13T06:13:54.184427+0000","last_clean":"2024-09-13T06:13:54.184427+0000","last_became_active":"2024-09-13T06:09:34.112805+0000","last_became_peered":"2024-09-13T06:09:34.112805+0000","last_unstale":"2024-09-13T06:13:54.184427+0000","last_undegraded":"2024-09-13T06:13:54.184427+0000","last_fullsized":"2024-09-13T06:13:54.184427+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'12","last_scrub_stamp":"2024-09-13T06:13:54.184142+0000","last_deep_scrub":"35'12","last_deep_scrub_stamp":"2024-09-13T06:13:54.184142+0000","last_clean_scrub_stamp":"2024-09-13T06:13:54.184142+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:51:20.968060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:08.975226+0000","last_change":"2024-09-13T06:14:08.975415+0000","last_active":"2024-09-13T06:14:08.975226+0000","last_peered":"2024-09-13T06:14:08.975226+0000","last_clean":"2024-09-13T06:14:08.975226+0000","last_became_active":"2024-09-13T06:09:32.145941+0000","last_became_peered":"2024-09-13T06:09:32.145941+0000","last_unstale":"2024-09-13T06:14:08.975226+0000","last_undegraded":"2024-09-13T06:14:08.975226+0000","last_fullsized":"2024-09-13T06:14:08.975226+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:08.974987+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:08.974987+0000","last_clean_scrub_stamp":"2024-09-13T06:14:08.974987+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:47:49.396587+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"35'10","reported_seq":82,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:04.932958+0000","last_change":"2024-09-13T06:14:04.933134+0000","last_active":"2024-09-13T06:14:04.932958+0000","last_peered":"2024-09-13T06:14:04.932958+0000","last_clean":"2024-09-13T06:14:04.932958+0000","last_became_active":"2024-09-13T06:09:34.118325+0000","last_became_peered":"2024-09-13T06:09:34.118325+0000","last_unstale":"2024-09-13T06:14:04.932958+0000","last_undegraded":"2024-09-13T06:14:04.932958+0000","last_fullsized":"2024-09-13T06:14:04.932958+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-09-13T06:14:04.932682+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-09-13T06:14:04.932682+0000","last_clean_scrub_stamp":"2024-09-13T06:14:04.932682+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:01:08.869470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"35'2","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:14.902552+0000","last_change":"2024-09-13T06:14:14.902614+0000","last_active":"2024-09-13T06:14:14.902552+0000","last_peered":"2024-09-13T06:14:14.902552+0000","last_clean":"2024-09-13T06:14:14.902552+0000","last_became_active":"2024-09-13T06:09:32.133230+0000","last_became_peered":"2024-09-13T06:09:32.133230+0000","last_unstale":"2024-09-13T06:14:14.902552+0000","last_undegraded":"2024-09-13T06:14:14.902552+0000","last_fullsized":"2024-09-13T06:14:14.902552+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:14.902345+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:14.902345+0000","last_clean_scrub_stamp":"2024-09-13T06:14:14.902345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:14:42.826299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"35'4","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:05.970204+0000","last_change":"2024-09-13T06:14:05.970361+0000","last_active":"2024-09-13T06:14:05.970204+0000","last_peered":"2024-09-13T06:14:05.970204+0000","last_clean":"2024-09-13T06:14:05.970204+0000","last_became_active":"2024-09-13T06:09:34.115512+0000","last_became_peered":"2024-09-13T06:09:34.115512+0000","last_unstale":"2024-09-13T06:14:05.970204+0000","last_undegraded":"2024-09-13T06:14:05.970204+0000","last_fullsized":"2024-09-13T06:14:05.970204+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:14:05.969984+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:14:05.969984+0000","last_clean_scrub_stamp":"2024-09-13T06:14:05.969984+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:15:46.339756+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"35'2","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:55.188916+0000","last_change":"2024-09-13T06:13:55.188996+0000","last_active":"2024-09-13T06:13:55.188916+0000","last_peered":"2024-09-13T06:13:55.188916+0000","last_clean":"2024-09-13T06:13:55.188916+0000","last_became_active":"2024-09-13T06:09:32.150328+0000","last_became_peered":"2024-09-13T06:09:32.150328+0000","last_unstale":"2024-09-13T06:13:55.188916+0000","last_undegraded":"2024-09-13T06:13:55.188916+0000","last_fullsized":"2024-09-13T06:13:55.188916+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:13:55.188727+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:13:55.188727+0000","last_clean_scrub_stamp":"2024-09-13T06:13:55.188727+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:42:47.449646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"35'12","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:58.146481+0000","last_change":"2024-09-13T06:13:58.146634+0000","last_active":"2024-09-13T06:13:58.146481+0000","last_peered":"2024-09-13T06:13:58.146481+0000","last_clean":"2024-09-13T06:13:58.146481+0000","last_became_active":"2024-09-13T06:09:34.113986+0000","last_became_peered":"2024-09-13T06:09:34.113986+0000","last_unstale":"2024-09-13T06:13:58.146481+0000","last_undegraded":"2024-09-13T06:13:58.146481+0000","last_fullsized":"2024-09-13T06:13:58.146481+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'12","last_scrub_stamp":"2024-09-13T06:13:58.146265+0000","last_deep_scrub":"35'12","last_deep_scrub_stamp":"2024-09-13T06:13:58.146265+0000","last_clean_scrub_stamp":"2024-09-13T06:13:58.146265+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:51:22.340040+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:13.944371+0000","last_change":"2024-09-13T06:14:13.944480+0000","last_active":"2024-09-13T06:14:13.944371+0000","last_peered":"2024-09-13T06:14:13.944371+0000","last_clean":"2024-09-13T06:14:13.944371+0000","last_became_active":"2024-09-13T06:09:32.136268+0000","last_became_peered":"2024-09-13T06:09:32.136268+0000","last_unstale":"2024-09-13T06:14:13.944371+0000","last_undegraded":"2024-09-13T06:14:13.944371+0000","last_fullsized":"2024-09-13T06:14:13.944371+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:13.944088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:13.944088+0000","last_clean_scrub_stamp":"2024-09-13T06:14:13.944088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:44:54.412744+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"35'4","reported_seq":50,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:19.128998+0000","last_change":"2024-09-13T06:14:19.129062+0000","last_active":"2024-09-13T06:14:19.128998+0000","last_peered":"2024-09-13T06:14:19.128998+0000","last_clean":"2024-09-13T06:14:19.128998+0000","last_became_active":"2024-09-13T06:09:34.121261+0000","last_became_peered":"2024-09-13T06:09:34.121261+0000","last_unstale":"2024-09-13T06:14:19.128998+0000","last_undegraded":"2024-09-13T06:14:19.128998+0000","last_fullsized":"2024-09-13T06:14:19.128998+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:14:19.128789+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:14:19.128789+0000","last_clean_scrub_stamp":"2024-09-13T06:14:19.128789+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:05:27.992700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:08.105829+0000","last_change":"2024-09-13T06:14:08.105893+0000","last_active":"2024-09-13T06:14:08.105829+0000","last_peered":"2024-09-13T06:14:08.105829+0000","last_clean":"2024-09-13T06:14:08.105829+0000","last_became_active":"2024-09-13T06:09:32.141602+0000","last_became_peered":"2024-09-13T06:09:32.141602+0000","last_unstale":"2024-09-13T06:14:08.105829+0000","last_undegraded":"2024-09-13T06:14:08.105829+0000","last_fullsized":"2024-09-13T06:14:08.105829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:08.105610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:08.105610+0000","last_clean_scrub_stamp":"2024-09-13T06:14:08.105610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:19:46.183614+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"35'6","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:18.072373+0000","last_change":"2024-09-13T06:14:18.072506+0000","last_active":"2024-09-13T06:14:18.072373+0000","last_peered":"2024-09-13T06:14:18.072373+0000","last_clean":"2024-09-13T06:14:18.072373+0000","last_became_active":"2024-09-13T06:09:34.122424+0000","last_became_peered":"2024-09-13T06:09:34.122424+0000","last_unstale":"2024-09-13T06:14:18.072373+0000","last_undegraded":"2024-09-13T06:14:18.072373+0000","last_fullsized":"2024-09-13T06:14:18.072373+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:14:18.072146+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:14:18.072146+0000","last_clean_scrub_stamp":"2024-09-13T06:14:18.072146+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:09:59.488966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:11.491383+0000","last_change":"2024-09-13T06:14:11.491442+0000","last_active":"2024-09-13T06:14:11.491383+0000","last_peered":"2024-09-13T06:14:11.491383+0000","last_clean":"2024-09-13T06:14:11.491383+0000","last_became_active":"2024-09-13T06:09:32.119665+0000","last_became_peered":"2024-09-13T06:09:32.119665+0000","last_unstale":"2024-09-13T06:14:11.491383+0000","last_undegraded":"2024-09-13T06:14:11.491383+0000","last_fullsized":"2024-09-13T06:14:11.491383+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:11.491173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:11.491173+0000","last_clean_scrub_stamp":"2024-09-13T06:14:11.491173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:27:39.464448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"35'10","reported_seq":68,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:07.156771+0000","last_change":"2024-09-13T06:14:07.156840+0000","last_active":"2024-09-13T06:14:07.156771+0000","last_peered":"2024-09-13T06:14:07.156771+0000","last_clean":"2024-09-13T06:14:07.156771+0000","last_became_active":"2024-09-13T06:09:34.114378+0000","last_became_peered":"2024-09-13T06:09:34.114378+0000","last_unstale":"2024-09-13T06:14:07.156771+0000","last_undegraded":"2024-09-13T06:14:07.156771+0000","last_fullsized":"2024-09-13T06:14:07.156771+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'10","last_scrub_stamp":"2024-09-13T06:14:07.156555+0000","last_deep_scrub":"35'10","last_deep_scrub_stamp":"2024-09-13T06:14:07.156555+0000","last_clean_scrub_stamp":"2024-09-13T06:14:07.156555+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:56:33.412136+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"35'4","reported_seq":55,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:15.998938+0000","last_change":"2024-09-13T06:14:15.999004+0000","last_active":"2024-09-13T06:14:15.998938+0000","last_peered":"2024-09-13T06:14:15.998938+0000","last_clean":"2024-09-13T06:14:15.998938+0000","last_became_active":"2024-09-13T06:09:32.146011+0000","last_became_peered":"2024-09-13T06:09:32.146011+0000","last_unstale":"2024-09-13T06:14:15.998938+0000","last_undegraded":"2024-09-13T06:14:15.998938+0000","last_fullsized":"2024-09-13T06:14:15.998938+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:14:15.998743+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:14:15.998743+0000","last_clean_scrub_stamp":"2024-09-13T06:14:15.998743+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:57:13.676423+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"35'2","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:01.041151+0000","last_change":"2024-09-13T06:14:01.041151+0000","last_active":"2024-09-13T06:14:01.041151+0000","last_peered":"2024-09-13T06:14:01.041151+0000","last_clean":"2024-09-13T06:14:01.041151+0000","last_became_active":"2024-09-13T06:09:34.117659+0000","last_became_peered":"2024-09-13T06:09:34.117659+0000","last_unstale":"2024-09-13T06:14:01.041151+0000","last_undegraded":"2024-09-13T06:14:01.041151+0000","last_fullsized":"2024-09-13T06:14:01.041151+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:01.040862+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:01.040862+0000","last_clean_scrub_stamp":"2024-09-13T06:14:01.040862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:24:05.707493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"35'2","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:38.822673+0000","last_change":"2024-09-13T06:14:38.822741+0000","last_active":"2024-09-13T06:14:38.822673+0000","last_peered":"2024-09-13T06:14:38.822673+0000","last_clean":"2024-09-13T06:14:38.822673+0000","last_became_active":"2024-09-13T06:09:32.121250+0000","last_became_peered":"2024-09-13T06:09:32.121250+0000","last_unstale":"2024-09-13T06:14:38.822673+0000","last_undegraded":"2024-09-13T06:14:38.822673+0000","last_fullsized":"2024-09-13T06:14:38.822673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:38.822439+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:38.822439+0000","last_clean_scrub_stamp":"2024-09-13T06:14:38.822439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:33:31.596195+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"35'6","reported_seq":61,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:08.927366+0000","last_change":"2024-09-13T06:14:08.927366+0000","last_active":"2024-09-13T06:14:08.927366+0000","last_peered":"2024-09-13T06:14:08.927366+0000","last_clean":"2024-09-13T06:14:08.927366+0000","last_became_active":"2024-09-13T06:09:34.118270+0000","last_became_peered":"2024-09-13T06:09:34.118270+0000","last_unstale":"2024-09-13T06:14:08.927366+0000","last_undegraded":"2024-09-13T06:14:08.927366+0000","last_fullsized":"2024-09-13T06:14:08.927366+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:14:08.926982+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:14:08.926982+0000","last_clean_scrub_stamp":"2024-09-13T06:14:08.926982+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:32:51.698999+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:07.008210+0000","last_change":"2024-09-13T06:14:07.008276+0000","last_active":"2024-09-13T06:14:07.008210+0000","last_peered":"2024-09-13T06:14:07.008210+0000","last_clean":"2024-09-13T06:14:07.008210+0000","last_became_active":"2024-09-13T06:09:32.145988+0000","last_became_peered":"2024-09-13T06:09:32.145988+0000","last_unstale":"2024-09-13T06:14:07.008210+0000","last_undegraded":"2024-09-13T06:14:07.008210+0000","last_fullsized":"2024-09-13T06:14:07.008210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:07.008017+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:07.008017+0000","last_clean_scrub_stamp":"2024-09-13T06:14:07.008017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:52:30.109612+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"33'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:07.967599+0000","last_change":"2024-09-13T06:14:07.967667+0000","last_active":"2024-09-13T06:14:07.967599+0000","last_peered":"2024-09-13T06:14:07.967599+0000","last_clean":"2024-09-13T06:14:07.967599+0000","last_became_active":"2024-09-13T06:09:34.117320+0000","last_became_peered":"2024-09-13T06:09:34.117320+0000","last_unstale":"2024-09-13T06:14:07.967599+0000","last_undegraded":"2024-09-13T06:14:07.967599+0000","last_fullsized":"2024-09-13T06:14:07.967599+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T06:14:07.967409+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T06:14:07.967409+0000","last_clean_scrub_stamp":"2024-09-13T06:14:07.967409+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:23:37.518274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:10.151581+0000","last_change":"2024-09-13T06:14:10.151647+0000","last_active":"2024-09-13T06:14:10.151581+0000","last_peered":"2024-09-13T06:14:10.151581+0000","last_clean":"2024-09-13T06:14:10.151581+0000","last_became_active":"2024-09-13T06:09:32.141009+0000","last_became_peered":"2024-09-13T06:09:32.141009+0000","last_unstale":"2024-09-13T06:14:10.151581+0000","last_undegraded":"2024-09-13T06:14:10.151581+0000","last_fullsized":"2024-09-13T06:14:10.151581+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:10.151382+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:10.151382+0000","last_clean_scrub_stamp":"2024-09-13T06:14:10.151382+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:48:46.322553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"35'12","reported_seq":92,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:50.099644+0000","last_change":"2024-09-13T06:13:50.099644+0000","last_active":"2024-09-13T06:13:50.099644+0000","last_peered":"2024-09-13T06:13:50.099644+0000","last_clean":"2024-09-13T06:13:50.099644+0000","last_became_active":"2024-09-13T06:09:34.124270+0000","last_became_peered":"2024-09-13T06:09:34.124270+0000","last_unstale":"2024-09-13T06:13:50.099644+0000","last_undegraded":"2024-09-13T06:13:50.099644+0000","last_fullsized":"2024-09-13T06:13:50.099644+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'12","last_scrub_stamp":"2024-09-13T06:13:50.099391+0000","last_deep_scrub":"35'12","last_deep_scrub_stamp":"2024-09-13T06:13:50.099391+0000","last_clean_scrub_stamp":"2024-09-13T06:13:50.099391+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:45:17.171613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"35'2","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:06.105644+0000","last_change":"2024-09-13T06:14:06.105715+0000","last_active":"2024-09-13T06:14:06.105644+0000","last_peered":"2024-09-13T06:14:06.105644+0000","last_clean":"2024-09-13T06:14:06.105644+0000","last_became_active":"2024-09-13T06:09:32.142581+0000","last_became_peered":"2024-09-13T06:09:32.142581+0000","last_unstale":"2024-09-13T06:14:06.105644+0000","last_undegraded":"2024-09-13T06:14:06.105644+0000","last_fullsized":"2024-09-13T06:14:06.105644+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:06.105415+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:06.105415+0000","last_clean_scrub_stamp":"2024-09-13T06:14:06.105415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:14:58.354875+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"35'16","reported_seq":86,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:57.087154+0000","last_change":"2024-09-13T06:13:57.087154+0000","last_active":"2024-09-13T06:13:57.087154+0000","last_peered":"2024-09-13T06:13:57.087154+0000","last_clean":"2024-09-13T06:13:57.087154+0000","last_became_active":"2024-09-13T06:09:34.118290+0000","last_became_peered":"2024-09-13T06:09:34.118290+0000","last_unstale":"2024-09-13T06:13:57.087154+0000","last_undegraded":"2024-09-13T06:13:57.087154+0000","last_fullsized":"2024-09-13T06:13:57.087154+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'16","last_scrub_stamp":"2024-09-13T06:13:57.086869+0000","last_deep_scrub":"35'16","last_deep_scrub_stamp":"2024-09-13T06:13:57.086869+0000","last_clean_scrub_stamp":"2024-09-13T06:13:57.086869+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:49:34.359420+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":58,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:40.825386+0000","last_change":"2024-09-13T06:14:40.825445+0000","last_active":"2024-09-13T06:14:40.825386+0000","last_peered":"2024-09-13T06:14:40.825386+0000","last_clean":"2024-09-13T06:14:40.825386+0000","last_became_active":"2024-09-13T06:09:32.121400+0000","last_became_peered":"2024-09-13T06:09:32.121400+0000","last_unstale":"2024-09-13T06:14:40.825386+0000","last_undegraded":"2024-09-13T06:14:40.825386+0000","last_fullsized":"2024-09-13T06:14:40.825386+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:40.825185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:40.825185+0000","last_clean_scrub_stamp":"2024-09-13T06:14:40.825185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:35:38.074006+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"35'14","reported_seq":83,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:51.115078+0000","last_change":"2024-09-13T06:13:51.115078+0000","last_active":"2024-09-13T06:13:51.115078+0000","last_peered":"2024-09-13T06:13:51.115078+0000","last_clean":"2024-09-13T06:13:51.115078+0000","last_became_active":"2024-09-13T06:09:34.121743+0000","last_became_peered":"2024-09-13T06:09:34.121743+0000","last_unstale":"2024-09-13T06:13:51.115078+0000","last_undegraded":"2024-09-13T06:13:51.115078+0000","last_fullsized":"2024-09-13T06:13:51.115078+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'14","last_scrub_stamp":"2024-09-13T06:13:51.114821+0000","last_deep_scrub":"35'14","last_deep_scrub_stamp":"2024-09-13T06:13:51.114821+0000","last_clean_scrub_stamp":"2024-09-13T06:13:51.114821+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:13:09.983207+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"35'2","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:27.822613+0000","last_change":"2024-09-13T06:14:27.822750+0000","last_active":"2024-09-13T06:14:27.822613+0000","last_peered":"2024-09-13T06:14:27.822613+0000","last_clean":"2024-09-13T06:14:27.822613+0000","last_became_active":"2024-09-13T06:09:32.127830+0000","last_became_peered":"2024-09-13T06:09:32.127830+0000","last_unstale":"2024-09-13T06:14:27.822613+0000","last_undegraded":"2024-09-13T06:14:27.822613+0000","last_fullsized":"2024-09-13T06:14:27.822613+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:27.822361+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:27.822361+0000","last_clean_scrub_stamp":"2024-09-13T06:14:27.822361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:22:21.878003+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"35'4","reported_seq":53,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:57.956132+0000","last_change":"2024-09-13T06:13:57.956132+0000","last_active":"2024-09-13T06:13:57.956132+0000","last_peered":"2024-09-13T06:13:57.956132+0000","last_clean":"2024-09-13T06:13:57.956132+0000","last_became_active":"2024-09-13T06:09:34.126020+0000","last_became_peered":"2024-09-13T06:09:34.126020+0000","last_unstale":"2024-09-13T06:13:57.956132+0000","last_undegraded":"2024-09-13T06:13:57.956132+0000","last_fullsized":"2024-09-13T06:13:57.956132+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:13:57.955748+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:13:57.955748+0000","last_clean_scrub_stamp":"2024-09-13T06:13:57.955748+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:48:29.811216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"35'2","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:10.525305+0000","last_change":"2024-09-13T06:14:10.525305+0000","last_active":"2024-09-13T06:14:10.525305+0000","last_peered":"2024-09-13T06:14:10.525305+0000","last_clean":"2024-09-13T06:14:10.525305+0000","last_became_active":"2024-09-13T06:09:32.119542+0000","last_became_peered":"2024-09-13T06:09:32.119542+0000","last_unstale":"2024-09-13T06:14:10.525305+0000","last_undegraded":"2024-09-13T06:14:10.525305+0000","last_fullsized":"2024-09-13T06:14:10.525305+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-13T06:14:10.524864+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-13T06:14:10.524864+0000","last_clean_scrub_stamp":"2024-09-13T06:14:10.524864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:24:35.781954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"35'6","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:59.089157+0000","last_change":"2024-09-13T06:13:59.089218+0000","last_active":"2024-09-13T06:13:59.089157+0000","last_peered":"2024-09-13T06:13:59.089157+0000","last_clean":"2024-09-13T06:13:59.089157+0000","last_became_active":"2024-09-13T06:09:34.110506+0000","last_became_peered":"2024-09-13T06:09:34.110506+0000","last_unstale":"2024-09-13T06:13:59.089157+0000","last_undegraded":"2024-09-13T06:13:59.089157+0000","last_fullsized":"2024-09-13T06:13:59.089157+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'6","last_scrub_stamp":"2024-09-13T06:13:59.088967+0000","last_deep_scrub":"35'6","last_deep_scrub_stamp":"2024-09-13T06:13:59.088967+0000","last_clean_scrub_stamp":"2024-09-13T06:13:59.088967+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:47:06.868835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:24.898869+0000","last_change":"2024-09-13T06:14:24.898931+0000","last_active":"2024-09-13T06:14:24.898869+0000","last_peered":"2024-09-13T06:14:24.898869+0000","last_clean":"2024-09-13T06:14:24.898869+0000","last_became_active":"2024-09-13T06:09:32.121895+0000","last_became_peered":"2024-09-13T06:09:32.121895+0000","last_unstale":"2024-09-13T06:14:24.898869+0000","last_undegraded":"2024-09-13T06:14:24.898869+0000","last_fullsized":"2024-09-13T06:14:24.898869+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:24.898655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:24.898655+0000","last_clean_scrub_stamp":"2024-09-13T06:14:24.898655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:00:29.891000+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:17.885220+0000","last_change":"2024-09-13T06:14:17.885278+0000","last_active":"2024-09-13T06:14:17.885220+0000","last_peered":"2024-09-13T06:14:17.885220+0000","last_clean":"2024-09-13T06:14:17.885220+0000","last_became_active":"2024-09-13T06:09:32.130056+0000","last_became_peered":"2024-09-13T06:09:32.130056+0000","last_unstale":"2024-09-13T06:14:17.885220+0000","last_undegraded":"2024-09-13T06:14:17.885220+0000","last_fullsized":"2024-09-13T06:14:17.885220+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:14:17.885008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:14:17.885008+0000","last_clean_scrub_stamp":"2024-09-13T06:14:17.885008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:43:49.653431+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"35'8","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:13:50.089510+0000","last_change":"2024-09-13T06:13:50.089510+0000","last_active":"2024-09-13T06:13:50.089510+0000","last_peered":"2024-09-13T06:13:50.089510+0000","last_clean":"2024-09-13T06:13:50.089510+0000","last_became_active":"2024-09-13T06:09:34.130980+0000","last_became_peered":"2024-09-13T06:09:34.130980+0000","last_unstale":"2024-09-13T06:13:50.089510+0000","last_undegraded":"2024-09-13T06:13:50.089510+0000","last_fullsized":"2024-09-13T06:13:50.089510+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'8","last_scrub_stamp":"2024-09-13T06:13:50.089259+0000","last_deep_scrub":"35'8","last_deep_scrub_stamp":"2024-09-13T06:13:50.089259+0000","last_clean_scrub_stamp":"2024-09-13T06:13:50.089259+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:04:38.003620+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"33'2","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:01.059413+0000","last_change":"2024-09-13T06:14:01.059413+0000","last_active":"2024-09-13T06:14:01.059413+0000","last_peered":"2024-09-13T06:14:01.059413+0000","last_clean":"2024-09-13T06:14:01.059413+0000","last_became_active":"2024-09-13T06:09:32.149426+0000","last_became_peered":"2024-09-13T06:09:32.149426+0000","last_unstale":"2024-09-13T06:14:01.059413+0000","last_undegraded":"2024-09-13T06:14:01.059413+0000","last_fullsized":"2024-09-13T06:14:01.059413+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T06:14:01.059140+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T06:14:01.059140+0000","last_clean_scrub_stamp":"2024-09-13T06:14:01.059140+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:11:35.487998+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"35'4","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T06:14:03.116819+0000","last_change":"2024-09-13T06:14:03.116819+0000","last_active":"2024-09-13T06:14:03.116819+0000","last_peered":"2024-09-13T06:14:03.116819+0000","last_clean":"2024-09-13T06:14:03.116819+0000","last_became_active":"2024-09-13T06:09:34.111230+0000","last_became_peered":"2024-09-13T06:09:34.111230+0000","last_unstale":"2024-09-13T06:14:03.116819+0000","last_undegraded":"2024-09-13T06:14:03.116819+0000","last_fullsized":"2024-09-13T06:14:03.116819+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'4","last_scrub_stamp":"2024-09-13T06:14:03.116583+0000","last_deep_scrub":"35'4","last_deep_scrub_stamp":"2024-09-13T06:14:03.116583+0000","last_clean_scrub_stamp":"2024-09-13T06:14:03.116583+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:05:21.374929+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":277,"ondisk_log_size":277,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2281,"ondisk_log_size":2281,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1530,"ondisk_log_size":1530,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1618,"num_read_kb":1508,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640330,"num_pgs":179,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39984,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331856,"statfs":{"total":96636764160,"available":96595820544,"internally_reserved":0,"allocated":491520,"data_stored":155427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640330,"num_pgs":155,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40524,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331316,"statfs":{"total":96636764160,"available":96595267584,"internally_reserved":0,"allocated":1044480,"data_stored":743705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673034,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40500,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331340,"statfs":{"total":96636764160,"available":96595292160,"internally_reserved":0,"allocated":1019904,"data_stored":743361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705736,"num_pgs":170,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39952,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331888,"statfs":{"total":96636764160,"available":96595853312,"internally_reserved":0,"allocated":458752,"data_stored":154423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T06:15:07.812 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-13T06:15:07.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.959+0000 7fb68d952640 1 Processor -- start 2024-09-13T06:15:07.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.959+0000 7fb68d952640 1 -- start start 2024-09-13T06:15:07.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.959+0000 7fb68d952640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fb68812d160 0x7fb6881319f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:15:07.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.959+0000 7fb68d952640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb688070d40 con 0x7fb68812c670 2024-09-13T06:15:07.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.959+0000 7fb68d952640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fb68812d570 con 0x7fb68812d160 2024-09-13T06:15:07.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.959+0000 7fb6867fc640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fb68812d160 0x7fb6881319f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:15:07.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.959+0000 7fb686ffd640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fb68812c670 0x7fb68812ca50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:46248/0 (socket says 172.21.15.120:46248) 2024-09-13T06:15:07.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.959+0000 7fb686ffd640 1 -- 172.21.15.120:0/1591779775 learned_addr learned my addr 172.21.15.120:0/1591779775 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-09-13T06:15:07.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.959+0000 7fb6867fc640 1 -- 172.21.15.120:0/1591779775 >> v1:172.21.15.120:6789/0 conn(0x7fb68812c670 legacy=0x7fb68812ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:15:07.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.959+0000 7fb6867fc640 1 -- 172.21.15.120:0/1591779775 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb688071420 con 0x7fb68812d160 2024-09-13T06:15:07.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.959+0000 7fb6867fc640 1 --2- 172.21.15.120:0/1591779775 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb68812d160 0x7fb6881319f0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fb67c009740 tx=0x7fb67c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9137054ba19f8ad2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:15:07.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.959+0000 7fb685ffb640 1 -- 172.21.15.120:0/1591779775 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb67c0b0070 con 0x7fb68812d160 2024-09-13T06:15:07.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.959+0000 7fb685ffb640 1 -- 172.21.15.120:0/1591779775 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb67c0ab530 con 0x7fb68812d160 2024-09-13T06:15:07.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.959+0000 7fb685ffb640 1 -- 172.21.15.120:0/1591779775 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb67c0ab830 con 0x7fb68812d160 2024-09-13T06:15:07.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.963+0000 7fb68d952640 1 -- 172.21.15.120:0/1591779775 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb68812d160 msgr2=0x7fb6881319f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:15:07.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.963+0000 7fb68d952640 1 --2- 172.21.15.120:0/1591779775 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb68812d160 0x7fb6881319f0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fb67c009740 tx=0x7fb67c01c370 comp rx=0 tx=0).stop 2024-09-13T06:15:07.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.963+0000 7fb68d952640 1 -- 172.21.15.120:0/1591779775 shutdown_connections 2024-09-13T06:15:07.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.963+0000 7fb68d952640 1 --2- 172.21.15.120:0/1591779775 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb68812d160 0x7fb6881319f0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:15:07.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.963+0000 7fb68d952640 1 -- 172.21.15.120:0/1591779775 >> 172.21.15.120:0/1591779775 conn(0x7fb68809a8a0 msgr2=0x7fb68809acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:15:07.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.963+0000 7fb68d952640 1 -- 172.21.15.120:0/1591779775 shutdown_connections 2024-09-13T06:15:07.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.963+0000 7fb68d952640 1 -- 172.21.15.120:0/1591779775 wait complete. 2024-09-13T06:15:07.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.963+0000 7fb68d952640 1 Processor -- start 2024-09-13T06:15:07.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.963+0000 7fb68d952640 1 -- start start 2024-09-13T06:15:07.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.963+0000 7fb68d952640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb68812c670 0x7fb68806ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:15:07.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.963+0000 7fb68d952640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fb688134960 con 0x7fb68812c670 2024-09-13T06:15:07.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.963+0000 7fb686ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb68812c670 0x7fb68806ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:15:07.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.963+0000 7fb686ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb68812c670 0x7fb68806ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34156/0 (socket says 172.21.15.120:34156) 2024-09-13T06:15:07.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.963+0000 7fb686ffd640 1 -- 172.21.15.120:0/3081369952 learned_addr learned my addr 172.21.15.120:0/3081369952 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-13T06:15:07.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.963+0000 7fb686ffd640 1 -- 172.21.15.120:0/3081369952 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6881264b0 con 0x7fb68812c670 2024-09-13T06:15:07.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.963+0000 7fb686ffd640 1 --2- 172.21.15.120:0/3081369952 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb68812c670 0x7fb68806ea80 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fb67800c480 tx=0x7fb67800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:15:07.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.963+0000 7fb66ffff640 1 -- 172.21.15.120:0/3081369952 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb678017070 con 0x7fb68812c670 2024-09-13T06:15:07.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.963+0000 7fb66ffff640 1 -- 172.21.15.120:0/3081369952 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb678005c20 con 0x7fb68812c670 2024-09-13T06:15:07.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.963+0000 7fb68d952640 1 -- 172.21.15.120:0/3081369952 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb68806fe20 con 0x7fb68812c670 2024-09-13T06:15:07.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.963+0000 7fb66ffff640 1 -- 172.21.15.120:0/3081369952 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb678007070 con 0x7fb68812c670 2024-09-13T06:15:07.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.963+0000 7fb68d952640 1 -- 172.21.15.120:0/3081369952 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb68806f190 con 0x7fb68812c670 2024-09-13T06:15:07.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.963+0000 7fb68d952640 1 -- 172.21.15.120:0/3081369952 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb68812ca50 con 0x7fb68812c670 2024-09-13T06:15:07.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.963+0000 7fb66ffff640 1 -- 172.21.15.120:0/3081369952 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb67801a070 con 0x7fb68812c670 2024-09-13T06:15:07.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.963+0000 7fb66ffff640 1 --2- 172.21.15.120:0/3081369952 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fb674035db0 0x7fb674038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T06:15:07.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.963+0000 7fb66ffff640 1 -- 172.21.15.120:0/3081369952 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6307+0+0 (secure 0 0 0) 0x7fb678048440 con 0x7fb68812c670 2024-09-13T06:15:07.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.967+0000 7fb6867fc640 1 --2- 172.21.15.120:0/3081369952 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fb674035db0 0x7fb674038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T06:15:07.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.967+0000 7fb6867fc640 1 --2- 172.21.15.120:0/3081369952 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fb674035db0 0x7fb674038270 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb67c0ad000 tx=0x7fb67c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T06:15:07.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:07.971+0000 7fb66ffff640 1 -- 172.21.15.120:0/3081369952 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb67801a760 con 0x7fb68812c670 2024-09-13T06:15:08.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:08.127+0000 7fb68d952640 1 -- 172.21.15.120:0/3081369952 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fb688126da0 con 0x7fb68812c670 2024-09-13T06:15:08.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:08.131+0000 7fb66ffff640 1 -- 172.21.15.120:0/3081369952 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7fb678007210 con 0x7fb68812c670 2024-09-13T06:15:08.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:08.135+0000 7fb66ffff640 1 -- 172.21.15.120:0/3081369952 <== mon.0 v2:172.21.15.120:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fb6780480d0 con 0x7fb68812c670 2024-09-13T06:15:08.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:08.135+0000 7fb68d952640 1 -- 172.21.15.120:0/3081369952 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fb674035db0 msgr2=0x7fb674038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:15:08.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:08.135+0000 7fb68d952640 1 --2- 172.21.15.120:0/3081369952 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fb674035db0 0x7fb674038270 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb67c0ad000 tx=0x7fb67c008040 comp rx=0 tx=0).stop 2024-09-13T06:15:08.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:08.135+0000 7fb68d952640 1 -- 172.21.15.120:0/3081369952 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb68812c670 msgr2=0x7fb68806ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T06:15:08.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:08.135+0000 7fb68d952640 1 --2- 172.21.15.120:0/3081369952 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb68812c670 0x7fb68806ea80 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fb67800c480 tx=0x7fb67800c940 comp rx=0 tx=0).stop 2024-09-13T06:15:08.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:08.135+0000 7fb68d952640 1 -- 172.21.15.120:0/3081369952 shutdown_connections 2024-09-13T06:15:08.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:08.135+0000 7fb68d952640 1 --2- 172.21.15.120:0/3081369952 >> [v2:172.21.15.194:6824/3475680902,v1:172.21.15.194:6825/3475680902] conn(0x7fb674035db0 0x7fb674038270 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:15:08.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:08.135+0000 7fb68d952640 1 --2- 172.21.15.120:0/3081369952 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb68812c670 0x7fb68806ea80 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T06:15:08.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:08.135+0000 7fb68d952640 1 -- 172.21.15.120:0/3081369952 >> 172.21.15.120:0/3081369952 conn(0x7fb68809a8a0 msgr2=0x7fb688126fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T06:15:08.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:08.135+0000 7fb68d952640 1 -- 172.21.15.120:0/3081369952 shutdown_connections 2024-09-13T06:15:08.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-13T06:15:08.135+0000 7fb68d952640 1 -- 172.21.15.120:0/3081369952 wait complete. 2024-09-13T06:15:08.152 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-13T06:15:08.152 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-13T06:15:08.152 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-13T06:15:08.152 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T06:15:08.240 INFO:tasks.ceph.osd.0:Stopped 2024-09-13T06:15:08.241 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-13T06:15:08.241 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T06:15:08.330 INFO:tasks.ceph.osd.1:Stopped 2024-09-13T06:15:08.330 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-13T06:15:08.330 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T06:15:08.412 INFO:tasks.ceph.osd.2:Stopped 2024-09-13T06:15:08.413 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-13T06:15:08.413 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T06:15:09.910 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-13T06:15:09.905+0000 7f3783d4d640 -1 calc_pg_upmaps abort due to max <= 0 2024-09-13T06:15:10.294 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-09-13T06:15:14.515 INFO:tasks.ceph.osd.3:Stopped 2024-09-13T06:15:14.515 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-13T06:15:14.515 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-13T06:15:14.515 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T06:15:14.545 INFO:tasks.ceph.mgr.x:Stopped 2024-09-13T06:15:14.546 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-13T06:15:14.546 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-13T06:15:14.546 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T06:15:14.571 INFO:tasks.ceph.mon.a:Stopped 2024-09-13T06:15:14.571 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-13T06:15:14.571 DEBUG:teuthology.orchestra.run.smithi120:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | head -n 1 2024-09-13T06:15:14.629 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi120.front.sepia.ceph.com 2024-09-13T06:15:14.630 DEBUG:teuthology.orchestra.run.smithi120:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-13T06:15:14.869 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi194.front.sepia.ceph.com 2024-09-13T06:15:14.870 DEBUG:teuthology.orchestra.run.smithi194:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-13T06:15:15.220 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi194.front.sepia.ceph.com 2024-09-13T06:15:15.220 DEBUG:teuthology.orchestra.run.smithi194:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-13T06:15:15.294 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-09-13T06:15:15.354 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi194.front.sepia.ceph.com 2024-09-13T06:15:15.355 DEBUG:teuthology.orchestra.run.smithi194:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-13T06:15:15.477 INFO:tasks.ceph:Archiving mon data... 2024-09-13T06:15:15.479 DEBUG:teuthology.misc:Transferring archived files from smithi120:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/tchandra-2024-09-13_05:06:18-rgw-wip-tejas-testing-2024-09-09-1611-squid-distro-default-smithi/7903244/data/mon.a.tgz 2024-09-13T06:15:15.479 DEBUG:teuthology.orchestra.run.smithi120:> mktemp 2024-09-13T06:15:15.484 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/tmp.GUT4dvfUDX 2024-09-13T06:15:15.485 DEBUG:teuthology.orchestra.run.smithi120:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.GUT4dvfUDX 2024-09-13T06:15:15.613 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 0666 /tmp/tmp.GUT4dvfUDX 2024-09-13T06:15:15.674 DEBUG:teuthology.orchestra.remote:smithi120:/tmp/tmp.GUT4dvfUDX is 291KB 2024-09-13T06:15:15.736 DEBUG:teuthology.orchestra.run.smithi120:> rm -fr /tmp/tmp.GUT4dvfUDX 2024-09-13T06:15:15.741 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-13T06:15:15.741 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-13T06:15:15.783 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-13T06:15:15.838 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-13T06:15:15.846 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-13T06:15:15.846 INFO:tasks.ceph:Archiving crash dumps... 2024-09-13T06:15:15.848 DEBUG:teuthology.misc:Transferring archived files from smithi120:/var/lib/ceph/crash to /home/teuthworker/archive/tchandra-2024-09-13_05:06:18-rgw-wip-tejas-testing-2024-09-09-1611-squid-distro-default-smithi/7903244/remote/smithi120/crash 2024-09-13T06:15:15.848 DEBUG:teuthology.orchestra.run.smithi120:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-13T06:15:15.892 DEBUG:teuthology.misc:Transferring archived files from smithi194:/var/lib/ceph/crash to /home/teuthworker/archive/tchandra-2024-09-13_05:06:18-rgw-wip-tejas-testing-2024-09-09-1611-squid-distro-default-smithi/7903244/remote/smithi194/crash 2024-09-13T06:15:15.893 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-13T06:15:15.906 INFO:tasks.ceph:Compressing logs... 2024-09-13T06:15:15.906 DEBUG:teuthology.orchestra.run.smithi120:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-13T06:15:15.939 DEBUG:teuthology.orchestra.run.smithi194:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-13T06:15:15.961 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25082.log 2024-09-13T06:15:15.961 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24576.log 2024-09-13T06:15:15.962 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.25082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23748.log 2024-09-13T06:15:15.963 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.24576.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.25082.log.gz 2024-09-13T06:15:15.963 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-13T06:15:15.963 INFO:teuthology.orchestra.run.smithi120.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.24576.log.gz 2024-09-13T06:15:15.963 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.23748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25506.log 2024-09-13T06:15:15.963 INFO:teuthology.orchestra.run.smithi120.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.23748.log.gz 2024-09-13T06:15:15.964 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25530.log 2024-09-13T06:15:15.965 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.25506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24874.log 2024-09-13T06:15:15.965 INFO:teuthology.orchestra.run.smithi120.stderr: 86.3%/var/log/ceph/ceph-client.admin.25530.log: -- replaced with /var/log/ceph/ceph-client.admin.25506.log.gz 2024-09-13T06:15:15.965 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24869.log 2024-09-13T06:15:15.965 INFO:teuthology.orchestra.run.smithi120.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.25530.log.gz 2024-09-13T06:15:15.965 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25160.log 2024-09-13T06:15:15.965 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.24874.log: /var/log/ceph/ceph-client.admin.24869.log: gzip 86.5% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.24874.log.gz 2024-09-13T06:15:15.965 INFO:teuthology.orchestra.run.smithi120.stderr: -- /var/log/ceph/ceph-client.admin.25394.log 2024-09-13T06:15:15.965 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.25160.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.24869.log.gz 2024-09-13T06:15:15.967 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-13T06:15:15.967 INFO:teuthology.orchestra.run.smithi120.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.25160.log.gz 2024-09-13T06:15:15.967 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25316.log 2024-09-13T06:15:15.967 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.25394.log: /var/log/ceph/ceph-mon.a.log: 85.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.25394.log.gz 2024-09-13T06:15:15.967 INFO:teuthology.orchestra.run.smithi120.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.22890.log 2024-09-13T06:15:15.967 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.25316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25368.log 2024-09-13T06:15:15.967 INFO:teuthology.orchestra.run.smithi120.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.25316.log.gz 2024-09-13T06:15:15.967 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.22890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25264.log 2024-09-13T06:15:15.969 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.25368.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.22890.log.gz 2024-09-13T06:15:15.969 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25108.log 2024-09-13T06:15:15.969 INFO:teuthology.orchestra.run.smithi120.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.25368.log.gz 2024-09-13T06:15:15.969 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24870.log 2024-09-13T06:15:15.969 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.25264.log: /var/log/ceph/ceph-client.admin.25108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24769.log 2024-09-13T06:15:15.969 INFO:teuthology.orchestra.run.smithi120.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.25264.log.gz 2024-09-13T06:15:15.969 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.24870.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.25108.log.gz 2024-09-13T06:15:15.969 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25212.log 2024-09-13T06:15:15.969 INFO:teuthology.orchestra.run.smithi120.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.24870.log.gz 2024-09-13T06:15:15.970 INFO:teuthology.orchestra.run.smithi120.stderr:gzip/var/log/ceph/ceph-client.admin.24769.log: -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.21516.log 2024-09-13T06:15:15.971 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.25212.log: gzip 86.4% -5 -- replaced with /var/log/ceph/ceph-client.admin.24769.log.gz --verbose 2024-09-13T06:15:15.971 INFO:teuthology.orchestra.run.smithi120.stderr: -- /var/log/ceph/ceph-client.admin.25186.log 2024-09-13T06:15:15.971 INFO:teuthology.orchestra.run.smithi120.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.25212.log.gz 2024-09-13T06:15:15.972 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph.tmp-client.admin.21516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25056.log 2024-09-13T06:15:15.972 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.21516.log.gz 2024-09-13T06:15:15.972 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.25186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24770.log 2024-09-13T06:15:15.972 INFO:teuthology.orchestra.run.smithi120.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.25186.log.gz 2024-09-13T06:15:15.972 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.25056.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-13T06:15:15.972 INFO:teuthology.orchestra.run.smithi120.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.25056.log.gz 2024-09-13T06:15:15.972 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.24770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24628.log 2024-09-13T06:15:15.972 INFO:teuthology.orchestra.run.smithi120.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.24770.log.gz 2024-09-13T06:15:15.974 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25018.log 2024-09-13T06:15:15.974 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.24628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24660.log 2024-09-13T06:15:15.975 INFO:teuthology.orchestra.run.smithi120.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.24628.log.gz 2024-09-13T06:15:15.975 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.25018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22850.log 2024-09-13T06:15:15.975 INFO:teuthology.orchestra.run.smithi120.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.25018.log.gz 2024-09-13T06:15:15.975 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.24660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24531.log 2024-09-13T06:15:15.975 INFO:teuthology.orchestra.run.smithi120.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.24660.log.gz 2024-09-13T06:15:15.975 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.22850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25290.log 2024-09-13T06:15:15.975 INFO:teuthology.orchestra.run.smithi120.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.22850.log.gz 2024-09-13T06:15:15.975 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25423.log 2024-09-13T06:15:15.975 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.24531.log: /var/log/ceph/ceph-client.admin.25290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24862.log 2024-09-13T06:15:15.975 INFO:teuthology.orchestra.run.smithi120.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.24531.log.gz 2024-09-13T06:15:15.975 INFO:teuthology.orchestra.run.smithi120.stderr: 86.3% -- replaced with /var/log/ceph/ceph.log.gz 85.9% 2024-09-13T06:15:15.975 INFO:teuthology.orchestra.run.smithi120.stderr: -- replaced with /var/log/ceph/ceph-client.admin.25290.log.gz 2024-09-13T06:15:15.975 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.25423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24602.log 2024-09-13T06:15:15.988 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.24862.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.25423.log.gz 2024-09-13T06:15:15.988 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-13T06:15:15.988 INFO:teuthology.orchestra.run.smithi120.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.24862.log.gz 2024-09-13T06:15:15.988 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.24602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25342.log 2024-09-13T06:15:15.988 INFO:teuthology.orchestra.run.smithi120.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.24602.log.gz 2024-09-13T06:15:15.988 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25476.log 2024-09-13T06:15:15.988 INFO:teuthology.orchestra.run.smithi120.stderr: 88.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-13T06:15:15.988 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24500.log 2024-09-13T06:15:15.988 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.25342.log: /var/log/ceph/ceph-client.admin.25476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24762.log 2024-09-13T06:15:15.988 INFO:teuthology.orchestra.run.smithi120.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.25342.log.gz 2024-09-13T06:15:15.989 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.24500.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.25476.log.gz 2024-09-13T06:15:15.989 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24556.log 2024-09-13T06:15:15.989 INFO:teuthology.orchestra.run.smithi120.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.24500.log.gz 2024-09-13T06:15:15.989 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.24762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25449.log 2024-09-13T06:15:15.989 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24758.log 2024-09-13T06:15:15.989 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.24556.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.24762.log.gz 2024-09-13T06:15:15.989 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.25449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24664.log 2024-09-13T06:15:15.989 INFO:teuthology.orchestra.run.smithi120.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.25449.log.gz 2024-09-13T06:15:15.989 INFO:teuthology.orchestra.run.smithi120.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.24556.log.gz 2024-09-13T06:15:15.989 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.24758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24665.log 2024-09-13T06:15:15.989 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.24664.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.24758.log.gz 2024-09-13T06:15:15.989 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24992.log 2024-09-13T06:15:15.989 INFO:teuthology.orchestra.run.smithi120.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.24664.log.gz 2024-09-13T06:15:15.990 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25238.log 2024-09-13T06:15:15.990 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.24665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24966.log 2024-09-13T06:15:15.990 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.24992.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.24665.log.gz 2024-09-13T06:15:15.990 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.25238.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.24992.log.gz 2024-09-13T06:15:15.990 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24666.log 2024-09-13T06:15:15.990 INFO:teuthology.orchestra.run.smithi120.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.25238.log.gz 2024-09-13T06:15:15.990 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.24966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25134.log 2024-09-13T06:15:15.990 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.24666.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.24966.log.gz 2024-09-13T06:15:15.990 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22780.log 2024-09-13T06:15:15.990 INFO:teuthology.orchestra.run.smithi120.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.24666.log.gz 2024-09-13T06:15:15.990 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.25134.log: /var/log/ceph/ceph-client.admin.22780.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.25134.log.gz 2024-09-13T06:15:15.990 INFO:teuthology.orchestra.run.smithi120.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.22780.log.gz 2024-09-13T06:15:16.002 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87174.log 2024-09-13T06:15:16.002 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46494.log 2024-09-13T06:15:16.002 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-13T06:15:16.002 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.87174.log: /var/log/ceph/ceph-client.0.46494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56524.log 2024-09-13T06:15:16.002 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25155.log 2024-09-13T06:15:16.003 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.56524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67144.log 2024-09-13T06:15:16.003 INFO:teuthology.orchestra.run.smithi194.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.46494.log.gz 2024-09-13T06:15:16.003 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.25155.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.87174.log.gz 2024-09-13T06:15:16.003 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64194.log 2024-09-13T06:15:16.003 INFO:teuthology.orchestra.run.smithi194.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.25155.log.gz 2024-09-13T06:15:16.003 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60064.log 2024-09-13T06:15:16.003 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.67144.log: /var/log/ceph/ceph-client.0.64194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37054.log 2024-09-13T06:15:16.003 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.60064.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.56524.log.gz 2024-09-13T06:15:16.003 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71864.log 2024-09-13T06:15:16.003 INFO:teuthology.orchestra.run.smithi194.stderr:gzip/var/log/ceph/ceph-client.0.37054.log: -5 --verbose -- /var/log/ceph/ceph-client.0.42364.log 2024-09-13T06:15:16.003 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.71864.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.64194.log.gz 2024-09-13T06:15:16.003 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.88359.log 2024-09-13T06:15:16.003 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73634.log 2024-09-13T06:15:16.004 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.42364.log: 91.9% -- replaced with /var/log/ceph/ceph-client.0.67144.log.gz 2024-09-13T06:15:16.004 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.88359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63014.log 2024-09-13T06:15:16.004 INFO:teuthology.orchestra.run.smithi194.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.60064.log.gz/var/log/ceph/ceph-client.0.73634.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.37054.log.gz 2024-09-13T06:15:16.004 INFO:teuthology.orchestra.run.smithi194.stderr: 2024-09-13T06:15:16.004 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45314.log 2024-09-13T06:15:16.004 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42954.log 2024-09-13T06:15:16.004 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.63014.log: 91.7% 91.4% -- replaced with /var/log/ceph/ceph-client.0.71864.log.gz 2024-09-13T06:15:16.004 INFO:teuthology.orchestra.run.smithi194.stderr: -- replaced with /var/log/ceph/ceph-client.0.42364.log.gz 2024-09-13T06:15:16.004 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.45314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51214.log 2024-09-13T06:15:16.004 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.42954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37644.log 2024-09-13T06:15:16.004 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.51214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25131.log 2024-09-13T06:15:16.004 INFO:teuthology.orchestra.run.smithi194.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.73634.log.gz 2024-09-13T06:15:16.005 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.37644.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.45314.log.gz 2024-09-13T06:15:16.005 INFO:teuthology.orchestra.run.smithi194.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.63014.log.gz 2024-09-13T06:15:16.005 INFO:teuthology.orchestra.run.smithi194.stderr:gzip 91.5% -5 -- replaced with /var/log/ceph/ceph-client.0.42954.log.gz --verbose 2024-09-13T06:15:16.005 INFO:teuthology.orchestra.run.smithi194.stderr: -- /var/log/ceph/ceph-client.0.49444.log 2024-09-13T06:15:16.005 INFO:teuthology.orchestra.run.smithi194.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.0.88359.log.gz 2024-09-13T06:15:16.005 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.25131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52984.log 2024-09-13T06:15:16.005 INFO:teuthology.orchestra.run.smithi194.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.51214.log.gz 2024-09-13T06:15:16.005 INFO:teuthology.orchestra.run.smithi194.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.25131.log.gz 2024-09-13T06:15:16.005 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.49444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25107.log 2024-09-13T06:15:16.005 INFO:teuthology.orchestra.run.smithi194.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.37644.log.gz 2024-09-13T06:15:16.005 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.52984.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-13T06:15:16.006 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.25107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77174.log 2024-09-13T06:15:16.006 INFO:teuthology.orchestra.run.smithi194.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.25107.log.gz 2024-09-13T06:15:16.006 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44134.log 2024-09-13T06:15:16.006 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-osd.2.log: 91.8% -- replaced with /var/log/ceph/ceph-client.0.49444.log.gz 2024-09-13T06:15:16.006 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.77174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62424.log 2024-09-13T06:15:16.006 INFO:teuthology.orchestra.run.smithi194.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.0.77174.log.gz 2024-09-13T06:15:16.006 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.44134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29311.log 2024-09-13T06:15:16.006 INFO:teuthology.orchestra.run.smithi194.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.52984.log.gz 2024-09-13T06:15:16.006 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41774.log 2024-09-13T06:15:16.006 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.62424.log: /var/log/ceph/ceph-client.admin.29311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47084.log 2024-09-13T06:15:16.006 INFO:teuthology.orchestra.run.smithi194.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.29311.log.gz 2024-09-13T06:15:16.006 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.41774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35874.log 2024-09-13T06:15:16.006 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.47084.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.44134.log.gz 2024-09-13T06:15:16.006 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69504.log 2024-09-13T06:15:16.007 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.35874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38234.log 2024-09-13T06:15:16.007 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.69504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.29980.log 2024-09-13T06:15:16.007 INFO:teuthology.orchestra.run.smithi194.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.41774.log.gz 2024-09-13T06:15:16.007 INFO:teuthology.orchestra.run.smithi194.stderr: 91.6%/var/log/ceph/ceph-client.0.38234.log: 92.8% -- replaced with /var/log/ceph/ceph-client.0.62424.log.gz 2024-09-13T06:15:16.007 INFO:teuthology.orchestra.run.smithi194.stderr: -- replaced with /var/log/ceph/ceph-client.0.47084.log.gz 2024-09-13T06:15:16.007 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51804.log 2024-09-13T06:15:16.007 INFO:teuthology.orchestra.run.smithi194.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.35874.log.gz 2024-09-13T06:15:16.007 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.32340.log 2024-09-13T06:15:16.007 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.29980.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.69504.log.gz 2024-09-13T06:15:16.007 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.51804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.30570.log 2024-09-13T06:15:16.007 INFO:teuthology.orchestra.run.smithi194.stderr: 91.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29287.log 2024-09-13T06:15:16.007 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.32340.log: -- replaced with /var/log/ceph/ceph-client.0.38234.log.gz 2024-09-13T06:15:16.007 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.30570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52394.log 2024-09-13T06:15:16.007 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.29287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78342.log 2024-09-13T06:15:16.008 INFO:teuthology.orchestra.run.smithi194.stderr: 91.5% 92.3% -- replaced with /var/log/ceph/ceph-client.0.29980.log.gz 2024-09-13T06:15:16.008 INFO:teuthology.orchestra.run.smithi194.stderr: -- replaced with /var/log/ceph/ceph-client.0.51804.log.gz 2024-09-13T06:15:16.008 INFO:teuthology.orchestra.run.smithi194.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.29287.log.gz 2024-09-13T06:15:16.008 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.52394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25179.log 2024-09-13T06:15:16.008 INFO:teuthology.orchestra.run.smithi194.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.32340.log.gz 2024-09-13T06:15:16.008 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.78342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29239.log 2024-09-13T06:15:16.008 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-13T06:15:16.008 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.25179.log: 91.7% 90.7% -- replaced with /var/log/ceph/ceph-client.0.78342.log.gz 2024-09-13T06:15:16.008 INFO:teuthology.orchestra.run.smithi194.stderr: -- replaced with /var/log/ceph/ceph-client.0.30570.log.gz/var/log/ceph/ceph-client.admin.29239.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.25179.log.gz 2024-09-13T06:15:16.008 INFO:teuthology.orchestra.run.smithi194.stderr: 2024-09-13T06:15:16.008 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43544.log 2024-09-13T06:15:16.008 INFO:teuthology.orchestra.run.smithi194.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.29239.log.gz 2024-09-13T06:15:16.008 INFO:teuthology.orchestra.run.smithi194.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.52394.log.gz 2024-09-13T06:15:16.009 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58884.log 2024-09-13T06:15:16.009 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.43544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86584.log 2024-09-13T06:15:16.009 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.58884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68914.log 2024-09-13T06:15:16.009 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.86584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55934.log 2024-09-13T06:15:16.009 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.68914.log: 91.7% -- replaced with /var/log/ceph/ceph-client.0.43544.log.gz 2024-09-13T06:15:16.009 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36464.log 2024-09-13T06:15:16.009 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39414.log 2024-09-13T06:15:16.009 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.55934.log: 91.7%/var/log/ceph/ceph-client.0.36464.log: -- replaced with /var/log/ceph/ceph-client.0.58884.log.gz 2024-09-13T06:15:16.009 INFO:teuthology.orchestra.run.smithi194.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.86584.log.gz 2024-09-13T06:15:16.009 INFO:teuthology.orchestra.run.smithi194.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.68914.log.gz 2024-09-13T06:15:16.009 INFO:teuthology.orchestra.run.smithi194.stderr: 91.3% 91.3% -- replaced with /var/log/ceph/ceph-client.0.36464.log.gz -- replaced with /var/log/ceph/ceph-client.0.55934.log.gz 2024-09-13T06:15:16.009 INFO:teuthology.orchestra.run.smithi194.stderr: 2024-09-13T06:15:16.009 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70094.log 2024-09-13T06:15:16.009 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.39414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83044.log 2024-09-13T06:15:16.010 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.70094.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-13T06:15:16.010 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.83044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57704.log 2024-09-13T06:15:16.010 INFO:teuthology.orchestra.run.smithi194.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.39414.log.gz 2024-09-13T06:15:16.010 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87764.log 2024-09-13T06:15:16.010 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.57704.log: 91.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80094.log 2024-09-13T06:15:16.010 INFO:teuthology.orchestra.run.smithi194.stderr: -- replaced with /var/log/ceph/ceph-client.0.70094.log.gz 2024-09-13T06:15:16.010 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.87764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84224.log 2024-09-13T06:15:16.010 INFO:teuthology.orchestra.run.smithi194.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.83044.log.gz/var/log/ceph/ceph-client.0.80094.log: 2024-09-13T06:15:16.010 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48854.log 2024-09-13T06:15:16.010 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.84224.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.57704.log.gz 2024-09-13T06:15:16.010 INFO:teuthology.orchestra.run.smithi194.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.87764.log.gz 2024-09-13T06:15:16.010 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76584.log 2024-09-13T06:15:16.010 INFO:teuthology.orchestra.run.smithi194.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.80094.log.gz 2024-09-13T06:15:16.015 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.48854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.31750.log 2024-09-13T06:15:16.015 INFO:teuthology.orchestra.run.smithi194.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.84224.log.gz 2024-09-13T06:15:16.015 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.76584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40594.log 2024-09-13T06:15:16.015 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-13T06:15:16.015 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.31750.log: /var/log/ceph/ceph-client.0.40594.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.48854.log.gz 2024-09-13T06:15:16.015 INFO:teuthology.orchestra.run.smithi194.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.76584.log.gz 2024-09-13T06:15:16.015 INFO:teuthology.orchestra.run.smithi194.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.40594.log.gz 2024-09-13T06:15:16.015 INFO:teuthology.orchestra.run.smithi194.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.31750.log.gz 2024-09-13T06:15:16.016 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41184.log 2024-09-13T06:15:16.016 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81274.log 2024-09-13T06:15:16.016 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.41184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81864.log 2024-09-13T06:15:16.016 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.81274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54164.log 2024-09-13T06:15:16.016 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.81864.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.41184.log.gz 2024-09-13T06:15:16.016 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64784.log 2024-09-13T06:15:16.016 INFO:teuthology.orchestra.run.smithi194.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.81274.log.gz 2024-09-13T06:15:16.016 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.54164.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.81864.log.gz 2024-09-13T06:15:16.016 INFO:teuthology.orchestra.run.smithi194.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.54164.log.gz 2024-09-13T06:15:16.016 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70684.log 2024-09-13T06:15:16.016 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.64784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50034.log 2024-09-13T06:15:16.016 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.70684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72454.log 2024-09-13T06:15:16.016 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.50034.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.70684.log.gz 2024-09-13T06:15:16.017 INFO:teuthology.orchestra.run.smithi194.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.64784.log.gz 2024-09-13T06:15:16.017 INFO:teuthology.orchestra.run.smithi194.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.50034.log.gz 2024-09-13T06:15:16.017 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80684.log 2024-09-13T06:15:16.017 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.72454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65374.log 2024-09-13T06:15:16.017 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.80684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74814.log 2024-09-13T06:15:16.018 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.65374.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.72454.log.gz 2024-09-13T06:15:16.018 INFO:teuthology.orchestra.run.smithi194.stderr:gzip 91.3% -- replaced with /var/log/ceph/ceph-client.0.80684.log.gz -5 2024-09-13T06:15:16.018 INFO:teuthology.orchestra.run.smithi194.stderr: --verbose -- /var/log/ceph/ceph-client.0.75404.log 2024-09-13T06:15:16.018 INFO:teuthology.orchestra.run.smithi194.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.65374.log.gz 2024-09-13T06:15:16.018 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.74814.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.74814.log.gz 2024-09-13T06:15:16.019 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78926.log 2024-09-13T06:15:16.019 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.75404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67734.log 2024-09-13T06:15:16.020 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.78926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61244.log 2024-09-13T06:15:16.021 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.67734.log: 90.6% -- replaced with /var/log/ceph/ceph-client.0.78926.log.gz 2024-09-13T06:15:16.021 INFO:teuthology.orchestra.run.smithi194.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.75404.log.gz 2024-09-13T06:15:16.022 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65964.log 2024-09-13T06:15:16.022 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.61244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77758.log 2024-09-13T06:15:16.022 INFO:teuthology.orchestra.run.smithi194.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.0.67734.log.gz 2024-09-13T06:15:16.023 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.65964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79510.log 2024-09-13T06:15:16.024 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.77758.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.65964.log.gz 2024-09-13T06:15:16.024 INFO:teuthology.orchestra.run.smithi194.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.0.77758.log.gz 2024-09-13T06:15:16.024 INFO:teuthology.orchestra.run.smithi194.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.0.61244.log.gz 2024-09-13T06:15:16.025 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74224.log 2024-09-13T06:15:16.025 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.79510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71274.log 2024-09-13T06:15:16.026 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.74224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34694.log 2024-09-13T06:15:16.026 INFO:teuthology.orchestra.run.smithi194.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.0.79510.log.gz 2024-09-13T06:15:16.026 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.71274.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-13T06:15:16.029 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.34694.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.71274.log.gz 2024-09-13T06:15:16.029 INFO:teuthology.orchestra.run.smithi194.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.34694.log.gz 92.2% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-13T06:15:16.029 INFO:teuthology.orchestra.run.smithi194.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.74224.log.gz 2024-09-13T06:15:16.029 INFO:teuthology.orchestra.run.smithi194.stderr: 2024-09-13T06:15:16.029 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83634.log 2024-09-13T06:15:16.029 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60654.log 2024-09-13T06:15:16.029 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ops-log-ceph-client.0.log: /var/log/ceph/ceph-client.0.83634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29263.log 2024-09-13T06:15:16.030 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.60654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58294.log 2024-09-13T06:15:16.030 INFO:teuthology.orchestra.run.smithi194.stderr: 91.8% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-13T06:15:16.030 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.29263.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.29263.log.gz 2024-09-13T06:15:16.030 INFO:teuthology.orchestra.run.smithi194.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.83634.log.gz 2024-09-13T06:15:16.030 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47674.log 2024-09-13T06:15:16.031 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.58294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50624.log 2024-09-13T06:15:16.032 INFO:teuthology.orchestra.run.smithi194.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.60654.log.gz 2024-09-13T06:15:16.032 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.47674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85994.log 2024-09-13T06:15:16.032 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.50624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44724.log 2024-09-13T06:15:16.033 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.85994.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.58294.log.gz 2024-09-13T06:15:16.033 INFO:teuthology.orchestra.run.smithi194.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.0.47674.log.gz 2024-09-13T06:15:16.033 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34104.log 2024-09-13T06:15:16.034 INFO:teuthology.orchestra.run.smithi194.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.50624.log.gz/var/log/ceph/ceph-client.0.44724.log: 2024-09-13T06:15:16.034 INFO:teuthology.orchestra.run.smithi194.stderr:gzip 91.2% -5 --verbose -- replaced with /var/log/ceph/ceph-client.0.85994.log.gz -- 2024-09-13T06:15:16.034 INFO:teuthology.orchestra.run.smithi194.stderr: /var/log/ceph/ceph-client.0.84814.log 2024-09-13T06:15:16.035 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66554.log 2024-09-13T06:15:16.035 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.34104.log: /var/log/ceph/ceph-client.0.84814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75994.log 2024-09-13T06:15:16.035 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.66554.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.44724.log.gz 2024-09-13T06:15:16.036 INFO:teuthology.orchestra.run.smithi194.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.34104.log.gz 2024-09-13T06:15:16.036 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.31160.log 2024-09-13T06:15:16.036 INFO:teuthology.orchestra.run.smithi194.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.84814.log.gz 2024-09-13T06:15:16.036 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.75994.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.66554.log.gz 2024-09-13T06:15:16.037 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.32930.log 2024-09-13T06:15:16.038 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.31160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57114.log 2024-09-13T06:15:16.038 INFO:teuthology.orchestra.run.smithi194.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.0.75994.log.gz 2024-09-13T06:15:16.038 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.32930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85404.log 2024-09-13T06:15:16.039 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.57114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48264.log 2024-09-13T06:15:16.039 INFO:teuthology.orchestra.run.smithi194.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.0.32930.log.gz 2024-09-13T06:15:16.039 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.85404.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.31160.log.gz 2024-09-13T06:15:16.040 INFO:teuthology.orchestra.run.smithi194.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.57114.log.gz 2024-09-13T06:15:16.040 INFO:teuthology.orchestra.run.smithi194.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.85404.log.gz 2024-09-13T06:15:16.040 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63604.log 2024-09-13T06:15:16.041 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.48264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55344.log 2024-09-13T06:15:16.041 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.63604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45904.log 2024-09-13T06:15:16.042 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.55344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38824.log 2024-09-13T06:15:16.042 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.45904.log: 91.9% -- replaced with /var/log/ceph/ceph-client.0.48264.log.gz 2024-09-13T06:15:16.043 INFO:teuthology.orchestra.run.smithi194.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.63604.log.gz 2024-09-13T06:15:16.043 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29215.log 2024-09-13T06:15:16.044 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.38824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53574.log 2024-09-13T06:15:16.044 INFO:teuthology.orchestra.run.smithi194.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.55344.log.gz 2024-09-13T06:15:16.044 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.29215.log: 91.7% -- replaced with /var/log/ceph/ceph-client.0.45904.log.gz 2024-09-13T06:15:16.044 INFO:teuthology.orchestra.run.smithi194.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.29215.log.gz 2024-09-13T06:15:16.044 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33514.log 2024-09-13T06:15:16.044 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.53574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59474.log 2024-09-13T06:15:16.045 INFO:teuthology.orchestra.run.smithi194.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.38824.log.gz/var/log/ceph/ceph-client.0.33514.log: 2024-09-13T06:15:16.045 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35284.log 2024-09-13T06:15:16.046 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40004.log 2024-09-13T06:15:16.047 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.59474.log: /var/log/ceph/ceph-client.0.35284.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.53574.log.gz 2024-09-13T06:15:16.047 INFO:teuthology.orchestra.run.smithi194.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.0.33514.log.gz 2024-09-13T06:15:16.047 INFO:teuthology.orchestra.run.smithi194.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.35284.log.gz 2024-09-13T06:15:16.047 INFO:teuthology.orchestra.run.smithi194.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.0.59474.log.gz 2024-09-13T06:15:16.047 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.82454.log 2024-09-13T06:15:16.048 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.40004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73044.log 2024-09-13T06:15:16.048 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.82454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61834.log 2024-09-13T06:15:16.048 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.73044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54754.log 2024-09-13T06:15:16.049 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.61834.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.40004.log.gz 2024-09-13T06:15:16.049 INFO:teuthology.orchestra.run.smithi194.stderr: 91.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68324.log 2024-09-13T06:15:16.049 INFO:teuthology.orchestra.run.smithi194.stderr: -- replaced with /var/log/ceph/ceph-client.0.82454.log.gz 2024-09-13T06:15:16.050 INFO:teuthology.orchestra.run.smithi194.stderr: 91.4%/var/log/ceph/ceph-client.0.54754.log: -- replaced with /var/log/ceph/ceph-client.0.73044.log.gz 2024-09-13T06:15:16.052 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.68324.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.68324.log.gz 2024-09-13T06:15:16.052 INFO:teuthology.orchestra.run.smithi194.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.54754.log.gz 2024-09-13T06:15:16.052 INFO:teuthology.orchestra.run.smithi194.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.0.61834.log.gz 2024-09-13T06:15:16.066 INFO:teuthology.orchestra.run.smithi194.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-13T06:15:16.161 INFO:teuthology.orchestra.run.smithi120.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-13T06:15:16.947 INFO:teuthology.orchestra.run.smithi194.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-13T06:15:17.001 INFO:teuthology.orchestra.run.smithi120.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-13T06:15:17.003 INFO:teuthology.orchestra.run.smithi120.stderr: 2024-09-13T06:15:17.003 INFO:teuthology.orchestra.run.smithi120.stderr:real 0m1.062s 2024-09-13T06:15:17.003 INFO:teuthology.orchestra.run.smithi120.stderr:user 0m1.259s 2024-09-13T06:15:17.003 INFO:teuthology.orchestra.run.smithi120.stderr:sys 0m0.058s 2024-09-13T06:15:17.085 INFO:teuthology.orchestra.run.smithi194.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-13T06:15:17.112 INFO:teuthology.orchestra.run.smithi194.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-13T06:15:17.113 INFO:teuthology.orchestra.run.smithi194.stderr: 2024-09-13T06:15:17.113 INFO:teuthology.orchestra.run.smithi194.stderr:real 0m1.160s 2024-09-13T06:15:17.113 INFO:teuthology.orchestra.run.smithi194.stderr:user 0m3.376s 2024-09-13T06:15:17.113 INFO:teuthology.orchestra.run.smithi194.stderr:sys 0m0.193s 2024-09-13T06:15:17.113 INFO:tasks.ceph:Archiving logs... 2024-09-13T06:15:17.114 DEBUG:teuthology.misc:Transferring archived files from smithi120:/var/log/ceph to /home/teuthworker/archive/tchandra-2024-09-13_05:06:18-rgw-wip-tejas-testing-2024-09-09-1611-squid-distro-default-smithi/7903244/remote/smithi120/log 2024-09-13T06:15:17.115 DEBUG:teuthology.orchestra.run.smithi120:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T06:15:17.313 DEBUG:teuthology.misc:Transferring archived files from smithi194:/var/log/ceph to /home/teuthworker/archive/tchandra-2024-09-13_05:06:18-rgw-wip-tejas-testing-2024-09-09-1611-squid-distro-default-smithi/7903244/remote/smithi194/log 2024-09-13T06:15:17.314 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T06:15:17.807 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-13T06:15:17.817 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-13T06:15:17.818 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T06:15:17.820 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T06:15:17.894 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-13T06:15:17.904 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-13T06:15:17.904 DEBUG:teuthology.orchestra.run.smithi120:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T06:15:17.907 DEBUG:teuthology.orchestra.run.smithi194:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T06:15:17.918 INFO:teuthology.orchestra.run.smithi120.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T06:15:17.918 INFO:teuthology.orchestra.run.smithi120.stdout:============================================================================== 2024-09-13T06:15:17.918 INFO:teuthology.orchestra.run.smithi120.stdout:*hv01.front.sepi 67.205.162.81 3 u 41 64 377 0.069 -2.032 1.449 2024-09-13T06:15:17.918 INFO:teuthology.orchestra.run.smithi120.stdout:+hv02.front.sepi 63.231.80.2 3 u 34 64 377 0.100 +0.032 1.410 2024-09-13T06:15:17.918 INFO:teuthology.orchestra.run.smithi120.stdout:+hv03.front.sepi 74.6.168.72 3 u 38 64 377 0.088 -1.886 1.361 2024-09-13T06:15:17.918 INFO:teuthology.orchestra.run.smithi120.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T06:15:17.921 INFO:teuthology.orchestra.run.smithi194.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T06:15:17.921 INFO:teuthology.orchestra.run.smithi194.stdout:============================================================================== 2024-09-13T06:15:17.921 INFO:teuthology.orchestra.run.smithi194.stdout:*hv01.front.sepi 67.205.162.81 3 u 41 64 377 0.097 -1.690 0.620 2024-09-13T06:15:17.921 INFO:teuthology.orchestra.run.smithi194.stdout:+hv02.front.sepi 63.231.80.2 3 u 38 64 377 0.098 +1.051 0.828 2024-09-13T06:15:17.921 INFO:teuthology.orchestra.run.smithi194.stdout:+hv03.front.sepi 74.6.168.72 3 u 36 64 377 0.084 -2.585 1.351 2024-09-13T06:15:17.921 INFO:teuthology.orchestra.run.smithi194.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T06:15:17.922 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-13T06:15:17.933 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-13T06:15:17.934 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-13T06:15:17.943 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-13T06:15:17.951 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-13T06:15:17.961 INFO:teuthology.task.internal:Duration was 959.418869 seconds 2024-09-13T06:15:17.961 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-13T06:15:17.971 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-13T06:15:17.971 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T06:15:17.974 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T06:15:18.011 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-13T06:15:18.011 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi120.front.sepia.ceph.com 2024-09-13T06:15:18.011 DEBUG:teuthology.orchestra.run.smithi120:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T06:15:18.060 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi194.front.sepia.ceph.com 2024-09-13T06:15:18.060 DEBUG:teuthology.orchestra.run.smithi194:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T06:15:18.069 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-13T06:15:18.070 DEBUG:teuthology.orchestra.run.smithi120:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T06:15:18.107 DEBUG:teuthology.orchestra.run.smithi194:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T06:15:18.142 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-13T06:15:18.142 DEBUG:teuthology.orchestra.run.smithi120:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T06:15:18.175 DEBUG:teuthology.orchestra.run.smithi194:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T06:15:18.240 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-13T06:15:18.251 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-13T06:15:18.251 DEBUG:teuthology.orchestra.run.smithi120:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T06:15:18.263 DEBUG:teuthology.orchestra.run.smithi194:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T06:15:18.273 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-13T06:15:18.284 DEBUG:teuthology.orchestra.run.smithi120:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T06:15:18.307 DEBUG:teuthology.orchestra.run.smithi194:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T06:15:18.316 INFO:teuthology.orchestra.run.smithi120.stdout:kernel.core_pattern = core 2024-09-13T06:15:18.326 INFO:teuthology.orchestra.run.smithi194.stdout:kernel.core_pattern = core 2024-09-13T06:15:18.519 DEBUG:teuthology.orchestra.run.smithi120:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T06:15:18.566 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T06:15:18.567 DEBUG:teuthology.orchestra.run.smithi194:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T06:15:18.572 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T06:15:18.572 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-13T06:15:18.582 INFO:teuthology.task.internal:Transferring archived files... 2024-09-13T06:15:18.582 DEBUG:teuthology.misc:Transferring archived files from smithi120:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/tchandra-2024-09-13_05:06:18-rgw-wip-tejas-testing-2024-09-09-1611-squid-distro-default-smithi/7903244/remote/smithi120 2024-09-13T06:15:18.583 DEBUG:teuthology.orchestra.run.smithi120:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T06:15:18.631 DEBUG:teuthology.misc:Transferring archived files from smithi194:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/tchandra-2024-09-13_05:06:18-rgw-wip-tejas-testing-2024-09-09-1611-squid-distro-default-smithi/7903244/remote/smithi194 2024-09-13T06:15:18.631 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T06:15:18.655 INFO:teuthology.task.internal:Removing archive directory... 2024-09-13T06:15:18.655 DEBUG:teuthology.orchestra.run.smithi120:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T06:15:18.671 DEBUG:teuthology.orchestra.run.smithi194:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T06:15:18.698 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-13T06:15:18.710 INFO:teuthology.task.internal:Not uploading archives. 2024-09-13T06:15:18.710 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-13T06:15:18.720 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-13T06:15:18.720 DEBUG:teuthology.orchestra.run.smithi120:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T06:15:18.723 DEBUG:teuthology.orchestra.run.smithi194:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T06:15:18.727 INFO:teuthology.orchestra.run.smithi120.stdout: 658617 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 06:15 /home/ubuntu/cephtest 2024-09-13T06:15:18.746 INFO:teuthology.orchestra.run.smithi194.stdout: 658465 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 06:15 /home/ubuntu/cephtest 2024-09-13T06:15:18.748 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-13T06:15:18.758 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-13T06:15:18.784 INFO:teuthology.run:Summary data: description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{ubuntu_latest}} duration: 959.4188694953918 flavor: default owner: scheduled_tchandra@teuthology success: true 2024-09-13T06:15:18.784 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T06:15:18.893 INFO:teuthology.run:pass